Cognition seminars

In this talk I’ll discuss translation of findings of multisensory facilitation of learning to cognitive training. I’ll first review some early findings of multisensory facilitation of learning and then discuss how we have been translating these basic science approaches into gamified training interventions to improve cognitive functions. I’ll touch on approaches to training vision, hearing and working memory that we are developing at the UCR Brain Game Center for Mental Fitness and Well-being. I look forward to discussing both the basic science but also the complexities of how to translate approaches from basic science into the more complex frameworks often used in interventions.

The idea that behavior results from a dynamic interplay between automatic and controlled processing underlies much of decision science, but has also generated considerable controversy. In this talk, I will highlight behavioral and neural data showing how recently-developed computational models of decision making can be used to shed new light on whether, when, and how decisions result from distinct processes operating at different timescales. Across diverse domains ranging from altruism to risky choice biases and self-regulation, our work suggests that a model of prioritized attentional sampling and evidence accumulation may provide an alternative explanation for many phenomena previously interpreted as supporting dual process models of choice. However, I also show how some features of the model might be taken as support for specific aspects of dual-process models, providing a way to reconcile conflicting accounts and generating new predictions and insights along the way.

Mental simulation—the capacity to imagine what will or what could be—is a salient feature of human cognition, playing a key role in a wide range of cognitive abilities. In artificial intelligence, the last few years have seen the development of methods which are analogous to mental models and mental simulation. In this talk, I will discuss recent methods in deep learning for constructing such models from data and learning to use them via reinforcement learning, and compare such approaches to human mental simulation. While a number of challenges remain in matching the capacity of human mental simulation, I will highlight some recent progress on developing more compositional and efficient model-based algorithms through the use of graph neural networks and tree search.

Animals constantly modify their behavior through experience. Flexible behavior is key to our ability to adapt to the ever-changing environment. My laboratory is interested in studying the activity of neuronal ensembles in behaving animals, and how it changes with learning. We have recently set up a paradigm where mice learn to associate sensory information (two different odors) to motor outputs (lick vs no-lick) under head-fixation. We combined this with two-photon calcium imaging, which can monitor the activity of a microcircuit of many tens of neurons simultaneously from a small area of the brain. Imaging the motor cortex during the learning of this task revealed neurons with diverse task-related response types. Intriguingly, different response types were spatially intermingled; even immediately adjacent neurons often had very different response types. As the mouse learned the task under the microscope, the activity coupling of neurons with similar response types specifically increased, even though they are intermingled with neurons with dissimilar response types. This suggests that intermingled subnetworks of functionally-related neurons form in a learning-related way, an observation that became possible with our cutting-edge technique combining imaging and behavior. We are working to extend this study. How plastic are neuronal microcircuits during other forms of learning? How plastic are they in other parts of the brain? What are the cellular and molecular mechanisms of the microcircuit plasticity? Are the observed activity and plasticity required for learning? How does the activity of identified individual neurons change over days to weeks? We are asking these questions, combining a variety of techniques including in vivo two-photon imaging, optogenetics, electrophysiology, genetics and behavior.

How is it that some memories fade in a day while others last forever? The formation of long-lasting (remote) memories depends on the coordinated activity between the hippocampus and frontal cortices, but the timeline of these interactions is debated. Astrocytes, star-shaped glial cells, sense and modify neuronal activity, but their role in remote memory is scarcely explored. We manipulated the activity of hippocampal astrocytes during memory acquisition and discovered it impaired remote, but not recent, memory retrieval. We also revealed a massive recruitment of cortical-projecting hippocampal neurons during memory acquisition, a process that is specifically inhibited by astrocytic manipulation. Finally, we directly inhibited this projection during memory acquisition to prove its necessity for the formation of remote memory. Our findings reveal that the foundation of remote memory can be established during acquisition with projection-specific effect of astrocytes.

Empathy plays a critical role in social interactions, and many species, including rodents, display evolutionarily conserved behavioral antecedents of empathy. In both humans and rodents, the anterior cingulate cortex (ACC) encodes information about the affective state of others. However, little is known about which downstream targets of the ACC contribute to empathy behaviors. We optimized a protocol for the social transfer of pain behavior in mice and compared the ACC-dependent neural circuitry responsible for this behavior with the neural circuitry required for the social transfer of two related states: analgesia and fear. We found that a 1-hour social interaction between a bystander mouse and a cagemate experiencing inflammatory pain led to congruent mechanical hyperalgesia in the bystander. This social transfer led to activation of neurons in the ACC and several downstream targets, including the nucleus accumbens (NAc), which was revealed by monosynaptic rabies virus tracing to be directly connected to the ACC. Bidirectional manipulation of activity in ACC-to-NAc inputs influenced the acquisition of socially transferred pain. Further, the social transfer of analgesia also depended upon ACC-NAc inputs. By contrast, the social transfer of fear instead required activity in ACC projections to the basolateral amygdala. This shows that mice rapidly adopt the sensory-affective state of a social partner, regardless of the valance of the information (pain, fear, or pain relief). We find that the ACC generates specific and appropriate empathic behavioral responses through distinct downstream targets. More sophisticated understanding of evolutionarily conserved brain mechanisms of empathy will also expedite the development of new therapies for the empathy-related deficits associated with a broad range of neuropsychiatric disorders.

Across species, humans are uniquely able to acquire deep relational systems of the kind needed for mathematics, science, and human language. Analogical comparison processes are a major contributor to this ability. Analogical comparison engages a structure-mapping process (Gentner, 1983) that fosters learning in at least three ways: first, it highlights common relational systems and thereby promotes abstraction; second, it promotes inferences from known situations to less familiar situations; and, third, it reveals potentially important differences between examples. In short, structure-mapping is a domain-general learning process by which abstract, portable knowledge can arise from experience. It is operative from early infancy on, and is critical to the rapid learning we see in human children. Although structure-mapping processes are present pre-linguistically, their scope is greatly amplified by language. Analogical processes are instrumental in learning relational language, and the reverse is also true: relational language acts to preserve relational abstractions and render them accessible for future learning and reasoning. Although structure-mapping processes are present pre-linguistically, their scope is greatly amplified by language. Analogical processes are instrumental in learning relational language, and the reverse is also true: relational language acts to preserve relational abstractions and render them accessible for future learning and reasoning.

Sensory experience and perceptual learning changes receptive field properties of cortical pyramidal neurons possibly mediated by long-term potentiation (LTP) of synapses. We have previously shown in the mouse somatosensory cortex (S1) that sensory-driven LTP in layer (L) 2/3 pyramidal neurons is dependent on higher order thalamic feedback from the posteromedial nucleus (POm), which is thought to convey contextual information from various cortical regions integrated with sensory input. We have followed up on this work by dissecting the cortical microcircuitry that underlies this form of LTP. We found that repeated pairing of Pom thalamocortical and intracortical pathway activity in brain slices induces NMDAr-dependent LTP of the L2/3 synapses that are driven by the intracortical pathway. Repeated pairing also recruits activity of vasoactive intestinal peptide (VIP) interneurons, whereas it reduces the activity of somatostatin (SST) interneurons. VIP interneuron-mediated inhibition of SST interneurons has been established as a motif for the disinhibition of pyramidal neurons. By chemogenetic interrogation we found that activation of this disinhibitory microcircuit motif by higher-order thalamic feedback is indispensable for eliciting LTP. Preliminary results in vivo suggest that VIP neuron activity also increases during sensory-evoked LTP. Together, this suggests that the higherorder thalamocortical feedback may help modifying the strength of synaptic circuits that process first-order sensory information in S1. To start characterizing the relationship between higher-order feedback and cortical plasticity during learning in vivo, we adapted a perceptual learning paradigm in which head-fixed mice have to discriminate two types of textures in order to obtain a reward. POm axons or L2/3 pyramidal neurons labeled with the genetically encoded calcium indicator GCaMP6s were imaged during the acquisition of this task as well as the subsequent learning of a new discrimination rule. We found that a subpopulation of the POm axons and L2/3 neurons dynamically represent textures. Moreover, upon a change in reward contingencies, a fraction of the L2/3 neurons re-tune their selectivity to the texture that is newly associated with the reward. Altogether, our data indicates that higher-order thalamic feedback can facilitate synaptic plasticity and may be implicated in dynamic sensory stimulus representations in S1, which depends on higher-order features that are associated with the stimuli.

Constraints on control-dependent processing have become a fundamental concept in general theories of cognition that explain human behavior in terms of rational adaptations to these constraints. However, theories miss a rationale for why such constraints would exist in the first place. Recent work suggests that constraints on the allocation of control facilitate flexible task switching at the expense of the stability needed to support goal-directed behavior in face of distraction. We formulate this problem in a dynamical system, in which control signals are represented as attractors and in which constraints on control allocation limit the depth of these attractors. We derive formal expressions of the stability-flexibility tradeoff, showing that constraints on control allocation improve cognitive flexibility but impair cognitive stability. We provide evidence that human participants adapt higher constraints on the allocation of control as the demand for flexibility increases but that participants deviate from optimal constraints. In continuing work, we are investigating how collaborative performance of a group of individuals can benefit from individual differences defined in terms of balance between cognitive stability and flexibility.

The cognitive neuroscience of conscious perception has seen considerable growth over the past few decades. Confirming an influential hypothesis driven by earlier studies of neuropsychological patients, we have found that the lateral and polar prefrontal cortices play important causal roles in the generation of subjective experiences. However, this basic empirical finding has been hotly contested by researchers with different theoretical commitments, and the differences are at times difficult to resolve. To address the controversies, I suggest one alternative venue may be to look for clinical applications derived from current theories. I outline an example in which we used closed-loop fMRI combined with machine learning to nonconsciously manipulate the physiological responses to threatening stimuli, such as spiders or snakes. A clinical trial involving patients with phobia is currently taking place. I also outline how this theoretical framework may be extended to other diseases. Ultimately, a truly meaningful understanding of the fundamental nature of our mental existence should lead to useful insights for our colleagues on the clinical frontlines. If we use this as a yardstick, whoever loses the esoteric theoretical debates, both science and the patients will always win.

Drawing on recent findings from evolutionary anthropology and neuroscience, professor Barton will lead us through the amazing story of the evolution of human cognition. Usingstatistical, phylogenetic analyses that tease apart the variation associated with different neural systems and due to different selection pressures, he will be addressing intriguing questions like ‘Why are there so many neurons in the cerebellum?’, ‘Is the neocortex the ‘intelligent’ bit of the brain?’, and ‘What explains that the recognition by humans of emotional expressions is disrupted by trancranial magnetic stimulation of the somatosensory cortex?’ Could, as professor Barton suggests, the cerebellum -modestly concealed beneath the volumetrically dominating neocortex and largely ignored- turn out to be the Cinderella of the study of brain evolution?

State-of-the-art machine vision models can predict human recognition memory for complex scenes with astonishing accuracy. In this talk I present work that investigated how memorable scenes are actually remembered and experienced by human observers. We found that memorable scenes were recognized largely based on recollection of specific episodic details but also based on familiarity for an entire scene. I thus highlight current limitations in machine vision models emulating human recognition memory, with promising opportunities for future research. Moreover, we were interested in what observers specifically remember about complex scenes. We thus considered the functional role of eye-movements as a window into the content of memories, particularly when observers recollected specific information about a scene. We found that when observers formed a memory representation that they later recollected (compared to scenes that only felt familiar), the overall extent of exploration was broader, with a specific subset of fixations clustered around later to-be-recollected scene content, irrespective of the memorability of a scene. I discuss the critical role that our viewing behavior plays in visual memory formation and retrieval and point to potential implications for machine vision models predicting the content of human memories.

Understanding speech in noisy backgrounds requires selective attention to a particular speaker. Humans excel at this challenging task, while current speech recognition technology still struggles when background noise is loud. The neural mechanisms by which we process speech remain, however, poorly understood, not least due to the complexity of natural speech. Here we describe recent progress obtained through applying machine-learning to neuroimaging data of humans listening to speech in different types of background noise. In particular, we develop statistical models to relate characteristic features of speech such as pitch, amplitude fluctuations and linguistic surprisal to neural measurements. We find neural correlates of speech processing both at the subcortical level, related to the pitch, as well as at the cortical level, related to amplitude fluctuations and linguistic structures. We also show that some of these measures allow to diagnose disorders of consciousness. Our findings may be applied in smart hearing aids that automatically adjust speech processing to assist a user, as well as in the diagnosis of brain disorders.