Cognition seminars

Whether we are deciding about Covid-related restrictions, estimating a ball’s trajectory when playing tennis, or interpreting radiological images – most any choice we make is based on uncertain evidence. How do we infer that information is more or less reliable when making these decisions? How does the brain represent knowledge of this uncertainty? In this talk, I will present recent neuroimaging data combined with novel analysis tools to address these questions. Our results indicate that sensory uncertainty can reliably be estimated from the human visual cortex on a trial-by-trial basis, and moreover that observers appear to rely on this uncertainty when making perceptual decisions.

Many psychological theories assume that qualitatively different cognitive processes can result in identical responses. Multinomial processing tree (MPT) models allow researchers to disentangle latent cognitive processes based on observed response frequencies. Recently, MPT models have been extended to explicitly account for participant and item heterogeneity. These hierarchical Bayesian MPT models provide the opportunity to connect two traditionally isolated disciplines. Whereas cognitive psychology has often focused on the experimental validation of MPT model parameters on the group level, psychometrics provides the necessary concepts and tools for measuring differences in MPT parameters on the item or person level. Moreover, MPT parameters can be regressed on covariates to model latent processes as a function of personality traits or other person characteristics.

Arguably one of the biggest mysteries in neuroscience is how the brain stores long-term memories. The major challenge for investigating the neural circuit underlying memory formation in the neocortex is the distributed nature of the resulting memory trace throughout the cortex. Here, we used a new behavioral paradigm that enabled us to generate memory traces in a specific cortical location and to specifically examine the mechanisms of memory formation in that region. We found that medial-temporal inputs arrive in neocortical layer 1 where the apical dendrites of cortical pyramidal neurons predominate. These dendrites have active properties that make them sensitive to contextual inputs from other areas that also send axons to layer 1 around the cortex. Blocking the influence of these medial-temporal inputs prevented learning and suppressed resulting dendritic activity. We conclude that layer 1 is the locus for hippocampal-dependent memory formation in the neocortex and propose that this process enhances the sensitivity of the tuft dendrites to contextual inputs.

For social animals, successfully communicating with others is essential for interactions and survival. My research aims to answer a central question on the neuronal basis of this ability, from the perspective of the listener: how do our brains enable us to communicate with each other? My work develops nonhuman animal models to study the behavioural and neuronal mechanisms underlying the perception of vocal patterns. I will start by providing an overview of my past research characterizing the neuronal-level substrates of voice processing along the primate temporal lobe. I will then focus on my current work on vocal perception in mice, in which I utilize natural male-female courtship behaviour to evaluate the acoustic dimensions extracted by listeners from ultrasonic sequences. I will then talk about ongoing work investigating the neuronal substrates supporting the perception of behaviourally relevant acoustic cues from mouse vocal sequences.

Individual neurons in visual cortex provide the brain with unreliable estimates of visual features. It is not known if the single-neuron variability is correlated across large neural populations, thus impairing the global encoding of stimuli. We recorded simultaneously from up to 50,000 neurons in mouse primary visual cortex (V1) and in higher-order visual areas and measured stimulus discrimination thresholds of 0.35 degrees and 0.37 degrees respectively in an orientation decoding task. These neural thresholds were almost 100 times smaller than the behavioral discrimination thresholds reported in mice. This discrepancy could not be explained by stimulus properties or arousal states. Furthermore, the behavioral variability during a sensory discrimination task could not be explained by neural variability in primary visual cortex. Instead behavior-related neural activity arose dynamically across a network of non-sensory brain areas. These results imply that sensory perception in mice is limited by downstream decoders, not by neural noise in sensory representations.

Human vision flaunts a remarkable ability to recognize objects in the surrounding environment even in the absence of complete visual representation of these objects. This process is done almost intuitively and it was not until scientists had to tackle this problem in computer vision that they noticed its complexity. While current advances in artificial vision systems have made great strides exceeding human level in normal vision tasks, it has yet to achieve a similar robustness level. One cause of this robustness is the extensive connectivity that is not limited to a feedforward hierarchical pathway similar to the current state-of-the-art deep convolutional neural networks but also comprises recurrent and top-down connections. They allow the human brain to enhance the neural representations of degraded images in concordance with meaningful representations stored in memory. The mechanisms by which these different pathways interact are still not understood. In this seminar, studies concerning the effect of recurrent and top-down modulation on the neural representations resulting from viewing blurred images will be presented. Those studies attempted to uncover the role of recurrent and top-down connections in human vision. The results presented challenge the notion of predictive coding as a mechanism for top-down modulation of visual information during natural vision. They show that neural representation enhancement (sharpening) appears to be a more dominant process of different levels of visual hierarchy. They also show that inference in visual recognition is achieved through a Bayesian process between incoming visual information and priors from deeper processing regions in the brain.

Historically, research on the brain has been working its way in from the outside world, hoping that such systematic exploration will take us some day to the middle and on through the middle to the output. Ever since the time of Aristotle, philosophers and scientists have assumed that the brain (or, more precisely, the mind) is initially a blank slate filled up gradually with experience in an outside-in manner. An alternative, brain-centric view, the one I am promoting, is that self-organized brain networks induce a vast repertoire of preformed neuronal patterns. While interacting with the world, some of these initially ‘nonsensical’ patterns acquire behavioral significance or meaning. Thus, experience is primarily a process of matching preexisting neuronal dynamics to events in the world. I suggest that perpetually active, internal dynamic is the source of cognition, a neuronal operation disengaged from immediate senses.

Interval timing is a fundamental component action, and is susceptible to motor-related temporal distortions. Previous studies have shown that movement biases temporal estimates, but have primarily considered self-modulated movement only. However, real-world encounters often include situations in which movement is restricted or perturbed by environmental factors. In the following experiments, we introduced viscous movement environments to externally modulate movement and investigated the resulting effects on temporal perception. In two separate tasks, participants timed auditory intervals while moving a robotic arm that randomly applied four levels of viscosity. Results demonstrated that higher viscosity led to shorter perceived durations. Using a drift-diffusion model and a Bayesian observer model, we confirmed these biasing effects arose from perceptual mechanisms, instead of biases in decision making. These findings suggest that environmental perturbations are an important factor in movement-related temporal distortions, and enhance the current understanding of the interactions of motor activity and cognitive processes. https://www.biorxiv.org/content/10.1101/2020.10.26.355396v1

In daily life, we consistently make decisions in pursuit of some goal. Many decisions are informed by multiple sources of information. Unfortunately, these sources often provide ambiguous information about what course of action to take. Therefore, determining how the brain integrates information to resolve this ambiguity is key to understanding the neural mechanisms of decision-making. In the domain of time, this topic can be studied by training subjects to predict when a future event will occur based on distinct cues (e.g., tone, light, etc.). If multiple cues are presented simultaneously and their cue-to-event intervals differ (e.g., tone-10s + light-30s), subjects will often expect the event to occur at the average of their intervals. This ‘temporal averaging’ effect is presumably how the timing system resolves ambiguous time-information. The neural mechanisms of temporal averaging are currently unclear. Here, we will propose how temporal averaging could emerge in cortical circuits using a simple modification of a ‘drift-diffusion’ model of timing.

From robots to humans, the ability to learn from experience turns a rigid response system into a flexible, adaptive one. In this talk, I will discuss emerging findings regarding the neural and cognitive mechanisms by which learning shapes decisions. The lecture will focus on how multiple brain regions interact to support learning, what this means for how memories are built, and the consequences for how decisions are made. Results emerging from this work challenge the traditional view of separate learning systems and advance understanding of how memory biases decisions in both adaptive and maladaptive ways.