Cognition seminars

Learning is a population phenomenon. Since it is the organized activity of populations of neurons that cause movement, learning a new skill must involve reshaping those population activity patterns. Seeing how the brain does this has been elusive, but a brain-computer interface approach can yield new insight. We presented monkeys with novel BCI mappings that we knew would be difficult for them to learn how to control. Over several days, we observed the emergence of new patterns of neural activity that endowed the animals with the ability to perform better at the BCI task. We speculate that there also exists a direct relationship between new patterns of neural activity and new abilities during natural movements, but it is much harder to see in that setting.

The brain is remarkably flexible, and appears to instantly reconfigure its processing depending on what’s needed to solve a task at hand: fMRI studies indicate that distal brain areas appear to fluidly couple and decouple with one another depending on behavioral context. We investigated how the brain coordinates its activity across areas to inform complex, top-down control behaviors. Animals were trained to perform a novel brain machine interface task to guide a visual cursor to a reward zone, using activity recorded with widefield calcium imaging. This allowed us to screen for cortical areas implicated in causal neural control of the visual object. Animals could decorrelate normally highly-correlated areas to perform the task, and used an explore-exploit search in neural activity space to discover successful strategies. Higher visual and parietal areas were more active during the task in expert animals. Single unit recordings targeted to these areas indicated that the sensory representation of an object was sensitive to an animal’s subjective sense of controlling it.

Learning by analogy is a powerful tool children’s developmental repertoire, as well as in educational contexts such as mathematics, where the key knowledge base involves building flexible schemas. However, noticing and learning from analogies develops over time and is cognitively resource intensive. I review studies that provide insight into the relationship between mechanisms driving children’s developing analogy skills, highlighting environmental inputs (parent talk and prior experiences priming attention to relations) and neuro-cognitive factors (Executive Functions and brain injury). I then note implications for mathematics learning, reviewing experimental findings that show analogy can improve learning, but also that both individual differences in EFs and environmental factors that reduce available EFs such as performance pressure can predict student learning.

In 1955, John McCarthy and colleagues proposed an AI summer research project with the following aim: “An attempt will be made to find how to make machines use language, form abstractions and concepts, solve kinds of problems now reserved for humans, and improve themselves.” More than six decades later, all of these research topics remain open and actively investigated in the AI community. While AI has made dramatic progress over the last decade in areas such as vision, natural language processing, and robotics, current AI systems still almost entirely lack the ability to form humanlike concepts and abstractions. Some cognitive scientists have proposed that analogy-making is a central mechanism for conceptual abstraction and understanding in humans. Douglas Hofstadter called analogy-making “the core of cognition”, and Hofstadter and co-author Emmanuel Sander noted, “Without concepts there can be no thought, and without analogies there can be no concepts.” In this talk I will reflect on the role played by analogy-making at all levels of intelligence, and on prospects for developing AI systems with humanlike abilities for abstraction and analogy.

Abstract semantic relations (e.g., category membership, part-whole, antonymy, cause-effect) are central to human intelligence, underlying the distinctively human ability to reason by analogy. I will describe a computational project (Bayesian Analogy with Relational Transformations) that aims to extract explicit representations of abstract semantic relations from non-relational inputs automatically generated by machine learning. BART’s representations predict patterns of typicality and similarity for semantic relations, as well as similarity of neural signals triggered by semantic relations during analogical reasoning. In this approach, analogy emerges from the ability to learn and compare relations; mapping emerges later from the ability to compare patterns of relations.

In mammals, the selective transformation of transient experience into stored memory occurs in the hippocampus, which develops representations of specific events in the context in which they occur. In this talk, I will focus on the development of hippocampal circuits and the self-organized dynamics embedded in them since the latter critically support the role of the hippocampus in memory. I will discuss evidence that adult hippocampal cells and circuits are remarkably sculpted by development, as early as embryonic neurogenesis. We argue that these primary developmental programs provide a scaffold onto which later experience of the external world can be grafted. Next, I will present data on the emergence of recurrent connectivity and self-organized dynamics in hippocampal circuits and outline the critical turn points and discontinuities in that developmental journey.

The question of free will has been topical for millennia, especially considering its links to moral responsibility and the ownership of that responsibility. Free will, or volition, is an incredibly complex phenomenon - and cannot easily be reduced to a single empirical paradigm. Roskies (2010) proposes that there are five cognitive aspects to be considered when developing a more complete understanding of volition. These are: intention, initiation, feeling, executive control and decision-making. Decision-making will be the focus of this talk, which steps through aspects of the philosophy of free will; highlights experimental paradigms stemming from the seminal work of Benjamin Libet et al., and proposes machine learning as a promising method in progressing the empirical studies of decision-making and free will.

Drug addiction is a chronically relapsing disorder characterized by compulsive drug use despite catastrophic personal consequences (e.g., loss of family, job) and even when the substance is no longer perceived as pleasurable. In this talk, I will present results of human neuroimaging studies, utilizing a multimodal approach (neuropsychology, functional magnetic resonance imaging, event-related potentials recordings), to explore the neurobiology underlying the core psychological impairments in drug addiction (impulsivity, drive/motivation, insight/awareness) as associated with its clinical symptomatology (intoxication, craving, bingeing, withdrawal). The focus of this talk is on understanding the role of the dopaminergic mesocorticolimbic circuit, and especially the prefrontal cortex, in higher-order executive dysfunction (e.g., disadvantageous decision-making such as trading a car for a couple of cocaine hits) in drug addicted individuals. The theoretical model that guides the presented research is called iRISA (Impaired Response Inhibition and Salience Attribution), postulating that abnormalities in the orbitofrontal cortex and anterior cingulate cortex, as related to dopaminergic dysfunction, contribute to the core clinical symptoms in drug addiction. Specifically, our multi-modality program of research is guided by the underlying working hypothesis that drug addicted individuals disproportionately attribute reward value to their drug of choice at the expense of other potentially but no-longer-rewarding stimuli, with a concomitant decrease in the ability to inhibit maladaptive drug use. In this talk I will also explore whether treatment (as usual) and 6-month abstinence enhance recovery in these brain-behavior compromises in treatment seeking cocaine addicted individuals. Promising neuroimaging studies, which combine pharmacological (i.e., oral methylphenidate, or RitalinTM) and salient cognitive tasks or functional connectivity during resting-state, will be discussed as examples for using neuroimaging for empirically guiding the development of effective neurorehabilitation strategies (encompassing cognitive reappraisal and transcranial direct current stimulation) in drug addiction.

Cases with visuospatial abnormalities provide opportunities for understanding the underlying cognitive mechanisms. Three cases of visual mirror-reversal have been reported: AH (McCloskey, 2009), TM (McCloskey, Valtonen, & Sherman, 2006) and PR (Pflugshaupt et al., 2007). This research reports a fourth case, BS -- with focal occipital cortical dysgenesis -- who displays highly unusual visuospatial abnormalities. They initially produced mirror reversal errors similar to those of AH, who -- like the patient in question -- showed a selective developmental deficit. Extensive examination of BS revealed phenomena such as: mirror reversal errors (sometimes affecting only parts of the visual fields) in both horizontal and vertical planes; subjective representation of visual objects and words in distinct left and right visual fields; subjective duplication of objects of visual attention (not due to diplopia); uncertainty regarding the canonical upright orientation of everyday objects; mirror reversals during saccadic eye movements on oculomotor tasks; and failure to integrate visual with other sensory inputs (e.g., they feel themself moving backwards when visual information shows they are moving forward). Fewer errors are produced under conditions of certain visual variables. These and other findings have led the researchers to conclude that BS draws upon a subjective representation of visual space that is structured phenomenally much as it is anatomically in early visual cortex (i.e., rotated through 180 degrees, split into left and right fields, etc.). Despite this, BS functions remarkably well in their everyday life, apparently due to extensive compensatory mechanisms deployed at higher (executive) processing levels beyond the visual modality.

Humans continuously need to learn to make good choices – be it using a new video-conferencing set up, figuring out what questions to ask to successfully secure a reliable babysitter, or just selecting which location in a house is least likely to be interrupted by toddlers during work calls. However, the goals we seek to attain – such as using zoom successfully – are often vaguely defined and previously unexperienced, and in that sense cannot be known by us as being rewarding. We hypothesized that learning to make good choices in such situations nevertheless leverages reinforcement learning processes, and that executive functions in general, and working memory in particular, play a crucial role in defining the reward function for arbitrary outcomes in such a way that they become reinforcing. I will show results from a novel behavioral protocol, as well as preliminary computational and imaging evidence supporting our hypothesis.

The world confronts our senses with a continuous stream of rapidly changing information. Yet, we experience life as a series of episodes or events, and in memory these pieces seem to become even further organized. How do we recall and give structure to this complex information? Recent studies have begun to examine these questions using naturalistic stimuli and behavior: subjects view audiovisual movies and then freely recount aloud their memories of the events. We find brain activity patterns that are unique to individual episodes, and which reappear during verbal recollection; robust generalization of these patterns across people; and memory effects driven by the structure of links between events in a narrative. These findings construct a picture of how we comprehend and recall real-world events that unfold continuously across time.

Although electroencephalography (EEG) has been used in clinical and research studies for almost a century, recent technological advances have made the equipment and processing tools more accessible outside laboratory settings. These low-cost alternatives can achieve satisfactory results in experiments such as detecting event-related potentials and classifying cognitive states. In our research, we use low-cost single-channel EEG to classify brain activity during the presentation of images of opposite emotional valence from the OASIS database. Emotional classification has already been achieved using research-grade and commercial-grade equipment, but our approach pioneers the use of educational-grade equipment for said task. EEG data is collected with a Backyard Brains SpikerBox, a low-cost and open-source bioamplifier that can record a single-channel electric signal from a pair of electrodes placed on the scalp, and used to train machine learning classifiers.

In many ways, cognitive neuroscience is the attempt to use physiological observation to clarify the mechanisms that shape behavior. Over the past 25 years, fMRI has provided a system-wide and yet somewhat spatially precise view of the response in human cortex evoked by a wide variety of stimuli and task contexts. The current talk focuses on the other direction of inference; the implications of this observed functional organization for behavior. To begin, we must interrogate the methodological and empirical frameworks underlying our derivation of this organization, partially by exploring its relationship to and predictability from gross neuroanatomy. Next, across a series of studies, the implications of two properties of functional organization for behavior will be explored: 1) the co-localization of visual working memory and perceptual processing and 2) implicit learning in the context of distributed responses. In sum, these results highlight the limitations of our current approach and hint at a new general mechanism for explaining observed behavior in context with the neural substrate.

Temporal lobe epilepsy is associated with memory deficits but the circuit mechanisms underlying these cognitive disabilities are not understood. We used electrophysiological recordings, open-source wire-free miniaturized microscopy and computational modeling to probe these deficits in a model of temporal lobe epilepsy. We find desynchronization of dentate gyrus interneurons with CA1 interneurons during theta oscillations and a loss of precision and stability of place fields. We also find that emergence of place cell dysfunction is delayed, providing a potential temporal window for treatments. Computation modeling shows that desynchronization rather than interneuron cell loss can drive place cell dysfunction. Future studies will uncover cell types driving these changes and transcriptional changes that may be driving dysfunction.

People frequently interpret the same information differently, based on their prior beliefs and views. This may occur in everyday settings, as when two friends are watching the same movie, but also in more consequential circumstances, such as when people interpret the same news differently based on their political views. The role of subjective knowledge in altering how the brain processes narratives has been explored mainly in controlled settings. I will present two projects that examines neural mechanisms underlying narrative interpretation “in the wild” -- how responses differ between two groups of people who interpret the same narrative in two coherent, but opposing ways. In the first project we manipulated participant’s prior knowledge to make them interpret the narrative differently, and found that responses in high-order areas, including the default mode network, language areas and subsets of the mirror neuron system, tend to be similar among people who share the same interpretation, but different from people with an opposing interpretation. In contrast to the active manipulation of participants’ interpretation in the first study, in the second (ongoing) project we examine these processes in a more ecological setting. Taking advantage of people’s natural tendencies to interpret the world through their own (political) filters, we examine these mechanisms while measuring their brain response to political movie clips. These studies are intended to deepen our understanding of the differences in subjective construal processes, by mapping their underlying brain mechanisms.

Over the past decade, the domain of face identity processing has seen a surging interest in inter-individual differences, with a focus on individuals with superior skills, so-called Super-Recognizers (SRs; Ramon et al., 2019; Russell et al., 2009). Their study can provide valuable insights into brain-behavior relationships and advance our understanding of neural functioning. Despite a decade of research, and similarly to the field of developmental prosopagnosia, a consensus on diagnostic criteria for SR identification is lacking. Consequently, SRs are currently identified either inconsistently, via suboptimal individual tests, or via undocumented collections of tests. This state of the field has two major implications. Firstly, our scientific understanding of SRs will remain at best limited. Secondly, the needs of government agencies interested in deploying SRs for real-life identity verification (e.g., policing) are unlikely to be met. To counteract these issues, I suggest the following action points. Firstly, based on our and others’ work suggesting novel and challenging tests of face cognition (Bobak et al., 2019; Fysh et al., in press; Stacchi et al., 2019), and my collaborations with international security agencies, I recommend novel diagnostic criteria for SR identification. These are currently being used to screen the Berlin State Police’s >25K employees before identifying SRs via bespoke testing procedures we have collaboratively developed over the past years. Secondly, I introduce a cohort of SRs identified using these criteria, which is being studied in-depth using behavioral methods, psychophysics, eye-tracking, and neuroimaging. Finally, I suggest data acquired for these individuals should be curated to develop and share best practices with researchers and practitioners, and to gain an accurate and transparent description of SR cases to exploit their informative value.