BERT
Latest
Cerebellum-Basal Ganglia Interactions
In search of the unknown: Artificial intelligence and foraging
May Webinar
Autopoiesis and Enaction in the Game of Life
Enaction plays a central role in the broader fabric of so-called 4E (embodied, embedded, extended, enactive) cognition. Although the origin of the enactive approach is widely dated to the 1991 publication of the book "The Embodied Mind" by Varela, Thompson and Rosch, many of the central ideas trace to much earlier work. Over 40 years ago, the Chilean biologists Humberto Maturana and Francisco Varela put forward the notion of autopoiesis as a way to understand living systems and the phenomena that they generate, including cognition. Varela and others subsequently extended this framework to an enactive approach that places biological autonomy at the foundation of situated and embodied behavior and cognition. I will describe an attempt to place Maturana and Varela's original ideas on a firmer foundation by studying them within the context of a toy model universe, John Conway's Game of Life (GoL) cellular automata. This work has both pedagogical and theoretical goals. Simple concrete models provide an excellent vehicle for introducing some of the core concepts of autopoiesis and enaction and explaining how these concepts fit together into a broader whole. In addition, a careful analysis of such toy models can hone our intuitions about these concepts, probe their strengths and weaknesses, and move the entire enterprise in the direction of a more mathematically rigorous theory. In particular, I will identify the primitive processes that can occur in GoL, show how these can be linked together into mutually-supporting networks that underlie persistent bounded entities, map the responses of such entities to environmental perturbations, and investigate the paths of mutual perturbation that these entities and their environments can undergo.
Do large language models solve verbal analogies like children do?
Analogical reasoning –learning about new things by relating it to previous knowledge– lies at the heart of human intelligence and creativity and forms the core of educational practice. Children start creating and using analogies early on, making incredible progress moving from associative processes to successful analogical reasoning. For example, if we ask a four-year-old “Horse belongs to stable like chicken belongs to …?” they may use association and reply “egg”, whereas older children will likely give the intended relational response “chicken coop” (or other term to refer to a chicken’s home). Interestingly, despite state-of-the-art AI-language models having superhuman encyclopedic knowledge and superior memory and computational power, our pilot studies show that these large language models often make mistakes providing associative rather than relational responses to verbal analogies. For example, when we asked four- to eight-year-olds to solve the analogy “body is to feet as tree is to …?” they responded “roots” without hesitation, but large language models tend to provide more associative responses such as “leaves”. In this study we examine the similarities and differences between children's and six large language models' (Dutch/multilingual models: RobBERT, BERT-je, M-BERT, GPT-2, M-GPT, Word2Vec and Fasttext) responses to verbal analogies extracted from an online adaptive learning environment, where >14,000 7-12 year-olds from the Netherlands solved 20 or more items from a database of 900 Dutch language verbal analogies.
Elucidating the mechanism underlying Stress and Caffeine-induced motor dysfunction using a mouse model of Episodic Ataxia Type 2
Episodic Ataxia type 2 (EA2), caused by mutations in the CACNA1A gene, results in a loss-of-function of the P/Q type calcium channel, which leads to baseline ataxia, and attacks of dyskinesia, that can last a few hours to a few days. Attacks are brought on by consumption of caffeine, alcohol, and physical or emotional stress. Interestingly, caffeine and stress are common triggers among other episodic channelopathies, as well as causing tremor or shaking in otherwise healthy adults. The mechanism underlying stress and caffeine induced motor impairment remains poorly understood. Utilizing behavior, and in vivo and in vitro electrophysiology in the tottering mouse, a well characterized mouse model of EA2, or WT mice, we first sought to elucidate the mechanism underlying stress-induced motor impairment. We found stress induces attacks in EA2 though the activation of cerebellar alpha 1 adrenergic receptors by norepinephrine (NE) through casein kinase 2 (CK2) dependent phosphorylation. This decreases SK2 channel activity, causing increased Purkinje cell irregularity and motor impairment. Knocking down or blocking CK2 with an FDA approved drug CX-4945 prevented PC irregularity and stress-induced attacks. We next hypothesized caffeine, which has been shown to increase NE levels, could induce attacks through the same alpha 1 adrenergic mechanism in EA2. We found caffeine increases PC irregularity and induces attacks through the same CK2 pathway. Block of alpha 1 adrenergic receptors, however, failed to prevent caffeine-induced attacks. Caffeine instead induces attacks through the block of cerebellar A1 adenosine receptors. This increases the release of glutamate, which interacts with mGluR1 receptors on PC, resulting in erratic firing and motor attacks. Finally, we show a novel direct interaction between mGluR1 and CK2, and inhibition of mGluR1 prior to initiation of attack, prevents the caffeine-induced increase in phosphorylation. These data elucidate the mechanism underlying stress and caffeine-induced motor impairment. Furthermore, given the success of CX-4945 to prevent stress and caffeine induced attacks, it establishes ground-work for the development of therapeutics for the treatment of caffeine and stress induced attacks in EA2 patients and possibly other episodic channelopathies.
Probabilistic computation in natural vision
A central goal of vision science is to understand the principles underlying the perception and neural coding of the complex visual environment of our everyday experience. In the visual cortex, foundational work with artificial stimuli, and more recent work combining natural images and deep convolutional neural networks, have revealed much about the tuning of cortical neurons to specific image features. However, a major limitation of this existing work is its focus on single-neuron response strength to isolated images. First, during natural vision, the inputs to cortical neurons are not isolated but rather embedded in a rich spatial and temporal context. Second, the full structure of population activity—including the substantial trial-to-trial variability that is shared among neurons—determines encoded information and, ultimately, perception. In the first part of this talk, I will argue for a normative approach to study encoding of natural images in primary visual cortex (V1), which combines a detailed understanding of the sensory inputs with a theory of how those inputs should be represented. Specifically, we hypothesize that V1 response structure serves to approximate a probabilistic representation optimized to the statistics of natural visual inputs, and that contextual modulation is an integral aspect of achieving this goal. I will present a concrete computational framework that instantiates this hypothesis, and data recorded using multielectrode arrays in macaque V1 to test its predictions. In the second part, I will discuss how we are leveraging this framework to develop deep probabilistic algorithms for natural image and video segmentation.
NMC4 Short Talk: Image embeddings informed by natural language improve predictions and understanding of human higher-level visual cortex
To better understand human scene understanding, we extracted features from images using CLIP, a neural network model of visual concept trained with supervision from natural language. We then constructed voxelwise encoding models to explain whole brain responses arising from viewing natural images from the Natural Scenes Dataset (NSD) - a large-scale fMRI dataset collected at 7T. Our results reveal that CLIP, as compared to convolution based image classification models such as ResNet or AlexNet, as well as language models such as BERT, gives rise to representations that enable better prediction performance - up to a 0.86 correlation with test data and an r-square of 0.75 - in higher-level visual cortex in humans. Moreover, CLIP representations explain distinctly unique variance in these higher-level visual areas as compared to models trained with only images or text. Control experiments show that the improvement in prediction observed with CLIP is not due to architectural differences (transformer vs. convolution) or to the encoding of image captions per se (vs. single object labels). Together our results indicate that CLIP and, more generally, multimodal models trained jointly on images and text, may serve as better candidate models of representation in human higher-level visual cortex. The bridge between language and vision provided by jointly trained models such as CLIP also opens up new and more semantically-rich ways of interpreting the visual brain.
Retinoblastoma: Canadian global leadership
- CANCELLED -
A recent formulation of predictive coding theory proposes that a subset of neurons in each cortical area encodes sensory prediction errors, the difference between predictions relayed from higher cortex and the sensory input. Here, we test for evidence of prediction error responses in spiking responses and local field potentials (LFP) recorded in primary visual cortex and area V4 of macaque monkeys, and in complementary electroencephalographic (EEG) scalp recordings in human participants. We presented a fixed sequence of visual stimuli on most trials, and violated the expected ordering on a small subset of trials. Under predictive coding theory, pattern-violating stimuli should trigger robust prediction errors, but we found that spiking, LFP and EEG responses to expected and pattern-violating stimuli were nearly identical. Our results challenge the assertion that a fundamental computational motif in sensory cortex is to signal prediction errors, at least those based on predictions derived from temporal patterns of visual stimulation.
Can non-random collapses of the wavefunction enable libertarian free will?
Agent-causal libertarian free will asserts that the conscious agent is the ultimate cause of her own voluntary behavior. A major reason to reject libertarian free will is that it seems incompatible with our current knowledge of physics. In this talk I will argue how quantum processes, specifically non-random collapses of the wavefunction in the human cortex, may enable libertarian free will. I will discuss how this account can be empirically tested.
Imaging memory consolidation in wakefulness and sleep
New memories are initially labile and have to be consolidated into stable long-term representations. Current theories assume that this is supported by a shift in the neural substrate that supports the memory, away from rapidly plastic hippocampal networks towards more stable representations in the neocortex. Rehearsal, i.e. repeated activation of the neural circuits that store a memory, is thought to crucially contribute to the formation of neocortical long-term memory representations. This may either be achieved by repeated study during wakefulness or by a covert reactivation of memory traces during offline periods, such as quiet rest or sleep. My research investigates memory consolidation in the human brain with multivariate decoding of neural processing and non-invasive in-vivo imaging of microstructural plasticity. Using pattern classification on recordings of electrical brain activity, I show that we spontaneously reprocess memories during offline periods in both sleep and wakefulness, and that this reactivation benefits memory retention. In related work, we demonstrate that active rehearsal of learning material during wakefulness can facilitate rapid systems consolidation, leading to an immediate formation of lasting memory engrams in the neocortex. These representations satisfy general mnemonic criteria and cannot only be imaged with fMRI while memories are actively processed but can also be observed with diffusion-weighted imaging when the traces lie dormant. Importantly, sleep seems to hold a crucial role in stabilizing the changes in the contribution of memory systems initiated by rehearsal during wakefulness, indicating that online and offline reactivation might jointly contribute to forming long-term memories. Characterizing the covert processes that decide whether, and in which ways, our brains store new information is crucial to our understanding of memory formation. Directly imaging consolidation thus opens great opportunities for memory research.
Brain-body interactions in the metabolic/nutritional control of puberty: Neuropeptide pathways and central energy sensors
Puberty is a brain-driven phenomenon, which is under the control of sophisticated regulatory networks that integrate a large number of endogenous and environmental signals, including metabolic and nutritional cues. Puberty onset is tightly bound to the state of body energy reserves, and deregulation of energy/metabolic homeostasis is often associated with alterations in the timing of puberty. However, despite recent progress in the field, our knowledge of the specific molecular mechanisms and pathways whereby our brain decode metabolic information to modulate puberty onset remains fragmentary and incomplete. Compelling evidence, gathered over the last fifteen years, supports an essential role of hypothalamic neurons producing kisspeptins, encoded by Kiss1, in the neuroendocrine control of puberty. Kiss1 neurons are major components of the hypothalamic GnRH pulse generator, whose full activation is mandatory pubertal onset. Kiss1 neurons seemingly participate in transmitting the regulatory actions of metabolic cues on pubertal maturation. However, the modulatory influence of metabolic signals (e.g., leptin) on Kiss1 neurons might be predominantly indirect and likely involves also the interaction with other transmitters and neuronal populations. In my presentation, I will review herein recent work of our group, using preclinical models, addressing the molecular mechanisms whereby Kiss1 neurons are modulated by metabolic signals, and thereby contribute to the nutritional control of puberty. In this context, the putative roles of the energy/metabolic sensors, AMP-activated protein kinase (AMPK) and SIRT1, in the metabolic control of Kiss1 neurons and puberty will be discussed. In addition, I will summarize recent findings from our team pointing out a role of central de novo ceramide signaling in mediating the impact of obesity of (earlier) puberty onset, via non-canonical, kisspeptin-related pathways. These findings are posed of translational interest, as perturbations of these molecular pathways could contribute to the alterations of pubertal timing linked to conditions of metabolic stress in humans, ranging from malnutrition to obesity, and might become druggable targets for better management of pubertal disorders.
Herbert Jasper Lecture
There is a long-standing tension between the notion that the hippocampal formation is essentially a spatial mapping system, and the notion that it plays an essential role in the establishment of episodic memory and the consolidation of such memory into structured knowledge about the world. One theory that resolves this tension is the notion that the hippocampus generates rather arbitrary 'index' codes that serve initially to link attributes of episodic memories that are stored in widely dispersed and only weakly connected neocortical modules. I will show how an essentially 'spatial' coding mechanism, with some tweaks, provides an ideal indexing system and discuss the neural coding strategies that the hippocampus apparently uses to overcome some biological constraints affecting the possibility of shipping the index code out widely to the neocortex. Finally, I will present new data suggesting that the hippocampal index code is indeed transferred to layer II-III of the neocortex.
Targeting selective autophagy against neurodegenerative diseases
Protein quality control is essential for maintenance of a healthy and functional proteome that can attend the multiplicity of cellular functions. Failure of the systems that contribute to protein homeostasis, the so called proteostasis networks, have been identified in the pathogenesis of multiple neurodegenerative disorders and demonstrated to contribute to disease onset and progression. We are interested in autophagy, one of the components of the proteostasis network, and in the interplay of wo selective types of autophagy, chaperone-mediated autophagy (CMA) and endosomal microautophagy (eMI), with neurodegeneration. We have recently found that pathogenic proteins involved in common neurodegenerative conditions such as tauopathies or Parkinson’s disease, can exert a toxic effect in both types of selective types of autophagy compromising their functioning. We have now used mouse models with compromised CMA that support increased propagation of proteins such as tau and alpha-synuclein and an exacerbation of disease phenotype with aging. Conversely, genetic or chemical upregulation of CMA in this context of proteotoxicity slow down disease progression by facilitating effective intracellular removal of pathogenic proteins. Our findings highlight CMA and eMI as potential novel therapeutic targets against neurodegeneration.
CrossTalk Event with Susan Rogers & Ed Robertson
Join us for a conversation on the neuroscience of music, composition and song writing!
The role of orexin/hypocretin in social behaviour
My lab is focused on how brain encodes and modulates social interactions. Intraspecific social interactions are integral for survival and maintenance of society among all mammalian species. Despite the importance of social interactions, we lack a complete understanding of the brain circuitry involved in processing social behaviour. My lab investigates how the hypothalamic orexin (hypocretin) neurons and their downstream circuits participate in social interaction behaviours. These neurons are located exclusively in the hypothalamus that regulates complex and goal-directed behaviours. We recently identified that orexin neurons differentially encode interaction between familiar and novel animals. We are currently investigating how chronic social isolation, a risk factor for the development of social-anxiety like behaviours, affects orexin neuron activity and how we can manipulate the activity of these neurons to mitigate isolation-induced social deficits.
A human-specific modifier of synaptic development, cortical circuit connectivity and function
The remarkable cognitive abilities characterizing humans has been linked to unique patterns of connectivity characterizing the neocortex. Comparative studies have shown that human cortical pyramidal neurons (PN) receive a significant increase of synaptic inputs when compared to other mammals, including non-human primates and rodents, but how this may relate to changes in cortical connectivity and function remained largely unknown. We previously identified a human-specific gene duplication (HSGD), SRGAP2C, that, when induced in mouse cortical PNs drives human-specific features of synaptic development, including a correlated increase in excitatory (E) and inhibitory (I) synapse density through inhibition of the ancestral SRGAP2A protein (Charrier et al. 2012; Fossatti et al. 2016; Schmidt et al. 2019). However, the origin and nature of this increased connectivity and its impact on cortical circuit function was unknown. I will present new results exploring these questions (see Schmidt et al. (2020) https://www.biorxiv.org/content/10.1101/852970v1). Using a combination of transgenic approaches and quantitative monosynaptic tracing, we discovered that humanization of SRGAP2C expression in the mouse cortex leads to a specific increase in local and long-range cortico-cortical inputs received by layer 2/3 cortical PNs. Moreover, using in vivo two-photon imaging in the barrel cortex of awake mice, we show that humanization of SRGAP2C expression increases the reliability and selectivity of sensory- evoked responses in layer 2/3 PNs. We also found that mice humanized for SRGAP2C in all cortical pyramidal neurons and throughout development are characterized by improved behavioural performance in a novel whisker-based sensory discrimination task compared to control wild-type mice. Our results suggest that the emergence of SRGAP2C during human evolution underlie a new substrate for human brain evolution whereby it led to increased local and long-range cortico-cortical connectivity and improved reliability of sensory-evoked cortical coding. References cited Charrier C.*, Joshi K. *, Coutinho-Budd J., Kim, J-E., Lambert N., de Marchena, J., Jin W-L., Vanderhaeghen P., Ghosh A., Sassa T, and Polleux F. (2012) Inhibition of SRGAP2 function by its human-specific paralogs induces neoteny of spine maturation. Cell 149:923-935. * Co-first authors. Fossati M, Pizzarelli R, Schmidt ER, Kupferman JV, Stroebel D, Polleux F*, Charrier C*. (2016) SRGAP2 and Its Human-Specific Paralog Co-Regulate the Development of Excitatory and Inhibitory Synapses. Neuron. 91(2):356-69. * Co-senior corresponding authors. Schmidt E.R.E., Kupferman J.V., Stackmann M., Polleux F. (2019) The human-specific paralogs SRGAP2 and SRGAP2C differentially modulate SRGAP2A-dependent synaptic development. Scientific Rep. 9(1):18692. Schmidt E.R.E, Zhao H.T., Hillman E.M.C., Polleux F. (2020) Humanization of SRGAP2C expression increases cortico-cortical connectivity and reliability of sensory-evoked responses in mouse brain. Submitted. See also: https://www.biorxiv.org/content/10.1101/852970v1
TweetyBERT, a self-supervised vision transformer to automate birdsong annotation
COSYNE 2025
Altered activities of antioxidant enzymes in peripheral organs and erythrocytes due to social isolation in peripuberty: Findings from a rodent study
FENS Forum 2024
DivfreqBERT: Encoding distinct frequency ranges of brain dynamics based on the complexity of the brain
FENS Forum 2024
The effect of pubertal development on spatial reasoning
FENS Forum 2024
Pubertal immune challenge differentially modulates LPS-induced molecular and behavioural sequelae in adult male and female mice
FENS Forum 2024
BERT coverage
23 items