Cosyne 2027
The annual Computational and Systems Neuroscience (Cosyne) meeting, an exchange forum for experimental and theoretical/computational approaches to problems in systems neuroscience. Cosyne returns to Montreal, Canada, from 11-16 March 2027.
How energy determines where proteins are produced in neurons
Gaute Einevoll talks with Tatjana Tchumatchenko about a mechanistic mathematical model of how neurons minimize energy use by deciding whether ion-channel proteins are produced locally in dendrites or in the soma. The model’s predictions agree with experimental findings.
Reading Minds & Machines
1. Can we reconstruct images that a person saw, directly from their fMRI brain recordings? 2. Can we reconstruct the training data that a deep-network trained on, directly from the parameters of the network? The answer to both of these intriguing questions is “Yes!” In this talk I will present some of our work in both domains. I will then show how combining the power of Brains and Machines can lead to significant breakthroughs in both areas, and potentially bridge the gap between Minds and Machines. Finally, I will show how combining the power of Multiple Brains (with NO shared data) may lead to new breakthrough discoveries in Brain-Science, and allow mapping of information between different brains. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2026-02-18. Recording duration: 00:50:24.
Computing the effects of excitatory-inhibitory balance on neuronal input-output properties
In sensory systems, stimuli are represented through the diverse firing responses and receptive fields of neurons. These features emerge from the interaction between excitatory (E) and inhibitory (I) neuron populations within the network. Changes in sensory inputs alter this balance, leading to shifts in firing patterns and the input-output properties of individual neurons and the network. While these phenomena have been studied extensively with experiments and theory, the underlying principles for combining E and I inputs are still unclear. Here, the rules for probabilistically combining E and I inputs are derived that describe how neurons in a feedforward inhibitory circuit respond to stimuli. This simple model is broadly applicable, capturing a wide range of response features that would otherwise require multiple separate models and offers insights into the cellular and network mechanisms influencing the input-output properties of neurons, gain modulation, and the emergence of diverse temporal firing patterns. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2026-02-11. Recording duration: 00:48:34.
What is So Interesting About Reinforcement Learning?
This talk aims to answer these questions along four dimensions. First is history. RL was the basis of AI long before the term AI was introduced in 1956. The first machine learning (ML) systems were based on RL even before digital computers existed. Despite notable early successes of ML based on RL, RL essentially disappeared from ML until relatively recently. A second reason for renewed interest in RL is the clarification of some misunderstandings that have been prevalent in the ML community. A third, and most important, reason for this resurgence is that new, or rediscovered, algorithms and connections to well developed mathematical and engineering methods have been worked out. Finally, a fourth reason for the renewed interest in RL is its strong links to animal reward systems, in particular, to the role that dopamine plays in motivation and learning. VVTNS Sixth Season Opening Lecture. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2025-10-29. Recording duration: 00:55:21.
Insights into vision from interpreting a neuronal wiring diagram
In 2023, the FlyWire Consortium released the neuronal wiring diagram of an adult fly brain. This contains as a corollary the first complete wiring diagram of a visual system, which has been used to identify all 200+ cell types that are intrinsic to the Drosophila optic lobe. About half of these cell types were previously unknown, and less than 20% have ever been recorded by a physiologist. I will argue that plausible functions for many cell types can be guessed by interpreting the wiring diagram. VVTNS Fifth Season Closing Lecture. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2025-06-25. Recording duration: 00:42:39.
From neurons to Newtons: Brain evolution as a machine learning problem
We have entered a golden age of artificial intelligence research, driven mainly by the advances in the artificial neural networks over the last several decades. Applications of these techniques—to machine vision, speech recognition, autonomous vehicles, natural language, and many other domains—are coming so quickly that many observers predict that the long-elusive goal of “Artificial General Intelligence” (AGI) is within our grasp. However, we still cannot build a machine capable of building a nest, stalking prey, or loading a dishwasher. I will describe how evolution may have shaped the algorithms that the brain is using to solve some of these challenging problems. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2025-05-21. Recording duration: 00:44:20.
Learning generative dynamical systems models from multi-modal and multi-animal neuro-data
For decades dynamical systems theory played a pivotal role in theoretical and computational neuroscience, as it links biophysical and biochemical processes to neural computation. In fact, dynamical systems are computationally universal. Rather than hand-crafting computational theories of neural function based on dynamical systems, recent developments in scientific machine learning (ML) and AI suggest that we may be able to infer such dynamical-computational models directly from neurophysiological and behavioral observations. This is called dynamical systems reconstruction (DSR), the learning of generative surrogate models of the underlying dynamics, including its long-term temporal and geometrical properties, from time series data. In my talk I will cover recent ML/AI architectures, training algorithms, and validation procedures for DSR. I will discuss specifically how recent AI architectures for DSR can integrate neuroscience data from multiple modalities (like multiple single-unit recordings and behavioral choices), across diverse time scales, and across many different animals and task designs, into a joint DSR model. This provides first steps toward dynamical systems based AI foundation models for neuroscience. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2025-04-23. Recording duration: 00:53:24.
Active learning of neural population dynamics
Recent advances in techniques for monitoring and perturbing neural populations have greatly enhanced our ability to study circuits in the brain. In particular, two-photon holographic optogenetics now enables precise photostimulation of experimenter-specified groups of individual neurons, while simultaneous two-photon calcium imaging enables the measurement of ongoing and induced activity across the neural population. Despite the enormous space of potential photostimulation patterns and the time-consuming nature of photostimulation experiments, very little algorithmic work has been done to determine the most effective photostimulation patterns for identifying the neural population dynamics. Here, I will discuss ongoing development of active learning techniques to efficiently select which neurons to stimulate such that the resulting neural responses will best inform a dynamical model of the neural population activity. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2025-02-05. Recording duration: 00:42:29.
Dense Associative Memory and its potential role in brain computation
Dense Associative Memories (Dense AMs) are energy-based neural networks that share many desirable features of celebrated Hopfield Networks but have superior information storage capabilities. In contrast to conventional Hopfield Networks, which were popular in the 1980s, DenseAMs have a very large memory storage capacity - possibly exponential in the size of the network. This aspect makes them appealing tools for many problems in AI and neurobiology. In this talk I will describe two theories of how DenseAMs might be built in biological “hardware”. According to the first theory, DenseAMs arise as effective theories after integrating out a large number of neuronal degrees of freedom. According to the second theory, astrocytes, a particular type of glia cells, serve as core computational units enabling large memory storage capabilities. This second theory challenges a common point of view in the neuroscience community that astrocytes play the role of only passive house-keeping support structures in the brain. In contrast, it suggests that astrocytes might be actively involved in brain computation and memory storage and retrieval. This story is an illustration of how computational principles originating in physics may provide insights into novel AI architectures and brain computation. VVTNS New Year Opening Lecture. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2025-01-08. Recording duration: 00:49:16.
The Brain Prize winners' webinar
This webinar brings together three leaders in theoretical and computational neuroscience—Larry Abbott, Haim Sompolinsky, and Terry Sejnowski—to discuss how neural circuits generate fundamental aspects of the mind. Abbott illustrates mechanisms in electric fish that differentiate self-generated electric signals from external sensory cues, showing how predictive plasticity and two-stage signal cancellation mediate a sense of self. Sompolinsky explores attractor networks, revealing how discrete and continuous attractors can stabilize activity patterns, enable working memory, and incorporate chaotic dynamics underlying spontaneous behaviors. He further highlights the concept of object manifolds in high-level sensory representations and raises open questions on integrating connectomics with theoretical frameworks. Sejnowski bridges these motifs with modern artificial intelligence, demonstrating how large-scale neural networks capture language structures through distributed representations that parallel biological coding. Together, their presentations emphasize the synergy between empirical data, computational modeling, and connectomics in explaining the neural basis of cognition—offering insights into perception, memory, language, and the emergence of mind-like processes.
Back to the Continuous Attractor
Continuous attractors offer a unique class of solutions for storing continuous-valued variables in recurrent system states for indefinitely long time intervals. Unfortunately, continuous attractors suffer from severe structural instability in general---they are destroyed by most infinitesimal changes of the dynamical law that defines them. This fragility limits their utility especially in biological systems as their recurrent dynamics are subject to constant perturbations. We observe that the bifurcations from continuous attractors in theoretical neuroscience models display various structurally stable forms. Although their asymptotic behaviors to maintain memory are categorically distinct, their finite-time behaviors are similar. We build on the persistent manifold theory to explain the commonalities between bifurcations from and approximations of continuous attractors. Fast-slow decomposition analysis uncovers the existence of a persistent slow manifold that survives the seemingly destructive bifurcation, relating the flow within the manifold to the size of the perturbation. Moreover, this allows the bounding of the memory error of these approximations of continuous attractors. Finally, we train recurrent neural networks on analog memory tasks to support the appearance of these systems as solutions and their generalization capabilities. Therefore, we conclude that continuous attractors are functionally robust and remain useful as a universal analogy for understanding analog memory. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2024-11-27. Recording duration: 00:59:01.
Learning and prediction in artificial deep neural networks: scaling, data manifolds, and universality
Developing scientifically-grounded theories for representation learning and generalization in artificial deep neural networks remains a grand challenge of fundamental interest to theoretical neuroscience and machine learning. I will discuss our work on one facet of this challenge — namely understanding generalization or “scaling laws” in learned neural networks as a function of basic control variables. I’ll discuss a taxonomy we develop that classifies different regimes of scaling behavior. We identify regimes where generalization exhibits universal scaling behavior and others where it can be traced back to properties of the data and neural architecture. The theoretical analysis is enabled by leveraging exactly solvable models of deep neural networks that arise naturally in the limit of large hidden layers. Along the way, I’ll also discuss our work on these theoretical models, which have been a useful starting point for theoretical descriptions of neural network dynamics. Finally, I’ll discuss our findings connecting generalization in neural networks to properties of the learned data manifold. I’ll close by discussing future directions and new hypotheses that emerge from our findings Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2024-06-19. Recording duration: 00:46:53.
How random connections and motifs shape the covariance spectrum of recurrent network dynamics
Theoretical neuroscience aims to understand the relationship between neuron dynamics and connectivity in recurrent circuits. This has been intensively studied at the local level, where dynamics is described by pairwise correlations. Recent advances in simultaneous recordings of many neurons have allowed researchers to address the question at the global level, such as for the dimensionality of population dynamics. Our work contributes to this effort by analyzing the impact of connectivity statistics, including certain motifs, on the bulk and outlier covariance eigenvalues. By considering linearized dynamics around a steady state, we obtained analytically the covariance spectrum which exhibits a signature long tail robust to model variants and matches zebrafish calcium imaging data. This provides a local circuit mechanism for shaping the geometry of population dynamics and a quantitative benchmark for interpreting data. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2024-05-22. Recording duration: 00:53:15.
Flip flops and toggles for effective decision making in neural circuits
Neural computation is inextricably bound to decisions that must be made under time pressure and uncertainty. At the level of neural circuits, single neurons need to decide whether to spike. On longer timescales, the component circuitry needs to decide whether to reconfigure to store memories and adapt to novel situations. In this talk I will focus on two fun ideas in each of these contexts by showing how nonlinearities in neural components naturally form excitable switches that enable reliable decisions to be made in fluctuating environments. I will also issue propaganda that the kind of high level, cognitive faculties that we normally associate with decision making apply equally well and are understudied at the level of neural and synaptic populations. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2024-04-17. Recording duration: 00:41:08.
Prediction of neural activity in connectome-constrained recurrent networks
In this talk, I will explain a theory of connectome-constrained neural networks in which a “student” networks is trained to reproduce the activity of a ground-truth “teacher”, representing a neural system for which a connectome is available. Unlike standard paradigms with unconstrained connectivity, here both networks have the same connectivity but they have different biophysical parameters, reflecting uncertainty in neuronal and synaptic properties. We find that the connectome is often insufficient to constrain the dynamics of networks that perform a specific task, illustrating the difficulty of inferring function from connectivity alone. However, recordings from a small subset of neurons can remove this degeneracy, producing dynamics in the student that agree with the teacher. Our theory can prioritize which neurons to record from to most efficiently unmeasured network activity. The analysis shows that the solution spaces of connectome-constrained and unconstrained models are qualitatively different, and provides a framework to determine when such models yield consistent dynamics. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2024-04-03. Recording duration: 00:42:28.
Rethinking behavior in the light of evolution
In theoretical neuroscience, the brain is usually described as an information processing system that encodes and manipulates representations of knowledge to produce plans of action. This view leads to a decomposition of brain functions into putative processes such as object recognition, working memory, decision-making, action planning, etc., inspiring the search for the neural correlates of these processes. However, neurophysiological data do not support many of the predictions of these classic subdivisions. Instead, there is divergence and broad distribution of functions that should be unified, mixed representations combining functions that should be distinct, and a general incompatibility with the conceptual subdivisions posited by theories of information processing. In this talk, I will explore the possibility of resynthesizing a different set of functional subdivisions, guided by the growing body of data on the evolutionary process that produced the human brain. I will summarize, in chronological order, a proposed sequence of innovations that appeared in nervous systems along the lineage that leads from the earliest multicellular animals to humans. Along the way, functional subdivisions and elaborations will be introduced in parallel with the neural specializations that made them possible, gradually building up an alternative conceptual taxonomy of brain functions. These functions emphasize mechanisms for real-time interaction with the world, rather than for building explicit knowledge of the world, and the relevant representations emphasize pragmatic outcomes rather than decoding accuracy, mixing variables in the way seen in real neural data. I suggest that this alternative taxonomy may better delineate the real functional pieces into which the brain is organized, and can offer a more natural mapping between behavior and neural mechanisms. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2024-03-13. Recording duration: 00:52:50.
Neural mechanisms of adaptive behavior
Animals and humans rapidly adapt their behavior to dynamic environmental changes, such as predator threats or fluctuating food resources, often without immediate rewards. Existing literature posits that animals rely on internal representations of the environment, termed “beliefs”, for their decision policy. However, previous work ties belief updates to external reward signals, which does not explain adaptation in scenarios where trial-and-error approaches are inefficient or potentially perilous. In this work, we propose that the brain utilize dynamic representations that continuously infer the state of the environment, allowing it to update behavior rapidly. I will present a Bayesian theory for state inference in a partially observed Markov Decision Process with multiple interacting latent variables. Optimal behavior requires knowledge of hidden interactions between latent states. I will show that recurrent neural networks trained through reinforcement solve the task by learning the hidden interaction between latent states, and their activity encodes the dynamics of the optimal Bayesian estimators. The behavior of rodents trained on an identical task aligns with our theoretical model and neural network simulations, suggesting that the brain utilizes dynamic internal state representation and inference. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2024-01-31. Recording duration: 00:51:21.
Matrix Factorization with Neural Networks
The factorization of a large matrix into the product of two matrices is an important mathematical problem encountered in many tasks, ranging from dictionary learning to machine learning. Statistical physics can provide on the one hand theoretical limits on the possibility of factorizing matrices in the limit of infinite size, and also practical algorithms. While this program has been successful in the case of finite rank matrices, the regime of extensive rank (scaling linearly with the dimension of the matrix) turns out to be much harder. This talk will describe a new approach to matrix factorization that maps it to neural network models of associative memory: each pattern found in the associative memory corresponds to one factor of the matrix decomposition. A detailed theoretical analysis of this new approach shows that matrix factorization in the extensive rank regime is possible when the rank is below a certain threshold. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2024-01-03. Recording duration: 00:44:31.
A unifying framework for movement control and decision making
To understand subjective evaluation of an option, various disciplines have quantified the interaction between reward and effort during decision making, producing an estimate of economic utility, namely the subject ‘goodness’ of an option. However, those same variables that affect the utility of an option also influence the vigor (speed) of movements to acquire it. To better understand this, we have developed a mathematical framework demonstrating how utility can influence not only the choice of what to do, but also the speed of the movement follows. I will present results demonstrating that expectation of reward increases speed of saccadic eye and reaching movements, whereas expectation of effort expenditure decreases this speed. Intriguingly, when deliberating between two visual options, saccade vigor to each option increases differentially, encoding their relative value. These results and others imply that vigor may serve as a new, real-time metric with which to quantify subjective utility, and that the control of movements may be an implicit reflection of the brain’s economic evaluation of the expected outcome. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2023-10-18. Recording duration: 00:45:32.
Vasomotor dynamics: Measuring, modeling, and understanding the other network in the brain
Much as Santiago Ramón y Cajal is the godfather of neuronal computation, which occurs among neurons that communicate predominantly via threshold logic, Camillo Golgi is the inadvertent godfather of neurovascular signaling, in which the endothelial cells that form the lumen of blood vessels communicate via electrodiffusion as well as threshold logic. I will address questions that define spatiotemporal patterns of constriction and dilation that develop across the network of cortical vasculature: First - is there a common topology and geometry of brain vasculature (our work)? Second - what mechanisms govern neuron-to-vessel and vessel-to-vessel signaling (work of Mark Nelson at U Vermont)? Last - what is the nature of competition among arteriole smooth muscle oscillators and the underlying neuronal drive (our work)? This answers to these questions bear on fundamental aspects of brain science as well as practical issues, including the relation of fMRI signals to neuronal activity and the impact of vascular dysfunction on cognition. Challenges and opportunities for experimentalists and theorists alike will be discussed. The organizer explicitly announced an exceptional 11:15 am ET start. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2023-10-11. Recording duration: 00:56:46.
What does a neuron do? A new model for Neuroscience and AI
The traditional view of a neuron as a feature detector or an efficient encoder has difficulties in explaining the function of motor neurons and experimentally observed variable and context-dependent response properties of neurons. We put forward an alternative perspective, modeling each neuron as a feedback controller within a closed loop that includes other neurons and the external environment. Based on the recently developed Direct Data-Driven Control (DD-DC) approach, we propose a biologically plausible controller which implicitly identifies the dynamics of the rest of the loop, infers its latent state and optimizes control. The DD-DC model of a neuron accounts for multiple neurophysiological observations, including the switch from potentiation to depression in Spike-Timing-Dependent Plasticity (STDP) and its asymmetry; temporally extended feedforward and feedback neuronal filters and their adaptation to input statistics; imprecision of the neuronal spike-generation mechanism under constant input; as well as the prevalence of variability and/or noise in brain operation. The DD-DC neuron offers an alternative to the feedforward, instantaneously responding McCulloch-Pitts-Rosenblatt unit as a primitive for constructing biologically-inspired neural networks. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2023-06-28. Recording duration: 00:52:20.
Bernstein Student Workshop Series
The Bernstein Student Workshop Series is an initiative of the student members of the Bernstein Network. It provides a unique opportunity to enhance the technical exchange on a peer-to-peer basis. The series is motivated by the idea of bridging the gap between theoretical and experimental neuroscience by bringing together methodological expertise in the network. Unlike conventional workshops, a talented junior scientist will first give a tutorial about a specific theoretical or experimental technique, and then give a talk about their own research to demonstrate how the technique helps to address neuroscience questions. The workshop series is designed to cover a wide range of theoretical and experimental techniques and to elucidate how different techniques can be applied to answer different types of neuroscience questions. Combining the technical tutorial and the research talk, the workshop series aims to promote knowledge sharing in the community and enhance in-depth discussions among students from diverse backgrounds.
Bernstein Student Workshop Series
The Bernstein Student Workshop Series is an initiative of the student members of the Bernstein Network. It provides a unique opportunity to enhance the technical exchange on a peer-to-peer basis. The series is motivated by the idea of bridging the gap between theoretical and experimental neuroscience by bringing together methodological expertise in the network. Unlike conventional workshops, a talented junior scientist will first give a tutorial about a specific theoretical or experimental technique, and then give a talk about their own research to demonstrate how the technique helps to address neuroscience questions. The workshop series is designed to cover a wide range of theoretical and experimental techniques and to elucidate how different techniques can be applied to answer different types of neuroscience questions. Combining the technical tutorial and the research talk, the workshop series aims to promote knowledge sharing in the community and enhance in-depth discussions among students from diverse backgrounds.
Bernstein Student Workshop Series
The Bernstein Student Workshop Series is an initiative of the student members of the Bernstein Network. It provides a unique opportunity to enhance the technical exchange on a peer-to-peer basis. The series is motivated by the idea of bridging the gap between theoretical and experimental neuroscience by bringing together methodological expertise in the network. Unlike conventional workshops, a talented junior scientist will first give a tutorial about a specific theoretical or experimental technique, and then give a talk about their own research to demonstrate how the technique helps to address neuroscience questions. The workshop series is designed to cover a wide range of theoretical and experimental techniques and to elucidate how different techniques can be applied to answer different types of neuroscience questions. Combining the technical tutorial and the research talk, the workshop series aims to promote knowledge sharing in the community and enhance in-depth discussions among students from diverse backgrounds.
Neural network mechanisms of flexible, robust & efficient cognitive motor control
One of the fundamental functions of the brain is to flexibly plan and control movement production at different timescales in order to efficiently shape structured behaviors. I will present research investigating how these complex computations are performed in the mammalian brain, with an emphasis on autonomous motor control. Specifically, I will focus on the mechanisms supporting efficient interfacing between 'higher-level' planning commands and 'lower-level' motor cortical dynamics that ultimately drive muscles. I will take advantage of the fact that the anatomy of the circuits underlying motor control is well known. It notably involves the primary motor cortex, a recurrent network that generates learned commands to drive muscles while interacting through loops with thalamic neurons that lack recurrent excitation. Using an analytically tractable model that incorporates these architectural constraints, I will explain how this motor circuit can implement a form of efficient modularity by combining (i) plastic thalamocortical loops that are movement-specific and (ii) shared hardwired circuits. I will show that this modular architecture can balance two different objectives: first, supporting the flexible recombination of an extensible library of re-usable motor primitives; and second, promoting the efficient use of neural resources by taking advantage of shared connections between modules. I will finally show that these insights are relevant for designing artificial neural networks able to flexibly and robustly compose hierarchical analog behaviors from a library of motor primitives. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2023-01-11. Recording duration: 00:49:52.
Invariant neural subspaces maintained by feedback modulation
This session is a double feature of the Cologne Theoretical Neuroscience Forum and the Institute of Neuroscience and Medicine (INM-6) Computational and Systems Neuroscience of the Jülich Research Center.
Homage to Carl van Vreeswijk (1962–2022)
Carl van Vreeswijk (1962-2022) Carl van Vreeswijk passed away on the 13th of April, 2022, in Paris, as he was getting ready to go to the lab for the WWTNS of the week. Carl was an exceptionally gifted theoretical neuroscientist. With his deep understanding of theoretical tools, his curiosity and collaborations with experimentalists, he introduced and developed many pioneering concepts and techniques which have shaped our current understanding of recurrent neuronal networks and cortical dynamics. Beyond his prolific scientific wisdom and creativity, Carl was an inspiration to many, a generous and beloved friend and collaborator, and an extraordinarily caring mentor. He was keen on teaching. He spent ample time bringing his exceptional knowledge to many young researchers over many summer schools, workshops, and conferences. The World Wide Theoretical Neuroscience Seminar (WWTNS) series, that Carl and I founded (November 2020) as a space where theoreticians can present their work in-depth, including equations and mathematical tools will be renamed the "van Vreeswijk Theoretical Neuroscience Seminar" (VVTNS) series to honour his memory. David Hansel The provider supplies a memorial description; a complete speaker roster is not published. Carl van Vreeswijk is the person commemorated, not a listed speaker. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2022-04-27. Recording duration: 00:35:48.
Theory of recurrent neural networks – from parameter inference to intrinsic timescales in spiking networks
Perceptual Inference, Uncertainty and Representation
To act effectively and flexibly in an imperfectly predictable environment with only incomplete and unreliable sensory information, animals must learn to form and compute with internal representations that reflect their necessarily uncertain beliefs about the state of the world. The optimal approach to handling uncertainty is rooted in Bayesian probability, and indeed humans and other animals often approach Bayes optimality with a degree of robustness and flexibility that continues to evade artificial systems. However, the question of how neural circuits organise to achieve this performance remains one of the fundamental mysteries of neuroscience. I will discuss a series of models built around the idea that distributional information is naturally encoded in a distributed fashion by neural population firing rates that converge on the mean values of non-linear functions of state. We will see that such representations emerge naturally in task-optimised systems, and also provide a simple and effective substrate for unsupervised learning. Finally, I will sketch ongoing work that links the emergence of such representations to the architecture of recurrent neural circuits. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2021-07-07. Recording duration: 00:52:28.
Pattern formation in biological neural networks with rebound currents
Waves and patterns in the brain are well known to subserve natural computation. Much attention in the theoretical neuroscience community has been devoted to analysing networks of relatively simple spiking neurons (IF type) or firing rate models (Wilson-Cowan type) and to great effect! Indeed, the understanding of how spatio-temporal patterns of neural activity may arise in the cortex has advanced significantly with the development and analysis of such models. To replicate this success for sub-cortical tissues requires an extension to include relevant ionic currents that can further shape firing response. Here I will advocate for two complementary approaches: i) that augments the approach for IF networks to include piecewise linear caricatures of gating dynamics for nonlinear ionic current models, ii) firing rate reductions for systems where the nonlinear ionic currents are slow. By way of illustration, I will show how to construct spatially periodic waves and patterns in i) a simple spiking tissue model of medial enthorinal cortex (with an I_h current), ii) a firing rate model of thalamus (with an I_T current). The biological commonality between these two models is that both express local 'rebound' currents that can usefully shape global tissue response. The mathematical commonality is the use of tools from non-smooth dynamical systems theory to make analytical progress in determining patterns and their stability. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2021-06-30. Recording duration: 00:40:23.
Ten theorems about threshold-linear networks
Threshold-linear networks (TLNs) are popular firing rate models of recurrent networks. They have been used to model associative memory, decision-making, and position coding in cortical and hippocampal networks. Unlike rate models with other choices of nonlinearity, TLNs are piecewise linear, making them more amenable to mathematical analysis. In this talk I will present ten theorems about TLNs from the past five years. Many of these theorems connect the fixed points of a network to the structure of an underlying connectivity graph. These results have enabled us to develop graph rules to predict both static and dynamic attractors from network motifs. The theorems will be complemented with examples that illustrate how the mathematical results can be used to analyze and design recurrent networks that support a rich variety of computations and dynamics. Examples include internally-generated sequences, neural integrators, and central pattern generator circuits. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2021-06-23. Recording duration: 00:53:51.
(Two or) three easy pieces
(1) We (Grace Lindsay) used convolutional neural nets to model attention, by scaling the input/output function of neurons in an imagenet-trained network according to their selectivity for the feature or object category being attended. While this was effective in improving performance on difficult tasks, it was far less effective in earlier than in later layers. This indicated that neurons selective for a feature in earlier layers did not necessarily drive neurons selective for that feature in later layers. In contrast, applying attention according to the gradient for improving task performance worked well in early as well as late layers. This raises the question whether biological attentional modulation might reflect task requirements and not only the features of the stimuli to be attended. We suggest a simple experiment to answer this question, which we hope to convince an appropriate lab to carry out. (2) In E/I networks, a "paradoxical" response to stimulation has been shown: If the excitatory neurons would be unstable by themselves, but are stabilized by feedback inhibition (an "inhibition-stabilized network", or ISN), then, in response to addition of excitatory input to inhibitory neurons, their steady-state firing rates paradoxically decrease. In circuits with multiple inhibitory cell types, this has been generalized: in an ISN, if there is an added stimulus only to inhibitory cells, there will be a paradoxical change in the net inhibition received by excitatory cells -- e.g., if excitatory firing rates increase, so too will the net inhibition they receive. This does not imply that the firing rates of any particular inhibitory cell type will change paradoxically. Here we (Agostina Palmigiano along with Francesco Fumarola, and experimental work of Dan Mossing in the Adesnik lab) generalize the conditions for a paradoxical firing rate response, including in responses to partial as well as full perturbation of the neurons of a given cell type. We work in the context of the circuit with three inhibitory cell types (PV, SOM, VIP) in mouse V1. We show that, if a given cell type shows a paradoxical response to its own full stimulation, then the circuit without that cell type is unstable. This and experimental results to date, as well as our models fitted to data, suggest that PV but not SOM interneurons stabilize the circuit of layer 2/3 of mouse V1, at least for smaller visual stimulus sizes. For partial perturbations of a fraction f of a cell type that responds paradoxically to a full perturbation, there is a "fractional paradoxical effect": the proportion of all the cells of that type, stimulated and unstimulated, that respond opposite to the stimulation (i.e. negative response to excitation), changes non-monotonically, approaching 1 for f→0, decreasing with increasing f, and then increasing again to again approach 1 as f→1. I'll explain the origins of this behavior.3) We (Mario Dipoppa, in collaboration with the experimental work of Andy Keller and Morgane Roth from the Scanziani lab) have studied the E-PV-SOM-VIP circuit underlying contextual modulation in layer 2/3 of mouse V1. Experiments showed that E, PV, and VIP are suppressed by a surround stimuus that has the same orientation as, but not by one orthogonal to, the center stimulus. SOM neurons show the opposite behavior, being suppressed by an orthogonal but much less by a parallel surround. A combination of theory and optogenetic experiments show that the disinhibitory circuit -- VIP inhibits SOM, which inhibits E -- modulate responses between the two conditions. However, it does so, as part of the recurrent circuit, primarily by changing the recurrent excitation E cells receive, rather than by directly changing the inhibition received, in a manner reminiscent of the paradoxical response. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2021-06-09. Recording duration: 00:51:59.
Low Dimensional Manifolds for Neural Dynamics
The ability to simultaneously record the activity from tens to thousands to tens of thousands of neurons has allowed us to analyze the computational role of population activity as opposed to single neuron activity. Recent work on a variety of cortical areas suggests that neural function may be built on the activation of population-wide activity patterns, the neural modes, rather than on the independent modulation of individual neural activity. These neural modes, the dominant covariation patterns within the neural population, define a low dimensional neural manifold that captures most of the variance in the recorded neural activity. We refer to the time-dependent activation of the neural modes as their latent dynamics, and argue that latent cortical dynamics within the manifold are the fundamental and stable building blocks of neural population activity. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2021-03-17. Recording duration: 00:47:16.
Reading out responses of large neural populations with minimal information loss
Classic studies show that in many species – from leech and cricket to primate – responses of neural populations can be quite successfully read out using a measure neural population activity termed the population vector. However, despite its successes, detailed analyses have shown that the standard population vector discards substantial amounts of information contained in the responses of a neural population, and so is unlikely to accurately describe how signal communication between parts of the nervous system. I will describe recent theoretical results showing how to modify the population vector expression in order to read out neural responses without information loss, ideally. These results make it possible to quantify the contribution of weakly tuned neurons to perception. I will also discuss numerical methods that can be used to minimize information loss when reading out responses of large neural populations. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2021-03-03. Recording duration: 00:45:35.
Neural network models – analysis of their spontaneous activity and their response to single-neuron stimulation
Learning from learning in recurrent neural networks
Learning a new skill requires assimilating into our brain the regularities of the external world and how our body interacts with them as we engage in this skill. Trained Recurrent Neural Networks (TRNNs) are increasingly used as models of neural circuits of animals that were trained in laboratory setups, but the learning process itself has received less attention. Furthermore, most use of TRNNs is of a heuristic, rather than theory-based, nature, leaving many open questions: Which tasks yield to this approach and why? How do initial network architecture and learning rules bias the resultant network? In this talk, I will argue that studying the learning process of TRNNs can both advance our understanding of TRNNs and set up possible comparisons to the biological process of learning. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2021-01-06. Recording duration: 00:42:41.