Chaos Theory seminars

Large recurrent networks are important models in several fields, including neuroscience, machine learning, physics, and applied mathematics. Yet their dynamics are difficult to study directly, because high-dimensional nonlinear systems can exhibit rich behavior that is hard to summarize in terms of individual trajectories. In this talk, I will discuss an approach that seeks to understand such dynamics through the structure of the network’s equilibria. I will focus on a random balanced network of threshold-linear units that undergoes a transition from a single stable equilibrium to extensive chaos as the disorder strength crosses a critical value. Using a combination of Kac–Rice theory, replica calculations, numerical root-finding, and dynamical mean-field theory, we show that the chaotic regime contains an exponentially large number of equilibria. These equilibria are all saddles, but with only a fractionally small number of unstable directions. Surprisingly, despite the completely random connectivity, the equilibria are not scattered randomly through phase space. Instead, they are strongly correlated and confined to a comparatively small region. The chaotic attractor lies within this same region, suggesting a direct geometric link between the organization of unstable equilibria and the collective structure of the dynamics. This picture helps explain why networks with extensive chaos can nevertheless display dynamics dominated by a relatively small number of collective modes. More broadly, the results suggest that the geometry of equilibria provides a useful complementary perspective to dynamical mean-field theory for understanding high-dimensional neural dynamics. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2026-05-27. Recording duration: 00:46:40.

Vijay Balasubramanian connects quantum chaos with the complexity of time evolution. One approach bounds the smallest circuit needed to simulate physical dynamics; another measures how quickly and ergodically a state explores its accessible Hilbert space. Examples from spin chains, billiards, many-body systems and random matrices distinguish chaotic and integrable behaviour. Applications address geometric conjectures for complexity in quantum gravity and possible failure of effective field theory near spacelike singularities.

Computations in neural circuits are often construed as being implemented through the coordinated dynamics of neurons. In this picture, the role of synaptic connectivity is to sculpt neuronal dynamics to implement computations of interest. Of course, synapses are not static but change on a variety of timescales, including fast timescales comparable to those of neurons. Thus, a more accurate view of computation in neural circuits may involve the coupled dynamics of neurons and synapses. This form of computation is closer to what is implemented by Transformers via an equivalence between ongoing synaptic plasticity and self-attention. I will first describe a nonlinear recurrent neural-network model with ongoing Hebbian dynamics of “fast” synapses atop unstructured “slow” synapses. I will then describe two computations implemented through neuronal-synaptic dynamics, which can be studied in this model using techniques including dynamical mean-field theory and random-matrix theory. First, there exists a novel phase termed “freezable chaos” in which a stable fixed point of neuronal dynamics is continuously destabilized by synaptic dynamics. This allows for the creation of a stable fixed point at any neuronal state visited by the network by halting synaptic plasticity. Second, I will describe an effect termed “persistent oscillations” in which, following stimulation by a periodic signal, a plastic network continues to autonomously reproduce a similar signal for a duration exceeding any intrinsic timescale in the system. Thus, ongoing Hebbian plasticity can provide a dynamic form of working memory, complementing the static form provided by freezable chaos. Ongoing experimental work suggests that this effect is realized in cortical organoids. Overall, this line of work suggests that synapses should be promoted to first-class dynamical degrees of freedom in our conceptual understanding of neural-circuit function. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2026-01-14. Recording duration: 00:43:14.

Neural circuits exhibit complex activity patterns, both spontaneously and in response to external stimuli. Information encoding and learning in neural circuits depend on the ability of time-varying stimuli to control spontaneous network activity. In particular, variability arising from the sensitivity to initial conditions of recurrent cortical circuits can limit the information conveyed about the sensory input. Spiking and firing rate network models can exhibit such sensitivity to initial conditions that are reflected in their dynamic entropy rate and attractor dimensionality computed from their full Lyapunov spectrum. I will show how chaos in both spiking and rate networks depends on biophysical properties of neurons and the statistics of time-varying stimuli. In spiking networks, increasing the input rate or coupling strength aids in controlling the driven target circuit, which is reflected in both a reduced trial-to-trial variability and a decreased dynamic entropy rate. With sufficiently strong input, a transition towards complete network state control occurs. Surprisingly, this transition does not coincide with the transition from chaos to stability but occurs at even larger values of external input strength. Controllability of spiking activity is facilitated when neurons in the target circuit have a sharp spike onset, thus a high speed by which neurons launch into the action potential. I will also discuss chaos and controllability in firing-rate networks in the balanced state. For these, external control of recurrent dynamics strongly depends on correlations in the input. This phenomenon was studied with a non-stationary dynamic mean-field theory that determines how the activity statistics and the largest Lyapunov exponent depend on frequency and amplitude of the input, recurrent coupling strength, and network size. This shows that uncorrelated inputs facilitate learning in balanced networks. The results highlight the potential of Lyapunov spectrum analysis as a diagnostic for machine learning applications of recurrent networks. They are also relevant in light of recent advances in optogenetics that allow for time-dependent stimulation of a select population of neurons.

Neuronal variability is a reflection of recurrent circuitry and cellular physiology. The modulation of neuronal variability is a reliable signature of cognitive and processing state. A pervasive yet puzzling feature of cortical circuits is that despite their complex wiring, population-wide shared spiking variability is low dimensional with all neurons fluctuating en masse. We show that the spatiotemporal dynamics in a spatially structured network produce large population-wide shared variability. When the spatial and temporal scales of inhibitory coupling match known physiology, model spiking neurons naturally generate low dimensional shared variability that captures in vivo population recordings along the visual pathway. Further, we show that firing rate models with spatial coupling can also generate chaotic and low-dimensional rate dynamics. The chaotic parameter region expands when the network is driven by correlated noisy inputs, while being insensitive to the intensity of independent noise.

We study the dynamics of (inhibitory) balanced networks at varying (i) the level of symmetry in the synaptic connectivity; and (ii) the ariance of the synaptic efficacies (synaptic gain). We find three regimes of activity. For suitably low synaptic gain, regardless of the level of symmetry, there exists a unique stable fixed point. Using a cavity-like approach, we develop a quantitative theory that describes the statistics of the activity in this unique fixed point, and the conditions for its stability. Increasing the synaptic gain, the unique fixed point destabilizes, and the network exhibits chaotic activity for zero or negative levels of symmetry (i.e., random or antisymmetric). Instead, for positive levels of symmetry, there is multi-stability among a large number of marginally stable fixed points. In this regime, ergodicity is broken and the network exhibits non-exponential relaxational dynamics. We discuss the potential relevance of such a “glassy” phase to explain some features of cortical activity.