Applied Mathematics seminars

Classic studies show that in many species – from leech and cricket to primate – responses of neural populations can be quite successfully read out using a measure neural population activity termed the population vector. However, despite its successes, detailed analyses have shown that the standard population vector discards substantial amounts of information contained in the responses of a neural population, and so is unlikely to accurately describe how signal communication between parts of the nervous system. I will describe recent theoretical results showing how to modify the population vector expression in order to read out neural responses without information loss, ideally. These results make it possible to quantify the contribution of weakly tuned neurons to perception. I will also discuss numerical methods that can be used to minimize information loss when reading out responses of large neural populations.

Sylvia Serfaty studies the many-particle limit of systems driven by Coulomb or Riesz interactions through gradient flows or analogous conservative dynamics, possibly with added random diffusion. The Riesz interaction has inverse-distance exponent s between d−2 and d in dimension d. The talk presents convergence, as the number of particles tends to infinity, to the expected mean-field evolution. It also discusses deriving the Vlasov–Poisson equation from Newtonian dynamics in the monokinetic case and related results for Ginzburg–Landau vortex dynamics.

Active particles which are self-propelled by converting energy into mechanical motion represent an expanding research realm in physics and chemistry. For micron-sized particles moving in a liquid (``microswimmers''), most of the basic features have been described by using the model of overdamped active Brownian motion [1]. However, for macroscopic particles or microparticles moving in a gas, inertial effects become relevant such that the dynamics is underdamped. Therefore, recently, active particles with inertia have been described by extending the active Brownian motion model to active Langevin dynamics which include inertia [2]. In this talk, recent developments of active particles with inertia (``microflyers'', ``hoppers'' or ``runners'') are summarized including: inertial delay effects between particle velocity and self-propulsion direction [3], tuning of the long-time self-diffusion by the moment of inertia [3], the influence of inertia on motility-induced phase separation and the cluster growth exponent [4], and the formation of active micelles (“rotelles”) by using inertial active surfactants. References [1] C. Bechinger, R. di Leonardo, H. Löwen, C. Reichhardt, G. Volpe, G. Volpe, Reviews of Modern Physics 88, 045006 (2016). [2] H. Löwen, Journal of Chemical Physics 152, 040901 (2020). [3] C. Scholz, S. Jahanshahi, A. Ldov, H. Löwen, Nature Communications 9, 5156 (2018). [4] S. Mandal, B. Liebchen, H. Löwen, Physical Review Letters 123, 228001 (2019). [5] C. Scholz, A. Ldov, T. Pöschel, M. Engel, H. Löwen, Surfactants and rotelles in active chiral fluids, will be published

Microorganisms can swim in a variety of environments, interacting with chemicals and other proteins in the fluid. In this talk, we will highlight recent computational methods and results for swimming efficiency and hydrodynamic interactions of swimmers in different fluid environments. Sperm are modeled via a centerline representation where forces are solved for using elastic rod theory. The method of regularized Stokeslets is used to solve the fluid-structure interaction where emergent swimming speeds can be compared to asymptotic analysis. In the case of fluids with extra proteins or cells that may act as friction, swimming speeds may be enhanced, and attraction may not occur. We will also highlight how parameter estimation techniques can be utilized to infer fluid and/or swimmer properties.

Rigidity is the ability of a system to resist imposed stresses before ultimately undergoing failure. However, disordered materials often contain both rigid and floppy subregions that complicate the utility of taking system-wide averages. I will talk about 3 frameworks capable of connecting the internal structure of disordered materials to their rigidity and/or failure under loading, and describe how my collaborators and I have applied these frameworks to laboratory data on laser-cut lattices and idealized granular materials. These are, in order of increasing physics content: (1) centrality within an adjacency matrix describing its connectivity, (2) Maxwell constraint counting on the full network of frictional contact forces, and (3) the vibrational modes of a synthetic dynamical matrix (Hessian). The first two rely primarily on topology, and the second two contrast the utility of considering interparticle forces (Coulomb failure) vs. the energy landscape. All three methods, while successfully elucidating the origins of rigidity and brittle vs. ductile failure, also provide interesting counterpoints regarding how much information is enough to make predictions.

The structural connectivity matrix of synaptic weights between neurons is a critical determinant of overall network function. However, quantitative links between neural network structure and function are complex and subtle. For example, many networks can give rise to similar functional responses, and the same network can function differently depending on context. Whether certain patterns of synaptic connectivity are required to generate specific network-level computations is largely unknown. Here we introduce a geometric framework for identifying synaptic connections required by steady-state responses in recurrent networks of rectified-linear neurons. Assuming that the number of specified response patterns does not exceed the number of input synapses, we analytically calculate all feedforward and recurrent connectivity matrices that can generate the specified responses from the network inputs. We then use this analytical characterization to rigorously analyze the solution space geometry and derive certainty conditions guaranteeing a non-zero synapse between neurons.

Cement is the main binding agent in concrete, literally gluing together rocks and sand into the most-used synthetic material on Earth. However, cement production is responsible for significant amounts of man- made greenhouse gases—in fact if the cement industry were a country, it would be the third largest emitter in the world. Alternatives to the current, environmentally harmful cement production process are not available essentially because the gaps in fundamental understanding hamper the development of smarter and more sustainable solutions. The ultimate challenge is to link the chemical composition of cement grains to the nanoscale physics of the cohesive forces that emerge when mixing cement with water. Cement nanoscale cohesion originates from the electrostatics of ions accumulated in a water-based solution between like-charged surfaces but it is not captured by existing theories because of the nature of the ions involved and the high surface charges. Surprisingly enough, this is also the case for unexplained cohesion in a range of colloidal and biological matter. About one century after the early studies of cement hydration, we have quantitatively solved this notoriously hard problem and discovered how cement cohesion develops during hydration. I will discuss how 3D numerical simulations that feature a simple but molecular description of ions and water, together with an analytical theory that goes beyond the traditional continuum approximations, helped us demonstrate that the optimized interlocking of ion-water structures determine the net cohesive forces and their evolution. These findings open the path to scientifically grounded strategies of material design for cements and have implications for a much wider range of materials and systems where ionic water-based solutions feature both strong Coulombic and confinement effects, ranging from biological membranes to soils. Construction materials are central to our society and to our life as humans on this planet, but usually far removed from fundamental science. We can now start to understand how cement physical-chemistry determines performance, durability and sustainability.

My talk will discuss the use of some of these four, simple Matlab functions to simulate models of timing, and to fit models to empirical data. Feel free to examine the code and the relatively brief book chapter that explains the code before the talk if you would like to learn more about computational/mathematical modeling.

In daily life, we consistently make decisions in pursuit of some goal. Many decisions are informed by multiple sources of information. Unfortunately, these sources often provide ambiguous information about what course of action to take. Therefore, determining how the brain integrates information to resolve this ambiguity is key to understanding the neural mechanisms of decision-making. In the domain of time, this topic can be studied by training subjects to predict when a future event will occur based on distinct cues (e.g., tone, light, etc.). If multiple cues are presented simultaneously and their cue-to-event intervals differ (e.g., tone-10s + light-30s), subjects will often expect the event to occur at the average of their intervals. This ‘temporal averaging’ effect is presumably how the timing system resolves ambiguous time-information. The neural mechanisms of temporal averaging are currently unclear. Here, we will propose how temporal averaging could emerge in cortical circuits using a simple modification of a ‘drift-diffusion’ model of timing.

Physics offers countless examples for which theoretical predictions are astonishingly powerful. But it’s hard to imagine a similar precision in complex systems where the number and interdependencies between components simply prohibits a first-principles approach, look no further than the challenge of the billions of neurons and trillions of connections within our own brains. In such settings how do we even identify the important theoretical questions? We describe a systems-scale perspective in which we integrate information theory, dynamical systems and statistical physics to extract understanding directly from measurements. We demonstrate our approach with a reconstructed state space of the behavior of the nematode C. elegans, revealing a chaotic attractor with symmetric Lyapunov spectrum and a novel perspective of motor control. We then outline a maximally predictive coarse-graining in which nonlinear dynamics are subsumed into a linear, ensemble evolution to obtain a simple yet accurate model on multiple scales. With this coarse-graining we identify long timescales and collective states in the Langevin dynamics of a double-well potential, the Lorenz system and in worm behavior. We suggest that such an ``inverse’’ approach offers an emergent, quantitative framework in which to seek rather than impose effective organizing principles of complex systems.

Multistable structures can reversibly change between multiple stable configurations when a sufficient energetic input is provided. While originally the field focused on understanding what governs the snapping, more recently it has been shown that these systems also provide a powerful platform to design a wide range of smart structures. In this talk, I will first show that pressure-deployable origami structures characterized by two stable configurations provide opportunities for a new generation of large-scale inflatable structures that lock in place after deployment and provide a robust enclosure through their rigid faces. Then, I will demonstrate that the propagation of transition waves in a bistable one-dimensional linkage can be exploited as a robust mechanism to realize structures that can be quickly deployed. Finally, while in the first two examples multistability is harnessed to realize deployable architectures, I will demonstrate that bistable building blocks can also be exploited to design crawling and jumping robots. Unlike previously proposed robots that require complex input control of multiple actuators, a simple, slow input signal suffices to make our system move, as all features required for locomotion are embedded into the architecture of the building blocks.

Activity patterns of neural populations in natural and artificial neural networks constitute representations of data. The nature of these representations and how they are learned are key questions in neuroscience and deep learning. In his talk, I will describe my group's efforts in building a theory of representations as feature maps leading to sample efficient function approximation. Kernel methods are at the heart of these developments. I will present applications to deep learning and neuronal data.

I shall present two recent piece of work investigating how shape effects the transport of active particles in shear. Firstly we will consider the sedimentation of particles in 2D laminar flow fields of increasing complexity; and how insights from this can help explain why turbulence can enhance the sedimentation of negatively buoyant diatoms [1]. Secondly, we will consider the 3D transport of elongated active particles under the action of an aligning force (e.g. gyrotactic swimmers) in some simple flow fields; and will see how shape can influence the vertical distribution, for example changing the structure of thin layers [2]. [1] Enhanced sedimentation of elongated plankton in simple flows (2018). IMA Journal of Applied Mathematics W Clifton, RN Bearon, & MA Bees. [2] Elongation enhances migration through hydrodynamic shear (in Prep), RN Bearon & WM Durham.

The dream of programmable matter is to create materials whose physical properties (shape, moduli, response to perturbations, etc.) can be changed on the fly. For many years, my group has been thinking about how to program flat sheets that fold up into three dimensional shapes, most recently by exploiting the principles of origami design. Unfortunately, a combinatorial explosion of folding pathways makes robust folding particularly challenging. In this talk, I will discuss how this pluripotency arises from the topology of the configuration space. This suggests a broader understanding of a larger class of materials spanning from folding forms to spring networks to mechanical structures that perform computational logic.

Diversity in the natural world emerges from the collective behavior of large numbers of interacting objects. Statistical physics provides the framework relating microscopic to macroscopic properties. A fundamental assumption underlying this approach is that we have complete knowledge of the interactions between the microscopic entities. But what if that, even though possible in principle becomes impossible in practice ? Can we still construct a framework for describing their collective behavior ? Dense suspensions and granular materials are two often quoted examples where we face this challenge. These are systems where because of the complicated surface properties of particles there is extreme sensitivity of the interactions to particle positions. In this talk, I will present a perspective based on notions of constraint satisfaction that provides a way forward. I will focus on our recent work on the emergence of elasticity in the absence of any broken symmetry, and sketch out other problems that can be addressed using this perspective.

Many of us came to biology from physics. There we have been trained on such classic examples as muon g-2, where experimental data and theoretical predictions agree to many significant digits. Now, working in biology, we routinely hear that it is messy, most details matter, and that the best hope for theory in biology is to be semi-qualitative, predict general trends, and to forgo the hope of ever making quantitative predictions with the precision that we are used to in physics. Colloquially, we should be satisfied even if data and models differ so much that plotting them on the same plot makes little sense. However, some of us won’t be satisfied by this. So can we take theory in biology seriously and predict experimental outcomes within (small) error bars? Certainly, we won’t be able to predict everything, but this is never required, even in traditional physics. But we should be able to choose some features of data that are nontrivial and interesting, and focus on them. We also should be able to find different classes of models --- maybe even null models --- that match biology better, and thus allow for a better agreement. It is even possible that large-dimensional datasets of modern high-throughput experiments, and the ensuing “more is different” statistical physics style models will make quantitative, precise theory easier. To explore the role of quantitative theory in biology, in this workshop, eight speakers will address some of the following general questions based on their specific work in different corners of biology: Which features of biological data are predictable? Which types of models are best suited to making quantitative predictions in different fields? Should theorists interested in quantitative predictions focus on different questions, not typically asked by biologists? Do large, multidimensional datasets make theories (and which theories?) more or less likely to succeed? This will be an unapologetically theoretical physics workshop — we won’t focus on a specific subfield of biology, but will explore these questions across the fields, hoping that the underlying theoretical frameworks will help us find the missing connections.

The Smoluchowski equation has often been used as the starting point of many continuum models of active suspensions. However, its six-dimensional nature depending on time, space and orientation requires a huge computational cost, fundamentally limiting its use for large-scale problems, such as mixing and transport of active fluids in turbulent flows. Despite the singular nature in strain-dominant flows, the generalised Taylor dispersion (GTD) theory (Frankel & Brenner 1991, J. Fluid Mech. 230:147-181) has been understood to be one of the most promising ways to reduce the Smoluchowski equation into an advection-diffusion equation, the mean drift and diffusion tensor of which rely on ‘local’ flow information only. In this talk, we will introduce an exact transformation of the Smoluchowski equation into such an advection-diffusion equation requiring only local flow information. Based on this transformation, a new advection-diffusion equation will subsequently be proposed by taking an asymptotic analysis in the limit of small particle velocity. With several examples, it will be demonstrated that the new advection-diffusion model, non-singular in strain-dominant flows, outperforms the GTD theory.

Interpreting high-dimensional datasets requires new computational and analytical methods. We developed such methods to extract and analyze neural activity from 20,000 neurons recorded simultaneously in awake, behaving mice. The neural activity was not low-dimensional as commonly thought, but instead was high-dimensional and obeyed a power-law scaling across its eigenvalues. We developed a theory that proposes that neural responses to external stimuli maximize information capacity while maintaining a smooth neural code. We then observed power-law eigenvalue scaling in many real-world datasets, and therefore developed a nonlinear manifold embedding algorithm called Rastermap that can capture such high-dimensional structure.

The affinity between statistical physics and machine learning has long history, this is reflected even in the machine learning terminology that is in part adopted from physics. I will describe the main lines of this long-lasting friendship in the context of current theoretical challenges and open questions about deep learning. Theoretical physics often proceeds in terms of solvable synthetic models, I will describe the related line of work on solvable models of simple feed-forward neural networks. I will highlight a path forward to capture the subtle interplay between the structure of the data, the architecture of the network, and the learning algorithm.

Firing-rate (FR) or neural-mass models are widely used for studying computations performed by neural populations. Despite their success, classical firing-rate models do not capture spike timing effects on the microscopic level such as spike synchronization and are difficult to link to spiking data in experimental recordings. For large neuronal populations, the gap between the spiking neuron dynamics on the microscopic level and coarse-grained FR models on the population level can be bridged by mean-field theory formally valid for infinitely many neurons. It remains however challenging to extend the resulting mean-field models to finite-size populations with biologically realistic neuron numbers per cell type (mesoscopic scale). In this talk, I present a mathematical framework for mesoscopic populations of generalized integrate-and-fire neuron models that accounts for fluctuations caused by the finite number of neurons. To this end, I will introduce the refractory density method for quasi-renewal processes and show how this method can be generalized to finite-size populations. To demonstrate the flexibility of this approach, I will show how synaptic short-term plasticity can be incorporated in the mesoscopic mean-field framework. On the other hand, the framework permits a systematic reduction to low-dimensional FR equations using the eigenfunction method. Our modeling framework enables a re-examination of classical FR models in computational neuroscience under biophysically more realistic conditions.