Many engineered and biological systems must trade off performance and energy use, and the brain is no exception. While there are theories on how activity levels are controlled in biological networks through feedback control (homeostasis), it is not clear what the effects on population coding are, and therefore how performance and energy can be traded off. In this talk we will consider this tradeoff in auto-encoding networks, in which there is a clear definition of performance (the coding loss). We first show how SNNs follow a characteristic trade-off curve between activity levels and coding loss, but that standard networks need to be retrained to achieve different tradeoff points. We next formalize this tradeoff with a joint loss function incorporating coding loss (performance) and activity loss (energy use). From this loss we derive a class of spiking networks which coordinates its spiking to minimize both the activity and coding losses -- and as a result can dynamically adjust its coding precision and energy use. The network utilizes several known activity control mechanisms for this --- threshold adaptation and feedback inhibition --- and elucidates their potential function within neural circuits. Using geometric intuition, we demonstrate how these mechanisms regulate coding precision, and thereby performance. Lastly, we consider how these insights could be transferred to trained SNNs. Overall, this work addresses a key energy-coding trade-off which is often overlooked in network studies, expands on our understanding of homeostasis in biological SNNs, as well as provides a clear framework for considering performance and energy use in artificial SNNs.

The ability to discriminate different sensory patterns by disentangling their neural representations is an important property of neural networks. While a variety of learning rules are known to be highly effective at fine-tuning synapses to achieve this, less is known about how different cell types in the brain can facilitate this process by providing architectural priors that bias the network towards sparse, selective, and discriminable representations. We studied this by simulating a neuronal network modelled on the dentate gyrus—an area characterised by sparse activity associated with pattern separation in spatial memory tasks. To test the contribution of different cell types to these functions, we presented the model with a wide dynamic range of input patterns and systematically added or removed different circuit elements. We found that recruiting feedback inhibition indirectly via recurrent excitatory neurons proved particularly helpful in disentangling patterns, and show that simple alignment principles for excitatory and inhibitory connections are a highly effective strategy.

Cortical circuits process information by rich recurrent interactions between excitatory neurons and inhibitory interneurons. One of the prime functions of interneurons is to stabilize the circuit by feedback inhibition, but the level of specificity on which inhibitory feedback operates is not fully resolved. We hypothesized that inhibitory circuits could enable separate feedback control loops for different synaptic input streams, by means of specific feedback inhibition to different neuronal compartments. To investigate this hypothesis, we adopted an optimization approach. Leveraging recent advances in training spiking network models, we optimized the connectivity and short-term plasticity of interneuron circuits for compartment-specific feedback inhibition onto pyramidal neurons. Over the course of the optimization, the interneurons diversified into two classes that resembled parvalbumin (PV) and somatostatin (SST) expressing interneurons. The resulting circuit can be understood as a neural decoder that inverts the nonlinear biophysical computations performed within the pyramidal cells. Our model provides a proof of concept for studying structure-function relations in cortical circuits by a combination of gradient-based optimization and biologically plausible phenomenological models

I am working on the vertebrate retina, with a main focus on the mouse and bird retina. Currently my work is focused on three major topics: Functional and molecular analysis of electrical synapses in the retina Circuitry and functional role of retinal interneurons: horizontal cells Circuitry for light-dependent magnetoreception in the bird retina Electrical synapses Electrical synapses (gap junctions) permit fast transmission of electrical signals and passage of metabolites by means of channels, which directly connect the cytoplasm of adjoining cells. A functional gap junction channel consists of two hemichannels (one provided by each of the cells), each comprised of a set of six protein subunits, termed connexins. These building blocks exist in a variety of different subtypes, and the connexin composition determines permeability and gating properties of a gap junction channel, thereby enabling electrical synapses to meet a diversity of physiological requirements. In the retina, various connexins are expressed in different cell types. We study the cellular distribution of different connexins as well as the modulation induced by transmitter action or change of ambient light levels, which leads to altered electrical coupling properties. We are also interested in exploiting them as therapeutic avenue for retinal degeneration diseases. Horizontal cells Horizontal cells receive excitatory input from photoreceptors and provide feedback inhibition to photoreceptors and feedforward inhibition to bipolar cells. Because of strong electrical coupling horizontal cells integrate the photoreceptor input over a wide area and are thought to contribute to the antagonistic organization of bipolar cell and ganglion cell receptive fields and to tune the photoreceptor–bipolar cell synapse with respect to the ambient light conditions. However, the extent to which this influence shapes retinal output is unclear, and we aim to elucidate the functional importance of horizontal cells for retinal signal processing by studying various transgenic mouse models. Retinal circuitry for light-dependent magnetoreception in the bird We are studying which neuronal cell types and pathways in the bird retina are involved in the processing of magnetic signals. Likely, magnetic information is detected in cryptochrome-expressing photoreceptors and leaves the retina through ganglion cell axons that project via the thalamofugal pathway to Cluster N, a part of the visual wulst essential for the avian magnetic compass. Thus, we aim to elucidate the synaptic connections and retinal signaling pathways from putatively magnetosensitive photoreceptors to thalamus-projecting ganglion cells in migratory birds using neuroanatomical and electrophysiological techniques.

Neural codes, such as temporal codes (precisely timed spikes) and rate codes (instantaneous spike firing rates), are believed to be used in encoding sensory information into spike trains of cortical neurons. Temporal and rate codes co-exist in the spike train and such multiplexed neural code-carrying spike trains have been shown to be spatially synchronized in multiple neurons across different cortical layers during sensory information processing. Inhibition is suggested to promote such synchronization, but it is unclear whether distinct subtypes of interneurons make different contributions in the synchronization of multiplexed neural codes. To test this, in vivo single-unit recordings from barrel cortex were combined with optogenetic manipulations to determine the contributions of parvalbumin (PV)- and somatostatin (SST)-positive interneurons to synchronization of precisely timed spike sequences. We found that PV interneurons preferentially promote the synchronization of spike times when instantaneous firing rates are low (<12 Hz), whereas SST interneurons preferentially promote the synchronization of spike times when instantaneous firing rates are high (>12 Hz). Furthermore, using a computational model, we demonstrate that these effects can be explained by PV and SST interneurons having preferential contribution to feedforward and feedback inhibition, respectively. Overall, these results show that PV and SST interneurons have distinct frequency (rate code)-selective roles in dynamically gating the synchronization of spike times (temporal code) through preferentially recruiting feedforward and feedback inhibitory circuit motifs. The inhibitory neural circuit mechanisms we uncovered here his may have critical roles in regulating neural code-based somatosensory information processing in the neocortex.