Neurons spike spontaneously in many experimental settings. Such firing patterns are often characterized by prolonged periods of silence followed by an unknown trigger of spontaneous activity that propagates throughout the slice. These were dubbed `neural avalanches' as they resemble avalanches in which accumulated…
COSYNE 2022 ePosters
Results
Using navigational information to learn visual representations
Lizhen Zhu, Brad Wyble and James Wang
Video
Children learn to build a visual representation of the world from unsupervised exploration and we hypothesize that a key part of this learning ability is the use of self-generated navigational information as a similarity label to drive a learning objective for self-supervised learning. The goal of this work is to…
Using Markov Decision Processes to benchmark the performance of artificial and biological agents
Alexander Kazakov, Ana Polterovich, Maciej M. Jankowski, Johannes Niediek and 1 more
Video
When an agent is trained on a complex episodic task, different task parts may be learned at different rates. How do we determine which part of the task challenged the agent the most? Since reward is provided usually only at the end of each trial, it cannot be used to infer within-trial learning trends. Behavioral…
Understanding rat behavior in a complex task via non-deterministic policies
Johannes Niediek, Maciej M. Jankowski, Ana Polterovich, Alexander Kazakov and 1 more
Video
We trained five rats to perform a complex auditory-guided task in a large environment (diameter 160 cm) with twelve nose-poke ports. To obtain rewards, rats had to position themselves at specific locations indicated by sounds. Despite the nontrivial task, rats reached high success rates within two 70-minute sessions.…
Time cell encoding in deep reinforcement learning agents depends on mnemonic demands
Dongyan Lin and Blake Richards
Audio
The representation of “what happened when” is central to encoding episodic and working memories. Recently discovered hippocampal “time cells” are theorized to provide the neural substrate for such representations by forming distinct sequences that encode both time elapsed and sensory content. However, while multiple…
“This Is My Spot!”: Social Determinants Regulate Space Utilization in Macaques.
Sylvia Wirth, Tadeusz Kononowicz, Felipe Rolando, Lucas Maigre and 3 more
Video
Space can be a limited resource. Many species including humans, evolved a compromise regulating space sharing and its occupancy based on social determinants. For example, students in a classroom tend to sit close to their friends, keeping the same spots across days, revealing the social structure in the classroom.…
Stabilizing brain-computer interfaces through nonlinear manifold alignment with dynamics
Brianna Karpowicz, Yahia H. Ali, Lahiru N. Wimalasena, Mohammad Reza Keshtkaran and 5 more
Video
Intracortical brain-computer interfaces (iBCIs) can restore voluntary movement to people with paralysis by translating their brain activity into a control signal for an external device. Maintaining stable iBCI performance is challenging due to instabilities at the neural interface, such as shifts in electrode position…
Soft-actor-critic for model-free reinforcement learning of eye saccade control
Henrique Granado, Akhil John, Reza Javanmard, John Van Opstal and 1 more
Video
Saccades are fast eye movements that change gaze direction in a ballistic fashion. Human saccadic behaviour has been studied extensively in neuroscience and several methods have been proposed to model the saccadic system. For example, John et al. (2021) adopted a model-based approach, based on a physical model of the…
The smart image compression algorithm in the retina: recoding inputs in neural circuits
Gabrielle Gutierrez, Fred Rieke and Eric Shea-Brown
Audio
Sensory neural circuits rely on a common set of motifs to process inputs, including convergence of multiple inputs to a single neuron, divergence of inputs into parallel pathways, and nonlinearities that are selective for some inputs over others. Past work has detailed how optimized response nonlinearities and…
Single-phase deep learning in cortico-cortical networks
Will Greedy, Heng Wei Zhu, Jack Mellor and Rui Ponte Costa
Audio
The error-backpropagation (backprop) algorithm has stood at the forefront as a solution to the credit assignment problem in artificial neural networks. Whether the brain adopts a similar strategy to ensure that the correct synapses are modified remains unclear. Recent work has attempted to bridge this gap with…
Sensory feedback can drive adaptation in motor cortex and facilitate generalization
Barbara Feulner, Matthew G. Perich, Lee E. Miller, Claudia Clopath and 1 more
Video
Experimental and computational studies suggest that motor cortex acts as a feedback controller, allowing for ‘on-the-fly’ movement corrections in response to afferent sensory feedback. However, it remains unclear whether feedback control relates to longer-term learning, and how this would be implemented in neural…
Self-assembly of the mammalian neocortex, from mouse to macaque
Gabriela Michel, Rodney Douglas, Andreas Hauri, Sabina Pfister and 5 more
Audio
During mammalian neural development, mitotic cells sense local cues and morphogenic gradients to form complex and coherent processing systems, such as the cerebral cortex, that contains billions of neurons classified into different cell types. We use agent-based simulations of cellular growth and differentiation to…
Neural information processing in dynamic, natural environments requires the brain to flexibly allocate limited computational resources to varying task demands. One example is selective attention in the visual system, which allows to preferentially route signals from behaviourally relevant stimuli to downstream visual…
Reward modulates visual responses in mouse superior colliculus independently of arousal
Liad J. Baruchin and Sylvia Schroeder
Video
The superior colliculus (SC) is a major recipient of visual input in the mouse and controls innate approach and avoidance behaviours. Neurons in the superficial SC (sSC), which receives direct input from the retina, do not only process visual stimuli, but are also modulated by the animal’s running speed and…
Rapid approximation of successor representations with STDP and theta phase precession
Tom George, William de Cothi, Kimberly Stachenfeld and Caswell Barry
Video
The successor representation (SR) is a promising candidate principle for hippocampal function. Theory proposes that each place cell encodes the expected state occupancy of its target location in the near future. This framework has desirable consequences on the generalisability and efficiency of reinforcement learning…
Processing of visual textures in the mouse visual cortex
Federico Bolaños, Javier G. Orlandi, Akshay V. Jagadeesh, Justin L. Gardner and 1 more
Video
Visual textures efficiently represent real-world information that is essential for perceptual tasks like pattern detection, object segmentation and classification. This information appears to be encoded in intermediate areas along the primate ventral visual stream (areas V2-V4), but how textural selectivity emerges at…
Optimal reward-rate in multi-task environments, and its consequences for behavior
Lucas Silva Simões, Alex Pouget and Peter Latham
Audio
Consider a task where you're accumulating noisy evidence about two options, and the longer you collect evidence the more likely you are to choose the correct one. You get $1,000 for choosing the correct option and $900 for choosing the incorrect one. How long should you wait before making a decision? Tasks like this…
One-shot learning of paired associations by a reservoir computing model with Hebbian plasticity
M Ganesh Kumar, Cheston Tan, Camilo Libedinsky, Shih-Cheng Yen and 1 more
Video
One-shot learning can be achieved by animals and algorithms, but how animals do it is poorly understood as most of the algorithms are not biologically plausible. Experiments studying one-shot learning in rodents have shown that after initial gradual learning of associations between cues and locations, new associations…
Neuromodulation as a path along the model manifold for spiking networks
Jacob Crosser and Braden Brinkman
Video
Summary: Modulation of neural activity by hormones, peptides, and other small molecules is known to be required for learning, motor control, and homeostasis, and it can induce similarly structured networks to exhibit different behaviors. Yet, relatively few theoretic studies have attempted to detangle the role and…
Neural sequence representation of stimulus value, response and surprise in hippocampus and prefrontal cortex
Bryan Souza, Luca Mazzucato, Francesco Battaglia and Jan Klee
Audio
The hippocampus and the medial prefrontal cortex (mPFC) participate in episodic and working memory, respectively. In trace conditioning, animals learn to associate a sensory stimulus (CS) and a reward (US) separated by a delay (trace period). Although the neural activity in both areas can be linked to memory…
Neural optimal feedback control with local learning rules
Johannes Friedrich, Siavash Golkar, Shiva Farashahi, Alexander Genkin and 2 more
Video
A major problem in systems neuroscience, specifically in sensory-motor control, is understanding how the brain plans and executes proper movements in the face of delayed and noisy stimuli. A prominent framework for addressing such control problems is Optimal Feedback Control (OFC). OFC generates control actions that…
Neural basis of transferable representations for efficient learning
Ai Phuong Tong, Vishnu Sreekumar, Mark Woolrich, Huiling Tan and 2 more
Video
We learn different rules that can switch depending on context. When the rule depends on context, the context is important to learn to differentiate the rewarded choice in different contexts. While it has previously been shown that the reinstatement of context guides decisions for reward, it is less clear how or…
Hierarchical cortical organization unifies the brain’s structural and functional organization, yet its relationship to task-evoked cognitive processes remains unclear. How might intrinsic hierarchical properties shape and constrain the cognitive processes required to perform the wide variety of tasks encountered in…
Movement and stimuli are differentially encoded in on- or off-manifold dimensions revealed by sleep
Eliezyer Fermino de Oliveira, Soyoun Kim, Tian Qiu, Adrien Peyrache and 2 more
Audio
Recent work has shown that spontaneous movements are represented throughout the brain, even in sensory areas such as primary visual cortex (V1). Interference between visual stimuli and movement is minimized in V1 because they are encoded in orthogonal subspaces, but it is not known how these subspaces are formed.…