Vision Science seminars

The research in my lab focuses on sensory signal processing, particularly in cases where sensory systems perform at or near the limits imposed by physics. Photon counting in the visual system is a beautiful example. At its peak sensitivity, the performance of the visual system is limited largely by the division of light into discrete photons. This observation has several implications for phototransduction and signal processing in the retina: rod photoreceptors must transduce single photon absorptions with high fidelity, single photon signals in photoreceptors, which are only 0.03 – 0.1 mV, must be reliably transmitted to second-order cells in the retina, and absorption of a single photon by a single rod must produce a noticeable change in the pattern of action potentials sent from the eye to the brain. My approach is to combine quantitative physiological experiments and theory to understand photon counting in terms of basic biophysical mechanisms. Fortunately there is more to visual perception than counting photons. The visual system is very adept at operating over a wide range of light intensities (about 12 orders of magnitude). Over most of this range, vision is mediated by cone photoreceptors. Thus adaptation is paramount to cone vision. Again one would like to understand quantitatively how the biophysical mechanisms involved in phototransduction, synaptic transmission, and neural coding contribute to adaptation.

Visual restoration is certainly the greatest challenge for brain-machine interfaces with the high pixel number and high refreshing rate. In the recent year, we brought retinal prostheses and optogenetic therapy up to successful clinical trials. Concerning visual restoration at the cortical level, prostheses have shown efficacy for limited periods of time and limited pixel numbers. We are investigating the potential of sonogenetics to develop a non-contact brain machine interface allowing long-lasting activation of the visual cortex. The presentation will introduce our genetic-based brain machine interfaces for visual restoration at the retinal and cortical levels.

Research in our lab focuses on the circuit mechanisms underlying sensory computation. We use the mouse retina as a model system because it allows us to stimulate the circuit precisely with its natural input, patterns of light, and record its natural output, the spike trains of retinal ganglion cells. We harness the power of genetic manipulations and detailed information about cell types to uncover new circuits and discover their role in visual processing. Our methods include electrophysiology, computational modeling, and circuit tracing using a variety of imaging techniques.

A central goal of vision science is to understand the principles underlying the perception and neural coding of the complex visual environment of our everyday experience. In the visual cortex, foundational work with artificial stimuli, and more recent work combining natural images and deep convolutional neural networks, have revealed much about the tuning of cortical neurons to specific image features. However, a major limitation of this existing work is its focus on single-neuron response strength to isolated images. First, during natural vision, the inputs to cortical neurons are not isolated but rather embedded in a rich spatial and temporal context. Second, the full structure of population activity—including the substantial trial-to-trial variability that is shared among neurons—determines encoded information and, ultimately, perception. In the first part of this talk, I will argue for a normative approach to study encoding of natural images in primary visual cortex (V1), which combines a detailed understanding of the sensory inputs with a theory of how those inputs should be represented. Specifically, we hypothesize that V1 response structure serves to approximate a probabilistic representation optimized to the statistics of natural visual inputs, and that contextual modulation is an integral aspect of achieving this goal. I will present a concrete computational framework that instantiates this hypothesis, and data recorded using multielectrode arrays in macaque V1 to test its predictions. In the second part, I will discuss how we are leveraging this framework to develop deep probabilistic algorithms for natural image and video segmentation.

My research uses electrophysiological techniques to evaluate normal retinal function, dysfunction caused by blinding retinal diseases and the restoration of function using a variety of therapeutic strategies. We can use our understanding or normal retinal function and disease-related changes to construct optimal therapeutic strategies and evaluate how they ameliorate the effects of disease. Retinitis pigmentosa (RP) is a family of blinding eye diseases caused by photoreceptor degeneration. The absence of the cells that for this primary signal leads to blindness. My interest in RP involves the evaluation of therapies to restore vision: replacing degenerated photoreceptors either with: (1) new stem or other embryonic cells, manipulated to become photoreceptors or (2) prosthetics devices that replace the photoreceptor signal with an electronic signal to light. Glaucoma is caused by increased intraocular pressure and leads to ganglion cell death, which eliminates the link between the retinal output and central visual processing. We are parsing out of the effects of increased intraocular pressure and aging on ganglion cells. Congenital Stationary Night Blindness (CSNB) is a family of diseases in which signaling is eliminated between rod photoreceptors and their postsynaptic targets, rod bipolar cells. This deafferents the retinal circuit that is responsible for vision under dim lighting. My interest in CSNB involves understanding the basic interplay between excitation and inhibition in the retinal circuit and its normal development. Because of the targeted nature of this disease, we are hopeful that a gene therapy approach can be developed to restore night vision. My work utilizes rodent disease models whose mutations mimic those found in human patients. While molecular manipulation of rodents is a fairly common approach, we have recently developed a mutant NIH miniature swine model of a common form of autosomal dominant RP (Pro23His rhodopsin mutation) in collaboration with the National Swine Resource Research Center at University of Missouri. More genetically modified mini-swine models are in the pipeline to examine other retinal diseases.

How does the visual system of insects function in vastly different light intensities, process separate parts of the visual field in parallel, and cope with eye sizes that differ between individuals? This talk will give you the answers we receive from our unique(ly adorable) model system: hawkmoths.

How does the brain interpret signals from the outside world? Walking through a park, you might take for granted the ease with which you can understand what you see. Rather than seeing a series of still snapshots, you are able to see simple, fluid movement — of dogs running, squirrels foraging, or kids playing basketball. You can track their paths and know where they are headed without much thought. “How does this process take place?” asks Rudy Behnia, PhD, a principal investigator at Columbia’s Mortimer B. Zuckerman Mind Brain Behavior Institute. “For most of us, it’s hard to imagine a world where we can’t see motion, shapes, and color; where we can’t have a representation of the physical world in our head.” And yet this representation does not happen automatically — our brain has no direct connection with the outside world. Instead, it interprets information taken in by our senses. Dr. Behnia is studying how the brain builds these representations. As a starting point, she focuses on how we see motion

Statistics of natural scenes are not uniform - their structure varies dramatically from ground to sky. It remains unknown whether these non-uniformities are reflected in the large-scale organization of the early visual system and what benefits such adaptations would confer. By deploying an efficient coding argument, we predict that changes in the structure of receptive fields across visual space increase the efficiency of sensory coding. To test this experimentally, developed a simple, novel imaging system that is indispensable for studies at this scale. In agreement with our predictions, we could show that receptive fields of retinal ganglion cells change their shape along the dorsoventral axis, with a marked surround asymmetry at the visual horizon. Our work demonstrates that, according to principles of efficient coding, the panoramic structure of natural scenes is exploited by the retina across space and cell-types.

Gravity is a constant in our lives. It provides an internalized reference to which all other perceptions are related. We can experimentally manipulate the relationship between physical gravity with other cues to the direction of “up” using virtual reality - with either HMDs or specially built tilting environments - to explore how gravity contributes to perceptual judgements. The effect of gravity can also be cancelled by running experiments on the International Space Station in low Earth orbit. Changing orientation relative to gravity - or even just perceived orientation – affects your perception of how far away things are (they appear closer when supine or prone). Cancelling gravity altogether has a similar effect. Changing orientation also affects how much visual motion is needed to perceive a particular travel distance (you need less when supine or prone). Adapting to zero gravity has the opposite effect (you need more). These results will be discussed in terms of their practical consequences and the multisensory processes involved, in particular the response to visual-vestibular conflict.

I am working on color vision in Drosophila, identifying behaviors that involve color vision and understanding the neural circuits supporting them (Longden 2016). I have a long-term interest in understanding how neural computations operate reliably under changing circumstances, be they external changes in the sensory context, or internal changes of state such as hunger and locomotion. On internal state-modulation of sensory processing, I have shown how hunger alters visual motion processing in blowflies (Longden et al. 2014), and identified a role for octopamine in modulating motion vision during locomotion (Longden and Krapp 2009, 2010). On responses to external cues, I have shown how one kind of uncertainty in the motion of the visual scene is resolved by the fly (Saleem, Longden et al. 2012), and I have identified novel cells for processing translation-induced optic flow (Longden et al. 2017). I like working with colleagues who use different model systems, to get at principles of neural operation that might apply in many species (Ding et al. 2016, Dyakova et al. 2015). I like work motivated by computational principles - my background is computational neuroscience, with a PhD on models of memory formation in the hippocampus (Longden and Willshaw, 2007).

To survive in the wild small rodents evolved specialized retinas. To escape predators, looming shadows need to be detected with speed and precision. To evade starvation, small seeds, grass, nuts and insects need to also be detected quickly. Some of these succulent seeds and insects may be camouflaged offering only low contrast targets.Moreover, these challenging tasks need to be accomplished continuously at dusk, night, dawn and daytime. Crossover inhibition is thought to be involved in enhancing contrast detectionin the microcircuits of the inner plexiform layer of the mammalian retina. The AII amacrine cells are narrow field cells that play a key role in crossover inhibition. Our lab studies the synaptic physiology that regulates glycine release from AII amacrine cellsin mouse retina. These interneurons receive excitation from rod and conebipolar cells and transmit excitation to ON-type bipolar cell terminals via gap junctions. They also transmit inhibition via multiple glycinergic synapses onto OFF bipolar cell terminals.AII amacrine cells are thus a central hub of synaptic information processing that cross links the ON and the OFF pathways. What are the functions of crossover inhibition? How does it enhance contrast detection at different ambient light levels? How is the dynamicrange, frequency response and synaptic gain of glycine release modulated by luminance levels and circadian rhythms? How is synaptic gain changed by different extracellular neuromodulators, like dopamine, and by intracellular messengers like cAMP, phosphateand Ca2+ ions from Ca2+ channels and Ca2+ stores? My talk will try to answer some of these questions and will pose additional ones. It will end with further hypothesis and speculations on the multiple roles of crossover inhibition.