Vision Science seminars

I am working on the vertebrate retina, with a main focus on the mouse and bird retina. Currently my work is focused on three major topics: Functional and molecular analysis of electrical synapses in the retina Circuitry and functional role of retinal interneurons: horizontal cells Circuitry for light-dependent magnetoreception in the bird retina Electrical synapses Electrical synapses (gap junctions) permit fast transmission of electrical signals and passage of metabolites by means of channels, which directly connect the cytoplasm of adjoining cells. A functional gap junction channel consists of two hemichannels (one provided by each of the cells), each comprised of a set of six protein subunits, termed connexins. These building blocks exist in a variety of different subtypes, and the connexin composition determines permeability and gating properties of a gap junction channel, thereby enabling electrical synapses to meet a diversity of physiological requirements. In the retina, various connexins are expressed in different cell types. We study the cellular distribution of different connexins as well as the modulation induced by transmitter action or change of ambient light levels, which leads to altered electrical coupling properties. We are also interested in exploiting them as therapeutic avenue for retinal degeneration diseases. Horizontal cells Horizontal cells receive excitatory input from photoreceptors and provide feedback inhibition to photoreceptors and feedforward inhibition to bipolar cells. Because of strong electrical coupling horizontal cells integrate the photoreceptor input over a wide area and are thought to contribute to the antagonistic organization of bipolar cell and ganglion cell receptive fields and to tune the photoreceptor–bipolar cell synapse with respect to the ambient light conditions. However, the extent to which this influence shapes retinal output is unclear, and we aim to elucidate the functional importance of horizontal cells for retinal signal processing by studying various transgenic mouse models. Retinal circuitry for light-dependent magnetoreception in the bird We are studying which neuronal cell types and pathways in the bird retina are involved in the processing of magnetic signals. Likely, magnetic information is detected in cryptochrome-expressing photoreceptors and leaves the retina through ganglion cell axons that project via the thalamofugal pathway to Cluster N, a part of the visual wulst essential for the avian magnetic compass. Thus, we aim to elucidate the synaptic connections and retinal signaling pathways from putatively magnetosensitive photoreceptors to thalamus-projecting ganglion cells in migratory birds using neuroanatomical and electrophysiological techniques.

We seek to understand the control of behavior – by animals, their brains, and their neurons. Reiser and his team are focused on the fly visual system, using modern methods from the Drosophila toolkit to understand how visual pathways are involved in specific behaviors. Due to the recent connectomics explosion, they now study the brain-wide networks organizing visual information for behavior control. The team combines explorations of visually guided behaviors with functional investigations of specific cell types throughout the fly brain. The Reiser lab actively develops and disseminates new methods and instruments enabling increasingly precise quantification of animal behavior.

Using a combination of in vivo imaging of neuronal circuit functional and structural dynamics, we have investigated the mechanisms by which patterned neural activity and sensory experience alter connectivity in the developing brain. We have identified, in addition to the long-hypothesized Hebbian structural plasticity mechanisms, a kind of plasticity induced by the absence of correlated firing that we dubbed “Stentian plasticity”. In the talk I will discuss the phenomenology and some mechanistic insights regarding Stentian mechanisms in brain development. Further, I will show how glia may have a key role in circuit remodeling during development. These studies have led us to an appreciation of the importance of neuron-glia interactions in early development and the ability of patterned activity to guide circuit wiring.

It has generally been presumed that sensory information encoded by a nervous system should be as accurate as its biological limitations allow. However, perhaps counter intuitively, accurate representations of sensory signals do not necessarily maximize the organism’s chances of survival. We show that neural codes that maximize reward expectation—and not accurate sensory representations—account for retinal responses in insects, and retinotopically-specific adaptive codes in humans. Thus, our results provide evidence that fitness-maximizing rules imposed by the environment are applied at the earliest stages of sensory processing.

Human vision relies on rapid eye movements (saccades) 2-3 times every second to bring peripheral targets to central foveal vision for high resolution inspection. This rapid sampling of the world defines the perception-action cycle of natural vision and profoundly impacts our perception. Marmosets have similar visual processing and eye movements as humans, including a fovea that supports high-acuity central vision. Here, I present a novel approach developed in my laboratory for investigating the neural mechanisms of visual processing using naturalistic free viewing and simple target foraging paradigms. First, we establish that it is possible to map receptive fields in the marmoset with high precision in visual areas V1 and MT without constraints on fixation of the eyes. Instead, we use an off-line correction for eye position during foraging combined with high resolution eye tracking. This approach allows us to simultaneously map receptive fields, even at the precision of foveal V1 neurons, while also assessing the impact of eye movements on the visual information encoded. We find that the visual information encoded by neurons varies dramatically across the saccade to fixation cycle, with most information localized to brief post-saccadic transients. In a second study we examined if target selection prior to saccades can predictively influence how foveal visual information is subsequently processed in post-saccadic transients. Because every saccade brings a target to the fovea for detailed inspection, we hypothesized that predictive mechanisms might prime foveal populations to process the target. Using neural decoding from laminar arrays placed in foveal regions of area MT, we find that the direction of motion for a fixated target can be predictively read out from foveal activity even before its post-saccadic arrival. These findings highlight the dynamic and predictive nature of visual processing during eye movements and the utility of the marmoset as a model of active vision. Funding sources: NIH EY030998 to JM, Life Sciences Fellowship to JY

Among mammals, excellent color vision has evolved only in certain non-human primates. And yet, color is often assumed to be just a low-level stimulus feature with a modest role in encoding and recognizing objects. The rationale for this dogma is compelling: object recognition is excellent in grayscale images (consider black-and-white movies, where faces, places, objects, and story are readily apparent). In my talk I will discuss experiments in which we used color as a tool to uncover an organizational plan in inferior temporal cortex (parallel, multistage processing for places, faces, colors, and objects) and a visual-stimulus functional representation in prefrontal cortex (PFC). The discovery of an extensive network of color-biased domains within IT and PFC, regions implicated in high-level object vision and executive functions, compels a re-evaluation of the role of color in behavior. I will discuss behavioral studies prompted by the neurobiology that uncover a universal principle for color categorization across languages, the first systematic study of the color statistics of objects and a chromatic mechanism by which the brain may compute animacy, and a surprising paradoxical impact of memory on face color. Taken together, my talk will put forward the argument that color is not primarily for object recognition, but rather for the assessment of the likely behavioral relevance, or meaning, of the stuff we see.

We have long known that rod and cone signals interact within the retina and can even contribute to color vision, but the extent of these influences has remained unclear. New results with more powerful methods of RNA expression profiling, specific cell labeling, and single-cell recording have provided greater clarity and are showing that rod and cone signals can mix at virtually every level of signal processing. These interactions influence the integration of retinal signals and make an important contribution to visual perception.

All sensory perception and every coordinated movement, as well as feelings, memories and motivation, arise from the bustling activity of many millions of interconnected cells in the brain. The ultimate function of this elaborate network is to generate behavior. We use zebrafish as our experimental model, employing a diverse array of molecular, genetic, optical, connectomic, behavioral and computational approaches. The goal of our research is to understand how neuronal circuits integrate sensory inputs and internal state and convert this information into behavioral responses.

During communication, alignment between signals and sensors can be critical. Signals are often best perceived from specific angles, and sensory systems can also exhibit strong directional biases. However, we know little about how animals establish and maintain such signaling alignment during communication. To investigate this, we characterized the spatial dynamics of visual courtship signal- ing in the jumping spider Habronattus pyrrithrix. The male performs forward-facing displays involving complex color and movement patterns, with distinct long- and short-range phases. The female views displays with 2 distinct eye types and can only perceive colors and fine patterns of male displays when they are presented in her frontal field of view. Whether and how courtship interactions pro- duce such alignment between male display and female field of view is unknown. We recorded relative positions and orientations of both actors throughout courtship and established the role of each sex in maintaining signaling alignment. Males always oriented their displays toward the female. However, when females were free to move, male displays were consistently aligned with female princi- pal eyes only during short-range courtship. When female position was fixed, signaling alignment consistently occurred during both phases, suggesting that female movement reduces communication efficacy. When female models were experimentally rotated to face away during courtship, males rarely repositioned themselves to re-align their display. However, males were more likely to present cer- tain display elements after females turned to face them. Thus, although signaling alignment is a function of both sexes, males appear to rely on female behavior for effective communication

Each spring, billions of Bogong moths escape hot conditions in different regions of southeast Australia by migrating over 1000 km to a limited number of cool caves in the Australian Alps, historically used for aestivating over the summer. At the beginning of autumn the same individuals make a return migration to their breeding grounds to reproduce and die. To steer migration Bogong moths sense the Earth’s magnetic field and correlate its directional information with visual cues. In this presentation, we will show that a critically important visual cue is the distribution of starlight within the austral night sky. By tethering spring and autumn migratory moths in a flight simulator, we found that under natural dorsally-projected night skies, and in a nulled magnetic field (disabling the magnetic sense), moths flew in their seasonally appropriate migratory directions, turning in the opposite direction when the night sky was rotated 180°. Visual interneurons in the moth’s optic lobe and central brain responded vigorously to identical sky rotations. Migrating Bogong moths thus use the starry night sky as a true compass to distinguish geographic cardinal directions, the first invertebrate known to do so. These stellar cues are likely reinforced by the Earth’s magnetic field to create a robust compass mechanism for long-distance nocturnal navigation.

Our study reveals the most elaborate opsin expression patterns ever described in any animal eye. In mantis shrimp, a pugnacious crustacean renowned for its visual sophistication, we found unexpected retinal expression patterns highlighting the potential for cryptic photoreceptor functional diversity, including single photoreceptors that coexpress opsins from different spectral clades and a single opsin with a putative nonvisual function important in color vision. This study demonstrates the evolutionary potential for increasing visual system functional diversity through opsin gene duplication and diversification, as well as changes in patterns of gene coexpression among photoreceptors and retinula cells. These results have significant implications for the function of other visual systems, particularly in arthropods where large numbers of retinally expressed opsins have been documented.

All sensory information – like what we see, hear and smell – gets encoded in spike trains by sensory neurons and gets sent to the brain. Due to the complexity of neural circuits and the difficulty of quantifying complex animal behavior, it has been exceedingly hard to resolve how the brain decodes these spike trains to drive behavior. We now measure quantal signals originating from sparse photons through the most sensitive neural circuits of the mammalian retina and correlate the retinal output spike trains with precisely quantified behavioral decisions. We utilize a combination of electrophysiological measurements on the most sensitive ON and OFF retinal ganglion cell types and a novel deep-learning based tracking technology of the head and body positions of freely-moving mice. We show that visually-guided behavior relies on information from the retinal ON pathway for the dimmest light increments and on information from the retinal OFF pathway for the dimmest light decrements (“quantal shadows”). Our results show that the distribution of labor between ON and OFF pathways starts already at starlight supporting distinct pathway-specific visual computations to drive visually-guided behavior. These results have several fundamental consequences for understanding how the brain integrates information across parallel information streams as well as for understanding the limits of sensory signal processing. In my talk, I will discuss some of the most eminent consequences including the extension of this “Quantum Behavior” paradigm from mouse vision to monkey and human visual systems.