The mapping from the visual field to V1 can be approximated by a log-polar transform. In this domain, scale is a left-right shift, and rotation is an up-down shift. When fed into a standard shift-invariant convolutional network, this provides scale and rotation invariance. However, translation invariance is lost. In our model, this is compensated for by multiple fixations on an object. Due to the high concentration of cones in the fovea with the dropoff of resolution in the periphery, fully 10 degrees of visual angle take up about half of V1, with the remaining 170 degrees (or so) taking up the other half. This layout provides the basis for the central and peripheral pathways. Simulations with this model closely match human performance in scene classification, and competition between the pathways leads to the peripheral pathway being used for this task. Remarkably, in spite of the property of rotation invariance, this model can explain the inverted face effect. We suggest that the standard method of using image coordinates is the wrong prior for models of primate vision.

Drosophila olfactory sensory hairs ("sensilla") typically house two olfactory receptor neurons (ORNs) which can laterally inhibit each other via electrical ("ephaptic") coupling. ORN pairing is highly stereotyped and genetically determined. Thus, olfactory signals arriving in the Antennal Lobe (AL) have been pre-processed by a fixed and shallow network at the periphery. To uncover the functional significance of this organization, we developed a nonlinear phenomenological model of asymmetrically coupled ORNs responding to odor mixture stimuli. We derived an analytical solution to the ORNs’ dynamics, which shows that the peripheral network can extract the valence of specific odor mixtures via transient amplification. Our model predicts that for efficient read-out of the amplified valence signal there must exist specific patterns of downstream connectivity that reflect the organization at the periphery. Analysis of AL→Lateral Horn (LH) fly connectomic data reveals evidence directly supporting this prediction. We further studied the effect of ephaptic coupling on olfactory processing in the AL→Mushroom Body (MB) pathway. We show that stereotyped ephaptic interactions between ORNs lead to a clustered odor representation of glomerular responses. Such clustering in the AL is an essential assumption of theoretical studies on odor recognition in the MB. Together our work shows that preprocessing of olfactory stimuli by a fixed and shallow network increases sensitivity to specific odor mixtures, and aids in the learning of novel olfactory stimuli. Work led by Palka Puri, in collaboration with Chih-Ying Su and Shiuan-Tze Wu.

A high-resolution central fovea is a prominent design feature of human vision. But how important is the fovea for information processing and gaze guidance in everyday visual-cognitive tasks? Following on from classic findings for sentence reading, I will present key results from a series of eye-tracking experiments in which observers had to search for a target object within static or dynamic images of real-world scenes. Gaze-contingent scotomas were used to selectively deny information processing in the fovea, parafovea, or periphery. Overall, the results suggest that foveal vision is less important and peripheral vision is more important for scene perception and search than previously thought. The importance of foveal vision was found to depend on the specific requirements of the task. Moreover, the data support a central-peripheral dichotomy in which peripheral vision selects and central vision recognizes.

Cells preferentially responding to visual motion in a particular direction are said to be direction-selective, and these were first identified in the primary visual cortex. Since then, direction-selective responses have been observed in the retina of several species, including mice, indicating motion analysis begins at the earliest stage of the visual hierarchy. Yet little is known about how retinal direction selectivity contributes to motion processing in the visual cortex. In this talk, I will present our experimental efforts to narrow this gap in our knowledge. To this end, we used genetic approaches to disrupt direction selectivity in the retina and mapped neuronal responses to visual motion in the visual cortex of mice using intrinsic signal optical imaging and two-photon calcium imaging. In essence, our work demonstrates that direction selectivity computed at the level of the retina causally serves to establish specialized motion responses in distinct areas of the mouse visual cortex. This finding thus compels us to revisit our notions of how the brain builds complex visual representations and underscores the importance of the processing performed in the periphery of sensory systems.

Animals traversing different environments encounter both stable background stimuli and novel cues, which are generally thought to be detected by primary sensory neurons and then distinguished by downstream brain circuits. Sensory adaptation is a neural mechanism that filters background by minimizing responses to stable sensory stimuli, and a fundamental feature of sensory systems. Adaptation over relatively fast timescales (milliseconds to minutes) have been reported in many sensory systems. However, adaptation to persistent environmental stimuli over longer timescales (hours to days) have been largely unexplored, even though those timescales are ethologically important since animals typically stay in one environment for hours. I showed that each of the ~1,000 olfactory sensory neuron (OSN) subtypes in the mouse harbors a distinct transcriptome whose content is precisely determined by interactions between its odorant receptor and the environment. This transcriptional variation is systematically organized to support sensory adaptation: expression levels of many genes relevant to transforming odors into spikes continuously vary across OSN subtypes, dynamically adjust to new environments over hours, and accurately predict acute OSN-specific odor responses. The sensory periphery therefore separates salient signals from predictable background via a transcriptional mechanism whose moment-to-moment state reflects the past and constrains the future; these findings suggest a general model in which structured transcriptional variation within a cell type reflects individual experience.

Evolution has endowed primates, including humans, with a powerful visual system, seemingly providing us with a detailed perception of our surroundings. But in reality the underlying process is one of active filtering, enhancement and reshaping. For visual motion perception, the dorsal pathway in primate visual cortex and in particular area MT/V5 is considered to be of critical importance. Combining physiological and psychophysical approaches we have used the processing and perception of visual motion and area MT/V5 as a model for the interaction of sensory (bottom-up) signals with cognitive (top-down) modulatory influences that characterizes visual perception. Our findings document how this interaction enables visual cortex to actively generate a neural representation of the environment that combines the high-performance sensory periphery with selective modulatory influences for producing an “integrated saliency map’ of the environment.

Brains must integrate complex sensory information and compare to past events to generate appropriate behavioral responses. The neural circuit basis of these computations is unclear and the underlying structure unknown. Here, we mapped the comprehensive synaptic wiring diagram of the fruit fly larva brain, which contains 3,013 neurons and 544K synaptic sites. It is the most complete insect connectome to date: 1) Both brain hemispheres are reconstructed, allowing investigation of neural pathways that include contralateral axons, which we found in 37% of brain neurons. 2) All sensory neurons and descending neurons are reconstructed, allowing one to follow signals in an uninterrupted chain—from the sensory periphery, through the brain, to motor neurons in the nerve cord. We developed novel computational tools, allowing us to cluster the brain and investigate how information flows through it. We discovered that feedforward pathways from sensory to descending neurons are multilayered and highly multimodal. Robust feedback was observed at almost all levels of the brain, including descending neurons. We investigated how the brain hemispheres communicate with each other and the nerve cord, leading to identification of novel circuit motifs. This work provides the complete blueprint of a brain and a strong foundation to study the structure-function relationship of neural circuits.

A recent approach to understanding the mammalian visual system is to show correspondence between the sequential stages of processing in the ventral stream with layers in a deep convolutional neural network (DCNN), providing evidence that visual information is processed hierarchically, with successive stages containing ever higher-level information. However, correspondence is usually defined as shared variance between brain region and model layer. We propose that task-relevant variance is a stricter test: If a DCNN layer corresponds to a brain region, then substituting the model’s activity with brain activity should successfully drive the model’s object recognition decision. Using this approach on three datasets (human fMRI and macaque neuron firing rates) we found that in contrast to the hierarchical view, all ventral stream regions corresponded best to later model layers. That is, all regions contain high-level information about object category. We hypothesised that this is due to recurrent connections propagating high-level visual information from later regions back to early regions, in contrast to the exclusively feed-forward connectivity of DCNNs. Using task-relevant correspondence with a late DCNN layer akin to a tracer, we used Granger causal modelling to show late-DCNN correspondence in IT drives correspondence in V4. Our analysis suggests, effectively, that no ventral stream region can be appropriately characterised as ‘early’ beyond 70ms after stimulus presentation, challenging hierarchical models. More broadly, we ask what it means for a model component and brain region to correspond: beyond quantifying shared variance, we must consider the functional role in the computation. We also demonstrate that using a DCNN to decode high-level conceptual information from ventral stream produces a general mapping from brain to model activation space, which generalises to novel classes held-out from training data. This suggests future possibilities for brain-machine interface with high-level conceptual information, beyond current designs that interface with the sensorimotor periphery.

By continuously producing electrical signals, neurones are amongst the most energy-demanding cells in the organism. Resting ionic levels are restored via metabolic pumps that receive the necessary energy from oxygen supplied by blood vessels. Intense spontaneous neural activity is omnipresent in the developing CNS. It occurs during short, well-defined periods that coincide precisely with the timing of angiogenesis. Such coincidence cannot be random; there must be a universal mechanism triggering spontaneous activity concurrently with blood vessels invading neural territories for the first time. However, surprisingly little is known about the role of neural activity per se in guiding angiogenesis. Part of the reason is that it is challenging to study developing neurovascular networks in tri-dimensional space in the brain. We investigate these questions in the neonatal mouse retina, where blood vessels are much easier to visualise because they initially grow in a plane, while waves of spontaneous neural activity (spreading via cholinergic starburst amacrine cells) sweep across the retinal ganglion cell layer, in close juxtaposition with the growing vasculature. Blood vessels reach the periphery by postnatal day (P) 7-8, shortly before the cholinergic waves disappear (at P10). We discovered transient clusters of auto-fluorescent cells that form an annulus around the optic disc, gradually expanding to the periphery, which they reach at the same time as the growing blood vessels. Remarkably, these cells appear locked to the frontline of the growing vasculature. Moreover, by recording waves with a large-scale multielectrode array that enables us to visualise them at pan-retinal level, we found that their initiation points are not random; they follow a developmental centre-to-periphery pattern similar to the clusters and blood vessels. The density of growing blood vessels is higher in cluster areas than in-between clusters at matching eccentricity. The cluster cells appear to be phagocytosed by microglia. Blocking Pannexin1 (PANX1) hemichannels activity with probenecid completely blocks the spontaneous waves and results in the disappearance of the fluorescent cell clusters. We suggest that these transient cells are specialised, hyperactive neurones that form spontaneous activity hotspots, thereby triggering retinal waves through the release of ATP via PANX1 hemichannels. These activity hotspots attract new blood vessels to enhance local oxygen supply. Signalling through PANX1 attracts microglia that establish contact with these cells, eventually eliminating them once blood vessels have reached their vicinity. The auto-fluorescence that characterises the cell clusters may develop only once the process of microglial phagocytosis is initiated.

Behavior varies even among genetically identical animals raised in the same environment. However, little is known about the circuit or anatomical underpinnings of this individuality, though previous work implicates sensory periphery. Drosophila olfaction presents an ideal model to study the biological basis of behavioral individuality, because while the neural circuit underlying olfactory behavior is well-described and highly stereotyped, persistent idiosyncrasy in behavior, neural coding, and neural wiring have also been described. Projection neurons (PNs), which relay odor signals sensed by olfactory receptor neurons (ORNs) to deeper brain structures, exhibit variable calcium responses to identical odor stimuli across individuals, but how these idiosyncrasies relate to individual behavioral responses remains unknown. Here, using paired behavior and two-photon imaging measurements, we show that idiosyncratic calcium dynamics in both ORNs and PNs predict individual preferences for an aversive monomolecular odorant versus air, suggesting that variation at the periphery of the olfactory system determines individual preference for an odor’s presence. In contrast, PN, but not ORN, calcium responses predict individual preferences in a two-odor choice assay. Furthermore, paired behavior and immunohistochemistry measurements reveal that variation in ORN presynaptic density also predicts two-odor preference, suggesting this site is a locus of individuality where microscale circuit variation gives rise to idiosyncrasy in behavior. Our results demonstrate how a neural circuit may vary functionally and structurally to produce variable behavior among individuals.

Chemotherapeutic drugs (used for treating cancer), HIV infection and antiretroviral therapy (ART) can independently cause difficult-to-manage painful neuropathy. Paclitaxel, a chemotherapeutic drug, for example is associated with high incidence of peripheral neuropathy, around 71% of the patients of which 27% of these develop neuropathic pain. Use of cannabis or phytocannabinoids has been reported to improve pain measures in patients with neuropathic pain, including painful HIV-associated sensory neuropathy and cancer pain. Phytocannabinoids and endocannabinoids, such as anandamide and 2-arachidonoylglycerol (2-AG), produce their effects via cannabinoid (CB) receptors, which are present both in the periphery and central nervous system. Endocannabinoids are synthesized in an “on demand” fashion and are degraded by various enzymes such as fatty acid amide hydrolase (FAAH) and monoacylglycerol lipase (MGL). Various studies, including those from our group, suggest that there are changes in gene and protein expression of endocannabinoid molecules during chemotherapy-induced neuropathic pain (CINP), HIV and antiretroviral-induced neuropathic pain. Analysis of endocannabinoid molecule expression in the brain, spinal cord and paw skin using LC-MS/MS show that there is a specific deficiency of the endocannabinoids 2-AG and/or anandamide in the periphery during CINP. Various drugs including endocannabinoids, cannabidiol, inhibitors of FAAH and MGL, CB receptor agonists, desipramine and coadministered indomethacin plus minocycline have been found to either prevent the development and/or attenuate established CINP, HIV and antiretroviral-induced neuropathic pain in a CB receptor-dependent manner. The results available suggest that targeting the endocannabinoid system for prevention and treatment of CINP, HIV-associated neuropathic pain and antiretroviral-induced neuropathic pain is a plausible therapeutic option.

behaviour varies even among genetically identical animals raised in the same environment. However, little is known about the circuit or anatomical underpinnings of this individuality, though previous work implicates sensory periphery. Drosophila olfaction presents an ideal model to study the biological basis of behavioural individuality, because while the neural circuit underlying olfactory behaviour is well-described and highly stereotyped, persistent idiosyncrasy in behaviour, neural coding, and neural wiring have also been described. Projection neurons (PNs), which relay odor signals sensed by olfactory receptor neurons (ORNs) to deeper brain structures, exhibit variable calcium responses to identical odor stimuli across individuals, but how these idiosyncrasies relate to individual behavioural responses remains unknown. Here, using paired behaviour and two-photon imaging measurements, we show that idiosyncratic calcium dynamics in both ORNs and PNs predict individual preferences for an aversive monomolecular odorant versus air, suggesting that variation at the periphery of the olfactory system determines individual preference for an odor’s presence. In contrast, PN, but not ORN, calcium responses predict individual preferences in a two-odor choice assay. Furthermore, paired behaviour and immunohistochemistry measurements reveal that variation in ORN presynaptic density also predicts two-odor preference, suggesting this site is a locus of individuality where microscale circuit variation gives rise to idiosyncrasy in behaviour. Our results demonstrate how a neural circuit may vary functionally and structurally to produce variable behaviour among individuals.

Olfactory navigation provides a tractable model for studying the circuit basis of sensori-motor transformations and goal-directed behaviour. Macroscopic organisms typically navigate in odor plumes that provide a noisy and uncertain signal about the location of an odor source. Work in many species has suggested that animals accomplish this task by combining temporal processing of dynamic odor information with an estimate of wind direction. Our lab has been using adult walking Drosophila to understand both the computational algorithms and the neural circuits that support navigation in a plume of attractive food odor. We developed a high-throughput paradigm to study behavioural responses to temporally-controlled odor and wind stimuli. Using this paradigm we found that flies respond to a food odor (apple cider vinegar) with two behaviours: during the odor they run upwind, while after odor loss they perform a local search. A simple computational model based one these two responses is sufficient to replicate many aspects of fly behaviour in a natural turbulent plume. In on-going work, we are seeking to identify the neural circuits and biophysical mechanisms that perform the computations delineated by our model. Using electrophysiology, we have identified mechanosensory neurons that compute wind direction from movements of the two antennae and central mechanosensory neurons that encode wind direction are are involved in generating a stable downwind orientation. Using optogenetic activation, we have traced olfactory circuits capable of evoking upwind orientation and offset search from the periphery, through the mushroom body and lateral horn, to the central complex. Finally, we have used optogenetic activation, in combination with molecular manipulation of specific synapses, to localize temporal computations performed on the odor signal to olfactory transduction and transmission at specific synapses. Our work illustrates how the tools available in fruit fly can be applied to dissect the mechanisms underlying a complex goal-directed behaviour.