Colour
colour
The Effects of Negative Emotions on Mental Representation of Faces
Face detection is an initial step of many social interactions involving a comparison between a visual input and a mental representation of faces, built from previous experience. Whilst emotional state was found to affect the way humans attend to faces, little research has explored the effects of emotions on the mental representation of faces. Here, we examined the specific perceptual modulation of geometric properties of the mental representations associated with state anxiety and state depression on face detection, and to compare their emotional expression. To this end, we used an adaptation of the reverse correlation technique inspired by Gosselin and Schyns’, (2003) ‘Superstitious Approach’, to construct visual representations of observers’ mental representations of faces and to relate these to their mental states. In two sessions, on separate days, participants were presented with ‘colourful’ noise stimuli and asked to detect faces, which they were told were present. Based on the noise fragments that were identified as faces, we reconstructed the pictorial mental representation utilised by each participant in each session. We found a significant correlation between the size of the mental representation of faces and participants’ level of depression. Our findings provide a preliminary insight about the way emotions affect appearance expectation of faces. To further understand whether the facial expressions of participants’ mental representations reflect their emotional state, we are conducting a validation study with a group of naïve observers who are asked to classify the reconstructed face images by emotion. Thus, we assess whether the faces communicate participants’ emotional states to others.
A model of colour appearance based on efficient coding of natural images
An object’s colour, brightness and pattern are all influenced by its surroundings, and a number of visual phenomena and “illusions” have been discovered that highlight these often dramatic effects. Explanations for these phenomena range from low-level neural mechanisms to high-level processes that incorporate contextual information or prior knowledge. Importantly, few of these phenomena can currently be accounted for when measuring an object’s perceived colour. Here we ask to what extent colour appearance is predicted by a model based on the principle of coding efficiency. The model assumes that the image is encoded by noisy spatio-chromatic filters at one octave separations, which are either circularly symmetrical or oriented. Each spatial band’s lower threshold is set by the contrast sensitivity function, and the dynamic range of the band is a fixed multiple of this threshold, above which the response saturates. Filter outputs are then reweighted to give equal power in each channel for natural images. We demonstrate that the model fits human behavioural performance in psychophysics experiments, and also primate retinal ganglion responses. Next we systematically test the model’s ability to qualitatively predict over 35 brightness and colour phenomena, with almost complete success. This implies that contrary to high-level processing explanations, much of colour appearance is potentially attributable to simple mechanisms evolved for efficient coding of natural images, and is a basis for modelling the vision of humans and other animals.
Seeing colour: is human perception optimised for natural illumination?
The evolution of computation in the brain: Insights from studying the retina
The retina is probably the most accessible part of the vertebrate central nervous system. Its computational logic can be interrogated in a dish, from patterns of lights as the natural input, to spike trains on the optic nerve as the natural output. Consequently, retinal circuits include some of the best understood computational networks in neuroscience. The retina is also ancient, and central to the emergence of neurally complex life on our planet. Alongside new locomotor strategies, the parallel evolution of image forming vision in vertebrate and invertebrate lineages is thought to have driven speciation during the Cambrian. This early investment in sophisticated vision is evident in the fossil record and from comparing the retina’s structural make up in extant species. Animals as diverse as eagles and lampreys share the same retinal make up of five classes of neurons, arranged into three nuclear layers flanking two synaptic layers. Some retina neuron types can be linked across the entire vertebrate tree of life. And yet, the functions that homologous neurons serve in different species, and the circuits that they innervate to do so, are often distinct to acknowledge the vast differences in species-specific visuo-behavioural demands. In the lab, we aim to leverage the vertebrate retina as a discovery platform for understanding the evolution of computation in the nervous system. Working on zebrafish alongside birds, frogs and sharks, we ask: How do synapses, neurons and networks enable ‘function’, and how can they rearrange to meet new sensory and behavioural demands on evolutionary timescales?
Opponent processing in the expanded retinal mosaic of Nymphalid butterflies
In many butterflies, the ancestral trichromatic insect colour vision, based on UV-, blue- and green-sensitive photoreceptors, is extended with red-sensitive cells. Physiological evidence for red receptors has been missing in nymphalid butterflies, although some species can discriminate red hues well. In eight species from genera Archaeoprepona, Argynnis, Charaxes, Danaus, Melitaea, Morpho, Heliconius and Speyeria, we found a novel class of green-sensitive photoreceptors that have hyperpolarizing responses to stimulation with red light. These green-positive, red-negative (G+R–) cells are allocated to positions R1/2, normally occupied by UV and blue-sensitive cells. Spectral sensitivity, polarization sensitivity and temporal dynamics suggest that the red opponent units (R–) are the basal photoreceptors R9, interacting with R1/2 in the same ommatidia via direct inhibitory synapses. We found the G+R– cells exclusively in butterflies with red-shining ommatidia, which contain longitudinal screening pigments. The implementation of the red colour channel with R9 is different from pierid and papilionid butterflies, where cells R5–8 are the red receptors. The nymphalid red-green opponent channel and the potential for tetrachromacy seem to have been switched on several times during evolution, balancing between the cost of neural processing and the value of extended colour information.
Data spaces: category (sheaf) theory and phenomenology
In this talk, I’ll introduce the formal concept of a (pre)sheaf as data attached to a topological space. Sheaves capture the notion of patching local sources of information to form a global whole, e.g., the binding of visual features such as colour and shape. The formal theory appears to be closely related to the foundational properties asserted by the Information Integration Theory (IIT) for phenomenology. A comparison is intended to engender discussion on ways that phenomenology may benefit from a sheaf theory, or (more generally) a category theory approach.
Predator-prey interactions: the avian visual sensory perspective
My research interests are centered on animal ecology, and more specifically include the following areas: visual ecology, behavioral ecology, and conservation biology, as well as the interactions between them. My research is question-driven. I answer my questions in a comprehensive manner, using a combination of empirical, theoretical, and comparative approaches. My model species are usually birds, but I have also worked with fish, mammals, amphibians, and insects. I was fortunate to enrich my education by attending Universities in different parts of the world. I did my undergraduate, specialized in ecology and biodiversity, at the "Universidad Nacional de Cordoba", Argentina. My Ph.D. was in animal ecology and conservation biology at the "Universidad Complutense de Madrid", Spain. My two post-docs were focused on behavioral ecology; the first one at University of Oxford (United Kingdom), and the second one at University of Minnesota (USA). I was an Assistant Professor at California State University Long Beach for almost six years. I am now a Full Professor of Biological Sciences at Purdue University.
Colour processing in the mouse brain for vision and beyond
Colour vision plays important roles in regulating animal behaviour, yet understanding of how such information is processed in the brain is still incomplete. Here I discuss our work addressing this issue in mice where, despite aspects of retinal organisation that might suggest limited capacity for colour vision, we find evidence of extensive cone-dependent spectral opponency across subcortical visual centres. In particular, our data both reveals important contributions of such colour signals to non-image-forming functions (regulation of the circadian system) but also indicate surprisingly sophisticated support for more conventional aspects of colour vision.
“From the Sublime to the Stomatopod: the story from beginning to nowhere near the end.”
“Call me a marine vision scientist. Some years ago - never mind how long precisely - having little or no money in my purse, and nothing particular to interest me on shore, I thought I would sail about a little and see what animals see in the watery part of the world. It is a way I have of dividing off the spectrum, and regulating circular polarisation.” Sometimes I wish I had just set out to harpoon a white whale as it would have been easier than studying stomatopod (mantis shrimp) vision. Nowhere near as much fun of course and certainly less dangerous so in this presentation I track the history of discovery and confusion that stomatopods deliver in trying to understand what the do actually see. The talk unashamedly borrows from that of Mike Bok a few weeks ago (April 13th 2021 “The Blurry Beginnings: etc” talk) as an introduction to the system (do go look at his talk again, it is beautiful!) and goes both backwards and forwards in time, trying to provide an explanation for the design of this visual system. The journey is again one of retinal anatomy and physiology, neuroanatomy, electrophysiology, behaviour and body ornaments but this time focusses more on polarisation vision (Mike covered the colour stuff well). There is a comparative section looking at the cephalopods too and by the end, I hope you will understand where we are at with trying to understand this extraordinary way of seeing the world and why we ‘pod-people’ wave our arms around so much when asked to explain; what do stomatopods see? Maybe, to butcher another quote: “mantis shrimp have been rendered visually beautiful for vision’s sake.”
Retinal circuits for colour vision in a tetrachromate
The neuroscience of color and what makes primates special
Among mammals, excellent color vision has evolved only in certain non-human primates. And yet, color is often assumed to be just a low-level stimulus feature with a modest role in encoding and recognizing objects. The rationale for this dogma is compelling: object recognition is excellent in grayscale images (consider black-and-white movies, where faces, places, objects, and story are readily apparent). In my talk I will discuss experiments in which we used color as a tool to uncover an organizational plan in inferior temporal cortex (parallel, multistage processing for places, faces, colors, and objects) and a visual-stimulus functional representation in prefrontal cortex (PFC). The discovery of an extensive network of color-biased domains within IT and PFC, regions implicated in high-level object vision and executive functions, compels a re-evaluation of the role of color in behavior. I will discuss behavioral studies prompted by the neurobiology that uncover a universal principle for color categorization across languages, the first systematic study of the color statistics of objects and a chromatic mechanism by which the brain may compute animacy, and a surprising paradoxical impact of memory on face color. Taken together, my talk will put forward the argument that color is not primarily for object recognition, but rather for the assessment of the likely behavioral relevance, or meaning, of the stuff we see.
The Blurry Beginnings: What nature’s strangest eyes tell us about the evolution of vision
Our study reveals the most elaborate opsin expression patterns ever described in any animal eye. In mantis shrimp, a pugnacious crustacean renowned for its visual sophistication, we found unexpected retinal expression patterns highlighting the potential for cryptic photoreceptor functional diversity, including single photoreceptors that coexpress opsins from different spectral clades and a single opsin with a putative nonvisual function important in color vision. This study demonstrates the evolutionary potential for increasing visual system functional diversity through opsin gene duplication and diversification, as well as changes in patterns of gene coexpression among photoreceptors and retinula cells. These results have significant implications for the function of other visual systems, particularly in arthropods where large numbers of retinally expressed opsins have been documented.
Young IBRO NextInNeuro Webinar - The retinal basis of colour vision: from fish to humans
Colour vision is based on circuit-level comparison of the signals from spectral distinct types of photoreceptors. In our own eyes, the presence of three types of cones enable trichromatic colour vision. However, many phylogenetically ‘older’ vertebrates have four or more cone types, and in almost all their cases the circuits that enable tetra- or possibly even pentachromatic colour vision are not known. This includes the majority of birds, reptiles, amphibians, and bony fish. In the lab we study neuronal circuits for colour vision in non-mammalian vertebrates, with a focus on zebrafish, a tetrachromatic surface dwelling species of teleost. I will discuss how in the case of zebrafish, retinal colour computations are implemented in a fundamentally different, and probably much more efficient way compared to how they are thought to work in humans. I will then highlight how these fish circuits might be linked with those in mammals, possibly providing a new way of thinking about how circuits for colour vision are organized in vertebrates.
Synaesthesia as a Model System for Understanding Variation in the Human Mind and Brain
During this talk, I will seek to reposition synaesthesia as model system for understanding variation in the construction of the human mind and brain. People with synaesthesia inhabit a remarkable mental world in which numbers can be coloured, words can have tastes, and music is a visual spectacle. Synaesthesia has now been documented for over two hundred years but key questions remain unanswered about why it exists, and what such conditions might mean for theories of the human mind. I will argue that we need to rethink synaesthesia as not just representing exceptional experiences, but as a product of an unusual neurodevelopmental cascade from genes to brain to cognition of which synaesthesia is only one outcome. Rather than synaesthesia being a kind of 'dangling qualia' (atypical experiences attached to a typical mind/brain) it should be thought of as unusual experiences that accompany an unusual mind/brain. Specifically, differences in the brains of synaesthetes support a distinctive way of thinking (enhanced memory, imagery etc.) and may also predispose towards particular clinical vulnerabilities. It is this neurodiverse phenotype that is an important object of study in its own right and may explain any adaptive value for having synaesthesia.
Cones with character: An in vivo circuit implementation of efficient coding
In this talk I will summarize some of our recent unpublished work on spectral coding in the larval zebrafish retina. Combining 2p imaging, hyperspectral stimulation, computational modeling and connectomics, we take a renewed look at the spectral tuning of cone photoreceptors in the live eye. We find that already cones optimally rotate natural colour space in a PCA-like fashion to disambiguate greyscale from "colour" information. We then follow this signal through the retinal layers and ultimately into the brain to explore the major spectral computations performed by the visual system at its consecutive stages. We find that by and large, zebrafish colour vision can be broken into three major spectral zones: long wavelength grey-scale-like vision, short-wavelength prey capture circuits, and spectrally diverse mid-wavelength circuits which possibly support the bulk of "true colour vision" in this tetrachromate vertebrate.
Natural visual stimuli for mice
During the course of evolution, a species’ environment shapes its sensory abilities, as individuals with more optimized sensory abilities are more likely survive and procreate. Adaptations to the statistics of the natural environment can be observed along the early visual pathway and across species. Therefore, characterising the properties of natural environments and studying the representation of natural scenes along the visual pathway is crucial for advancing our understanding of the structure and function of the visual system. In the past 20 years, mice have become an important model in vision research, but the fact that they live in a different environment than primates and have different visual needs is rarely considered. One particular challenge for characterising the mouse’s visual environment is that they are dichromats with photoreceptors that detect UV light, which the typical camera does not record. This also has consequences for experimental visual stimulation, as the blue channel of computer screens fails to excite mouse UV cone photoreceptors. In my talk, I will describe our approach to recording “colour” footage of the habitat of mice – from the mouse’s perspective – and to studying retinal circuits in the ex vivo retina with natural movies.