Conscious Experience
conscious experience
Consciousness Aesthetics
We can perceive aesthetic properties such as beauty and sublimity in artworks, environmental nature and even ordinary life. How about consciousness? Does consciousness have aesthetic properties? If so, what kind of aesthetic properties conscious experiences can have? If conscious experiences can have some kinds of aesthetic properties, how can we appreciate them? These questions constitute "Consciousness Aesthetics". In this talk, I will introduce consciousness aesthetics as a new field of aesthetics and discuss some of such questions.
Beyond Volition
Voluntary actions are actions that agents choose to make. Volition is the set of cognitive processes that implement such choice and initiation. These processes are often held essential to modern societies, because they form the cognitive underpinning for concepts of individual autonomy and individual responsibility. Nevertheless, psychology and neuroscience have struggled to define volition, and have also struggled to study it scientifically. Laboratory experiments on volition, such as those of Libet, have been criticised, often rather naively, as focussing exclusively on meaningless actions, and ignoring the factors that make voluntary action important in the wider world. In this talk, I will first review these criticisms, and then look at extending scientific approaches to volition in three directions that may enrich scientific understanding of volition. First, volition becomes particularly important when the range of possible actions is large and unconstrained - yet most experimental paradigms involve minimal response spaces. We have developed a novel paradigm for eliciting de novo actions through verbal fluency, and used this to estimate the elusive conscious experience of generativity. Second, volition can be viewed as a mechanism for flexibility, by promoting adaptation of behavioural biases. This view departs from the tradition of defining volition by contrasting internally-generated actions with externally-triggered actions, and instead links volition to model-based reinforcement learning. By using the context of competitive games to re-operationalise the classic Libet experiment, we identified a form of adaptive autonomy that allows agents to reduce biases in their action choices. Interestingly, this mechanism seems not to require explicit understanding and strategic use of action selection rules, in contrast to classical ideas about the relation between volition and conscious, rational thought. Third, I will consider volition teleologically, as a mechanism for achieving counterfactual goals through complex problem-solving. This perspective gives a key role in mediating between understanding and planning on the one hand, and instrumental action on the other hand. Taken together, these three cognitive phenomena of generativity, flexibility, and teleology may partly explain why volition is such an important cognitive function for organisation of human behaviour and human flourishing. I will end by discussing how this enriched view of volition can relate to individual autonomy and responsibility.
Time as its own representation? Exploring a link between timing of cognition and time perception
The way we represent and perceive time has crucial implications for studying temporality in conscious experience. Contrasting positions posit that temporal information is separately abstracted out like any other perceptual property, or that time is represented through representations having temporal properties themselves. To add to this debate, we investigated alterations in felt time in conditions where only conscious visual experience is altered while a bistable figure remains physically unchanged. In this talk, I will discuss two studies that we have done in relation to answering this question. In study 1, we investigated whether perceptual switches in fixed intervals altered felt time. In three experiments we showed that a break in visual experience (via a perceptual switch) also leads to a break in felt time. In study 2, we are currently looking at figure-ground perception in ambigous displays. Here, in experiment 1 we show that differences in flicker frequencies on ambigous regions can induce figure-ground segregation. To see if a reverse complementarity exists for felt time, we ask participants to view ambigous regions as figure/ground and show that they have different temporal resolutions for the same region based on whether it is seen as figure or background. Overall, the two studies provide evidence for temporal mirroring and isomorphism in visual experience, arguing for a link between the timing of experience and time perception.
Why Some Intelligent Agents are Conscious
In this talk I will present an account of how an agent designed or evolved to be intelligent may come to enjoy subjective experiences. First, the agent is stipulated to be capable of (meta)representing subjective ‘qualitative’ sensory information, in the sense that it can easily assess how exactly similar a sensory signal is to all other possible sensory signals. This information is subjective in the sense that it concerns how the different stimuli can be distinguished by the agent itself, rather than how physically similar they are. For this to happen, sensory coding needs to satisfy sparsity and smoothness constraints, which are known to facilitate metacognition and generalization. Second, this qualitative information can under some specific circumstances acquire an ‘assertoric force’. This happens when a certain self-monitoring mechanism decides that the qualitative information reliably tracks the current state of the world, and informs a general symbolic reasoning system of this fact. I will argue that the having of subjective conscious experiences amounts to nothing more than having qualitative sensory information acquiring an assertoric status within one’s belief system. When this happens, the perceptual content presents itself as reflecting the state of the world right now, in ways that seem undeniably rational to the agent. At the same time, without effort, the agent also knows what the perceptual content is like, in terms of how subjectively similar it is to all other possible precepts. I will discuss the computational benefits of this architecture, for which consciousness might have arisen as a byproduct.
Refuting the unfolding-argument on the irrelevance of causal structure to consciousness
I will build from Niccolo's discussion of the Blockhead argument to argue that having an FeedForward Network (FN) responding like an recurrent network (RN) in a consciousness experiment is not enough to convince us the two are the same with regards to the posession of mental states and conscious experience. I will then argue that a robust functional equivalence between FFN and RN is akso not supported by the mathematical work on the Universal Approximator theorem, and is also unlikely to hold, as a conjecture, given data in cognitive neuroscience; I will argue that an equivalence of RN and FFN may only apply to static functions between input/output layers and not to the temporal patterns or to the network's reactions to structural perturbations. Finally, I review data indicating that consciousness has functional characteristics, such as a flexible control of behavior, and that cognitive/brain dynamics reveal interacting top-down and bottom-up processes, which are necessary for the mediation of such control processes.
Cellular mechanisms of conscious processing
Recent breakthroughs in neurobiology indicate that time is ripe to understand the cellular-level mechanisms of conscious experience. Accordingly, we have recently proposed that conscious processing depends on the integration between top-down and bottom-up information streams and that there exists a specific cellular mechanism that gates this integration. I will first describe this cellular mechanism and demonstrate how it controls signal propagation within the thalamocortical system. Then I will show how this cellular-level mechanism provides a natural explanation for why conscious experience is modulated by top-down processing. Besides shining new light on the neural basis of consciousness, this perspective unravels the mechanisms of internally generated perception, such as dreams, imagery, and hallucinations.
Qualitative Structure, Automorphism Groups and Private Language
It is generally agreed upon that qualities of conscious experience instantiate structural properties, usually called relations. They furnish a representation of qualities (or qualia, in fact) in terms of a mathematical space Q (rather than a set), which is crucial to both modelling and measuring of conscious experience." "What is usually disregarded is that “only such structural properties generalize across individuals” (Austen Clark), but that qualities themselves as differentiated by stimulus specifications, behavior or reports do not. We show that this implies that only the part of Q which is invariant with respect to the automorphism group has a well-defined referent, while individual elements do not. This poses a prima facie limitation of any theory or experiment that aims to address individual qualities. We show how mathematical theories of consciousness can overcome this limitation via symmetry groups and group actions, making accessible to science what is properly called private language.
Bidirectionally connected cores in a mouse connectome: Towards extracting the brain subnetworks essential for consciousness
Where in the brain consciousness resides remains unclear. It has been suggested that the subnetworks supporting consciousness should be bidirectionally (recurrently) connected because both feed-forward and feedback processing are necessary for conscious experience. Accordingly, evaluating which subnetworks are bidirectionally connected and the strength of these connections would likely aid the identification of regions essential to consciousness. Here, we propose a method for hierarchically decomposing a network into cores with different strengths of bidirectional connection, as a means of revealing the structure of the complex brain network. We applied the method to a whole-brain mouse connectome. We found that cores with strong bidirectional connections consisted of regions presumably essential to consciousness (e.g., the isocortical and thalamic regions, and claustrum) and did not include regions presumably irrelevant to consciousness (e.g., cerebellum). Contrarily, we could not find such correspondence between cores and consciousness when we applied other simple methods which ignored bidirectionality. These findings suggest that our method provides a novel insight into the relation between bidirectional brain network structures and consciousness. Our recent preprint on this work is here: https://doi.org/10.1101/2021.07.12.452022.
Seeing with technology: Exchanging the senses with sensory substitution and augmentation
What is perception? Our sensory modalities transmit information about the external world into electrochemical signals that somehow give rise to our conscious experience of our environment. Normally there is too much information to be processed in any given moment, and the mechanisms of attention focus the limited resources of the mind to some information at the expense of others. My research has advanced from first examining visual perception and attention to now examine how multisensory processing contributes to perception and cognition. There are fundamental constraints on how much information can be processed by the different senses on their own and in combination. Here I will explore information processing from the perspective of sensory substitution and augmentation, and how "seeing" with the ears and tongue can advance fundamental and translational research.
From real problems to beast machines: the somatic basis of selfhood
At the foundation of human conscious experience lie basic embodied experiences of selfhood – experiences of simply ‘being alive’. In this talk, I will make the case that this central feature of human existence is underpinned by predictive regulation of the interior of the body, using the framework of predictive processing, or active inference. I start by showing how conscious experiences of the world around us can be understood in terms of perceptual predictions, drawing on examples from psychophysics and virtual reality. Then, turning the lens inwards, we will see how the experience of being an ‘embodied self’ rests on control-oriented predictive (allostatic) regulation of the body’s physiological condition. This approach implies a deep connection between mind and life, and provides a new way to understand the subjective nature of consciousness as emerging from systems that care intrinsically about their own existence. Contrary to the old doctrine of Descartes, we are conscious because we are beast machines.
As soon as there was life there was danger
Organisms face challenges to survival throughout life. When we freeze or flee in danger, we often feel fear. Tracing the deep history of danger gives a different perspective. The first cells living billions of years ago had to detect and respond to danger in order to survive. Life is about not being dead, and behavior is a major way that organisms hold death off. Although behavior does not require a nervous system, complex organisms have brain circuits for detecting and responding to danger, the deep roots of which go back to the first cells. But these circuits do not make fear, and fear is not the cause of why we freeze or flee. Fear a human invention; a construct we use to account for what happens in our minds when we become aware that we are in harm’s way. This requires a brain that can personally know that it existed in the past, that it is the entity that might be harmed in the present, and that it will cease to exist it the future. If other animals have conscious experiences, they cannot have the kinds of conscious experiences we have because they do not have the kinds of brains we have. This is not meant as a denial of animal consciousness; it is simply a statement about the fact that every species has a different brain. Nor is it a declaration about the wonders of the human brain, since we have done some wonderful, but also horrific, things with our brains. In fact, we are on the way to a climatic disaster that will not, as some suggest, destroy the Earth. But it will make it inhabitable for our kind, and other organisms with high energy demands. Bacteria have made it for billions of years and will likely be fine. The rest is up for grabs, and, in a very real sense, up to us.
Psychedelics and the Pharmacology of Consciousness
The study of altered states of consciousness has long had the potential to provide important insight into the nature of consciousness. In recent years there has been a resurgence of research and public interest in atypical or altered states of consciousness. These have focused both on conditions in which consciousness is considered to be impaired due to brain trauma or enhanced in some way through mediation practices or ingestion of psychedelics. The talk will begin with a brief overview of recent scientific approaches to understanding these different types of altered consciousness. The remainder of the talk will focus on lab-based experiments conducted by myself and others looking at the effects of serotoninergic hallucinogens (i.e. psilocybin and LSD) on perceptual and cognitive function. Together this body of research provides important new insights for the scientific study of consciousness and an initial understanding of the neuropharmacological mechanisms underlying conscious experience.
The pharmacology of consciousness
My research uses a range of methods to better understand how the brain’s natural chemicals control complex behaviours, thoughts and perceptions. I also have a particular fascination about the factors that determine the contents of an individual’s conscious experience. In this talk I will present work that sits at the intersection of these two research areas looking at the role of different neurotransmitter systems in driving changes in conscious state. Specifically, I will discuss a series of studies using ambiguous stimuli to explore the neuropharmacological processes that underly alternations in perceptual awareness. By comparing different methods and neurotransmitter systems including: serotonin (psychedelics), noradrenaline (pupillometry) and Glutamate/GABA (Magnetic Resonance Spectroscopy MRS) we can start to tease apart the distinct role that different neurotransmitter systems play in coordinating conscious experience across time.
A no-report paradigm reveals that face cells multiplex consciously perceived and suppressed stimuli
Having conscious experience is arguably the most important reason why it matters to us whether we are alive or dead. A powerful paradigm to identify neural correlates of consciousness is binocular rivalry, wherein a constant visual stimulus evokes a varying conscious percept. It has recently been suggested that activity modulations observed during rivalry may represent the act of report rather than the conscious percept itself. Here, we performed single-unit recordings from face patches in macaque inferotemporal (IT) cortex using a novel no-report paradigm in which the animal’s conscious percept was inferred from eye movements. These experiments reveal two new results concerning the neural correlates of consciousness. First, we found that high proportions of IT neurons represented the conscious percept even without active report. Using high-channel recordings, including a new 128-channel Neuropixels-like probe, we were able to decode the conscious percept on single trials. Second, we found that even on single trials, modulation to rivalrous stimuli was weaker than that to unambiguous stimuli, suggesting that cells may encode not only the conscious percept but also the suppressed stimulus. To test this hypothesis, we varied the identity of the suppressed stimulus during binocular rivalry; we found that indeed, we could decode not only the conscious percept but also the suppressed stimulus from neural activity. Moreover, the same cells that were strongly modulated by the conscious percept also tended to be strongly modulated by the suppressed stimulus. Together, our findings indicate that (1) IT cortex possesses a true neural correlate of consciousness even in the absence of report, and (2) this correlate consists of a population code wherein single cells multiplex representation of the conscious percept and veridical physical stimulus, rather than a subset of cells perfectly reflecting consciousness.
Can subjective experience be quantified? Critically examining computational cognitive neuroscience approaches
Computational and cognitive neuroscience techniques have made great strides towards describing the neural computations underlying perceptual inference and decision-making under uncertainty. These tools tell us how and why perceptual illusions occur, which brain areas may represent noisy information in a probabilistic manner, and so on. However, an understanding of the subjective, qualitative aspects of perception remains elusive: qualia, or the personal, intrinsic properties of phenomenal awareness, have remained out of reach of these computational analytic insights. Here, I propose that metacognitive computations, and the subjective feelings that go along with them, give us a solid starting point for understanding subjective experience in general. Specifically, perceptual metacognition possesses ontological and practical properties that provide a powerful and unique opportunity for studying the studying the neural and computational correlates of subjective experience using established tools of computational and cognitive neuroscience. By capitalizing on decades of developments in formal computational model comparisons as applied to the specific properties of perceptual metacognition, we are now in a privileged position to reveal new and exciting insights about how the brain constructs our subjective conscious experiences.