Decision Making
Decision Making
Prof Mark Humphries
The Humphries’ lab at the University of Nottingham is seeking a postdoc to study the neural basis of foraging, in collaboration with the groups of Matthew Apps (Birmingham) and Nathan Lepora (Bristol). Whether choosing to leave one shop for another, switching TV programs, or seeking berries to eat, humans and other animals make innumerable stay-or-leave decisions, but how we make them is not well understood. The goal of this project is to develop new computational accounts of stay-or-leave decisions, and use them to test hypotheses for how humans, primates, and rodents learn and make these decisions. The work will draw on and develop new reinforcement learning and accumulation (e.g. diffusion) models of decision-making. The Humphries’ group researches fundamental insights into how the joint activity of neurons encodes actions in the world (https://www.humphries-lab.org). This post will join our developing research program into how humans and other animals learn to make the right decisions (e.g. https://doi.org/10.1101/2022.08.30.505807).
Dr Flavia Mancini
This is an opportunity for a highly creative and skilled pre-doctoral Research Assistant to join the dynamic and multidisciplinary research environment of the Computational and Biological Learning research group (https://www.cbl-cambridge.org/), Department of Engineering, University of Cambridge. We are looking for a Research Assistant to work on projects related to statistical learning and contextual inference in the human brain. We have a particular focus of learning of aversive states, as this has a strong clinical significance for chronic pain and mental health disorders. The RA will be supervised by Dr Flavia Mancini (MRC Career Development fellow, and Head of the Nox Lab www.noxlab.org), and is expected to collaborate with theoretical and experimental colleagues in Cambridge, Oxford and abroad. The post holder will be located in central Cambridge, Cambridgeshire, UK. As a general approach, we combine statistical learning tasks in humans, computational modelling (using Bayesian inference, reinforcement learning, deep learning and neural networks) with neuroimaging methods (including 7T fMRI). The successful candidate will strengthen this approach and be responsible for designing experiments, collecting and analysis behavioural and brain fMRI data using computational modelling techniques. The key responsibilities and duties are: Ideating and conducting research studies on statistical/aversive learning, combining behavioural tasks, computational modelling (using Bayesian inference, reinforcement learning, deep learning and/or neural networks) with fMRI in healthy volunteers and chronic pain patients. Disseminating research findings Maintaining and developing technical skills to expand their scientific potential ******* More info and to apply: https://www.jobs.cam.ac.uk/job/35905/
Anne Urai
Full listing: https://www.medewerkers.universiteitleiden.nl/vacatures/2022/kwartaal-2/22-25911465postdoc-in-cognitive-and-computational-neuroscience The way that neural computations give rise to behavior is shaped by ever-fluctuating internal states. These states (such as arousal, fear, stress, hunger, motivation, engagement, or drowsiness) are characterized by spontaneous neural dynamics that arise independent of task demands. Across subfields of neuroscience, internal states have been quantified using a variety of measurements and markers (based on physiology, brain activity or behavioral motifs), but these are rarely explicitly compared or integrated. It is thus unclear if such different state markers quantify the same, or even related underlying processes. Instead, the simplified concept of internal states likely obscures a multi-dimensional set of biologically relevant processes, which may affect behavior in distinct ways. In this project, we will take an integrative approach to quantify the structure and dimensionality of internal states and their effects on decision-making behavior. We will apply several state-of-the-art methods to extract different markers of internal states from facial video data, pupillometry, and high-density neural recordings. We will then quantify the unique and shared dimensionality of internal states, and their relevance for predicting choice behavior. By combining existing, publicly available datasets in mice with additional experiments in humans, we will directly test the cross-species relevance of our findings. Lastly, we will investigate how internal states change over a range of timescales: from sub-second fluctuations relevant for choice behavior to the very slow changes that take place with aging. This project is a collaboration between the Cognitive, Computational and Systems Neuroscience lab led by Dr. Anne Urai (daily supervisor) and the Temporal Attention Lab led by Prof. Sander Nieuwenhuis. We are based in Leiden University’s Cognitive Psychology Unit, and we participate in the Leiden Institute for Brain and Cognition (LIBC), an interfaculty center for interdisciplinary research on brain and cognition ( https://www.libc-leiden.nl ). There are further options for collaborating with the International Brain Laboratory ( https://www.internationalbrainlab.com ). Leiden is a small, friendly town near the beach, with great public transport connections to larger cities nearby. The Netherlands has excellent support for families. The working language at the university is English, and you can comfortably get by with only minimal knowledge of Dutch. Our team is small, and we value a collegial and supportive environment. Open science is a core value in our work, and we actively pursue ways to make academia a better place. We support postdocs in developing their own ideas and research line, and we offer opportunities to gain small-scale teaching and grant writing experience. More information on our groups’ research interests, scientific vision and working environment can be found at https://anneurai.net, https://anne-urai.github.io/lab_wiki/Vision.html and https://www.temporalattentionlab.com If you like asking hard questions, making things work, and pursuing creative ideas in a collaborative team, then this position may be for you. Please do not be discouraged from applying if your current CV is not a ‘perfect fit’. This job could suit someone from a range of different career backgrounds, and there is great scope for the right applicant to develop the role and make it their own.
Dr. Tobias U. Hauser
We have a postdoc position at the Max Planck UCL Centre for Computational Psychiatry and Ageing Research and the Wellcome Centre for Human Neuroimaging to fill this summer. The eligible candidate should have a strong background in fMRI and decision making. They will join the developmental computational psychiatry group, working on innovative topics, such as structure learning, complex decision making and mental health. The focus will be on conducting fMRI research with the possibility to do computational modelling.
Dr Tobias U. Hauser
The eligible candidate should have a strong background in fMRI and decision making. He will join the developmental computational psychiatry group, working on innovative topics, such as structure learning, complex decision making and mental health. The focus will be on conducting fMRI research with the possibility to do computational modelling.
N/A
The position holder will be a member of the Hessian Center for Artificial Intelligence - hessian.AI and provides research at the Center and will also be a member of the Centre for Cognitive Science. The scientific focus of the position is on the computational and algorithmic modeling of behavioral data to understand the human mind. Exemplary research topics include computational level models of perception, cognition, decision making, action, and learning as well as extended behavior and social interactions in humans, algorithmic models that are able to simulate, predict, and explain human behavior, model-driven behavioral research on human cognition. The professorship is expected to strengthen the Hessian Center for Artificial Intelligence and TU Darmstadt’s Human Science department’s research focus on Cognitive Science. Depending on the candidate’s profile there is the opportunity to participate in joint research projects currently running at TU Darmstadt. This in particular includes the state funded cluster projects “The Adaptive Mind (TAM)” and “The Third Wave of Artificial Intelligence (3AI)”. In addition to excellent scientific credentials, we seek a strong commitment to teaching in the department’s Bachelor and Masters programs in Cognitive Science. Experience in attracting third-party funding as well as participation in academic governance is expected.
Sam Neymotin
Postdoctoral scientist positions are available at the Nathan Kline Institute (NKI) for Psychiatric Research to work on computational neuroscience research funded by recently awarded NIH and DoD grants. Our NIH-funded projects investigate the brain's dynamic circuit motifs underlying internal vs. external-oriented processes in the auditory and interconnected areas, using circuit modeling of the thalamocortical system. In this project, the postdoc will build data-driven biophysical models constrained by data collected from electrophysiology labs at NKI and Columbia & The Feinstein Institutes for Medical Research, and then use the models to predict optimal neuromodulation strategies for inducing/suppressing circuit patterns, testable in vivo. Our DoD project involves developing computational models of the hippocampal and entorhinal cortex circuitry used in spatial navigation, higher level decision making circuits, and integrating the models with agents learning to solve navigation tasks using neurobiologically-inspired learning rules. This project includes mathematicians and robotics researchers at UTK and CMU.
Prof. Shu-Chen Li
The Chair of Lifespan Developmental Neuroscience investigates neurocognitive mechanisms underlying perceptual, cognitive, and motivational development across the lifespan. The main themes of our research are neurofunctional mechanisms underlying lifespan development of episodic and spatial memory, cognitive control, reward processing, decision making, perception and action. We also pursue applied research to study effects of behavioral intervention, non-invasive brain stimulation, or digital technologies in enhancing functional plasticity for individuals of difference ages. We utilize a broad range of neurocognitive (e.g., EEG, fNIRs, fMRI, tDCS) and computational methods. The here announced position is embedded in a newly established research group funded by the DFG (FOR5429), with a focus on modulating brain networks for memory and learning by using focalized transcranial electrical stimulation (tES). The subproject with which this position is associated will study effects of focalized tES on value-based sequential learning at the behavioral and brain levels in adults. The data collection for this subproject will mainly be carried out at the Berlin site (Center for Cognitive Neuroscience, FU Berlin).
Susan Fischer
The 'Developmental Computational Psychiatry' lab and the W3 professorship 'Computational Psychiatry' led by Tobias Hauser at the University of Tübingen (Germany) is currently hiring new postdocs. The focus of the lab is to better understand the computational and neural mechanisms underlying decision making and learning, and how these processes go awry in patients with mental illnesses. The successful candidates will have the chance to work in a highly dynamic and inspiring environment and to collaborate closely with Prof Peter Dayan and the Max Planck Institute for Biological Cybernetics.
Susan Fischer
The 'Developmental Computational Psychiatry' lab and the W3 professorship 'Computational Psychiatry' led by Tobias Hauser at the University of Tübingen is hiring new postdocs. The lab focuses on understanding the computational and neural mechanisms underlying decision making and learning, and how these processes are affected in patients with mental illnesses. Successful candidates will work in a dynamic environment and collaborate with Prof Peter Dayan and the Max-Planck Institute for Biological Cybernetics.
Jorge Jaramillo
We are looking for an outstanding applicant to develop large-scale circuit models for decision making within a collaborative consortium that includes the Allen Institute for Neural Dynamics, New York University, and the University of Chicago. This ambitious NIH-funded project requires the creativity and expertise to integrate multimodal data sets (e.g., connectivity, large-scale neural recordings, behavior) into a comprehensive modeling framework. The successful applicant will join Jorge Jaramillo’s Distributed Neural Dynamics and Control Lab at the Grossman Center at the University of Chicago. Throughout the course of the postdoctoral training, there will be opportunities to visit the other sites in Seattle (Karel Svoboda) and New York (Adam Carter, Xiao-Jing Wang) for additional training and collaboration opportunities. Appointees will join as Grossman Center Postdoctoral Fellows at the University of Chicago and will have access to state-of-the-art facilities and additional opportunities for collaboration with exceptional experimental labs within the Department of Neurobiology, as well as other labs from the departments of Physics, Computer Sciences, and Statistics. The Grossman Center offers competitive postdoctoral salaries in the vibrant and international city of Chicago, and a rich intellectual environment that includes the Argonne National Laboratory and the Data Science Institute. Postdoctoral fellows will also have the possibility to work in additional projects with other Grossman Center faculty members.
Jorge Jaramillo
We are looking for an outstanding applicant to develop large-scale circuit models for decision making within a collaborative consortium that includes the Allen Institute for Neural Dynamics, New York University, and the University of Chicago. This ambitious NIH-funded project requires the creativity and expertise to integrate multimodal data sets (e.g., connectivity, large-scale neural recordings, behavior) into a comprehensive modeling framework. The successful applicant will join Jorge Jaramillo’s Distributed Neural Dynamics and Control Lab at the Grossman Center at the University of Chicago. Throughout the course of the postdoctoral training, there will be opportunities to visit the other sites in Seattle (Karel Svoboda) and New York (Adam Carter, Xiao-Jing Wang) for additional training and collaboration opportunities. Appointees will join as Grossman Center Postdoctoral Fellows at the University of Chicago and will have access to state-of-the-art facilities and additional opportunities for collaboration with exceptional experimental labs within the Department of Neurobiology, as well as other labs from the departments of Physics, Computer Sciences, and Statistics. The Grossman Center offers competitive postdoctoral salaries in the vibrant and international city of Chicago, and a rich intellectual environment that includes the Argonne National Laboratory and the Data Science Institute. Postdoctoral fellows will also have the possibility to work in additional projects with other Grossman Center faculty members.
Max Garagnani
The MSc in Computational Cognitive Neuroscience at Goldsmiths, University of London is designed for students with a good degree in the biological/life sciences (psychology, neuroscience, biology, medicine, etc.) or physical sciences (computer science, mathematics, physics, engineering). The course provides a solid theoretical basis and experimental techniques in computational cognitive neuroscience. It includes the opportunity to apply knowledge in a practical research project, potentially in collaboration with industry partners. The programme covers fundamentals of cognitive neuroscience, computational modelling of biological neurons, neuronal circuits, higher brain functions, and includes the study of biologically constrained models of cognitive processes.
N/A
The Department of Psychology at Florida State University (FSU) invites applicants for a full-time tenure-track Assistant Professor position in BEHAVIORAL/SYSTEMS NEUROSCIENCE. Candidates with lines of laboratory animal research in any area of Neuroscience are encouraged to apply, particularly those who work to understand experience-dependent neural activity in the normal or diseased brain. Such research might include spatial navigation, decision making, and/or learning and memory. FSU is classified as a Carnegie R1 (Highest Research Activities) and ranks in the top 20 of National Public Universities (US News & World Reports). Candidates will find an outstanding research infrastructure with scientific colleagues housed in adjacent buildings, and relatively new laboratory space and vivarium. The department has a fully-staffed electronics and machine shop and faculty have access to core equipment and resources including surgical suites, a confocal microscope and common-use histology/molecular laboratory in the building and numerous other shared resources across the program facilities (see https://www.neuro.fsu.edu/rsrc/cores) and campus (e.g., 21T small animal magnet). Our department has outstanding resources, a favorable teaching load, a high level of research activity, and a collegial atmosphere. The neuroscience community across the state of Florida is also highly collaborative. More information about our department and the Program in Neuroscience can be found at www.psy.fsu.edu and www.neuro.fsu.edu. The University is in Tallahassee, the capital of Florida, where residents have access to a broad range of cultural amenities and an abundance of regional springs, lakes and rivers, and pristine beaches on the Gulf of Mexico. Faculty will be expected to maintain a strong research program, train graduate students in the Interdisciplinary Program in Neuroscience, and have the potential for excellent teaching and mentoring of diverse student populations for undergraduate and graduate neuroscience courses in the Psychology Department. A doctoral degree is required. Applicants with a demonstrated commitment to expanding access to neuroscience through their program of research are encouraged to apply. To apply, go to http://www.jobs.fsu.edu (Job ID 58629) and submit: (1) a cover letter, (2) a curriculum vitae, (3) a research statement, (4) a teaching statement, and (5) up to four peer-reviewed papers, and (6) the names and contact information for writers for 3 letters of recommendation. Application review will begin on October 30, 2024. FSU is an Equal Opportunity/Access/Affirmative Action/Pro Disabled & Veteran Employer committed to enhancing the diversity of its faculty and students. Statement can be accessed at: https://hr.fsu.edu/sites/g/files/upcbnu2186/files/PDF/Publications/diversity/EEO_Statement.pdf. Inquiries about the position may be directed to Aaron Wilber, Search Chair, at awilber@fsu.edu.
N/A
The Department of Psychology at Florida State University (FSU) invites applicants for a full-time tenure-track Assistant Professor position in BEHAVIORAL/SYSTEMS NEUROSCIENCE. Candidates with lines of laboratory animal research in any area of Neuroscience are encouraged to apply, particularly those who work to understand experience-dependent neural activity in the normal or diseased brain. Such research might include spatial navigation, decision making, and/or learning and memory. FSU is classified as a Carnegie R1 (Highest Research Activities) and ranks in the top 20 of National Public Universities (US News & World Reports). Candidates will find an outstanding research infrastructure with scientific colleagues housed in adjacent buildings, and relatively new laboratory space and vivarium. The department has a fully-staffed electronics and machine shop and faculty have access to core equipment and resources including surgical suites, a confocal microscope and common-use histology/molecular laboratory in the building and numerous other shared resources across the program facilities (see https://www.neuro.fsu.edu/rsrc/cores) and campus (e.g., 21T small animal magnet). Our department has outstanding resources, a favorable teaching load, a high level of research activity, and a collegial atmosphere. The neuroscience community across the state of Florida is also highly collaborative. More information about our department and the Program in Neuroscience can be found at www.psy.fsu.edu and www.neuro.fsu.edu. The University is in Tallahassee, the capital of Florida, where residents have access to a broad range of cultural amenities and an abundance of regional springs, lakes and rivers, and pristine beaches on the Gulf of Mexico. Faculty will be expected to maintain a strong research program, train graduate students in the Interdisciplinary Program in Neuroscience, and have the potential for excellent teaching and mentoring of diverse student populations for undergraduate and graduate neuroscience courses in the Psychology Department. A doctoral degree is required. Applicants with a demonstrated commitment to expanding access to neuroscience through their program of research are encouraged to apply. To apply, go to http://www.jobs.fsu.edu (Job ID 58629) and submit: (1) a cover letter, (2) a curriculum vitae, (3) a research statement, (4) a teaching statement, and (5) up to four peer-reviewed papers, and (6) the names and contact information for writers for 3 letters of recommendation. Application review will begin on October 30, 2024. FSU is an Equal Opportunity/Access/Affirmative Action/Pro Disabled & Veteran Employer committed to enhancing the diversity of its faculty and students. Statement can be accessed at: https://hr.fsu.edu/sites/g/files/upcbnu2186/files/PDF/Publications/diversity/EEO_Statement.pdf. Inquiries about the position may be directed to Aaron Wilber, Search Chair, at awilber@fsu.edu.
Florida State University
The Department of Psychology at Florida State University (FSU) invites applicants for a full-time tenure-track Assistant Professor position in BEHAVIORAL/SYSTEMS NEUROSCIENCE. Candidates with lines of laboratory animal research in any area of Neuroscience are encouraged to apply, particularly those who work to understand experience-dependent neural activity in the normal or diseased brain. Such research might include spatial navigation, decision making, and/or learning and memory. FSU is classified as a Carnegie R1 (Highest Research Activities) and ranks in the top 20 of National Public Universities (US News & World Reports). Candidates will find an outstanding research infrastructure with scientific colleagues housed in adjacent buildings, and relatively new laboratory space and vivarium. The department has a fully-staffed electronics and machine shop and faculty have access to core equipment and resources including surgical suites, a confocal microscope and common-use histology/molecular laboratory in the building and numerous other shared resources across the program facilities (see https://www.neuro.fsu.edu/rsrc/cores) and campus (e.g., 21T small animal magnet). Our department has outstanding resources, a favorable teaching load, a high level of research activity, and a collegial atmosphere. The neuroscience community across the state of Florida is also highly collaborative. More information about our department and the Program in Neuroscience can be found at www.psy.fsu.edu and www.neuro.fsu.edu. The University is in Tallahassee, the capital of Florida, where residents have access to a broad range of cultural amenities and an abundance of regional springs, lakes and rivers, and pristine beaches on the Gulf of Mexico.
Brad Wyble
The Department of Psychology at The Pennsylvania State University, University Park, PA, invites applications for a full-time Assistant or Associate Professor of Cognitive Psychology with anticipated start date of August, 2025. Areas of specialization within cognitive psychology are open and may include (but are not limited to) such topics as cognitive control, creativity, computational approaches and modelling, motor control, language science, memory, attention, perception, and decision making. A record of collaboration is desirable for both ranks. Substantial collaboration opportunities exist within the department that align with the department’s cross-cutting research themes and across campus. Current faculty in the cognitive area are active in units including the Center for Language Sciences, the Social Life and Engineering Sciences Imaging Center, the Center for Healthy Aging, the Center for Brain, Behavior, and Cognition and the Applied Research Lab. Responsibilities of the Assistant or Associate Professor of Cognitive Psychology include maintaining a strong record of publications in top outlets. This position will include resident instruction at the undergraduate and graduate level and normal university service, based on the candidate’s qualifications. A Ph.D. in Psychology or related field is required by the appointment date for both ranks. Candidates for the tenure-track Assistant Professor of Cognitive Psychology position must have demonstrated ability as a researcher, scholar, and teacher in a relevant field and have evidence of growth in scholarly achievement. Duties will involve a combination of teaching, research, and service, based on the candidate’s qualifications. Candidates for the tenure-track Associate Professor of Cognitive Psychology position must have demonstrated excellence as a researcher, scholar, and teacher in a relevant field and have an established reputation in scholarly achievement. Duties will involve a combination of teaching, research, and service, based on the candidate’s qualifications. The ideal candidate will have a strong record of publications in top outlets and have a history of or potential for external funding. In addition, successful candidates must either have demonstrated a commitment to building an inclusive, equitable, and diverse campus community, or describe one or more ways they would envision doing so, given the opportunity. Review of applications will begin immediately and will continue until the position is filled. Interested candidates should submit an online application at Penn State’s Job Posting Board, and should upload the following application materials electronically: (1) a Cover letter of application, (2) Concise statements of research and teaching interests, (3) a CV and (4) three selected (re)prints. System limitations allow for a total of 5 documents (5mb per document) as part of your application. Please combine materials to meet the 5-document limit. In addition, please arrange to have three letters of recommendation sent electronically to PsychApplications@psu.edu with the subject line: “Cognitive Psychology” Questions regarding the application process can be emailed to PsychApplications@psu.edu and questions regarding the position can be sent to the search chair: cogsearch@psu.edu. The Pennsylvania State University is committed to and accountable for advancing diversity, equity, and inclusion in all of its forms. We embrace individual uniqueness, foster a culture of inclusion that supports both broad and specific diversity initiatives, leverage the educational and institutional benefits of diversity, and engage all individuals to help them thrive. We value inclusion as a core strength and an essential element of our public service mission. Penn State offers competitive benefits to full-time employees, including medical, dental, vision, and retirement plans, in addition to 75% tuition discounts (including for a spouse and dependent children up to the age of 26) and paid holidays.
Susan Fischer
The 'Developmental Computational Psychiatry' lab and the W3 professorship 'Computational Psychiatry' led by Tobias Hauser at the University of Tübingen (Germany) is currently hiring new postdocs. The focus of the lab is to better understand the computational and neural mechanisms underlying decision making and learning, and how these processes go awry in patients with mental illnesses. The successful candidates will have the chance to work in a highly dynamic and inspiring environment and to collaborate closely with Prof Peter Dayan and the Max-Planck Institute for Biological Cybernetics. Concretely, we are looking for the following candidates: Postdoc with experimental & neuroimaging background, Postdoc with computational modelling background. More information about the positions can be found here: https://devcompsy.org/join-the-lab/. Interested candidates are encouraged to reach out to Tobias Hauser directly to informally discuss the positions.
Nicolas P. Rougier
The goal of this PhD is to explore a minimal model of decision making using a simulated agent in a contiguous environment (T-Maze like). The goal for the agent is to learn to alternate between left and right, independently of the geometry of the maze, even though topology remains the same. This will be done using an echo state network of limited size in order to be able to perform a thorough analysis of its dynamics and representations from three different perspectives (sensory-motor space, external behavior and neural activity). The goal is to find the conditions for the emergence of concepts such as left and right using a manifold-based approach and to prove for their existence independently an external observer.
Neural Representations of Abstract Cognitive Maps in Prefrontal Cortex and Medial Temporal Lobe
Face matching and decision making: The influence of framing, task presentation and criterion placement
Many situations rely on the accurate identification of people with whom we are unfamiliar. For example, security at airports or in police investigations require the identification of individuals from photo-ID. Yet, the identification of unfamiliar faces is error prone, even for practitioners who routinely perform this task. Indeed, even training protocols often yield no discernible improvement. The challenge of unfamiliar face identification is often thought of as a perceptual problem; however, this assumption ignores the potential role of decision-making and its contributing factors (e.g., criterion placement). In this talk, I am going to present a series of experiments that investigate the role of decision-making in face identification.
Generative models for video games (rescheduled)
Developing agents capable of modeling complex environments and human behaviors within them is a key goal of artificial intelligence research. Progress towards this goal has exciting potential for applications in video games, from new tools that empower game developers to realize new creative visions, to enabling new kinds of immersive player experiences. This talk focuses on recent advances of my team at Microsoft Research towards scalable machine learning architectures that effectively capture human gameplay data. In the first part of my talk, I will focus on diffusion models as generative models of human behavior. Previously shown to have impressive image generation capabilities, I present insights that unlock applications to imitation learning for sequential decision making. In the second part of my talk, I discuss a recent project taking ideas from language modeling to build a generative sequence model of an Xbox game.
Generative models for video games
Developing agents capable of modeling complex environments and human behaviors within them is a key goal of artificial intelligence research. Progress towards this goal has exciting potential for applications in video games, from new tools that empower game developers to realize new creative visions, to enabling new kinds of immersive player experiences. This talk focuses on recent advances of my team at Microsoft Research towards scalable machine learning architectures that effectively capture human gameplay data. In the first part of my talk, I will focus on diffusion models as generative models of human behavior. Previously shown to have impressive image generation capabilities, I present insights that unlock applications to imitation learning for sequential decision making. In the second part of my talk, I discuss a recent project taking ideas from language modeling to build a generative sequence model of an Xbox game.
Bridging the gap from research to clinical decision making in epilepsy neuromodulation; How to become an integral part of the functional neurosurgery team as a radiologist
On Wednesday, November 30th, at noon ET / 6PM CET, we will host Alexandre Boutet and Erik H. Middlebrooks. Alexandre Boutet, MD, PhD, is a neuroradiology fellow at the University of Toronto, and will tell us about “How to become an integral part of the functional neurosurgery team as a radiologist”. Erik H. Middlebrooks, MD, is a Professor and Consultant of Neuroradiology and Neurosurgery and the Neuroradiology Program Director at Mayo Clinic. Beside his scientific presentation about “Bridging the Gap from Research to Clinical Decision Making in Epilepsy Neuromodulation”, he will also give us a glimpse at the “Person behind the science”. The talks will be followed by a shared discussion. You can register via talks.stimulatingbrains.org to receive the (free) Zoom link!
Exploiting sensory statistics in decision making
Neural Circuit Mechanisms of Abstract Decision Making
Decision Making and the Brain
In this talk, we will examine human behavior from the perspective of the choices we make every day. We will study the role of the brain in enabling these decisions and discuss some simple computational models of decision making and the neural basis. Towards the end, we will have a short, interactive session to engage in some easy decisions that will help us discover our own biases.
Sex Differences in Learning from Exploration
Sex-based modulation of cognitive processes could set the stage for individual differences in vulnerability to neuropsychiatric disorders. While value-based decision making processes in particular have been proposed to be influenced by sex differences, the overall correct performance in decision making tasks often show variable or minimal differences across sexes. Computational tools allow us to uncover latent variables that define different decision making approaches, even in animals with similar correct performance. Here, we quantify sex differences in mice in the latent variables underlying behavior in a classic value-based decision making task: a restless two-armed bandit. While male and female mice had similar accuracy, they achieved this performance via different patterns of exploration. Male mice tended to make more exploratory choices overall, largely because they appeared to get ‘stuck’ in exploration once they had started. Female mice tended to explore less but learned more quickly during exploration. Together, these results suggest that sex exerts stronger influences on decision making during periods of learning and exploration than during stable choices. Exploration during decision making is altered in people diagnosed with addictions, depression, and neurodevelopmental disabilities, pinpointing the neural mechanisms of exploration as a highly translational avenue for conferring sex-modulated vulnerability to neuropsychiatric diagnoses.
Inter-individual variability in reward seeking and decision making: role of social life and consequence for vulnerability to nicotine
Inter-individual variability refers to differences in the expression of behaviors between members of a population. For instance, some individuals take greater risks, are more attracted to immediate gains or are more susceptible to drugs of abuse than others. To probe the neural bases of inter-individual variability we study reward seeking and decision-making in mice, and dissect the specific role of dopamine in the modulation of these behaviors. Using a spatial version of the multi-armed bandit task, in which mice are faced with consecutive binary choices, we could link modifications of midbrain dopamine cell dynamics with modulation of exploratory behaviors, a major component of individual characteristics in mice. By analyzing mouse behaviors in semi-naturalistic environments, we then explored the role of social relationships in the shaping of dopamine activity and associated beahviors. I will present recent data from the laboratory suggesting that changes in the activity of dopaminergic networks link social influences with variations in the expression of non-social behaviors: by acting on the dopamine system, the social context may indeed affect the capacity of individuals to make decisions, as well as their vulnerability to drugs of abuse, in particular nicotine.
Multimodal framework and fusion of EEG, graph theory and sentiment analysis for the prediction and interpretation of consumer decision
The application of neuroimaging methods to marketing has recently gained lots of attention. In analyzing consumer behaviors, the inclusion of neuroimaging tools and methods is improving our understanding of consumer’s preferences. Human emotions play a significant role in decision making and critical thinking. Emotion classification using EEG data and machine learning techniques has been on the rise in the recent past. We evaluate different feature extraction techniques, feature selection techniques and propose the optimal set of features and electrodes for emotion recognition.Affective neuroscience research can help in detecting emotions when a consumer responds to an advertisement. Successful emotional elicitation is a verification of the effectiveness of an advertisement. EEG provides a cost effective alternative to measure advertisement effectiveness while eliminating several drawbacks of the existing market research tools which depend on self-reporting. We used Graph theoretical principles to differentiate brain connectivity graphs when a consumer likes a logo versus a consumer disliking a logo. The fusion of EEG and sentiment analysis can be a real game changer and this combination has the power and potential to provide innovative tools for market research.
Frontal circuit specialisations for information search and decision making
During primate evolution, prefrontal cortex (PFC) expanded substantially relative to other cortical areas. The expansion of PFC circuits likely supported the increased cognitive abilities of humans and anthropoids to sample information about their environment, evaluate that information, plan, and decide between different courses of action. What quantities do these circuits compute as information is being sampled towards and a decision is being made? And how can they be related to anatomical specialisations within and across PFC? To address this, we recorded PFC activity during value-based decision making using single unit recording in non-human primates and magnetoencephalography in humans. At a macrocircuit level, we found that value correlates differ substantially across PFC subregions. They are heavily shaped by each subregion’s anatomical connections and by the decision-maker’s current locus of attention. At a microcircuit level, we found that the temporal evolution of value correlates can be predicted using cortical recurrent network models that temporally integrate incoming decision evidence. These models reflect the fact that PFC circuits are highly recurrent in nature and have synaptic properties that support persistent activity across temporally extended cognitive tasks. Our findings build upon recent work describing economic decision making as a process of attention-weighted evidence integration across time.
Sex, drugs, and bad choices: using rodent models to understand decision making
Nearly every aspect of life involves decisions between options that differ in both their expected rewards and the potential costs (such as delay to reward delivery or risk of harm) that accompany those rewards. The ability to choose adaptively when faced with such decisions is critical for well-being and overall quality of life. In neuropsychiatric conditions such as substance use disorders, however, decision making is often compromised, which can prolong and exacerbate their severity and co-morbidities. In this seminar, Dr. Setlow will discuss research in rodent models investigating behavioral and biological mechanisms of cost-benefit decision making. In particular, he will focus on factors (including sex) that contribute to differences in cost-benefit decision making across the population, how variability in decision making is related to substance use, and how substance use can produce long-lasting changes in decision preference.
Functional ultrasound imaging during behavior
The dream of a systems neuroscientist is to be able to unravel neural mechanisms that give rise to behavior. It is increasingly appreciated that behavior involves the concerted distributed activity of multiple brain regions so the focus on single or few brain areas might hinder our understanding. There have been quite a few technological advancements in this domain. Functional ultrasound imaging (fUSi) is an emerging technique that allows us to measure neural activity from medial frontal regions down to subcortical structures up to a depth of 20 mm. It is a method for imaging transient changes in cerebral blood volume (CBV), which are proportional to neural activity changes. It has excellent spatial resolution (~100 μm X 100 μm X 400 μm); its temporal resolution can go down to 100 milliseconds. In this talk, I will present its use in two model systems: marmoset monkeys and rats. In marmoset monkeys, we used it to delineate a social – vocal network involved in vocal communication while in rats, we used it to gain insights into brain wide networks involved in evidence accumulation based decision making. fUSi has the potential to provide an unprecedented access to brain wide dynamics in freely moving animals performing complex behavioral tasks.
The processing of price during purchase decision making: Are there neural differences among prosocial and non-prosocial consumers?
International organizations, governments and companies are increasingly committed to developing measures that encourage adoption of sustainable consumption patterns among the population. However, their success requires a deep understanding of the everyday purchasing decision process and the elements that shape it. Price is an element that stands out. Prior research concluded that the influence of price on purchase decisions varies across consumer profiles. Yet no consumer behavior study to date has assessed the differences of price processing among consumers adopting sustainable habits (prosocial) as opposed to those who have not (non-prosocial). This is the first study to resort to neuroimaging tools to explore the underlying neural mechanisms that reveal the effect of price on prosocial and non-prosocial consumers. Self-reported findings indicate that prosocial consumers place greater value on collective costs and benefits while non-prosocial consumers place a greater weight on price. The neural data gleaned from this analysis offers certain explanations as to the origin of the differences. Non-prosocial (vs. prosocial) consumers, in fact, exhibit a greater activation in brain areas involved with reward, valuation and choice when evaluating price information. These findings could steer managers to improve market segmentation and assist institutions in their design of campaigns fostering environmentally sustainable behaviors
NMC4 Short Talk: Transient neuronal suppression for exploitation of new sensory evidence
Decision-making in noisy environments with constant sensory evidence involves integrating sequentially-sampled evidence, a strategy formalized by diffusion models which is supported by decades behavioral and neural findings. By contrast, it is unknown whether this strategy is also used during decision-making when the underlying sensory evidence is expected to change. Here, we trained monkeys to identify the dominant color of a dynamically refreshed checkerboard pattern that doesn't become informative until after a variable delay. Animals' behavioral responses were briefly suppressed after an abrupt change in evidence, and many neurons in the frontal eye field displayed a corresponding dip in activity at this time, similar to the dip frequently observed after stimulus onset. Generalized drift-diffusion models revealed that behavior and neural activity were consistent with a brief suppression of motor output without a change in evidence accumulation itself, in contrast to the popular belief that evidence accumulation is paused or reset. These results suggest that a brief interruption in motor preparation is an important strategy for dealing with changing evidence during perceptual decision making.
NMC4 Keynote: Formation and update of sensory priors in working memory and perceptual decision making tasks
The world around us is complex, but at the same time full of meaningful regularities. We can detect, learn and exploit these regularities automatically in an unsupervised manner i.e. without any direct instruction or explicit reward. For example, we effortlessly estimate the average tallness of people in a room, or the boundaries between words in a language. These regularities and prior knowledge, once learned, can affect the way we acquire and interpret new information to build and update our internal model of the world for future decision-making processes. Despite the ubiquity of passively learning from the structured information in the environment, the mechanisms that support learning from real-world experience are largely unknown. By combing sophisticated cognitive tasks in human and rats, neuronal measurements and perturbations in rat and network modelling, we aim to build a multi-level description of how sensory history is utilised in inferring regularities in temporally extended tasks. In this talk, I will specifically focus on a comparative rat and human model, in combination with neural network models to study how past sensory experiences are utilized to impact working memory and decision making behaviours.
Timing errors and decision making
Error monitoring refers to the ability to monitor one's own task performance without explicit feedback. This ability is studied typically in two-alternative forced-choice (2AFC) paradigms. Recent research showed that humans can also keep track of the magnitude and direction of errors in different magnitude domains (e.g., numerosity, duration, length). Based on the evidence that suggests a shared mechanism for magnitude representations, we aimed to investigate whether metric error monitoring ability is commonly governed across different magnitude domains. Participants reproduced/estimated temporal, numerical, and spatial magnitudes after which they rated their confidence regarding first order task performance and judged the direction of their reproduction/estimation errors. Participants were also tested in a 2AFC perceptual decision task and provided confidence ratings regarding their decisions. Results showed that variability in reproductions/estimations and metric error monitoring ability, as measured by combining confidence and error direction judgements, were positively related across temporal, spatial, and numerical domains. Metacognitive sensitivity in these metric domains was also positively associated with each other but not with metacognitive sensitivity in the 2AFC perceptual decision task. In conclusion, the current findings point at a general metric error monitoring ability that is shared across different metric domains with limited generalizability to perceptual decision-making.
The processing of price during purchase decision making: Are there neural differences among prosocial and non-prosocial consumers?
International organizations, governments and companies are increasingly committed to developing measures that encourage adoption of sustainable consumption patterns among the population. However, their success requires a deep understanding of the everyday purchasing decision process and the elements that shape it. Price is an element that stands out. Prior research concluded that the influence of price on purchase decisions varies across consumer profiles. Yet no consumer behavior study to date has assessed the differences of price processing among consumers adopting sustainable habits (prosocial) as opposed to those who have not (non-prosocial). This is the first study to resort to neuroimaging tools to explore the underlying neural mechanisms that reveal the effect of price on prosocial and non-prosocial consumers. Self-reported findings indicate that prosocial consumers place greater value on collective costs and benefits while non-prosocial consumers place a greater weight on price. The neural data gleaned from this analysis offers certain explanations as to the origin of the differences. Non-prosocial (vs. prosocial) consumers, in fact, exhibit a greater activation in brain areas involved with reward, valuation and choice when evaluating price information. These findings could steer managers to improve market segmentation and assist institutions in their design of campaigns fostering environmentally sustainable behaviors
Analogy and ethics: opportunities at the intersection
Analogy offers a new interpretation of a common concern in ethics: whether decision making includes or excludes a consideration of moral issues. This is often discussed as the moral awareness of decision makers and considered a motivational concern. The possible new interpretation is that moral awareness is in part a matter of expertise. Some failures of moral awareness can then be understood as stemming from novicehood. Studies of analogical transfer are consistent with the possibility that moral awareness is in part a matter of expertise, that as a result motivation is less helpful than some prior theorizing would predict, and that many adults are not as expert in the domain of ethics as one might hope. The possibility of expert knowledge of ethical principles leads to new questions and opportunities.
Microbiota in the health of the nervous system and the response to stress
Microbes have shaped the evolution of eukaryotes and contribute significantly to the physiology and behavior of animals. Some of these traits are inherited by the progenies. Despite the vast importance of microbe-host communication, we still do not know how bacteria change short term traits or long-term decisions in individuals or communities. In this seminar I will present our work on how commensal and pathogenic bacteria impact specific neuronal phenotypes and decision making. The traits we specifically study are the degeneration and regeneration of neurons and survival behaviors in animals. We use the nematode Caenorhabditis elegans and its dietary bacteria as model organisms. Both nematode and bacteria are genetically tractable, simplifying the detection of specific molecules and their effect on measurable characteristics. To identify these molecules we analyze their genomes, transcriptomes and metabolomes, followed by functional in vivo validation. We found that specific bacterial RNAs and bacterially produced neurotransmitters are key to trigger a survival behavioral and neuronal protection respectively. While RNAs cause responses that lasts for many generations we are still investigating whether bacterial metabolites are capable of inducing long lasting phenotypic changes.
Motives and modulators of human decision making
Did we eat spaghetti for lunch because we saw our colleague eat spaghetti? What drives a risk decision? How can our breakfast impact our decisions throughout the day? Research from different disciplines such as economics, psychology and neuroscience have attempted to investigate the motives and modulators of human decision making. Human decisions can be flexibly modulated by the different experiences we have in our daily lives, at the same time, bodily processes, such as metabolism can also impact economic behavior. These modulations can occur through our social networks, through the impact of our own behavior on the social environment, but also simply by the food we have eaten. Here, I will present a series of recent studies from my lab in which we shed light on the psychological, neural and metabolic motives and modulators of human decision making.
Uncertainty and Timescales of Learning and Decision Making
Metacognition for past and future decision making in primates
As Socrates said that "I know that I know nothing," our mind's function to be aware of our ignorance is essential for abstract and conceptual reasoning. However, the biological mechanism to enable such a hierarchical thought, or meta-cognition, remained unknown. In the first part of the talk, I will demonstrate our studies on the neural mechanism for metacognition on memory in macaque monkeys. In reality, awareness of ignorance is essential not only for the retrospection of the past but also for the exploration of novel unfamiliar environments for the future. However, this proactive feature of metacognition has been understated in neuroscience. In the second part of the talk, I will demonstrate our studies on the neural mechanism for prospective metacognitive matching among uncertain options prior to perceptual decision making in humans and monkeys. These studies converge to suggest that higher-order processes to self-evaluate mental state either retrospectively or prospectively are implemented in the primate neural networks.
Introducing YAPiC: An Open Source tool for biologists to perform complex image segmentation with deep learning
Robust detection of biological structures such as neuronal dendrites in brightfield micrographs, tumor tissue in histological slides, or pathological brain regions in MRI scans is a fundamental task in bio-image analysis. Detection of those structures requests complex decision making which is often impossible with current image analysis software, and therefore typically executed by humans in a tedious and time-consuming manual procedure. Supervised pixel classification based on Deep Convolutional Neural Networks (DNNs) is currently emerging as the most promising technique to solve such complex region detection tasks. Here, a self-learning artificial neural network is trained with a small set of manually annotated images to eventually identify the trained structures from large image data sets in a fully automated way. While supervised pixel classification based on faster machine learning algorithms like Random Forests are nowadays part of the standard toolbox of bio-image analysts (e.g. Ilastik), the currently emerging tools based on deep learning are still rarely used. There is also not much experience in the community how much training data has to be collected, to obtain a reasonable prediction result with deep learning based approaches. Our software YAPiC (Yet Another Pixel Classifier) provides an easy-to-use Python- and command line interface and is purely designed for intuitive pixel classification of multidimensional images with DNNs. With the aim to integrate well in the current open source ecosystem, YAPiC utilizes the Ilastik user interface in combination with a high performance GPU server for model training and prediction. Numerous research groups at our institute have already successfully applied YAPiC for a variety of tasks. From our experience, a surprisingly low amount of sparse label data is needed to train a sufficiently working classifier for typical bioimaging applications. Not least because of this, YAPiC has become the "standard weapon” for our core facility to detect objects in hard-to-segement images. We would like to present some use cases like cell classification in high content screening, tissue detection in histological slides, quantification of neural outgrowth in phase contrast time series, or actin filament detection in transmission electron microscopy.
Perception, attention, visual working memory, and decision making: The complete consort dancing together
Our research investigates how processes of attention, visual working memory (VWM), and decision-making combine to translate perception into action. Within this framework, the role of VWM is to form stable representations of transient stimulus events that allow them to be identified by a decision process, which we model as a diffusion process. In psychophysical tasks, we find the capacity of VWM is well defined by a sample-size model, which attributes changes in VWM precision with set-size to differences in the number evidence samples recruited to represent stimuli. In the first part of the talk, I review evidence for the sample-size model and highlight the model's strengths: It provides a parameter-free characterization of the set-size effect; it has plausible neural and cognitive interpretations; an attention-weighted version of the model accounts for the power-law of VWM, and it accounts for the selective updating of VWM in multiple-look experiments. In the second part of the talk, I provide a characterization of the theoretical relationship between two-choice and continuous-outcome decision tasks using the circular diffusion model, highlighting their common features. I describe recent work characterizing the joint distributions of decision outcomes and response times in continuous-outcome tasks using the circular diffusion model and show that the model can clearly distinguish variable-precision and simple mixture models of the evidence entering the decision process. The ability to distinguish these kinds of processes is central to current VWM studies.
Why does online collaboration work? Insights into sequential collaboration
The last two decades have seen a rise in online projects such as Wikipedia or OpenStreetMap in which people collaborate to create a common product. Contributors in such projects often work together sequentially. Essentially, the first contributor generates an entry (e.g., a Wikipedia article) independently which is then adjusted in the following by other contributors by adding or correcting information. We refer to this way of working together as sequential collaboration. This process has not yet been studied in the context of judgment and decision making even though research has demonstrated that Wikipedia and OpenStreetMap yield very accurate information. In this talk, I give first insights into the structure of sequential collaboration, how adjusting each other’s judgments can yield more accurate final estimates, which boundary conditions need to be met, and which underlying mechanisms may be responsible for successful collaboration. A preprint is available at https://psyarxiv.com/w4xdk/
Frontal circuit specialisations for decision making
During primate evolution, prefrontal cortex (PFC) expanded substantially relative to other cortical areas. The expansion of PFC circuits likely supported the increased cognitive abilities of humans and anthropoids to plan, evaluate, and decide between different courses of action. But what do these circuits compute as a decision is being made, and how can they be related to anatomical specialisations within and across PFC? To address this, we recorded PFC activity during value-based decision making using single unit recording in non-human primates and magnetoencephalography in humans. At a macrocircuit level, we found that value correlates differ substantially across PFC subregions. They are heavily shaped by each subregion’s anatomical connections and by the decision-maker’s current locus of attention. At a microcircuit level, we found that the temporal evolution of value correlates can be predicted using cortical recurrent network models that temporally integrate incoming decision evidence. These models reflect the fact that PFC circuits are highly recurrent in nature and have synaptic properties that support persistent activity across temporally extended cognitive tasks. Our findings build upon recent work describing economic decision making as a process of attention-weighted evidence integration across time.
Choosing, fast and slow: Implications of prioritized-sampling models for understanding automaticity and control
The idea that behavior results from a dynamic interplay between automatic and controlled processing underlies much of decision science, but has also generated considerable controversy. In this talk, I will highlight behavioral and neural data showing how recently-developed computational models of decision making can be used to shed new light on whether, when, and how decisions result from distinct processes operating at different timescales. Across diverse domains ranging from altruism to risky choice biases and self-regulation, our work suggests that a model of prioritized attentional sampling and evidence accumulation may provide an alternative explanation for many phenomena previously interpreted as supporting dual process models of choice. However, I also show how some features of the model might be taken as support for specific aspects of dual-process models, providing a way to reconcile conflicting accounts and generating new predictions and insights along the way.
What is Foraging?
Foraging research aims at describing, understanding, and predicting resource-gathering behaviour. Optimal Foraging Theory (OFT) is a sub-discipline that emphasises that these aims can be aided by segmenting foraging behaviour into discrete problems that can be formally described and examined with mathematical maximization techniques. Examples of such segmentation are found in the isolated treatment of issues such as patch residence time, prey selection, information gathering, risky choice, intertemporal decision making, resource allocation, competition, memory updating, group structure, and so on. Since foragers face these problems simultaneously rather than in isolation, it is unsurprising that OFT models are ‘always wrong but sometimes useful’. I will argue that a progressive optimal foraging research program should have a defined strategy for dealing with predictive failure of models. Further, I will caution against searching for brain structures responsible for solving isolated foraging problems.
Decision making in slime molds
Modelling affective biases in rodents: behavioural and computational approaches
My research focuses, broadly speaking, on how emotions impact decision making. Specifically, I am interested in affective biases, a phenomenon known to be important in depression. Using a rodent decision-making task, combined with computational modelling I have investigated how different antidepressant and pro-depressant manipulations that are known to alter mood in humans alter judgement bias, and provided insight into the decision processes that underlie these behaviours. I will also highlight how the combination of behaviour and modelling can provide a truly translation approach, enabling comparison and interpretation of the same cognitive processes between animal and human research.
What to consider, when making strategic social decisions? An Eye-tracking investigation
In many societal problems, individuals exhibit a conflict between keeping resources (e.g., money, time or attention) to themselves or sharing them with another individual or group. The reasons motivating decisions in favor of others welfare can thereby vary from purely altruistic to completely strategic. Be it the stranger making an effort returning a lost valet to its rightful owner or a co-worker pitching in her fair share in a joint project. Actions like that create an environment that makes living together a pleasant experience. Hence, understanding how decisions determining the welfare of oneself and others are made is important for facilitating this behavior by building institutions that maximize the rate of cooperation in a society. To shed new light on such decision making processes I will present recent evidence from a set of process tracing experiments utilizing eye-tracking and economic games. Experiments will focus on the role of social preferences in the choice construction process and will identify mechanisms (i.e., search and processing depth, information weighting, and ignorance) through which they guide choice behavior. I will in particular focus on the differences and commonalitiesbetween strategic and altruistic decisions. Specifically, investigating to which extent people direct attention towards certain components of the decision situation in a context-dependent manner.
Exploration beyond bandits
Machine learning researchers frequently focus on human-level performance, in particular in games. However, in these applications human (or human-level) behavior is commonly reduced to a simple dot on a performance graph. Cognitive science, in particular theories of learning and decision making, could hold the key to unlock what is behind this dot, thereby gaining further insights into human cognition and the design principles of intelligent algorithms. However, cognitive experiments commonly focus on relatively simple paradigms such as restricted multi-armed bandit tasks. In this talk, I will argue that cognitive science can turn its lens to more complex scenarios to study exploration in real-world domains and online games. I will show in one large data set of online food delivery orders and across many online games how current cognitive theories of learning and exploration can describe human behavior in the wild, but also how these tasks demand us to expand our theoretical toolkit to describe a rich repertoire of real-world behaviors such as empowerment and fun.
How to simulate and analyze drift-diffusion models of timing and decision making
My talk will discuss the use of some of these four, simple Matlab functions to simulate models of timing, and to fit models to empirical data. Feel free to examine the code and the relatively brief book chapter that explains the code before the talk if you would like to learn more about computational/mathematical modeling.
Uncertainty in learning and decision making
Uncertainty plays a critical role in reinforcement learning and decision making. However, exactly how subjective uncertainty influences behaviour remains unclear. Multi-armed bandits are a useful framework to gain more insight into this. Paired with computational tools such as Kalman filters, they allow us to closely characterize the interplay between trial-by-trial value, uncertainty, learning, and choice. In this talk, I will present recent research where we also measured participants visual fixations on the options in a multi-armed bandit task. The estimated value of each option, and the uncertainty in these estimations, influenced what subjects looked at in the period before making a choice and their subsequent choice, as additionally did fixation itself. Uncertainty also determined how long participants looked at the obtained outcomes. Our findings clearly show the importance of uncertainty in learning and decision making.
Slowing down the body slows down time (perception)
Interval timing is a fundamental component action, and is susceptible to motor-related temporal distortions. Previous studies have shown that movement biases temporal estimates, but have primarily considered self-modulated movement only. However, real-world encounters often include situations in which movement is restricted or perturbed by environmental factors. In the following experiments, we introduced viscous movement environments to externally modulate movement and investigated the resulting effects on temporal perception. In two separate tasks, participants timed auditory intervals while moving a robotic arm that randomly applied four levels of viscosity. Results demonstrated that higher viscosity led to shorter perceived durations. Using a drift-diffusion model and a Bayesian observer model, we confirmed these biasing effects arose from perceptual mechanisms, instead of biases in decision making. These findings suggest that environmental perturbations are an important factor in movement-related temporal distortions, and enhance the current understanding of the interactions of motor activity and cognitive processes. https://www.biorxiv.org/content/10.1101/2020.10.26.355396v1
Study of sensory "prior distributions" in rodent models of working memory and perceptual decision making
Cocaine-Sensitive Orbitofrontal Circuits Encode Action Variables for Flexible Decision Making
Flexible decision making in a premotor circuit
Machine reasoning in histopathologic image analysis
Deep learning is an emerging computational approach inspired by the human brain’s neural connectivity that has transformed machine-based image analysis. By using histopathology as a model of an expert-level pattern recognition exercise, we explore the ability for humans to teach machines to learn and mimic image-recognition and decision making. Moreover, these models also allow exploration into the ability for computers to independently learn salient histological patterns and complex ontological relationships that parallel biological and expert knowledge without the need for explicit direction or supervision. Deciphering the overlap between human and unsupervised machine reasoning may aid in eliminating biases and improving automation and accountability for artificial intelligence-assisted vision tasks and decision-making. Aleksandar Ivanov Title:
Deep learning for model-based RL
Model-based approaches to control and decision making have long held the promise of being more powerful and data efficient than model-free counterparts. However, success with model-based methods has been limited to those cases where a perfect model can be queried. The game of Go was mastered by AlphaGo using a combination of neural networks and the MCTS planning algorithm. But planning required a perfect representation of the game rules. I will describe new algorithms that instead leverage deep neural networks to learn models of the environment which are then used to plan, and update policy and value functions. These new algorithms offer hints about how brains might approach planning and acting in complex environments.
Spanning the arc between optimality theories and data
Ideas about optimization are at the core of how we approach biological complexity. Quantitative predictions about biological systems have been successfully derived from first principles in the context of efficient coding, metabolic and transport networks, evolution, reinforcement learning, and decision making, by postulating that a system has evolved to optimize some utility function under biophysical constraints. Yet as normative theories become increasingly high-dimensional and optimal solutions stop being unique, it gets progressively hard to judge whether theoretical predictions are consistent with, or "close to", data. I will illustrate these issues using efficient coding applied to simple neuronal models as well as to a complex and realistic biochemical reaction network. As a solution, we developed a statistical framework which smoothly interpolates between ab initio optimality predictions and Bayesian parameter inference from data, while also permitting statistically rigorous tests of optimality hypotheses.
Dragons, Sleep, and the Claustrum
The mammalian claustrum, by virtue of its dense interconnectivity with cortex and other brain structures, has been hypothesized to mediate functions ranging from decision making to consciousness. I will be presenting experimental evidence for the existence of a claustrum in reptiles, its role in generating brain dynamics characteristic of sleep, and discuss our neuroetholgical approach towards understanding fundamental aspects of sleep and claustrum function.
Causal role of human frontopolar cortex in information integration during complex decision making
Bernstein Conference 2024
Decision making: describing the dynamics of working memory
Bernstein Conference 2024
The Neural Basis of Spatial Decision Making
Bernstein Conference 2024
PERCEPTUAL DECISION MAKING OF NONEQUILIBRIUM FLUCTUATIONS
Bernstein Conference 2024
Investigation of a multilevel multisensory circuit underlying female decision making in Drosophila
COSYNE 2022
Investigation of a multilevel multisensory circuit underlying female decision making in Drosophila
COSYNE 2022
Modeling multi-region neural communication during decision making with recurrent switching dynamical systems
COSYNE 2022
Modeling multi-region neural communication during decision making with recurrent switching dynamical systems
COSYNE 2022
Orbitofrontal cortex is required to infer hidden task states during value-based decision making
COSYNE 2022
Orbitofrontal cortex is required to infer hidden task states during value-based decision making
COSYNE 2022
Serotonergic Control of Model-based Decision Making
COSYNE 2022
Serotonergic Control of Model-based Decision Making
COSYNE 2022
Computational mechanisms underlying thalamic regulation of prefrontal signal-to-noise ratio in decision making
COSYNE 2023
Identifying state-dependent interactions between brain regions during decision making
COSYNE 2023
Neural network dynamics underlying context-dependent perceptual decision making
COSYNE 2023
Activity of distinct excitatory populations in prefrontal cortex during decision making in mice
FENS Forum 2024
Context-dependent gamma-band synchrony between sensory and decision-related cortex during flexible decision making
FENS Forum 2024
Decision making in mice in the intermittent regime of olfactory stimuli
FENS Forum 2024
How does frontal cortex impact exploratory decision making in Mongolian gerbils? Insights from a probabilistic foraging paradigm
FENS Forum 2024
Dopaminergic computation of preference measures in probabilistic decision making
FENS Forum 2024
FreiControl: A cost-efficient, open-source system for investigating individual strategies in decision making of rodents
FENS Forum 2024
Frontal dynamics underlying flexible decision making in mice
FENS Forum 2024
Hierarchical encoding of reward, effort and choice across the frontal cortex and basal ganglia during cost-benefit decision making
FENS Forum 2024
Investigating neurocognitive mechanisms and modulatory factors of news-related decision making using MyNewsScan platform
FENS Forum 2024
Latent state representations in ventral hippocampus during flexible decision making
FENS Forum 2024
Neurocomputational investigation of human schema-based learning, decision making and their modulators in ecological settings
FENS Forum 2024
Neuronal correlates of rank-order based decision making within different cell classes of primate prefrontal cortex
FENS Forum 2024
Reuniens-hippocampus synchronization is required for successful navigation and decision making
FENS Forum 2024
A role for acetylcholine in uncertain decision making
FENS Forum 2024
Role of the orbitofrontal cortex in decision making under risk
FENS Forum 2024
Value guided decision making in the prefrontal cortex
FENS Forum 2024
RTNet: A neural network that exhibits the signatures of human perceptual decision making
Neuromatch 5