The focus of the PhD position in the Autonomous Intelligent Systems group at the University of Münster will be on Deep Reinforcement Learning for the control of locomotion in robots. The aim is to develop biologically-inspired principles that enable more efficient learning mechanisms for adaptive behaviour. The position will focus on model-free and model-based learning approaches for the control of robots based on biological principles such as decentralization, modularization, and hierarchical organization. The architecture will be applied to robots, e.g., the Unitree Go1, in multiple and increasingly more difficult tasks that require transfer learning. The candidate will also have the opportunity to extend this work towards a multi-agent setting or XAI to make decision-making more transparent. The position is tied to working towards a doctorate.

At any given moment the brain receives more sensory information than it can use to guide adaptive behaviour, creating the need for mechanisms that promote efficient processing of incoming sensory signals. One way in which the brain might reduce its sensory processing load is to encode successive presentations of the same stimulus in a more efficient form, a process known as neural adaptation. Conversely, when a stimulus violates an expected pattern, it should evoke an enhanced neural response. Such a scheme for sensory encoding has been formalised in predictive coding theories, which propose that recent experience establishes expectations in the brain that generate prediction errors when violated. In this webinar, Professor Jason Mattingley will discuss whether the encoding of elementary visual features is modulated when otherwise identical stimuli are expected or unexpected based upon the history of stimulus presentation. In humans, EEG was employed to measure neural activity evoked by gratings of different orientations, and multivariate forward modelling was used to determine how orientation selectivity is affected for expected versus unexpected stimuli. In mice, two-photon calcium imaging was used to quantify orientation tuning of individual neurons in the primary visual cortex to expected and unexpected gratings. Results revealed enhanced orientation tuning to unexpected visual stimuli, both at the level of whole-brain responses and for individual visual cortex neurons. Professor Mattingley will discuss the implications of these findings for predictive coding theories of sensory encoding. Professor Jason Mattingley is a Laureate Fellow and Foundation Chair in Cognitive Neuroscience at The University of Queensland. His research is directed toward understanding the brain processes that support perception, selective attention and decision-making, in health and disease.

Our work concerns the general problem of adaptive behaviour in response to predatory threats, and of the neural mechanisms underlying a choice between strategies. When faced with a threat, an animal must decide whether to freeze, reducing its chances of being noticed, or to flee to the safety of a refuge. Animals from fish to primates choose between these two alternatives when confronted by an attacking predator, a choice that largely depends on the context in which the threat occurs. Recent work has made strides identifying the pre-motor circuits, and their inputs, which control freezing behaviour in rodents, but how contextual information is integrated to guide this choice is still far from understood. The social environment is a potent contextual modulator of defensive behaviours of animals in a group. Indeed, anti-predation strategies are believed to be a major driving force for the evolution of sociality. We recently found that fruit flies in response to visual looming stimuli, simulating a large object on collision course, make rapid freeze/flee choices accompanied by lasting changes in the fly’s internal state, reflected in altered cardiac activity. In this talk, I will discuss our work on how flies process contextual cues, focusing on the social environment, to guide their behavioural response to a threat. We have identified a social safety cue, resumption of activity, and visual projection neurons involved in processing this cue. Given the knowledge regarding sensory detection of looming threats and descending neuron involved in the expression of freezing, we are now in a unique position to understand how information about a threat is integrated with cues from the social environment to guide the choice of whether to freeze.