Topic: safe exploration

Across species, survival depends on harvesting essential rewards such as food in the face of potential, occasionally catastrophic, dangers (such as serious injuries). This presents the challenge as to how to remain as efficient as possible when it comes to reward acquisition, whilst avoiding accrual of damage, especially during early exploration of new environments. This safety-efficiency dilemma is a special case of the exploration-exploitation dilemma, which typically collapses punishment and reward into a single scalar signal, whereby early losses can be overcome by later gains. However, th

The neural control of movement is a fundamental aspect of understanding how the nervous system coordinate and regulate motor behavior. Procedural safety is a critical concern for movement control, especially for online tasks in high-dimensional control spaces. Current safe exploration algorithms exhibit inefficiency and may even become infeasible with large high-dimensional input spaces. Furthermore, existing high-dimensional constrained optimization methods neglect safety in the search process. In this extended abstract, we introduce High-dimensional Safe Bayesian Optimization with local opti