augmented reality

Augmented-reality guided lumpectomy

Abstract Far too many women with a newly diagnosed breast cancer must undergo repeat surgery because positive margins were found at the time of their initial lumpectomy. Supine volumetric MRI has potential to improve surgical accuracy, and reduce re-excision rates by nearly 50%. Spurred by our preliminary results improving depth perception via projected apertures and integrating intra-operative marker tracking into commercial Augmented Reality systems, we have developed a highly accurate initial prototype Augmented Reality system to project volumetric MRI data inside the breast to guide surgery. In Aim 1, we will compare methods of projecting apertures in a phantom model of lumpectomy. In Aim 2, we will test the final prototype system in a pilot study of 30 women with new breast cancer. Standardized use of cavity- and shave-margins will enable paired comparisons between standard and AR-guided techniques in the same patients, including ability to reduce positive margin rates and minimize overexcision. Ultimately the system will be ready for future randomized controlled trials to measure efficacy as the next step toward broad clinical adoption.

Multisensory perception in the metaverse

From natural scene statistics to multisensory integration: experiments, models and applications

To efficiently process sensory information, the brain relies on statistical regularities in the input. While generally improving the reliability of sensory estimates, this strategy also induces perceptual illusions that help reveal the underlying computational principles. Focusing on auditory and visual perception, in my talk I will describe how the brain exploits statistical regularities within and across the senses for the perception space, time and multisensory integration. In particular, I will show how results from a series of psychophysical experiments can be interpreted in the light of Bayesian Decision Theory, and I will demonstrate how such canonical computations can be implemented into simple and biologically plausible neural circuits. Finally, I will show how such principles of sensory information processing can be leveraged in virtual and augmented reality to overcome display limitations and expand human perception.

Online "From Bench to Bedside" Neurosciences Symposium

2 Keynote lectures :“Homeostatic control of sleep in the fly"and “Management of Intracerebral Haemorrhage – where is the evidence?” and 2 sessions: "Cortical top-down information processing” and “Virtual/augmented reality and its implications for the clinic”

Seeing with technology: Exchanging the senses with sensory substitution and augmentation

What is perception? Our sensory modalities transmit information about the external world into electrochemical signals that somehow give rise to our conscious experience of our environment. Normally there is too much information to be processed in any given moment, and the mechanisms of attention focus the limited resources of the mind to some information at the expense of others. My research has advanced from first examining visual perception and attention to now examine how multisensory processing contributes to perception and cognition. There are fundamental constraints on how much information can be processed by the different senses on their own and in combination. Here I will explore information processing from the perspective of sensory substitution and augmentation, and how "seeing" with the ears and tongue can advance fundamental and translational research.