Cookies
We use essential cookies to run the site. Analytics cookies are optional and help us improve World Wide. Learn more.
Institute of Neuroinformatics
Showing your local timezone
Schedule
Wednesday, July 6, 2022
5:00 PM Europe/Berlin
Recording provided by the organiser.
Domain
NeuroscienceHost
SNUFA
Duration
30 minutes
Spiking recurrent neural networks (RNNs) are a promising tool for solving a wide variety of complex cognitive and motor tasks, due to their rich temporal dynamics and sparse processing. However training spiking RNNs on dedicated neuromorphic hardware is still an open challenge. This is due mainly to the lack of local, hardware-friendly learning mechanisms that can solve the temporal credit assignment problem and ensure stable network dynamics, even when the weight resolution is limited. These challenges are further accentuated, if one resorts to using memristive devices for in-memory computing to resolve the von-Neumann bottleneck problem, at the expense of a substantial increase in variability in both the computation and the working memory of the spiking RNNs. In this talk, I will present our recent work where we introduced a PyTorch simulation framework of memristive crossbar arrays that enables accurate investigation of such challenges. I will show that recently proposed e-prop learning rule can be used to train spiking RNNs whose weights are emulated in the presented simulation framework. Although e-prop locally approximates the ideal synaptic updates, it is difficult to implement the updates on the memristive substrate due to substantial device non-idealities. I will mention several widely adapted weight update schemes that primarily aim to cope with these device non-idealities and demonstrate that accumulating gradients can enable online and efficient training of spiking RNN on memristive substrates.
Yigit Demirag
Institute of Neuroinformatics
Contact & Resources
neuro
Nervous system function relies on the polarized architecture of neurons, established by directional transport of pre- and postsynaptic cargoes. While delivery of postsynaptic components depends on the
neuro
A combinatorial neural code for long-term motor memory
neuro
The postdoctoral researcher will work on an interdisciplinary project at the intersection of deep learning and comparative politics. The candidate will work in the Human-Centered Machine Learning (HuM
We are looking for highly motivated researchers to join our group in interdisciplinary projects that focus on the development of computational models to understand how linguistic information is repres
The CSNG Lab at the Faculty of Mathematics and Physics at the Charles University is seeking a highly motivated Postdoctoral Researcher to join our team to work on a digital twin model of the visual sy
PROJECT SUMMARY / ABSTRACT Cluster headache (CH), which affects about 1 in 1,000 people, is a severe and debilitating primary headache disorder characterized by repeated attacks occurring in clusters