Computer Engineering seminars

Paritosh Ramanan presents algorithm–hardware co-design for reliable linear algebra and optimization on resistive-memory in-memory computing systems. The distributed MELISO simulation framework supports multiple hardware models, while multilevel error correction makes noisy, low-energy devices useful for matrix-vector multiplication. Simulations report energy improvements of up to five orders of magnitude and latency reductions of up to two for high-dimensional linear algebra. A distributed primal-dual hybrid gradient solver for linear programs combines convergence analysis under device noise with simulated gains of up to two orders in latency and three in energy over GPU baselines on medium-scale problems. Preliminary randomized Kaczmarz results use online signal-to-noise estimates to select rows, comparing this strategy with offline alternatives. The talk closes with open problems in in-memory computation.

Over the past decade our community has made substantial progress in the construction of anatomically detailed network models of the cortical tissue. Thanks to advances in computer hardware and simulation technology, researchers can now routinely work with these models at the natural density of neurons and synapses. Moreover, the availability of cloud services means that such investigations can be carried out without having to install either the model or the simulation software. A recent workshop analyzed the impact of a specific model of the cortical microcircuit, published ten years ago . The model has been reused in multiple contexts: for reproduction studies, validation of mean-field approaches, exploration of methods of model sharing, and as a building block for larger models. Although the model was less successful in inspiring further neuroscientific studies than the authors of the original work had hoped, it became a de facto benchmark for neuromorphic computing systems. It sparked a constructive race for ever shorter simulation times and lower energy consumption. The quantitative comparison of different platforms reveals qualitative differences between conventional and neuromorphic hardware and limits of speed-up. The structure of the model is based on light microscopy because these were the data available at the time. Guided by simulation results and physiological evidence, the original publication hypothesized a preference of excitatory neurons for inhibitory targets. Modern electron microscopy data of cortical volumes combined with AI based reconstruction techniques is capable of resolving individual synaptic connections. This advances the concept of digital twins of the cortical network to a new level of precision, and has already enabled us to confirm the assumption of target type specifity underlying earlier models. Maybe with the progress sketched here, our community is at a transition point where it becomes easier to cooperatively and incrementally work on models with a larger explanatory scope. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2025-12-10. Recording duration: 00:39:15.

Engineered pattern-recognition systems strive for short time-to-solution and low energy-to-solution characteristics. This represents one of the main driving forces behind the development of neuromorphic devices. For both them and their biological archetypes, this corresponds to using as few spikes as early as possible. The concept of few and early spikes is used as the founding principle in the time-to-first-spike coding scheme. Within this framework, we have developed a spike-timing-based learning algorithm, which we used to train neuronal networks on the mixed-signal neuromorphic platform BrainScaleS-2. We derive, from first principles, error-backpropagation-based learning in networks of leaky integrate-and-fire (LIF) neurons relying only on spike times, for specific configurations of neuronal and synaptic time constants. We explicitly examine applicability to neuromorphic substrates by studying the effects of reduced weight precision and range, as well as of parameter noise. We demonstrate the feasibility of our approach on continuous and discrete data spaces, both in software simulations and on BrainScaleS-2. This narrows the gap between previous models of first-spike-time learning and biological neuronal dynamics and paves the way for fast and energy-efficient neuromorphic applications.

The potential of machine learning and deep learning to advance artificial intelligence is driving a quest to build dedicated computers, such as neuromorphic hardware that emulate the biological processes of the brain. While the hardware technologies already exist, their application to real-world tasks is hindered by the lack of suitable programming methods. Advances at the interface of neural computation and machine learning showed that key aspects of deep learning models and tools can be transferred to biologically plausible neural circuits. Building on these advances, I will show that differentiable programming can address many challenges of programming spiking neural networks for solving real-world tasks, and help devise novel continual and local learning algorithms. In turn, these new algorithms pave the road towards systematically synthesizing machine intelligence in neuromorphic hardware without detailed knowledge of the hardware circuits.