Electronic Engineering seminars

Paritosh Ramanan presents algorithm–hardware co-design for reliable linear algebra and optimization on resistive-memory in-memory computing systems. The distributed MELISO simulation framework supports multiple hardware models, while multilevel error correction makes noisy, low-energy devices useful for matrix-vector multiplication. Simulations report energy improvements of up to five orders of magnitude and latency reductions of up to two for high-dimensional linear algebra. A distributed primal-dual hybrid gradient solver for linear programs combines convergence analysis under device noise with simulated gains of up to two orders in latency and three in energy over GPU baselines on medium-scale problems. Preliminary randomized Kaczmarz results use online signal-to-noise estimates to select rows, comparing this strategy with offline alternatives. The talk closes with open problems in in-memory computation.

John Clarke, Michel H. Devoret and John M. Martinis trace the discovery that a macroscopic electrical circuit can display quantum tunnelling and discrete energy levels. Clarke connects early superconducting measuring devices with experiments on current-biased Josephson junctions. Microwave-induced resonances and the crossover from thermal activation to temperature-independent escape provide tests of quantum behaviour. Devoret explains how superconducting circuits became controllable artificial atoms, with Josephson elements enabling engineered energy spectra, qubits and quantum-limited amplifiers. He considers what these designed systems make possible beyond experiments with natural atoms. Martinis follows the development from early junction experiments to superconducting quantum processors. He discusses energy-level quantization, tunnelling, photon generation, quantum computational experiments, and the fabrication and error-control challenges involved in building useful machines.

The use of electronic circuits to model neural systems goes back to C. Mead and is present in models, from leaky-integrate-and-fire to Hodking-Huxley. Simulating neural network with analog hardware is attractive: it allows to implement neurocomputations in real time without discretization approximations, it has perfect simulation-time scaling with system size, and it provides ready-to-deploy neuromorphic circuit for applications. There are implementations in CMOS technology, however, they are complex, require sophisticated fabrication facilities and, most important, suffer from significant device mismatch. In a radically different approach, based on the concept of memristors, we introduce a neuro-synaptic circuit of unprecedented simplicity, with readily available cheap off-the-shelf electronic components, that can quantitatively reproduce textbook theoretical neuron and synaptic current models. Our neuron circuits can avoid the mismatch problem and are easily tuneable at bio-compatible time-scales. We first introduce a voltage-gated conductance bursting neuron model that produces spike traces that bare striking similarity to experimental recordings. We then introduce synaptic current circuits and show the modularity of our method implementing neurocomputing primitives of basic network motifs, including CPGs. With this "theoretical hardware" approach we show: (i) that neuron adaptation and self-excitation can be viewed as a self-consistent dynamical problem; (ii) that a dynamical memory can be minimally implemented with a single recursive spiking neuron; (iii) that an adaptive membrane current reveals a connection between bursting and the driven harmonic oscillator, perhaps pointing to a neural correlate of the pendular limb motion. Finally we discuss the limitation of the approach to networks of mid-size and its potential application for brain-machine-interfaces, robotics and AI. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2025-03-19. Recording duration: 00:43:46.

Spiking recurrent neural networks (RNNs) are a promising tool for solving a wide variety of complex cognitive and motor tasks, due to their rich temporal dynamics and sparse processing. However training spiking RNNs on dedicated neuromorphic hardware is still an open challenge. This is due mainly to the lack of local, hardware-friendly learning mechanisms that can solve the temporal credit assignment problem and ensure stable network dynamics, even when the weight resolution is limited. These challenges are further accentuated, if one resorts to using memristive devices for in-memory computing to resolve the von-Neumann bottleneck problem, at the expense of a substantial increase in variability in both the computation and the working memory of the spiking RNNs. In this talk, I will present our recent work where we introduced a PyTorch simulation framework of memristive crossbar arrays that enables accurate investigation of such challenges. I will show that recently proposed e-prop learning rule can be used to train spiking RNNs whose weights are emulated in the presented simulation framework. Although e-prop locally approximates the ideal synaptic updates, it is difficult to implement the updates on the memristive substrate due to substantial device non-idealities. I will mention several widely adapted weight update schemes that primarily aim to cope with these device non-idealities and demonstrate that accumulating gradients can enable online and efficient training of spiking RNN on memristive substrates.

Controlling biological processes using light has increased the accuracy and speed with which researchers can manipulate many biological processes. Optical control allows for an unprecedented ability to dissect function and holds the potential for enabling novel genetic therapies. However, optogenetic experiments require adequate light sources with spatial, temporal, or intensity control, often a bottleneck for researchers. Here we detail how to build a low-cost and versatile LED illumination system that is easily customizable for different available optogenetic tools. This system is configurable for manual or computer control with adjustable LED intensity. We provide an illustrated step-by-step guide for building the circuit, making it computer-controlled, and constructing the LEDs. To facilitate the assembly of this device, we also discuss some basic soldering techniques and explain the circuitry used to control the LEDs. Using our open-source user interface, users can automate precise timing and pulsing of light on a personal computer (PC) or an inexpensive tablet. This automation makes the system useful for experiments that use LEDs to control genes, signaling pathways, and other cellular activities that span large time scales. For this protocol, no prior expertise in electronics is required to build all the parts needed or to use the illumination system to perform optogenetic experiments.