Latent Diffusion for Neural Spiking Data
Auguste Schulz, Jaivardhan Kapoor, Julius Vetter, Felix Pei, Richard Gao, Jakob Macke · Bernstein Conference 2024
Modern datasets in neuroscience enable unprecedented inquiries into the relationship between complex behaviors and the activity of many simultaneously recorded neurons. While latent variable models can successfully extract low-dimensional embeddings from such recordings, using them to generate realistic spiking data, especially in a behavior-dependent manner, still poses a challenge. Here, we present Latent Diffusion for Neural Spiking data (LDNS), a diffusion-based generative model with a low-dimensional latent space: LDNS employs an autoencoder with structured state-space (S4) layers to pro