Utilizing the Full Power of Empire AI
The Simons Foundation invites two-year research proposals that use Empire AI's multinode GPU clusters to address fundamental questions in computational astrophysics and physics, computational biology, mathematics, neuroscience or computational physical chemistry. Proposals must develop and use foundational machine-learning models for the scientific problem; data curation may be considered only when the resulting data are used to solve scientific problems within the same proposal. The programme expects to fund six to twelve awards from a total budget of six million US dollars.
A Riemannian Geometry Perspective on Foundation Models
Oden Institute Seminar by Rex Ying (Yale University) on how non-Euclidean geometries, particularly hyperbolic geometry, can enhance foundation models by better capturing hierarchies and symmetries in real-world data, with applications across Transformers, language model training, multimodal systems, and recommender systems.
Research Scientist, Robotics
Ai2's Robotics team is hiring a research scientist to investigate foundation models for robotics and develop open methods, datasets, benchmarks, and models. The work combines large-scale simulation with real robots, spanning manipulation, planning and control, reinforcement or imitation learning, sim-to-real transfer, world models, and broadly competent robotic systems.
Learning generative dynamical systems models from multi-modal and multi-animal neuro-data
For decades dynamical systems theory played a pivotal role in theoretical and computational neuroscience, as it links biophysical and biochemical processes to neural computation. In fact, dynamical systems are computationally universal. Rather than hand-crafting computational theories of neural function based on dynamical systems, recent developments in scientific machine learning (ML) and AI suggest that we may be able to infer such dynamical-computational models directly from neurophysiological and behavioral observations. This is called dynamical systems reconstruction (DSR), the learning of generative surrogate models of the underlying dynamics, including its long-term temporal and geometrical properties, from time series data. In my talk I will cover recent ML/AI architectures, training algorithms, and validation procedures for DSR. I will discuss specifically how recent AI architectures for DSR can integrate neuroscience data from multiple modalities (like multiple single-unit recordings and behavioral choices), across diverse time scales, and across many different animals and task designs, into a joint DSR model. This provides first steps toward dynamical systems based AI foundation models for neuroscience. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2025-04-23. Recording duration: 00:53:24.
Llama 3.1 Paper: The Llama Family of Models
Modern artificial intelligence (AI) systems are powered by foundation models. This paper presents a new set of foundation models, called Llama 3. It is a herd of language models that natively support multilinguality, coding, reasoning, and tool usage. Our largest model is a dense Transformer with 405B parameters and a context window of up to 128K tokens. This paper presents an extensive empirical evaluation of Llama 3. We find that Llama 3 delivers comparable quality to leading language models such as GPT-4 on a plethora of tasks. We publicly release Llama 3, including pre-trained and post-trained versions of the 405B parameter language model and our Llama Guard 3 model for input and output safety. The paper also presents the results of experiments in which we integrate image, video, and speech capabilities into Llama 3 via a compositional approach. We observe this approach performs competitively with the state-of-the-art on image, video, and speech recognition tasks. The resulting models are not yet being broadly released as they are still under development.