Building a foundation model for the brain
datasets, theory, and models
Workshop

March 31 - April 1, 2025 | COSYNE 2025 | Mont Tremblant, Canada

Advances in neurotechnology have enabled the collection of large-scale neural recordings during animal behavior. To extract insights from these datasets, researchers are now faced with significant challenges when comparing data across different brain regions, subjects, and tasks. Inspired by recent successes in large-scale "foundation" modeling of natural language and computational biology, there has been a push towards developing "neuro-foundation models" that can be trained across diverse datasets and then fine-tuned for downstream tasks and analyses including neural encoding, decoding, cell-type classification, and activity prediction. In this workshop, we aim to provide an overview of current neuro-foundation model approaches and to bring together experimentalists, theoreticians, and model builders to discuss how this paradigm can lead to a deeper understanding of the brain. In particular, we plan to highlight the utility of neuro-foundation models in analyses across recording modalities, brain regions, individuals, species, and contexts. In addition to these talks, we will also host a panel to discuss challenges, opportunities, and risks of building these models.

Speakers

Eva Dyer
Eva Dyer

Georgia Tech

Blake Richards
Blake Richards

McGill University, Mila

Andreas Tolias
Andreas Tolias

Stanford University, Enigma Project

Katrin Franke
Katrin Franke

Stanford University, Enigma Project

Gaëlle Chapuis
Gaëlle Chapuis

International Brain Laboratory

Saskia de Vries
Saskia de Vries

Allen Institute

Juan Gallego
Juan Gallego

Imperial College London

Patrick Mineault
Patrick Mineault

Amaranth Foundation

Chethan Pandarinath
Chethan Pandarinath

Emory University, Georgia Tech

Yizi Zhang
Yizi Zhang

Columbia University

Geeling Chau
Geeling Chau

Caltech

Auguste Schulz
Auguste Schulz

University of Tübingen

Josué Ortega Caro
Josué Ortega Caro

Yale University

Marvin Mathony
Marvin Mathony

Helmholtz Institute for Human-Centered AI

David Sussillo
David Sussillo

Meta, Stanford University

Ayesha Vermani
Ayesha Vermani

Champalimaud Centre for the Unknown

Joel Ye
Joel Ye

Carnegie Mellon University

Adam Calhoun
Adam Calhoun

Meta

Organizers

Mehdi Azabou
Mehdi Azabou

Columbia University, ARNI

Cole Hurwitz
Cole Hurwitz

Columbia University

Nanda H Krishna
Nanda H Krishna

Université de Montréal, Mila

Avery Hee-Woon Ryoo
Avery Hee-Woon Ryoo

Université de Montréal, Mila

Eva Dyer
Eva Dyer

Georgia Tech

Blake Richards
Blake Richards

McGill University, Mila

Goals of the workshop

This workshop will bring together experts who are at the forefront of neuro-foundation model research. Our goal is to foster a much-needed dialogue between modelers, theorists, and experimentalists, providing a platform to explore the unique challenges, opportunities, and risks of creating foundation models for brain data. Participants will discuss the future of large-scale neural modeling through diverse perspectives, including:

  • Cross-region: Exploring how neural activity across different brain regions and cell types can be jointly analyzed.
  • Cross-animal and cross-species: Investigating common and unique neural signatures across individuals and species.
  • Cross-task and cross-context: Understanding how neural activity adapts across different behaviors and environments.

In addition to these talks, we will host a panel discussion focused on the current landscape and future directions of neuro-foundation models. This discussion will delve into critical topics such as:

  • The potential applications of foundation models for neural data
  • Key challenges in developing generalizable models across diverse datasets
  • Ethical considerations and risks of scaling these models

By bringing together diverse perspectives, this workshop will serve as a catalyst for identifying commonalities and differences in current approaches, highlighting how these models can generate new insights into brain function, and establishing a roadmap for this growing interdisciplinary field.

Schedule

Day 1 - March 31, 2025

09:30 - 10:00

Opening Remarks

Cole Hurwitz, Mehdi Azabou
10:00 - 10:25

Scaling Up in Neuroscience: Lessons Learned

Eva Dyer
10:25 - 10:50

Foundation models for neuroscience: what are they good for?

Blake Richards
10:50 - 11:05

Coffee Break

11:05 - 11:40

Digital Twins of the Brain and Inception Loops: A New Paradigm for Neuroscience

Andreas Tolias
11:40 - 12:05

Mapping visual representations in the brain using deep learning

Katrin Franke
12:05 - 12:30

The International Brain Laboratory: The Brainwide Map and Beyond

Gaëlle Chapuis
12:30 - 15:30

Lunch Break

15:30 - 15:55

The AIND Data Platform for Neurophysiology and Neuroanatomy: Advancing Collaborative and Open Science

Saskia de Vries
15:55 - 16:20

Preserved neural dynamics underpin similar motor and cognitive computations across animals

Juan Gallego
16:20 - 16:50

Foundation models and NeuroAI safety: Opportunities and Pitfalls

Patrick Mineault
16:50 - 17:05

Coffee Break

17:05 - 18:30

Panel Discussion

Andreas Tolias, Blake Richards, Il Memming Park, Saskia de Vries

Day 2 - April 1, 2025

09:30 - 09:45

Opening Remarks

Nanda H Krishna, Avery Hee-Woon Ryoo
09:45 - 10:15

Neural Population Structure and Complexity in High Channel Count, Multi-Task Recordings

Chethan Pandarinath
10:15 - 10:40

Building brain-wide models at single-cell, single-spike resolution

Yizi Zhang
10:40 - 11:05

Population Transformer: Learning Population-level Representations of Neural Activity

Geeling Chau
11:05 - 11:20

Coffee Break

11:20 - 11:45

Deep generative models for linking neural spiking activity and behavior

Auguste Schulz
11:45 - 12:10

BrainLM and Beyond: Foundation Models for Understanding Brain Dynamics

Josué Ortega Caro
12:10 - 12:35

Towards a Foundation Model of Cognitive Modeling

Marvin Mathony
12:35 - 15:30

Lunch Break

15:30 - 16:00

Brain-wide population dynamics of decision-making under uncertainty

David Sussillo
16:00 - 16:25

Meta-dynamical state space models for integrative neural data analysis

Ayesha Vermani
16:25 - 16:50

A generalist model for intracortical motor brain-computer interfaces

Joel Ye
16:50 - 17:15

A generic noninvasive neuromotor interface for human-computer interaction

Adam Calhoun
17:15 - 17:30

Coffee Break

17:30 - 18:30

Panel Discussion

Chethan Pandarinath, David Sussillo, Eva Dyer, Patrick Mineault