A Language‐Guided Multimodal Foundation Model for Zero‐Shot and Multi‐Task Brain Signal Analysis

Brain signal analysis is essential for both neuroscience research and clinical diagnostics, yet current approaches face critical limitations. End‐to‐end models require task‐specific retraining and exhibit limited generalization, while pre‐trained models lack semantic depth and still depend on extensive fine‐tuning. Meanwhile, general‐purpose multimodal foundation models, though powerful in other domains, struggle to interpret brain signals due to representational misalignment and lack of domain knowledge. This study introduces a M ultimodal foundation mod E l for zero‐sho T and mult I ‐ta S k brain signal analysis ( METIS ) through a unified language‐signal alignment framework. METIS is pretrained on the largest and most diverse brain‐signal corpus to date, comprising over 70 000 h of recordings from more than 11 000 subjects across 20 datasets. In a comprehensive zero‐shot evaluation across 12 datasets, METIS outperformed the leading generalist model by over 20.9% in average accuracy. Remarkably, without any fine‐tuning, METIS's performance matches or exceeds that of supervised, task‐specific models. Furthermore, METIS demonstrates exceptional data efficiency and strong generalization, achieving an average AUROC advantage of over 16.0% in few‐shot settings and 15.9% in cross‐dataset transfer. This work establishes a new paradigm for general‐purpose brain signal analysis, paving the way for next‐generation neurotechnology. The code is available at https://github.com/mingzhi‐c/metis‐brain‐signal‐foundation‐model .

Authors

Institutions

Publication Details

Journal
Advanced Intelligent Systems
Published
2026-07-23
DOI
https://doi.org/10.1002/aisy.70486
Primary Topic
EEG and Brain-Computer Interfaces
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Language‐Guided Multimodal Foundation Model for Zero‐Shot and Multi‐Task Brain Signal Analysis

Yuchao Yang, Yiyu Gui, Guibo Luo, Mingzhi Chen
Advanced Intelligent Systems
EEG and Brain-Computer Interfaces
article

A Language‐Guided Multimodal Foundation Model for Zero‐Shot and Multi‐Task Brain Signal Analysis

Yuchao Yang, Yiyu Gui, Guibo Luo, Mingzhi Chen
article en

Abstract

Brain signal analysis is essential for both neuroscience research and clinical diagnostics, yet current approaches face critical limitations. End‐to‐end models require task‐specific retraining and exhibit limited generalization, while pre‐trained models lack semantic depth and still depend on extensive fine‐tuning. Meanwhile, general‐purpose multimodal foundation models, though powerful in other domains, struggle to interpret brain signals due to representational misalignment and lack of domain knowledge. This study introduces a M ultimodal foundation mod E l for zero‐sho T and mult I ‐ta S k brain signal analysis ( METIS ) through a unified language‐signal alignment framework. METIS is pretrained on the largest and most diverse brain‐signal corpus to date, comprising over 70 000 h of recordings from more than 11 000 subjects across 20 datasets. In a comprehensive zero‐shot evaluation across 12 datasets, METIS outperformed the leading generalist model by over 20.9% in average accuracy. Remarkably, without any fine‐tuning, METIS's performance matches or exceeds that of supervised, task‐specific models. Furthermore, METIS demonstrates exceptional data efficiency and strong generalization, achieving an average AUROC advantage of over 16.0% in few‐shot settings and 15.9% in cross‐dataset transfer. This work establishes a new paradigm for general‐purpose brain signal analysis, paving the way for next‐generation neurotechnology. The code is available at https://github.com/mingzhi‐c/metis‐brain‐signal‐foundation‐model .

Advanced Intelligent Systems
Chinese Institute for Brain Research (CN), Fraunhofer Institute for Integrated Circuits (DE), Peking University Shenzhen Hospital (CN), Shanghai Center for Brain Science and Brain-Inspired Technology (CN)
Quality Education
Openalex Percentile: Top 7%
EEG and Brain-Computer Interfaces
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Language‐Guided Multimodal Foundation Model for Zero‐Shot and Multi‐Task Brain Signal Analysis — Yuchao Yang, Yiyu Gui, et al. · Advanced Intelligent Systems (2026) | TGRS Research Map | TGRS