A multimodal speech-production dataset with time-aligned articulography, EEG, audio, and vocal-tract anatomy

Abstract We present a multimodal speech-production dataset combining simultaneous electromagnetic articulography (EMA), electroencephalography (EEG), and audio from 29 adult native speakers of German. All participants have external craniofacial anthropometry; an anatomical subset (N = 18) additionally contributed acoustic pharyngometry, rhinometry, and 3D head surface meshes. Speech materials include high-trial diadochokinetic sequences at habitual and maximally fast rates, plus EMA+audio for passage reading and sustained vowels, as well as EMA for palate tracing and non-speech oromotor actions. The corpus contains 8,700 syllable-task trials and approximately 17 h of EMA with matched audio. A microcontroller mirrors each EMA sweep’s start and stop as 1 ms transistor—transistor logic (TTL) pulses on the EEG digital channel, enabling sub-millisecond alignment. We distribute raw and minimally processed streams, stable event codes, and machine-readable metadata, plus example Python utilities (and a container) for loading, synchronising, and basic preprocessing. The resource supports studies that exploit articulatory landmarks for EEG alignment, examine pre-movement activity, assess overt-speech EEG artefact handling, and develop anatomy-informed models linking vocal-tract structure to articulatory dynamics and acoustics. Data and code are openly available under a CC-BY 4.0 licence with versioned DOIs.

Authors

Institutions

Publication Details

Journal
Scientific Data
Published
2026-07-01
DOI
https://doi.org/10.1038/s41597-026-07704-3
Primary Topic
EEG and Brain-Computer Interfaces
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A multimodal speech-production dataset with time-aligned articulography, EEG, audio, and vocal-tract anatomy

Volker Dellwo, Elena Bolt, Mónica Lancheros, Valeriia Vyshnevetska et al.
Scientific Data
EEG and Brain-Computer Interfaces
article

A multimodal speech-production dataset with time-aligned articulography, EEG, audio, and vocal-tract anatomy

Volker Dellwo, Elena Bolt, Mónica Lancheros, Valeriia Vyshnevetska, Daniel Friedrichs, Steven Moran
article en

Abstract

Abstract We present a multimodal speech-production dataset combining simultaneous electromagnetic articulography (EMA), electroencephalography (EEG), and audio from 29 adult native speakers of German. All participants have external craniofacial anthropometry; an anatomical subset (N = 18) additionally contributed acoustic pharyngometry, rhinometry, and 3D head surface meshes. Speech materials include high-trial diadochokinetic sequences at habitual and maximally fast rates, plus EMA+audio for passage reading and sustained vowels, as well as EMA for palate tracing and non-speech oromotor actions. The corpus contains 8,700 syllable-task trials and approximately 17 h of EMA with matched audio. A microcontroller mirrors each EMA sweep’s start and stop as 1 ms transistor—transistor logic (TTL) pulses on the EEG digital channel, enabling sub-millisecond alignment. We distribute raw and minimally processed streams, stable event codes, and machine-readable metadata, plus example Python utilities (and a container) for loading, synchronising, and basic preprocessing. The resource supports studies that exploit articulatory landmarks for EEG alignment, examine pre-movement activity, assess overt-speech EEG artefact handling, and develop anatomy-informed models linking vocal-tract structure to articulatory dynamics and acoustics. Data and code are openly available under a CC-BY 4.0 licence with versioned DOIs.

Scientific Data
University of Geneva (CH), University of Zurich (CH), Infrastructure Management Consultants (Switzerland) (CH), University of Neuchâtel (CH)
Quality Education
Openalex Percentile: Top 6%
EEG and Brain-Computer Interfaces
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.