A multimodal speech-production dataset with time-aligned articulography, EEG, audio, and vocal-tract anatomy
Abstract We present a multimodal speech-production dataset combining simultaneous electromagnetic articulography (EMA), electroencephalography (EEG), and audio from 29 adult native speakers of German. All participants have external craniofacial anthropometry; an anatomical subset (N = 18) additionally contributed acoustic pharyngometry, rhinometry, and 3D head surface meshes. Speech materials include high-trial diadochokinetic sequences at habitual and maximally fast rates, plus EMA+audio for passage reading and sustained vowels, as well as EMA for palate tracing and non-speech oromotor actions. The corpus contains 8,700 syllable-task trials and approximately 17 h of EMA with matched audio. A microcontroller mirrors each EMA sweep’s start and stop as 1 ms transistor—transistor logic (TTL) pulses on the EEG digital channel, enabling sub-millisecond alignment. We distribute raw and minimally processed streams, stable event codes, and machine-readable metadata, plus example Python utilities (and a container) for loading, synchronising, and basic preprocessing. The resource supports studies that exploit articulatory landmarks for EEG alignment, examine pre-movement activity, assess overt-speech EEG artefact handling, and develop anatomy-informed models linking vocal-tract structure to articulatory dynamics and acoustics. Data and code are openly available under a CC-BY 4.0 licence with versioned DOIs.
Authors
- Volker Dellwo (ORCID: https://orcid.org/0000-0002-8494-6025)
- Elena Bolt (ORCID: https://orcid.org/0000-0002-7611-7905)
- Mónica Lancheros (ORCID: https://orcid.org/0000-0003-3124-0966)
- Valeriia Vyshnevetska
- Daniel Friedrichs
- Steven Moran
Institutions
- University of Geneva (CH)
- University of Zurich (CH)
- Infrastructure Management Consultants (Switzerland) (CH)
- University of Neuchâtel (CH)
Publication Details
- Journal
- Scientific Data
- Published
- 2026-07-01
- DOI
- https://doi.org/10.1038/s41597-026-07704-3
- Primary Topic
- EEG and Brain-Computer Interfaces
- Type
- article
- Field-Weighted Citation Impact
- 0.00