Can speech foundation models effectively identify languages in low-resource multilingual aging populations?
Speech foundation models (SFMs) achieve state-of-the-art results in many tasks, but their performance on elderly, multilingual speech remains underexplored. In this work, we investigate SFMs' ability to analyze multilingual speech from older adults using spoken language identification as a proxy task. We propose three key qualities for foundation models to serve multilingual aging populations: robustness to input duration, invariance to speaker demographics, and few-shot transferability in low-resource settings. Zero-shot evaluation indicates a noticeable performance drop for shorter inputs. We find that native speakers' speech consistently outperforms non-native speech across languages. Few-shot learning indicates better transferability in larger models.
Authors
- Aditya Kommineni (ORCID: https://orcid.org/0009-0002-0056-8336)
- Pranali Khobragade (ORCID: https://orcid.org/0000-0002-1117-1177)
- Jinkook Lee (ORCID: https://orcid.org/0000-0002-6209-719X)
- Miguel Arce Rentería (ORCID: https://orcid.org/0000-0002-4696-6279)
- Sudarsana Reddy Kadiri (ORCID: https://orcid.org/0000-0001-5806-3053)
- Sarah Petrosyan (ORCID: https://orcid.org/0000-0001-5122-6155)
- Rajat Hebbar (ORCID: https://orcid.org/0000-0002-0904-0573)
- Shrikanth Narayanan
Institutions
- University of Southern California (US)
- Columbia University (US)
Publication Details
- Journal
- JASA Express Letters
- Published
- 2025-09-01
- DOI
- https://doi.org/10.1121/10.0039265
- Primary Topic
- Speech Recognition and Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 0.00