A cautionary tale of two corpora: analyzing cognitive impairments using linguistic data

Language samples are increasingly used to support the early detection of cognitive impairment and to develop automated models for identifying mild cognitive impairment (MCI) and dementia. Many studies have relied on Cookie Theft picture descriptions from DementiaBank’s Pitt corpus. Recently, researchers have begun combining data from the newer Delaware corpus to enlarge datasets or train and validate models across corpora. However, demographic and linguistic differences between these datasets have not been fully characterized. This study examined participant characteristics and linguistic measures from the picture descriptions in these two corpora. Multiple logistic regression assessed the homogeneity of the two corpora while controlling for age, sex, and education. Additional analyses compared language outcomes between diagnostic groups within each corpus. Delaware participants were significantly older than Pitt participants, and the Delaware control group included significantly more females. All demographic and linguistic covariates significantly contributed to classification of corpus membership. Among control participants, five of six language measures differed significantly between corpora; among participants with MCI, only grammatical complexity differed significantly. These findings demonstrate substantial heterogeneity between the Pitt and Delaware corpora, particularly among control participants. Researchers should consider demographic, linguistic, and data collection differences when combining these datasets, interpreting cross-corpus findings, or evaluating the generalizability of models trained on these two different corpora.

Authors

Institutions

Publication Details

Journal
Frontiers in Aging Neuroscience
Published
2026-11-20
DOI
https://doi.org/10.3389/fnagi.2026.1985729
Primary Topic
Dementia and Cognitive Impairment Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

A cautionary tale of two corpora: analyzing cognitive impairments using linguistic data

Brian MacWhinney, Emily Wang, Joel Greenhouse, Alyssa Lanzi et al.
1 links
Frontiers in Aging Neuroscience
Dementia and Cognitive Impairment Research
article

A cautionary tale of two corpora: analyzing cognitive impairments using linguistic data

Brian MacWhinney, Emily Wang, Joel Greenhouse, Alyssa Lanzi, Quingxuan He, S. Shria Parupudi, Davida Fromm, Elina Lee
article en

Abstract

Language samples are increasingly used to support the early detection of cognitive impairment and to develop automated models for identifying mild cognitive impairment (MCI) and dementia. Many studies have relied on Cookie Theft picture descriptions from DementiaBank’s Pitt corpus. Recently, researchers have begun combining data from the newer Delaware corpus to enlarge datasets or train and validate models across corpora. However, demographic and linguistic differences between these datasets have not been fully characterized. This study examined participant characteristics and linguistic measures from the picture descriptions in these two corpora. Multiple logistic regression assessed the homogeneity of the two corpora while controlling for age, sex, and education. Additional analyses compared language outcomes between diagnostic groups within each corpus. Delaware participants were significantly older than Pitt participants, and the Delaware control group included significantly more females. All demographic and linguistic covariates significantly contributed to classification of corpus membership. Among control participants, five of six language measures differed significantly between corpora; among participants with MCI, only grammatical complexity differed significantly. These findings demonstrate substantial heterogeneity between the Pitt and Delaware corpora, particularly among control participants. Researchers should consider demographic, linguistic, and data collection differences when combining these datasets, interpreting cross-corpus findings, or evaluating the generalizability of models trained on these two different corpora.

Frontiers in Aging NeuroscienceVol. 18
Carnegie Mellon University (US), University of Delaware (US)
Good health and well-being
Dementia and Cognitive Impairment Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
A cautionary tale of two corpora: analyzing cognitive impairments using linguistic data — Brian MacWhinney, Emily Wang, et al. · Frontiers in Aging Neuroscience (2026) | TGRS Research Map | TGRS