Computational Approaches to Measuring Latent Human Constructs
<p class="p1">As AI systems are deployed in domains where the constructs they claim to measure (meaning, bias, cognition, social experience) cannot be observed directly, the gap between what evaluations claim to capture and what they actually capture has become difficult to audit. This thesis asks whether construct validity and reliability, drawn from measurement science, can be productively applied to two computational domains where this gap has gone largely unexamined. The first is sound symbolism. Using an adversarial scrubber over <span class="s1">810 size adjectives across 27 typologically diverse languages, I suppress genealogical signal </span>while preserving semantic signal, and find a modest but consistent cross-family iconicity <span class="s1">effect carried largely by vowel quality. The second is stigma in LLMs. Using the validated </span>Individual Level Abortion Stigma Scale across 627 personas and five models, I show that representations of stigma fragment across cognitive, interpersonal, and structural levels. Together, the chapters show that rigorous measurement surfaces failure modes that standard <span class="s2">evaluation cannot, motivating the need to ground auditing system performance in domain </span><span class="s1">science, rather than generic benchmarks.</span>
Authors
- Anika Sharma
Institutions
- University of North Carolina at Chapel Hill (US)
Publication Details
- Journal
- UNC Libraries
- Published
- 2026-06-09
- DOI
- https://doi.org/10.17615/4s4t-af06
- Primary Topic
- Emotion and Mood Recognition
- Type
- article
- Field-Weighted Citation Impact
- 0.00