Appendix A. LLM-Based Concept Detection: Prompt Development and Classification Cases
This supplementary appendix documents iterative prompt development for large language model-based detection of three interpretive concepts in oral history interviews: collective memory, intersubjectivity through affirmation and backchanneling, and identity performance. Six tables present prompt modifications, their design rationales, selected classification results, and diagnostically selected interview passages illustrating true positives, false positives and false negatives. The tables examine the effects of operational definitions, conversational context, passage boundaries and relational criteria on classification, including trade-offs between precision and recall. The reported results document prompt development rather than independent evaluation. Examples from additional interviews illustrate recurring error types and the challenges of translating interpretive concepts into reproducible annotation decisions. Funded by the Deutsche Forschungsgemeinschaft (DFG) and the Arts and Humanities Research Council (AHRC) through “Mixed-Methods Digital Oral History: Interlocking Semantic Web Technologies and Historical Interpretive Analysis to better understand narratives of emergence, disruption and change in the History of Computer Technology in the Humanities”. DFG project number: 528052031.
Authors
- Julianne Nyhan (ORCID: https://orcid.org/0000-0002-4998-1757)
- Andreas Vlachidis (ORCID: https://orcid.org/0000-0003-0986-4430)
- Frieda Schmidt
- Valentina Prishchepova
- Florian Elleringmann
- Aleksey Varfolomeyev
Institutions
- Uppsala University (SE)
- Technische Universität Darmstadt (DE)
- University College London (GB)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-10-29
- DOI
- https://doi.org/10.5281/zenodo.23781858
- Primary Topic
- Computational and Text Analysis Methods
- Type
- article
- Field-Weighted Citation Impact
- 0.00