Appendix A. LLM-Based Concept Detection: Prompt Development and Classification Cases

This supplementary appendix documents iterative prompt development for large language model-based detection of three interpretive concepts in oral history interviews: collective memory, intersubjectivity through affirmation and backchanneling, and identity performance. Six tables present prompt modifications, their design rationales, selected classification results, and diagnostically selected interview passages illustrating true positives, false positives and false negatives. The tables examine the effects of operational definitions, conversational context, passage boundaries and relational criteria on classification, including trade-offs between precision and recall. The reported results document prompt development rather than independent evaluation. Examples from additional interviews illustrate recurring error types and the challenges of translating interpretive concepts into reproducible annotation decisions. Funded by the Deutsche Forschungsgemeinschaft (DFG) and the Arts and Humanities Research Council (AHRC) through “Mixed-Methods Digital Oral History: Interlocking Semantic Web Technologies and Historical Interpretive Analysis to better understand narratives of emergence, disruption and change in the History of Computer Technology in the Humanities”. DFG project number: 528052031.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-29
DOI
https://doi.org/10.5281/zenodo.23781858
Primary Topic
Computational and Text Analysis Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Appendix A. LLM-Based Concept Detection: Prompt Development and Classification Cases

Julianne Nyhan, Andreas Vlachidis, Frieda Schmidt, Valentina Prishchepova et al.
3 links
Zenodo (CERN European Organization for Nuclear Research)
Computational and Text Analysis Methods
article

Appendix A. LLM-Based Concept Detection: Prompt Development and Classification Cases

Julianne Nyhan, Andreas Vlachidis, Frieda Schmidt, Valentina Prishchepova, Florian Elleringmann, Aleksey Varfolomeyev
article en

Abstract

This supplementary appendix documents iterative prompt development for large language model-based detection of three interpretive concepts in oral history interviews: collective memory, intersubjectivity through affirmation and backchanneling, and identity performance. Six tables present prompt modifications, their design rationales, selected classification results, and diagnostically selected interview passages illustrating true positives, false positives and false negatives. The tables examine the effects of operational definitions, conversational context, passage boundaries and relational criteria on classification, including trade-offs between precision and recall. The reported results document prompt development rather than independent evaluation. Examples from additional interviews illustrate recurring error types and the challenges of translating interpretive concepts into reproducible annotation decisions. Funded by the Deutsche Forschungsgemeinschaft (DFG) and the Arts and Humanities Research Council (AHRC) through “Mixed-Methods Digital Oral History: Interlocking Semantic Web Technologies and Historical Interpretive Analysis to better understand narratives of emergence, disruption and change in the History of Computer Technology in the Humanities”. DFG project number: 528052031.

Zenodo (CERN European Organization for Nuclear Research)
Uppsala University (SE), Technische Universität Darmstadt (DE), University College London (GB)
Openalex Percentile: Top 6%
Computational and Text Analysis Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon