‘Two Sides of the Same Coin’: A Multi‐Stakeholder Perspective on Discoverability and Promotionality in a Comparison of Scholar‐Authored vs. AI ‐Generated Keywords From the Chinese Social Sciences
ABSTRACT For scholarly publishers, Generative AI presents efficiency opportunities but critical metadata quality challenges. To determine if AI can replace authors, we conducted a multi‐dimensional comparative analysis of 1500 paired scholar‐authored and Large Language Model (LLM)‐generated keyword sets from high‐impact Chinese social science articles, assessing grammatical, semantic and discourse features. Supported by rigorous statistical testing, we found the two approaches represent ‘two sides of the same coin’. The AI employed a bottom‐up ‘intelligent summarization’ logic, creating comprehensive sets optimised for discoverability. Conversely, human scholars used a top‐down ‘artisanal distillation’ logic to serve promotionality by crafting conceptually novel terms. Our findings demonstrate that full automation is suboptimal, sacrificing the crucial promotional function that brands research and signals specific contributions. We conclude the ideal path is a synergistic human‐AI workflow. This critical curation model enhances metadata by creating keywords that are both comprehensive and conceptually potent.
Authors
- Chenghui Wu (ORCID: https://orcid.org/0000-0001-8694-5213)
- Yang Zhang (ORCID: https://orcid.org/0009-0001-0397-7840)
- Hanlin Xu (ORCID: https://orcid.org/0009-0009-8789-9541)
Institutions
- University of Electronic Science and Technology of China (CN)
- Peking University (CN)
- University of Science and Technology Beijing (CN)
Publication Details
- Journal
- Learned Publishing
- Published
- 2026-09-01
- DOI
- https://doi.org/10.1002/leap.2098
- Primary Topic
- Computational and Text Analysis Methods
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Nanjing University