When Models Agree but Institutions Disagree: Cross-Model Convergence on Genre-Boundary Blindness in AI-Assisted Journal Selection

This working paper examines a recurrent failure mode in AI-assisted journal selection: the tendency of large language models (LLMs) to conflate topical relevance and article-like format with institutional genre admissibility. While AI systems are increasingly used by researchers to identify suitable publication venues, the underlying judgment they perform remains poorly understood and insufficiently governed. Using a trace-based comparative case study combined with a small controlled mini-benchmark, the paper analyses journal-fit recommendations generated independently by two widely used LLM-based systems. Despite architectural and product-level differences, both systems converge on the same judgment pattern: confident venue recommendations driven by scope alignment and surface scholarly features, accompanied by a persistent absence of explicit reasoning about whether a journal typically accepts the proposed type of contribution. The paper characterises this shared failure mode as Genre-Boundary Blindness (GBB)—a judgment-infrastructure gap in which tacit editorial genre gates are bypassed through proxy signals. Importantly, the analysis reframes the issue from model accuracy to judgment delegation: the systems are not merely “wrong,” but are governing the wrong object. Cross-model agreement, rather than mitigating risk, may amplify automation bias by creating an illusion of corroborated institutional judgment. To address this gap, the paper proposes a Journal-Fit Safety Protocol (JFSP) that treats journal selection as a governed institutional judgment rather than a pattern-matching task. The protocol requires explicit contribution-type classification, venue-specific disqualifiers, and conditional uncertainty disclosure, offering a practical governance intervention for AI-assisted research workflows. This paper contributes to the literature on AI governance, human–AI judgment delegation, and academic publishing by making editorial judgment flows observable and auditable. It is intended as part of the broader Judgment Infrastructure research programme and serves as a foundational case for understanding how AI systems misrepresent institutional decision processes in knowledge production.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-01-21
DOI
https://doi.org/10.5281/zenodo.18322317
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

When Models Agree but Institutions Disagree: Cross-Model Convergence on Genre-Boundary Blindness in AI-Assisted Journal Selection

Sincere Ann Ma
Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
article

When Models Agree but Institutions Disagree: Cross-Model Convergence on Genre-Boundary Blindness in AI-Assisted Journal Selection

Sincere Ann Ma
article en

Abstract

This working paper examines a recurrent failure mode in AI-assisted journal selection: the tendency of large language models (LLMs) to conflate topical relevance and article-like format with institutional genre admissibility. While AI systems are increasingly used by researchers to identify suitable publication venues, the underlying judgment they perform remains poorly understood and insufficiently governed. Using a trace-based comparative case study combined with a small controlled mini-benchmark, the paper analyses journal-fit recommendations generated independently by two widely used LLM-based systems. Despite architectural and product-level differences, both systems converge on the same judgment pattern: confident venue recommendations driven by scope alignment and surface scholarly features, accompanied by a persistent absence of explicit reasoning about whether a journal typically accepts the proposed type of contribution. The paper characterises this shared failure mode as Genre-Boundary Blindness (GBB)—a judgment-infrastructure gap in which tacit editorial genre gates are bypassed through proxy signals. Importantly, the analysis reframes the issue from model accuracy to judgment delegation: the systems are not merely “wrong,” but are governing the wrong object. Cross-model agreement, rather than mitigating risk, may amplify automation bias by creating an illusion of corroborated institutional judgment. To address this gap, the paper proposes a Journal-Fit Safety Protocol (JFSP) that treats journal selection as a governed institutional judgment rather than a pattern-matching task. The protocol requires explicit contribution-type classification, venue-specific disqualifiers, and conditional uncertainty disclosure, offering a practical governance intervention for AI-assisted research workflows. This paper contributes to the literature on AI governance, human–AI judgment delegation, and academic publishing by making editorial judgment flows observable and auditable. It is intended as part of the broader Judgment Infrastructure research programme and serves as a foundational case for understanding how AI systems misrepresent institutional decision processes in knowledge production.

Zenodo (CERN European Organization for Nuclear Research)
Industry, innovation and infrastructure
Openalex Percentile: Top 84%
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

When Models Agree but Institutions Disagree: Cross-Model Convergence on Genre-Boundary Blindness in AI-Assisted Journal Selection — Sincere Ann Ma · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS