AURORA-RAG: A Trustworthy Hierarchical Retrieval-Augmented Generation Architecture for Grounded Synthetic Personas

Large language models can generate synthetic personas, but their factual claims may be unsupported when generation relies on parametric knowledge alone. We present AURORA-RAG, a hierarchical retrieval-augmented generation architecture that introduces documentary evidence at country–topic, community, community–topic, and persona construction stages. The evaluated four-country corpus comprises 834 input files and 3888 indexed semantic chunks, with non-English source material translated into English. AURORA-RAG combines dense retrieval and BM25 using reciprocal rank fusion and pseudo-relevance feedback while retaining document provenance. We compare no-RAG, persona-only hybrid RAG, and full AURORA-RAG using 1440 personas per condition across three geopolitical topics. Corpus support increases from 68% to 82% and 91%, respectively, while unsupported-claim rates decline from 24% to 13% and 7%. Between retrieval-enabled conditions, supplied-evidence faithfulness rises from 79% to 90%, attribution accuracy from 82% to 92%, and citation correctness from 85% to 94%. Full AURORA-RAG also produces greater opinion displacement from no-RAG than persona-only retrieval (0.210 versus 0.103), a measure of output change rather than accuracy. Hybrid retrieval leads on five of six ranking metrics, although only MRR@5 over dense retrieval remains significant after Holm correction. These findings support hierarchical retrieval for stronger documentary grounding and source traceability.

Authors

Institutions

Publication Details

Journal
Electronics
Published
2026-10-27
DOI
https://doi.org/10.3390/electronics15214962
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AURORA-RAG: A Trustworthy Hierarchical Retrieval-Augmented Generation Architecture for Grounded Synthetic Personas

Kathleen M. Carley, Rebecca Marigliano
2 links
Electronics
Topic Modeling
article

AURORA-RAG: A Trustworthy Hierarchical Retrieval-Augmented Generation Architecture for Grounded Synthetic Personas

Kathleen M. Carley, Rebecca Marigliano
article en

Abstract

Large language models can generate synthetic personas, but their factual claims may be unsupported when generation relies on parametric knowledge alone. We present AURORA-RAG, a hierarchical retrieval-augmented generation architecture that introduces documentary evidence at country–topic, community, community–topic, and persona construction stages. The evaluated four-country corpus comprises 834 input files and 3888 indexed semantic chunks, with non-English source material translated into English. AURORA-RAG combines dense retrieval and BM25 using reciprocal rank fusion and pseudo-relevance feedback while retaining document provenance. We compare no-RAG, persona-only hybrid RAG, and full AURORA-RAG using 1440 personas per condition across three geopolitical topics. Corpus support increases from 68% to 82% and 91%, respectively, while unsupported-claim rates decline from 24% to 13% and 7%. Between retrieval-enabled conditions, supplied-evidence faithfulness rises from 79% to 90%, attribution accuracy from 82% to 92%, and citation correctness from 85% to 94%. Full AURORA-RAG also produces greater opinion displacement from no-RAG than persona-only retrieval (0.210 versus 0.103), a measure of output change rather than accuracy. Hybrid retrieval leads on five of six ranking metrics, although only MRR@5 over dense retrieval remains significant after Holm correction. These findings support hierarchical retrieval for stronger documentary grounding and source traceability.

ElectronicsVol. 15(21)
Software Engineering Institute (US), Carnegie Mellon University (US)
John S. and James L. Knight Foundation, Carnegie Mellon University, U.S. Army
Openalex Percentile: Top 13%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon