Fragment-Level Evidence Retrieval for Complex Long Texts in the Power Domain via Recursive Character Splitting
Knowledge bases for primary power equipment must retrieve concise, verifiable evidence from long standards, fault cases, and maintenance records. We evaluate six retrieval-unit strategies, three retrievers, and two Chinese embedding encoders using 149 documents (1.73 million characters) and 48 author-constructed questions, with 20 for development and 28 held out for testing. At the matched 500-character/100-overlap setting, recursive splitting preserves 84.5% of numbered standards clauses, compared with 78.6% for sliding-window, 72.0% for paragraph, and 64.9% for semantic chunking; clause-aware splitting reaches 88.3%. Recursive splitting with dense retrieval records Hit@10 of 0.571 and evidence coverage@10 of 0.542; hybrid dense–BM25 fusion raises these to 0.714 and 0.685. Sliding-window dense retrieval records 0.786 and 0.685 on the same measures. Recursive, sliding-window, paragraph, and semantic chunks each contain all 112 annotated evidence spans, whose lengths range from 11 to 90 characters (median 36); clause-aware chunking contains 97.3%. The results characterize the structural-preservation and retrieval profiles of the tested strategies and show that hybrid fusion improves top-10 evidence recovery with recursive chunks.
Authors
- Shanfeng Liu (ORCID: https://orcid.org/0009-0002-6337-0992)
- Li Ruan (ORCID: https://orcid.org/0000-0002-2386-961X)
- Joshua Luhwago (ORCID: https://orcid.org/0009-0005-2420-1354)
- Shengzhe Xi (ORCID: https://orcid.org/0009-0003-6668-5372)
- Guojing Qian
- Asad Ullah
- Xiawei Cheng
- Limin Xiao
- Wanden Mao
Institutions
- State Grid Henan Electric Power Company (China) (CN)
- Beihang University (CN)
Publication Details
- Journal
- Electronics
- Published
- 2026-11-18
- DOI
- https://doi.org/10.3390/electronics15225373
- Primary Topic
- Information Retrieval and Search Behavior
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- State Grid Henan Electric Power Company