Privacy-Preserving Structured Knowledge Extraction from Census-Style Records Using a Hierarchical Multi-Agent Open-Weight LLM Architecture

Census-style address records contain heterogeneous structures that must be decomposed into fine-grained fields before they can support linkage, geocoding, and administrative processing. This paper describes the design and implementation of a three-stage Planner–Manager–Worker pipeline using a locally deployed open-weight language model. The prototype includes address-specific extraction, same-model semantic consistency review, formatting, record-preserving chunking, and an exploratory bounded retry pathway. Although the prototype also implements workers for names, phone numbers, email addresses, Social Security numbers, and dates of birth, the quantitative evaluation is limited to address-component parsing. We conduct a controlled pilot using 700 author-generated synthetic records distributed across seven address categories. Each record was first created as a structured object and then rendered into text; the original structured object served as the evaluation reference. Across three repeated executions on the same fixed benchmark, the complete hierarchical configuration obtained a mean micro-averaged address-component exact-match score of 95.7%, compared with 80.9% for the evaluated monolithic LLM reference; the deterministic rule-based reference obtained 52.3%. The fixed prompts were not matched, and realized inference calls, dynamic token allocation, original batching, and reported-run segmentation could not be verified from retained artifacts. No component ablations were conducted. Consequently, the numerical difference cannot be attributed uniquely to planning, task coordination, specialization, semantic review, feedback, chunking, or multi-agent organization. The reference labels were not independently annotated, the benchmark does not estimate performance on naturally occurring records, and the retry pathway was invoked only three times. The contribution is therefore the specification and controlled pilot characterization of an on-premise address-parsing pipeline, rather than evidence of architectural causality, production readiness, broad PII-extraction accuracy, or real-record robustness.

Authors

Publication Details

Journal
Knowledge
Published
2026-09-01
DOI
https://doi.org/10.3390/knowledge6030023
Primary Topic
Data Quality and Management
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Privacy-Preserving Structured Knowledge Extraction from Census-Style Records Using a Hierarchical Multi-Agent Open-Weight LLM Architecture

Shames Al Mandalawi, Adeeba Tarannum, John R. Talburt, Muzakkiruddin Ahmed Mohammed et al.
Knowledge
Data Quality and Management
article

Privacy-Preserving Structured Knowledge Extraction from Census-Style Records Using a Hierarchical Multi-Agent Open-Weight LLM Architecture

Shames Al Mandalawi, Adeeba Tarannum, John R. Talburt, Muzakkiruddin Ahmed Mohammed, Mert Can Cakmak
article en

Abstract

Census-style address records contain heterogeneous structures that must be decomposed into fine-grained fields before they can support linkage, geocoding, and administrative processing. This paper describes the design and implementation of a three-stage Planner–Manager–Worker pipeline using a locally deployed open-weight language model. The prototype includes address-specific extraction, same-model semantic consistency review, formatting, record-preserving chunking, and an exploratory bounded retry pathway. Although the prototype also implements workers for names, phone numbers, email addresses, Social Security numbers, and dates of birth, the quantitative evaluation is limited to address-component parsing. We conduct a controlled pilot using 700 author-generated synthetic records distributed across seven address categories. Each record was first created as a structured object and then rendered into text; the original structured object served as the evaluation reference. Across three repeated executions on the same fixed benchmark, the complete hierarchical configuration obtained a mean micro-averaged address-component exact-match score of 95.7%, compared with 80.9% for the evaluated monolithic LLM reference; the deterministic rule-based reference obtained 52.3%. The fixed prompts were not matched, and realized inference calls, dynamic token allocation, original batching, and reported-run segmentation could not be verified from retained artifacts. No component ablations were conducted. Consequently, the numerical difference cannot be attributed uniquely to planning, task coordination, specialization, semantic review, feedback, chunking, or multi-agent organization. The reference labels were not independently annotated, the benchmark does not estimate performance on naturally occurring records, and the retry pathway was invoked only three times. The contribution is therefore the specification and controlled pilot characterization of an on-premise address-parsing pipeline, rather than evidence of architectural causality, production readiness, broad PII-extraction accuracy, or real-record robustness.

KnowledgeVol. 6(3)
National Science Foundation
Industry, innovation and infrastructure
Openalex Percentile: Top 51%
Data Quality and Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.