TALAAN: A Framework for Offline Multi-Tier Retrieval-Augmented Generation in Philippine Local Government Document Intelligence

Abstract—Philippine Local Government Units (LGUs) accumulate thousands of legislative documents—resolutions and ordinances—that remain largely inaccessible for evidence-based policy analysis due to fragmented storage, inconsistent naming conventions, OCR degradation, and the absence of semantic search infrastructure. This paper presents TALAAN (Tagged Archival Lookup for Analysis and Accountability Network), a framework for offline Retrieval-Augmented Generation (RAG) designed for LGU document intelligence under resource-constrained, privacy-sensitive deployment conditions. TALAAN does not attempt to replace the full document and records lifecycle; it operates as a retrieval and synthesis layer on top of existing document holdings. The framework introduces a seven-stage processing pipeline covering PDF ingest, multi-layer OCR correction with Filipino diacritics restoration, three-method metadata extraction, and a dual-table tagging architecture that enables systematic comparison of keyword-baseline versus LLM-generated tags. Retrieval is handled by a priority-enforced three-tier architecture combining deterministic exact-match (T1), structured SQL tag and metadata filtering (T2), and semantic vector search via ChromaDB (T3) at a calibrated cosine threshold of 0.75. The system operates fully offline on commodity CPU hardware using Ollama with gemma4 and incorporates privacy controls designed to support compliance with the Philippine Data Privacy Act of 2012. While existing platforms such as NotebookLM and Gemini offer document AI capabilities for LGUs already using Google Drive, these require document transmission to external servers—requiring institutional assessment of privacy and data-processing obligations under RA 10173 and operational dependency on reliable internet connectivity. TALAAN's locally-sovereign design addresses both constraints. A working implementation has been deployed on a corpus of 1,867 Sangguniang Bayan resolutions and ordinances from the Municipality of Midsayap, Cotabato (2021–2025).

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-21
DOI
https://doi.org/10.5281/zenodo.22866490
Primary Topic
Web Data Mining and Analysis
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
preprint

TALAAN: A Framework for Offline Multi-Tier Retrieval-Augmented Generation in Philippine Local Government Document Intelligence

Shem Durst Elijah Sandig
Zenodo (CERN European Organization for Nuclear Research)
Web Data Mining and Analysis
preprint

TALAAN: A Framework for Offline Multi-Tier Retrieval-Augmented Generation in Philippine Local Government Document Intelligence

Shem Durst Elijah Sandig
preprint en

Abstract

Abstract—Philippine Local Government Units (LGUs) accumulate thousands of legislative documents—resolutions and ordinances—that remain largely inaccessible for evidence-based policy analysis due to fragmented storage, inconsistent naming conventions, OCR degradation, and the absence of semantic search infrastructure. This paper presents TALAAN (Tagged Archival Lookup for Analysis and Accountability Network), a framework for offline Retrieval-Augmented Generation (RAG) designed for LGU document intelligence under resource-constrained, privacy-sensitive deployment conditions. TALAAN does not attempt to replace the full document and records lifecycle; it operates as a retrieval and synthesis layer on top of existing document holdings. The framework introduces a seven-stage processing pipeline covering PDF ingest, multi-layer OCR correction with Filipino diacritics restoration, three-method metadata extraction, and a dual-table tagging architecture that enables systematic comparison of keyword-baseline versus LLM-generated tags. Retrieval is handled by a priority-enforced three-tier architecture combining deterministic exact-match (T1), structured SQL tag and metadata filtering (T2), and semantic vector search via ChromaDB (T3) at a calibrated cosine threshold of 0.75. The system operates fully offline on commodity CPU hardware using Ollama with gemma4 and incorporates privacy controls designed to support compliance with the Philippine Data Privacy Act of 2012. While existing platforms such as NotebookLM and Gemini offer document AI capabilities for LGUs already using Google Drive, these require document transmission to external servers—requiring institutional assessment of privacy and data-processing obligations under RA 10173 and operational dependency on reliable internet connectivity. TALAAN's locally-sovereign design addresses both constraints. A working implementation has been deployed on a corpus of 1,867 Sangguniang Bayan resolutions and ordinances from the Municipality of Midsayap, Cotabato (2021–2025).

Zenodo (CERN European Organization for Nuclear Research)
Jeju National University (KR), West Visayas State University (PH)
Industry, innovation and infrastructure
Web Data Mining and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.