A RAG data pipeline transforming heterogeneous data into AI-ready format for autonomous building performance discovery

• Introduces a novel RAG data pipeline that integrates domain-adapted extraction to convert building documents into accurate, provenance-grounded answers • Converts unstructured multimodal inputs (images, text, tables) into AI-ready, provenance-linked chunks while preserving spatial and hierarchical relationships • Delivers approximately 30% improvement in coverage and structural preservation with domain-adapted RAG processing • Demonstrates potential integration with MCP tools to automatically generate semantic data models, reducing effort from days to minutes. • Substantially reduces data-preparation overhead, enabling accessible building information for operations, auditing, and analytics. . Despite a growing volume of data being collected from buildings, a small portion of the data has been analyzed to provide actionable insights, mainly due to the labor intensive and error prone process of integrating and understanding the heterogeneous data with varying levels of quality and resolutions. This study introduces a novel domain-adapted Retrieval Augmented Generation (RAG) based data pipeline designed for efficient information retrieval and management from heterogeneous building data sources. The proposed data pipeline leverages Large Language Models (LLMs) and domain-specific processing to transform unstructured data (including images, tables, and plain text) into semantically rich, AI-ready representations. Evaluation results show that the domain-adapted processing techniques achieved approximately 30% improvement in both coverage and structural preservation for documents like images and tables compared to generic baseline methods employing generic prompts and minimal preprocessing. This automation capability transforms raw building artifacts into AI-ready searchable knowledge bases. A critical application demonstrated is the automation of semantic data model creation, reducing the manual effort from potentially days to minutes. This domain-adapted RAG pipeline significantly addresses persistent data challenges in the building sector, increasing the accessibility and utility of building information for diverse stakeholders and applications.

Authors

Institutions

Publication Details

Journal
Advances in Applied Energy
Published
2025-12-31
DOI
https://doi.org/10.1016/j.adapen.2025.100261
Citations
2
Primary Topic
Handwritten Text Recognition Techniques
Type
article
Field-Weighted Citation Impact
2.55
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A RAG data pipeline transforming heterogeneous data into AI-ready format for autonomous building performance discovery

Christopher Weyandt, Ana Comesana, Han Li, Tianzhen Hong
2 citations
Advances in Applied Energy
Handwritten Text Recognition Techniques
2.55
article

A RAG data pipeline transforming heterogeneous data into AI-ready format for autonomous building performance discovery

Christopher Weyandt, Ana Comesana, Han Li, Tianzhen Hong
article en
2 citations

Abstract

• Introduces a novel RAG data pipeline that integrates domain-adapted extraction to convert building documents into accurate, provenance-grounded answers • Converts unstructured multimodal inputs (images, text, tables) into AI-ready, provenance-linked chunks while preserving spatial and hierarchical relationships • Delivers approximately 30% improvement in coverage and structural preservation with domain-adapted RAG processing • Demonstrates potential integration with MCP tools to automatically generate semantic data models, reducing effort from days to minutes. • Substantially reduces data-preparation overhead, enabling accessible building information for operations, auditing, and analytics. . Despite a growing volume of data being collected from buildings, a small portion of the data has been analyzed to provide actionable insights, mainly due to the labor intensive and error prone process of integrating and understanding the heterogeneous data with varying levels of quality and resolutions. This study introduces a novel domain-adapted Retrieval Augmented Generation (RAG) based data pipeline designed for efficient information retrieval and management from heterogeneous building data sources. The proposed data pipeline leverages Large Language Models (LLMs) and domain-specific processing to transform unstructured data (including images, tables, and plain text) into semantically rich, AI-ready representations. Evaluation results show that the domain-adapted processing techniques achieved approximately 30% improvement in both coverage and structural preservation for documents like images and tables compared to generic baseline methods employing generic prompts and minimal preprocessing. This automation capability transforms raw building artifacts into AI-ready searchable knowledge bases. A critical application demonstrated is the automation of semantic data model creation, reducing the manual effort from potentially days to minutes. This domain-adapted RAG pipeline significantly addresses persistent data challenges in the building sector, increasing the accessibility and utility of building information for diverse stakeholders and applications.

Advances in Applied EnergyVol. 21
Lawrence Berkeley National Laboratory (US)
Decent work and economic growth
Openalex Percentile: Top 8%
Handwritten Text Recognition Techniques
2.55
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.