Roof Structure Extraction from Remote Sensing Images

Accurate roof structure extraction from aerial imagery is important for applications such as solar energy assessment, urban analysis, and 3D city modeling, where roof surfaces require geometrically reliable polygonal representations. Although instance segmentation methods can detect rooftop regions, their masks often contain redundant or overlapping predictions and irregular boundaries, making them difficult to convert into coherent roof surfaces. To address these limitations, we propose a polygon-level structured inference framework for roof-region extraction. Rather than directly using raster masks as final outputs or reconstructing roof polygons from local vector primitives, the proposed method generates over-segmented polygon candidates from line-based cues and aggregates confidence-weighted probabilities at the polygon level. Roof-region assignment is formulated as a Markov Random Field (MRF) optimization problem, where unary terms encode segmentation evidence and pairwise terms enforce spatial consistency. Experiments on the Cities and RoofVec datasets show that the proposed framework suppresses redundant and spurious predictions while improving region coherence. On RoofVec, false positives are reduced from 111 to 94 and precision improves from 96.7% to 97.2% compared with unary-only polygon labeling, while maintaining comparable mean IoU. These results show improved geometric consistency in roof extraction from 2D remote sensing imagery. The source code is publicly available at https://github.com/appleadele/Roof-Structure-Extraction-from-Remote-Sensing-Images.

Authors

Institutions

Publication Details

Journal
ISPRS annals of the photogrammetry, remote sensing and spatial information sciences
Published
2026-09-28
DOI
https://doi.org/10.5194/isprs-annals-xii-4-w1-2026-81-2026
Primary Topic
Remote Sensing and LiDAR Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Roof Structure Extraction from Remote Sensing Images

Liangliang Nan, Weixiao Gao, Hsin-Yu Cheng
ISPRS annals of the photogrammetry, remote sensing and spatial information sciences
Remote Sensing and LiDAR Applications
article

Roof Structure Extraction from Remote Sensing Images

Liangliang Nan, Weixiao Gao, Hsin-Yu Cheng
article en

Abstract

Accurate roof structure extraction from aerial imagery is important for applications such as solar energy assessment, urban analysis, and 3D city modeling, where roof surfaces require geometrically reliable polygonal representations. Although instance segmentation methods can detect rooftop regions, their masks often contain redundant or overlapping predictions and irregular boundaries, making them difficult to convert into coherent roof surfaces. To address these limitations, we propose a polygon-level structured inference framework for roof-region extraction. Rather than directly using raster masks as final outputs or reconstructing roof polygons from local vector primitives, the proposed method generates over-segmented polygon candidates from line-based cues and aggregates confidence-weighted probabilities at the polygon level. Roof-region assignment is formulated as a Markov Random Field (MRF) optimization problem, where unary terms encode segmentation evidence and pairwise terms enforce spatial consistency. Experiments on the Cities and RoofVec datasets show that the proposed framework suppresses redundant and spurious predictions while improving region coherence. On RoofVec, false positives are reduced from 111 to 94 and precision improves from 96.7% to 97.2% compared with unary-only polygon labeling, while maintaining comparable mean IoU. These results show improved geometric consistency in roof extraction from 2D remote sensing imagery. The source code is publicly available at https://github.com/appleadele/Roof-Structure-Extraction-from-Remote-Sensing-Images.

ISPRS annals of the photogrammetry, remote sensing and spatial information sciencesVol. XII-4/W1-2026(0)
Wageningen University & Research (NL), Delft University of Technology (NL)
Sustainable cities and communities
Openalex Percentile: Top 19%
Remote Sensing and LiDAR Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Roof Structure Extraction from Remote Sensing Images — Liangliang Nan, Weixiao Gao, et al. · ISPRS annals of the photogrammetry, remote sensing and spatial information sciences (2026) | TGRS Research Map | TGRS