Symmetry-Driven Hyperspectral Imaging–Augmented Reality Fusion: A Review from Surgical Navigation to Cultural Heritage Conservation

Hyperspectral imaging (HSI) and augmented reality (AR) act as a symmetric pair of sensing operations: HSI encodes a physical object into a spectral response at the acquisition end, and AR decodes that response back into physical space at the display end. Registration and calibration keep the two ends consistent, so that the composition of the two maps stays close to the identity. This review organizes HSI-AR fusion as a closed loop of acquisition, multimodal registration, spatial anchoring and augmented visualization, and reads it in symmetry terms: rigid-body symmetry between sensor and display frames, symmetry breaking of an otherwise flat spectrum as the source of material contrast, asymmetric pairing of spectral and spatial sensors, and the mismatch between symmetric technical metrics and asymmetric task-error costs. Applications in surgery, mineral analysis, education and cultural heritage are compared by architecture, with cultural heritage treated as the leading case. Systems divide by whether spectra are acquired in real time or beforehand. The main challenges are spatiotemporal consistency, end-to-end latency, task-oriented representation of high-dimensional spectra, and cross-system evaluation. Future work will center on acquisition–computation co-optimization, multisensor fusion, edge computing and task-oriented interaction. The framework offers a common reference for HSI-AR systems in the field.

Authors

Institutions

Publication Details

Journal
Symmetry
Published
2026-11-19
DOI
https://doi.org/10.3390/sym18111933
Primary Topic
Augmented Reality Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Symmetry-Driven Hyperspectral Imaging–Augmented Reality Fusion: A Review from Surgical Navigation to Cultural Heritage Conservation

Xiaogang Lin, Tong Xu, Yuyang Zhao, Xinshuo Li
Symmetry
Augmented Reality Applications
article

Symmetry-Driven Hyperspectral Imaging–Augmented Reality Fusion: A Review from Surgical Navigation to Cultural Heritage Conservation

Xiaogang Lin, Tong Xu, Yuyang Zhao, Xinshuo Li
article en

Abstract

Hyperspectral imaging (HSI) and augmented reality (AR) act as a symmetric pair of sensing operations: HSI encodes a physical object into a spectral response at the acquisition end, and AR decodes that response back into physical space at the display end. Registration and calibration keep the two ends consistent, so that the composition of the two maps stays close to the identity. This review organizes HSI-AR fusion as a closed loop of acquisition, multimodal registration, spatial anchoring and augmented visualization, and reads it in symmetry terms: rigid-body symmetry between sensor and display frames, symmetry breaking of an otherwise flat spectrum as the source of material contrast, asymmetric pairing of spectral and spatial sensors, and the mismatch between symmetric technical metrics and asymmetric task-error costs. Applications in surgery, mineral analysis, education and cultural heritage are compared by architecture, with cultural heritage treated as the leading case. Systems divide by whether spectra are acquired in real time or beforehand. The main challenges are spatiotemporal consistency, end-to-end latency, task-oriented representation of high-dimensional spectra, and cross-system evaluation. Future work will center on acquisition–computation co-optimization, multisensor fusion, edge computing and task-oriented interaction. The framework offers a common reference for HSI-AR systems in the field.

SymmetryVol. 18(11)
Chongqing University (CN)
Augmented Reality Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon