GSAlign: Optical Alignment for Photorealistic Dynamic 3D Reconstruction from UGC in Web3

User-generated 3D content plays a crucial role in enabling truly immersive experiences within the Web3 metaverse. Although significant progress has been made in dynamic 3D content creation and animation using multi-camera setups, they typically require professional equipment and strict synchronization. In contrast, a dynamic and inclusive Web3 ecosystem is collectively built by digital assets from anyone, at any time, and from anywhere. Most Web3 participants are therefore decentralized and non-professional, and their contributed videos, even of the same scene, are usually captured asynchronously using handheld devices. In this paper, we present GSAlign, a novel framework that achieves high-fidelity dynamic 3D reconstruction from unstructured, user-generated videos in the Web3 metaverse. To address the temporal and spatial misalignments inherent in such data, GSAlign integrates three key modules: Epipolar-guided Temporal Alignment (ETA), Motion-centric Separated Reconstruction (MSR), and Background-guided Global Pose Alignment (BGPA). We detail the design of each module and their integration toward a practical end-to-end implementation. Our evaluation of GSAlign on real-world user-generated videos demonstrates robust reconstruction of dynamic 3D scenes despite unsynchronized captures, sparse views, and handheld camera motion.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Multimedia Computing Communications and Applications
Published
2026-06-09
DOI
https://doi.org/10.1145/3820054
Primary Topic
Virtual Reality Applications and Impacts
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

GSAlign: Optical Alignment for Photorealistic Dynamic 3D Reconstruction from UGC in Web3

Yili Jin, Jiangchuan Liu, Xue Liu, Rui Qian et al.
ACM Transactions on Multimedia Computing Communications and Applications
Virtual Reality Applications and Impacts
article

GSAlign: Optical Alignment for Photorealistic Dynamic 3D Reconstruction from UGC in Web3

Yili Jin, Jiangchuan Liu, Xue Liu, Rui Qian, Daheng Yin, Isaac Ding
article en

Abstract

User-generated 3D content plays a crucial role in enabling truly immersive experiences within the Web3 metaverse. Although significant progress has been made in dynamic 3D content creation and animation using multi-camera setups, they typically require professional equipment and strict synchronization. In contrast, a dynamic and inclusive Web3 ecosystem is collectively built by digital assets from anyone, at any time, and from anywhere. Most Web3 participants are therefore decentralized and non-professional, and their contributed videos, even of the same scene, are usually captured asynchronously using handheld devices. In this paper, we present GSAlign, a novel framework that achieves high-fidelity dynamic 3D reconstruction from unstructured, user-generated videos in the Web3 metaverse. To address the temporal and spatial misalignments inherent in such data, GSAlign integrates three key modules: Epipolar-guided Temporal Alignment (ETA), Motion-centric Separated Reconstruction (MSR), and Background-guided Global Pose Alignment (BGPA). We detail the design of each module and their integration toward a practical end-to-end implementation. Our evaluation of GSAlign on real-world user-generated videos demonstrates robust reconstruction of dynamic 3D scenes despite unsynchronized captures, sparse views, and handheld camera motion.

ACM Transactions on Multimedia Computing Communications and Applications
Simon Fraser University (CA), Mohamed bin Zayed University of Artificial Intelligence (AE)
Openalex Percentile: Top 5%
Virtual Reality Applications and Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

GSAlign: Optical Alignment for Photorealistic Dynamic 3D Reconstruction from UGC in Web3 — Yili Jin, Jiangchuan Liu, et al. · ACM Transactions on Multimedia Computing Communications and Applications (2026) | TGRS Research Map | TGRS