GBC: Gaussian-Based Colorization and Super-Resolution for 3D Reconstruction
In this paper, we introduce GBC, an advanced framework for transforming low-resolution, monochrome video sequences into high-resolution, colorized, and geometrically accurate 3D models. GBC combines Bidirectional Optical Flow Super-Resolution (BOF-SR) for temporal super-resolution with a novel colorization approach, Temporal Optical Flow-based Colorization (TOF-CO), designed to enhance frame-to-frame temporal consistency. The integration of these modules with COLMAP-based 3D Gaussian splatting further extends GBC’s capability to reconstruct high-fidelity 3D scenes. Additionally, we created a custom dataset tailored to the challenges of low-light, low-quality historical footage, enabling robust evaluation alongside public datasets. This solution offers a new approach to video restoration, advancing temporal coherence, color accuracy, and 3D scene fidelity. The source code is publicly available at https://github.com/ffftuanxxx/GBC.
Authors
- Yujian Yuan (ORCID: https://orcid.org/0009-0004-0389-449X)
- Hui Zhang (ORCID: https://orcid.org/0000-0002-1681-7926)
- Shi He
- Jiecheng Liao (ORCID: https://orcid.org/0009-0001-2778-885X)
Institutions
- Beijing Normal-Hong Kong Baptist University (CN)
Publication Details
- Published
- 2024-12-01
- DOI
- https://doi.org/10.1145/3703619.3706039
- Primary Topic
- Advanced Vision and Imaging
- Type
- article
- Field-Weighted Citation Impact
- 0.00