Disparity estimation of stereo-endoscopic images using deep generative network
A novel disparity estimation pipeline is proposed for 3D reconstruction of dynamic soft tissues in minimally invasive surgery (MIS), which uses a deep generative network to learn manifold distributions of reasonable disparity maps from past stereo images in the training phase, and transforms stereo matching into an optimization problem with respect to the low-dimensional latent vector of the learned generator in the application phase. The proposed pipeline is particularly suitable for dynamic MIS scenarios with insufficient training data, as the photometric loss is explicitly used in the application phase and the scenario priors are introduced via a deep generative network.
Authors
- Bo Yang (ORCID: https://orcid.org/0000-0002-1108-4006)
- Lirong Yin (ORCID: https://orcid.org/0000-0002-5022-610X)
- Siyuan Xu (ORCID: https://orcid.org/0009-0009-8528-5079)
- Wenfeng Zheng (ORCID: https://orcid.org/0000-0002-8486-1654)
- Chao Liu (ORCID: https://orcid.org/0000-0003-0696-3943)
Institutions
- Louisiana State University (US)
- Centre National de la Recherche Scientifique (FR)
- University of Electronic Science and Technology of China (CN)
- Laboratoire d'Informatique, de Robotique et de Microélectronique de Montpellier (FR)
- Texas A&M University (US)
Publication Details
- Journal
- ICT Express
- Published
- 2024-10-05
- DOI
- https://doi.org/10.1016/j.icte.2024.09.017
- Citations
- 10
- Primary Topic
- Advanced Vision and Imaging
- Type
- article
- Field-Weighted Citation Impact
- 2.49
Funders
- Sichuan Province Science and Technology Support Program