Capturing Rich Details of Human Eyes
Capturing rich details of human eyes is essential for realistic digital humans, yet remains challenging due to the eye's complex optical structure. The sclera, cornea, and iris exhibit distinct appearance properties, and their geometry and appearance are tightly coupled through reflection and refraction in image observations. We present a human eye capture and reconstruction system based on multi-source optical measurements, which are tailored to different eye components to capture detail-rich observations at multiple scales and provide direct constraints for staged, decoupled reconstruction. For the sclera, multi-view and multi-gaze imaging recovers subject-specific exterior geometry and establishes an eye-centric frame. For the cornea, specular highlights and dense Placido-based topographic cues estimate the anterior surface before it is used as the refractive interface for iris reconstruction. For the iris, refraction-aware photometric reconstruction recovers albedo, normals, and fine-scale displacement under limited viewing angles. Experiments demonstrate detailed reconstruction of scleral shape, corneal topography, and iris micro-geometry across diverse subjects. The reconstructed assets further expose physiology-supported ocular details, including scleral asymmetry, non-axisymmetric corneal shape, iris relief, and pupil-center motion, providing evidence for reconstruction fidelity and useful annotations for downstream rendering, tracking, and data generation. We will release a consented 20-eye reconstructed ocular asset dataset containing component models and textures for all eye components.
Authors
- Shihong Xia (ORCID: https://orcid.org/0000-0002-7228-9646)
- Zhiheng Zhang
- Shuang Yang (ORCID: https://orcid.org/0009-0005-1854-7383)
Institutions
- Chinese Academy of Sciences (CN)
- Institute of Computing Technology (CN)
- University of Chinese Academy of Sciences (CN)
Publication Details
- Journal
- ACM Transactions on Graphics
- Published
- 2026-11-09
- DOI
- https://doi.org/10.1145/3842575
- Primary Topic
- 3D Shape Modeling and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 0.00