Capturing Rich Details of Human Eyes

Capturing rich details of human eyes is essential for realistic digital humans, yet remains challenging due to the eye's complex optical structure. The sclera, cornea, and iris exhibit distinct appearance properties, and their geometry and appearance are tightly coupled through reflection and refraction in image observations. We present a human eye capture and reconstruction system based on multi-source optical measurements, which are tailored to different eye components to capture detail-rich observations at multiple scales and provide direct constraints for staged, decoupled reconstruction. For the sclera, multi-view and multi-gaze imaging recovers subject-specific exterior geometry and establishes an eye-centric frame. For the cornea, specular highlights and dense Placido-based topographic cues estimate the anterior surface before it is used as the refractive interface for iris reconstruction. For the iris, refraction-aware photometric reconstruction recovers albedo, normals, and fine-scale displacement under limited viewing angles. Experiments demonstrate detailed reconstruction of scleral shape, corneal topography, and iris micro-geometry across diverse subjects. The reconstructed assets further expose physiology-supported ocular details, including scleral asymmetry, non-axisymmetric corneal shape, iris relief, and pupil-center motion, providing evidence for reconstruction fidelity and useful annotations for downstream rendering, tracking, and data generation. We will release a consented 20-eye reconstructed ocular asset dataset containing component models and textures for all eye components.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Graphics
Published
2026-11-09
DOI
https://doi.org/10.1145/3842575
Primary Topic
3D Shape Modeling and Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Capturing Rich Details of Human Eyes

Shihong Xia, Zhiheng Zhang, Shuang Yang
ACM Transactions on Graphics
3D Shape Modeling and Analysis
article

Capturing Rich Details of Human Eyes

Shihong Xia, Zhiheng Zhang, Shuang Yang
article en

Abstract

Capturing rich details of human eyes is essential for realistic digital humans, yet remains challenging due to the eye's complex optical structure. The sclera, cornea, and iris exhibit distinct appearance properties, and their geometry and appearance are tightly coupled through reflection and refraction in image observations. We present a human eye capture and reconstruction system based on multi-source optical measurements, which are tailored to different eye components to capture detail-rich observations at multiple scales and provide direct constraints for staged, decoupled reconstruction. For the sclera, multi-view and multi-gaze imaging recovers subject-specific exterior geometry and establishes an eye-centric frame. For the cornea, specular highlights and dense Placido-based topographic cues estimate the anterior surface before it is used as the refractive interface for iris reconstruction. For the iris, refraction-aware photometric reconstruction recovers albedo, normals, and fine-scale displacement under limited viewing angles. Experiments demonstrate detailed reconstruction of scleral shape, corneal topography, and iris micro-geometry across diverse subjects. The reconstructed assets further expose physiology-supported ocular details, including scleral asymmetry, non-axisymmetric corneal shape, iris relief, and pupil-center motion, providing evidence for reconstruction fidelity and useful annotations for downstream rendering, tracking, and data generation. We will release a consented 20-eye reconstructed ocular asset dataset containing component models and textures for all eye components.

ACM Transactions on GraphicsVol. 45(6)
Chinese Academy of Sciences (CN), Institute of Computing Technology (CN), University of Chinese Academy of Sciences (CN)
3D Shape Modeling and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
Capturing Rich Details of Human Eyes — Shihong Xia, Zhiheng Zhang, et al. · ACM Transactions on Graphics (2026) | TGRS Research Map | TGRS