Event-Based Shape and Reflectance Acquisition Using the Refresh Line of a Single Off-the-Shelf Display

Capturing the shape and spatially varying reflectance of objects is fundamental to many graphics and vision applications, yet achieving fast acquisition remains challenging. Existing display-based appearance capture methods rely on a sequence of multiple illumination patterns and measurements to disentangle illumination, geometry, material response, and sensor characteristics. However, pattern switching and multi-frame capture are time-consuming, limiting acquisition speed and applicability to dynamic scenarios. In this paper, we observe that the native row-wise refresh lines of commodity displays already provide a fast spatiotemporal illumination signal within a single frame. Combining this with a high-temporal-resolution event camera, we capture object appearance changes within one frame during the display's progressive scanning. Based on this signal, we propose a method to simultaneously reconstruct shape and reflectance from the event stream induced by refresh lines. We build a prototype system that pairs a commodity OLED display with an event camera to capture refresh-line responses from near-planar, highly metallic objects. Using this setup, we develop a reconstruction pipeline that uses event measurements to recover surface shape and spatially varying reflectance. Through 25 fps real-time capture and offline reconstruction on real near-planar metallic objects, we demonstrate that native display refresh can be repurposed from an imaging artifact into a practical high-speed cue for appearance acquisition.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Graphics
Published
2026-11-09
DOI
https://doi.org/10.1145/3842542
Primary Topic
Computer Graphics and Visualization Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Event-Based Shape and Reflectance Acquisition Using the Refresh Line of a Single Off-the-Shelf Display

Bohan Yu, Boxin Shi, Zhuofeng Wang, Jiayi Zhou
ACM Transactions on Graphics
Computer Graphics and Visualization Techniques
article

Event-Based Shape and Reflectance Acquisition Using the Refresh Line of a Single Off-the-Shelf Display

Bohan Yu, Boxin Shi, Zhuofeng Wang, Jiayi Zhou
article en

Abstract

Capturing the shape and spatially varying reflectance of objects is fundamental to many graphics and vision applications, yet achieving fast acquisition remains challenging. Existing display-based appearance capture methods rely on a sequence of multiple illumination patterns and measurements to disentangle illumination, geometry, material response, and sensor characteristics. However, pattern switching and multi-frame capture are time-consuming, limiting acquisition speed and applicability to dynamic scenarios. In this paper, we observe that the native row-wise refresh lines of commodity displays already provide a fast spatiotemporal illumination signal within a single frame. Combining this with a high-temporal-resolution event camera, we capture object appearance changes within one frame during the display's progressive scanning. Based on this signal, we propose a method to simultaneously reconstruct shape and reflectance from the event stream induced by refresh lines. We build a prototype system that pairs a commodity OLED display with an event camera to capture refresh-line responses from near-planar, highly metallic objects. Using this setup, we develop a reconstruction pipeline that uses event measurements to recover surface shape and spatially varying reflectance. Through 25 fps real-time capture and offline reconstruction on real near-planar metallic objects, we demonstrate that native display refresh can be repurposed from an imaging artifact into a practical high-speed cue for appearance acquisition.

ACM Transactions on GraphicsVol. 45(6)
Peking University (CN)
Computer Graphics and Visualization Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon