Depth Dynamics via One-Bit Frequency Probing in Embedded Direct Time-of-Flight Sensing
Time-of-flight (ToF) sensors with single-photon avalanche diodes (SPADs) estimate depth by accumulating a histogram of photon return times, which discards the timing information required to measure depth dynamics, such as vibrations or transient motions. We introduce a method that transforms a direct ToF sensor into a depth frequency analyzer capable of measuring high-frequency motion and transient events using only lightweight, on-sensor computations. By replacing conventional discrete Fourier transforms (DFTs) with one-bit probing sinusoids generated via oversampled sigma-delta modulation, we enable in-pixel frequency analysis without multipliers or floating-point operations. We extend the lightweight analysis of depth dynamics to Haar wavelets for time-localized detection of brief, non-repetitive depth changes. We validate our approach through simulation and hardware experiments, showing that it achieves noise performance approaching that of full-resolution DFTs, detects sub-millimeter motions above 6 kHz, and localizes millisecond-scale transients. Using a laboratory ToF setup, we demonstrate applications in oscillatory motion analysis and depth edge detection. This work has the potential to enable a new class of compact, motion-aware ToF sensors for embedded deployment in industrial predictive maintenance, structural health monitoring, robotic perception, and dynamic scene understanding.
Authors
- Lucas J. Koerner (ORCID: https://orcid.org/0000-0002-7236-7202)
- Ben Johnson (ORCID: https://orcid.org/0000-0003-0373-8986)
- S Lindgren
Institutions
- University of St. Thomas - Minnesota (US)
Publication Details
- Journal
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tpami.2025.3598593
- Citations
- 1
- Primary Topic
- Advanced Optical Sensing Technologies
- Type
- article
- Field-Weighted Citation Impact
- 1.19