Subtopic Deep Dive

Time-of-Flight Depth Sensing
Research Guide

What is Time-of-Flight Depth Sensing?

Time-of-Flight (ToF) depth sensing measures distance by timing light travel from emitter to target and back using continuous-wave or time-domain principles in PMD and SPAD array cameras.

ToF systems employ lock-in pixels for phase demodulation in continuous-wave setups or single-photon detection in SPAD arrays for direct time measurement. Key surveys include Foix et al. (2011) on lock-in ToF cameras (614 citations) and Sansoni et al. (2009) on 3D imaging sensors (555 citations). Applications span robotics to autonomous vehicles with over 20 papers addressing calibration and multipath issues.

Curated Papers

Key Challenges

Why It Matters

ToF depth sensing provides compact 3D vision for robotics navigation, as shown in Fankhauser et al. (2015) evaluating Kinect v2 (309 citations). In autonomous driving, it fuses with LiDAR per Wang et al. (2019, 467 citations) and Royo et al. (2019, 445 citations) for environmental mapping. Velten et al. (2012, 717 citations) demonstrate non-line-of-sight imaging, enabling AR/VR and medical applications via Sansoni et al. (2009).

Key Research Challenges

Multipath Interference Correction

Reflected light from multiple surfaces distorts depth in ToF cameras. Foix et al. (2011) detail limitations in lock-in ToF systems. Calibration algorithms mitigate this, as surveyed in Sansoni et al. (2009).

Ambient Light Suppression

Sunlight overwhelms ToF signals in SPAD and PMD arrays. Bruschini et al. (2019, 452 citations) review SPAD imagers facing this in biophotonics. Modulation techniques help but degrade at high intensities.

Calibration Accuracy

Nonlinear errors require precise per-pixel calibration. Foix et al. (2011) cover existing methods for lock-in cameras. Sarbolandi et al. (2015, 376 citations) compare Kinect ToF calibration needs.

Essential Papers

Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging

Andreas Velten, Thomas Willwacher, Otkrist Gupta et al. · 2012 · Nature Communications · 717 citations

Lock-in Time-of-Flight (ToF) Cameras: A Survey

Sergi Foix, Guillem Alenyà, Carme Torras · 2011 · IEEE Sensors Journal · 614 citations

This paper reviews the state-of-the art in the field of lock-in time-of-flight (ToF) cameras, their advantages, their limitations, the existing calibration methods, and the way they are being used,...

State-of-The-Art and Applications of 3D Imaging Sensors in Industry, Cultural Heritage, Medicine, and Criminal Investigation

Giovanna Sansoni, Marco Trebeschi, Franco Docchio · 2009 · Sensors · 555 citations

3D imaging sensors for the acquisition of three dimensional (3D) shapes have created, in recent years, a considerable degree of interest for a number of applications. The miniaturization and integr...

Multi-Sensor Fusion in Automated Driving: A Survey

Zhangjing Wang, Yu Wu, Qingqing Niu · 2019 · IEEE Access · 467 citations

With the significant development of practicability in deep learning and the ultra-high-speed information transmission rate of 5G communication technology will overcome the barrier of data transmiss...

Single-photon avalanche diode imagers in biophotonics: review and outlook

Claudio Bruschini, Harald Homulle, Ivan Michel Antolović et al. · 2019 · Light Science & Applications · 452 citations

An Overview of Lidar Imaging Systems for Autonomous Vehicles

Santiago Royo, Maria Ballesta-Garcia · 2019 · Applied Sciences · 445 citations

Lidar imaging systems are one of the hottest topics in the optronics industry. The need to sense the surroundings of every autonomous vehicle has pushed forward a race dedicated to deciding the fin...

A Review of the Pinned Photodiode for CCD and CMOS Image Sensors

Eric R. Fossum, Donald Hondongwa · 2014 · IEEE Journal of the Electron Devices Society · 430 citations

The pinned photodiode is the primary photodetector structure used in most CCD and CMOS image sensors. This paper reviews the development, physics, and technology of the pinned photodiode.

Reading Guide

Foundational Papers

Start with Foix et al. (2011, 614 citations) for lock-in ToF survey and calibration; Velten et al. (2012, 717 citations) for time-domain principles; Sansoni et al. (2009, 555 citations) for applications overview.

Recent Advances

Bruschini et al. (2019, 452 citations) on SPAD imagers; Wang et al. (2019, 467 citations) on multi-sensor fusion; Fankhauser et al. (2015, 309 citations) on Kinect v2 evaluation.

Core Methods

Lock-in demodulation (Foix et al., 2011), SPAD photon timing (Bruschini et al., 2019), pinned photodiode detection (Fossum et al., 2014), phase-based continuous-wave ranging.

How PapersFlow Helps You Research Time-of-Flight Depth Sensing

Discover & Search

Research Agent uses searchPapers and citationGraph on 'lock-in ToF cameras multipath' to map 50+ papers from Foix et al. (2011, 614 citations), revealing clusters around Velten et al. (2012). exaSearch finds niche SPAD-ToF works; findSimilarPapers expands from Bruschini et al. (2019).

Analyze & Verify

Analysis Agent applies readPaperContent to Foix et al. (2011) abstracts, verifying claims via verifyResponse (CoVe) against Sansoni et al. (2009). runPythonAnalysis simulates ToF multipath in NumPy sandbox, with GRADE scoring calibration method rigor from Fankhauser et al. (2015).

Synthesize & Write

Synthesis Agent detects gaps in ambient light handling across Foix et al. (2011) and Bruschini et al. (2019); Writing Agent uses latexEditText, latexSyncCitations for Foix survey, and latexCompile for error correction reports. exportMermaid diagrams ToF vs. structured-light per Sarbolandi et al. (2015).

Use Cases

"Simulate Kinect v2 ToF multipath error from Fankhauser paper"

Research Agent → searchPapers('Kinect v2 ToF') → Analysis Agent → readPaperContent(Fankhauser 2015) → runPythonAnalysis(NumPy model depth distortion) → matplotlib plot of corrected vs. raw depths.

"Write LaTeX review of lock-in ToF calibration methods"

Research Agent → citationGraph(Foix 2011) → Synthesis Agent → gap detection → Writing Agent → latexEditText(intro), latexSyncCitations(20 papers), latexCompile → PDF with ToF principles diagram.

"Find GitHub code for SPAD ToF simulation"

Research Agent → searchPapers('SPAD ToF simulation') → Code Discovery → paperExtractUrls(Bruschini 2019) → paperFindGithubRepo → githubRepoInspect → verified simulation scripts for ambient light tests.

Automated Workflows

Deep Research workflow scans 50+ ToF papers via searchPapers → citationGraph(Foix 2011 hub) → structured report on multipath fixes. DeepScan applies 7-step CoVe to verify Velten et al. (2012) non-line-of-sight claims against Sansoni et al. (2009). Theorizer generates calibration algorithm hypotheses from Fankhauser et al. (2015) Kinect data.

Try Doxa for Time-of-Flight Depth Sensing Research

Frequently Asked Questions

What defines Time-of-Flight depth sensing?

ToF measures distance by timing modulated or pulsed light round-trip using PMD lock-in pixels or SPAD arrays (Foix et al., 2011).

What are main ToF methods?

Continuous-wave uses phase demodulation in lock-in cameras; time-domain employs SPADs for photon timing (Bruschini et al., 2019; Foix et al., 2011).

What are key papers on ToF sensing?

Foix et al. (2011, 614 citations) surveys lock-in ToF; Velten et al. (2012, 717 citations) shows ultrafast imaging; Sansoni et al. (2009, 555 citations) covers applications.