Subtopic Deep Dive

Non-Line-of-Sight Imaging
Research Guide

What is Non-Line-of-Sight Imaging?

Non-Line-of-Sight (NLOS) Imaging reconstructs hidden scenes from time-resolved diffuse reflections using computational methods and ultrafast sensors.

NLOS imaging employs time-of-flight measurements from SPADs and ultrafast lasers to capture transients scattered around occluders. Key techniques include confocal back-projection (O’Toole et al., 2018) and phasor-field virtual wave optics (Liu et al., 2019). Over 10 papers from 2009-2020 exceed 200 citations each, with Velten et al. (2012) at 717 citations.

Curated Papers

Key Challenges

Why It Matters

NLOS enables imaging around corners for search-and-rescue operations and medical endoscopy by reconstructing hidden objects from scattered light. Velten et al. (2012) demonstrated 3D shape recovery using ultrafast time-of-flight, applicable to robotics and remote sensing. O’Toole et al. (2018) advanced confocal methods for higher resolution, impacting cultural heritage scanning (Sansoni et al., 2009) and photon-efficient imaging (Shin et al., 2015). Liu et al. (2019) introduced phasor fields for practical deployments in autonomous vehicles.

Key Research Challenges

Sparse Photon Detection

Low signal-to-noise from multiply scattered light requires efficient single-photon processing. Buttafava et al. (2015) used time-gated SPADs but faced noise in transients. Shin et al. (2015) addressed photon efficiency yet reconstruction degrades below 100 photons per pixel.

Complex Light Transport

Modeling higher-order scattering remains computationally intensive. O’Toole et al. (2018) applied light-cone transforms for confocal imaging but struggled with non-Lambertian surfaces. Lindell et al. (2019) used f-k migration for waves, limited by medium assumptions.

Real-Time Reconstruction

Ultrafast capture demands fast algorithms for practical use. Liu et al. (2019) proposed phasor fields for speed but resolution trades off. Faccio et al. (2020) reviewed scalability issues in deploying NLOS systems.

Essential Papers

Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging

Andreas Velten, Thomas Willwacher, Otkrist Gupta et al. · 2012 · Nature Communications · 717 citations

State-of-The-Art and Applications of 3D Imaging Sensors in Industry, Cultural Heritage, Medicine, and Criminal Investigation

Giovanna Sansoni, Marco Trebeschi, Franco Docchio · 2009 · Sensors · 555 citations

3D imaging sensors for the acquisition of three dimensional (3D) shapes have created, in recent years, a considerable degree of interest for a number of applications. The miniaturization and integr...

Confocal non-line-of-sight imaging based on the light-cone transform

Matthew O’Toole, David B. Lindell, Gordon Wetzstein · 2018 · Nature · 459 citations

Non-line-of-sight imaging using phasor-field virtual wave optics

Xiaochun Liu, Ibón Guillén, Marco La Manna et al. · 2019 · Nature · 282 citations

Non-line-of-sight imaging using a time-gated single photon avalanche diode

Mauro Buttafava, Jessica Zeman, Alberto Tosi et al. · 2015 · Optics Express · 262 citations

By using time-of-flight information encoded in multiply scattered light, it is possible to reconstruct images of objects hidden from the camera’s direct line of sight. Here, we present a non-line-o...

Optical Vehicle-to-Vehicle Communication System Using LED Transmitter and Camera Receiver

Isamu Takai, Tomohisa Harada, Michinori Andoh et al. · 2014 · IEEE photonics journal · 254 citations

This paper introduces an optical vehicle-to-vehicle (V2V) communication system based on an optical wireless communication technology using an LED transmitter and a camera receiver, which employs a ...

Object Recognition, Segmentation, and Classification of Mobile Laser Scanning Point Clouds: A State of the Art Review

Erzhuo Che, Jaehoon Jung, Michael J. Olsen · 2019 · Sensors · 240 citations

Mobile Laser Scanning (MLS) is a versatile remote sensing technology based on Light Detection and Ranging (lidar) technology that has been utilized for a wide range of applications. Several previou...

Reading Guide

Foundational Papers

Start with Velten et al. (2012) for ultrafast time-of-flight basics (717 citations), then Sansoni et al. (2009) for 3D sensor contexts (555 citations), followed by Buttafava et al. (2015) for SPAD implementations.

Recent Advances

Study O’Toole et al. (2018) confocal transform (459 citations), Liu et al. (2019) phasor fields (282 citations), and Lindell et al. (2019) f-k migration (234 citations) for state-of-the-art algorithms.

Core Methods

Time-resolved transients with SPADs/ultrafast lasers; back-projection (confocal/light-cone); wave-based (phasor/f-k migration); photon-efficient computation.

How PapersFlow Helps You Research Non-Line-of-Sight Imaging

Discover & Search

Research Agent uses searchPapers and citationGraph to map NLOS literature from Velten et al. (2012, 717 citations) as seed, revealing clusters around O’Toole et al. (2018) and Liu et al. (2019). exaSearch finds transients-based methods; findSimilarPapers expands to SPAD applications like Buttafava et al. (2015).

Analyze & Verify

Analysis Agent applies readPaperContent to extract time-of-flight algorithms from Velten et al. (2012), then verifyResponse with CoVe checks reconstruction claims against transients data. runPythonAnalysis simulates photon-efficient imaging (Shin et al., 2015) using NumPy for SNR curves; GRADE scores evidence strength on back-projection fidelity.

Synthesize & Write

Synthesis Agent detects gaps in real-time NLOS via contradiction flagging between f-k migration (Lindell et al., 2019) and phasor methods (Liu et al., 2019). Writing Agent uses latexEditText for equations, latexSyncCitations for 10+ papers, latexCompile for reports, and exportMermaid for light transport diagrams.

Use Cases

"Compare SNR in SPAD-based NLOS from Buttafava 2015 vs Shin 2015"

Analysis Agent → readPaperContent (extract transients data) → runPythonAnalysis (NumPy simulation of photon budgets) → GRADE grading → CSV export of SNR curves.

"Draft LaTeX review of confocal NLOS methods citing O’Toole 2018"

Synthesis Agent → gap detection (light-cone transform limits) → Writing Agent → latexEditText (add equations) → latexSyncCitations (10 NLOS papers) → latexCompile → PDF output.

"Find GitHub code for f-k migration NLOS from Lindell 2019"

Research Agent → searchPapers (Lindell 2019) → paperExtractUrls → paperFindGithubRepo → Code Discovery → githubRepoInspect → Python sandbox test of reconstruction script.

Automated Workflows

Deep Research workflow scans 50+ NLOS papers via citationGraph from Velten et al. (2012), producing structured reports on SPAD vs streak camera methods with GRADE checkpoints. DeepScan applies 7-step analysis to Liu et al. (2019) phasor fields, verifying wave optics via CoVe and runPythonAnalysis. Theorizer generates hypotheses on neural NLOS extensions from O’Toole et al. (2018) transients.

Try Doxa for Non-Line-of-Sight Imaging Research

Frequently Asked Questions

What defines Non-Line-of-Sight Imaging?

NLOS Imaging reconstructs hidden scenes from time-resolved diffuse reflections using ultrafast sensors and computational back-projection (Velten et al., 2012).

What are core methods in NLOS?

Confocal back-projection via light-cone transform (O’Toole et al., 2018), phasor-field wave optics (Liu et al., 2019), and f-k migration (Lindell et al., 2019) model scattered transients.

What are key papers?

Velten et al. (2012, 717 citations) pioneered 3D recovery; O’Toole et al. (2018, 459 citations) introduced confocal NLOS; Faccio et al. (2020) reviewed the field.