Real-time Non-line-of-sight Imaging

被引:12
|
作者
O'Toole, Matthew [1 ]
Lindell, David B. [1 ]
Wetzstein, Gordon [1 ]
机构
[1] Stanford Univ, Stanford, CA 94305 USA
关键词
computational photography; single-photon sensors; time-of-flight imaging; non-line-of-sight imaging;
D O I
10.1145/3214907.3214920
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Non-line-of-sight (NLOS) imaging aims at recovering the shape of objects hidden outside the direct line of sight of a camera. In this work, we report on a new approach for acquiring time-resolved measurements that are suitable for NLOS imaging. The system uses a confocalized single-photon detector and pulsed laser. As opposed to previously-proposed NLOS imaging systems, our setup is very similar to LIDAR systems used for autonomous vehicles and it facilitates a closed-form solution of the associated inverse problem, which we derive in this work. This algorithm, dubbed the Light Cone Transform, is three orders of magnitude faster and more memory efficient than existing methods. We demonstrate experimental results for indoor and outdoor scenes captured and reconstructed with the proposed confocal NLOS imaging system.
引用
收藏
页数:2
相关论文
共 50 条
  • [1] FPGA Accelerator for Real-Time Non-Line-of-Sight Imaging
    Liao, Zhengpeng
    Jiang, Deyang
    Liu, Xiaochun
    Velten, Andreas
    Ha, Yajun
    Lou, Xin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2022, 69 (02) : 721 - 734
  • [2] Real-time scan-free non-line-of-sight imaging
    Zhang, Wenjun
    Guo, Enlai
    Zhu, Shuo
    Huang, Chenyang
    Chen, Lijia
    Liu, Lingfeng
    Bai, Lianfa
    Lam, Edmund Y.
    Han, Jing
    APL PHOTONICS, 2024, 9 (12)
  • [3] Propagate And Calibrate: Real-time Passive Non-line-of-sight Tracking
    Wang, Yihao
    Wang, Zhigang
    Zhao, Bin
    Wang, Dong
    Chen, Mulin
    Li, Xuelong
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 972 - 981
  • [4] Real-time non-line-of-sight computational imaging using spectrum filtering and motion compensation
    Ye, Jun-Tian
    Sun, Yi
    Li, Wenwen
    Zeng, Jian-Wei
    Hong, Yu
    Li, Zheng-Ping
    Huang, Xin
    Xue, Xianghui
    Yuan, Xin
    Xu, Feihu
    Dou, Xiankang
    Pan, Jian-Wei
    NATURE COMPUTATIONAL SCIENCE, 2024, 4 (11): : 920 - 927
  • [5] Non-line-of-sight imaging
    Daniele Faccio
    Andreas Velten
    Gordon Wetzstein
    Nature Reviews Physics, 2020, 2 : 318 - 327
  • [6] Non-line-of-sight imaging
    Faccio, Daniele
    Velten, Andreas
    Wetzstein, Gordon
    NATURE REVIEWS PHYSICS, 2020, 2 (06) : 318 - 327
  • [7] Acoustic Non-Line-of-Sight Imaging
    Lindell, David B.
    Wetzstein, Gordon
    Koltun, Vladlen
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3773 - 6782
  • [8] Deep-inverse correlography: towards real-time high-resolution non-line-of-sight imaging
    Metzler, Christopher A.
    Heide, Felix
    Rangarajan, Prasana
    Balaji, Muralidhar Madabhushi
    Viswanath, Aparna
    Veeraraghavan, Ashok
    Baraniuk, Richard G.
    OPTICA, 2020, 7 (01): : 63 - 71
  • [9] Confocal Non-line-of-sight Imaging
    O'Toole, Matthew
    Lindell, David B.
    Wetzstein, Gordon
    SIGGRAPH'18: ACM SIGGRAPH 2018 TALKS, 2018,
  • [10] Thermal Non-Line-of-Sight Imaging
    Maeda, Tomohiro
    Wang, Yiqin
    Raskar, Ramesh
    Kadambi, Achuta
    2019 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY (ICCP), 2019,