Non-line-of-sight imaging with arbitrary illumination and detection pattern

被引:23
|
作者
Liu, Xintong [1 ]
Wang, Jianyu [1 ]
Xiao, Leping [2 ,3 ]
Shi, Zuoqiang [1 ,4 ]
Fu, Xing [2 ,3 ]
Qiu, Lingyun [1 ,4 ]
机构
[1] Tsinghua Univ, Yau Math Sci Ctr, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Dept Precis Instrument, State Key Lab Precis Measurement Technol & Instrum, Beijing 100084, Peoples R China
[3] Tsinghua Univ, Key Lab Photon Control Technol, Minist Educ, Beijing 100084, Peoples R China
[4] Yanqi Lake Beijing Inst Math Sci & Applicat, Beijing 101408, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1038/s41467-023-38898-4
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The authors propose a confocal complemented signal-object collaborative regularization method for non-line-of-sight (NLOS) imaging without specific requirements on the spatial pattern of measurement points. The method extends the application range of NLOS imaging. Non-line-of-sight (NLOS) imaging aims at reconstructing targets obscured from the direct line of sight. Existing NLOS imaging algorithms require dense measurements at regular grid points in a large area of the relay surface, which severely hinders their availability to variable relay scenarios in practical applications such as robotic vision, autonomous driving, rescue operations and remote sensing. In this work, we propose a Bayesian framework for NLOS imaging without specific requirements on the spatial pattern of illumination and detection points. By introducing virtual confocal signals, we design a confocal complemented signal-object collaborative regularization (CC-SOCR) algorithm for high-quality reconstructions. Our approach is capable of reconstructing both the albedo and surface normal of the hidden objects with fine details under general relay settings. Moreover, with a regular relay surface, coarse rather than dense measurements are enough for our approach such that the acquisition time can be reduced significantly. As demonstrated in multiple experiments, the proposed framework substantially extends the application range of NLOS imaging.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Compressive Non-Line-of-Sight Imaging with Deep Learning
    Zhu, Shenyu
    Sua, Yong Meng
    Bu, Ting
    Huang, Yu -Ping
    PHYSICAL REVIEW APPLIED, 2023, 19 (03)
  • [22] Exploiting Occlusion in Non-Line-of-Sight Active Imaging
    Thrampoulidis, Christos
    Shulkind, Gal
    Xu, Feihu
    Freeman, William T.
    Shapiro, Jeffrey H.
    Torralba, Antonio
    Wong, Franco N. C.
    Wornell, Gregory W.
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2018, 4 (03): : 419 - 431
  • [23] Calibration scheme for non-line-of-sight imaging setups
    Klein, Jonathan
    Laurenzis, Martin
    Hullin, Matthias B.
    Iseringhausen, Julian
    OPTICS EXPRESS, 2020, 28 (19): : 28324 - 28342
  • [24] Non-Line-of-Sight Imaging with Picosecond Temporal Resolution
    Wang, Bin
    Zheng, Ming-Yang
    Han, Jin-Jian
    Huang, Xin
    Xie, Xiu-Ping
    Xu, Feihu
    Zhang, Qiang
    Pan, Jian-Wei
    PHYSICAL REVIEW LETTERS, 2021, 127 (05)
  • [25] Deep Non-Line-of-Sight Imaging Using Echolocation
    Jang, Seungwoo
    Shin, Ui-Hyeon
    Kim, Kwangsu
    SENSORS, 2022, 22 (21)
  • [26] Non-line-of-sight imaging over 1.43 km
    Wu, Cheng
    Liu, Jianjiang
    Huang, Xin
    Li, Zheng-Ping
    Yu, Chao
    Ye, Jun-Tian
    Zhang, Jun
    Zhang, Qiang
    Dou, Xiankang
    Goyal, Vivek K.
    Xu, Feihu
    Pan, Jian-Wei
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2021, 118 (10)
  • [27] Non-line-of-sight imaging with adaptive artifact cancellation
    Zhou, Hongyuan
    Chen, Ziyang
    Qiu, Jumin
    Zhong, Sijia
    Zhang, Dejian
    Wang, Tongbiao
    Liu, Qiegen
    Yu, Tianbao
    OPTICS AND LASER TECHNOLOGY, 2025, 182
  • [28] Steady-state Non-Line-of-Sight Imaging
    Chen, Wenzheng
    Daneau, Simon
    Mannan, Fahim
    Heide, Felix
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3783 - 6792
  • [29] Photon-Efficient Non-Line-of-Sight Imaging
    Liu, Jianjiang
    Zhou, Yijun
    Huang, Xin
    Li, Zheng-Ping
    Xu, Feihu
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2022, 8 : 639 - 650
  • [30] Seeing around corners non-line-of-sight imaging
    Faccio D.
    Optics and Photonics News, 2019, 30 (01): : 36 - 43