Non-line-of-sight imaging with arbitrary illumination and detection pattern

被引:23
|
作者
Liu, Xintong [1 ]
Wang, Jianyu [1 ]
Xiao, Leping [2 ,3 ]
Shi, Zuoqiang [1 ,4 ]
Fu, Xing [2 ,3 ]
Qiu, Lingyun [1 ,4 ]
机构
[1] Tsinghua Univ, Yau Math Sci Ctr, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Dept Precis Instrument, State Key Lab Precis Measurement Technol & Instrum, Beijing 100084, Peoples R China
[3] Tsinghua Univ, Key Lab Photon Control Technol, Minist Educ, Beijing 100084, Peoples R China
[4] Yanqi Lake Beijing Inst Math Sci & Applicat, Beijing 101408, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1038/s41467-023-38898-4
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The authors propose a confocal complemented signal-object collaborative regularization method for non-line-of-sight (NLOS) imaging without specific requirements on the spatial pattern of measurement points. The method extends the application range of NLOS imaging. Non-line-of-sight (NLOS) imaging aims at reconstructing targets obscured from the direct line of sight. Existing NLOS imaging algorithms require dense measurements at regular grid points in a large area of the relay surface, which severely hinders their availability to variable relay scenarios in practical applications such as robotic vision, autonomous driving, rescue operations and remote sensing. In this work, we propose a Bayesian framework for NLOS imaging without specific requirements on the spatial pattern of illumination and detection points. By introducing virtual confocal signals, we design a confocal complemented signal-object collaborative regularization (CC-SOCR) algorithm for high-quality reconstructions. Our approach is capable of reconstructing both the albedo and surface normal of the hidden objects with fine details under general relay settings. Moreover, with a regular relay surface, coarse rather than dense measurements are enough for our approach such that the acquisition time can be reduced significantly. As demonstrated in multiple experiments, the proposed framework substantially extends the application range of NLOS imaging.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Non-line-of-sight imaging with arbitrary illumination and detection pattern
    Xintong Liu
    Jianyu Wang
    Leping Xiao
    Zuoqiang Shi
    Xing Fu
    Lingyun Qiu
    Nature Communications, 14
  • [2] Non-line-of-sight imaging
    Daniele Faccio
    Andreas Velten
    Gordon Wetzstein
    Nature Reviews Physics, 2020, 2 : 318 - 327
  • [3] Non-line-of-sight imaging
    Faccio, Daniele
    Velten, Andreas
    Wetzstein, Gordon
    NATURE REVIEWS PHYSICS, 2020, 2 (06) : 318 - 327
  • [4] Acoustic Non-Line-of-Sight Imaging
    Lindell, David B.
    Wetzstein, Gordon
    Koltun, Vladlen
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3773 - 6782
  • [5] Confocal Non-line-of-sight Imaging
    O'Toole, Matthew
    Lindell, David B.
    Wetzstein, Gordon
    SIGGRAPH'18: ACM SIGGRAPH 2018 TALKS, 2018,
  • [6] Thermal Non-Line-of-Sight Imaging
    Maeda, Tomohiro
    Wang, Yiqin
    Raskar, Ramesh
    Kadambi, Achuta
    2019 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY (ICCP), 2019,
  • [7] Polarized Non-Line-of-Sight Imaging
    Tanaka, Kenichiro
    Mukaigawa, Yasuhiro
    Kadambi, Achuta
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2133 - 2142
  • [8] Non-line-of-sight imaging with absorption backprojection
    Zhou, Hongyuan
    Zhang, Dejian
    Wang, Tongbiao
    Liao, Qinghua
    Yu, Tianbao
    APPLIED PHYSICS LETTERS, 2023, 123 (05)
  • [9] NLOST: Non-Line-of-Sight Imaging with Transformer
    Li, Yue
    Peng, Jiayong
    Ye, Juntian
    Zhang, Yueyi
    Xu, Feihu
    Xiong, Zhiwei
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 13313 - 13322
  • [10] Non-line-of-sight Imaging with Radio Signals
    He, Ying
    Zhang, Dongheng
    Hu, Yang
    Chen, Yan
    2020 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2020, : 11 - 16