Non-line-of-sight Imaging with Signal Superresolution Network

被引:9
|
作者
Wang, Jianyu [1 ]
Liu, Xintong [1 ]
Xiao, Leping [1 ]
Shi, Zuoqiang [1 ,2 ]
Qiu, Lingyun [1 ,2 ]
Fu, Xing [1 ]
机构
[1] Tsinghua Univ, Beijing, Peoples R China
[2] Yanqi Lake Beijing Inst Math Sci & Applicat, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR52729.2023.01671
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Non-line-of-sight (NLOS) imaging aims at reconstructing the location, shape, albedo, and surface normal of the hidden object around the corner with measured transient data. Due to its strong potential in various fields, it has drawn much attention in recent years. However, long exposure time is not always available for applications such as auto-driving, which hinders the practical use of NLOS imaging. Although scanning fewer points can reduce the total measurement time, it also brings the problem of imaging quality degradation. This paper proposes a general learning-based pipeline for increasing imaging quality with only a few scanning points. We tailor a neural network to learn the operator that recovers a high spatial resolution signal. Experiments on synthetic and measured data indicate that the proposed method provides faithful reconstructions of the hidden scene under both confocal and non-confocal settings. Compared with original measurements, the acquisition of our approach is 16 times faster while maintaining similar reconstruction quality. Besides, the proposed pipeline can be applied directly to existing optical systems and imaging algorithms as a plug-in-and-play module. We believe the proposed pipeline is powerful in increasing the frame rate in NLOS video imaging.
引用
收藏
页码:17420 / 17429
页数:10
相关论文
共 50 条
  • [1] Non-line-of-sight imaging
    Daniele Faccio
    Andreas Velten
    Gordon Wetzstein
    Nature Reviews Physics, 2020, 2 : 318 - 327
  • [2] Non-line-of-sight imaging
    Faccio, Daniele
    Velten, Andreas
    Wetzstein, Gordon
    NATURE REVIEWS PHYSICS, 2020, 2 (06) : 318 - 327
  • [3] Acoustic Non-Line-of-Sight Imaging
    Lindell, David B.
    Wetzstein, Gordon
    Koltun, Vladlen
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3773 - 6782
  • [4] Confocal Non-line-of-sight Imaging
    O'Toole, Matthew
    Lindell, David B.
    Wetzstein, Gordon
    SIGGRAPH'18: ACM SIGGRAPH 2018 TALKS, 2018,
  • [5] Thermal Non-Line-of-Sight Imaging
    Maeda, Tomohiro
    Wang, Yiqin
    Raskar, Ramesh
    Kadambi, Achuta
    2019 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY (ICCP), 2019,
  • [6] Polarized Non-Line-of-Sight Imaging
    Tanaka, Kenichiro
    Mukaigawa, Yasuhiro
    Kadambi, Achuta
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2133 - 2142
  • [7] Non-line-of-sight imaging based on an untrained deep decoder network
    Wu, Huazheng
    Liu, Shoupei
    Meng, Xiangfeng
    Yang, Xiulun
    Yin, Yongkai
    OPTICS LETTERS, 2022, 47 (19) : 5056 - 5059
  • [8] Non-line-of-sight imaging with absorption backprojection
    Zhou, Hongyuan
    Zhang, Dejian
    Wang, Tongbiao
    Liao, Qinghua
    Yu, Tianbao
    APPLIED PHYSICS LETTERS, 2023, 123 (05)
  • [9] NLOST: Non-Line-of-Sight Imaging with Transformer
    Li, Yue
    Peng, Jiayong
    Ye, Juntian
    Zhang, Yueyi
    Xu, Feihu
    Xiong, Zhiwei
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 13313 - 13322
  • [10] Non-line-of-sight Imaging with Radio Signals
    He, Ying
    Zhang, Dongheng
    Hu, Yang
    Chen, Yan
    2020 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2020, : 11 - 16