Non-line-of-sight Imaging with Signal Superresolution Network

被引:9
|
作者
Wang, Jianyu [1 ]
Liu, Xintong [1 ]
Xiao, Leping [1 ]
Shi, Zuoqiang [1 ,2 ]
Qiu, Lingyun [1 ,2 ]
Fu, Xing [1 ]
机构
[1] Tsinghua Univ, Beijing, Peoples R China
[2] Yanqi Lake Beijing Inst Math Sci & Applicat, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR52729.2023.01671
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Non-line-of-sight (NLOS) imaging aims at reconstructing the location, shape, albedo, and surface normal of the hidden object around the corner with measured transient data. Due to its strong potential in various fields, it has drawn much attention in recent years. However, long exposure time is not always available for applications such as auto-driving, which hinders the practical use of NLOS imaging. Although scanning fewer points can reduce the total measurement time, it also brings the problem of imaging quality degradation. This paper proposes a general learning-based pipeline for increasing imaging quality with only a few scanning points. We tailor a neural network to learn the operator that recovers a high spatial resolution signal. Experiments on synthetic and measured data indicate that the proposed method provides faithful reconstructions of the hidden scene under both confocal and non-confocal settings. Compared with original measurements, the acquisition of our approach is 16 times faster while maintaining similar reconstruction quality. Besides, the proposed pipeline can be applied directly to existing optical systems and imaging algorithms as a plug-in-and-play module. We believe the proposed pipeline is powerful in increasing the frame rate in NLOS video imaging.
引用
收藏
页码:17420 / 17429
页数:10
相关论文
共 50 条
  • [31] Steady-state Non-Line-of-Sight Imaging
    Chen, Wenzheng
    Daneau, Simon
    Mannan, Fahim
    Heide, Felix
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3783 - 6792
  • [32] Non-line-of-sight imaging with adaptive artifact cancellation
    Zhou, Hongyuan
    Chen, Ziyang
    Qiu, Jumin
    Zhong, Sijia
    Zhang, Dejian
    Wang, Tongbiao
    Liu, Qiegen
    Yu, Tianbao
    OPTICS AND LASER TECHNOLOGY, 2025, 182
  • [33] Progress and prospect of non-line-of-sight imaging (invited)
    Jin X.
    Du D.
    Deng R.
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2022, 51 (08):
  • [34] Seeing around corners non-line-of-sight imaging
    Faccio D.
    Optics and Photonics News, 2019, 30 (01): : 36 - 43
  • [35] Coherent Control of Light for Non-Line-of-Sight Imaging
    Starshynov, Ilya
    Ghafur, Omair
    Fitches, James
    Faccio, Daniele
    PHYSICAL REVIEW APPLIED, 2019, 12 (06)
  • [36] Non-Line-of-Sight Detection Based on TOA and Signal Strength
    Yu, Kegen
    Guo, Y. Jay
    2008 IEEE 19TH INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, 2008, : 425 - 429
  • [37] Non-line-of-sight reconstruction with signal–object collaborative regularization
    Xintong Liu
    Jianyu Wang
    Zhupeng Li
    Zuoqiang Shi
    Xing Fu
    Lingyun Qiu
    Light: Science & Applications, 10
  • [38] Non-Line-of-Sight Radar
    Woolfson, Malcolm
    AERONAUTICAL JOURNAL, 2020, 124 (1282): : 2019 - 2020
  • [39] Few-shot Non-line-of-sight Imaging with Signal-surface Collaborative Regularization
    Liu, Xintong
    Wang, Jianyu
    Xiao, Leping
    Fu, Xing
    Qiu, Lingyun
    Shi, Zuoqiang
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 13303 - 13312
  • [40] Convolutional Approximations to the General Non-Line-of-Sight Imaging Operator
    Ahn, Byeongjoo
    Dave, Akshat
    Veeraraghavan, Ashok
    Gkioulekas, Ioannis
    Sankaranarayanan, Aswin C.
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 7888 - 7898