Non-Line-of-Sight Long-Wave Infrared Imaging based on Nestformer

被引:0
|
作者
Jin, Shaohui [1 ]
Zhao, Yayong [1 ]
Liu, Hao [1 ]
Wu, Jiaqi [1 ]
Yu, Zhenjie [1 ]
Xu, Mingliang [1 ]
机构
[1] Zhengzhou Univ, Sch Comp Artificial & Intelligence, Zhengzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
NLOS; Dual-Branch mechanism; Transformer; LWIR;
D O I
10.1109/CSCWD61410.2024.10580361
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Due to its portability, low cost, and unnoticed detection mode, passive non-line-of-sight (NLOS) imaging has garnered widespread attention in recent years. This technology reconstructs hidden objects beyond the direct line of sight by analyzing the diffuse reflection on a relay surface. However, issues such as scene complexity and interference from ambient light lead to suboptimal reconstruction results. Long-wave infrared (LWIR) imaging is more significantly affected by ambient temperature but less by illumination, resulting superior resistance to environmental light interference. Therefore, we conduct NLOS imaging experiments using an LWIR camera and propose a novel NLOS image reconstruction network called Nestformer. The feature extraction component of this network incorporates a Transformer-CNN dual-branch mechanism. This dual-branch mechanism includes a Base Transformer Module for capturing global features and a Spatial Channel Attention Module that focuses on extracting local information. Additionally, to enhance the robustness of our model, a combination of multiple loss functions is employed to optimize its feedback capability. Experimental results on our self-collected NLOS-LR dataset indicate that Nestformer outperforms current passive NLOS imaging methods in terms of reconstruction performance.
引用
收藏
页码:2758 / 2763
页数:6
相关论文
共 50 条
  • [31] Deep Non-Line-of-Sight Imaging Using Echolocation
    Jang, Seungwoo
    Shin, Ui-Hyeon
    Kim, Kwangsu
    SENSORS, 2022, 22 (21)
  • [32] Non-line-of-sight imaging over 1.43 km
    Wu, Cheng
    Liu, Jianjiang
    Huang, Xin
    Li, Zheng-Ping
    Yu, Chao
    Ye, Jun-Tian
    Zhang, Jun
    Zhang, Qiang
    Dou, Xiankang
    Goyal, Vivek K.
    Xu, Feihu
    Pan, Jian-Wei
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2021, 118 (10)
  • [33] Non-line-of-sight imaging with adaptive artifact cancellation
    Zhou, Hongyuan
    Chen, Ziyang
    Qiu, Jumin
    Zhong, Sijia
    Zhang, Dejian
    Wang, Tongbiao
    Liu, Qiegen
    Yu, Tianbao
    OPTICS AND LASER TECHNOLOGY, 2025, 182
  • [34] Steady-state Non-Line-of-Sight Imaging
    Chen, Wenzheng
    Daneau, Simon
    Mannan, Fahim
    Heide, Felix
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3783 - 6792
  • [35] Photon-Efficient Non-Line-of-Sight Imaging
    Liu, Jianjiang
    Zhou, Yijun
    Huang, Xin
    Li, Zheng-Ping
    Xu, Feihu
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2022, 8 : 639 - 650
  • [36] Seeing around corners non-line-of-sight imaging
    Faccio D.
    Optics and Photonics News, 2019, 30 (01): : 36 - 43
  • [37] Progress and prospect of non-line-of-sight imaging (invited)
    Jin X.
    Du D.
    Deng R.
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2022, 51 (08):
  • [38] Coherent Control of Light for Non-Line-of-Sight Imaging
    Starshynov, Ilya
    Ghafur, Omair
    Fitches, James
    Faccio, Daniele
    PHYSICAL REVIEW APPLIED, 2019, 12 (06)
  • [39] The infrared laser atmosphere scattering communication study based on "Non-line-of-sight"
    Yang Ze-hou
    Fan Dong
    Li Xiao-feng
    Chen Yong
    Feng Zhen-zhong
    Sheng Kai-xiang
    Tao Gang
    Zhou Ding-fu
    Hou Tian-jin
    INTERNATIONAL SYMPOSIUM ON PHOTOELECTRONIC DETECTION AND IMAGING 2013: LASER COMMUNICATION TECHNOLOGIES AND SYSTEMS, 2013, 8906
  • [40] Non-line-of-sight tracking of people at long range
    Chan, Susan
    Warburton, Ryan E.
    Gariepy, Genevieve
    Leach, Jonathan
    Faccio, Daniele
    OPTICS EXPRESS, 2017, 25 (09): : 10109 - 10117