Non-Line-of-Sight Long-Wave Infrared Imaging based on Nestformer

被引:0
|
作者
Jin, Shaohui [1 ]
Zhao, Yayong [1 ]
Liu, Hao [1 ]
Wu, Jiaqi [1 ]
Yu, Zhenjie [1 ]
Xu, Mingliang [1 ]
机构
[1] Zhengzhou Univ, Sch Comp Artificial & Intelligence, Zhengzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
NLOS; Dual-Branch mechanism; Transformer; LWIR;
D O I
10.1109/CSCWD61410.2024.10580361
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Due to its portability, low cost, and unnoticed detection mode, passive non-line-of-sight (NLOS) imaging has garnered widespread attention in recent years. This technology reconstructs hidden objects beyond the direct line of sight by analyzing the diffuse reflection on a relay surface. However, issues such as scene complexity and interference from ambient light lead to suboptimal reconstruction results. Long-wave infrared (LWIR) imaging is more significantly affected by ambient temperature but less by illumination, resulting superior resistance to environmental light interference. Therefore, we conduct NLOS imaging experiments using an LWIR camera and propose a novel NLOS image reconstruction network called Nestformer. The feature extraction component of this network incorporates a Transformer-CNN dual-branch mechanism. This dual-branch mechanism includes a Base Transformer Module for capturing global features and a Spatial Channel Attention Module that focuses on extracting local information. Additionally, to enhance the robustness of our model, a combination of multiple loss functions is employed to optimize its feedback capability. Experimental results on our self-collected NLOS-LR dataset indicate that Nestformer outperforms current passive NLOS imaging methods in terms of reconstruction performance.
引用
收藏
页码:2758 / 2763
页数:6
相关论文
共 50 条
  • [1] Millimeter-wave non-line-of-sight imaging
    Li, Yuanji
    Ou, Zhan
    Li, Siming
    2022 IEEE 10TH ASIA-PACIFIC CONFERENCE ON ANTENNAS AND PROPAGATION, APCAP, 2022,
  • [2] Non-line-of-sight imaging
    Daniele Faccio
    Andreas Velten
    Gordon Wetzstein
    Nature Reviews Physics, 2020, 2 : 318 - 327
  • [3] Non-line-of-sight imaging
    Faccio, Daniele
    Velten, Andreas
    Wetzstein, Gordon
    NATURE REVIEWS PHYSICS, 2020, 2 (06) : 318 - 327
  • [4] Acoustic Non-Line-of-Sight Imaging
    Lindell, David B.
    Wetzstein, Gordon
    Koltun, Vladlen
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3773 - 6782
  • [5] Confocal Non-line-of-sight Imaging
    O'Toole, Matthew
    Lindell, David B.
    Wetzstein, Gordon
    SIGGRAPH'18: ACM SIGGRAPH 2018 TALKS, 2018,
  • [6] Thermal Non-Line-of-Sight Imaging
    Maeda, Tomohiro
    Wang, Yiqin
    Raskar, Ramesh
    Kadambi, Achuta
    2019 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY (ICCP), 2019,
  • [7] Polarized Non-Line-of-Sight Imaging
    Tanaka, Kenichiro
    Mukaigawa, Yasuhiro
    Kadambi, Achuta
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2133 - 2142
  • [8] PI-NLOS: polarized infrared non-line-of-sight imaging
    Liu, Hao
    Wang, Pengfei
    Chen, Mingyang
    Liu, Mengge
    Jiang, Xiaoheng
    Peng, Xin
    Xu, Mingliang
    OPTICS EXPRESS, 2023, 31 (26): : 44113 - 44126
  • [9] Non-line-of-sight imaging with absorption backprojection
    Zhou, Hongyuan
    Zhang, Dejian
    Wang, Tongbiao
    Liao, Qinghua
    Yu, Tianbao
    APPLIED PHYSICS LETTERS, 2023, 123 (05)
  • [10] Non-line-of-sight imaging based on Archimedean spiral scanning
    Zhang, Meiling
    Shi, Yaoyao
    Sheng, Wei
    Liu, Jiaqing
    Li, Jingwen
    Wei, Yang
    Wang, Bin
    Zhang, Dejin
    Liu, Youwen
    OPTICS COMMUNICATIONS, 2023, 537