Non-Line-of-Sight Long-Wave Infrared Imaging based on Nestformer

被引:0
|
作者
Jin, Shaohui [1 ]
Zhao, Yayong [1 ]
Liu, Hao [1 ]
Wu, Jiaqi [1 ]
Yu, Zhenjie [1 ]
Xu, Mingliang [1 ]
机构
[1] Zhengzhou Univ, Sch Comp Artificial & Intelligence, Zhengzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
NLOS; Dual-Branch mechanism; Transformer; LWIR;
D O I
10.1109/CSCWD61410.2024.10580361
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Due to its portability, low cost, and unnoticed detection mode, passive non-line-of-sight (NLOS) imaging has garnered widespread attention in recent years. This technology reconstructs hidden objects beyond the direct line of sight by analyzing the diffuse reflection on a relay surface. However, issues such as scene complexity and interference from ambient light lead to suboptimal reconstruction results. Long-wave infrared (LWIR) imaging is more significantly affected by ambient temperature but less by illumination, resulting superior resistance to environmental light interference. Therefore, we conduct NLOS imaging experiments using an LWIR camera and propose a novel NLOS image reconstruction network called Nestformer. The feature extraction component of this network incorporates a Transformer-CNN dual-branch mechanism. This dual-branch mechanism includes a Base Transformer Module for capturing global features and a Spatial Channel Attention Module that focuses on extracting local information. Additionally, to enhance the robustness of our model, a combination of multiple loss functions is employed to optimize its feedback capability. Experimental results on our self-collected NLOS-LR dataset indicate that Nestformer outperforms current passive NLOS imaging methods in terms of reconstruction performance.
引用
收藏
页码:2758 / 2763
页数:6
相关论文
共 50 条
  • [41] Non-line-of-sight imaging using phasor-field virtual wave optics
    Xiaochun Liu
    Ibón Guillén
    Marco La Manna
    Ji Hyun Nam
    Syed Azer Reza
    Toan Huu Le
    Adrian Jarabo
    Diego Gutierrez
    Andreas Velten
    Nature, 2019, 572 : 620 - 623
  • [42] Non-line-of-sight imaging using phasor-field virtual wave optics
    Liu, Xiaochun
    Guillen, Ibon
    La Manna, Marco
    Nam, Ji Hyun
    Reza, Syed Azer
    Le, Toan Huu
    Jarabo, Adrian
    Gutierrez, Diego
    Velten, Andreas
    NATURE, 2019, 572 (7771) : 620 - +
  • [43] NON-LINE-OF-SIGHT ISAR IMAGING VIA MILLIMETER-WAVE AUTOMOTIVE RADAR
    Wen, Yanbo
    Wei, Shunjun
    Liu, Xinyuan
    Cai, Xiang
    Shi, Jun
    Zhang, Xiaoling
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 1229 - 1232
  • [44] Non-Line-of-Sight Radar
    Woolfson, Malcolm
    AERONAUTICAL JOURNAL, 2020, 124 (1282): : 2019 - 2020
  • [45] Fast non-line-of-sight imaging based on first photon event stamping
    Li, Zhupeng
    Liu, Xintong
    Wang, Jianyu
    Shi, Zuoqiang
    Qiu, Lingyun
    Fu, Xing
    OPTICS LETTERS, 2022, 47 (08) : 1928 - 1931
  • [46] Confocal non-line-of-sight imaging based on the light-cone transform
    O'Toole, Matthew
    Lindell, David B.
    Wetzstein, Gordon
    NATURE, 2018, 555 (7696) : 338 - 341
  • [47] Confocal non-line-of-sight imaging based on the light-cone transform
    Matthew O’Toole
    David B. Lindell
    Gordon Wetzstein
    Nature, 2018, 555 : 338 - 341
  • [48] Super-resolution non-line-of-sight imaging based on temporal encoding
    Miao, Jinye
    Guo, Enlai
    Shi, Yingjie
    Cai, Fuyao
    Bai, Lianfa
    Han, Jing
    OPTICS EXPRESS, 2023, 31 (24) : 40235 - 40248
  • [49] Fast non-line-of-sight imaging based on product-convolution expansions
    Xu, W. E. I. H. A. O.
    Chen, S. O. N. G. M. A. O.
    Tian, Y. U. Y. U. A. N.
    Wang, D. I. N. G. J. I. E.
    Su, X. I. U. Q. I. N.
    OPTICS LETTERS, 2022, 47 (18) : 4680 - 4683
  • [50] Non-line-of-sight imaging and tracking of moving objects based on deep learning
    He, JinHui
    Wu, ShuKong
    Wei, Ran
    Zhang, YuNing
    OPTICS EXPRESS, 2022, 30 (10) : 16758 - 16772