Non-Line-of-Sight Long-Wave Infrared Imaging based on Nestformer

被引:0
|
作者
Jin, Shaohui [1 ]
Zhao, Yayong [1 ]
Liu, Hao [1 ]
Wu, Jiaqi [1 ]
Yu, Zhenjie [1 ]
Xu, Mingliang [1 ]
机构
[1] Zhengzhou Univ, Sch Comp Artificial & Intelligence, Zhengzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
NLOS; Dual-Branch mechanism; Transformer; LWIR;
D O I
10.1109/CSCWD61410.2024.10580361
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Due to its portability, low cost, and unnoticed detection mode, passive non-line-of-sight (NLOS) imaging has garnered widespread attention in recent years. This technology reconstructs hidden objects beyond the direct line of sight by analyzing the diffuse reflection on a relay surface. However, issues such as scene complexity and interference from ambient light lead to suboptimal reconstruction results. Long-wave infrared (LWIR) imaging is more significantly affected by ambient temperature but less by illumination, resulting superior resistance to environmental light interference. Therefore, we conduct NLOS imaging experiments using an LWIR camera and propose a novel NLOS image reconstruction network called Nestformer. The feature extraction component of this network incorporates a Transformer-CNN dual-branch mechanism. This dual-branch mechanism includes a Base Transformer Module for capturing global features and a Spatial Channel Attention Module that focuses on extracting local information. Additionally, to enhance the robustness of our model, a combination of multiple loss functions is employed to optimize its feedback capability. Experimental results on our self-collected NLOS-LR dataset indicate that Nestformer outperforms current passive NLOS imaging methods in terms of reconstruction performance.
引用
收藏
页码:2758 / 2763
页数:6
相关论文
共 50 条
  • [21] Domain Reduction Strategy for Non-Line-of-Sight Imaging
    Shim, Hyunbo
    Cho, In
    Kwon, Daekyu
    Kim, Seon Joo
    COMPUTER VISION - ECCV 2024, PT XXXI, 2025, 15089 : 75 - 92
  • [22] Real-time Non-line-of-sight Imaging
    O'Toole, Matthew
    Lindell, David B.
    Wetzstein, Gordon
    SIGGRAPH'18: ACM SIGGRAPH 2018 EMERGING TECHNOLOGIES, 2018,
  • [23] Non-Line-of-Sight Imaging Through Deep Learning
    Yu T.
    Qiao M.
    Liu H.
    Han S.
    Guangxue Xuebao/Acta Optica Sinica, 2019, 39 (07):
  • [24] Non-Line-of-Sight Imaging Through Deep Learning
    Yu Tingyi
    Qiao Mu
    Liu Honglin
    Han Shensheng
    ACTA OPTICA SINICA, 2019, 39 (07)
  • [25] Non-line-of-sight Imaging with Signal Superresolution Network
    Wang, Jianyu
    Liu, Xintong
    Xiao, Leping
    Shi, Zuoqiang
    Qiu, Lingyun
    Fu, Xing
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 17420 - 17429
  • [26] Compressive Non-Line-of-Sight Imaging with Deep Learning
    Zhu, Shenyu
    Sua, Yong Meng
    Bu, Ting
    Huang, Yu -Ping
    PHYSICAL REVIEW APPLIED, 2023, 19 (03)
  • [27] Exploiting Occlusion in Non-Line-of-Sight Active Imaging
    Thrampoulidis, Christos
    Shulkind, Gal
    Xu, Feihu
    Freeman, William T.
    Shapiro, Jeffrey H.
    Torralba, Antonio
    Wong, Franco N. C.
    Wornell, Gregory W.
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2018, 4 (03): : 419 - 431
  • [28] Wave-Based Non-Line-of-Sight Imaging using Fast f-k Migration
    Lindell, David B.
    Wetzstein, Gordon
    O'Toole, Matthew
    ACM TRANSACTIONS ON GRAPHICS, 2019, 38 (04):
  • [29] Calibration scheme for non-line-of-sight imaging setups
    Klein, Jonathan
    Laurenzis, Martin
    Hullin, Matthias B.
    Iseringhausen, Julian
    OPTICS EXPRESS, 2020, 28 (19): : 28324 - 28342
  • [30] Non-Line-of-Sight Imaging with Picosecond Temporal Resolution
    Wang, Bin
    Zheng, Ming-Yang
    Han, Jin-Jian
    Huang, Xin
    Xie, Xiu-Ping
    Xu, Feihu
    Zhang, Qiang
    Pan, Jian-Wei
    PHYSICAL REVIEW LETTERS, 2021, 127 (05)