Non-local affinity adaptive acceleration propagation network for generating dense depth maps from LiDAR

被引:0
|
作者
Zhang, Hanxuan [1 ]
Huo, Ju [1 ]
机构
[1] Harbin Inst Technol, Sch Elect Engn & Automat, Harbin 150000, Peoples R China
基金
中国国家自然科学基金;
关键词
COMPLETION; MODEL; NET;
D O I
10.1364/OE.492187
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Depth completion aims to generate dense depth maps from the sparse depth images generated by LiDAR. In this paper, we propose a non-local affinity adaptive accelerated (NL-3A) propagation network for depth completion to solve the mixing depth problem of different objects on the depth boundary. In the network, we design the NL-3A prediction layer to predict the initial dense depth maps and their reliability, non-local neighbors and affinities of each pixel, and learnable normalization factors. Compared with the traditional fixed-neighbor affinity refinement scheme, the non-local neighbors predicted by the network can overcome the propagation error problem of mixed depth objects. Subsequently, we combine the learnable normalized propagation of non-local neighbor affinity with pixel depth reliability in the NL-3A propagation layer, so that it can adaptively adjust the propagation weight of each neighbor during the propagation process, which enhances the robustness of the network. Finally, we design an accelerated propagation model. This model enables parallel propagation of all neighbor affinities and improves the efficiency of refining dense depth maps. Experiments on KITTI depth completion and NYU Depth V2 datasets show that our network is superior to most algorithms in terms of accuracy and efficiency of depth completion. In particular, we predict and reconstruct more smoothly and consistently at the pixel edges of different objects.
引用
收藏
页码:22012 / 22029
页数:18
相关论文
共 33 条
  • [21] DRCR Net: Dense Residual Channel Re-calibration Network with Non-local Purification for Spectral Super Resolution
    Li, Jiaojiao
    Du, Songcheng
    Wu, Chaoxiong
    Leng, Yihong
    Song, Rui
    Li, Yunsong
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 1258 - 1267
  • [22] Improving 360° Monocular Depth Estimation via Non-local Dense Prediction Transformer and Joint Supervised and Self-Supervised Learning
    Yun, Ilwi
    Lee, Hyuk-Jae
    Rhee, Chae Eun
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 3224 - 3233
  • [23] MNL-Network: A Multi-Scale Non-local Network for Epilepsy Detection From EEG Signals
    Zhang, Guokai
    Yang, Le
    Li, Boyang
    Lu, Yiwen
    Liu, Qinyuan
    Zhao, Wei
    Ren, Tianhe
    Zhou, Junsheng
    Wang, Shui-Hua
    Che, Wenliang
    FRONTIERS IN NEUROSCIENCE, 2020, 14
  • [24] A Hybrid Deep Learning Approach for Skin Cancer Classification Using Swin Transformer and Dense Group Shuffle Non-Local Attention Network
    Karthik, R.
    Menaka, R.
    Atre, Shivansh
    Cho, Jaehyuk
    Easwaramoorthy, Sathishkumar Veerappampalayam
    IEEE ACCESS, 2024, 12 : 158040 - 158051
  • [25] Noise adaptive super-resolution from single image via non-local mean and sparse representation
    Mandal, Srimanta
    Bhaysar, Arnav
    Sao, Anil Kumar
    SIGNAL PROCESSING, 2017, 132 : 134 - 149
  • [26] A Non-local adaptive network for cross-domain intelligent fault diagnosis leveraging multi-source IOT data
    Shao, Hanshu
    Tan, Yongwen
    Li, Jingbo
    Gao, Hengkai
    Yin, Huiying
    Gao, Hongli
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (04)
  • [27] DAN-Net: Dual-domain adaptive-scaling non-local network for CT metal artifact reduction
    Wang, Tao
    Xia, Wenjun
    Huang, Yongqiang
    Sun, Huaiqiang
    Liu, Yan
    Chen, Hu
    Zhou, Jiliu
    Zhang, Yi
    PHYSICS IN MEDICINE AND BIOLOGY, 2021, 66 (15):
  • [28] From local context-aware to non-local: A road extraction network via guidance of multi-spectral image
    Du, Yang
    Sheng, Qinghong
    Zhang, Weili
    Zhu, Chongrui
    Li, Jun
    Wang, Bo
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 203 : 230 - 245
  • [29] Deep Unfolding Network for Image Compressed Sensing by Content-Adaptive Gradient Updating and Deformation-Invariant Non-Local Modeling
    Cui, Wenxue
    Fan, Xiaopeng
    Zhang, Jian
    Zhao, Debin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 4012 - 4027
  • [30] From local to global: a multi-group feature enhancement network for non-uniform and dense haze removal
    Xiaotao Shao
    Yan Guo
    Yan Shen
    Manyi Qian
    Zhongli Wang
    Multimedia Tools and Applications, 2023, 82 : 27057 - 27073