Defocus blur detection via adaptive cross-level feature fusion and refinement

被引:1
|
作者
Zhao, Zijian [1 ,2 ]
Yang, Hang [1 ]
Liu, Peiyu [3 ]
Nie, Haitao [1 ]
Zhang, Zhongbo [4 ]
Li, Chunyu [1 ]
机构
[1] Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] AVIC Shenyang Aircraft Design & Res Inst, Shenyang 110087, Peoples R China
[4] Jilin Univ, Changchun 130012, Peoples R China
来源
VISUAL COMPUTER | 2024年 / 40卷 / 11期
关键词
Defocus blur detection; Homogeneous region; Adaptive cross-level feature fusion;
D O I
10.1007/s00371-023-03229-7
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Convolutional neural networks have achieved competitive performance in defocus blur detection (DBD). However, due to the different receptive fields of different convolutional layers, there are distinct differences in the features generated by these layers, and the complementary information between cross-level features cannot be fully utilized. Besides, there are still challenges to be solved in homogeneous regions. To tackle the above issues, we focus on both homogeneous region dataset augmentation and model design to propose a novel DBD model based on adaptive cross-level feature fusion and refinement. Specifically, in terms of homogeneous region dataset enhancement, a Laplace filter is used to extract the homogeneous region image patch of the training image to realize homogeneous region image augmentation, which improves the robustness of the model for DBD in the homogeneous region; in terms of model design, we propose an adaptive fusion mechanism with self-learning weights and design the adaptive cross-level feature fusion module, which adaptively discriminates between different levels of features and fuses them step-by-step. In addition, we design the cross-level feature refinement module and embed it into the network, which captures the complementary information of the cross-level features, and refines cross-level feature information from coarse to fine in the decoder stage. Experimental results on two commonly used datasets show that the proposed method outperforms 13 state-of-the-art approaches.
引用
收藏
页码:8141 / 8153
页数:13
相关论文
共 50 条
  • [41] SiamX: An Efficient Long-term Tracker Using Cross-level Feature Correlation and Adaptive Tracking Scheme
    Huang, Huajian
    Yeung, Sai-Kit
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022,
  • [42] Feature fusion and weight adaptive updating based motion blur object tracking
    Wang G.-L.
    Tian J.
    Zhu W.-J.
    Fang D.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2019, 27 (05): : 1158 - 1166
  • [43] Unsupervised Feature earning by Cross-Level Instance-Group Discrimination
    Wang, Xudong
    Liu, Ziwei
    Yu, Stella X.
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12581 - 12590
  • [44] Cross-Level Context Fusion Network for Polyp Segmentation in Colonoscopy Images
    Cai, Duanfang
    Zhan, Kongcai
    Tan, Youguo
    Chen, Xiaoyan
    Luo, Heng
    Li, Guangyu
    IEEE ACCESS, 2024, 12 : 35366 - 35377
  • [45] Automatic crack defect detection via multiscale feature aggregation and adaptive fusion
    Huang, Hanyun
    Ma, Mingyang
    Bai, Suli
    Yang, Lei
    Liu, Yanhong
    AUTOMATION IN CONSTRUCTION, 2025, 170
  • [46] Scene Text Detection via Deep Semantic Feature Fusion and Attention-based Refinement
    Song, Yu
    Cui, Yuanshun
    Han, Hu
    Shan, Shiguang
    Chen, Xilin
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 3747 - 3752
  • [47] Detecting camouflaged objects via cross-level context supplement
    Zhang, Qing
    Yan, Weiqi
    Zhao, Rui
    Shi, Yanjiao
    Zeng, Jian
    APPLIED INTELLIGENCE, 2024, 54 (20) : 9685 - 9705
  • [48] Small Object Detection by DETR via Information Augmentation and Adaptive Feature Fusion
    Huang, Ji
    Li, Tianrui
    PROCEEDINGS OF 2024 ACM ICMR WORKSHOP ON MULTIMODAL VIDEO RETRIEVAL, ICMR-MVR 2024, 2024, : 39 - 44
  • [49] Defocus Blur Detection via Multi-Stream Bottom-Top-Bottom Network
    Zhao, Wenda
    Zhao, Fan
    Wang, Dong
    Lu, Huchuan
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (08) : 1884 - 1897
  • [50] Msu-mamba: multi-scale defocus blur detection using cross-scale fusion and state-space models
    Wang, Xijun
    Zhou, Xin
    Wang, Yi
    Zeng, Songto
    Liu, Xinyu
    Shen, Haobo
    Fei, Song
    Zhu, Lei
    VISUAL COMPUTER, 2025,