Depth-Distilled Multi-Focus Image Fusion

被引:26
|
作者
Zhao, Fan [1 ]
Zhao, Wenda [2 ]
Lu, Huimin [3 ]
Liu, Yong [4 ]
Yao, Libo [5 ]
Liu, Yu [5 ]
机构
[1] Liaoning Normal Univ, Sch Phys & Elect Technol, Dalian 116029, Peoples R China
[2] Dalian Univ Technol, Key Lab Intelligent Control & Optimizat Ind Equipm, Minist Educ, Dalian 116024, Peoples R China
[3] Kyushu Inst Technol, Kyushu, Japan
[4] Acad Mil Sci, Natl Innovat Inst Def Technol, Beijing 100052, Peoples R China
[5] Naval Aviat Univ, Res Inst informat Fus, Yantai 264001, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Feature extraction; Lenses; Task analysis; Testing; Cameras; Adaptation models; Depth distillation; multi-focus image fusion; multi-level decision map fusion; ENHANCEMENT; TRANSFORM; FRAMEWORK; NETWORK;
D O I
10.1109/TMM.2021.3134565
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Homogeneous regions, which are smooth areas that lack blur clues to discriminate if they are focused or non-focused. Therefore, they bring a great challenge to achieve high accurate multi-focus image fusion (MFIF). Fortunately, we observe that depth maps are highly related to focus and defocus, containing a preponderance of discriminative power to locate homogeneous regions. This offers the potential to provide additional depth cues to assist MFIF task. Taking depth cues into consideration, in this paper, we propose a new depth-distilled multi-focus image fusion framework, namely D2MFIF. In D2MFIF, depth-distilled model (DDM) is designed for adaptively transferring the depth knowledge into MFIF task, gradually improving MFIF performance. Moreover, multi-level fusion mechanism is designed to integrate multi-level decision maps from intermediate outputs for improving the final prediction. Visually and quantitatively experimental results demonstrate the superiority of our method over several state-of-the-art methods.
引用
收藏
页码:966 / 978
页数:13
相关论文
共 50 条
  • [21] Compressive Sensing Multi-focus Image Fusion
    Cheng, Fang
    Yang, Bin
    Huang, Zhiwei
    PATTERN RECOGNITION (CCPR 2014), PT II, 2014, 484 : 107 - 116
  • [22] Survey on Multi-Focus Image Fusion Algorithms
    Garg, Rishu
    Gupta, Preeti
    Kaur, Harvinder
    2014 RECENT ADVANCES IN ENGINEERING AND COMPUTATIONAL SCIENCES (RAECS), 2014,
  • [23] A NOVEL METHOD FOR MULTI-FOCUS IMAGE FUSION
    Bilcu, Radu Ciprian
    Alenius, Sakari
    Vehvilainen, Markku
    2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, : 1525 - 1528
  • [24] Multi-focus image fusion based on NLEMD
    Jing, Zhao
    Bu, Xu
    Fei, Liu
    2008 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION AND LOGISTICS, VOLS 1-6, 2008, : 2266 - 2270
  • [25] A lightweight scheme for multi-focus image fusion
    Xin Jin
    Jingyu Hou
    Rencan Nie
    Shaowen Yao
    Dongming Zhou
    Qian Jiang
    Kangjian He
    Multimedia Tools and Applications, 2018, 77 : 23501 - 23527
  • [26] Multi-focus image fusion using PCNN
    Wang, Zhaobin
    Ma, Yide
    Gu, Jason
    PATTERN RECOGNITION, 2010, 43 (06) : 2003 - 2016
  • [27] Multi-focus image fusion techniques: a survey
    Shiveta Bhat
    Deepika Koundal
    Artificial Intelligence Review, 2021, 54 : 5735 - 5787
  • [28] A CRYSTALVIEW ON MULTI-FOCUS IMAGE FUSION METHODS
    Prasad, K. H. K.
    Babu, S. B. G. Tilak
    Krishna, R. V. V.
    2021 IEEE INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION, AND INTELLIGENT SYSTEMS (ICCCIS), 2021, : 669 - 674
  • [29] Multi-Focus Image Fusion of Digital Images
    Malviya, Anjali
    Bhirud, S. G.
    2009 INTERNATIONAL CONFERENCE ON ADVANCES IN RECENT TECHNOLOGIES IN COMMUNICATION AND COMPUTING (ARTCOM 2009), 2009, : 887 - +
  • [30] Ensemble of CNN for multi-focus image fusion
    Amin-Naji, Mostafa
    Aghagolzadeh, Ali
    Ezoji, Mehdi
    INFORMATION FUSION, 2019, 51 : 201 - 214