Interactive Feature Embedding for Infrared and Visible Image Fusion

被引:8
|
作者
Zhao, Fan [1 ]
Zhao, Wenda [2 ,3 ]
Lu, Huchuan [2 ,3 ]
机构
[1] Liaoning Normal Univ, Sch Phys & Elect Technol, Dalian 116029, Peoples R China
[2] Dalian Univ Technol, Key Lab Intelligent Control & Optimizat Ind Equipm, Minist Educ, Dalian 116024, Peoples R China
[3] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian 116024, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Image fusion; Task analysis; Image reconstruction; Fuses; Self-supervised learning; Data mining; Hierarchical representations; infrared and visible image fusion; interactive feature embedding; self-supervised learning; MULTI-FOCUS; SPARSE REPRESENTATION; SHEARLET TRANSFORM; DECOMPOSITION; ENHANCEMENT; INFORMATION; FRAMEWORK;
D O I
10.1109/TNNLS.2023.3264911
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
General deep learning-based methods for infrared and visible image fusion rely on the unsupervised mechanism for vital information retention by utilizing elaborately designed loss functions. However, the unsupervised mechanism depends on a well-designed loss function, which cannot guarantee that all vital information of source images is sufficiently extracted. In this work, we propose a novel interactive feature embedding in a self-supervised learning framework for infrared and visible image fusion, attempting to overcome the issue of vital information degradation. With the help of a self-supervised learning framework, hierarchical representations of source images can be efficiently extracted. In particular, interactive feature embedding models are tactfully designed to build a bridge between self-supervised learning and infrared and visible image fusion learning, achieving vital information retention. Qualitative and quantitative evaluations exhibit that the proposed method performs favorably against state-of-the-art methods.
引用
收藏
页码:12810 / 12822
页数:13
相关论文
共 50 条
  • [31] Infrared and Visible Image Fusion via Interactive Compensatory Attention Adversarial Learning
    Wang, Zhishe
    Shao, Wenyu
    Chen, Yanlin
    Xu, Jiawei
    Zhang, Xiaoqin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 7800 - 7813
  • [32] Infrared and Visible Image Fusion Method via Interactive Self-attention
    Yang Fan
    Wang Zhishe
    Sun Jing
    Yu Zhaofa
    ACTA PHOTONICA SINICA, 2024, 53 (06)
  • [33] AITFuse: Infrared and visible image fusion via adaptive interactive transformer learning
    Wang, Zhishe
    Yang, Fan
    Sun, Jing
    Xu, Jiawei
    Yang, Fengbao
    Yan, Xiaomei
    KNOWLEDGE-BASED SYSTEMS, 2024, 299
  • [34] AFSFusion: An Adjacent Feature Shuffle Combination Network for Infrared and Visible Image Fusion
    Hu, Yufeng
    Xu, Shaoping
    Cheng, Xiaohui
    Zhou, Changfei
    Xiong, Minghai
    APPLIED SCIENCES-BASEL, 2023, 13 (09):
  • [35] Infrared and Visible Image Fusion Based on Multiclassification Adversarial Mechanism in Feature Space
    Zhang H.
    Ma J.
    Fan F.
    Huang J.
    Ma Y.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2023, 60 (03): : 690 - 704
  • [36] Feature dynamic alignment and refinement for infrared-visible image fusion: Translation robust fusion
    Li, Huafeng
    Zhao, Junzhi
    Li, Jinxing
    Yu, Zhengtao
    Lu, Guangming
    INFORMATION FUSION, 2023, 95 : 26 - 41
  • [37] A three-dimensional feature-based fusion strategy for infrared and visible image fusion
    Liu, Xiaowen
    Huo, Hongtao
    Yang, Xin
    Li, Jing
    PATTERN RECOGNITION, 2025, 157
  • [38] An infrared and visible image fusion method based on deep convolutional feature extraction
    Pang Z.-X.
    Liu G.-H.
    Chen C.-M.
    Liu H.-T.
    Kongzhi yu Juece/Control and Decision, 2024, 39 (03): : 910 - 918
  • [39] Infrared and visible image fusion based on contrast enhancement guided filter and infrared feature decomposition
    Zhang, Bozhi
    Gao, Meijing
    Chen, Pan
    Shang, Yucheng
    Li, Shiyu
    Bai, Yang
    Liao, Hongping
    Liu, Zehao
    Li, Zhilong
    INFRARED PHYSICS & TECHNOLOGY, 2022, 127
  • [40] Infrared and visible image fusion based on variational auto-encoder and infrared feature compensation
    Ren, Long
    Pan, Zhibin
    Cao, Jianzhong
    Liao, Jiawen
    INFRARED PHYSICS & TECHNOLOGY, 2021, 117