MHFNet: An Improved HGR Multimodal Network for Informative Correlation Fusion in Remote Sensing Image Classification

被引:1
|
作者
Zhang, Hongkang [1 ]
Huang, Shao-Lun [1 ]
Kuruoglu, Ercan Engin [1 ]
机构
[1] Tsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Shenzhen 518055, Peoples R China
基金
国家重点研发计划;
关键词
Feature extraction; Convolutional neural networks; Remote sensing; Correlation; Laser radar; Data models; Synthetic aperture radar; Data sparsity; HGR maximal correlation; multimodal fusion; remote sensing image classification; LIDAR;
D O I
10.1109/JSTARS.2024.3448430
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the realm of urban development, the precise classification and identification of land types are crucial for improving land use efficiency. This article proposes a land recognition and classification method based on data sparsity and improved Soft Hirschfeld-Gebelein-R & eacute;nyi (Soft-HGR) under multimodal conditions. First, a sparse information processing module is designed to enhance information accuracy and quickly obtain data sample features. Then, to solve the problem of information independence in single mode and lack of fusion in multimodal mode, an improved SoftHGR module is developed. This module incorporates covariance and trace constraints, enhances machine learning efficiency by stabilizing output and addressing dimensionality and variance issues in HGR, and speeds up land classification by cross-fusing multimodal features to deepen the understanding of diverse information interconnections. Based on this, a multimodal MI-SoftHGR fusion network is constructed, which can achieve cross-correlation sharing and collaborative extraction of feature information, thereby realizing accurate remote sensing image recognition and classification under multimodal conditions. Finally, empirical evaluations were conducted on Berlin, Augsburg, and MUUFL datasets, and the proposed method was compared with state-of-the-art algorithms. The results fully validate the efficacy and significant superiority of the proposed method.
引用
收藏
页码:15052 / 15066
页数:15
相关论文
共 50 条
  • [21] Multiloss Adversarial Attacks for Multimodal Remote Sensing Image Classification
    Hu, Qi
    Shen, Zhidong
    Sha, Zongyao
    Tan, Weijie
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 13
  • [22] A Shallow-to-Deep Feature Fusion Network for VHR Remote Sensing Image Classification
    Liu, Sicong
    Zheng, Yongjie
    Du, Qian
    Bruzzone, Lorenzo
    Samat, Alim
    Tong, Xiaohua
    Jin, Yanmin
    Wang, Chao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [23] MHFNet: A Multimodal Hybrid-embedding Fusion Network for Automatic Sleep Staging
    Liu, Ruhan
    Li, Jiajia
    Wen, Yang
    Huang, Xian
    Sheng, Bin
    Feng, David Dagan
    Zhang, Ping
    IEEE Journal of Biomedical and Health Informatics,
  • [24] Deep Symmetric Fusion Transformer for Multimodal Remote Sensing Data Classification
    Chang, Honghao
    Bi, Haixia
    Li, Fan
    Xu, Chen
    Chanussot, Jocelyn
    Hong, Danfeng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [25] Remote sensing image classification method based on improved ShuffleNet convolutional neural network
    Li, Ziqi
    Su, Yuxuan
    Zhang, Yonghong
    Yin, Hefeng
    Sun, Jun
    Wu, Xiaojun
    INTELLIGENT DATA ANALYSIS, 2024, 28 (02) : 397 - 414
  • [26] Remote Sensing Image Fusion with Convolutional Neural Network
    Zhong J.
    Yang B.
    Huang G.
    Zhong F.
    Chen Z.
    Sensing and Imaging, 2016, 17 (1):
  • [27] Improved Subspace Classification Method for Multispectral Remote Sensing Image Classification
    Bagan, Hasi
    Yamagata, Yoshiki
    PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2010, 76 (11): : 1239 - 1251
  • [28] Remote sensing image classification using subspace sensor fusion
    Rasti, Behnood
    Ghamisi, Pedram
    INFORMATION FUSION, 2020, 64 : 121 - 130
  • [29] Fusion of Global and Local Descriptors for Remote Sensing Image Classification
    Risojevic, Vladimir
    Babic, Zdenka
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2013, 10 (04) : 836 - 840
  • [30] Remote Sensing Image Scene Classification Based on Fusion Method
    Yin, Liancheng
    Yang, Peiyi
    Mao, Keming
    Liu, Qian
    JOURNAL OF SENSORS, 2021, 2021