MHFNet: An Improved HGR Multimodal Network for Informative Correlation Fusion in Remote Sensing Image Classification

被引:1
|
作者
Zhang, Hongkang [1 ]
Huang, Shao-Lun [1 ]
Kuruoglu, Ercan Engin [1 ]
机构
[1] Tsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Shenzhen 518055, Peoples R China
基金
国家重点研发计划;
关键词
Feature extraction; Convolutional neural networks; Remote sensing; Correlation; Laser radar; Data models; Synthetic aperture radar; Data sparsity; HGR maximal correlation; multimodal fusion; remote sensing image classification; LIDAR;
D O I
10.1109/JSTARS.2024.3448430
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the realm of urban development, the precise classification and identification of land types are crucial for improving land use efficiency. This article proposes a land recognition and classification method based on data sparsity and improved Soft Hirschfeld-Gebelein-R & eacute;nyi (Soft-HGR) under multimodal conditions. First, a sparse information processing module is designed to enhance information accuracy and quickly obtain data sample features. Then, to solve the problem of information independence in single mode and lack of fusion in multimodal mode, an improved SoftHGR module is developed. This module incorporates covariance and trace constraints, enhances machine learning efficiency by stabilizing output and addressing dimensionality and variance issues in HGR, and speeds up land classification by cross-fusing multimodal features to deepen the understanding of diverse information interconnections. Based on this, a multimodal MI-SoftHGR fusion network is constructed, which can achieve cross-correlation sharing and collaborative extraction of feature information, thereby realizing accurate remote sensing image recognition and classification under multimodal conditions. Finally, empirical evaluations were conducted on Berlin, Augsburg, and MUUFL datasets, and the proposed method was compared with state-of-the-art algorithms. The results fully validate the efficacy and significant superiority of the proposed method.
引用
收藏
页码:15052 / 15066
页数:15
相关论文
共 50 条
  • [1] HGR Correlation Pooling Fusion Framework for Recognition and Classification in Multimodal Remote Sensing Data
    Zhang, Hongkang
    Huang, Shao-Lun
    Kuruoglu, Ercan Engin
    REMOTE SENSING, 2024, 16 (10)
  • [2] Multimodal Fusion Transformer for Remote Sensing Image Classification
    Roy, Swalpa Kumar
    Deria, Ankur
    Hong, Danfeng
    Rasti, Behnood
    Plaza, Antonio
    Chanussot, Jocelyn
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [3] IFF-Net: Irregular Feature Fusion Network for Multimodal Remote Sensing Image Classification
    Wang, Huiqing
    Wang, Huajun
    Wu, Linfeng
    APPLIED SCIENCES-BASEL, 2024, 14 (12):
  • [4] A multimodal hyper-fusion transformer for remote sensing image classification
    Ma, Mengru
    Ma, Wenping
    Jiao, Licheng
    Liu, Xu
    Li, Lingling
    Feng, Zhixi
    Liu, Fang
    Yang, Shuyuan
    INFORMATION FUSION, 2023, 96 : 66 - 79
  • [5] Scale Adaptive Fusion Network for Multimodal Remote Sensing Data Classification
    Liu, Xiaomin
    Yu, Mengjun
    Qiao, Zhenzhuang
    Wang, Haoyu
    Xing, Changda
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2024, 46 (09): : 3693 - 3702
  • [6] Remote Sensing Image Semantic Segmentation Network Based on Multimodal Fusion
    Hu, Yuxiang
    Yu, Changhong
    Gao, Ming
    Computer Engineering and Applications, 60 (15): : 234 - 242
  • [7] An improved neural network algorithm for remote sensing image classification
    Zhao L.
    Zhao, Liang, 2020, North Atlantic University Union NAUN (14): : 1034 - 1039
  • [8] Improved convolutional neural network in remote sensing image classification
    Binghui Xu
    Neural Computing and Applications, 2021, 33 : 8169 - 8180
  • [9] Improved convolutional neural network in remote sensing image classification
    Xu, Binghui
    NEURAL COMPUTING & APPLICATIONS, 2021, 33 (14): : 8169 - 8180
  • [10] Heterogeneous feature learning network for multimodal remote sensing image collaborative classification
    Yu, Xuchu
    Xue, Zhixiang
    Yang, Guopeng
    Yu, Anzhu
    Liu, Bing
    Hu, Qingfeng
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2024, 45 (15) : 4983 - 5007