Multi-Feature Enhanced Building Change Detection Based on Semantic Information Guidance

被引:13
|
作者
Xue, Junkang [1 ]
Xu, Hao [2 ]
Yang, Hui [1 ,3 ,4 ,5 ]
Wang, Biao [1 ,3 ]
Wu, Penghai [1 ,3 ]
Choi, Jaewan [6 ]
Cai, Lixiao [7 ]
Wu, Yanlan [1 ,3 ]
机构
[1] Anhui Univ, Sch Resources & Environm Engn, Hefei 230601, Peoples R China
[2] Inst Spacecraft Syst Engn, Beijing 100094, Peoples R China
[3] Informat Mat & Intelligent Sensing Lab Anhui Prov, Hefei 230601, Peoples R China
[4] Anhui Univ, Inst Phys Sci, Hefei 230601, Peoples R China
[5] Anhui Univ, Inst Informat Technol, Hefei 230601, Peoples R China
[6] Chungbuk Natl Univ, Sch Civil Engn, Chungju 28644, South Korea
[7] Shandong Jianzhu Univ, Sch Design Grp, Jinan 250101, Peoples R China
基金
中国国家自然科学基金;
关键词
remote sensing; building change detection; deep learning; multi-branch; semantic information; IMAGES; NETWORK;
D O I
10.3390/rs13204171
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Building change detection has always been an important research focus in production and urbanization. In recent years, deep learning methods have demonstrated a powerful ability in the field of detecting remote sensing changes. However, due to the heterogeneity of remote sensing and the characteristics of buildings, the current methods do not present an effective means to perceive building changes or the ability to fuse multi-temporal remote sensing features, which leads to fragmented and incomplete results. In this article, we propose a multi-branched network structure to fuse the semantic information of the building changes at different levels. In this model, two accessory branches were used to guide the buildings' semantic information under different time sequences, and the main branches can merge the change information. In addition, we also designed a feature enhancement layer to further strengthen the integration of the main and accessory branch information. For ablation experiments, we designed experiments on the above optimization process. For MDEFNET, we designed experiments which compare with typical deep learning model and recent deep learning change detection methods. Experimentation with the WHU Building Change Detection Dataset showed that the method in this paper obtained accuracies of 0.8526, 0.9418, and 0.9204 in Intersection over Union (IoU), Recall, and F1 Score, respectively, which could assess building change areas with complete boundaries and accurate results.</p>
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Semantic Enhanced Video Captioning with Multi-feature Fusion
    Niu, Tian-Zi
    Dong, Shan-Shan
    Chen, Zhen-Duo
    Luo, Xin
    Guo, Shanqing
    Huang, Zi
    Xu, Xin-Shun
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (06)
  • [2] FAKE NEWS DETECTION BASED ON MULTI-FEATURE FUSION UNDER ATTENTION GUIDANCE
    Peng, Yan
    Wu, Huimin
    Wang, Lei
    Wang, Jie
    JOURNAL OF NONLINEAR AND CONVEX ANALYSIS, 2022, 23 (09) : 1931 - 1941
  • [3] Crack detection for nuclear containments based on multi-feature fused semantic segmentation
    Pan, Pai
    Xu, Yaming
    Xing, Cheng
    Chen, Yang
    CONSTRUCTION AND BUILDING MATERIALS, 2022, 329
  • [4] Semantic Segmentation of Aerial Laser Point Clouds Based on Deep-Residual Enhanced Coding of Multi-Feature Information
    Luo, Xin
    Lin, Peng
    Li, Xiaoxi
    Wei, Zuqi
    Li, Hai
    Remote Sensing, 2024, 16 (23)
  • [5] Joint of Multi-feature Fusion and Mutual Information-Based Image Semantic Annotation
    Zhu, Guiqian
    Liu, Chunping
    Zhang, Lingyan
    FOUNDATIONS OF INTELLIGENT SYSTEMS (ISKE 2013), 2014, 277 : 833 - 844
  • [6] Detection of Commodities Based on Multi-Feature Fusion and Attention Screening by Entropy Function Guidance
    Xie, An
    Xie, Kai
    Dong, Hao-Nan
    He, Jian-Biao
    IEEE ACCESS, 2023, 11 : 90595 - 90612
  • [7] Battle Damage Assessment for Building based on Multi-feature
    Zhao, Feihong
    Bao, Jingyuan
    Ming, Delie
    PROCEEDINGS OF 2020 IEEE 5TH INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC 2020), 2020, : 57 - 60
  • [8] Smoke Detection Based on Multi-feature Fusion
    Wu Dongmei
    Wang Nana
    Yan Hongmei
    2012 5TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING (CISP), 2012, : 220 - 223
  • [9] Subjectivity Detection Based on Multi-feature Fusion
    Tian, Weixin
    Sun, Shuifa
    Wang, Anhui
    2012 WORLD AUTOMATION CONGRESS (WAC), 2012,
  • [10] Corner detection algorithm based on multi-feature
    Zhang, KH
    Wang, JR
    Zhang, QH
    IMAGE EXTRACTION, SEGMENTATION, AND RECOGNITION, 2001, 4550 : 85 - 90