Feature Guide Network With Context Aggregation Pyramid for Remote Sensing Image Segmentation

被引:6
|
作者
Li, Jiaojiao [1 ]
Liu, Yuzhe [1 ]
Liu, Jiachao [1 ]
Song, Rui [1 ]
Liu, Wei [2 ]
Han, Kailiang [3 ]
Du, Qian [4 ]
机构
[1] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[2] State Key Lab Geoinformat Engn, Xian 710054, Peoples R China
[3] Chinese Acad Sci, Key Lab Infrared Syst Detect & Imaging Technol, Shanghai Inst Tech Phys, Shanghai 200083, Peoples R China
[4] Mississippi State Univ, Dept Elect & Comp Engn, Starkville, MS 39762 USA
基金
中国博士后科学基金;
关键词
Context aggregation pyramid (CAP); deep learning; edge guide; remote sensing images (RSIs); semantic segmentation; CLASSIFICATION;
D O I
10.1109/JSTARS.2022.3221860
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In recent years, the deep learning method based on fully convolution networks has proven to be an effective method for the semantic segmentation of remote sensing images (RSIs). However, the rich information and complex content of RSIs make networks training for segmentation more challenging. Specifically, the observing distance between the space-borne cameras and the ground objects is extraordinarily far, resulting in that some smaller objects only occupy a few pixels in the image. However, due to the rapid degeneration of tiny objects during the training process, most algorithms cannot properly handle these common small objects in RSIs with satisfactory results. In this article, we propose a novel feature guide network with a context aggregation pyramid (CAP) for RSIs segmentation to conquer these issues. An innovative edge-guide feature transform module is designed to take advantage of the edge and body information of objects to strengthen edge contours and the internal consistency in homogeneous regions, which can explicitly enhance the representation of tiny objects and relieve the degradation of small objects. Furthermore, we design a CAP pooling strategy to adaptively capture optimal feature characterization that can assemble multiscale features according to the significance of different contexts. Extensive experiments on three large-scale remote sensing datasets demonstrate that our method not only can outperform the state-of-the-art methods for objects of different scales but can also achieve robust segmentation results, especially for tiny objects.
引用
收藏
页码:9900 / 9912
页数:13
相关论文
共 50 条
  • [21] A Dense Feature Pyramid Network for Remote Sensing Object Detection
    Sun, Yu
    Liu, Wenkai
    Gao, Yangte
    Hou, Xinghai
    Bi, Fukun
    APPLIED SCIENCES-BASEL, 2022, 12 (10):
  • [22] HFPNet: Super Feature Aggregation Pyramid Network for Maritime Remote Sensing Small-Object Detection
    Chen, Chengcheng
    Zeng, Weiming
    Zhang, Xiliang
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 5973 - 5989
  • [23] Rotation Equivariant Feature Image Pyramid Network for Object Detection in Optical Remote Sensing Imagery
    Shamsolmoali, Pourya
    Zareapoor, Masoumeh
    Chanussot, Jocelyn
    Zhou, Huiyu
    Yang, Jie
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [24] Multi-feature Map Pyramid Fusion Deep Network for Semantic Segmentation on Remote Sensing Data
    Zhao Fei
    Zhang Wenkai
    Yan Zhiyuan
    Yu Hongfeng
    Diao Wenhui
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2019, 41 (10) : 2525 - 2531
  • [25] FFPN: Fourier Feature Pyramid Network for Ultrasound Image Segmentation
    Chen, Chaoyu
    Yang, Xin
    Chen, Rusi
    Yu, Junxuan
    Du, Liwei
    Wang, Jian
    Hu, Xindi
    Cao, Yan
    Liu, Yingying
    Ni, Dong
    MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2023, PT I, 2024, 14348 : 166 - 175
  • [26] Scenario Context-Aware-Based Bidirectional Feature Pyramid Network for Remote Sensing Target Detection
    Huang, Wei
    Li, Guanyi
    Jin, Baohua
    Chen, Qiqiang
    Yin, Junru
    Huang, Long
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [27] CPFNet: Context Pyramid Fusion Network for Medical Image Segmentation
    Feng, Shuanglang
    Zhao, Heming
    Shi, Fei
    Cheng, Xuena
    Wang, Meng
    Ma, Yuhui
    Xiang, Dehui
    Zhu, Weifang
    Chen, Xinjian
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (10) : 3008 - 3018
  • [28] Robust feature aggregation network for lightweight and effective remote sensing image change detection
    You, Zhi-Hui
    Chen, Si-Bao
    Wang, Jia-Xin
    Luo, Bin
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2024, 215 : 31 - 43
  • [29] A full-scale feature aggregation network for remote sensing image change detection
    Liu G.
    Fang S.
    Li Z.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2022, 48 (08): : 1464 - 1470
  • [30] Multiscale Feature Aggregation Capsule Neural Network for Hyperspectral Remote Sensing Image Classification
    Lei, Runmin
    Zhang, Chunju
    Zhang, Xueying
    Huang, Jianwei
    Li, Zhenxuan
    Liu, Wencong
    Cui, Hao
    REMOTE SENSING, 2022, 14 (07)