Feature Guide Network With Context Aggregation Pyramid for Remote Sensing Image Segmentation

被引:6
|
作者
Li, Jiaojiao [1 ]
Liu, Yuzhe [1 ]
Liu, Jiachao [1 ]
Song, Rui [1 ]
Liu, Wei [2 ]
Han, Kailiang [3 ]
Du, Qian [4 ]
机构
[1] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[2] State Key Lab Geoinformat Engn, Xian 710054, Peoples R China
[3] Chinese Acad Sci, Key Lab Infrared Syst Detect & Imaging Technol, Shanghai Inst Tech Phys, Shanghai 200083, Peoples R China
[4] Mississippi State Univ, Dept Elect & Comp Engn, Starkville, MS 39762 USA
基金
中国博士后科学基金;
关键词
Context aggregation pyramid (CAP); deep learning; edge guide; remote sensing images (RSIs); semantic segmentation; CLASSIFICATION;
D O I
10.1109/JSTARS.2022.3221860
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In recent years, the deep learning method based on fully convolution networks has proven to be an effective method for the semantic segmentation of remote sensing images (RSIs). However, the rich information and complex content of RSIs make networks training for segmentation more challenging. Specifically, the observing distance between the space-borne cameras and the ground objects is extraordinarily far, resulting in that some smaller objects only occupy a few pixels in the image. However, due to the rapid degeneration of tiny objects during the training process, most algorithms cannot properly handle these common small objects in RSIs with satisfactory results. In this article, we propose a novel feature guide network with a context aggregation pyramid (CAP) for RSIs segmentation to conquer these issues. An innovative edge-guide feature transform module is designed to take advantage of the edge and body information of objects to strengthen edge contours and the internal consistency in homogeneous regions, which can explicitly enhance the representation of tiny objects and relieve the degradation of small objects. Furthermore, we design a CAP pooling strategy to adaptively capture optimal feature characterization that can assemble multiscale features according to the significance of different contexts. Extensive experiments on three large-scale remote sensing datasets demonstrate that our method not only can outperform the state-of-the-art methods for objects of different scales but can also achieve robust segmentation results, especially for tiny objects.
引用
收藏
页码:9900 / 9912
页数:13
相关论文
共 50 条
  • [41] Hyperspectral Image Instance Segmentation Using SpectralSpatial Feature Pyramid Network
    Fang, Leyuan
    Jiang, Yifan
    Yan, Yinglong
    Yue, Jun
    Deng, Yue
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [42] Spatial Structure Preserving Feature Pyramid Network for Semantic Image Segmentation
    Yuan, Yuan
    Fang, Jie
    Lu, Xiaoqiang
    Feng, Yachuang
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2019, 15 (03)
  • [43] SAR remote sensing image segmentation based on feature enhancement
    Wei, Wei
    Ye, Yanyu
    Chen, Guochao
    Zhao, Yuming
    Yang, Xin
    Zhang, Lei
    Zhang, Yanning
    NEURAL NETWORKS, 2025, 185
  • [44] An Attention-Guided Multilayer Feature Aggregation Network for Remote Sensing Image Scene Classification
    Li, Ming
    Lei, Lin
    Tang, Yuqi
    Sun, Yuli
    Kuang, Gangyao
    REMOTE SENSING, 2021, 13 (16)
  • [45] CPFTransformer: transformer fusion context pyramid medical image segmentation network
    Li, Jiao
    Ye, Jinyu
    Zhang, Ruixin
    Wu, Yue
    Berhane, Gebremedhin Samuel
    Deng, Hongxia
    Shi, Hong
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [46] GFSCompNet: remote sensing image compression network based on global feature-assisted segmentation
    Ye, Wenhui
    Lei, Weimin
    Zhang, Wei
    Yu, Tingting
    Feng, Xiang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (25) : 67103 - 67127
  • [47] Remote sensing image instance segmentation network with transformer and multi-scale feature representation
    Ye, Wenhui
    Zhang, Wei
    Lei, Weimin
    Zhang, Wenchao
    Chen, Xinyi
    Wang, Yanwen
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 234
  • [48] Remote Sensing Image Segmentation Network Based on Multi-Level Feature Refinement and Fusion
    Jian Yongsheng
    Zhu Daming
    Fu Zhitao
    Wen Shiya
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (04)
  • [49] Non-Local Feature Search Network for Building and Road Segmentation of Remote Sensing Image
    Ding, Cheng
    Weng, Liguo
    Xia, Min
    Lin, Haifeng
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2021, 10 (04)
  • [50] GLFRNet: Global-Local Feature Refusion Network for Remote Sensing Image Instance Segmentation
    Zhao, Jiaqi
    Wang, Yari
    Zhou, Yong
    Du, Wen-Liang
    Yao, Rui
    Saddik, Abdulmotaleb El
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63