Adaptive multi-scale feature fusion with spatial translation for semantic segmentation

被引:0
|
作者
Wang, Hongru [1 ,2 ]
Wang, Haoyu [1 ,2 ]
机构
[1] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin 150001, Heilongjiang, Peoples R China
[2] Harbin Engn Univ, Key Lab Adv Ship Commun & Informat Technol, Harbin 150001, Heilongjiang, Peoples R China
关键词
Adaptive feature perception module; Spatial shift mechanism; Channel-Spectral mechanism; NETWORK;
D O I
10.1007/s11760-024-03477-7
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In image segmentation tasks, contextual information is crucial as it provides essential semantic details. Multi-scale feature extraction methods help models capture this contextual information comprehensively, but they can introduce redundancy and insufficient receptive fields in some areas, particularly with large objects or complex scenes. To address these issues, we propose the Adaptive Feature Perception Module (AFPM). Inspired by the visual system, we combine the pyramid model with dilated convolutions and incorporate a spatial shift mechanism for extensive information capture.This module adaptively adjusts its focus and perception range to maximize target feature capture.Meanwhile, we introduce the Channel and Spectral Attention Module(CSAM) to model dependencies between channels and spectral domains,enabling the network to learn more discriminative features and improve segmentation accuracy. Based on these enhancements,we propose a new network model called AMFFNet. We validated its effectiveness by comparing it with several state-of-the-art methods on the PASCAL VOC 2012, Cityscapes and ADE20K datasets. The results demonstrate that AMFFNet offers superior performance.
引用
收藏
页码:8337 / 8348
页数:12
相关论文
共 50 条
  • [21] MFFRand: Semantic Segmentation of Point Clouds Based on Multi-Scale Feature Fusion and Multi-Loss Supervision
    Miao, Zhiqing
    Song, Shaojing
    Tang, Pan
    Chen, Jian
    Hu, Jinyan
    Gong, Yumei
    ELECTRONICS, 2022, 11 (21)
  • [22] An Improved Multi-Scale Feature Fusion for Skin Lesion Segmentation
    Liu, Luzhou
    Zhang, Xiaoxia
    Li, Yingwei
    Xu, Zhinan
    APPLIED SCIENCES-BASEL, 2023, 13 (14):
  • [23] Edge-guided multi-scale adaptive feature fusion network for liver tumor segmentation
    Zhang, Tiange
    Liu, Yuefeng
    Zhao, Qiyan
    Xue, Guoyue
    Shen, Hongyu
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [24] MLFNet- Point Cloud Semantic Segmentation Convolution Network Based on Multi-Scale Feature Fusion
    Yang, Jingfang
    Zou, Bochang
    Qiu, Huadong
    Li, Zhi
    IEEE ACCESS, 2021, 9 : 44950 - 44962
  • [25] Off-Road Environment Semantic Segmentation for Autonomous Vehicles Based on Multi-Scale Feature Fusion
    Zhou, Xiaojing
    Feng, Yunjia
    Li, Xu
    Zhu, Zijian
    Hu, Yanzhong
    WORLD ELECTRIC VEHICLE JOURNAL, 2023, 14 (10):
  • [26] MFPNet: A Multi-scale Feature Propagation Network for Lightweight Semantic Segmentation
    Xu, Guoan
    Jia, Wenjing
    Wu, Tao
    Chen, Ligeng
    Gao, Guangwei
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING-ICANN 2024, PT III, 2024, 15018 : 76 - 86
  • [27] Multi-Scale Feature Aggregation Network for Semantic Segmentation of Land Cover
    Shen, Xu
    Weng, Liguo
    Xia, Min
    Lin, Haifeng
    REMOTE SENSING, 2022, 14 (23)
  • [28] Adaptive fusion with multi-scale features for interactive image segmentation
    Zongyuan Ding
    Tao Wang
    Quansen Sun
    Hongyuan Wang
    Applied Intelligence, 2021, 51 : 5610 - 5621
  • [29] Adaptive fusion with multi-scale features for interactive image segmentation
    Ding, Zongyuan
    Wang, Tao
    Sun, Quansen
    Wang, Hongyuan
    APPLIED INTELLIGENCE, 2021, 51 (08) : 5610 - 5621
  • [30] Multi-scale fusion for RGB-D indoor semantic segmentation
    Jiang, Shiyi
    Xu, Yang
    Li, Danyang
    Fan, Runze
    SCIENTIFIC REPORTS, 2022, 12 (01):