Adaptive multi-scale feature fusion with spatial translation for semantic segmentation

被引:0
|
作者
Wang, Hongru [1 ,2 ]
Wang, Haoyu [1 ,2 ]
机构
[1] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin 150001, Heilongjiang, Peoples R China
[2] Harbin Engn Univ, Key Lab Adv Ship Commun & Informat Technol, Harbin 150001, Heilongjiang, Peoples R China
关键词
Adaptive feature perception module; Spatial shift mechanism; Channel-Spectral mechanism; NETWORK;
D O I
10.1007/s11760-024-03477-7
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In image segmentation tasks, contextual information is crucial as it provides essential semantic details. Multi-scale feature extraction methods help models capture this contextual information comprehensively, but they can introduce redundancy and insufficient receptive fields in some areas, particularly with large objects or complex scenes. To address these issues, we propose the Adaptive Feature Perception Module (AFPM). Inspired by the visual system, we combine the pyramid model with dilated convolutions and incorporate a spatial shift mechanism for extensive information capture.This module adaptively adjusts its focus and perception range to maximize target feature capture.Meanwhile, we introduce the Channel and Spectral Attention Module(CSAM) to model dependencies between channels and spectral domains,enabling the network to learn more discriminative features and improve segmentation accuracy. Based on these enhancements,we propose a new network model called AMFFNet. We validated its effectiveness by comparing it with several state-of-the-art methods on the PASCAL VOC 2012, Cityscapes and ADE20K datasets. The results demonstrate that AMFFNet offers superior performance.
引用
收藏
页码:8337 / 8348
页数:12
相关论文
共 50 条
  • [41] MFEFNet: Multi-scale feature enhancement and Fusion Network for polyp segmentation
    Xia, Yang
    Yun, Haijiao
    Liu, Yanjun
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 157
  • [42] Multi-scale feature map fusion encoding for underwater object segmentation
    Liu, Chengxiang
    Yao, Haoxin
    Qiu, Wenhui
    Cui, Hongyuan
    Fang, Yubin
    Xu, Anqi
    APPLIED INTELLIGENCE, 2025, 55 (02)
  • [43] BFMNet: Bilateral feature fusion network with multi-scale context aggregation for real-time semantic segmentation
    Liu, Jin
    Zhang, Fangyu
    Zhou, Ziyin
    Wang, Jiajun
    NEUROCOMPUTING, 2023, 521 : 27 - 40
  • [44] Semantic Segmentation of Remote Sensing Image via Self-Attention-Based Multi-Scale Feature Fusion
    Guo D.
    Fu Y.
    Zhu Y.
    Wen W.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2023, 35 (08): : 1259 - 1268
  • [45] Construction of a Semantic Segmentation Network for the Overhead Catenary System Point Cloud Based on Multi-Scale Feature Fusion
    Xu, Tao
    Gao, Xianjun
    Yang, Yuanwei
    Xu, Lei
    Xu, Jie
    Wang, Yanjun
    REMOTE SENSING, 2022, 14 (12)
  • [46] Mamba-UAV-SegNet: A Multi-Scale Adaptive Feature Fusion Network for Real-Time Semantic Segmentation of UAV Aerial Imagery
    Huang, Longyang
    Tan, Jintao
    Chen, Zhonghui
    DRONES, 2024, 8 (11)
  • [47] Semantic segmentation of multi-scale remote sensing images with contextual feature enhancement
    Zhang, Mei
    Liu, Lingling
    Pei, Yongtao
    Xie, Guojing
    Wen, Jinghua
    VISUAL COMPUTER, 2025, 41 (02): : 1303 - 1317
  • [48] Semantic Segmentation Network Based on Adaptive Attention and Deep Fusion Utilizing a Multi-Scale Dilated Convolutional Pyramid
    Zhao, Shan
    Wang, Zihao
    Huo, Zhanqiang
    Zhang, Fukai
    SENSORS, 2024, 24 (16)
  • [49] Encoder-Decoder with Multi-scale Information Fusion for Semantic Image Segmentation
    Ma, Xinxin
    Liu, Kai
    Ding, Chongyang
    Yan, Lin
    Duan, Meiyu
    ELEVENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2019), 2020, 11373
  • [50] Multi-scale attention fusion network for semantic segmentation of remote sensing images
    Wen, Zhiqiang
    Huang, Hongxu
    Liu, Shuai
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (24) : 7909 - 7926