Adaptive multi-scale feature fusion with spatial translation for semantic segmentation

被引:0
|
作者
Wang, Hongru [1 ,2 ]
Wang, Haoyu [1 ,2 ]
机构
[1] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin 150001, Heilongjiang, Peoples R China
[2] Harbin Engn Univ, Key Lab Adv Ship Commun & Informat Technol, Harbin 150001, Heilongjiang, Peoples R China
关键词
Adaptive feature perception module; Spatial shift mechanism; Channel-Spectral mechanism; NETWORK;
D O I
10.1007/s11760-024-03477-7
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In image segmentation tasks, contextual information is crucial as it provides essential semantic details. Multi-scale feature extraction methods help models capture this contextual information comprehensively, but they can introduce redundancy and insufficient receptive fields in some areas, particularly with large objects or complex scenes. To address these issues, we propose the Adaptive Feature Perception Module (AFPM). Inspired by the visual system, we combine the pyramid model with dilated convolutions and incorporate a spatial shift mechanism for extensive information capture.This module adaptively adjusts its focus and perception range to maximize target feature capture.Meanwhile, we introduce the Channel and Spectral Attention Module(CSAM) to model dependencies between channels and spectral domains,enabling the network to learn more discriminative features and improve segmentation accuracy. Based on these enhancements,we propose a new network model called AMFFNet. We validated its effectiveness by comparing it with several state-of-the-art methods on the PASCAL VOC 2012, Cityscapes and ADE20K datasets. The results demonstrate that AMFFNet offers superior performance.
引用
收藏
页码:8337 / 8348
页数:12
相关论文
共 50 条
  • [31] Multi-scale Adaptive Feature Fusion Hashing for Image Retrieval
    Jiang, Xiangkui
    Hu, Fei
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2024,
  • [32] Multi-scale fusion for RGB-D indoor semantic segmentation
    Shiyi Jiang
    Yang Xu
    Danyang Li
    Runze Fan
    Scientific Reports, 12 (1)
  • [33] Multi-scale underwater object tracking by adaptive feature fusion
    Lu, Ying
    Wang, Huibin
    Chen, Zhe
    Zhang, Zhen
    INTERNATIONAL SYMPOSIUM ON ARTIFICIAL INTELLIGENCE AND ROBOTICS 2021, 2021, 11884
  • [34] Dynamically Enhanced lane detection with multi-scale semantic feature fusion
    Deng, Liwei
    Cao, He
    Lan, Qi
    COMPUTERS & ELECTRICAL ENGINEERING, 2024, 118
  • [35] Multi-scale sparse convolution and point convolution adaptive fusion point cloud semantic segmentation method
    Bi, Yuxuan
    Liu, Peng
    Zhang, Tianyi
    Shi, Jialin
    Wang, Caixia
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [36] Multi-scale feature fusion network with local attention for lung segmentation
    Xie, Yinghua
    Zhou, Yuntong
    Wang, Chen
    Ma, Yanshan
    Yang, Ming
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 119
  • [37] Multi-scale feature pyramid fusion network for medical image segmentation
    Zhang, Bing
    Wang, Yang
    Ding, Caifu
    Deng, Ziqing
    Li, Linwei
    Qin, Zesheng
    Ding, Zhao
    Bian, Lifeng
    Yang, Chen
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2023, 18 (02) : 353 - 365
  • [38] A Segmentation Algorithm of Colonoscopy Images Based on Multi-Scale Feature Fusion
    Yu, Jing
    Li, Zhengping
    Xu, Chao
    Feng, Bo
    ELECTRONICS, 2022, 11 (16)
  • [39] Multi-scale feature pyramid fusion network for medical image segmentation
    Bing Zhang
    Yang Wang
    Caifu Ding
    Ziqing Deng
    Linwei Li
    Zesheng Qin
    Zhao Ding
    Lifeng Bian
    Chen Yang
    International Journal of Computer Assisted Radiology and Surgery, 2023, 18 : 353 - 365
  • [40] Regional perception and multi-scale feature fusion network for cardiac segmentation
    Lu, Chenggang
    Yuan, Jinli
    Xia, Kewen
    Guo, Zhitao
    Chen, Muxuan
    Yu, Hengyong
    PHYSICS IN MEDICINE AND BIOLOGY, 2023, 68 (10):