Instance segmentation algorithm based on fine-grained feature perception and cross-path aggregation

被引:4
|
作者
Ma, Jianxin [1 ]
Gu, Songbo [1 ]
Deng, Yangyang [1 ]
Ao, Tianyong [1 ]
机构
[1] Henan Univ, Sch Artificial Intelligence, Zhengzhou 450046, Peoples R China
关键词
Instance segmentation; Fine-grained feature perception; Cross-path aggregation; Local loss;
D O I
10.1016/j.knosys.2023.110754
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most existing instance segmentation methods are based on object detection models, and their segmentation performance is limited by the accuracy of the detection boxes. To overcome the limitation of detection boxes, we propose an instance segmentation algorithm based on fine-grained feature perception and cross-path aggregation. Our approach aims to find strongly distinguished feature regions without relying on detection boxes and to perform precise local segmentation. Therefore, a fine-grained feature perception module is designed in the decoding stage by compressing the number of channels to aggregate scattered feature responses and then using an activation function to obtain a weight matrix. Finally, the weight matrix is used to find feature maps that focus on different mask regions to perform precise local segmentation. In addition, we also design a new cross-path aggregation structure in the encoding stage to reduce the loss of foreground instance information during network propagation. Experiments on the MS-COCO and PASCAL VOC 2012 datasets validate the effectiveness of our proposed algorithm and show that our method is competitive compared with state-of-the-art methods.& COPY; 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] A Fine-Grained Outcome-Based Learning Path Model
    Yang, Fan
    Li, Frederick W. B.
    Lau, Rynson W. H.
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2014, 44 (02): : 235 - 245
  • [22] Partial Multimodal Hashing Based on Fine-grained Feature Fusion
    Yin Z.-Z.
    Li B.-H.
    Wang M.
    Huang R.-L.
    Wu W.-L.
    Wang H.-F.
    Ruan Jian Xue Bao/Journal of Software, 2024, 35 (03): : 1074 - 1089
  • [23] Instance Switching-Based Contrastive Learning for Fine-Grained Airplane Detection
    Zeng, Lanxin
    Guo, Haowen
    Yang, Wen
    Yu, Huai
    Yu, Lei
    Zhang, Peng
    Zou, Tongyuan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [24] Fine-Grained Instance-Level Sketch-Based Video Retrieval
    Xu, Peng
    Liu, Kun
    Xiang, Tao
    Hospedales, Timothy M.
    Ma, Zhanyu
    Guo, Jun
    Song, Yi-Zhe
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (05) : 1995 - 2007
  • [25] Fine-Grained Instance-Level Sketch-Based Image Retrieval
    Qian Yu
    Jifei Song
    Yi-Zhe Song
    Tao Xiang
    Timothy M. Hospedales
    International Journal of Computer Vision, 2021, 129 : 484 - 500
  • [26] Fine-Grained Instance-Level Sketch-Based Image Retrieval
    Yu, Qian
    Song, Jifei
    Song, Yi-Zhe
    Xiang, Tao
    Hospedales, Timothy M.
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (02) : 484 - 500
  • [27] High-level feature aggregation for fine-grained architectural floor plan retrieval
    Sharma, Divya
    Chattopadhyay, Chiranjoy
    IET COMPUTER VISION, 2018, 12 (05) : 702 - 709
  • [28] Multiproxies Adaptive Distribution Loss with Weakly Supervised Feature Aggregation for Fine-Grained Retrieval
    Zhao, Hongwei
    Zhang, Danyang
    Wu, Jiaxin
    Liu, Pingping
    SCIENTIFIC PROGRAMMING, 2021, 2021
  • [29] MA-VLAD: a fine-grained local feature aggregation scheme for action recognition
    Feng, Na
    Tang, Ying
    Song, Zikai
    Yu, Junqing
    Chen, Yi-Ping Phoebe
    Yang, Wei
    MULTIMEDIA SYSTEMS, 2024, 30 (03)
  • [30] A cross-granularity feature fusion method for fine-grained image recognition
    Wu, Shan
    Hu, Jun
    Sun, Chen
    Zhong, Fujin
    Zhang, Qinghua
    Wang, Guoyin
    APPLIED INTELLIGENCE, 2025, 55 (01)