Few-shot object segmentation with a new feature aggregation module

被引:5
|
作者
Liu, Kaijun [1 ]
Lyu, Shujing [1 ]
Shivakumara, Palaiahnakote [2 ]
Lu, Yue [1 ]
机构
[1] East China Normal Univ, Shanghai Key Lab Multidimens Informat Proc, Shanghai, Peoples R China
[2] Univ Malaya, Fac Comp Sci & Informat Technol, Kuala Lumpur, Malaysia
关键词
Few-shot learning; Object segmentation; Feature aggregation; Attention mechanism;
D O I
10.1016/j.displa.2023.102459
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The success of convolutional neural network for object segmentation depends on a large amount of training data and high-quality samples. But annotating such high-quality training data for pixel-wise segmentation is labor-intensive. To reduce the massive labor work, few-shot learning has been introduced to segment objects, which uses a few samples for training without compromising the performance. However, the current few-shot models are biased towards the seen classes rather than being class-irrelevant due to lack of global context prior attention. Therefore, this study aims at proposing a few-shot object segmentation model with a new feature aggregation module. Specifically, the proposed work develops a detail-aware module to enhance the discrimination of details with diversified attributes. To enhance the semantics of each pixel, we propose a global attention module to aggregate detailed features containing semantic information. Furthermore, to improve the performance of the proposed model, the model uses support samples that represents class-specific prototype obtained by respective category prototype block. Next, the proposed model predicts label of each pixel of query sample by estimating the distance between the pixel and prototypes. Experiments on standard datasets demonstrate significance of the proposed model over SOTA in terms of segmentation with a few training samples.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Decoupling Classifier for Boosting Few-shot Object Detection and Instance Segmentation
    Gao, Bin-Bin
    Chen, Xiaochen
    Huang, Zhongyi
    Nie, Congchong
    Liu, Jun
    Lai, Jinxiang
    Jiang, Guannan
    Wang, Xi
    Wang, Chengjie
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [42] Holistic Prototype Attention Network for Few-Shot Video Object Segmentation
    Tang, Yin
    Chen, Tao
    Jiang, Xiruo
    Yao, Yazhou
    Xie, Guo-Sen
    Shen, Heng-Tao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (08) : 6699 - 6709
  • [43] Mutually-aware feature learning for few-shot object counting
    Jeon, Yerim
    Lee, Subeen
    Kim, Jihwan
    Heo, Jae-Pil
    PATTERN RECOGNITION, 2025, 161
  • [44] Relevant Intrinsic Feature Enhancement Network for Few-Shot Semantic Segmentation
    Bao, Xiaoyi
    Qin, Jie
    Sun, Siyang
    Wang, Xingang
    Zheng, Yun
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 2, 2024, : 765 - 773
  • [45] Unsupervised Semantic Segmentation with Feature Enhancement for Few-shot Image Classification
    Li, Xiang
    Xu, Zhuoming
    Xu, Qi
    Tang, Yan
    2022 TENTH INTERNATIONAL CONFERENCE ON ADVANCED CLOUD AND BIG DATA, CBD, 2022, : 104 - 109
  • [46] Feature reconstruction and metric based network for few-shot object detection
    Li, Yuewen
    Feng, Wenquan
    Lyu, Shuchang
    Zhao, Qi
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 227
  • [47] GFENet: Generalization Feature Extraction Network for Few-Shot Object Detection
    Ke, Xiao
    Chen, Qiuqin
    Liu, Hao
    Guo, Wenzhong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) : 12741 - 12755
  • [48] Few-shot Object Counting with Similarity-Aware Feature Enhancement
    You, Zhiyuan
    Yang, Kai
    Luo, Wenhan
    Lu, Xin
    Cui, Lei
    Le, Xinyi
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 6304 - 6313
  • [49] Multi-Stage Feature Redistribution for Few-Shot Object Detection
    Liu L.
    He Z.
    Ma Z.
    Liu B.
    Wang L.
    Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2023, 52 (01): : 116 - 124
  • [50] Accurate few-shot object counting with Hough matching feature enhancement
    He, Zhiquan
    Zheng, Donghong
    Wang, Hengyou
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2023, 17