Posture-guided part learning for fine-grained image categorization

被引:1
|
作者
Song, Wei [1 ]
Chen, Dongmei [1 ]
机构
[1] Jiangnan Univ, Sch Artificial Intelligence & Comp Sci, Wuxi, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
fine-grained image classification; feature enhancement; posture modeling; feature fusion; CLASSIFICATION; NETWORK;
D O I
10.1117/1.JEI.33.3.033013
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
. The challenge in fine-grained image classification tasks lies in distinguishing subtle differences among fine-grained images. Existing image classification methods often only explore information in isolated regions without considering the relationships among these parts, resulting in incomplete information and a tendency to focus on individual parts. Posture information is hidden among these parts, so it plays a crucial role in differentiating among similar categories. Therefore, we propose a posture-guided part learning framework capable of extracting hidden posture information among regions. In this framework, the dual-branch feature enhancement module (DBFEM) highlights discriminative information related to fine-grained objects by extracting attention information between the feature space and channels. The part selection module selects multiple discriminative parts based on the attention information from DBFEM. Building upon this, the posture feature fusion module extracts semantic features from discriminative parts and constructs posture features among different parts based on these semantic features. Finally, by fusing part semantic features with posture features, a comprehensive representation of fine-grained object features is obtained, aiding in differentiating among similar categories. Extensive evaluations on three benchmark datasets demonstrate the competitiveness of the proposed framework compared with state-of-the-art methods.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Universal Fine-Grained Visual Categorization by Concept Guided Learning
    Bi, Qi
    Zhou, Beichen
    Ji, Wei
    Xia, Gui-Song
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2025, 34 : 394 - 409
  • [2] A Survey of Fine-Grained Image Categorization
    Zheng, Min
    Li, Qingyong
    Geng, Yangli-ao
    Yu, Haomin
    Wang, Jianzhu
    Gan, Jinrui
    Xue, Wenyuan
    PROCEEDINGS OF 2018 14TH IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP), 2018, : 533 - 538
  • [3] PFNet: A Novel Part Fusion Network for Fine-grained Image Categorization
    Guo, Jinlin
    Liang, Jingyun
    Bai, Liang
    Lao, Songyang
    2018 IEEE FOURTH INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM), 2018,
  • [4] Weakly Supervised Fine-Grained Categorization With Part-Based Image Representation
    Zhang, Yu
    Wei, Xiu-Shen
    Wu, Jianxin
    Cai, Jianfei
    Lu, Jiangbo
    Nguyen, Viet-Anh
    Do, Minh N.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (04) : 1713 - 1725
  • [5] Symbiotic Segmentation and Part Localization for Fine-Grained Categorization
    Chai, Yuning
    Lempitsky, Victor
    Zisserman, Andrew
    2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 321 - 328
  • [6] Hierarchical Part Matching for Fine-Grained Visual Categorization
    Xie, Lingxi
    Tian, Qi
    Hong, Richang
    Yan, Shuicheng
    Zhang, Bo
    2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 1641 - 1648
  • [7] Part-Aware Segmentation for Fine-Grained Categorization
    Pang, Cheng
    Yao, Hongxun
    Yang, Zhiyuan
    Sun, Xiaoshuai
    Zhao, Sicheng
    Zhang, Yanhao
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2015, PT I, 2015, 9314 : 538 - 548
  • [8] Cross-Part Learning for Fine-Grained Image Classification
    Liu, Man
    Zhang, Chunjie
    Bai, Huihui
    Zhang, Riquan
    Zhao, Yao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 748 - 758
  • [9] Combining Randomization and Discrimination for Fine-Grained Image Categorization
    Yao, Bangpeng
    Khosla, Aditya
    Li Fei-Fei
    2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011, : 1577 - 1584
  • [10] Efficient match kernel in fine-grained image categorization
    Zhang, Lei
    Cao, Yongjiao
    Xiang, Xuezhi
    Junejo, Naveed Ur Rehman
    2014 11TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2014, : 5578 - 5581