Posture-guided part learning for fine-grained image categorization

被引:1
|
作者
Song, Wei [1 ]
Chen, Dongmei [1 ]
机构
[1] Jiangnan Univ, Sch Artificial Intelligence & Comp Sci, Wuxi, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
fine-grained image classification; feature enhancement; posture modeling; feature fusion; CLASSIFICATION; NETWORK;
D O I
10.1117/1.JEI.33.3.033013
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
. The challenge in fine-grained image classification tasks lies in distinguishing subtle differences among fine-grained images. Existing image classification methods often only explore information in isolated regions without considering the relationships among these parts, resulting in incomplete information and a tendency to focus on individual parts. Posture information is hidden among these parts, so it plays a crucial role in differentiating among similar categories. Therefore, we propose a posture-guided part learning framework capable of extracting hidden posture information among regions. In this framework, the dual-branch feature enhancement module (DBFEM) highlights discriminative information related to fine-grained objects by extracting attention information between the feature space and channels. The part selection module selects multiple discriminative parts based on the attention information from DBFEM. Building upon this, the posture feature fusion module extracts semantic features from discriminative parts and constructs posture features among different parts based on these semantic features. Finally, by fusing part semantic features with posture features, a comprehensive representation of fine-grained object features is obtained, aiding in differentiating among similar categories. Extensive evaluations on three benchmark datasets demonstrate the competitiveness of the proposed framework compared with state-of-the-art methods.
引用
收藏
页数:19
相关论文
共 50 条
  • [41] A Survey on Fine-grained Image Categorization Using Deep Convolutional Features
    Luo J.-H.
    Wu J.-X.
    Wu, Jian-Xin (wujx2001@nju.edu.cn), 1600, Science Press (43): : 1306 - 1318
  • [42] Detecting Densely Distributed Graph Patterns for Fine-Grained Image Categorization
    Zhang, Luming
    Yang, Yang
    Wang, Meng
    Hong, Richang
    Nie, Liqiang
    Li, Xuelong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (02) : 553 - 565
  • [43] DATA-DRIVEN TAXONOMY FOREST FOR FINE-GRAINED IMAGE CATEGORIZATION
    Wu, Xiaomeng
    Mori, Minoru
    Kashino, Kunio
    2015 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO (ICME), 2015,
  • [44] GKA: Graph-guided knowledge association for fine-grained visual categorization
    Wang, Yuetian
    Ye, Shuo
    Hou, Wenjin
    Xu, Duanquan
    You, Xinge
    NEUROCOMPUTING, 2025, 634
  • [45] StackDRL: Stacked Deep Reinforcement Learning for Fine-grained Visual Categorization
    He, Xiangteng
    Peng, Yuxin
    Zhao, Junjie
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 741 - 747
  • [46] Hierarchical deep transfer learning for fine-grained categorization on micro datasets
    Wang, Ronggui
    Yao, Xuchen
    Yang, Juan
    Xue, Lixia
    Hu, Min
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 62 : 129 - 139
  • [47] Learning a Mixture of Granularity-Specific Experts for Fine-Grained Categorization
    Zhang, Lianbo
    Huang, Shaoli
    Liu, Wei
    Tao, Dacheng
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 8330 - 8339
  • [48] Learning Scale-Consistent Attention Part Network for Fine-Grained Image Recognition
    Liu, Huabin
    Li, Jianguo
    Li, Dian
    See, John
    Lin, Weiyao
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 2902 - 2913
  • [49] Learning Rich Part Hierarchies With Progressive Attention Networks for Fine-Grained Image Recognition
    Zheng, Heliang
    Fu, Jianlong
    Zha, Zheng-Jun
    Luo, Jiebo
    Mei, Tao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 476 - 488
  • [50] MASK GUIDED ATTENTION FOR FINE-GRAINED PATCHY IMAGE CLASSIFICATION
    Wang, Jun
    Yu, Xiaohan
    Gao, Yongsheng
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1044 - 1048