Concept-Aware Graph Convolutional Network for Compositional Zero-Shot Learning

被引:0
|
作者
Liu, Yang [1 ,2 ]
Wang, Xinshuo [1 ]
Gao, Xinbo [3 ]
Han, Jungong [4 ]
Shao, Ling [5 ]
机构
[1] Xidian Univ, Sch Telecommun Engn, Xian 710071, Peoples R China
[2] Anhui Univ, Anhui Prov Key Lab Multimodal Cognit Computat, Hefei 230601, Peoples R China
[3] Chongqing Univ Posts & Telecommun, Chongqing Key Lab Image Cognit, Chongqing 400065, Peoples R China
[4] Univ Sheffield, Dept Comp Sci, Sheffield S10 2TN, Yorkshire, England
[5] Univ Chinese Acad Sci, UCAS Terminus AI Lab, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
Visualization; Transformers; Feature extraction; Dogs; Zero shot learning; Object recognition; Computational modeling; Training; Telecommunications; Compositional zero-shot learning (CZSL); concept-aware; cross-attentions; Earth mover's distance (EMD); graph convolutional network (GCN);
D O I
10.1109/TNNLS.2025.3528885
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Compositional zero-shot learning (CZSL) aims to identify unobservable compositional concepts with prior knowledge of known primitives (attributes and objects). Due to distribution differences between seen and unseen components, existing methods for CZSL often ignore intrinsic variations between primitives and suffer from domain bias problems. To address this challenge, we proposed a concept-aware graph convolutional network (GCN) that utilizes cross-attentions to extract features unique to attributes and objects from paired concept-sharing inputs. The proposed model utilizes the cosine similarity between visual features and synthetic embeddings to estimate the feasibility score for each unseen composition. This score is then employed as a weight in the graph adjacency matrix. Additionally, the proposed model incorporates the Earth mover's distance (EMD) to further limit the concept of learning interest in disentanglers. Experimental results on three challenging dataset benchmarks, including UT-Zappos 50K, C-GQA, and MIT-States, demonstrate that the proposed model outperforms prior work in both closed-and open-world CZSL (OW-CZSL).
引用
收藏
页数:13
相关论文
共 50 条
  • [31] Distilled Reverse Attention Network for Open-world Compositional Zero-Shot Learning
    Li, Yun
    Liu, Zhe
    Jha, Saurav
    Yao, Lina
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 1782 - 1791
  • [32] Zero-Shot Learning on Semantic Class Prototype Graph
    Fu, Zhenyong
    Xiang, Tao
    Kodirov, Elyor
    Gong, Shaogang
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (08) : 2009 - 2022
  • [33] Rethinking Knowledge Graph Propagation for Zero-Shot Learning
    Kampffmeyer, Michael
    Chen, Yinbo
    Liang, Xiaodan
    Wang, Hao
    Zhang, Yujia
    Xing, Eric P.
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11479 - 11488
  • [34] Hierarchical Visual Primitive Experts for Compositional Zero-Shot Learning
    Kim, Hanjae
    Lee, Jiyoung
    Park, Seongheon
    Sohn, Kwanghoon
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 5652 - 5662
  • [35] Semantic-Adversarial Graph Convolutional Network for Zero-Shot Cross-Modal Retrieval
    Li, Chuang
    Fei, Lunke
    Kang, Peipei
    Liang, Jiahao
    Fang, Xiaozhao
    Teng, Shaohua
    PRICAI 2022: TRENDS IN ARTIFICIAL INTELLIGENCE, PT II, 2022, 13630 : 459 - 472
  • [36] Swap-Reconstruction Autoencoder for Compositional Zero-Shot Learning
    Guo, Ting
    Liang, Jiye
    Xie, Guo-Sen
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 438 - 443
  • [37] Attributes learning network for generalized zero-shot learning
    Yun, Yu
    Wang, Sen
    Hou, Mingzhen
    Gao, Quanxue
    NEURAL NETWORKS, 2022, 150 : 112 - 118
  • [38] Differential Refinement Network for Zero-Shot Learning
    Tian, Yi
    Zhang, Yilei
    Huang, Yaping
    Xu, Wanru
    Ding, Zhengming
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (03) : 4164 - 4178
  • [39] Hierarchical Zero-Shot Classification with Convolutional Neural Network Features and Semantic Attribute Learning
    Markowitz, Jared
    Schmidt, Aurora C.
    Burlina, Philippe M.
    Wang, I-Jeng
    PROCEEDINGS OF THE FIFTEENTH IAPR INTERNATIONAL CONFERENCE ON MACHINE VISION APPLICATIONS - MVA2017, 2017, : 194 - 197
  • [40] Dual Bidirectional Graph Convolutional Networks for Zero-shot Node Classification
    Yue, Qin
    Liang, Jiye
    Cui, Junbiao
    Bai, Liang
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 2408 - 2417