Concept-Aware Graph Convolutional Network for Compositional Zero-Shot Learning

被引:0
|
作者
Liu, Yang [1 ,2 ]
Wang, Xinshuo [1 ]
Gao, Xinbo [3 ]
Han, Jungong [4 ]
Shao, Ling [5 ]
机构
[1] Xidian Univ, Sch Telecommun Engn, Xian 710071, Peoples R China
[2] Anhui Univ, Anhui Prov Key Lab Multimodal Cognit Computat, Hefei 230601, Peoples R China
[3] Chongqing Univ Posts & Telecommun, Chongqing Key Lab Image Cognit, Chongqing 400065, Peoples R China
[4] Univ Sheffield, Dept Comp Sci, Sheffield S10 2TN, Yorkshire, England
[5] Univ Chinese Acad Sci, UCAS Terminus AI Lab, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
Visualization; Transformers; Feature extraction; Dogs; Zero shot learning; Object recognition; Computational modeling; Training; Telecommunications; Compositional zero-shot learning (CZSL); concept-aware; cross-attentions; Earth mover's distance (EMD); graph convolutional network (GCN);
D O I
10.1109/TNNLS.2025.3528885
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Compositional zero-shot learning (CZSL) aims to identify unobservable compositional concepts with prior knowledge of known primitives (attributes and objects). Due to distribution differences between seen and unseen components, existing methods for CZSL often ignore intrinsic variations between primitives and suffer from domain bias problems. To address this challenge, we proposed a concept-aware graph convolutional network (GCN) that utilizes cross-attentions to extract features unique to attributes and objects from paired concept-sharing inputs. The proposed model utilizes the cosine similarity between visual features and synthetic embeddings to estimate the feasibility score for each unseen composition. This score is then employed as a weight in the graph adjacency matrix. Additionally, the proposed model incorporates the Earth mover's distance (EMD) to further limit the concept of learning interest in disentanglers. Experimental results on three challenging dataset benchmarks, including UT-Zappos 50K, C-GQA, and MIT-States, demonstrate that the proposed model outperforms prior work in both closed-and open-world CZSL (OW-CZSL).
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Concept-Aware Denoising Graph Neural Network for Micro-Video Recommendation
    Liu, Yiyu
    Liu, Qian
    Tian, Yu
    Wang, Changping
    Niu, Yanan
    Song, Yang
    Li, Chenliang
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 1099 - 1108
  • [42] HAPZSL: A hybrid attention prototype network for knowledge graph zero-shot relational learning
    Li, Xuewei
    Ma, Jinming
    Yu, Jian
    Xu, Tianyi
    Zhao, Mankun
    Liu, Hongwei
    Yu, Mei
    Yu, Ruiguo
    NEUROCOMPUTING, 2022, 508 : 324 - 336
  • [43] Adaptive Relation-Aware Network for zero-shot classification
    Zhang, Xun
    Liu, Yang
    Dang, Yuhao
    Gao, Xinbo
    Han, Jungong
    Shao, Ling
    NEURAL NETWORKS, 2024, 174
  • [44] A concept-aware explainability method for convolutional neural networks
    Gurkan, Mustafa Kagan
    Arica, Nafiz
    Vural, Fatos T. Yarman
    MACHINE VISION AND APPLICATIONS, 2025, 36 (02)
  • [45] Knowledge-aware Zero-Shot Learning: Survey and Perspective
    Chen, Jiaoyan
    Geng, Yuxia
    Chen, Zhuo
    Horrocks, Ian
    Pan, Jeff Z.
    Chen, Huajun
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 4366 - 4373
  • [46] Context-Aware Zero-Shot Learning for Object Recognition
    Zablocki, Eloi
    Bordes, Patrick
    Piwowarski, Benjamin
    Soulier, Laure
    Gallinari, Patrick
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [47] Uncertainty-Aware Learning for Zero-Shot Semantic Segmentation
    Hu, Ping
    Sclaroff, Stan
    Saenko, Kate
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [48] Domain-aware Stacked AutoEncoders for zero-shot learning
    Song, Jianqiang
    Shi, Guangming
    Xie, Xuemei
    Wu, Qingtao
    Zhang, Mingchuan
    NEUROCOMPUTING, 2021, 429 : 118 - 131
  • [49] Zero-shot Node Classification with Decomposed Graph Prototype Network
    Wang, Zheng
    Wang, Jialong
    Guo, Yuchen
    Gong, Zhiguo
    KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 1769 - 1779
  • [50] TGG: Transferable Graph Generation for Zero-shot and Few-shot Learning
    Zhang, Chenrui
    Lyu, Xiaoqing
    Tang, Zhi
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 1641 - 1649