Disentangled Ontology Embedding for Zero-shot Learning

被引:6
|
作者
Geng, Yuxia [1 ]
Chen, Jiaoyan [2 ]
Zhang, Wen [3 ]
Xu, Yajing [3 ]
Chen, Zhuo [1 ]
Pan, Jeff Z. [4 ]
Huang, Yufeng [3 ]
Xiong, Feiyu [5 ]
Chen, Huajun [1 ,6 ]
机构
[1] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou, Peoples R China
[2] Univ Oxford, Dept Comp Sci, Oxford, England
[3] Zhejiang Univ, Sch Software Technol, Ningbo, Peoples R China
[4] Univ Edinburgh, Sch Informat, Edinburgh, Midlothian, Scotland
[5] Alibaba Grp, Hangzhou, Peoples R China
[6] Alibaba Zhejiang Univ Joint Inst Frontier Technol, ZJU Hangzhou Global Sci & Technol Innovat Ctr, Hangzhou, Peoples R China
基金
英国工程与自然科学研究理事会;
关键词
Zero-shot Learning; Ontology; Knowledge Graph; Disentangled Representation Learning;
D O I
10.1145/3534678.3539453
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Knowledge Graph (KG) and its variant of ontology have been widely used for knowledge representation, and have shown to be quite effective in augmenting Zero-shot Learning (ZSL). However, existing ZSL methods that utilize KGs all neglect the intrinsic complexity of inter-class relationships represented in KGs. One typical feature is that a class is often related to other classes in different semantic aspects. In this paper, we focus on ontologies for augmenting ZSL, and propose to learn disentangled ontology embeddings guided by ontology properties to capture and utilize more fine-grained class relationships in different aspects. We also contribute a new ZSL framework named DOZSL, which contains two new ZSL solutions based on generative models and graph propagation models, respectively, for effectively utilizing the disentangled ontology embeddings. Extensive evaluations have been conducted on five benchmarks across zero-shot image classification (ZS-IMGC) and zero-shot KG completion (ZS-KGC). DOZSL often achieves better performance than the state-of-the-art, and its components have been verified by ablation studies and case studies. Our codes and datasets are available at https://github.com/zjukg/DOZSL.
引用
收藏
页码:443 / 453
页数:11
相关论文
共 50 条
  • [21] Ontology-guided Semantic Composition for Zero-Shot Learning
    Chen, Jiaoyan
    Lecue, Freddy
    Geng, Yuxia
    Pan, Jeff Z.
    Chen, Huajun
    KR2020: PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON PRINCIPLES OF KNOWLEDGE REPRESENTATION AND REASONING, 2020, : 850 - 854
  • [22] ROBUST DISENTANGLED VARIATIONAL SPEECH REPRESENTATION LEARNING FOR ZERO-SHOT VOICE CONVERSION
    Lian, Jiachen
    Zhang, Chunlei
    Yu, Dong
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 6572 - 6576
  • [23] Learning discriminative visual semantic embedding for zero-shot recognition
    Xie, Yurui
    Song, Tiecheng
    Yuan, Jianying
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 115
  • [24] Zero-Shot Learning via Joint Latent Similarity Embedding
    Zhang, Ziming
    Saligrama, Venkatesh
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 6034 - 6042
  • [25] Semantic Consistent Embedding for Domain Adaptive Zero-Shot Learning
    Zhang, Jianyang
    Yang, Guowu
    Hu, Ping
    Lin, Guosheng
    Lv, Fengmao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 4024 - 4035
  • [26] Transductive Visual-Semantic Embedding for Zero-shot Learning
    Xu, Xing
    Shen, Fumin
    Yang, Yang
    Shao, Jie
    Huang, Zi
    PROCEEDINGS OF THE 2017 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL (ICMR'17), 2017, : 41 - 49
  • [27] Domain-Oriented Semantic Embedding for Zero-Shot Learning
    Min, Shaobo
    Yao, Hantao
    Xie, Hongtao
    Zha, Zheng-Jun
    Zhang, Yongdong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 3919 - 3930
  • [28] Siamese Contrastive Embedding Network for Compositional Zero-Shot Learning
    Li, Xiangyu
    Yang, Xu
    Wei, Kun
    Deng, Cheng
    Yang, Muli
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 9316 - 9325
  • [29] Leveraging Balanced Semantic Embedding for Generative Zero-Shot Learning
    Xie, Guo-Sen
    Zhang, Xu-Yao
    Xiang, Tian-Zhu
    Zhao, Fang
    Zhang, Zheng
    Shao, Ling
    Li, Xuelong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (11) : 9575 - 9582
  • [30] Zero-Shot Learning With Attentive Region Embedding and Enhanced Semantics
    Liu, Yang
    Dang, Yuhao
    Gao, Xinbo
    Han, Jungong
    Shao, Ling
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (03) : 4220 - 4231