LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions

被引:23
|
作者
Yuksel, Oguz Kaan [1 ]
Simsar, Enis [2 ,3 ]
Er, Ezgi Gulperi [3 ]
Yanardag, Pinar [3 ]
机构
[1] Ecole Polytech Fed Lausanne, Lausanne, Switzerland
[2] Tech Univ Munich, Munich, Germany
[3] Bogazici Univ, Istanbul, Turkey
关键词
D O I
10.1109/ICCV48922.2021.01400
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent research has shown that it is possible to find interpretable directions in the latent spaces of pre-trained Generative Adversarial Networks (GANs). These directions enable controllable image generation and support a wide range of semantic editing operations, such as zoom or rotation. The discovery of such directions is often done in a supervised or semi-supervised manner and requires manual annotations which limits their use in practice. In comparison, unsupervised discovery allows finding subtle directions that are difficult to detect a priori. In this work, we propose a contrastive learning-based approach to discover semantic directions in the latent space of pre-trained GANs in a selfsupervised manner. Our approach finds semantically meaningful dimensions compatible with state-of-the-art methods.
引用
收藏
页码:14243 / 14252
页数:10
相关论文
共 50 条
  • [41] Self-attentive Rationalization for Interpretable Graph Contrastive Learning
    Li, Sihang
    Luo, Yanchen
    Zhang, An
    Wang, Xiang
    Li, Longfei
    Zhou, Jun
    Chua, Tat-seng
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2025, 19 (02)
  • [42] Weakly Supervised Contrastive Learning for Unsupervised Vehicle Reidentification
    Yu, Jongmin
    Oh, Hyeontaek
    Kim, Minkyung
    Kim, Junsik
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (11) : 15543 - 15553
  • [43] Unsupervised Feature Learning for Manipulation with Contrastive Domain Randomization
    Rabinovitz, Carmel
    Grupen, Niko
    Tamar, Aviv
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 10153 - 10159
  • [44] Joint Reinforcement and Contrastive Learning for Unsupervised Video Summarization
    Zhang, Yunzuo
    Liu, Yameng
    Zhu, Pengfei
    Kang, Weili
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 2587 - 2591
  • [45] Unsupervised Structure-Adaptive Graph Contrastive Learning
    Zhao, Han
    Yang, Xu
    Deng, Cheng
    Tao, Dacheng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) : 13728 - 13740
  • [46] Unsupervised Outlier Detection Using Memory and Contrastive Learning
    Huyan, Ning
    Quan, Dou
    Zhang, Xiangrong
    Liang, Xuefeng
    Chanussot, Jocelyn
    Jiao, Licheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 6440 - 6454
  • [47] DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations
    Giorgi, John
    Nitski, Osvald
    Wang, Bo
    Bader, Gary
    59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1 (ACL-IJCNLP 2021), 2021, : 879 - 895
  • [48] PAC-Bayesian Contrastive Unsupervised Representation Learning
    Nozawa, Kento
    Germain, Pascal
    Guedj, Benjamin
    CONFERENCE ON UNCERTAINTY IN ARTIFICIAL INTELLIGENCE (UAI 2020), 2020, 124 : 21 - 30
  • [49] Unsupervised Contrastive Learning for Automatic Grouping of Aerial Swarms
    Li, Leyan
    Yang, Rennong
    Li, Huanyu
    Lv, Maolong
    Yue, Longfei Li
    Wu, Ao
    Mo, Li
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (05) : 6249 - 6258
  • [50] Instance Smoothed Contrastive Learning for Unsupervised Sentence Embedding
    He, Hongliang
    Zhang, Junlei
    Lan, Zhenzhong
    Zhang, Yue
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 11, 2023, : 12863 - 12871