LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions

被引:23
|
作者
Yuksel, Oguz Kaan [1 ]
Simsar, Enis [2 ,3 ]
Er, Ezgi Gulperi [3 ]
Yanardag, Pinar [3 ]
机构
[1] Ecole Polytech Fed Lausanne, Lausanne, Switzerland
[2] Tech Univ Munich, Munich, Germany
[3] Bogazici Univ, Istanbul, Turkey
关键词
D O I
10.1109/ICCV48922.2021.01400
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent research has shown that it is possible to find interpretable directions in the latent spaces of pre-trained Generative Adversarial Networks (GANs). These directions enable controllable image generation and support a wide range of semantic editing operations, such as zoom or rotation. The discovery of such directions is often done in a supervised or semi-supervised manner and requires manual annotations which limits their use in practice. In comparison, unsupervised discovery allows finding subtle directions that are difficult to detect a priori. In this work, we propose a contrastive learning-based approach to discover semantic directions in the latent space of pre-trained GANs in a selfsupervised manner. Our approach finds semantically meaningful dimensions compatible with state-of-the-art methods.
引用
收藏
页码:14243 / 14252
页数:10
相关论文
共 50 条
  • [21] Unsupervised Interpretable Pattern Discovery in Time Series Using Autoencoders
    Bascol, Kevin
    Emonet, Remi
    Fromont, Elisa
    Odobez, Jean-Marc
    STRUCTURAL, SYNTACTIC, AND STATISTICAL PATTERN RECOGNITION, S+SSPR 2016, 2016, 10029 : 427 - 438
  • [22] Unsupervised contrastive learning for seismic facies characterization
    Li, Jintao
    Wu, Xinming
    Ye, Yueming
    Yang, Cun
    Hu, Zhanxuan
    Sun, Xiaoming
    Zhao, Tao
    GEOPHYSICS, 2023, 88 (01) : WA81 - WA89
  • [23] UNSUPERVISED CONTRASTIVE LEARNING OF SOUND EVENT REPRESENTATIONS
    Fonseca, Eduardo
    Ortego, Diego
    McGuinness, Kevin
    O'Connor, Noel E.
    Serra, Xavier
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 371 - 375
  • [24] Unsupervised Image Enhancement via Contrastive Learning
    Li, Di
    Rahardja, Susanto
    2024 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS 2024, 2024,
  • [25] CONTRASTIVE UNSUPERVISED LEARNING FOR SPEECH EMOTION RECOGNITION
    Li, Mao
    Yang, Bo
    Levy, Joshua
    Stolcke, Andreas
    Rozgic, Viktor
    Matsoukas, Spyros
    Papayiannis, Constantinos
    Bone, Daniel
    Wang, Chao
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 6329 - 6333
  • [26] DetCo: Unsupervised Contrastive Learning for Object Detection
    Xie, Enze
    Ding, Jian
    Wang, Wenhai
    Zhan, Xiaohang
    Xu, Hang
    Sun, Peize
    Li, Zhenguo
    Luo, Ping
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 8372 - 8381
  • [27] Unsupervised discriminative projection based on contrastive learning
    Yang, Jingwen
    Zhang, Hongjie
    Zhou, Ruojin
    Hao, Zhuangzhuang
    Jing, Ling
    KNOWLEDGE-BASED SYSTEMS, 2024, 301
  • [28] Extending Contrastive Learning to Unsupervised Redundancy Identification
    Ju, Jeongwoo
    Jung, Heechul
    Kim, Junmo
    APPLIED SCIENCES-BASEL, 2022, 12 (04):
  • [29] Contrastive Learning for Unsupervised Video Highlight Detection
    Badamdorj, Taivanbat
    Rochan, Mrigank
    Wang, Yang
    Cheng, Li
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 14022 - 14032
  • [30] A Theoretical Analysis of Contrastive Unsupervised Representation Learning
    Arora, Sanjeev
    Khandeparkar, Hrishikesh
    Khodak, Mikhail
    Plevrakis, Orestis
    Saunshi, Nikunj
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97