Unsupervised cycle-consistent person pose transfer

被引:3
|
作者
Liu, Songyan [1 ,2 ]
Guo, Haiyun [1 ,2 ]
Zhu, Kuan [1 ,2 ]
Wang, Jinqiao [1 ,2 ]
Tang, Ming [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, 95 Zhongguancun East Rd, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Generative adversarial networks; Person pose transfer; Data augmentation;
D O I
10.1016/j.neucom.2020.10.059
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person pose transfer, i.e., transferring the pose of a given person to a target pose, is a challenging task due to the complex interplay of appearance, pose, and background. Most of the previous works adopted the supervised framework and required paired person images with the same identity and different poses, which largely limits their applications. Besides, the background of the generated image may be altered from the original one due to some over-fitting issues, which is unfavorable for the pose transfer task. To tackle the above problems, we propose an unsupervised cycle-consistent person pose transfer approach. It is trained with unpaired cross-identity person images and can well preserve the background information. Compared with previous methods, our proposed approach achieves better results in the cross-identity person pose transfer task and similar results in self-identity one. Moreover, our method can serve as an effective data augmentation scheme for person recognition tasks, which is validated by extensive experiments on pedestrian re-identification and detection. (c) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:502 / 511
页数:10
相关论文
共 50 条
  • [41] Adversarial Self-Defense for Cycle-Consistent GANs
    Bashkirova, Dina
    Usman, Ben
    Saenko, Kate
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [42] Road detection using cycle-consistent adversarial networks
    Wang, Yucheng
    Zhang, Juan
    Jiang, Hao
    Fang, Zhijun
    JOURNAL OF ELECTRONIC IMAGING, 2019, 28 (05)
  • [43] Visible-infrared person re-identification with data augmentation via cycle-consistent adversarial network
    Xia, Daoxun
    Liu, Haojie
    Xu, Lili
    Wang, Linna
    NEUROCOMPUTING, 2021, 443 : 35 - 46
  • [44] An Unsupervised Domain Adaptation Method for Intelligent Bearing Fault Diagnosis Based on Signal Reconstruction by Cycle-Consistent Adversarial Learning
    Zhu, Wenying
    Shi, Boqiang
    Feng, Zhipeng
    Tang, Jiachen
    IEEE SENSORS JOURNAL, 2023, 23 (16) : 18477 - 18485
  • [45] TSI-GAN: Unsupervised Time Series Anomaly Detection Using Convolutional Cycle-Consistent Generative Adversarial Networks
    Saravanan, Shyam Sundar
    Luo, Tie
    Ngo, Mao Van
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2023, PT I, 2023, 13935 : 39 - 54
  • [46] xAI-CycleGAN, a Cycle-Consistent Generative Assistive Network
    Sloboda, Tibor
    Hudec, Lukas
    Benesova, Wanda
    COMPUTER VISION SYSTEMS, ICVS 2023, 2023, 14253 : 403 - 411
  • [47] Image steganography based on smooth cycle-consistent adversarial learning
    Abdollahi, Behnaz
    Harati, Ahad
    Taherinia, Amir Hossein
    JOURNAL OF INFORMATION SECURITY AND APPLICATIONS, 2023, 79
  • [48] Gender based face aging with cycle-consistent adversarial networks
    Yang, Chun
    Lv, Zhihan
    IMAGE AND VISION COMPUTING, 2020, 100
  • [49] Cycle-Consistent Inverse GAN for Text-to-Image Synthesis
    Wang, Hao
    Lin, Guosheng
    Hoi, Steven C. H.
    Miao, Chunyan
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 630 - 638
  • [50] A Transfer Learning Strategy for Rotation Machinery Fault Diagnosis based on Cycle-Consistent Generative Adversarial Networks
    Xie, Yuan
    Zhang, Tao
    2018 CHINESE AUTOMATION CONGRESS (CAC), 2018, : 1309 - 1313