Unsupervised cycle-consistent person pose transfer

被引:3
|
作者
Liu, Songyan [1 ,2 ]
Guo, Haiyun [1 ,2 ]
Zhu, Kuan [1 ,2 ]
Wang, Jinqiao [1 ,2 ]
Tang, Ming [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, 95 Zhongguancun East Rd, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Generative adversarial networks; Person pose transfer; Data augmentation;
D O I
10.1016/j.neucom.2020.10.059
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person pose transfer, i.e., transferring the pose of a given person to a target pose, is a challenging task due to the complex interplay of appearance, pose, and background. Most of the previous works adopted the supervised framework and required paired person images with the same identity and different poses, which largely limits their applications. Besides, the background of the generated image may be altered from the original one due to some over-fitting issues, which is unfavorable for the pose transfer task. To tackle the above problems, we propose an unsupervised cycle-consistent person pose transfer approach. It is trained with unpaired cross-identity person images and can well preserve the background information. Compared with previous methods, our proposed approach achieves better results in the cross-identity person pose transfer task and similar results in self-identity one. Moreover, our method can serve as an effective data augmentation scheme for person recognition tasks, which is validated by extensive experiments on pedestrian re-identification and detection. (c) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:502 / 511
页数:10
相关论文
共 50 条
  • [21] Unsupervised image-to-image translation via long-short cycle-consistent adversarial networks
    Gang Wang
    Haibo Shi
    Yufei Chen
    Bin Wu
    Applied Intelligence, 2023, 53 : 17243 - 17259
  • [22] Unsupervised cycle-consistent network using restricted subspace field map for removing susceptibility artifacts in EPI
    Bao, Qingjia
    Xie, Weida
    Otikovs, Martins
    Xia, Liyang
    Xie, Han
    Liu, Xinjie
    Liu, Kewen
    Zhang, Zhi
    Chen, Fang
    Zhou, Xin
    Liu, Chaoyang
    MAGNETIC RESONANCE IN MEDICINE, 2023, 90 (02) : 458 - 472
  • [23] Unsupervised image-to-image translation via long-short cycle-consistent adversarial networks
    Wang, Gang
    Shi, Haibo
    Chen, Yufei
    Wu, Bin
    APPLIED INTELLIGENCE, 2023, 53 (14) : 17243 - 17259
  • [24] CyCADA Cycle-Consistent Adversarial Domain Adaptation
    Hoffman, Judy
    Tzeng, Eric
    Park, Taesung
    Zhu, Jun-Yan
    Isola, Phillip
    Saenko, Kate
    Efros, Alexei A.
    Darrell, Trevor
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [25] Cycle-Consistent Domain Adaptive Faster RCNN
    Zhang, Dan
    Li, Jingjing
    Xiong, Lin
    Lin, Lan
    Ye, Mao
    Yang, Shangming
    IEEE ACCESS, 2019, 7 (123903-123911) : 123903 - 123911
  • [26] Self-supervised Text Style Transfer Using Cycle-Consistent Adversarial Networks
    LA Quatra, Moreno
    Gallipoli, Giuseppe
    Cagliero, Luca
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2024, 15 (05)
  • [27] Relative Camera Pose Estimation using Synthetic Data with Domain Adaptation via Cycle-Consistent Adversarial Networks
    Chenhao Yang
    Yuyi Liu
    Andreas Zell
    Journal of Intelligent & Robotic Systems, 2021, 102
  • [28] Relative Camera Pose Estimation using Synthetic Data with Domain Adaptation via Cycle-Consistent Adversarial Networks
    Yang, Chenhao
    Liu, Yuyi
    Zell, Andreas
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2021, 102 (04)
  • [29] Neural Topic Modeling with Cycle-Consistent Adversarial Training
    Hu, Xuemeng
    Wang, Rui
    Zhou, Deyu
    Xiong, Yuxuan
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 9018 - 9030
  • [30] Colorization for anime sketches with cycle-consistent adversarial network
    Zhang G.
    Qu M.
    Jin Y.
    Song Q.
    International Journal of Performability Engineering, 2019, 15 (03) : 910 - 918