Unsupervised cycle-consistent person pose transfer

被引:3
|
作者
Liu, Songyan [1 ,2 ]
Guo, Haiyun [1 ,2 ]
Zhu, Kuan [1 ,2 ]
Wang, Jinqiao [1 ,2 ]
Tang, Ming [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, 95 Zhongguancun East Rd, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Generative adversarial networks; Person pose transfer; Data augmentation;
D O I
10.1016/j.neucom.2020.10.059
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person pose transfer, i.e., transferring the pose of a given person to a target pose, is a challenging task due to the complex interplay of appearance, pose, and background. Most of the previous works adopted the supervised framework and required paired person images with the same identity and different poses, which largely limits their applications. Besides, the background of the generated image may be altered from the original one due to some over-fitting issues, which is unfavorable for the pose transfer task. To tackle the above problems, we propose an unsupervised cycle-consistent person pose transfer approach. It is trained with unpaired cross-identity person images and can well preserve the background information. Compared with previous methods, our proposed approach achieves better results in the cross-identity person pose transfer task and similar results in self-identity one. Moreover, our method can serve as an effective data augmentation scheme for person recognition tasks, which is validated by extensive experiments on pedestrian re-identification and detection. (c) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:502 / 511
页数:10
相关论文
共 50 条
  • [31] 3D Pelvic CT-MR Deformable Registration Using Unsupervised Cycle-Consistent FCN
    Guo, Y.
    Wu, X.
    Wang, Z.
    Pei, X.
    Xu, X.
    MEDICAL PHYSICS, 2020, 47 (06) : E564 - E564
  • [32] Learning Cycle-Consistent Cooperative Networks via Alternating MCMC Teaching for Unsupervised Cross-Domain Translation
    Xie, Jianwen
    Zheng, Zilong
    Fang, Xiaolin
    Zhu, Song-Chun
    Wu, Ying Nian
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 10430 - 10440
  • [33] Selective transfer cycle GAN for unsupervised person re-identification
    Dai, Chengqiu
    Peng, Cheng
    Chen, Min
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (17-18) : 12597 - 12613
  • [34] Blind Image Restoration Based on Cycle-Consistent Network
    Wu, Shixiang
    Dong, Chao
    Qiao, Yu
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1111 - 1124
  • [35] Interactive Elearning Application for Cycle-Consistent Adversarial Networks
    Dragomir, Marilena-Catalina
    Pupezescu, Valentin
    PROCEEDINGS OF THE 15TH INTERNATIONAL CONFERENCE ON VIRTUAL LEARNING (ICVL-2020), 2020, : 439 - 444
  • [36] Cycle-Consistent Learning for Fetal Cortical Surface Reconstruction
    Dong, Xiuyu
    Wu, Zhengwang
    Ma, Laifa
    Wang, Ya
    Tang, Kaibo
    Zhang, He
    Lin, Weili
    Li, Gang
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT VII, 2024, 15007 : 212 - 222
  • [37] Selective transfer cycle GAN for unsupervised person re-identification
    Chengqiu Dai
    Cheng Peng
    Min Chen
    Multimedia Tools and Applications, 2020, 79 : 12597 - 12613
  • [38] Generating Cuneiform Signs with Cycle-Consistent Adversarial Networks
    Rusakov, Eugen
    Brandenbusch, Kai
    Fisseler, Denis
    Somel, Turna
    Fink, Gernot A.
    Weichert, Frank
    Muller, Gerfrid G. W.
    PROCEEDINGS OF THE 2019 WORKSHOP ON HISTORICAL DOCUMENT IMAGING AND PROCESSING (HIP' 19), 2019, : 19 - 24
  • [39] Towards Cycle-Consistent Models for Text and Image Retrieval
    Cornia, Marcella
    Baraldi, Lorenzo
    Tavakoli, Hamed R.
    Cucchiara, Rita
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT IV, 2019, 11132 : 687 - 691
  • [40] A Condition Number for Joint Optimization of Cycle-Consistent Networks
    Guibas, Leonidas
    Huang, Qixing
    Liang, Zhenxiao
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32