Unsupervised cycle-consistent person pose transfer

被引:3
|
作者
Liu, Songyan [1 ,2 ]
Guo, Haiyun [1 ,2 ]
Zhu, Kuan [1 ,2 ]
Wang, Jinqiao [1 ,2 ]
Tang, Ming [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, 95 Zhongguancun East Rd, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Generative adversarial networks; Person pose transfer; Data augmentation;
D O I
10.1016/j.neucom.2020.10.059
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person pose transfer, i.e., transferring the pose of a given person to a target pose, is a challenging task due to the complex interplay of appearance, pose, and background. Most of the previous works adopted the supervised framework and required paired person images with the same identity and different poses, which largely limits their applications. Besides, the background of the generated image may be altered from the original one due to some over-fitting issues, which is unfavorable for the pose transfer task. To tackle the above problems, we propose an unsupervised cycle-consistent person pose transfer approach. It is trained with unpaired cross-identity person images and can well preserve the background information. Compared with previous methods, our proposed approach achieves better results in the cross-identity person pose transfer task and similar results in self-identity one. Moreover, our method can serve as an effective data augmentation scheme for person recognition tasks, which is validated by extensive experiments on pedestrian re-identification and detection. (c) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:502 / 511
页数:10
相关论文
共 50 条
  • [1] Unsupervised cycle-consistent deformation for shape matching
    Groueix, Thibault
    Fisher, Matthew
    Kim, Vladimir G.
    Russell, Bryan C.
    Aubry, Mathieu
    COMPUTER GRAPHICS FORUM, 2019, 38 (05) : 123 - 133
  • [2] Unsupervised Deformable Image Registration Using Cycle-Consistent CNN
    Kim, Boah
    Kim, Jieun
    Lee, June-Goo
    Kim, Dong Hwan
    Park, Seong Ho
    Ye, Jong Chul
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT VI, 2019, 11769 : 166 - 174
  • [3] Unsupervised Cycle-Consistent Generative Adversarial Networks for Pan Sharpening
    Zhou, Huanyu
    Liu, Qingjie
    Weng, Dawei
    Wang, Yunhong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] Cycle-consistent Conditional Adversarial Transfer Networks
    Li, Jingjing
    Chen, Erpeng
    Ding, Zhengming
    Zhu, Lei
    Lu, Ke
    Huang, Zi
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 747 - 755
  • [5] Unsupervised cycle-consistent adversarial attacks for visual object tracking
    Yao, Rui
    Zhu, Xiangbin
    Zhou, Yong
    Shao, Zhiwen
    Hu, Fuyuan
    Zhang, Yanning
    DISPLAYS, 2023, 80
  • [6] Unsupervised Video Summarization With Cycle-Consistent Adversarial LSTM Networks
    Yuan, Li
    Tay, Francis Eng Hock
    Li, Ping
    Feng, Jiashi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (10) : 2711 - 2722
  • [7] Unsupervised Image Dedusting via a Cycle-Consistent Generative Adversarial Network
    Gao, Guxue
    Lai, Huicheng
    Jia, Zhenhong
    REMOTE SENSING, 2023, 15 (05)
  • [8] Cycle-SUM: Cycle-Consistent Adversarial LSTM Networks for Unsupervised Video Summarization
    Yuan, Li
    Tay, Francis E. H.
    Li, Ping
    Zhou, Li
    Feng, Jiashi
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 9143 - 9150
  • [9] Unsupervised Image-to-Image Translation with Stacked Cycle-Consistent Adversarial Networks
    Li, Minjun
    Huang, Haozhi
    Ma, Lin
    Liu, Wei
    Zhang, Tong
    Jiang, Yugang
    COMPUTER VISION - ECCV 2018, PT IX, 2018, 11213 : 186 - 201
  • [10] Cycle-Consistent Speech Enhancement
    Meng, Zhong
    Li, Jinyu
    Gong, Yifan
    Juang, Biing-Hwang
    19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES, 2018, : 1165 - 1169