Portrait Map Art Generation By Asymmetric Image-to-Image Translation

被引:2
|
作者
Zhang, Yuxin [1 ,2 ]
Tang, Fan [3 ]
Dong, Weiming [5 ,6 ]
Le, Thi-Ngoc-Hanh [4 ]
Xu, Changsheng [5 ,6 ,7 ,8 ]
Lee, Tong-Yee [4 ,9 ]
机构
[1] Chinese Acad Sci, Inst Automat, NLPR, NLPR, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100190, Peoples R China
[3] Jilin Univ, Sch Artificial Intelligence, Changchun 130012, Jilin, Peoples R China
[4] Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China
[5] Sch Artificial Intelligence, NLPR, Inst Automat, Beijing 100190, Peoples R China
[6] Natl Cheng Kung Univ, Dept Comp Sci & Informat Engn, Tainan 701, Taiwan
[7] Chinese Acad Sci, Inst Automat, NLPR, Beijing 100190, Peoples R China
[8] Sch Artificial Intelligence, Beijing 100190, Peoples R China
[9] Natl Cheng Kung Univ, Dept Comp Sci & Informat Engn, Tainan 701, Taiwan
基金
中国国家自然科学基金;
关键词
STYLE;
D O I
10.1162/leon_a_02323
中图分类号
J [艺术];
学科分类号
13 ; 1301 ;
摘要
The authors propose a deep neural network-based algorithm to automatically generate portrait map art (PMA), a modern art form created by British portrait artist Ed Fairburn. The authors formulate the generation of PMA as an adaptive dual-to-single image translation problem. The authors' proposed model analyzes the appearance of one portrait and one map image using two encoder networks and utilizes their hidden encodings as representations of the portrait and map image to generate new PMA using a decoder network. An adaptive style harmonization module is proposed to fuse the two hidden encodings. Optimized by cycle-consistency constraint, the model can produce new PMA images without baselines.
引用
收藏
页码:28 / 36
页数:9
相关论文
共 50 条
  • [21] Correction to: Generative image completion with image-to-image translation
    Shuzhen Xu
    Qing Zhu
    Jin Wang
    Neural Computing and Applications, 2020, 32 : 17809 - 17809
  • [22] Unsupervised Image-to-Image Translation with Generative Prior
    Yang, Shuai
    Jiang, Liming
    Liu, Ziwei
    Loy, Chen Change
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 18311 - 18320
  • [23] Leveraging Local Domains for Image-to-Image Translation
    Dell'Eva, Anthony
    Pizzati, Fabio
    Bertozzi, Massimo
    de Charette, Raoul
    PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2022, : 179 - 189
  • [24] Unsupervised Image-to-Image Translation with Style Consistency
    Lai, Binxin
    Wang, Yuan-Gen
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT VI, 2024, 14430 : 322 - 334
  • [25] Image-to-Image Translation with Conditional Adversarial Networks
    Isola, Phillip
    Zhu, Jun-Yan
    Zhou, Tinghui
    Efros, Alexei A.
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5967 - 5976
  • [26] Breaking the Dilemma of Medical Image-to-image Translation
    Kong, Lingke
    Lian, Chenyu
    Huang, Detian
    Li, Zhenjiang
    Hu, Yanle
    Zhou, Qichao
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [27] Random Reconstructed Unpaired Image-to-Image Translation
    Zhang, Xiaoqin
    Fan, Chenxiang
    Xiao, Zhiheng
    Zhao, Li
    Chen, Huiling
    Chang, Xiaojun
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (03) : 3144 - 3154
  • [28] Research on Image-to-Image Translation with Capsule Network
    Ye, Jian
    Chang, Qing
    Jia, Xiaotian
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: THEORETICAL NEURAL COMPUTATION, PT I, 2019, 11727 : 141 - 151
  • [29] Edge Sensitive Unsupervised Image-to-Image Translation
    Akkaya, Ibrahim Batuhan
    Halici, Ugur
    2020 28TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2020,
  • [30] Zero-shot Image-to-Image Translation
    Parmar, Gaurav
    Singh, Krishna Kumar
    Zhang, Richard
    Li, Yijun
    Lu, Jingwan
    Zhu, Jun-Yan
    PROCEEDINGS OF SIGGRAPH 2023 CONFERENCE PAPERS, SIGGRAPH 2023, 2023,