Portrait Map Art Generation By Asymmetric Image-to-Image Translation

被引:2
|
作者
Zhang, Yuxin [1 ,2 ]
Tang, Fan [3 ]
Dong, Weiming [5 ,6 ]
Le, Thi-Ngoc-Hanh [4 ]
Xu, Changsheng [5 ,6 ,7 ,8 ]
Lee, Tong-Yee [4 ,9 ]
机构
[1] Chinese Acad Sci, Inst Automat, NLPR, NLPR, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100190, Peoples R China
[3] Jilin Univ, Sch Artificial Intelligence, Changchun 130012, Jilin, Peoples R China
[4] Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China
[5] Sch Artificial Intelligence, NLPR, Inst Automat, Beijing 100190, Peoples R China
[6] Natl Cheng Kung Univ, Dept Comp Sci & Informat Engn, Tainan 701, Taiwan
[7] Chinese Acad Sci, Inst Automat, NLPR, Beijing 100190, Peoples R China
[8] Sch Artificial Intelligence, Beijing 100190, Peoples R China
[9] Natl Cheng Kung Univ, Dept Comp Sci & Informat Engn, Tainan 701, Taiwan
基金
中国国家自然科学基金;
关键词
STYLE;
D O I
10.1162/leon_a_02323
中图分类号
J [艺术];
学科分类号
13 ; 1301 ;
摘要
The authors propose a deep neural network-based algorithm to automatically generate portrait map art (PMA), a modern art form created by British portrait artist Ed Fairburn. The authors formulate the generation of PMA as an adaptive dual-to-single image translation problem. The authors' proposed model analyzes the appearance of one portrait and one map image using two encoder networks and utilizes their hidden encodings as representations of the portrait and map image to generate new PMA using a decoder network. An adaptive style harmonization module is proposed to fuse the two hidden encodings. Optimized by cycle-consistency constraint, the model can produce new PMA images without baselines.
引用
收藏
页码:28 / 36
页数:9
相关论文
共 50 条
  • [1] Asymmetric GAN for Unpaired Image-to-Image Translation
    Li, Yu
    Tang, Sheng
    Zhang, Rui
    Zhang, Yongdong
    Li, Jintao
    Yan, Shuicheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (12) : 5881 - 5896
  • [2] Pixel art character generation as an image-to-image translation problem using GANs
    Coutinho, Flavio
    Chaimowicz, Luiz
    GRAPHICAL MODELS, 2024, 132
  • [3] MULTIMODAL IMAGE-TO-IMAGE TRANSLATION FOR GENERATION OF GASTRITIS IMAGES
    Togo, Ren
    Ogawa, Takahiro
    Haseyama, Miki
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2466 - 2470
  • [4] Conditional Image-to-Image translation
    Lin, Jianxin
    Xia, Yingce
    Qin, Tao
    Chen, Zhibo
    Liu, Tie-Yan
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 5524 - 5532
  • [5] Asynchronous Generative Adversarial Network for Asymmetric Unpaired Image-to-Image Translation
    Zheng, Ziqiang
    Bin, Yi
    Lv, Xiaoou
    Wu, Yang
    Yang, Yang
    Shen, Heng Tao
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 2474 - 2487
  • [6] Hypercomplex Image-to-Image Translation
    Grassucci, Eleonora
    Sigillo, Luigi
    Uncini, Aurelio
    Comminiello, Danilo
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [7] Underwater dam crack image generation based on unsupervised image-to-image translation
    Huang, Ben
    Kang, Fei
    Li, Xinyu
    Zhu, Sisi
    AUTOMATION IN CONSTRUCTION, 2024, 163
  • [8] Generative image completion with image-to-image translation
    Shuzhen Xu
    Qing Zhu
    Jin Wang
    Neural Computing and Applications, 2020, 32 : 7333 - 7345
  • [9] Generative image completion with image-to-image translation
    Xu, Shuzhen
    Zhu, Qing
    Wang, Jin
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (11): : 7333 - 7345
  • [10] Image-to-Image Translation Method for Game-Character Face Generation
    Kang, Shinjin
    Ok, Yoonchan
    Kim, Hwanhee
    Hahn, Teasung
    2020 IEEE CONFERENCE ON GAMES (IEEE COG 2020), 2020, : 628 - 631