Unsupervised Image to Image Translation With Additional Mask

被引:1
|
作者
Choi, Hyun-Tae [1 ]
Sohn, Bong-Soo [2 ]
Hong, Byung-Woo [1 ]
机构
[1] Chung Ang Univ, Dept Artificial Intelligence, Seoul 06974, South Korea
[2] Chung Ang Univ, Dept Comp Sci, Seoul 06974, South Korea
基金
新加坡国家研究基金会;
关键词
Generative adversarial network; multi-modal image-to-image translation;
D O I
10.1109/ACCESS.2023.3322146
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of deep learning, the performance of image-to-image translation is also increasing. However, most of the image-to-image translation models depend on the implicit method which does not explain why the models alter specific parts of the original input images. In this work, we assume that we can control the extent to which the models translate the input images using an explicit method. We explicitly create masks that will be added to the input images, aiming to highlight the difference between the inputs and the translated images. Since limiting the area of the masks directly affects the shape of the translated images, we can adjust the model through a simple regularization parameter. Our proposed method demonstrates that a simple regularization parameter, which regularizes the generated masks, can control where the model needs to change and remain. Furthermore, by adjusting the degree of the regularization parameter, we can generate diverse translated images from one original image.
引用
收藏
页码:110522 / 110529
页数:8
相关论文
共 50 条
  • [31] Latent Filter Scaling for Multimodal Unsupervised Image-to-Image Translation
    Alharbi, Yazeed
    Smith, Neil
    Wonka, Peter
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 1458 - 1466
  • [32] Towards Unsupervised Deformable-Instances Image-to-Image Translation
    Su, Sitong
    Song, Jingkuan
    Gao, Lianli
    Zhu, Junchen
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 1004 - 1010
  • [33] Semantically Consistent Image-to-Image Translation for Unsupervised Domain Adaptation
    Brehm, Stephan
    Scherer, Sebastian
    Lienhart, Rainer
    ICAART: PROCEEDINGS OF THE 14TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE - VOL 2, 2022, : 131 - 141
  • [34] Unsupervised Deep Learning for Medical Image Translation
    Schaefferkoetter, Josh
    Ortega, Claudia
    Metser, Ur
    Veit-Haibach, Patrick
    JOURNAL OF NUCLEAR MEDICINE, 2020, 61
  • [35] Unsupervised image translation with distributional semantics awareness
    Peng, Zhexi
    Wang, He
    Weng, Yanlin
    Yang, Yin
    Shao, Tianjia
    COMPUTATIONAL VISUAL MEDIA, 2023, 9 (03) : 619 - 631
  • [36] Unsupervised image translation with distributional semantics awareness
    Zhexi Peng
    He Wang
    Yanlin Weng
    Yin Yang
    Tianjia Shao
    Computational Visual Media, 2023, 9 : 619 - 631
  • [37] Retrieval Guided Unsupervised Multi-domain Image-to-Image Translation
    Gomez, Raul
    Liu, Yahui
    De Nadai, Marco
    Karatzas, Dimosthenis
    Lepri, Bruno
    Sebe, Nicu
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 3164 - 3172
  • [38] Multimodal Unsupervised Image-to-Image Translation Without Independent Style Encoder
    Sun, Yanbei
    Lu, Yao
    Lu, Haowei
    Zhao, Qingjie
    Wang, Shunzhou
    MULTIMEDIA MODELING (MMM 2022), PT I, 2022, 13141 : 624 - 636
  • [39] SPatchGAN: A Statistical Feature Based Discriminator for Unsupervised Image-to-Image Translation
    Shao, Xuning
    Zhang, Weidong
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 6526 - 6535
  • [40] Unsupervised image-to-image translation by semantics consistency and self-attention
    Zhang Zhibin
    Xue Wanli
    Fu Guokai
    OPTOELECTRONICS LETTERS, 2022, 18 (03) : 175 - 180