Unsupervised Image to Image Translation With Additional Mask

被引:1
|
作者
Choi, Hyun-Tae [1 ]
Sohn, Bong-Soo [2 ]
Hong, Byung-Woo [1 ]
机构
[1] Chung Ang Univ, Dept Artificial Intelligence, Seoul 06974, South Korea
[2] Chung Ang Univ, Dept Comp Sci, Seoul 06974, South Korea
基金
新加坡国家研究基金会;
关键词
Generative adversarial network; multi-modal image-to-image translation;
D O I
10.1109/ACCESS.2023.3322146
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of deep learning, the performance of image-to-image translation is also increasing. However, most of the image-to-image translation models depend on the implicit method which does not explain why the models alter specific parts of the original input images. In this work, we assume that we can control the extent to which the models translate the input images using an explicit method. We explicitly create masks that will be added to the input images, aiming to highlight the difference between the inputs and the translated images. Since limiting the area of the masks directly affects the shape of the translated images, we can adjust the model through a simple regularization parameter. Our proposed method demonstrates that a simple regularization parameter, which regularizes the generated masks, can control where the model needs to change and remain. Furthermore, by adjusting the degree of the regularization parameter, we can generate diverse translated images from one original image.
引用
收藏
页码:110522 / 110529
页数:8
相关论文
共 50 条
  • [41] Domain Bridge for Unpaired Image-to-Image Translation and Unsupervised Domain Adaptation
    Pizzati, Fabio
    de Charette, Raoul
    Zaccaria, Michela
    Cerri, Pietro
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 2979 - 2987
  • [42] Unsupervised Multimodal Image-to-Image Translation: Generate What You Want
    Zhang, Chao
    Xi, Wei
    Liu, Xinhui
    Bai, Gairui
    Sun, Jingtong
    Yu, Fan
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [43] Unsupervised Sketch-to-Image Translation Network for Single Category Image Synthesis
    Deng, Wanyu
    Feng, Xiaoting
    Li, Qirui
    Xu, Huijiao
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 6616 - 6621
  • [44] UNSUPERVISED IMAGE-TO-IMAGE TRANSLATION VIA FAIR REPRESENTATI ON OF GENDER BIAS
    Hwang, Sunhee
    Byun, Hyeran
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 1953 - 1957
  • [45] Smoothing the Disentangled Latent Style Space for Unsupervised Image-to-Image Translation
    Liu, Yahui
    Sangineto, Enver
    Chen, Yajing
    Bao, Linchao
    Zhang, Haoxian
    Sebe, Nicu
    Lepri, Bruno
    Wang, Wei
    De Nadai, Marco
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 10780 - 10789
  • [46] Unsupervised Generative Adversarial Network for Plantar Pressure Image-to-Image Translation
    Ahmadian, Mona
    Beheshti, Mohammad T. H.
    Kalhor, Ahmad
    Shirian, Amir
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 2580 - 2583
  • [47] Multi-Constraint Adversarial Networks for Unsupervised Image-to-Image Translation
    Saxena, Divya
    Kulshrestha, Tarun
    Cao, Jiannong
    Cheung, Shing-Chi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 1601 - 1612
  • [48] Allowing Supervision in Unsupervised Deformable- Instances Image-to-Image Translation
    Liu, Yu
    Su, Sitong
    Zhu, Junchen
    Zheng, Feng
    Gao, Lianli
    Song, Jingkuan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 5335 - 5349
  • [49] Unsupervised image-to-image translation by semantics consistency and self-attention
    Zhibin Zhang
    Wanli Xue
    Guokai Fu
    Optoelectronics Letters, 2022, 18 : 175 - 180
  • [50] CR-UNIT: UNSUPERVISED IMAGE-TO-IMAGE TRANSLATION WITH CONTENT RECONSTRUCTION
    Shi, Xiao-Wen
    Wang, Yuan-Gen
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1165 - 1169