Unsupervised Image to Image Translation With Additional Mask

被引:1
|
作者
Choi, Hyun-Tae [1 ]
Sohn, Bong-Soo [2 ]
Hong, Byung-Woo [1 ]
机构
[1] Chung Ang Univ, Dept Artificial Intelligence, Seoul 06974, South Korea
[2] Chung Ang Univ, Dept Comp Sci, Seoul 06974, South Korea
基金
新加坡国家研究基金会;
关键词
Generative adversarial network; multi-modal image-to-image translation;
D O I
10.1109/ACCESS.2023.3322146
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of deep learning, the performance of image-to-image translation is also increasing. However, most of the image-to-image translation models depend on the implicit method which does not explain why the models alter specific parts of the original input images. In this work, we assume that we can control the extent to which the models translate the input images using an explicit method. We explicitly create masks that will be added to the input images, aiming to highlight the difference between the inputs and the translated images. Since limiting the area of the masks directly affects the shape of the translated images, we can adjust the model through a simple regularization parameter. Our proposed method demonstrates that a simple regularization parameter, which regularizes the generated masks, can control where the model needs to change and remain. Furthermore, by adjusting the degree of the regularization parameter, we can generate diverse translated images from one original image.
引用
收藏
页码:110522 / 110529
页数:8
相关论文
共 50 条
  • [21] Unsupervised Attention-guided Image-to-Image Translation
    Mejjati, Youssef A.
    Richardt, Christian
    Tompkin, James
    Cosker, Darren
    Kim, Kwang In
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [22] Underwater dam crack image generation based on unsupervised image-to-image translation
    Huang, Ben
    Kang, Fei
    Li, Xinyu
    Zhu, Sisi
    AUTOMATION IN CONSTRUCTION, 2024, 163
  • [23] SUNIT: multimodal unsupervised image-to-image translation with shared encoder
    Lin, Liyuan
    Ji, Shulin
    Zhou, Yuan
    Zhang, Shun
    JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (01)
  • [24] Truly Unsupervised Image-to-Image Translation with Contrastive Representation Learning
    Hong, Zhiwei
    Feng, Jianxing
    Jiang, Tao
    COMPUTER VISION - ACCV 2022, PT III, 2023, 13843 : 239 - 255
  • [25] Unsupervised Image-to-Image Translation with Self-Attention Networks
    Kang, Taewon
    Lee, Kwang Hee
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP 2020), 2020, : 102 - 108
  • [26] InvolutionGAN: lightweight GAN with involution for unsupervised image-to-image translation
    Deng, Haipeng
    Wu, Qiuxia
    Huang, Han
    Yang, Xiaowei
    Wang, Zhiyong
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (22): : 16593 - 16605
  • [27] TransGaGa: Geometry-Aware Unsupervised Image-to-Image Translation
    Wu, Wayne
    Cao, Kaidi
    Li, Cheng
    Qian, Chen
    Loy, Chen Change
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 8004 - 8013
  • [28] InvolutionGAN: lightweight GAN with involution for unsupervised image-to-image translation
    Haipeng Deng
    Qiuxia Wu
    Han Huang
    Xiaowei Yang
    Zhiyong Wang
    Neural Computing and Applications, 2023, 35 : 16593 - 16605
  • [29] DUNIT: Detection-based Unsupervised Image-to-Image Translation
    Bhattacharjee, Deblina
    Kim, Seungryong
    Vizier, Guillaume
    Salzmann, Mathieu
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 4786 - 4795
  • [30] Unsupervised Exemplar-Domain Aware Image-to-Image Translation
    Fu, Yuanbin
    Ma, Jiayi
    Guo, Xiaojie
    ENTROPY, 2021, 23 (05)