Disentangled Image Attribute Editing in Latent Space via Mask-based Retention Loss

被引:0
|
作者
Ohaga, Shunya [1 ]
Togo, Ren [1 ]
Ogawa, Takahiro [1 ]
Haseyama, Miki [1 ]
机构
[1] Hokkaido Univ, Sapporo, Hokkaido, Japan
关键词
computer vision; image editing; image manipulation;
D O I
10.1145/3551626.3564949
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
We propose an image attribute editing method with the mask-based retention loss. Although conventional image attribute editing methods can edit a particular attribute, they cannot retain non-editing attributes including unknown attributes before and after editing, which causes unexpected changes in the edited images. We solve this problem by dividing the pre- and post-edited images into the editing and non-editing regions and increasing the image similarity in the non-editing regions. In this paper, we introduce the novel mask-based retention loss to retain the non-editing regions. To compute the mask-based retention loss, we divide the images into the editing and non-editing regions by using a binary mask generated from the difference between the pre- and post-edited images. Experimental results show that our proposed method is qualitatively and quantitatively superior to state-of-the-art methods.
引用
收藏
页数:7
相关论文
共 50 条
  • [41] A novel attribute-based generation architecture for facial image editing
    Defang Li
    Min Zhang
    Lifang Zhang
    Weifu Chen
    Guocan Feng
    Multimedia Tools and Applications, 2021, 80 : 4881 - 4902
  • [42] A novel attribute-based generation architecture for facial image editing
    Li, Defang
    Zhang, Min
    Zhang, Lifang
    Chen, Weifu
    Feng, Guocan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (04) : 4881 - 4902
  • [43] L2M-GAN: Learning to Manipulate Latent Space Semantics for Facial Attribute Editing
    Yang, Guoxing
    Fei, Nanyi
    Ding, Mingyu
    Liu, Guangzhen
    Lu, Zhiwu
    Xiang, Tao
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 2950 - 2959
  • [44] Explainability in image captioning based on the latent space
    Elguendouze, Sofiane
    Hafiane, Adel
    de Souto, Marcilio C. P.
    Halftermeyer, Anais
    NEUROCOMPUTING, 2023, 546
  • [45] Structuring unbreakable and autoclavable hydrophobic barriers in paper via direct printing and mask-based photolithography
    Nargang, Tobias M.
    Dierkes, Robert
    Bruchmann, Julia
    Keller, Nico
    Sachsenheimer, Kai
    Kotz, Frederik
    Helmer, Dorothea
    Rapp, Bastian E.
    MICROFLUIDICS, BIOMEMS, AND MEDICAL MICROSYSTEMS XVII, 2019, 10875
  • [46] Image Segmentation Based on the Analysis of Distances in an Attribute Space
    Chochia, P. A.
    OPTOELECTRONICS INSTRUMENTATION AND DATA PROCESSING, 2014, 50 (06) : 613 - 624
  • [47] Likelihood-Based Generative Radiance Field with Latent Space Energy-Based Model for 3D-Aware Disentangled Image Representation
    Zhu, Yaxuan
    Xie, Jianwen
    Li, Ping
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 206, 2023, 206
  • [48] Structural MRI Harmonization via Disentangled Latent Energy-Based Style Translation
    Wu, Mengqi
    Zhang, Lintao
    Yap, Pew-Thian
    Lin, Weili
    Zhu, Hongtu
    Liu, Mingxia
    MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2023, PT I, 2024, 14348 : 1 - 11
  • [49] A Latent Space of Stochastic Diffusion Models for Zero-Shot Image Editing and Guidance
    Wu, Chen Henry
    De la Torre, Fernando
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 7344 - 7353
  • [50] Data Augmentation via Latent Space Interpolation for Image Classification
    Liu, Xiaofeng
    Zou, Yang
    Kong, Lingsheng
    Diao, Zhihui
    Yan, Junliang
    Wang, Jun
    Li, Site
    Jia, Ping
    You, Jane
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 728 - 733