Disentangled Image Attribute Editing in Latent Space via Mask-based Retention Loss

被引:0
|
作者
Ohaga, Shunya [1 ]
Togo, Ren [1 ]
Ogawa, Takahiro [1 ]
Haseyama, Miki [1 ]
机构
[1] Hokkaido Univ, Sapporo, Hokkaido, Japan
关键词
computer vision; image editing; image manipulation;
D O I
10.1145/3551626.3564949
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
We propose an image attribute editing method with the mask-based retention loss. Although conventional image attribute editing methods can edit a particular attribute, they cannot retain non-editing attributes including unknown attributes before and after editing, which causes unexpected changes in the edited images. We solve this problem by dividing the pre- and post-edited images into the editing and non-editing regions and increasing the image similarity in the non-editing regions. In this paper, we introduce the novel mask-based retention loss to retain the non-editing regions. To compute the mask-based retention loss, we divide the images into the editing and non-editing regions by using a binary mask generated from the difference between the pre- and post-edited images. Experimental results show that our proposed method is qualitatively and quantitatively superior to state-of-the-art methods.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] Disentangled Face Attribute Editing via Instance-Aware Latent Space Search
    Han, Yuxuan
    Yang, Jiaolong
    Fu, Ying
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 715 - 721
  • [2] A Compact and Semantic Latent Space for Disentangled and Controllable Image Editing
    Lesne, Gwilherm
    Gousseau, Yann
    Ladjal, Said
    Newson, Alasdair
    20TH ACM SIGGRAPH EUROPEAN CONFERENCE ON VISUAL MEDIA PRODUCTION, CVMP 2023, 2023,
  • [3] Mask-based Latent Reconstruction for Reinforcement Learning
    Yu, Tao
    Zhang, Zhizheng
    Lan, Cuiling
    Lu, Yan
    Chen, Zhibo
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [4] Image-to-Image Translation With Disentangled Latent Vectors for Face Editing
    Dalva, Yusuf
    Pehlivan, Hamza
    Hatipoglu, Oyku Irmak
    Moran, Cansu
    Dundar, Aysegul
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (12) : 14777 - 14788
  • [5] Everything is There in Latent Space: Attribute Editing and Attribute Style Manipulation by StyleGAN Latent Space Exploration
    Parihar, Rishubh
    Dhiman, Ankit
    Karmali, Tejan
    Babu, R. Venkatesh
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 1828 - 1836
  • [6] StyleDiff: Attribute comparison between unlabeled datasets in latent disentangled space
    Kawano, Keisuke
    Kutsuna, Takuro
    Tokuhisa, Ryoko
    Nakamura, Akihiro
    Esaki, Yasushi
    IMAGE AND VISION COMPUTING, 2023, 138
  • [7] Mask-based second-generation connectivity and attribute filters
    Ouzounis, Georgios K.
    Wilkinson, Michael H. F.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (06) : 990 - 1004
  • [8] Attribute-Based Facial Image Manipulation on Latent Space
    Lin, Chien-Hung
    Pan, Yi-Lun
    Wu, Ja-Ling
    2021 17TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS 2021), 2021,
  • [9] On mask-based image set desensitization with recognition support
    Li, Qilong
    Liu, Ji
    Sun, Yifan
    Zhang, Chongsheng
    Dou, Dejing
    APPLIED INTELLIGENCE, 2024, 54 (01) : 886 - 898
  • [10] Image reconstruction with transformer for mask-based lensless imaging
    Pan, Xiuxi
    Chen, Xiao
    Takeyama, Saori
    Yamaguchi, Masahiro
    OPTICS LETTERS, 2022, 47 (07) : 1843 - 1846