The Devil is in the Details: StyleFeatureEditor for Detail-Rich StyleGAN Inversion and High Quality Image Editing

被引:1
|
作者
机构
来源
2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) | 2024年
关键词
D O I
10.1109/CVPR52733.2024.00892
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The task of manipulating real image attributes through StyleGAN inversion has been extensively researched. This process involves searching latent variables from a well-trained StyleGAN generator that can synthesize a real image, modifying these latent variables, and then synthesizing an image with the desired edits. A balance must be struck between the quality of the reconstruction and the ability to edit. Earlier studies utilized the low-dimensional W-space for latent search, which facilitated effective editing but struggled with reconstructing intricate details. More recent research has turned to the high-dimensional feature space F, which successfully inverses the input image but loses much of the detail during editing. In this paper, we introduce StyleFeatureEditor - a novel method that enables editing in both w-latents and F-latents. This technique not only allows for the reconstruction of finer image details but also ensures their preservation during editing. We also present a new training pipeline specifically designed to train our model to accurately edit F-latents. Our method is compared with state-of-the-art encoding approaches, demonstrating that our model excels in terms of reconstruction quality and is capable of editing even challenging out-of-domain examples.
引用
收藏
页码:9337 / 9346
页数:10
相关论文
共 11 条
  • [1] Delving StyleGAN Inversion for Image Editing: A Foundation Latent Space Viewpoint
    Liu, Hongyu
    Song, Yibing
    Chen, Qifeng
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 10072 - 10082
  • [2] CLIP-guided StyleGAN Inversion for Text-driven Real Image Editing
    Baykal, Ahmet Canberk
    Anees, Abdul Basit
    Ceylan, Duygu
    Erdem, Erkut
    Erdem, Aykut
    Yuret, Deniz
    ACM TRANSACTIONS ON GRAPHICS, 2023, 42 (05):
  • [3] Predicting the Invariance behind Residuals: A Novel GAN Inversion Method for Image Editing and Detail Retaining
    Yan, Zhimo
    Xu, Jinfeng
    He, Hengyang
    Li, Shengxi
    Yang, Ren
    Xu, Mai
    Zhu, Ce
    2023 IEEE 25TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, MMSP, 2023,
  • [4] High-Fidelity GAN Inversion for Image Attribute Editing
    Wang, Tengfei
    Zhang, Yong
    Fan, Yanbo
    Wang, Jue
    Chen, Qifeng
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 11369 - 11378
  • [5] Conditional reiterative High-Fidelity GAN inversion for image editing
    Dere, Vedant Vasant
    Shinde, Amita
    Vast, Prachi
    PATTERN RECOGNITION, 2024, 147
  • [6] High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD
    Cao, Xiangang
    Wei, Hengyang
    Wang, Peng
    Zhang, Chiyu
    Huang, Shikai
    Li, Hu
    SENSORS, 2023, 23 (01)
  • [7] LAMA-WAVELET: IMAGE IMPAINTING WITH HIGH QUALITY OF FINE DETAILS AND OBJECT EDGES
    Kolodochka, D. O.
    Polyakova, M. V.
    RADIO ELECTRONICS COMPUTER SCIENCE CONTROL, 2024, (01) : 208 - 220
  • [8] Photograph registration of petri dishes in high quality and image editing of microbiological assays
    Cleverson Rodrigues
    Grace Queiroz David
    André Rodrigues dos Reis
    International Microbiology, 2022, 25 : 561 - 570
  • [9] Photograph registration of petri dishes in high quality and image editing of microbiological assays
    Rodrigues, Cleverson
    David, Grace Queiroz
    dos Reis, Andre Rodrigues
    INTERNATIONAL MICROBIOLOGY, 2022, 25 (03) : 561 - 570
  • [10] High-Quality Text-to-Image Generation Using High-Detail Feature-Preserving Network
    Hsu, Wei-Yen
    Lin, Jing-Wen
    APPLIED SCIENCES-BASEL, 2025, 15 (02):