Nonlinear hierarchical editing: A powerful framework for face editing

被引:0
|
作者
Niu, Yongjie [1 ,2 ]
Zhou, Pengbo [3 ]
Chi, Hao [4 ]
Zhou, Mingquan [1 ]
机构
[1] Northwest Univ, Sch Informat Sci & Technol, Xian, Peoples R China
[2] Yanan Univ, Coll Math & Comp Sci, Yanan, Peoples R China
[3] Beijing Normal Univ, Coll Informat Sci & Technol, Beijing, Peoples R China
[4] Shandong Water Conservancy Vocat Coll, Dept Informat Engn, Rizhao, Peoples R China
关键词
Nonlinear editing path; Hierarchical editing; Attribute entanglement; Model collapse; Effective attribute change magnitude; Continuous editing;
D O I
10.1016/j.engappai.2024.108706
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Hierarchical Generative Adversarial Networks (GANs) have achieved considerable success in generating images, yet the task of editing these images in an interpretable, prominent, and disentangled manner remains a challenging issue. In this study, we introduce a novel hierarchical editing methodology that leverages nonlinear editing paths within GAN models. Nonlinear editing paths are identified in the GAN's latent space in an unsupervised manner, and attribute evaluators are employed to automatically discern the semantics associated with these paths. Subsequently, a layer -by -layer scoring technique is utilized to pinpoint the most pertinent layer for the editing path. The latent code navigates a nonlinear path reflective of a specific semantic, with modifications confined to layers most germane to the identified semantic. This hierarchical editing strategy results in significant, disentangled, and commutative editing outcomes. Compared to the current state-of-theart, our approach reduces side effect error by 20% to 39% in attribute disentanglement and commutativity error by 30% to 60% in continuous editing.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] An efficient framework for quantum video and video editing
    Wei, Zhanhong
    Sun, Wentao
    Zhu, Shangchao
    Han, Mengdi
    Yin, Huijuan
    INTERNATIONAL JOURNAL OF QUANTUM INFORMATION, 2023, 21 (05)
  • [42] NeRFFaceEditing: Disentangled Face Editing in Neural Radiance Fields
    Jiang, Kaiwen
    Chen, Shu-Yu
    Liu, Feng-Lin
    Fu, Hongbo
    Gao, Lin
    PROCEEDINGS SIGGRAPH ASIA 2022, 2022,
  • [43] Face attribute editing based on generative adversarial networks
    Xiaoxia Song
    Mingwen Shao
    Wangmeng Zuo
    Cunhe Li
    Signal, Image and Video Processing, 2020, 14 : 1217 - 1225
  • [44] A Latent Transformer for Disentangled Face Editing in Images and Videos
    Yao, Xu
    Newson, Alasdair
    Gousseau, Yann
    Hellier, Pierre
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 13769 - 13778
  • [45] Leonardo: A framework for modeling and editing graphical components
    Oswald, E
    MODULAR PROGRAMMING LANGUAGES, PROCEEDINGS, 2001, 1897 : 147 - 160
  • [46] Transforming the latent space of StyleGAN for real face editing
    Li, Heyi
    Liu, Jinlong
    Zhang, Xinyu
    Bai, Yunzhi
    Wang, Huayan
    Mueller, Klaus
    VISUAL COMPUTER, 2024, 40 (05): : 3553 - 3568
  • [47] Teaching editing - Learning editing
    Plachta, B
    PROBLEMS IN EDITING, 1999, 14 : 18 - +
  • [48] A framework for synchronized editing of multiple curve representations
    Grimm, C
    Ayers, M
    COMPUTER GRAPHICS FORUM, 1998, 17 (03) : C31 - C40
  • [49] Disentangling the latent space of GANs for semantic face editing
    Niu, Yongjie
    Zhou, Mingquan
    Li, Zhan
    PLOS ONE, 2023, 18 (10):
  • [50] Facial Expression Synthesis with Synchronous Editing of Face Organs
    Dai, Jiangnan
    BIOMETRIC RECOGNITION (CCBR 2021), 2021, 12878 : 139 - 147