Nonlinear hierarchical editing: A powerful framework for face editing

被引:0
|
作者
Niu, Yongjie [1 ,2 ]
Zhou, Pengbo [3 ]
Chi, Hao [4 ]
Zhou, Mingquan [1 ]
机构
[1] Northwest Univ, Sch Informat Sci & Technol, Xian, Peoples R China
[2] Yanan Univ, Coll Math & Comp Sci, Yanan, Peoples R China
[3] Beijing Normal Univ, Coll Informat Sci & Technol, Beijing, Peoples R China
[4] Shandong Water Conservancy Vocat Coll, Dept Informat Engn, Rizhao, Peoples R China
关键词
Nonlinear editing path; Hierarchical editing; Attribute entanglement; Model collapse; Effective attribute change magnitude; Continuous editing;
D O I
10.1016/j.engappai.2024.108706
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Hierarchical Generative Adversarial Networks (GANs) have achieved considerable success in generating images, yet the task of editing these images in an interpretable, prominent, and disentangled manner remains a challenging issue. In this study, we introduce a novel hierarchical editing methodology that leverages nonlinear editing paths within GAN models. Nonlinear editing paths are identified in the GAN's latent space in an unsupervised manner, and attribute evaluators are employed to automatically discern the semantics associated with these paths. Subsequently, a layer -by -layer scoring technique is utilized to pinpoint the most pertinent layer for the editing path. The latent code navigates a nonlinear path reflective of a specific semantic, with modifications confined to layers most germane to the identified semantic. This hierarchical editing strategy results in significant, disentangled, and commutative editing outcomes. Compared to the current state-of-theart, our approach reduces side effect error by 20% to 39% in attribute disentanglement and commutativity error by 30% to 60% in continuous editing.
引用
收藏
页数:12
相关论文
共 50 条
  • [11] MODULAR NONLINEAR VIDEO EDITING
    SUTHERLAND, D
    COMPUTER GRAPHICS WORLD, 1995, 18 (05) : 70 - 72
  • [12] Powerful tools for genetic modification: Advances in gene editing
    Roesch, Erica A.
    Drumm, Mitchell L.
    PEDIATRIC PULMONOLOGY, 2017, 52 : S15 - S20
  • [13] A divide and conquer framework for Knowledge Editing
    Han, Xiaoqi
    Li, Ru
    Li, Xiaoli
    Pan, Jeff Z.
    KNOWLEDGE-BASED SYSTEMS, 2023, 279
  • [14] R-FACE: Reference guided face component editing
    Deng, Qiyao
    Cao, Jie
    Liu, Yunfan
    Li, Qi
    Sun, Zhenan
    PATTERN RECOGNITION, 2024, 152
  • [15] A framework for interactive image color editing
    Przemyslaw Musialski
    Ming Cui
    Jieping Ye
    Anshuman Razdan
    Peter Wonka
    The Visual Computer, 2013, 29 : 1173 - 1186
  • [16] A framework for interactive image color editing
    Musialski, Przemyslaw
    Cui, Ming
    Ye, Jieping
    Razdan, Anshuman
    Wonka, Peter
    VISUAL COMPUTER, 2013, 29 (11): : 1173 - 1186
  • [17] RayPortals: a light transport editing framework
    Thomas Subileau
    Nicolas Mellado
    David Vanderhaeghe
    Mathias Paulin
    The Visual Computer, 2017, 33 : 129 - 138
  • [18] Multi-level Editing of Hierarchical Documents
    Claudia-Lavinia Ignat*
    Moira C. Norrie
    Computer Supported Cooperative Work (CSCW), 2008, 17 : 423 - 468
  • [19] ImEW: A Framework for Editing Image in the Wild
    Mohiuddin, Tasnim
    Zhang, Tianyi
    Nie, Maowen
    Huang, Jing
    Chen, Qianqian
    Shi, Wei
    PROCEEDINGS OF THE 1ST WORKSHOP ON LARGE GENERATIVE MODELS MEET MULTIMODAL APPLICATIONS, LGM3A 2023, 2023, : 34 - 44
  • [20] RayPortals: a light transport editing framework
    Subileau, Thomas
    Mellado, Nicolas
    Vanderhaeghe, David
    Paulin, Mathias
    VISUAL COMPUTER, 2017, 33 (02): : 129 - 138