PREIM3D: 3D Consistent Precise Image Attribute Editing from a Single Image

被引:5
|
作者
Li, Jianhui [1 ,2 ]
Li, Jianmin [1 ]
Zhang, Haoji [1 ]
Liu, Shilong [1 ]
Wang, Zhengyi [1 ]
Xiao, Zihao [3 ]
Zheng, Kaiwen [1 ]
Zhu, Jun [1 ]
机构
[1] Tsinghua Univ, Inst AI, Dept Comp Sci & Technol, Beijing, Peoples R China
[2] Xian Satellite Control Ctr, State Key Lab Astronaut Dynam, Xian, Peoples R China
[3] RealAI, Beijing, Peoples R China
关键词
D O I
10.1109/CVPR52729.2023.00826
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We study the 3D-aware image attribute editing problem in this paper, which has wide applications in practice. Recent methods solved the problem by training a shared encoder to map images into a 3D generator's latent space or by per-image latent code optimization and then edited images in the latent space. Despite their promising results near the input view, they still suffer from the 3D inconsistency of produced images at large camera poses and imprecise image attribute editing, like affecting unspecified attributes during editing. For more efficient image inversion, we train a shared encoder for all images. To alleviate 3D inconsistency at large camera poses, we propose two novel methods, an alternating training scheme and a multi-view identity loss, to maintain 3D consistency and subject identity. As for imprecise image editing, we attribute the problem to the gap between the latent space of real images and that of generated images. We compare the latent space and inversion manifold of GAN models and demonstrate that editing in the inversion manifold can achieve better results in both quantitative and qualitative evaluations. Extensive experiments show that our method produces more 3D consistent images and achieves more precise image editing than previous work. Source code and pretrained models can be found on our project page: https://mybabyyh.github.io/Preim3D/.
引用
收藏
页码:8549 / 8558
页数:10
相关论文
共 50 条
  • [21] 3D Character Animation Generation from a Single Image
    Lin Z.
    Huang H.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (09): : 1341 - 1350
  • [22] 3D RECONSTRUCTION BASED ON GAT FROM A SINGLE IMAGE
    Yang Dongsheng
    Kuang Ping
    Gu Xiaofeng
    2020 17TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICCWAMTIP), 2020, : 122 - 125
  • [23] 3D corrective nose reconstruction from a single image
    Yanlong Tang
    Yun Zhang
    Xiaoguang Han
    Fang-Lue Zhang
    Yu-Kun Lai
    Ruofeng Tong
    ComputationalVisualMedia, 2022, 8 (02) : 225 - 237
  • [24] 3D tree models reconstruction from a single image
    Zeng, Jiguo
    Zhang, Yan
    Zhan, Shouyi
    ISDA 2006: SIXTH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS DESIGN AND APPLICATIONS, VOL 2, 2006, : 445 - +
  • [25] 3D Human Avatar Digitization from a Single Image
    Li, Zhong
    Chen, Lele
    Liu, Celong
    Gao, Yu
    Ha, Yuanzhou
    Xu, Chenliang
    Quan, Shuxue
    Xu, Yi
    17TH ACM SIGGRAPH INTERNATIONAL CONFERENCE ON VIRTUAL-REALITY CONTINUUM AND ITS APPLICATIONS IN INDUSTRY (VRCAI 2019), 2019,
  • [26] 3D Ken Burns Effect from a Single Image
    Niklaus, Simon
    Mai, Long
    Yang, Jimei
    Liu, Feng
    ACM TRANSACTIONS ON GRAPHICS, 2019, 38 (06):
  • [27] A 3D RECONSTRUCTION OF THE HUMAN JAW FROM A SINGLE IMAGE
    Abdelrahim, Aly
    Shalaby, Ahmed
    Elhabian, Shireen
    Graham, James
    Farag, Aly
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 3622 - 3626
  • [28] Localizing object parts in 3D from a single image
    Shen YIN
    Bin ZHOU
    Mingjia YANG
    Yu ZHANG
    ScienceChina(InformationSciences), 2019, 62 (07) : 217 - 219
  • [29] Regressing a 3D Face Shape from a Single Image
    Tulyakov, Sergey
    Sebe, Nicu
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 3748 - 3755
  • [30] 3D terrain estimation from a single landscape image
    Takahashi, Haruka
    Kanamori, Yoshihiro
    Endo, Yuki
    COMPUTER ANIMATION AND VIRTUAL WORLDS, 2022, 33 (06)