SAC-GAN: Face Image Inpainting with Spatial-Aware Attribute Controllable GAN

被引:0
|
作者
Cha, Dongmin [1 ]
Kim, Taehun [1 ]
Lee, Joonyeong [1 ]
Kim, Dajin [1 ]
机构
[1] Pohang Univ Sci & Technol POSTECH, Dept CSE, Pohang, South Korea
来源
关键词
D O I
10.1007/978-3-031-26293-7_13
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The objective of image inpainting is refilling the masked area with semantically appropriate pixels and producing visually realistic images as an output. After the introduction of generative adversarial networks (GAN), many inpainting approaches are showing promising development. Several attempts have been recently made to control reconstructed output with the desired attribute on face images using exemplar images and style vectors. Nevertheless, conventional style vector has the limitation that to project style attribute representation onto linear vector without preserving dimensional information. We introduce spatial-aware attribute controllable GAN (SAC-GAN) for face image inpainting, which is effective for reconstructing masked images with desired controllable facial attributes with advantage of utilizing style tensors as spatial forms. Various experiments to control over facial characteristics demonstrate the superiority of our method compared with previous image inpainting methods.
引用
收藏
页码:202 / 218
页数:17
相关论文
共 50 条
  • [41] Dual-path Image Inpainting with Auxiliary GAN Inversion
    Wang, Wentao
    Niu, Li
    Zhang, Jianfu
    Yang, Xue
    Zhang, Liqing
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 11411 - 11420
  • [42] Spatial-Aware Remote Sensing Image Generation From Spatial Relationship Descriptions
    Lei, Yaxian
    Tong, Xiaochong
    Qiu, Chunping
    Song, Haoshuai
    Guo, Congzhou
    Li, He
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2025, 22
  • [43] FA-GAN: FEATURE-AWARE GAN FOR TEXT TO IMAGE SYNTHESIS
    Jeon, Eunyeong
    Kim, Kunhee
    Kim, Daijin
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 2443 - 2447
  • [44] Face Attribute Manipulation Based on Self-Perception GAN
    Tu, X. G.
    Luo, Y.
    Zhang, H. S.
    Ai, W. J.
    Ma, Z.
    Xie, M.
    2020 4TH INTERNATIONAL CONFERENCE ON MACHINE VISION AND INFORMATION TECHNOLOGY (CMVIT 2020), 2020, 1518
  • [45] Spatial Fusion GAN for Image Synthesis
    Zhan, Fangneng
    Zhu, Hongyuan
    Lu, Shijian
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3648 - 3657
  • [46] Spatial-Aware Collaborative Representation for Hyperspectral Remote Sensing Image Classification
    Jiang, Junjun
    Chen, Chen
    Yu, Yi
    Jiang, Xinwei
    Ma, Jiayi
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (03) : 404 - 408
  • [47] Cross-Domain Face Synthesis using a Controllable GAN
    Mokhayeri, Fania
    Kamali, Kaveh
    Granger, Eric
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 241 - 249
  • [48] Customizable GAN: A Method for Image Synthesis of Human Controllable
    Zhang, Zhiqiang
    Yu, Wenxin
    Zhou, Jinjia
    Zhang, Xuewen
    Jiang, Ning
    He, Gang
    Yang, Zhuo
    IEEE ACCESS, 2020, 8 (08): : 108004 - 108017
  • [49] Face Image Completion Based on GAN Prior
    Shao, Xiaofeng
    Qiang, Zhenping
    Dai, Fei
    He, Libo
    Lin, Hong
    ELECTRONICS, 2022, 11 (13)
  • [50] Robust face alignment by dual-attentional spatial-aware capsule networks
    Ma, Jinyan
    Li, Jing
    Du, Bo
    Wu, Jia
    Wan, Jun
    Xiao, Yafu
    PATTERN RECOGNITION, 2022, 122