SAC-GAN: Face Image Inpainting with Spatial-Aware Attribute Controllable GAN

被引:0
|
作者
Cha, Dongmin [1 ]
Kim, Taehun [1 ]
Lee, Joonyeong [1 ]
Kim, Dajin [1 ]
机构
[1] Pohang Univ Sci & Technol POSTECH, Dept CSE, Pohang, South Korea
来源
关键词
D O I
10.1007/978-3-031-26293-7_13
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The objective of image inpainting is refilling the masked area with semantically appropriate pixels and producing visually realistic images as an output. After the introduction of generative adversarial networks (GAN), many inpainting approaches are showing promising development. Several attempts have been recently made to control reconstructed output with the desired attribute on face images using exemplar images and style vectors. Nevertheless, conventional style vector has the limitation that to project style attribute representation onto linear vector without preserving dimensional information. We introduce spatial-aware attribute controllable GAN (SAC-GAN) for face image inpainting, which is effective for reconstructing masked images with desired controllable facial attributes with advantage of utilizing style tensors as spatial forms. Various experiments to control over facial characteristics demonstrate the superiority of our method compared with previous image inpainting methods.
引用
收藏
页码:202 / 218
页数:17
相关论文
共 50 条
  • [1] SAC-GAN: Structure-Aware Image Composition
    Zhou, Hang
    Ma, Rui
    Zhang, Ling-Xiao
    Gao, Lin
    Mahdavi-Amiri, Ali
    Zhang, Hao
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (07) : 3151 - 3165
  • [2] Spatial-Aware GAN for Instance-Guided Cross-Spectral Face Hallucination
    Xiao, Wenpeng
    Xu, Cheng
    Zhang, Huaidong
    Xu, Xuemiao
    ARTIFICIAL INTELLIGENCE, CICAI 2022, PT I, 2022, 13604 : 93 - 105
  • [3] Spatial-Aware GAN for Unsupervised Person Re-identification
    Zhan, Fangneng
    Zhang, Changgong
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 6889 - 6896
  • [4] Geometry-Aware GAN for Face Attribute Transfer
    Huang, Danlan
    Tao, Xiaoming
    Lu, Jianhua
    Do, Minh N.
    IEEE ACCESS, 2019, 7 : 145953 - 145969
  • [5] GEOMETRY-AWARE GAN FOR FACE ATTRIBUTE TRANSFER
    Huang, Danlan
    Tao, Xiaoming
    Lu, Jianhua
    Do, Minh N.
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 729 - 733
  • [6] Controllable Image Synthesis With Attribute-Decomposed GAN
    Pu, Guo
    Men, Yifang
    Mao, Yiming
    Jiang, Yuning
    Ma, Wei-Ying
    Lian, Zhouhui
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (02) : 1514 - 1532
  • [7] From Image to Video Face Inpainting: Spatial-Temporal Nested GAN (STN-GAN) for Usability Recovery
    Wu, Yifan
    Singh, Vivek
    Kapoor, Ankur
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 2385 - 2394
  • [8] EC-GAN: Emotion-Controllable GAN for Face Image Completion
    Chen, Yueqiao
    Yang, Wenxia
    Fang, Xi
    Han, Huan
    APPLIED SCIENCES-BASEL, 2023, 13 (13):
  • [9] Controllable Person Image Synthesis with Attribute-Decomposed GAN
    Men, Yifang
    Mao, Yiming
    Jiang, Yuning
    Ma, Wei-Ying
    Lian, Zhouhui
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 5083 - 5092
  • [10] Image Inpainting with Cascaded Modulation GAN and Object-Aware Training
    Zheng, Haitian
    Lin, Zhe
    Lu, Jingwan
    Cohen, Scott
    Shechtman, Eli
    Barnes, Connelly
    Zhang, Jianming
    Xu, Ning
    Amirghodsi, Sohrab
    Luo, Jiebo
    COMPUTER VISION - ECCV 2022, PT XVI, 2022, 13676 : 277 - 296