Mural inpainting progressive generative adversarial networks based on structure guided

被引:0
|
作者
Chen Y. [1 ,2 ]
Chen J. [1 ]
Tao M. [1 ]
机构
[1] School of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou
[2] Gansu Provincial Engineering Research Center for Artificial Intelligence and Graphics & Image Processing, Lanzhou
基金
中国国家自然科学基金;
关键词
double pooling feature selection; generative adversarial networks; image reconstruction; mural inpainting; structure guidance;
D O I
10.13700/j.bh.1001-5965.2021.0440
中图分类号
学科分类号
摘要
Aiming at the problems of improper structural repair and loss of mural detail reconstruction after repairing during the process of damaged mural image inpainting, mural inpainting progressive generative adversarial networks based on structure guided is proposed. Firstly, a structure generator is designed to generate the missing structure content of the mural. Secondly, the mural generator is used to generate adversarial learning, and combined with the improved double pooling SKNet multi-scale feature extraction modular, the repaired structure image is used to guide the damaged mural to achieve progressive repair, which improves the detailed feature learning ability of the mural. Lastly, the reconstruction of the structural picture and the mural image is finished using the local discriminator and the global discriminator, which improves the overall consistency of the mural restoration result. Experiments on digital restoration of real Dunhuang murals show that the proposed method can effectively repair damaged Dunhuang murals, and the restored murals have a stronger structure and high-quality texture details than other comparison algorithms. Meanwhile, the proposed has better both subjective and objective evaluation. © 2023 Beijing University of Aeronautics and Astronautics (BUAA). All rights reserved.
引用
收藏
页码:1247 / 1259
页数:12
相关论文
共 22 条
  • [1] WANG H, LI Q Q, JIA S., A global and local feature weighted method for ancient murals inpainting, International Journal of Machine Learning and Cybernetics, 11, 6, pp. 1197-1216, (2020)
  • [2] SHAO H, WANG Y X., Generative image inpainting with salient prior and relative total variation, Journal of Visual Communication and Image Representation, 79, (2021)
  • [3] BRKIC A L, MITROVIC D, NOVAK A., On the image inpainting problem from the viewpoint of a nonlocal Cahn-Hilliard type equation, Journal of Advanced Research, 25, pp. 67-76, (2020)
  • [4] YANG X H, GUO B L, XIAO Z L, Et al., Improved structure tensor for fine-grained texture inpainting, Signal Processing:Image Communication, 73, pp. 84-95, (2019)
  • [5] FAN Y., Damaged region filling by improved criminisi image inpainting algorithm for thangka, Cluster Computing, 22, 6, pp. 13683-13691, (2019)
  • [6] LI P, CHEN W G, NG M K., Compressive total variation for image reconstruction and restoration, Computers and Mathematics with Applications, 80, 5, pp. 874-893, (2020)
  • [7] BINI A A., Image restoration via DOST and total variation regularisation, IET Image Processing, 13, 3, pp. 458-468, (2019)
  • [8] WAN W, HUANG H Y, LIU J., Local block operators and TV regularization based image inpainting, Inverse Problems & Imaging, 12, 6, pp. 1389-1410, (2018)
  • [9] CHEN Y, AI Y P, GUO H G., Improved curvature-driven model of Dunhuang mural restoration algorithm, Journal of Computer Aided Design and Graphics, 32, 5, pp. 787-796, (2020)
  • [10] QIN J, BAI H H, ZHAO Y., Multi-scale attention network for image inpainting, Computer Vision and Image Understanding, 204, (2021)