Style recommendation and simulation for handmade artworks using generative adversarial networks

被引:0
|
作者
Wan, Mengzhen [1 ]
Jing, Nie [1 ]
机构
[1] Hongik Univ, Dept Fine Arts, Seoul 04066, South Korea
来源
SCIENTIFIC REPORTS | 2024年 / 14卷 / 01期
关键词
Style recommendation; Simulation; Handmade artwork; Generative adversarial network; Artificial intelligence;
D O I
10.1038/s41598-024-79144-1
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Today, artificial intelligence (AI) is used in the design and production of artworks as a powerful tool that helps artists and designers to create more creative and attractive artworks. AI as a new tool has created new opportunities to create and improve artworks. Therefore, in this study, a new model for recommending and simulating the style of handmade artworks using generative adversarial networks (GANs) is presented. This model operates in two distinct phases: style recommendation and style simulation. The reason for using these two separate phases is to increase the accuracy and efficiency of the model. In the first phase, a pre-trained GAN is used to suggest different styles to the artist. In the second phase, a new GAN specifically designed to produce realistic images of handmade artwork is used to simulate the artist's selected style. Also, in order to improve the accuracy, the genetic algorithm (GA) was used to adjust the activity configuration of Self-Attention (SA) modules. The results of a case study on two types of data, including samples without and with the initial background pattern, GA-SAGAN model has been able to significantly reduce the validation error. As a result, adjusting the activity configuration of SA modules using GA can be effective in producing realistic and accurate artworks. The outputs produced by the GA-SAGAN model have a loss rate close to zero. Also, the Entropy values and Precision and Recall indices are higher than GAN and SAGAN models, it shows the higher diversity of production output patterns and the superiority of the proposed model.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] A Style-Based Generator Architecture for Generative Adversarial Networks
    Karras, Tero
    Laine, Samuli
    Aila, Timo
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 4396 - 4405
  • [32] Styleformer: Transformer based Generative Adversarial Networks with Style Vector
    Park, Jeeseung
    Kim, Younggeun
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 8973 - 8982
  • [33] MSGAN: Generative Adversarial Networks for Image Seasonal Style Transfer
    Zhang, Fuquan
    Wang, Chuansheng
    IEEE ACCESS, 2020, 8 : 104830 - 104840
  • [34] A Style-Based Generator Architecture for Generative Adversarial Networks
    Karras, Tero
    Laine, Samuli
    Aila, Timo
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (12) : 4217 - 4228
  • [35] Style Transfer Using Generative Adversarial Networks for Multi-site MRI Harmonization
    Liu, Mengting
    Maiti, Piyush
    Thomopoulos, Sophia
    Zhu, Alyssa
    Chai, Yaqiong
    Kim, Hosung
    Jahanshad, Neda
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT III, 2021, 12903 : 313 - 322
  • [36] Style Transfer of Urban Road Images Using Generative Adversarial Networks With Structural Details
    Li, Yaochen
    Wu, Xiao
    Lu, Danhui
    Li, Ling
    Liu, Yuehu
    Zhu, Li
    IEEE MULTIMEDIA, 2020, 27 (03) : 54 - 65
  • [37] Artificial gamma ray spectra simulation using Generative Adversarial Networks (GANs) and Supervised Generative Networks (SGNs)
    de Oliveira, Felipe M. F.
    Daniel, G.
    Limousin, O.
    NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION A-ACCELERATORS SPECTROMETERS DETECTORS AND ASSOCIATED EQUIPMENT, 2023, 1047
  • [38] Restoration of damaged artworks based on a generative adversarial network
    Praveen Kumar
    Varun Gupta
    Multimedia Tools and Applications, 2023, 82 : 40967 - 40985
  • [39] Rating-Trustworthy Recommendation Model Based on Generative Adversarial Networks
    Wang Y.
    Wang S.
    Deng J.
    Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2024, 53 (03): : 396 - 403
  • [40] Generative Adversarial Network Based Service Recommendation in Heterogeneous Information Networks
    Xie, Fenfang
    Li, Shenghui
    Chen, Liang
    Xu, Yangjun
    Zheng, Zibin
    2019 IEEE INTERNATIONAL CONFERENCE ON WEB SERVICES (IEEE ICWS 2019), 2019, : 265 - 272