Style recommendation and simulation for handmade artworks using generative adversarial networks

被引:0
|
作者
Wan, Mengzhen [1 ]
Jing, Nie [1 ]
机构
[1] Hongik Univ, Dept Fine Arts, Seoul 04066, South Korea
来源
SCIENTIFIC REPORTS | 2024年 / 14卷 / 01期
关键词
Style recommendation; Simulation; Handmade artwork; Generative adversarial network; Artificial intelligence;
D O I
10.1038/s41598-024-79144-1
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Today, artificial intelligence (AI) is used in the design and production of artworks as a powerful tool that helps artists and designers to create more creative and attractive artworks. AI as a new tool has created new opportunities to create and improve artworks. Therefore, in this study, a new model for recommending and simulating the style of handmade artworks using generative adversarial networks (GANs) is presented. This model operates in two distinct phases: style recommendation and style simulation. The reason for using these two separate phases is to increase the accuracy and efficiency of the model. In the first phase, a pre-trained GAN is used to suggest different styles to the artist. In the second phase, a new GAN specifically designed to produce realistic images of handmade artwork is used to simulate the artist's selected style. Also, in order to improve the accuracy, the genetic algorithm (GA) was used to adjust the activity configuration of Self-Attention (SA) modules. The results of a case study on two types of data, including samples without and with the initial background pattern, GA-SAGAN model has been able to significantly reduce the validation error. As a result, adjusting the activity configuration of SA modules using GA can be effective in producing realistic and accurate artworks. The outputs produced by the GA-SAGAN model have a loss rate close to zero. Also, the Entropy values and Precision and Recall indices are higher than GAN and SAGAN models, it shows the higher diversity of production output patterns and the superiority of the proposed model.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Stroke-GAN Painter: Learning to paint artworks using stroke-style generative adversarial networks
    Qian Wang
    Cai Guo
    Hong-Ning Dai
    Ping Li
    Computational Visual Media, 2023, 9 : 787 - 806
  • [2] Stroke-GAN Painter: Learning to paint artworks using stroke-style generative adversarial networks
    Wang, Qian
    Guo, Cai
    Dai, Hong-Ning
    Li, Ping
    COMPUTATIONAL VISUAL MEDIA, 2023, 9 (04) : 787 - 806
  • [3] Generative Image Modeling Using Style and Structure Adversarial Networks
    Wang, Xiaolong
    Gupta, Abhinav
    COMPUTER VISION - ECCV 2016, PT IV, 2016, 9908 : 318 - 335
  • [4] Hybrid Generative Adversarial Networks for News Recommendation
    Liu, Duen-ren
    Huang, Yang
    Tseng, Ching-yi
    Lee, Shin-jye
    JOURNAL OF INFORMATION SCIENCE AND ENGINEERING, 2023, 39 (06) : 1437 - 1457
  • [5] Style and Content Disentanglement in Generative Adversarial Networks
    Kazemi, Hadi
    Iranmanesh, Seyed Mehdi
    Nasrabadi, Nasser M.
    2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, : 848 - 856
  • [6] Image Style Transfer with Generative Adversarial Networks
    Li, Ru
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2950 - 2954
  • [7] Microstructure synthesis using style-based generative adversarial networks
    Fokina, Daria
    Muravleva, Ekaterina
    Ovchinnikov, George
    Oseledets, Ivan
    PHYSICAL REVIEW E, 2020, 101 (04)
  • [8] PRGAN: Personalized Recommendation with Conditional Generative Adversarial Networks
    Wen, Jing
    Chen, Bi-Yi
    Wang, Chang-Dong
    Tian, Zhihong
    2021 21ST IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2021), 2021, : 729 - 738
  • [9] Wide & deep generative adversarial networks for recommendation system
    Li, Jianhong
    Li, Jianhua
    Wang, Chengjun
    Zhao, Xin
    INTELLIGENT DATA ANALYSIS, 2023, 27 (01) : 121 - 136
  • [10] A framework for personalized recommendation with conditional generative adversarial networks
    Wen, Jing
    Zhu, Xi-Ran
    Wang, Chang-Dong
    Tian, Zhihong
    KNOWLEDGE AND INFORMATION SYSTEMS, 2022, 64 (10) : 2637 - 2660