RAST: Restorable Arbitrary Style Transfer

被引:2
|
作者
Ma, Yingnan [1 ]
Zhao, Chenqiu [1 ]
Huang, Bingran [1 ]
Li, Xudong [1 ]
Basu, Anup [1 ]
机构
[1] Univ Alberta, Edmonton, AB, Canada
关键词
Neural style transfer; multi-restorations; style difference;
D O I
10.1145/3638770
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The objective of arbitrary style transfer is to apply a given artistic or photo-realistic style to a target image. Although current methods have shown some success in transferring style, arbitrary style transfer still has several issues, including content leakage. Embedding an artistic style can result in unintended changes to the image content. This article proposes an iterative framework called Restorable Arbitrary Style Transfer (RAST) to effectively ensure content preservation and mitigate potential alterations to the content information. RAST can transmit both content and style information through multi-restorations and balance the content-style tradeoff in stylized images using the image restoration accuracy. To ensure RAST's effectiveness, we introduce two novel loss functions: multi-restoration loss and style difference loss. We also propose a new quantitative evaluation method to assess content preservation and style embedding performance. Experimental results show that RAST outperforms state-of-the-art methods in generating stylized images that preserve content and embed style accurately.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] RAST: Restorable Arbitrary Style Transfer via Multi-restoration
    Ma, Yingnan
    Zhao, Chenqiu
    Li, Xudong
    Basu, Anup
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 331 - 340
  • [2] Style Permutation for Diversified Arbitrary Style Transfer
    Li, Pan
    Zhang, Dan
    Zhao, Lei
    Xu, Duanqing
    Lu, Dongming
    IEEE ACCESS, 2020, 8 (08): : 199147 - 199158
  • [3] Arbitrary Style Transfer with Style Enhancement and Structure Retention
    Yang, Sijia
    Zhou, Yun
    ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT II, 2024, 14496 : 401 - 413
  • [4] Arbitrary Style Transfer with Style-Attentional Networks
    Park, Dae Young
    Lee, Kwang Hee
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 5873 - 5881
  • [5] Arbitrary Image Emotionalizing with Style Transfer
    Luo, Xing
    Zhang, Jiajia
    Wu, Guang
    Chen, Yanxiang
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING, PT III, 2018, 11166 : 407 - 416
  • [6] Arbitrary Portuguese text style transfer
    da Costa, Pablo Botton
    Paraboni, Ivandre
    LINGUAMATICA, 2023, 15 (02): : 19 - 36
  • [7] Flow style-aware network for arbitrary style transfer
    Hu, Zhenshan
    Ge, Bin
    Xia, Chenxing
    Wu, Wenyan
    Zhou, Guangao
    Wang, Baotong
    COMPUTERS & GRAPHICS-UK, 2024, 124
  • [8] Arbitrary style transfer via content consistency and style consistency
    Yu, Xiaoming
    Zhou, Gan
    VISUAL COMPUTER, 2024, 40 (03): : 1369 - 1382
  • [9] Pyramid style-attentional network for arbitrary style transfer
    Gaoming Yang
    Shicheng Zhang
    Xianjin Fang
    Ji Zhang
    Multimedia Tools and Applications, 2024, 83 : 13483 - 13502
  • [10] Pyramid style-attentional network for arbitrary style transfer
    Yang, Gaoming
    Zhang, Shicheng
    Fang, Xianjin
    Zhang, Ji
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (05) : 13483 - 13502