RAST: Restorable Arbitrary Style Transfer

被引:2
|
作者
Ma, Yingnan [1 ]
Zhao, Chenqiu [1 ]
Huang, Bingran [1 ]
Li, Xudong [1 ]
Basu, Anup [1 ]
机构
[1] Univ Alberta, Edmonton, AB, Canada
关键词
Neural style transfer; multi-restorations; style difference;
D O I
10.1145/3638770
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The objective of arbitrary style transfer is to apply a given artistic or photo-realistic style to a target image. Although current methods have shown some success in transferring style, arbitrary style transfer still has several issues, including content leakage. Embedding an artistic style can result in unintended changes to the image content. This article proposes an iterative framework called Restorable Arbitrary Style Transfer (RAST) to effectively ensure content preservation and mitigate potential alterations to the content information. RAST can transmit both content and style information through multi-restorations and balance the content-style tradeoff in stylized images using the image restoration accuracy. To ensure RAST's effectiveness, we introduce two novel loss functions: multi-restoration loss and style difference loss. We also propose a new quantitative evaluation method to assess content preservation and style embedding performance. Experimental results show that RAST outperforms state-of-the-art methods in generating stylized images that preserve content and embed style accurately.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] Style-Aware Normalized Loss for Improving Arbitrary Style Transfer
    Cheng, Jiaxin
    Jaiswal, Ayush
    Wu, Yue
    Natarajan, Pradeep
    Natarajan, Prem
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 134 - 143
  • [22] PARAMETER-FREE STYLE PROJECTION FOR ARBITRARY IMAGE STYLE TRANSFER
    Huang, Siyu
    Xiong, Haoyi
    Wang, Tianyang
    Wen, Bihan
    Wang, Qingzhong
    Chen, Zeyu
    Huan, Jun
    Dou, Dejing
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2070 - 2074
  • [23] Arbitrary Style Transfer with Parallel Self-Attention
    Zhang, Tiange
    Gao, Ying
    Gao, Feng
    Qi, Lin
    Dong, Junyu
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 1406 - 1413
  • [24] Arbitrary Motion Style Transfer via Contrastive Learning
    Yang, Zirui
    Luo, Zhongwen
    Wang, Zhengrui
    Liu, Yuanyuan
    APPLIED SCIENCES-BASEL, 2025, 15 (04):
  • [25] LCCStyle: Arbitrary Style Transfer With Low Computational Complexity
    Huang, Yujie
    Jing, Minge
    Zhou, Jinjia
    Liu, Yuhao
    Fan, Yibo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 501 - 514
  • [26] Frequency Domain Disentanglement for Arbitrary Neural Style Transfer
    Li, Dongyang
    Luo, Hao
    Wang, Pichao
    Wang, Zhibin
    Liu, Shang
    Wang, Fan
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 1287 - 1295
  • [27] All-to-key Attention for Arbitrary Style Transfer
    Zhu, Mingrui
    He, Xiao
    Wang, Nannan
    Wang, Xiaoyu
    Gao, Xinbo
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 23052 - 23062
  • [28] Improving the Transferability of Adversarial Examples with Arbitrary Style Transfer
    Ge, Zhijin
    Shang, Fanhua
    Liu, Hongying
    Liu, Yuanyuan
    Wan, Liang
    Feng, Wei
    Wang, Xiaosen
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 4440 - 4449
  • [29] A SALIENCY-AWARE METHOD FOR ARBITRARY STYLE TRANSFER
    Li, Yitong
    Ma, Jie
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 740 - 744
  • [30] ETNet: Error Transition Network for Arbitrary Style Transfer
    Song, Chunjin
    Wu, Zhijie
    Zhou, Yang
    Gong, Minglun
    Huang, Hui
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32