RAST: Restorable Arbitrary Style Transfer

被引:2
|
作者
Ma, Yingnan [1 ]
Zhao, Chenqiu [1 ]
Huang, Bingran [1 ]
Li, Xudong [1 ]
Basu, Anup [1 ]
机构
[1] Univ Alberta, Edmonton, AB, Canada
关键词
Neural style transfer; multi-restorations; style difference;
D O I
10.1145/3638770
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The objective of arbitrary style transfer is to apply a given artistic or photo-realistic style to a target image. Although current methods have shown some success in transferring style, arbitrary style transfer still has several issues, including content leakage. Embedding an artistic style can result in unintended changes to the image content. This article proposes an iterative framework called Restorable Arbitrary Style Transfer (RAST) to effectively ensure content preservation and mitigate potential alterations to the content information. RAST can transmit both content and style information through multi-restorations and balance the content-style tradeoff in stylized images using the image restoration accuracy. To ensure RAST's effectiveness, we introduce two novel loss functions: multi-restoration loss and style difference loss. We also propose a new quantitative evaluation method to assess content preservation and style embedding performance. Experimental results show that RAST outperforms state-of-the-art methods in generating stylized images that preserve content and embed style accurately.
引用
收藏
页数:21
相关论文
共 50 条
  • [41] Exploring the Temporal Consistency of Arbitrary Style Transfer: A Channelwise Perspective
    Kong, Xiaoyu
    Deng, Yingying
    Tang, Fan
    Dong, Weiming
    Ma, Chongyang
    Chen, Yongyong
    He, Zhenyu
    Xu, Changsheng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (06) : 8482 - 8496
  • [42] Recipe For Arbitrary Text Style Transfer with Large Language Models
    Reif, Emily
    Ippolito, Daphne
    Yuan, Ann
    Coenen, Andy
    Callison-Burch, Chris
    Wei, Jason
    PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022): (SHORT PAPERS), VOL 2, 2022, : 837 - 848
  • [43] Arbitrary Style Transfer via Multi-Adaptation Network
    Deng, Yingying
    Tang, Fan
    Dong, Weiming
    Sun, Wen
    Huang, Feiyue
    Xu, Changsheng
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 2719 - 2727
  • [44] AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfer
    Liu, Songhua
    Lin, Tianwei
    He, Dongliang
    Li, Fu
    Wang, Meiling
    Li, Xin
    Sun, Zhengxing
    Li, Qian
    Ding, Errui
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 6629 - 6638
  • [45] Arbitrary style transfer based on Attention and Covariance-Matching
    Peng, Haiyuan
    Qian, Wenhua
    Cao, Jinde
    Tang, Shan
    COMPUTERS & GRAPHICS-UK, 2023, 116 : 298 - 307
  • [46] Arbitrary Style Transfer With Fused Convolutional Block Attention Modules
    Xin, Haitao
    Li, Li
    IEEE ACCESS, 2023, 11 : 44977 - 44988
  • [47] Motion Puzzle: Arbitrary Motion Style Transfer by Body Part
    Jang, Deok-Kyeong
    Park, Soomin
    Lee, Sung-Hee
    ACM TRANSACTIONS ON GRAPHICS, 2022, 41 (03):
  • [48] Arbitrary style transfer via multi-feature correlation
    Xiang, Jin
    Zhao, Huihuang
    Li, Pengfei
    Deng, Yue
    Meng, Weiliang
    COMPUTERS & GRAPHICS-UK, 2024, 123
  • [49] Preserving Structural Consistency in Arbitrary Artist and Artwork Style Transfer
    Wu, Jingyu
    Hou, Lefan
    Li, Zejian
    Liao, Jun
    Liu, Li
    Sun, Lingyun
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 3, 2023, : 2830 - 2838
  • [50] LVAST: a lightweight vision transformer for effective arbitrary style transfer
    Yang, Gaoming
    Yu, Chenlong
    Wang, Xiujun
    Fang, Xianjin
    Zhang, Ji
    JOURNAL OF SUPERCOMPUTING, 2025, 81 (01):