Colorization for anime sketches with cycle-consistent adversarial network

被引:0
|
作者
Zhang G. [1 ]
Qu M. [1 ]
Jin Y. [1 ]
Song Q. [1 ]
机构
[1] School of Information Science and Engineering, Hebei University of Science and Technology, Shijiazhuang
基金
中国国家自然科学基金;
关键词
Anime; Colorization; Cycle-consistency; Sketches; U-net;
D O I
10.23940/ijpe.19.03.p20.910918
中图分类号
学科分类号
摘要
Coloring animation sketches has always been a complex and interesting task, but as the sketch is the first part of animation creation that neither presents gray value nor presents semantic information, the lack of real animation sketches is the biggest difficulty in current model training. It is also usually expensive to collect such data. In recent years, some methods based on generative adversarial networks (GANs) have achieved great success. They can generate colorized anime illustration on given sketches. Many existing sketch coloring tools are based on this supervised learning method, but the marking of data is particularly important for supervised learning, and much time is spent on the marking of data. To address these challenges, we propose a novel approach for unsupervised learning based on U-net and periodic consistent confrontation. Specifically, we combine the periodic consistent antagonism framework with the U-net structure and residual network, enabling us to robustly train a deep network to make the resulting images more natural and realistic. We also adopted some special data generation methods, so that our model can not only color anime sketches but also extract line drafts from colored pictures. By comparing the mainstream models of supervised learning, we show that the image processed by the proposed method can achieve a similar effect. © 2019 Totem Publisher, Inc. All rights reserved.
引用
收藏
页码:910 / 918
页数:8
相关论文
共 50 条
  • [1] Context-aware colorization of gray-scale images utilizing a cycle-consistent generative adversarial network architecture
    Johari, Mohammad Mahdi
    Behroozi, Hamid
    NEUROCOMPUTING, 2020, 407 : 94 - 104
  • [2] Seismic impedance inversion based on cycle-consistent generative adversarial network
    Yu-Qing Wang
    Qi Wang
    Wen-Kai Lu
    Qiang Ge
    Xin-Fei Yan
    Petroleum Science, 2022, (01) : 147 - 161
  • [3] MRI Image Harmonization using Cycle-Consistent Generative Adversarial Network
    Modanwal, Gourav
    Vellal, Adithya
    Buda, Mateusz
    Mazurowski, Maciej A.
    MEDICAL IMAGING 2020: COMPUTER-AIDED DIAGNOSIS, 2020, 11314
  • [4] Endoscopic Ultrasound Image Synthesis Using a Cycle-Consistent Adversarial Network
    Grimwood, Alexander
    Ramalhinho, Joao
    Baum, Zachary M. C.
    Montana-Brown, Nina
    Johnson, Gavin J.
    Hu, Yipeng
    Clarkson, Matthew J.
    Pereira, Stephen P.
    Barratt, Dean C.
    Bonmati, Ester
    SIMPLIFYING MEDICAL ULTRASOUND, 2021, 12967 : 169 - 178
  • [5] Overwater Image Dehazing via Cycle-Consistent Generative Adversarial Network
    Zheng, Shunyuan
    Sun, Jiamin
    Liu, Qinglin
    Qi, Yuankai
    Yan, Jianen
    ELECTRONICS, 2020, 9 (11) : 1 - 19
  • [6] Seismic impedance inversion based on cycle-consistent generative adversarial network
    Wang, Yu-Qing
    Wang, Qi
    Lu, Wen-Kai
    Ge, Qiang
    Yan, Xin-Fei
    PETROLEUM SCIENCE, 2022, 19 (01) : 147 - 161
  • [7] Cycle-consistent adversarial denoising network for multiphase coronary CT angiography
    Kang, Eunhee
    Koo, Hyun Jung
    Yang, Dong Hyun
    Seo, Joon Bum
    Ye, Jong Chul
    MEDICAL PHYSICS, 2019, 46 (02) : 550 - 562
  • [8] Seismic impedance inversion based on cycle-consistent generative adversarial network
    YuQing Wang
    Qi Wang
    WenKai Lu
    Qiang Ge
    XinFei Yan
    Petroleum Science, 2022, 19 (01) : 147 - 161
  • [9] Unsupervised Image Dedusting via a Cycle-Consistent Generative Adversarial Network
    Gao, Guxue
    Lai, Huicheng
    Jia, Zhenhong
    REMOTE SENSING, 2023, 15 (05)
  • [10] A Deep Multimodal Adversarial Cycle-Consistent Network for Smart Enterprise System
    Li, Peng
    Laghari, Asif Ali
    Rashid, Mamoon
    Gao, Jing
    Gadekallu, Thippa Reddy
    Javed, Abdul Rehman
    Yin, Shoulin
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (01) : 693 - 702