MARVEL: Raster Gray-Level Manga Vectorization via Primitive-Wise Deep Reinforcement Learning

被引:1
|
作者
Su, Hao [1 ]
Liu, Xuefeng [1 ]
Niu, Jianwei [1 ,2 ,3 ]
Cui, Jiahe [1 ]
Wan, Ji [1 ]
Wu, Xinghao [1 ]
Wang, Nana [1 ]
机构
[1] Beihang Univ, Sch Comp Sci & Engn, State Key Lab VR Technol & Syst, Beijing 100000, Peoples R China
[2] Zhengzhou Univ, Ind Technol Res Inst, Sch Informat Engn, Zhengzhou 450000, Henan, Peoples R China
[3] Beihang Univ, Hangzhou Innovat Inst, Hangzhou 310000, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Manga; image vectorization; deep reinforcement learning;
D O I
10.1109/TCSVT.2023.3309786
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Manga is a fashionable Japanese-style comic form that is composed of black-and-white strokes and is generally displayed as raster images on digital devices. Typical mangas have simple textures, wide lines, and few color gradients, which are vectorizable natures to enjoy the merits of vector graphics, e.g., adaptive resolutions and small file sizes. In this paper, we propose MARVEL (MAnga's Raster to VEctor Learning), a primitive-wise approach for vectorizing raster gray-level mangas by Deep Reinforcement Learning (DRL). Unlike previous learning-based methods which predict vector parameters for an entire image, MARVEL introduces a new perspective that regards an entire manga as a collection of basic primitives-stroke lines, and designs a DRL model to decompose the target image into a primitive sequence for achieving accurate vectorization. To improve vectorization accuracies and decrease file sizes, we further propose a stroke accuracy reward to predict accurate stroke lines, and a pruning mechanism to avoid generating erroneous and repeated strokes. Extensive subjective and objective experiments show that our MARVEL can generate impressive results and reaches the state-of-the-art level.
引用
收藏
页码:2677 / 2693
页数:17
相关论文
共 19 条
  • [1] CMID: Crossmodal Image Denoising via Pixel-Wise Deep Reinforcement Learning
    Guo, Yi
    Gao, Yuanhang
    Hu, Bingliang
    Qian, Xueming
    Liang, Dong
    SENSORS, 2024, 24 (01)
  • [2] Instance-Wise Laplace Mechanism via Deep Reinforcement Learning (Student Abstract)
    Ryu, Sehyun
    Joo, Hosung
    Jang, Jonggyu
    Yang, Hyun Jong
    THIRTY-EIGTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 21, 2024, : 23640 - 23641
  • [3] A vertebral level-wise data augmentation scheme for segmentation via deep learning
    Wu, Shaoju
    Cai, Yunliang
    Fan, Xiaoyao
    Mirza, Sohail K.
    Paulsen, Keith D.
    Ji, Songbai
    MEDICAL IMAGING 2021: IMAGE PROCESSING, 2021, 11596
  • [4] Boosting Verification of Deep Reinforcement Learning via Piece-wise Linear Decision Neural Networks
    Tian, Jiaxu
    Zhi, Dapeng
    Liu, Si
    Wang, Peixin
    Chen, Cheng
    Zhang, Min
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [5] Generic dual-phase classification models through deep learning semantic segmentation method and image gray-level optimization
    Yan, Biaojie
    Yin, Jiaqing
    Wang, Yi
    Li, Mingxing
    Fa, Tao
    Bin, Bai
    Su, Bin
    Zhang, Pengcheng
    SCRIPTA MATERIALIA, 2024, 242
  • [6] Dynamic multi-objective sequence-wise recommendation framework via deep reinforcement learning
    Xiankun Zhang
    Yuhu Shang
    Yimeng Ren
    Kun Liang
    Complex & Intelligent Systems, 2023, 9 : 1891 - 1911
  • [7] Dynamic multi-objective sequence-wise recommendation framework via deep reinforcement learning
    Zhang, Xiankun
    Shang, Yuhu
    Ren, Yimeng
    Liang, Kun
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (02) : 1891 - 1911
  • [8] An Efficient Deep Learning Framework for Malware Image Classification Using Gray-Level Co-Occurrence Matrix and Sparse Convolution
    Priya, V.
    Sofia, A. Sathya
    IRANIAN JOURNAL OF SCIENCE AND TECHNOLOGY-TRANSACTIONS OF ELECTRICAL ENGINEERING, 2024, : 65 - 88
  • [9] Accelerating Deep Reinforcement Learning via Phase-Level Parallelism for Robotics Applications
    Kim, Yang-Gon
    Han, Yun-Ki
    Shin, Jae-Kang
    Kim, Jun-Kyum
    Kim, Lee-Sup
    IEEE COMPUTER ARCHITECTURE LETTERS, 2024, 23 (01) : 41 - 44
  • [10] Unsupervised Video Summarization via Deep Reinforcement Learning With Shot-Level Semantics
    Yuan, Ye
    Zhang, Jiawan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (01) : 445 - 456