Deep Sketch Vectorization via Implicit Surface Extraction

被引:0
|
作者
Yan, Chuan [1 ]
Li, Yong [1 ,2 ]
Aneja, Deepali [3 ]
Fisher, Matthew [3 ]
Simo-Serra, Edgar [4 ]
Gingold, Yotam [1 ]
机构
[1] George Mason Univ, Fairfax, VA 22030 USA
[2] South China Univ Technol, Guangzhou, Peoples R China
[3] Adobe Inc, San Jose, CA USA
[4] Waseda Univ, Tokyo, Japan
来源
ACM TRANSACTIONS ON GRAPHICS | 2024年 / 43卷 / 04期
关键词
vectorization; raster; sketch; drawing;
D O I
10.1145/3658197
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We introduce an algorithm for sketch vectorization with state-of-the-art accuracy and capable of handling complex sketches. We approach sketch vectorization as a surface extraction task from an unsigned distance field, which is implemented using a two-stage neural network and a dual contouring domain post processing algorithm. The first stage consists of extracting unsigned distance fields from an input raster image. The second stage consists of an improved neural dual contouring network more robust to noisy input and more sensitive to line geometry. To address the issue of under-sampling inherent in grid-based surface extraction approaches, we explicitly predict undersampling and keypoint maps. These are used in our post-processing algorithm to resolve sharp features and multi-way junctions. The keypoint and undersampling maps are naturally controllable, which we demonstrate in an interactive topology refinement interface. Our proposed approach produces far more accurate vectorizations on complex input than previous approaches with efficient running time.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Isosurface Extraction of Volumetric Data Using Implicit Surface Polygonization
    Zheng, Pan
    Belaton, Bahari
    Liao, Iman Yi
    2009 THIRD ASIA INTERNATIONAL CONFERENCE ON MODELLING & SIMULATION, VOLS 1 AND 2, 2009, : 555 - 559
  • [22] Implicit Relation Inference with Deep Path Extraction for Commonsense Question Answering
    Yang, Peng
    Liu, Zijian
    Li, Bing
    Zhang, Penghui
    NEURAL PROCESSING LETTERS, 2022, 54 (06) : 4751 - 4768
  • [23] A relic sketch extraction framework based on detail-aware hierarchical deep network
    Peng, Jinye
    Wang, Jiaxin
    Wang, Jun
    Zhang, Erlei
    Zhang, Qunxi
    Zhang, Yongqin
    Peng, Xianlin
    Yu, Kai
    SIGNAL PROCESSING, 2021, 183
  • [24] SketchMaker: Sketch Extraction and Reuse for Interactive Scene Sketch Composition
    Liu, Fang
    Deng, Xiaoming
    Song, Jiancheng
    Lai, Yu-Kun
    Liu, Yong-Jin
    Wang, Hao
    Ma, Cuixia
    Qin, Shengfeng
    Wang, Hongan
    ACM TRANSACTIONS ON INTERACTIVE INTELLIGENT SYSTEMS, 2022, 12 (03)
  • [25] Implicit Surface Reconstruction via RBF Interpolation: A Review
    Mo J.
    Shou H.
    Chen W.
    Recent Patents on Engineering, 2022, 16 (05) : 49 - 66
  • [26] Video Vectorization via Tetrahedral Remeshing
    Wang, Chuan
    Zhu, Jie
    Guo, Yanwen
    Wang, Wenping
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (04) : 1833 - 1844
  • [27] Enhancing Sketch-Based Image Retrieval via Deep Discriminative Representation
    Huang, Fei
    Cheng, Yong
    Jin, Cheng
    Zhang, Yuejie
    Zhang, Tao
    ECAI 2016: 22ND EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, 285 : 1626 - 1627
  • [28] Event Causality Extraction via Implicit Cause-Effect Interactions
    Liu, Jintao
    Zhang, Zequn
    Wei, Kaiwen
    Guo, Zhi
    Sun, Xian
    Jin, Li
    Li, Xiaoyu
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, EMNLP 2023, 2023, : 6792 - 6804
  • [29] Learning Deep Sketch Abstraction
    Muhammad, Umar Riaz
    Yang, Yongxin
    Song, Yi-Zhe
    Xiang, Tao
    Hospedales, Timothy M.
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8014 - 8023
  • [30] Interactive Contour Extraction via Sketch-Alike Dense-Validation Optimization
    Nie, Yongwei
    Cao, Xu
    Li, Ping
    Zhang, Qing
    Zhang, Zhensong
    Li, Guiqing
    Sun, Hanqiu
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (04) : 903 - 916