Deep Sketch Vectorization via Implicit Surface Extraction

被引:0
|
作者
Yan, Chuan [1 ]
Li, Yong [1 ,2 ]
Aneja, Deepali [3 ]
Fisher, Matthew [3 ]
Simo-Serra, Edgar [4 ]
Gingold, Yotam [1 ]
机构
[1] George Mason Univ, Fairfax, VA 22030 USA
[2] South China Univ Technol, Guangzhou, Peoples R China
[3] Adobe Inc, San Jose, CA USA
[4] Waseda Univ, Tokyo, Japan
来源
ACM TRANSACTIONS ON GRAPHICS | 2024年 / 43卷 / 04期
关键词
vectorization; raster; sketch; drawing;
D O I
10.1145/3658197
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We introduce an algorithm for sketch vectorization with state-of-the-art accuracy and capable of handling complex sketches. We approach sketch vectorization as a surface extraction task from an unsigned distance field, which is implemented using a two-stage neural network and a dual contouring domain post processing algorithm. The first stage consists of extracting unsigned distance fields from an input raster image. The second stage consists of an improved neural dual contouring network more robust to noisy input and more sensitive to line geometry. To address the issue of under-sampling inherent in grid-based surface extraction approaches, we explicitly predict undersampling and keypoint maps. These are used in our post-processing algorithm to resolve sharp features and multi-way junctions. The keypoint and undersampling maps are naturally controllable, which we demonstrate in an interactive topology refinement interface. Our proposed approach produces far more accurate vectorizations on complex input than previous approaches with efficient running time.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Integer-Grid Sketch Simplification and Vectorization
    Stanko, Tibor
    Bessmeltsev, Mikhail
    Bommes, David
    Bousseau, Adrien
    COMPUTER GRAPHICS FORUM, 2020, 39 (05) : 149 - 161
  • [2] Vectorization of graphical components in sketch-based interfaces
    Ferri, F
    Grifoni, P
    DATABASES IN NETWORKED INFORMATION SYSTEMS, PROCEEDINGS, 2003, 2822 : 231 - 244
  • [3] Color by Numbers: Interactive Structuring and Vectorization of Sketch Imagery
    Parakkat, Amal Dev
    Cani, Marie-Paule
    Singh, Karan
    CHI '21: PROCEEDINGS OF THE 2021 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2021,
  • [4] A complete hand-drawn sketch vectorization framework
    Donati, Luca
    Cesano, Simone
    Prati, Andrea
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (14) : 19083 - 19113
  • [5] A complete hand-drawn sketch vectorization framework
    Luca Donati
    Simone Cesano
    Andrea Prati
    Multimedia Tools and Applications, 2019, 78 : 19083 - 19113
  • [6] Reference Based Sketch Extraction via Attention Mechanism
    Ashtari, Amirsaman
    Seo, Chang Wook
    Kang, Cholmin
    Cha, Sihun
    Noh, Junyong
    ACM TRANSACTIONS ON GRAPHICS, 2022, 41 (06):
  • [7] Road network extraction and vectorization of remote sensing images based on deep learning
    Gong, Zhe
    Xu, Li
    Tian, Zhenpo
    Bao, Jingyuan
    Ming, Delie
    PROCEEDINGS OF 2020 IEEE 5TH INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC 2020), 2020, : 303 - 307
  • [8] Vectorization of Historical Maps Using Deep Edge Filtering and Closed Shape Extraction
    Chen, Yizi
    Carlinet, Edwin
    Chazalon, Joseph
    Mallet, Clement
    Dumenieu, Bertrand
    Perret, Julien
    DOCUMENT ANALYSIS AND RECOGNITION, ICDAR 2021, PT IV, 2021, 12824 : 510 - 525
  • [9] Deep Line Drawing Vectorization via Line Subdivision and Topology Reconstruction
    Guo, Yi
    Zhang, Zhuming
    Han, Chu
    Hu, Wenbo
    Li, Chengze
    Wong, Tien-Tsin
    COMPUTER GRAPHICS FORUM, 2019, 38 (07) : 81 - 90
  • [10] VECTORIZATION OF AN IMPLICIT NAVIER-STOKES SOLVER
    VAQUEZ, P
    ERRERA, MP
    DUTOYA, D
    RECHERCHE AEROSPATIALE, 1991, (01): : 17 - 29