Scribble-Based 3D Shape Segmentation via Weakly-Supervised Learning

被引:19
|
作者
Shu, Zhenyu [1 ]
Shen, Xiaoyong [2 ]
Xin, Shiqing [3 ]
Chang, Qingjun [1 ]
Feng, Jieqing [4 ]
Kavan, Ladislav [5 ]
Liu, Ligang [6 ]
机构
[1] Zhejiang Univ, Ningbo Inst Technol, Sch Comp & Data Engn, Ningbo, Peoples R China
[2] Chinese Univ Hong Kong, Dept Comp Sci & Engn, Hong Kong, Peoples R China
[3] ShanDong Univ, Sch Comp Sci & Technol, Jinan, Peoples R China
[4] Zhejiang Univ, State Key Lab CAD&CG, Hangzhou, Peoples R China
[5] Univ Utah, Sch Comp, Salt Lake City, UT USA
[6] Univ Sci & Technol China, Graph & Geometr Comp Lab, Sch Math Sci, Hefei, Anhui, Peoples R China
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Shape; Three-dimensional displays; Training; Labeling; Training data; Solid modeling; Deep learning; 3D shapes; segmentation; scribble; weakly-supervised; deep learning; UNSUPERVISED CO-SEGMENTATION; MESH SEGMENTATION;
D O I
10.1109/TVCG.2019.2892076
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Shape segmentation is a fundamental problem in shape analysis. Previous research shows that prior knowledge helps to improve the segmentation accuracy and quality. However, completely labeling each 3D shape in a large training data set requires a heavy manual workload. In this paper, we propose a novel weakly-supervised algorithm for segmenting 3D shapes using deep learning. Our method jointly propagates information from scribbles to unlabeled faces and learns deep neural network parameters. Therefore, it does not rely on completely labeled training shapes and only needs a really simple and convenient scribble-based partially labeling process, instead of the extremely time-consuming and tedious fully labeling processes. Various experimental results demonstrate the proposed method's superior segmentation performance over the previous unsupervised approaches and comparable segmentation performance to the state-of-the-art fully supervised methods.
引用
收藏
页码:2671 / 2682
页数:12
相关论文
共 50 条
  • [1] Scribble Hides Class: Promoting Scribble-Based Weakly-Supervised Semantic Segmentation with Its Class Label
    Zhang, Xinliang
    Zhu, Lei
    He, Hangzhou
    Jin, Lujia
    Lu, Yanye
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 7, 2024, : 7332 - 7340
  • [2] Scribble-Based Hierarchical Weakly Supervised Learning for Brain Tumor Segmentation
    Ji, Zhanghexuan
    Shen, Yan
    Ma, Chunwei
    Gao, Mingchen
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT III, 2019, 11766 : 175 - 183
  • [3] Weakly-supervised structural component segmentation via scribble annotations
    Zhang, Chenyu
    Li, Ke
    Yin, Zhaozheng
    Qin, Ruwen
    COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2025, 40 (05) : 561 - 578
  • [4] Scribble2D5: Weakly-Supervised Volumetric Image Segmentation via Scribble Annotations
    Chen, Qiuhui
    Hong, Yi
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VIII, 2022, 13438 : 234 - 243
  • [5] Weakly-supervised learning for catheter segmentation in 3D frustum ultrasound
    Yang, Hongxu
    Shan, Caifeng
    Kolen, Alexander F.
    De With, Peter H. N.
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2022, 96
  • [6] Weakly-Supervised Mirror Detection via Scribble Annotations
    Zha, Mingfeng
    Pei, Yunqiang
    Wang, Guoqing
    Li, Tianyu
    Yang, Yang
    Qian, Wenbin
    Shen, Heng Tao
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 7, 2024, : 6953 - 6961
  • [7] Absolute 3D Human Pose Estimation via Weakly-supervised Learning
    Guo, Yiru
    Chen, Zerui
    2020 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2020, : 273 - 276
  • [8] Active Learning for Scribble-Based Diffusion MRI Segmentation
    Lennartz, Jonathan
    Pohl, Golo
    Schultz, Thomas
    UNCERTAINTY FOR SAFE UTILIZATION OF MACHINE LEARNING IN MEDICAL IMAGING, UNSURE 2024, 2025, 15167 : 14 - 22
  • [9] One-Shot Weakly-Supervised Segmentation in 3D Medical Images
    Lei, Wenhui
    Su, Qi
    Jiang, Tianyu
    Gu, Ran
    Wang, Na
    Liu, Xinglong
    Wang, Guotai
    Zhang, Xiaofan
    Zhang, Shaoting
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2024, 43 (01) : 175 - 189
  • [10] HybridCR: Weakly-Supervised 3D Point Cloud Semantic Segmentation via Hybrid Contrastive Regularization
    Li, Mengtian
    Xie, Yuan
    Shen, Yunhang
    Ke, Bo
    Qiao, Ruizhi
    Ren, Bo
    Lin, Shaohui
    Ma, Lizhuang
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 14910 - 14919