Scribble-Based 3D Shape Segmentation via Weakly-Supervised Learning

被引:19
|
作者
Shu, Zhenyu [1 ]
Shen, Xiaoyong [2 ]
Xin, Shiqing [3 ]
Chang, Qingjun [1 ]
Feng, Jieqing [4 ]
Kavan, Ladislav [5 ]
Liu, Ligang [6 ]
机构
[1] Zhejiang Univ, Ningbo Inst Technol, Sch Comp & Data Engn, Ningbo, Peoples R China
[2] Chinese Univ Hong Kong, Dept Comp Sci & Engn, Hong Kong, Peoples R China
[3] ShanDong Univ, Sch Comp Sci & Technol, Jinan, Peoples R China
[4] Zhejiang Univ, State Key Lab CAD&CG, Hangzhou, Peoples R China
[5] Univ Utah, Sch Comp, Salt Lake City, UT USA
[6] Univ Sci & Technol China, Graph & Geometr Comp Lab, Sch Math Sci, Hefei, Anhui, Peoples R China
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Shape; Three-dimensional displays; Training; Labeling; Training data; Solid modeling; Deep learning; 3D shapes; segmentation; scribble; weakly-supervised; deep learning; UNSUPERVISED CO-SEGMENTATION; MESH SEGMENTATION;
D O I
10.1109/TVCG.2019.2892076
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Shape segmentation is a fundamental problem in shape analysis. Previous research shows that prior knowledge helps to improve the segmentation accuracy and quality. However, completely labeling each 3D shape in a large training data set requires a heavy manual workload. In this paper, we propose a novel weakly-supervised algorithm for segmenting 3D shapes using deep learning. Our method jointly propagates information from scribbles to unlabeled faces and learns deep neural network parameters. Therefore, it does not rely on completely labeled training shapes and only needs a really simple and convenient scribble-based partially labeling process, instead of the extremely time-consuming and tedious fully labeling processes. Various experimental results demonstrate the proposed method's superior segmentation performance over the previous unsupervised approaches and comparable segmentation performance to the state-of-the-art fully supervised methods.
引用
收藏
页码:2671 / 2682
页数:12
相关论文
共 50 条
  • [31] Weakly Supervised 3D Point Cloud Segmentation via Multi-Prototype Learning
    Su, Yongyi
    Xu, Xun
    Jia, Kui
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (12) : 7723 - 7736
  • [32] PPDistiller: Weakly-supervised 3D point cloud semantic segmentation framework via point-to-pixel distillation
    Zhang, Yong
    Wu, Zhaolong
    Lan, Rukai
    Liang, Yingjie
    Liu, Yifan
    KNOWLEDGE-BASED SYSTEMS, 2024, 305
  • [33] Supervoxel based weakly-supervised multi-level 3D CNNs for lung nodule detection and segmentation
    Feng Y.
    Hao P.
    Zhang P.
    Liu X.
    Wu F.
    Wang H.
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 (11) : 14817 - 14827
  • [34] SQN: Weakly-Supervised Semantic Segmentation of Large-Scale 3D Point Clouds
    Hu, Qingyong
    Yang, Bo
    Fang, Guangchi
    Guo, Yulan
    Leonardis, Ales
    Trigoni, Niki
    Markham, Andrew
    COMPUTER VISION - ECCV 2022, PT XXVII, 2022, 13687 : 600 - 619
  • [35] Weakly-supervised learning-based pathology detection and localization in 3D chest CT scans
    Djahnine, Aissam
    Jupin-Delevaux, Emilien
    Nempont, Olivier
    Si-Mohamed, Salim Aymeric
    Craighero, Fabien
    Cottin, Vincent
    Douek, Philippe
    Popoff, Alexandre
    Boussel, Loic
    MEDICAL PHYSICS, 2024, 51 (11) : 8272 - 8282
  • [36] Weakly-Supervised 3D Medical Image Segmentation Using Geometric Prior and Contrastive Similarity
    Du, Hao
    Dong, Qihua
    Xu, Yan
    Liao, Jing
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (10) : 2936 - 2947
  • [37] ComplementMe: Weakly-Supervised Component Suggestions for 3D Modeling
    Sung, Minhyuk
    Su, Hao
    Kim, Vladimir G.
    Chaudhuri, Siddhartha
    Guibas, Leonidas
    ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (06):
  • [38] Weakly-supervised Instance Segmentation via Class-agnostic Learning with Salient Images
    Wang, Xinggang
    Feng, Jiapei
    Hu, Bin
    Ding, Qi
    Ran, Longjin
    Chen, Xiaoxin
    Liu, Wenyu
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 10220 - 10230
  • [39] Transformer Based Prototype Learning for Weakly-Supervised Histopathology Tissue Semantic Segmentation
    She, Jinwen
    Hu, Yanxu
    Ma, Andy J.
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT IV, 2023, 14257 : 203 - 215
  • [40] Weakly-Supervised Medical Image Segmentation Based on Multi-task Learning
    Xie, Xuanhua
    Fan, Huijie
    Yu, Zhencheng
    Bai, Haijun
    Tang, Yandong
    INTELLIGENT ROBOTICS AND APPLICATIONS (ICIRA 2022), PT II, 2022, 13456 : 395 - 404