A task-driven network for mesh classification and semantic part segmentation

被引:0
|
作者
Dong, Qiujie [1 ]
Gong, Xiaoran [1 ]
Xu, Rui [1 ]
Wang, Zixiong [2 ]
Gao, Junjie [1 ]
Chen, Shuangmin [3 ]
Xin, Shiqing [1 ]
Tu, Changhe [1 ]
Wang, Wenping [4 ]
机构
[1] Shandong Univ, Jinan, Peoples R China
[2] Nankai Univ, Tianjin, Peoples R China
[3] Qingdao Univ Sci & Technol, Qingdao, Peoples R China
[4] Texas A&M Univ, College Stn, TX USA
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Geometric deep learning; Mesh classification; Semantic part segmentation; Task-driven neural network;
D O I
10.1016/j.cagd.2024.102304
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Given the rapid advancements in geometric deep -learning techniques, there has been a dedicated effort to create mesh -based convolutional operators that act as a link between irregular mesh structures and widely adopted backbone networks. Despite the numerous advantages of Convolutional Neural Networks (CNNs) over Multi -Layer Perceptrons (MLPs), mesh -oriented CNNs often require intricate network architectures to tackle irregularities of a triangular mesh. These architectures not only demand that the mesh be manifold and watertight but also impose constraints on the abundance of training samples. In this paper, we note that for specific tasks such as mesh classification and semantic part segmentation, large-scale shape features play a pivotal role. This is in contrast to the realm of shape correspondence, where a comprehensive understanding of 3D shapes necessitates considering both local and global characteristics. Inspired by this key observation, we introduce a task -driven neural network architecture that seamlessly operates in an end -to -end fashion. Our method takes as input mesh vertices equipped with the heat kernel signature (HKS) and dihedral angles between adjacent faces. Notably, we replace the conventional convolutional module, commonly found in ResNet architectures, with MLPs and incorporate Layer Normalization (LN) to facilitate layer -wise normalization. Our approach, with a seemingly straightforward network architecture, demonstrates an accuracy advantage. It exhibits a marginal 0.1% improvement in the mesh classification task and a substantial 1.8% enhancement in the mesh part segmentation task compared to state-of-the-art methodologies. Moreover, as the number of training samples decreases to 1/50 or even 1/100, the accuracy advantage of our approach becomes more pronounced. In summary, our convolution -free network is tailored for specific tasks relying on large-scale shape features and excels in the situation with a limited number of training samples, setting itself apart from state-of-the-art methodologies.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Retinal vessel segmentation based on task-driven generative adversarial network
    Chen, Zhiyuan
    Jin, Wei
    Zeng, Xingbin
    Xu, Liang
    IET IMAGE PROCESSING, 2020, 14 (17) : 4599 - 4605
  • [2] Semantic weights of features in task-driven map generalization
    Research Center of Spatial Information and Digital Engineering, Wuhan University, 129 Luoyu Road, Wuhan 430079, China
    Geomatics Inf. Sci. Wuhan Univ., 2007, 3 (279-281):
  • [3] A Comparative Analysis of Visual Encoding Models Based on Classification and Segmentation Task-Driven CNNs
    Yu, Ziya
    Zhang, Chi
    Wang, Linyuan
    Tong, Li
    Yan, Bin
    COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2020, 2020 (2020)
  • [4] Task-Driven Semantic Coding via Reinforcement Learning
    Li, Xin
    Shi, Jun
    Chen, Zhibo
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 6307 - 6320
  • [5] Task-Driven Feature Pooling for Image Classification
    Xie, Guo-Sen
    Zhang, Xu-Yao
    Shu, Xiangbo
    Yan, Shuicheng
    Liu, Cheng-Lin
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 1179 - 1187
  • [6] Multimodal Task-Driven Dictionary Learning for Image Classification
    Bahrampour, Soheil
    Nasrabadi, Nasser M.
    Ray, Asok
    Jenkins, William Kenneth
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (01) : 24 - 38
  • [7] TASK-DRIVEN DEEP TRANSFER LEARNING FOR IMAGE CLASSIFICATION
    Ding, Zhengming
    Nasrabadi, Nasser M.
    Fu, Yun
    2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 2414 - 2418
  • [8] Reinforced Bit Allocation under Task-Driven Semantic Distortion Metrics
    Shi, Jun
    Chen, Zhibo
    2020 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2020,
  • [9] KERNEL TASK-DRIVEN DICTIONARY LEARNING FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    Bahrampour, Soheil
    Nasrabadi, Nasser M.
    Ray, Asok
    Jenkins, Kenneth W.
    2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 1324 - 1328
  • [10] A novel decoder based on Bayesian rules for task-driven object segmentation
    Cai, Yuxiang
    Yu, Yuanlong
    Jiang, Weijie
    Chen, Rong
    Zheng, Weitao
    Wu, Xi
    Su, Renjie
    IET IMAGE PROCESSING, 2023, 17 (03) : 832 - 848