Multi-view expressive graph neural networks for 3D CAD model classification

被引:8
|
作者
Li, Shuang [1 ]
Corney, Jonathan [1 ]
机构
[1] Univ Edinburgh, Sch Engn, Sanderson Bldg, Robert Stevenson Rd, Edinburgh EH9 3FB, Scotland
关键词
Graph Neural Network; 3D shape classification; Multi-view; CAD; Content-based retrieval; Machine learning for engineering applications;
D O I
10.1016/j.compind.2023.103993
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The creation of effective content-based retrieval systems for the 3D models of engineering components created by Mechanical Computer Aided Design (MCAD) systems has been a subject of academic investigation since the 1990 s. Recently some of the most promising results have been reported by researchers using Deep Neural Nets (DNN) to classify industrial parts represented by collections of images generated from different viewpoints. Known as Multi-View Convolutional Neural Network (MVCNN) these systems have extended the architectures developed for 2D images analysis to handle 3D data by using a series of pictures rendered from different viewpoints. In 2016 Monti et al. used Graph Neural Networks (GNN) to classify the superpixel images for the first time and reported results which suggested that the approach could produce good classification accuracy (an observation confirmed by the application of GNNs to 2D image datasets of common objects such as MNIST and Cifar). To investigate the potential for GNNs to reason about spatial adjacency relationships this paper reports, for the first time, the application of GNNs to classifications of 3D MCAD models of mechanical components. Viewing GNN as a convolution operator, parallel GNN can be applied to multiple views of a 3D shape in the same way as CNN is structured in a MVCNN. After outlining the architecture implemented to support MVGNNs the impact of various hyperparameters on the expressive power are explored. When optimised these hyper -parameters (located in both intra-layer and inter-layer structures) combined with the multi-view architecture produced a classification accuracy superior to previous methods. The results also suggest that GNNs have the potential to produce fast, accurate classification systems for 3D MCAD data using significantly smaller datasets than those used for transfer learning in MVCNNs.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] 3D multi-view convolutional neural networks for lung nodule classification
    Kang, Guixia
    Liu, Kui
    Hou, Beibei
    Zhang, Ningbo
    PLOS ONE, 2017, 12 (11):
  • [2] Multi-view SoftPool attention convolutional networks for 3D model classification
    Wang, Wenju
    Wang, Xiaolin
    Chen, Gang
    Zhou, Haoran
    FRONTIERS IN NEUROROBOTICS, 2022, 16
  • [3] Multi-view Heterogeneous Graph Neural Networks for Node Classification
    Zeng, Xi
    Lei, Fang-Yuan
    Wang, Chang-Dong
    Dai, Qing-Yun
    DATA SCIENCE AND ENGINEERING, 2024, 9 (03) : 294 - 308
  • [4] Multi-View Graph Matching for 3D Model Retrieval
    Su, Yu-Ting
    Li, Wen-Hui
    Nie, Wei-Zhi
    Liu, An-An
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2020, 16 (03)
  • [5] Joint Multi-view 2D Convolutional Neural Networks for 3D Object Classification
    Xu, Jinglin
    Zhang, Xiangsen
    Li, Wenbin
    Liu, Xinwang
    Han, Junwei
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 3202 - 3208
  • [6] Multi-View Classification and 3D Bounding Box Regression Networks
    Pramerdorfer, Christopher
    Kampel, Martin
    Van Loock, Mark
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 734 - 739
  • [7] Deformable convolutional networks for multi-view 3D shape classification
    Ma, Pengfei
    Ma, Jie
    Wang, Xujiao
    Yang, Lichuang
    Wang, Nannan
    ELECTRONICS LETTERS, 2018, 54 (24) : 1373 - 1374
  • [8] Multi-view Convolutional Neural Networks for 3D Shape Recognition
    Su, Hang
    Maji, Subhransu
    Kalogerakis, Evangelos
    Learned-Miller, Erik
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 945 - 953
  • [9] A coarse aggregate particle size classification method by fusing 3D multi-view and graph convolutional networks
    Tian, Aojia
    Li, Wei
    Yang, Ming
    Ding, Jiangang
    Pei, Lili
    Weng, Yuhan
    COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2025, 40 (07) : 940 - 958
  • [10] Hierarchical Graph Structure Learning for Multi-View 3D Model Retrieval
    Su, Yuting
    Li, Wenhui
    Liu, Anan
    Nie, Weizhi
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 913 - 919