Multi-view expressive graph neural networks for 3D CAD model classification

被引:8
|
作者
Li, Shuang [1 ]
Corney, Jonathan [1 ]
机构
[1] Univ Edinburgh, Sch Engn, Sanderson Bldg, Robert Stevenson Rd, Edinburgh EH9 3FB, Scotland
关键词
Graph Neural Network; 3D shape classification; Multi-view; CAD; Content-based retrieval; Machine learning for engineering applications;
D O I
10.1016/j.compind.2023.103993
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The creation of effective content-based retrieval systems for the 3D models of engineering components created by Mechanical Computer Aided Design (MCAD) systems has been a subject of academic investigation since the 1990 s. Recently some of the most promising results have been reported by researchers using Deep Neural Nets (DNN) to classify industrial parts represented by collections of images generated from different viewpoints. Known as Multi-View Convolutional Neural Network (MVCNN) these systems have extended the architectures developed for 2D images analysis to handle 3D data by using a series of pictures rendered from different viewpoints. In 2016 Monti et al. used Graph Neural Networks (GNN) to classify the superpixel images for the first time and reported results which suggested that the approach could produce good classification accuracy (an observation confirmed by the application of GNNs to 2D image datasets of common objects such as MNIST and Cifar). To investigate the potential for GNNs to reason about spatial adjacency relationships this paper reports, for the first time, the application of GNNs to classifications of 3D MCAD models of mechanical components. Viewing GNN as a convolution operator, parallel GNN can be applied to multiple views of a 3D shape in the same way as CNN is structured in a MVCNN. After outlining the architecture implemented to support MVGNNs the impact of various hyperparameters on the expressive power are explored. When optimised these hyper -parameters (located in both intra-layer and inter-layer structures) combined with the multi-view architecture produced a classification accuracy superior to previous methods. The results also suggest that GNNs have the potential to produce fast, accurate classification systems for 3D MCAD data using significantly smaller datasets than those used for transfer learning in MVCNNs.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] Hierarchical Graph Attention Based Multi-View Convolutional Neural Network for 3D Object Recognition
    Zeng, Hui
    Zhao, Tianmeng
    Cheng, Ruting
    Wang, Fuzhou
    Liu, Jiwei
    IEEE ACCESS, 2021, 9 (09): : 33323 - 33335
  • [32] Volumetric and Multi-View CNNs for Object Classification on 3D Data
    Qi, Charles R.
    Su, Hao
    Niessner, Matthias
    Dai, Angela
    Yan, Mengyuan
    Guibas, Leonidas J.
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 5648 - 5656
  • [33] Graph Neural Networks for 3D Bravais Lattices Classification
    Barcz, Aleksy
    Jankowski, Stanislaw
    NEURAL NETWORKS AND ARTIFICIAL INTELLIGENCE, ICNNAI 2014, 2014, 440 : 76 - 86
  • [34] Multi-view Fusion with Deep Learning for 3D Shape Classification
    Huang, Xiang
    Wang, Mantao
    Zhang, Dejun
    Zhu, Yu
    Zou, Lu
    Sun, Jun
    Han, Fei
    He, Linchao
    2018 INTERNATIONAL CONFERENCE ON AUDIO, LANGUAGE AND IMAGE PROCESSING (ICALIP), 2018, : 189 - 194
  • [35] A Multi-View Probabilistic Model for 3D Object Classes
    Sun, Min
    Su, Hao
    Savarese, Silvio
    Li Fei-Fei
    CVPR: 2009 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-4, 2009, : 1247 - +
  • [36] A multi-view recurrent neural network for 3D mesh segmentation
    Le, Truc
    Bui, Giang
    Duan, Ye
    COMPUTERS & GRAPHICS-UK, 2017, 66 : 103 - 112
  • [37] Multi-View Convolutional Neural Networks for Mammographic Image Classification
    Sun, Lilei
    Wang, Junqian
    Hu, Zhijun
    Xu, Yong
    Cui, Zhongwei
    IEEE ACCESS, 2019, 7 : 126273 - 126282
  • [38] Neural 3D Video Synthesis from Multi-view Video
    Li, Tianye
    Slavcheva, Mira
    Zollhoefer, Michael
    Green, Simon
    Lassner, Christoph
    Kim, Changil
    Schmidt, Tanner
    Lovegrove, Steven
    Goesele, Michael
    Newcombe, Richard
    Lv, Zhaoyang
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5511 - 5521
  • [39] 3D multi-view squeeze-and-excitation convolutional neural network for lung nodule classification
    Yang, Yang
    Li, Xiaoqin
    Fu, Jipeng
    Han, Zhenbo
    Gao, Bin
    MEDICAL PHYSICS, 2023, 50 (03) : 1905 - 1916
  • [40] Multi-View Tree Structure Learning for 3D Model Retrieval and Classification in Smart City
    Liu, An-An
    Zhao, Zhenlan
    Li, Wenhui
    Song, Dan
    IEEE ACCESS, 2020, 8 : 129743 - 129753