Multi-view expressive graph neural networks for 3D CAD model classification

被引:8
|
作者
Li, Shuang [1 ]
Corney, Jonathan [1 ]
机构
[1] Univ Edinburgh, Sch Engn, Sanderson Bldg, Robert Stevenson Rd, Edinburgh EH9 3FB, Scotland
关键词
Graph Neural Network; 3D shape classification; Multi-view; CAD; Content-based retrieval; Machine learning for engineering applications;
D O I
10.1016/j.compind.2023.103993
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The creation of effective content-based retrieval systems for the 3D models of engineering components created by Mechanical Computer Aided Design (MCAD) systems has been a subject of academic investigation since the 1990 s. Recently some of the most promising results have been reported by researchers using Deep Neural Nets (DNN) to classify industrial parts represented by collections of images generated from different viewpoints. Known as Multi-View Convolutional Neural Network (MVCNN) these systems have extended the architectures developed for 2D images analysis to handle 3D data by using a series of pictures rendered from different viewpoints. In 2016 Monti et al. used Graph Neural Networks (GNN) to classify the superpixel images for the first time and reported results which suggested that the approach could produce good classification accuracy (an observation confirmed by the application of GNNs to 2D image datasets of common objects such as MNIST and Cifar). To investigate the potential for GNNs to reason about spatial adjacency relationships this paper reports, for the first time, the application of GNNs to classifications of 3D MCAD models of mechanical components. Viewing GNN as a convolution operator, parallel GNN can be applied to multiple views of a 3D shape in the same way as CNN is structured in a MVCNN. After outlining the architecture implemented to support MVGNNs the impact of various hyperparameters on the expressive power are explored. When optimised these hyper -parameters (located in both intra-layer and inter-layer structures) combined with the multi-view architecture produced a classification accuracy superior to previous methods. The results also suggest that GNNs have the potential to produce fast, accurate classification systems for 3D MCAD data using significantly smaller datasets than those used for transfer learning in MVCNNs.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] 3D object recognition based on pairwise Multi-view Convolutional Neural Networks
    Gao, Z.
    Wang, D. Y.
    Xue, Y. B.
    Xu, G. P.
    Zhang, H.
    Wang, Y. L.
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 56 : 305 - 315
  • [22] Aggregated Deep Convolutional Neural Networks for Multi-View 3D Object Retrieval
    Alzu'bi, Ahmad
    Abuarqoub, Abdelrahman
    Al-Hmouz, Ahmed
    2019 11TH INTERNATIONAL CONGRESS ON ULTRA MODERN TELECOMMUNICATIONS AND CONTROL SYSTEMS AND WORKSHOPS (ICUMT), 2019,
  • [23] Multi-view Classification Model for Knowledge Graph Completion
    Jiang, Wenbin
    Guo, Mengfei
    Chen, Yufeng
    Li, Ying
    Xu, Jinan
    Lyu, Yajuan
    Zhu, Yong
    1ST CONFERENCE OF THE ASIA-PACIFIC CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 10TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (AACL-IJCNLP 2020), 2020, : 726 - 734
  • [24] Multi-view Omics Translation with Multiplex Graph Neural Networks
    Georgantas, Costa
    Richiardi, Jonas
    COMPANION PROCEEDINGS OF THE WEB CONFERENCE 2022, WWW 2022 COMPANION, 2022, : 1030 - 1036
  • [25] Graph neural networks for multi-view learning: a taxonomic review
    Xiao, Shunxin
    Li, Jiacheng
    Lu, Jielong
    Huang, Sujia
    Zeng, Bao
    Wang, Shiping
    ARTIFICIAL INTELLIGENCE REVIEW, 2024, 57 (12)
  • [26] MV-C3D: A Spatial Correlated Multi-View 3D Convolutional Neural Networks
    Xuan, Qi
    Li, Fuxian
    Liu, Yi
    Xiang, Yun
    IEEE ACCESS, 2019, 7 : 92528 - 92538
  • [27] 3D model retrieval based on multi-view attentional convolutional neural network
    Liu, An-An
    Zhou, He-Yu
    Li, Meng-Jie
    Nie, Wei-Zhi
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (7-8) : 4699 - 4711
  • [28] 3D model retrieval based on multi-view attentional convolutional neural network
    An-An Liu
    He-Yu Zhou
    Meng-Jie Li
    Wei-Zhi Nie
    Multimedia Tools and Applications, 2020, 79 : 4699 - 4711
  • [29] Semi-Supervised and Self-Supervised Classification with Multi-View Graph Neural Networks
    Yuan, Jinliang
    Yu, Hualei
    Cao, Meng
    Xu, Ming
    Xie, Junyuan
    Wang, Chongjun
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 2466 - 2476
  • [30] Multi-view graph representation learning for hyperspectral image classification with spectral-spatial graph neural networks
    Hanachi, Refka
    Sellami, Akrem
    Farah, Imed Riadh
    Dalla Mura, Mauro
    NEURAL COMPUTING & APPLICATIONS, 2024, 36 (07): : 3737 - 3759