Multi-view expressive graph neural networks for 3D CAD model classification

被引:8
|
作者
Li, Shuang [1 ]
Corney, Jonathan [1 ]
机构
[1] Univ Edinburgh, Sch Engn, Sanderson Bldg, Robert Stevenson Rd, Edinburgh EH9 3FB, Scotland
关键词
Graph Neural Network; 3D shape classification; Multi-view; CAD; Content-based retrieval; Machine learning for engineering applications;
D O I
10.1016/j.compind.2023.103993
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The creation of effective content-based retrieval systems for the 3D models of engineering components created by Mechanical Computer Aided Design (MCAD) systems has been a subject of academic investigation since the 1990 s. Recently some of the most promising results have been reported by researchers using Deep Neural Nets (DNN) to classify industrial parts represented by collections of images generated from different viewpoints. Known as Multi-View Convolutional Neural Network (MVCNN) these systems have extended the architectures developed for 2D images analysis to handle 3D data by using a series of pictures rendered from different viewpoints. In 2016 Monti et al. used Graph Neural Networks (GNN) to classify the superpixel images for the first time and reported results which suggested that the approach could produce good classification accuracy (an observation confirmed by the application of GNNs to 2D image datasets of common objects such as MNIST and Cifar). To investigate the potential for GNNs to reason about spatial adjacency relationships this paper reports, for the first time, the application of GNNs to classifications of 3D MCAD models of mechanical components. Viewing GNN as a convolution operator, parallel GNN can be applied to multiple views of a 3D shape in the same way as CNN is structured in a MVCNN. After outlining the architecture implemented to support MVGNNs the impact of various hyperparameters on the expressive power are explored. When optimised these hyper -parameters (located in both intra-layer and inter-layer structures) combined with the multi-view architecture produced a classification accuracy superior to previous methods. The results also suggest that GNNs have the potential to produce fast, accurate classification systems for 3D MCAD data using significantly smaller datasets than those used for transfer learning in MVCNNs.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Multi-View Attentive Contextualization for Multi-View 3D Object Detection
    Liu, Xianpeng
    Zheng, Ce
    Qian, Ming
    Xue, Nan
    Chen, Chen
    Zhang, Zhebin
    Li, Chen
    Wu, Tianfu
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 16688 - 16698
  • [42] Multi-View 3D Video Delivery for Broadband IP Networks
    Ho, Ting-Yu
    Yeh, Yi-Nung
    Yang, De-Nian
    2015 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2015, : 5796 - 5802
  • [43] Multi-View Tensor Graph Neural Networks Through Reinforced Aggregation
    Zhao, Xusheng
    Dai, Qiong
    Wu, Jia
    Peng, Hao
    Liu, Mingsheng
    Bai, Xu
    Tan, Jianlong
    Wang, Senzhang
    Yu, Philip S.
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (04) : 4077 - 4091
  • [44] Impression Estimation Model of 3D Objects Using Multi-View Convolutional Neural Network
    Sakashita, Keisuke
    Tobitani, Kensuke
    Taguchi, Koichi
    Hashimoto, Manabu
    Tani, Iori
    Hashimoto, Sho
    Katahira, Kenji
    Nagata, Noriko
    FRONTIERS OF COMPUTER VISION (IW-FCV 2022), 2022, 1578 : 343 - 355
  • [45] Dynamic Multi-View Graph Neural Networks for Citywide Traffic Inference
    Dai, Shaojie
    Wang, Jinshuai
    Huang, Chao
    Yu, Yanwei
    Dong, Junyu
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2023, 17 (04)
  • [46] Link Inference via Heterogeneous Multi-view Graph Neural Networks
    Xing, Yuying
    Li, Zhao
    Hui, Pengrui
    Huang, Jiaming
    Chen, Xia
    Zhang, Long
    Yu, Guoxian
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2020), PT I, 2020, 12112 : 698 - +
  • [47] Multi-view heterogeneous graph learning with compressed hypergraph neural networks
    Huang, Aiping
    Fang, Zihan
    Wu, Zhihao
    Tan, Yanchao
    Han, Peng
    Wang, Shiping
    Zhang, Le
    NEURAL NETWORKS, 2024, 179
  • [48] Learning-Based Multiple Pooling Fusion in Multi-View Convolutional Neural Network for 3D Model Classification and Retrieval
    Zeng, Hui
    Wang, Qi
    Li, Chen
    Song, Wei
    JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2019, 15 (05): : 1179 - 1191
  • [49] Group-Pair Convolutional Neural Networks for Multi-View Based 3D Object Retrieval
    Gao, Zan
    Wang, Deyu
    He, Xiangnan
    Zhang, Hua
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 2223 - 2231
  • [50] Classification of Hull Blocks of Ships Using CNN with Multi-View Image Set from 3D CAD Data
    Chon, Haemyung
    Oh, Daekyun
    Noh, Jackyou
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (02)