3D model retrieval based on interactive attention CNN and multiple features

被引:0
|
作者
Gao, Xue-Yao [1 ]
Jia, Wen-Hui [1 ]
Zhang, Chun-Xiang [1 ]
机构
[1] Harbin Univ Sci & Technol, Sch Comp Sci & Technol, Harbin, Peoples R China
关键词
3D model; Freehand sketch; 3D model retrieval; Interactive attention; 2D views; Euclidean distance; Shape distribution feature; SHAPE RETRIEVAL; SKETCH; NETWORK; CLASSIFICATION;
D O I
10.7717/peerj-cs.1227
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D (three-dimensional) models are widely applied in our daily life, such as mechanical manufacture, games, biochemistry, art, virtual reality, and etc. With the exponential growth of 3D models on web and in model library, there is an increasing need to retrieve the desired model accurately according to freehand sketch. Researchers are focusing on applying machine learning technology to 3D model retrieval. In this article, we combine semantic feature, shape distribution features and gist feature to retrieve 3D model based on interactive attention convolutional neural networks (CNN). The purpose is to improve the accuracy of 3D model retrieval. Firstly, 2D (two-dimensional) views are extracted from 3D model at six different angles and converted into line drawings. Secondly, interactive attention module is embedded into CNN to extract semantic features, which adds data interaction between two CNN layers. Interactive attention CNN extracts effective features from 2D views. Gist algorithm and 2D shape distribution (SD) algorithm are used to extract global features. Thirdly, Euclidean distance is adopted to calculate the similarity of semantic feature, the similarity of gist feature and the similarity of shape distribution feature between sketch and 2D view. Then, the weighted sum of three similarities is used to compute the similarity between sketch and 2D view for retrieving 3D model. It solves the problem that low accuracy of 3D model retrieval is caused by the poor extraction of semantic features. Nearest neighbor (NN), first tier (FT), second tier (ST), F-measure (E(F)), and discounted cumulated gain (DCG) are used to evaluate the performance of 3D model retrieval. Experiments are conducted on ModelNet40 and results show that the proposed method is better than others. The proposed method is feasible in 3D model retrieval.
引用
收藏
页码:1 / 19
页数:19
相关论文
共 50 条
  • [1] 3D CNN based Partial 3D Shape Retrieval Focusing on Local Features
    Iwabuchi, Wataru
    Aono, Masaki
    2018 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2018, : 1523 - 1529
  • [2] The 3D Model Retrieval Based on Local Features
    Huo, Lei
    Lv, Xueqiang
    Zhang, Kai
    Li, Zhuo
    2014 SEVENTH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID 2014), VOL 2, 2014,
  • [3] 3D Model Classification and Retrieval Based on CNN and Voting Scheme
    Bai J.
    Si Q.
    Qin F.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2019, 31 (02): : 303 - 314
  • [4] 3D Model Retrieval Using Multiple Features and Manifold Ranking
    Hsieh, Cheng-Ta
    Han, Chin-Chuan
    Shih, Jau-Ling
    Lee, Chang-Hsing
    Fan, Kuo-Chin
    2015 8TH INTERNATIONAL CONFERENCE ON UBI-MEDIA COMPUTING (UMEDIA) CONFERENCE PROCEEDINGS, 2015, : 7 - 10
  • [5] On volume distribution features based 3D model retrieval
    Pang, Mingyong
    Dai, Wenjun
    Wu, Gangshan
    Zhang, Fuyan
    ADVANCES IN ARTIFICIAL REALITY AND TELE-EXISTENCE, PROCEEDINGS, 2006, 4282 : 928 - +
  • [6] 3D CAD model retrieval based on the combination of features
    Chen, Qiang
    Fang, Bin
    Yu, Yong-Mei
    Tang, Yan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2015, 74 (13) : 4907 - 4925
  • [7] 3D CAD model retrieval based on the combination of features
    Qiang Chen
    Bin Fang
    Yong-Mei Yu
    Yan Tang
    Multimedia Tools and Applications, 2015, 74 : 4907 - 4925
  • [8] 3D engineering model retrieval algorithm based on multiple features and similarity calculation optimization
    Zhuang, Ting
    Zhang, Xutang
    Hou, Zhenxiu
    Harbin Gongcheng Daxue Xuebao/Journal of Harbin Engineering University, 2015, 36 (05): : 720 - 724
  • [9] Off-the-shelf CNN features for 3D object retrieval
    Dong Wang
    Bin Wang
    Sicheng Zhao
    Hongxun Yao
    Hong Liu
    Multimedia Tools and Applications, 2018, 77 : 19833 - 19849
  • [10] A 3D motion image recognition model based on 3D CNN-GRU model and attention mechanism
    Cheng, Chen
    Xu, Huahu
    IMAGE AND VISION COMPUTING, 2024, 146