Accurate estimation of 6-DoF tooth pose in 3D intraoral scans for dental applications using deep learning

被引:0
|
作者
Ding, Wanghui [1 ]
Sun, Kaiwei [2 ]
Yu, Mengfei [1 ]
Lin, Hangzheng [2 ]
Feng, Yang [3 ]
Li, Jianhua [4 ]
Liu, Zuozhu [1 ,2 ]
机构
[1] Zhejiang Univ, Stomatol Hosp, Canc Ctr Zhejiang Univ, Engn Res Ctr Oral Biomat & Devices Zhejiang Prov,S, Hangzhou 310000, Peoples R China
[2] Zhejiang Univ, Univ Illinois, Urbana Champaign Inst, Haining 314400, Peoples R China
[3] Angel Align Inc, Shanghai 200433, Peoples R China
[4] Hangzhou Dent Hosp, Hangzhou 310006, Peoples R China
基金
中国国家自然科学基金;
关键词
Artificial intelligence; Digital dentistry; Deep learning; Orthodontics; Tooth pose; Neural network;
D O I
10.1631/FITEE.2300596
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A critical step in digital dentistry is to accurately and automatically characterize the orientation and position of individual teeth, which can subsequently be used for treatment planning and simulation in orthodontic tooth alignment. This problem remains challenging because the geometric features of different teeth are complicated and vary significantly, while a reliable large-scale dataset is yet to be constructed. In this paper we propose a novel method for automatic tooth orientation estimation by formulating it as a six-degree-of-freedom (6-DoF) tooth pose estimation task. Regarding each tooth as a three-dimensional (3D) point cloud, we design a deep neural network with a feature extractor backbone and a two-branch estimation head for tooth pose estimation. Our model, trained with a novel loss function on the newly collected large-scale dataset (10 393 patients with 280 611 intraoral tooth scans), achieves an average Euler angle error of only 4.780 degrees-5.979 degrees and a translation L1 error of 0.663 mm on a hold-out set of 2598 patients (77 870 teeth). Comprehensive experiments show that 98.29% of the estimations produce a mean angle error of less than 15 degrees, which is acceptable for many clinical and industrial applications.
引用
收藏
页码:1240 / 1249
页数:10
相关论文
共 50 条
  • [31] A Comprehensive Review on 3D Object Detection and 6D Pose Estimation With Deep Learning
    Hoque, Sabera
    Arafat, Md. Yasir
    Xu, Shuxiang
    Maiti, Ananda
    Wei, Yuchen
    IEEE ACCESS, 2021, 9 : 143746 - 143770
  • [32] BOLD3D: A 3D BOLD descriptor for 6Dof pose estimation
    Zhou, Jun
    Liu, Yuanpeng
    Liu, Jinshan
    Xie, Qian
    Zhang, Yuqi
    Zhu, Xusheng
    Ding, Xiao
    COMPUTERS & GRAPHICS-UK, 2020, 89 : 94 - 104
  • [33] A 3D Object Recognition and Pose estimation System Using Deep Learning Method
    Liang, Dong
    Weng, Kaijian
    Wang, Can
    Liang, Guoyuan
    Chen, Haoyao
    Wu, Xinyu
    2014 4TH IEEE INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND TECHNOLOGY (ICIST), 2014, : 401 - 404
  • [34] Deep learning based pose estimation method using 3D point clouds
    Wang, Haowen
    Ai, Shangyou
    Zhuang, Chungang
    Xiong, Zhenhua
    2021 27TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE (M2VIP), 2021,
  • [35] Surface-Based Detection and 6-DoF Pose Estimation of 3-D Objects in Cluttered Scenes
    Teng, Zhou
    Xiao, Jing
    IEEE TRANSACTIONS ON ROBOTICS, 2016, 32 (06) : 1347 - 1361
  • [36] A numerical methodology for a 6 DOF pose estimation with 3D magnetic field sensors
    Meier, Phil
    Rohrmann, Kris
    Sandner, Marvin
    Prochaska, Marcus
    2019 IEEE 62ND INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS (MWSCAS), 2019, : 1005 - 1008
  • [37] Learning 6D Object Pose Estimation Using 3D Object Coordinates
    Brachmann, Eric
    Krull, Alexander
    Michel, Frank
    Gumhold, Stefan
    Shotton, Jamie
    Rother, Carsten
    COMPUTER VISION - ECCV 2014, PT II, 2014, 8690 : 536 - 551
  • [38] TSegFormer: 3D Tooth Segmentation in Intraoral Scans with Geometry Guided Transformer
    Xiong, Huimin
    Li, Kunle
    Tan, Kaiyuan
    Feng, Yang
    Zhou, Joey Tianyi
    Hao, Jin
    Ying, Haochao
    Wu, Jian
    Liu, Zuozhu
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT VI, 2023, 14225 : 421 - 432
  • [39] Detecting Object Surface Keypoints From a Single RGB Image via Deep Learning Network for 6-DoF Pose Estimation
    Aing, Lee
    Lie, Wen-Nung
    IEEE ACCESS, 2021, 9 : 77729 - 77741
  • [40] 2D/3D Pose Estimation and Action Recognition using Multitask Deep Learning
    Luvizon, Diogo C.
    Picard, David
    Tabia, Hedi
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 5137 - 5146