Accurate estimation of 6-DoF tooth pose in 3D intraoral scans for dental applications using deep learning

被引:0
|
作者
Ding, Wanghui [1 ]
Sun, Kaiwei [2 ]
Yu, Mengfei [1 ]
Lin, Hangzheng [2 ]
Feng, Yang [3 ]
Li, Jianhua [4 ]
Liu, Zuozhu [1 ,2 ]
机构
[1] Zhejiang Univ, Stomatol Hosp, Canc Ctr Zhejiang Univ, Engn Res Ctr Oral Biomat & Devices Zhejiang Prov,S, Hangzhou 310000, Peoples R China
[2] Zhejiang Univ, Univ Illinois, Urbana Champaign Inst, Haining 314400, Peoples R China
[3] Angel Align Inc, Shanghai 200433, Peoples R China
[4] Hangzhou Dent Hosp, Hangzhou 310006, Peoples R China
基金
中国国家自然科学基金;
关键词
Artificial intelligence; Digital dentistry; Deep learning; Orthodontics; Tooth pose; Neural network;
D O I
10.1631/FITEE.2300596
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A critical step in digital dentistry is to accurately and automatically characterize the orientation and position of individual teeth, which can subsequently be used for treatment planning and simulation in orthodontic tooth alignment. This problem remains challenging because the geometric features of different teeth are complicated and vary significantly, while a reliable large-scale dataset is yet to be constructed. In this paper we propose a novel method for automatic tooth orientation estimation by formulating it as a six-degree-of-freedom (6-DoF) tooth pose estimation task. Regarding each tooth as a three-dimensional (3D) point cloud, we design a deep neural network with a feature extractor backbone and a two-branch estimation head for tooth pose estimation. Our model, trained with a novel loss function on the newly collected large-scale dataset (10 393 patients with 280 611 intraoral tooth scans), achieves an average Euler angle error of only 4.780 degrees-5.979 degrees and a translation L1 error of 0.663 mm on a hold-out set of 2598 patients (77 870 teeth). Comprehensive experiments show that 98.29% of the estimations produce a mean angle error of less than 15 degrees, which is acceptable for many clinical and industrial applications.
引用
收藏
页码:1240 / 1249
页数:10
相关论文
共 50 条
  • [1] NEMA: 6-DoF Pose Estimation Dataset for Deep Learning
    Roman, Philippe Perez de San
    Desbarats, Pascal
    Domenger, Jean-Philippe
    Buendia, Axel
    PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 4, 2022, : 682 - 690
  • [2] 6-DoF Pose Estimation for Axisymmetric Objects Using Deep Learning with Uncertainty
    Hashimoto, Shintaro
    Hirano, Daichi
    Ishihama, Naoki
    2020 IEEE AEROSPACE CONFERENCE (AEROCONF 2020), 2020,
  • [3] Object 6-DoF pose estimation using auxiliary learning
    Chen M.
    Gai S.
    Da F.
    Yu J.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2024, 32 (06): : 901 - 914
  • [4] Deep object 6-DoF pose estimation using instance segmentation
    Pujolle, Victor
    Hayashi, Eiji
    PROCEEDINGS OF THE 2020 INTERNATIONAL CONFERENCE ON ARTIFICIAL LIFE AND ROBOTICS (ICAROB2020), 2020, : 241 - 244
  • [5] Online 3D Reconstruction and 6-DoF Pose Estimation for RGB-D Sensors
    Lim, Hyon
    Lim, Jongwoo
    Kim, H. Jin
    COMPUTER VISION - ECCV 2014 WORKSHOPS, PT I, 2015, 8925 : 238 - 254
  • [6] Image Based 6-DOF Camera Pose Estimation with Weighted RANSAC 3D
    Wetzel, Johannes
    PATTERN RECOGNITION, GCPR 2013, 2013, 8142 : 249 - 254
  • [7] 6-DoF Pose Estimation from Stereo LiDAR of Actual Machine using Deep Learning
    Hashimoto, Shintaro
    Nakajima, Yu
    Ishihama, Naoki
    2023 IEEE AEROSPACE CONFERENCE, 2023,
  • [8] 6-DOF Pose Estimation from Single Ultrasound Image Using 3D IP Models
    Zheng, Bo
    Ishikawa, Ryo
    Oishi, Takeshi
    Takamatsu, Jun
    Ikeuchi, Katsushi
    2008 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, VOLS 1-3, 2008, : 812 - +
  • [9] 6DOF Pose Estimation using 3D Sensors
    Verzijlenberg, Bart
    Jenkin, Michael
    2011 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2011,
  • [10] Towards Deep Learning-based 6D Bin Pose Estimation in 3D Scans
    Gajdosech, Lukas
    Kocur, Viktor
    Stuchlik, Martin
    Hudec, Lukas
    Madaras, Martin
    PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 4, 2022, : 545 - 552