Interpretable and Interactive Deep Multiple Instance Learning for Dental Caries Classification in Bitewing X-rays

被引:0
|
作者
Bergner, Benjamin [1 ,5 ]
Rohrer, Csaba [2 ]
Taleb, Aiham [1 ]
Duchrau, Martha [2 ]
De Leon, Guilherme [3 ]
Rodrigues, Jonas Almeida [4 ]
Schwendicke, Falk [2 ]
Krois, Joachim [2 ]
Lippert, Christoph [1 ,5 ]
机构
[1] Univ Potsdam, Hasso Plattner Inst, Digital Hlth & Machine Learning, Potsdam, Germany
[2] Charite, Dept Oral Diagnost, Digital Hlth & Hlth Serv Res, Berlin, Germany
[3] Contraste Radiol Odontol, Blumenau, Brazil
[4] Univ Fed Rio Grande UFRGS, Sch Dent, Dept Surg & Orthoped, Porto Alegre, RS, Brazil
[5] Icahn Sch Med Mt Sinai, Hasso Plattner Inst Digital Hlth Mt Sinai, New York, NY 10029 USA
关键词
dental deep learning; MIL; interpretability; interactive learning;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a simple and efficient image classification architecture based on deep multiple instance learning, and apply it to the challenging task of caries detection in dental radiographs. Technically, our approach contributes in two ways: First, it outputs a heatmap of local patch classification probabilities despite being trained with weak image-level labels. Second, it is amenable to learning from segmentation labels to guide training. In contrast to existing methods, the human user can faithfully interpret predictions and interact with the model to decide which regions to attend to. Experiments are conducted on a large clinical dataset of similar to 38k bitewings (similar to 316k teeth), where we achieve competitive performance compared to various baselines. When guided by an external caries segmentation model, a significant improvement in classification and localization performance is observed.
引用
收藏
页码:130 / 149
页数:20
相关论文
共 50 条
  • [31] Classification and segmentation of hip fractures in x-rays: highlighting fracture regions for interpretable diagnosis
    Germán González
    Joaquín Galant
    José María Salinas
    Emilia Benítez
    Maria Dolores Sánchez-Valverde
    Jorge Calbo
    Nicolás Cerrolaza
    Insights into Imaging, 16 (1)
  • [32] Deep Learning Method for Normal, Osteopenia and Osteoporosis Classification on Chest X-rays: A Multinational Investigation
    Kim, Minje
    Park, Junhyeok
    Park, Saerom
    Jang, Miso
    Jeong, Jinhoon
    Lee, Seung Hun
    Koh, Jung-Min
    Bae, Sung Jin
    Kim, Namkug
    JOURNAL OF BONE AND MINERAL RESEARCH, 2024, 39 : 45 - 45
  • [33] Numbering permanent and deciduous teeth via deep instance segmentation in panoramic X-rays
    Pinheiro, Lais
    Silva, Bernardo
    Sobrinho, Brenda
    Lima, Fernanda
    Cury, Patricia
    Oliveira, Luciano
    17TH INTERNATIONAL SYMPOSIUM ON MEDICAL INFORMATION PROCESSING AND ANALYSIS, 2021, 12088
  • [34] Transfer learning with chest X-rays for ER patient classification
    Jonathan Stubblefield
    Mitchell Hervert
    Jason L. Causey
    Jake A. Qualls
    Wei Dong
    Lingrui Cai
    Jennifer Fowler
    Emily Bellis
    Karl Walker
    Jason H. Moore
    Sara Nehring
    Xiuzhen Huang
    Scientific Reports, 10
  • [35] Transfer learning with chest X-rays for ER patient classification
    Stubblefield, Jonathan
    Hervert, Mitchell
    Causey, Jason L.
    Qualls, Jake A.
    Dong, Wei
    Cai, Lingrui
    Fowler, Jennifer
    Bellis, Emily
    Walker, Karl
    Moore, Jason H.
    Nehring, Sara
    Huang, Xiuzhen
    SCIENTIFIC REPORTS, 2020, 10 (01)
  • [36] Deep learning for prediction of cardiomegaly using chest X-rays
    Department of Biological Sciences and Engineering , Netaji Subhas University of Technology , Dwarka Sector-3, Delhi
    110078, India
    Neural Comput. Appl., 2024, 31 (19383-19391): : 19383 - 19391
  • [37] Identifying pneumonia in chest X-rays: A deep learning approach
    Jaiswal, Amit Kumar
    Tiwari, Prayag
    Kumar, Sachin
    Gupta, Deepak
    Khanna, Ashish
    Rodrigues, Joel J. P. C.
    MEASUREMENT, 2019, 145 : 511 - 518
  • [38] A Hybrid Optimization Approach with Deep Learning Technique for the Classification of Dental Caries
    Chawla, Riddhi
    Krishna, Konda Hari
    Deshmukh, Araddhana Arvind
    Sagar, K. V. Daya
    Al Ansari, Mohammed Saleh
    Taloba, Ahmed, I
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (12) : 339 - 347
  • [39] Dental Caries Detection and Classification in CBCT Images Using Deep Learning
    Esmaeilyfard, Rasool
    Bonyadifard, Haniyeh
    Paknahad, Maryam
    INTERNATIONAL DENTAL JOURNAL, 2024, 74 (02) : 328 - 334
  • [40] Classification of COVID-19 chest X-rays with deep learning: new models or fine tuning?
    Tuan D. Pham
    Health Information Science and Systems, 9