Interpretable and Interactive Deep Multiple Instance Learning for Dental Caries Classification in Bitewing X-rays

被引:0
|
作者
Bergner, Benjamin [1 ,5 ]
Rohrer, Csaba [2 ]
Taleb, Aiham [1 ]
Duchrau, Martha [2 ]
De Leon, Guilherme [3 ]
Rodrigues, Jonas Almeida [4 ]
Schwendicke, Falk [2 ]
Krois, Joachim [2 ]
Lippert, Christoph [1 ,5 ]
机构
[1] Univ Potsdam, Hasso Plattner Inst, Digital Hlth & Machine Learning, Potsdam, Germany
[2] Charite, Dept Oral Diagnost, Digital Hlth & Hlth Serv Res, Berlin, Germany
[3] Contraste Radiol Odontol, Blumenau, Brazil
[4] Univ Fed Rio Grande UFRGS, Sch Dent, Dept Surg & Orthoped, Porto Alegre, RS, Brazil
[5] Icahn Sch Med Mt Sinai, Hasso Plattner Inst Digital Hlth Mt Sinai, New York, NY 10029 USA
关键词
dental deep learning; MIL; interpretability; interactive learning;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a simple and efficient image classification architecture based on deep multiple instance learning, and apply it to the challenging task of caries detection in dental radiographs. Technically, our approach contributes in two ways: First, it outputs a heatmap of local patch classification probabilities despite being trained with weak image-level labels. Second, it is amenable to learning from segmentation labels to guide training. In contrast to existing methods, the human user can faithfully interpret predictions and interact with the model to decide which regions to attend to. Experiments are conducted on a large clinical dataset of similar to 38k bitewings (similar to 316k teeth), where we achieve competitive performance compared to various baselines. When guided by an external caries segmentation model, a significant improvement in classification and localization performance is observed.
引用
收藏
页码:130 / 149
页数:20
相关论文
共 50 条
  • [41] Automated image classification of chest X-rays of COVID-19 using deep transfer learning
    Dilshad, Sara
    Singh, Nikhil
    Atif, M.
    Hanif, Atif
    Yaqub, Nafeesah
    Farooq, W. A.
    Ahmad, Hijaz
    Chu, Yu-ming
    Masood, Muhammad Tamoor
    RESULTS IN PHYSICS, 2021, 28
  • [42] Classification of COVID-19 chest X-rays with deep learning: new models or fine tuning?
    Pham, Tuan D.
    HEALTH INFORMATION SCIENCE AND SYSTEMS, 2021, 9 (01)
  • [43] Effect of Patient Clinical Variables in Osteoporosis Classification Using Hip X-rays in Deep Learning Analysis
    Yamamoto, Norio
    Sukegawa, Shintaro
    Yamashita, Kazutaka
    Manabe, Masaki
    Nakano, Keisuke
    Takabatake, Kiyofumi
    Kawai, Hotaka
    Ozaki, Toshifumi
    Kawasaki, Keisuke
    Nagatsuka, Hitoshi
    Furuki, Yoshihiko
    Yorifuji, Takashi
    MEDICINA-LITHUANIA, 2021, 57 (08):
  • [44] Precise dental caries segmentation in X-rays with an attention and edge dual-decoder network
    Huang, Feng
    Yin, Jiaxing
    Ma, Yuxin
    Zhang, Hao
    Ying, Shunv
    MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2025,
  • [45] CariesXrays: Enhancing Caries Detection in Hospital-Scale Panoramic Dental X-rays via Feature Pyramid Contrastive Learning
    Chen, Bingzhi
    Fu, Sisi
    Liu, Yishu
    Pan, Jiahui
    Lu, Guangming
    Zhang, Zheng
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 20, 2024, : 21940 - 21948
  • [46] Pneumonia Transfer Learning Deep Learning Model from Segmented X-rays
    Alharbi, Amal H.
    Mahmoud, Hanan A. Hosni
    HEALTHCARE, 2022, 10 (06)
  • [47] COVID-19 Chest X-rays Classification Through the Fusion of Deep Transfer Learning and Machine Learning Methods
    Khalifa, Nour Eldeen M.
    Taha, Mohamed Hamed N.
    Chakrabortty, Ripon K.
    Loey, Mohamed
    PROCEEDINGS OF 7TH INTERNATIONAL CONFERENCE ON HARMONY SEARCH, SOFT COMPUTING AND APPLICATIONS (ICHSA 2022), 2022, 140 : 1 - 11
  • [48] DEEP HIERARCHICAL MULTIPLE INSTANCE LEARNING FOR WHOLE SLIDE IMAGE CLASSIFICATION
    Zhou, Yuanpin
    Lu, Yao
    2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022), 2022,
  • [49] Deep Multiple Instance Learning for Image Classification and Auto-Annotation
    Wu, Jiajun
    Yu, Yinan
    Huang, Chang
    Yu, Kai
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 3460 - 3469
  • [50] Dental biothermophotonics: How photothermal methods are winning the race with X-rays for dental caries diagnostic needs of clinical dentistry
    A. Mandelis
    R. Jeon
    A. Matvienko
    S. H. Abrams
    B. T. Amaechi
    The European Physical Journal Special Topics, 2008, 153 : 449 - 454