Development and validation of a machine learning model integrated with the clinical workflow for early detection of sepsis

被引:2
|
作者
Mahyoub, Mohammed A. [1 ,2 ]
Yadav, Ravi R. [1 ]
Dougherty, Kacie [1 ]
Shukla, Ajit [1 ]
机构
[1] Virtua Hlth, Adv Analyt & Solut, Marlton, NJ 08053 USA
[2] SUNY Binghamton, Dept Syst Sci & Ind Engn, Binghamton, NY USA
关键词
sepsis; early detection; machine learning; XGBoost; model interpretability; machine learning deployment; MORTALITY;
D O I
10.3389/fmed.2023.1284081
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
BackgroundSepsis is a life-threatening condition caused by a dysregulated response to infection, affecting millions of people worldwide. Early diagnosis and treatment are critical for managing sepsis and reducing morbidity and mortality rates.Materials and methodsA systematic design approach was employed to build a model that predicts sepsis, incorporating clinical feedback to identify relevant data elements. XGBoost was utilized for prediction, and interpretability was achieved through the application of Shapley values. The model was successfully deployed within a widely used Electronic Medical Record (EMR) system.ResultsThe developed model demonstrated robust performance pre-operations, with a sensitivity of 92%, specificity of 93%, and a false positive rate of 7%. Following deployment, the model maintained comparable performance, with a sensitivity of 91% and specificity of 94%. Notably, the post-deployment false positive rate of 6% represents a substantial reduction compared to the currently deployed commercial model in the same health system, which exhibits a false positive rate of 30%.DiscussionThese findings underscore the effectiveness and potential value of the developed model in improving timely sepsis detection and reducing unnecessary alerts in clinical practice. Further investigations should focus on its long-term generalizability and impact on patient outcomes.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] Development and validation of a novel blending machine learning model for hospital mortality prediction in ICU patients with Sepsis
    Zhixuan Zeng
    Shuo Yao
    Jianfei Zheng
    Xun Gong
    BioData Mining, 14
  • [32] Early prediction of sepsis in intensive care patients using the machine learning algorithm NAVOY® Sepsis, a prospective randomized clinical validation study
    Persson, Inger
    Macura, Andreas
    Becedas, David
    Sjovall, Fredrik
    JOURNAL OF CRITICAL CARE, 2024, 80
  • [33] Development and Validation of a Machine-Learning Model to Predict Early Recurrence of Intrahepatic Cholangiocarcinoma
    Alaimo, Laura
    Lima, Henrique A.
    Moazzam, Zorays
    Endo, Yutaka
    Yang, Jason
    Ruzzenente, Andrea
    Guglielmi, Alfredo
    Aldrighetti, Luca
    Weiss, Matthew
    Bauer, Todd W. W.
    Alexandrescu, Sorin
    Poultsides, George A. A.
    Maithel, Shishir K. K.
    Marques, Hugo P. P.
    Martel, Guillaume
    Pulitano, Carlo
    Shen, Feng
    Cauchy, Francois
    Koerkamp, Bas Groot
    Endo, Itaru
    Kitago, Minoru
    Pawlik, Timothy M. M.
    ANNALS OF SURGICAL ONCOLOGY, 2023, 30 (09) : 5406 - 5415
  • [34] Development and Validation of a Machine-Learning Model to Predict Early Recurrence of Intrahepatic Cholangiocarcinoma
    Laura Alaimo
    Henrique A. Lima
    Zorays Moazzam
    Yutaka Endo
    Jason Yang
    Andrea Ruzzenente
    Alfredo Guglielmi
    Luca Aldrighetti
    Matthew Weiss
    Todd W. Bauer
    Sorin Alexandrescu
    George A. Poultsides
    Shishir K. Maithel
    Hugo P. Marques
    Guillaume Martel
    Carlo Pulitano
    Feng Shen
    François Cauchy
    Bas Groot Koerkamp
    Itaru Endo
    Minoru Kitago
    Timothy M. Pawlik
    Annals of Surgical Oncology, 2023, 30 : 5406 - 5415
  • [35] Interpretable Machine Learning for Early Prediction of Prognosis in Sepsis: A Discovery and Validation Study
    Chang Hu
    Lu Li
    Weipeng Huang
    Tong Wu
    Qiancheng Xu
    Juan Liu
    Bo Hu
    Infectious Diseases and Therapy, 2022, 11 : 1117 - 1132
  • [36] Interpretable Machine Learning for Early Prediction of Prognosis in Sepsis: A Discovery and Validation Study
    Hu, Chang
    Li, Lu
    Huang, Weipeng
    Wu, Tong
    Xu, Qiancheng
    Liu, Juan
    Hu, Bo
    INFECTIOUS DISEASES AND THERAPY, 2022, 11 (03) : 1117 - 1132
  • [37] Development and Validation of a Machine Learning-Based Prediction Model for Detection of Biliary Atresia
    Choi, Ho Jung
    Kim, Yeong Eun
    Namgoong, Jung-Man
    Kim, Inki
    Park, Jun Sung
    Baek, Woo Im
    Lee, Byong Sop
    Yoon, Hee Mang
    Cho, Young Ah
    Lee, Jin Seong
    Shim, Jung Ok
    Oh, Seak Hee
    Moon, Jin Soo
    Ko, Jae Sung
    Kim, Dae Yeon
    Kim, Kyung Mo
    GASTRO HEP ADVANCES, 2023, 2 (06): : 778 - 787
  • [38] Development and validation of a machine learning model for clinical wellness visit classification in cats and dogs
    Szlosek, Donald
    Coyne, Michael
    Riggott, Julia
    Knight, Kevin
    McCrann, D. J.
    Kincaid, Dave
    FRONTIERS IN VETERINARY SCIENCE, 2024, 11
  • [39] Development and Validation of a Machine Learning Model for Automated Assessment of Resident Clinical Reasoning Documentation
    Schaye, Verity
    Guzman, Benedict
    Burk-Rafel, Jesse
    Marin, Marina
    Reinstein, Ilan
    Kudlowitz, David
    Miller, Louis
    Chun, Jonathan
    Aphinyanaphongs, Yindalon
    JOURNAL OF GENERAL INTERNAL MEDICINE, 2022, 37 (09) : 2230 - 2238
  • [40] Development and Validation of a Machine Learning Model for Automated Assessment of Resident Clinical Reasoning Documentation
    Verity Schaye
    Benedict Guzman
    Jesse Burk-Rafel
    Marina Marin
    Ilan Reinstein
    David Kudlowitz
    Louis Miller
    Jonathan Chun
    Yindalon Aphinyanaphongs
    Journal of General Internal Medicine, 2022, 37 : 2230 - 2238