Development and validation of a machine learning model integrated with the clinical workflow for early detection of sepsis

被引:2
|
作者
Mahyoub, Mohammed A. [1 ,2 ]
Yadav, Ravi R. [1 ]
Dougherty, Kacie [1 ]
Shukla, Ajit [1 ]
机构
[1] Virtua Hlth, Adv Analyt & Solut, Marlton, NJ 08053 USA
[2] SUNY Binghamton, Dept Syst Sci & Ind Engn, Binghamton, NY USA
关键词
sepsis; early detection; machine learning; XGBoost; model interpretability; machine learning deployment; MORTALITY;
D O I
10.3389/fmed.2023.1284081
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
BackgroundSepsis is a life-threatening condition caused by a dysregulated response to infection, affecting millions of people worldwide. Early diagnosis and treatment are critical for managing sepsis and reducing morbidity and mortality rates.Materials and methodsA systematic design approach was employed to build a model that predicts sepsis, incorporating clinical feedback to identify relevant data elements. XGBoost was utilized for prediction, and interpretability was achieved through the application of Shapley values. The model was successfully deployed within a widely used Electronic Medical Record (EMR) system.ResultsThe developed model demonstrated robust performance pre-operations, with a sensitivity of 92%, specificity of 93%, and a false positive rate of 7%. Following deployment, the model maintained comparable performance, with a sensitivity of 91% and specificity of 94%. Notably, the post-deployment false positive rate of 6% represents a substantial reduction compared to the currently deployed commercial model in the same health system, which exhibits a false positive rate of 30%.DiscussionThese findings underscore the effectiveness and potential value of the developed model in improving timely sepsis detection and reducing unnecessary alerts in clinical practice. Further investigations should focus on its long-term generalizability and impact on patient outcomes.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Development and validation of a machine learning model integrated with the clinical workflow for inpatient discharge date prediction
    Mahyoub, Mohammed A.
    Dougherty, Kacie
    Yadav, Ravi R.
    Berio-Dorta, Raul
    Shukla, Ajit
    FRONTIERS IN DIGITAL HEALTH, 2024, 6
  • [2] Development and Validation of a Machine Learning Model for Early Detection of Untreated Infection
    Buell, Kevin G.
    Carey, Kyle A.
    Dussault, Nicole
    Parker, William F.
    Dumanian, Jay
    Bhavani, Sivasubramanium V.
    Gilbert, Emily R.
    Winslow, Christopher J.
    Shah, Nirav S.
    Afshar, Majid
    Edelson, Dana P.
    Churpek, Matthew M.
    CRITICAL CARE EXPLORATIONS, 2024, 6 (10)
  • [3] Machine learning for early detection of sepsis: an internal and temporal validation study
    Bedoya, Armando D.
    Futoma, Joseph
    Clement, Meredith E.
    Corey, Kristin
    Brajer, Nathan
    Lin, Anthony
    Simons, Morgan G.
    Gao, Michael
    Nichols, Marshall
    Balu, Suresh
    Heller, Katherine
    Sendak, Mark
    O'Brien, Cara
    JAMIA OPEN, 2020, 3 (02) : 252 - 260
  • [4] Clinical validation and optimization of machine learning models for early prediction of sepsis
    Liu, Xi
    Li, Meiyi
    Liu, Xu
    Luo, Yuting
    Yang, Dong
    Hui, Ouyang
    He, Jiaoling
    Xia, Jinyu
    Xiao, Fei
    FRONTIERS IN MEDICINE, 2025, 12
  • [5] Validation of a Machine Learning Model for Early Shock Detection
    Pinevich, Yuliya
    Amos-Binks, Adam
    Burris, Christie S.
    Rule, Gregory
    Bogojevic, Marija
    Flint, Isaac
    Pickering, Brian W.
    Nemeth, Christopher P.
    Herasevich, Vitaly
    MILITARY MEDICINE, 2022, 187 (1-2) : 82 - 88
  • [6] Early Detection of Sepsis With Machine Learning Techniques: A Brief Clinical Perspective
    Giacobbe, Daniele Roberto
    Signori, Alessio
    Del Puente, Filippo
    Mora, Sara
    Carmisciano, Luca
    Briano, Federica
    Vena, Antonio
    Ball, Lorenzo
    Robba, Chiara
    Pelosi, Paolo
    Giacomini, Mauro
    Bassetti, Matteo
    FRONTIERS IN MEDICINE, 2021, 8
  • [7] Early sepsis mortality prediction model based on interpretable machine learning approach: development and validation study
    Wang, Yiping
    Gao, Zhihong
    Zhang, Yang
    Lu, Zhongqiu
    Sun, Fangyuan
    INTERNAL AND EMERGENCY MEDICINE, 2024, : 909 - 918
  • [8] DEVELOPMENT OF A MACHINE LEARNING MODEL FOR EARLY SHOCK DETECTION
    Pinevich, Yuliya
    Amos-Binks, Adam
    Burris, Christie
    Rule, Gregory
    Lowe, Ryan
    Pickering, Brian
    Nemeth, Christopher
    Herasevich, Vitaly
    CRITICAL CARE MEDICINE, 2020, 48
  • [9] Development and Validation of a Machine Learning Model for Early Prediction of Sepsis Onset in Hospital Inpatients from All Departments
    Thiboud, Pierre-Elliott
    Francois, Quentin
    Faure, Cecile
    Chaufferin, Gilles
    Arribe, Barthelemy
    Ettahar, Nicolas
    DIAGNOSTICS, 2025, 15 (03)
  • [10] Development and multi-center validation of machine learning model for early detection of fungal keratitis
    Wei, Zhenyu
    Wang, Shigeng
    Wang, Zhiqun
    Zhang, Yang
    Chen, Kexin
    Gong, Lan
    Li, Guigang
    Zheng, Qinxiang
    Zhang, Qin
    He, Yan
    Zhang, Qi
    Chen, Di
    Cao, Kai
    Pang, Jinding
    Zhang, Zijun
    Wang, Leying
    Ou, Zhonghong
    Liang, Qingfeng
    EBIOMEDICINE, 2023, 88