Can large language models assist with pediatric dosing accuracy?

BACKGROUND AND OBJECTIVE: Medication errors in pediatric care remain a significant healthcare challenge despite technological advancements, necessitating innovative approaches. This study aims to evaluate Large Language Models' (LLMs) potential in reducing pediatric medication dosage calculation errors compared to experienced nurses. METHODS: This cross-sectional study (June-August 2024) involved 101 nurses from pediatric and neonatal departments and three LLMs (ChatGPT-4o, Claude-3.0, Llama 3 8B). Participants completed a nine-question survey on pediatric medication calculations. Primary outcomes were accuracy and response time. Secondary measures included seniority and group membership on accuracy. RESULTS: Significant differences (P < 0.001) were observed between nurses and LLMs. Nurses averaged 93.14 +/- 9.39 accuracy. Claude-3.0 and ChatGPT-4o achieved 100 accuracy, while Llama 3 8B was 66 accurate. LLMs were faster (15.7-75.12 seconds) than nurses (1621.2 +/- 8379.3 s).The Generalized Linear Model analysis revealed task performance was significantly influenced by duration (Wald chi(2) = 27,881.261, p < 0.001) and interaction between relative seniority and group membership (Wald chi(2) = 3,938.250, p < 0.001), with participants achieving a mean total grade of 91.03 (SD = 13.87). CONCLUSIONS: Claude-3.0 and ChatGPT-4o demonstrated perfect accuracy and rapid calculation capabilities, showing promise in reducing pediatric medication dosage errors. Further research is needed to explore their integration into practice.