Leveraging artificial intelligence to summarize abstracts in lay language for increasing research accessibility and transparency

被引:3
|
作者
Shyr, Cathy [1 ]
Grout, Randall W. [2 ,3 ]
Kennedy, Nan [4 ]
Akdas, Yasemin [5 ]
Tischbein, Maeve [4 ]
Milford, Joshua [4 ]
Tan, Jason [4 ]
Quarles, Kaysi [4 ]
Edwards, Terri L. [4 ]
Novak, Laurie L. [1 ]
White, Jules [6 ]
Wilkins, Consuelo H. [7 ]
Harris, Paul A. [1 ,8 ,9 ]
机构
[1] Vanderbilt Univ, Dept Biomed Informat, Med Ctr, 2525 West End Ave, Nashville, TN 37203 USA
[2] Indiana Univ Sch Med, Dept Pediat, Indianapolis, IN 46202 USA
[3] Regenstrief Inst Inc, Indianapolis, IN 46202 USA
[4] Vanderbilt Univ, Vanderbilt Inst Clin & Translat Res, Med Ctr, Nashville, TN 37203 USA
[5] Vanderbilt Univ, Div Emergency Med Res, Med Ctr, Nashville, TN 37232 USA
[6] Vanderbilt Univ, Dept Elect Engn & Comp Sci, Nashville, TN 37240 USA
[7] Vanderbilt Univ, Dept Med, Med Ctr, Nashville, TN 37232 USA
[8] Vanderbilt Univ, Dept Biostat, Med Ctr, Nashville, TN 37203 USA
[9] Vanderbilt Univ, Dept Biomed Engn, Nashville, TN 37240 USA
关键词
artificial intelligence; large language model; text summarization; ResearchMatch; return of study results; PARTICIPANTS; COMMUNICATION; ATTITUDES; TEXT;
D O I
10.1093/jamia/ocae186
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Objective Returning aggregate study results is an important ethical responsibility to promote trust and inform decision making, but the practice of providing results to a lay audience is not widely adopted. Barriers include significant cost and time required to develop lay summaries and scarce infrastructure necessary for returning them to the public. Our study aims to generate, evaluate, and implement ChatGPT 4 lay summaries of scientific abstracts on a national clinical study recruitment platform, ResearchMatch, to facilitate timely and cost-effective return of study results at scale.Materials and Methods We engineered prompts to summarize abstracts at a literacy level accessible to the public, prioritizing succinctness, clarity, and practical relevance. Researchers and volunteers assessed ChatGPT-generated lay summaries across five dimensions: accuracy, relevance, accessibility, transparency, and harmfulness. We used precision analysis and adaptive random sampling to determine the optimal number of summaries for evaluation, ensuring high statistical precision.Results ChatGPT achieved 95.9% (95% CI, 92.1-97.9) accuracy and 96.2% (92.4-98.1) relevance across 192 summary sentences from 33 abstracts based on researcher review. 85.3% (69.9-93.6) of 34 volunteers perceived ChatGPT-generated summaries as more accessible and 73.5% (56.9-85.4) more transparent than the original abstract. None of the summaries were deemed harmful. We expanded ResearchMatch's technical infrastructure to automatically generate and display lay summaries for over 750 published studies that resulted from the platform's recruitment mechanism.Discussion and Conclusion Implementing AI-generated lay summaries on ResearchMatch demonstrates the potential of a scalable framework generalizable to broader platforms for enhancing research accessibility and transparency.
引用
收藏
页码:2294 / 2303
页数:10
相关论文
共 50 条
  • [1] Letter to the editors in response to "Leveraging artificial intelligence to summarize abstracts in lay language for increasing research accessibility and transparency"
    Layne, Ethan
    Cei, Francesco
    Cacciamani, Giovanni E.
    JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION, 2025,
  • [2] Improving accessibility of scientific research by artificial intelligence-An example for lay abstract generation
    Schmitz, Boris
    DIGITAL HEALTH, 2023, 9
  • [3] Leveraging foundation and large language models in medical artificial intelligence
    Wong Io Nam
    Monteiro Olivia
    BaptistaHon Daniel T
    Wang Kai
    Lu Wenyang
    Sun Zhuo
    Nie Sheng
    Yin Yun
    中华医学杂志英文版, 2024, 137 (21)
  • [4] Leveraging foundation and large language models in medical artificial intelligence
    Wong, Io Nam
    Monteiro, Olivia
    Baptista-Hon, Daniel T.
    Wang, Kai
    Lu, Wenyang
    Sun, Zhuo
    Nie, Sheng
    Yin, Yun
    CHINESE MEDICAL JOURNAL, 2024, 137 (21) : 2529 - 2539
  • [5] Preliminary Research in Tsunami Modelling - Leveraging Artificial Intelligence Technology
    Mudita, Imam
    Hendriyono, Wahyu
    Putri, Gabriella Eka
    Wibowo, Mardi
    Gumbira, Gugum
    Sulistyodarmayanti, Nungki Dian
    2021 IEEE OCEAN ENGINEERING TECHNOLOGY AND INNOVATION CONFERENCE: OCEAN OBSERVATION, TECHNOLOGY AND INNOVATION IN SUPPORT OF OCEAN DECADE OF SCIENCE (OETIC), 2021, : 75 - 79
  • [6] A framework for fostering transparency in shared artificial intelligence models by increasing visibility of contributions
    Barclay, Iain
    Taylor, Harrison
    Preece, Alun
    Taylor, Ian
    Verma, Dinesh
    de Mel, Geeth
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (19):
  • [7] Increasing Transparency on the Use of Artificial Intelligence and Automated Tools in Mixed Methods Studies
    James, Tyler G.
    Guetterman, Timothy C.
    Molina-Azorin, Jose F.
    JOURNAL OF MIXED METHODS RESEARCH, 2024, 18 (04) : 425 - 429
  • [8] Research Presentation Session: Artificial Intelligence & Machine Learning Abstracts
    不详
    INSIGHTS INTO IMAGING, 2021, 12 (SUPPL 2): : 5 - 322
  • [9] Improving Cancer Information Accessibility: Leveraging Artificial Intelligence Chatbots to Improve NCCN Website Readability
    Abreu, Andres A.
    Murimwa, Gilbert
    Farah, Emile
    Zhang, Lucia
    Rodriguez, Jonathan
    Sweetenham, John
    Zeh, Herbert J., III
    Polanco, Patrician M.
    ANNALS OF SURGICAL ONCOLOGY, 2024, 31 (01) : S71 - S71
  • [10] Increasing Accessibility: Effectiveness of a Remote Artificial Intelligence Education Curriculum for International Medical Graduates
    Jagannath, Preethi
    Perera, Nichelle
    Minton, Laura
    Bass, Rachel
    Milner, Desmin
    Perchik, Jordan
    CLINICAL TEACHER, 2025, 22 (02):