Leveraging artificial intelligence to summarize abstracts in lay language for increasing research accessibility and transparency

被引:3
|
作者
Shyr, Cathy [1 ]
Grout, Randall W. [2 ,3 ]
Kennedy, Nan [4 ]
Akdas, Yasemin [5 ]
Tischbein, Maeve [4 ]
Milford, Joshua [4 ]
Tan, Jason [4 ]
Quarles, Kaysi [4 ]
Edwards, Terri L. [4 ]
Novak, Laurie L. [1 ]
White, Jules [6 ]
Wilkins, Consuelo H. [7 ]
Harris, Paul A. [1 ,8 ,9 ]
机构
[1] Vanderbilt Univ, Dept Biomed Informat, Med Ctr, 2525 West End Ave, Nashville, TN 37203 USA
[2] Indiana Univ Sch Med, Dept Pediat, Indianapolis, IN 46202 USA
[3] Regenstrief Inst Inc, Indianapolis, IN 46202 USA
[4] Vanderbilt Univ, Vanderbilt Inst Clin & Translat Res, Med Ctr, Nashville, TN 37203 USA
[5] Vanderbilt Univ, Div Emergency Med Res, Med Ctr, Nashville, TN 37232 USA
[6] Vanderbilt Univ, Dept Elect Engn & Comp Sci, Nashville, TN 37240 USA
[7] Vanderbilt Univ, Dept Med, Med Ctr, Nashville, TN 37232 USA
[8] Vanderbilt Univ, Dept Biostat, Med Ctr, Nashville, TN 37203 USA
[9] Vanderbilt Univ, Dept Biomed Engn, Nashville, TN 37240 USA
关键词
artificial intelligence; large language model; text summarization; ResearchMatch; return of study results; PARTICIPANTS; COMMUNICATION; ATTITUDES; TEXT;
D O I
10.1093/jamia/ocae186
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Objective Returning aggregate study results is an important ethical responsibility to promote trust and inform decision making, but the practice of providing results to a lay audience is not widely adopted. Barriers include significant cost and time required to develop lay summaries and scarce infrastructure necessary for returning them to the public. Our study aims to generate, evaluate, and implement ChatGPT 4 lay summaries of scientific abstracts on a national clinical study recruitment platform, ResearchMatch, to facilitate timely and cost-effective return of study results at scale.Materials and Methods We engineered prompts to summarize abstracts at a literacy level accessible to the public, prioritizing succinctness, clarity, and practical relevance. Researchers and volunteers assessed ChatGPT-generated lay summaries across five dimensions: accuracy, relevance, accessibility, transparency, and harmfulness. We used precision analysis and adaptive random sampling to determine the optimal number of summaries for evaluation, ensuring high statistical precision.Results ChatGPT achieved 95.9% (95% CI, 92.1-97.9) accuracy and 96.2% (92.4-98.1) relevance across 192 summary sentences from 33 abstracts based on researcher review. 85.3% (69.9-93.6) of 34 volunteers perceived ChatGPT-generated summaries as more accessible and 73.5% (56.9-85.4) more transparent than the original abstract. None of the summaries were deemed harmful. We expanded ResearchMatch's technical infrastructure to automatically generate and display lay summaries for over 750 published studies that resulted from the platform's recruitment mechanism.Discussion and Conclusion Implementing AI-generated lay summaries on ResearchMatch demonstrates the potential of a scalable framework generalizable to broader platforms for enhancing research accessibility and transparency.
引用
收藏
页码:2294 / 2303
页数:10
相关论文
共 50 条
  • [21] Democratizing academic research with Artificial Intelligence: The misleading case of language
    Ghio, Alessandro
    CRITICAL PERSPECTIVES ON ACCOUNTING, 2024, 98
  • [22] Research on Personalized English Language Learning Based on Artificial Intelligence
    Yang, Kunlun
    Applied Mathematics and Nonlinear Sciences, 2024, 9 (01)
  • [23] Trends, Research Issues and Applications of Artificial Intelligence in Language Education
    Huang, Xinyi
    Zou, Di
    Cheng, Gary
    Chen, Xieling
    Xie, Haoran
    EDUCATIONAL TECHNOLOGY & SOCIETY, 2021, 24 (03): : 238 - 255
  • [24] Trends, Research Issues and Applications of Artificial Intelligence in Language Education
    Huang, Xinyi
    Zou, Di
    Cheng, Gary
    Chen, Xieling
    Xie, Haoran
    EDUCATIONAL TECHNOLOGY & SOCIETY, 2023, 26 (01): : 112 - 131
  • [25] Research Trends of Artificial Intelligence in Language Education: A Bibliometric Review
    Liu, Lei
    Fu, Linling
    2024 INTERNATIONAL SYMPOSIUM ON EDUCATIONAL TECHNOLOGY, ISET, 2024, : 29 - 33
  • [26] Leveraging the efficiency and transparency of artificial intelligence-driven visual Chatbot through smart prompt learning concept
    Goktas, Polat
    Kucukkaya, Aycan
    Karacay, Pelin
    SKIN RESEARCH AND TECHNOLOGY, 2023, 29 (11)
  • [27] Leveraging artificial intelligence (AI) in English as a foreign language (EFL) classes: Challenges and opportunities in the spotlight
    Dai, Kun
    Liu, Quanguo
    COMPUTERS IN HUMAN BEHAVIOR, 2024, 159
  • [28] Research on the Application of Artificial Intelligence in Public Health Management: Leveraging Artificial Intelligence to Improve COVID-19 CT Image Diagnosis
    He, Tiancheng
    Liu, Hong
    Zhang, Zhihao
    Li, Chao
    Zhou, Youmei
    INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2023, 20 (02)
  • [29] Leveraging artificial intelligence to enhance systematic reviews in health research: advanced tools and challenges
    Ge, Lixia
    Agrawal, Rupesh
    Singer, Maxwell
    Kannapiran, Palvannan
    Molina, Joseph Antonio De Castro
    Teow, Kiok Liang
    Yap, Chun Wei
    Abisheganaden, John Arputhan
    SYSTEMATIC REVIEWS, 2024, 13 (01)
  • [30] Disclosure Standards for Social Media and Generative Artificial Intelligence Research: Toward Transparency and Replicability
    Kostygina, Ganna
    Kim, Yoonsang
    Seeskin, Zachary
    Leclere, Felicia
    Emery, Sherry
    SOCIAL MEDIA + SOCIETY, 2023, 9 (04):