Leveraging artificial intelligence to summarize abstracts in lay language for increasing research accessibility and transparency

被引:3
|
作者
Shyr, Cathy [1 ]
Grout, Randall W. [2 ,3 ]
Kennedy, Nan [4 ]
Akdas, Yasemin [5 ]
Tischbein, Maeve [4 ]
Milford, Joshua [4 ]
Tan, Jason [4 ]
Quarles, Kaysi [4 ]
Edwards, Terri L. [4 ]
Novak, Laurie L. [1 ]
White, Jules [6 ]
Wilkins, Consuelo H. [7 ]
Harris, Paul A. [1 ,8 ,9 ]
机构
[1] Vanderbilt Univ, Dept Biomed Informat, Med Ctr, 2525 West End Ave, Nashville, TN 37203 USA
[2] Indiana Univ Sch Med, Dept Pediat, Indianapolis, IN 46202 USA
[3] Regenstrief Inst Inc, Indianapolis, IN 46202 USA
[4] Vanderbilt Univ, Vanderbilt Inst Clin & Translat Res, Med Ctr, Nashville, TN 37203 USA
[5] Vanderbilt Univ, Div Emergency Med Res, Med Ctr, Nashville, TN 37232 USA
[6] Vanderbilt Univ, Dept Elect Engn & Comp Sci, Nashville, TN 37240 USA
[7] Vanderbilt Univ, Dept Med, Med Ctr, Nashville, TN 37232 USA
[8] Vanderbilt Univ, Dept Biostat, Med Ctr, Nashville, TN 37203 USA
[9] Vanderbilt Univ, Dept Biomed Engn, Nashville, TN 37240 USA
关键词
artificial intelligence; large language model; text summarization; ResearchMatch; return of study results; PARTICIPANTS; COMMUNICATION; ATTITUDES; TEXT;
D O I
10.1093/jamia/ocae186
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Objective Returning aggregate study results is an important ethical responsibility to promote trust and inform decision making, but the practice of providing results to a lay audience is not widely adopted. Barriers include significant cost and time required to develop lay summaries and scarce infrastructure necessary for returning them to the public. Our study aims to generate, evaluate, and implement ChatGPT 4 lay summaries of scientific abstracts on a national clinical study recruitment platform, ResearchMatch, to facilitate timely and cost-effective return of study results at scale.Materials and Methods We engineered prompts to summarize abstracts at a literacy level accessible to the public, prioritizing succinctness, clarity, and practical relevance. Researchers and volunteers assessed ChatGPT-generated lay summaries across five dimensions: accuracy, relevance, accessibility, transparency, and harmfulness. We used precision analysis and adaptive random sampling to determine the optimal number of summaries for evaluation, ensuring high statistical precision.Results ChatGPT achieved 95.9% (95% CI, 92.1-97.9) accuracy and 96.2% (92.4-98.1) relevance across 192 summary sentences from 33 abstracts based on researcher review. 85.3% (69.9-93.6) of 34 volunteers perceived ChatGPT-generated summaries as more accessible and 73.5% (56.9-85.4) more transparent than the original abstract. None of the summaries were deemed harmful. We expanded ResearchMatch's technical infrastructure to automatically generate and display lay summaries for over 750 published studies that resulted from the platform's recruitment mechanism.Discussion and Conclusion Implementing AI-generated lay summaries on ResearchMatch demonstrates the potential of a scalable framework generalizable to broader platforms for enhancing research accessibility and transparency.
引用
收藏
页码:2294 / 2303
页数:10
相关论文
共 50 条
  • [41] Artificial Intelligence in scientific writing and research publication: A paradigm shift in language inclusivity
    Osama, Muhammad
    JOURNAL OF BACK AND MUSCULOSKELETAL REHABILITATION, 2024, 37 (02) : 249 - 251
  • [42] The 'Implicit Intelligence' of artificial intelligence. Investigating the potential of large language models in social science research
    Cappelli, Ottorino
    Aliberti, Marco
    Praino, Rodrigo
    POLITICAL RESEARCH EXCHANGE, 2024, 6 (01):
  • [43] The Application Landscape and Research Status of Artificial Intelligence in Language Learning: A Visual Analysis
    Chen, Xiaojiao
    Zhu, Keke
    Jing, Yuhui
    Wang, Chengliang
    PROCEEDINGS OF THE 15TH INTERNATIONAL CONFERENCE ON EDUCATION TECHNOLOGY AND COMPUTERS, ICETC 2023, 2023, : 461 - 468
  • [44] Artificial Intelligence text generators for overcoming language barriers in ecological research communication
    Zenni, Rafael D.
    Andrew, Nigel R.
    AUSTRAL ECOLOGY, 2023, 48 (07) : 1225 - 1229
  • [45] Bridging nano- and microscale X-ray tomography for battery research by leveraging artificial intelligence
    Jonathan Scharf
    Mehdi Chouchane
    Donal P. Finegan
    Bingyu Lu
    Christopher Redquest
    Min-cheol Kim
    Weiliang Yao
    Alejandro A. Franco
    Dan Gostovic
    Zhao Liu
    Mark Riccio
    František Zelenka
    Jean-Marie Doux
    Ying Shirley Meng
    Nature Nanotechnology, 2022, 17 : 446 - 459
  • [46] Comprehensive review of publicly available colonoscopic imaging databases for artificial intelligence research: availability, accessibility, and usability
    Houwen, Britt B. S. L.
    Nass, Karlijn J.
    Vleugels, Jasper L. A.
    Fockens, Paul
    Hazewinkel, Yark
    Dekker, Evelien
    GASTROINTESTINAL ENDOSCOPY, 2023, 97 (02) : 184 - 199.e16
  • [47] Bridging nano- and microscale X-ray tomography for battery research by leveraging artificial intelligence
    Scharf, Jonathan
    Chouchane, Mehdi
    Finegan, Donal P.
    Lu, Bingyu
    Redquest, Christopher
    Kim, Min-cheol
    Yao, Weiliang
    Franco, Alejandro A.
    Gostovic, Dan
    Liu, Zhao
    Riccio, Mark
    Zelenka, Frantsek
    Doux, Jean-Marie
    Meng, Ying Shirley
    NATURE NANOTECHNOLOGY, 2022, 17 (05) : 446 - 459
  • [48] Leveraging artificial intelligence in firm-generated online customer communities: a framework and future research agenda
    Marti, Candice L.
    Liu, Huimin
    Kour, Gurpreet
    Bilgihan, Anil
    Xu, Yu
    JOURNAL OF SERVICE MANAGEMENT, 2024, 35 (03) : 438 - 458
  • [49] Need for Transparency and Clinical Interpretability in Hemorrhagic Stroke Artificial Intelligence Research: Promoting Effective Clinical Application
    Lim, Chae Young
    Sohn, Beomseok
    Seong, Minjung
    Kim, Eung Yeop
    Kim, Sung Tae
    Won, So Yeon
    YONSEI MEDICAL JOURNAL, 2024, 65 (10) : 611 - 618
  • [50] Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework
    Turchioe, Meghan Reading
    Kisselev, Sergey
    Van Bulck, Liesbet
    Bakken, Suzanne
    APPLIED CLINICAL INFORMATICS, 2024, 15 (05): : 842 - 851