Leveraging artificial intelligence to summarize abstracts in lay language for increasing research accessibility and transparency

被引:3
|
作者
Shyr, Cathy [1 ]
Grout, Randall W. [2 ,3 ]
Kennedy, Nan [4 ]
Akdas, Yasemin [5 ]
Tischbein, Maeve [4 ]
Milford, Joshua [4 ]
Tan, Jason [4 ]
Quarles, Kaysi [4 ]
Edwards, Terri L. [4 ]
Novak, Laurie L. [1 ]
White, Jules [6 ]
Wilkins, Consuelo H. [7 ]
Harris, Paul A. [1 ,8 ,9 ]
机构
[1] Vanderbilt Univ, Dept Biomed Informat, Med Ctr, 2525 West End Ave, Nashville, TN 37203 USA
[2] Indiana Univ Sch Med, Dept Pediat, Indianapolis, IN 46202 USA
[3] Regenstrief Inst Inc, Indianapolis, IN 46202 USA
[4] Vanderbilt Univ, Vanderbilt Inst Clin & Translat Res, Med Ctr, Nashville, TN 37203 USA
[5] Vanderbilt Univ, Div Emergency Med Res, Med Ctr, Nashville, TN 37232 USA
[6] Vanderbilt Univ, Dept Elect Engn & Comp Sci, Nashville, TN 37240 USA
[7] Vanderbilt Univ, Dept Med, Med Ctr, Nashville, TN 37232 USA
[8] Vanderbilt Univ, Dept Biostat, Med Ctr, Nashville, TN 37203 USA
[9] Vanderbilt Univ, Dept Biomed Engn, Nashville, TN 37240 USA
关键词
artificial intelligence; large language model; text summarization; ResearchMatch; return of study results; PARTICIPANTS; COMMUNICATION; ATTITUDES; TEXT;
D O I
10.1093/jamia/ocae186
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Objective Returning aggregate study results is an important ethical responsibility to promote trust and inform decision making, but the practice of providing results to a lay audience is not widely adopted. Barriers include significant cost and time required to develop lay summaries and scarce infrastructure necessary for returning them to the public. Our study aims to generate, evaluate, and implement ChatGPT 4 lay summaries of scientific abstracts on a national clinical study recruitment platform, ResearchMatch, to facilitate timely and cost-effective return of study results at scale.Materials and Methods We engineered prompts to summarize abstracts at a literacy level accessible to the public, prioritizing succinctness, clarity, and practical relevance. Researchers and volunteers assessed ChatGPT-generated lay summaries across five dimensions: accuracy, relevance, accessibility, transparency, and harmfulness. We used precision analysis and adaptive random sampling to determine the optimal number of summaries for evaluation, ensuring high statistical precision.Results ChatGPT achieved 95.9% (95% CI, 92.1-97.9) accuracy and 96.2% (92.4-98.1) relevance across 192 summary sentences from 33 abstracts based on researcher review. 85.3% (69.9-93.6) of 34 volunteers perceived ChatGPT-generated summaries as more accessible and 73.5% (56.9-85.4) more transparent than the original abstract. None of the summaries were deemed harmful. We expanded ResearchMatch's technical infrastructure to automatically generate and display lay summaries for over 750 published studies that resulted from the platform's recruitment mechanism.Discussion and Conclusion Implementing AI-generated lay summaries on ResearchMatch demonstrates the potential of a scalable framework generalizable to broader platforms for enhancing research accessibility and transparency.
引用
收藏
页码:2294 / 2303
页数:10
相关论文
共 50 条
  • [31] A systematic review of research on emotional artificial intelligence in English language education
    Liu, Yuhan
    Zhang, Heng
    Jiang, Meilin
    Chen, Juanjuan
    Wang, Minhong
    SYSTEM, 2024, 126
  • [32] The Artificial intelligence large language models and neuropsychiatry practice and research ethic
    Zhong, Yi
    Chen, Yu-jun
    Zhou, Yang
    Lyu, Yan-Ao-Hai
    Yin, Jia-Jun
    Gao, Yu-jun
    ASIAN JOURNAL OF PSYCHIATRY, 2023, 84
  • [33] Research on Innovative Models of Second Language Teaching in the Age of Artificial Intelligence
    Chen L.
    Applied Mathematics and Nonlinear Sciences, 2024, 9 (01)
  • [34] ChatGPT: Transcending Language Limitations in Scientific Research Using Artificial Intelligence
    Osama, Muhammad
    Afridi, Sabah
    Maaz, Muhammad
    JCPSP-JOURNAL OF THE COLLEGE OF PHYSICIANS AND SURGEONS PAKISTAN, 2023, 33 (10): : 1198 - 1200
  • [35] Applications of Artificial Intelligence and Large Language Models to Plastic Surgery Research
    Seth, Ishith
    Bulloch, Gabriella
    Rozen, Warren M.
    AESTHETIC SURGERY JOURNAL, 2023, 43 (10) : NP809 - NP810
  • [36] The Transparency of Science with ChatGPT and the Emerging Artificial Intelligence Language Models: Where Should Medical Journals Stand?
    Donato, Helena
    Escada, Pedro
    Villanueva, Tiago
    ACTA MEDICA PORTUGUESA, 2023, 36 (03) : 147 - 148
  • [37] Leveraging and exercising caution with ChatGPT and other generative artificial intelligence tools in environmental psychology research
    Yuan, Shuai
    Li, Fu
    Browning, Matthew H. E. M.
    Bardhan, Mondira
    Zhang, Kuiran
    McAnirlin, Olivia
    Patwary, Muhammad Mainuddin
    Reuben, Aaron
    FRONTIERS IN PSYCHOLOGY, 2024, 15
  • [38] Note: Leveraging Artificial Intelligence to build a Data Catalog and support research on the Sustainable Development Goals
    Spezzatti, Andy
    Kheradmand, Elham
    Gupta, Kartik
    Peras, Marie
    Zaminpeyma, Roxaneh
    PROCEEDINGS OF THE 4TH ACM SIGCAS/SIGCHI CONFERENCE ON COMPUTING AND SUSTAINABLE SOCIETIES, COMPASS'22, 2022, : 579 - 584
  • [39] User Transparency of Artificial Intelligence and Digital Twins in Production - Research on Lead Applications and the Transfer to Industry
    Wittenberg, Carsten
    Boos, Sabine
    Harst, Felix
    Lanquillon, Carsten
    Ohrnberger, Morris
    Schloer, Nicholas
    Schoch, Fabian
    Stache, Nicolaj C.
    ARTIFICIAL INTELLIGENCE IN HCI, AI-HCI 2023, PT II, 2023, 14051 : 322 - 332
  • [40] The Application Landscape and Research Status of Artificial Intelligence in Language Learning: A Visual Analysis
    Chen, Xiaojiao
    Zhu, Keke
    Jing, Yuhui
    Wang, Chengliang
    ACM International Conference Proceeding Series, 2023, : 461 - 468