Multimodal biomedical AI

被引：525

作者：

Acosta, Julian N. ^{[1
]}

Falcone, Guido J. ^{[1
]}

Rajpurkar, Pranav ^{[2
]}

Topol, Eric J. ^{[3
]}

机构：

[1] Yale Sch Med, Dept Neurol, New Haven, CT USA

[2] Harvard Med Sch, Dept Biomed Informat, Boston, MA 02115 USA

[3] Scripps Res, Scripps Res Translat Inst, La Jolla, CA 92037 USA

来源：

NATURE MEDICINE | 2022年 / 28卷 / 09期

关键词：

UK BIOBANK; HEALTH-CARE; BIG DATA; CLINICAL-TRIALS; PLATFORM; FUSION; TECHNOLOGY; PREDICTION; MEDICINE; COVID-19;

D O I：

10.1038/s41591-022-01981-2

中图分类号：

Q5 [生物化学]; Q7 [分子生物学];

学科分类号：

071010 ; 081704 ;

摘要：

Multimodal artificial intelligence models could unlock many exciting applications in health and medicine; this Review outlines the most promising uses and the technical pitfalls to avoid. The increasing availability of biomedical data from large biobanks, electronic health records, medical imaging, wearable and ambient biosensors, and the lower cost of genome and microbiome sequencing have set the stage for the development of multimodal artificial intelligence solutions that capture the complexity of human health and disease. In this Review, we outline the key applications enabled, along with the technical and analytical challenges. We explore opportunities in personalized medicine, digital clinical trials, remote monitoring and care, pandemic surveillance, digital twin technology and virtual health assistants. Further, we survey the data, modeling and privacy challenges that must be overcome to realize the full potential of multimodal artificial intelligence in health.

引用

页码：1773 / 1784

页数：12

共 177 条

[111] The digital twin revolution [J].

Omer San .

NATURE COMPUTATIONAL SCIENCE, 2021, 1 (05) :307-308

[112]

Oncotype IQ, 2020, ONC MAP PAN CANC TIS

[113] Rapid Sequencing-Based Diagnosis of Thiamine Metabolism Dysfunction Syndrome [J].

Owen, Mallory J. ;

Niemi, Anna-Kaisa ;

Dimmock, David P. ;

Speziale, Mark ;

Nespeca, Mark .

NEW ENGLAND JOURNAL OF MEDICINE, 2021, 384 (22) :2159-2161

[114] Adaptive designs in clinical trials: why use them, and how to run and report them [J].

Pallmann, Philip ;

Bedding, Alun W. ;

Choodari-Oskooei, Babak ;

Dimairo, Munyaradzi ;

Flight, Laura ;

Hampson, Lisa V. ;

Holmes, Jane ;

Mander, Adrian P. ;

Odondi, Lang'O ;

Sydes, Matthew R. ;

Villar, Sofia S. ;

Wason, James M. S. ;

Weir, Christopher J. ;

Wheeler, Graham M. ;

Yap, Christina ;

Jaki, Thomas .

BMC MEDICINE, 2018, 16

[115] Smartphone apps in the COVID-19 pandemic [J].

Pandit, Jay A. ;

Radin, Jennifer M. ;

Quer, Giorgio ;

Topol, Eric J. .

NATURE BIOTECHNOLOGY, 2022, 40 (07) :1013-1022

[116] Health-focused conversational agents in person-centered care: a review of apps [J].

Parmar, Pritika ;

Ryu, Jina ;

Pandya, Shivani ;

Sedoc, Joao ;

Agarwal, Smisha .

NPJ DIGITAL MEDICINE, 2022, 5 (01)

[117] An integrated genomic analysis of human glioblastoma Multiforme [J].

Parsons, D. Williams ;

Jones, Sian ;

Zhang, Xiaosong ;

Lin, Jimmy Cheng-Ho ;

Leary, Rebecca J. ;

Angenendt, Philipp ;

Mankoo, Parminder ;

Carter, Hannah ;

Siu, I-Mei ;

Gallia, Gary L. ;

Olivi, Alessandro ;

McLendon, Roger ;

Rasheed, B. Ahmed ;

Keir, Stephen ;

Nikolskaya, Tatiana ;

Nikolsky, Yuri ;

Busam, Dana A. ;

Tekleab, Hanna ;

Diaz, Luis A., Jr. ;

Hartigan, James ;

Smith, Doug R. ;

Strausberg, Robert L. ;

Marie, Suely Kazue Nagahashi ;

Shinjo, Sueli Mieko Oba ;

Yan, Hai ;

Riggins, Gregory J. ;

Bigner, Darell D. ;

Karchin, Rachel ;

Papadopoulos, Nick ;

Parmigiani, Giovanni ;

Vogelstein, Bert ;

Velculescu, Victor E. ;

Kinzler, Kenneth W. .

SCIENCE, 2008, 321 (5897) :1807-1812

[118] Nudge Units to Improve the Delivery of Health Care [J].

Patel, Mitesh S. ;

Volpp, Kevin G. ;

Asch, David A. .

NEW ENGLAND JOURNAL OF MEDICINE, 2018, 378 (03) :214-216

[119] Towards a Psychosis Risk Blood Diagnostic for Persons Experiencing High-Risk Symptoms: Preliminary Results From the NAPLS Project [J].

Perkins, Diana O. ;

Jeffries, Clark D. ;

Addington, Jean ;

Bearden, Carrie E. ;

Cadenhead, Kristin S. ;

Cannon, Tyrone D. ;

Cornblatt, Barbara A. ;

Mathalon, Daniel H. ;

McGlashan, Thomas H. ;

Seidman, Larry J. ;

Tsuang, Ming T. ;

Walker, Elaine F. ;

Woods, Scott W. ;

Heinssen, Robert .

SCHIZOPHRENIA BULLETIN, 2015, 41 (02) :419-428

[120] Development of CancerLinQ, a Health Information Learning Platform From Multiple Electronic Health Record Systems to Support Improved Quality of Care [J].

Potter, Danielle ;

Brothers, Raven ;

Kolacevski, Andrej ;

Koskimaki, Jacob E. ;

McNutt, Amy ;

Miller, Robert S. ;

Nagda, Jatin ;

Nair, Anil ;

Rubinstein, Wendy S. ;

Stewart, Andrew K. ;

Trieb, Iris J. ;

Komatsoulis, George A. .

JCO CLINICAL CANCER INFORMATICS, 2020, 4 :929-937

← 7 8 9 10 11 12 13 14 15 16 →