High Recall Retrieval Via Technology-Assisted Review

被引:0
|
作者
Gray, Lenora [1 ]
Lewis, David D. [1 ]
Pickens, Jeremy [1 ]
Yang, Eugene [2 ]
机构
[1] Redgrave Data, Chantilly, VA 20151 USA
[2] Johns Hopkins Univ, HLTCOE, Baltimore, MD USA
关键词
text classification; human-in-the-loop; active learning; generative; AI; statistical evaluation;
D O I
10.1145/3626772.3661376
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High Recall Retrieval (HRR) tasks, including eDiscovery in the law, systematic literature reviews, and sunshine law requests focus on efficiently prioritizing relevant documents for human review. Technology-assisted review (TAR) refers to iterative human-in-theloop workflows that combine human review with IR and AI techniques to minimize both time and manual effort while maximizing recall. This full-day tutorial provides a comprehensive introduction to TAR. The morning session presents an overview of the key technologies and workflow designs used, the basics of practical evaluation methods, and the social and ethical implications of TAR deployment. The afternoon session provides more technical depth on the implications of TAR workflows for supervised learning algorithm design, how generative AI is can be applied in TAR, more sophisticated statistical evaluation techniques, and a wide range of open research questions.
引用
收藏
页码:2987 / 2988
页数:2
相关论文
共 50 条
  • [41] Technology-Assisted Reading Instruction for English Language Learners: A Methodological Review
    Zuo, Xinyue
    Ives, Denise
    ECNU REVIEW OF EDUCATION, 2024, 7 (02) : 258 - 282
  • [42] Emergency Care of the Technology-Assisted Child
    Posner, Jill C.
    Cronan, Kathleen
    Badaki, Oluwakemi
    Fein, Joel A.
    CLINICAL PEDIATRIC EMERGENCY MEDICINE, 2006, 7 (01) : 38 - 51
  • [43] Third Workshop on Augmented Intelligence in Technology-Assisted Review Systems (ALTARS)
    Di Nunzio, Giorgio Maria
    Kanoulas, Evangelos
    Majumder, Prasenjit
    ADVANCES IN INFORMATION RETRIEVAL, ECIR 2024, PT V, 2024, 14612 : 432 - 436
  • [44] Technology-Assisted Weight Management Interventions: Systematic Review of Clinical Trials
    Allen, Jerilyn K.
    Stephens, Janna
    Patel, Angel
    TELEMEDICINE AND E-HEALTH, 2014, 20 (12) : 1103 - 1120
  • [45] Automatic and Semi-Automatic Document Selection for Technology-Assisted Review
    Grossman, Maura R.
    Cormack, Gordon V.
    Roegiest, Adam
    SIGIR'17: PROCEEDINGS OF THE 40TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2017, : 905 - 908
  • [46] TECHNOLOGY-ASSISTED WEIGHT LOSS INTERVENTIONS IN PRIMARY CARE: A SYSTEMATIC REVIEW
    Levine, David M.
    Nicholson, Joseph
    Jay, Melanie
    JOURNAL OF GENERAL INTERNAL MEDICINE, 2013, 28 : S194 - S194
  • [47] Technology-Assisted Weight Loss Interventions in Primary Care: A Systematic Review
    David M. Levine
    Stella Savarimuthu
    Allison Squires
    Joseph Nicholson
    Melanie Jay
    Journal of General Internal Medicine, 2015, 30 : 107 - 117
  • [49] Technology-Assisted Counseling for Couples and Families
    Teufel-Prida, Lee A.
    Raglin, Marissa
    Long, Samantha C.
    Wirick, Dawn M.
    FAMILY JOURNAL, 2018, 26 (02): : 134 - 142
  • [50] Editorial: Advances in technology-assisted rehabilitation
    Kannenberg, Andreas
    Rupp, Ruediger
    Wurdeman, Shane R.
    Frossard, Laurent
    FRONTIERS IN REHABILITATION SCIENCES, 2024, 5