Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction

被引:39
|
作者
Shelby, Renee [1 ,2 ]
Rismani, Shalaleh [3 ]
Henne, Kathryn [2 ]
Moon, Ajung [3 ]
Rostamzadeh, Negar [4 ]
Nicholas, Paul [5 ]
Yilla-Akbari, N'Mah [6 ]
Gallegos, Jess [7 ]
Smart, Andrew [8 ]
Garcia, Emilio [9 ]
Virk, Gurleen [10 ]
机构
[1] Google Res, JusTech Lab, San Francisco, CA 94105 USA
[2] Australian Natl Univ, Canberra, ACT, Australia
[3] McGill Univ, Montreal, PQ, Canada
[4] Google Res, Montreal, PQ, Canada
[5] Google, San Francisco, CA USA
[6] Google, Washington, DC USA
[7] Google Res, New York, NY USA
[8] Google Res, San Francisco, CA USA
[9] Google, New York, NY USA
[10] Google, San Diego, CA USA
关键词
harms; AI; machine learning; scoping review; TECHNOLOGY; VIOLENCE; SCIENCE; ETHICS; BIAS;
D O I
10.1145/3600211.3604673
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Understanding the landscape of potential harms from algorithmic systems enables practitioners to better anticipate consequences of the systems they build. It also supports the prospect of incorporating controls to help minimize harms that emerge from the interplay of technologies and social and cultural dynamics. A growing body of scholarship has identified a wide range of harms across different algorithmic technologies. However, computing research and practitioners lack a high level and synthesized overview of harms from algorithmic systems. Based on a scoping review of computing research (n=172), we present an applied taxonomy of sociotechnical harms to support a more systematic surfacing of potential harms in algorithmic systems. The final taxonomy builds on and refers to existing taxonomies, classifications, and terminologies. Five major themes related to sociotechnical harms - representational, allocative, quality-of-service, interpersonal harms, and social system/societal harms - and sub-themes are presented along with a description of these categories. We conclude with a discussion of challenges and opportunities for future research.
引用
收藏
页码:723 / 741
页数:19
相关论文
共 50 条
  • [31] A Scoping Review of Australian Literature on People Who Use MDMA and Their Harm Reduction Practices
    Span, Chloe
    Farah, Baillee
    Ivetic, Nathan
    Stronach, Oisin
    CONTEMPORARY DRUG PROBLEMS, 2024, 51 (01) : 25 - 44
  • [32] Why Defend Harm Reduction for Severe and Enduring Eating Disorders? Who Wouldn't Want to Reduce Harms?
    Yager, Joel
    AMERICAN JOURNAL OF BIOETHICS, 2021, 21 (07): : 57 - 59
  • [33] Between Emergency Department Visits: The Role of Harm Reduction Programs in Mitigating the Harms Associated With Injection Drug Use
    Macias-Konstantopoulos, Wendy
    Heins, Alan
    Sachs, Carolyn J.
    Whiteman, Paula J.
    Wingkun, Neil-Jeremy G.
    Riviello, Ralph J.
    ANNALS OF EMERGENCY MEDICINE, 2021, 77 (05) : 479 - 492
  • [34] Poly-substance use and related harms: A systematic review of harm reduction strategies implemented in recreational settings
    Akbar, Tahira
    Baldacchino, Alex
    Cecil, Joanne
    Riglietta, Marco
    Sommer, Borge
    Humphris, Gerry
    NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2011, 35 (05): : 1186 - 1202
  • [35] Harm reduction strategies related to dosing and their relation to harms among festival attendees who use multiple drugs
    Fernandez-Calderon, Fermin
    Diaz-Batanero, Carmen
    Barratt, Monica J.
    Palamar, Joseph J.
    DRUG AND ALCOHOL REVIEW, 2019, 38 (01) : 57 - 67
  • [36] Identifying risks and emergent risks across sociotechnical systems: the NETworked hazard analysis and risk management system (NET-HARMS)
    Dallat, Clare
    Salmon, Paul M.
    Goode, Natassia
    THEORETICAL ISSUES IN ERGONOMICS SCIENCE, 2018, 19 (04) : 456 - 482
  • [37] Analyzing recommender systems for health promotion using a multidisciplinary taxonomy: A scoping review
    Hors-Fraile, Santiago
    Rivera-Romero, Octavio
    Schneider, Francine
    Fernandez-Luque, Luis
    Luna-Perejon, Francisco
    Civit-Balcells, Anton
    de Vries, Hein
    INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS, 2018, 114 : 143 - 155
  • [38] One-month alcohol abstinence national campaigns: a scoping review of the harm reduction benefits
    de Ternay, Julia
    Leblanc, Pierre
    Michel, Philippe
    Benyamina, Amine
    Naassila, Mickael
    Rolland, Benjamin
    HARM REDUCTION JOURNAL, 2022, 19 (01)
  • [39] A scoping review on barriers and facilitators to harm reduction care among youth in British Columbia, Canada
    Beck, Kassey
    Pallot, Katija
    Amri, Michelle
    HARM REDUCTION JOURNAL, 2024, 21 (01)
  • [40] Harm reduction strategies in acute care for people who use alcohol and/or drugs: A scoping review
    Crowther, Daniel
    Curran, Janet
    Somerville, Mari
    Sinclair, Doug
    Wozney, Lori
    Macphee, Shannon
    Rose, Annette Elliott
    Boulos, Leah
    Caudrella, Alexander
    PLOS ONE, 2023, 18 (12):