Ethics and society review: Ethics reflection as a precondition to research funding

被引:27
|
作者
Bernstein, Michael S. [1 ]
Levi, Margaret [2 ,3 ]
Magnus, David [4 ]
Rajala, Betsy A. [2 ]
Satz, Debra [5 ]
Waeiss, Charla [2 ]
机构
[1] Stanford Univ, Dept Comp Sci, Stanford, CA 94305 USA
[2] Stanford Univ, Ctr Adv Study Behav Sci, Stanford, CA 94305 USA
[3] Stanford Univ, Dept Polit Sci, Stanford, CA 94305 USA
[4] Stanford Univ, Dept Pediat, Stanford, CA 94305 USA
[5] Stanford Univ, Dept Philosophy, Stanford, CA 94305 USA
关键词
ethics; machine learning; computer science; societal consequences; DILEMMAS;
D O I
10.1073/pnas.2117261118
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Researchers in areas as diverse as computer science and political science must increasingly navigate the possible risks of their research to society. However, the history of medical experiments on vulnerable individuals influencedmany research ethics reviews to focus exclusively on risks to human subjects rather than risks to human society. We describe an Ethics and Society Review board (ESR), which fills this moral gap by facilitating ethical and societal reflection as a requirement to access grant funding: Researchers cannot receive grant funding from participating programs until the researchers complete the ESR process for their proposal. Researchers author an initial statement describing their proposed research's risks to society, subgroups within society, and globally and commit to mitigation strategies for these risks. An interdisciplinary faculty panel iterates with the researchers to refine these risks and mitigation strategies. We describe a mixed-method evaluation of the ESR over 1 y, in partnership with a large artificial intelligence grant program at our university. Surveys and interviews of researchers who interacted with the ESR found 100% (95% CI: 87 to 100%) were willing to continue submitting future projects to the ESR, and 58% (95% CI: 37 to 77%) felt that it had influenced the design of their research project. The ESR panel most commonly identified issues of harms to minority groups, inclusion of diverse stakeholders in the research plan, dual use, and representation in datasets. These principles, paired with possible mitigation strategies, offer scaffolding for future research designs.
引用
收藏
页数:8
相关论文
共 50 条