FactSheets: Increasing trust in AI services through supplier's declarations of conformity

被引：193

作者：

Arnold, M. ^{[1
]}

Bellamy, R. K. E. ^{[1
]}

Hind, M. ^{[1
]}

Houde, S. ^{[2
]}

Mehta, S. ^{[3
]}

Mojsilovic, A. ^{[1
]}

Nair, R. ^{[1
]}

Ramamurthy, K. Natesan ^{[1
]}

Olteanu, A. ^{[4
]}

Piorkowski, D. ^{[1
]}

Reimer, D. ^{[1
]}

Richards, J. ^{[1
]}

Tsay, J. ^{[1
]}

Varshney, K. R. ^{[1
]}

机构：

[1] IBM Res, Yorktown Hts, NY 10598 USA

[2] IBM Res, Cambridge, MA 02142 USA

[3] IBM Res, Bengaluru 560045, India

[4] Microsoft Res, Montreal, PQ H3A 3H3, Canada

来源：

IBM JOURNAL OF RESEARCH AND DEVELOPMENT | 2019年 / 63卷 / 4-5期

关键词：

UNCERTAINTY; SAFETY;

D O I：

10.1147/JRD.2019.2942288

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

Accuracy is an important concern for suppliers of artificial intelligence (AI) services, but considerations beyond accuracy, such as safety (which includes fairness and explainability), security, and provenance, are also critical elements to engender consumers' trust in a service. Many industries use transparent, standardized, but often not legally required documents called supplier's declarations of conformity (SDoCs) to describe the lineage of a product along with the safety and performance testing it has undergone. SDoCs may be considered multidimensional fact sheets that capture and quantify various aspects of the product and its development to make it worthy of consumers' trust. In this article, inspired by this practice, we propose FactSheets to help increase trust in AI services. We envision such documents to contain purpose, performance, safety, security, and provenance information to be completed by AI service providers for examination by consumers. We suggest a comprehensive set of declaration items tailored to AI in the Appendix of this article.

引用

页数：13

共 48 条

[21]

IEEE Standards Association, WHAT AR STAND

[22] Understanding perception of algorithmic decisions: Fairness, trust, and emotion in response to algorithmic management [J].