Issues of trust and control on agent autonomy

被引:4
|
作者
Falcone, R [1 ]
Castelfranchi, C [1 ]
机构
[1] CNR, Inst Cognit Sci & Technol, Rome, Italy
关键词
autonomous agents; trust; control; cooperation; adjustable autonomy;
D O I
10.1080/0954009021000068763
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The relationship between trust and control is quite relevant both for the very notion of trust and for modelling and implementing trust-control relations with autonomous systems. We claim that control is antagonistic of the strict form of trust: 'trust in y'; but also that it completes and complements it for arriving to a global trust. In other words, putting control and guaranties is trust-building; it produces a sufficient trust, when trust in y's autonomous willingness and competence would not be enough. We also argue that control requires new forms of trust: trust in the control itself or in the controller, trust in y as for being monitored and controlled, trust in possible authorities, etc. Finally, we show that paradoxically control could not be antagonistic of strict trust in y, but it can even create, increase it by making y more willing or more effective. In conclusion, depending on the circumstances, control makes y more reliable or less reliable; control can either decrease or increase trust. A good theory of trust cannot be complete without a theory of control.
引用
收藏
页码:249 / 263
页数:15
相关论文
共 50 条
  • [1] Social norms accentuate agent trust and attenuate agent autonomy
    Poli, P
    Hexmoor, H
    IC-AI '04 & MLMTA'04 , VOL 1 AND 2, PROCEEDINGS, 2004, : 469 - 475
  • [2] Quality assurance in UK higher education: Issues of trust, control, professional autonomy and accountability
    Hoecht, A
    HIGHER EDUCATION, 2006, 51 (04) : 541 - 563
  • [3] Quality Assurance in UK Higher Education: Issues of Trust, Control, Professional Autonomy and Accountability
    Andreas Hoecht
    Higher Education, 2006, 51 : 541 - 563
  • [4] Autonomy domain trust model in manufacturing grid based on user trust agent
    Xiao, Junyu
    Yang, Zhangwei
    Jiang, Feng
    Telkomnika - Indonesian Journal of Electrical Engineering, 2013, 11 (11): : 6534 - 6539
  • [5] AUTONOMY, CONTROL, AND AFFILIATION - YOUR ISSUES OR MINE
    HAFERKAMP, CJ
    JOURNAL OF COUNSELING AND DEVELOPMENT, 1988, 67 (02): : 75 - 75
  • [6] Agent theory: Autonomy and self-control
    Wan, ADM
    Braspenning, PJ
    ARTIFICIAL INTELLIGENCE: METHODOLOGY, SYSTEMS, APPLICATIONS, 1996, 35 : 268 - 277
  • [7] Control and autonomy for intelligent virtual agent behaviour
    Thalmann, D
    METHODS AND APPLICATIONS OF ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2004, 3025 : 515 - 524
  • [8] Models of Trust in Human Control of Swarms With Varied Levels of Autonomy
    Nam, Changjoo
    Walker, Phillip
    Li, Huao
    Lewis, Michael
    Sycara, Katia
    IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2020, 50 (03) : 194 - 204
  • [9] Autonomy and trust in bioethics
    McCarney, J
    RADICAL PHILOSOPHY, 2002, (116): : 41 - 43
  • [10] Autonomy and Trust in Bioethics
    Karen L. Hornsby
    The Journal of Value Inquiry, 2005, 39 : 255 - 259