Risk-Sensitive Optimal Feedback Control Accounts for Sensorimotor Behavior under Uncertainty

被引:59
|
作者
Nagengast, Arne J. [1 ,2 ]
Braun, Daniel A. [1 ]
Wolpert, Daniel M. [1 ]
机构
[1] Univ Cambridge, Dept Engn, Computat & Biol Learning Lab, Cambridge CB2 1PZ, England
[2] Univ Cambridge, Dept Expt Psychol, Cambridge CB2 3EB, England
基金
英国惠康基金;
关键词
ADAPTATION; SPECIFICITY; STRATEGIES; MOVEMENTS;
D O I
10.1371/journal.pcbi.1000857
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
Many aspects of human motor behavior can be understood using optimality principles such as optimal feedback control. However, these proposed optimal control models are risk-neutral; that is, they are indifferent to the variability of the movement cost. Here, we propose the use of a risk-sensitive optimal controller that incorporates movement cost variance either as an added cost (risk-averse controller) or as an added value (risk-seeking controller) to model human motor behavior in the face of uncertainty. We use a sensorimotor task to test the hypothesis that subjects are risk-sensitive. Subjects controlled a virtual ball undergoing Brownian motion towards a target. Subjects were required to minimize an explicit cost, in points, that was a combination of the final positional error of the ball and the integrated control cost. By testing subjects on different levels of Brownian motion noise and relative weighting of the position and control cost, we could distinguish between risk-sensitive and risk-neutral control. We show that subjects change their movement strategy pessimistically in the face of increased uncertainty in accord with the predictions of a risk-averse optimal controller. Our results suggest that risk-sensitivity is a fundamental attribute that needs to be incorporated into optimal feedback control models.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Markov risk mappings and risk-sensitive optimal prediction
    Tomasz Kosmala
    Randall Martyr
    John Moriarty
    Mathematical Methods of Operations Research, 2023, 97 : 91 - 116
  • [42] Output feedback risk-sensitive control and dynamic games: Small noise limits
    Charalambous, CD
    PROCEEDINGS OF THE 1997 AMERICAN CONTROL CONFERENCE, VOLS 1-6, 1997, : 430 - 434
  • [43] Optimal Liver Acceptance for Risk-Sensitive Patients
    Batun, Sakine
    Schaefer, Andrew J.
    Bhandari, Atul
    Roberts, Mark S.
    SERVICE SCIENCE, 2018, 10 (03) : 320 - 333
  • [44] Bellman equations of risk-sensitive control
    Nagai, H
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1996, 34 (01) : 74 - 101
  • [45] Robust properties of risk-sensitive control
    Dupuis, P
    James, MR
    Petersen, I
    MATHEMATICS OF CONTROL SIGNALS AND SYSTEMS, 2000, 13 (04) : 318 - 332
  • [46] Risk-sensitive control of branching processes
    Canbolat, Pelin G.
    IISE TRANSACTIONS, 2021, 53 (08) : 914 - 927
  • [47] Robust properties of risk-sensitive control
    Dupuis, Paul
    James, Matthew R.
    Petersen, Ian
    Proceedings of the IEEE Conference on Decision and Control, 1998, 2 : 2365 - 2370
  • [48] RISK-SENSITIVE MARKOV CONTROL PROCESSES
    Shen, Yun
    Stannat, Wilhelm
    Obermayer, Klaus
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2013, 51 (05) : 3652 - 3672
  • [49] A maximum principle for risk-sensitive control
    Lim, AEB
    Zhou, XY
    42ND IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-6, PROCEEDINGS, 2003, : 5819 - 5824
  • [50] Remarks on risk-sensitive control problems
    Menaldi, JL
    Robin, M
    APPLIED MATHEMATICS AND OPTIMIZATION, 2005, 52 (03): : 297 - 310