Risk-Sensitive Optimal Feedback Control Accounts for Sensorimotor Behavior under Uncertainty

被引:59
|
作者
Nagengast, Arne J. [1 ,2 ]
Braun, Daniel A. [1 ]
Wolpert, Daniel M. [1 ]
机构
[1] Univ Cambridge, Dept Engn, Computat & Biol Learning Lab, Cambridge CB2 1PZ, England
[2] Univ Cambridge, Dept Expt Psychol, Cambridge CB2 3EB, England
基金
英国惠康基金;
关键词
ADAPTATION; SPECIFICITY; STRATEGIES; MOVEMENTS;
D O I
10.1371/journal.pcbi.1000857
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
Many aspects of human motor behavior can be understood using optimality principles such as optimal feedback control. However, these proposed optimal control models are risk-neutral; that is, they are indifferent to the variability of the movement cost. Here, we propose the use of a risk-sensitive optimal controller that incorporates movement cost variance either as an added cost (risk-averse controller) or as an added value (risk-seeking controller) to model human motor behavior in the face of uncertainty. We use a sensorimotor task to test the hypothesis that subjects are risk-sensitive. Subjects controlled a virtual ball undergoing Brownian motion towards a target. Subjects were required to minimize an explicit cost, in points, that was a combination of the final positional error of the ball and the integrated control cost. By testing subjects on different levels of Brownian motion noise and relative weighting of the position and control cost, we could distinguish between risk-sensitive and risk-neutral control. We show that subjects change their movement strategy pessimistically in the face of increased uncertainty in accord with the predictions of a risk-averse optimal controller. Our results suggest that risk-sensitivity is a fundamental attribute that needs to be incorporated into optimal feedback control models.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Risk-Sensitive Optimal Feedback Control for Haptic Assistance
    Medina, Jose Ramon
    Lee, Dongheui
    Hirche, Sandra
    2012 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2012, : 1025 - 1031
  • [2] The optimal control for the output feedback stochastic system under the risk-sensitive cost
    Dai, LY
    Pan, ZG
    Shi, SJ
    PROCEEDINGS OF THE 4TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-4, 2002, : 273 - 277
  • [3] The Optimal Control for the Output Feedback Stochastic System at the Risk-Sensitive Cost
    Dai Liyan
    Department of Electrical and Computer Engineering and Computer Science
    Journal of Systems Engineering and Electronics, 2003, (01) : 74 - 80
  • [4] Risk-Sensitive Optimal Control of Queues
    Singh, Rahul
    Guo, Xueying
    Modiano, Eytan
    2017 IEEE 56TH ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2017,
  • [5] Risk-sensitive control and an optimal investment model
    Fleming, WH
    Sheu, SJ
    MATHEMATICAL FINANCE, 2000, 10 (02) : 197 - 213
  • [6] Risk-sensitive optimal control of quantum systems
    James, MR
    PHYSICAL REVIEW A, 2004, 69 (03): : 032108 - 1
  • [7] Disagreement-Aware Physical Assistance Through Risk-Sensitive Optimal Feedback Control
    Medina, Jose Ramon
    Lorenz, Tamara
    Lee, Dongheui
    Hirche, Sandra
    2012 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2012, : 3639 - 3645
  • [8] Risk-sensitive control and an optimal investment model II
    Fleming, WH
    Sheu, SJ
    ANNALS OF APPLIED PROBABILITY, 2002, 12 (02): : 730 - 767
  • [9] LQ optimal and risk-sensitive control for vehicle suspensions
    Brezas, Panos
    Smith, Malcolm C.
    2012 IEEE 51ST ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2012, : 2465 - 2470
  • [10] A quantum Langevin formulation of risk-sensitive optimal control
    James, MR
    JOURNAL OF OPTICS B-QUANTUM AND SEMICLASSICAL OPTICS, 2005, 7 (10) : S198 - S207