Goal-directed EEG activity evoked by discriminative stimuli in reinforcement learning

被引:21
|
作者
Luque, David [1 ]
Moris, Joaquin [1 ]
Rushby, Jacqueline A. [2 ]
Le Pelley, Mike E. [2 ]
机构
[1] Univ Malaga, Inst Invest Biomed Malaga IBIMA, Dept Psicol Basica, E-29071 Malaga, Spain
[2] Univ New S Wales, Sch Psychol, Sydney, NSW, Australia
基金
澳大利亚研究理事会;
关键词
Reinforcement learning; Goal-directed action; Cognitive neuroscience; Event-related potentials; Feedback correct-related positivity; P2; P3; P3b; EVENT-RELATED POTENTIALS; FEEDBACK-RELATED NEGATIVITY; REWARD; ATTENTION; ERROR; MODULATION; SCHIZOPHRENIA; ASSOCIABILITY; POSITIVITY; COMPONENTS;
D O I
10.1111/psyp.12302
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
In reinforcement learning (RL), discriminative stimuli (S) allow agents to anticipate the value of a future outcome, and the response that will produce that outcome. We examined this processing by recording EEG locked to S during RL. Incentive value of outcomes and predictive value of S were manipulated, allowing us to discriminate between outcome-related and response-related activity. S predicting the correct response differed from nonpredictive S in the P2. S paired with high-value outcomes differed from those paired with low-value outcomes in a frontocentral positivity and in the P3b. A slow negativity then distinguished between predictive and nonpredictive S. These results suggest that, first, attention prioritizes detection of informative S. Activation of mental representations of these informative S then retrieves representations of outcomes, which in turn retrieve representations of responses that previously produced those outcomes.
引用
收藏
页码:238 / 248
页数:11
相关论文
共 50 条
  • [1] Goal-directed behaviours by reinforcement learning
    Johannet, A
    Sarda, I
    NEUROCOMPUTING, 1999, 28 : 107 - 125
  • [2] Reinforcement learning with goal-directed eligibility traces
    Andrecut, M
    Ali, MK
    INTERNATIONAL JOURNAL OF MODERN PHYSICS C, 2004, 15 (09): : 1235 - 1247
  • [3] Accelerating Goal-Directed Reinforcement Learning by Model Characterization
    Debnath, Shoubhik
    Sukhatme, Gaurav
    Liu, Lantao
    2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2018, : 8666 - 8673
  • [4] Goal-directed graph construction using reinforcement learning
    Darvariu, Victor-Alexandru
    Hailes, Stephen
    Musolesi, Mirco
    PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2021, 477 (2254):
  • [5] THE IMPACT OF STIMULUS VALUE ON GOAL-DIRECTED AVERSIVE REINFORCEMENT LEARNING
    Lindstrom, Bjorn
    Golkar, Armita
    Olsson, Andreas
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2013, : 155 - 155
  • [6] Goal-Directed Feature Learning
    Weber, Cornelius
    Triesch, Jochen
    IJCNN: 2009 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1- 6, 2009, : 3355 - 3362
  • [7] Predicting Goal-directed Human Attention Using Inverse Reinforcement Learning
    Yang, Zhibo
    Huang, Lihan
    Chen, Yupei
    Wei, Zijun
    Ahn, Seoyoung
    Zelinsky, Gregory
    Samaras, Dimitris
    Hoai, Minh
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 190 - 199
  • [8] Listening as a Goal-Directed Activity
    Gearhart, Christopher C.
    Denham, Jonathan P.
    Bodie, Graham D.
    WESTERN JOURNAL OF COMMUNICATION, 2014, 78 (05) : 668 - 684
  • [9] The effect of representation and knowledge on goal-directed exploration with reinforcement-learning algorithms
    Koenig, S
    Simmons, RG
    MACHINE LEARNING, 1996, 22 (1-3) : 227 - 250
  • [10] Learning to play in a goal-directed practice
    Wallerstedt, Cecilia
    Pramling, Niklas
    EARLY YEARS, 2012, 32 (01) : 5 - 15