Goal-directed EEG activity evoked by discriminative stimuli in reinforcement learning

被引:21
|
作者
Luque, David [1 ]
Moris, Joaquin [1 ]
Rushby, Jacqueline A. [2 ]
Le Pelley, Mike E. [2 ]
机构
[1] Univ Malaga, Inst Invest Biomed Malaga IBIMA, Dept Psicol Basica, E-29071 Malaga, Spain
[2] Univ New S Wales, Sch Psychol, Sydney, NSW, Australia
基金
澳大利亚研究理事会;
关键词
Reinforcement learning; Goal-directed action; Cognitive neuroscience; Event-related potentials; Feedback correct-related positivity; P2; P3; P3b; EVENT-RELATED POTENTIALS; FEEDBACK-RELATED NEGATIVITY; REWARD; ATTENTION; ERROR; MODULATION; SCHIZOPHRENIA; ASSOCIABILITY; POSITIVITY; COMPONENTS;
D O I
10.1111/psyp.12302
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
In reinforcement learning (RL), discriminative stimuli (S) allow agents to anticipate the value of a future outcome, and the response that will produce that outcome. We examined this processing by recording EEG locked to S during RL. Incentive value of outcomes and predictive value of S were manipulated, allowing us to discriminate between outcome-related and response-related activity. S predicting the correct response differed from nonpredictive S in the P2. S paired with high-value outcomes differed from those paired with low-value outcomes in a frontocentral positivity and in the P3b. A slow negativity then distinguished between predictive and nonpredictive S. These results suggest that, first, attention prioritizes detection of informative S. Activation of mental representations of these informative S then retrieves representations of outcomes, which in turn retrieve representations of responses that previously produced those outcomes.
引用
收藏
页码:238 / 248
页数:11
相关论文
共 50 条
  • [31] Computational Properties of the Hippocampus Increase the Efficiency of Goal-Directed Foraging through Hierarchical Reinforcement Learning
    Chalmers, Eric
    Luczak, Artur
    Gruber, Aaron J.
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2016, 10
  • [33] A data-efficient goal-directed deep reinforcement learning method for robot visuomotor skill
    Jiang, Rong
    Wang, Zhipeng
    He, Bin
    Zhou, Yanmin
    Li, Gang
    Zhu, Zhongpan
    NEUROCOMPUTING, 2021, 462 (462) : 389 - 401
  • [34] MULTI-BAND CHARACTERISTICS OF EEG COHERENCE UNDERLYING MENTAL SPECIFICS OF SUSTAINED GOAL-DIRECTED ATTENTION OF SUSTAINED GOAL-DIRECTED ATTENTION
    Danko, Sergei G.
    Kachalova, Larisa M.
    Solovjeva, Maria L.
    PSYCHOPHYSIOLOGY, 2011, 48 : S43 - S43
  • [35] INFLUENCE OF GOAL-DIRECTED SACCADES ON PROCESSING OF VISUAL-STIMULI - REACTION-TIMES AND VISUAL EVOKED-POTENTIALS
    BAEDEKER, C
    WOLF, W
    APPEL, U
    PERCEPTION, 1987, 16 (02) : 253 - 253
  • [36] An easily implementable method to support goal-directed learning
    Ulrich, C
    Chen, AP
    ED-MEDIA 2004: WORLD CONFERENCE ON EDUCATIONAL MULTIMEDIA, HYPERMEDIA & TELECOMMUNICATIONS, VOLS. 1-7, 2004, : 4059 - 4063
  • [37] Visual Goal-Directed Meta-Imitation Learning
    Rivera, Corban G.
    Handelman, David A.
    Ratto, Christopher R.
    Patrone, David
    Paulhamus, Bart L.
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 3766 - 3772
  • [38] Is the learning of goal-directed displacement effector-independent?
    Camachon, C
    Buekers, M
    Montagne, G
    HUMAN MOVEMENT SCIENCE, 2004, 23 (3-4) : 239 - 255
  • [39] Robot Learning and Use of Affordances in Goal-directed Tasks
    Wang, Chang
    Hindriks, Koen V.
    Babuska, Robert
    2013 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2013, : 2288 - 2294
  • [40] Corticostriatal Correlates of Human Goal-Directed Learning and Motivation
    Eryilmaz, Hamdi
    Rodriguez-Thompson, Anais
    Huntington, Franklin C.
    Giegold, Madeline
    Tanner, Alexandra S.
    Roffman, Joshua L.
    BIOLOGICAL PSYCHIATRY, 2016, 79 (09) : 214S - 214S