Aberrant reward learning, but not negative reinforcement learning, is related to depressive symptoms: an attentional perspective

被引:3
|
作者
Hertz-Palmor, Nimrod [1 ,2 ]
Rozenblit, Danielle [1 ]
Lavi, Shani [1 ]
Zeltser, Jonathan [1 ]
Kviatek, Yonatan [1 ]
Lazarov, Amit [1 ,3 ]
机构
[1] Tel Aviv Univ, Sch Psychol Sci, Tel Aviv, Israel
[2] Univ Cambridge, MRC Cognit & Brain Sci Unit, Cambridge, England
[3] Columbia Univ, Irving Med Ctr, Dept Psychiat, New York, NY 10027 USA
基金
以色列科学基金会;
关键词
anhedonia; attention allocation; depression symptoms; negative reinforcement; positive reinforcement; reward learning; selection history; SOCIAL ANXIETY DISORDER; VALUE-DRIVEN ATTENTION; EYE-TRACKING; BIAS MODIFICATION; INDIVIDUALS; ANHEDONIA; INFORMATION; RESPONSES; STIMULI; STRESS;
D O I
10.1017/S0033291723002519
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
Background Aberrant reward functioning is implicated in depression. While attention precedes behavior and guides higher-order cognitive processes, reward learning from an attentional perspective - the effects of prior reward-learning on subsequent attention allocation - has been mainly overlooked.Methods The present study explored the effects of reward-based attentional learning in depression using two separate, yet complimentary, studies. In study 1, participants with high (HD) and low (LD) levels of depression symptoms were trained to divert their gaze toward one type of stimuli over another using a novel gaze-contingent music reward paradigm - music played when fixating the desired stimulus type and stopped when gazing the alternate one. Attention allocation was assessed before, during, and following training. In study 2, using negative reinforcement, the same attention allocation pattern was trained while substituting the appetitive music reward for gazing the desired stimulus type with the removal of an aversive sound (i.e. white noise).Results In study 1 both groups showed the intended shift in attention allocation during training (online reward learning), while generalization of learning at post-training was only evident among LD participants. Conversely, in study 2 both groups showed post-training generalization. Results were maintained when introducing anxiety as a covariate, and when using a more powerful sensitivity analysis. Finally, HD participants showed higher learning speed than LD participants during initial online learning, but only when using negative, not positive, reinforcement.Conclusions Deficient generalization of learning characterizes the attentional system of HD individuals, but only when using reward-based positive reinforcement, not negative reinforcement.
引用
收藏
页码:794 / 807
页数:14
相关论文
共 50 条
  • [21] Effects of Depressive Symptoms, Feelings, and Interoception on Reward-Based Decision-Making: Investigation Using Reinforcement Learning Model
    Ogishima, Hiroyoshi
    Maeda, Shunta
    Tanaka, Yuki
    Shimada, Hironori
    BRAIN SCIENCES, 2020, 10 (08) : 1 - 15
  • [22] DECREASED REWARD RESPONSIVENESS WITH DEPRESSIVE SYMPTOMS: A DEVELOPMENTAL PERSPECTIVE
    Bress, Jennifer N.
    Smith, Ezra
    Foti, Dan
    Hajcak, Greg
    PSYCHOPHYSIOLOGY, 2011, 48 : S47 - S47
  • [23] Belief Reward Shaping in Reinforcement Learning
    Marom, Ofir
    Rosman, Benjamin
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 3762 - 3769
  • [24] Reinforcement Learning with a Corrupted Reward Channel
    Everitt, Tom
    Krakovna, Victoria
    Orseau, Laurent
    Legg, Shane
    PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 4705 - 4713
  • [25] Multigrid Reinforcement Learning with Reward Shaping
    Grzes, Marek
    Kudenko, Daniel
    ARTIFICIAL NEURAL NETWORKS - ICANN 2008, PT I, 2008, 5163 : 357 - 366
  • [26] Reward Shaping in Episodic Reinforcement Learning
    Grzes, Marek
    AAMAS'17: PROCEEDINGS OF THE 16TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS, 2017, : 565 - 573
  • [27] Hybrid Reward Architecture for Reinforcement Learning
    van Seijen, Harm
    Fatemi, Mehdi
    Romoff, Joshua
    Laroche, Romain
    Barnes, Tavian
    Tsang, Jeffrey
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [28] Hierarchical average reward reinforcement learning
    Ghavamzadeh, Mohammad
    Mahadevan, Sridhar
    JOURNAL OF MACHINE LEARNING RESEARCH, 2007, 8 : 2629 - 2669
  • [29] Reinforcement Learning with Stochastic Reward Machines
    Corazza, Jan
    Gavran, Ivan
    Neider, Daniel
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 6429 - 6436
  • [30] Reward Identification in Inverse Reinforcement Learning
    Kim, Kuno
    Garg, Shivam
    Shiragur, Kirankumar
    Ermon, Stefano
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139