Overcoming catastrophic forgetting in neural networks

被引:4538
作者
Kirkpatricka, James [1 ]
Pascanu, Razvan [1 ]
Rabinowitz, Neil [1 ]
Veness, Joel [1 ]
Desjardins, Guillaume [1 ]
Rusu, Andrei A. [1 ]
Milan, Kieran [1 ]
Quan, John [1 ]
Ramalho, Tiago [1 ]
Grabska-Barwinska, Agnieszka [1 ]
Hassabis, Demis [1 ]
Clopath, Claudia [2 ]
Kumaran, Dharshan [1 ]
Hadsell, Raia [1 ]
机构
[1] DeepMind, London EC4 5TW, England
[2] Imperial Coll London, Dept Bioengn, London SW7 2AZ, England
基金
英国工程与自然科学研究理事会; 英国惠康基金;
关键词
synaptic consolidation; artificial intelligence; stability plasticity; continual learning; deep learning; COMPLEMENTARY LEARNING-SYSTEMS; CONNECTIONIST MODELS; PREFRONTAL CORTEX; MEMORY;
D O I
10.1073/pnas.1611835114
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The ability to learn tasks in a sequential fashion is crucial to the development of artificial intelligence. Until now neural networks have not been capable of this and it has been widely thought that catastrophic forgetting is an inevitable feature of connectionist models. We show that it is possible to overcome this limitation and train networks that can maintain expertise on tasks that they have not experienced for a long time. Our approach remembers old tasks by selectively slowing down learning on the weights important for those tasks. We demonstrate our approach is scalable and effective by solving a set of classification tasks based on a hand-written digit dataset and by learning several Atari 2600 games sequentially.
引用
收藏
页码:3521 / 3526
页数:6
相关论文
共 44 条
[1]  
Amit DJ., 1989, MODELING BRAIN FUNCT, DOI DOI 10.1017/CBO9780511623257
[2]  
[Anonymous], 2015, ARXIV151106295
[3]  
[Anonymous], ARXIV150504544
[4]  
[Anonymous], ARXIV150707580
[5]  
[Anonymous], CHILD 1 STEP CONTINU
[6]  
[Anonymous], 2013, ARXIV13013584
[7]  
[Anonymous], 2016, P 4 INT C LEARN REPR
[8]  
[Anonymous], 2013, P INT C NEUR INF PRO
[9]  
[Anonymous], 1998, The mnist database of handwritten digits
[10]  
[Anonymous], 2016, NEURAL INFORM PROCES