首页 | 本学科首页   官方微博 | 高级检索  
     


Temporal difference models describe higher-order learning in humans
Authors:Seymour Ben  O'Doherty John P  Dayan Peter  Koltzenburg Martin  Jones Anthony K  Dolan Raymond J  Friston Karl J  Frackowiak Richard S
Affiliation:Wellcome Department of Imaging Neuroscience, 12 Queen Square, London WC1N 3BG, UK. bseymour@fil.ion.ucl.ac.uk
Abstract:The ability to use environmental stimuli to predict impending harm is critical for survival. Such predictions should be available as early as they are reliable. In pavlovian conditioning, chains of successively earlier predictors are studied in terms of higher-order relationships, and have inspired computational theories such as temporal difference learning. However, there is at present no adequate neurobiological account of how this learning occurs. Here, in a functional magnetic resonance imaging (fMRI) study of higher-order aversive conditioning, we describe a key computational strategy that humans use to learn predictions about pain. We show that neural activity in the ventral striatum and the anterior insula displays a marked correspondence to the signals for sequential learning predicted by temporal difference models. This result reveals a flexible aversive learning process ideally suited to the changing and uncertain nature of real-world environments. Taken with existing data on reward learning, our results suggest a critical role for the ventral striatum in integrating complex appetitive and aversive predictions to coordinate behaviour.
Keywords:
本文献已被 PubMed 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号