JN Fuel your research with LabChart
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
QUICK SEARCH:   [advanced]


     

J Neurophysiol 80: 1-27, 1998;
0022-3077/98 $5.00
This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow A corrigendum has been published
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Schultz, W.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Schultz, W.

The Journal of Neurophysiology Vol. 80 No. 1 July 1998, pp. 1-27
Copyright ©1998 The American Physiological Society

INVITED REVIEW


Predictive Reward Signal of Dopamine Neurons

Wolfram Schultz

Institute of Physiology and Program in Neuroscience, University of Fribourg, CH-1700 Fribourg, Switzerland

Schultz, Wolfram. Predictive reward signal of dopamine neurons. J. Neurophysiol. 80: 1-27, 1998. The effects of lesions, receptor blocking, electrical self-stimulation, and drugs of abuse suggest that midbrain dopamine systems are involved in processing reward information and learning approach behavior. Most dopamine neurons show phasic activations after primary liquid and food rewards and conditioned, reward-predicting visual and auditory stimuli. They show biphasic, activation-depression responses after stimuli that resemble reward-predicting stimuli or are novel or particularly salient. However, only few phasic activations follow aversive stimuli. Thus dopamine neurons label environmental stimuli with appetitive value, predict and detect rewards and signal alerting and motivating events. By failing to discriminate between different rewards, dopamine neurons appear to emit an alerting message about the surprising presence or absence of rewards. All responses to rewards and reward-predicting stimuli depend on event predictability. Dopamine neurons are activated by rewarding events that are better than predicted, remain uninfluenced by events that are as good as predicted, and are depressed by events that are worse than predicted. By signaling rewards according to a prediction error, dopamine responses have the formal characteristics of a teaching signal postulated by reinforcement learning theories. Dopamine responses transfer during learning from primary rewards to reward-predicting stimuli. This may contribute to neuronal mechanisms underlying the retrograde action of rewards, one of the main puzzles in reinforcement learning. The impulse response releases a short pulse of dopamine onto many dendrites, thus broadcasting a rather global reinforcement signal to postsynaptic neurons. This signal may improve approach behavior by providing advance reward information before the behavior occurs, and may contribute to learning by modifying synaptic transmission. The dopamine reward signal is supplemented by activity in neurons in striatum, frontal cortex, and amygdala, which process specific reward information but do not emit a global reward prediction error signal. A cooperation between the different reward signals may assure the use of specific rewards for selectively reinforcing behaviors. Among the other projection systems, noradrenaline neurons predominantly serve attentional mechanisms and nucleus basalis neurons code rewards heterogeneously. Cerebellar climbing fibers signal errors in motor performance or errors in the prediction of aversive events to cerebellar Purkinje cells. Most deficits following dopamine-depleting lesions are not easily explained by a defective reward signal but may reflect the absence of a general enabling function of tonic levels of extracellular dopamine. Thus dopamine systems may have two functions, the phasic transmission of reward information and the tonic enabling of postsynaptic neurons.




This article has been cited by other articles:


Home page
 Soc Cogn Affect NeurosciHome page
O. C. Schultheiss, M. M. Wirth, C. E. Waugh, S. J. Stanton, E. A. Meier, and P. Reuter-Lorenz
Exploring the motivational brain: effects of implicit power motivation on brain activation in response to facial expressions of emotion
Soc Cogn Affect Neurosci, October 8, 2008; (2008) nsn030v1.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
E. Brazhnik, F. Shah, and J. M. Tepper
GABAergic Afferents Activate Both GABAA and GABAB Receptors in Mouse Substantia Nigra Dopaminergic Neurons In Vivo
J. Neurosci., October 8, 2008; 28(41): 10386 - 10398.
[Abstract] [Full Text] [PDF]

Home page
 Neural Comput.Home page
G. Gangadhar, D. Joseph, and V. S. Chakravarthy
Understanding Parkinsonian Handwriting Through a Computational Model of Basal Ganglia
Neural Comput., October 1, 2008; 20(10): 2491 - 2525.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
C. O. Tan and D. Bullock
A Local Circuit Model of Learned Striatal and Dopamine Cell Responses under Probabilistic Schedules of Reward
J. Neurosci., October 1, 2008; 28(40): 10062 - 10074.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
J. D. Berke
Uncoordinated Firing Rate Changes of Striatal Fast-Spiking Interneurons during Behavioral Task Performance
J. Neurosci., October 1, 2008; 28(40): 10075 - 10080.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
H. E.M. den Ouden, K. J. Friston, N. D. Daw, A. R. McIntosh, and K. E. Stephan
A Dual Role for Prediction Error in Associative Learning
Cereb Cortex, September 26, 2008; (2008) bhn161v1.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
W.-X. Pan, R. Schmidt, J. R. Wickens, and B. I. Hyland
Tripartite Mechanism of Extinction Suggested by Dopamine Neuron Activity and Temporal Difference Model
J. Neurosci., September 24, 2008; 28(39): 9619 - 9631.
[Abstract] [Full Text] [PDF]

Home page
 ScienceHome page
G. D. Stuber, M. Klanker, B. de Ridder, M. S. Bowers, R. N. Joosten, M. G. Feenstra, and A. Bonci
Reward-Predictive Cues Enhance Excitatory Synaptic Strength onto Midbrain Dopamine Neurons
Science, September 19, 2008; 321(5896): 1690 - 1692.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
K. Aoki, K. Kosakai, and M. Yoshino
Monoaminergic Modulation of the Na+-Activated K+ Channel in Kenyon Cells Isolated From the Mushroom Body of the Cricket (Gryllus bimaculatus) Brain
J Neurophysiol, September 1, 2008; 100(3): 1211 - 1222.
[Abstract] [Full Text] [PDF]

Home page
 Schizophr BullHome page
J. M. Gold, J. A. Waltz, K. J. Prentice, S. E. Morris, and E. A. Heerey
Reward Processing in Schizophrenia: A Deficit in the Representation of Value
Schizophr Bull, September 1, 2008; 34(5): 835 - 847.
[Abstract] [Full Text] [PDF]

Home page
 NeurologyHome page
N. J. Diederich and C. G. Goetz
The placebo treatments in neurosciences: New insights from clinical and neuroimaging studies
Neurology, August 26, 2008; 71(9): 677 - 684.
[Abstract] [Full Text] [PDF]

Home page
 Proc. Natl. Acad. Sci. USAHome page
C. A. Owesson-White, J. F. Cheer, M. Beyene, R. M. Carelli, and R. M. Wightman
Dynamic changes in accumbens dopamine correlate with learning during intracranial self-stimulation
PNAS, August 19, 2008; 105(33): 11957 - 11962.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
N. Santana, G. Mengod, and F. Artigas
Quantitative Analysis of the Expression of Dopamine D1 and D2 Receptors in Pyramidal and GABAergic Neurons of the Rat Prefrontal Cortex
Cereb Cortex, August 9, 2008; (2008) bhn134v1.
[Abstract] [Full Text] [PDF]

Home page
 ScienceHome page
W. Shen, M. Flajolet, P. Greengard, and D. J. Surmeier
Dichotomous Dopaminergic Control of Striatal Synaptic Plasticity
Science, August 8, 2008; 321(5890): 848 - 851.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
D. J. Lodge and A. A. Grace
Amphetamine Activation of Hippocampal Drive of Mesolimbic Dopamine Neurons: A Mechanism of Behavioral Sensitization
J. Neurosci., July 30, 2008; 28(31): 7876 - 7882.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
A. Brovelli, N. Laksiri, B. Nazarian, M. Meunier, and D. Boussaoud
Understanding the Neural Computations of Arbitrary Visuomotor Learning through fMRI and Associative Learning Theory
Cereb Cortex, July 1, 2008; 18(7): 1485 - 1495.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
J. A. Mendez, M.-J. Bourque, G. D. Bo, M. L. Bourdeau, M. Danik, S. Williams, J.-C. Lacaille, and L.-E. Trudeau
Developmental and Target-Dependent Regulation of Vesicular Glutamate Transporter Expression by Dopamine Neurons
J. Neurosci., June 18, 2008; 28(25): 6309 - 6318.
[Abstract] [Full Text] [PDF]

Home page
 Cogn Affect Behav NeurosciHome page
M. X. COHEN
Neurocomputational mechanisms of reinforcement-guided learning in humans: A review
Cogn Affect Behav Neurosci, June 1, 2008; 8(2): 113 - 125.
[Abstract] [PDF]

Home page
 J. Neurosci.Home page
K. Nakamura, M. Matsumoto, and O. Hikosaka
Reward-Dependent Modulation of Neuronal Activity in the Primate Dorsal Raphe Nucleus
J. Neurosci., May 14, 2008; 28(20): 5331 - 5343.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
A. Ishikawa, F. Ambroggi, S. M. Nicola, and H. L. Fields
Dorsomedial Prefrontal Cortex Contribution to Behavioral and Nucleus Accumbens Neuronal Responses to Incentive Cues
J. Neurosci., May 7, 2008; 28(19): 5088 - 5098.
[Abstract] [Full Text] [PDF]

Home page
 J. Neuropsychiatry Clin. Neurosi.Home page
J. A. Trafton and E. V. Gifford
Behavioral Reactivity and Addiction: The Adaptation of Behavioral Response to Reward Opportunities
J Neuropsychiatry Clin Neurosci, February 1, 2008; 20(1): 23 - 35.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
B. Lau and P. W. Glimcher
Action and Outcome Encoding in the Primate Caudate Nucleus
J. Neurosci., December 26, 2007; 27(52): 14502 - 14514.
[Abstract] [Full Text] [PDF]

Home page
 ScienceHome page
T. A. Klein, J. Neumann, M. Reuter, J. Hennig, D. Y. von Cramon, and M. Ullsperger
Genetically Determined Differences in Learning from Errors
Science, December 7, 2007; 318(5856): 1642 - 1645.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
J. T. Moyer, J. A. Wolf, and L. H. Finkel
Effects of Dopaminergic Modulation on the Integrative Properties of the Ventral Striatal Medium Spiny Neuron
J Neurophysiol, December 1, 2007; 98(6): 3731 - 3748.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
M. A. Farries and A. L. Fairhall
Reinforcement Learning With Modulated Spike Timing Dependent Synaptic Plasticity
J Neurophysiol, December 1, 2007; 98(6): 3648 - 3665.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
Y. B. Kim, N. Huh, H. Lee, E. H. Baeg, D. Lee, and M. W. Jung
Encoding of Action History in the Rat Ventral Striatum
J Neurophysiol, December 1, 2007; 98(6): 3548 - 3556.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
N. Bunzeck, H. Schutze, S. Stallforth, J. Kaufmann, S. Duzel, H.-J. Heinze, and E. Duzel
Mesolimbic Novelty Processing in Older Adults
Cereb Cortex, December 1, 2007; 17(12): 2940 - 2948.
[Abstract] [Full Text] [PDF]

Home page
 ScienceHome page
M. J. Frank, J. Samanta, A. A. Moustafa, and S. J. Sherman
Hold Your Horses: Impulsivity, Deep Brain Stimulation, and Medication in Parkinsonism
Science, November 23, 2007; 318(5854): 1309 - 1312.
[Abstract] [Full Text] [PDF]

Home page
 Neural Comput.Home page
A. Gruning
Elman Backpropagation as Reinforcement for Simple Recurrent Networks
Neural Comput., November 1, 2007; 19(11): 3108 - 3131.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
R. Okada, J. Rybak, G. Manz, and R. Menzel
Learning-Related Plasticity in PE1 and Other Mushroom Body-Extrinsic Neurons in the Honeybee Brain
J. Neurosci., October 24, 2007; 27(43): 11736 - 11747.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
D. J. Lodge and A. A. Grace
Aberrant Hippocampal Activity Underlies the Dopamine Dysregulation in an Animal Model of Schizophrenia
J. Neurosci., October 17, 2007; 27(42): 11424 - 11430.
[Abstract] [Full Text] [PDF]

Home page
 Neural Comput.Home page
B. Porr and F. Worgotter
Learning with "Relevance": Using a Third Factor to Stabilize Hebbian Learning
Neural Comput., October 1, 2007; 19(10): 2694 - 2719.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
E. M. Izhikevich
Solving the Distal Reward Problem through Linkage of STDP and Dopamine Signaling
Cereb Cortex, October 1, 2007; 17(10): 2443 - 2452.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
D. Sabatinelli, M. M. Bradley, P. J. Lang, V. D. Costa, and F. Versace
Pleasure Rather Than Salience Activates Human Nucleus Accumbens and Medial Prefrontal Cortex
J Neurophysiol, September 1, 2007; 98(3): 1374 - 1379.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
H. M. Bayer, B. Lau, and P. W. Glimcher
Statistics of Midbrain Dopamine Neuron Spike Trains in the Awake Primate
J Neurophysiol, September 1, 2007; 98(3): 1428 - 1439.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
M. A. Kliem, N. T. Maidment, L. C. Ackerson, S. Chen, Y. Smith, and T. Wichmann
Activation of Nigral and Pallidal Dopamine D1-Like Receptors Modulates Basal Ganglia Outflow in Monkeys
J Neurophysiol, September 1, 2007; 98(3): 1489 - 1500.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
B. W. Balleine, M. R. Delgado, and O. Hikosaka
The Role of the Dorsal Striatum in Reward and Decision-Making
J. Neurosci., August 1, 2007; 27(31): 8161 - 8165.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
H. Seo and D. Lee
Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game
J. Neurosci., August 1, 2007; 27(31): 8366 - 8377.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
T. Michelet, B. Bioulac, D. Guehl, L. Escola, and P. Burbaud
Impact of Commitment on Performance Evaluation in the Rostral Cingulate Motor Area
J. Neurosci., July 11, 2007; 27(28): 7482 - 7489.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
P. Mazzoni, A. Hristova, and J. W. Krakauer
Why Don't We Move Faster? Parkinson's Disease, Movement Vigor, and Implicit Motivation
J. Neurosci., July 4, 2007; 27(27): 7105 - 7116.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
S. L. Cowen and B. L. McNaughton
Selective Delay Activity in the Medial Prefrontal Cortex of the Rat: Contribution of Sensorimotor Information and Contingency
J Neurophysiol, July 1, 2007; 98(1): 303 - 316.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
A. G. Roseberry, T. Painter, G. P. Mark, and J. T. Williams
Decreased Vesicular Somatodendritic Dopamine Stores in Leptin-Deficient Mice
J. Neurosci., June 27, 2007; 27(26): 7021 - 7027.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
S. Geisler, C. Derst, R. W. Veh, and D. S. Zahm
Glutamatergic Afferents of the Ventral Tegmental Area in the Rat
J. Neurosci., May 23, 2007; 27(21): 5730 - 5743.
[Abstract] [Full Text] [PDF]

Home page
 J PsychopharmacolHome page
P.R. Corlett, G.D. Honey, and P.C. Fletcher
From prediction error to psychosis: ketamine as a pharmacological model of delusions
J Psychopharmacol, May 1, 2007; 21(3): 238 - 252.
[Abstract] [PDF]

Home page
 J. Neurosci.Home page
X. Liu, D. K. Powell, H. Wang, B. T. Gold, C. R. Corbly, and J. E. Joseph
Functional Dissociation in Frontal and Striatal Areas for Processing of Positive and Negative Reward Information
J. Neurosci., April 25, 2007; 27(17): 4587 - 4597.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
G. Cui, B. E. Bernier, M. T. Harnett, and H. Morikawa
Differential Regulation of Action Potential- and Metabotropic Glutamate Receptor-Induced Ca2+ Signals by Inositol 1,4,5-Trisphosphate in Dopaminergic Neurons
J. Neurosci., April 25, 2007; 27(17): 4776 - 4785.
[Abstract] [Full Text] [PDF]

Home page
 Pers Soc Psychol BullHome page
L. D. Smillie, L. I. Dalgleish, and C. J. Jackson
Distinguishing Between Learning and Motivation in Behavioral Tests of the Reinforcement Sensitivity Theory of Personality
Pers Soc Psychol Bull, April 1, 2007; 33(4): 476 - 489.
[Abstract] [PDF]

Home page
 Adaptive BehaviorHome page
M. Witkowski
An Action-Selection Calculus
Adaptive Behavior, March 1, 2007; 15(1): 73 - 97.
[Abstract] [PDF]

Home page
 Soc Cogn Affect NeurosciHome page
M. X Cohen
Individual differences and the neural representations of reward expectation and reward prediction error
Soc Cogn Affect Neurosci, March 1, 2007; 2(1): 20 - 30.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
P. W. German and H. L. Fields
Rat Nucleus Accumbens Neurons Persistently Encode Locations Associated With Morphine Reward
J Neurophysiol, March 1, 2007; 97(3): 2094 - 2106.
[Abstract] [Full Text] [PDF]

Home page
 Arch Gen PsychiatryHome page
B. W. Dunlop and C. B. Nemeroff
The Role of Dopamine in the Pathophysiology of Depression
Arch Gen Psychiatry, March 1, 2007; 64(3): 327 - 337.
[Full Text] [PDF]

Home page
 J. Neurosci.Home page
S. B. Floresco and M. T. Tse
Dopaminergic Regulation of Inhibitory and Excitatory Transmission in the Basolateral Amygdala-Prefrontal Cortical Pathway
J. Neurosci., February 21, 2007; 27(8): 2045 - 2057.
[Abstract] [Full Text] [PDF]

Home page
 J. Cogn. Neurosci.Home page
C. M. Cincotta and C. A. Seger
Dissociation between Striatal Regions while Learning to Categorize via Feedback and via Observation.
J. Cogn. Neurosci., February 1, 2007; 19(2): 249 - 265.
[Abstract] [Full Text] [PDF]

Home page
 FocusHome page
P. W. Kalivas and N. D. Volkow
The Neural Basis of Addiction: A Pathology of Motivation and Choice
Focus, January 1, 2007; 5(2): 208 - 219.
[Abstract] [Full Text] [PDF]

Home page
 FocusHome page
S. E. Hyman
Addiction: A Disease of Learning and Memory
Focus, January 1, 2007; 5(2): 220 - 228.
[Abstract] [Full Text] [PDF]

Home page
 J. Physiol.Home page
E. B. Margolis, H. Lock, G. O. Hjelmstad, and H. L. Fields
The ventral tegmental area revisited: is there an electrophysiological marker for dopaminergic neurons?
J. Physiol., December 15, 2006; 577(3): 907 - 924.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
M. D. Humphries, R. D. Stewart, and K. N. Gurney
A Physiologically Plausible Model of Action Selection and Oscillatory Activity in the Basal Ganglia
J. Neurosci., December 13, 2006; 26(50): 12921 - 12942.
[Abstract] [Full Text] [PDF]

Home page
 NeuroscientistHome page
S. Pecina, K. S. Smith, and K. C. Berridge
Hedonic Hot Spots in the Brain
Neuroscientist, December 1, 2006; 12(6): 500 - 511.
[Abstract] [PDF]

Home page
 Pers Soc Psychol RevHome page
L. D. Smillie, A. D. Pickering, and C. J. Jackson
The New Reinforcement Sensitivity Theory: Implications for Personality Measurement
Personality and Social Psychology Review, November 1, 2006; 10(4): 320 - 335.
[Abstract] [PDF]

Home page
 J. Neurophysiol.Home page
S. D. Gale and D. J. Perkel
Physiological Properties of Zebra Finch Ventral Tegmental Area and Substantia Nigra Pars Compacta Neurons
J Neurophysiol, November 1, 2006; 96(5): 2295 - 2306.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
C. C. Canavier and R. S. Landry
An Increase in AMPA and a Decrease in SK Conductance Increase Burst Firing by Different Mechanisms in a Model of a Dopamine Neuron In Vivo
J Neurophysiol, November 1, 2006; 96(5): 2549 - 2563.
[Abstract] [Full Text] [PDF]

Home page