| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
|
|
|
|||||||
|
|||||||||
Journal of Neurophysiology, Vol 67, Issue 1 145-163, Copyright © 1992 by APS
ARTICLES |
T. Ljungberg, P. Apicella and W. Schultz
Institut de Physiologie, Universite de Fribourg, Switzerland.
1. Previous studies have shown that dopamine (DA) neurons respond to stimuli of behavioral significance, such as primary reward and conditioned stimuli predicting reward and eliciting behavioral reactions. The present study investigated how these responses develop and vary when the behavioral significance of stimuli changes during different stages of learning. Impulses from DA neurons were recorded with movable microelectrodes from areas A8, A9, and A10 in two awake monkeys during the successive acquisition of two behavioral tasks. Impulses of DA neurons were distinguished from other neurons by their long duration (1.8-5.0 ms) and low spontaneous frequency (0.5-7.0 imp/s). 2. In the first task, animals learned to reach in a small box in front of them when it opened visibly and audibly. Before conditioning, DA neurons were activated the first few times that the empty box opened and animals reacted with saccadic eye movements. Neuronal and behavioral responses disappeared on repeated stimulus presentation. Thus neuronal responses were related to the novelty of an unexpected stimulus eliciting orienting behavior. 3. Subsequently, the box contained a small morsel of apple in one out of six trials. Animals reacted with ocular saccades to nearly every box opening and reached out when the morsel was present. One-third of 49 neurons were phasically activated by every door opening. The response was stronger when food was present. Thus DA neurons responded simultaneously to the sight of primary food reward and to the conditioned stimulus associated with reward. 4. When the box contained a morsel of apple on every trial, animals regularly reacted with target-directed eye and arm movements, and the majority of 76 DA neurons responded to door opening. The same neurons lacked responses to a light not associated with task performance that was illuminated at the position of the food box in alternate sessions, thus demonstrating specificity for the behavioral significance of stimuli. 5. The second task employed the operant conditioning of a reaction time situation in which animals reached from a resting key toward a lever when a small light was illuminated. DA neurons lacked responses to the unconditioned light. During task acquisition lasting 2-3 days, one-half of 25 DA neurons were phasically activated when a drop of liquid reward was delivered for reinforcing the reaching movement. In contrast, neurons were not activated when reward was delivered at regular intervals (2.5-3.5 s) but a task was not performed.(ABSTRACT TRUNCATED AT 400 WORDS)
This article has been cited by other articles:
|
|
 |
|
  D. H. Zald, R. L. Cowan, P. Riccardi, R. M. Baldwin, M. S. Ansari, R. Li, E. S. Shelby, C. E. Smith, M. McHugo, and R. M. Kessler Midbrain Dopamine Receptor Availability Is Inversely Associated with Novelty-Seeking Traits in Humans J. Neurosci., December 31, 2008; 28(53): 14372 - 14378. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
B. H. Schott, L. Minuzzi, R. M. Krebs, D. Elmenhorst, M. Lang, O. H. Winz, C. I. Seidenbecher, H. H. Coenen, H.-J. Heinze, K. Zilles, et al. Mesolimbic Functional Magnetic Resonance Imaging Activations during Reward Anticipation Correlate with Reward-Related Ventral Striatal Dopamine Release J. Neurosci., December 24, 2008; 28(52): 14311 - 14319. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. O. Tan and D. Bullock A Local Circuit Model of Learned Striatal and Dopamine Cell Responses under Probabilistic Schedules of Reward J. Neurosci., October 1, 2008; 28(40): 10062 - 10074. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 C. A. Owesson-White, J. F. Cheer, M. Beyene, R. M. Carelli, and R. M. Wightman Dynamic changes in accumbens dopamine correlate with learning during intracranial self-stimulation PNAS, August 19, 2008; 105(33): 11957 - 11962. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
L. A. B. Wisman, G. Sahin, M. Maingay, G. Leanza, and D. Kirik Functional Convergence of Dopaminergic and Cholinergic Input Is Critical for Hippocampus-Dependent Working Memory J. Neurosci., July 30, 2008; 28(31): 7797 - 7807. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. Kobayashi and W. Schultz Influence of Reward Delays on Responses of Dopamine Neurons J. Neurosci., July 30, 2008; 28(31): 7837 - 7846. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
X. Wan and L. L. Peoples Amphetamine Exposure Enhances Accumbal Responses to Reward-Predictive Stimuli in a Pavlovian Conditioned Approach Task J. Neurosci., July 23, 2008; 28(30): 7501 - 7512. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. Ishikawa, F. Ambroggi, S. M. Nicola, and H. L. Fields Dorsomedial Prefrontal Cortex Contribution to Behavioral and Nucleus Accumbens Neuronal Responses to Incentive Cues J. Neurosci., May 7, 2008; 28(19): 5088 - 5098. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 N. Granado, O. Ortiz, L. M. Suarez, E. D. Martin, V. Cena, J. M. Solis, and R. Moratalla D1 but not D5 Dopamine Receptors Are Critical for LTP, Spatial Learning, and LTP-Induced arc and zif268 Expression in the Hippocampus Cereb Cortex, January 1, 2008; 18(1): 1 - 12. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. K. Hitchcott, J. J. Quinn, and J. R. Taylor Bidirectional Modulation of Goal-Directed Actions by Prefrontal Cortical Dopamine Cereb Cortex, December 1, 2007; 17(12): 2820 - 2827. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
E. M. Izhikevich Solving the Distal Reward Problem through Linkage of STDP and Dopamine Signaling Cereb Cortex, October 1, 2007; 17(10): 2443 - 2452. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
Z.-B. You, B. Wang, D. Zitzman, S. Azari, and R. A. Wise A Role for Conditioned Ventral Tegmental Glutamate Release in Cocaine Seeking J. Neurosci., September 26, 2007; 27(39): 10546 - 10555. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 H. M. Bayer, B. Lau, and P. W. Glimcher Statistics of Midbrain Dopamine Neuron Spike Trains in the Awake Primate J Neurophysiol, September 1, 2007; 98(3): 1428 - 1439. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. A. Kliem, N. T. Maidment, L. C. Ackerson, S. Chen, Y. Smith, and T. Wichmann Activation of Nigral and Pallidal Dopamine D1-Like Receptors Modulates Basal Ganglia Outflow in Monkeys J Neurophysiol, September 1, 2007; 98(3): 1489 - 1500. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. Bray, S. Shimojo, and J. P. O'Doherty Direct Instrumental Conditioning of Neural Activity Using Functional Magnetic Resonance Imaging-Derived Reward Feedback J. Neurosci., July 11, 2007; 27(28): 7498 - 7507. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. R. Laviolette Dopamine Modulation of Emotional Processing in Cortical and Subcortical Neural Circuits: Evidence for a Final Common Pathway in Schizophrenia? Schizophr Bull, July 1, 2007; 33(4): 971 - 981. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
H. Ji and P. D. Shepard Lateral Habenula Stimulation Inhibits Rat Midbrain Dopamine Neurons through a GABAA Receptor-Mediated Mechanism J. Neurosci., June 27, 2007; 27(26): 6923 - 6930. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 P.R. Corlett, G.D. Honey, and P.C. Fletcher From prediction error to psychosis: ketamine as a pharmacological model of delusions J Psychopharmacol, May 1, 2007; 21(3): 238 - 252. [Abstract] [PDF]
|
|
|
|
 |
|
 C. M. O'Carroll, S. J. Martin, J. Sandin, B. Frenguelli, and R. G.M. Morris Dopaminergic modulation of the persistence of one-trial hippocampus-dependent memory Learn. Mem., November 1, 2006; 13(6): 760 - 769. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
N. Lemon and D. Manahan-Vaughan Dopamine D1/D5 Receptors Gate the Acquisition of Novel Information through Hippocampal Long-Term Potentiation and Long-Term Depression J. Neurosci., July 19, 2006; 26(29): 7723 - 7729. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. N. Tobler, J. P. O'Doherty, R. J. Dolan, and W. Schultz Human Neural Learning Depends on Reward Prediction Errors in the Blocking Paradigm J Neurophysiol, January 1, 2006; 95(1): 301 - 310. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
W. Y. Choi, P. D. Balsam, and J. C. Horvitz Extended Habit Training Reduces Dopamine Mediation of Appetitive Response Expression J. Neurosci., July 20, 2005; 25(29): 6729 - 6733. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
W.-X. Pan, R. Schmidt, J. R. Wickens, and B. I. Hyland Dopamine Cells Respond to Predicted Events during Classical Conditioning: Evidence for Eligibility Traces in the Reward-Learning Network J. Neurosci., June 29, 2005; 25(26): 6235 - 6242. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
W.-X. Pan and B. I. Hyland Pedunculopontine Tegmental Nucleus Controls Conditioned Responses of Midbrain Dopamine Neurons in Behaving Rats J. Neurosci., May 11, 2005; 25(19): 4725 - 4732. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. Faure, U. Haberland, F. Conde, and N. E. Massioui Lesion to the Nigrostriatal Dopamine System Disrupts Stimulus-Response Habit Formation J. Neurosci., March 16, 2005; 25(11): 2771 - 2780. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. Vandecasteele, J. Glowinski, and L. Venance Electrical Synapses between Dopaminergic Neurons of the Substantia Nigra Pars Compacta J. Neurosci., January 12, 2005; 25(2): 291 - 298. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
Y. Takikawa, R. Kawagoe, and O. Hikosaka A Possible Role of Midbrain Dopamine Neurons in Short- and Long-Term Adaptation of Saccades to Position-Reward Mapping J Neurophysiol, October 1, 2004; 92(4): 2520 - 2529. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. H. Zald, I. Boileau, W. El-Dearedy, R. Gunn, F. McGlone, G. S. Dichter, and A. Dagher Dopamine Transmission in the Human Striatum during Monetary Reward Tasks J. Neurosci., April 28, 2004; 24(17): 4105 - 4112. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 D. Shohamy, C. E. Myers, S. Grossman, J. Sage, M. A. Gluck, and R. A. Poldrack Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology Brain, April 1, 2004; 127(4): 851 - 859. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
I. A. Yun, K. T. Wakabayashi, H. L. Fields, and S. M. Nicola The Ventral Tegmental Area Is Required for the Behavioral and Nucleus Accumbens Neuronal Firing Responses to Incentive Cues J. Neurosci., March 24, 2004; 24(12): 2923 - 2933. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. J. Tindell, K. C. Berridge, and J. W. Aldridge Ventral Pallidal Representation of Pavlovian Cues and Reward: Population and Rate Codes J. Neurosci., February 4, 2004; 24(5): 1058 - 1069. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. G. Phillips, S. Ahn, and S. B. Floresco Magnitude of Dopamine Release in Medial Prefrontal Cortex Predicts Accuracy of Memory on a Delayed Response Task J. Neurosci., January 14, 2004; 24(2): 547 - 553. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. N. Tobler, A. Dickinson, and W. Schultz Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm J. Neurosci., November 12, 2003; 23(32): 10402 - 10410. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. Otani, H. Daniel, M.-P. Roisin, and F. Crepel Dopaminergic Modulation of Long-term Synaptic Plasticity in Rat Prefrontal Neurons Cereb Cortex, November 1, 2003; 13(11): 1251 - 1256. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
T. Satoh, S. Nakai, T. Sato, and M. Kimura Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons J. Neurosci., October 29, 2003; 23(30): 9913 - 9923. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. R. Roesch and C. R. Olson Impact of Expected Reward on Neuronal Activity in Prefrontal Cortex, Frontal and Supplementary Eye Fields and Premotor Cortex J Neurophysiol, September 1, 2003; 90(3): 1766 - 1789. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. J. Gruber, S. A. Solla, D. J. Surmeier, and J. C. Houk Modulation of Striatal Single Units by Expected Reward: A Spiny Neuron Model Displaying Dopamine-Induced Bistability J Neurophysiol, August 1, 2003; 90(2): 1095 - 1114. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. L. Fudge and A. B. Emiliano The Extended Amygdala and the Dopamine System: Another Piece of the Dopamine Puzzle J Neuropsychiatry Clin Neurosci, August 1, 2003; 15(3): 306 - 316. [Abstract] [Full Text]
|
|
|
|
 |
|
 R. A. Chambers, J. R. Taylor, and M. N. Potenza Developmental Neurocircuitry of Motivation in Adolescence: A Critical Period of Addiction Vulnerability Am J Psychiatry, June 1, 2003; 160(6): 1041 - 1052. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. Kapur Psychosis as a State of Aberrant Salience: A Framework Linking Biology, Phenomenology, and Pharmacology in Schizophrenia Am J Psychiatry, January 1, 2003; 160(1): 13 - 23. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. L. Robinson, M. L. A. V. Heien, and R. M. Wightman Frequency of Dopamine Concentration Transients Increases in Dorsal and Ventral Striatum of Male Rats during Introduction of Conspecifics J. Neurosci., December 1, 2002; 22(23): 10477 - 10486. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
F. Stocchi, S. Ruggieri, L. Vacca, and C. W. Olanow Prospective randomized trial of lisuride infusion versus oral levodopa in patients with Parkinson's disease Brain, September 1, 2002; 125(9): 2058 - 2066. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. L. Krichmar and G. M. Edelman Machine Psychology: Autonomous Behavior, Perceptual Categorization and Conditioning in a Brain-based Device Cereb Cortex, August 1, 2002; 12(8): 818 - 830. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. O. Komendantov and C. C. Canavier Electrical Coupling Between Model Midbrain Dopamine Neurons: Effects on Firing Pattern and Synchrony J Neurophysiol, March 1, 2002; 87(3): 1526 - 1541. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. Di Ciano, R. N. Cardinal, R. A. Cowell, S. J. Little, and B. J. Everitt Differential Involvement of NMDA, AMPA/Kainate, and Dopamine Receptors in the Nucleus Accumbens Core in the Acquisition and Performance of Pavlovian Approach Behavior J. Neurosci., December 1, 2001; 21(23): 9471 - 9477. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. Ravel, P. Sardo, E. Legallet, and P. Apicella Reward Unpredictability inside and outside of a Task Context as a Determinant of the Responses of Tonically Active Neurons in the Monkey Striatum J. Neurosci., August 1, 2001; 21(15): 5730 - 5739. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. L. Thomas and B. J. Everitt Limbic-Cortical-Ventral Striatal Activation during Retrieval of a Discrete Cocaine-Associated Stimulus: A Cellular Imaging Study with {gamma} Protein Kinase C Expression J. Neurosci., April 1, 2001; 21(7): 2526 - 2535. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. Ito, J. W. Dalley, S. R. Howes, T. W. Robbins, and B. J. Everitt Dissociation in Conditioned Dopamine Release in the Nucleus Accumbens Core and Shell in Response to Cocaine Cues and during Cocaine-Seeking Behavior in Rats J. Neurosci., October 1, 2000; 20(19): 7489 - 7495. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. Elliott, K. J. Friston, and R. J. Dolan Dissociable Neural Responses in Human Reward Systems J. Neurosci., August 15, 2000; 20(16): 6159 - 6165. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. J. Wilson and J. C. Callaway Coupled Oscillator Model of the Dopaminergic Neuron of the Substantia Nigra J Neurophysiol, May 1, 2000; 83(5): 3084 - 3100. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
L. Tremblay and W. Schultz Reward-Related Neuronal Activity During Go-Nogo Task Performance in Primate Orbitofrontal Cortex J Neurophysiol, April 1, 2000; 83(4): 1864 - 1876. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. N. Haber, J. L. Fudge, and N. R. McFarland Striatonigrostriatal Pathways in Primates Form an Ascending Spiral from the Shell to the Dorsolateral Striatum J. Neurosci., March 15, 2000; 20(6): 2369 - 2382. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. D. Fiorillo and J. T. Williams Selective Inhibition by Adenosine of mGluR IPSPs in Dopamine Neurons After Cocaine Treatment J Neurophysiol, March 1, 2000; 83(3): 1307 - 1314. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. Durstewitz, J. K. Seamans, and T. J. Sejnowski Dopamine-Mediated Stabilization of Delay-Period Activity in a Network Model of Prefrontal Cortex J Neurophysiol, March 1, 2000; 83(3): 1733 - 1750. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 O. Sporns, N. Almassy, and G. M. Edelman Plasticity in Value Systems and its Role in Adaptive Behavior Adaptive Behavior, March 1, 2000; 8(2): 129 - 148. [Abstract] [PDF]
|
|
|
|
|
|
W. Schultz, L. Tremblay, and J. R. Hollerman Reward Processing in Primate Orbitofrontal Cortex and Basal Ganglia Cereb Cortex, March 1, 2000; 10(3): 272 - 283. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. Legault, P.-P. Rompre, and R. A. Wise Chemical Stimulation of the Ventral Hippocampus Elevates Nucleus Accumbens Dopamine by Activating Dopaminergic Neurons of the Ventral Tegmental Area J. Neurosci., February 15, 2000; 20(4): 1635 - 1642. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 W. Schultz The Reward Signal of Midbrain Dopamine Neurons Physiology, December 1, 1999; 14(6): 249 - 255. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. Brown, D. Bullock, and S. Grossberg How the Basal Ganglia Use Parallel Excitatory and Inhibitory Learning Pathways to Selectively Respond to Unexpected Rewarding Cues J. Neurosci., December 1, 1999; 19(23): 10502 - 10511. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. Durstewitz, M. Kelc, and O. Gunturkun A Neurocomputational Theory of the Dopaminergic Modulation of Working Memory Functions J. Neurosci., April 1, 1999; 19(7): 2807 - 2822. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. O. West Anesthetics Eliminate Somatosensory-Evoked Discharges of Neurons in the Somatotopically Organized Sensorimotor Striatum of the Rat J. Neurosci., November 1, 1998; 18(21): 9055 - 9068. [Abstract] [Full Text] |
