Note to users. If you're seeing this message, it means that your browser cannot find this page's style/presentation instructions -- or possibly that you are using a browser that does not support current Web standards. Find out more about why this message is appearing, and what you can do to make your experience of our site the best it can be.

Science 18 June 2004:
Vol. 304. no. 5678, pp. 1782 - 1787
DOI: 10.1126/science.1094765
Prev | Table of Contents | Next

Research Articles

Matching Behavior and the Representation of Value in the Parietal Cortex

Leo P. Sugrue,* Greg S. Corrado, William T. Newsome

Psychologists and economists have long appreciated the contribution of reward history and expectation to decision-making. Yet we know little about how specific histories of choice and reward lead to an internal representation of the "value" of possible actions. We approached this problem through an integrated application of behavioral, computational, and physiological techniques. Monkeys were placed in a dynamic foraging environment in which they had to track the changing values of alternative choices through time. In this context, the monkeys' foraging behavior provided a window into their subjective valuation. We found that a simple model based on reward history can duplicate this behavior and that neurons in the parietal cortex represent the relative value of competing actions predicted by this model.

Howard Hughes Medical Institute and Department of Neurobiology, Stanford University School of Medicine, Stanford, CA 94305, USA.

* To whom correspondence should be addressed. E-mail: leo{at}monkeybiz.stanford.edu

Read the Full Text


THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES:
Temporal Sequence of Attentional Modulation in the Lateral Intraparietal Area and Middle Temporal Area during Rapid Covert Shifts of Attention.
T. M. Herrington and J. A. Assad (2010)
J. Neurosci. 30, 3287-3296
   Abstract »    Full Text »    PDF »
Relationships Between the Threshold and Slope of Psychometric and Neurometric Functions During Perceptual Learning: Implications for Neuronal Pooling.
J. I. Gold, C.-T. Law, P. Connolly, and S. Bennur (2010)
J Neurophysiol 103, 140-154
   Abstract »    Full Text »    PDF »
The Effects of COMT (Val108/158Met) and DRD4 (SNP -521) Dopamine Genotypes on Brain Activations Related to Valence and Magnitude of Rewards.
E. Camara, U. M. Kramer, T. Cunillera, J. Marco-Pallares, D. Cucurell, W. Nager, A. Mestres-Misse, P. Bauer, R. Schule, L. Schols, et al. (2009)
Cereb Cortex
   Abstract »    Full Text »    PDF »
Dopaminergic Drugs Modulate Learning Rates and Perseveration in Parkinson's Patients in a Dynamic Foraging Task.
R. B. Rutledge, S. C. Lazzaro, B. Lau, C. E. Myers, M. A. Gluck, and P. W. Glimcher (2009)
J. Neurosci. 29, 15104-15114
   Abstract »    Full Text »    PDF »
Neuronal Encoding of Reward Value and Direction of Actions in the Primate Putamen.
Y. Hori, T. Minamimoto, and M. Kimura (2009)
J Neurophysiol 102, 3530-3543
   Abstract »    Full Text »    PDF »
Been There, Seen That: A Neural Mechanism for Performing Efficient Visual Search.
K. Mirpour, F. Arcizet, W. S. Ong, and J. W. Bisley (2009)
J Neurophysiol 102, 3481-3491
   Abstract »    Full Text »    PDF »
Neural Activity in the Middle Temporal Area and Lateral Intraparietal Area during Endogenously Cued Shifts of Attention.
T. M. Herrington and J. A. Assad (2009)
J. Neurosci. 29, 14160-14176
   Abstract »    Full Text »    PDF »
A role for the ventral premotor cortex beyond performance monitoring.
J. L. Pardo-Vazquez, V. Leboran, and C. Acuna (2009)
PNAS 106, 18815-18819
   Abstract »    Full Text »    PDF »
Human Reinforcement Learning Subdivides Structured Action Spaces by Learning Effector-Specific Values.
S. J. Gershman, B. Pesaran, and N. D. Daw (2009)
J. Neurosci. 29, 13524-13531
   Abstract »    Full Text »    PDF »
Neural Correlates of the Spatial and Expectancy Components of Endogenous and Stimulus-Driven Orienting of Attention in the Posner Task.
F. Doricchi, E. Macci, M. Silvetti, and E. Macaluso (2009)
Cereb Cortex
   Abstract »    Full Text »    PDF »
Neural computations underlying action-based decision making in the human brain.
K. Wunderlich, A. Rangel, and J. P. O'Doherty (2009)
PNAS 106, 17199-17204
   Abstract »    Full Text »    PDF »
Reward Modulates Attention Independently of Action Value in Posterior Parietal Cortex.
C. J. Peck, D. C. Jangraw, M. Suzuki, R. Efem, and J. Gottlieb (2009)
J. Neurosci. 29, 11182-11191
   Abstract »    Full Text »    PDF »
Search for a Threatening Target Triggers Limbic Guidance of Spatial Attention.
A. Mohanty, T. Egner, J. M. Monti, and M.-M. Mesulam (2009)
J. Neurosci. 29, 10563-10572
   Abstract »    Full Text »    PDF »
Anticipatory and Stimulus-Evoked Blood Oxygenation Level-Dependent Modulations Related to Spatial Attention Reflect a Common Additive Signal.
C. M. Sylvester, G. L. Shulman, A. I. Jack, and M. Corbetta (2009)
J. Neurosci. 29, 10671-10682
   Abstract »    Full Text »    PDF »
Validation of Decision-Making Models and Analysis of Decision Variables in the Rat Basal Ganglia.
M. Ito and K. Doya (2009)
J. Neurosci. 29, 9861-9874
   Abstract »    Full Text »    PDF »
The Role of Human Orbitofrontal Cortex in Value Comparison for Incommensurable Objects.
T. H. B. FitzGerald, B. Seymour, and R. J. Dolan (2009)
J. Neurosci. 29, 8388-8395
   Abstract »    Full Text »    PDF »
Functional Significance of Nonspatial Information in Monkey Lateral Intraparietal Area.
P. F. Balan and J. Gottlieb (2009)
J. Neurosci. 29, 8166-8176
   Abstract »    Full Text »    PDF »
Lateral Intraparietal Cortex and Reinforcement Learning during a Mixed-Strategy Game.
H. Seo, D. J. Barraclough, and D. Lee (2009)
J. Neurosci. 29, 7278-7289
   Abstract »    Full Text »    PDF »
Learning to Attend and to Ignore Is a Matter of Gains and Losses.
C. D. Libera and L. Chelazzi (2009)
Psychological Science 20, 778-784
   Full Text »    PDF »
Adaptive Gaze Control in Natural Environments.
J. Jovancevic-Misic and M. Hayhoe (2009)
J. Neurosci. 29, 6234-6238
   Abstract »    Full Text »    PDF »
Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex.
R. Kiani and M. N. Shadlen (2009)
Science 324, 759-764
   Abstract »    Full Text »    PDF »
Inferior Parietal Lobule Supports Decision Making under Uncertainty in Humans.
T. J. Vickery and Y. V. Jiang (2009)
Cereb Cortex 19, 916-925
   Abstract »    Full Text »    PDF »
Role of the Superior Colliculus in Choosing Mixed-Strategy Saccades.
D. Thevarajah, A. Mikulic, and M. C. Dorris (2009)
J. Neurosci. 29, 1998-2008
   Abstract »    Full Text »    PDF »
Learning cue validity through performance feedback.
J. A. Droll, C. K. Abbey, and M. P. Eckstein (2009)
J Vis 9, 18
   Abstract »    Full Text »    PDF »
Determining a Role for Ventromedial Prefrontal Cortex in Encoding Action-Based Value Signals During Reward-Related Decision Making.
J. Glascher, A. N. Hampton, and J. P. O'Doherty (2009)
Cereb Cortex 19, 483-495
   Abstract »    Full Text »    PDF »
When in doubt, chimpanzees rely on estimates of past reward amounts.
M. J Beran, T. A Evans, and E. H Harris (2009)
Proc R Soc B 276, 309-314
   Abstract »    Full Text »    PDF »
Direction Selectivity of Neurons in the Macaque Lateral Intraparietal Area.
A. Fanini and J. A. Assad (2009)
J Neurophysiol 101, 289-305
   Abstract »    Full Text »    PDF »
Frontal Cortex Subregions Play Distinct Roles in Choices between Actions and Stimuli.
P. H. Rudebeck, T. E. Behrens, S. W. Kennerley, M. G. Baxter, M. J. Buckley, M. E. Walton, and M. F. S. Rushworth (2008)
J. Neurosci. 28, 13775-13785
   Abstract »    Full Text »    PDF »
Effects of Prior Information and Reward on Oculomotor and Perceptual Choices.
D. B. Liston and L. S. Stone (2008)
J. Neurosci. 28, 13866-13875
   Abstract »    Full Text »    PDF »
Neuroethology of reward and decision making.
K. K Watson and M. L Platt (2008)
Phil Trans R Soc B 363, 3825-3835
   Abstract »    Full Text »    PDF »
Cortical mechanisms for reinforcement learning in competitive games.
H. Seo and D. Lee (2008)
Phil Trans R Soc B 363, 3845-3857
   Abstract »    Full Text »    PDF »
Conceptual representations in goal-directed decision making.
N. Shea, K. Krug, and P. N. Tobler (2008)
Cogn Affect Behav Neurosci 8, 418-428
   Abstract »    PDF »
Cells, circuits, and choices: Social influences on perceptual decision making.
A. Mojzisch and K. Krug (2008)
Cogn Affect Behav Neurosci 8, 498-508
   Abstract »    PDF »
Ratio and difference comparisons of expected reward in decision-making tasks.
D. A. Worthy, W. T. Maddox, and A. B. Markman (2008)
Mem Cognit 36, 1460-1469
   Abstract »    PDF »
The Relative Influences of Priors and Sensory Evidence on an Oculomotor Decision Variable During Perceptual Learning.
J. I. Gold, C.-T. Law, P. Connolly, and S. Bennur (2008)
J Neurophysiol 100, 2653-2668
   Abstract »    Full Text »    PDF »
The Spatial Attention Network Interacts with Limbic and Monoaminergic Systems to Modulate Motivation-Induced Attention Shifts.
A. Mohanty, D. R. Gitelman, D. M. Small, and M. M. Mesulam (2008)
Cereb Cortex 18, 2604-2613
   Abstract »    Full Text »    PDF »
Temporal and Spatial Allocation of Motor Preparation During a Mixed-Strategy Game.
A. Mikulic and M. C. Dorris (2008)
J Neurophysiol 100, 2101-2108
   Abstract »    Full Text »    PDF »
Moment-to-Moment Tracking of State Value in the Amygdala.
M. A. Belova, J. J. Paton, and C. D. Salzman (2008)
J. Neurosci. 28, 10023-10030
   Abstract »    Full Text »    PDF »
Reward Facilitates Tactile Judgments and Modulates Hemodynamic Responses in Human Primary Somatosensory Cortex.
B. Pleger, F. Blankenburg, C. C. Ruff, J. Driver, and R. J. Dolan (2008)
J. Neurosci. 28, 8161-8168
   Abstract »    Full Text »    PDF »
Neurocomputational mechanisms of reinforcement-guided learning in humans: A review.
M. X. COHEN (2008)
Cogn Affect Behav Neurosci 8, 113-125
   Abstract »    PDF »
Learning Stochastic Reward Distributions in a Speeded Pointing Task.
A. Seydell, B. C. McCann, J. Trommershauser, and D. C. Knill (2008)
J. Neurosci. 28, 4356-4367
   Abstract »    Full Text »    PDF »
Serotonin is necessary for place memory in Drosophila.
D. Sitaraman, M. Zars, H. LaFerriere, Y.-C. Chen, A. Sable-Smith, T. Kitamoto, G. E. Rottinghaus, and T. Zars (2008)
PNAS 105, 5579-5584
   Abstract »    Full Text »    PDF »
Expected Value, Reward Outcome, and Temporal Difference Error Representations in a Probabilistic Decision Task.
E. T. Rolls, C. McCabe, and J. Redoute (2008)
Cereb Cortex 18, 652-663
   Abstract »    Full Text »    PDF »
Trial-by-Trial Updating of the Gain in Preparation for Smooth Pursuit Eye Movement Based on Past Experience in Humans.
H. Tabata, K. Miura, and K. Kawano (2008)
J Neurophysiol 99, 747-758
   Abstract »    Full Text »    PDF »
Dynamic Changes in Representations of Preceding and Upcoming Reward in Monkey Orbitofrontal Cortex.
J. M. Simmons and B. J. Richmond (2008)
Cereb Cortex 18, 93-103
   Abstract »    Full Text »    PDF »
Immediate Reward Bias in Humans: Fronto-Parietal Networks and a Role for the Catechol-O-Methyltransferase 158Val/Val Genotype.
C. A. Boettiger, J. M. Mitchell, V. C. Tavares, M. Robertson, G. Joslyn, M. D'Esposito, and H. L. Fields (2007)
J. Neurosci. 27, 14383-14391
   Abstract »    Full Text »    PDF »
Order-Dependent Modulation of Directional Signals in the Supplementary and Presupplementary Motor Areas.
J.-W. Sohn and D. Lee (2007)
J. Neurosci. 27, 13655-13666
   Abstract »    Full Text »    PDF »
Positive and Negative Modulation of Motor Response in Primate Superior Colliculus by Reward Expectation.
T. Ikeda and O. Hikosaka (2007)
J Neurophysiol 98, 3163-3170
   Abstract »    Full Text »    PDF »
Representing Spatial Relationships in Posterior Parietal Cortex: Single Neurons Code Object-Referenced Position.
M. V. Chafee, B. B. Averbeck, and D. A. Crowe (2007)
Cereb Cortex 17, 2914-2932
   Abstract »    Full Text »    PDF »
Learning where to direct gaze during change detection.
J. A. Droll, K. Gigone, and M. M. Hayhoe (2007)
J Vis 7, 6
   Abstract »    Full Text »    PDF »
The Role of the Superior Intraparietal Sulcus in Supporting Visual Short-Term Memory for Multifeature Objects.
Y. Xu (2007)
J. Neurosci. 27, 11676-11686
   Abstract »    Full Text »    PDF »
Control of Sensorimotor Variability by Consequences.
L. Madelain, L. Champrenaut, and A. Chauvin (2007)
J Neurophysiol 98, 2255-2265
   Abstract »    Full Text »    PDF »
Do we expect natural selection to produce rational behaviour?.
A. I Houston, J. M McNamara, and M. D Steer (2007)
Phil Trans R Soc B 362, 1531-1543
   Abstract »    Full Text »    PDF »
Cortical mechanisms of action selection: the affordance competition hypothesis.
P. Cisek (2007)
Phil Trans R Soc B 362, 1585-1599
   Abstract »    Full Text »    PDF »
Extending a biologically inspired model of choice: multi-alternatives, nonlinearity and value-based multidimensional choice.
R. Bogacz, M. Usher, J. Zhang, and J. L McClelland (2007)
Phil Trans R Soc B 362, 1655-1670
   Abstract »    Full Text »    PDF »
Understanding Neural Coding through the Model-Based Analysis of Decision Making.
G. Corrado and K. Doya (2007)
J. Neurosci. 27, 8178-8180
   Abstract »    Full Text »    PDF »
Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game.
H. Seo and D. Lee (2007)
J. Neurosci. 27, 8366-8377
   Abstract »    Full Text »    PDF »
Dynamic Circuitry for Updating Spatial Representations. III. From Neurons to Behavior.
R. A. Berman, L. M. Heiser, C. A. Dunn, R. C. Saunders, and C. L. Colby (2007)
J Neurophysiol 98, 105-121
   Abstract »    Full Text »    PDF »
Decision Neuroscience: New Directions in Studies of Judgment and Decision Making.
A. G. Sanfey (2007)
Current Directions in Psychological Science 16, 151-155
   Abstract »    Full Text »    PDF »
Modulation of visual processing by attention and emotion: windows on causal interactions between human brain regions.
P. Vuilleumier and J. Driver (2007)
Phil Trans R Soc B 362, 837-855
   Abstract »    Full Text »    PDF »
Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration.
J. D Cohen, S. M McClure, and A. J Yu (2007)
Phil Trans R Soc B 362, 933-942
   Abstract »    Full Text »    PDF »
Neural signature of fictive learning signals in a sequential investment task.
T. Lohrenz, K. McCabe, C. F. Camerer, and P. R. Montague (2007)
PNAS 104, 9493-9498
   Abstract »    Full Text »    PDF »
Optimal Sensorimotor Integration in Recurrent Cortical Networks: A Neural Implementation of Kalman Filters.
S. Deneve, J.-R. Duhamel, and A. Pouget (2007)
J. Neurosci. 27, 5744-5756
   Abstract »    Full Text »    PDF »
Individual differences and the neural representations of reward expectation and reward prediction error.
M. X Cohen (2007)
Soc Cogn Affect Neurosci 2, 20-30
   Abstract »    Full Text »    PDF »
Target Selection Signals for Arm Reaching in the Posterior Parietal Cortex.
H. Scherberger and R. A. Andersen (2007)
J. Neurosci. 27, 2001-2012
   Abstract »    Full Text »    PDF »
Decoding the neural substrates of reward-related decision making with functional MRI.
A. N. Hampton and J. P. O'Doherty (2007)
PNAS 104, 1377-1382
   Abstract »    Full Text »    PDF »
Reinforcement Learning Signals Predict Future Decisions.
M. X Cohen and C. Ranganath (2007)
J. Neurosci. 27, 371-378
   Abstract »    Full Text »    PDF »
Humans Rapidly Estimate Expected Gain in Movement Planning.
J. Trommershauser, M. S. Landy, and L. T. Maloney (2006)
Psychological Science 17, 981-988
   PDF »
Operant matching is a generic outcome of synaptic plasticity based on the covariance between reward and neural activity.
Y. Loewenstein and H. S. Seung (2006)
PNAS 103, 15224-15229
   Abstract »    Full Text »    PDF »
Integrated neural processes for defining potential actions and deciding between them: a computational model..
P. Cisek (2006)
J. Neurosci. 26, 9761-9770
   Abstract »    Full Text »    PDF »
The Role of the Ventromedial Prefrontal Cortex in Abstract State-Based Inference during Decision Making in Humans..
A. N. Hampton, P. Bossaerts, and J. P. O'Doherty (2006)
J. Neurosci. 26, 8360-8367
   Abstract »    Full Text »    PDF »
Changes in expectation consequent on experience, modeled by a simple, forgetful neural circuit.
A. J. Anderson and R. H. S. Carpenter (2006)
J Vis 6, 5
   Abstract »    Full Text »    PDF »
Reward Encoding in the Monkey Anterior Cingulate Cortex.
C. Amiez, J.P. Joseph, and E. Procyk (2006)
Cereb Cortex 16, 1040-1055
   Abstract »    Full Text »    PDF »
Role of dopamine in the primate caudate nucleus in reward modulation of saccades..
K. Nakamura and O. Hikosaka (2006)
J. Neurosci. 26, 5360-5369
   Abstract »    Full Text »    PDF »
Spatial Updating in Area LIP Is Independent of Saccade Direction.
L. M. Heiser and C. L. Colby (2006)
J Neurophysiol 95, 2751-2767
   Abstract »    Full Text »    PDF »
A biophysically based neural model of matching law behavior: melioration by stochastic synapses..
A. Soltani and X.-J. Wang (2006)
J. Neurosci. 26, 3731-3744
   Abstract »    Full Text »    PDF »
Neural Correlates of Attention and Distractibility in the Lateral Intraparietal Area.
J. W. Bisley and M. E. Goldberg (2006)
J Neurophysiol 95, 1696-1717
   Abstract »    Full Text »    PDF »
Basal Ganglia Orient Eyes to Reward.
O. Hikosaka, K. Nakamura, and H. Nakahara (2006)
J Neurophysiol 95, 567-584
   Abstract »    Full Text »    PDF »
Different Neural Correlates of Reward Expectation and Reward Expectation Error in the Putamen and Caudate Nucleus During Stimulus-Action-Reward Association Learning.
M. Haruno and M. Kawato (2006)
J Neurophysiol 95, 948-959
   Abstract »    Full Text »    PDF »
Brain signals for spatial attention predict performance in a motion discrimination task.
A. Sapir, G. d'Avossa, M. McAvoy, G. L. Shulman, and M. Corbetta (2005)
PNAS 102, 17810-17815
   Abstract »    Full Text »    PDF »
Neural Activity in Macaque Parietal Cortex Reflects Temporal Integration of Visual Motion Signals during Perceptual Decision Making.
A. C. Huk and M. N. Shadlen (2005)
J. Neurosci. 25, 10420-10436
   Abstract »    Full Text »    PDF »
Auditory processing in the posterior parietal cortex..
Y. E. Cohen, B. E. Russ, and G. W. Gifford III (2005)
Behav Cogn Neurosci Rev 4, 218-231
   Abstract »    PDF »
Neural Correlates of Spatial Judgement during Object Construction in Parietal Cortex.
M. V. Chafee, D. A. Crowe, B. B. Averbeck, and A. P. Georgopoulos (2005)
Cereb Cortex 15, 1393-1413
   Abstract »    Full Text »    PDF »
Supplementary Motor Area Encodes Reward Expectancy in Eye-Movement Tasks.
M. Campos, B. Breznen, K. Bernheim, and R. A. Andersen (2005)
J Neurophysiol 94, 1325-1335
   Abstract »    Full Text »    PDF »
Neuronal Activity Dependent on Anticipated and Elapsed Delay in Macaque Prefrontal Cortex, Frontal and Supplementary Eye Fields, and Premotor Cortex.
M. R. Roesch and C. R. Olson (2005)
J Neurophysiol 94, 1469-1497
   Abstract »    Full Text »    PDF »
Simultaneous Representation of Saccade Targets and Visual Onsets in Monkey Lateral Intraparietal Area.
J. Gottlieb, M. Kusunoki, and M. E. Goldberg (2005)
Cereb Cortex 15, 1198-1206
   Abstract »    Full Text »    PDF »
Complementary Process to Response Bias in the Centromedian Nucleus of the Thalamus.
T. Minamimoto, Y. Hori, and M. Kimura (2005)
Science 308, 1798-1801
   Abstract »    Full Text »    PDF »
An Event-Related Functional Magnetic Resonance Imaging Study of Voluntary and Stimulus-Driven Orienting of Attention.
J. M. Kincade, R. A. Abrams, S. V. Astafiev, G. L. Shulman, and M. Corbetta (2005)
J. Neurosci. 25, 4593-4604
   Abstract »    Full Text »    PDF »
Learned Predictions of Error Likelihood in the Anterior Cingulate Cortex.
J. W. Brown and T. S. Braver (2005)
Science 307, 1118-1121
   Abstract »    Full Text »    PDF »
Inaugural Article: Biography of William T. Newsome.
E. Hitt (2005)
PNAS 102, 521-523
   Full Text »    PDF »
Independent Coding of Movement Direction and Reward Prediction by Single Pallidal Neurons.
D. Arkadir, G. Morris, E. Vaadia, and H. Bergman (2004)
J. Neurosci. 24, 10047-10056
   Abstract »    Full Text »    PDF »
Functional-Anatomic Correlates of Memory Retrieval That Suggest Nontraditional Processing Roles for Multiple Distinct Regions within Posterior Parietal Cortex.
B. J. Shannon and R. L. Buckner (2004)
J. Neurosci. 24, 10084-10092
   Abstract »    Full Text »    PDF »


To Advertise     Find Products

Science. ISSN 0036-8075 (print), 1095-9203 (online)