Abstract
In extinction, an animal learns that a previously conditioned stimulus (CS+) no longer predicts delivery of a salient reinforcer (unconditioned stimulus, UCS). Rodent studies indicate that extinction relies on amygdala-prefrontal interactions and involves formation of memories that inhibit, without actually erasing, the original conditioning trace. Whether extinction learning in humans follows similar neurobiological principles is unknown. We used functional magnetic resonance imaging to measure human brain activity evoked during olfactory aversive conditioning and extinction learning. Neural responses in orbitofrontal cortex and amygdala were preferentially enhanced during extinction, suggesting potential cross-species preservation of learning mechanisms that oppose conditioning. Moreover, by manipulating UCS aversiveness via reinforcer inflation, we showed that a CS+ retains access to representations of UCS value in distinct regions of ventral prefrontal cortex, even as extinction proceeds.
This is a preview of subscription content, access via your institution
Access options
Subscribe to this journal
Receive 12 print issues and online access
$209.00 per year
only $17.42 per issue
Rent or buy this article
Prices vary by article type
from$1.95
to$39.95
Prices may be subject to local taxes which are calculated during checkout
Similar content being viewed by others
References
LeDoux, J.E. Emotion circuits in the brain. Annu. Rev. Neurosci. 23, 155–184 (2000).
Maren, S. Neurobiology of Pavlovian fear conditioning. Annu. Rev. Neurosci. 24, 897–931 (2001).
Gottfried, J.A., O'Doherty, J. & Dolan, R.J. Appetitive and aversive olfactory learning in humans studied using event-related functional magnetic resonance imaging. J. Neurosci. 22, 10829–10837 (2002).
O'Doherty, J., Deichmann, R., Critchley, H.D. & Dolan, R.J. Neural responses during anticipation of a primary taste reward. Neuron 33, 815–826 (2002).
Morrow, B.A., Elsworth, J.D., Rasmusson, A.M. & Roth, R.H. The role of mesoprefrontal dopamine neurons in the acquisition and expression of conditioned fear in the rat. Neuroscience 92, 553–564 (1999).
Baeg, E.H. et al. Fast spiking and regular spiking neural correlates of fear conditioning in the medial prefrontal cortex of the rat. Cereb. Cortex 11, 441–451 (2001).
Rescorla, R.A. Experimental extinction, in Handbook of Contemporary Learning Theories (eds. Mowrer, R.R. & Klein, S.) 119–154 (Lawrence Erlbaum, Mahwah, New Jersey, 2001).
Myers, K.M. & Davis, M. Behavioral and neural analysis of extinction. Neuron 36, 567–584 (2002).
Bouton, M.E. Context, time, and memory retrieval in the interference paradigms of Pavlovian learning. Psychol. Bull. 114, 80–99 (1993).
Garcia, R. Postextinction of conditioned fear: between two CS-related memories. Learn. Mem. 9, 361–363 (2002).
Hobin, J.A., Goosens, K.A. & Maren, S. Context-dependent neuronal activity in the lateral amygala represents fear memories after extinction. J. Neurosci. 23, 8410–8416 (2003).
Quirk, G.J., Likhtik, E., Pelletier, J.G. & Pare, D. Stimulation of medial prefrontal cortex decreases the responsiveness of central amygdala output neurons. J. Neurosci. 23, 8800–8807 (2003).
Rosenkranz, J.A., Moore, H. & Grace, A.A. The prefrontal cortex regulates lateral amygdala neuronal plasticity and responses to previously conditioned stimuli. J. Neurosci. 23, 11054–11064 (2003).
Quirk, G.J. & Gehlert, D.R. Inhibition of the amygdala: key to pathological states? Ann. NY Acad. Sci. 985, 263–272 (2003).
LaBar, K.S., Gatenby, J.C., Gore, J.C., LeDoux, J.E. & Phelps, E.A. Human amygdala activation during conditioned fear acquisition and extinction: a mixed-trial fMRI study. Neuron 20, 937–945 (1998).
Rescorla, R.A. Effect of inflation of the unconditioned stimulus value following conditioning. J. Comp. Physiol. Psychol. 86, 101–106 (1974).
Bouton, M.E. Differential control by context in the inflation and reinstatement paradigms. J. Exp. Psychol. Animal Behav. Proc. 10, 56–74 (1984).
Morris, J.S., Ohman, A. & Dolan, R.J. Conscious and unconscious emotional learning in the human amygdala. Nature 393, 467–470 (1998).
Buchel, C., Morris, J., Dolan, R.J. & Friston, K.J. Brain systems mediating aversive conditioning: an event-related fMRI study. Neuron 20, 947–957 (1998).
Critchley, H.D., Mathias, C.J. & Dolan, R.J. Fear conditioning in humans: the influence of awareness and autonomic arousal on functional neuroanatomy. Neuron 33, 653–663 (2002).
Falls, W.A., Miserendino, M.J.D. & Davis, M. Extinction of fear-potentiated startle: blockade by infusion of an NMDA antagonist into the amygdala. J. Neurosci. 12, 854–863 (1992).
Morgan, M.A., Romanski, L.M. & LeDoux, J.E. Extinction of emotional learning: contribution of medial prefrontal cortex. Neurosci. Lett. 163, 109–113 (1993).
Repa, J.C. et al. Two different lateral amygdala cell populations contribute to the initiation and storage of memory. Nat. Neurosci. 4, 724–731 (2001).
Herry, C. & Garcia, R. Prefrontal cortex long-term potentiation, but not long-term depression, is associated with the maintenance of extinction of learned fear in mice. J. Neurosci. 22, 577–583 (2002).
Milad, M.R. & Quirk, G.J. Neurons in medial prefrontal cortex signal memory for fear extinction. Nature 420, 70–74 (2002).
White, K. & Davey, G.C.L. Sensory preconditioning and UCS inflation in human 'fear' conditioning. Behav. Res. Ther. 27, 161–166 (1989).
Hosoba, T., Iwanaga, M. & Seiwa, H. The effect of UCS inflation and deflation procedures on 'fear' conditioning. Behav. Res. Ther. 39, 465–475 (2001).
Rosenkranz, J.A. & Grace, A.A. Cellular mechanisms of infralimbic and prelimbic prefrontal cortical inhibition and dopaminergic modulation of basolateral amygdala neurons in vivo. J. Neurosci. 22, 324–337 (2002).
Royer, S. & Pare, D. Bidirectional synaptic plasticity in intercalated amygdala neurons and the extinction of conditioned fear responses. Neuroscience 115, 455–462 (2002).
Mai, J.K., Assheuer, J. & Paxinos, G. Atlas of the Human Brain (Academic Press, San Diego, California, 1997).
Pearce, J.M. & Hall, G. A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol. Rev. 87, 532–552 (1980).
Wilson, P.N., Boumphrey, P. & Pearce, J.M. Restoration of the orienting response to a light by a change in its predictive accuracy. Q. J. Exp. Psychol. 44B, 17–36 (1992).
Holland, P.C. & Gallagher, M. Amygdala circuitry in attentional and representational processes. Trends Cogn. Sci. 3, 65–73 (1999).
Schoenbaum, G., Setlow, B., Saddoris, M.P. & Gallagher, M. Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala. Neuron 39, 855–867 (2003).
Pickens, C.L. et al. Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task. J. Neurosci. 23, 11078–11084 (2003).
Tremblay, L. & Schultz, W. Relative reward preference in primate orbitofrontal cortex. Nature 398, 704–708 (1999).
Arana, F.S., Parkinson, J.A., Hinton, E., Holland, A.J. & Owen, A.M. Dissociable contributions of the human amygdala and orbitofrontal cortex to incentive motivation and goal selection. J. Neurosci. 23, 9632–9638 (2003).
Gottfried, J.A., O'Doherty, J. & Dolan, R.J. Encoding predictive reward value in human amygala and orbitofrontal cortex. Science 301, 1104–1107 (2003).
O'Doherty, J., Critchley, H., Deichmann, R. & Dolan, R.J. Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices. J. Neurosci. 23, 7931–7939 (2003).
Hatfield, T., Han, J.S., Conley, M., Gallagher, M. & Holland, P. Neurotoxic lesions of basolateral, but not central, amygdala interfere with Pavlovian second-order conditioning and reinforcer devaluation effects. J. Neurosci. 16, 5256–5265 (1996).
Malkova, L., Gaffan, D. & Murray, E.A. Excitotoxic lesions of the amygdala fail to produce impairment in visual learning for auditory secondary reinforcement but interfere with reinforcer devaluation effects in rhesus monkeys. J. Neurosci. 17, 6011–6020 (1997).
Gallagher, M., McMahan, R.W. & Schoenbaum, G. Orbitofrontal cortex and representation of incentive value in associative learning. J. Neurosci. 19, 6610–6614 (1999).
Baxter, M.G., Parker, A., Lindner, C.C., Izquierdo, A.D. & Murray, E.A. Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. J. Neurosci. 20, 4311–4319 (2000).
Morris, J.S. & Dolan, R.J. Dissociable amygdala and orbitofrontal responses during reversal fear conditioning. Neuroimage 22, 372–380 (2004).
Schoenbaum, G., Chiba, A.A. & Gallagher, M. Changes in functional connectivity in orbitofrontal cortex and basolateral amygdala during olfactory discrimination learning. J. Neurosci. 20, 5179–5189 (2000).
Ekman, P. & Friesen, W.V. Pictures of Facial Affect (Consulting Psychologists Press, Palo Alto, California, USA, 1976).
Gottfried, J.A., Deichmann, R., Winston, J.S. & Dolan, R.J. Functional heterogeneity in human olfactory cortex: an event-related functional magnetic resonance imaging study. J. Neurosci. 22, 10819–10828 (2002).
Deichmann, R., Gottfried, J.A., Hutton, C. & Turner, R. Optimized EPI for fMRI studies of the orbitofrontal cortex. Neuroimage 19, 430–441 (2003).
Friston, K.J. et al. Statistical parametric maps in functional imaging: a general linear approach. Hum. Brain Mapp. 2, 189–210 (1995).
Price, C.J. & Friston, K.J. Cognitive conjunction: a new approach to brain activation experiments. Neuroimage 5, 261–270 (1997).
Worsley, K.J. et al. A unified statistical approach for determining significant voxels in images of cerebral activation. Hum. Brain Mapp. 4, 58–73 (1996).
Acknowledgements
This work was supported by a Howard Hughes Physician-Scientist Fellowship Grant (J.A.G.) and a Wellcome Trust Programme Grant (R.J.D.). We thank J.S. Winston and J.M. Kilner for helpful discussions.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing financial interests.
Rights and permissions
About this article
Cite this article
Gottfried, J., Dolan, R. Human orbitofrontal cortex mediates extinction learning while accessing conditioned representations of value. Nat Neurosci 7, 1144–1152 (2004). https://doi.org/10.1038/nn1314
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/nn1314
This article is cited by
-
Medial orbitofrontal cortical regulation of different aspects of Pavlovian and instrumental reward seeking
Psychopharmacology (2023)
-
Prefrontal cortex, amygdala, and threat processing: implications for PTSD
Neuropsychopharmacology (2022)
-
Impact of exogenous estradiol on task-based and resting-state neural signature during and after fear extinction in healthy women
Neuropsychopharmacology (2021)
-
Neural contributors to trauma resilience: a review of longitudinal neuroimaging studies
Translational Psychiatry (2021)
-
Emergence of complex dynamics of choice due to repeated exposures to extinction learning
Animal Cognition (2021)