The effects of dopaminergic D2-like receptor stimulation upon behavioral and neural correlates of renewal depend on individual context processing propensities

65 years of research on dopamine's role in classical fear conditioning and extinction: A systematic review

Dopamine, a catecholamine neurotransmitter, has historically been associated with the encoding of reward, whereas its role in aversion has received less attention. Here, we systematically gathered the vast evidence of the role of dopamine in the simplest forms of aversive learning: classical fear conditioning and extinction. In the past, crude methods were used to augment or inhibit dopamine to study its relationship with fear conditioning and extinction. More advanced techniques such as conditional genetic, chemogenic and optogenetic approaches now provide causal evidence for dopamine's role in these learning processes. Dopamine neurons encode conditioned stimuli during fear conditioning and extinction and convey the signal via activation of D1-4 receptor sites particularly in the amygdala, prefrontal cortex and striatum. The coordinated activation of dopamine receptors allows for the continuous formation, consolidation, retrieval and updating of fear and extinction memory in a dynamic and reciprocal manner. Based on the reviewed literature, we conclude that dopamine is crucial for the encoding of classical fear conditioning and extinction and contributes in a way that is comparable to its role in encoding reward.

Dopaminergic D2-like receptor stimulation affects attention on contextual information and modulates BOLD activation of extinction-related brain areas

Contextual information is essential for learning and memory processes and plays a crucial role during the recall of extinction memory, and in the renewal effect, which is the context-dependent recovery of an extinguished response. The dopaminergic system is known to be involved in regulating attentional processes by shifting attention to novel and salient contextual cues. Higher dopamine levels are associated with a better recall of previously learned stimulus-outcome associations and enhanced encoding, as well as retrieval of contextual information which promotes renewal. In this fMRI study, we aimed to investigate the impact of processing contextual information and the influence of dopaminergic D2-like receptor activation on attention to contextual information during a predictive learning task as well as upon extinction learning, memory performance, and activity of extinction-related brain areas. A single oral dose of 1.25 mg bromocriptine or an identical-looking placebo was administered to the participants. We modified a predictive learning task that in previous studies reliably evoked a renewal effect, by increasing the complexity of contextual information. We analysed fixations and dwell on contextual cues by use of eye-tracking and correlated these with behavioural performance and BOLD activation of extinction-related brain areas. Our results indicate that the group with dopaminergic D2-like receptor stimulation had higher attention to task-relevant contextual information and greater/lower BOLD activation of brain regions associated with cognitive control during extinction learning and recall. Moreover, renewal responses were almost completely absent. Since this behavioural effect was observed for both treatment groups, we assume that this was due to the complexity of the altered task design.

Cortisol decreases activation in extinction related brain areas resulting in an impaired recall of context-dependent extinction memory

Conditioned responding gradually stops during successful extinction learning. The renewal effect is defined as the recovery of a extinguished conditioned response when the context of extinction is different from acquisition. The stress hormone cortisol is known to have an influence on extinction memory and associative learning. Different effects of cortisol on behaviour and brain activity have been observed with respect to stress timing, duration, and intensity. However, the influence of cortisol prior to the initial encoding of stimulus-outcome associations on extinction learning, renewal and its behavioural and neurobiological correlates is still largely unknown. In our study, 60 human participants received 20 mg cortisol or placebo and then learned, extinguished, and recalled the associations between food stimuli presented in distinct contexts and different outcomes in three subsequent task phases. Learning performance during acquisition and extinction phases was equally good for both treatment groups. In the cortisol group, significantly more participants showed renewal compared to placebo. In the subgroup of participants with renewal, cortisol treated participants showed significantly better extinction learning performance compared to placebo. Participants showing renewal had in general difficulties with recalling extinction memory, but in contrast to placebo, the cortisol group exhibited a context-dependent impairment of extinction memory recall. Imaging analyses revealed that cortisol decreased activation in the hippocampus during acquisition. The cortisol group also showed reduced dorsolateral prefrontal cortex activation when extinction learning took place in a different context, but enhanced activation in inferior frontal gyrus during extinction learning without context change. During recall, cortisol decreased ventromedial prefrontal cortex activation. Taken together, our findings illustrate cortisol as a potent modulator of extinction learning and recall of extinction memory which also promotes renewal.

NMDA receptor-mediated processing in inferior frontal gyrus facilitates acquisition and extinction learning and strengthens renewal

While the renewal effect of extinction is considered to be invoked by attention to context during the extinction phase, there is also evidence that processing during initial learning (acquisition) may be important for later renewal. A noradrenergic agonist and a dopaminergic antagonist, administered before acquisition, did not affect renewal, however, the effects of NMDAergic neurotransmission in this regard are as yet unknown. In a previous study, administration of a single dose of the NMDA agonist D-cycloserine (DCS) before extinction learning facilitated extinction in the context of acquisition (AAA), but had no effect upon renewal. In the present fMRI study, DCS was administered prior to the initial acquisition of a predictive learning task, in order to investigate whether NMDA receptor (NMDAR) stimulation at this timepoint will modulate overall learning as well as the level of renewal, while increasing activation in the extinction- and renewal-relevant brain regions of inferior frontal gyrus (iFG) and hippocampus (HC). DCS facilitated acquisition, as well as extinction learning in the context of acquisition (AAA), and raised the level of ABA renewal. While BOLD activation during acquisition did not differ between treatment groups, activation in bilateral iFG showed a double dissociation during processing of AAA extinction trials, with DCS-mediated higher activation in right iFG and deactivation in left iFG. In contrast, placebo showed higher activation in left iFG and deactivation in right iFG. During the test (recall) phase, left iFG and right anterior hippocampus activation was increased in DCS participants who showed renewal, with activation in this region correlating with the ABA renewal level. The results demonstrate that NMDA receptor stimulation can facilitate both initial learning and extinction of associations, and in this way has an impact upon the resultant level of renewal. In particular NMDAergic processing in iFG appears relevant for the facilitation of AAA extinction and ABA recall in the test phase.

The DA-antagonist Tiapride affects context-related extinction learning in a predictive learning task, but not initial forming of associations, or renewal

Renewal describes the recovery of an extinguished response if the contexts of extinction and recall differ, highlighting the context dependency of extinction. Studies demonstrated dopaminergic (DA) signalling to be important for context-related extinction learning with and without a fear component. In a previous study in humans, administration of the dopamine D2/D3 antagonist tiapride prior to extinction impaired extinction learning in a novel, but not a familiar context, without affecting renewal. In a further study, context processing during initial acquisition of associations was shown to be related to renewal. In this human fMRI study we investigated the potential role of DA signalling during this initial conditioning for the learning process and for renewal. While tiapride, administered prior to the start of learning, did not affect initial acquisition and renewal, extinction learning in a novel context was impaired, associated with reduced BOLD activation in vmPFC, left iFG and ACC - regions mediating response inhibition and selection from competing options using contextual information. Thus, different timepoints of administration of tiapride (before initial conditioning or extinction) had largely similar effects upon extinction and renewal. In addition, retrieval of previously acquired associations was impaired, pointing towards weaker association forming during acquisition. Conceivably, effects of the DA blockade are associated with the challenge present in the respective task rather than the administration timepoint: the cognitive flexibility required for forming a new inhibitory association that includes a novel element clearly requires DA processing, while initial forming of associations, or of inhibitory associations without a new element, apparently rely less on the proper function of the DA system.

Left Inferior Frontal Gyrus Participates in Mediating the Renewal Effect Irrespective of Context Salience

The renewal effect of extinction demonstrates the context-dependency of extinction learning. It is defined as the recovery of an extinguished response occurring when the contexts of extinction and recall differ. Behavioral studies showed that modulating context relevance can strengthen context-specific responses. In our fMRI study, we investigated to what extent a modulation of context salience can alter renewal levels and provide additional information about the neural basis for renewal. In a within-subjects design, participants completed two sessions of an associative learning task in randomized order. In the salient condition (SAL), a context was presented alone at the start of each trial, before being presented together with the stimulus. The regular condition (REG) contained no context-alone phase. In about one-third of participants (SWITCH), the context salience modulation significantly increased renewal rates in the SAL compared to the REG condition. The other participants showed either renewal (REN) or no renewal (NoREN) in both conditions. The modulation did not significantly affect learning performance during the initial forming of associations or extinction learning. In the SWITCH group, activation in left opercular inferior frontal gyrus (iFG) during the recall phase was associated with a renewal effect, together with activity in the bilateral posterior hippocampus and ventromedial prefrontal cortex (vmPFC). Also during the extinction phase, left opercular iFG activation was higher in groups exhibiting renewal in recall, irrespective of the context salience modulation. Besides confirming the participation of vmPFC in extinction recall, our findings provide novel insights regarding an as yet undetected, potentially important role for renewal-supporting processes in left iFG during extinction learning and recall, which are presumably based on the region's proposed function of evaluating competing response options under conditions of ambiguity.

Reduced hippocampal recruitment during response conflict resolution in mesial temporal lobe epilepsy

Recent evidence suggests that the human hippocampus (HC) is not only involved in the processing of motivationally relevant approach-avoidance conflicts but is also engaged in the resolution of more general response conflicts as measured in the Stroop paradigm. Here we investigated whether neural activity in the HC is necessary for successful response conflict resolution. We compared hippocampal recruitment during an auditory Stroop paradigm in 20 patients with mesial temporal lobe epilepsy (MTLE) due to hippocampal sclerosis and 20 age-matched healthy controls using functional magnetic resonance imaging (fMRI). We analyzed hippocampal activation and behavioral performance in conflict trials relative to non-conflict trials. Moreover, functional connectivity (FC) analyses with left and right HCs as seeds were performed. Subjects' regional gray matter volumes were analyzed based on high-resolution T2-weighted MRI scans. The current study replicated previous results showing increased activation in left HC during the processing of conflict trials in healthy subjects. By contrast, MTLE patients showed higher behavioral costs of response conflict resolution and reduced conflict-related HC activation. In patients with left MTLE, left HC activation was predictive of faster conflict-related response times (RTs). By contrast, right HC activation was related to RT slowing, suggestive of a maladaptive compensation attempt in MTLE patients. Our results provide evidence that left hippocampal activation is required for the successful resolution of response conflicts.

Renewal of extinguished behavior in pigeons (Columba livia) does not require memory consolidation of acquisition or extinction in a free-operant appetitive conditioning paradigm

Extinction learning is a fundamental capacity for adaptive and flexible behavior. As extinguished conditioned responding is prone to relapse under certain conditions, the necessity of memory consolidation for recovery phenomena to occur has been highlighted recently. Several studies have demonstrated that both acquisition and extinction training need to be properly consolidated for a relapse of the original acquired memory trace to occur. Does this imply that extinguished responses cannot relapse before memory consolidation? To answer this question, we investigated the renewal effect subsequent to an immediate or a delayed (24 h) extinction in a discriminative operant conditioning paradigm. In three different experiments, we could show (1) that acquisition learning does not need to be long-term consolidated for the occurrence of renewal, (2) that the offset of extinction training is a reliable marker for extinction recall in a free-operant extinction learning paradigm where organisms undergo consecutive acquisition training, extinction training as well as testing of conditioned responding and (3), that immediate and long-term consolidated renewal do not demonstrate any qualitative difference in terms of the behavioral output. Our results indicate on the behavioral level that the inhibitory nature of extinction is already present in free-operant learning paradigms and that it does not seem to be affected by the absence of long-term memory consolidation.

Effects of Noradrenergic Stimulation Upon Context-Related Extinction Learning Performance and BOLD Activation in Hippocampus and Prefrontal Cortex Differ Between Participants Showing and Not Showing Renewal

While the neural structures mediating context-related renewal of extinction are well established, the neurotransmitter systems processing renewal remain elusive. Noradrenergic stimulation before extinction improved learning, but did not alter renewal. Since context processing already during initial conditioning can influence renewal, in this fMRI study we investigated how noradrenergic stimulation by a single dose of atomoxetine (ATO) before initial acquisition of a context-related predictive-learning task affects subsequent learning and renewal in humans. ATO participants showing contextual renewal (REN) exhibited a selective extinction learning deficit compared to placebo (PLAC) and ATO participants lacking renewal (ATO NoREN), probably owing to formation of more stable associations during acquisition. New learning and retrieval during the extinction phase as well as initial acquisition were unimpaired. In ATO REN, higher activation in right inferior frontal gyrus (iFG) during acquisition may have supported the formation of more stable associations, while reduced activation in hippocampus and left iFG during extinction was associated with impaired context encoding and response inhibition. During recall, ATO REN showed reduced overall context-dependent renewal associated with higher activation in medial PFC and right hippocampus. The results demonstrate the importance of noradrenergic processing in inferior frontal cortex and hippocampus for human extinction learning, but not necessarily initial conditioning. Since an identical atomoxetine treatment evoked diverging blood-oxygen level dependent (BOLD) activation patterns in REN and NoREN participants, the effect is presumably related to the participants’ preferred processing strategies that may have recruited differentially interconnected networks in which noradrenergic stimulation produced diverging consequences. In the ATO REN group, probably an additive effect of their preferred processing strategy, which pre-activated the noradrenergic system, and the experimental treatment caused a shift beyond the optimal working range of the noradrenergic system, thus modulating BOLD activation in a way that impaired extinction learning and recall.