Effects of ventral tegmental area stimulation on the acquisition and long-term retention of active avoidance learning

Revisiting the role of anxiety in the initial acquisition of two-way active avoidance: pharmacological, behavioural and neuroanatomical convergence

Two-way active avoidance (TWAA) acquisition constitutes a particular case of approach -avoidance conflict for laboratory rodents. The present article reviews behavioural, psychopharmacological and neuroanatomical evidence accumulated along more than fifty years that provides strong support to the contention that anxiety is critical in the transition from CS (conditioned stimulus)-induced freezing to escape/avoidance responses during the initial stages of TWAA acquisition. Thus, anxiolytic drugs of different types accelerate avoidance acquisition, anxiogenic drugs impair it, and avoidance during these initial acquisition stages is negatively associated with other typical measures of anxiety. In addition behavioural and developmental treatments that reduce or increase anxiety/stress respectively facilitate or impair TWAA acquisition. Finally, evidence for the regulation of TWAA acquisition by septo-hippocampal and amygdala-related mechanisms is discussed. Collectively, the reviewed evidence gives support to the initial acquisition of TWAA as a paradigm with considerable predictive and (in particular) construct validity as an approach-avoidance conflict-based rodent anxiety model.

Differential effects of wake promoting drug modafinil in aversive learning paradigms

Modafinil (MO) an inhibitor of the dopamine transporter was initially approved to treat narcolepsy, a sleep related disorder in humans. One interesting “side-effect” of this drug, which emerged from preclinical and clinical studies, is the facilitation of cognitive performance. So far, this was primarily shown in appetitive learning paradigms, but it is yet unclear whether MO exerts a more general cognitive enhancement effect. Thus, the aim of the present study in rats was to extend these findings by testing the effects of MO in two aversive paradigms, Pavlovian fear conditioning (FC) and the operant two-way active avoidance (TWA) learning paradigms. We discovered a differential, task-dependent effect of MO. In the FC paradigm MO treated rats showed a dose-dependent enhancement of fear memory compared to vehicle treated rats, indicated by increased context-related freezing. Cue related fear memory remained unaffected. In the TWA paradigm MO induced a significant decrease of avoidance responses compared to vehicle treated animals, while the number of escape reactions during the acquisition of the TWA task remained unaffected. These findings expand the knowledge in the regulation of cognitive abilities and may contribute to the understanding of the contraindicative effects of MO in anxiety related mental disorders.

Electrical stimulation of lateral habenula during learning: frequency-dependent effects on acquisition but not retrieval of a two-way active avoidance response

The lateral habenula (LHb) is an epithalamic structure involved in signaling reward omission and aversive stimuli, and it inhibits dopaminergic neurons during motivated behavior. Less is known about LHb involvement in the acquisition and retrieval of avoidance learning. Our previous studies indicated that brief electrical stimulation of the LHb, time-locked to the avoidance of aversive footshock (presumably during the positive affective “relief” state that occurs when an aversive outcome is averted), inhibited the acquisition of avoidance learning. In the present study, we used the same paradigm to investigate different frequencies of LHb stimulation. The effect of 20 Hz vs. 50 Hz vs. 100 Hz stimulation was investigated during two phases, either during acquisition or retrieval in Mongolian gerbils. The results indicated that 50 Hz, but not 20 Hz, was sufficient to produce a long-term impairment in avoidance learning, and was somewhat more effective than 100 Hz in this regard. None of the stimulation parameters led to any effects on retrieval of avoidance learning, nor did they affect general motor activity. This suggests that, at frequencies in excess of the observed tonic firing rates of LHb neurons (>1–20 Hz), LHb stimulation may serve to interrupt the consolidation of new avoidance memories. However, these stimulation parameters are not capable of modifying avoidance memories that have already undergone extensive consolidation.

Effects of L-dopa during auditory instrumental learning in humans

The dopaminergic neurotransmitter system is critically involved in promoting plasticity in auditory cortex. We combined functional magnetic resonance imaging (fMRI) and a pharmacological manipulation to investigate dopaminergic modulation of neural activity in auditory cortex during instrumental learning. Volunteers either received 100 mg L-dopa (Madopar) or placebo in an appetitive, differential instrumental conditioning paradigm, which involved learning that a specific category of frequency modulated tones predicts a monetary reward when fast responses were made in a subsequent reaction time task. The other category of frequency modulated tones was not related to a reward. Our behavioral data provides evidence that dopaminergic stimulation differentially impacts on the speed of instrumental responding in rewarded and unrewarded trials. L-dopa increased neural BOLD activity in left auditory cortex to tones in rewarded and unrewarded trials. This increase was related to plasma L-dopa levels and learning rate. Our data thus provides evidence for dopaminergic modulation of neural activity in auditory cortex, which occurs for both auditory stimuli related to a later reward and those not related to a reward.

The role of dopamine in the context of aversive stimuli with particular reference to acoustically signaled avoidance learning

Learning from punishment is a powerful means for behavioral adaptation with high relevance for various mechanisms of self-protection. Several studies have explored the contribution of released dopamine (DA) or responses of DA neurons on reward seeking using rewards such as food, water, and sex. Phasic DA signals evoked by rewards or conditioned reward predictors are well documented, as are modulations of these signals by such parameters as reward magnitude, probability, and deviation of actually occurring from expected rewards. Less attention has been paid to DA neuron firing and DA release in response to aversive stimuli, and the prediction and avoidance of punishment. In this review, we first focus on DA changes in response to aversive stimuli as measured by microdialysis and voltammetry followed by the change in electrophysiological signatures by aversive stimuli and fearful events. We subsequently focus on the role of DA and effect of DA manipulations on signaled avoidance learning, which consists of learning the significance of a warning cue through Pavlovian associations and the execution of an instrumental avoidance response. We present a coherent framework utilizing the data on microdialysis, voltammetry, electrophysiological recording, electrical brain stimulation, and behavioral analysis. We end by outlining current gaps in the literature and proposing future directions aimed at incorporating technical and conceptual progress to understand the involvement of reward circuit on punishment based decisions.