Evidence that conditioned avoidance responses are reinforced by positive prediction errors signaled by tonic striatal dopamine

Improving Translational Relevance in Preclinical Psychopharmacology (iTRIPP)

Animal models are important in preclinical psychopharmacology to study mechanisms and potential treatments for psychiatric disorders. A working group of 14 volunteers, comprising an international team of researchers from academia and industry, convened in 2021 to discuss how to improve the translational relevance and interpretation of findings from animal models that are used in preclinical psychopharmacology. The following paper distils the outcomes of the working group's discussions into 10 key considerations for the planning and reporting of behavioural studies in animal models relevant to psychiatric disorders. These form the iTRIPP guidelines (Improving Translational Relevance In Preclinical Psychopharmacology). These guidelines reflect the key considerations that the group thinks will likely have substantial impact in terms of improving the translational relevance of behavioural studies in animal models that are used to study psychiatric disorders and their treatment. They are relevant to the research community when drafting and reviewing manuscripts, presentations and grant applications. The iTRIPP guidelines are intended to complement general recommendations for planning and reporting animal studies that have been published elsewhere, by enabling researchers to fully consider the most appropriate animal model for the research purpose and to interpret their findings appropriately. This in turn will increase the clinical benefit of such research and is therefore important not only for the scientific community but also for patients and the lay public.

Lateral preoptic area glutamate neurons relay nociceptive information to the ventral tegmental area

The ventral tegmental area (VTA) has been proposed to play a role in pain, but the brain structures modulating VTA activity in response to nociceptive stimuli remain unclear. Here, we demonstrate that the lateral preoptic area (LPO) glutamate neurons relay nociceptive information to the VTA. These LPO glutamatergic neurons synapsing on VTA neurons respond to nociceptive stimulation and conditioned stimuli predicting nociceptive stimulation and also mediate aversion. In contrast, LPO GABA neurons synapsing in the VTA mediate reward. By ultrastructural quantitative synaptic analysis, ex vivo electrophysiology, and functional neuroanatomy we identify a complex circuitry between LPO glutamatergic and GABAergic neurons and VTA dopaminergic, GABAergic, and glutamatergic neurons. We conclude that LPO glutamatergic neurons play a causal role in the processing of nociceptive stimuli and in relaying information about nociceptive stimuli. The pathway from LPO glutamatergic neurons to the VTA represents an unpredicted interface between peripheral nociceptive information and the limbic system.

"Don't [ruminate], be happy": A cognitive perspective linking depression and anhedonia

Anhedonia, a lack of pleasure in things an individual once enjoyed, and rumination, the process of perseverative and repetitive attention to specific thoughts, are hallmark features of depression. Though these both contribute to the same debilitating disorder, they have often been studied independently and through different theoretical lenses (e.g., biological vs. cognitive). Cognitive theories and research on rumination have largely focused on understanding negative affect in depression with much less focus on the etiology and maintenance of anhedonia. In this paper, we argue that by examining the relation between cognitive constructs and deficits in positive affect, we may better understand anhedonia in depression thereby improving prevention and intervention efforts. We review the extant literature on cognitive deficits in depression and discuss how these dysfunctions may not only lead to sustained negative affect but, importantly, interfere with an ability to attend to social and environmental cues that could restore positive affect. Specifically, we discuss how rumination is associated to deficits in working memory and propose that these deficits in working memory may contribute to anhedonia in depression. We further argue that analytical approaches such as computational modeling are needed to study these questions and, finally, discuss implications for treatment.

An Adaptive Motivation Approach to Understanding the 'How' and 'Why' of Wellbeing

A new model provides insight into the 'how' and 'why' of wellbeing to better understand the 'what'. Informed by evolutionary psychology and neuroscience, it proposes that systems for adaptive motivation underpin experiential and reflective wellbeing. The model proposes that the brain learns to predict situations, and errors arise between the predictions and experience. These prediction errors drive emotional experience, learning, motivation, decision-making, and the formation of wellbeing-relevant memories. The model differentiates four layers of wellbeing: objective, experiential, reflective, and narrative, which relate to the model in different ways. Constituents of wellbeing, human motives, and specific emotions integrate into the model. A simple computational implementation of the model reproduced several established wellbeing phenomena, including: the greater frequency of pleasant to unpleasant emotions, the stronger emotional salience of unpleasant emotions, hedonic adaptation to changes in circumstances, heritable influences on wellbeing, and affective forecasting errors. It highlights the importance of individual differences, and implies that high wellbeing will correlate with the experience of infrequent, routine, and predictable avoidance cues and frequent, varied, and novel approach cues. The model suggests that wellbeing arises directly from a system for adaptive motivation. This system functions like a mental dashboard that calls attention to situational changes and motivates the kinds of behaviours that gave humans a relative advantage in their ancestral environment. The model offers a set of fundamental principles and processes that may underlie diverse conceptualisations of wellbeing.

Neural signals implicated in the processing of appetitive and aversive events in social and non-social contexts

In 2014, we participated in a special issue of Frontiers examining the neural processing of appetitive and aversive events. Specifically, we reviewed brain areas that contribute to the encoding of prediction errors and value versus salience, attention and motivation. Further, we described how we disambiguated these cognitive processes and their neural substrates by using paradigms that incorporate both appetitive and aversive stimuli. We described a circuit in which the orbitofrontal cortex (OFC) signals expected value and the basolateral amygdala (BLA) encodes the salience and valence of both appetitive and aversive events. This information is integrated by the nucleus accumbens (NAc) and dopaminergic (DA) signaling in order to generate prediction and prediction error signals, which guide decision-making and learning via the dorsal striatum (DS). Lastly, the anterior cingulate cortex (ACC) is monitoring actions and outcomes, and signals the need to engage attentional control in order to optimize behavioral output. Here, we expand upon this framework, and review our recent work in which within-task manipulations of both appetitive and aversive stimuli allow us to uncover the neural processes that contribute to the detection of outcomes delivered to a conspecific and behaviors in social contexts. Specifically, we discuss the involvement of single-unit firing in the ACC and DA signals in the NAc during the processing of appetitive and aversive events in both social and non-social contexts.

Different brain systems support learning from received and avoided pain during human pain-avoidance learning

Both unexpected pain and unexpected pain absence can drive avoidance learning, but whether they do so via shared or separate neural and neurochemical systems is largely unknown. To address this issue, we combined an instrumental pain-avoidance learning task with computational modeling, functional magnetic resonance imaging (fMRI), and pharmacological manipulations of the dopaminergic (100 mg levodopa) and opioidergic (50 mg naltrexone) systems (N = 83). Computational modeling provided evidence that untreated participants learned more from received than avoided pain. Our dopamine and opioid manipulations negated this learning asymmetry by selectively increasing learning rates for avoided pain. Furthermore, our fMRI analyses revealed that pain prediction errors were encoded in subcortical and limbic brain regions, whereas no-pain prediction errors were encoded in frontal and parietal cortical regions. However, we found no effects of our pharmacological manipulations on the neural encoding of prediction errors. Together, our results suggest that human pain-avoidance learning is supported by separate threat- and safety-learning systems, and that dopamine and endogenous opioids specifically regulate learning from successfully avoided pain.

Discovery of a new class of multi-target heterocycle piperidine derivatives as potential antipsychotics with pro-cognitive effect

A series of benzoisoxazoleylpiperidine derivatives were synthesized by using the multi-target strategies and their potent affinities for dopamine (DA), serotonin (5-HT) and human histamine H₃ receptors have been evaluated. Of these compounds, the promising candidate 4w displayed high affinities for D₂, D₃, 5-HT_1A, 5-HT_2A and H₃, a moderate affinity for 5-HT₆, negligible effects on the human ether-a-go-go-related gene (hERG) channel, low affinities for off-target receptors (5-HT_2C, adrenergic α₁ and H₁). In addition, the animal behavioral study revealed that, compared to risperidone, compound 4w significantly inhibited apomorphine-induced climbing and MK-801-induced movement behaviors with a high threshold for catalepsy and low liabilities for weight gain and hyperprolactinemia. Results from the conditioned avoidance response test and novel object recognition task demonstrated that 4w had pro-cognitive effects. Thus, the antipsychotic drug-like activities of 4w indicate that it may be a potential polypharmacological antipsychotic candidate drug.

Analysis of memory modulation by conditioned stimuli

Conditioned stimuli (CS) have multiple psychological functions that can potentially contribute to their effect on memory formation. It is generally believed that CS-induced memory modulation is primarily due to conditioned emotional responses, however, well-learned CSs not only generate the appropriate behavioral and physiological reactions required to best respond to an upcoming unconditioned stimulus (US), but they also serve as signals that the US is about to occur. Therefore, it is possible that CSs can impact memory consolidation even when their ability to elicit conditioned emotional arousal is significantly reduced. To test this, male Sprague–Dawley rats trained on a signaled active avoidance task were divided into “Avoider” and “Non-Avoider” subgroups on the basis of percentage avoidance after 6 d of training. Subgroup differences in responding to the CS complex were maintained during a test carried out in the absence of the US. Moreover, the subgroups displayed significant differences in stress-induced analgesia (hot-plate test) immediately after this test, suggesting significant subgroup differences in conditioned emotionality. Importantly, using the spontaneous object recognition task, it was found that immediate post-sample exposure to the avoidance CS complex had a similar enhancing effect on object memory in the two subgroups. Therefore, to our knowledge, this is the first study to demonstrate that a significant conditioned emotional response is not necessary for the action of a predictive CS on modulation of memory consolidation.

Evaluation of electrochemical methods for tonic dopamine detection in vivo

Dysfunction in dopaminergic neuronal systems underlie a number of neurologic and psychiatric disorders such as Parkinson's disease, drug addiction, and schizophrenia. Dopamine systems communicate via two mechanisms, a fast "phasic" release (sub-second to second) that is related to salient stimuli and a slower "tonic" release (minutes to hours) that regulates receptor tone. Alterations in tonic levels are thought to be more critically important in enabling normal motor, cognitive, and motivational functions, and dysregulation in tonic dopamine levels are associated with neuropsychiatric disorders. Therefore, development of neurochemical recording techniques that enable rapid, selective, and quantitative measurements of changes in tonic extracellular levels are essential in determining the role of dopamine in both normal and disease states. Here, we review state-of-the-art advanced analytical techniques for in vivo detection of tonic levels, with special focus on electrochemical techniques for detection in humans.

Revisiting the role of anxiety in the initial acquisition of two-way active avoidance: pharmacological, behavioural and neuroanatomical convergence

Two-way active avoidance (TWAA) acquisition constitutes a particular case of approach -avoidance conflict for laboratory rodents. The present article reviews behavioural, psychopharmacological and neuroanatomical evidence accumulated along more than fifty years that provides strong support to the contention that anxiety is critical in the transition from CS (conditioned stimulus)-induced freezing to escape/avoidance responses during the initial stages of TWAA acquisition. Thus, anxiolytic drugs of different types accelerate avoidance acquisition, anxiogenic drugs impair it, and avoidance during these initial acquisition stages is negatively associated with other typical measures of anxiety. In addition behavioural and developmental treatments that reduce or increase anxiety/stress respectively facilitate or impair TWAA acquisition. Finally, evidence for the regulation of TWAA acquisition by septo-hippocampal and amygdala-related mechanisms is discussed. Collectively, the reviewed evidence gives support to the initial acquisition of TWAA as a paradigm with considerable predictive and (in particular) construct validity as an approach-avoidance conflict-based rodent anxiety model.

Dopamine signals related to appetitive and aversive events in paradigms that manipulate reward and avoidability

Using environmental cues to acquire good and avoid harmful things is critical for survival. Rewarding and aversive outcomes both drive behavior through reinforcement learning and sometimes occur together in the environment, but it remains unclear how these signals are encoded within the brain and if signals for positive and negative reinforcement are encoded similarly. Recent studies demonstrate that the dopaminergic system and interconnected brain regions process both positive and negative reinforcement necessary for approach and avoidance behaviors, respectively. Here, we review these data with a special focus on behavioral paradigms that manipulate both expected reward and the avoidability of aversive events to reveal neural correlates related to value, prediction error encoding, motivation, and salience.

Hippocampus and Prefrontal Cortex Predict Distinct Timescales of Activation in the Human Ventral Tegmental Area

The mesolimbic dopamine system contributes to a remarkable variety of behaviors at multiple timescales. Midbrain neurons have fast and slow signaling components, and specific afferent systems, such as the hippocampus (HPC) and prefrontal cortex (PFC), have been demonstrated to drive these components in anesthetized animals. Whether these interactions exist during behavior, however, is unknown. To address this question, we developed a novel analysis of human functional magnetic resonance imaging data that fits models of network excitation and inhibition on ventral tegmental area (VTA) activation. We show that specific afferent systems predict distinct temporal components of midbrain VTA signal. We found that PFC, but not HPC, positively predicted transient, event-evoked VTA activation. In contrast, HPC, but not PFC, positively predicted slow shifts in VTA baseline variability. Thus, unique functional contributions of afferent systems to VTA physiology are detectable at the network level in behaving humans. The findings support models of dopamine function in which dissociable neural circuits support different aspects of motivated behavior via active regulation of tonic and phasic signals.

Partial lesion of dopamine neurons of rat substantia nigra impairs conditioned place aversion but spares conditioned place preference

Midbrain dopamine neurons play critical roles in reward- and aversion-driven associative learning. However, it is not clear whether they do this by a common mechanism or by separate mechanisms that can be dissociated. In the present study we addressed this question by testing whether a partial lesion of the dopamine neurons of the rat SNc has comparable effects on conditioned place preference (CPP) learning and conditioned place aversion (CPA) learning. Partial lesions of dopamine neurons in the rat substantia nigra pars compacta (SNc) induced by bilateral intranigral infusion of 6-hydroxydopamine (6-OHDA, 3μg/side) or 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine (MPTP, 200μg/side) impaired learning of conditioned place aversion (CPA) without affecting conditioned place preference (CPP) learning. Control experiments demonstrated that these lesions did not impair motor performance and did not alter the hedonic value of the sucrose and quinine. The number of dopamine neurons in the caudal part of the SNc positively correlated with the CPP scores of the 6-OHDA rats and negatively correlated with CPA scores of the SHAM rats. In addition, the CPA scores of the 6-OHDA rats positively correlated with the tissue content of striatal dopamine. Insomuch as reward-driven learning depends on an increase in dopamine release by nigral neurons, these findings show that this mechanism is functional even in rats with a partial lesion of the SNc. On the other hand, if aversion-driven learning depends on a reduction of extracellular dopamine in the striatum, the present study suggests that this mechanism is no longer functional after the partial SNc lesion.

Reversal Learning in Humans and Gerbils: Dynamic Control Network Facilitates Learning

Biologically plausible modeling of behavioral reinforcement learning tasks has seen great improvements over the past decades. Less work has been dedicated to tasks involving contingency reversals, i.e., tasks in which the original behavioral goal is reversed one or multiple times. The ability to adjust to such reversals is a key element of behavioral flexibility. Here, we investigate the neural mechanisms underlying contingency-reversal tasks. We first conduct experiments with humans and gerbils to demonstrate memory effects, including multiple reversals in which subjects (humans and animals) show a faster learning rate when a previously learned contingency re-appears. Motivated by recurrent mechanisms of learning and memory for object categories, we propose a network architecture which involves reinforcement learning to steer an orienting system that monitors the success in reward acquisition. We suggest that a model sensory system provides feature representations which are further processed by category-related subnetworks which constitute a neural analog of expert networks. Categories are selected dynamically in a competitive field and predict the expected reward. Learning occurs in sequentialized phases to selectively focus the weight adaptation to synapses in the hierarchical network and modulate their weight changes by a global modulator signal. The orienting subsystem itself learns to bias the competition in the presence of continuous monotonic reward accumulation. In case of sudden changes in the discrepancy of predicted and acquired reward the activated motor category can be switched. We suggest that this subsystem is composed of a hierarchically organized network of dis-inhibitory mechanisms, dubbed a dynamic control network (DCN), which resembles components of the basal ganglia. The DCN selectively activates an expert network, corresponding to the current behavioral strategy. The trace of the accumulated reward is monitored such that large sudden deviations from the monotonicity of its evolution trigger a reset after which another expert subnetwork can be activated-if it has already been established before-or new categories can be recruited and associated with novel behavioral patterns.

Multiple value signals in dopaminergic midbrain and their role in avoidance contexts

The role of dopaminergic brain regions in avoidance behaviour is unclear. Active avoidance requires motivation, and the latter is linked to increased activity in dopaminergic regions. However, avoidance is also often tethered to the prospect of punishment, a state typically characterized by below baseline levels of dopaminergic function. Avoidance has been considered from the perspective of two-factor theories where the prospect of safety is considered to act as a surrogate for reward, leading to dopamine release and enhanced motivational drive. Using fMRI we investigated predictions from two-factor theory by separating the neural representation of a conventional net expected value, which is negative in the case of avoidance, from an adjusted expected value which factors in a possibility of punishment and is larger for both big rewards and big (predictably avoidable) punishments. We show that neural responses in ventral striatum and ventral tegmental area/substantial nigra (VTA/SN) covaried with net expected value. Activity in VTA/SN also covaried with an adjusted expected value, as did activity in anterior insula. Consistent with two-factor theory models, the findings indicate that VTA/SN and insula process an adjusted expected value during avoidance behaviour.

•

We use fMRI and a novel visual-search paradigm to study the role of dopaminergic regions is avoidance contexts

•

Activity in ventral striatum and ventral tegmental area/substantia nigra (VTA/SN) represents a raw expected value

•

Activity in VTA/SN also reflects an expected value adjusted to the punishment potentially avoidable through action

•

An adjusted expected value was also consistent with activity in insula

Selective Increase of Auditory Cortico-Striatal Coherence during Auditory-Cued Go/NoGo Discrimination Learning

Goal directed behavior and associated learning processes are tightly linked to neuronal activity in the ventral striatum. Mechanisms that integrate task relevant sensory information into striatal processing during decision making and learning are implicitly assumed in current reinforcement models, yet they are still weakly understood. To identify the functional activation of cortico-striatal subpopulations of connections during auditory discrimination learning, we trained Mongolian gerbils in a two-way active avoidance task in a shuttlebox to discriminate between falling and rising frequency modulated tones with identical spectral properties. We assessed functional coupling by analyzing the field-field coherence between the auditory cortex and the ventral striatum of animals performing the task. During the course of training, we observed a selective increase of functional coupling during Go-stimulus presentations. These results suggest that the auditory cortex functionally interacts with the ventral striatum during auditory learning and that the strengthening of these functional connections is selectively goal-directed.

Hippocampus and two-way active avoidance conditioning: Contrasting effects of cytotoxic lesion and temporary inactivation

Hippocampal lesions tend to facilitate two-way active avoidance (2WAA) conditioning, where rats learn to cross to the opposite side of a conditioning chamber to avoid a tone-signaled footshock. This classical finding has been suggested to reflect that hippocampus-dependent place/context memory inhibits 2WAA (a crossing response to the opposite side is inhibited by the memory that this is the place where a shock was received on the previous trial). However, more recent research suggests other aspects of hippocampal function that may support 2WAA learning. More specifically, the ventral hippocampus has been shown to contribute to behavioral responses to aversive stimuli and to positively modulate the meso-accumbens dopamine system, whose activation has been implicated in 2WAA learning. Permanent hippocampal lesions may not reveal these contributions because, following complete and permanent loss of hippocampal output, other brain regions may mediate these processes or because deficits could be masked by lesion-induced extra-hippocampal changes, including an upregulation of accumbal dopamine transmission. Here, we re-examined the hippocampal role in 2WAA learning in Wistar rats, using permanent NMDA-induced neurotoxic lesions and temporary functional inhibition by muscimol or tetrodotoxin (TTX) infusion. Complete hippocampal lesions tended to facilitate 2WAA learning, whereas ventral (VH) or dorsal hippocampal (DH) lesions had no effect. In contrast, VH or DH muscimol or TTX infusions impaired 2WAA learning. Ventral infusions caused an immediate impairment, whereas after dorsal infusions rats showed intact 2WAA learning for 40-50 min, before a marked deficit emerged. These data show that functional inhibition of ventral hippocampus disrupts 2WAA learning, while the delayed impairment following dorsal infusions may reflect the time required for drug diffusion to ventral hippocampus. Overall, using temporary functional inhibition, our study shows that the ventral hippocampus contributes to 2WAA learning. Permanent lesions may not reveal these contributions due to functional compensation and extra-hippocampal lesion effects.

Activation of postsynaptic D2 dopamine receptors in the rat dorsolateral striatum prevents the amnestic effect of systemically administered neuroleptics

Systemically administered antipsychotics bind to dopamine (DA) D2 receptors expressed in both pre- and postsynaptic neurons of different striatal sites and present an amnestic effect on learning and memory of conditioned avoidance responses (CAR). The aim of this study was to test whether blockade of the pre- or post-synaptic D2 receptors of the dorsolateral striatum of rats is the mechanism by which systemically administered antipsychotics present this amnestic effect. CAR learning and memory was evaluated in rats that received i.p. administrations of pre- or postsynaptic doses of the antipsychotic sulpiride combined with intra-DLS infusion of the D2 agonist quinpirole. Intra-DLS quinpirole itself was not amnestic and this effect was prevented by co-administration of presynaptic dose of sulpiride. However, sulpiride was amnestic when administered systemically in a post- but not presynaptic dose. This amnestic effect of sulpiride was prevented by the co-administration of quinpirole into the DLS. These results show that a blockade of postsynaptic D2 receptors in the DLS is necessary and sufficient to produce the amnestic effect of neuroleptics on CARs.

Toward sophisticated basal ganglia neuromodulation: Review on basal ganglia deep brain stimulation

This review presents state-of-the-art knowledge about the roles of the basal ganglia (BG) in action-selection, cognition, and motivation, and how this knowledge has been used to improve deep brain stimulation (DBS) treatment of neurological and psychiatric disorders. Such pathological conditions include Parkinson's disease, Huntington's disease, Tourette syndrome, depression, and obsessive-compulsive disorder. The first section presents evidence supporting current hypotheses of how the cortico-BG circuitry works to select motor and emotional actions, and how defects in this circuitry can cause symptoms of the BG diseases. Emphasis is given to the role of striatal dopamine on motor performance, motivated behaviors and learning of procedural memories. Next, the use of cutting-edge electrochemical techniques in animal and human studies of BG functioning under normal and disease conditions is discussed. Finally, functional neuroimaging studies are reviewed; these works have shown the relationship between cortico-BG structures activated during DBS and improvement of disease symptoms.

Good riddance to dopamine: roles for the dopamine transporter in synaptic function and dopamine-associated brain disorders

The neurotransmitter dopamine (DA) plays a critical role in CNS circuits that provide for attention, executive function, reward responses, motivation and movement. DA is inactivated by the cocaine- and amphetamine-sensitive DA transporter (DAT), a protein that also provides a pathway for non-vesicular DA release. After a brief review of DAT function and psychostimulant actions, we consider the importance DAT in relation to the distinct firing patterns of DA neurons that permit awareness of novelty and reward. Finally, we review recent efforts to gather direct support for DAT-linked disorders, with a specific focus on DAT mutations recently identified in subjects with ADHD.

Activation of extracellular signal-regulated kinase (ERK) and ΔFosB in emotion-associated neural circuitry after asymptotic levels of active avoidance behavior are attained

Avoidance susceptibility may constitute a vulnerability to develop anxiety disorders, and Wistar-Kyoto (WKY) rats exhibit unique features in their acquisition of avoidance behavior that appear to promote susceptibility to this form of learning, namely the absence of the commonly observed "warm-up" effect. The present study sought to determine if strain differences in acquired avoidance behavior, between WKY and Sprague Dawley rats, could be attributed to differences in dopamine-related plasticity, represented by extracellular signal-regulated kinase (ERK) activity, and prolonged neuronal activation, represented by ΔFosB accumulation, in three key areas of the brain: the medial prefrontal cortex (mPFC), dorsal striatum (DS), and basolateral amygdala (BLA). Consistent with earlier work, WKY rats exhibited a higher level of asymptotic performance of avoidance behavior, which included an absence of warm-up in the first few trials of later training sessions, and they exhibited more non-reinforced anticipatory responses in the single minute prior to the initiation of the first warning signal presentation of each training session. In the brain, phosyphorylated ERK2 (pERK2) activation was higher in avoidance trained rats in both the mPFC and DS, although the difference in DS was mostly observed in WKY rats. Avoidance-training was associated with higher levels of ΔFosB expression in the mPFC of SD rats, but not WKY rats. The strain differences in pERK2 activation in the DS and ΔFosB levels in the mPFC may underlie the strain-specific differences observed in warm-up, the emission of non-reinforced anticipatory responses, and general differences in asymptotic performance of active avoidance behavior. The mPFC and DS require further study as potential neural targets for understanding avoidance susceptibility and, as a result, anxiety vulnerability.

Electrical stimulation of lateral habenula during learning: frequency-dependent effects on acquisition but not retrieval of a two-way active avoidance response

The lateral habenula (LHb) is an epithalamic structure involved in signaling reward omission and aversive stimuli, and it inhibits dopaminergic neurons during motivated behavior. Less is known about LHb involvement in the acquisition and retrieval of avoidance learning. Our previous studies indicated that brief electrical stimulation of the LHb, time-locked to the avoidance of aversive footshock (presumably during the positive affective “relief” state that occurs when an aversive outcome is averted), inhibited the acquisition of avoidance learning. In the present study, we used the same paradigm to investigate different frequencies of LHb stimulation. The effect of 20 Hz vs. 50 Hz vs. 100 Hz stimulation was investigated during two phases, either during acquisition or retrieval in Mongolian gerbils. The results indicated that 50 Hz, but not 20 Hz, was sufficient to produce a long-term impairment in avoidance learning, and was somewhat more effective than 100 Hz in this regard. None of the stimulation parameters led to any effects on retrieval of avoidance learning, nor did they affect general motor activity. This suggests that, at frequencies in excess of the observed tonic firing rates of LHb neurons (>1–20 Hz), LHb stimulation may serve to interrupt the consolidation of new avoidance memories. However, these stimulation parameters are not capable of modifying avoidance memories that have already undergone extensive consolidation.

On the role of subsecond dopamine release in conditioned avoidance

Using shock avoidance procedures to study conditioned behavioral responses has a rich history within the field of experimental psychology. Such experiments led to the formulation of the general concept of negative reinforcement and specific theories attempting to explain escape and avoidance behavior, or why animals choose to either terminate or prevent the presentation of an aversive event. For example, the two-factor theory of avoidance holds that cues preceding an aversive event begin to evoke conditioned fear responses, and these conditioned fear responses reinforce the instrumental avoidance response. Current neuroscientific advances are providing new perspectives into this historical literature. Due to its well-established role in reinforcement processes and behavioral control, the mesolimbic dopamine system presented itself as a logical starting point in the search for neural correlates of avoidance and escape behavior. We recently demonstrated that phasic dopamine release events are inhibited by stimuli associated with aversive events but increased by stimuli preceding the successful avoidance of the aversive event. The latter observation is inconsistent with the second component of the two-factor theory of avoidance and; therefore, led us propose a new theoretical explanation of conditioned avoidance: (1) fear is initially conditioned to the warning signal and dopamine computes this fear association as a decrease in release, (2) the warning signal, now capable of producing a negative emotional state, suppresses dopamine release and behavior, (3) over repeated trials the warning signal becomes associated with safety rather than fear; dopaminergic neurons already compute safety as an increase in release and begin to encode the warning signal as the earliest predictor of safety (4) the warning signal now promotes conditioned avoidance via dopaminergic modulation of the brain's incentive-motivational circuitry.