Nucleus accumbens core lesions enhance two-way active avoidance

Basal Ganglia Output Has a Permissive Non-Driving Role in a Signaled Locomotor Action Mediated by the Midbrain

The basal ganglia are important for movement and reinforcement learning. Using mice of either sex, we found that the main basal ganglia GABAergic output in the midbrain, the substantia nigra pars reticulata (SNr), shows movement-related neural activity during the expression of a negatively reinforced signaled locomotor action known as signaled active avoidance; this action involves mice moving away during a warning signal to avoid a threat. In particular, many SNr neurons deactivate during active avoidance responses. However, whether SNr deactivation has an essential role driving or regulating active avoidance responses is unknown. We found that optogenetic excitation of SNr or striatal GABAergic fibers that project to an area in the pedunculopontine tegmentum (PPT) within the midbrain locomotor region abolishes signaled active avoidance responses, while optogenetic inhibition of SNr cells (mimicking the SNr deactivation observed during an active avoidance behavior) serves as an effective conditioned stimulus signal to drive avoidance responses by disinhibiting PPT neurons. However, preclusion of SNr deactivation, or direct inhibition of SNr fibers in the PPT, does not impair the expression of signaled active avoidance, indicating that SNr output does not drive the expression of a signaled locomotor action mediated by the midbrain. Consistent with a permissive regulatory role, SNr output provides information about the state of the ongoing action to downstream structures that mediate the action.SIGNIFICANCE STATEMENT During signaled active avoidance behavior, subjects move away to avoid a threat when directed by an innocuous sensory stimulus. Excitation of GABAergic cells in the substantia nigra pars reticulata (SNr), the main output of the basal ganglia, blocks signaled active avoidance, while inhibition of SNr cells is an effective stimulus to drive active avoidance. Interestingly, many SNr cells inhibit their firing during active avoidance responses, suggesting that SNr inhibition could be driving avoidance responses by disinhibiting downstream areas. However, interfering with the modulation of SNr cells does not impair the behavior. Thus, SNr may regulate the active avoidance movement in downstream areas that mediate the behavior, but does not drive it.

Divergent projections of the prelimbic cortex bidirectionally regulate active avoidance

The prefrontal cortex (PFC) integrates incoming information to guide our actions. When motivation for food-seeking competes with avoidance of danger, the PFC likely plays a role in selecting the optimal choice. In platform-mediated active avoidance, rats avoid a tone-signaled footshock by stepping onto a nearby platform, delaying access to sucrose pellets. This avoidance requires prelimbic (PL) PFC, basolateral amygdala (BLA), and ventral striatum (VS). We previously showed that inhibitory tone responses of PL neurons correlate with avoidability of shock (Diehl et al., 2018). Here, we optogenetically modulated PL terminals in VS and BLA to identify PL outputs regulating avoidance. Photoactivating PL-VS projections reduced avoidance, whereas photoactivating PL-BLA projections increased avoidance. Moreover, photosilencing PL-BLA or BLA-VS projections reduced avoidance, suggesting that VS receives opposing inputs from PL and BLA. Bidirectional modulation of avoidance by PL projections to VS and BLA enables the animal to make appropriate decisions when faced with competing drives.

Zona Incerta GABAergic Output Controls a Signaled Locomotor Action in the Midbrain Tegmentum

The zona incerta is a subthalamic nucleus proposed to link sensory stimuli with motor responses to guide behavior, but its functional role is not well established. Using mice of either sex, we studied the effect of manipulating zona incerta GABAergic cells on the expression of a signaled locomotor action, known as signaled active avoidance. We found that modulation of GABAergic zona incerta cells, but not of cells in the adjacent thalamic reticular nucleus (NRT), fully controls the expression of signaled active avoidance responses. Inhibition of zona incerta GABAergic cells drives active avoidance responses, while excitation of these cells blocks signaled active avoidance mainly by inhibiting cells in the midbrain pedunculopontine tegmental nucleus (PPT). The zona incerta regulates signaled locomotion in the midbrain.

Effect of ischemic lesions in medial prefrontal cortex and nucleus accumbens on affective behavior in rats

Post-stroke depression (PSD) and post-stroke anxiety (PSA) are usually undertreated and many cases may remain undiagnosed, indicating a need for a better understanding of the underlying mechanisms. Current animal models of PSD and PSA using the middle cerebral artery occlusion model may be associated with motor deficits that can interfere with behavioral tests of depression- and anxiety-like behavior. Unilateral lesions of the medial prefrontal cortex (mPFC) have been reported to induce a depression- and anxiety-like phenotype in mice. The aim of this study was to examine the effects of unilateral microinjections of the vasoconstrictor endothelin-1 (ET-1) in the mPFC alone or in combination with the nucleus accumbens (NAc) on the behavior of rats after 2 and 6 weeks. Specifically, we measured anxiety- and depressive-like behavior, locomotion, and cognition. ET-1 injections in the mPFC and NAc resulted in replicable and localized lesions. Lesions to the mPFC and NAc resulted in more time spent in the open arms of the Elevated Plus Maze compared to sham-operated animals at 2 weeks post stroke, indicating decreased anxiety. This effect did not persist until 6 weeks post injection. No differences in locomotion, cognition and depressive-like behavior were found at either time point. In summary, unilateral lesions of mPFC and NAc did not produce a reliable and persistent anxiety and depression phenotype in rats.

Long-lasting neurobehavioral alterations in burn-injured mice resembling post-traumatic stress disorder in humans

OBJECTIVE

To establish an animal model for posttraumatic stress disorder in burn-injured patients.

METHODS

Thermal-injured mice with 15% total body surface area were subjected to a series of neurobehavioral tests at 1 and 3 months postburn. Brains were collected for analysis of key molecules expression, spleens for T cell function analysis, and blood for biochemistry and hormones detection.

RESULTS

Comparison with sham mice, burn mice showed extremely high locomotion in homecage, open field, and forced swimming tests, indicating a hyper-arousal state. Burn mice exhibited improved spatial memory in Morris Water Maze test and heightened context fear memory in context fear conditioning, suggesting re-experiencing behavior. Although burn mice showed pronounced passive avoidance in the step-through test, their active avoidance capability in response to the conditional stimulus in the shuttle box test was relatively deteriorated. Likewise, the retention of cue-feared memory was impaired in fear conditioning test. The above negative alterations in mood were recapitulated in open-field test, in which the burn mice displayed an anxiety-like behavior with less time spent in the center. However, no sign of depression was found in the forced swimming and sucrose preference tests. The negative mood of burn mice was reinforced by a deficit in sociality and preference for social novelty in social interaction test. These neurobehavioral alterations were associated with an increased expression of brain-derived neurotrophic factor along with a remarkable microgliosis and a moderate astrocytosis in the brain of burn vs. sham mice. Moreover, a prominent Th2 switch and consequent increased nuclear NF-κB translocation were seen in the splenic T cells from burn relative to sham mice.

CONCLUSIONS

We conclude that even mild burn injury could lead to long-lasting cognitive and effective alterations in mice. These findings shed light on the interactions among neuropsychology, neurobiology, and immunology throughout the recovery period of burn injury.

Circuits That Mediate Expression of Signaled Active Avoidance Converge in the Pedunculopontine Tegmentum

An innocuous sensory stimulus that reliably signals an upcoming aversive event can be conditioned to elicit locomotion to a safe location before the aversive outcome ensues. The neural circuits that mediate the expression of this signaled locomotor action, known as signaled active avoidance, have not been identified. While exploring sensorimotor midbrain circuits in mice of either sex, we found that excitation of GABAergic cells in the substantia nigra pars reticulata blocks signaled active avoidance by inhibiting cells in the pedunculopontine tegmental nucleus (PPT), not by inhibiting cells in the superior colliculus or thalamus. Direct inhibition of putative-glutamatergic PPT cells, excitation of GABAergic PPT cells, or excitation of GABAergic afferents in PPT, abolish signaled active avoidance. Conversely, excitation of putative-glutamatergic PPT cells, or inhibition of GABAergic PPT cells, can be tuned to drive avoidance responses. The PPT is an essential junction for the expression of signaled active avoidance gated by nigral and other synaptic afferents.SIGNIFICANCE STATEMENT When a harmful situation is signaled by a sensory stimulus (e.g., street light), subjects typically learn to respond with active or passive avoidance responses that circumvent the threat. During signaled active avoidance behavior, subjects move away to avoid a threat signaled by a preceding innocuous stimulus. We identified a part of the midbrain essential to process the signal and avoid the threat. Inhibition of neurons in this area eliminates avoidance responses to the signal but preserves escape responses caused by presentation of the threat. The results highlight an essential part of the neural circuits that mediate signaled active avoidance behavior.

Pavlovian-instrumental interactions in active avoidance: The bark of neutral trials

In active avoidance tasks, subjects have to learn to execute particular actions in order to avoid an aversive stimulus, such as a shock. Such paradigms pose a number of psychological and neural enigmas, and so have attracted substantial computational interest. However, the ratio of conjecture to confirmation remains high. Here, we perform a theoretical inquiry into a recent experiment by Gentry, Lee, and Roesch ('Phasic dopamine release in the rat nucleus accumbens predicts approach and avoidance performance', Nat. Commun., 7:13154) who measured phasic dopamine concentrations in the nucleus accumbens core of rats whilst they avoided shocks, acquired food, or acted to gain no programmed outcome. These last, neutral, trials turned out to be a perfect probe for the workings of avoidance, partly because of the substantial differences between subjects and sessions revealed in the experiment. We suggest a way to interpret this probe, gaining support for opponency-, safety-, and Pavlovian-influenced treatments of avoidance.

Contributions of medial prefrontal cortex to decision making involving risk of punishment

The prefrontal cortex (PFC) plays an important role in several forms of cost-benefit decision making. Its contributions to decision making under risk of explicit punishment, however, are not well understood. A rat model was used to investigate the role of the medial PFC (mPFC) and its monoaminergic innervation in a Risky Decision-making Task (RDT), in which rats chose between a small, "safe" food reward and a large, "risky" food reward accompanied by varying probabilities of mild footshock punishment. Inactivation of mPFC increased choice of the large, risky reward when the punishment probability increased across the session ("ascending RDT"), but decreased choice of the large, risky reward when the punishment probability decreased across the session ("descending RDT"). In contrast, enhancement of monoamine availability via intra-mPFC amphetamine reduced choice of the large, risky reward only in the descending RDT. Systemic administration of amphetamine reduced choice of the large, risky reward in both the ascending and descending RDT; however, this reduction was not attenuated by concurrent mPFC inactivation, indicating that mPFC is not a critical locus of amphetamine's effects on risk taking. These findings suggest that mPFC plays an important role in adapting choice behavior in response to shifting risk contingencies, but not necessarily in risk-taking behavior per se.

Caudal Nucleus Accumbens Core Is Critical in the Regulation of Cue-Elicited Approach-Avoidance Decisions

The nucleus accumbens (NAc) is thought to be a site of integration of positively and negatively valenced information and action selection. Functional differentiation in valence processing has previously been found along the rostrocaudal axis of the shell region of the NAc in assessments of unconditioned motivation. Given that the core region of the NAc has been implicated in the elicitation of motivated behavior in response to conditioned cues, we sought to assess the role of caudal, intermediate, and rostral sites within this subregion in cue-elicited approach-avoidance decisions. Rats were trained to associate visuo-tactile cues with appetitive, aversive, and neutral outcomes. Following the successful acquisition of the cue-outcome associations, rats received microinfusions of GABA_A and GABA_B receptor agonists (muscimol/baclofen) or saline into the caudal, intermediate, or rostral NAc core and were then exposed to a superimposition of appetitively and aversively valenced cues versus neutral cues in a “conflict test,” as well as to the appetitive versus neutral cues, and aversive cues versus neutral cues, in separate conditioned preference/avoidance tests. Disruption of activity in the intermediate to caudal parts of the NAc core resulted in a robust avoidance bias in response to motivationally conflicting cues, as well as a potentiated avoidance of aversive cues as compared with control animals, coupled with an attenuated conditioned preference for the appetitive cue. These results suggest that the caudal NAc core may have the capacity to exert bidirectional control over appetitively and aversively motivated responses to valence signals.

The birth, death and resurrection of avoidance: a reconceptualization of a troubled paradigm

Research on avoidance conditioning began in the late 1930s as a way to use laboratory experiments to better understand uncontrollable fear and anxiety. Avoidance was initially conceived of as a two-factor learning process in which fear is first acquired through Pavlovian aversive conditioning (so-called fear conditioning), and then behaviors that reduce the fear aroused by the Pavlovian conditioned stimulus are reinforced through instrumental conditioning. Over the years, criticisms of both the avoidance paradigm and the two-factor fear theory arose. By the mid-1980s, avoidance had fallen out of favor as an experimental model relevant to fear and anxiety. However, recent progress in understanding the neural basis of Pavlovian conditioning has stimulated a new wave of research on avoidance. This new work has fostered new insights into contributions of not only Pavlovian and instrumental learning but also habit learning, to avoidance, and has suggested that the reinforcing event underlying the instrumental phase should be conceived in terms of cellular and molecular events in specific circuits rather than in terms of vague notions of fear reduction. In our approach, defensive reactions (freezing), actions (avoidance) and habits (habitual avoidance) are viewed as being controlled by unique circuits that operate nonconsciously in the control of behavior, and that are distinct from the circuits that give rise to conscious feelings of fear and anxiety. These refinements, we suggest, overcome older criticisms, justifying the value of the new wave of research on avoidance, and offering a fresh perspective on the clinical implications of this work.

Persistent active avoidance correlates with activity in prelimbic cortex and ventral striatum

Persistent avoidance is a prominent symptom of anxiety disorders and is often resistant to extinction-based therapies. Little is known about the circuitry mediating persistent avoidance. Using a recently described platform-mediated active avoidance task, we assessed activity in several structures with c-Fos immuno-labeling. In Task 1, rats were conditioned to avoid a tone-signaled shock by moving to a safe platform, and then were extinguished over two days. One day later, failure to retrieve extinction correlated with increased activity in the prelimbic prefrontal cortex (PL), ventral striatum (VS), and basal amygdala (BA), and decreased activity in infralimbic prefrontal cortex (IL), consistent with pharmacological inactivation studies. In Task 2, the platform was removed during extinction training and fear (suppression of bar pressing) was extinguished to criterion over 3–5 days. The platform was then returned in a post-extinction test. Under these conditions, avoidance levels were equivalent to Experiment 1 and correlated with increased activity in PL and VS, but there was no correlation with activity in IL or BA. Thus, persistent avoidance can occur independently of deficits in fear extinction and its associated structures.

From ventral-medial to dorsal-lateral striatum: neural correlates of reward-guided decision-making

The striatum is critical for reward-guided and habitual behavior. Anatomical and interference studies suggest a functional heterogeneity within striatum. Medial regions, such as nucleus accumbens core and dorsal medial striatum play roles in goal-directed behavior, while dorsal lateral striatum is critical for control of habitual action. Subdivisions of striatum are topographically connected with different cortical and subcortical structures forming channels that carry information related to limbic, associative, and sensorimotor functions. Here, we describe data showing that as one progresses from ventral-medial to dorsal-lateral striatum, there is a shift from more prominent value encoding to activity more closely related to associative and motor aspects of decision-making. In addition, we will describe data suggesting that striatal circuits work in parallel to control behavior and that regions within striatum can compensate for each other when functions are disrupted.

Neurophysiology of Reward-Guided Behavior: Correlates Related to Predictions, Value, Motivation, Errors, Attention, and Action

Many brain areas are activated by the possibility and receipt of reward. Are all of these brain areas reporting the same information about reward? Or are these signals related to other functions that accompany reward-guided learning and decision-making? Through carefully controlled behavioral studies, it has been shown that reward-related activity can represent reward expectations related to future outcomes, errors in those expectations, motivation, and signals related to goal- and habit-driven behaviors. These dissociations have been accomplished by manipulating the predictability of positively and negatively valued events. Here, we review single neuron recordings in behaving animals that have addressed this issue. We describe data showing that several brain areas, including orbitofrontal cortex, anterior cingulate, and basolateral amygdala signal reward prediction. In addition, anterior cingulate, basolateral amygdala, and dopamine neurons also signal errors in reward prediction, but in different ways. For these areas, we will describe how unexpected manipulations of positive and negative value can dissociate signed from unsigned reward prediction errors. All of these signals feed into striatum to modify signals that motivate behavior in ventral striatum and guide responding via associative encoding in dorsolateral striatum.