Early adversity disrupts the adult use of aversive prediction errors to reduce fear in uncertainty

A fear conditioned cue orchestrates a suite of behaviors in rats

Pavlovian fear conditioning has been extensively used to study the behavioral and neural basis of defensive systems. In a typical procedure, a cue is paired with foot shock, and subsequent cue presentation elicits freezing, a behavior theoretically linked to predator detection. Studies have since shown a fear conditioned cue can elicit locomotion, a behavior that - in addition to jumping, and rearing - is theoretically linked to imminent or occurring predation. A criticism of studies observing fear conditioned cue-elicited locomotion is that responding is non-associative. We gave rats Pavlovian fear discrimination over a baseline of reward seeking. TTL-triggered cameras captured 5 behavior frames/s around cue presentation. Experiment 1 examined the emergence of danger-specific behaviors over fear acquisition. Experiment 2 examined the expression of danger-specific behaviors in fear extinction. In total, we scored 112,000 frames for nine discrete behavior categories. Temporal ethograms show that during acquisition, a fear conditioned cue suppresses reward seeking and elicits freezing, but also elicits locomotion, jumping, and rearing - all of which are maximal when foot shock is imminent. During extinction, a fear conditioned cue most prominently suppresses reward seeking, and elicits locomotion that is timed to shock delivery. The independent expression of these behaviors in both experiments reveals a fear conditioned cue to orchestrate a temporally organized suite of behaviors.

A unidirectional but not uniform striatal landscape of dopamine signaling for motivational stimuli

SignificanceAlthough it is undisputed that striatal dopamine plays a prominent role in motivated behavior and learning, the precise information conveyed by dopamine signals as such is under active debate. For a long time, the idea dominated that dopamine encodes a reward prediction error and that this signal is broadcast uniformly throughout the brain. However, here, we capture dopamine dynamics across many striatal regions and demonstrate that dopamine release is, regionally, extremely heterogeneous and that a reward prediction error-like signal is predominantly found in the relatively small limbic domain of the striatum. Another striking organizing principle is that stimulus valence directs dopamine concentration homogeneously across all regions (i.e., appetitive stimuli increase dopamine and aversive stimuli decrease dopamine).

Dorsal Raphe 5-HT Neurons Utilize, But Do Not Generate, Negative Aversive Prediction Errors

The dorsal raphe nucleus (DRN) contains the largest population of serotonin (5-HT) neurons in the central nervous system. 5-HT, synthesized via tryptophan hydroxylase 2 (Tph2), is a widely functioning neuromodulator implicated in fear learning. Here, we sought to investigate whether DRN 5-HT is necessary to reduce fear via negative prediction error (–PE). Using male and female TPH2-cre rats, DRN^tph2+ cells were selectively deleted via cre-caspase (rAAV5-Flex-taCasp3-TEVp) in experiment 1. Rats then underwent fear discrimination during which three cues were associated with unique foot shock probabilities: safety p = 0.00, uncertainty p = 0.375, and danger p = 1.00. Rats then received selective extinction to the uncertainty cue, a behavioral manipulation designed to probe –PE. Deleting DRN^tph2+ cells had no impact on initial discrimination but slowed selective extinction. In experiment 2, we used a within-subjects optogenetic inhibition design to causally implicate DRN^tph2+ cells in prediction error signaling. Male and female TPH2-cre rats received intra-DRN infusions of cre-dependent halorhodopsin (rAAV5-Ef1a-DIO-eNpHR3.0-eYFP) or cre-YFP. DRN^tph2+ cells were inhibited specifically during the time of prediction error or a control period. Illumination during either positive prediction error (+PE) or control periods had no impact on fear to the uncertainty cue. Inhibition of DRN^tph2+ cells at the time of –PE did not impact immediate fear, but facilitated selective extinction in postillumination sessions. Together, these results demonstrate a role for DRN^tph2+ cells in using, but not generating, –PE to weaken cue-shock associations.

Retrorubral field is a hub for diverse threat and aversive outcome signals

Adaptive fear scales to the degree of threat and requires diverse neural signals for threat and aversive outcome. We propose that the retrorubral field (RRF), a midbrain region containing A8 dopamine, is a neural origin of such signals. To reveal these signals, we recorded RRF single-unit activity while male rats discriminated danger, uncertainty, and safety. Many RRF neurons showed firing extremes to danger and safety that framed intermediate firing to uncertainty. The remaining neurons showed unique, threat-selective cue firing patterns. Diversity in firing direction, magnitude, and temporal characteristics led to the detection of at least eight functional neuron types. Neuron types defined with respect to threat showed unique firing patterns following aversive outcome. The result was RRF signals for foot shock receipt, positive prediction error, anti-positive prediction error, persistent safety, and persistent threat. The diversity of threat and aversive outcome signals points to a key role for the RRF in adaptive fear.

Foot shock facilitates reward seeking in an experience-dependent manner

Animals organize reward seeking around aversive events. An abundance of research shows that foot shock, as well as a shock-associated cue, can elicit freezing and suppress reward seeking. Yet, there is evidence that experience can flip the effect of foot shock to facilitate reward seeking. Here we examined cue suppression, foot shock suppression and foot shock facilitation of reward seeking in a single behavioural setting. Male Long Evans rats received fear discrimination consisting of danger, uncertainty, and safety cues. Discrimination took place over a baseline of rewarded nose poking. With limited experience (1-2 sessions), all cues and foot shock suppressed reward seeking. With continued experience (10-16 sessions), suppression became specific to shock-associated cues, foot shock briefly suppressed, then facilitated reward seeking. Our results provide a means of assessing positive properties of foot shock, and may provide insight into maladaptive behaviour around aversive events.

Early adolescent adversity alters periaqueductal gray/dorsal raphe threat responding in adult female rats

Early adolescent adversity increases adult risk for anxiety disorders. The ventrolateral periaqueductal gray (vlPAG) and neighboring dorsal raphe (DR) are integral to threat prediction, and are responsive to acute stressors. Here, we tested the hypothesis that early adolescent adversity reshapes vlPAG/DR threat-related cue activity and threat probability signaling. Female, Long Evans rats experienced a battery of adverse adolescent experiences (n = 12), while controls did not (n = 8). Single-unit activity was recorded 50 + days following the final adverse experience, when the adult rats received fear discrimination consisting of danger, uncertainty and safety cues. Despite achieving fear discrimination that was equivalent to controls, vlPAG/DR threat responding was altered in adverse-experienced rats. Early adolescent adversity resulted in a greater proportion of cue-responsive neurons. Cue-excited neurons showed greater increases in firing and cue-inhibited neurons showed greater decreases. Even more, early adversity reduced flexible, threat probability signaling by cue-excited neurons and promoted more rigid, fear output signaling by cue-inhibited neurons. The results reveal long-lasting changes in vlPAG/DR threat responding resulting from early adolescent adversity.

Anterior Cingulate Cortex Signals Attention in a Social Paradigm that Manipulates Reward and Shock

The ability to recognize emotions in others and adapt one's behavior accordingly is critical for functioning in any social context. This ability is impaired in several psychiatric disorders, such as autism and psychopathy. Recent work has identified the anterior cingulate cortex (ACC) among other brain regions involved in this process. Neural recording studies have shown that neurons in ACC are modulated by reward or shock when delivered to a conspecific and when experienced first-hand. Because previous studies do not vary reward and shock within the same experiment, it has been unclear whether the observed activity reflects how much attention is being paid to outcomes delivered to a conspecific or the valence associated with those stimuli. To address this issue, we recorded from ACC as rats performed a Pavlovian task that predicted whether reward, shock, or nothing would be delivered to the rat being recorded from or a conspecific located in the opposite chamber. Consistent with previous reports, we found that the firing of ACC neurons was modulated by aversive stimuli delivered to the recording rat and their conspecific. Activity of some of these neurons genuinely reflected outcome identity (i.e., reward or shock); however, the population of neurons as a whole responded similarly for both reward and shock, as well as for cues that predicted their occurrence (i.e., reward > neutral and shock > neutral; attention). These results suggest that ACC can process information about outcomes (i.e., identity and recipient) in the service of promoting attention in some social contexts.

The Nucleus Accumbens Core is Necessary to Scale Fear to Degree of Threat

Fear is adaptive when the level of the response rapidly scales to degree of threat. Using a discrimination procedure consisting of danger, uncertainty, and safety cues, we have found rapid fear scaling (within 2 s of cue presentation) in male rats. Here, we examined a possible role for the nucleus accumbens core (NAcc) in the acquisition and expression of fear scaling. In experiment 1, male Long-Evans rats received bilateral sham or neurotoxic NAcc lesions, recovered, and underwent fear discrimination. NAcc-lesioned rats were generally impaired in scaling fear to degree of threat, and specifically impaired in rapid uncertainty-safety discrimination. In experiment 2, male Long-Evans rats received NAcc transduction with halorhodopsin (Halo) or a control fluorophore. After fear scaling was established, the NAcc was illuminated during cue or control periods. NAcc-Halo rats receiving cue illumination were specifically impaired in rapid uncertainty-safety discrimination. The results reveal a general role for the NAcc in scaling fear to degree of threat, and a specific role in rapid discrimination of uncertain threat and safety.SIGNIFICANCE STATEMENT Rapidly discriminating cues for threat and safety is essential for survival and impaired threat-safety discrimination is a hallmark of stress and anxiety disorders. In two experiments, we induced nucleus accumbens core (NAcc) dysfunction in rats receiving fear discrimination consisting of cues for danger, uncertainty, and safety. Permanent NAcc dysfunction, via neurotoxic lesion, generally disrupted the ability to scale fear to degree of threat, and specifically impaired one component of scaling: rapid discrimination of uncertain threat and safety. Reversible NAcc dysfunction, via optogenetic inhibition, specifically impaired rapid discrimination of uncertain threat and safety. The results reveal that the NAcc is essential to scale fear to degree of threat, and is a plausible source of dysfunction in stress and anxiety disorders.

Cue-inhibited ventrolateral periaqueductal gray neurons signal fear output and threat probability in male rats

The ventrolateral periaqueductal gray (vlPAG) is proposed to mediate fear responses to imminent danger. Previously we reported that vlPAG neurons showing short-latency increases in firing to a danger cue - the presumed neural substrate for fear output - signal threat probability in male rats (Wright et al., 2019). Here, we scrutinize the activity vlPAG neurons that decrease firing to danger. One cue-inhibited population flipped danger activity from early inhibition to late excitation: a poor neural substrate for fear output, but a better substrate for threat timing. A second population showed differential firing with greatest inhibition to danger, less to uncertainty and no inhibition to safety. The pattern of differential firing reflected the pattern of fear output, and was observed throughout cue presentation. The results reveal an expected vlPAG signal for fear output in an unexpected, cue-inhibited population.

The ventrolateral periaqueductal grey updates fear via positive prediction error

Aversive, positive prediction error (+PE) provides a mechanism to update and increase future fear to uncertain threat predictors. The ventrolateral periaqueductal grey (vlPAG) has been offered as a neural locus for +PE computation. Yet, a causal demonstration of vlPAG +PE activity to update fear remains elusive. We devised a fear discrimination procedure in which a danger cue predicts shock deterministically and an uncertainty cue predicts shock probabilistically, requiring prediction errors to achieve an appropriate fear response. Recording vlPAG single-unit activity during fear discrimination in Long-Evans rats, we reveal activity related to shock is consistent with +PE and updates subsequent fear to uncertainty at the trial level. We further demonstrate that vlPAG inhibition during shock selectively decreases future fear to uncertainty, but not danger, and temporal emergence of this effect is consistent with single-unit activity. These findings provide causal evidence that vlPAG +PE is necessary for fear updating.

Individual differences in voluntary alcohol consumption are associated with conditioned fear in the fear incubation model

Previous research in male Long Evans rats has shown a relationship between low voluntary alcohol consumption and high conditioned fear after a single training session. Here, we determined whether chronic intermittent access (CIA) to alcohol during adolescence/early adulthood or during adulthood would alter or be associated with auditory-cued conditioned fear levels using an extended training fear incubation procedure. This training procedure leads to low fear soon after training that grows over one month. Rats received 6 weeks of CIA to 20% alcohol or water from PND 26-66. Ten or eleven days later, the rats began behavioral testing that included 10 sessions of tone-shock pairings. Rats then received 4 weeks of CIA exposure during the 1-month fear incubation period and were tested for conditioned fear 6 days after the end of alcohol access. We found no evidence that voluntary alcohol consumption during adolescence/early adulthood or adulthood altered fear expression. However, we found that rats that consumed more alcohol during early adulthood (PND 54-66) had lower fear than low-consumption rats on day 1 of conditioned fear training and in the day 2 and 1-month tests. This extends associations we previously found between individual differences in alcohol consumption and conditioned fear to a different fear conditioning procedure. Combined with our previous data that show that the rate of instrumental extinction is associated with both alcohol consumption and conditioned fear, these data provide further support for the generality and reliability of a pair of phenotypes that encompass a wide variety of learning traits.

Ventrolateral periaqueductal gray neurons prioritize threat probability over fear output

Faced with potential harm, individuals must estimate the probability of threat and initiate an appropriate fear response. In the prevailing view, threat probability estimates are relayed to the ventrolateral periaqueductal gray (vlPAG) to organize fear output. A straightforward prediction is that vlPAG single-unit activity reflects fear output, invariant of threat probability. We recorded vlPAG single-unit activity in male, Long Evans rats undergoing fear discrimination. Three 10 s auditory cues predicted unique foot shock probabilities: danger (p=1.00), uncertainty (p=0.375) and safety (p=0.00). Fear output was measured by suppression of reward seeking over the entire cue and in one-second cue intervals. Cued fear non-linearly scaled to threat probability and cue-responsive vlPAG single-units scaled their firing on one of two timescales: at onset or ramping toward shock delivery. VlPAG onset activity reflected threat probability, invariant of fear output, while ramping activity reflected both signals with threat probability prioritized.

Early adolescent adversity inflates threat estimation in females and promotes alcohol use initiation in both sexes

Childhood adversity is associated with exaggerated threat processing and earlier alcohol use initiation. Conclusive links remain elusive, as childhood adversity typically co-occurs with detrimental socioeconomic factors, and its impact is likely moderated by biological sex. To unravel the complex relationships among childhood adversity, sex, threat estimation, and alcohol use initiation, we exposed female and male Long-Evans rats to early adolescent adversity (EAA). In adulthood, >50 days following the last adverse experience, threat estimation was assessed using a novel fear discrimination procedure in which cues predict a unique probability of footshock: danger (p = 1.00), uncertainty (p = .25), and safety (p = .00). Alcohol use initiation was assessed using voluntary access to 20% ethanol, >90 days following the last adverse experience. During development, EAA slowed body weight gain in both females and males. In adulthood, EAA selectively inflated female threat estimation, exaggerating fear to uncertainty and safety, but promoted alcohol use initiation across sexes. Meaningful relationships between threat estimation and alcohol use initiation were not observed, underscoring the independent effects of EAA. Results isolate the contribution of EAA to adult threat estimation, alcohol use initiation, and reveal moderation by biological sex. (PsycINFO Database Record

Lateral orbitofrontal cortex partitions mechanisms for fear regulation and alcohol consumption

Anxiety disorders and alcohol use disorder are highly comorbid, yet identifying neural dysfunction driving comorbidity has been challenging. Lateral orbitofrontal cortex (lOFC) dysfunction has been independently observed in each disorder. Here we tested the hypothesis that the lOFC is essential to partition mechanisms for fear regulation and alcohol consumption. Specifically, the capacity to regulate fear and the propensity to consume alcohol are unrelated when lOFC is intact, but become linked through lOFC dysfunction. Male Long Evans rats received bilateral, neurotoxic lOFC lesions or sham surgery. Fear regulation was determined by establishing discrimination to danger, uncertainty, and safety cues then shifting the shock probability of the uncertainty cue. Alcohol consumption was assessed through voluntary, intermittent access to 20% ethanol. The neurotoxic lesion approach ensured lOFC dysfunction spanned testing in fear regulation and alcohol consumption. LOFC-lesioned rats demonstrated maladaptive fear generalization during probability shifts, inverting normal prediction error assignment, and subsequently consumed more alcohol. Most novel, fear regulation and alcohol consumption were inextricably linked only in lOFC-lesioned rats: extreme fear regulation predicted excessive alcohol consumption. The results reveal the lOFC is essential to partition mechanisms for fear regulation and alcohol consumption and uncover a plausible source of neural dysfunction contributing to comorbid anxiety disorders and alcohol use disorder.

Alcohol, psychomotor-stimulants and behaviour: methodological considerations in preclinical models of early-life stress

BACKGROUND

In order to assess the risk associated with early-life stress, there has been an increase in the amount of preclinical studies investigating early-life stress. There are many challenges associated with investigating early-life stress in animal models and ensuring that such models are appropriate and clinically relevant.

OBJECTIVES

The purpose of this review is to highlight the methodological considerations in the design of preclinical studies investigating the effects of early-life stress on alcohol and psychomotor-stimulant intake and behaviour.

METHODS

The protocols employed for exploring early-life stress were investigated and summarised. Experimental variables include animals, stress models, and endpoints employed.

RESULTS

The findings in this paper suggest that there is little consistency among these studies and so the interpretation of these results may not be as clinically relevant as previously thought.

CONCLUSION

The standardisation of these simple stress procedures means that results will be more comparable between studies and that results generated will give us a more robust understanding of what can and may be happening in the human and veterinary clinic.

Inactivation of the Ventrolateral Orbitofrontal Cortex Impairs Flexible Use of Safety Signals

Survival depends on adaptation to shifting environmental risks and opportunities. Regarding risks, the mechanisms which permit acquisition, recall, and flexible use of aversive associations is poorly understood. Drawing on the evidence that the orbital frontal cortex is critical to integrating outcome expectancies with flexible appetitive behavioral responses, we hypothesized that OFC would contribute to behavioral flexibility within an aversive learning domain. We introduce a fear conditioning procedure in which adult male rats were presented with shock-paired conditioned stimulus (CS+) or a safety cue (CS-). In a recall test, rats exhibit greater freezing to the CS+ than the CS-. Temporary inactivation of the ventrolateral OFC with muscimol prior to conditioning did not affect later discrimination, but inactivation after learning and prior to recall impaired discrimination between safety and danger cues. This result complements prior research in the appetitive domain and suggests that the OFC plays a general role in behavioral flexibility regardless of the valence of the CS.

Translational relevance of rodent models of hypothalamic-pituitary-adrenal function and stressors in adolescence

Elevations in glucocorticoids that result from environmental stressors can have programming effects on brain structure and function when the exposure occurs during sensitive periods that involve heightened neural development. In recent years, adolescence has gained increasing attention as another sensitive period of development, a period in which pubertal transitions may increase the vulnerability to stressors. There are similarities in physical and behavioural development between humans and rats, and rats have been used effectively as an animal model of adolescence and the unique plasticity of this period of ontogeny. This review focuses on benefits and challenges of rats as a model for translational research on hypothalamic-pituitary-adrenal (HPA) function and stressors in adolescence, highlighting important parallels and contrasts between adolescent rats and humans, and we review the main stress procedures that are used in investigating HPA stress responses and their consequences in adolescence in rats. We conclude that a greater focus on timing of puberty as a factor in research in adolescent rats may increase the translational relevance of the findings.

Adolescent transitions in reflexive and non-reflexive behavior: Review of fear conditioning and impulse control in rodent models

Adolescence is a time of critical brain changes that pave the way for adult learning processes. However, the extent to which learning in adolescence is best characterized as a transitional linear progression from childhood to adulthood, or represents a period that differs from earlier and later developmental stages, remains unclear. Here we examine behavioral literature on associative fear conditioning and complex choice behavior with rodent models. Many aspects of fear conditioning are intact by adolescence and do not differ from adult patterns. Sufficient evidence, however, suggests that adolescent learning cannot be characterized simply as an immature precursor to adulthood. Across different paradigms assessing choice behavior, literature suggests that adolescent animals typically display more impulsive patterns of responding compared to adults. The extent to which the development of basic conditioning processes serves as a scaffold for later adult decision making is an additional research area that is important for theory, but also has widespread applications for numerous psychological conditions.

Subsecond fear discrimination in rats: adult impairment in adolescent heavy alcohol drinkers

Discriminating safety from danger must be accurate and rapid. Yet, the rapidity with which fear discrimination emerges remains unknown. Rapid fear discrimination in adulthood may be susceptible to impairment by adolescent heavy alcohol drinking, which increases incidence of anxiety disorders. Rats were given voluntary, adolescent alcohol access, and heavy drinkers were identified. In adulthood, rapid fear discrimination of safety, uncertainty, and danger cues was assessed. Normal rats, but not heavy drinkers, showed discriminative fear <1 sec following cue onset. This provides the first demonstration of subsecond fear discrimination and its adult impairment in adolescent heavy alcohol drinkers.