Neural correlates of appetitive-aversive interactions in Pavlovian fear conditioning

Paraventricular thalamus to nucleus accumbens circuit activation decreases long-term relapse of alcohol-seeking behaviour in male mice

BACKGROUND

Some studies have highlighted the crucial role of aversion in addiction treatment. The pathway from the anterior paraventricular thalamus (PVT) to the shell of the nucleus accumbens (NAc) has been reported as an essential regulatory pathway for processing aversion and is also closely associated with substance addiction. However, its impact on alcohol addiction has been relatively underexplored. Therefore, this study focused on the role of the PVT-NAc pathway in the formation and relapse of alcohol addiction-like behaviour, offering a new perspective on the mechanisms of alcohol addiction.

RESULTS

The chemogenetic inhibition of the PVT-NAc pathway in male mice resulted in a notable decrease in the establishment of ethanol-induced conditioned place aversion (CPA), and NAc-projecting PVT neurons were recruited due to aversive effects. Conversely, activation of the PVT-NAc pathway considerably impeded the formation of ethanol-induced conditioned place preference (CPP). Furthermore, during the memory reconsolidation phase, activation of this pathway effectively disrupted the animals' preference for alcohol-associated contexts. Whether it was administered urgently 24 h later or after a long-term withdrawal of 10 days, a low dose of alcohol could still not induce the reinstatement of ethanol-induced CPP.

CONCLUSIONS

Our results demonstrated PVT-NAc circuit processing aversion, which may be one of the neurobiological mechanisms underlying aversive counterconditioning, and highlighted potential targets for inhibiting the development of alcohol addiction-like behaviour and relapse after long-term withdrawal.

Modulation of aversive value coding in the vertebrate and invertebrate brain

Avoiding potentially dangerous situations is key for the survival of any organism. Throughout life, animals learn to avoid environments, stimuli or actions that can lead to bodily harm. While the neural bases for appetitive learning, evaluation and value-based decision-making have received much attention, recent studies have revealed more complex computations for aversive signals during learning and decision-making than previously thought. Furthermore, previous experience, internal state and systems level appetitive-aversive interactions seem crucial for learning specific aversive value signals and making appropriate choices. The emergence of novel methodologies (computation analysis coupled with large-scale neuronal recordings, neuronal manipulations at unprecedented resolution offered by genetics, viral strategies and connectomics) has helped to provide novel circuit-based models for aversive (and appetitive) valuation. In this review, we focus on recent vertebrate and invertebrate studies yielding strong evidence that aversive value information can be computed by a multitude of interacting brain regions, and that past experience can modulate future aversive learning and therefore influence value-based decisions.

Aversive motivation and cognitive control

Aversive motivation plays a prominent role in driving individuals to exert cognitive control. However, the complexity of behavioral responses attributed to aversive incentives creates significant challenges for developing a clear understanding of the neural mechanisms of this motivation-control interaction. We review the animal learning, systems neuroscience, and computational literatures to highlight the importance of experimental paradigms that incorporate both motivational context manipulations and mixed motivational components (e.g., bundling of appetitive and aversive incentives). Specifically, we postulate that to understand aversive incentive effects on cognitive control allocation, a critical contextual factor is whether such incentives are associated with negative reinforcement or punishment. We further illustrate how the inclusion of mixed motivational components in experimental paradigms enables increased precision in the measurement of aversive influences on cognitive control. A sharpened experimental and theoretical focus regarding the manipulation and assessment of distinct motivational dimensions promises to advance understanding of the neural, monoaminergic, and computational mechanisms that underlie the interaction of motivation and cognitive control.

Behavior and Fos activation reveal that male and female rats differentially assess affective valence during CTA learning and expression

Females are more affected by psychiatric illnesses including eating disorders, depression, and post-traumatic stress disorder than males. However, the neural mechanisms mediating these sex differences are poorly understood. Animal models can be useful in exploring such neural mechanisms. Conditioned taste aversion (CTA) is a behavioral task that assesses how animals process the competition between associated reinforcing and aversive stimuli in subsequent task performance, a process critical to healthy behavior in many domains. The purpose of the present study was to identify sex differences in this behavior and associated neural responses. We hypothesized that females would value the rewarding stimulus (Boost®) relative to the aversive stimulus (LiCl) more than males in performing CTA. We evaluated behavior (Boost® intake, LiCl-induced behaviors, ultrasonic vocalizations (USVs), CTA performance) and Fos activation in relevant brain regions after the acute stimuli [acute Boost® (AB), acute LiCl (AL)] and the context-only task control (COT), Boost® only task (BOT) and Boost®-LiCl task (BLT). Acutely, females drank more Boost® than males but showed similar aversive behaviors after LiCl. Females and males performed CTA similarly. Both sexes produced 55 kHz USVs anticipating BOT and inhibited these calls in the BLT. However, more females emitted both 22 kHz and 55 kHz USVs in the BLT than males: the latter correlated with less CTA. Estrous cycle stage also influenced 55 kHz USVs. Fos responses were similar in males and females after AB or AL. Females engaged the gustatory cortex and ventral tegmental area (VTA) more than males during the BOT and males engaged the amygdala more than females in both the BOT and BLT. Network analysis of correlated Fos responses across brain regions identified two unique networks characterizing the BOT and BLT, in both of which the VTA played a central role. In situ hybridization with RNAscope identified a population of D1-receptor expressing cells in the CeA that responded to Boost® and D2 receptor-expressing cells that responded to LiCl. The present study suggests that males and females differentially process the affective valence of a stimulus to produce the same goal-directed behavior.

Establishment and evaluation of a compound fear behavior model of Tourette's syndrome in rats

Background

Tourette syndrome (TS) is a common childhood disorder characterized by unwanted movements or vocal sounds called tics. It is often accompanied by other psychobehavioral disorders, including fearful behavior. The establishment and evaluation of rat models of TS and comorbid fear can provide an experimental basis for the treatment of TS and its comorbid fear disorder.

Methods

Sixteen rats were randomly divided into a model group (n=8) and control group (n=8). In the model group, rats were injected intraperitoneally with iminodipropionitrile (IDPN) for 1 week to establish the TS model, which was followed by acoustic and electrical stimulation for 3 weeks to establish the rat models of TS and comorbid fear. The control group received intraperitoneal injection of saline for 1 week, and no further intervention was given in the last 3 weeks. The behavioral changes of the rats were observed and analyzed by the open field test (OFT). Protein kinase A (PKA), cyclic adenosine monophosphate (cAMP), and dopamine (DA) were measured by enzyme-linked immunosorbent assay (ELISA), and tyrosine hydroxylase (TH) and microRNA-134 (miRNA-134) in the brain tissue were detected by using polymerase chain reaction (PCR).

Results

One rat in the model group died on the 24th day. Compared with the control group, the model group had significantly higher scores of locomotor activity, stereotyped behavior, and motor behavior, along with prolonged freezing time and significantly lower expression of miRNA-134. The differences in the expressions of PKA, cAMP, DA, and TH in brain tissue were not statistically significant.

Conclusions

The rat models of TS and comorbid fear have similar changes in behaviors and miRNA-134 level to those in clinical settings and therefore can be used as a reliable animal model to study the mechanism of action of TS and comorbid fear.

Mindfulness and Behavior Change

Initiating and maintaining behavior change is key to the prevention and treatment of most preventable chronic medical and psychiatric illnesses. The cultivation of mindfulness, involving acceptance and nonjudgment of present-moment experience, often results in transformative health behavior change. Neural systems involved in motivation and learning have an important role to play. A theoretical model of mindfulness that integrates these mechanisms with the cognitive, emotional, and self-related processes commonly described, while applying an integrated model to health behavior change, is needed. This integrative review (1) defines mindfulness and describes the mindfulness-based intervention movement, (2) synthesizes the neuroscience of mindfulness and integrates motivation and learning mechanisms within a mindful self-regulation model for understanding the complex effects of mindfulness on behavior change, and (3) synthesizes current clinical research evaluating the effects of mindfulness-based interventions targeting health behaviors relevant to psychiatric care. The review provides insight into the limitations of current research and proposes potential mechanisms to be tested in future research and targeted in clinical practice to enhance the impact of mindfulness on behavior change.

Motivational competition and the paraventricular thalamus

Although significant progress has been made in understanding the behavioral and brain mechanisms for motivational systems, much less is known about competition between motivational states or motivational conflict (e.g., approach - avoidance conflict). Despite being produced under diverse conditions, behavior during motivational competition has two signatures: bistability and metastability. These signatures reveal the operation of positive feedback mechanisms in behavioral selection. Different neuronal architectures can instantiate this selection to achieve bistability and metastability in behavior, but each relies on circuit-level inhibition to achieve rapid and stable selection between competing tendencies. Paraventricular thalamus (PVT) is identified as critical to this circuit level inhibition, resolving motivational competition via its extensive projections to local inhibitory networks in the ventral striatum and extended amygdala, enabling adaptive responding under motivational conflict.

Neutral Sphingomyelinase is an Affective Valence-Dependent Regulator of Learning and Memory

Sphingolipids and enzymes of the sphingolipid rheostat determine synaptic appearance and signaling in the brain, but sphingolipid contribution to normal behavioral plasticity is little understood. Here we asked how the sphingolipid rheostat contributes to learning and memory of various dimensions. We investigated the role of these lipids in the mechanisms of two different types of memory, such as appetitively and aversively motivated memory, which are considered to be mediated by different neural mechanisms. We found an association between superior performance in short- and long-term appetitively motivated learning and regionally enhanced neutral sphingomyelinase (NSM) activity. An opposite interaction was observed in an aversively motivated task. A valence-dissociating role of NSM in learning was confirmed in mice with genetically reduced NSM activity. This role may be mediated by the NSM control of N-methyl-d-aspartate receptor subunit expression. In a translational approach, we confirmed a positive association of serum NSM activity with long-term appetitively motivated memory in nonhuman primates and in healthy humans. Altogether, these data suggest a new sphingolipid mechanism of de-novo learning and memory, which is based on NSM activity.

Valence of social information is encoded in different subpopulations of mushroom body Kenyon cells in the honeybee brain

Over 600 Myr of evolutionary divergence between vertebrates and invertebrates is associated with considerable neuroanatomical variation both across and within these lineages. By contrast, valence encoding is an important behavioural trait that is evolutionarily conserved across vertebrates and invertebrates, and enables individuals to distinguish between positive (potentially beneficial) and negative (potentially harmful) situations. We tested the hypothesis that social interactions of positive and negative valence are modularly encoded in the honeybee brain (i.e. encoded in different cellular subpopulations) as in vertebrate brains. In vertebrates, neural activation patterns are distributed across distinct parts of the brain, suggesting that discrete circuits encode positive or negative stimuli. Evidence for this hypothesis would suggest a deep homology of neural organization between insects and vertebrates for valence encoding, despite vastly different brain sizes. Alternatively, overlapping localization of valenced social information in the brain would imply a 're-use' of circuitry in response to positive and negative social contexts, potentially to overcome the energetic constraints of a tiny brain. We used immediate early gene expression to map positively and negatively valenced social interactions in the brain of the western honeybee Apis mellifera. We found that the valence of a social signal is represented by distinct anatomical subregions of the mushroom bodies, an invertebrate sensory neuropil associated with social behaviour, multimodal sensory integration, learning and memory. Our results suggest that the modularization of valenced social information in the brain is a fundamental property of neuroanatomical organization.

Reward anticipation and punishment anticipation are instantiated in the brain via opponent mechanisms

fMRI investigations have examined the extent to which reward and punishment motivation are associated with common or opponent neural systems, but such investigations have been limited by confounding variables and methodological constraints. The present study aimed to address limitations of earlier approaches and more comprehensively evaluate the extent to which neural activation associated with reward and punishment motivation reflects opponent or shared systems. Participants completed a modified monetary incentive delay task, which involved the presentation of a cue followed by a target to which participants were required to make a speeded button press. Using a factorial design, cues indicated whether monetary reward and/or loss (i.e., cues signaled probability of reward, punishment, both, or neither) could be expected depending upon response speed. Neural analyses evaluated evidence of (a) directionally opposing effects by testing for regions of differential activation for reward and punishment anticipation, (b) mutual inhibition by testing for interactive effects of reward and punishment anticipation within a factorial design, and (c) opposing effects on shared outputs via a psychophysiological interaction analysis. Evidence supporting all three criteria for opponent systems was obtained. Collectively, present findings support conceptualizing reward and punishment motivation as opponent forces influencing brain and behavior and indicate that shared activation does not suggest the operation of a common neural mechanism instantiating reward and punishment motivation.

Paraventricular Thalamus Controls Behavior during Motivational Conflict

Decision-making often involves motivational conflict because of the competing demands of approach and avoidance for a common resource: behavior. This conflict must be resolved as a necessary precursor for adaptive behavior. Here we show a role for the paraventricular thalamus (PVT) in behavioral control during motivational conflict. We used Pavlovian counterconditioning in male rats to establish a conditioned stimulus (CS) as a signal for reward (or danger) and then transformed the same CS into a signal for danger (or reward). After such training, the CS controls conflicting appetitive and aversive behaviors. To assess PVT involvement in conflict, we injected an adeno-associated virus (AAV) expressing the genetically encoded Ca²⁺ indicator GCaMP and used fiber photometry to record population PVT Ca²⁺ signals. We show distinct profiles of responsivity across the anterior-posterior axis of PVT during conflict, including an ordinal relationship between posterior PVT CS responses and behavior strength. To study the causal role of PVT in behavioral control during conflict, we injected AAV expressing the inhibitory hM4Di DREADD and determined the effects of chemogenetic PVT inhibition on behavior. We show that chemogenetic inhibition across the anterior-posterior axis of the PVT, but not anterior or posterior PVT alone, disrupts arbitration between appetitive and aversive behaviors when they are in conflict but has no effect when these behaviors are assessed in isolation. Together, our findings identify PVT as central to behavioral control during motivational conflict.SIGNIFICANCE STATEMENT Animals, including humans, approach attractive stimuli and avoid aversive ones. However, they frequently face conflict when the demands of approach and avoidance are incompatible. Resolution of this conflict is fundamental to adaptive behavior. Here we show a role for the paraventricular thalamus, a nucleus of the dorsal midline thalamus, in the arbitration of appetitive and aversive behavior during motivational conflict.

Adolescent conditioning affects rate of adult fear, safety and reward learning during discriminative conditioning

Fear and reward memories formed in adulthood are influenced by prior experiences. Experiences that occur during sensitive periods, such as adolescence, can have an especially high impact on later learning. Fear and reward memories form when aversive or appetitive events co-occur with initially neutral stimuli, that then gain negative or positive emotional load. Fear and reward seeking behaviours are influenced by safety cues, signalling the non-occurrence of a threat. It is unclear how adolescent fear or reward pre-conditioning influences later dynamics of these conditioned emotions, and conditioned safety. In this study, we presented male rats with adolescent fear or reward pre-conditioning, followed by discriminative conditioning in adulthood. In this discriminative task, rats are simultaneously conditioned to reward, fear and safety cues. We show that adolescent reward pre-conditioning did not affect the rate of adult reward conditioning, but instead accelerated adult safety conditioning. Adolescent fear pre-conditioning accelerated adult fear and reward seeking behaviours but delayed adult safety expression. Together, our results suggest that the dynamics of safety conditioning can be influenced by adolescent priming of different valences. Taking adolescent experiences into consideration can have implications on how we approach therapy options for later learned fear disorders where safety learning is compromised.

Disconnection of basolateral amygdala and insular cortex disrupts conditioned approach in Pavlovian lever autoshaping

Previously established individual differences in appetitive approach and devaluation sensitivity observed in goal- and sign-trackers may be attributed to differences in the acquisition, modification, or use of associative information in basolateral amygdala (BLA) pathways. Here, we sought to determine the extent to which communication of associative information between BLA and anterior portions of insular cortex (IC) supports ongoing Pavlovian conditioned approach behaviors in sign- and goal-tracking rats, in the absence of manipulations to outcome value. We hypothesized that the BLA mediates goal-, but not sign- tracking approach through interactions with the IC, a brain region involved in supporting flexible behavior. We first trained rats in Pavlovian lever autoshaping to determine their sign- or goal-tracking tendency. During alternating test sessions, we gave unilateral intracranial injections of vehicle or a cocktail of gamma-aminobutyric acid (GABA) receptor agonists, baclofen and muscimol, unilaterally into the BLA and contralaterally or ipsilaterally into the IC prior to reinforced lever autoshaping sessions. Consistent with our hypothesis we found that contralateral inactivation of BLA and IC increased the latency to approach the food cup and decreased the number of food cup contacts in goal-trackers. While contralateral inactivation of BLA and IC did not affect the total number of lever contacts in sign-trackers, this manipulation increased the latency to approach the lever. Ipsilateral inactivation of BLA and IC did not impact approach behaviors in Pavlovian lever autoshaping. These findings, contrary to our hypothesis, suggest that communication between BLA and IC maintains a representation of initially learned appetitive associations that commonly support the initiation of Pavlovian conditioned approach behavior regardless of whether it is directed at the cue or the location of reward delivery.

Paraventricular Thalamus Balances Danger and Reward

Foraging animals balance the need to seek food and energy against the accompanying dangers of injury and predation. To do so, they rely on learning systems encoding reward and danger. Whereas much is known about these separate learning systems, little is known about how they interact to shape and guide behavior. Here we show a key role for the rat paraventricular nucleus of the thalamus (PVT), a nucleus of the dorsal midline thalamus, in this interaction. First, we show behavioral competition between reward and danger: the opportunity to seek food reward negatively modulates expression of species-typical defensive behavior. Then, using a chemogenetic approach expressing the inhibitory hM4Di designer receptor exclusively activated by a designer drug in PVT neurons, we show that the PVT is central to this behavioral competition. Chemogenetic PVT silencing biases behavior toward either defense or reward depending on the experimental conditions, but does not consistently favor expression of one over the other. This bias could not be attributed to changes in fear memory retrieval, learned safety, or memory interference. Rather, our results demonstrate that the PVT is essential for balancing conflicting behavioral tendencies toward danger and reward, enabling adaptive responding under this basic selection pressure.SIGNIFICANCE STATEMENT Among the most basic survival problems faced by animals is balancing the need to seek food and energy against the accompanying dangers of injury and predation. Although much is known about the brain mechanisms that underpin learning about reward and danger, little is known about how these interact to solve basic survival problems. Here we show competition between defensive (to avoid predatory detection) and approach (to obtain food) behavior. We show that the paraventricular thalamus, a nucleus of the dorsal midline thalamus, is integral to this behavioral competition. The paraventricular thalamus balances the competing behavioral demands of danger and reward, enabling adaptive responding under this selection pressure.

Cue-induced food seeking after punishment is associated with increased Fos expression in the lateral hypothalamus and basolateral and medial amygdala

In humans, relapse to unhealthy eating habits following dieting is a significant impediment to obesity treatment. Food-associated cues are one of the main triggers of relapse to unhealthy eating during self-imposed abstinence. Here we report a behavioral method examining cue-induced relapse to food seeking following punishment-induced suppression of food taking. We trained male rats to lever press for food pellets that were delivered after a 10-s conditional stimulus (CS) (appetitive). Following training, 25% of reinforced lever presses resulted in the presentation of a compound stimulus consisting of a novel CS (aversive) and the appetitive CS followed by a pellet and footshock. After punishment-imposed abstinence, we tested the rats in an extinction test where lever pressing resulted in the presentation of either the appetitive or aversive CS. We then compared activity of lateral hypothalamus (LH) and associated extrahypothalamic regions following this test. We also assessed Fos expression in LH orexin and GABA neurons. We found that cue-induced relapse of food seeking on test was higher in rats tested with the appetitive CS compared to the aversive CS. Relapse induced by the appetitive CS was associated with increased Fos expression in LH, caudal basolateral amygdala (BLA), and medial amygdala (MeA). This relapse was also associated with increased Fos expression in LH orexin and VGAT-expressing neurons. These data show that relapse to food seeking can be induced by food-associated cues after punishment-imposed abstinence, and this relapse is associated with increased activity in LH, caudal BLA, and MeA. (PsycINFO Database Record

Loss of dopamine D1 receptors and diminished D1/5 receptor-mediated ERK phosphorylation in the periaqueductal gray after spinal cord lesion

Neuropathic pain resulting from spinal cord injury is often accompanied by maladaptive plasticity of the central nervous system, including the opioid receptor-rich periaqueductal gray (PAG). Evidence suggests that sensory signaling via the PAG is robustly modulated by dopamine D1- and D2-like receptors, but the effect of damage to the spinal cord on D1 and D2 receptor protein expression and function in the PAG has not been examined. Here we show that 21days after a T10 or C6 spinothalamic tract lesion, both mice and rats display a remarkable decline in the expression of D1 receptors in the PAG, revealed by western blot analysis. These changes were associated with a significant reduction in hindpaw withdrawal thresholds in lesioned animals compared to sham-operated controls. We investigated the consequences of diminished D1 receptor levels by quantifying D1-like receptor-mediated phosphorylation of ERK1,2 and CREB, events that have been observed in numerous brain structures. In naïve animals, western blot analysis revealed that ERK1,2, but not CREB phosphorylation was significantly increased in the PAG by the D1-like agonist SKF 81297. Using immunohistochemistry, we found that SKF 81297 increased ERK1,2 phosphorylation in the PAG of sham animals. However, in lesioned animals, basal pERK1,2 levels were elevated and did not significantly increase after exposure to SKF 81297. Our findings provide support for the hypothesis that molecular adaptations resulting in a decrease in D1 receptor expression and signaling in the PAG are a consequence of SCL.

Appetitive context conditioning proactively, but transiently, interferes with expression of counterconditioned context fear

Four experiments used rats to study appetitive-aversive transfer. Rats trained to eat a palatable food in a distinctive context and shocked in that context ate and did not freeze when tested 1 d later but froze and did not eat when tested 14 d later. These results were associatively mediated (Experiments 1 and 2), observed when rats were or were not food deprived (Experiments 1 and 2), and were not due to latent inhibition (Experiment 3). In contrast, rats trained to eat in the context and shocked there 13 d later froze and did not eat when tested 1 d after the shocked exposure. However, rats that received an additional eating session in the context 1 d before the shocked exposure ate and did not freeze when tested 1 d after the shocked exposure (Experiment 4). The results show that appetitive conditioning transiently interferes with aversive conditioning. They are discussed in terms of a weak context-shock association becoming stronger with the lapse of time (so-called fear incubation) or of the interference by the context-food association becoming weaker with the lapse of time.