Occasion setting, inhibition, and the contextual control of extinction in Pavlovian and instrumental (operant) learning

Ventral hippocampus mediates inter-trial responding in signaled active avoidance

The hippocampus has a central role in regulating contextual processes in memory. We have shown that pharmacological inactivation of ventral hippocampus (VH) attenuates the context-dependence of signaled active avoidance (SAA) in rats. Here, we explore whether the VH mediates intertrial responses (ITRs), which are putative unreinforced avoidance responses that occur between trials. First, we examined whether VH inactivation would affect ITRs. Male rats underwent SAA training and subsequently received intra-VH infusions of saline or muscimol before retrieval tests in the training context. Rats that received muscimol performed significantly fewer ITRs, but equivalent avoidance responses, compared to controls. Next, we asked whether chemogenetic VH activation would increase ITR vigor. In male and female rats expressing excitatory (hM3Dq) DREADDs, systemic CNO administration produced a robust ITR increase that was not due to nonspecific locomotor effects. Then, we examined whether chemogenetic VH activation potentiated ITRs in an alternate (non-training) test context and found it did. Finally, to determine if context-US associations mediate ITRs, we exposed rats to the training context for three days after SAA training to extinguish the context. Rats submitted to context extinction did not show a reliable decrease in ITRs during a retrieval test, suggesting that context-US associations are not responsible for ITRs. Collectively, these results reveal an important role for the VH in context-dependent ITRs during SAA. Further work is required to explore the neural circuits and associative basis for these responses, which may be underlie pathological avoidance that occurs in humans after threat has passed.

Fear extinction is impaired in aged rats

Normal aging is accompanied by broad loss of cognitive function in humans and rodents, including declines in cognitive flexibility. In extinction, a conditional stimulus (CS) that was previously paired with a footshock is presented alone. This procedure reliably reduces conditional freezing behavior in young adult rats. Here, we aimed to investigate how normal aging affects extinction learning. Using young (3 months) and aged (20 months) male and female Long Evans rats, we compared extinction (using 20 CS-alone presentations) to a no extinction control (equal exposure to the conditioning chamber without CS presentations) following delay fear conditioning. We found that young animals in the extinction group showed a decrease in freezing following extinction; aged animals did not. We next examined changes in neural activity using expression of the immediate early gene zif268. In young animals, extinction corresponded with decreased expression of zif268 in the basolateral amygdala and anterior retrosplenial cortex; this was not observed in aged animals. Further, aged animals showed increased zif268 expression in each region examined, suggesting that dysfunction in neural activity precedes cognitive deficits. These results demonstrate that aging impacts both extinction learning and neural activity.

Perceived stress and renewal: The effects of long-term stress on the renewal effect

Two online experiments evaluated the relationship between long-term stress, as measured with the Perceived Stress Scale-10, and the Renewal Effect. In the first experiment renewal was assessed with a behavioral suppression task in a science-fiction based video game. Participants learned to suppress mouse clicking during a signal for an upcoming attack to avoid losing points. The signal was first paired with an attack in Context A and extinguished in Context B and tested back in Context A. The contexts were different space galaxies where the gameplay took place. Experiment 2 used a food/illness predictive-learning paradigm. Two food items were paired with stomachache in one restaurant (A) and extinguished in Context B prior to testing in both contexts without feedback. Positive correlations were obtained between renewal and stress in each experiment. Unlike acute stress (Drexler et al., 2017), long term stress was associated with greater renewal. The effects of stress, both chronic and punctual, on renewal are discussed.

Basal forebrain cholinergic systems as circuits through which traumatic stress disrupts emotional memory regulation

Contextual and spatial systems facilitate changes in emotional memory regulation brought on by traumatic stress. Cholinergic basal forebrain (chBF) neurons provide input to contextual/spatial systems and although chBF neurons are important for emotional memory, it is unknown how they contribute to the traumatic stress effects on emotional memory. Clusters of chBF neurons that project to the prefrontal cortex (PFC) modulate fear conditioned suppression and passive avoidance, while clusters of chBF neurons that project to the hippocampus (Hipp) and PFC (i.e. cholinergic medial septum and diagonal bands of Broca (chMS/DBB neurons) are critical for fear extinction. Interestingly, neither Hipp nor PFC projecting chMS/DBB neurons are critical for fear extinction. The retrosplenial cortex (RSC) is a contextual/spatial memory system that receives input from chMS/DBB neurons, but whether this chMS/DBB-RSC circuit facilitates traumatic stress effects on emotional memory remain unexplored. Traumatic stress leads to neuroinflammation and the buildup of reactive oxygen species. These two molecular processes may converge to disrupt chBF circuits enhancing the impact of traumatic stress on emotional memory.

Ventral hippocampus mediates inter-trial responding in signaled active avoidance

The hippocampus has a central role in regulating contextual processes in memory. We have shown that pharmacological inactivation of ventral hippocampus (VH) attenuates the context-dependence of signaled active avoidance (SAA) in rats. Here, we explore whether the VH mediates intertrial responses (ITRs), which are putative unreinforced avoidance responses that occur between trials. First, we examined whether VH inactivation would affect ITRs. Male rats underwent SAA training and subsequently received intra-VH infusions of saline or muscimol before retrieval tests in the training context. Rats that received muscimol performed significantly fewer ITRs, but equivalent avoidance responses, compared to controls. Next, we asked whether chemogenetic VH activation would increase ITR vigor. In male and female rats expressing excitatory (hM3Dq) DREADDs, systemic CNO administration produced a robust ITR increase that was not due to nonspecific locomotor effects. Then, we examined whether chemogenetic VH activation potentiated ITRs in an alternate (non-training) test context and found it did. Finally, to determine if context-US associations mediate ITRs, we exposed rats to the training context for three days after SAA training to extinguish the context. Rats submitted to context extinction did not show a reliable decrease in ITRs during a retrieval test, suggesting that context-US associations are not responsible for ITRs. Collectively, these results reveal an important role for the VH in context-dependent ITRs during SAA. Further work is required to explore the neural circuits and associative basis for these responses, which may be underlie pathological avoidance that occurs in humans after threat has passed.

Positive mood induction does not reduce return of fear: A virtual reality exposure study for public speaking anxiety

Previous laboratory work has shown that induction of positive mood prior to fear extinction decreases the negative valence of the conditional stimulus (CS) and reduces reinstatement of fear. Before translating these insights to clinical practice, it is important to test this strategy in anxious individuals. Students with a high fear of public speaking (N = 62) were randomized to either a positive mood induction, a negative mood induction, or no induction control group. All participants performed two weekly sessions of virtual reality exposure and a 1-week follow-up test including a spontaneous recovery test and reinstatement test after a social rejection (unconditional stimulus). We used self-reported fear measures and skin conductance responses. We expected that the positive group, compared to the other groups, would evaluate the CS (i.e., speaking in front of an audience) as less negative following exposure and would show less spontaneous recovery and reinstatement of fear following a social rejection. Although mood was successfully manipulated, there were no group differences in CS valence following exposure. In all conditions, VR exposure successfully reduced public speaking fear, and these effects were stable at follow-up. In contrast with expectations, the positive group showed more spontaneous recovery of CS negative valence than the negative group. To conclude, we found no evidence that positive mood induction prior to exposure optimizes exposure effects for anxious individuals.

Decoding context memories for threat in large-scale neural networks

Humans are often tasked with determining the degree to which a given situation poses threat. Salient cues present during prior events help bring online memories for context, which plays an informative role in this process. However, it is relatively unknown whether and how individuals use features of the environment to retrieve context memories for threat, enabling accurate inferences about the current level of danger/threat (i.e. retrieve appropriate memory) when there is a degree of ambiguity surrounding the present context. We leveraged computational neuroscience approaches (i.e. independent component analysis and multivariate pattern analyses) to decode large-scale neural network activity patterns engaged during learning and inferring threat context during a novel functional magnetic resonance imaging task. Here, we report that individuals accurately infer threat contexts under ambiguous conditions through neural reinstatement of large-scale network activity patterns (specifically striatum, salience, and frontoparietal networks) that track the signal value of environmental cues, which, in turn, allows reinstatement of a mental representation, primarily within a ventral visual network, of the previously learned threat context. These results provide novel insight into distinct, but overlapping, neural mechanisms by which individuals may utilize prior learning to effectively make decisions about ambiguous threat-related contexts as they navigate the environment.

Fear Reduced Through Unconditional Stimulus Deflation Is Behaviorally Distinct From Extinction and Differentially Engages the Amygdala

Background

Context fear memory can be reliably reduced by subsequent pairings of that context with a weaker shock. This procedure shares similarities with extinction learning: both involve extended time in the conditioning chamber following training and reduce context-elicited fear. Unlike extinction, this weak-shock exposure has been hypothesized to engage reconsolidation-like processes that weaken the original memory.

Methods

We directly compared the weak-shock procedure with extinction using male and female Long Evans rats.

Results

Both repeated weak-shock exposure and extinction resulted in decreased context freezing relative to animals that received context fear conditioning but no subsequent context exposure. Conditioning with the weak shock was not enough to form a persistent context-shock association on its own, suggesting that the weak-shock procedure does not create a new memory. Weak-shock exposure in a new context can still reduce freezing elicited by the training context, suggesting that it reduces responding through a different process than extinction, which does not transcend context. Finally, reduced fear behavior produced through both extinction and weak-shock exposure was mirrored by reduced zif268 expression in the basolateral amygdala. However, only the weak-shock procedure resulted in changes in lysine-48 polyubiquitin tagging in the synapse of the basolateral amygdala, suggesting that this procedure produced long-lasting changes in synaptic function within the basolateral amygdala.

Conclusions

These results suggest that the weak-shock procedure does not rely on the creation of a new inhibitory memory, as in extinction, and instead may alter the original representation of the shock to reduce fear responding.

Contribution of dorsal versus ventral hippocampus to the hierarchical modulation of goal-directed actions in rats

Adaptive behaviour often necessitates that animals learn about events in a manner that is specific to a particular context or environment. These hierarchical organisations allow the animal to decide which action is the most appropriate when faced with ambiguous or conflicting possibilities. This study examined the role of hippocampus in enabling animals to use the context to guide action selection. We used a hierarchical instrumental outcome devaluation task in which male rats learn that the context provides information about the unique action-outcome relations that are in effect. We first confirmed that rats encode and use hierarchical context-(action-outcome) relations. We then show that chemogenetic inhibition of ventral hippocampus impairs both the encoding and retrieval of these associations, while inhibition of dorsal hippocampus impairs only the retrieval. Importantly, neither dorsal nor ventral hippocampus was required for goal-directed behaviour per se as these impairments only emerged when rats were forced to use the context to identify the current action-outcome relationships. These findings are discussed with respect to the role of the hippocampus and its broader circuitry in the contextual modulation of goal-directed behaviour and the importance of hierarchical associations in flexible behaviour.

A comparison of renewal, spontaneous recovery, and reacquisition after punishment and extinction

Punishment and extinction are both effective methods of reducing instrumental responding and may involve similar learning mechanisms. To characterize the similarities and differences between them, we examined three well-established recovery or "relapse" effects -renewal, spontaneous recovery, and reacquisition - following either punishment or extinction of an instrumental response. In Experiment 1a, both punished and extinguished responses renewed to similar degrees following a context change at test (ABA renewal). In Experiment 1b, responding spontaneously recovered to similar degrees following punishment or extinction. In Experiment 2, responding was rapidly reacquired when the response was reinforced again following extinction but not following punishment, as predicted by the idea that the reinforcer delivered in reacquisition is part of the context of punishment, but not extinction. The results collectively suggest that both punishment and extinction produce similar context-dependent retroactive interference effects. More broadly, they also suggest that punished and extinguished responses may be equally likely to return following a change of context despite the intuition that punishment might provide a more extreme and effective means of suppressing behavior. To our knowledge, this is the first direct behavioral comparison of response recovery after punishment and extinction within individual experiments.

Fear extinction relies on ventral hippocampal safety codes shaped by the amygdala

Extinction memory retrieval is influenced by spatial contextual information that determines responding to conditioned stimuli (CS). However, it is poorly understood whether contextual representations are imbued with emotional values to support memory selection. Here, we performed activity-dependent engram tagging and in vivo single-unit electrophysiological recordings from the ventral hippocampus (vH) while optogenetically manipulating basolateral amygdala (BLA) inputs during the formation of cued fear extinction memory. During fear extinction when CS acquire safety properties, we found that CS-related activity in the vH reactivated during sleep consolidation and was strengthened upon memory retrieval. Moreover, fear extinction memory was facilitated when the extinction context exhibited precise coding of its affective zones. Last, these activity patterns along with the retrieval of the fear extinction memory were dependent on glutamatergic transmission from the BLA during extinction learning. Thus, fear extinction memory relies on the formation of contextual and stimulus safety representations in the vH instructed by the BLA.

Inhibitory Learning during Exposure Treatment in Anorexia Nervosa: A Practical Guide

Exposure therapy is known to be an effective intervention in the treatment of anxiety-related disorders. In eating disorders, such as anorexia nervosa, anxiety and avoidance are identified as maintenance factors. Therefore, they may constitute an important treatment target, suitable for the use of exposure therapy. Remarkably, exposure techniques to target fears and avoidance behaviors are not commonly used in the treatment of anorexia nervosa. We present a practical guide for the implementation of exposure therapy in the treatment of anorexia nervosa. We outline how exposure therapy is supposed to work according to the inhibitory learning model and how the exposure intervention can be designed for individuals with anorexia nervosa. Practical examples are provided through the case presentation of a patient with anorexia nervosa who completed 31 exposure sessions that focused on her fears of food, eating, weight, weight gain, their feared social consequences and the associated safety behaviors.

Memory retrieval, reconsolidation, and extinction: Exploring the boundary conditions of post-conditioning cue exposure

Following fear conditioning, behavior can be reduced by giving many CS-alone presentations in a process known as extinction or by presenting a few CS-alone presentations and interfering with subsequent memory reconsolidation. While the two share procedural similarities, both the behavioral outcomes and the neurobiological underpinnings are distinct. Here we review the neural and behavioral mechanisms that produce these separate behavioral reductions, as well as some factors that determine whether or not a retrieval-dependent reconsolidation process or an extinction process will be in effect.

Learning processes in relapse to alcohol use: lessons from animal models

RATIONALE

Alcohol use is reliably preceded by discrete and contextual stimuli which, through diverse learning processes, acquire the capacity to promote alcohol use and relapse to alcohol use.

OBJECTIVE

We review contemporary extinction, renewal, reinstatement, occasion setting, and sex differences research within a conditioning framework of relapse to alcohol use to inform the development of behavioural and pharmacological therapies.

KEY FINDINGS

Diverse learning processes and corresponding neurobiological substrates contribute to relapse to alcohol use. Results from animal models indicate that cortical, thalamic, accumbal, hypothalamic, mesolimbic, glutamatergic, opioidergic, and dopaminergic circuitries contribute to alcohol relapse through separable learning processes. Behavioural therapies could be improved by increasing the endurance and generalizability of extinction learning and should incorporate whether discrete cues and contexts influence behaviour through direct excitatory conditioning or occasion setting mechanisms. The types of learning processes that most effectively influence responding for alcohol differ in female and male rats.

CONCLUSION

Sophisticated conditioning experiments suggest that diverse learning processes are mediated by distinct neural circuits and contribute to relapse to alcohol use. These experiments also suggest that gender-specific behavioural and pharmacological interventions are a way towards efficacious therapies to prevent relapse to alcohol use.

Basolateral amygdala and orbitofrontal cortex, but not dorsal hippocampus, are necessary for the control of reward-seeking by occasion setters

Reward-seeking in the world is driven by cues that can have ambiguous predictive and motivational value. To produce adaptive, flexible reward-seeking, it is necessary to exploit occasion setters, other distinct features in the environment, to resolve the ambiguity of Pavlovian reward-paired cues. Despite this, very little research has investigated the neurobiological underpinnings of occasion setting, and as a result little is known about which brain regions are critical for occasion setting. To address this, we exploited a recently developed task that was amenable to neurobiological inquiry where a conditioned stimulus is only predictive of reward delivery if preceded in time by the non-overlapping presentation of a separate cue-an occasion setter. This task required male rats to maintain and link cue-triggered expectations across time to produce adaptive reward-seeking. We interrogated the contributions of the basolateral amygdala and orbitofrontal cortex to occasion setting as these regions are thought to be critical for the computation and exploitation of state value, respectively. Reversible inactivation of either structure prior to the occasion-setting task resulted in a profound inability of rats to use the occasion setter to guide reward-seeking. In contrast, inactivation of the dorsal hippocampus, a region fundamental for context-specific responding was without effect nor did inactivation of the basolateral amygdala or orbitofrontal cortex in a standard Pavlovian conditioning preparation affect conditioned responding. We conclude that neural activity within the orbitofrontal cortex and basolateral amygdala circuit is necessary to update and resolve ambiguity in the environment to promote cue-driven reward-seeking.

Hierarchical cue control of cocaine seeking in the face of cost

RATIONALE

Addiction is characterized by intermittent drug seeking despite rising costs. This behavior is heavily influenced by environmental stimuli that signal drug availability and reinforce drug seeking.

OBJECTIVE

To establish the relationship between three key aspects of human drug use in rats: the intermittent, binge nature of drug intake, the motivational conflict of drug seeking in the face of escalating negative costs, and the ability of different drug cues to interact to modulate relapse.

METHODS

Male and female rats were trained to self-administer cocaine on an intermittent access schedule, where brief drug-availability states were signaled by a shift in the ambient lighting of the environment, and cocaine infusions were signaled by a separate proximal discrete cue. Rats then went through a conflict procedure, where foot shock intensity associated with cocaine seeking was escalated until intake was suppressed. We then completed relapse tests where the drug-delivery cue was noncontingently presented alone, or in the context of dynamic drug-availability state transitions.

RESULTS

Intermittent access spurred psychomotor sensitization and binge-like cocaine intake. The intensity of binge-like drug taking during training was predictive of later drug seeking despite escalating costs during conflict. In relapse tests, the ability of a proximal discrete drug cue to trigger relapse was gated by the presence of a global cue signaling drug-availability state transitions.

CONCLUSIONS

Our results suggest that the pattern of drug intake plays a role in many features of addiction, including modifying an individual's willingness to endure high costs associated with drug seeking. Furthermore, our studies indicate that drug-related sensory information can be hierarchically organized to exert a dynamic modulating influence on drug-seeking motivation.

Neural correlates of recall and extinction in a rat model of appetitive Pavlovian conditioning

Extinction is a fundamental form of inhibitory learning that is important for adapting to changing environmental contingencies. While numerous studies have investigated the neural correlates of extinction using Pavlovian fear conditioning and appetitive operant reward-seeking procedures, less is known about the neural circuitry mediating the extinction of appetitive Pavlovian responding. Here, we aimed to generate an extensive brain activation map of extinction learning in a rat model of appetitive Pavlovian conditioning. Male Long-Evans rats were trained to associate a conditioned stimulus (CS; 20 s white noise) with the delivery of a 10% sucrose unconditioned stimulus (US; 0.3 ml/CS) to a fluid port. Control groups also received CS presentations, but sucrose was delivered either during the inter-trial interval or in the home-cage. After conditioning, 1 or 6 extinction sessions were conducted in which the CS was presented but sucrose was withheld. We performed Fos immunohistochemistry and network connectivity analyses on a set of cortical, striatal, thalamic, and amygdalar brain regions. Neural activity in the prelimbic cortex, ventral orbitofrontal cortex, nucleus accumbens core, and paraventricular nucleus of the thalamus was greater during recall relative to extinction. Conversely, prolonged extinction following 6 sessions induced increased neural activity in the infralimbic cortex, medial orbitofrontal cortex, and nucleus accumbens shell compared to home-cage controls. All these structures were similarly recruited during recall on the first extinction session. These findings provide novel evidence for the contribution of brain areas and neural networks that are differentially involved in the recall versus extinction of appetitive Pavlovian conditioned responding.

Ambiguity drives higher-order Pavlovian learning

In the natural world, stimulus-outcome associations are often ambiguous, and most associations are highly complex and situation-dependent. Learning to disambiguate these complex associations to identify which specific outcomes will occur in which situations is critical for survival. Pavlovian occasion setters are stimuli that determine whether other stimuli will result in a specific outcome. Occasion setting is a well-established phenomenon, but very little investigation has been conducted on how occasion setters are disambiguated when they themselves are ambiguous (i.e., when they do not consistently signal whether another stimulus will be reinforced). In two preregistered studies, we investigated the role of higher-order Pavlovian occasion setting in humans. We developed and tested the first computational model predicting direct associative learning, traditional occasion setting (i.e., 1st-order occasion setting), and 2nd-order occasion setting. This model operationalizes stimulus ambiguity as a mechanism to engage in higher-order Pavlovian learning. Both behavioral and computational modeling results suggest that 2nd-order occasion setting was learned, as evidenced by lack and presence of transfer of occasion setting properties when expected and the superior fit of our 2nd-order occasion setting model compared to the 1st-order occasion setting or direct associations models. These results provide a controlled investigation into highly complex associative learning and may ultimately lead to improvements in the treatment of Pavlovian-based mental health disorders (e.g., anxiety disorders, substance use).

Spontaneous recovery from overexpectation in an insect

In associative learning in mammals, it is widely accepted that learning is determined by the prediction error, i.e., the error between the actual reward and the reward predicted by the animal. However, it is unclear whether error-based learning theories are applicable to the learning occurring in other non-mammalian species. Here, we examined whether overexpectation, a phenomenon that supports error-based learning theories, occurs in crickets. Crickets were independently trained with two different conditioned stimuli (CSs), an odour and a visual pattern, that were followed by an appetitive unconditioned stimulus (US). Then the two CSs were presented simultaneously as a compound, followed by the same US. This treatment resulted in a reduced conditioned response to the odour CS when tested immediately after training. However, the response to the CS was partially recovered after 1 day. These results are the first to show overexpectation and its spontaneous recovery in an invertebrate species. While the results showing overexpectation are in agreement with the prediction by the Rescorla-Wagner model, a major form of error-based learning theories, the ones showing spontaneous recovery are not. Our results suggest that conventional error-based learning models account for some, but not for all essential features of Pavlovian conditioning in crickets.

Context coding in the mouse nucleus accumbens modulates motivationally relevant information

Neural activity in the nucleus accumbens (NAc) is thought to track fundamentally value-centric quantities linked to reward and effort. However, the NAc also contributes to flexible behavior in ways that are difficult to explain based on value signals alone, raising the question of if and how nonvalue signals are encoded in NAc. We recorded NAc neural ensembles while head-fixed mice performed an odor-based biconditional discrimination task where an initial discrete cue modulated the behavioral significance of a subsequently presented reward-predictive cue. We extracted single-unit and population-level correlates related to the cues and found value-independent coding for the initial, context-setting cue. This context signal occupied a population-level coding space orthogonal to outcome-related representations and was predictive of subsequent behaviorally relevant responses to the reward-predictive cues. Together, these findings support a gating model for how the NAc contributes to behavioral flexibility and provide a novel population-level perspective from which to view NAc computations.

Impact of the Aversive Effects of Drugs on Their Use and Abuse

Drug use and abuse are complex issues in that the basis of each may involve different determinants and consequences, and the transition from one to the other may be equally multifaceted. A recent model of the addiction cycle (as proposed by Koob and his colleagues) illustrates how drug-taking patterns transition from impulsive (acute use) to compulsive (chronic use) as a function of various neuroadaptations leading to the downregulation of DA systems, upregulation of stress systems, and the dysregulation of the prefrontal/orbitofrontal cortex. Although the nature of reinforcement in the initiation and mediation of these effects may differ (positive vs. negative), the role of reinforcement in drug intake (acute and chronic) is well characterized. However, drugs of abuse have other stimulus properties that may be important in their use and abuse. One such property is their aversive effects that limit drug intake instead of initiating and maintaining it. Evidence of such effects comes from both clinical and preclinical populations. In support of this position, the present review describes the aversive effects of drugs (assessed primarily in conditioned taste aversion learning), the fact that they occur concurrently with reward as assessed in combined taste aversion/place preference designs, the role of aversive effects in drug-taking (in balance with their rewarding effects), the dissociation of these affective properties in that they can be affected in different ways by the same manipulations, and the impact of various parametric, experiential, and subject factors on the aversive effects of drugs and the consequent impact of these factors on their use and abuse potential.

The rodent medial prefrontal cortex and associated circuits in orchestrating adaptive behavior under variable demands

Emerging evidence implicates rodent medial prefrontal cortex (mPFC) in tasks requiring adaptation of behavior to changing information from external and internal sources. However, the computations within mPFC and subsequent outputs that determine behavior are incompletely understood. We review the involvement of mPFC subregions, and their projections to the striatum and amygdala in two broad types of tasks in rodents: 1) appetitive and aversive Pavlovian and operant conditioning tasks that engage mPFC-striatum and mPFC-amygdala circuits, and 2) foraging-based tasks that require decision making to optimize reward. We find support for region-specific function of the mPFC, with dorsal mPFC and its projections to the dorsomedial striatum supporting action control with higher cognitive demands, and ventral mPFC engagement in translating affective signals into behavior via discrete projections to the ventral striatum and amygdala. However, we also propose that defined mPFC subdivisions operate as a functional continuum rather than segregated functional units, with crosstalk that allows distinct subregion-specific inputs (e.g., internal, affective) to influence adaptive behavior supported by other subregions.

Relapse after incentivized choice treatment in humans: A laboratory model for studying behavior change

Behavior change interventions that incentivize desired behavior are highly effective for improving personal health, but difficult to maintain long term. Relapse is common and examining the mechanisms that contribute to relapse in experimental settings can identify processes relevant to substance abuse treatment. We developed a laboratory task that parallels a recent operant model of relapse after incentivized choice reported in the rodent laboratory. In two experiments, undergraduate participants first learned to make an operant response (keyboard button; R1) to earn a reinforcer consisting of an image of a preferred snack food (O1). In a second phase (Phase 2), R1 was still reinforced, but a new response (R2) was introduced and reinforced with a different reinforcer (a coin; O2). In a test phase, contingent incentives for R2 were removed (extinction) and relapse of R1 was assessed. Experiment 1 found that the O2 contingency suppressed R1 during Phase 2, and R1 relapsed rapidly in the test. Neither effect was consistently related to O2 value. Experiment 2 examined whether noncontingent presentations of O1 or O2 during the test could weaken relapse. Here, we found that noncontingent reinforcers did little to reduce or slow the increase in R1 responding. The present experiments highlight a laboratory approach to studying variables that may influence relapse after incentivized treatment. We identify and discuss areas for development to address differences between the present results and prior observations from animal and clinical studies. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

A Role for Serotonin in Modulating Opposing Drive and Brake Circuits of Impulsivity

Impulsivity generally refers to a deficit in inhibition, with a focus on understanding the neural circuits which constitute the “brake” on actions and gratification. It is likely that increased impulsivity can arise not only from reduced inhibition, but also from a heightened or exaggerated excitatory “drive.” For example, an action which has more vigor, or is fueled by either increased incentive salience or a stronger action-outcome association, may be harder to inhibit. From this perspective, this review focuses on impulse control as a competition over behavioral output between an initially learned response-reward outcome association, and a subsequently acquired opposing inhibitory association. Our goal is to present a synthesis of research from humans and animal models that supports this dual-systems approach to understanding the behavioral and neural substrates that contribute to impulsivity, with a focus on the neuromodulatory role of serotonin. We review evidence for the role of serotonin signaling in mediating the balance of the “drive” and “brake” circuits. Additionally, we consider parallels of these competing instrumental systems in impulsivity within classical conditioning processes (e.g., extinction) in order to point us to potential behavioral and neural mechanisms that may modulate the competing instrumental associations. Finally, we consider how the balance of these competing associations might contribute to, or be extracted from, our experimental assessments of impulsivity. A careful understanding of the underlying behavioral and circuit level contributions to impulsivity is important for understanding the pathogenesis of increased impulsivity present in a number of psychiatric disorders. Pathological levels of impulsivity in such disorders are likely subserved by deficits in the balance of motivational and inhibitory processes.

Corticostriatal Suppression of Appetitive Pavlovian Conditioned Responding

The capacity to suppress learned responses is essential for animals to adapt in dynamic environments. Extinction is a process by which animals learn to suppress conditioned responding when an expected outcome is omitted. The infralimbic (IL) cortex to nucleus accumbens shell (NAcS) neural circuit is implicated in suppressing conditioned responding after extinction, especially in the context of operant cocaine-seeking behavior. However, the role of the IL-to-NAcS neural circuit in the extinction of responding to appetitive Pavlovian cues is unknown, and the psychological mechanisms involved in response suppression following extinction are unclear. We trained male Long Evans rats to associate a 10 s auditory conditioned stimulus (CS; 14 trials per session) with a sucrose unconditioned stimulus (US; 0.2 ml per CS) in a specific context, and then following extinction in a different context, precipitated a renewal of CS responding by presenting the CS alone in the original Pavlovian conditioning context. Unilateral, optogenetic stimulation of the IL-to-NAcS circuit selectively during CS trials suppressed renewal. In a separate experiment, IL-to-NAcS stimulation suppressed CS responding regardless of prior extinction and impaired extinction retrieval. Finally, IL-to-NAcS stimulation during the CS did not suppress the acquisition of Pavlovian conditioning but was required for the subsequent expression of CS responding. These results are consistent with multiple studies showing that the IL-to-NAcS neural circuit is involved in the suppression of operant cocaine-seeking, extending these findings to appetitive Pavlovian cues. The suppression of appetitive Pavlovian responding following IL-to-NAcS circuit stimulation, however, does not appear to be an extinction-dependent process.SIGNIFICANCE STATEMENT Extinction is a form of inhibitory learning through which animals learn to suppress conditioned responding in the face of nonreinforcement. We investigated the role of the IL cortex inputs to the NAcS in the extinction of responding to appetitive Pavlovian cues and the psychological mechanisms involved in response suppression following extinction. Using in vivo optogenetics, we found that stimulating the IL-to-NAcS neural circuit suppressed context-induced renewal of conditioned responding after extinction. In a separate experiment, stimulating the IL-to-NAcS circuit suppressed conditioned responding in an extinction-independent manner. These findings can be used by future research aimed at understanding how corticostriatal circuits contribute to behavioral flexibility and mental disorders that involve the suppression of learned behaviors.

Extinction trial spacing across days differentially impacts fear regulation in adult and adolescent male mice

Fear regulation changes as a function of age and adolescence is a key developmental period for the continued maturation of fear neural circuitry. A consistent finding in the literature is diminished extinction retention in adolescents. However, these studies often directly compare adolescents to adults using a single protocol and therefore provide little insight into learning parameters that improve adolescent fear regulation. Studies in adults highlight the benefits of spaced learning over massed learning. These findings have been extended to fear regulation, with adult rodents exhibiting improved extinction learning and retention when cues are distributed over days versus a single session. However, similar studies have not been performed in adolescents. Here, we systematically examine the impact of trial spacing across days on fear regulation. Adolescent or adult male mice were exposed to one of three extinction paradigms that presented the same number of trials but differed in the temporal distribution of trials across days (one day, two days, or four days). We found that introducing consolidation events into the protocol improves adult extinction learning and short-term extinction retention but these effects disappear after two weeks. For adolescents, all three protocols were comparably effective in reducing freezing across extinction training and improved retention at both short-term and long-term fear recall time points relative to extinction-naive mice. These findings suggest that extinction protocols that incorporate consolidation events are optimal for adults but additional booster training may be required for enduring efficacy. In contrast, protocols incorporating either massed or spaced presentations show immediate and enduring benefits for adolescents.

Contextual modulation of conditioned responses in humans: A review on virtual reality studies

Conditioned response (CRs) triggered by stimuli predicting aversive consequences have been confirmed across various species including humans, and were found to be exaggerated in anxious individuals and anxiety disorder patients. Importantly, contextual information may strongly modulate such conditioned responses (CR), however, there are several methodological boundaries in the translation of animal findings to humans, and from healthy individuals to patients. Virtual Reality (VR) is a useful technological tool for overcoming such boundaries. In this review, we summarize and evaluate human VR conditioning studies exploring the role of the context as conditioned stimulus or occasion setter for CRs. We observe that VR allows successful acquisition of conditioned anxiety and conditioned fear in response to virtual contexts and virtual cues, respectively. VR studies also revealed that spatial or temporal contextual information determine whether conditioned anxiety and conditioned fear become extinguished and/or return. Novel contexts resembling the threatening context foster conditioned fear but not conditioned anxiety, suggesting distinct context-related generalization processes. We conclude VR contexts are able to strongly modulate CRs and therefore allow a comprehensive investigation of the modulatory role of the context over CR in humans leading to conclusions relevant for non-VR and clinical studies.

Conditional Control of Instrumental Avoidance by Context Following Extinction

Using rodents, three training arrangements (i.e., ABB vs. ABA, AAA vs. AAB and ABB vs. ABC) explored whether extinction influences the expression of avoidance in a manner controlled by context. Retention testing following extinction showed that more avoidance responding (i.e., renewal) was observed when extinguished cues were tested outside of the context where they had undergone extinction. In contrast, response rates were significantly lower when stimuli were tested within the context where extinction learning had occurred. These findings add to the emerging literature assessing the role of Pavlovian extinction processes in the development of instrumental avoidance responding by demonstrating conditional control over extinguished responding by context. This study was conducted using a within-subjects approach that minimized the potential for context-outcome associations to bias responding, and thus, reflects hierarchical control over behavior based on the specific associative status of each tested cue in each training context.

Pavlovian occasion setting in human fear and appetitive conditioning: Effects of trait anxiety and trait depression

Contexts and discrete stimuli often hierarchically influence the association between a stimulus and outcome. This phenomenon, called occasion setting, is central to modulation-based Pavlovian learning. We conducted two experiments with humans in fear and appetitive conditioning paradigms, training stimuli in differential conditioning, feature-positive discriminations, and feature-negative discriminations. We also investigated the effects of trait anxiety and trait depression on these forms of learning. Results from both experiments showed that participants were able to successfully learn which stimuli predicted the electric shock and monetary reward outcomes. Additionally, as hypothesized, the stimuli trained as occasion setters had little-to-no effect on simple reinforced or non-reinforced stimuli, suggesting the former were indeed occasion setters. Lastly, in fear conditioning, trait anxiety was associated with increases in fear of occasion setter/conditional stimulus compounds; in appetitive conditioning, trait depression was associated with lower expectations of monetary reward for the trained negative occasion setting compound and transfer of the negative occasion setter to the simple reinforced stimulus. These results suggest that clinically anxious individuals may have enhanced fear of occasion setting compounds, and clinically depressed individuals may expect less reward with compounds involving the negative occasion setter.

Beyond the hippocampus: The role of parahippocampal-prefrontal communication in context-modulated behavior

Multiple paradigms indicate that the physical environment can influence spontaneous and learned behavior. In rodents, context-dependent behavior is putatively supported by the prefrontal cortex and the medial temporal lobe. A preponderance of the literature has targeted the role of the hippocampus. In addition to the hippocampus proper, the medial temporal lobe also comprises parahippocampal areas, including the perirhinal and postrhinal cortices. These parahippocampal areas directly connect with multiple regions in the prefrontal cortex. The function of these connections, however, is not well understood. This article first reviews the involvement of the perirhinal, postrhinal, and prefrontal cortices in context-dependent behavior in rodents. Then, based on functional and anatomical evidence, we suggest that perirhinal and postrhinal contributions to context-dependent behavior go beyond supporting context representation in the hippocampus. Specifically, we propose that the perirhinal and postrhinal cortices act as a contextual-support network that directly provides contextual and spatial information to the prefrontal cortex. In turn, the perirhinal and postrhinal cortices modulate prefrontal input to the hippocampus in the service of context-guided behavior.

Recovery-from-extinction effects in an anuran amphibian: renewal effect, but no reinstatement

Recovery-from-extinction effects in which a conditioned response returns after extinction have been shown in mammals, birds and fish. Thus, these effects appear to be conserved among vertebrates; however, they have yet to be investigated in amphibians. Using prey catching conditioning in the fire-bellied toad (Bombina orientalis), we tested if renewal and reinstatement occurred after extinction when subjects were respectively re-exposed to the context or reinforcer used during conditioning. For renewal, a different context was used during extinction and thus renewal tests assessed if external contextual cues associated during conditioning stimulated prey catching performance. For reinstatement, the reinforcer withheld during extinction was simply delivered again prior to a test assessing if internal cues associated with recent prey consumption stimulated prey catching performance. Conditioning followed a fixed ratio 5 schedule of reinforcement, where five attempts to capture a cricket stimulus displayed on a computer screen were reinforced by delivery of a single live cricket. Performance was measured as the time to reach five prey catching attempts. A significant improvement in prey catching performance during conditioning followed by deterioration with extinction was seen in the experiments. Upon return to the context used for conditioning after extinction, toads showed a renewal effect whereby they displayed faster performance during testing compared to the end of extinction. Conversely, toads showed no reinstatement effect because pre-feeding of a cricket did not influence performance during the test that followed extinction. Reinstatement could have been lost in amphibian phylogeny due to secondary simplification of the nervous system.

Perceived Discrimination and Symptoms of Cognitive Dysfuntion Among Middle-Age and Older Persons Living With HIV in China: A Multicenter Cross-Sectional Study of the Mediating Role of Mental Health Symptoms and Social Isolation

ABSTRACT

Perceived discrimination is associated with symptoms of cognitive dysfunction (SOCD) among middle-age and older persons living with HIV (PLWH). We aimed to explore how the association between perceived discrimination and SOCD was mediated by mental health symptoms and social isolation. The sample included 321 PLWH, ages 45 years and older, for a multicenter cross-sectional study. Structural equation modeling showed an acceptable model fit and a significant total indirect effect between perceived discrimination and SOCD. All three indirect effect pathways were significant, suggesting that perceived discrimination could influence SOCD through mental health symptoms, through social isolation, or through mental health symptoms and then social isolation. Our study demonstrates that perceived discrimination is a concern for the management of cognitive function among middle-age and older PLWH. Both mental health symptoms and social isolation are critical elements in the design and evaluation of interventions for promoting cognitive health.

When gut feelings teach the brain to fear pain: Context-dependent activation of the central fear network in a novel interoceptive conditioning paradigm

The relevance of contextual factors in shaping neural mechanisms underlying visceral pain-related fear learning remains elusive. However, benign interoceptive sensations, which shape patients' clinical reality, may context-dependently become conditioned predictors of impending visceral pain. In a novel context-dependent interoceptive conditioning paradigm, we elucidated the putative role of the central fear network in the acquisition and extinction of pain-related fear induced by interoceptive cues and pain-predictive contexts. In this fMRI study involving rectal distensions as a clinically-relevant model of visceroception, N = 27 healthy men and women underwent differential conditioning. During acquisition training, visceral sensations of low intensity as conditioned stimuli (CS) predicted visceral pain as unconditioned stimulus (US) in one context (Con⁺), or safety from pain in another context (Con^-). During extinction training, interoceptive CS remained unpaired in both contexts, which were operationalized as images of different rooms presented in the MRI scanner. Successful contextual conditioning was supported by increased negative valence of Con⁺ compared to Con^- after acquisition training, which resolved after extinction training. Although interoceptive CS were perceived as comparatively pleasant, they induced significantly greater neural activation of the amygdala, ventromedial PFC, and hippocampus when presented in Con⁺, while contexts alone did not elicit differential responses. During extinction training, a shift from CS to context differentiation was observed, with enhanced responses in the amygdala, ventromedial, and ventrolateral PFC to Con⁺ relative to Con^-, whereas no CS-induced differential activation emerged. Context-dependent interoceptive conditioning can turn benign interoceptive cues into predictors of visceral pain that recruit key regions of the fear network. This first evidence expands knowledge about learning and memory mechanisms underlying interoceptive hypervigilance and maladaptive avoidance behavior, with implications for disorders of the gut-brain axis.

Evaluating Extinction, Renewal, and Resurgence of Operant Behavior in Humans with Amazon Mechanical Turk

Amazon Mechanical Turk (MTurk) is a crowdsourcing marketplace providing researchers with the opportunity to collect behavioral data from remote participants at a low cost. Recent research demonstrated reliable extinction effects, as well as renewal and resurgence of button pressing with MTurk participants. To further examine the generality of these findings, we replicated and extended these methods across six experiments arranging reinforcement and extinction of a target button press. In contrast to previous findings, we did not observe as reliable of decreases in button pressing during extinction (1) after training with VR or VI schedules of reinforcement, (2) in the presence or absence of context changes, or (3) with an added response cost for button pressing. However, we found that that a 1-point response cost for all button presses facilitated extinction to a greater extent than the absence of response cost. Nevertheless, we observed ABA renewal of button pressing when changing background contexts across phases and resurgence when extinguishing presses on an alternative button. Our findings suggest that MTurk could be a viable platform from which to ask and address questions about extinction and relapse processes, but further procedural refinements will be necessary to improve the replicability of control by experimental contingencies.

Emergence of complex dynamics of choice due to repeated exposures to extinction learning

Extinction learning, the process of ceasing an acquired behavior in response to altered reinforcement contingencies, is not only essential for survival in a changing environment, but also plays a fundamental role in the treatment of pathological behaviors. During therapy and other forms of training involving extinction, subjects are typically exposed to several sessions with a similar structure. The effects of this repeated exposure are not well understood. Here, we studied the behavior of pigeons across several sessions of a discrimination-learning task in context A, extinction in context B, and a return to context A to test the context-dependent return of the learned responses (ABA renewal). By focusing on individual learning curves across animals, we uncovered a session-dependent variability of behavior: (1) during extinction, pigeons preferred the unrewarded alternative choice in one-third of the sessions, predominantly during the first one. (2) In later sessions, abrupt transitions of behavior at the onset of context B emerged, and (3) the renewal effect decayed as sessions progressed. We show that the observed results can be parsimoniously accounted for by a computational model based only on associative learning between stimuli and actions. Our work thus demonstrates the critical importance of studying the trial-by-trial dynamics of learning in individual sessions, and the power of “simple” associative learning processes.

BEHAVIORAL AND NEUROBIOLOGICAL MECHANISMS OF PAVLOVIAN AND INSTRUMENTAL EXTINCTION LEARNING

This article reviews the behavioral neuroscience of extinction, the phenomenon in which a behavior that has been acquired through Pavlovian or instrumental (operant) learning decreases in strength when the outcome that reinforced it is removed. Behavioral research indicates that neither Pavlovian nor operant extinction depends substantially on erasure of the original learning but instead depends on new inhibitory learning that is primarily expressed in the context in which it is learned, as exemplified by the renewal effect. Although the nature of the inhibition may differ in Pavlovian and operant extinction, in either case the decline in responding may depend on both generalization decrement and the correction of prediction error. At the neural level, Pavlovian extinction requires a tripartite neural circuit involving the amygdala, prefrontal cortex, and hippocampus. Synaptic plasticity in the amygdala is essential for extinction learning, and prefrontal cortical inhibition of amygdala neurons encoding fear memories is involved in extinction retrieval. Hippocampal-prefrontal circuits mediate fear relapse phenomena, including renewal. Instrumental extinction involves distinct ensembles in corticostriatal, striatopallidal, and striatohypothalamic circuits as well as their thalamic returns for inhibitory (extinction) and excitatory (renewal and other relapse phenomena) control over operant responding. The field has made significant progress in recent decades, although a fully integrated biobehavioral understanding still awaits.

Contributions of prelimbic cortex, dorsal and ventral hippocampus, and basolateral amygdala to fear return induced by elevated platform stress in rats

Fear relapse is a major challenge in the treatment of stress-related mental disorders. Most investigations have focused on fear return induced by stimuli associated with the initial fear learning, while little attention has been paid to fear return evoked after exposure to an unconditioned stressor. This study explored the neural mechanisms of fear return induced by elevated platform (EP) stressor in Sprague-Dawley rats initially subjected to auditory fear conditioning. The contributions of the prelimbic cortex (PL), dorsal hippocampus (DH), ventral hippocampus (VH), and basolateral amygdala (BLA) were examined by targeted bilateral intracerebral injection of the GABAA agonist muscimol after elevated platform (EP) stressor. Muscimol-induced inactivation of PL or BLA significantly impaired the return of conditioning fear, while inactivation of the DH or VH had no effect. These results suggest that fear return induced by non-associative stressor may depend on the PL and BLA but not on the hippocampus.

Associative processes in addiction relapse models: A review of their Pavlovian and instrumental mechanisms, history, and terminology

Animal models of relapse to drug-seeking have borrowed heavily from associative learning approaches. In studies of relapse-like behaviour, animals learn to self-administer drugs then receive a period of extinction during which they learn to inhibit the operant response. Several triggers can produce a recovery of responding which form the basis of a variety of models. These include the passage of time (spontaneous recovery), drug availability (rapid reacquisition), extinction of an alternative response (resurgence), context change (renewal), drug priming, stress, and cues (reinstatement). In most cases, the behavioural processes driving extinction and recovery in operant drug self-administration studies are similar to those in the Pavlovian and behavioural literature, such as context effects. However, reinstatement in addiction studies have several differences with Pavlovian reinstatement, which have emerged over several decades, in experimental procedures, associative mechanisms, and terminology. Interestingly, in cue-induced reinstatement, drug-paired cues that are present during acquisition are omitted during lever extinction. The unextinguished drug-paired cue may limit the model’s translational relevance to cue exposure therapy and renders its underlying associative mechanisms ambiguous. We review major behavioural theories that explain recovery phenomena, with a particular focus on cue-induced reinstatement because it is a widely used model in addiction. We argue that cue-induced reinstatement may be explained by a combination of behavioural processes, including reacquisition of conditioned reinforcement and Pavlovian to Instrumental Transfer. While there are important differences between addiction studies and the behavioural literature in terminology and procedures, it is clear that understanding associative learning processes is essential for studying relapse.

An evaluation of a renewal-mitigation procedure for inappropriate mealtime behavior

Renewal, the increase in behavior during extinction following context changes, may be particularly concerning during intervention for feeding disorders because context changes are often necessary for intervention generality and maintenance (Podlesnik et al., 2017). In the current study, we tested for renewal and evaluated a renewal-mitigation procedure when we transferred intervention from a therapist to a caregiver, from clinic to the home, and changed the foods the feeder presented. We used an ABA arrangement to evaluate the generality of the renewal effect with 7 participants who engaged in inappropriate mealtime behavior. Context A was functional reinforcement. Context B was function-based extinction during the control and mitigation conditions and our renewal-mitigation procedure in the mitigation condition. The renewal test was function-based extinction in Context A. We observed renewal of inappropriate mealtime behavior in 4 of 7 participants, and our renewal-mitigation procedure was effective for 4 of 4 participants.

Renewal of goal direction with a context change after habit learning

An instrumental action can be goal-directed after a moderate amount of practice and then convert to habit after more extensive practice. Recent evidence suggests, however, that habits can return to action status after different environmental manipulations. The present experiments therefore asked whether habit learning interferes with goal direction in a context-dependent manner like other types of retroactive interference (e.g., extinction, punishment, counterconditioning). In Experiment 1, rats were given a moderate amount of instrumental training to form an action in one context (Context A) and then more extended training of the same response to form a habit in another context (Context B). We then performed reinforcer devaluation with taste aversion conditioning in both contexts, and tested the response in both contexts. The response remained habitual in Context B, but was goal-directed in Context A, indicating renewal of goal direction after habit learning. Experiment 2 expanded on Experiment 1 by testing the response in a third context (Context C). It found that the habitual response also renewed as action in this context. Together, the results establish a parallel between habit and extinction learning: Conversion to habit does not destroy action knowledge, but interferes with it in a context-specific way. They are also consistent with other results suggesting that habit is specific to the context in which it is learned, whereas goal-direction can transfer between contexts. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

The impact of three weeks of pre-quit varenicline on reinforcing value and craving for cigarettes in a laboratory choice procedure

RATIONALE

Varenicline, a partial nicotinic agonist, is theorized to attenuate pre-quit smoking reinforcement and post-quit withdrawal and craving. However, the mechanisms of action have not been fully characterized, as most studies employ only retrospective self-report measures, hypothetical indices of reinforcing value, and/or nontreatment-seeking samples.

OBJECTIVES

The current research examined the impact of pre-quit varenicline (vs. placebo) on laboratory measures of smoking and food (vs. water) reinforcement and craving.

METHODS

Participants were 162 treatment-seeking smokers enrolled in a randomized controlled trial of smoking cessation ( clinicaltrials.gov ID: NCT03262662). Participants completed two laboratory sessions: a pre-treatment session, ~ 1 week prior to beginning varenicline or placebo, and an active treatment session, after ~ 3 weeks of treatment. At each session, participants completed a laboratory choice procedure; on each of 36 trials, a lit cigarette, food item, or cup of water was randomly presented. Participants reported level of craving and spent $0.01-0.25 to have a corresponding 5-95% chance to sample the cue.

RESULTS

As predicted, spending was significantly higher on cigarette trials than water trials, and varenicline resulted in a greater between-session decline in spending on cigarette trials (but not water) than did placebo. Cigarette craving was enhanced in the presence of smoking cues compared to water, but neither average (tonic) cigarette craving nor cue-specific cigarette craving was significantly influenced by varenicline. Food spending and craving were generally unaffected by varenicline treatment.

CONCLUSIONS

These laboratory data from treatment-seeking smokers provide the strongest evidence to date that varenicline selectively attenuates smoking reinforcement prior to quitting.

Reward-Related Attentional Capture Moderates the Association between Fear-Driven Motives and Heavy Drinking

BACKGROUND

To date, there has been little investigation on how motivational and cognitive mechanisms interact to influence problematic drinking behaviours. Towards this aim, the current study examined whether reward-related attentional capture is associated with reward, fear (relief), and habit drinking motives, and further, whether it interacts with these motives in relation to problematic drinking patterns.

METHODS

Ninety participants (mean age = 34.8 years, SD = 9.1, 54% male) who reported having consumed alcohol in the past month completed an online visual search task that measured reward-related attentional capture as well as the Habit Reward Fear Scale, a measure of drinking motives. Participants also completed measures of psychological distress, impulsivity, compulsive drinking, and consumption items of Alcohol Use Disorders Identification Test. Regression analyses examined the associations between motives for alcohol consumption and reward-related attentional capture, as well as the associations between reward-related attentional capture, motives, and their interaction, with alcohol consumption and problems.

RESULTS

Greater reward-related attentional capture was associated with greater reward motives. Further, reward-related attentional capture also interacted with fear motives in relation to alcohol consumption. Follow-up analyses showed that this interaction was driven by greater fear motives being associated with heavier drinking among those with lower reward-related attentional capture (i.e., "goal-trackers").

CONCLUSION

These findings have implications for understanding how cognition may interact with motives in association with problematic drinking. Specifically, the findings highlight different potential pathways to problematic drinking according to an individual's cognitive-motivational profile and may inform tailored interventions to target profile-specific mechanisms. Finally, these findings offer support for contemporary models of addiction that view excessive goal-directed behaviour under negative affect as a critical contributor to addictive behaviours.

Prolonged avoidance training exacerbates OCD-like behaviors in a rodent model

Obsessive-compulsive disorder (OCD) is characterized by compulsive behaviors that often resemble avoidance of perceived danger. OCD can be treated with exposure-with-response prevention (ERP) therapy in which patients are exposed to triggers but are encouraged to refrain from compulsions, to extinguish compulsive responses. The compulsions of OCD are strengthened by many repeated exposures to triggers, but little is known about the effects of extended repetition of avoidance behaviors on extinction. Here we assessed the extent to which overtraining of active avoidance affects subsequent extinction-with-response prevention (Ext-RP) as a rodent model of ERP, in which rats are extinguished to triggers, while the avoidance option is prevented. Male rats conditioned for 8d or 20d produced similar avoidance behavior to a tone paired with a shock, however, the 20d group showed a severe impairment of extinction during Ext-RP, as well as heightened anxiety. Furthermore, the majority of overtrained (20d) rats (75%) exhibited persistent avoidance following Ext-RP. In the 8d group, only a minority of rats (37%) exhibited persistent avoidance, and this was associated with elevated activity (c-Fos) in the prelimbic cortex and nucleus accumbens. In the 20d group, the minority of non-persistent rats (25%) showed elevated activity in the insular-orbital cortex and paraventricular thalamus. Lastly, extending the duration of Ext-RP prevented the deleterious effects of overtraining on extinction and avoidance. These rodent findings suggest that repeated expression of compulsion-like behaviors biases individuals toward persistent avoidance and alters avoidance circuits, thereby reducing the effectiveness of current extinction-based therapies.

Occasion setters determine responses of putative DA neurons to discriminative stimuli

Midbrain dopamine (DA) neurons are involved in the processing of rewards and reward-predicting stimuli, possibly analogous to reinforcement learning reward prediction errors. Here we studied the activity of putative DA neurons (n = 37) recorded in the ventral tegmental area of rats (n = 6) performing a behavioural task involving occasion setting. In this task an occasion setter (OS) indicated that the relationship between a discriminative stimulus (DS) and reinforcement is in effect, so that reinforcement of bar pressing occurred only after the OS (tone or houselight) was followed by the DS (houselight or tone). We found that responses of putative DA cells to the DS were enhanced when preceded by the OS, as were behavioural responses to obtain rewards. Surprisingly though, we did not find a homogeneous increase in the mean activity of the population of putative DA neurons to the OS, contrary to predictions of standard temporal-difference models of DA neurons. Instead, putative DA neurons exhibited a heterogeneous response on a single unit level, so that some units increased and others decreased their activity as a response to the OS. Similarly, putative non-DA cells did not show a homogeneous response to the DS on a population level, but also had heterogeneous responses on a single unit level. The heterogeneity in the responses of neurons in the ventral tegmental area may reflect how DA neurons encode context and point to local differences in DA signalling.

Reduced renewal of conditioned suppression following lesions of the dorsal hippocampus in male rats

Extinguished responding will renew when the conditioned stimulus occurs outside the extinction context. Although studies of conditioned freezing have consistently demonstrated a role for the hippocampus in renewal, several studies have demonstrated intact renewal of conditioned suppression despite damage to the hippocampus (Frohardt, Guarraci, & Bouton, 2000; Todd, Jiang, DeAngeli, & Bucci, 2017; Wilson, Brooks, & Bouton, 1995). Because these prior studies have examined renewal when testing occurred in the original conditioning context ("Context A"), the present conditioned suppression experiments examined the role of the hippocampus when testing occurred in a context not associated with prior conditioning ("Context C"). In Experiments 1 and 2, conditioning occurred in Context A, and extinction in Context B. Renewal of conditioned suppression was observed when the extinguished conditioned stimulus (CS) was tested in Context C. However, renewal was attenuated in rats with lesions of the dorsal hippocampus (DH). Summation testing failed to detect conditioned inhibition in the extinction context, suggesting instead that the context acquired negative occasion-setting properties. Attenuated renewal was not due to an inability of DH lesioned rats to discriminate contexts (Experiment 3). These experiments thus demonstrate a role for the DH in renewal of conditioned suppression when testing occurs in a neutral context. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Context and renewal of habits and goal-directed actions after extinction

Instrumental behaviors that are goal-directed actions after moderate amounts of training can become habits after more extended training. Little research has asked how actions and habits are affected by retroactive interference treatments like extinction. The present experiments begin to fill this gap in the literature. In Experiments 1a and 1b, lever pressing in rats was minimally trained (1a) or extensively trained (1b) in one context (Context A), extinguished in a second context (Context B), and then tested in the acquisition context (Context A). Exposure to both contexts was equated and controlled throughout, and the status of the behavior as action or habit was determined by reinforcer devaluation methods (taste aversion conditioning). Results confirmed that action (1a) and habit (1b) renewed with action or habit status, respectively, when they were returned to Context A. Experiments 2a and 2b then similarly tested action and habit after extinction in an ABC renewal paradigm. Here, lever pressing that was trained in Context A and extinguished in Context B renewed as action in Context C regardless of whether it had been an action or habit before extinction. The apparent conversion of habit to action during renewal testing in Context C was consistent with other results suggesting that habits converted to action when the context was changed at the start of extinction. Together, the results suggest that extinction in a second context inhibits instrumental behaviors trained as either actions or habits in a context-specific manner. They also expand on prior findings suggesting that actions transfer across contexts, and that habits do not. A change of context may be sufficient to convert a habit to goal-directed action. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Extinction training can make the extinction context a stimulus-specific inhibitor: A potential mechanism of experimental renewal

Renewal is the recovery of extinguished responding to a conditioned stimulus when testing occurs outside the extinction context. Renewal has been explained as the extinction context becoming a negative occasion setter during extinction. However, other mechanisms may contribute. Two recent studies showed (a) after extinction of a discrete cue, the extinction context can serve as a conditioned inhibitor, and (b) in some circumstances operational extinction of a conditioned inhibitor can reduce inhibition with respect to a transfer excitor while retaining inhibition with respect to the excitor used in inhibitory training. Here we examine the potential contribution of these phenomena to renewal. In the present experiment, all rats received fear-conditioning with a target cue in one context and extinction of that cue in a second context. Then half of the subjects received massive extinction of the extinction context (i.e., 24 h) while the other half received only handling. Finally, some subjects in each condition were tested for responding to the target cue in the extinction context, others in a second familiar context, and yet others in a third transfer context in which another fear cue had been extinguished. The results showed ABC renewal independent of whether subjects had or had not received context extinction. However, transfer of the inhibitory potential of the extinction context was observed only in subjects that did not receive context extinction. These results suggest an extinction context can serve as a stimulus-specific conditioned inhibitor, thereby contributing to renewal by decreasing responding to the target cue in an ABB control condition.

Reward-related attentional capture and cognitive inflexibility interact to determine greater severity of compulsivity-related problems

BACKGROUND AND OBJECTIVES

Neurocognitive processes are key drivers of addictive and compulsive disorders. The current study examined whether reward-related attentional capture and cognitive inflexibility are associated with impulsive and/or compulsive personality traits, and whether these cognitive characteristics interact to predict greater compulsivity-related problems across obsessive-compulsive and drinking behaviors.

METHODS

One-hundred and seventy-three participants (mean age = 34.5 years, S.D = 8.4, 42% female) completed an online visual search task to measure reward-related attentional capture and its persistence following reversal of stimulus-reward contingencies. Participants also completed questionnaires to assess trait impulsivity, compulsivity, alcohol use, and obsessive-compulsive behaviors.

RESULTS

Greater reward-related attentional capture was associated with trait compulsivity, over and above all impulsivity dimensions, while greater cognitive inflexibility was associated with higher negative urgency (distress-elicited impulsivity). Reward-related attentional capture and cognitive inflexibility interacted to predict greater compulsivity-related problems among participants who reported obsessive-compulsive behaviors in the past month (n = 57) as well as current drinkers (n = 88). Follow-up analyses showed that, for OCD behaviors, this interaction was driven by an association between higher reward-related attentional capture and more problematic behaviors among cognitively inflexible participants only. For drinking, the same pattern was seen, albeit at trend level.

LIMITATIONS

This study includes a non-clinical, online sample and is cross-sectional, thus its findings need to be interpreted with these limitations in mind.

CONCLUSIONS

Reward-related attentional capture and cognitive flexibility are related to trait compulsivity and impulsivity (negative urgency) respectively, and interact to determine more problematic behaviors.