Acquisition of specific response–outcome associations requires NMDA receptor activation in the basolateral amygdala but not in the insular cortex

Medial orbitofrontal neurotrophin systems integrate hippocampal input into outcome-specific value representations

In everyday life, we mentally represent possible consequences of our behaviors and integrate specific outcome values into existing knowledge to inform decisions. The medial orbitofrontal cortex (MO) is necessary to adapt behaviors when outcomes are not immediately available-when they and their values need to be envisioned. Nevertheless, neurobiological mechanisms remain unclear. We find that the neuroplasticity-associated neurotrophin receptor tropomyosin receptor kinase B (TrkB) is necessary for mice to integrate outcome-specific value information into choice behavior. This function appears attributable to memory updating (and not retrieval) and the stabilization of dendritic spines on excitatory MO neurons, which led us to investigate inputs to the MO. Ventral hippocampal (vHC)-to-MO projections appear conditionally necessary for value updating, involved in long-term aversion-based value memory updating. Furthermore, vHC-MO-mediated control of choice is TrkB dependent. Altogether, we reveal a vHC-MO connection by which specific value memories are updated, and we position TrkB within this functional circuit.

Role of anterior insula cortex in context-induced relapse of nicotine-seeking

Tobacco use is the leading cause of preventable death worldwide, and relapse during abstinence remains the critical barrier to successful treatment of tobacco addiction. During abstinence, environmental contexts associated with nicotine use can induce craving and contribute to relapse. The insular cortex (IC) is thought to be a critical substrate of nicotine addiction and relapse. However, its specific role in context-induced relapse of nicotine-seeking is not fully known. In this study, we report a novel rodent model of context-induced relapse to nicotine-seeking after punishment-imposed abstinence, which models self-imposed abstinence through increasing negative consequences of excessive drug use. Using the neuronal activity marker Fos we find that the anterior (aIC), but not the middle or posterior IC, shows increased activity during context-induced relapse. Combining Fos with retrograde labeling of aIC inputs, we show projections to aIC from contralateral aIC and basolateral amygdala exhibit increased activity during context-induced relapse. Next, we used fiber photometry in aIC and observed phasic increases in aIC activity around nicotine-seeking responses during self-administration, punishment, and the context-induced relapse tests. Next, we used chemogenetic inhibition in both male and female rats to determine whether activity in aIC is necessary for context-induced relapse. We found that chemogenetic inhibition of aIC decreased context-induced nicotine-seeking after either punishment- or extinction-imposed abstinence. These findings highlight the critical role nicotine-associated contexts play in promoting relapse, and they show that aIC activity is critical for this context-induced relapse following both punishment and extinction-imposed abstinence.

Prefrontal regulation of behavioural control: Evidence from learning theory and translational approaches in rodents

Everyday activities require adaptive decision-making and control over our actions to achieve our goals. Sub-regions within the cortex are widely reported to regulate these choices. Here we review rodent studies from two disparate fields of instrumental action control - goal-directed and habitual responding, and impulsive and compulsive behaviour. Our aim was to compare findings across the spectrum, from precision associative learning to translational studies of action control. The evidence suggests that each cortical sub-region performs different roles depending on task requirements and, within tasks, clear dissociations exist between regions. Rather than synthesizing a single role or function for a given region, we should consider regions to be capable of many different functions. Further investigation of cortico-cortical connections and the pattern of input and output circuitry within each region may be needed to identify unique process-specific pathways. Despite differences in the scope and purpose of these two fields, integrating evidence across tasks provides a broader context for testing hypotheses about the role of cortical regions in adaptive actions and decision-making.

Striatopallidal adenosine A2A receptors in the nucleus accumbens confer motivational control of goal-directed behavior

The ability to learn the reward-value and action-outcome contingencies in dynamic environment is critical for flexible adaptive behavior and development of effective pharmacological control of goal-directed behaviors represents an important challenge for improving the deficits in goal-directed behavior which may underlie seemingly disparate symptoms across psychiatric disorders. Adenosine A_2A receptor (A_2AR) is emerging as a novel neuromodulatory target for controlling goal-directed behavior for its unique neuromodulatory features: the ability to integrate dopamine and glutamate signaling, the "brake" constraint of various cognitive processes and the balanced control of goal-directed and habit actions. However, the contribution and circuit mechanisms of the striatopallidal A_2ARs in nucleus accumbens (NAc) to control of goal-directed behavior remain to be determined. Here, we employed newly developed opto-A_2AR and the focal A_2AR knockdown strategies to demonstrate the causal role of NAc A_2AR in control of goal-directed behavior. Furthermore, we dissected out multiple distinct behavioral mechanisms underlying which NAc A_2ARs control goal-directed behavior: (i) NAc A_2ARs preferentially control goal-directed behavior at the expense of habit formation. (ii) NAc A_2ARs modify the animals' sensitivity to the value of the reward without affecting the action-outcome contingency. (iii) A_2AR antagonist KW6002 promotes instrumental actions by invigorating motivation. (iv) NAc A_2ARs facilitate Pavlovian incentive value transferring to instrumental action. (v) NAc A_2ARs control goal-directed behavior probably not through NAc-VP pathway. These insights into the behavioral and circuit mechanisms for NAc A_2AR control of goal-directed behavior facilitate translational potential for A_2AR antagonists in reversal of deficits in goal-directed decision-making associated with multiple neuropsychiatric disorders.

Pre-training inactivation of basolateral amygdala and mediodorsal thalamus, but not orbitofrontal cortex or prelimbic cortex, impairs devaluation in a multiple-response/multiple-reinforcer cued operant task

Reinforcer devaluation is a task often used to model flexible goal-directed behavior. Here, we inactivated basolateral amygdala (BLA), orbitofrontal cortex (OFC), mediodorsal thalamus (MD) (Exp. 1) and prelimbic cortex (PL) (Exp. 3) in rats during multiple-response/multiple-reinforcer operant training with levers available to earn reinforcers during cued trials. After two training days with each lever-food relationship, a reinforcer was devalued through selective satiety and devaluation was assessed in a choice test with the brain areas non-inactivated. The control and OFC and PL inactivation groups exhibited a devaluation effect, but the BLA or MD groups did not. Since the OFC is proposed to be required in devaluation tasks when a discrete cue signals an outcome and PL is proposed to be required when responses based on lever spatial-location guide behavior, we ran new rats through a cue-switching experiment (Exp. 2) to determine the strategy rats use to complete our task (attending to the discrete light cue or spatial lever location). Both groups (cue switched and cue normal) showed a devaluation effect based on the lever spatial location, suggesting that rats rely on the spatial lever location to guide behavior. Future studies will determine whether OFC and PL can compensate for each other to show intact devaluation when the functioning of one of them is impaired.

The Basolateral Nucleus of the Amygdala Executes the Parallel Processes of Avoidance and Palatability in the Retrieval of Conditioned Taste Aversion in Male Rats

Conditioned taste aversion (CTA) is an essential behavior for animal survival. Conditioned animals show avoidance and decreased palatability to a conditioned stimulus (CS) on CTA retrieval. In this study, we aimed to determine whether the basolateral nucleus of the amygdala (BLA) is involved in CTA retrieval and whether avoidance and palatability in CTA retrieval are processed in the BLA. We developed an experimental chamber for time-course analysis of the behavior to approach a spout and lick a CS. In this experimental chamber, we analyzed the behavior of male rats following microinjections of GABA_A receptor agonist muscimol or saline into the BLA. The rats showed two types of approach behavior: they either (1) approached and licked the spout or (2) approached but did not lick the spout. Muscimol injection into the BLA decreased the frequency of the latter type of approach behavior, indicating that BLA inactivation reduced avoidance to the CS. The muscimol injection into the BLA also significantly increased the consumption of the CS. Lick microstructure analysis demonstrated that intra-BLA muscimol significantly increased licking burst number and size, indicating that BLA inactivation attenuated aversion to the CS as large burst licking is an indicator of high palatability. These results suggest that the increase in CS consumption with intra-BLA muscimol injection was due to alterations in approach and aversive responses to the CS. Therefore, we conclude that the BLA plays an essential role in CTA retrieval by parallel processing of avoidance and palatability.

The role of serotonin 1B in the representation of outcomes

Disrupted serotonin neurotransmission has been implicated in the etiology of psychopathic traits. Empirical research has found that people with high levels of psychopathic traits have a deficit in reinforcement learning that is thought to be linked with amygdala dysfunction. Altered serotonin neurotransmission provides a plausible explanation for amygdala dysfunction in psychopathic traits and recent research suggests that this may be associated with serotonin 1B (5-HT_1B) receptor function. This research used an animal model to test the hypothesis that 5-HT_1B receptors are involved in the encoding of the specific features of reinforcing outcomes. An outcome devaluation task was used to test the effect of the systemic administration of a selective 5-HT_1B receptor agonist administered before encoding of “action-outcome” associations. Results showed that while administration of a 5-HT_1B receptor agonist allowed rats to acquire instrumental responding for food, when the content of that learning was further probed using an outcome devaluation task, performance differed from controls. 5-HT_1B agonism impaired learning about the specific sensory qualities of food rewards associated with distinct instrumental responses, required to direct choice performance when the value of one outcome changed. These findings suggest a role for 5-HT_1B receptor function in the encoding of the specific features of reinforcing outcomes.

Insular and Ventrolateral Orbitofrontal Cortices Differentially Contribute to Goal-Directed Behavior in Rodents

The medial prefrontal cortex (mPFC) has long been considered a critical site in action control. However, recent evidence indicates that the contribution of cortical areas to goal-directed behavior likely extends beyond mPFC. Here, we examine the function of both insular (IC) and ventrolateral orbitofrontal (vlOFC) cortices in action-dependent learning. We used chemogenetics to study the consequences of IC or vlOFC inhibition on acquisition and performance of instrumental actions using the outcome devaluation task. Rats first learned to associate actions with desirable outcomes. Then, one of these outcomes was devalued and we assessed the rats' choice between the 2 actions. Typically, rats will bias their selection towards the action that delivers the still valued outcome. We show that chemogenetic-induced inhibition of IC during choice abolishes goal-directed control whereas inhibition during instrumental acquisition is without effect. IC is therefore necessary for action selection based on current outcome value. By contrast, vlOFC inhibition during acquisition or the choice test impaired goal-directed behavior but only following a shift in the instrumental contingencies. Our results provide clear evidence that vlOFC plays a critical role in action-dependent learning, which challenges the popular idea that this region of OFC is exclusively involved in stimulus-dependent behaviors.