A neural substrate of sex-dependent modulation of motivation

Dopaminergic lesions of the anterior cingulate cortex of rats increase vulnerability to salient distractors

The anterior cingulate cortex (ACC) has been shown to be critical to many aspects of executive function including filtering irrelevant information, updating response contingencies when reinforcement contingencies change and stabilizing task sets. Nonspecific lesions to this region in rats produce a vulnerability to distractors that have gained salience through prior associations with reinforcement. These lesions also exacerbate cognitive fatigue in tests of sustained attention but do not produce global attentional impairments nor do they produce distractibility to novel distractors that do not have a prior association with reinforcement. To determine the neurochemical basis of these cognitive impairments, dopaminergically selective lesions of the ACC were made in both male and female Long-Evans, hooded rats prior to assessment in two attentional tasks. Dopaminergic lesions of the ACC increase the vulnerability of subjects to previously reinforced distractors and impede formation of an attentional set. Lesioned rats were not more susceptible to the effects of novel, irrelevant stimuli in a test of sustained attention as has been previously shown. Additionally, the effects of dopaminergic lesions were found to differ based on sex. Lesioned female, but not male, rats were more vulnerable than sham-lesioned females to the effects of prolonged testing and the removal of reinforcement during a test of sustained attention. Together, these data support the hypothesis that dopamine in the ACC is critical to filtering distractors whose salience has been gained through reinforcement.

Anterior cingulate cortex projections to the dorsal medial striatum underlie insomnia associated with chronic pain

Chronic pain often leads to the development of sleep disturbances. However, the precise neural circuit mechanisms responsible for sleep disorders in chronic pain have remained largely unknown. Here, we present compelling evidence that hyperactivity of pyramidal neurons (PNs) in the anterior cingulate cortex (ACC) drives insomnia in a mouse model of nerve-injury-induced chronic pain. After nerve injury, ACC PNs displayed spontaneous hyperactivity selectively in periods of insomnia. We then show that ACC PNs were both necessary for developing chronic-pain-induced insomnia and sufficient to mimic sleep loss in naive mice. Importantly, combining optogenetics and electrophysiological recordings, we found that the ACC projection to the dorsal medial striatum (DMS) underlies chronic-pain-induced insomnia through enhanced activity and plasticity of ACC-DMS dopamine D1R neuron synapses. Our findings shed light on the pivotal role of ACC PNs in developing chronic-pain-induced sleep disorders.

A special role for anterior cingulate cortex, but not orbitofrontal cortex or basolateral amygdala, in choices involving information

Subjects are often willing to pay a cost for information. In a procedure that promotes paradoxical choices, animals choose between a richer option followed by a cue that is rewarded 50% of the time (No Info) vs. a leaner option followed by one of two cues that signal certain outcomes: one always rewarded (100%) and the other never rewarded, 0% (Info). Since decisions involve comparing the subjective value of options after integrating all their features, preference for information may rely on cortico-amygdalar circuitry. To test this, male and female rats were prepared with bilateral inhibitory Designer Receptors Exclusively Activated by Designer Drugs (DREADDs) in the anterior cingulate cortex, orbitofrontal cortex, basolateral amygdala, or null virus (control). We inhibited these regions after stable preference was acquired. We found that inhibition of the anterior cingulate cortex destabilized choice preference in female rats without affecting latency to choose or response rate to cues. A logistic regression fit revealed that previous choice predicted current choice in all conditions, however previously rewarded Info trials strongly predicted preference in all conditions except in female rats following anterior cingulate cortex inhibition. The results reveal a causal, sex-dependent role for the anterior cingulate cortex in decisions involving information.

Appetitively motivated tasks in the IntelliCage reveal a higher motivational cost of spatial learning in male than female mice

The IntelliCage (IC) permits the assessment of the behavior and learning abilities of mice in a social home cage context. To overcome water deprivation as an aversive driver of learning, we developed protocols in which spatial learning is motivated appetitively by the preference of mice for sweetened over plain water. While plain water is available at all times, only correct task responses give access to sweetened water rewards. Under these conditions, C57BL/6J mice successfully mastered a corner preference task with the reversal and also learned a more difficult time-place task with reversal. However, the rate of responding to sweetened water decreased strongly with increasing task difficulty, indicating that learning challenges and reduced success in obtaining rewards decreased the motivation of the animals to seek sweetened water. While C57BL/6J mice of both sexes showed similar initial taste preferences and learned similarly well in simple learning tasks, the rate of responding to sweetened water and performance dropped more rapidly in male than in female mice in response to increasing learning challenges. Taken together, our data indicate that male mice can have a disadvantage relative to females in mastering difficult, appetitively motivated learning tasks, likely due to sex differences in value-based decision-making.

Dissociable Contributions of Basolateral Amygdala and Ventrolateral Orbitofrontal Cortex to Flexible Learning Under Uncertainty

Reversal learning measures the ability to form flexible associations between choice outcomes with stimuli and actions that precede them. This type of learning is thought to rely on several cortical and subcortical areas, including the highly interconnected orbitofrontal cortex (OFC) and basolateral amygdala (BLA), and is often impaired in various neuropsychiatric and substance use disorders. However, the unique contributions of these regions to stimulus- and action-based reversal learning have not been systematically compared using a chemogenetic approach particularly before and after the first reversal that introduces new uncertainty. Here, we examined the roles of ventrolateral OFC (vlOFC) and BLA during reversal learning. Male and female rats were prepared with inhibitory designer receptors exclusively activated by designer drugs targeting projection neurons in these regions and tested on a series of deterministic and probabilistic reversals during which they learned about stimulus identity or side (left or right) associated with different reward probabilities. Using a counterbalanced within-subject design, we inhibited these regions prior to reversal sessions. We assessed initial and pre-/post-reversal changes in performance to measure learning and adjustments to reversals, respectively. We found that inhibition of the ventrolateral orbitofrontal cortex (vlOFC), but not BLA, eliminated adjustments to stimulus-based reversals. Inhibition of BLA, but not vlOFC, selectively impaired action-based probabilistic reversal learning, leaving deterministic reversal learning intact. vlOFC exhibited a sex-dependent role in early adjustment to action-based reversals, but not in overall learning. These results reveal dissociable roles for BLA and vlOFC in flexible learning and highlight a more crucial role for BLA in learning meaningful changes in the reward environment.

Neural circuit models for evidence accumulation through choice-selective sequences

Decision making is traditionally thought to be mediated by populations of neurons whose firing rates persistently accumulate evidence across time. However, recent decision-making experiments in rodents have observed neurons across the brain that fire sequentially as a function of spatial position or time, rather than persistently, with the subset of neurons in the sequence depending on the animal's choice. We develop two new candidate circuit models, in which evidence is encoded either in the relative firing rates of two competing chains of neurons or in the network location of a stereotyped pattern ("bump") of neural activity. Encoded evidence is then faithfully transferred between neuronal populations representing different positions or times. Neural recordings from four different brain regions during a decision-making task showed that, during the evidence accumulation period, different brain regions displayed tuning curves consistent with different candidate models for evidence accumulation. This work provides mechanistic models and potential neural substrates for how graded-value information may be precisely accumulated within and transferred between neural populations, a set of computations fundamental to many cognitive operations.

A special role for anterior cingulate cortex, but not orbitofrontal cortex or basolateral amygdala, in choices involving information

Subjects often are willing to pay a cost for information. In a procedure that promotes paradoxical choices, animals choose between a richer option followed by a cue that is rewarded 50% of the time (No-info) vs a leaner option followed by one of two cues that signal certain outcomes: one always rewarded (100%), and the other never rewarded, 0% (Info). Since decisions involve comparing the subjective value of options after integrating all their features, preference for information may rely on cortico-amygdalar circuitry. To test this, male and female rats were prepared with bilateral inhibitory DREADDs in the anterior cingulate cortex (ACC), orbitofrontal cortex (OFC), basolateral amygdala (BLA), or null virus (control). We inhibited these regions after stable preference was acquired. We found that inhibition of ACC destabilized choice preference in female rats without affecting latency to choose or response rate to cues. A logistic regression fit revealed that the previous choice strongly predicted preference in control animals, but not in female rats following ACC inhibition. The results reveal a causal, sex-dependent role for ACC in decisions involving information.

Dynamic Foraging Behavior Performance Is Not Affected by Scn2a Haploinsufficiency

Dysfunction in the gene SCN2A, which encodes the voltage-gated sodium channel Nav1.2, is strongly associated with neurodevelopmental disorders including autism spectrum disorder and intellectual disability (ASD/ID). This dysfunction typically manifests in these disorders as a haploinsufficiency, where loss of one copy of a gene cannot be compensated for by the other allele. Scn2a haploinsufficiency affects a range of cells and circuits across the brain, including associative neocortical circuits that are important for cognitive flexibility and decision-making behaviors. Here, we tested whether Scn2a haploinsufficiency has any effect on a dynamic foraging task that engages such circuits. Scn2a +/- mice and wild-type (WT) littermates were trained on a choice behavior where the probability of reward between two options varied dynamically across trials and where the location of the high reward underwent uncued reversals. Despite impairments in Scn2a-related neuronal excitability, we found that both male and female Scn2a +/- mice performed these tasks as well as wild-type littermates, with no behavioral difference across genotypes in learning or performance parameters. Varying the number of trials between reversals or probabilities of receiving reward did not result in an observable behavioral difference, either. These data suggest that, despite heterozygous loss of Scn2a, mice can perform relatively complex foraging tasks that make use of higher-order neuronal circuits.

Divergent reward cue representations in the prefrontal cortex drive reward motivation in adolescence and adulthood

Alterations in motivation and reward-seeking are a transdiagnostic feature of numerous psychiatric disorders that commonly emerge in adolescence, including depression, obsessive- compulsive disorder, and attention deficit hyperactivity disorder. During adolescence, reward motivation is naturally heightened, compared to adulthood, but the underlying mechanisms are not well understood. The medial prefrontal cortex (mPFC) is a late developing brain region that regulates reward learning and motivation and is still maturing in adolescence. The mPFC modulates reward-motivated behaviors in adults, and has been hypothesized to be responsible for adolescents' inability to suppress reward-seeking and impulsive behaviors. Using 2-photon imaging of the mPFC and an active reward task, we demonstrate that both the adult and adolescent mPFC encode reward-predictive cues, with distinct neuronal populations encoding rewarded and unrewarded cues. In adolescence the mPFC is hyper-responsive to reward cues and recruits a larger population of neurons to encode reward predictive cues. Furthermore, in the adolescent mPFC, representations of unrewarded cues are attenuated, compared to the adult mPFC, which may tip the balance of action toward reward-seeking. Differences in neuronal responses to rewarded and unrewarded cues were observed in both GABAergic and glutamatergic neurons, with GABAergic inhibition causing disparate effects in adolescents compared to adults. Together our findings identify differences in the functional properties of mPFC microcircuits in adolescents that may underlie differences in reward-seeking behavior and the ability to adaptively suppress reward seeking.

Dissociable contributions of basolateral amygdala and ventrolateral orbitofrontal cortex to flexible learning under uncertainty

Reversal learning measures the ability to form flexible associations between choice outcomes with stimuli and actions that precede them. This type of learning is thought to rely on several cortical and subcortical areas, including highly interconnected orbitofrontal cortex (OFC) and basolateral amygdala (BLA), and is often impaired in various neuropsychiatric and substance use disorders. However, unique contributions of these regions to stimulus- and action-based reversal learning have not been systematically compared using a chemogenetic approach and particularly before and after the first reversal that introduces new uncertainty. Here, we examined the roles of ventrolateral OFC (vlOFC) and BLA during reversal learning. Male and female rats were prepared with inhibitory DREADDs targeting projection neurons in these regions and tested on a series of deterministic and probabilistic reversals during which they learned about stimulus identity or side (left or right) associated with different reward probabilities. Using a counterbalanced within-subject design, we inhibited these regions prior to reversal sessions. We assessed initial and pre-post reversal changes in performance to measure learning and adjustments to reversals, respectively. We found that inhibition of vlOFC, but not BLA, eliminated adjustments to stimulus-based reversals. Inhibition of BLA, but not vlOFC, selectively impaired action-based probabilistic reversal learning, leaving deterministic reversal learning intact. vlOFC exhibited a sex-dependent role in early adjustment to action-based reversals, but not in overall learning. These results reveal dissociable roles for BLA and vlOFC in flexible learning and highlight a more crucial role for BLA in learning meaningful changes in the reward environment.

A comprehensive assay of social motivation reveals sex-specific roles of autism-associated genes and oxytocin

Social motivation is critical to the development of typical social functioning. Social motivation, specifically one or more of its components (e.g., social reward seeking or social orienting), could be relevant for understanding phenotypes related to autism. We developed a social operant conditioning task to quantify effort to access a social partner and concurrent social orienting in mice. We established that mice will work for access to a social partner, identified sex differences, and observed high test-retest reliability. We then benchmarked the method with two test-case manipulations. Shank3B mutants exhibited reduced social orienting and failed to show social reward seeking. Oxytocin receptor antagonism decreased social motivation, consistent with its role in social reward circuitry. Overall, we believe that this method provides a valuable addition to the assessment of social phenotypes in rodent models of autism and the mapping of potentially sex-specific social motivation neural circuits.