Neurophysiology of rule switching in the corticostriatal circuit

Enhanced cognitive flexibility and phasic striatal dopamine dynamics in a mouse model of low striatal tonic dopamine

The catecholamine neuromodulators dopamine and norepinephrine are implicated in motor function, motivation, and cognition. Although roles for striatal dopamine in these aspects of behavior are well established, the specific roles for cortical catecholamines in regulating striatal dopamine dynamics and behavior are less clear. We recently showed that elevating cortical dopamine but not norepinephrine suppresses hyperactivity in dopamine transporter knockout (DAT-KO) mice, which have elevated striatal dopamine levels. In contrast, norepinephrine transporter knockout (NET-KO) mice have a phenotype distinct from DAT-KO mice, as they show elevated extracellular cortical catecholamines but reduced baseline striatal dopamine levels. Here we evaluated the consequences of altered catecholamine levels in NET-KO mice on cognitive flexibility and striatal dopamine dynamics. In a probabilistic reversal learning task, NET-KO mice showed enhanced reversal learning, which was consistent with larger phasic dopamine transients (dLight) in the dorsomedial striatum (DMS) during reward delivery and reward omission, compared to WT controls. Selective depletion of dorsal medial prefrontal cortex (mPFC) norepinephrine in WT mice did not alter performance on the reversal learning task but reduced nestlet shredding. Surprisingly, NET-KO mice did not show altered breakpoints in a progressive ratio task, suggesting intact food motivation. Collectively, these studies show novel roles of cortical catecholamines in the regulation of tonic and phasic striatal dopamine dynamics and cognitive flexibility, updating our current views on dopamine regulation and informing future therapeutic strategies to counter multiple psychiatric disorders.

Inactivation of medial or lateral orbitofrontal cortex during fear extinction did not interfere with fear renewal

Hyperactive orbitofrontal cortical activation is commonly seen in patients of obsessive-compulsive disorder (OCD). Previous studies from our laboratory showed that for rats with aberrant activation of the orbitofrontal cortex (OFC) during the extinction phase, they were unable to use contexts as the reference for proper retrieval of fear memory during renewal test. This result supported the phenomenon that many OCD patients show poor regulation of fear-related behavior. Since there are robust anatomical connections of the OFC with the fear-circuit, we aim to further examine whether the OFC is actively engaged in fear regulation under normal circumstances. In this study, the lateral or medial OFC was inactivated during the extinction phase using the ABA fear renewal procedure. We found that these animals showed intact fear renewal during retrieval test with their freezing levels equivalent to the control rats, revealing that the OFC did not have decisive roles in extinction acquisition. Together with our previous study, we suggest that the OFC only interferes with fear regulation when it becomes pathophysiologically hyperactive.

Activation of prefrontal cortex and striatal regions in rats after shifting between rules in a T-maze

Prefrontal cortical and striatal areas have been identified by inactivation or lesion studies to be required for behavioral flexibility, including selecting and processing of different types of information. In order to identify these networks activated selectively during the acquisition of new reward contingency rules, rats were trained to discriminate orientations of bars presented in pseudorandom sequence on two video monitors positioned behind the goal sites on a T-maze with return arms. A second group already trained in the visual discrimination task learned to alternate left and right goal arm visits in the same maze while ignoring the visual cues still being presented. In each experimental group, once the rats reached criterion performance, the brains were prepared after a 90-min delay for later processing for c-fos immunohistochemistry. While both groups extinguished a prior strategy and acquired a new rule, they differed by the identity of the strategies and previous learning experience. Among the 28 forebrain areas examined, there were significant increases in the relative density of c-fos immunoreactive cell bodies after learning the second rule in the prefrontal cortex cingulate, the prelimbic and infralimbic areas, the dorsomedial striatum and the core of the nucleus accumbens, the ventral subiculum, and the central nucleus of the amygdala. These largely correspond to structures previously identified in inactivation studies, and their neurons fire synchronously during learning and strategy shifts. The data suggest that this dynamic network may underlie reward-based selection for action-a type of cognitive flexibility.

Exploration behavior after reversals is predicted by STN-GPe synaptic plasticity in a basal ganglia model

Humans can quickly adapt their behavior to changes in the environment. Classical reversal learning tasks mainly measure how well participants can disengage from a previously successful behavior but not how alternative responses are explored. Here, we propose a novel 5-choice reversal learning task with alternating position-reward contingencies to study exploration behavior after a reversal. We compare human exploratory saccade behavior with a prediction obtained from a neuro-computational model of the basal ganglia. A new synaptic plasticity rule for learning the connectivity between the subthalamic nucleus (STN) and external globus pallidus (GPe) results in exploration biases to previously rewarded positions. The model simulations and human data both show that during experimental experience exploration becomes limited to only those positions that have been rewarded in the past. Our study demonstrates how quite complex behavior may result from a simple sub-circuit within the basal ganglia pathways.

Acute psilocybin enhances cognitive flexibility in rats

Psilocybin has been shown to improve symptoms of depression and anxiety when combined with psychotherapy or other clinician-guided interventions. To understand the neural basis for this pattern of clinical efficacy, experimental and conceptual approaches that are different than traditional laboratory models of anxiety and depression are needed. A potential novel mechanism is that acute psilocybin improves cognitive flexibility, which then enhances the impact of clinician-assisted interventions. Consistent with this idea, we find that acute psilocybin robustly improves cognitive flexibility in male and female rats using a task where animals switched between previously learned strategies in response to uncued changes in the environment. Psilocybin did not influence Pavlovian reversal learning, suggesting that its cognitive effects are selective to enhanced switching between previously learned behavioral strategies. The serotonin (5HT) 2 A receptor antagonist ketanserin blocked psilocybin's effect on set-shifting, while a 5HT2C-selective antagonist did not. Ketanserin alone also improved set-shifting performance, suggesting a complex relationship between psilocybin's pharmacology and its impact on flexibility. Further, the psychedelic drug 2,5-Dimethoxy-4-iodoamphetamine (DOI) impaired cognitive flexibility in the same task, suggesting that this effect of psilocybin does not generalize to all other serotonergic psychedelics. We conclude that the acute impact of psilocybin on cognitive flexibility provides a useful behavioral model to investigate its neuronal effects relevant to its positive clinical outcome.

Acute psilocybin enhances cognitive flexibility in rats

Psilocybin has been shown to improve symptoms of depression and anxiety when combined with psychotherapy or other clinician-guided interventions. To understand the neural basis for this pattern of clinical efficacy, experimental and conceptual approaches that are different than traditional laboratory models of anxiety and depression are needed. A potential novel mechanism is that acute psilocybin improves cognitive flexibility, which then enhances the impact of clinician-assisted interventions. Consistent with this idea, we find that acute psilocybin robustly improves cognitive flexibility in male and female rats using a task where animals switched between previously learned strategies in response to uncued changes in the environment. Psilocybin did not influence Pavlovian reversal learning, suggesting that its cognitive effects are selective to enhanced switching between previously learned behavioral strategies. The serotonin (5HT) 2A receptor antagonist ketanserin blocked psilocybin's effect on set-shifting, while a 5HT2C-selective antagonist did not. Ketanserin alone also improved set-shifting performance, suggesting a complex relationship between psilocybin's pharmacology and its impact on flexibility. Further, the psychedelic drug 2,5-Dimethoxy-4-iodoamphetamine (DOI) impaired cognitive flexibility in the same task, suggesting that this effect of psilocybin does not generalize to all other serotonergic psychedelics. We conclude that the acute impact of psilocybin on cognitive flexibility provides a useful behavioral model to investigate its neuronal effects relevant to its positive clinical outcome.

Cognitive, Graphomotor, and Psychosocial Challenges in Pediatric Autoimmune Neuropsychiatric Disorders Associated With Streptococcal Infections (PANDAS)

OBJECTIVES

Pediatric autoimmune neuropsychiatric disorders associated with streptococcal infection (PANDAS) is characterized by the sudden onset of obsessive-compulsive disorder (OCD) and other neurobehavioral symptoms following group A streptococcal infection. The cardinal neuropsychiatric symptoms are believed to reflect an aberrant autoimmune or inflammatory response that may selectively disrupt basal ganglia function. The investigators examined whether neuropsychological skills associated with frontostriatal networks (executive functions and motor skills) are affected in patients with PANDAS following resolution of acute symptoms and the degree to which there are persistent social, emotional, and academic difficulties.

METHODS

Twenty-seven patients ages 6-14 years (mean age=9.63 years [SD=1.78]; male, N=22) completed neuropsychological testing as part of routine clinical care. Performances on measures of intellectual ability, executive function, motor skills, and academic skills are reported, as well as parent-reported emotional, behavioral, and social skills.

RESULTS

On neuropsychological measures, patients exhibited average intellectual functioning with relative and mild difficulties in skills supporting cognitive efficiency, including attentional regulation, inhibitory control, and processing speed. Dexterity was normal but graphomotor skills were reduced. Core reading, math, and writing skills were within expectations, but reading and math fluency were reduced, and the majority of patients received special education services or accommodations. Parents reported high levels of concern about anxiety, depression, inattention, hyperactivity, and social skills.

CONCLUSIONS

These findings indicated relative difficulties with aspects of executive and motor functions. Although evaluations were performed following the resolution of acute symptoms, ongoing and significant academic difficulties and emotional, behavioral, and social concerns were targets for clinical intervention and support.

The rodent medial prefrontal cortex and associated circuits in orchestrating adaptive behavior under variable demands

Emerging evidence implicates rodent medial prefrontal cortex (mPFC) in tasks requiring adaptation of behavior to changing information from external and internal sources. However, the computations within mPFC and subsequent outputs that determine behavior are incompletely understood. We review the involvement of mPFC subregions, and their projections to the striatum and amygdala in two broad types of tasks in rodents: 1) appetitive and aversive Pavlovian and operant conditioning tasks that engage mPFC-striatum and mPFC-amygdala circuits, and 2) foraging-based tasks that require decision making to optimize reward. We find support for region-specific function of the mPFC, with dorsal mPFC and its projections to the dorsomedial striatum supporting action control with higher cognitive demands, and ventral mPFC engagement in translating affective signals into behavior via discrete projections to the ventral striatum and amygdala. However, we also propose that defined mPFC subdivisions operate as a functional continuum rather than segregated functional units, with crosstalk that allows distinct subregion-specific inputs (e.g., internal, affective) to influence adaptive behavior supported by other subregions.

Suppression of pyramidal neuron G protein-gated inwardly rectifying K+ channel signaling impairs prelimbic cortical function and underlies stress-induced deficits in cognitive flexibility in male, but not female, mice

Imbalance in prefrontal cortical (PFC) pyramidal neuron excitation:inhibition is thought to underlie symptomologies shared across stress-related disorders and neuropsychiatric disease, including dysregulation of emotion and cognitive function. G protein-gated inwardly rectifying K+ (GIRK/Kir3) channels mediate excitability of medial PFC pyramidal neurons, however, the functional role of these channels in mPFC-dependent regulation of affect, cognition, and cortical dynamics is unknown. We used a viral-cre approach in male and female mice harboring a "floxed" version of the kcnj3 (Girk1) gene, to disrupt GIRK1-containing channel expression in pyramidal neurons within the prelimbic cortex (PrL). In males, loss of pyramidal GIRK1-dependent signaling differentially impacted measures of affect and impaired working memory and cognitive flexibility. Unexpectedly, ablation of PrL GIRK1-dependent signaling did not impact affect or cognition in female mice. Additional studies used a model of chronic unpredictable stress (CUS) to determine the impact on PrL GIRK-dependent signaling and cognitive function. CUS exposure in male mice produced deficits in cognition that paralleled a reduction in PrL pyramidal GIRK-dependent signaling akin to viral approaches whereas CUS exposure in female mice did not alter cognitive flexibility performance. Stress-induced behavioral deficits in male mice were rescued by systemic injection of a novel, GIRK1-selective agonist, ML297. In conclusion, GIRK1-dependent signaling in male mice, but not females, is critical for maintaining optimal PrL function and behavioral control. Disruption of this inhibition may underlie stress-related dysfunction of the PrL and represent a therapeutic target for treating stress-induced deficits in affect regulation and impaired cognition that reduce quality of life.

Reversible Fronto-occipitotemporal Signaling Complements Task Encoding and Switching under Ambiguous Cues

Adaptation to changing environments involves the appropriate extraction of environmental information to achieve a behavioral goal. It remains unclear how behavioral flexibility is guided under situations where the relevant behavior is ambiguous. Using functional brain mapping of machine learning decoders and directional functional connectivity, we show that brain-wide reversible neural signaling underpins task encoding and behavioral flexibility in ambiguously changing environments. When relevant behavior is cued ambiguously during behavioral shifting, neural coding is attenuated in distributed cortical regions, but top-down signals from the prefrontal cortex complement the coding. When behavioral shifting is cued more explicitly, modality-specialized occipitotemporal regions implement distinct neural coding about relevant behavior, and bottom-up signals from the occipitotemporal region to the prefrontal cortex supplement the behavioral shift. These results suggest that our adaptation to an ever-changing world is orchestrated by the alternation of top-down and bottom-up signaling in the fronto-occipitotemporal circuit depending on the availability of environmental information.

Remifentanil self-administration in mice promotes sex-specific prefrontal cortex dysfunction underlying deficits in cognitive flexibility

Opioid-based drugs are frequently used for pain management in both males and females despite the known risk of prefrontal cortex dysfunction and cognitive impairments. Although poorly understood, loss of cognitive control following chronic drug use has been linked to decreased activation of frontal cortex regions. Here, we show that self-administration of the potent opioid, remifentanil, causes a long-lasting hypoactive basal state evidenced by a decrease in ex vivo excitability that is paralleled by an increase in firing capacity of layer 5/6 pyramidal neurons in the prelimbic, but not infralimbic region of the medial prefrontal cortex. This phenomenon was observed in females after as few as 5 days and up to 25-30 days of self-administration. In contrast, pyramidal neurons in males showed increased excitability following 10-16 days of self-administration, with hypoactive states arising only following 25-30 days of self-administration. The emergence of a hypoactive, but not hyperactive basal state following remifentanil self-administration aligned with deficits in cognitive flexibility as assessed using an operant-based attentional set-shifting task. In females, the hypoactive basal state is driven by a reduction in excitatory synaptic transmission mediated by AMPA-type glutamate receptors. Alternatively, hyper- and hypoactive states in males align selectively with decreased and increased GABA_B signaling, respectively. Chemogenetic compensation for this hypoactive state prior to testing restored cognitive flexibility, basal hypoactive state, and remifentanil-induced plasticity. These data define cellular and synaptic mechanisms by which opioids impair prefrontal function and cognitive control; indicating that interventions aimed at targeting opioid-induced adaptations should be tailored based on biological sex.

Detrimental effects of adolescent escalating low-dose Δ9 -tetrahydrocannabinol leads to a specific bio-behavioural profile in adult male rats

BACKGROUND AND PURPOSE

Adolescent cannabis use is associated with adult psychopathology. When Δ⁹ -tetrahydrocannabinol (THC), mainly in high doses, is administered to adolescence rats there are also long lasting effects in adults. This study aims to determine the specific adult bio-behavioural profile after adolescent low-dose THC, which better mirrors adolescent recreational cannabis use.

EXPERIMENTAL APPROACH

Adolescent male Sprague-Dawley rats were treated with escalating low-dose of THC. In adulthood, they were evaluated for their spontaneous locomotion, sensorimotor gating, higher order and spatial cognitive functions. Dopaminergic activity and cannabinoid receptor expression were measured in distinct brain regions. Hippocampal neurogenic activity of neural stem cells was determined and protein levels of neuroplasticity-related biomarkers were quantified. Adolescent low-dose THC exposure increased spontaneous open-field activity, without affecting prepulse inhibition and attentional set-shifting performance. Region-specific dopaminergic alterations and CB₁ receptor up-regulation in the prefrontal cortex were observed. Impaired spatial memory, as assessed with the object location task and Morris water maze test, was associated with significantly decreased proliferative activity (SOX2-positive cells), neurogenic potential (decreased doublecortin-positive cells) in the adult hippocampus and defective neuroplasticity, including reduced BDNF expression in the hippocampus and prefrontal cortex.

KEY RESULTS

Our findings reveal the adverse impact of adolescent low-dose THC on the psychomotor profile, dopaminergic neurotransmission, compensatory cannabinoid receptor response, cognition-related neurobiological and behavioural functions.

CONCLUSION AND IMPLICATIONS

Our adolescent low-dose THC animal model does not induce tangible psychotic-like effects, such as those reported in high-dose THC studies, but it impairs cognitive functions and points to hippocampal vulnerability and disrupted neurogenesis.

Stereotyped, automatized and habitual behaviours: are they similar constructs under the control of the same cerebral areas?

Comprehensive knowledge about higher executive functions of motor control has been covered in the last decades. Critical goals have been targeted through many different technological approaches. An abundant flow of new results greatly progressed our ability to respond at better-posited answers to look more than ever at the challenging neural system functioning. Behaviour is the observable result of the invisible, as complex cerebral functioning. Many pathological states are approached after symptomatology categorisation of behavioural impairments is achieved. Motor, non-motor and psychiatric signs are greatly shared by many neurological/psychiatric disorders. Together with the cerebral cortex, the basal ganglia contribute to the expression of behaviour promoting the correct action schemas and the selection of appropriate sub-goals based on the evaluation of action outcomes. The present review focus on the basic classification of higher motor control functioning, taking into account the recent advances in basal ganglia structural knowledge and the computational model of basal ganglia functioning. We discuss about the basal ganglia capability in executing ordered motor patterns in which any single movement is linked to each other into an action, and many actions are ordered into each other, giving them a syntactic value to the final behaviour. The stereotypic, automatized and habitual behaviour's constructs and controls are the expression of successive stages of rule internalization and categorisation aimed in producing the perfect spatial-temporal control of motor command.

Cross-hemispheric gamma synchrony between prefrontal parvalbumin interneurons supports behavioral adaptation during rule shift learning

Organisms must learn new strategies to adapt to changing environments. Activity in different neurons often exhibits synchronization that can dynamically enhance their communication and might create flexible brain states that facilitate changes in behavior. We studied the role of gamma-frequency (~40 Hz) synchrony between prefrontal parvalbumin (PV) interneurons in mice learning multiple new cue-reward associations. Voltage indicators revealed cell-type-specific increases of cross-hemispheric gamma synchrony between PV interneurons when mice received feedback that previously learned associations were no longer valid. Disrupting this synchronization by delivering out-of-phase optogenetic stimulation caused mice to perseverate on outdated associations, an effect not reproduced by in-phase stimulation or out-of-phase stimulation at other frequencies. Gamma synchrony was specifically required when new associations used familiar cues that were previously irrelevant to behavioral outcomes, not when associations involved new cues or for reversing previously learned associations. Thus, gamma synchrony is indispensable for reappraising the behavioral salience of external cues.

Bridging the species gap in translational research for neurodevelopmental disorders

The prevalence and societal impact of neurodevelopmental disorders (NDDs) continue to increase despite years of research in both patient populations and animal models. There remains an urgent need for translational efforts between clinical and preclinical research to (i) identify and evaluate putative causes of NDD, (ii) determine their underlying neurobiological mechanisms, (iii) develop and test novel therapeutic approaches, and (iv) translate basic research into safe and effective clinical practices. Given the complexity behind potential causes and behaviors affected by NDDs, modeling these uniquely human brain disorders in animals will require that we capitalize on unique advantages of a diverse array of species. While much NDD research has been conducted in more traditional animal models such as the mouse, ultimately, we may benefit from creating animal models with species that have a more sophisticated social behavior repertoire such as the rat (Rattus norvegicus) or species that more closely related to humans, such as the rhesus macaque (Macaca mulatta). Here, we highlight the rat and rhesus macaque models for their role in previous psychological research discoveries, current efforts to understand the neurobiology of NDDs, and focus on the convergence of behavior outcome measures that parallel features of human NDDs.

Prefrontal cortex and cognitive control: new insights from human electrophysiology

Cognitive control, the ability to regulate one's cognition and actions on the basis of over-riding goals, is impaired in many psychiatric conditions. Although control requires the coordinated function of several prefrontal cortical regions, it has been challenging to determine how they work together, in part because doing so requires simultaneous recordings from multiple regions. Here, we provide a précis of cognitive control and describe the beneficial consequences of recent advances in neurosurgical practice that make large-scale prefrontal cortical network recordings possible in humans. Such recordings implicate inter-regional theta (5-8 Hz) local field potential (LFP) synchrony as a key element in cognitive control. Major open questions include how theta might influence other oscillations within these networks, the precise timing of information flow between these regions, and how perturbations such as brain stimulation might demonstrate the causal role of LFP phenomena. We propose that an increased focus on human electrophysiology is essential for an understanding of the neural basis of cognitive control.

Cognitive control involves theta power within trials and beta power across trials in the prefrontal-subthalamic network

There is increasing evidence that the medial prefrontal cortex participates in conflict and feedback monitoring while the subthalamic nucleus adjusts actions. Yet how these two structures coordinate their activity during cognitive control remains poorly understood. We recorded from the human prefrontal cortex and the subthalamic nucleus simultaneously while participants (n = 22) performed a novel task involving high conflict trials, complete response inhibition trials, and trial-to-trial behavioural adaptations to conflict and errors. Overall, we found that within-trial adaptions to both conflict and complete response inhibition involved changes in the theta band while across-trial behavioural adaptations to both conflict and errors involved changes in the beta band (P < 0.05). Yet the role each region's theta and beta oscillations played during the task differed significantly between the two sites. Trials that involved either within-trial conflict or complete response inhibition were associated with increased theta phase synchrony between the medial prefrontal cortex and the subthalamic nucleus (P < 0.05). Despite increased synchrony, however, increases in prefrontal theta power were associated with response inhibition, while increases in subthalamic theta power were associated with response execution (P < 0.05). In the beta band, post-response increases in prefrontal beta power were suppressed when the completed trial contained either conflict or an erroneous response (P < 0.05). Subthalamic beta power, on the other hand, was only modified during the subsequent trial that followed a conflict or error trial. Notably, these adaptation trials exhibited slower response times (P < 0.05), suggesting that both brain regions contribute to across-trial adaptations but do so at different stages of the adaptation process. Taken together, our data shed light on the mechanisms underlying within-trial and across-trial cognitive control and how disruption of this network can negatively impact cognition. More broadly, however, our data also demonstrate that the specific role of a brain region, rather than the frequency being utilized, governs the behavioural correlates of oscillatory activity.

Acute stressor effects on cognitive flexibility: mediating role of stressor appraisals and cortisol

Acute stressor experiences may influence cognition, possibly through actions of cognitive flexibility, which comprises the ability to modify cognitive and behavioral strategies in response to changing environmental demands. In the present investigation, we examined the effects of an acute psychosocial stressor (the Trier Social Stress Test) on a specific form of cognitive flexibility, namely that of set-shifting, which was assessed by the Berg's Card Sorting Task (BCST). Among undergraduate students, the stressor promoted better performance on the BSCT relative to that evident among nonstressed individuals, including a reduction of perseverative (an index of enhanced set-shifting) and non-perseverative errors. They also required fewer trials to learn the first sorting category, reflecting augmented acquisition of an attentional set, but did not differ in the ability to maintain a set. Moreover, increased cortisol levels specifically mediated the enhancing effects of the acute stressor on set-shifting, but not the ability to acquire and maintain an attentional set. However, this enhancing effect was minimized among individuals who appraised the stressor as being uncontrollable. These data indicate that an acute, social-evaluative stressor can facilitate certain forms of cognitive flexibility, such as set-shifting. The present investigation also highlights the value of focusing on psychological and physiological mediators in determining the impact of stressful experiences on cognitive functioning. Lay summary A brief social stressor (public speaking) can have an enhancing effect on mental flexibility, and this seems to be related to the stress hormone, cortisol. This cognitive enhancing effect, however, might be minimized if a stressful situation is perceived as beyond a person's control.

A novel multichoice touchscreen paradigm for assessing cognitive flexibility in mice

Cognitive flexibility refers to various processes which enable behaviors to be modified on the basis of a change in the contingencies between stimuli or responses and their associated outcomes. Reversal learning is a form of cognitive flexibility which measures the ability to adjust responding based on a switch in the stimulus–outcome contingencies of, typically two, perceptually distinct stimuli. Reversal tasks have provided valuable insight into the neural basis of cognitive flexibility, implicating brain regions including the lateral orbitofrontal cortex (lOFC) and dorsomedial prefrontal cortex (dmPFC). However, with two-stimulus reversal, it is difficult to determine whether response errors are due excessive perseveration, deficient learning, or other problems with updating. To address this limitation, we developed a mouse three-choice touchscreen-based visual reversal task, in which the contingencies of two stimuli were switched on reversal but a third, simultaneously presented, stimulus was never reinforced. We found that, in male C57BL/6J mice, responding at the previously rewarded stimulus predominated over the newly and never-reinforced stimuli during early reversal. Next, we showed that acute pharmacological inhibition of lOFC, but not dmPFC, impaired early reversal performance, relative to noninactivated controls. Interestingly, however, lOFC inactivation deficits were characterized by increased choice of the never-reinforced stimulus and a decrease in (perseverative-like) responding at the previously rewarded stimulus. These effects are inconsistent with the historical notion of lOFC mediating response inhibition and closer to recent views of the lOFC's role in response/outcome tracking. Overall, these findings provide initial support the utility of this novel paradigm for studying cognitive flexibility and its underlying neural substrates.

Retrieval of Inhibitory Avoidance Memory Induces Differential Transcription of arc in Striatum, Hippocampus, and Amygdala

Similar to the hippocampus and amygdala, the dorsal striatum is involved in memory retrieval of inhibitory avoidance, a task commonly used to study memory processes. It has been reported that memory retrieval of fear conditioning regulates gene expression of arc and zif268 in the amygdala and the hippocampus, and it is surprising that only limited effort has been made to study the molecular events caused by retrieval in the striatum. To further explore the involvement of immediate early genes in retrieval, we used real-time PCR to analyze arc and zif268 transcription in dorsal striatum, dorsal hippocampus, and amygdala at different time intervals after retrieval of step-through inhibitory avoidance memory. We found that arc expression in the striatum increased 30 min after retrieval while no changes were observed in zif268 in this region. Expression of arc and zif268 also increased in the dorsal hippocampus but the changes were attributed to context re-exposure. Control procedures indicated that in the amygdala, arc and zif268 expression was not dependent on retrieval. Our data indicate that memory retrieval of inhibitory avoidance induces arc gene expression in the dorsal striatum, caused, very likely, by the instrumental component of the task. Striatal arc expression after retrieval may induce structural and functional changes in the neurons involved in this process.

Basal ganglia mechanisms in action selection, plasticity, and dystonia

Basal ganglia circuits are organized to selected desired actions and to inhibit potentially competing unwanted actions. This is accomplished through a complex circuitry that is modified through development and learning. Mechanisms of neural plasticity underlying these modifications are increasingly understood, but new mechanisms continue to be discovered. Dystonia, a movement disorder characterized by involuntary muscle contractions that cause abnormal postures and movements. Emerging evidence points to important links between mechanisms of plasticity and the manifestations of dystonia. Investigation of these mechanisms has improved understanding of the action of currently used medication and is informing the development of new treatments.

Rule Encoding in Orbitofrontal Cortex and Striatum Guides Selection

Active maintenance of rules, like other executive functions, is often thought to be the domain of a discrete executive system. An alternative view is that rule maintenance is a broadly distributed function relying on widespread cortical and subcortical circuits. Tentative evidence supporting this view comes from research showing some rule selectivity in the orbitofrontal cortex and dorsal striatum. We recorded in these regions and in the ventral striatum, which has not been associated previously with rule representation, as macaques performed a Wisconsin Card Sorting Task. We found robust encoding of rule category (color vs shape) and rule identity (six possible rules) in all three regions. Rule identity modulated responses to potential choice targets, suggesting that rule information guides behavior by highlighting choice targets. The effects that we observed were not explained by differences in behavioral performance across rules and thus cannot be attributed to reward expectation. Our results suggest that rule maintenance and rule-guided selection of options are distributed processes and provide new insight into orbital and striatal contributions to executive control.

SIGNIFICANCE STATEMENT

Rule maintenance, an important executive function, is generally thought to rely on dorsolateral brain regions. In this study, we examined activity of single neurons in orbitofrontal cortex and in ventral and dorsal striatum of macaques in a Wisconsin Card Sorting Task. Neurons in all three areas encoded rules and rule categories robustly. Rule identity also affected neural responses to potential choice options, suggesting that stored information is used to influence decisions. These results endorse the hypothesis that rule maintenance is a broadly distributed mental operation.

Neural Signatures of Cognitive Flexibility and Reward Sensitivity Following Nicotinic Receptor Stimulation in Dependent Smokers: A Randomized Trial

IMPORTANCE

Withdrawal from nicotine is an important contributor to smoking relapse. Understanding how reward-based decision making is affected by abstinence and by pharmacotherapies such as nicotine replacement therapy and varenicline tartrate may aid cessation treatment.

OBJECTIVE

To independently assess the effects of nicotine dependence and stimulation of the nicotinic acetylcholine receptor on the ability to interpret valence information (reward sensitivity) and subsequently alter behavior as reward contingencies change (cognitive flexibility) in a probabilistic reversal learning task.

DESIGN, SETTING, AND PARTICIPANTS

Nicotine-dependent smokers and nonsmokers completed a probabilistic reversal learning task during acquisition of functional magnetic resonance imaging (fMRI) in a 2-drug, double-blind placebo-controlled crossover design conducted from January 21, 2009, to September 29, 2011. Smokers were abstinent from cigarette smoking for 12 hours for all sessions. In a fully Latin square fashion, participants in both groups underwent MRI twice while receiving varenicline and twice while receiving a placebo pill, wearing either a nicotine or a placebo patch. Imaging analysis was performed from June 15, 2015, to August 10, 2016.

MAIN OUTCOME AND MEASURES

A well-established computational model captured effects of smoking status and administration of nicotine and varenicline on probabilistic reversal learning choice behavior. Neural effects of smoking status, nicotine, and varenicline were tested for on MRI contrasts that captured reward sensitivity and cognitive flexibility.

RESULTS

The study included 24 nicotine-dependent smokers (12 women and 12 men; mean [SD] age, 35.8 [9.9] years) and 20 nonsmokers (10 women and 10 men; mean [SD] age, 30.4 [7.2] years). Computational modeling indicated that abstinent smokers were biased toward response shifting and that their decisions were less sensitive to the available evidence, suggesting increased impulsivity during withdrawal. These behavioral impairments were mitigated with nicotine and varenicline. Similarly, decreased mesocorticolimbic activity associated with cognitive flexibility in abstinent smokers was restored to the level of nonsmokers following stimulation of nicotinic acetylcholine receptors (familywise error-corrected P < .05). Conversely, neural signatures of decreased reward sensitivity in smokers (vs nonsmokers; familywise error-corrected P < .05) in the dorsal striatum and anterior cingulate cortex were not mitigated by nicotine or varenicline.

CONCLUSIONS AND RELEVANCE

There was a double dissociation between the effects of chronic nicotine dependence on neural representations of reward sensitivity and acute effects of stimulation of nicotinic acetylcholine receptors on behavioral and neural signatures of cognitive flexibility in smokers. These chronic and acute pharmacologic effects were observed in overlapping mesocorticolimbic regions, suggesting that available pharmacotherapies may alleviate deficits in the same circuitry for certain mental computations but not for others.

TRIAL REGISTRATION

clinicaltrials.gov Identifier: NCT00830739.