Involvement of the dorsomedial striatum in behavioral flexibility: role of muscarinic cholinergic receptors

Pro-cognitive effects of dual tacrine derivatives acting as cholinesterase inhibitors and NMDA receptor antagonists

Therapeutic options for Alzheimer's disease are limited. Dual compounds targeting two pathways concurrently may enable enhanced effect. The study focuses on tacrine derivatives inhibiting acetylcholinesterase (AChE) and simultaneously N-methyl-D-aspartate (NMDA) receptors. Compounds with balanced inhibitory potencies for the target proteins (K1578 and K1599) or increased potency for AChE (K1592 and K1594) were studied to identify the most promising pro-cognitive compound. Their effects were studied in cholinergic (scopolamine-induced) and glutamatergic (MK-801-induced) rat models of cognitive deficits in the Morris water maze. Moreover, the impacts on locomotion in the open field and AChE activity in relevant brain structures were investigated. The effect of the most promising compound on NMDA receptors was explored by in vitro electrophysiology. The cholinergic antagonist scopolamine induced a deficit in memory acquisition, however, it was unaffected by the compounds, and a deficit in reversal learning that was alleviated by K1578 and K1599. K1578 and K1599 significantly inhibited AChE in the striatum, potentially explaining the behavioral observations. The glutamatergic antagonist dizocilpine (MK-801) induced a deficit in memory acquisition, which was alleviated by K1599. K1599 also mitigated the MK-801-induced hyperlocomotion in the open field. In vitro patch-clamp corroborated the K1599-associated NMDA receptor inhibitory effect. K1599 emerged as the most promising compound, demonstrating pro-cognitive efficacy in both models, consistent with intended dual effect. We conclude that tacrine has the potential for development of derivatives with dual in vivo effects. Our findings contributed to the elucidation of the structural and functional properties of tacrine derivatives associated with optimal in vivo pro-cognitive efficacy.

Conditional deletion of neurexin-2 impaired behavioral flexibility to alterations in action-outcome contingency

Neurexins (Nrxns) are critical for synapse organization and their mutations have been documented in autism spectrum disorder, schizophrenia, and epilepsy. We recently reported that conditional deletion of Nrxn2, under the control of Emx1Cre promoter, predominately expressed in the neocortex and hippocampus (Emx1-Nrxn2 cKO mice) induced stereotyped patterns of behavior in mice, suggesting behavioral inflexibility. In this study, we investigated the effects of Nrxn2 deletion through two different conditional approaches targeting presynaptic cortical neurons projecting to dorsomedial striatum on the flexibility between goal-directed and habitual actions in response to devaluation of action-outcome (A-O) contingencies in an instrumental learning paradigm or upon reversal of A-O contingencies in a water T-maze paradigm. Nrxn2 deletion through both the conditional approaches induced an inability of mice to discriminate between goal-directed and habitual action strategies in their response to devaluation of A-O contingency. Emx1-Nrxn2 cKO mice exhibited reversal learning deficits, indicating their inability to adopt new action strategies. Overall, our studies showed that Nrxn2 deletion through two distinct conditional deletion approaches impaired flexibility in response to alterations in A-O contingencies. These investigations can lay the foundation for identification of novel genetic factors underlying behavioral inflexibility.

Deep brain stimulation alleviates tics in Tourette syndrome via striatal dopamine transmission

Tourette syndrome is a childhood-onset neuropsychiatric disorder characterized by intrusive motor and vocal tics that can lead to self-injury and deleterious mental health complications. While dysfunction in striatal dopamine neurotransmission has been proposed to underlie tic behaviour, evidence is scarce and inconclusive. Deep brain stimulation (DBS) of the thalamic centromedian parafascicular complex (CMPf), an approved surgical interventive treatment for medical refractory Tourette syndrome, may reduce tics by affecting striatal dopamine release. Here, we use electrophysiology, electrochemistry, optogenetics, pharmacological treatments and behavioural measurements to mechanistically examine how thalamic DBS modulates synaptic and tonic dopamine activity in the dorsomedial striatum. Previous studies demonstrated focal disruption of GABAergic transmission in the dorsolateral striatum of rats led to repetitive motor tics recapitulating the major symptom of Tourette syndrome. We employed this model under light anaesthesia and found CMPf DBS evoked synaptic dopamine release and elevated tonic dopamine levels via striatal cholinergic interneurons while concomitantly reducing motor tic behaviour. The improvement in tic behaviour was found to be mediated by D2 receptor activation as blocking this receptor prevented the therapeutic response. Our results demonstrate that release of striatal dopamine mediates the therapeutic effects of CMPf DBS and points to striatal dopamine dysfunction as a driver for motor tics in the pathoneurophysiology of Tourette syndrome.

Inhibition of the dorsomedial striatal direct pathway is essential for the execution of action sequences

Contrary to the previous notion that the dorsomedial striatum (DMS) is crucial for acquiring new learning, accumulated evidence has suggested that the DMS also plays a role in the execution of already learned action sequences. Here, we examined how the direct and indirect pathways in the DMS regulate action sequences using a task that requires animals to press a lever consecutively. Cell-type-specific bulk Ca2+ recording revealed that the direct pathway was inhibited at the time of sequence execution. The sequence-related response was blunted in trials where the sequential behaviors were disrupted. Optogenetic activation at the sequence start caused distraction of action sequences without affecting motor function or memory of the task structure. By contrast with the direct pathway, the indirect pathway was slightly activated at the start of the sequence, but the optogenetic suppression of such sequence-related signaling did not impact the behaviors. These results suggest that the inhibition of the DMS direct pathway promotes sequence execution potentially by suppressing the formation of a new association.

Striatal hypoactivation during monetary loss anticipation in individuals with substance use disorders in a heterogenous urban American Indian sample

Research suggests that disproportionate exposure to risk factors places American Indian (AI) peoples at higher risk for substance use disorders (SUD). Although SUD is linked to striatal prioritization of drug rewards over other appetitive stimuli, there are gaps in the literature related to the investigation of aversive valuation processing, and inclusion of AI samples. To address these gaps, this study compared striatal anticipatory gain and loss processing between AI-identified with SUD (SUD+; n = 52) and without SUD (SUD-; n = 35) groups from the Tulsa 1000 study who completed a monetary incentive delay (MID) task during functional magnetic resonance imaging. Results indicated that striatal activations in the nucleus accumbens (NAcc), caudate, and putamen were greatest for anticipating gains (ps < 0.001) but showed no group differences. In contrast to gains, the SUD+ exhibited lower NAcc (p = .01, d =0.53) and putamen (p = .04, d =0.40) activation to anticipating large losses than the comparison group. Within SUD+ , lower striatal responses during loss anticipations were associated with slower MID reaction times (NAcc: r = -0.43; putamen: r = -0.35) during loss trials. This is among the first imaging studies to examine underlying neural mechanisms associated with SUD within AIs. Attenuated loss processing provides initial evidence of a potential mechanism wherein blunted prediction of aversive consequences may be a defining feature of SUD that can inform future prevention and intervention targets.

Chronic stress causes striatal disinhibition mediated by SOM-interneurons in male mice

Chronic stress (CS) is associated with a number of neuropsychiatric disorders, and it may also contribute to or exacerbate motor function. However, the mechanisms by which stress triggers motor symptoms are not fully understood. Here, we report that CS functionally alters dorsomedial striatum (DMS) circuits in male mice, by affecting GABAergic interneuron populations and somatostatin positive (SOM) interneurons in particular. Specifically, we show that CS impairs communication between SOM interneurons and medium spiny neurons, promoting striatal overactivation/disinhibition and increased motor output. Using probabilistic machine learning to analyze animal behavior, we demonstrate that in vivo chemogenetic manipulation of SOM interneurons in DMS modulates motor phenotypes in stressed mice. Altogether, we propose a causal link between dysfunction of striatal SOM interneurons and motor symptoms in models of chronic stress.

Dissociable roles for the striatal cholinergic system in different flexibility contexts

The production of behavioural flexibility requires the coordination and integration of information from across the brain, by the dorsal striatum. In particular, the striatal cholinergic system is thought to be important for the modulation of striatal activity. Research from animal literature has shown that chemical inactivation of the dorsal striatum leads to impairments in reversal learning. Furthermore, proton magnetic resonance spectroscopy work has shown that the striatal cholinergic system is also important for reversal learning in humans. Here, we aim to assess whether the state of the dorsal striatal cholinergic system at rest is related to serial reversal learning in humans. We provide preliminary results showing that variability in choline in the dorsal striatum is significantly related to both the number of perseverative and regressive errors that participants make, and their rate of learning from positive and negative prediction errors. These findings, in line with previous work, suggest the resting state of dorsal striatal cholinergic system has important implications for producing flexible behaviour. However, these results also suggest the system may have heterogeneous functionality across different types of tasks measuring behavioural flexibility. These findings provide a starting point for further interrogation into understanding the functional role of the striatal cholinergic system in flexibility.

•

Striatal acetylcholine is important for behavioural flexibility in rodents & primates.

•

Nascent evidence the striatal cholinergic system is important for human flexibility.

•

¹H-MRS, reversal learning and reinforcement learning used to interrogate relationship.

•

Striatal cholinergic system at rest is associated with direct and latent performance.

•

Results specific to concentrations of striatal choline, and not other metabolites.

Striatum expresses region-specific plasticity consistent with distinct memory abilities

The striatum mediates two learning modalities: goal-directed behavior in dorsomedial (DMS) and habits in dorsolateral (DLS) striata. The synaptic bases of these learnings are still elusive. Indeed, while ample research has described DLS plasticity, little remains known about DMS plasticity and its involvement in procedural learning. Here, we find symmetric and asymmetric anti-Hebbian spike-timing-dependent plasticity (STDP) in DMS and DLS, respectively, with opposite plasticity dominance upon increasing corticostriatal activity. During motor-skill learning, plasticity is engaged in DMS and striatonigral DLS neurons only during early learning stages, whereas striatopallidal DLS neurons are mobilized only during late phases. With a mathematical modeling approach, we find that symmetric anti-Hebbian STDP favors memory flexibility, while asymmetric anti-Hebbian STDP favors memory maintenance, consistent with memory processes at play in procedural learning.

Cholinergic neurons in the pedunculopontine nucleus guide reversal learning by signaling the changing reward contingency

Cognitive flexibility enables effective switching between mental processes to generate appropriate responses. Cholinergic neurons (CNs) within the pedunculopontine nucleus (PPN) are associated with many functions, but their contribution to cognitive flexibility remains poorly understood. Here we measure PPN cholinergic activities using calcium indicators during the attentional set-shifting task. We find that PPN CNs exhibit increasing activities correlated with rewards during each stage and error trials in reversal stages, indicating sensitivity to rule switching. Inhibition of PPN cholinergic activity selectively impairs reversal learning, which improves with PPN CN activation. Activation of PPN CNs projecting to the substantia nigra pars compacta, mediodorsal thalamus, and parafascicular nucleus in a time-locked manner with reward improves reversal learning. Therefore, PPN CNs may encode not only reward signals but also the information of changing reward contingency that contributes to guiding reversal learning through output projections to multiple nuclei that participate in flexibility.

Towards an expanded neuroscientific understanding of social play

Play has been recognized as a complex and diverse set of behaviors that has been difficult to define. Play can range from rough and tumble play among rats to a human child playing a computer game. Play has been understood to exist in multiple forms such as social, object, and locomotor (Burghardt, 2005). In this article we review the literatures on the neural basis of social play, on heart rate variability, on behavioral switching and set-shifting, on prepulse inhibition of the acoustic startle reflex, and on learning at the level of the basal ganglia. Each of these neuronal pathways, aside from heart rate variability, is rooted in the parafascicular nucleus of the thalamus, an important neural substrate for social play. We argue that social play optimally balances a number of opposing neural pathways by engaging systems involved in safety versus danger (heart rate variability), automatized reactions versus learned reactions to new stimuli (behavioral switching and set-shifting), and gating relevant versus less relevant stimuli (prepulse inhibition of the acoustic startle reflex). The idea that play, in addition to its role in interpersonal adaptation to social life, may have a central role in optimizing flexibility and creativity in individual response to novelty has been explored by previous authors (Huizinga, 1955; Spinka et al., 2001; Pellegrini et al., 2007; Pellis and Pellis, 2017). In this paper we explore the possible underlying neural basis for this function of play, having to do with balancing various neural networks, and in doing so propose an expanded understanding of the nature and function of social play.

Thalamostriatal System Controls the Acquisition, Performance, and Flexibility of Learning Behavior

The dorsal striatum (DS) is a key structure of the basal ganglia circuitry, which regulates various types of learning processes and flexible switching of behavior. Intralaminar thalamic nuclei (ILNs) provide the main source of thalamostriatal inputs to the DS and constitute multiple nuclear groups, each of which innervates specific subdivisions of the striatum. Although the anatomical and electrophysiological properties of thalamostriatal neurons have been previously characterized, the behavioral and physiological functions of these neurons remain unclarified. Two representative thalamostriatal cell groups in the parafascicular nucleus (PF) and the central lateral nucleus (CL) are located in the caudal and rostral regions of the ILNs in rodents. Recently, the behavioral roles of these thalamostriatal cell groups have been investigated by the use of genetic and pharmacological manipulation techniques. In the current review, we summarize behavioral studies on thalamostriatal neurons, showing the key roles of these neurons in different learning processes, such as the acquisition, performance, and flexibility of behavior.

Astrocyte-neuron interaction in the dorsal striatum-pallidal circuits and alcohol-seeking behaviors

In the striatum, two main types of GABAergic medium spiny neurons (MSNs), denoted striatonigral (or direct-pathway MSNs, dMSNs) and striatopallidal neurons (indirect-pathway MSNs, iMSNs), form circuits with distinct pallidal nuclei, which sends "GO" or "NO-GO" signals through the thalamus. These striatopallidal circuits evaluate and execute reward-seeking and taking behaviors. Especially, the dorsal striatum can be further divided into the dorsomedial striatum (DMS, equivalent to caudate in primates and humans) and dorsolateral striatum (DLS, equivalent to putamen), which orchestrates goal-directed and habitual reward-seeking and taking behaviors, respectively. Using optogenetics, chemogenetics and in vivo calcium imaging technologies combined with electrophysiology and digitalized behavior phenotyping, recent studies have revealed cell-, circuit- and context-specific functions of these microcircuits in addictive behaviors. Also, region-specific astrocytes regulate the homeostatic activities of the dMSNs and iMSNs as well as the downstream circuits, which determine the net balance of cortico-striato-pallidal activities to the thalamic neurons. This review will summarize the recent progress of striatopallidal circuits focusing on astrocyte-neuron interaction and, reward- and alcohol-seeking behaviors. Our review will also discuss the translational and clinical implications of these microcircuit studies. This article is part of the special Issue on "Neurocircuitry Modulating Drug and Alcohol Abuse".

Increased Endogenous GDNF in Mice Protects Against Age-Related Decline in Neuronal Cholinergic Markers

Gradual decline in cholinergic transmission and cognitive function occurs during normal aging, whereas pathological loss of cholinergic function is a hallmark of different types of dementia, including Alzheimer’s disease (AD), Lewy body dementia (LBD), and Parkinson’s disease dementia (PDD). Glial cell line-derived neurotrophic factor (GDNF) is known to modulate and enhance the dopamine system. However, how endogenous GDNF influences brain cholinergic transmission has remained elusive. In this study, we explored the effect of a twofold increase in endogenous GDNF (Gdnf hypermorphic mice, Gdnf^wt/hyper) on cholinergic markers and cognitive function upon aging. We found that Gdnf^wt/hyper mice resisted an overall age-associated decline in the cholinergic index observed in the brain of Gdnf^wt/wt animals. Biochemical analysis revealed that the level of nerve growth factor (NGF), which is important for survival and function of central cholinergic neurons, was significantly increased in several brain areas of old Gdnf^wt/hyper mice. Analysis of expression of genes involved in cholinergic transmission in the cortex and striatum confirmed modulation of cholinergic pathways by GDNF upon aging. In line with these findings, Gdnf^wt/hyper mice did not undergo an age-related decline in cognitive function in the Y-maze test, as observed in the wild type littermates. Our results identify endogenous GDNF as a potential modulator of cholinergic transmission and call for future studies on endogenous GDNF function in neurodegenerative disorders characterized by cognitive impairments, including AD, LBD, and PDD.

The Free-movement pattern Y-maze: A cross-species measure of working memory and executive function

Numerous neurodegenerative and psychiatric disorders are associated with deficits in executive functions such as working memory and cognitive flexibility. Progress in developing effective treatments for disorders may benefit from targeting these cognitive impairments, the success of which is predicated on the development of animal models with validated behavioural assays. Zebrafish offer a promising model for studying complex brain disorders, but tasks assessing executive function are lacking. The Free-movement pattern (FMP) Y-maze combines aspects of the common Y-maze assay, which exploits the inherent motivation of an organism to explore an unknown environment, with analysis based on a series of sequential two-choice discriminations. We validate the task as a measure of working memory and executive function by comparing task performance parameters in adult zebrafish treated with a range of glutamatergic, cholinergic and dopaminergic drugs known to impair working memory and cognitive flexibility. We demonstrate the cross-species validity of the task by assessing performance parameters in adapted versions of the task for mice and Drosophila, and finally a virtual version in humans, and identify remarkable commonalities between vertebrate species' navigation of the maze. Together, our results demonstrate that the FMP Y-maze is a sensitive assay for assessing working memory and cognitive flexibility across species from invertebrates to humans, providing a simple and widely applicable behavioural assay with exceptional translational relevance.

Striatal cholinergic transmission. Focus on nicotinic receptors' influence in striatal circuits

The critical role of acetylcholine (ACh) in the basal ganglia is evident from the effect of cholinergic agents in patients suffering from several related neurological disorders, such as Parkinson's disease, Tourette syndrome, or dystonia. The striatum possesses the highest density of ACh markers in the basal ganglia underlying the importance of ACh in this structure. Striatal cholinergic interneurons (CINs) are responsible for the bulk of striatal ACh, although extrinsic cholinergic afferents from brainstem structures may also play a role. CINs are tonically active, and synchronized pause in their activity occurs following the presentation of salient stimuli during behavioral conditioning. However, the synaptic mechanisms involved are not fully understood in this physiological response. ACh modulates striatal circuits by acting on muscarinic and nicotinic receptors existing in several combinations both presynaptically and postsynaptically. While the effects of ACh in the striatum through muscarinic receptors have received particular attention, nicotinic receptors function has been less studied. Here, after briefly reviewing relevant results regarding muscarinic receptors expression and function, I will focus on striatal nicotinic receptor expressed presynaptically on glutamatergic and dopaminergic afferents and postsynaptically on diverse striatal interneurons populations. I will also review recent evidence suggesting the involvement of different GABAergic sources in two distinct nicotinic-receptor-mediated striatal circuits: the disynaptic inhibition of striatal projection neurons and the recurrent inhibition among CINs. A better understanding of striatal nicotinic receptors expression and function may help to develop targeted pharmacological interventions to treat brain disorders such as Parkinson's disease, Tourette syndrome, dystonia, or nicotine addiction.

Place vs. Response Learning: History, Controversy, and Neurobiology

The present article provides a historical review of the place and response learning plus-maze tasks with a focus on the behavioral and neurobiological findings. The article begins by reviewing the conflict between Edward C. Tolman's cognitive view and Clark L. Hull's stimulus-response (S-R) view of learning and how the place and response learning plus-maze tasks were designed to resolve this debate. Cognitive learning theorists predicted that place learning would be acquired faster than response learning, indicating the dominance of cognitive learning, whereas S-R learning theorists predicted that response learning would be acquired faster, indicating the dominance of S-R learning. Here, the evidence is reviewed demonstrating that either place or response learning may be dominant in a given learning situation and that the relative dominance of place and response learning depends on various parametric factors (i.e., amount of training, visual aspects of the learning environment, emotional arousal, et cetera). Next, the neurobiology underlying place and response learning is reviewed, providing strong evidence for the existence of multiple memory systems in the mammalian brain. Research has indicated that place learning is principally mediated by the hippocampus, whereas response learning is mediated by the dorsolateral striatum. Other brain regions implicated in place and response learning are also discussed in this section, including the dorsomedial striatum, amygdala, and medial prefrontal cortex. An exhaustive review of the neurotransmitter systems underlying place and response learning is subsequently provided, indicating important roles for glutamate, dopamine, acetylcholine, cannabinoids, and estrogen. Closing remarks are made emphasizing the historical importance of the place and response learning tasks in resolving problems in learning theory, as well as for examining the behavioral and neurobiological mechanisms of multiple memory systems. How the place and response learning tasks may be employed in the future for examining extinction, neural circuits of memory, and human psychopathology is also briefly considered.

The Hippocampus and Dorsolateral Striatum Integrate Distinct Types of Memories through Time and Space, Respectively

Several decades of research have established that different kinds of memories result from the activity of discrete neural networks. Studying how these networks process information in experiments that target specific types of mnemonic representations has provided deep insights into memory architecture and its neural underpinnings. However, in natural settings reality confronts organisms with problems that are not neatly compartmentalized. Thus, a critical problem in memory research that still needs to be addressed is how distinct types of memories are ultimately integrated. Here we demonstrate how two memory networks, the hippocampus and dorsolateral striatum, may accomplish such a goal. The hippocampus supports memory for facts and events, collectively known as declarative memory and often studied as spatial memory in rodents. The dorsolateral striatum provides the basis for habits that are assessed in stimulus-response types of tasks. Expanding previous findings, the current work revealed that in male Long-Evans rats, the hippocampus and dorsolateral striatum use time and space in distinct and largely complementary ways to integrate spatial and habitual representations. Specifically, the hippocampus supported both types of memories when they were formed in temporal juxtaposition, even if the learning took place in different environments. In contrast, the lateral striatum supported both types of memories if they were formed in the same environment, even at temporally distinct points. These results reveal for the first time that by using fundamental aspects of experience in specific ways, the hippocampus and dorsolateral striatum can transcend their attributed roles in information storage.SIGNIFICANCE STATEMENT The current paradigm in memory research postulates that different types of memories reflected in separate types of behavioral strategies result from activity in distinct neural circuits. However, recent data have shown that when rats concurrently acquired in the same environment of hippocampal-dependent spatial navigation and striatal-dependent approach of a visual cue, each of the two types of memories became dependent on both the hippocampus and dorsolateral striatum. The current work reveals that the hippocampus and dorsolateral striatum use distinct and complementary principles to integrate different types of memories in time and space: the hippocampus integrates memories formed in temporal proximity, while the lateral striatum integrates memories formed in the same space.

Muscarinic receptor signaling in the amygdala is required for conditioned taste aversion

The sense of taste provides information regarding the nutrient content, safety or potential toxicity of an edible. This is accomplished via a combination of innate and learned taste preferences. In conditioned taste aversion (CTA), rats learn to avoid ingesting a taste that has previously been paired with gastric malaise. Recent evidence points to a role of cholinergic muscarinic signaling in the amygdala for the learning and storage of emotional memories. The present study tested the participation of muscarinic receptors in the amygdala during the formation of CTA by infusing the non-specific antagonist scopolamine into the basolateral or central subnuclei before or after conditioning, as well as before retrieval. Our data show that regardless of the site of infusion, pre-conditioning administration of scopolamine impaired CTA acquisition whereas post-conditioning infusion did not affect its storage. Also, infusions into the basolateral but not in the central amygdala before retrieval test partially reduced the expression of CTA. Our results indicate that muscarinic receptors activity is required for acquisition but not consolidation of CTA. In addition, our data add to recent evidence pointing to a role of cholinergic signaling in peri-hippocampal structures in the process of memory retrieval.

Targeting the cholinergic system in Parkinson's disease

Motor control in the striatum is an orchestra played by various neuronal populations. Loss of harmony due to dopamine deficiency is considered the primary pathological cause of the symptoms of Parkinson’s disease (PD). Recent progress in experimental approaches has enabled us to examine the striatal circuitry in a much more comprehensive manner, not only reshaping our understanding of striatal functions in movement regulation but also leading to new opportunities for the development of therapeutic strategies for treating PD. In addition to dopaminergic innervation, giant aspiny cholinergic interneurons (ChIs) within the striatum have long been recognized as a critical node for balancing dopamine signaling and regulating movement. With the roles of ChIs in motor control further uncovered and more specific manipulations available, striatal ChIs and their corresponding receptors are emerging as new promising therapeutic targets for PD. This review summarizes recent progress in functional studies of striatal circuitry and discusses the translational implications of these new findings for the treatment of PD.

Dopamine D1 and muscarinic acetylcholine receptors in dorsal striatum are required for high speed running

Dopamine (DA) signaling in the basal ganglia plays important roles in motor control. Motor deficiencies were previously reported in dopamine receptor D1 (D1R) and D2 (D2R) knockout mice. While these results indicate the involvement of DA receptors in motor execution, the null knockout (KO) mouse lacks the specificity necessary to determine when and where in the brain D1R and D2R function in motor execution. To address these questions, we restricted the loss of function temporally and spatially by using D1R conditional knockdown (cKD) mice and mice injected with antagonists against DA receptors directly into the dorsal striatum. In addition, we address the DA and acetylcholine (ACh) balance hypothesis by using antagonists against ACh receptors. We tested the motor ability of the mice with a newly devised task named the accelerating step-wheel. In this task, the maximum running speed was measured in a situation where the wheel rotation speed was gradually accelerated in one trial. We found significant decreases in the maximum running speed of D1R cKD mice and the mice injected with the antagonist against D1R or muscarinic ACh receptor. These results indicated that D1R and muscarinic ACh receptor in the dorsal striatum play pivotal roles in the execution of walking/running.

Reversal Learning Performance in the XY∗ Mouse Model of Klinefelter and Turner Syndromes

Klinefelter syndrome (KS; 47, XXY) and Turner syndrome (TS; 45, XO) are caused by two relatively common sex chromosome aneuploidies. These conditions are associated with an increased odds of neuropsychiatric disorders, including attention deficit/hyperactivity disorder (ADHD), as well as impairments in cognition that include learning delays, attentional dysfunction and impulsivity. We studied cognitive functions in the XY^∗ mouse model, which allows comparison of XXY to XY males (KS model), and XO to XX females (TS model). We evaluated adult mice with and without gonads, using a version of an operant reversal-learning task (RLT) that can be used to measure various facets of learning, impulsivity and attention. In the KS model, only one measure related to impulsivity – perseverative responding under reversal conditions – reliably discriminated gonadally intact XXY and XY mice. In contrast, a fundamental learning impairment (more trials to criterion in acquisition phase) in XXY mice, as compared to XY, was observed in gonadectomized subjects. No other task measures showed differences consistent with KS. In the TS mouse model, XO mice did not show a pattern of results consistent with TS, similar to past observations. Thus, the application of this RLT to these XY^∗ models reveals only limited behavioral impairments relevant to KS.

Dichotomy between motor and cognitive functions of midbrain cholinergic neurons

Cholinergic neurons of the pedunculopontine nucleus (PPN) are interconnected with all the basal ganglia structures, as well as with motor centers in the brainstem and medulla. Recent theories put into question whether PPN cholinergic neurons form part of a locomotor region that directly regulates the motor output, and rather suggest a modulatory role in adaptive behavior involving both motor and cognitive functions. In support of this, experimental studies in animals suggest that cholinergic neurons reinforce actions by signaling reward prediction and shape adaptations in behavior during changes of environmental contingencies. This is further supported by clinical studies proposing that decreased cholinergic transmission originated in the PPN is associated with impaired sensorimotor integration and perseverant behavior, giving rise to some of the symptoms observed in Parkinson's disease and progressive supranuclear palsy. Altogether, the evidence suggests that cholinergic neurons of the PPN, mainly through their interactions with the basal ganglia, have a leading role in action control.

Regional Striatal Cholinergic Involvement in Human Behavioral Flexibility

Animal studies have shown that the striatal cholinergic system plays a role in behavioral flexibility but, until recently, this system could not be studied in humans due to a lack of appropriate noninvasive techniques. Using proton magnetic resonance spectroscopy, we recently showed that the concentration of dorsal striatal choline (an acetylcholine precursor) changes during reversal learning (a measure of behavioral flexibility) in humans. The aim of the present study was to examine whether regional average striatal choline was associated with reversal learning. A total of 22 participants (mean age = 25.2 years, range = 18-32 years, 13 female) reached learning criterion in a probabilistic learning task with a reversal component. We measured choline at rest in both the dorsal and ventral striatum using magnetic resonance spectroscopy. Task performance was described using a simple reinforcement learning model that dissociates the contributions of positive and negative prediction errors to learning. Average levels of choline in the dorsal striatum were associated with performance during reversal, but not during initial learning. Specifically, lower levels of choline in the dorsal striatum were associated with a lower number of perseverative trials. Moreover, choline levels explained interindividual variance in perseveration over and above that explained by learning from negative prediction errors. These findings suggest that the dorsal striatal cholinergic system plays an important role in behavioral flexibility, in line with evidence from the animal literature and our previous work in humans. Additionally, this work provides further support for the idea of measuring choline with magnetic resonance spectroscopy as a noninvasive way of studying human cholinergic neurochemistry.SIGNIFICANCE STATEMENT Behavioral flexibility is a crucial component of adaptation and survival. Evidence from the animal literature shows that the striatal cholinergic system is fundamental to reversal learning, a key paradigm for studying behavioral flexibility, but this system remains understudied in humans. Using proton magnetic resonance spectroscopy, we showed that choline levels at rest in the dorsal striatum are associated with performance specifically during reversal learning. These novel findings help to bridge the gap between animal and human studies by demonstrating the importance of cholinergic function in the dorsal striatum in human behavioral flexibility. Importantly, the methods described here cannot only be applied to furthering our understanding of healthy human neurochemistry, but also to extending our understanding of cholinergic disorders.

Action Selection and Flexible Switching Controlled by the Intralaminar Thalamic Neurons

Learning processes contributing to appropriate selection and flexible switching of behaviors are mediated through the dorsal striatum, a key structure of the basal ganglia circuit. The major inputs to striatal subdivisions are provided from the intralaminar thalamic nuclei, including the central lateral nucleus (CL) and parafascicular nucleus (PF). Thalamostriatal neurons in the PF modulate the acquisition and performance of stimulus-response learning. Here, we address the roles of the CL thalamostriatal neurons in learning processes by using a selective neural pathway targeting technique. We show that the CL neurons are essential for the performance of stimulus-response learning and for behavioral flexibility, including reversal and attentional set-shifting of learned responses. In addition, chemogenetic suppression of neural activity supports the requirements of these neurons for behavioral flexibility. Our results suggest that the main contribution of the CL thalamostriatal neurons is functional control of the basal ganglia circuit linked to the prefrontal cortex.

Contribution of cholinergic interneurons to striatal pathophysiology in Parkinson's disease

Parkinson's disease (PD) is a neurodegenerative disorder caused by the loss of nigral dopaminergic neurons innervating the striatum, the main input structure of the basal ganglia. This creates an imbalance between dopaminergic inputs and cholinergic interneurons (ChIs) within the striatum. The efficacy of anticholinergic drugs, one of the earliest therapy for PD before the discovery of L-3,4-dihydroxyphenylalanine (L-DOPA) suggests an increased cholinergic tone in this disease. The dopamine (DA)-acetylcholine (ACh) balance hypothesis is now revisited with the use of novel cutting-edge techniques (optogenetics, pharmacogenetics, new electrophysiological recordings). This review will provide the background of the specific contribution of ChIs to striatal microcircuit organization in physiological and pathological conditions. The second goal of this review is to delve into the respective contributions of nicotinic and muscarinic receptor cholinergic subunits to the control of striatal afferent and efferent neuronal systems. Special attention will be given to the role played by muscarinic acetylcholine receptors (mAChRs) in the regulation of striatal network which may have important implications in the development of novel therapeutic strategies for motor and cognitive impairment in PD.

Selective Role of the Putamen in Serial Reversal Learning in the Marmoset

Fronto-striatal circuitry involving the orbitofrontal cortex has been identified as mediating successful reversal of stimulus-outcome contingencies. The region of the striatum that most contributes to reversal learning remains unclear, with studies in primates implicating both caudate nucleus and putamen. We trained four marmosets on a touchscreen-based serial reversal task and implanted each with cannulae targeting both putamen and caudate bilaterally. This allowed reversible inactivation of the two areas within the same monkeys, but across separate sessions, to directly investigate their respective contributions to reversal performance. Behavioral sensitivity to the GABAA agonist muscimol varied across subjects and between brain regions, so each marmoset received a range of doses. Intermediate doses of intra-putamen muscimol selectively impaired reversal performance, leaving the baseline discrimination phase unchanged. There was no effect of low doses and high doses were generally disruptive. By contrast, low doses of intra-caudate muscimol improved reversal performance, while high doses impaired both reversal and baseline discrimination performance. These data provide evidence for a specific role of the putamen in serial reversal learning, which may reflect the more habitual nature of repeated reversals using the same stimulus pair.

Acetylcholine-modulated plasticity in reward-driven navigation: a computational study

Neuromodulation plays a fundamental role in the acquisition of new behaviours. In previous experimental work, we showed that acetylcholine biases hippocampal synaptic plasticity towards depression, and the subsequent application of dopamine can retroactively convert depression into potentiation. We also demonstrated that incorporating this sequentially neuromodulated Spike-Timing-Dependent Plasticity (STDP) rule in a network model of navigation yields effective learning of changing reward locations. Here, we employ computational modelling to further characterize the effects of cholinergic depression on behaviour. We find that acetylcholine, by allowing learning from negative outcomes, enhances exploration over the action space. We show that this results in a variety of effects, depending on the structure of the model, the environment and the task. Interestingly, sequentially neuromodulated STDP also yields flexible learning, surpassing the performance of other reward-modulated plasticity rules.

Neurological Changes in Vulnerable Brain Areas of Chronic Cerebral Hypoperfusion Mice

BACKGROUND

Chronic cerebral hypoperfusion (CCH) is associated with neurological changes and cognitive decline. It is a major cause of vascular dementia and a contributing factor in Alzheimer disease. Animal models are useful in helping to elucidate the mechanisms of these diseases while demonstrating differences in pathological onset and severity. Furthermore, different mouse strains show differences in their susceptibility to neurological damage resulting in different cognitive outcomes.

PURPOSE

This study investigated the effect of CCH induced by permanent unilateral common carotid artery occlusion (UCO) on neurological damage in vulnerable brain regions such as hippocampus, striatum, and white matter areas from 2 to 8 weeks following CCH induction.

METHODS

Thirty-six male Institute of Cancer Research (ICR) mice were randomly divided into 2 main experimental groups, Sham and UCO. These 2 main groups were further divided into 3 observation periods of 2, 4, and 8 weeks following CCH. Histological study was then employed using 0.1% cresyl violet and luxol fast blue staining to assess neurological damage.

RESULTS

We found equal levels of neurological damage induced by CCH between ipsi- and contralateral hemispheres. Hippocampus and striatum damage were slightly increased from 2 to 8 weeks rising to significance at 8 weeks in both areas, while the white matter densities of the corpus callosum, internal capsule, optic tract and striatum fiber did not change.

CONCLUSION

CCH induced by UCO in ICR mice induces hippocampal and striatal damage at 8 weeks while leaving white matter undamaged.

Functional neurochemical imaging of the human striatal cholinergic system during reversal learning

Animal studies have shown that acetylcholine (ACh) levels in the dorsal striatum play a role in reversal learning. However, this has not been studied in humans due to a lack of appropriate non-invasive techniques. Proton magnetic resonance spectroscopy (¹ H-MRS) can be used to measure metabolite levels in humans in vivo. Although it cannot be used to study ACh directly, ¹ H-MRS can be used to study choline, an ACh precursor, which is linked to activity-dependent ACh release. The aim of this study was to use functional-¹ H-MRS (fMRS) to measure changes in choline levels in the human dorsal striatum during performance of a probabilistic reversal learning task. We demonstrate a task-dependent decrease in choline, specifically during reversal, but not initial, learning. We interpret this to reflect a sustained increase in ACh levels, which is in line with findings from the animal literature. This task-dependent change was specific to choline and was not observed in control metabolites. These findings provide support for the use of fMRS in the in vivo study of the human cholinergic system.

Task-dependent function of striatal cholinergic interneurons in behavioural flexibility

Flexible switching of behaviours depends on integrative functioning through the neural circuit connecting the prefrontal cortex and the dorsomedial striatum (DMS). Although cholinergic interneurons modulate striatal outputs by diverse synaptic mechanisms, the roles of cholinergic interneurons in the DMS appear to vary among different models used to validate behavioural flexibility. Here, we conducted immunotoxin-mediated cell targeting of DMS cholinergic interneurons and examined the functions of these interneurons in behavioural flexibility, with the learning conditions differing in trial spacing and discrimination type in a modified T-maze. Elimination of the DMS cholinergic cell group normally spared reversal learning in place discrimination with an intertrial interval (ITI) of 15 s, but it impaired the reversal performance in response discrimination with the same ITI. In contrast, DMS cholinergic elimination resulted in enhanced reversal performance in both place and response discrimination tasks with a 10-min ITI and accelerated the reversal of response discrimination with a 20-min ITI. Our previous study also showed an enhanced influence of cholinergic targeting on place reversal learning with a 20-min ITI, and the present results demonstrate that DMS cholinergic interneurons act to inhibit both place and response reversal performance with a relatively longer ITI, whereas their functions differ between types of reversal performance in the tasks with a shorter ITI. These findings suggest distinct roles of the DMS cholinergic cell group in behavioural flexibility dependent on the trial spacing and discrimination type constituting the learning tasks.

Attentional deficits and altered neuronal activation in medial prefrontal and posterior parietal cortices in mice with reduced dopamine transporter levels

The executive control function of attention is regulated by the dopaminergic (DA) system. Dopamine transporter (DAT) likely plays a role in controlling the influence of DA on cognitive processes. We examined the effects of DAT depletion on cognitive processes related to attention. Mice with the DAT gene genetically deleted (DAT+/- heterozygotes) were compared to wild type (WT) mice on the Attentional Set-Shifting Task (ASST). Changes in neuronal activity during the ASST were shown with early growth response genes 1 and 2 (egr-1 and egr-2) immunohistochemistry in the medial prefrontal cortex (mPFC) and in the posterior parietal cortex (PPC). Heterozygotes were impaired in tasks that tax reversal learning, attentional-set formation and set-shifting. Densities of egr-2 labeled cells in the mPFC were lower in mutant mice when compared with wild-types in intradimensional shift of attention (IDS), extradimensional shift of attention and extradimensional shift of attention-reversal phases of the ASST task, and in PPC in the IDS phase of the task. The results demonstrate impairments of the areas associated with attentional functions in DAT+/- mice and show that an imbalance of the dopaminergic system has an impact on the complex attention-related executive functions.

Thalamic inputs to dorsomedial striatum are involved in inhibitory control: evidence from the five-choice serial reaction time task in rats

RATIONALE

Corticostriatal circuits are widely implicated in the top-down control of attention including inhibitory control and behavioural flexibility. However, recent neurophysiological evidence also suggests a role for thalamic inputs to striatum in behaviours related to salient, reward-paired cues.

OBJECTIVES

Here, we used designer receptors exclusively activated by designer drugs (DREADDs) to investigate the role of parafascicular (Pf) thalamic inputs to the dorsomedial striatum (DMS) using the five-choice serial reaction time task (5CSRTT) in rats.

METHODS

The 5CSRTT requires sustained attention in order to detect spatially and temporally distributed visual cues and provides measures of inhibitory control related to impulsivity (premature responses) and compulsivity (perseverative responses). Rats underwent bilateral Pf injections of the DREADD vector, AAV2-CaMKIIa-HA-hM4D(Gi)-IRES-mCitrine. The DREADD agonist, clozapine N-oxide (CNO; 1 μl bilateral; 3 μM) or vehicle, was injected into DMS 1 h before behavioural testing. Task parameters were manipulated to increase attention load or reduce stimulus predictability respectively.

RESULTS

We found that inhibition of the Pf-DMS projection significantly increased perseverative responses when stimulus predictability was reduced but had no effect on premature responses or response accuracy, even under increased attentional load. Control experiments showed no effects on locomotor activity in an open field.

CONCLUSIONS

These results complement previous lesion work in which the DMS and orbitofrontal cortex were similarly implicated in perseverative responses and suggest a specific role for thalamostriatal inputs in inhibitory control.

Behavioural inflexibility in a comorbid rat model of striatal ischemic injury and mutant hAPP overexpression

Alzheimer disease (AD) and stroke coexist and interact; yet how they interact is not sufficiently understood. Both AD and basal ganglia stroke can impair behavioural flexibility, which can be reliably modeled in rats using an established operant based set-shifting test. Transgenic Fischer 344-APP21 rats (TgF344) overexpress pathogenic human amyloid precursor protein (hAPP) but do not spontaneously develop overt pathology, hence TgF344 rats can be used to model the effect of vascular injury in the prodromal stages of Alzheimer disease. We demonstrate that the injection of endothelin-1 (ET1) into the dorsal striatum of TgF344 rats (Tg-ET1) produced an exacerbation of behavioural inflexibility with a behavioural phenotype that was distinct from saline-injected wildtype & TgF344 rats as well as ET1-injected wildtype rats (Wt-ET1). In addition to profiling the types of errors made, interpolative modeling using logistic exposure-response regression provided an informative analysis of the timing and efficiency of behavioural flexibility. During set-shifting, Tg-ET1 committed fewer perseverative errors than Wt-ET1. However, Tg-ET1 committed significantly more regressive errors and had a less efficient strategy change than all other groups. Thus, behavioural flexibility was more vulnerable to striatal ischemic injury in TgF344 rats.

A Biologically Plausible Architecture of the Striatum to Solve Context-Dependent Reinforcement Learning Tasks

Basal ganglia circuit is an important subcortical system of the brain thought to be responsible for reward-based learning. Striatum, the largest nucleus of the basal ganglia, serves as an input port that maps cortical information. Microanatomical studies show that the striatum is a mosaic of specialized input-output structures called striosomes and regions of the surrounding matrix called the matrisomes. We have developed a computational model of the striatum using layered self-organizing maps to capture the center-surround structure seen experimentally and explain its functional significance. We believe that these structural components could build representations of state and action spaces in different environments. The striatum model is then integrated with other components of basal ganglia, making it capable of solving reinforcement learning tasks. We have proposed a biologically plausible mechanism of action-based learning where the striosome biases the matrisome activity toward a preferred action. Several studies indicate that the striatum is critical in solving context dependent problems. We build on this hypothesis and the proposed model exploits the modularity of the striatum to efficiently solve such tasks.

Regulatory BC1 RNA in cognitive control

Dendritic regulatory BC1 RNA is a non-protein-coding (npc) RNA that operates in the translational control of gene expression. The absence of BC1 RNA in BC1 knockout (KO) animals causes translational dysregulation that entails neuronal phenotypic alterations including prolonged epileptiform discharges, audiogenic seizure activity in vivo, and excessive cortical oscillations in the γ frequency band. Here we asked whether BC1 RNA control is also required for higher brain functions such as learning, memory, or cognition. To address this question, we used odor/object attentional set shifting tasks in which prefrontal cortical performance was assessed in a series of discrimination and conflict learning sessions. Results obtained in these behavioral trials indicate that BC1 KO animals were significantly impaired in their cognitive flexibility. When faced with conflicting information sources, BC1 KO animals committed regressive errors as they were compromised in their ability to disengage from recently acquired memories even though recall of such memories was in conflict with new situational context. The observed cognitive deficits are reminiscent of those previously described in subtypes of human autism spectrum disorders.

Effects of lesions of the subthalamic nucleus/zona incerta area and dorsomedial striatum on attentional set-shifting in the rat

Patients with Parkinson's disease (PD) show cognitive impairments, including difficulty in shifting attention between perceptual dimensions of complex stimuli. Inactivation of the subthalamic nucleus (STN) has been shown to be effective in ameliorating the motor abnormalities associated with striatal dopamine (DA) depletion, but it is possible that STN inactivation might result in additional, perhaps attentional, deficits. This study examined the effects of: DA depletion from the dorsomedial striatum (DMS); lesions of the STN area; and the effects of the two lesions together, on the ability to shift attentional set in the rat. In a single session, rats performed the intradimensional/extradimensional (ID/ED) test of attentional set-shifting. This comprises a series of seven, two-choice discriminations, including acquisitions of novel discriminations in which the relevant stimulus is either in the currently attended dimension (ID) or the currently unattended dimension (ED shift) and reversals (REVs) following each acquisition stage. Bilateral lesions were made by injection of 6-hydroxydopamine (6-OHDA) into the DMS, resulting in a selective impairment in reversal learning. Large bilateral ibotenic acid lesions centered on the STN resulted in an increase in trials to criterion in the initial stages, but learning rate improved within the session. There was no evidence of a 'cost' of set-shifting - the ED stage was completed in fewer trials than the ID stage - and neither was there a cost of reversal learning. Strikingly, combined lesions of both regions did not resemble the effects of either lesion alone and resulted in no apparent deficits.

New Variations for Strategy Set-shifting in the Rat

Behavioral flexibility is crucial for survival in changing environments. Broadly defined, behavioral flexibility requires a shift of behavioral strategy based on a change in governing rules. We describe a strategy set-shifting task that requires an attentional shift from one stimulus dimension to another. The paradigm is often used for testing cognitive flexibility in primates. However, the rodent version has not been as extensively developed. We have recently extended an established set-shifting task in the rat¹ by requiring attention to different stimuli according to context. All the experimental conditions required animals to choose either a left or right lever. Initially, all animals had to choose on the basis of the location of the lever. Subsequently, a change in the rule occurred, which required a shift in set from location-based rule to a rule in which the correct lever was indicated by a light cue. We compared performance on three different versions of the task, in which the light stimulus was either novel, previously relevant, or previously irrelevant. We found that specific neurochemical lesions selectively impaired the ability to make particular types of set shift as measured by the performance on the different versions of the task.

Updating temporal expectancy of an aversive event engages striatal plasticity under amygdala control

Pavlovian aversive conditioning requires learning of the association between a conditioned stimulus (CS) and an unconditioned, aversive stimulus (US) but also involves encoding the time interval between the two stimuli. The neurobiological bases of this time interval learning are unknown. Here, we show that in rats, the dorsal striatum and basal amygdala belong to a common functional network underlying temporal expectancy and learning of a CS-US interval. Importantly, changes in coherence between striatum and amygdala local field potentials (LFPs) were found to couple these structures during interval estimation within the lower range of the theta rhythm (3-6 Hz). Strikingly, we also show that a change to the CS-US time interval results in long-term changes in cortico-striatal synaptic efficacy under the control of the amygdala. Collectively, this study reveals physiological correlates of plasticity mechanisms of interval timing that take place in the striatum and are regulated by the amygdala.

A cholinergic feedback circuit to regulate striatal population uncertainty and optimize reinforcement learning

Convergent evidence suggests that the basal ganglia support reinforcement learning by adjusting action values according to reward prediction errors. However, adaptive behavior in stochastic environments requires the consideration of uncertainty to dynamically adjust the learning rate. We consider how cholinergic tonically active interneurons (TANs) may endow the striatum with such a mechanism in computational models spanning three Marr's levels of analysis. In the neural model, TANs modulate the excitability of spiny neurons, their population response to reinforcement, and hence the effective learning rate. Long TAN pauses facilitated robustness to spurious outcomes by increasing divergence in synaptic weights between neurons coding for alternative action values, whereas short TAN pauses facilitated stochastic behavior but increased responsiveness to change-points in outcome contingencies. A feedback control system allowed TAN pauses to be dynamically modulated by uncertainty across the spiny neuron population, allowing the system to self-tune and optimize performance across stochastic environments.

Comparing the effects of subchronic phencyclidine and medial prefrontal cortex dysfunction on cognitive tests relevant to schizophrenia

RATIONALE

It is becoming increasingly clear that the development of treatments for cognitive symptoms of schizophrenia requires urgent attention, and that valid animal models of relevant impairments are required. With subchronic psychotomimetic agent phencyclidine (scPCP), a putative model of such impairment, the extent to which changes following scPCP do or do not resemble those following dysfunction of the prefrontal cortex is of importance.

OBJECTIVES

The present study carried out a comparison of the most common scPCP dosing regimen with excitotoxin-induced medial prefrontal cortex (mPFC) dysfunction in rats, across several cognitive tests relevant to schizophrenia.

METHODS

ScPCP subjects were dosed intraperitoneal with 5 mg/kg PCP or vehicle twice daily for 1 week followed by 1 week washout prior to behavioural testing. mPFC dysfunction was induced via fibre-sparing excitotoxin infused into the pre-limbic and infralimbic cortex. Subjects were tested on spontaneous novel object recognition, touchscreen object-location paired-associates learning and touchscreen reversal learning.

RESULTS

A double-dissociation was observed between object-location paired-associates learning and object recognition: mPFC dysfunction impaired acquisition of the object-location task but not spontaneous novel object recognition, while scPCP impaired spontaneous novel object recognition but not object-location associative learning. Both scPCP and mPFC dysfunction resulted in a similar facilitation of reversal learning.

CONCLUSIONS

The pattern of impairment following scPCP raises questions around its efficacy as a model of cognitive impairment in schizophrenia, particularly if importance is placed on faithfully replicating the effects of mPFC dysfunction.

Role of Striatal Cholinergic Interneurons in Set-Shifting in the Rat

The ability to change strategies in different contexts is a form of behavioral flexibility that is crucial for adaptive behavior. The striatum has been shown to contribute to certain forms of behavioral flexibility such as reversal learning. Here we report on the contribution of striatal cholinergic interneurons-a key element in the striatal neuronal circuit-to strategy set-shifting in which an attentional shift from one stimulus dimension to another is required. We made lesions of rat cholinergic interneurons in dorsomedial or ventral striatum using a specific immunotoxin and investigated the effects on set-shifting paradigms and on reversal learning. In shifting to a set that required attention to a previously irrelevant cue, lesions of dorsomedial striatum significantly increased the number of perseverative errors. In this condition, the number of never-reinforced errors was significantly decreased in both types of lesions. When shifting to a set that required attention to a novel cue, rats with ventral striatum lesions made more perseverative errors. Neither lesion impaired learning of the initial response strategy nor a subsequent switch to a new strategy when response choice was indicated by a previously relevant cue. Reversal learning was not affected. These results suggest that in set-shifting the striatal cholinergic interneurons play a fundamental role, which is dissociable between dorsomedial and ventral striatum depending on behavioral context. We propose a common mechanism in which cholinergic interneurons inhibit neurons representing the old strategy and enhance plasticity underlying exploration of a new rule.

Hippocampus and subregions of the dorsal striatum respond differently to a behavioral strategy change on a spatial navigation task

Goal-directed and habit-based behaviors are driven by multiple but dissociable decision making systems involving several different brain areas, including the hippocampus and dorsal striatum. On repetitive tasks, behavior transitions from goal directed to habit based with experience. Hippocampus has been implicated in initial learning and dorsal striatum in automating behavior, but recent studies suggest that subregions within the dorsal striatum have distinct roles in mediating habit-based and goal-directed behavior. We compared neural activity in the CA1 region of hippocampus with anterior dorsolateral and posterior dorsomedial striatum in rats on a spatial choice task, in which subjects experienced reward delivery changes that forced them to adjust their behavioral strategy. Our results confirm the importance of the hippocampus in evaluating predictive steps during goal-directed behavior, while separate circuits in the basal ganglia integrated relevant information during automation of actions and recognized when new behaviors were needed to continue obtaining rewards.

Preferential involvement by nucleus accumbens shell in mediating probabilistic learning and reversal shifts

Different subregions of nucleus accumbens (NAc) have been implicated in reward seeking, promoting flexible approach responses, suppressing nonrewarded actions, and facilitating shifts between different discrimination strategies. Interestingly, the NAc does not appear to mediate shifting between stimulus-reward associations (i.e., reversal learning) when reinforcement is predictable. How these nuclei may facilitate flexible response strategies when reward delivery is uncertain remains unclear. We investigated the effects of inactivation of the NAc shell and core on probabilistic reversal learning using an operant task wherein a "correct" response delivered reward on 80% of trials, and an "incorrect" response was reinforced on 20% of trials. Reinforcement contingencies were reversed repeatedly within a session. In well-trained rats, shell inactivation reduced the number of reversals completed and selectively reduced win-stay behavior. This impairment was apparent during the first discrimination, indicating a more general deficit in the use of probabilistic reward feedback to guide action selection. Shell inactivation also impaired reversal performance on a similar task where correct/incorrect choices always/never delivered reward. However, this impairment only emerged after both levers had been associated with reward. Inactivation of NAc core did not impair reversal performance but increased latencies to approach the response levers. These results suggest the NAc shell and core facilitate reward seeking in a distinct yet complementary manner when the relationship between specific actions and reward is uncertain or ambiguous and cognitive flexibility is required. The core promotes approach toward reward-associated stimuli, whereas the shell refines response selection to those specific actions more likely to yield reward.

Differential effects of systemic cholinergic receptor blockade on Pavlovian incentive motivation and goal-directed action selection

Reward-seeking actions can be guided by external cues that signal reward availability. For instance, when confronted with a stimulus that signals sugar, rats will prefer an action that produces sugar over a second action that produces grain pellets. Action selection is also sensitive to changes in the incentive value of potential rewards. Thus, rats that have been prefed a large meal of sucrose will prefer a grain-seeking action to a sucrose-seeking action. The current study investigated the dependence of these different aspects of action selection on cholinergic transmission. Hungry rats were given differential training with two unique stimulus-outcome (S1-O1 and S2-O2) and action-outcome (A1-O1 and A2-O2) contingencies during separate training phases. Rats were then given a series of Pavlovian-to-instrumental transfer tests, an assay of cue-triggered responding. Before each test, rats were injected with scopolamine (0, 0.03, or 0.1 mg/kg, intraperitoneally), a muscarinic receptor antagonist, or mecamylamine (0, 0.75, or 2.25 mg/kg, intraperitoneally), a nicotinic receptor antagonist. Although the reward-paired cues were capable of biasing action selection when rats were tested off-drug, both anticholinergic treatments were effective in disrupting this effect. During a subsequent round of outcome devaluation testing-used to assess the sensitivity of action selection to a change in reward value--we found no effect of either scopolamine or mecamylamine. These results reveal that cholinergic signaling at both muscarinic and nicotinic receptors mediates action selection based on Pavlovian reward expectations, but is not critical for flexibly selecting actions using current reward values.