Dorsal and ventral striatal dopamine D1 and D2 receptors differentially modulate distinct phases of serial visual reversal learning

Lower Dorsal Putamen D2/3 Receptor Availability and Amphetamine-Induced Dopamine Release are Related to Poorer Cognitive Function in Recently Abstinent People Who Smoke and Healthy Controls

INTRODUCTION

In the dopamine system, the mesolimbic pathway, including the dorsal striatum, underlies the reinforcing properties of tobacco smoking, and the mesocortical pathway, including the dorsolateral prefrontal cortex (dlPFC), is critical for cognitive functioning. Dysregulated dopamine signaling has been linked to drug-seeking behaviors and cognitive deficits. The dorsal striatum and dlPFC are structurally and functionally connected and are key regions for cognitive functioning. We recently showed that people who smoke have lower dlPFC dopamine (D2/3R) receptor availability than people who do not, which is related to poorer cognitive function.

AIMS AND METHODS

The goal of this study was to examine the same brain-behavior relationship in the dorsal striatum. Twenty-nine (18 males) recently abstinent people who smoke and 29 sex-matched healthy controls participated in 2 same-day [11C]-(+)-PHNO positron emission tomography scans before and after amphetamine administration to provoke dopamine release. D2/3R availability (binding potential; BPND) and amphetamine-induced dopamine release (%ΔBPND) were calculated. Cognition (verbal learning and memory) was assessed with the CogState computerized battery.

RESULTS

There were no group differences in baseline BPND. People who smoke have a smaller magnitude %ΔBPND in dorsal putamen than healthy controls (p = .022). People who smoke perform worse on immediate (p = .035) and delayed (p = .011) recall than healthy controls. In all people, lower dorsal putamen BPND was associated with worse immediate (p = .006) and delayed recall (p = .049), and lower %ΔBPND was related to worse delayed recall (p = .022).

CONCLUSIONS

Lower dorsal putamen D2/3R availability and function are associated with disruptions in cognitive function that may underlie difficulty with resisting smoking.

IMPLICATIONS

This study directly relates dopamine imaging outcomes in the dorsal striatum to cognitive function in recently abstinent people who smoke cigarettes and healthy controls. The current work included a well-characterized subject sample in terms of demographics, smoking characteristics, and a validated neurocognitive test of verbal learning and memory. The findings of this study extend previous literature relating dopamine imaging outcomes to cognition in recently abstinent people who smoke and people who do not smoke, expanding our understanding of brain-behavior relationships.

Distinct basal ganglia contributions to learning from implicit and explicit value signals in perceptual decision-making

Metacognitive evaluations of confidence provide an estimate of decision accuracy that could guide learning in the absence of explicit feedback. We examine how humans might learn from this implicit feedback in direct comparison with that of explicit feedback, using simultaneous EEG-fMRI. Participants performed a motion direction discrimination task where stimulus difficulty was increased to maintain performance, with intermixed explicit- and no-feedback trials. We isolate single-trial estimates of post-decision confidence using EEG decoding, and find these neural signatures re-emerge at the time of feedback together with separable signatures of explicit feedback. We identified these signatures of implicit versus explicit feedback along a dorsal-ventral gradient in the striatum, a finding uniquely enabled by an EEG-fMRI fusion. These two signals appear to integrate into an aggregate representation in the external globus pallidus, which could broadcast updates to improve cortical decision processing via the thalamus and insular cortex, irrespective of the source of feedback.

Characterizing the dynamic learning process: Implications of a quantitative analysis

Understanding the neural mechanisms involved in learning processes is crucial for unraveling the complexities of behavior and cognition. Sudden change from the untrained level to the fully-learned level is a pivotal feature of instrumental learning. However, the concept of change point and suitable methods to conveniently analyze the characteristics of sudden change in groups remain elusive, which might hinder a fuller understanding of the neural mechanism underlying dynamic leaning process. In the current study, we investigated the learning processes of mice that were trained in an aversive instrumental learning task, and introduced a novel strategy to analyze behavioral variations in instrumental learning, leading to improved clarity on the concept of sudden change and enabling comprehensive group analysis. By applying this novel strategy, we examined the effects of cocaine and a cannabinoid receptor agonist on instrumental learning. Intriguingly, our analysis revealed significant differences in timing and occurrence of sudden changes that were previously overlooked using traditional analysis. Overall, our research advances understanding of behavioral variation during instrumental learning and the interplay between learning behaviors and neurotransmitter systems, contributing to a deeper comprehension of learning processes and informing future investigations and therapeutic interventions.

Frontostriatal circuit dysfunction leads to cognitive inflexibility in neuroligin-3 R451C knockin mice

Cognitive and behavioral rigidity are observed in various psychiatric diseases, including in autism spectrum disorder (ASD). However, the underlying mechanism remains to be elucidated. In this study, we found that neuroligin-3 (NL3) R451C knockin mouse model of autism (KI mice) exhibited deficits in behavioral flexibility in choice selection tasks. Single-unit recording of medium spiny neuron (MSN) activity in the nucleus accumbens (NAc) revealed altered encoding of decision-related cue and impaired updating of choice anticipation in KI mice. Additionally, fiber photometry demonstrated significant disruption in dynamic mesolimbic dopamine (DA) signaling for reward prediction errors (RPEs), along with reduced activity in medial prefrontal cortex (mPFC) neurons projecting to the NAc in KI mice. Interestingly, NL3 re-expression in the mPFC, but not in the NAc, rescued the deficit of flexible behaviors and simultaneously restored NAc-MSN encoding, DA dynamics, and mPFC-NAc output in KI mice. Taken together, this study reveals the frontostriatal circuit dysfunction underlying cognitive inflexibility and establishes a critical role of the mPFC NL3 deficiency in this deficit in KI mice. Therefore, these findings provide new insights into the mechanisms of cognitive and behavioral inflexibility and potential intervention strategies.

How are overweight and obesity associated with reinforcement learning deficits? A systematic review

Reinforcement learning (RL) refers to the ability to learn stimulus-response or response-outcome associations relevant to the acquisition of behavioral repertoire and adaptation to the environment. Research data from correlational and case-control studies have shown that obesity is associated with impairments in RL. The aim of the present study was to systematically review how obesity and overweight are associated with RL performance. More specifically, the relationship between high body mass index (BMI) and task performance was explored through the analysis of specific RL processes associated with different physiological, computational, and behavioral manifestations. Our systematic analyses indicate that obesity might be associated with impairments in the use of aversive outcomes to change ongoing behavior, as revealed by results involving instrumental negative reinforcement and extinction/reversal learning, but further research needs to be conducted to confirm this association. Hypotheses regarding how obesity might be associated with altered RL were discussed.

Prospective associations between cognitive flexibility and eating disorder symptoms in anorexia nervosa and bulimia nervosa

This study investigated concurrent and prospective associations between measures of reversal learning and attentional set-shifting and eating disorder symptoms at baseline, 3 months, and 6 months among individuals with anorexia nervosa restricting subtype (AN-R, n = 26), AN binge eating/purging subtype (AN-BP, n = 22), bulimia nervosa (BN, n = 35), and healthy controls (n = 27), and explored whether these associations differed by diagnosis. At baseline, participants completed diagnostic interviews, height/weight measurements, and measures of set-shifting (the Intradimensional/Extradimensional shift task) and reversal learning (a probabilistic reversal learning task). At 3- and 6-month follow-up, participants with eating disorders completed assessments of weight and eating disorder symptoms. A one-way analysis of variance found no evidence that baseline reversal learning and attentional set-shifting differed across diagnostic groups. Multilevel modeling analyses indicated that perseverative errors (an index of reversal learning) predicted an increase in purging over time for individuals with AN-BP and BN. Set-shifting errors differentially predicted frequency of loss of control eating for individuals with AN-BP and BN; however, set-shifting was not related to loss of control eating when examined separately in AN-BP and BN. These findings suggest that disentangling facets of cognitive flexibility may help understand change in eating disorder symptoms.

Fatty acid-binding protein 5 differentially impacts dopamine signaling independent of sex and environment

Epidermal/brain fatty acid-binding protein 5 (FABP5) plays an integral role in the intracellular trafficking of bioactive lipids/endocannabinoids and the subsequent initiation of cellular cascades affecting cannabinoid and dopamine (DA) systems. Social isolation (SI) and environmental enrichment (EE) during adolescence have been shown to impact DA signaling, and, specifically, DA transporter (DAT) and receptor levels of DA type 1 (D1) and 2 (D2); however, the relationship between FABP5, environment and DA signaling remains unclear. The present study quantified DAT and DA receptor levels in male/female FABP5-/- and FABP5+/+ mice raised in either SI or EE. Results showed that FABP5-/- mice had 6.09-8.81% greater D1 levels in striatal sub-regions of the caudal brain, independent of sex or environment. D1 levels were 8.03% greater only in the olfactory tubercle of enrichment-reared animals. In summary, these results supported that FABP5 plays an important function in regulating striatal DA signaling, and this may have important implications as a target with therapeutic potential for various psychiatric disorders.

Characterization of striatal dopamine projections across striatal subregions in behavioral flexibility

Behavioural flexibility is key to survival in a dynamic environmentWhile flexible, goal-directed behaviours are initially dependent on dorsomedial striatum, they become dependent on lateral striatum as behaviours become inflexible. Similarly, lesions of dopamine terminals in lateral striatum disrupt the development of inflexible habits. This work suggests that dopamine release in lateral striatum may drive inflexible behaviours, though few studies have investigated a causative role of subpopulations of striatal dopamine terminals in reversal learning, a measure of flexibility. Here, we performed two optogenetic experiments to activate dopamine terminals in dorsomedial (DMS), dorsolateral (DLS) or ventral (nucleus accumbens [NAc]) striatum in DAT-Cre mice that expressed channelrhodopsin-2 via viral injection (Experiment I) or through transgenic breeding with an Ai32 reporter line (Experiment II) to determine how specific dopamine subpopulations impact reversal learning. Mice performed a reversal task in which they self-stimulated DMS, DLS, or NAc dopamine terminals by pressing one of two levers before action-outcome lever contingencies were reversed. Largely consistent with presumed ventromedial/lateral striatal function, we found that mice self-stimulating medial dopamine terminals reversed lever preference following contingency reversal, while mice self-stimulating NAc showed parial flexibility, and DLS self-stimulation resulted in impaired reversal. Impairments in DLS mice were characterized by more regressive errors and reliance on lose-stay strategies following reversal, as well as reduced within-session learning, suggesting reward insensitivity and overreliance on previously learned actions. This study supports a model of striatal function in which DMS and ventral dopamine facilitate goal-directed responding, and DLS dopamine supports more inflexible responding.

Prefrontal Dopamine in Flexible Adaptation to Environmental Changes: A Game for Two Players

Deficits in cognitive flexibility have been characterized in affective, anxiety, and neurodegenerative disorders. This paper reviews data, mainly from studies on animal models, that support the existence of a cortical-striatal brain circuit modulated by dopamine (DA), playing a major role in cognitive/behavioral flexibility. Moreover, we reviewed clinical findings supporting misfunctioning of this circuit in Parkinson's disease that could be responsible for some important non-motoric symptoms. The reviewed findings point to a role of catecholaminergic transmission in the medial prefrontal cortex (mpFC) in modulating DA's availability in the nucleus accumbens (NAc), as well as a role of NAc DA in modulating the motivational value of natural and conditioned stimuli. The review section is accompanied by a preliminary experiment aimed at testing weather the extinction of a simple Pavlovian association fosters increased DA transmission in the mpFC and inhibition of DA transmission in the NAc.

Antagonism of D2 receptors via raclopride ameliorates amphetamine-induced associative learning deficits in male mice

Dopamine levels in the dorsomedial striatum (DMS) are highly dynamic and are thought to underly the encoding of action-outcome associations. Although it is known that amphetamine disrupts the learning that is required for goal-directed action, the role of D1 and D2 receptors in this process has not been established. In this study, we examined the role of D1 and D2 receptor antagonists on learning in response to amphetamine. We used the outcome-specific devaluation task to examine goal-directed action in male C57BL6/J mice treated systemically with either a D1 antagonist (SCH-23990; 0.01 mg/kg) or a D2 antagonist (raclopride; 0.5 mg/kg) and then administered amphetamine (1 mg/kg). The mice were injected repeatedly throughout the instrumental training phase of the task to assess the impact on the learning of action-outcomes, and the subsequent choice test assessing performance of goal-directed action was conducted drug free. Effects of chronic drug administration on locomotor behaviour was assessed before and after the choice test. Treatment during learning with either amphetamine, or the D1 or D2 antagonists, impaired the subsequent performance of goal-directed action. The amphetamine-induced impairment in goal-directed action was reversed in mice treated with raclopride, but not when treated with SCH-23990. By contrast, amphetamine-induced hyperactivity was reversed in mice treated with SCH-23990, but not in mice treated with raclopride. Taken together, these data support the role of a balance of dopamine receptor signalling after amphetamine treatment. While overall D1 receptor availability is necessary to promote learning, in a state of elevated dopamine, modifying D2 receptor function can ameliorate learning deficits.

Sex, but not juvenile stress, affects reversal learning and DRL performance following cocaine administration

INTRODUCTION

Early adversity, impulsivity and sex all contribute to the risk of developing substance use disorder. Using rats, we examined how juvenile stress interacts with sex and cocaine to affect performance on a serial reversal task and a differential reinforcement of low rates 10 s (DRL10) task. The expression of dopamine-related proteins in several brain areas was also assessed.

METHODS

From postnatal days (PND) 25-29, rats were exposed to a variable stress protocol. In adulthood, rats were trained on the reversal task and the effects of cocaine (0, 10, or 20 mg/kg, IP) on performance were assessed. Next, rats were trained on the DRL10 task and the effects of cocaine on performance were assessed. Finally, brains were extracted, and Western blot analyses conducted.

RESULTS

Juvenile stress did not affect behavior. Sex did not affect baseline performance in either task. In the reversal task, cocaine decreased % high probability responses and the number of rewards earned in both sexes. Cocaine had sex-dependent effects on omissions, low probability responses and response latencies. In the DRL10 task, cocaine decreased the peak latency to respond and the number of rewards earned in both sexes. Cocaine had sex-dependent effects on peak rate of responding, response efficiency, burst responses and long responses. Female rats exhibited increased expression of DRD1 receptors in the striatum.

DISCUSSION

These data contribute to the growing literature demonstrating sex differences in the behavioral effects of cocaine and suggest that DRD1 receptors could contribute to the observed behavioral sex differences.

The Addiction-Susceptibility TaqIA/Ankk1 Controls Reward and Metabolism Through D2 Receptor-Expressing Neurons

BACKGROUND

A large body of evidence highlights the importance of genetic variants in the development of psychiatric and metabolic conditions. Among these, the TaqIA polymorphism is one of the most commonly studied in psychiatry. TaqIA is located in the gene that codes for the ankyrin repeat and kinase domain containing 1 kinase (Ankk1) near the dopamine D2 receptor (D2R) gene. Homozygous expression of the A1 allele correlates with a 30% to 40% reduction of striatal D2R, a typical feature of addiction, overeating, and other psychiatric pathologies. The mechanisms by which the variant influences dopamine signaling and behavior are unknown.

METHODS

Here, we used transgenic and viral-mediated strategies to reveal the role of Ankk1 in the regulation of activity and functions of the striatum.

RESULTS

We found that Ankk1 is preferentially enriched in striatal D2R-expressing neurons and that Ankk1 loss of function in the dorsal and ventral striatum leads to alteration in learning, impulsivity, and flexibility resembling endophenotypes described in A1 carriers. We also observed an unsuspected role of Ankk1 in striatal D2R-expressing neurons of the ventral striatum in the regulation of energy homeostasis and documented differential nutrient partitioning in humans with or without the A1 allele.

CONCLUSIONS

Overall, our data demonstrate that the Ankk1 gene is necessary for the integrity of striatal functions and reveal a new role for Ankk1 in the regulation of body metabolism.

Enhancing reinforcement learning models by including direct and indirect pathways improves performance on striatal dependent tasks

A major advance in understanding learning behavior stems from experiments showing that reward learning requires dopamine inputs to striatal neurons and arises from synaptic plasticity of cortico-striatal synapses. Numerous reinforcement learning models mimic this dopamine-dependent synaptic plasticity by using the reward prediction error, which resembles dopamine neuron firing, to learn the best action in response to a set of cues. Though these models can explain many facets of behavior, reproducing some types of goal-directed behavior, such as renewal and reversal, require additional model components. Here we present a reinforcement learning model, TD2Q, which better corresponds to the basal ganglia with two Q matrices, one representing direct pathway neurons (G) and another representing indirect pathway neurons (N). Unlike previous two-Q architectures, a novel and critical aspect of TD2Q is to update the G and N matrices utilizing the temporal difference reward prediction error. A best action is selected for N and G using a softmax with a reward-dependent adaptive exploration parameter, and then differences are resolved using a second selection step applied to the two action probabilities. The model is tested on a range of multi-step tasks including extinction, renewal, discrimination; switching reward probability learning; and sequence learning. Simulations show that TD2Q produces behaviors similar to rodents in choice and sequence learning tasks, and that use of the temporal difference reward prediction error is required to learn multi-step tasks. Blocking the update rule on the N matrix blocks discrimination learning, as observed experimentally. Performance in the sequence learning task is dramatically improved with two matrices. These results suggest that including additional aspects of basal ganglia physiology can improve the performance of reinforcement learning models, better reproduce animal behaviors, and provide insight as to the role of direct- and indirect-pathway striatal neurons.

Neurotensin and Alcohol Use Disorders: Towards a Pharmacological Treatment

Harmful alcohol use is responsible for a group of disorders collectively named alcohol use disorders (AUDs), according to the DSM-5 classification. The damage induced by alcohol depends on the amount, time, and consumption patterns (continuous and heavy episodic drinking). It affects individual global well-being and social and familial environments with variable impact. Alcohol addiction manifests with different degrees of organ and mental health detriment for the individual, exhibiting two main traits: compulsive drinking and negative emotional states occurring at withdrawal, frequently causing relapse episodes. Numerous individual and living conditions, including the concomitant use of other psychoactive substances, lie in the complexity of AUD. Ethanol and its metabolites directly impact the tissues and may cause local damage or alter the homeostasis of brain neurotransmission, immunity scaffolding, or cell repair biochemical pathways. Brain modulator and neurotransmitter-assembled neurocircuitries govern reward, reinforcement, social interaction, and consumption of alcohol behaviors in an intertwined manner. Experimental evidence supports the participation of neurotensin (NT) in preclinical models of alcohol addiction. For example, NT neurons in the central nucleus of the amygdala projecting to the parabrachial nucleus strengthen alcohol consumption and preference. In addition, the levels of NT in the frontal cortex were found to be lower in rats bred to prefer alcohol to water in a free alcohol-water choice compared to wild-type animals. NT receptors 1 and 2 seem to be involved in alcohol consumption and alcohol effects in several models of knockout mice. This review aims to present an updated picture of the role of NT systems in alcohol addiction and the possible use of nonpeptide ligands modulating the activity of the NT system, applied to experimental animal models of harmful drinking behavior mimicking alcohol addiction leading to health ruin in humans.

Lesions of nucleus accumbens shell abolish socially transmitted food preferences

Rats adapt their food choices to conform to their conspecifics' dietary preferences. The nucleus accumbens shell is a relevant brain region to process reward-related and motivated behaviours and social information. Here, we hypothesize that the integrity of the nucleus accumbens shell is necessary to show socially transmitted food preferences. We made excitotoxic and sham lesions of nucleus accumbens shell in male Long-Evans rats who performed a social transmission of food preference task. In this task, observer rats revealed their original preference for one out of two food options. Afterward, they were exposed to a demonstrator rat who was fed with the observer's originally non-preferred food, and the observer's food choices were sampled again. Sham lesioned observer rats changed their food preferences following interaction with the demonstrator, specifically by increasing the intake of their originally non-preferred food type. This interaction-related change in preference was not found after nucleus accumbens shell lesions. The lesion effects on choice were not the consequence of impaired social or non-social motivation, anxiety or sensory or motor function, suggesting that they reflected a genuine deficit in social reward revaluation. These results highlight the role of nucleus accumbens shell in revaluating food rewards to match a conspecific's preferences.

Nucleus Accumbens Core Dopamine D2 Receptor-Expressing Neurons Control Reversal Learning but Not Set-Shifting in Behavioral Flexibility in Male Mice

The ability to use environmental cues to flexibly guide responses is crucial for adaptive behavior and is thought to be controlled within a series of cortico-basal ganglia-thalamo-cortical loops. Previous evidence has indicated that different prefrontal cortical regions control dissociable aspects of behavioral flexibility, with the medial prefrontal cortex (mPFC) necessary for the ability to shift attention to a novel strategy (set-shifting) and the orbitofrontal cortex (OFC) necessary for shifting attention between learned stimulus-outcome associations (reversal learning). The nucleus accumbens (NAc) is a major downstream target of both the mPFC and the OFC; however, its role in controlling reversal learning and set-shifting abilities is still unclear. Here we investigated the contribution of the two major NAc neuronal populations, medium spiny neurons expressing either dopamine D1 or D2 receptors (D1-/D2-MSNs), in guiding reversal learning and set-shifting in an attentional set-shifting task (ASST). Persistent inhibition of neurotransmitter release from NAc D2-MSNs, but not D1-MSNs, resulted in an impaired ability for reversal learning, but not set-shifting in male mice. These findings suggest that NAc D2-MSNs play a critical role in suppressing responding toward specific learned cues that are now associated with unfavorable outcomes (i.e., in reversal stages), but not in the suppression of more general learned strategies (i.e., in set-shifting). This study provides further evidence for the anatomical separation of reversal learning and set-shifting abilities within cortico-basal ganglia-thalamo-cortical loops.

Translational profiling of mouse dopaminoceptive neurons reveals region-specific gene expression, exon usage, and striatal prostaglandin E2 modulatory effects

Forebrain dopamine-sensitive (dopaminoceptive) neurons play a key role in movement, action selection, motivation, and working memory. Their activity is altered in Parkinson's disease, addiction, schizophrenia, and other conditions, and drugs that stimulate or antagonize dopamine receptors have major therapeutic applications. Yet, similarities and differences between the various neuronal populations sensitive to dopamine have not been systematically explored. To characterize them, we compared translating mRNAs in the dorsal striatum and nucleus accumbens neurons expressing D1 or D2 dopamine receptor and prefrontal cortex neurons expressing D1 receptor. We identified genome-wide cortico-striatal, striatal D1/D2 and dorso/ventral differences in the translating mRNA and isoform landscapes, which characterize dopaminoceptive neuronal populations. Expression patterns and network analyses identified novel transcription factors with presumptive roles in these differences. Prostaglandin E2 (PGE2) was a candidate upstream regulator in the dorsal striatum. We pharmacologically explored this hypothesis and showed that misoprostol, a PGE2 receptor agonist, decreased the excitability of D2 striatal projection neurons in slices, and diminished their activity in vivo during novel environment exploration. We found that misoprostol also modulates mouse behavior including by facilitating reversal learning. Our study provides powerful resources for characterizing dopamine target neurons, new information about striatal gene expression patterns and regulation. It also reveals the unforeseen role of PGE2 in the striatum as a potential neuromodulator and an attractive therapeutic target.

Dorsal striatal dopamine induces fronto-cortical hypoactivity and attenuates anxiety and compulsive behaviors in rats

Dorsal striatal dopamine transmission engages the cortico-striato-thalamo-cortical (CSTC) circuit, which is implicated in many neuropsychiatric diseases, including obsessive-compulsive disorder (OCD). Yet it is unknown if dorsal striatal dopamine hyperactivity is the cause or consequence of changes elsewhere in the CSTC circuit. Classical pharmacological and neurotoxic manipulations of the CSTC and other brain circuits suffer from various drawbacks related to off-target effects and adaptive changes. Chemogenetics, on the other hand, enables a highly selective targeting of specific neuronal populations within a given circuit. In this study, we developed a chemogenetic method for selective activation of dopamine neurons in the substantia nigra, which innervates the dorsal striatum in the rat. We used this model to investigate effects of targeted dopamine activation on CSTC circuit function, especially in fronto-cortical regions. We found that chemogenetic activation of these neurons increased movement (as expected with increased dopamine release), rearings and time spent in center, while also lower self-grooming. Furthermore, this activation increased prepulse inhibition of the startle response in females. Remarkably, we observed reduced [¹⁸F]FDG metabolism in the frontal cortex, following dopamine activation in the dorsal striatum, while total glutamate levels- in this region were increased. This result is in accord with clinical studies of increased [¹⁸F]FDG metabolism and lower glutamate levels in similar regions of the brain of people with OCD. Taken together, the present chemogenetic model adds a mechanistic basis with behavioral and translational relevance to prior clinical neuroimaging studies showing deficits in fronto-cortical glucose metabolism across a variety of clinical populations (e.g. addiction, risky decision-making, compulsivity or obesity).

Repetitive and Inflexible Active Coping and Addiction-like Neuroplasticity in Stressed Mice of a Helplessness-Resistant Inbred Strain

Dysfunctional coping styles are involved in the development, persistence, and relapse of psychiatric diseases. Passive coping with stress challenges (helplessness) is most commonly used in animal models of dysfunctional coping, although active coping strategies are associated with generalized anxiety disorder, social anxiety disorder, panic, and phobias as well as obsessive-compulsive and post-traumatic stress disorder. This paper analyzes the development of dysfunctional active coping strategies of mice of the helplessness–resistant DBA/2J (D2) inbred strain, submitted to temporary reduction in food availability in an uncontrollable and unavoidable condition. The results indicate that food-restricted D2 mice developed a stereotyped form of food anticipatory activity and dysfunctional reactive coping in novel aversive contexts and acquired inflexible and perseverant escape strategies in novel stressful situations. The evaluation of FosB/DeltaFosB immunostaining in different brain areas of food-restricted D2 mice revealed a pattern of expression typically associated with behavioral sensitization to addictive drugs and compulsivity. These results support the conclusion that an active coping style represents an endophenotype of mental disturbances characterized by perseverant and inflexible behavior.

Distributed cell assemblies spanning prefrontal cortex and striatum

Highly synchronous neuronal assembly activity is deemed essential for cognitive brain function. In theory, such synchrony could coordinate multiple brain areas performing complementary processes. However, cell assemblies have been observed only in single structures, typically cortical areas, and little is known about their synchrony with downstream subcortical structures, such as the striatum. Here, we demonstrate distributed cell assemblies activated at high synchrony (∼10 ms) spanning prefrontal cortex and striatum. In addition to including neurons at different brain hierarchical levels, surprisingly, they synchronized functionally distinct limbic and associative sub-regions. These assembly activations occurred when members shifted their firing phase relative to ongoing 4 Hz and theta rhythms, in association with high gamma oscillations. This suggests that these rhythms could mediate the emergence of cross-structural assemblies. To test for the role of assemblies in behavior, we trained the rats to perform a task requiring cognitive flexibility, alternating between two different rules in a T-maze. Overall, assembly activations were correlated with task-relevant parameters, including impending choice, reward, rule, or rule order. Moreover, these behavioral correlates were more robustly expressed by assemblies than by their individual member neurons. Finally, to verify whether assemblies can be endogenously generated, we found that they were indeed spontaneously reactivated during sleep and quiet immobility. Thus, cell assemblies are a more general coding mechanism than previously envisioned, linking distributed neocortical and subcortical areas at high synchrony.

Parallel and hierarchical neural mechanisms for adaptive and predictive behavioral control

Our brain can be recognized as a network of largely hierarchically organized neural circuits that operate to control specific functions, but when acting in parallel, enable the performance of complex and simultaneous behaviors. Indeed, many of our daily actions require concurrent information processing in sensorimotor, associative, and limbic circuits that are dynamically and hierarchically modulated by sensory information and previous learning. This organization of information processing in biological organisms has served as a major inspiration for artificial intelligence and has helped to create in silico systems capable of matching or even outperforming humans in several specific tasks, including visual recognition and strategy-based games. However, the development of human-like robots that are able to move as quickly as humans and respond flexibly in various situations remains a major challenge and indicates an area where further use of parallel and hierarchical architectures may hold promise. In this article we review several important neural and behavioral mechanisms organizing hierarchical and predictive processing for the acquisition and realization of flexible behavioral control. Then, inspired by the organizational features of brain circuits, we introduce a multi-timescale parallel and hierarchical learning framework for the realization of versatile and agile movement in humanoid robots.

The neural basis of gambling disorder: An activation likelihood estimation meta-analysis

Previous imaging studies suggested that impairments of prefrontal-striatal and limbic circuits are correlated to excessive gambling. However, the neural underpinnings of gambling disorder (GD) continue to be the topic of debate. The present study aimed to identify structural changes in GD and differentiate the specific brain activity patterns associated with decision-making and reward-processing. We performed a systematic review complemented by Activation likelihood estimation (ALE) meta-analyses on morphometric and functional studies on neural correlates of GD. The ALE meta-analysis on structural studies revealed that patients with GD showed significant cortical grey-matter thinning in the right ventrolateral and ventromedial prefrontal cortex compared to healthy subjects. The ALE meta-analyses on functional studies revealed that patients with GD showed a significant hyperactivation in the medial prefrontal cortex and in the right ventral striatum during decision-making and gain processing compared to healthy subjects. These findings suggest that GD is related to an alteration of brain mechanisms underlying top-down control and appraisal of gambling-related stimuli and provided indications to develop new interventions in clinical practice.

Dopamine Receptor Subtypes, Physiology and Pharmacology: New Ligands and Concepts in Schizophrenia

Dopamine receptors are widely distributed within the brain where they play critical modulator roles on motor functions, motivation and drive, as well as cognition. The identification of five genes coding for different dopamine receptor subtypes, pharmacologically grouped as D1- (D1 and D5) or D2-like (D2S, D2L, D3, and D4) has allowed the demonstration of differential receptor function in specific neurocircuits. Recent observation on dopamine receptor signaling point at dopamine-glutamate-NMDA neurobiology as the most relevant in schizophrenia and for the development of new therapies. Progress in the chemistry of D1- and D2-like receptor ligands (agonists, antagonists, and partial agonists) has provided more selective compounds possibly able to target the dopamine receptors homo and heterodimers and address different schizophrenia symptoms. Moreover, an extensive evaluation of the functional effect of these agents on dopamine receptor coupling and intracellular signaling highlights important differences that could also result in highly differentiated clinical pharmacology. The review summarizes the recent advances in the field, addressing the relevance of emerging new targets in schizophrenia in particular in relation to the dopamine - glutamate NMDA systems interactions.