Reversal learning as a measure of impulsive and compulsive behavior in addictions

Hypocretin-1 receptor antagonism improves inhibitory control during the Go/No-Go task in highly motivated, impulsive male mice

RATIONALE

Motivation and inhibitory control are dominantly regulated by the dopaminergic (DA) and noradrenergic (NA) systems, respectively. Hypothalamic hypocretin (orexin) neurons provide afferent inputs to DA and NA nuclei and hypocretin-1 receptors (HcrtR1) are implicated in reward and addiction. However, the role of the HcrtR1 in inhibitory control is not well understood.

OBJECTIVES

To determine the effects of HcrtR1 antagonism and motivational state in inhibitory control using the go/no-go task in mice.

METHODS

n = 23 male C57Bl/6JArc mice were trained in a go/no-go task. Decision tree dendrogram analysis of training data identified more and less impulsive clusters of animals. A HcrtR1 antagonist (BI001, 12.5 mg/kg, per os) or vehicle were then administered 30 min before go/no-go testing, once daily for 5 days, under high (food-restricted) and low (free-feeding) motivational states in a latin-square crossover design. Compound exposure levels were assessed in a satellite group of animals.

RESULTS

HcrtR1 antagonism increased go accuracy and decreased no-go accuracy in free-feeding animals overall, whereas it decreased go accuracy and increased no-go accuracy only in more impulsive, food restricted mice. HcrtR1 antagonism also showed differential effects in premature responding, which was increased in response to the antagonist in free-feeding, less impulsive animals, and decreased in food restricted, more impulsive animals. HcrtR1 receptor occupancy by BI001 was estimated at ~ 66% during the task.

CONCLUSIONS

These data indicate that hypocretin signalling plays roles in goal-directed behaviour and inhibitory control in a motivational state-dependant manner. While likely not useful in all settings, HcrtR1 antagonism may be beneficial in improving inhibitory control in impulsive subpopulations.

Cognitive performance as a behavioral phenotype associated with cocaine self-administration in female and male socially housed monkeys

Considerable research has suggested that certain cognitive domains may contribute to cocaine misuse. However, there are gaps in the literature regarding whether cognitive performance before drug exposure predicts susceptibility to cocaine self-administration and how cognitive performance relates to future cocaine intake. Thus, the present study aimed to examine cognitive performance, as measured using automated CANTAB cognitive battery, prior to and following acquisition of cocaine self-administration under a concurrent drug vs. food choice procedure in female and male socially housed cynomolgus macaques. The cognitive battery consisted of measures of associative learning (stimulus and compound discrimination tasks), behavioral flexibility (intradimensional and extradimensional tasks), and behavioral inhibition (stimulus discrimination reversal, SDR, and extra-dimensional reversal tasks). After assessing cognitive performance, monkeys were trained to self-administer cocaine (saline, 0.01-0.1 mg/kg/injection) under a concurrent cocaine vs. food schedule of reinforcement. After a history of cocaine self-administration across 3-4 years, the cognitive battery was re-assessed and compared with sensitivity to cocaine reinforcement. Results showed drug-naïve monkeys that were less accurate on the SDR task, measuring behavioral inhibition, were more sensitive to cocaine reinforcement under the concurrent cocaine vs. food choice procedure. Furthermore, following chronic cocaine self-administration, cocaine intake was a negative predictor of accuracy on the SDR behavioral inhibition task. After cocaine maintenance, monkeys with higher cocaine intakes required more trials to complete the SDR behavioral inhibition task and made more incorrect responses during these trials. No sex or social rank differences were noted. Overall, these findings suggest that cognitive performance may influence vulnerability to cocaine misuse. Also, chronic cocaine may decrease levels of behavioral inhibition as measured via the SDR task in both females and males.

Valence ambiguity dynamically shapes striatal dopamine heterogeneity

Adaptive decision making relies on dynamic updating of learned associations where environmental cues come to predict positive and negatively valenced stimuli, such as food or threat. Flexible cue-guided behaviors depend on a network of brain systems, including dopamine signaling in the striatum, which is critical for learning and maintenance of conditioned behaviors. Critically, it remains unclear how dopamine signaling encodes multi-valent, dynamic learning contexts, where positive and negative associations must be rapidly disambiguated. To understand this, we employed a Pavlovian discrimination paradigm, where cues predicting positive and negative outcomes were intermingled during conditioning sessions, and their meaning was serially reversed across training. We found that rats readily distinguished these cues, and updated their behavior rapidly upon valence reversal. Using fiber photometry, we recorded dopamine signaling in three major striatal subregions -,the dorsolateral striatum (DLS), the nucleus accumbens core, and the nucleus accumbens medial shell - and found heterogeneous responses to positive and negative conditioned cues and their predicted outcomes. Valence ambiguity introduced by cue reversal reshaped striatal dopamine on different timelines: nucleus accumbens core and shell signals updated more readily than those in the DLS. Together, these results suggest that striatal dopamine flexibly encodes multi-valent learning contexts, and these signals are dynamically modulated by changing contingencies to resolve ambiguity about the meaning of environmental cues.

More widespread and rigid neuronal representation of reward expectation underlies impulsive choices

Impulsive choices prioritize smaller, more immediate rewards over larger, delayed, or potentially uncertain rewards. Impulsive choices are a critical aspect of substance use disorders and maladaptive decision-making across the lifespan. Here, we sought to understand the neuronal underpinnings of expected reward and risk estimation on a trial-by-trial basis during impulsive choices. To do so, we acquired electrical recordings from the human brain while participants carried out a risky decision-making task designed to measure choice impulsivity. Behaviorally, we found a reward-accuracy tradeoff, whereby more impulsive choosers were more accurate at the task, opting for a more immediate reward while compromising overall task performance. We then examined how neuronal populations across frontal, temporal, and limbic brain regions parametrically encoded reinforcement learning model variables, namely reward and risk expectation and surprise, across trials. We found more widespread representations of reward value expectation and prediction error in more impulsive choosers, whereas less impulsive choosers preferentially represented risk expectation. A regional analysis of reward and risk encoding highlighted the anterior cingulate cortex for value expectation, the anterior insula for risk expectation and surprise, and distinct regional encoding between impulsivity groups. Beyond describing trial-by-trial population neuronal representations of reward and risk variables, these results suggest impaired inhibitory control and model-free learning underpinnings of impulsive choice. These findings shed light on neural processes underlying reinforced learning and decision-making in uncertain environments and how these processes may function in psychiatric disorders.

Chronic Ethanol Exposure Produces Persistent Impairment in Cognitive Flexibility and Decision Signals in the Striatum

Lack of cognitive flexibility is a hallmark of substance use disorders and has been associated with drug-induced synaptic plasticity in the dorsomedial striatum (DMS). Yet the possible impact of altered plasticity on real-time striatal neural dynamics during decision-making is unclear. Here, we identified persistent impairments induced by chronic ethanol (EtOH) exposure on cognitive flexibility and striatal decision signals. After a substantial withdrawal period from prior EtOH vapor exposure, male, but not female, rats exhibited reduced adaptability and exploratory behavior during a dynamic decision-making task. Reinforcement learning models showed that prior EtOH exposure enhanced learning from rewards over omissions. Notably, neural signals in the DMS related to the decision outcome were enhanced, while those related to choice and choice-outcome conjunction were reduced, in EtOH-treated rats compared to the controls. These findings highlight the profound impact of chronic EtOH exposure on adaptive decision-making, pinpointing specific changes in striatal representations of actions and outcomes as underlying mechanisms for cognitive deficits.

Aberrant neural computation of social controllability in nicotine-dependent humans

Social controllability, defined as the ability to exert influence when interacting with others, is crucial for optimal decision-making. Inability to do so might contribute to maladaptive behaviors such as drug use, which often takes place in social settings. Here, we examined nicotine-dependent humans using fMRI, as they made choices that could influence the proposals from simulated partners. Computational modeling revealed that smokers under-estimated the influence of their actions and self-reported a reduced sense of control, compared to non-smokers. These findings were replicated in a large independent sample of participants recruited online. Neurally, smokers showed reduced tracking of forward projected choice values in the ventromedial prefrontal cortex, and impaired computation of social prediction errors in the midbrain. These results demonstrate that smokers were less accurate in estimating their personal influence when the social environment calls for control, providing a neurocomputational account for the social cognitive deficits in this population.

The role of the GABAergic cells of the median raphe region in reinforcement-based learning

Learning and memory are important in everyday life as well as in pathological conditions. The median raphe region (MRR) contributes to memory formation; however, its precise role and the neurotransmitters involved have yet to be elucidated. To address this issue, we stimulated the MRR neurons of mice by chemogenetic technique and studied them in the operant conditioning and active avoidance tests. The virus carrier infected a variety of neuron types including both GABAergic and glutamatergic ones. Behavior was not influenced by stimulation. We hypothesize that the lack of effect was due to opposing effects exerted via GABAergic and glutamatergic neurons. Therefore, next we used VGAT-Cre mice that allowed the specific manipulation of MRR-GABAergic neurons. The stimulation did not affect behavior in the learning phase of the operant conditioning task, but increased reward preference and total responses when operant contingencies were reversed. The enhanced responsiveness might be a proclivity to impulsive behavior. Stimulation facilitated learning in the active avoidance test but did not affect reversal learning in this paradigm. Our findings suggest that MRR-GABAergic neurons are involved in both learning and reversal learning, but the type of learning that is affected depends on the task.

Metabolic and functional substrates of impulsive decision-making in individuals with heroin addiction after prolonged methadone maintenance treatment

Elevated impulsivity has been frequently reported in individuals with opioid addiction receiving methadone maintenance therapy (MMT), but the underlying neural mechanisms and cognitive subprocesses are not fully understood. We acquired functional magnetic resonance imaging (fMRI) data from 37 subjects with heroin addiction receiving long-term MMT and 33 healthy controls who performed a probabilistic reversal learning task, and measured their resting-state brain glucose using fluorine-18-fluorodeoxyglucose positron emission tomography (18F-FDG PET). Subjects receiving MMT exhibited significantly elevated self-reported impulsivity, and computational modeling revealed a marked impulsive decision bias manifested as switching more frequently without available evidence. Moreover, this impulsive decision bias was associated with the dose and duration of methadone use, irrelevant to the duration of heroin use. During the task, the switch-related hypoactivation in the left rostral middle frontal gyrus was correlated with the impulsive decision bias while the function of reward sensitivity was intact in subjects receiving MMT. Using prior brain-wide receptor density data, we found that the highest variance of regional metabolic abnormalities was explained by the spatial distribution of μ-opioid receptors among 10 types of neurotransmitter receptors. Heightened impulsivity in individuals receiving prolonged MMT is manifested as atypical choice bias and noise in decision-making processes, which is further driven by deficits in top-down cognitive control, other than reward sensitivity. Our findings uncover multifaceted mechanisms underlying elevated impulsivity in subjects receiving MMT, which might provide insights for developing complementary therapies to improve retention during MMT.

The influence of dopamine autoreceptors on temperament and addiction risk

As a major regulator of dopamine (DA), DA autoreceptors (DAARs) exert substantial influence over DA-mediated behaviors. This paper reviews the physiological and behavioral impact of DAARs. Individual differences in DAAR functioning influences temperamental traits such as novelty responsivity and impulsivity, both of which are associated with vulnerability to addictive behavior in animal models and a broad array of externalizing behaviors in humans. DAARs additionally impact the response to psychostimulants and other drugs of abuse. Human PET studies of D2-like receptors in the midbrain provide evidence for parallels to the animal literature. These data lead to the proposal that weak DAAR regulation is a risk factor for addiction and externalizing problems. The review highlights the potential to build translational models of the functional role of DAARs in behavior. It also draws attention to key limitations in the current literature that would need to be addressed to further advance a weak DAAR regulation model of addiction and externalizing risk.

Repeatability and heritability of inhibitory control performance in wild toutouwai (Petroica longipes)

Despite increasing interest in the evolution of inhibitory control, few studies have examined the validity of widespread testing paradigms, the long-term repeatability and the heritability of this cognitive ability in the wild. We investigated these aspects in the inhibitory control performance of wild toutouwai (North Island robin; Petroica longipes), using detour and reversal learning tasks. We assessed convergent validity by testing whether individual performance correlated across detour and reversal learning tasks. We then further evaluated task validity by examining whether individual performance was confounded by non-cognitive factors. We tested a subset of subjects twice in each task to estimate the repeatability of performance across a 1-year period. Finally, we used a population pedigree to estimate the heritability of task performance. Individual performance was unrelated across detour and reversal learning tasks, indicating that these measured different cognitive abilities. Task performance was not influenced by body condition, boldness or prior experience, and showed moderate between-year repeatability. Yet despite this individual consistency, we found no evidence that task performance was heritable. Our findings suggest that detour and reversal learning tasks measure consistent individual differences in distinct forms of inhibitory control in toutouwai, but this variation may be environmentally determined rather than genetic.

Effects of pay rate and instructions on attrition in crowdsourcing research

Researchers in social sciences increasingly rely on crowdsourcing marketplaces such as Amazon Mechanical Turk (MTurk) and Prolific to facilitate rapid, low-cost data collection from large samples. However, crowdsourcing suffers from high attrition, threatening the validity of crowdsourced studies. Separate studies have demonstrated that (1) higher pay rates and (2) additional instructions-i.e., informing participants about task requirements, asking for personal information, and describing the negative impact of attrition on research quality-can reduce attrition rates with MTurk participants. The present study extended research on these possible remedies for attrition to Prolific, another crowdsourcing marketplace with strict requirements for participant pay. We randomly assigned 225 participants to one of four groups. Across groups, we evaluated effects of pay rates commensurate with or double the US minimum wage, expanding the upper range of this independent variable; two groups also received additional instructions. Higher pay reduced attrition and correlated with more accurate performance on experimental tasks but we observed no effect of additional instructions. Overall, our findings suggest that effects of increased pay on attrition generalize to higher minimum pay rates and across crowdsourcing platforms. In contrast, effects of additional instructions might not generalize across task durations, task types, or crowdsourcing platforms.

Network state dynamics underpin craving in a transdiagnostic population

Emerging fMRI brain dynamic methods present a unique opportunity to capture how brain region interactions across time give rise to evolving affective and motivational states. As the unfolding experience and regulation of affective states affect psychopathology and well-being, it is important to elucidate their underlying time-varying brain responses. Here, we developed a novel framework to identify network states specific to an affective state of interest and examine how their instantaneous engagement contributed to its experience. This framework investigated network state dynamics underlying craving, a clinically meaningful and changeable state. In a transdiagnostic sample of healthy controls and individuals diagnosed with or at risk for craving-related disorders (N=252), we utilized connectome-based predictive modeling (CPM) to identify craving-predictive edges. An edge-centric timeseries approach was leveraged to quantify the instantaneous engagement of the craving-positive and craving-negative networks during independent scan runs. Individuals with higher craving persisted longer in a craving-positive network state while dwelling less in a craving-negative network state. We replicated the latter results externally in an independent group of healthy controls and individuals with alcohol use disorder exposed to different stimuli during the scan (N=173). The associations between craving and network state dynamics can still be consistently observed even when craving-predictive edges were instead identified in the replication dataset. These robust findings suggest that variations in craving-specific network state recruitment underpin individual differences in craving. Our framework additionally presents a new avenue to explore how the moment-to-moment engagement of behaviorally meaningful network states supports our changing affective experiences.

Mechanisms of cognitive disinhibition explain individual differences in adult attention deficit hyperactivity disorder traits

BACKGROUND

Attention deficit hyperactivity disorder (ADHD) in adults is strongly associated with psychiatric comorbidity and functional impairment. Here, we aimed to use a newly developed online cognitive battery with strong psychometric properties for measuring individual differences in three cognitive mechanisms proposed to underlie ADHD traits in adults: 1) attentional control - the ability to mobilize cognitive resources to stop a prepotent motor response; 2) information sampling/gathering - adequate sampling of information in a stimulus detection task prior to making a decision; and 3) shifting - the ability to adapt behavior in response to positive and negative contingencies.

METHODS

This cross-sectional and correlational study recruited 650 adults (330 males) aged 18-69 years (M = 33.06; MD = 31.00; SD = 10.50), with previously diagnosed ADHD (n = 329) and those from the general community without a history of ADHD (n = 321). Self-report measures of ADHD traits (i.e., inattention/disorganization, impulsivity, hyperactivity) and the cognitive battery were completed online.

RESULTS

Latent class analysis, exploratory structural equation modeling and factor mixture modeling revealed self-reported ADHD traits formed a unidimensional and approximately normally distributed phenotype. Bayesian structural equation modeling demonstrated that all three mechanisms measured by the cognitive battery, explained unique, incremental variance in ADHD traits, with a total of 15.9% explained in the ADHD trait factor.

CONCLUSIONS

Attentional control and shifting, as well as the less researched cognitive process of information gathering, explain individual difference variance in self-reported ADHD traits with potential to yield genetic and neurobiological insights into adult ADHD.

Sex, but not juvenile stress, affects reversal learning and DRL performance following cocaine administration

INTRODUCTION

Early adversity, impulsivity and sex all contribute to the risk of developing substance use disorder. Using rats, we examined how juvenile stress interacts with sex and cocaine to affect performance on a serial reversal task and a differential reinforcement of low rates 10 s (DRL10) task. The expression of dopamine-related proteins in several brain areas was also assessed.

METHODS

From postnatal days (PND) 25-29, rats were exposed to a variable stress protocol. In adulthood, rats were trained on the reversal task and the effects of cocaine (0, 10, or 20 mg/kg, IP) on performance were assessed. Next, rats were trained on the DRL10 task and the effects of cocaine on performance were assessed. Finally, brains were extracted, and Western blot analyses conducted.

RESULTS

Juvenile stress did not affect behavior. Sex did not affect baseline performance in either task. In the reversal task, cocaine decreased % high probability responses and the number of rewards earned in both sexes. Cocaine had sex-dependent effects on omissions, low probability responses and response latencies. In the DRL10 task, cocaine decreased the peak latency to respond and the number of rewards earned in both sexes. Cocaine had sex-dependent effects on peak rate of responding, response efficiency, burst responses and long responses. Female rats exhibited increased expression of DRD1 receptors in the striatum.

DISCUSSION

These data contribute to the growing literature demonstrating sex differences in the behavioral effects of cocaine and suggest that DRD1 receptors could contribute to the observed behavioral sex differences.

Fast updating feedback from piriform cortex to the olfactory bulb relays multimodal reward contingency signals during rule-reversal

While animals readily adjust their behavior to adapt to relevant changes in the environment, the neural pathways enabling these changes remain largely unknown. Here, using multiphoton imaging, we investigated whether feedback from the piriform cortex to the olfactory bulb supports such behavioral flexibility. To this end, we engaged head-fixed mice in a multimodal rule-reversal task guided by olfactory and auditory cues. Both odor and, surprisingly, the sound cues triggered cortical bulbar feedback responses which preceded the behavioral report. Responses to the same sensory cue were strongly modulated upon changes in stimulus-reward contingency (rule reversals). The re-shaping of individual bouton responses occurred within seconds of the rule-reversal events and was correlated with changes in the behavior. Optogenetic perturbation of cortical feedback within the bulb disrupted the behavioral performance. Our results indicate that the piriform-to-olfactory bulb feedback carries reward contingency signals and is rapidly re-formatted according to changes in the behavioral context.

Purinergic receptors in cognitive disturbances

Purinergic receptors (Rs) of the ATP/ADP, UTP/UDP (P2X, P2Y) and adenosine (A1, A2A)-sensitive classes broadly interfere with cognitive processes both under quasi normal and disease conditions. During neurodegenerative illnesses, high concentrations of ATP are released from the damaged neuronal and non-neuronal cells of the brain; then, this ATP is enzymatically degraded to adenosine. Thus, the primary injury in neurodegenerative diseases appears to be caused by various protein aggregates on which a superimposed damage mediated by especially P2X7 and A2AR activation develops; this can be efficiently prevented by small molecular antagonists in animal models of the above diseases, or are mitigated in the respective knockout mice. Dementia is a leading symptom in Alzheimer's disease (AD), and accompanies Parkinson's disease (PD) and Huntington's disease (HD), especially in the advanced states of these illnesses. Animal experimentation suggests that P2X7 and A2ARs are also involved in a number of psychiatric diseases, such as major depressive disorder (MDD), obsessive compulsive behavior, and attention deficit hyperactivity disorder. In conclusion, small molecular antagonists of purinergic receptors are expected to supply us in the future with pharmaceuticals which are able to combat in a range of neurological/psychiatric diseases the accompanying cognitive deterioration.

Repetitive and compulsive behavior after Early-Life-Pain associated with reduced long-chain sphingolipid species

BACKGROUND

Pain in early life may impact on development and risk of chronic pain. We developed an optogenetic Cre/loxP mouse model of "early-life-pain" (ELP) using mice with transgenic expression of channelrhodopsin-2 (ChR2) under control of the Advillin (Avil) promoter, which drives expression of transgenes predominantly in isolectin B4 positive non-peptidergic nociceptors in postnatal mice. Avil-ChR2 (Cre +) and ChR2-flfl control mice were exposed to blue light in a chamber once daily from P1-P5 together with their Cre-negative mother.

RESULTS

ELP caused cortical hyperexcitability at P8-9 as assessed via multi-electrode array recordings that coincided with reduced expression of synaptic genes (RNAseq) including Grin2b, neurexins, piccolo and voltage gated calcium and sodium channels. Young adult (8-16 wks) Avil-ChR2 mice presented with nociceptive hypersensitivity upon heat or mechanical stimulation, which did not resolve up until one year of age. The persistent hypersensitivy to nociceptive stimuli was reflected by increased calcium fluxes in primary sensory neurons of aged mice (1 year) upon capsaicin stimulation. Avil-ChR2 mice behaved like controls in maze tests of anxiety, social interaction, and spatial memory but IntelliCage behavioral studies revealed repetitive nosepokes and corner visits and compulsive lickings. Compulsiveness at the behavioral level was associated with a reduction of sphingomyelin species in brain and plasma lipidomic studies. Behavioral studies were done with female mice.

CONCLUSION

The results suggest that ELP may predispose to chronic "pain" and compulsive psychopathology in part mediated by alterations of sphingolipid metabolism, which have been previously described in the context of addiction and psychiatric diseases.

Frontal tDCS reduces alcohol relapse rates by increasing connections from left dorsolateral prefrontal cortex to addiction networks

BACKGROUND

Brain-based interventions are needed to address persistent relapse in alcohol use disorder (AUD). Neuroimaging evidence suggests higher frontal connectivity as well as higher within-network connectivity of theoretically defined addiction networks are associated with reduced relapse rates and extended abstinence during follow-up periods.

OBJECTIVE

/Hypothesis: A longitudinal randomized double-blind sham-controlled clinical trial investigated whether a non-invasive neuromodulation intervention delivered during early abstinence can (i) modulate connectivity of addiction networks supporting abstinence and (ii) improve relapse rates.

HYPOTHESES

Active transcranial direct current stimulation (tDCS) will (i) increase connectivity of addiction networks known to support abstinence and (ii) reduce relapse rates.

METHODS

Short-term abstinent AUD participants (n = 60) were assigned to 5 days of either active tDCS or sham during cognitive training. Causal discovery analysis (CDA) examined the directional influence from left dorsolateral prefrontal cortex (LDLPFC, stimulation site) to addiction networks that support abstinence.

RESULTS

Active tDCS had an effect on the average strength of CDA-determined connectivity from LDLPFC to the incentive salience and negative emotionality addiction networks - increasing in the active tDCS group only. Active tDCS had an effect on relapse rates following the intervention, with lower probability of relapse in the active tDCS vs. sham. Active tDCS showed an unexpected sex-dependent effect on relapse rates.

CONCLUSION

Our results suggest that LDLPFC stimulation delivered during early abstinence has an effect on addiction networks supporting abstinence and on relapse rates. The unexpected sex-dependent neuromodulation effects need to be further examined in larger clinical trials.

Drug reinforcement impairs cognitive flexibility by inhibiting striatal cholinergic neurons

Addictive substance use impairs cognitive flexibility, with unclear underlying mechanisms. The reinforcement of substance use is mediated by the striatal direct-pathway medium spiny neurons (dMSNs) that project to the substantia nigra pars reticulata (SNr). Cognitive flexibility is mediated by striatal cholinergic interneurons (CINs), which receive extensive striatal inhibition. Here, we hypothesized that increased dMSN activity induced by substance use inhibits CINs, reducing cognitive flexibility. We found that cocaine administration in rodents caused long-lasting potentiation of local inhibitory dMSN-to-CIN transmission and decreased CIN firing in the dorsomedial striatum (DMS), a brain region critical for cognitive flexibility. Moreover, chemogenetic and time-locked optogenetic inhibition of DMS CINs suppressed flexibility of goal-directed behavior in instrumental reversal learning tasks. Notably, rabies-mediated tracing and physiological studies showed that SNr-projecting dMSNs, which mediate reinforcement, sent axonal collaterals to inhibit DMS CINs, which mediate flexibility. Our findings demonstrate that the local inhibitory dMSN-to-CIN circuit mediates the reinforcement-induced deficits in cognitive flexibility.

Explaining reversal learning deficits in anxiety with electrophysiological evidence

Reversal learning is a crucial aspect of behavioral flexibility that plays a significant role in environmental adaptation and development. While previous studies have established a link between anxiety and impaired reversal learning ability, the underlying mechanisms behind this association remain unclear. This study employed a probabilistic reversal learning task with electroencephalographic recording to investigate these mechanisms. Participants were divided into two groups based on their scores on Spielberger's State-Trait Anxiety Inventory: high trait-anxiety (HTA) and low trait-anxiety (LTA), consisting of 50 individuals in each group. The results showed that the HTA group had poorer reversal learning performance than the LTA group, including a lower tendency to shift to the new optimal option after rule reversals (reversal-shift). The study also examined event-related potentials elicited by reversals and found that although the N1 (related to attention allocation), feedback-related negativity (FRN: related to belief updating), and P3 (related to response inhibition) were all sensitive to the grouping factor, only the FRN elicited by reversal-shift mediated the relationship between anxiety and the number/reaction time of reversal-shift. From these findings, we suggest that abnormalities in belief updating may contribute to the impaired reversal learning performance observed in anxious individuals. In our opinion, this study sheds light on potential targets for interventions aimed at improving behavioral flexibility in anxious individuals.

PSMC3 proteasome subunit variants are associated with neurodevelopmental delay and type I interferon production

A critical step in preserving protein homeostasis is the recognition, binding, unfolding, and translocation of protein substrates by six AAA-ATPase proteasome subunits (ATPase-associated with various cellular activities) termed PSMC1-6, which are required for degradation of proteins by 26S proteasomes. Here, we identified 15 de novo missense variants in the PSMC3 gene encoding the AAA-ATPase proteasome subunit PSMC3/Rpt5 in 23 unrelated heterozygous patients with an autosomal dominant form of neurodevelopmental delay and intellectual disability. Expression of PSMC3 variants in mouse neuronal cultures led to altered dendrite development, and deletion of the PSMC3 fly ortholog Rpt5 impaired reversal learning capabilities in fruit flies. Structural modeling as well as proteomic and transcriptomic analyses of T cells derived from patients with PSMC3 variants implicated the PSMC3 variants in proteasome dysfunction through disruption of substrate translocation, induction of proteotoxic stress, and alterations in proteins controlling developmental and innate immune programs. The proteostatic perturbations in T cells from patients with PSMC3 variants correlated with a dysregulation in type I interferon (IFN) signaling in these T cells, which could be blocked by inhibition of the intracellular stress sensor protein kinase R (PKR). These results suggest that proteotoxic stress activated PKR in patient-derived T cells, resulting in a type I IFN response. The potential relationship among proteosome dysfunction, type I IFN production, and neurodevelopment suggests new directions in our understanding of pathogenesis in some neurodevelopmental disorders.

Exploration behavior after reversals is predicted by STN-GPe synaptic plasticity in a basal ganglia model

Humans can quickly adapt their behavior to changes in the environment. Classical reversal learning tasks mainly measure how well participants can disengage from a previously successful behavior but not how alternative responses are explored. Here, we propose a novel 5-choice reversal learning task with alternating position-reward contingencies to study exploration behavior after a reversal. We compare human exploratory saccade behavior with a prediction obtained from a neuro-computational model of the basal ganglia. A new synaptic plasticity rule for learning the connectivity between the subthalamic nucleus (STN) and external globus pallidus (GPe) results in exploration biases to previously rewarded positions. The model simulations and human data both show that during experimental experience exploration becomes limited to only those positions that have been rewarded in the past. Our study demonstrates how quite complex behavior may result from a simple sub-circuit within the basal ganglia pathways.

Reversal Training Discloses Gender Differences in a Spatial Memory Task in Humans

Over the past few years, spatial memory has been studied using virtual-reality-based tasks. Reversal learning has been widely used in spatial orientation tasks for testing, among other things, new learning and flexibility. By means of a reversal-learning protocol, we assessed spatial memory in men and women. A total of sixty participants (half of them women) performed a task that included two phases: during the acquisition phase, participants were asked to find one or three rewarded positions in the virtual room across ten trials. During the reversal phase, the rewarded boxes were moved to a new position and maintained for four trials. The results showed that men and women differed in the reversal phase, with men outperforming women in high demanding conditions. Dissimilarities in several cognitive abilities between both genders are the base of these differences and are discussed.

Theta oscillations in anterior cingulate cortex and orbitofrontal cortex differentially modulate accuracy and speed in flexible reward learning

Flexible reward learning relies on frontal cortex, with substantial evidence indicating that anterior cingulate cortex (ACC) and orbitofrontal cortex (OFC) subregions play important roles. Recent studies in both rat and macaque suggest theta oscillations (5-10 Hz) may be a spectral signature that coordinates this learning. However, network-level interactions between ACC and OFC in flexible learning remain unclear. We investigated the learning of stimulus-reward associations using a combination of simultaneous in vivo electrophysiology in dorsal ACC and ventral OFC, partnered with bilateral inhibitory DREADDs in ACC. In freely behaving male and female rats and using a within-subject design, we examined accuracy and speed of response across distinct and precisely defined trial epochs during initial visual discrimination learning and subsequent reversal of stimulus-reward contingencies. Following ACC inhibition, there was a propensity for random responding in early reversal learning, with correct vs. incorrect trials distinguished only from OFC, not ACC, theta power differences in the reversal phase. ACC inhibition also hastened incorrect choices during reversal. This same pattern of change in accuracy and speed was not observed in viral control animals. Thus, characteristics of impaired reversal learning following ACC inhibition are poor deliberation and weak theta signaling of accuracy in this region. The present results also point to OFC theta oscillations as a prominent feature of reversal learning, unperturbed by ACC inhibition.

Body Focused Repetitive Behavior Disorders: Behavioral Models and Neurobiological Mechanisms

OBJECTIVE

Body Focused Repetitive Behaviors (BFRB) is an umbrella term for undesirable, repetitive motor activities such as Trichotillomania (TTM), Skin Picking Disorder (SPD), nail biting, cheek chewing, lip biting, finger sucking, finger cracking and teeth grinding. Such behaviors are engaged in to eliminate a part of the body and may result in impaired functionality. The frequency of presentation to clinicians is low since BFRB are defined as harmless, although the number of studies on this condition has increased rapidly recently, including those making a clear determination of epidemiological data, those investigating the etiopathogenesis and those providing treatment guidelines, although they remain inadequate. The present study provides a review of studies investigating the etiology of BFRB to date.

METHOD

Articles published between 1992 and 2021 stored in the Pubmed, Medline, Scopus and Web of Science databases were reviewed, and the prominent research studies of the condition identified were included in the evaluation.

RESULTS

Studies investigating the etiopathogenesis of BFRB were found in most cases to investigate adult populations, and were hampered by such confounding factors as clinical heterogeneity, high rates of comorbid psychiatric diseases and small sample sizes. The identified studies reveal that attempts have been made to explain BFRB based on behavioral models, and that the condition is inherited at a high rate. Treatment planning is mostly associated with monoamine systems (especially glutamate and dopamine) and interventions were directed to addiction elements. Furthermore, cognitive flexibility and motor inhibition defects in neurocognitive area and cortico-striato-thalamocortical cycle abnormalities in neuroimaging studies have been reported.

CONCLUSION

Studies investigating the clinical features, incidence, etiopathogenesis and treatment of BFRB, which holds a controversial place in psychiatric classification systems, would contribute to a better understanding of the disease and a more appropriate definition of the condition.

Dichotomous regulation of striatal plasticity by dynorphin

Modulation of corticostriatal plasticity alters the information flow throughout basal ganglia circuits and represents a fundamental mechanism for motor learning, action selection, and reward. Synaptic plasticity in the striatal direct- and indirect-pathway spiny projection neurons (dSPNs and iSPNs) is regulated by two distinct networks of GPCR signaling cascades. While it is well-known that dopamine D2 and adenosine A2a receptors bi-directionally regulate iSPN plasticity, it remains unclear how D1 signaling modulation of synaptic plasticity is counteracted by dSPN-specific Gi signaling. Here, we show that striatal dynorphin selectively suppresses long-term potentiation (LTP) through Kappa Opioid Receptor (KOR) signaling in dSPNs. Both KOR antagonism and conditional deletion of dynorphin in dSPNs enhance LTP counterbalancing with different levels of D1 receptor activation. Behaviorally, mice lacking dynorphin in D1 neurons show comparable motor behavior and reward-based learning, but enhanced flexibility during reversal learning. These findings support a model in which D1R and KOR signaling bi-directionally modulate synaptic plasticity and behavior in the direct pathway.

Assessing cognitive flexibility in humans and rhesus macaques with visual motion and neutral distractors

Introduction

Cognitive flexibility is the ability of an individual to make behavioral adjustments in response to internal and/or external changes. While it has been reported in a wide variety of species, established paradigms to assess cognitive flexibility vary between humans and non-human animals, making systematic comparisons difficult to interpret.

Methods

We developed a computer-based paradigm to assess cognitive flexibility in humans and non-human primates. Our paradigm (1) uses a classical reversal learning structure in combination with a set-shifting approach (4 stimuli and 3 rules) to assess flexibility at various levels; (2) it employs the use of motion as one of three possible contextual rules; (3) it comprises elements that allow a foraging-like and random interaction, i.e., instances where the animals operate the task without following a strategy, to potentially minimize frustration in favor of a more positive engagement.

Results and Discussion

We show that motion can be used as a feature dimension (in addition to commonly used shape and color) to assess cognitive flexibility. Due to the way motion is processed in the primate brain, we argue that this dimension is an ideal candidate in situations where a non-binary rule set is needed and where participants might not be able to fully grasp other visual information of the stimulus (e.g., quantity in Wisconsin Card Sorting Test). All participants in our experiment flexibly shifted to and from motion-based rules as well as color- and shape-based rules, but did so with different proficiencies. Overall, we believe that with such approach it is possible to better characterize the evolution of cognitive flexibility in primates, as well as to develop more efficient tools to diagnose and treat various executive function deficits.

Male DAT Val559 Mice Exhibit Compulsive Behavior under Devalued Reward Conditions Accompanied by Cellular and Pharmacological Changes

Identified across multiple psychiatric disorders, the dopamine (DA) transporter (DAT) Ala559Val substitution triggers non-vesicular, anomalous DA efflux (ADE), perturbing DA neurotransmission and behavior. We have shown that DAT Val559 mice display a waiting impulsivity and changes in cognitive performance associated with enhanced reward motivation. Here, utilizing a within-subject, lever-pressing paradigm designed to bias the formation of goal-directed or habitual behavior, we demonstrate that DAT Val559 mice modulate their nose poke behavior appropriately to match context, but demonstrate a perseverative checking behavior. Although DAT Val559 mice display no issues with the cognitive flexibility required to acquire and re-learn a visual pairwise discrimination task, devaluation of reward evoked habitual reward seeking in DAT Val559 mutants in operant tasks regardless of reinforcement schedule. The direct DA agonist apomorphine also elicits locomotor stereotypies in DAT Val559, but not WT mice. Our observation that dendritic spine density is increased in the dorsal medial striatum (DMS) of DAT Val559 mice speaks to an imbalance in striatal circuitry that might underlie the propensity of DAT Val559 mutants to exhibit compulsive behaviors when reward is devalued. Thus, DAT Val559 mice represent a model for dissection of how altered DA signaling perturbs circuits that normally balance habitual and goal-directed behaviors.

Behavioral phenotypes revealed during reversal learning are linked with novel genetic loci in diversity outbred mice

Impulsive behavior and impulsivity are heritable phenotypes that are strongly associated with risk for substance use disorders. Identifying the neurogenetic mechanisms that influence impulsivity may also reveal novel biological insights into addiction vulnerability. Our past studies using the BXD and Collaborative Cross (CC) recombinant inbred mouse panels have revealed that behavioral indicators of impulsivity measured in a reversal-learning task are heritable and are genetically correlated with aspects of intravenous cocaine self-administration. Genome-wide linkage studies in the BXD panel revealed a quantitative trait locus (QTL) on chromosome 10, but we expect to identify additional QTL by testing in a population with more genetic diversity. To this end, we turned to Diversity Outbred (DO) mice; 392 DO mice (156 males, 236 females) were phenotyped using the same reversal learning test utilized previously. Our primary indicator of impulsive responding, a measure that isolates the relative difficulty mice have with reaching performance criteria under reversal conditions, revealed a genome-wide significant QTL on chromosome 7 (max LOD score = 8.73, genome-wide corrected p<0.05). A measure of premature responding akin to that implemented in the 5-choice serial reaction time task yielded a suggestive QTL on chromosome 17 (max LOD score = 9.14, genome-wide corrected <0.1). Candidate genes were prioritized (2900076A07Rik, Wdr73 and Zscan2) based upon expression QTL data we collected in DO and CC mice and analyses using publicly available gene expression and phenotype databases. These findings may advance understanding of the genetics that drive impulsive behavior and enhance risk for substance use disorders.

Medial septum activation improves strategy switching once strategies are well-learned via bidirectional regulation of dopamine neuron population activity

Strategy switching is a form of cognitive flexibility that requires inhibiting a previously successful strategy and switching to a new strategy of a different categorical modality. It is dependent on dopamine (DA) receptor activation and release in ventral striatum and prefrontal cortex, two primary targets of ventral tegmental area (VTA) DA projections. Although the circuitry that underlies strategy switching early in learning has been studied, few studies have examined it after extended discrimination training. This may be important as DA activity and release patterns change across learning, with several studies demonstrating a critical role for substantia nigra pars compacta (SNc) DA activity and release once behaviors are well-learned. We have demonstrated that medial septum (MS) activation simultaneously increased VTA and decreased SNc DA population activity, as well as improved reversal learning via these actions on DA activity. We hypothesized that MS activation would improve strategy switching both early in learning and after extended training through its ability to increase VTA DA population activity and decrease SNc DA population activity, respectively. We chemogenetically activated the MS of male and female rats and measured their performance on an operant-based strategy switching task following 1, 10, or 15 days of discrimination training. Contrary to our hypothesis, MS activation did not affect strategy switching after 1 day of discrimination training. MS activation improved strategy switching after 10 days of training, but only in females. MS activation improved strategy switching in both sexes after 15 days of training. Infusion of bicuculline into the ventral subiculum (vSub) inhibited the MS-mediated decrease in SNc DA population activity and attenuated the improvement in strategy switching. Intra-vSub infusion of scopolamine inhibited the MS-mediated increase in VTA DA population activity but did not affect the improvement in strategy switching. Intra-vSub infusion of both bicuculline and scopolamine inhibited the MS-mediated effects on DA population activity in both the SNc and VTA and completely prevented the improvement in strategy switching. These data indicate that MS activation improves strategy switching once the original strategy has been sufficiently well-learned, and that this may occur via the MS's regulation of DA neuron responsivity.

Altered Resting-State Network in Adolescents with Problematic Internet Use

Problematic internet use (PIU) is increasingly recognized as a mental health concern, particularly among adolescents. The resting-state functional connectivity (rsFC) of the triple-network model has been described inconsistently in PIU. Using resting-state fMRI (rsFMRI) and hypothesizing a lower rsFC between default mode (DMN) and central executive networks (CEN) but a higher rsFC within the salience network (SN), this study scrutinized the neural substrates of PIU adolescents. A total of 30 adolescents with PIU and 30 control subjects underwent rsFMRI. The severity of PIU was evaluated by the Internet Addiction Test. Additionally, personality traits as well as emotional and behavioral problems were evaluated by the Temperament and Character Inventory (TCI) and the Strength and Difficulties Questionnaire (SDQ), respectively. Focusing on the DMN, SN, and CEN, we compared rsFC values between PIU and the control. Subsequently, within the combined group of subjects, TCI and SDQ correlation and mediation effects were investigated. Higher rsFC values of the left lateral prefrontal cortex (LPFC(L)) with the left anterior insula (aIns(L)) were observed for PIU than for the control, while rsFCs of the LPFC(L) with the medial PFC (MPFC), LPFC(L), as well as with the right lateral parietal cortex (LP(R)) were lower for PIU. Among these significant group differences, the rsFC between the LPFC(L) and MPFC was mediated by emotional symptoms (standardized β = −0.12, 95% CI −0.29, −0.0052). The dysfunctional attention switching and incentive salience regulated by the SN were implicated as being a neural correlate of PIU, and this relationship would in part be explained by the emotional dysregulation associated with PIU in adolescents.

Behavioral measures of impulsivity and compulsivity in adolescents with nonsuicidal self-injury

BACKGROUND

Nonsuicidal self-injury (NSSI) is prevalent among adolescents and research is needed to clarify the mechanisms which contribute to the behavior. Here, the authors relate behavioral neurocognitive measures of impulsivity and compulsivity to repetitive and sporadic NSSI in a community sample of adolescents.

METHODS

Computerized laboratory tasks (Affective Go/No-Go, Cambridge Gambling Task, and Probabilistic Reversal Task) were used to evaluate cognitive performance. Participants were adolescents aged 15 to 17 with (n = 50) and without (n = 190) NSSI history, sampled from the ROOTS project which recruited adolescents from secondary schools in Cambridgeshire, UK. NSSI was categorized as sporadic (1-3 instances per year) or repetitive (4 or more instances per year). Analyses were carried out in a series of linear and negative binomial regressions, controlling for age, gender, intelligence, and recent depressive symptoms.

RESULTS

Adolescents with lifetime NSSI, and repetitive NSSI specifically, made significantly more perseverative errors on the Probabilistic Reversal Task and exhibited significantly lower quality of decision making on the Cambridge Gambling Task compared to no-NSSI controls. Those with sporadic NSSI did not significantly differ from no-NSSI controls on task performance. NSSI was not associated with behavioral measures of impulsivity.

CONCLUSIONS

Repetitive NSSI is associated with increased behavioral compulsivity and disadvantageous decision making, but not with behavioral impulsivity. Future research should continue to investigate how neurocognitive phenotypes contribute to the onset and maintenance of NSSI, and determine whether compulsivity and addictive features of NSSI are potential targets for treatment.

Role of Orbitofrontal Cortex and Differential Effects of Acute and Chronic Stress on Motor Impulsivity Measured With 1-Choice Serial Reaction Time Test in Male Rats

BACKGROUND

Deficits in motor impulsivity, that is, the inability to inhibit a prepotent response, are frequently observed in psychiatric conditions. Several studies suggest that stress often correlates with higher impulsivity. Among the brain areas affected by stress, the orbitofrontal cortex (OFC) is notable because of its role in impulse control. OFC subregions with unique afferent and efferent circuitry play distinct roles in impulse control, yet it is not clear what OFC subregions are engaged during motor impulsivity tasks.

METHODS

In this study we used a rodent test of motor impulsivity, the 1-choice serial reaction time test, to explore activation of OFC subregions either during a well-learned motor impulsivity task or in a challenge task with a longer wait time that increases premature responding. We also examined the effects of acute inescapable stress, chronic intermittent cold stress and chronic unpredictable stress on motor impulsivity.

RESULTS

Fos expression increased in the lateral OFC and agranular insular cortex during performance in both the mastered and challenge conditions. In the ventral OFC, Fos expression increased only during challenge, and within the medial OFC, Fos was not induced in either condition. Inescapable stress produced a transient effect on premature responses in the mastered task, whereas chronic intermittent cold stress and chronic unpredictable stress altered premature responses in both conditions in ways specific to each stressor.

CONCLUSIONS

These results suggest that different OFC subregions have different roles in motor impulse control, and the effects of stress vary depending on the nature and duration of the stressor.

Nucleus Accumbens Core Dopamine D2 Receptor-Expressing Neurons Control Reversal Learning but Not Set-Shifting in Behavioral Flexibility in Male Mice

The ability to use environmental cues to flexibly guide responses is crucial for adaptive behavior and is thought to be controlled within a series of cortico-basal ganglia-thalamo-cortical loops. Previous evidence has indicated that different prefrontal cortical regions control dissociable aspects of behavioral flexibility, with the medial prefrontal cortex (mPFC) necessary for the ability to shift attention to a novel strategy (set-shifting) and the orbitofrontal cortex (OFC) necessary for shifting attention between learned stimulus-outcome associations (reversal learning). The nucleus accumbens (NAc) is a major downstream target of both the mPFC and the OFC; however, its role in controlling reversal learning and set-shifting abilities is still unclear. Here we investigated the contribution of the two major NAc neuronal populations, medium spiny neurons expressing either dopamine D1 or D2 receptors (D1-/D2-MSNs), in guiding reversal learning and set-shifting in an attentional set-shifting task (ASST). Persistent inhibition of neurotransmitter release from NAc D2-MSNs, but not D1-MSNs, resulted in an impaired ability for reversal learning, but not set-shifting in male mice. These findings suggest that NAc D2-MSNs play a critical role in suppressing responding toward specific learned cues that are now associated with unfavorable outcomes (i.e., in reversal stages), but not in the suppression of more general learned strategies (i.e., in set-shifting). This study provides further evidence for the anatomical separation of reversal learning and set-shifting abilities within cortico-basal ganglia-thalamo-cortical loops.

Maternal Separation Alters Ethanol Drinking and Reversal Learning Processes in Adolescent Rats: The Impact of Sex and Glycine Transporter Type 1 (GlyT1) Inhibitor

Adverse early life experiences are associated with an enhanced risk for mental and physical health problems, including substance abuse. Despite clinical evidence, the mechanisms underlying these relationships are not fully understood. Maternal separation (MS) is a commonly used animal model of early neglect. The aim of the current study is to determine whether the N-methyl-D-aspartate receptor (NMDAR)/glycine sites are involved in vulnerability to alcohol consumption (two-bottle choice paradigm) and reversal learning deficits (Barnes maze task) in adolescent rats subjected to the MS procedure and whether these effects are sex dependent. By using ELISA, we evaluated MS-induced changes in the NMDAR subunits (GluN1, GluN2A, GluN2B) expression, especially in the glycine-binding subunit, GluN1, in the prefrontal cortex (PFC) and ventral striatum (vSTR) of male/female rats. Next, we investigated whether Org 24598, a glycine transporter 1 (GlyT1) inhibitor, was able to modify ethanol drinking in adolescent and adult male/female rats with prior MS experience and reversal learning in the Barnes maze task. Our findings revealed that adolescent MS female rats consumed more alcohol which may be associated with a substantial increase in GluN1 subunit of NMDAR in the PFC and vSTR. Org 24598 decreased ethanol intake in both sexes with a more pronounced decrease in ethanol consumption in adolescent female rats. Furthermore, MS showed deficits in reversal learning in both sexes. Org 24598 ameliorated reversal learning deficits, and this effect was reversed by the NMDAR/glycine site inhibitor, L-701,324. Collectively, our results suggest that NMDAR/glycine sites might be targeted in the treatment of alcohol abuse in adolescents with early MS, especially females.

Effects of early life adversities upon memory processes and cognition in rodent models

Exposure to stressors in early postnatal life induces long-lasting modifications in brainfunction.Thisplasticity,an essential characteristic of the brain that enables adaptation to the environment, may also induce impairments in some psychophysiological functions, including learning and memory. Early life stress (ELS) has long-term effects on thehypothalamic-pituitary-adrenal axisresponse to stressors, and has been reported to lead toneuroinflammation,altered levelsof neurotrophic factors, modifications inneurogenesis andsynaptic plasticity,with changes in neurotransmitter systems and network functioning. In this review, we focus on early postnatal stress in animal models and their effects on learning and memory.Many studies have reported ELS-induced impairments in different types of memories, including spatial memory, fear memory, recognition (both for objects and social) memory, working memory and reversal learning. Studies are not always in agreement, however, no effects, or sometimes facilitation, being reported, depending on the nature and intensity of the early intervention, as well as the age when the outcome was evaluated and the sex of the animals. When considering processes occurring after consolidation, related with memory maintenance or modification, there are a very reduced number of reports. Future studies addressing the mechanisms underlying memory changes for ELS should shed some light on the understanding of the different effects induced by stressors of different types and intensities on cognitive functions.

The Role of Impulsivity and Reward Deficiency in "Liking" and "Wanting" of Potentially Problematic Behaviors and Substance Uses

A few studies have examined the changes in substance- and behavior-related "wanting" and "liking" of human subjects, the key properties of Incentive Sensitization Theory (IST). The aim of this study was to examine the dissociation between "wanting" and "liking" as a function of usage frequency, intensity, and subjective severity in individuals across four substances (alcohol, nicotine, cannabis, and other drugs) and ten behaviors (gambling, overeating, gaming, pornography use, sex, social media use, Internet use, TV-series watching, shopping, and work). Also, the potential roles of impulsivity and reward deficiency were investigated in "wanting," "liking," and wellbeing. The sex differences between "wanting" and "liking" were also examined. Based on our findings using structural equation modeling with 749 participants (503 women, M age = 35.7 years, SD = 11.84), who completed self-report questionnaires, "wanting" increased with the severity, frequency, and intensity of potentially problematic use, while "liking" did not change. Impulsivity positively predicted "wanting," and "wanting" positively predicted problem uses/behaviors. Reward deficiency positively predicted problem uses/behaviors, and both impulsivity and problem uses/behaviors negatively predicted wellbeing. Finally, women showed higher levels of "wanting," compared to men. These findings demonstrate the potential roles of incentive sensitization in both potentially problematic substance uses and behaviors.

Sleep loss impairs cognitive performance and alters song output in Australian magpies

Sleep maintains optimal brain functioning to facilitate behavioural flexibility while awake. Owing to a historical bias towards research on mammals, we know comparatively little about the role of sleep in facilitating the cognitive abilities of birds. We investigated how sleep deprivation over the full-night (12 h) or half-night (6 h) affects cognitive performance in adult Australian magpies (Cracticus tibicen), relative to that after a night of undisturbed sleep. Each condition was preceded and followed by a baseline and recovery night of sleep, respectively. Prior to each treatment, birds were trained on an associative learning task; on the day after experimental treatment (recovery day), birds were tested on a reversal learning task. To glean whether sleep loss affected song output, we also conducted impromptu song recordings for three days. Ultimately, sleep-deprived magpies were slower to attempt the reversal learning task, less likely to perform and complete the task, and those that did the test performed worse than better-rested birds. We also found that sleep-deprived magpies sang longer yet fewer songs, shifted crepuscular singing to mid-day, and during the post-recovery day, song frequency bandwidth narrowed. These results collectively indicate that sleep loss impairs motivation and cognitive performance, and alters song output, in a social adult songbird.

Reinforcement learning and bayesian inference provide complementary models for the unique advantage of adolescents in stochastic reversal

During adolescence, youth venture out, explore the wider world, and are challenged to learn how to navigate novel and uncertain environments. We investigated how performance changes across adolescent development in a stochastic, volatile reversal-learning task that uniquely taxes the balance of persistence and flexibility. In a sample of 291 participants aged 8–30, we found that in the mid-teen years, adolescents outperformed both younger and older participants. We developed two independent cognitive models, based on Reinforcement learning (RL) and Bayesian inference (BI). The RL parameter for learning from negative outcomes and the BI parameters specifying participants’ mental models were closest to optimal in mid-teen adolescents, suggesting a central role in adolescent cognitive processing. By contrast, persistence and noise parameters improved monotonically with age. We distilled the insights of RL and BI using principal component analysis and found that three shared components interacted to form the adolescent performance peak: adult-like behavioral quality, child-like time scales, and developmentally-unique processing of positive feedback. This research highlights adolescence as a neurodevelopmental window that can create performance advantages in volatile and uncertain environments. It also shows how detailed insights can be gleaned by using cognitive models in new ways.

Idiosyncratic learning performance in flies

Individuals vary in their innate behaviours, even when they have the same genome and have been reared in the same environment. The extent of individuality in plastic behaviours, like learning, is less well characterized. Also unknown is the extent to which intragenotypic differences in learning generalize: if an individual performs well in one assay, will it perform well in other assays? We investigated this using the fruit fly Drosophila melanogaster, an organism long-used to study the mechanistic basis of learning and memory. We found that isogenic flies, reared in identical laboratory conditions, and subject to classical conditioning that associated odorants with electric shock, exhibit clear individuality in their learning responses. Flies that performed well when an odour was paired with shock tended to perform well when the odour was paired with bitter taste or when other odours were paired with shock. Thus, individuality in learning performance appears to be prominent in isogenic animals reared identically, and individual differences in learning performance generalize across some aversive sensory modalities. Establishing these results in flies opens up the possibility of studying the genetic and neural circuit basis of individual differences in learning in a highly suitable model organism.

Neural Circuits Underlying Behavioral Flexibility: Insights From Drosophila

Behavioral flexibility is critical to survival. Animals must adapt their behavioral responses based on changes in the environmental context, internal state, or experience. Studies in Drosophila melanogaster have provided insight into the neural circuit mechanisms underlying behavioral flexibility. Here we discuss how Drosophila behavior is modulated by internal and behavioral state, environmental context, and learning. We describe general principles of neural circuit organization and modulation that underlie behavioral flexibility, principles that are likely to extend to other species.

Computational analysis of probabilistic reversal learning deficits in male subjects with alcohol use disorder

BACKGROUND

Alcohol use disorder is characterized by perseverative alcohol use despite negative consequences. This hallmark feature of addiction potentially relates to impairments in behavioral flexibility, which can be measured by probabilistic reversal learning (PRL) paradigms. We here aimed to examine the cognitive mechanisms underlying impaired PRL task performance in patients with alcohol use disorder (AUDP) using computational models of reinforcement learning.

METHODS

Twenty-eight early abstinent AUDP and 27 healthy controls (HC) performed an extensive PRL paradigm. We compared conventional behavioral variables of choices (perseveration; correct responses) between groups. Moreover, we fitted Bayesian computational models to the task data to compare differences in latent cognitive variables including reward and punishment learning and choice consistency between groups.

RESULTS

AUDP and HC did not significantly differ with regard to direct perseveration rates after reversals. However, AUDP made overall less correct responses and specifically showed decreased win-stay behavior compared to HC. Interestingly, AUDP showed premature switching after no or little negative feedback but elevated proneness to stay when accumulation of negative feedback would make switching a more optimal option. Computational modeling revealed that AUDP compared to HC showed enhanced learning from punishment, a tendency to learn less from positive feedback and lower choice consistency.

CONCLUSION

Our data do not support the assumption that AUDP are characterized by increased perseveration behavior. Instead our findings provide evidence that enhanced negative reinforcement and decreased non-drug-related reward learning as well as diminished choice consistency underlie dysfunctional choice behavior in AUDP.

Cognitive performance during adulthood in a rat model of neonatal diffuse white matter injury

RATIONALE

Infants born prematurely risk developing diffuse white matter injury (WMI), which is associated with impaired cognitive functioning and an increased risk of autism spectrum disorder. Recently, our rat model of preterm diffuse WMI induced by combined fetal inflammation and postnatal hypoxia showed impaired motor performance, anxiety-like behaviour and autism-like behaviour in juvenile rats, especially males. Immunohistochemistry showed delayed myelination in the sensory cortex and impaired oligodendrocyte differentiation.

OBJECTIVE

To assess long-term cognitive deficits in this double-hit rat model of diffuse WMI, animals were screened on impulsivity, attention and cognitive flexibility in adulthood using the 5-choice serial reaction time task (5CSRTT) and a probabilistic reversal learning task, tests that require a proper functioning prefrontal cortex. Thereafter, myelination deficits were evaluated by immunofluorescent staining in adulthood.

RESULTS

Overall, little effect of WMI or sex was found in the cognitive tasks. WMI animals showed subtle differences in performance in the 5CSRTT. Manipulating 5CSRTT parameters resulted in performance patterns previously seen in the literature. Sex differences were found in perseverative responses and omitted trials: female WMI rats seem to be less flexible in the 5CSRTT but not in the reversal learning task. Males collected rewards faster in the probabilistic reversal learning task. These findings are explained by temporally rather than permanently affected myelination and by the absence of extensive injury to prefrontal cortical subregions, confirmed by immunofluorescent staining in both adolescence and adulthood.

CONCLUSION

This rat model of preterm WMI does not lead to long-term cognitive deficits as observed in prematurely born human infants.

Mitragynine improves cognitive performance in morphine-withdrawn rats

RATIONALE

The treatment of opiate addiction is an unmet medical need. Repeated exposure to opiates disrupts cognitive performance. Opioid substitution therapy, with, e.g., methadone, may further exacerbate the cognitive deficits. Growing evidence suggests that mitragynine, the primary alkaloid from the Kratom (Mitragyna speciosa) leaves, may serve as a promising alternative therapy for opiate addiction. However, the knowledge of its health consequences is still limited.

OBJECTIVES

We aimed to examine the cognitive effects of mitragynine substitution in morphine-withdrawn rats. Furthermore, we asked whether neuronal addiction markers like the brain-derived neurotrophic factor (BDNF) and Ca²⁺/calmodulin-dependent kinase II alpha (αCaMKII) might mediate the observed effects.

METHODS

Male Sprague-Dawley rats were given morphine at escalating doses before treatment was discontinued to induce a spontaneous morphine withdrawal. Then, vehicle or mitragynine (5 mg/kg, 15 mg/kg, or 30 mg/kg) substitution was given for 3 days. A vehicle-treated group was used as a control. Withdrawal signs were scored after 24 h, 48 h, and 72 h, while novel object recognition (NOR) and attentional set-shifting (ASST) were tested during the substitution period.

RESULTS

Discontinuation of morphine significantly induced morphine withdrawal signs and cognitive deficit in the ASST. The substitution with mitragynine was able to alleviate the withdrawal signs. Mitragynine did not affect the recognition memory in the NOR but significantly improved the reversal learning deficit in the morphine-withdrawn rats.

CONCLUSIONS

These data support the idea that mitragynine could be used as safe medication therapy to treat opiate addiction with beneficial effects on cognitive deficits.

Foraging with the frontal cortex: A cross-species evaluation of reward-guided behavior

Efficient foraging is essential to survival and depends on frontal cortex in mammals. Because of its role in psychiatric disorders, frontal cortex and its contributions to reward procurement have been studied extensively in both rodents and non-human primates. How frontal cortex of these animal models compares is a source of intense debate. Here we argue that translating findings from rodents to non-human primates requires an appreciation of both the niche in which each animal forages as well as the similarities in frontal cortex anatomy and function. Consequently, we highlight similarities and differences in behavior and anatomy, before focusing on points of convergence in how parts of frontal cortex contribute to distinct aspects of foraging in rats and macaques, more specifically. In doing so, our aim is to emphasize where translation of frontal cortex function between species is clearer, where there is divergence, and where future work should focus. We finish by highlighting aspects of foraging for which have received less attention but we believe are critical to uncovering how frontal cortex promotes survival in each species.

Maternal Immune Activation during Pregnancy Alters Postnatal Brain Growth and Cognitive Development in Nonhuman Primate Offspring

Human epidemiological studies implicate exposure to infection during gestation in the etiology of neurodevelopmental disorders. Animal models of maternal immune activation (MIA) have identified the maternal immune response as the critical link between maternal infection and aberrant offspring brain and behavior development. Here we evaluate neurodevelopment of male rhesus monkeys (Macaca mulatta) born to MIA-treated dams (n = 14) injected with a modified form of the viral mimic polyinosinic:polycytidylic acid at the end of the first trimester. Control dams received saline injections at the same gestational time points (n = 10) or were untreated (n = 4). MIA-treated dams exhibited a strong immune response as indexed by transient increases in sickness behavior, temperature, and inflammatory cytokines. Although offspring born to control or MIA-treated dams did not differ on measures of physical growth and early developmental milestones, the MIA-treated animals exhibited subtle changes in cognitive development and deviated from species-typical brain growth trajectories. Longitudinal MRI revealed significant gray matter volume reductions in the prefrontal and frontal cortices of MIA-treated offspring at 6 months that persisted through the final time point at 45 months along with smaller frontal white matter volumes in MIA-treated animals at 36 and 45 months. These findings provide the first evidence of early postnatal changes in brain development in MIA-exposed nonhuman primates and establish a translationally relevant model system to explore the neurodevelopmental trajectory of risk associated with prenatal immune challenge from birth through late adolescence.SIGNIFICANCE STATEMENT Women exposed to infection during pregnancy have an increased risk of giving birth to a child who will later be diagnosed with a neurodevelopmental disorder. Preclinical maternal immune activation (MIA) models have demonstrated that the effects of maternal infection on fetal brain development are mediated by maternal immune response. Since the majority of MIA models are conducted in rodents, the nonhuman primate provides a unique system to evaluate the MIA hypothesis in a species closely related to humans. Here we report the first longitudinal study conducted in a nonhuman primate MIA model. MIA-exposed offspring demonstrate subtle changes in cognitive development paired with marked reductions in frontal gray and white matter, further supporting the association between prenatal immune challenge and alterations in offspring neurodevelopment.

Obesity-associated deficits in inhibitory control are phenocopied to mice through gut microbiota changes in one-carbon and aromatic amino acids metabolic pathways

BACKGROUND

Inhibitory control (IC) is critical to keep long-term goals in everyday life. Bidirectional relationships between IC deficits and obesity are behind unhealthy eating and physical exercise habits.

METHODS

We studied gut microbiome composition and functionality, and plasma and faecal metabolomics in association with cognitive tests evaluating inhibitory control (Stroop test) and brain structure in a discovery (n=156), both cross-sectionally and longitudinally, and in an independent replication cohort (n=970). Faecal microbiota transplantation (FMT) in mice evaluated the impact on reversal learning and medial prefrontal cortex (mPFC) transcriptomics.

RESULTS

An interplay among IC, brain structure (in humans) and mPFC transcriptomics (in mice), plasma/faecal metabolomics and the gut metagenome was found. Obesity-dependent alterations in one-carbon metabolism, tryptophan and histidine pathways were associated with IC in the two independent cohorts. Bacterial functions linked to one-carbon metabolism (thyX,dut, exodeoxyribonuclease V), and the anterior cingulate cortex volume were associated with IC, cross-sectionally and longitudinally. FMT from individuals with obesity led to alterations in mice reversal learning. In an independent FMT experiment, human donor's bacterial functions related to IC deficits were associated with mPFC expression of one-carbon metabolism-related genes of recipient's mice.

CONCLUSION

These results highlight the importance of targeting obesity-related impulsive behaviour through the induction of gut microbiota shifts.

Interplay Between Inhibitory Control and Behavioural Flexibility: Impact of Dorsomedial Striatal Dopamine Denervation in Mice

In Parkinson's disease, nigrostriatal dopamine (DA) degeneration is commonly associated with motor symptomatology. However, non-motor symptoms affecting cognitive function, such as behavioural flexibility and inhibitory control may also appear early in the disease. Here we addressed the role of DA innervation of the dorsomedial striatum (DMS) in mediating these functions in 6-hydroxydopamine (6-OHDA)-lesioned mice using instrumental conditioning in various tasks. Behavioural flexibility was studied in a simple reversal task (nose-poke discrimination) or in reversal of a two-step sequence of actions (central followed by lateral nose-poke). Our results show that mild DA lesions of the DMS induces behavioural flexibility deficits in the sequential reversal learning only. In the first sessions following reversal of contingency, lesioned mice enhanced perseverative sequence of actions to the initial rewarded side then produced premature responses directly to the correct side omitting the central response, thus disrupting the two-step sequence of actions. These deficits may be linked to increased impulsivity as 6-OHDA-lesioned mice were unable to inhibit a previously learned motor response in a cued response inhibition task assessing proactive inhibitory control. Our findings show that partial DA denervation restricted to DMS impairs behavioural flexibility and proactive response inhibition in mice. Such striatal DA lesion may thus represent a valuable animal model for exploring deficits in executive control documented in early stage of Parkinson's disease.

Heritable variation in locomotion, reward sensitivity and impulsive behaviors in a genetically diverse inbred mouse panel

Drugs of abuse, including alcohol and stimulants like cocaine, produce effects that are subject to individual variability, and genetic variation accounts for at least a portion of those differences. Notably, research in both animal models and human subjects point toward reward sensitivity and impulsivity as being trait characteristics that predict relatively greater positive subjective responses to stimulant drugs. Here we describe use of the eight collaborative cross (CC) founder strains and 38 (reversal learning) or 10 (all other tests) CC strains to examine the heritability of reward sensitivity and impulsivity traits, as well as genetic correlations between these measures and existing addiction-related phenotypes. Strains were all tested for activity in an open field and reward sensitivity (intake of chocolate BOOST®). Mice were then divided into two counterbalanced groups and underwent reversal learning (impulsive action and waiting impulsivity) or delay discounting (impulsive choice). CC and founder mice show significant heritability for impulsive action, impulsive choice, waiting impulsivity, locomotor activity, and reward sensitivity, with each impulsive phenotype determined to be non-correlating, independent traits. This research was conducted within the broader, inter-laboratory effort of the Center for Systems Neurogenetics of Addiction (CSNA) to characterize CC and DO mice for multiple, cocaine abuse related traits. These data will facilitate the discovery of genetic correlations between predictive traits, which will then guide discovery of genes and genetic variants that contribute to addictive behaviors.

Examining the effects of psychoactive drugs on complex behavioral processes in laboratory animals

Behavioral pharmacology has been aided significantly by the development of innovative cognitive tasks designed to examine complex behavioral processes in laboratory animals. Performance outcomes under these conditions have provided key metrics of drug action which serve to supplement traditional in vivo assays of physiologic and behavioral effects of psychoactive drugs. This chapter provides a primer of cognitive tasks designed to assay different aspects of complex behavior, including learning, cognitive flexibility, memory, attention, motivation, and impulsivity. Both capstone studies and recent publications are highlighted throughout to illustrate task value for two distinct but often interconnected translational strategies. First, task performance in laboratory animals can be utilized to elucidate how drugs of abuse affect complex behavioral processes. Here, the expectation is that adverse effects on such processes will have predictive relevance to consequences that will be experienced by humans. Second, these same task outcomes can be used to evaluate candidate therapeutics. In this case, the extent to which drug doses with medicinal value perturb task performance can contribute critical information for a more complete safety profile appraisal and advance the process of medications development. Methodological and theoretical considerations are discussed and include an emphasis on determining selectivity in drug action on complex behavioral processes.