Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action

The role of the bed nucleus of the stria terminalis in the motivational control of instrumental action

We review recent studies assessing the role of the bed nucleus of the stria terminalis (BNST) in the motivational control of instrumental conditioning. This evidence suggests that the BNST and central nucleus of the amygdala (CeA) form a circuit that modulates the ventral tegmental area (VTA) input to the nucleus accumbens core (NAc core) to control the influence of Pavlovian cues on instrumental performance. In support of these claims, we found that activity in the oval region of BNST was increased by instrumental conditioning, as indexed by phosphorylated ERK activity (Experiment 1), but that this increase was not due to exposure to the instrumental contingency or to the instrumental outcome per se (Experiment 2). Instead, BNST activity was most significantly incremented in a test conducted when the instrumental outcome was anticipated but not delivered, suggesting a role for BNST in the motivational effects of anticipated outcomes on instrumental performance. To test this claim, we examined the effect of NMDA-induced cell body lesions of the BNST on general Pavlovian-to-instrumental transfer (Experiment 3). These lesions had no effect on instrumental performance or on conditioned responding during Pavlovian conditioning to either an excitory conditioned stimulus (CS) or a neutral CS (CS0) but significantly attenuated the excitatory effect of the Pavlovian CS on instrumental performance. These data are consistent with the claim that the BNST mediates the general excitatory influence of Pavlovian cues on instrumental performance and suggest BNST activity may be central to CeA-BNST modulation of a VTA-NAc core circuit in incentive motivation.

Orbitofrontal cortex populations are differentially recruited to support actions

The ability to use information from one's prior actions is necessary for decision-making. While orbitofrontal cortex (OFC) has been hypothesized as key for inferences made using cue and value-related information, whether OFC populations contribute to the use of information from volitional actions to guide behavior is not clear. Here, we used a self-paced lever-press hold-down task in which mice infer prior lever-press durations to guide subsequent action performance. We show that the activity of genetically identified lateral OFC (lOFC) subpopulations differentially instantiate current and prior action information during ongoing action execution. Transient state-dependent lOFC circuit disruptions of specified subpopulations reduced the encoding of ongoing press durations but did not disrupt the use of prior action information to guide future action performance. In contrast, a chronic functional loss of lOFC circuit activity resulted in increased reliance on recently executed lever-press durations and impaired contingency reversal, suggesting the recruitment of compensatory mechanisms that resulted in repetitive action control. Our results identify a novel role for lOFC in the integration of action information to guide adaptive behavior.

Misconfigured striatal connectivity profiles in smokers

Dysregulation of frontal cortical inputs to the striatum is foundational in the neural basis of substance use disorder (SUD). Neuroanatomical and electrophysiological data increasingly show that striatal nodes receive appreciable input from numerous cortical areas, and that the combinational properties of these multivariate "connectivity profiles" play a predominant role in shaping striatal activity and function. Yet, how abnormal configuration of striatal connectivity profiles might contribute to SUD is unknown. Here, we implemented a novel "connectivity profile analysis" (CPA) approach using resting-state functional connectivity data to facilitate detection of different types of connectivity profile "misconfiguration" that may reflect distinct forms of aberrant circuit plasticity in SUD. We examined 46 nicotine-dependent smokers and 33 non-smokers and showed that both dorsal striatum (DS) and ventral striatum (VS) connectivity profiles with frontal cortex were misconfigured in smokers-but in doubly distinct fashions. DS misconfigurations were stable across sated and acute abstinent states (indicative of a "trait" circuit adaptation) whereas VS misconfigurations emerged only during acute abstinence (indicative of a "state" circuit adaptation). Moreover, DS misconfigurations involved abnormal connection strength rank order arrangement, whereas VS misconfigurations involved abnormal aggregate strength. We found that caudal ventral putamen in smokers uniquely displayed multiple types of connectivity profile misconfiguration, whose interactive magnitude was linked to dependence severity, and that VS misconfiguration magnitude correlated positively with withdrawal severity during acute abstinence. Findings underscore the potential for approaches that more aptly model the neurobiological composition of corticostriatal circuits to yield deeper insights into the neural basis of SUD.

Symptom-Based Profiling and Multimodal Neuroimaging of a Large Preteenage Population Identifies Distinct Obsessive-Compulsive Disorder-like Subtypes With Neurocognitive Differences

BACKGROUND

Obsessive-compulsive disorder (OCD) is characterized by both internalizing (anxiety) and externalizing (compulsivity) symptoms. Currently, little is known about their interrelationships and their relative contributions to disease heterogeneity. Our goal is to resolve affective and cognitive symptom heterogeneity related to internalized and externalized symptom dimensions by determining subtypes of children with OCD symptoms, and to identify any corresponding neural differences.

METHODS

A total of 1269 children with OCD symptoms screened using the Child Behavior Checklist Obsessive-Compulsive Symptom scale and 3987 matched control subjects were obtained from the Adolescent Brain Cognitive Development (ABCD) Study. Consensus hierarchical clustering was used to cluster children with OCD symptoms into distinct subtypes. Ten neurocognitive task scores and 20 Child Behavior Checklist syndrome scales were used to characterize cognitive/behavioral differences. Gray matter volume, fractional anisotropy of major white matter fiber tracts, and functional connectivity among networks were used in case-control studies.

RESULTS

We identified two subgroups with contrasting patterns in internalized and externalized dimensions. Group 1 showed compulsive thoughts and repeated acts but relatively low anxiety symptoms, whereas group 2 exhibited higher anxiety and perfectionism and relatively low repetitive behavior. Only group 1 had significant cognitive impairments and gray matter volume reductions in the bilateral inferior parietal lobe, precentral gyrus, and precuneus gyrus, and had white matter tract fractional anisotropy reductions in the corticostriatal fasciculus.

CONCLUSIONS

Children with OCD symptoms are heterogeneous at the level of symptom clustering and its underlying neural basis. Two subgroups represent distinct patterns of externalizing and internalizing symptoms, suggesting that anxiety is not its major predisposing factor. These results may have implications for the nosology and treatment of preteenage OCD.

The role of dopamine and endocannabinoid systems in prefrontal cortex development: Adolescence as a critical period

The prefrontal cortex plays a central role in the control of complex cognitive processes including action control and decision making. It also shows a specific pattern of delayed maturation related to unique behavioral changes during adolescence and allows the development of adult cognitive processes. The adolescent brain is extremely plastic and critically vulnerable to external insults. Related to this vulnerability, adolescence is also associated with the emergence of numerous neuropsychiatric disorders involving alterations of prefrontal functions. Within prefrontal microcircuits, the dopamine and the endocannabinoid systems have widespread effects on adolescent-specific ontogenetic processes. In this review, we highlight recent advances in our understanding of the maturation of the dopamine system and the endocannabinoid system in the prefrontal cortex during adolescence. We discuss how they interact with GABA and glutamate neurons to modulate prefrontal circuits and how they can be altered by different environmental events leading to long-term neurobiological and behavioral changes at adulthood. Finally, we aim to identify several future research directions to help highlight gaps in our current knowledge on the maturation of these microcircuits.

Habit Formation and the Effect of Repeated Stress Exposures on Cognitive Flexibility Learning in Horses

Horse training exposes horses to an array of cognitive and ethological challenges. Horses are routinely required to perform behaviours that are not aligned to aspects of their ethology, which may delay learning. While horses readily form habits during training, not all of these responses are considered desirable, resulting in the horse being subject to retraining. This is a form of cognitive flexibility and is critical to the extinction of habits and the learning of new responses. It is underpinned by complex neural processes which can be impaired by chronic or repeated stress. Domestic horses may be repeatedly exposed to multiples stressors. The potential contribution of stress impairments of cognitive flexibility to apparent training failures is not well understood, however research from neuroscience can be used to understand horses’ responses to training. We trained horses to acquire habit-like responses in one of two industry-style aversive instrumental learning scenarios (moving away from the stimulus-instinctual or moving towards the stimulus-non-instinctual) and evaluated the effect of repeated stress exposures on their cognitive flexibility in a reversal task. We measured heart rate as a proxy for noradrenaline release, salivary cortisol and serum Brain Derived Neurotrophic Factor (BDNF) to infer possible neural correlates of the learning outcomes. The instinctual task which aligned with innate equine escape responses to aversive stimuli was acquired significantly faster than the non-instinctual task during both learning phases, however contrary to expectations, the repeated stress exposure did not impair the reversal learning. We report a preliminary finding that serum BDNF and salivary cortisol concentrations in horses are positively correlated. The ethological salience of training tasks and cognitive flexibility learning can significantly affect learning in horses and trainers should adapt their practices where such tasks challenge innate equine behaviour.

The mediodorsal thalamus supports adaptive responding based on stimulus-outcome associations

The ability to engage into flexible behaviors is crucial in dynamic environments. We recently showed that in addition to the well described role of the orbitofrontal cortex (OFC), its thalamic input from the submedius thalamic nucleus (Sub) also contributes to adaptive responding during Pavlovian degradation. In the present study, we examined the role of the mediodorsal thalamus (MD) which is the other main thalamic input to the OFC. To this end, we assessed the effect of both pre- and post-training MD lesions in rats performing a Pavlovian contingency degradation task. Pre-training lesions mildly impeded the establishment of stimulus-outcome associations during the initial training of Pavlovian conditioning without interfering with Pavlovian degradation training when the sensory feedback provided by the outcome rewards were available to animals. However, we found that both pre- and post-training MD lesions produced a selective impairment during a test conducted under extinction conditions, during which only current mental representation could guide behavior. Altogether, these data suggest a role for the MD in the successful encoding and representation of Pavlovian associations.

Psychopathic tendency in violent offenders is associated with reduced aversive Pavlovian inhibition of behavior and associated striatal BOLD signal

Background

Violent offenders with psychopathic tendencies are characterized by instrumental, i.e., planned, callous, and unemotional (aggressive) behavior and have been shown to exhibit abnormal aversive processing. However, the consequences of abnormal aversive processing for instrumental action and associated neural mechanisms are unclear.

Materials and methods

Here we address this issue by using event-related functional magnetic resonance imaging (fMRI) in 15 violent offenders with high psychopathic tendencies and 18 matched controls during the performance of an aversive Pavlovian-to-instrumental transfer paradigm. This paradigm allowed us to assess the degree to which aversive Pavlovian cues affect instrumental action and associated neural signaling.

Results

Psychopathic tendency scores were associated with an attenuation of aversive Pavlovian inhibition of instrumental action. Moreover, exploratory analyses revealed an anomalous positive association between aversive inhibition of action and aversive inhibition of BOLD signal in the caudate nucleus of violent offenders with psychopathic tendencies. In addition, psychopathic tendency also correlated positively with amygdala reactivity during aversive versus neutral cues in Pavlovian training.

Conclusion

These findings strengthen the hypothesis that psychopathic tendencies in violent offenders are related to abnormal impact of aversive processing on instrumental behavior. The neural effects raise the possibility that this reflects deficient transfer of aversive Pavlovian inhibitory biases onto neural systems that implement instrumental action, including the caudate nucleus.

Early Changes in Striatal Activity and Motor Kinematics in a Huntington's Disease Mouse Model

BACKGROUND

Huntington's disease is a progressive neurodegenerative disorder with no disease-modifying treatments. Patients experience motor, cognitive, and psychiatric disturbances, and the dorsal striatum is the main target of neurodegeneration. Mouse models of Huntington's disease show altered striatal synaptic signaling in vitro, but how these changes relate to behavioral deficits in vivo is unclear.

OBJECTIVES

We aimed to investigate how striatal activity correlates with behavior in vivo during motor learning and spontaneous behavior in a Huntington's disease mouse model at two disease stages.

METHODS

We used fiber photometry to record jGCaMP7f fluorescence, a read-out of neuronal activity, in the dorsal striatum of YAC128 (yeast artificial chromosome-128CAG) mice during accelerating rotarod and open-field behavior.

RESULTS

Mice showed increased striatal activity on the rotarod, which diminished by late stages of learning, leading to an inverse correlation between latency to fall and striatal activity. The 2- to 3-month-old YAC128 mice did not show a deficit in latency to fall, but displayed significant differences in paw kinematics, including increased paw slip frequency and variability in paw height. These mice exhibited a weaker correlation between latency to fall and striatal activity and aberrant striatal activity during paw slips. At 6 to 7 months, the YAC128 mice showed significantly reduced latency to fall, impaired paw kinematics, and increased striatal activity while on the rotarod. In the open field, the YAC128 mice showed elevated neuronal activity at rest.

CONCLUSIONS

We uncovered impaired motor coordination at a stage thought to be premotor manifest in YAC128 mice and aberrant striatal activity during the accelerating rotarod and open-field exploration. © 2022 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.

Making habits measurable beyond what they are not: A focus on associative dual-process models

Habits are the subject of intense international research. Under the associative dual-process model the outcome devaluation paradigm has been used extensively to classify behaviours as being either goal-directed (sensitive to shifts in the value of associated outcomes) or habitual (triggered by stimuli without anticipation of consequences). This has proven to be a useful framework for studying the neurobiology of habit and relevance of habits in clinical psychopathology. However, in recent years issues have been raised about this rather narrow definition of habits in comparison to habitual behaviour experienced in the real world. Specifically, defining habits as the absence of goal-directed control, the very specific set-ups required to demonstrate habit experimentally and the lack of direct evidence for habits as stimulus-response behaviours are viewed as problematic. In this review paper we address key critiques that have been raised about habit research within the framework of the associative dual-process model. We then highlight novel research approaches studying different features of habits with methods that expand beyond traditional paradigms.

"Wanting" versus "needing" related value: An fMRI meta-analysis

Consumption and its excesses are sometimes explained by imbalance of need or lack of control over "wanting." "Wanting" assigns value to cues that predict rewards, whereas "needing" assigns value to biologically significant stimuli that one is deprived of. Here we aimed at studying how the brain activation patterns related to value of "wanted" stimuli differs from that of "needed" stimuli using activation likelihood estimation neuroimaging meta-analysis approaches. We used the perception of a cue predicting a reward for "wanting" related value and the perception of food stimuli in a hungry state as a model for "needing" related value. We carried out separate, contrasts, and conjunction meta-analyses to identify differences and similarities between "wanting" and "needing" values. Our overall results for "wanting" related value show consistent activation of the ventral tegmental area, striatum, and pallidum, regions that both activate behavior and direct choice, while for "needing" related value, we found an overall consistent activation of the middle insula and to some extent the caudal-ventral putamen, regions that only direct choice. Our study suggests that wanting has more control on consumption and behavioral activation.

Amygdala response predicts clinical symptom reduction in patients with borderline personality disorder: A pilot fMRI study

Borderline personality disorder (BPD) is a prevalent, devastating, and heterogeneous psychiatric disorder. Treatment success is highly variable within this patient group. A cognitive neuroscientific approach to BPD might contribute to precision psychiatry by identifying neurocognitive factors that predict who will benefit from a specific treatment. Here, we build on observations that BPD is accompanied by the enhanced impact of the aversive effect on behavior and abnormal neural signaling in the amygdala. We assessed whether BPD is accompanied by abnormal aversive regulation of instrumental behavior and associated neural signaling, in a manner that is predictive of symptom reduction after therapy. We tested a clinical sample of 15 female patients with BPD, awaiting dialectical behavior therapy (DBT), and 16 matched healthy controls using fMRI and an aversive Pavlovian-to-instrumental transfer (PIT) task that assesses how instrumental behaviors are influenced by aversive Pavlovian stimuli. Patients were assessed 1 year after the start of DBT to quantify changes in BPD symptom severity. At baseline, behavioral aversive PIT and associated neural signaling did not differ between groups. However, the BOLD signal in the amygdala measured during aversive PIT was associated with symptom reduction at 1-year follow-up: higher PIT-related aversive amygdala signaling before treatment was associated with reduced clinical improvement at follow-up. Thus, within the evaluated group of BPD patients, the BOLD signal in the amygdala before treatment was related to clinical symptom reduction 1 year after the start of treatment. The results suggest that less PIT-related responsiveness of the amygdala increases the chances of treatment success. We note that the relatively small sample size is a limitation of this study and that replication is warranted.

Cross-paradigm integration shows a common neural basis for aversive and appetitive conditioning

Sharing imaging data and comparing them across different psychological tasks is becoming increasingly possible as the open science movement advances. Such cross-paradigm integration has the potential to identify commonalities in findings that neighboring areas of study thought to be paradigm-specific. However, even the integration of research from closely related paradigms, such as aversive and appetitive classical conditioning is rare - even though qualitative comparisons already hint at how similar the 'fear network' and 'reward network' may be. We aimed to validate these theories by taking a multivariate approach to assess commonalities across paradigms empirically. Specifically, we quantified the similarity of an aversive conditioning pattern derived from meta-analysis to appetitive conditioning fMRI data. We tested pattern expression in three independent appetitive conditioning studies with 29, 76 and 38 participants each. During fMRI scanning, participants in each cohorts performed an appetitive conditioning task in which a CS+ was repeatedly rewarded with money and a CS- was never rewarded. The aversive pattern was highly similar to appetitive CS+ > CS- contrast maps across samples and variations of the appetitive conditioning paradigms. Moreover, the pattern distinguished the CS+ from the CS- with above-chance accuracy in every sample. These findings provide robust empirical evidence for an underlying neural system common to appetitive and aversive learning. We believe that this approach provides a way to empirically integrate the steadily growing body of fMRI findings across paradigms.

Cannabis use is associated with sexually dimorphic changes in executive control of visuospatial decision-making

When the outcome of a choice is less favorable than expected, humans and animals typically shift to an alternate choice option on subsequent trials. Several lines of evidence indicate that this “lose-shift” responding is an innate sensorimotor response strategy that is normally suppressed by executive function. Therefore, the lose-shift response provides a covert gauge of cognitive control over choice mechanisms. We report here that the spatial position, rather than visual features, of choice targets drives the lose-shift effect. Furthermore, the ability to inhibit lose-shift responding to gain reward is different among male and female habitual cannabis users. Increased self-reported cannabis use was concordant with suppressed response flexibility and an increased tendency to lose-shift in women, which reduced performance in a choice task in which random responding is the optimal strategy. On the other hand, increased cannabis use in men was concordant with reduced reliance on spatial cues during decision-making, and had no impact on the number of correct responses. These data (63,600 trials from 106 participants) provide strong evidence that spatial-motor processing is an important component of economic decision-making, and that its governance by executive systems is different in men and women who use cannabis frequently.

Front and center: Maturational dysregulation of frontal lobe functional neuroanatomic connections in attention deficit hyperactivity disorder

Frontal lobe function may not universally explain all forms of attention deficit hyperactivity disorder (ADHD) but the frontal lobe hypothesis described supports an internally consistent model for integrating the numerous behaviors associated with ADHD. The paper examines the developmental trajectories of frontal and prefrontal lobe development, framing ADHD as maturational dysregulation concluding that the cognitive, motor, and behavioral abilities of the presumptive majority of ADHD children may not primarily be disordered or dysfunctional but reflect maturational dysregulation that is inconsistent with the psychomotor and cognitive expectations for the child’s chronological and mental age. ADHD children demonstrate decreased activation of the right and middle prefrontal cortex. Prefrontal and frontal lobe regions have an exuberant network of shared pathways with the diencephalic region, also having a regulatory function in arousal as well as with the ascending reticular formation which has a capacity for response suppression to task-irrelevant stimuli. Prefrontal lesions oftentimes are associated with the regulatory breakdown of goal-directed activity and impulsivity. In conclusion, a presumptive majority of childhood ADHD may result from maturational dysregulation of the frontal lobes with effects on the direct, indirect and/or, hyperdirect pathways.

An fMRI meta-analysis of the role of the striatum in everyday-life vs laboratory-developed habits

The dorsolateral striatum plays a critical role in the acquisition and expression of stimulus-response habits that are learned in experimental laboratories. Here, we use meta-analytic procedures to contrast the neural circuits activated by laboratory-acquired habits with those activated by stimulus-response behaviours acquired in everyday-life. We confirmed that newly learned habits rely more on the anterior putamen with activation extending into caudate and nucleus accumbens. Motor and associative components of everyday-life habits were identified. We found that motor-dominant stimulus-response associations developed outside the laboratory primarily engaged posterior dorsal putamen, supplementary motor area (SMA) and cerebellum. Importantly, associative components were also represented in the posterior putamen. Thus, common neural representations for both naturalistic and laboratory-based habits were found in the left posterior and right anterior putamen. These findings suggest a partial common striatal substrate for habitual actions that are performed predominantly by stimulus-response associations represented in the posterior striatum. The overlapping neural substrates for laboratory and everyday-life habits supports the use of both methods for the analysis of habitual behaviour.

Food cue reactivity: Neurobiological and behavioral underpinnings

The modern obesogenic environment contains an abundance of food cues (e.g., sight, smell of food) as well cues that are associated with food through learning and memory processes. Food cue exposure can lead to food seeking and excessive consumption in otherwise food-sated individuals, and a high level of food cue responsivity is a risk factor for overweight and obesity. Similar food cue responses are observed in experimental rodent models, and these models are therefore useful for mechanistically identifying the neural circuits mediating food cue responsivity. This review draws from both experimental rodent models and human data to characterize the behavioral and biological processes through which food-associated stimuli contribute to overeating and weight gain. Two rodent models are emphasized - cue-potentiated feeding and Pavlovian-instrumental transfer - that provide insight in the neural circuits and peptide systems underlying food cue responsivity. Data from humans are highlighted that reveal physiological, psychological, and neural mechanisms that connect food cue responsivity with overeating and weight gain. The collective literature identifies connections between heightened food cue responsivity and obesity in both rodents and humans, and identifies underlying brain regions (nucleus accumbens, amygdala, orbitofrontal cortex, hippocampus) and endocrine systems (ghrelin) that regulate food cue responsivity in both species. These species similarities are encouraging for the possibility of mechanistic rodent model research and further human research leading to novel treatments for excessive food cue responsivity in humans.

Structural and functional variations in the prefrontal cortex are associated with learning in pre-adolescent common marmosets (Callithrix jacchus)

There is substantial evidence linking the prefrontal cortex (PFC) to a variety of cognitive abilities, with adolescence being a critical period in its development. In the current study, we investigated the neural basis of differences in learning in pre-adolescent common marmosets. At 8 months old, marmosets were given anatomical and resting state MRI scans (n = 24). At 9 months old, association learning and inhibitory control was tested using a 'go/no go' visual discrimination (VD) task. Marmosets were grouped into 'learners' (n = 12) and "non-learners" (n = 12), and associations between cognitive performance and sub-regional PFC volumes, as well as PFC connectivity patterns, were investigated. "Learners" had significantly (p < 0.05) larger volumes of areas 11, 25, 47 and 32 than 'non-learners', although 'non-learners' had significantly larger volumes of areas 24a and 8 v than "learners". There was also a significant correlation between average % correct responses to the 'punished' stimulus and volume of area 47. Further, 'non-learners' had significantly greater global PFC connections, as well as significantly greater numbers of connections between the PFC and basal ganglia, cerebellum and hippocampus, compared to 'learners'. These results suggest that larger sub-regions of the orbitofrontal cortex and ventromedial PFC, as well more refined PFC connectivity patterns to other brain regions associated with learning, may be important in successful response inhibition. This study therefore offers new information on the neurodevelopment of individual differences in cognition during pre-adolescence in non-human primates.

Development and Validation of a Daily Habit Scale

Habits are defined as automatic behaviours triggered by cues and performed without awareness. They are difficult to control and mentally efficient, which contrasts with goal-directed behaviour, which is characterised by active thought, high computational effort, and the ability to modify this behaviour in response to a changing environment and contextual demands. Habits are not only defined by the frequency with which a behaviour is performed but represent a complex construct that also includes the strength and automaticity of the habitual behaviour. We report here the development and validation of a Daily Habit Scale (DHS) to assess the frequency, automaticity, and strength of daily habits in healthy individuals. Item reduction based on factor analysis resulted in a scale with 38 items grouped into eight factors explaining 52.91% of the variance. The DHS showed very good internal consistency (Cronbach alpha = 0.738) and test-retest reliability (Intraclass correlation coefficient = 0.892, p<0.001) as well as convergent and divergent reliability compared to other scales measuring habits. We found a significant effect of age, gender, anxiety, and depression on the DHS. Considering certain limitations of the DHS, such as not considering the context of performance of habits, and the absence of certain items, such as transportation use, the results of this study suggest that DHS is a reliable and valid measure of daily habits that can be used by both clinicians and researchers as a measure of daily habits.

Activation, but not inhibition, of the indirect pathway disrupts choice rejection in a freely moving, multiple-choice foraging task

The dorsomedial striatum (DMS) plays a key role in action selection, but less is known about how direct and indirect pathway spiny projection neurons (dSPNs and iSPNs, respectively) contribute to choice rejection in freely moving animals. Here, we use pathway-specific chemogenetic manipulation during a serial choice foraging task to test the role of dSPNs and iSPNs in learned choice rejection. We find that chemogenetic activation, but not inhibition, of iSPNs disrupts rejection of nonrewarded choices, contrary to predictions of a simple "select/suppress" heuristic. Our findings suggest that iSPNs' role in stopping and freezing does not extend in a simple fashion to choice rejection in an ethological, freely moving context. These data may provide insights critical for the successful design of interventions for addiction or other conditions in which it is desirable to strengthen choice rejection.

What Can Reinforcement Learning Models of Dopamine and Serotonin Tell Us about the Action of Antidepressants?

Although evidence suggests that antidepressants are effective at treating depression, the mechanisms behind antidepressant action remain unclear, especially at the cognitive/computational level. In recent years, reinforcement learning (RL) models have increasingly been used to characterise the roles of neurotransmitters and to probe the computations that might be altered in psychiatric disorders like depression. Hence, RL models might present an opportunity for us to better understand the computational mechanisms underlying antidepressant effects. Moreover, RL models may also help us shed light on how these computations may be implemented in the brain (e.g., in midbrain, striatal, and prefrontal regions) and how these neural mechanisms may be altered in depression and remediated by antidepressant treatments. In this paper, we evaluate the ability of RL models to help us understand the processes underlying antidepressant action. To do this, we review the preclinical literature on the roles of dopamine and serotonin in RL, draw links between these findings and clinical work investigating computations altered in depression, and appraise the evidence linking modification of RL processes to antidepressant function. Overall, while there is no shortage of promising ideas about the computational mechanisms underlying antidepressant effects, there is insufficient evidence directly implicating these mechanisms in the response of depressed patients to antidepressant treatment. Consequently, future studies should investigate these mechanisms in samples of depressed patients and assess whether modifications in RL processes mediate the clinical effect of antidepressant treatments.

Stress diminishes outcome but enhances response representations during instrumental learning

Stress may shift behavioural control from a goal-directed system that encodes action-outcome relationships to a habitual system that learns stimulus-response associations. Although this shift to habits is highly relevant for stress-related psychopathologies, limitations of existing behavioural paradigms hinder research from answering the fundamental question of whether the stress-induced bias to habits is due to reduced outcome processing or enhanced response processing at the time of stimulus presentation, or both. Here, we used EEG-based multivariate pattern analysis to decode neural outcome representations crucial for goal-directed control, as well as response representations during instrumental learning. We show that stress reduced outcome representations but enhanced response representations. Both were directly associated with a behavioural index of habitual responding. Furthermore, changes in outcome and response representations were uncorrelated, suggesting that these may reflect distinct processes. Our findings indicate that habitual behaviour under stress may be the result of both enhanced stimulus-response processing and diminished outcome processing.

Reward Responsiveness, Learning, and Valuation Implicated in Problematic Pornography Use — a Research Domain Criteria Perspective

Purpose of Review

Problematic pornography use (PPU) describes a pattern of behavior characterized by excessive time spent using or thinking about pornography and continued use despite negative consequences. To help advance the understanding of transdiagnostic underlying psychological and neurobiological mechanisms in PPU, we aim to review existing evidence on these mechanisms focusing on positive valence systems within the transdiagnostic Research Domain Criteria (RDoC) framework.

Recent Findings

Reward anticipation processes seem to be increased in individuals with PPU symptoms when they anticipate sexual stimuli compared with other rewards. Studies further suggest that the initial neural and attentional responses to sexual rewards compared with different control stimuli are also increased in individuals with PPU symptoms, as are conditioned responses in sexual reward learning paradigms. Sexual reward valuation studies point towards an increased neural value differentiation with increasing PPU symptoms.

Summary

The current state of evidence indicates that positive valence systems are altered in persons with PPU. This framework of organizing evidence may aid in elucidating PPU development and maintenance as well as planning future studies.

Fast and slow contributions to decision-making in corticostriatal circuits

We make complex decisions using both fast judgments and slower, more deliberative reasoning. For example, during value-based decision-making, animals make rapid value-guided orienting eye movements after stimulus presentation that bias the upcoming decision. The neural mechanisms underlying these processes remain unclear. To address this, we recorded from the caudate nucleus and orbitofrontal cortex while animals made value-guided decisions. Using population-level decoding, we found a rapid, phasic signal in caudate that predicted the choice response and closely aligned with animals' initial orienting eye movements. In contrast, the dynamics in orbitofrontal cortex were more consistent with a deliberative system serially representing the value of each available option. The phasic caudate value signal and the deliberative orbitofrontal value signal were largely independent from each other, consistent with value-guided orienting and value-guided decision-making being independent processes.

Model Sharing in the Human Medial Temporal Lobe

Effective planning involves knowing where different actions take us. However, natural environments are rich and complex, leading to an exponential increase in memory demand as a plan grows in depth. One potential solution is to filter out features of the environment irrelevant to the task at hand. This enables a shared model of transition dynamics to be used for planning over a range of different input features. Here, we asked human participants (13 male, 16 female) to perform a sequential decision-making task, designed so that knowledge should be integrated independently of the input features (visual cues) present in one case but not in another. Participants efficiently switched between using a low-dimensional (cue independent) and a high-dimensional (cue specific) representation of state transitions. fMRI data identified the medial temporal lobe as a locus for learning state transitions. Within this region, multivariate patterns of BOLD responses were less correlated between trials with differing input features but similar state associations in the high dimensional than in the low dimensional case, suggesting that these patterns switched between separable (specific to input features) and shared (invariant to input features) transition models. Finally, we show that transition models are updated more strongly following the receipt of positive compared with negative outcomes, a finding that challenges conventional theories of planning. Together, these findings propose a computational and neural account of how information relevant for planning can be shared and segmented in response to the vast array of contextual features we encounter in our world.SIGNIFICANCE STATEMENT Effective planning involves maintaining an accurate model of which actions take us to which locations. But in a world awash with information, mapping actions to states with the right level of complexity is critical. Using a new decision-making "heist task" in conjunction with computational modeling and fMRI, we show that patterns of BOLD responses in the medial temporal lobe-a brain region key for prospective planning-become less sensitive to the presence of visual features when these are irrelevant to the task at hand. By flexibly adapting the complexity of task-state representations in this way, state-action mappings learned under one set of features can be used to plan in the presence of others.

Gambling Environment Exposure Increases Temporal Discounting but Improves Model-Based Control in Regular Slot-Machine Gamblers

Gambling disorder is a behavioral addiction that negatively impacts personal finances, work, relationships and mental health. In this pre-registered study (https://osf.io/5ptz9/) we investigated the impact of real-life gambling environments on two computational markers of addiction, temporal discounting and model-based reinforcement learning. Gambling disorder is associated with increased temporal discounting and reduced model-based learning. Regular gamblers (n = 30, DSM-5 score range 3-9) performed both tasks in a neutral (café) and a gambling-related environment (slot-machine venue) in counterbalanced order. Data were modeled using drift diffusion models for temporal discounting and reinforcement learning via hierarchical Bayesian estimation. Replicating previous findings, gamblers discounted rewards more steeply in the gambling-related context. This effect was positively correlated with gambling related cognitive distortions (pre-registered analysis). In contrast to our pre-registered hypothesis, model-based reinforcement learning was improved in the gambling context. Here we show that temporal discounting and model-based reinforcement learning are modulated in opposite ways by real-life gambling cue exposure. Results challenge aspects of habit theories of addiction, and reveal that laboratory-based computational markers of psychopathology are under substantial contextual control.

Alterations of Dopamine Receptors and the Adaptive Changes of L-Type Calcium Channel Subtypes Regulate Cocaine-Seeking Habit in Tree Shrew

The putamen (Put) is necessary for habitual actions, while the nucleus caudate (Cd) is critical for goal-directed actions. However, compared with the natural reward (such as sucrose)-seeking habit, how drug-related dysfunction or imbalance between the Put and Cd is involved in cocaine-seeking habit, which is not easy to bias behavior to goal-directed actions, is absent. Therefore, in our present study, in comparison with sucrose-habitual behavior, we evaluated the distinctive changes of the two subtypes of dopamine (DA) receptors (D1R and D2R) in cocaine-seeking habitual behavior animals. Moreover, the adaptive changes of Ca_v1.2 and Ca_v1.3, as prime downstream targets of D1R and D2R respectively, were also assessed. Our results showed that a similar percentage of the animals exhibited habitual seeking behavior after cocaine or sucrose variable-interval self-administration (SA) training in tree shrews. In addition, compared with animals with non-habitual behavior, animals with cocaine habitual behavior showed higher D1Rs and Ca_v1.2 expression in the Put accompanied with lower D2Rs and Ca_v1.3 expression in the Cd. However, after sucrose SA training, animals with habitual behavior only showed lower membrane expression of D2R in the Put than animals with non-habitual behavior. These results suggested that the upregulation of D1Rs-Ca_v1.2 signaling may lead to hyper-excitability of the Put, and the inactivation of D2Rs-Ca_v1.3 signaling may result in depressed activity in the Cd. This imbalance function between the Put and Cd, which causes an inability to shift between habits and goal-directed actions, may underlie the compulsive addiction habit.

A spatiotemporal increase of neuronal activity accompanies the motivational effect of wheel running in mice

Spatiotemporal patterns of neuronal activity underlying the motivational effect of rotating running wheels (RWs) in rodents remain largely undetermined. Here, we investigated changes of neuronal activity among brain regions associated with motivation across different intensities of motivation for RWs in mice. Daily exposure to RWs gradually increased rotation number, then became stable after approximately 3 weeks. Immunohistochemical analyses revealed that the number of c-Fos (a neuronal activity marker)-positive cells increased in the medial prefrontal cortex (mPFC), core and shell of the nucleus accumbens (NAc), dorsal striatum (Str), and lateral septum (LS) at day 1, day 9, and days 20-24, in a time-dependent manner. Additionally, despite exposure to locked RWs for over 7 days after establishing stable rotation with 3-week RW access, increased c-Fos expression was still observed in most of these brain areas. Furthermore, daily overnight RW access developed stable rotation by day 6, with high and low rotation numbers at the start and end of the overnight session, respectively. The number of c-Fos-positive cells at the start of RW rotation was significantly higher than at the end of RW rotation in most brain regions. Furthermore, after establishing stable rotation, the number of c-Fos-positive cells increased in the mPFC and shell of the NAc of mice that only observed RWs. These findings suggest that the subareas of the mPFC and NAc may be critically involved in the motivational effects of RW rotations.

Divergent encoding of active avoidance behavior in corticostriatal and corticolimbic projections

Active avoidance behavior, in which an animal performs an action to avoid a stressor, is crucial for survival and may provide insight into avoidance behaviors seen in anxiety disorders. Active avoidance requires the dorsomedial prefrontal cortex (dmPFC), which is thought to regulate avoidance via downstream projections to the striatum and amygdala. However, the endogenous activity of dmPFC projections during active avoidance learning has never been recorded. Here we utilized fiber photometry to record from the dmPFC and its axonal projections to the dorsomedial striatum (DMS) and the basolateral amygdala (BLA) during active avoidance learning in both male and female mice. We examined neural activity during conditioned stimulus (CS) presentations and during clinically relevant behaviors such as active avoidance or cued freezing. Both prefrontal projections showed learning-related increases in activity during CS onset throughout active avoidance training. The dmPFC as a whole showed increased and decreased patterns of activity during avoidance and cued freezing, respectively. Finally, dmPFC-DMS and dmPFC-BLA projections show divergent encoding of active avoidance behavior, with the dmPFC-DMS projection showing increased activity and the dmPFC-BLA projection showing decreased activity during active avoidance. Our results demonstrate task-relevant encoding of active avoidance in projection-specific dmPFC subpopulations that play distinct but complementary roles in active avoidance learning.

What is neurorepresentationalism? From neural activity and predictive processing to multi-level representations and consciousness

This review provides an update on Neurorepresentationalism, a theoretical framework that defines conscious experience as multimodal, situational survey and explains its neural basis from brain systems constructing best-guess representations of sensations originating in our environment and body [1]. It posits that conscious experience is characterized by five essential hallmarks: (i) multimodal richness, (ii) situatedness and immersion, (iii) unity and integration, (iv) dynamics and stability, and (v) intentionality. Consciousness is furthermore proposed to have a biological function, framed by the contrast between reflexes and habits (not requiring consciousness) versus goal-directed, planned behavior (requiring multimodal, situational survey). Conscious experience is therefore understood as a sensorily rich, spatially encompassing representation of body and environment, while we nevertheless have the impression of experiencing external reality directly. Contributions to understanding neural mechanisms underlying consciousness are derived from models for predictive processing, which are trained in an unsupervised manner, do not necessarily require overt action, and have been extended to deep neural networks. Even with predictive processing in place, however, the question remains why this type of neural network activity would give rise to phenomenal experience. Here, I propose to tackle the Hard Problem with the concept of multi-level representations which emergently give rise to multimodal, spatially wide superinferences corresponding to phenomenal experiences. Finally, Neurorepresentationalism is compared to other neural theories of consciousness, and its implications for defining indicators of consciousness in animals, artificial intelligence devices and immobile or unresponsive patients with disorders of consciousness are discussed.

Common and Distinct Neural Patterns of Attention-Deficit/Hyperactivity Disorder and Borderline Personality Disorder: A Multimodal Functional and Structural Meta-analysis

BACKGROUND

Attention-deficit/hyperactivity disorder (ADHD) and borderline personality disorder (BPD) have partially overlapping symptom profiles and are highly comorbid in adults. However, whether the behavioral similarities correspond to shared neurobiological substrates is not known.

METHODS

An overlapping meta-analysis of 58 ADHD and 66 BPD whole-brain articles incorporating observations from 3401 adult patients and 3238 healthy participants was performed by seed-based d mapping. Brain maps were subjected to meta-analytic connectivity modeling and data-driven functional decoding analyses to identify associated neural circuit alterations and relations to behavioral dimensions.

RESULTS

Both groups exhibited hypoactivated abnormalities in the left inferior parietal lobule, and altered clusters of the bilateral superior temporal gyrus were disjunctive in ADHD and BPD. No overlapping structural abnormalities were found. Multimodal alterations of ADHD were located in the right putamen and of BPD in the left orbitofrontal cortex.

CONCLUSIONS

The transdiagnostic neural bases of ADHD and BPD in temporoparietal circuitry may underlie overlapping problems of behavioral control, while disorder-specific substrates in frontostriatal circuitry may account for their distinguishing features in motor and emotion domains, respectively.

Acute cannabinoids impair association learning via selectively enhancing synaptic transmission in striatonigral neurons

Background

Cannabinoids and their derivatives attract strong interest due to the tremendous potential of their psychoactive effects for treating psychiatric disorders and symptoms. However, their clinical application is restricted by various side-effects such as impaired coordination, anxiety, and learning and memory disability. Adverse impact on dorsal striatum-dependent learning is an important side-effect of cannabinoids. As one of the most important forms of learning mediated by the dorsal striatum, reinforcement learning is characterized by an initial association learning phase, followed by habit learning. While the effects of cannabinoids on habit learning have been well-studied, little is known about how cannabinoids influence the initial phase of reinforcement learning.

Results

We found that acute activation of cannabinoid receptor type 1 (CB1R) by the synthetic cannabinoid HU210 induced dose-dependent impairment of association learning, which could be alleviated by intra-dorsomedial striatum (DMS) injection of CB1R antagonist. Moreover, acute exposure to HU210 elicited enhanced synaptic transmission in striatonigral “direct” pathway medium spiny neurons (MSNs) but not indirect pathway neurons in DMS. Intriguingly, enhancement of synaptic transmission that is also observed after learning was abolished by HU210, indicating cannabinoid system might disrupt reinforcement learning by confounding synaptic plasticity normally required for learning. Remarkably, the impaired response-reinforcer learning was also induced by selectively enhancing the D1-MSN (MSN that selectively expresses the dopamine receptor type 1) activity by virally expressing excitatory hM3Dq DREADD (designer receptor exclusively activated by a designer drug), which could be rescued by specifically silencing the D1-MSN activity via hM4Di DREADD.

Conclusion

Our findings demonstrate dose-dependent deleterious effects of cannabinoids on association learning by disrupting plasticity change required for learning associated with the striatal direct pathway, which furthers our understanding of the side-effects of cannabinoids and the underlying mechanisms.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12915-022-01307-1.

Alcohol dependence decreases functional activation of the caudate nucleus during model-based decision processes

BACKGROUND

Impaired decision making, a key characteristic of alcohol dependence (AD), manifests in continuous alcohol consumption despite severe negative consequences. The neural basis of this impairment in individuals with AD and differences with known neural decision mechanisms among healthy subjects are not fully understood. In particular, it is unclear whether the choice behavior among individuals with AD is based on a general impairment of decision mechanisms or is mainly explained by altered value attribution, with an overly high subjective value attributed to alcohol-related stimuli.

METHODS

Here, we use a functional magnetic resonance imaging (fMRI) monetary reward task to compare the neural processes of model-based decision making and value computation between AD individuals (n = 32) and healthy controls (n = 32). During fMRI, participants evaluated monetary offers with respect to dynamically changing constraints and different levels of uncertainty.

RESULTS

Individuals with AD showed lower activation associated with model-based decision processes in the caudate nucleus than controls, but there were no group differences in value-related neural activity or task performance.

CONCLUSIONS

Our findings highlight the role of the caudate nucleus in impaired model-based decisions of alcohol-dependent individuals.

Impact of putamen inhibition by DREADDs on schedule-induced drinking in rhesus monkeys

The putamen is a nucleus within the sensory-motor striatal network that is involved in automatic, habitual actions. Schedule-induced polydipsia (SIP) is highly automated behavior, reliably occurring under intermediate interval schedules of reinforcement. The effect of putamen inhibition in mediating SIP of water and ethanol (4% w/v) under a Fixed Time 5-min (FT-5 min) schedule for food delivery was tested in 12 rhesus monkeys (6 male, 6 female). Water and ethanol SIP sessions ended after set volumes were consumed. Baseline patterns of SIP intake differed between water and ethanol SIP in volume but not in pattern of drinking. Activation of the designer receptor exclusively activated by designer drug (DREADD: hM4Di) with deschloroclozapine (DCZ; 300 μg/kg, i.m.) administered 30 min prior to the onset of the SIP session, for four consecutive sessions. DCZ administration increased the postpellet drink volume and reduced the time to drink both water and ethanol. Although the effect of DCZ treatment was similar for increasing SIP with either water or ethanol, post-DCZ return to baseline SIP rates of differed, perhaps highlighting the effect of a state dependency with ethanol SIP. Overall, the study shows that targeting the putamen with the inhibitory DREADD produces a reversible, reproducible and reliable increase in adjunctive drinking.

The Neural Bases of Action-Outcome Learning in Humans

From an associative perspective the acquisition of new goal-directed actions requires the encoding of specific action-outcome (AO) associations and, therefore, sensitivity to the validity of an action as a predictor of a specific outcome relative to other events. Although competitive architectures have been proposed within associative learning theory to achieve this kind of identity-based selection, whether and how these architectures are implemented by the brain is still a matter of conjecture. To investigate this issue, we trained human participants to encode various AO associations while undergoing functional neuroimaging (fMRI). We then degraded one AO contingency by increasing the probability of the outcome in the absence of its associated action while keeping other AO contingencies intact. We found that this treatment selectively reduced performance of the degraded action. Furthermore, when a signal predicted the unpaired outcome, performance of the action was restored, suggesting that the degradation effect reflects competition between the action and the context for prediction of the specific outcome. We used a Kalman filter to model the contribution of different causal variables to AO learning and found that activity in the medial prefrontal cortex (mPFC) and the dorsal anterior cingulate cortex (dACC) tracked changes in the association of the action and context, respectively, with regard to the specific outcome. Furthermore, we found the mPFC participated in a network with the striatum and posterior parietal cortex to segregate the influence of the various competing predictors to establish specific AO associations.SIGNIFICANCE STATEMENT Humans and other animals learn the consequences of their actions, allowing them to control their environment in a goal-directed manner. Nevertheless, it is unknown how we parse environmental causes from the effects of our own actions to establish these specific action-outcome (AO) relationships. Here, we show that the brain learns the causal structure of the environment by segregating the unique influence of actions from other causes in the medial prefrontal and anterior cingulate cortices and, through a network of structures, including the caudate nucleus and posterior parietal cortex, establishes the distinct causal relationships from which specific AO associations are formed.

Cell adhesion presence during adolescence controls the architecture of projection-defined prefrontal cortical neurons and reward-related action strategies later in life

Adolescent brain development is characterized by neuronal remodeling in the prefrontal cortex; relationships with behavior are largely undefined. Integrins are cell adhesion factors that link the extracellular matrix with intracellular actin cytoskeleton. We find that β1-integrin presence in the prelimbic prefrontal cortex (PL) during adolescence, but not adulthood, is necessary for mice to select actions based on reward likelihood and value. As such, adult mice that lacked β1-integrin during adolescence failed to modify response strategies when rewards lost value or failed to be delivered. This pattern suggests that β1-integrin-mediated neuronal development is necessary for PL function in adulthood. We next visualized adolescent PL neurons, including those receiving input from the basolateral amygdala (BLA) - thought to signal salience - and projecting to the dorsomedial striatum (DMS) - the striatal output by which the PL controls goal-seeking behavior. Firstly, we found that these projection-defined neurons had a distinct morphology relative to general layer V PL neurons. Secondly, β1-integrin loss triggered the overexpression of stubby-type dendritic spines at the expense of mature spines, including on projection-defined neurons. This phenotype was not observed when β1-integrins were silenced before or after adolescence. Altogether, our experiments localize β1-integrin-mediated cell adhesion within a developing di-synaptic circuit coordinating adaptive action.

Behavioral Engagement With Playable Objects Resolves Stress-Induced Adaptive Changes by Reshaping the Reward System

BACKGROUND

The reward system regulates motivated behavior, and repeated practice of specific motivated behavior might conversely modify the reward system. However, the detailed mechanisms by which they reciprocally regulate each other are not clearly understood.

METHODS

Mice subjected to chronic restraint stress show long-lasting depressive-like behavior, which is rescued by continual engagement with playable objects. A series of molecular, pharmacological, genetic, and behavioral analyses, combined with microarray, liquid chromatography, and chemogenetic tools, are used to investigate the neural mechanisms of antidepressive effects of playable objects.

RESULTS

Here, we show that repeated restraint induces dopamine surges into the nucleus accumbens-lateral shell (NAc-lSh), which cause upregulation of the neuropeptide PACAP in the NAc-lSh. As repeated stress is continued, the dopamine surge by stressors is adaptively suppressed without restoring PACAP upregulation, and the resulting enhanced PACAP inputs from NAc-lSh neurons to the ventral pallidum facilitate depressive-like behaviors. Continual engagement with playable objects in mice subjected to chronic stress remediates reduced dopamine response to new stressors, enhanced PACAP upregulation, and depressive-like behaviors. Overactivation of dopamine D₁ receptors over the action of D₂ receptors in the NAc-lSh promotes depressive-like behaviors. Conversely, inhibition of D₁ receptors or PACAP upregulation in the NAc-lSh confers resilience to chronic stress-induced depressive-like behaviors. Histochemical and chemogenetic analyses reveal that engagement with playable objects produces antidepressive effects by reshaping the ventral tegmental area-to-NAc-lSh and NAc-lSh-to-ventral pallidum circuits.

CONCLUSIONS

These results suggest that behavioral engagement with playable objects remediates depressive-like behaviors by resolving stress-induced maladaptive changes in the reward system.

Portable Neuroimaging-Guided Noninvasive Brain Stimulation of the Cortico-Cerebello-Thalamo-Cortical Loop—Hypothesis and Theory in Cannabis Use Disorder

Background: Maladaptive neuroplasticity-related learned response in substance use disorder (SUD) can be ameliorated using noninvasive brain stimulation (NIBS); however, inter-individual variability needs to be addressed for clinical translation. Objective: Our first objective was to develop a hypothesis for NIBS for learned response in SUD based on a competing neurobehavioral decision systems model. The next objective was to develop the theory by conducting a computational simulation of NIBS of the cortico-cerebello-thalamo-cortical (CCTC) loop in cannabis use disorder (CUD)-related dysfunctional “cue-reactivity”—a construct closely related to “craving”—that is a core symptom. Our third objective was to test the feasibility of a neuroimaging-guided rational NIBS approach in healthy humans. Methods: “Cue-reactivity” can be measured using behavioral paradigms and portable neuroimaging, including functional near-infrared spectroscopy (fNIRS) and electroencephalogram (EEG) metrics of sensorimotor gating. Therefore, we conducted a computational simulation of NIBS, including transcranial direct current stimulation (tDCS) and transcranial alternating current stimulation (tACS) of the cerebellar cortex and deep cerebellar nuclei (DCN) of the CCTC loop for its postulated effects on fNIRS and EEG metrics. We also developed a rational neuroimaging-guided NIBS approach for the cerebellar lobule (VII) and prefrontal cortex based on a healthy human study. Results: Simulation of cerebellar tDCS induced gamma oscillations in the cerebral cortex, while transcranial temporal interference stimulation induced a gamma-to-beta frequency shift. A preliminary healthy human study (N = 10) found that 2 mA cerebellar tDCS evoked similar oxyhemoglobin (HbO) response in the range of 5 × 10⁻⁶ M across the cerebellum and PFC brain regions (α = 0.01); however, infra-slow (0.01–0.10 Hz) prefrontal cortex HbO-driven phase–amplitude-coupled (PAC; 4 Hz, ±2 mA (max)) cerebellar tACS evoked HbO levels in the range of 10⁻⁷ M that were statistically different (α = 0.01) across these brain regions. Conclusion: Our healthy human study showed the feasibility of fNIRS of cerebellum and PFC and closed-loop fNIRS-driven ctACS at 4 Hz, which may facilitate cerebellar cognitive function via the frontoparietal network. Future work needs to combine fNIRS with EEG for multi-modal imaging for closed-loop NIBS during operant conditioning.

Effects of selective orexin receptor-2 and cannabinoid receptor-1 antagonists on the response of medial prefrontal cortex neurons to tramadol

Tramadol is widely used to control pain in various diseases, but the relevant mechanisms are less known despite the severe risks of abuse. The medial prefrontal cortex (mPFC) is one of the critical centers of the reward system. Studies have shown that orexins and endocannabinoids are likely to play an important role in addiction. In this study, the effect of orexin receptor-2 (OX2R) and endocannabinoid receptor-1 (CB1R) blockade on the neuronal activity of mPFC was investigated in response to tramadol in male rats. Tramadol was injected intraperitoneally, and its effects on the firing of mPFC pyramidal neurons were investigated using in vivo extracellular single-unit recording. Tramadol affected the pyramidal neuronal activity of the mPFC. AM251 (18 nmol/4 μl), as a selective CB1R antagonist, and TCS-OX2-29 (50 nmol/4 μl), as a selective OX2R antagonist, individually or simultaneously were microinjected into the lateral ventricle of the brain (intracerebroventricular, ICV). The results showed that the ratio of neurons with the excitatory/inhibitory or no responses was significantly changed by tramadol (p < .05). These changes were prevented by blockade of CB1Rs alone or blockade of OX2Rs and CB1Rs simultaneously (p < .05). However, blockade of these receptors in the vehicle group had no significant effect on neuronal activity. The findings of this study indicate the potential role of orexin and endocannabinoid systems in mediating the effects of tramadol in mPFC and the possible interaction between the two systems via OX2 and CB1 receptors. However, further studies are needed to identify these effects by examining intracellular signaling.

Striatum expresses region-specific plasticity consistent with distinct memory abilities

The striatum mediates two learning modalities: goal-directed behavior in dorsomedial (DMS) and habits in dorsolateral (DLS) striata. The synaptic bases of these learnings are still elusive. Indeed, while ample research has described DLS plasticity, little remains known about DMS plasticity and its involvement in procedural learning. Here, we find symmetric and asymmetric anti-Hebbian spike-timing-dependent plasticity (STDP) in DMS and DLS, respectively, with opposite plasticity dominance upon increasing corticostriatal activity. During motor-skill learning, plasticity is engaged in DMS and striatonigral DLS neurons only during early learning stages, whereas striatopallidal DLS neurons are mobilized only during late phases. With a mathematical modeling approach, we find that symmetric anti-Hebbian STDP favors memory flexibility, while asymmetric anti-Hebbian STDP favors memory maintenance, consistent with memory processes at play in procedural learning.

Mechanisms of memory under stress

It is well established that stress has a major impact on memory, driven by the concerted action of various stress mediators on the brain. Recent years, however, have seen considerable advances in our understanding of the cellular, neural network, and cognitive mechanisms through which stress alters memory. These novel insights highlight the intricate interplay of multiple stress mediators, including-beyond corticosteroids, catecholamines, and peptides-for instance, endocannabinoids, which results in time-dependent shifts in large-scale neural networks. Such stress-induced network shifts enable highly specific memories of the stressful experience in the long run at the cost of transient impairments in mnemonic flexibility during and shortly after a stressful event. Based on these recent discoveries, we provide a new integrative framework that links the cellular, systems, and cognitive mechanisms underlying acute stress effects on memory processes and points to potential targets for treating aberrant memory in stress-related mental disorders.

Animal models of action control and cognitive dysfunction in Parkinson's disease

Parkinson's disease (PD) has historically been considered a motor disorder induced by a loss of dopaminergic neurons in the substantia nigra pars compacta. More recently, it has been recognized to have significant non-motor symptoms, most prominently cognitive symptoms associated with a dysexecutive syndrome. It is common in the literature to see motor and cognitive symptoms treated separately and, indeed, there has been a general call for specialized treatment of the latter, particularly in the more severe cases of PD with mild cognitive impairment and dementia. Animal studies have similarly been developed to model the motor or non-motor symptoms. Nevertheless, considerable research has established that segregating consideration of cognition from the precursors to motor movement, particularly movement associated with goal-directed action, is difficult if not impossible. Indeed, on some contemporary views cognition is embodied in action control, something that is particularly prevalent in theory and evidence relating to the integration of goal-directed and habitual control processes. The current paper addresses these issues within the literature detailing animal models of cognitive dysfunction in PD and their neural and neurochemical bases. Generally, studies using animal models of PD provide some of the clearest evidence for the integration of these action control processes at multiple levels of analysis and imply that consideration of this integrative process may have significant benefits for developing new approaches to the treatment of PD.

Structure-function coupling within the reward network in preschool children predicts executive functioning in later childhood

Early differences in reward behavior have been linked to executive functioning development. The nucleus accumbens (NAc) and orbitofrontal cortex (OFC) are activated by reward-related tasks and identified as key nodes of the brain circuit that underlie reward processing. We aimed to investigate the relation between NAc-OFC structural and functional connectivity in preschool children, as well as associations with future reward sensitivity and executive function. We showed that NAc-OFC structural and functional connectivity were not significantly associated in preschool children, but both independently predicted sensitivity to reward in males in a left-lateralized manner. Moreover, significant NAc-OFC structure-function coupling was only found in individuals who performed poorly on executive function tasks in later childhood, but not in the middle- and high-performing groups. As structure-function coupling is proposed to measure functional specialization, this finding suggests premature functional specialization within the reward network, which may impede dynamic communication with other regions, affects executive function development. Our study also highlights the utility of multimodal imaging data integration when studying the effects of reward network functional flexibility in the preschool age, a critical period in brain and executive function development.

•

Functional connectivity is not tethered to structural connectivity in preschool age.

•

Higher degree of SC-FC coupling reflects lower plasticity in early childhood.

•

Gender differences in reward sensitivity were present as early as in preschool age.

•

Early reward network SC-FC coupling affects later executive function.

From Biological Synapses to “Intelligent” Robots

This selective review explores biologically inspired learning as a model for intelligent robot control and sensing technology on the basis of specific examples. Hebbian synaptic learning is discussed as a functionally relevant model for machine learning and intelligence, as explained on the basis of examples from the highly plastic biological neural networks of invertebrates and vertebrates. Its potential for adaptive learning and control without supervision, the generation of functional complexity, and control architectures based on self-organization is brought forward. Learning without prior knowledge based on excitatory and inhibitory neural mechanisms accounts for the process through which survival-relevant or task-relevant representations are either reinforced or suppressed. The basic mechanisms of unsupervised biological learning drive synaptic plasticity and adaptation for behavioral success in living brains with different levels of complexity. The insights collected here point toward the Hebbian model as a choice solution for “intelligent” robotics and sensor systems.

Leveraging Factors of Self-Efficacy and Motivation to Optimize Stroke Recovery

The International Classification of Functioning, Disability and Health framework recognizes that an individual's functioning post-stroke reflects an interaction between their health condition and contextual factors encompassing personal and environmental factors. Personal factors significantly impact rehabilitation outcomes as they determine how an individual evaluates their situation and copes with their condition in daily life. A key personal factor is self-efficacy-an individual's belief in their capacity to achieve certain outcomes. Self-efficacy influences an individual's motivational state to execute behaviors necessary for achieving desired rehabilitation outcomes. Stroke rehabilitation practice and research now acknowledge self-efficacy and motivation as critical elements in post-stroke recovery, and increasing evidence highlights their contributions to motor (re)learning. Given the informative value of neuroimaging-based biomarkers in stroke, elucidating the neurological underpinnings of self-efficacy and motivation may optimize post-stroke recovery. In this review, we examine the role of self-efficacy and motivation in stroke rehabilitation and recovery, identify potential neural substrates underlying these factors from current neuroimaging literature, and discuss how leveraging these factors and their associated neural substrates has the potential to advance the field of stroke rehabilitation.

As soon as there was life, there was danger: the deep history of survival behaviours and the shallower history of consciousness

It is often said that fear is a universal innate emotion that we humans have inherited from our mammalian ancestors by virtue of having inherited conserved features of their nervous systems. Contrary to this common sense-based scientific point of view, I have argued that what we have inherited from our mammalian ancestors, and they from their distal vertebrate ancestors, and they from their chordate ancestors, and so forth, is not a fear circuit. It is, instead, a defensive survival circuit that detects threats, and in response, initiates defensive survival behaviours and supporting physiological adjustments. Seen in this light, the defensive survival circuits of humans and other mammals can be conceptualized as manifestations of an ancient survival function-the ability to detect danger and respond to it-that may in fact predate animals and their nervous systems, and perhaps may go back to the beginning of life. Fear, on the other hand, from my perspective, is a product of cortical cognitive circuits. This conception is not just of academic interest. It also has practical implications, offering clues as to why efforts to treat problems related to fear and anxiety are not more effective, and what might make them better. This article is part of the theme issue 'Systems neuroscience through the lens of evolutionary theory'.