Medial orbitofrontal cortex dopamine D(1)/D(2) receptors differentially modulate distinct forms of probabilistic decision-making

Perturbations in risk/reward decision making and frontal cortical catecholamine regulation induced by mild traumatic brain injury

Mild traumatic brain injury (mTBI) disrupts cognitive processes that influence risk taking behavior. Little is known regarding the effects of repetitive mild injury (rmTBI) or whether these outcomes are sex specific. Risk/reward decision making is mediated by the prefrontal cortex (PFC), which is densely innervated by catecholaminergic fibers. Aberrant PFC catecholamine activity has been documented following TBI and may underlie TBI-induced risky behavior. The present study characterized the effects of rmTBI on risk/reward decision making behavior and catecholamine transmitter regulatory proteins within the PFC. Rats were exposed to sham, single (smTBI), or three closed-head controlled cortical impact (CH-CCI) injuries and assessed for injury-induced effects on risk/reward decision making using a probabilistic discounting task (PDT). In the first week post-final surgery, mTBI increased risky choice preference. By the fourth week, males exhibited increased latencies to make risky choices following rmTBI, demonstrating a delayed effect on processing speed. When levels of tyrosine hydroxylase (TH) and the norepinephrine reuptake transporter (NET) were measured within subregions of the PFC, females exhibited dramatic increases of TH levels within the orbitofrontal cortex (OFC) following smTBI. However, both males and females demonstrated reduced levels of OFC NET following rmTBI. These results indicate the OFC is susceptible to catecholamine instability after rmTBI and suggests that not all areas of the PFC contribute equally to TBI-induced imbalances. Overall, the CH-CCI model of rmTBI has revealed time-dependent and sex-specific changes in risk/reward decision making and catecholamine regulation following repetitive mild head injuries.

Reward Circuit Local Field Potential Modulations Precede Risk Taking

Risk taking behavior is a symptom of multiple neuropsychiatric disorders and often lacks effective treatments. Reward circuitry regions including the amygdala, orbitofrontal cortex, insula, and anterior cingulate have been implicated in risk-taking by neuroimaging studies. Electrophysiological activity associated with risk taking in these regions is not well understood in humans. Further characterizing the neural signalling that underlies risk-taking may provide therapeutic insight into disorders associated with risk-taking. Eleven patients with pharmacoresistant epilepsy who underwent stereotactic electroencephalography with electrodes in the amygdala, orbitofrontal cortex, insula, and/or anterior cingulate participated. Patients participated in a gambling task where they wagered on a visible playing card being higher than a hidden card, betting $5 or $20 on this outcome, while local field potentials were recorded from implanted electrodes. We used cluster-based permutation testing to identify reward prediction error signals by comparing oscillatory power following unexpected and expected rewards. We also used cluster-based permutation testing to compare power preceding high and low bets in high-risk (<50% chance of winning) trials and two-way ANOVA with bet and risk level to identify signals associated with risky, risk averse, and optimized decisions. We used linear mixed effects models to evaluate the relationship between reward prediction error and risky decision signals across trials, and a linear regression model for associations between risky decision signal power and Barratt Impulsiveness Scale scores for each patient. Reward prediction error signals were identified in the amygdala (p=0.0066), anterior cingulate (p=0.0092), and orbitofrontal cortex (p=6.0E-4, p=4.0E-4). Risky decisions were predicted by increased oscillatory power in high-gamma frequency range during card presentation in the orbitofrontal cortex (p=0.0022), and by increased power following bet cue presentation across the theta-to-beta range in the orbitofrontal cortex ( p =0.0022), high-gamma in the anterior cingulate ( p =0.0004), and high-gamma in the insula ( p =0.0014). Risk averse decisions were predicted by decreased orbitofrontal cortex gamma power ( p =2.0E-4). Optimized decisions that maximized earnings were preceded by decreases within the theta to beta range in orbitofrontal cortex ( p =2.0E-4), broad frequencies in amygdala ( p =2.0E-4), and theta to low-gamma in insula ( p =4.0E-4). Insula risky decision power was associated with orbitofrontal cortex high-gamma reward prediction error signal ( p =0.0048) and with patient impulsivity ( p =0.00478). Our findings identify and help characterize reward circuitry activity predictive of risk-taking in humans. These findings may serve as potential biomarkers to inform the development of novel treatment strategies such as closed loop neuromodulation for disorders of risk taking.

Clinical and neuroimaging predictors of benzodiazepine response in catatonia: A machine learning approach

Catatonia is a well characterized psychomotor syndrome combining motor, behavioural and neurovegetative signs. Benzodiazepines are the first-choice treatment, effective in 70 % of cases. Currently, the factors associated with benzodiazepine resistance remain unknown. We aimed to develop machine learning models using clinical and neuroimaging data to predict benzodiazepine response in catatonic patients. This study examined a cohort of catatonic patients who underwent standardized clinical evaluation, 3 T brain MRI, and benzodiazepine trial. Based on clinical response, patients were classified as benzodiazepine responders or non-responders. Cortical thickness and regional brain volumes were measured. Two machine learning models (linear model and gradient boosting tree model) were developed to identify predictors of treatment response using clinical, demographic, and neuroimaging data. The cohort included 65 catatonic patients, comprising 30 benzodiazepine responders and 35 non-responders. Using clinical data alone, the linear model achieved 63% precision, 51% recall, a specificity of 61%, and 58% AUC, while the gradient boosting tree (GBT) model attained 46% precision, 60% recall, a specificity of 62% and 64% AUC. Incorporating neuroimaging data improved model performance, with the linear model achieving 66% precision, 57% recall, a specificity of 67%, and 70% AUC, and the GBT model attaining 50% precision, 50% recall, a specificity of 62% and 70% AUC. The integration of imaging data with demographic and clinical information significantly enhanced the predictive performance of the models. The duration of the catatonic syndrome, along with the presence of mitgehen (passive obedience) and immobility/stupor, and the volume of the right medial orbito-frontal cortex emerged as important factors in predicting non-response to benzodiazepines.

Characterization of dopaminergic projections from the ventral tegmental area and the dorsal raphe nucleus to the orbital frontal cortex

The orbitofrontal cortex (OFC) is a key node in the cortico-limbic-striatal circuitry that influences decision-making guided by the relative value of outcomes. Midbrain dopamine from either the ventral tegmental area (VTA) or the dorsal raphe nucleus (DRN) has the potential to modulate OFC neurons; however, it is unknown at what concentrations these terminals release dopamine. Male and female adult dopamine transporter (DAT)IRES-Cre-tdTomato mice were injected with AAV2/8-EF1a-DIO-eYFP into either the DRN or the VTA or the retrograde label cholera toxin B (CTB) 488 in the medial or lateral OFC. We quantified co-expression of CTB 488 or enhanced yellow fluorescent protein (eYFP) with tdTomato fluorescence in VTA or DRN and eYFP fibre density in the medial or lateral OFC. Both VTA and DRN dopamine neurons project to either the medial OFC or the lateral OFC, with greater expression of fibres in the medial OFC. Using fast-scan cyclic voltammetry, we detected optogenetically evoked dopamine from channelrhodopsin 2 (ChR2)-expressing VTA or DRN dopamine terminals in either the medial OFC or the lateral OFC. We assessed if optical stimulation of dopamine from the VTA or the DRN onto the medial OFC could alter layer V pyramidal neuronal firing; however, we did not observe a change in firing at stimulation parameters that evoked dopamine release from either projection even though bath application of dopamine with the monoamine transporter inhibitor, nomifensine, decreased firing. In summary, dopaminergic neurons from the VTA or the DRN project to the OFC and release submicromolar dopamine in the medial and lateral OFC.

Pharmacological modulation of dopamine D1 and D2 receptors reveals distinct neural networks related to probabilistic learning in non-human primates

The neurotransmitter dopamine (DA) has a multifaceted role in healthy and disordered brains through its action on multiple subtypes of dopaminergic receptors. How modulation of these receptors controls behavior by altering connectivity across intrinsic brain-wide networks remains elusive. Here we performed parallel behavioral and resting-state functional MRI experiments after administration of two different DA receptor antagonists in macaque monkeys. Systemic administration of SCH-23390 (D1 antagonist) disrupted probabilistic learning when subjects had to learn new stimulus-reward associations and diminished functional connectivity (FC) in cortico-cortical and fronto-striatal connections. By contrast, haloperidol (D2 antagonist) improved learning and broadly enhanced FC in cortical connections. Further comparison between the effect of SCH-23390/haloperidol on behavioral and resting-state FC revealed specific cortical and subcortical networks associated with the cognitive and motivational effects of DA, respectively. Thus, we reveal the distinct brain-wide networks that are associated with the dopaminergic control of learning and motivation via DA receptors.

The Role of a Dopamine-Dependent Limbic-Motor Network in Sensory Motor Processing in Parkinson Disease

Limbic and motor integration is enabled by a mesial temporal to motor cortex network. Parkinson disease (PD) is characterized by a loss of dorsal striatal dopamine but relative preservation of mesolimbic dopamine early in disease, along with changes to motor action control. Here, we studied 47 patients with PD using the Simon conflict task and [18F]fallypride PET imaging. Additionally, a cohort of 16 patients participated in a single-blinded dextroamphetamine (dAMPH) study. Task performance was evaluated using the diffusion model for conflict tasks, which allows for an assessment of interpretable action control processes. First, a voxel-wise examination disclosed a negative relationship, such that longer non-decision time is associated with reduced D2-like binding potential (BPND) in the bilateral putamen, left globus pallidus, and right insula. Second, an ROI analysis revealed a positive relationship, such that shorter non-decision time is associated with reduced D2-like BPND in the amygdala and ventromedial OFC. The difference in non-decision time between off-dAMPH and on-dAMPH trials was positively associated with D2-like BPND in the globus pallidus. These findings support the idea that dysfunction of the traditional striatal-motor loop underlies action control deficits but also suggest that a compensatory parallel limbic-motor loop regulates motor output.

Neurosteroids and the mesocorticolimbic system

The mesocorticolimbic system coordinates executive functions, such as working memory and behavioral flexibility. This circuit includes dopaminergic projections from the ventral tegmental area to the nucleus accumbens and medial prefrontal cortex. In this review, we summarize evidence that cells in multiple nodes of the mesocorticolimbic system produce neurosteroids (steroids synthesized in the nervous system) and express steroid receptors. Here, we focus on neuroandrogens (androgens synthesized in the nervous system), neuroestrogens (estrogens synthesized in the nervous system), and androgen and estrogen receptors. We also summarize how (neuro)androgens and (neuro)estrogens affect dopamine signaling in the mesocorticolimbic system and regulate executive functions. Taken together, the data suggest that steroids produced in the gonads and locally in the brain modulate higher-order cognition and executive functions.

Development of cross-species translational paradigms for psychiatric research in the Research Domain Criteria era

The past 30 years of IBNS has included research attempting to treat the cognitive and behavioral deficits observed in people with psychiatric conditions. Early work utilized drugs identified from tests thought to be cognition-relevant, however the high failure rate crossing the translational-species barrier led to focus on developing valid cross-species translational tests. The face, predictive, and neurobiological validities used to assess animal models of psychiatry can be used to validate these tests. Clinical sensitivity is another important aspect however, for if the clinical population targeted for treatment does not exhibit task deficits, then why develop treatments? This review covers some work validating cross-species translational tests and suggests future directions. Also covered is the contribution IBNS made to fostering such research and my role in IBNS, making it more available to all including fostering mentor/mentee programs plus spearheading diversity and inclusivity initiatives. All science needs support and IBNS has supported research recreating the behavioral abnormalities that define psychiatric conditions with the aim to improve the lives of people with such conditions.

Medial orbitofrontal cortical regulation of different aspects of Pavlovian and instrumental reward seeking

RATIONALE

The medial subregion of the orbitofrontal cortex (mOFC) is thought to play an important role representing the expected outcome of a given course of action, as lesioning or inactivating this cortical region results in the adoption of choice strategies based more on observable (rather than previously learned) information. Despite this, its role in mediating basic associative learning remains to be fully clarified.

OBJECTIVE

The present series of experiments examined the role of the mOFC in (1) Pavlovian conditioned approach, (2) conditioned reinforcement, (3) extinction, and (4) cue-induced reinstatement of food-seeking behavior.

METHODS

Separate cohorts of rats went through Pavlovian or instrumental training. Intra-mOFC infusions of either saline or GABA agonists (to temporarily inactivate neural activity) were given prior to Pavlovian approach, conditioned reinforcement, first or second day of instrumental extinction training, or cue-induced reinstatement test days.

RESULTS

mOFC inactivation increased lever-CS contacts in Pavlovian conditioned approach and (2) had no effect on conditioned reinforcement. These manipulations (3) accelerated within-session instrumental extinction during the initial extinction session, but impaired subsequent extinction learning on drug-free days. (4) mOFC inactivation induced differential effects on reinstatement that depended on baseline performance. mOFC inactivation abolished reinstatement in "Reinstater" rats (who displayed robust responding under control conditions) and robustly increased reinstatement in "Non-Reinstater" rats (who showed little reinstatement under control conditions) suggesting that individual differences in reinstatement may be supported by differences in mOFC mediated representations of expected outcomes.

CONCLUSIONS

These findings have important implications for understanding how the mOFC uses stimulus-outcome and action-outcome expectancies to guide behavior, and how dysfunction within this region may contribute to pathological patterns of reward seeking.

The medial orbitofrontal cortex governs reward-related circuits in an age-dependent manner

Nucleus accumbens (NAc) neurons integrate excitatory inputs from cortical and limbic structures, contributing to critical cognitive functions, including decision-making. As these afferents mature from adolescence through adulthood, incoming signals to the NAc may summate differently between age groups. Decision-making evaluates both reward and risk before action selection, suggesting an interplay between reward- and risk-related circuits. Medial orbitofrontal cortex (MO)-NAc circuits permit risk assessment behaviors and likely underlie risk information incorporation. As adolescents make reward-centric choices regardless of risk, we hypothesized the impact of MO activity alters reward-related NAc circuits in an age-dependent manner. To test this hypothesis, we used single-unit electrophysiology to measure MO train stimulation's effect on reward-related pathways, specifically the basolateral amygdala (BLA)-NAc circuit, in adult and adolescent rats. MO train stimulation altered the strength but not the timing of BLA-NAc interactions in a frequency-dependent manner. In adults, MO train stimulation produced a frequency-dependent, bidirectional effect on BLA-evoked NAc AP probability. Contrastingly, MO train stimulation uniformly attenuated BLA-NAc interactions in adolescents. While the mature MO can govern reward-related circuits in an activity-dependent manner, perhaps to adapt to positive or negative decision-making outcomes, the adolescent MO may be less able to bidirectionally impact reward-related pathways resulting in biased decision-making.

Medial orbitofrontal neurotrophin systems integrate hippocampal input into outcome-specific value representations

In everyday life, we mentally represent possible consequences of our behaviors and integrate specific outcome values into existing knowledge to inform decisions. The medial orbitofrontal cortex (MO) is necessary to adapt behaviors when outcomes are not immediately available-when they and their values need to be envisioned. Nevertheless, neurobiological mechanisms remain unclear. We find that the neuroplasticity-associated neurotrophin receptor tropomyosin receptor kinase B (TrkB) is necessary for mice to integrate outcome-specific value information into choice behavior. This function appears attributable to memory updating (and not retrieval) and the stabilization of dendritic spines on excitatory MO neurons, which led us to investigate inputs to the MO. Ventral hippocampal (vHC)-to-MO projections appear conditionally necessary for value updating, involved in long-term aversion-based value memory updating. Furthermore, vHC-MO-mediated control of choice is TrkB dependent. Altogether, we reveal a vHC-MO connection by which specific value memories are updated, and we position TrkB within this functional circuit.

Regulation of sex differences in risk-based decision making by gonadal hormones: Insights from rodent models

Men and women differ in their ability to evaluate options that vary in their rewards and the risks that are associated with these outcomes. Most studies have shown that women are more risk averse than men and that gonadal hormones significantly contribute to this sex difference. Gonadal hormones can influence risk-based decision making (i.e., risk taking) by modulating the neurobiological substrates underlying this cognitive process. Indeed, estradiol, progesterone and testosterone modulate activity in the prefrontal cortex, amygdala and nucleus accumbens associated with reward and risk-related information. The use of animal models of decision making has advanced our understanding of the intersection between the behavioral, neural and hormonal mechanisms underlying sex differences in risk taking. This review will outline the current state of this literature, identify the current gaps in knowledge and suggest the neurobiological mechanisms by which hormones regulate risky decision making. Collectively, this knowledge can be used to understand the potential consequences of significant hormonal changes, whether endogenously or exogenously induced, on risk-based decision making as well as the neuroendocrinological basis of neuropsychiatric diseases that are characterized by impaired risk taking, such as substance use disorder and schizophrenia.