Firing of Putative Dopamine Neurons in Ventral Tegmental Area Is Modulated by Probability of Success during Performance of a Stop-Change Task

Optogenetic Inhibition of the Orbitofrontal Cortex Disrupts Inhibitory Control during Stop-Change Performance in Male Rats

Historically, the orbitofrontal cortex (OFC) has been implicated in a variety of behaviors ranging from reversal learning and inhibitory control to more complex representations of reward value and task space. While modern interpretations of the OFC's function have focused on a role in outcome evaluation, these cognitive processes often require an organism to inhibit a maladaptive response or strategy. Single-unit recordings from the OFC in rats performing a stop-change task show that the OFC responds strongly to STOP trials. To investigate the role that the OFC plays in stop-change performance, we expressed halorhodopsin (eNpHR3.0) in excitatory neurons in the OFC and tested rats on the stop-change task. Previous work suggests that the OFC differentiates between STOP trials based on trial sequence (i.e., gS trials: STOP trials preceded by a GO vs sS trials: STOP trials preceded by a STOP). We found that yellow light activation of the eNpHR3.0-expressing neurons significantly decreased accuracy only on STOP trials that followed GO trials (gS trials). Further, optogenetic inhibition of the OFC speeded reaction times on error trials. This suggests that the OFC plays a role in inhibitory control processes and that this role needs to be accounted for in modern interpretations of OFC function.

Transient food insecurity during the juvenile-adolescent period affects adult weight, cognitive flexibility, and dopamine neurobiology

A major challenge for neuroscience, public health, and evolutionary biology is to understand the effects of scarcity and uncertainty on the developing brain. Currently, a significant fraction of children and adolescents worldwide experience insecure access to food. The goal of our work was to test in mice whether the transient experience of insecure versus secure access to food during the juvenile-adolescent period produced lasting differences in learning, decision-making, and the dopamine system in adulthood. We manipulated feeding schedules in mice from postnatal day (P)21 to P40 as food insecure or ad libitum and found that when tested in adulthood (after P60), males with different developmental feeding history showed significant differences in multiple metrics of cognitive flexibility in learning and decision-making. Adult females with different developmental feeding history showed no differences in cognitive flexibility but did show significant differences in adult weight. We next applied reinforcement learning models to these behavioral data. The best fit models suggested that in males, developmental feeding history altered how mice updated their behavior after negative outcomes. This effect was sensitive to task context and reward contingencies. Consistent with these results, in males, we found that the two feeding history groups showed significant differences in the AMPAR/NMDAR ratio of excitatory synapses on nucleus-accumbens-projecting midbrain dopamine neurons and evoked dopamine release in dorsal striatal targets. Together, these data show in a rodent model that transient differences in feeding history in the juvenile-adolescent period can have significant impacts on adult weight, learning, decision-making, and dopamine neurobiology.

Medial prefrontal cortex lesions disrupt prepotent action selection signals in dorsomedial striatum

The ability to inhibit or adapt unwanted actions or movements is a critical feature of almost all forms of behavior. Many have attributed this ability to frontal brain areas such as the anterior cingulate cortex (ACC) and the medial prefrontal cortex (mPFC), but the exact contribution of each brain region is often debated because their functions are not examined in animals performing the same task. Recently, we have shown that ACC signals a need for cognitive control and is crucial for the adaptation of action selection signals in dorsomedial striatum (DMS) in rats performing a stop-change task. Here, we show that unlike ACC, the prelimbic region of mPFC does not disrupt the inhibition or adaption of an action plan at either the level of behavior or downstream firing in DMS. Instead, lesions to mPFC correlate with changes in DMS signals involved in action initiation and disrupt performance on GO trials while improving performance on STOP trials.

Reactive and Proactive Adaptation of Cognitive and Motor Neural Signals during Performance of a Stop-Change Task

The ability to inhibit or suppress unwanted or inappropriate actions, is an essential component of executive function and cognitive health. The immense selective pressure placed on maintaining inhibitory control processes is exemplified by the relatively small number of instances in which these systems completely fail in the average person's daily life. Although mistakes and errors do inevitably occur, inhibitory control systems not only ensure that this number is low, but have also adapted behavioral strategies to minimize future failures. The ability of our brains to adapt our behavior and appropriately engage proper motor responses is traditionally depicted as the primary domain of frontal brain areas, despite evidence to the fact that numerous other brain areas contribute. Using the stop-signal task as a common ground for comparison, we review a large body of literature investigating inhibitory control processes across frontal, temporal, and midbrain structures, focusing on our recent work in rodents, in an effort to understand how the brain biases action selection and adapts to the experience of conflict.

Is there a Neurobiological Rationale for the Utility of the Iowa Gambling Task in Parkinson's Disease?

Up to 23% of newly diagnosed, non-demented, Parkinson’s disease (PD) patients experience deficits in executive functioning (EF). In fact, EF deficits may occur up to 39-months prior to the onset of motor decline. Optimal EF requires working memory, attention, cognitive flexibility, and response inhibition underlying appropriate decision-making. The capacity for making strategic decisions requires inhibiting imprudent decisions and are associated with noradrenergic and dopaminergic signaling in prefrontal and orbitofrontal cortex. Catecholaminergic dysfunction and the loss of noradrenergic and dopaminergic cell bodies early in PD progression in the aforementioned cortical areas likely contribute to EF deficits resulting in non-strategic decision-making. Thus, detecting these deficits early in the disease process could help identify a significant portion of individuals with PD pathology (14–60%) before frank motor impairment. A task to evaluate EF in the domain of non-strategic decision-making might be useful to indicate the moderate loss of catecholamines that occurs early in PD pathology prior to motor decline and cognitive impairment. In this review, we focus on the potential utility of the Iowa Gambling Task (IGT) for this purpose, given significant overlap between in loss of dopaminergic and noradrenergic cells bodies in early PD and the deficits in catecholamine function associated with decreased EF. As such, given the loss of catecholamines already well-underway after PD diagnosis, we evaluate the potential utility of the IGT to identify the risk of therapeutic non-compliance and a potential companion approach to detect PD in premotor stages.

Neural Signals in Red Nucleus during Reactive and Proactive Adjustments in Behavior

The ability to adjust behavior is an essential component of cognitive control. Much is known about frontal and striatal processes that support cognitive control, but few studies have investigated how motor signals change during reactive and proactive adjustments in motor output. To address this, we characterized neural signals in red nucleus (RN), a brain region linked to motor control, as male and female rats performed a novel variant of the stop-signal task. We found that activity in RN represented the direction of movement and was strongly correlated with movement speed. Additionally, we found that directional movement signals were amplified on STOP trials before completion of the response and that the strength of RN signals was modulated when rats exhibited cognitive control. These results provide the first evidence that neural signals in RN integrate cognitive control signals to reshape motor outcomes reactively within trials and proactivity across them.SIGNIFICANCE STATEMENT Healthy human behavior requires the suppression or inhibition of errant or maladaptive motor responses, often called cognitive control. While much is known about how frontal brain regions facilitate cognitive control, less is known about how motor regions respond to rapid and unexpected changes in action selection. To address this, we recorded from neurons in the red nucleus, a motor region thought to be important for initiating movement in rats performing a cognitive control task. We show that red nucleus tracks motor plans and that selectivity was modulated on trials that required shifting from one motor response to another. Collectively, these findings suggest that red nucleus contributes to modulating motor behavior during cognitive control.

Anterior cingulate cortex is necessary for adaptation of action plans

Previous research has focused on the anterior cingulate cortex (ACC) as a key brain region in the mitigation of the competition that arises from two simultaneously active signals. However, to date, no study has demonstrated that ACC is necessary for this form of behavioral flexibility, nor have any studies shown that ACC acts by modulating downstream brain regions such as the dorsal medial striatum (DMS) that encode action plans necessary for task completion. Here, we performed unilateral excitotoxic lesions of ACC while recording downstream from the ipsilateral hemisphere of DMS in rats, performing a variant of the STOP-signal task. We show that on STOP trials lesioned rats perform worse, in part due to the failure of timely directional action plans to emerge in the DMS, as well as the overrepresentation of the to-be-inhibited behavior. Collectively, our findings suggest that ACC is necessary for the mitigation of competing inputs and validates many of the existing theoretical predictions for the role of ACC in cognitive control.

The impact of drugs of abuse on executive function: characterizing long-term changes in neural correlates following chronic drug exposure and withdrawal in rats

Addiction has long been characterized by diminished executive function, control, and impulsivity management. In particular, these deficits often manifest themselves as impairments in reversal learning, delay discounting, and response inhibition. Understanding the neurobiological substrates of these behavioral deficits is of paramount importance to our understanding of addiction. Within the cycle of addiction, periods during and after withdrawal represent a particularly difficult point of intervention in that the negative physical symptoms associated with drug removal and drug craving increase the likelihood that the patient will relapse and return to drug use in order to abate these symptoms. Moreover, it is often during this time that drug induced deficits in executive function hinder the ability of the patient to refrain from drug use. Thus, it is necessary to understand the physiological and behavioral changes associated with withdrawal and drug craving-largely manifesting as deficits in executive control-to develop more effective treatment strategies. In this review, we address the long-term impact that drugs of abuse have on the behavioral and neural correlates that give rise to executive control as measured by reversal learning, delay discounting, and stop-signal tasks, focusing particularly on our work using rats as a model system.