Response inhibition signals and miscoding of direction in dorsomedial striatum

Decreased Beta Power and OFC-STN Phase Synchronization during Reactive Stopping in Freely Behaving Rats

During natural behavior, an action often needs to be suddenly stopped in response to an unexpected sensory input-referred to as reactive stopping. Reactive stopping has been mostly investigated in humans, which led to hypotheses about the involvement of different brain structures, in particular the hyperdirect pathway. Here, we directly investigate the contribution and interaction of two key regions of the hyperdirect pathway, the orbitofrontal cortex (OFC) and subthalamic nucleus (STN), using dual-area, multielectrode recordings in male rats performing a stop-signal task. In this task, rats have to initiate movement to a go-signal, and occasionally stop their movement to the go-signal side after a stop-signal, presented at various stop-signal delays. Both the OFC and STN show near-simultaneous field potential reductions in the beta frequency range (12-30 Hz) compared with the period preceding the go-signal and the movement period. These transient reductions (∼200 ms) only happen during reactive stopping, which is when the stop-signal was received after action initiation, and are well timed after stop-signal onset and before the estimated time of stopping. Phase synchronization analysis also showed a transient attenuation of synchronization between the OFC and STN in the beta range during reactive stopping. The present results provide the first direct quantification of local neural oscillatory activity in the OFC and STN and interareal synchronization specifically timed during reactive stopping.

Optogenetic Inhibition of the Orbitofrontal Cortex Disrupts Inhibitory Control during Stop-Change Performance in Male Rats

Historically, the orbitofrontal cortex (OFC) has been implicated in a variety of behaviors ranging from reversal learning and inhibitory control to more complex representations of reward value and task space. While modern interpretations of the OFC's function have focused on a role in outcome evaluation, these cognitive processes often require an organism to inhibit a maladaptive response or strategy. Single-unit recordings from the OFC in rats performing a stop-change task show that the OFC responds strongly to STOP trials. To investigate the role that the OFC plays in stop-change performance, we expressed halorhodopsin (eNpHR3.0) in excitatory neurons in the OFC and tested rats on the stop-change task. Previous work suggests that the OFC differentiates between STOP trials based on trial sequence (i.e., gS trials: STOP trials preceded by a GO vs sS trials: STOP trials preceded by a STOP). We found that yellow light activation of the eNpHR3.0-expressing neurons significantly decreased accuracy only on STOP trials that followed GO trials (gS trials). Further, optogenetic inhibition of the OFC speeded reaction times on error trials. This suggests that the OFC plays a role in inhibitory control processes and that this role needs to be accounted for in modern interpretations of OFC function.

Adolescents rats engage the orbitofrontal-striatal pathway differently than adults during impulsive actions

Adolescence is characterized by increased impulsive and risk-taking behaviors. To better understand the neural networks that subserves impulsivity in adolescents, we used a reward-guided behavioral model that quantifies age differences in impulsive actions in adult and adolescent rats of both sexes. Using chemogenetics, we identified orbitofrontal cortex (OFC) projections to the dorsomedial striatum (DMS) as a critical pathway for age-related execution of impulsive actions. Simultaneous recording of single units and local field potentials in the OFC and DMS during task performance revealed an overall muted response in adolescents during impulsive actions as well as age-specific differences in theta power and OFC-DMS functional connectivity. Collectively, these data reveal that the OFC-DMS pathway is critical for age-differences in reward-guided impulsive actions and provide a network mechanism to enhance our understanding of how adolescent and adult brains coordinate behavioral inhibition.

Medial prefrontal cortex lesions disrupt prepotent action selection signals in dorsomedial striatum

The ability to inhibit or adapt unwanted actions or movements is a critical feature of almost all forms of behavior. Many have attributed this ability to frontal brain areas such as the anterior cingulate cortex (ACC) and the medial prefrontal cortex (mPFC), but the exact contribution of each brain region is often debated because their functions are not examined in animals performing the same task. Recently, we have shown that ACC signals a need for cognitive control and is crucial for the adaptation of action selection signals in dorsomedial striatum (DMS) in rats performing a stop-change task. Here, we show that unlike ACC, the prelimbic region of mPFC does not disrupt the inhibition or adaption of an action plan at either the level of behavior or downstream firing in DMS. Instead, lesions to mPFC correlate with changes in DMS signals involved in action initiation and disrupt performance on GO trials while improving performance on STOP trials.

Activation, but not inhibition, of the indirect pathway disrupts choice rejection in a freely moving, multiple-choice foraging task

The dorsomedial striatum (DMS) plays a key role in action selection, but less is known about how direct and indirect pathway spiny projection neurons (dSPNs and iSPNs, respectively) contribute to choice rejection in freely moving animals. Here, we use pathway-specific chemogenetic manipulation during a serial choice foraging task to test the role of dSPNs and iSPNs in learned choice rejection. We find that chemogenetic activation, but not inhibition, of iSPNs disrupts rejection of nonrewarded choices, contrary to predictions of a simple "select/suppress" heuristic. Our findings suggest that iSPNs' role in stopping and freezing does not extend in a simple fashion to choice rejection in an ethological, freely moving context. These data may provide insights critical for the successful design of interventions for addiction or other conditions in which it is desirable to strengthen choice rejection.

The Stop Signal Task for Measuring Behavioral Inhibition in Mice With Increased Sensitivity and High-Throughput Operation

Ceasing an ongoing motor response requires action cancelation. This is impaired in many pathologies such as attention deficit disorder and schizophrenia. Action cancelation is measured by the stop signal task that estimates how quickly a motor response can be stopped when it is already being executed. Apart from human studies, the stop signal task has been used to investigate neurobiological mechanisms of action cancelation overwhelmingly in rats and only rarely in mice, despite the need for a genetic model approach. Contributing factors to the limited number of mice studies may be the long and laborious training that is necessary and the requirement for a very loud (100 dB) stop signal. We overcame these limitations by employing a fully automated home-cage-based setup. We connected a home-cage to the operant box via a gating mechanism, that allowed individual ID chipped mice to start sessions voluntarily. Furthermore, we added a negative reinforcement consisting of a mild air puff with escape option to the protocol. This specifically improved baseline inhibition to 94% (from 84% with the conventional approach). To measure baseline inhibition the stop is signaled immediately with trial onset thus measuring action restraint rather than action cancelation ability. A high baseline allowed us to measure action cancelation ability with higher sensitivity. Furthermore, our setup allowed us to reduce the intensity of the acoustic stop signal from 100 to 70 dB. We constructed inhibition curves from stop trials with daily adjusted delays to estimate stop signal reaction times (SSRTs). SSRTs (median 88 ms) were lower than reported previously, which we attribute to the observed high baseline inhibition. Our automated training protocol reduced training time by 17% while also promoting minimal experimenter involvement. This sensitive and labor efficient stop signal task procedure should therefore facilitate the investigation of action cancelation pathologies in genetic mouse models.

Reactive and Proactive Adaptation of Cognitive and Motor Neural Signals during Performance of a Stop-Change Task

The ability to inhibit or suppress unwanted or inappropriate actions, is an essential component of executive function and cognitive health. The immense selective pressure placed on maintaining inhibitory control processes is exemplified by the relatively small number of instances in which these systems completely fail in the average person's daily life. Although mistakes and errors do inevitably occur, inhibitory control systems not only ensure that this number is low, but have also adapted behavioral strategies to minimize future failures. The ability of our brains to adapt our behavior and appropriately engage proper motor responses is traditionally depicted as the primary domain of frontal brain areas, despite evidence to the fact that numerous other brain areas contribute. Using the stop-signal task as a common ground for comparison, we review a large body of literature investigating inhibitory control processes across frontal, temporal, and midbrain structures, focusing on our recent work in rodents, in an effort to understand how the brain biases action selection and adapts to the experience of conflict.

Anterior cingulate cortex and adaptive control of brain and behavior

Research examining the functional underpinnings of anterior cingulate cortex (ACC) and its relationship to cognitive control have been described as "perennially controversial" and a "Rorschach Test" for modern neuroscience. Although there is near universal agreement that ACC is important for the adaptation of behavior, debate, despite decades of work, stems from the exact manner in which ACC goes about doing this. This chapter provides a brief overview of the various past and present theoretical arguments and research surrounding ACC function, and highlights an emerging literature of single unit ACC recordings from several species that support these theories. We will finish the chapter by focusing on our work examining the firing of single neurons in rat dorsal medial striatum (DMS) and ACC, and examining DMS's dependency on ACC to accurately signal adaptive behavioral output. Ultimately, we will conclude that ACC carries a myriad of signals (error detection, reinforcement/feedback, value, response conflict, etc.) necessary for the modulation of attention and task-relevant/irrelevant signals so that difficult decisions can be made and action plans adapted when necessary.

Anterior Cingulate Cortex Signals Attention in a Social Paradigm that Manipulates Reward and Shock

The ability to recognize emotions in others and adapt one's behavior accordingly is critical for functioning in any social context. This ability is impaired in several psychiatric disorders, such as autism and psychopathy. Recent work has identified the anterior cingulate cortex (ACC) among other brain regions involved in this process. Neural recording studies have shown that neurons in ACC are modulated by reward or shock when delivered to a conspecific and when experienced first-hand. Because previous studies do not vary reward and shock within the same experiment, it has been unclear whether the observed activity reflects how much attention is being paid to outcomes delivered to a conspecific or the valence associated with those stimuli. To address this issue, we recorded from ACC as rats performed a Pavlovian task that predicted whether reward, shock, or nothing would be delivered to the rat being recorded from or a conspecific located in the opposite chamber. Consistent with previous reports, we found that the firing of ACC neurons was modulated by aversive stimuli delivered to the recording rat and their conspecific. Activity of some of these neurons genuinely reflected outcome identity (i.e., reward or shock); however, the population of neurons as a whole responded similarly for both reward and shock, as well as for cues that predicted their occurrence (i.e., reward > neutral and shock > neutral; attention). These results suggest that ACC can process information about outcomes (i.e., identity and recipient) in the service of promoting attention in some social contexts.

The ever-changing OFC landscape: What neural signals in OFC can tell us about inhibitory control

Despite decades of research on OFC function, the exact function(s) of OFC remain elusive. In recent years, 1 of the earliest hypotheses about OFC function, namely its involvement in inhibitory control, has drifted to the periphery of the functional OFC landscape in favor of theories suggesting a role for OFC in the representation of task or state space. The reasons for this drift are valid, owing in part to the development of more sensitive behavioral approaches, a clear emphasis on cross-species and cross-method comparisons, as well as the elegant integration of reinforcement learning theories. However, recent evidence recording from OFC during the performance of traditional inhibitory control tasks has found new evidence supporting a role for OFC in inhibitory control. While the extent to which these findings can be integrated into existing frameworks is in its infancy, this review seeks to highlight these findings with the goal of providing new insights into function of OFC. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Single Neurons in Anterior Cingulate Cortex Signal the Need to Change Action During Performance of a Stop-change Task that Induces Response Competition

Several human imaging studies have suggested that anterior cingulate cortex (ACC) is highly active when participants receive competing inputs, and that these signals may be important for influencing the downstream planning of actions. Despite increasing evidence from several neuroimaging studies, no study has examined ACC activity at the level of the single neuron in rodents performing similar tasks. To fill this gap, we recorded from single neurons in ACC while rats performed a stop-change task. We found higher firing on trials with competing inputs (STOP trials), and that firing rates were positively correlated with accuracy and movement speed, suggesting that when ACC was engaged, rats tended to slow down and perform better. Finally, firing was the strongest when STOP trials were preceded by GO trials and was reduced when rats adapted their behavior on trials subsequent to a STOP trial. These data provide the first evidence that activity of single neurons in ACC is elevated when 2 responses are in competition with each other when there is a need to change the course of action to obtain reward.

Neural Signals in Red Nucleus during Reactive and Proactive Adjustments in Behavior

The ability to adjust behavior is an essential component of cognitive control. Much is known about frontal and striatal processes that support cognitive control, but few studies have investigated how motor signals change during reactive and proactive adjustments in motor output. To address this, we characterized neural signals in red nucleus (RN), a brain region linked to motor control, as male and female rats performed a novel variant of the stop-signal task. We found that activity in RN represented the direction of movement and was strongly correlated with movement speed. Additionally, we found that directional movement signals were amplified on STOP trials before completion of the response and that the strength of RN signals was modulated when rats exhibited cognitive control. These results provide the first evidence that neural signals in RN integrate cognitive control signals to reshape motor outcomes reactively within trials and proactivity across them.SIGNIFICANCE STATEMENT Healthy human behavior requires the suppression or inhibition of errant or maladaptive motor responses, often called cognitive control. While much is known about how frontal brain regions facilitate cognitive control, less is known about how motor regions respond to rapid and unexpected changes in action selection. To address this, we recorded from neurons in the red nucleus, a motor region thought to be important for initiating movement in rats performing a cognitive control task. We show that red nucleus tracks motor plans and that selectivity was modulated on trials that required shifting from one motor response to another. Collectively, these findings suggest that red nucleus contributes to modulating motor behavior during cognitive control.

Anterior cingulate cortex is necessary for adaptation of action plans

Previous research has focused on the anterior cingulate cortex (ACC) as a key brain region in the mitigation of the competition that arises from two simultaneously active signals. However, to date, no study has demonstrated that ACC is necessary for this form of behavioral flexibility, nor have any studies shown that ACC acts by modulating downstream brain regions such as the dorsal medial striatum (DMS) that encode action plans necessary for task completion. Here, we performed unilateral excitotoxic lesions of ACC while recording downstream from the ipsilateral hemisphere of DMS in rats, performing a variant of the STOP-signal task. We show that on STOP trials lesioned rats perform worse, in part due to the failure of timely directional action plans to emerge in the DMS, as well as the overrepresentation of the to-be-inhibited behavior. Collectively, our findings suggest that ACC is necessary for the mitigation of competing inputs and validates many of the existing theoretical predictions for the role of ACC in cognitive control.

Common Neural Network for Different Functions: An Investigation of Proactive and Reactive Inhibition

Successful behavioral inhibition involves both proactive and reactive inhibition, allowing people to prepare for restraining actions, and cancel their actions if the response becomes inappropriate. In the present study, we utilized the stop-signal paradigm to examine whole-brain contrasts and functional connectivity for proactive and reactive inhibition. The results of our functional magnetic resonance imaging (fMRI) data analysis show that the inferior frontal gyrus (IFG), the supplementary motor area (SMA), the subthalamic nucleus (STN), and the primary motor cortex (M1) were activated by both proactive and reactive inhibition. We then created 70 dynamic causal models (DCMs) representing the alternative hypotheses of modulatory effects from proactive and reactive inhibition in the IFG-SMA-STN-M1 network. Bayesian model selection (BMS) showed that causal connectivity from the IFG to the SMA was modulated by both proactive and reactive inhibition. To further investigate the possible brain circuits involved in behavioral control, including proactive inhibitory processes, we compared 13 DCMs representing the alternative hypotheses of proactive modulation in the dorsolateral prefrontal cortex (DLPFC)-caudate-IFG-SMA neural circuits. BMS revealed that the effective connectivity from the caudate to the IFG is modulated only in the proactive inhibition condition but not in the reactive inhibition. Together, our results demonstrate how fronto-basal ganglia pathways are commonly involved in proactive and reactive inhibitory control, with a "longer" pathway (DLPFC-caudate-IFG-SMA-STN-M1) playing a modulatory role in proactive inhibitory control, and a "shorter" pathway (IFG-SMA-STN-M1) involved in reactive inhibition. These results provide causal evidence for the roles of indirect and hyperdirect pathways in mediating proactive and reactive inhibitory control.

The orexin-1 receptor antagonist SB-334867 reduces motivation, but not inhibitory control, in a rat stop signal task

There is considerable clinical interest in the neuropeptide orexin/hypocretin for its ability to regulate motivation and reward as well as arousal and wakefulness. For instance, antagonists for the orexin-1 receptor (OxR1) are thought to hold great promise for treating drug addiction and disorders associated with overeating, as these compounds repeatedly have been found to suppress seeking of various drugs of abuse as well as highly palatable foods in preclinical models. Given the hypothesized role of OxR1 signaling in cue-driven motivation, an outstanding question is whether pharmacologically blocking this receptor affects cognitive functioning. Response inhibition - the ability to cancel ongoing behavior - is one aspect of cognitive control that may be particularly relevant. Response inhibition deficits are commonly associated with a range of psychiatric disorders and neurological diseases, including substance use disorders and obesity. Moreover, OxR1 signaling recently has been implicated in waiting impulsivity, another aspect of inhibitory control. Here, we investigated the effects of the OxR1 antagonist SB-334867 on response inhibition in a rat version of the stop-signal reaction time task. Results show that acutely blocking OxR1 had minimal effects on response inhibition or attentional functioning. In contrast, this manipulation reduced motivation to perform the task and earn food rewards, consistent with other recent findings. These results add to the growing body of literature implicating OxR1 in the regulation of motivation and suggest that effects of pharmacological compounds such as SB-334867 on drug-seeking behavior are not related to effects on response inhibition.

Controllability affects endocrine response of adolescent male rats to stress as well as impulsivity and behavioral flexibility during adulthood

Exposure to stress during adolescence exerts a long-term impact on behavior and might contribute to the development of several neuropsychiatric disorders. In adults, control over stress has been found to protect from the negative consequences of stress, but the influence of controllability at early ages has not been extensively studied. Here, we evaluated in a rodent model the effects of repeated exposure in adolescent male rats to controllable versus uncontrollable foot-shock stress (CST or UST, respectively). Rats were assigned to three groups: non-stress (stress-naïve), CST (exposed to 8 sessions of a two-way shuttle active avoidance task over a period of 22 days) and UST (receiving the same amount of shocks as CST, regardless of their actual behavior). During adulthood, different cohorts were tested in several tasks evaluating inhibitory control and cognitive flexibility: 5-choice serial reaction time, delay-discounting, gambling test and probabilistic reversal learning. Results showed that the hypothalamic-pituitary-adrenal response to the first shock session was similar in CST and UST animals, but the response to the 8^th session was lower in CST animals. In adulthood, the UST animals presented impaired motor (but not cognitive) impulsivity and more perseverative behavior. The behavioral effects of UST were associated with increased number of D2 dopamine receptors in dorsomedial striatum, but not in other striatal regions. In summary, UST exposure during adolescence induced long-term impairments in impulsivity and compulsivity, whereas CST had only minor effects. These data support a critical role of stress uncontrollability on the long-lasting consequences of stress, as a risk factor for mental illnesses.

Prefrontal cortex development and emergence of self-regulatory competence: the two cardinal features of adolescence disrupted in context of alcohol abuse

Adolescence is a tumultuous period in the lifetime of an individual confronted to major changes in emotional, social and cognitive appraisal. During this period of questioning and doubt, while the executive functions are still maturing, the abstract reasoning remains vague and the response inhibition loose; ultimately the adolescent scarcely resists temptation. Consequently, adolescence is often associated with uninhibited risk-taking, reckless behaviours, among which are alcohol and illicit drugs use. Here, we discuss how the development of the prefrontal cortex (which critically contributes to rational decision-making and temporal processing of complex events) can be associated with the idiosyncratic adolescent behaviour, and potentially uncontrolled alcohol use. Most importantly, we present clinical and preclinical evidence supporting that ethanol exposure has deleterious effects on the adolescent developing brain. Ultimately, we discuss why a late maturing prefrontal cortex represents a ripe candidate to environmental influences that contribute to shape the adolescent brain but, potentially, can also trigger lifelong maladaptive responses, including increased vulnerability to develop substance use disorder later in life.

The impact of drugs of abuse on executive function: characterizing long-term changes in neural correlates following chronic drug exposure and withdrawal in rats

Addiction has long been characterized by diminished executive function, control, and impulsivity management. In particular, these deficits often manifest themselves as impairments in reversal learning, delay discounting, and response inhibition. Understanding the neurobiological substrates of these behavioral deficits is of paramount importance to our understanding of addiction. Within the cycle of addiction, periods during and after withdrawal represent a particularly difficult point of intervention in that the negative physical symptoms associated with drug removal and drug craving increase the likelihood that the patient will relapse and return to drug use in order to abate these symptoms. Moreover, it is often during this time that drug induced deficits in executive function hinder the ability of the patient to refrain from drug use. Thus, it is necessary to understand the physiological and behavioral changes associated with withdrawal and drug craving-largely manifesting as deficits in executive control-to develop more effective treatment strategies. In this review, we address the long-term impact that drugs of abuse have on the behavioral and neural correlates that give rise to executive control as measured by reversal learning, delay discounting, and stop-signal tasks, focusing particularly on our work using rats as a model system.

Area-specific Modulation of Functional Cortical Activity During Block-based and Trial-based Proactive Inhibition

Animals can suppress their behavioral response in advance according to changes in environmental context (proactive inhibition: delaying the start of response), a process in which several cortical areas may participate. However, it remains unclear how this process is adaptively regulated according to contextual changes on different timescales. To address the issue, we used an improved stop-signal task paradigm to behaviorally and electrophysiologically characterize the temporal aspect of proactive inhibition in head-fixed rats. In the task, they must respond to a go cue as quickly as possible (go trial), but did not have to respond if a stop cue followed the go cue (stop trial). The task alternated between a block of only go trials (G-block) and a block of go-and-stop trials (GS-block). We observed block-based and trial-based proactive inhibition (emerging in GS-block and after stop trial, respectively) by behaviorally evaluating the delay in reaction time in correct go trials depending on contextual changes on different timescales. We electrophysiologically analyzed task-related neuronal activity in the primary and secondary motor, posterior parietal, and orbitofrontal cortices (M1, M2, PPC, and OFC, respectively). Under block-based proactive inhibition, spike activity of cue-preferring OFC neurons was attenuated continuously, while M1 and M2 activity was enhanced during motor preparation. Subsequently, M1 activity was attenuated during motor decision/execution. Under trial-based proactive inhibition, the OFC activity was continuously enhanced, and PPC and M1 activity was also enhanced shortly during motor decision/execution. These results suggest that different cortical mechanisms underlie the two types of proactive inhibition in rodents.

Firing of Putative Dopamine Neurons in Ventral Tegmental Area Is Modulated by Probability of Success during Performance of a Stop-Change Task

Response inhibition, the ability to refrain from unwanted actions, is an essential component of complex behavior and is often impaired across numerous neuropsychiatric disorders such as addiction, attention-deficit hyperactivity disorder (ADHD), schizophrenia, and obsessive-compulsive disorder. Accordingly, much research has been devoted to characterizing brain regions responsible for the regulation of response inhibition. The stop-signal task, a task in which animals are required to inhibit a prepotent response in the presence of a STOP cue, is one of the most well-studied tasks of response inhibition. While pharmacological evidence suggests that dopamine (DA) contributes to the regulation of response inhibition, what is exactly encoded by DA neurons during performance of response inhibition tasks is unknown. To address this issue, we recorded from single units in the ventral tegmental area (VTA), while rats performed a stop-change task. We found that putative DA neurons fired less and higher to cues and reward on STOP trials relative to GO trials, respectively, and that firing was reduced during errors. These results suggest that DA neurons in VTA encode the uncertainty associated with the probability of obtaining reward on difficult trials instead of the saliency associated with STOP cues or the need to resolve conflict between competing responses during response inhibition.

Neural and behavioral mechanisms of proactive and reactive inhibition

Response inhibition is an important component of adaptive behavior. Substantial prior research has focused on reactive inhibition, which refers to the cessation of a motor response that is already in progress. More recently, a growing number of studies have begun to examine mechanisms underlying proactive inhibition, whereby preparatory processes result in a response being withheld before it is initiated. It has become apparent that proactive inhibition is an essential component of the overall ability to regulate behavior and has implications for the success of reactive inhibition. Moreover, successful inhibition relies on learning the meaning of specific environmental cues that signal when a behavioral response should be withheld. Proactive inhibitory control is mediated by stopping goals, which reflect the desired outcome of inhibition and include information about how and when inhibition should be implemented. However, little is known about the circuits and cellular processes that encode and represent features in the environment that indicate the necessity for proactive inhibition or how these representations are implemented in response inhibition. In this article, we will review the brain circuits and systems involved in implementing inhibitory control through both reactive and proactive mechanisms. We also comment on possible cellular mechanisms that may contribute to inhibitory control processes, noting that substantial further research is necessary in this regard. Furthermore, we will outline a number of ways in which the temporal dynamics underlying the generation of the proactive inhibitory signal may be particularly important for parsing out the neurobiological correlates that contribute to the learning processes underlying various aspects of inhibitory control.

Lifespan Changes in the Countermanding Performance of Young and Middle Aged Adult Rats

Inhibitory control can be investigated with the countermanding task, which requires subjects to make a response to a go signal and cancel that response when a stop signal is presented occasionally. Adult humans performing the countermanding task typically exhibit impaired response time (RT), stop signal response time (SSRT) and response accuracy as they get older, but little change in post-error slowing. Rodent models of the countermanding paradigm have been developed recently, yet none have directly examined age-related changes in performance throughout the lifespan. Male Wistar rats (N = 16) were trained to respond to a visual stimulus (go signal) by pressing a lever directly below an illuminated light for food reward, but to countermand the lever press subsequent to a tone (stop signal) that was presented occasionally (25% of trials) at a variable delay. Subjects were tested in 1 h sessions at approximately 7 and 12 months of age with intermittent training in between. Rats demonstrated longer go trial RT, a higher proportion of go trial errors and performed less total trials at 12, compared to 7 months of age. Consistent SSRT and post-error slowing were observed for rats at both ages. These results suggest that the countermanding performance of rats does vary throughout the lifespan, in a manner similar to humans, suggesting that rodents may provide a suitable model for behavioral impairment related to normal aging. These findings also highlight the importance of indicating the age at which rodents are tested in countermanding investigations.

Prenatal Nicotine Exposure Impairs Executive Control Signals in Medial Prefrontal Cortex

Prenatal nicotine exposure (PNE) is linked to numerous psychiatric disorders including attention deficit hyperactivity disorder (ADHD). Current literature suggests that core deficits observed in ADHD reflect abnormal inhibitory control governed by the prefrontal cortex. Yet, it is unclear how neural activity in the medial prefrontal cortex (mPFC) is modulated during tasks that assess response inhibition or if these neural correlates, along with behavior, are affected by PNE. To address this issue, we recorded from single mPFC neurons in control and PNE rats as they performed a stop-signal task. We found that PNE rats were faster for all trial-types, made more premature responses, and were less likely to inhibit behavior on 'STOP' trials during which rats had to inhibit an already initiated response. Activity in mPFC was modulated by response direction and was positively correlated with accuracy and movement time in control but not PNE rats. Although the number of single neurons correlated with response direction was significantly reduced by PNE, neural activity observed on general STOP trials was largely unaffected. However, dramatic behavioral deficits on STOP trials immediately following non-conflicting (GO) trials in the PNE group appear to be mediated by the loss of conflict monitoring signals in mPFC. We conclude that prenatal nicotine exposure makes rats impulsive and disrupts firing of mPFC neurons that carry signals related to response direction and conflict monitoring.

Ongoing behavioral state information signaled in the lateral habenula guides choice flexibility in freely moving rats

The lateral habenula (LHb) plays a role in a wide variety of behaviors ranging from maternal care, to sleep, to various forms of cognition. One prominent theory with ample supporting evidence is that the LHb serves to relay basal ganglia and limbic signals about negative outcomes to midbrain monoaminergic systems. This makes it likely that the LHb is critically involved in behavioral flexibility as all of these systems have been shown to contribute when flexible behavior is required. Behavioral flexibility is commonly examined across species and is impaired in various neuropsychiatric conditions including autism, depression, addiction, and schizophrenia; conditions in which the LHb is thought to play a role. Therefore, a thorough examination of the role of the LHb in behavioral flexibility serves multiple functions including understanding possible connections with neuropsychiatric illnesses and additional insight into its role in cognition in general. Here, we assess the LHb’s role in behavioral flexibility through comparisons of the roles its afferent and efferent pathways are known to play. Additionally, we provide new evidence supporting the LHb contributions to behavioral flexibility through organization of specific goal directed actions under cognitively demanding conditions. Specifically, in the first experiment, a majority of neurons recorded from the LHb were found to correlate with velocity on a spatial navigation task and did not change significantly when reward outcomes were manipulated. Additionally, measurements of local field potential (LFP) in the theta band revealed significant changes in power relative to velocity and reward location. In a second set of experiments, inactivation of the LHb with the gamma-aminobutyric acid (GABA) agonists baclofen and muscimol led to an impairment in a spatial/response based repeated probabilistic reversal learning task. Control experiments revealed that this impairment was likely due to the demands of repeated switching behaviors as rats were unimpaired on initial discrimination acquisition or retention of probabilistic learning. Taken together, these novel findings compliment other work discussed supporting a role for the LHb in action selection when cognitive or emotional demands are increased. Finally, we discuss future mechanisms by which a superior understanding of the LHb can be obtained through additional examination of behavioral flexibility tasks.

Multimodal Plasticity in Dorsal Striatum While Learning a Lateralized Navigation Task

Growing evidence supports a critical role for the dorsal striatum in cognitive as well as motor control. Both lesions and in vivo recordings demonstrate a transition in the engaged dorsal striatal subregion, from dorsomedial to dorsolateral, as skill performance shifts from an attentive phase to a more automatic or habitual phase. What are the neural mechanisms supporting the cognitive and behavioral transitions in skill learning? To pursue this question, we used T-maze training during which rats transition from early, attentive (dorsomedial) to late habitual (dorsolateral) performance. Following early or late training, we performed the first direct comparison of bidirectional synaptic plasticity in striatal brain slices, and the first evaluation of striatal synaptic plasticity by hemisphere relative to a learned turn. Consequently, we find that long-term potentiation and long-term depression are independently modulated with learning rather than reciprocally linked as previously suggested. Our results establish that modulation of evoked synaptic plasticity with learning depends on striatal subregion, training stage, and hemisphere relative to the learned turn direction. Exclusive to the contralateral hemisphere, intrinsic excitability is enhanced in dorsomedial relative to dorsolateral medium spiny neurons early in training and population responses are dampened late in training. Neuronal reconstructions indicate dendritic remodeling after training, which may represent a novel form of pruning. In conclusion, we describe region- and hemisphere-specific changes in striatal synaptic, intrinsic, and morphological plasticity which correspond to T-maze learning stages, and which may play a role in the cognitive transition between attentive and habitual strategies. Significance statement: We investigated neural plasticity in dorsal striatum from rats that were briefly or extensively trained on a directional T-maze task. Our results demonstrate that both the extent of training and the direction a rat learns to turn control the location and type of change in synaptic plasticity. In addition, brief training produces changes in neuron excitability only within one striatal subregion, whereas all training produces widespread changes in dendritic morphology. Our results suggest that activity in dorsomedial striatum strengthens the rewarded turn after brief training, whereas activity in dorsolateral striatum suppresses unrewarded turns after extensive training. This study illuminates how plasticity mediates learning using a task recognized for transitioning subjects from attentive to automatic performance.

Neural correlates of rules and conflict in medial prefrontal cortex during decision and feedback epochs

The ability to properly adjust behavioral responses to cues in a changing environment is crucial for survival. Activity in the medial Prefrontal Cortex (mPFC) is thought to both represent rules to guide behavior as well as detect and resolve conflicts between rules in changing contingencies. However, while lesion and pharmacological studies have supported a crucial role for mPFC in this type of set-shifting, an understanding of how mPFC represents current rules or detects and resolves conflict between different rules is unclear. Here, we directly address the role of rat mPFC in shifting rule based behavioral strategies using a novel behavioral task designed to tease apart neural signatures of rules, conflict and direction. We demonstrate that activity of single neurons in rat mPFC represent distinct rules. Further, we show increased firing on high conflict trials in a separate population of mPFC neurons. Reduced firing in both populations of neurons was associated with poor performance. Moreover, activity in both populations increased and decreased firing during the outcome epoch when reward was and was not delivered on correct and incorrect trials, respectively. In addition, outcome firing was modulated by the current rule and the degree of conflict associated with the previous decision. These results promote a greater understanding of the role that mPFC plays in switching between rules, signaling both rule and conflict to promote improved behavioral performance.

Rule encoding in dorsal striatum impacts action selection

Cognitive flexibility is a hallmark of prefrontal cortical (PFC) function yet little is known about downstream area involvement. The medial dorsal striatum (mDS) receives major projections from the PFC and is uniquely situated to perform the integration of responses with rule information. In this study, we use a novel rule shifting task in rats that mirrors non-human primate and human studies in its temporal precision and counterbalanced responses. We record activity from single neurons in the mDS while rats switch between different rules for reward. Additionally, we pharmacologically inactivate mDS by infusion of a baclofen/muscimol cocktail. Inactivation of mDS impaired the ability to shift to a new rule and increased the number of regressive errors. While recording in mDS, we identified neurons modulated by direction whose activity reflected the conflict between competing rule information. We show that a subset of these neurons was also rule selective, and that the conflict between competing rule cues was resolved as behavioural performance improved. Other neurons were modulated by rule, but not direction. These neurons became selective before behavioural performance accurately reflected the current rule. These data provide an additional locus for investigating the mechanisms underlying behavioural flexibility. Converging lines of evidence from multiple human psychiatric disorders have implicated dorsal striatum as an important and understudied neural substrate of flexible cognition. Our data confirm the importance of mDS, and suggest a mechanism by which mDS mediates abstract cognition functions.

Executive control signals in orbitofrontal cortex during response inhibition

Orbitofrontal cortex (OFC) lesions produce deficits in response inhibition and imaging studies suggest that activity in OFC is stronger on trials that require suppression of behavior, yet few studies have examined neural correlates at the single-unit level in a behavioral task that probes response inhibition without varying other factors, such as anticipated outcomes. Here we recorded from single neurons in lateral OFC in a task that required animals in the minority of trials to STOP or inhibit an ongoing movement and respond in the opposite direction. We found that population and single-unit firing was modulated primarily by response direction and movement speed, and that very few OFC neurons exhibited a response independent inhibition signal. Remarkably, the strength of the directional signal was not diminished on STOP trials and was actually stronger on STOP trials during conflict adaptation. Finally, directional signals were stronger during sessions in which rats had the most difficulty inhibiting behavior. These results suggest that "inhibition" deficits observed with OFC interference studies reflect deficits unrelated to signaling the need to inhibit behavior, but instead support a role for OFC in executive functions related to dissociating between two perceptually similar actions during response conflict.

Proactive and reactive inhibitory control in rats

Inhibiting actions inappropriate for the behavioral context, or inhibitory control, is essential for survival and involves both reactively stopping the current prepared action and proactively adjusting behavioral tendencies to increase future performance. A powerful paradigm widely used in basic and clinical research to study inhibitory control is the stop signal task (SST). Recent years have seen a surging interest in translating the SST to rodents to study the neural mechanisms underlying inhibitory control. However, significant differences in task designs and behavioral strategies between rodent and primate studies have made it difficult to directly compare the two literatures. In this study, we developed a rodent-appropriate SST and characterized both reactive and proactive control in rats. For reactive inhibitory control, we found that, unlike in primates, incorrect stop trials in rodents result from two independent types of errors: an initial failure-to-stop error or, after successful stopping, a subsequent failure-to-wait error. Conflating failure-to-stop and failure-to-wait errors systematically overestimates the covert latency of reactive inhibition, the stop signal reaction time (SSRT). To correctly estimate SSRT, we developed and validated a new method that provides an unbiased SSRT estimate independent of the ability to wait. For proactive inhibitory control, we found that rodents adjust both their reaction time and the ability to stop following failure-to-wait errors and successful stop trials, but not after failure-to-stop errors. Together, these results establish a valid rodent model that utilizes proactive and reactive inhibitory control strategies similar to primates, and highlight the importance of dissociating initial stopping from subsequent waiting in studying mechanisms of inhibitory control using rodents.

Relationships between reward sensitivity, risk-taking and family history of alcoholism during an interactive competitive fMRI task

Background

Individuals with a positive family history for alcoholism (FHP) have shown differences from family-history-negative (FHN) individuals in the neural correlates of reward processing. FHP, compared to FHN individuals, demonstrate relatively diminished ventral striatal activation during anticipation of monetary rewards, and the degree of ventral striatal activation shows an inverse correlation with specific impulsivity measures in alcohol-dependent individuals. Rewards in socially interactive contexts relate importantly to addictive propensities, yet have not been examined with respect to how their neural underpinnings relate to impulsivity-related measures. Here we describe impulsivity measures in FHN and FHP individuals as they relate to a socially interactive functional magnetic resonance imaging (fMRI) task.

Methods

Forty FHP and 29 FHN subjects without histories of Axis-I disorders completed a socially interactive Domino task during functional magnetic resonance imaging and completed self-report and behavioral impulsivity-related assessments.

Results

FHP compared to FHN individuals showed higher scores (p = .004) on one impulsivity-related factor relating to both compulsivity (Padua Inventory) and reward/punishment sensitivity (Sensitivity to Punishment/Sensitivity to Reward Questionnaire). Multiple regression analysis within a reward-related network revealed a correlation between risk-taking (involving another impulsivity-related factor, the Balloon Analog Risk Task (BART)) and right ventral striatum activation under reward >punishment contrast (p<0.05 FWE corrected) in the social task.

Conclusions

Behavioral risk-taking scores may be more closely associated with neural correlates of reward responsiveness in socially interactive contexts than are FH status or impulsivity-related self-report measures. These findings suggest that risk-taking assessments be examined further in socially interactive settings relevant to addictive behaviors.

Ventral striatum lesions enhance stimulus and response encoding in dorsal striatum

BACKGROUND

The development of addiction is thought to reflect a transition from goal-directed to stimulus-response driven behavior, functions attributed to ventral (VS) and dorsal striatum (DS), respectively. In line with this theory, neuroadaptations that occur during prolonged drug use progress from VS to DS. Here we ask if VS dysfunction alone, independent of drug use, can affect neural selectivity in DS.

METHODS

To address this issue, we recorded from single neurons in DS while rats performed an odor-guided choice task for differently valued rewards in rats with and without unilateral VS lesions. In a separate group of animals, we used bilateral VS lesions to determine if VS was critical for performance on this task.

RESULTS

We describe data showing that unilateral lesions of VS enhance neural representations in DS during performance of a task that is dependent on VS. Furthermore, we show that VS is critical for reward-guided decision-making initially, but that rats regain function after several days.

CONCLUSIONS

These results suggest that loss of VS function, independent of chronic drug use, can trigger stronger encoding in DS in a reward-guided decision-making task and that the transition from VS to DS governed behavior observed in addiction might be due, in part, to initial loss of VS function.

Proactive selective response suppression is implemented via the basal ganglia

In the welter of everyday life, people can stop particular response tendencies without affecting others. A key requirement for such selective suppression is that subjects know in advance which responses need stopping. We hypothesized that proactively setting up and implementing selective suppression relies on the basal ganglia and, specifically, regions consistent with the inhibitory indirect pathway for which there is scant functional evidence in humans. Consistent with this hypothesis, we show, first, that the degree of proactive motor suppression when preparing to stop selectively (indexed by transcranial magnetic stimulation) corresponds to striatal, pallidal, and frontal activation (indexed by functional MRI). Second, we demonstrate that greater striatal activation at the time of selective stopping correlates with greater behavioral selectivity. Third, we show that people with striatal and pallidal volume reductions (those with premanifest Huntington's disease) have both absent proactive motor suppression and impaired behavioral selectivity when stopping. Thus, stopping goals are used to proactively set up specific basal ganglia channels that may then be triggered to implement selective suppression. By linking this suppression to the striatum and pallidum, these results provide compelling functional evidence in humans of the basal ganglia's inhibitory indirect pathway.