Consolidation of Goal-Directed Action Depends on MAPK/ERK Signaling in Rodent Prelimbic Cortex

Hyperactivation of MEK1 in cortical glutamatergic neurons results in projection axon deficits and aberrant motor learning

Abnormal extracellular signal-regulated kinase 1/2 (ERK1/2, encoded by Mapk3 and Mapk1, respectively) signaling is linked to multiple neurodevelopmental diseases, especially the RASopathies, which typically exhibit ERK1/2 hyperactivation in neurons and non-neuronal cells. To better understand how excitatory neuron-autonomous ERK1/2 activity regulates forebrain development, we conditionally expressed a hyperactive MEK1 (MAP2K1) mutant, MEK1S217/221E, in cortical excitatory neurons of mice. MEK1S217/221E expression led to persistent hyperactivation of ERK1/2 in cortical axons, but not in soma/nuclei. We noted reduced axonal arborization in multiple target domains in mutant mice and reduced the levels of the activity-dependent protein ARC. These changes did not lead to deficits in voluntary locomotion or accelerating rotarod performance. However, skilled motor learning in a single-pellet retrieval task was significantly diminished in these MEK1S217/221E mutants. Restriction of MEK1S217/221E expression to layer V cortical neurons recapitulated axonal outgrowth deficits but did not affect motor learning. These results suggest that cortical excitatory neuron-autonomous hyperactivation of MEK1 is sufficient to drive deficits in axon outgrowth, which coincide with reduced ARC expression, and deficits in skilled motor learning. Our data indicate that neuron-autonomous decreases in long-range axonal outgrowth may be a key aspect of neuropathogenesis in RASopathies.

What Role Does Striatal Dopamine Play in Goal-directed Action?

Evidence suggests that dopamine activity provides a US-related prediction error for Pavlovian conditioning and the reinforcement signal supporting the acquisition of habits. However, its role in goal-directed action is less clear. There are currently few studies that have assessed dopamine release as animals acquire and perform self-paced instrumental actions. Here we briefly review the literature documenting the psychological, behavioral and neural bases of goal-directed actions in rats and mice, before turning to describe recent studies investigating the role of dopamine in instrumental learning and performance. Plasticity in dorsomedial striatum, a central node in the network supporting goal-directed action, clearly requires dopamine release, the timing of which, relative to cortical and thalamic inputs, determines the degree and form of that plasticity. Beyond this, bilateral release appears to reflect reward prediction errors as animals experience the consequences of an action. Such signals feedforward to update the value of the specific action associated with that outcome during subsequent performance, with dopamine release at the time of action reflecting the updated predicted action value. More recently, evidence has also emerged for a hemispherically lateralised signal associated with the action; dopamine release is greater in the hemisphere contralateral to the spatial target of the action. This effect emerges over the course of acquisition and appears to reflect the strength of the action-outcome association. Thus, during goal-directed action, dopamine release signals the action, the outcome and their association to shape the learning and performance processes necessary to support this form of behavioral control.

Contribution of dorsal versus ventral hippocampus to the hierarchical modulation of goal-directed actions in rats

Adaptive behaviour often necessitates that animals learn about events in a manner that is specific to a particular context or environment. These hierarchical organisations allow the animal to decide which action is the most appropriate when faced with ambiguous or conflicting possibilities. This study examined the role of hippocampus in enabling animals to use the context to guide action selection. We used a hierarchical instrumental outcome devaluation task in which male rats learn that the context provides information about the unique action-outcome relations that are in effect. We first confirmed that rats encode and use hierarchical context-(action-outcome) relations. We then show that chemogenetic inhibition of ventral hippocampus impairs both the encoding and retrieval of these associations, while inhibition of dorsal hippocampus impairs only the retrieval. Importantly, neither dorsal nor ventral hippocampus was required for goal-directed behaviour per se as these impairments only emerged when rats were forced to use the context to identify the current action-outcome relationships. These findings are discussed with respect to the role of the hippocampus and its broader circuitry in the contextual modulation of goal-directed behaviour and the importance of hierarchical associations in flexible behaviour.

Cognitive dysfunction and increased phosphorylated tau are associated with reduced O-GlcNAc signaling in an aging mouse model of metabolic syndrome

Metabolic syndrome (MetS), characterized by hyperglycemia, obesity, and hyperlipidemia, can increase the risk of developing late-onset dementia. Recent studies in patients and mouse models suggest a putative link between hyperphosphorylated tau, a component of Alzheimer's disease-related dementia (ADRD) pathology, and cerebral glucose hypometabolism. Impaired glucose metabolism reduces glucose flux through the hexosamine metabolic pathway triggering attenuated O-linked N-acetylglucosamine (O-GlcNAc) protein modification. The goal of the current study was to investigate the link between cognitive function, tau pathology, and O-GlcNAc signaling in an aging mouse model of MetS, agouti KKAy+/- . Male and female C57BL/6, non-agouti KKAy-/- , and agouti KKAy+/- mice were aged 12-18 months on standard chow diet. Body weight, blood glucose, total cholesterol, and triglyceride were measured to confirm the MetS phenotype. Cognition, sensorimotor function, and emotional reactivity were assessed for each genotype followed by plasma and brain tissue collection for biochemical and molecular analyses. Body weight, blood glucose, total cholesterol, and triglyceride levels were significantly elevated in agouti KKAy+/- mice versus C57BL/6 controls and non-agouti KKAy-/- . Behaviorally, agouti KKAy+/- revealed impairments in sensorimotor and cognitive function versus age-matched C57BL/6 and non-agouti KKAy-/- mice. Immunoblotting demonstrated increased phosphorylated tau accompanied with reduced O-GlcNAc protein expression in hippocampal-associated dorsal midbrain of female agouti KKAy+/- versus C57BL/6 control mice. Together, these data demonstrate that impaired cognitive function and AD-related pathology are associated with reduced O-GlcNAc signaling in aging MetS KKAy+/- mice. Overall, our study suggests that interaction of tau pathology with O-GlcNAc signaling may contribute to MetS-induced cognitive dysfunction in aging.

Inhibition of noradrenergic signalling in rodent orbitofrontal cortex impairs the updating of goal-directed actions

In a constantly changing environment, organisms must track the current relationship between actions and their specific consequences and use this information to guide decision-making. Such goal-directed behaviour relies on circuits involving cortical and subcortical structures. Notably, a functional heterogeneity exists within the medial prefrontal, insular, and orbitofrontal cortices (OFC) in rodents. The role of the latter in goal-directed behaviour has been debated, but recent data indicate that the ventral and lateral subregions of the OFC are needed to integrate changes in the relationships between actions and their outcomes. Neuromodulatory agents are also crucial components of prefrontal functions and behavioural flexibility might depend upon the noradrenergic modulation of the prefrontal cortex. Therefore, we assessed whether noradrenergic innervation of the OFC plays a role in updating action-outcome relationships in male rats. We used an identity-based reversal task and found that depletion or chemogenetic silencing of noradrenergic inputs within the OFC rendered rats unable to associate new outcomes with previously acquired actions. Silencing of noradrenergic inputs in the prelimbic cortex or depletion of dopaminergic inputs in the OFC did not reproduce this deficit. Together, our results suggest that noradrenergic projections to the OFC are required to update goal-directed actions.

Long-term memory, synaptic plasticity and dopamine in rodent medial prefrontal cortex: Role in executive functions

Mnemonic functions, supporting rodent behavior in complex tasks, include both long-term and (short-term) working memory components. While working memory is thought to rely on persistent activity states in an active neural network, long-term memory and synaptic plasticity contribute to the formation of the underlying synaptic structure, determining the range of possible states. Whereas, the implication of working memory in executive functions, mediated by the prefrontal cortex (PFC) in primates and rodents, has been extensively studied, the contribution of long-term memory component to these tasks received little attention. This review summarizes available experimental data and theoretical work concerning cellular mechanisms of synaptic plasticity in the medial region of rodent PFC and the link between plasticity, memory and behavior in PFC-dependent tasks. A special attention is devoted to unique properties of dopaminergic modulation of prefrontal synaptic plasticity and its contribution to executive functions.

Central Thalamic-Medial Prefrontal Control of Adaptive Responding in the Rat: Many Players in the Chamber

The medial prefrontal cortex (mPFC) has robust afferent and efferent connections with multiple nuclei clustered in the central thalamus. These nuclei are elements in large-scale networks linking mPFC with the hippocampus, basal ganglia, amygdala, other cortical areas, and visceral and arousal systems in the brainstem that give rise to adaptive goal-directed behavior. Lesions of the mediodorsal nucleus (MD), the main source of thalamic input to middle layers of PFC, have limited effects on delayed conditional discriminations, like DMTP and DNMTP, that depend on mPFC. Recent evidence suggests that MD sustains and amplifies neuronal responses in mPFC that represent salient task-related information and is important for detecting and encoding contingencies between actions and their consequences. Lesions of rostral intralaminar (rIL) and ventromedial (VM) nuclei produce delay-independent impairments of egocentric DMTP and DNMTP that resemble effects of mPFC lesions on response speed and accuracy: results consistent with projections of rIL to striatum and VM to motor cortices. The ventral midline and anterior thalamic nuclei affect allocentric spatial cognition and memory consistent with their connections to mPFC and hippocampus. The dorsal midline nuclei spare DMTP and DNMTP. They have been implicated in behavioral-state control and response to salient stimuli in associative learning. mPFC functions are served during DNMTP by discrete populations of neurons with responses related to motor preparation, movements, lever press responses, reinforcement anticipation, reinforcement delivery, and memory delay. Population analyses show that different responses are timed so that they effectively tile the temporal interval from when DNMTP trials are initiated until the end. Event-related responses of MD neurons during DNMTP are predominantly related to movement and reinforcement, information important for DNMTP choice. These responses closely mirror the activity of mPFC neurons with similar responses. Pharmacological inactivation of MD and adjacent rIL affects the expression of diverse action- and outcome-related responses of mPFC neurons. Lesions of MD before training are associated with a shift away from movement-related responses in mPFC important for DNMTP choice. These results suggest that MD has short-term effects on the expression of event-related activity in mPFC and long-term effects that tune mPFC neurons to respond to task-specific information.

Whole-Brain Mapping of Direct Inputs to Dopamine D1 and D2 Receptor-Expressing Medium Spiny Neurons in the Posterior Dorsomedial Striatum

The posterior dorsomedial striatum (pDMS) is mainly composed of medium spiny neurons (MSNs) expressing either dopamine D1 receptors (D1Rs) or D2Rs. Activation of these two MSN types produces opposing effects on addictive behaviors. However, it remains unclear whether pDMS D1-MSNs or D2-MSNs receive afferent inputs from different brain regions or whether the extrastriatal afferents express distinct dopamine receptors. To assess whether these afferents also contained D1Rs or D2Rs, we generated double transgenic mice, in which D1R-expressing and D2R-expressing neurons were fluorescently labeled. We used rabies virus-mediated retrograde tracing in these mice to perform whole-brain mapping of direct inputs to D1-MSNs or D2-MSNs in the pDMS. We found that D1-MSNs preferentially received inputs from the secondary motor, secondary visual, and cingulate cortices, whereas D2-MSNs received inputs from the primary motor and primary sensory cortices, and the thalamus. We also discovered that the bed nucleus of the stria terminalis (BNST) and the central nucleus of the amygdala (CeA) contained abundant D2R-expressing, but few D1R-expressing, neurons in a triple transgenic mouse model. Remarkably, although limited D1R or D2R expression was observed in extrastriatal neurons that projected to D1-MSNs or D2-MSNs, we found that cortical structures preferentially contained D1R-expressing neurons that projected to D1-MSNs or D2-MSNs, while the thalamus, substantia nigra pars compacta (SNc), and BNST had more D2R-expressing cells that projected to D2-MSNs. Taken together, these findings provide a foundation for future understanding of the pDMS circuit and its role in action selection and reward-based behaviors.

Prefrontal regulation of behavioural control: Evidence from learning theory and translational approaches in rodents

Everyday activities require adaptive decision-making and control over our actions to achieve our goals. Sub-regions within the cortex are widely reported to regulate these choices. Here we review rodent studies from two disparate fields of instrumental action control - goal-directed and habitual responding, and impulsive and compulsive behaviour. Our aim was to compare findings across the spectrum, from precision associative learning to translational studies of action control. The evidence suggests that each cortical sub-region performs different roles depending on task requirements and, within tasks, clear dissociations exist between regions. Rather than synthesizing a single role or function for a given region, we should consider regions to be capable of many different functions. Further investigation of cortico-cortical connections and the pattern of input and output circuitry within each region may be needed to identify unique process-specific pathways. Despite differences in the scope and purpose of these two fields, integrating evidence across tasks provides a broader context for testing hypotheses about the role of cortical regions in adaptive actions and decision-making.

Prolonged avoidance training exacerbates OCD-like behaviors in a rodent model

Obsessive-compulsive disorder (OCD) is characterized by compulsive behaviors that often resemble avoidance of perceived danger. OCD can be treated with exposure-with-response prevention (ERP) therapy in which patients are exposed to triggers but are encouraged to refrain from compulsions, to extinguish compulsive responses. The compulsions of OCD are strengthened by many repeated exposures to triggers, but little is known about the effects of extended repetition of avoidance behaviors on extinction. Here we assessed the extent to which overtraining of active avoidance affects subsequent extinction-with-response prevention (Ext-RP) as a rodent model of ERP, in which rats are extinguished to triggers, while the avoidance option is prevented. Male rats conditioned for 8d or 20d produced similar avoidance behavior to a tone paired with a shock, however, the 20d group showed a severe impairment of extinction during Ext-RP, as well as heightened anxiety. Furthermore, the majority of overtrained (20d) rats (75%) exhibited persistent avoidance following Ext-RP. In the 8d group, only a minority of rats (37%) exhibited persistent avoidance, and this was associated with elevated activity (c-Fos) in the prelimbic cortex and nucleus accumbens. In the 20d group, the minority of non-persistent rats (25%) showed elevated activity in the insular-orbital cortex and paraventricular thalamus. Lastly, extending the duration of Ext-RP prevented the deleterious effects of overtraining on extinction and avoidance. These rodent findings suggest that repeated expression of compulsion-like behaviors biases individuals toward persistent avoidance and alters avoidance circuits, thereby reducing the effectiveness of current extinction-based therapies.

Involvement of the rodent prelimbic and medial orbitofrontal cortices in goal-directed action: A brief review

Goal-directed action refers to selecting behaviors based on the expectation that they will be reinforced with desirable outcomes. It is typically conceptualized as opposing habit-based behaviors, which are instead supported by stimulus-response associations and insensitive to consequences. The prelimbic prefrontal cortex (PL) is positioned along the medial wall of the rodent prefrontal cortex. It is indispensable for action-outcome-driven (goal-directed) behavior, consolidating action-outcome relationships and linking contextual information with instrumental behavior. In this brief review, we will discuss the growing list of molecular factors involved in PL function. Ventral to the PL is the medial orbitofrontal cortex (mOFC). We will also summarize emerging evidence from rodents (complementing existing literature describing humans) that it too is involved in action-outcome conditioning. We describe experiments using procedures that quantify responding based on reward value, the likelihood of reinforcement, or effort requirements, touching also on experiments assessing food consumption more generally. We synthesize these findings with the argument that the mOFC is essential to goal-directed action when outcome value information is not immediately observable and must be recalled and inferred.

The Meaning of Behavior: Discriminating Reflex and Volition in the Brain

The ability to establish behaviorally what psychological capacity an animal is deploying-to discern accurately what an animal is doing-is key to functional analyses of the brain. Our current understanding of these capacities suggests, however, that this task is complex; there is evidence that multiple capacities are engaged simultaneously and contribute independently to the control of behavior. As such, establishing the contribution of a cell, circuit, or neural system to any one function requires careful dissection of that role from its influence on other functions and, therefore, the careful selection and design of behavioral tasks fit for that purpose. Here I describe recent research that has sought to utilize behavioral tools to investigate the neural bases of instrumental conditioning, particularly the circuits and systems supporting the capacity for goal-directed action, as opposed to conditioned reflexes and habits, and how these sources of action control interact to generate adaptive behavior.

Dopamine D1 and Glutamate Receptors Co-operate With Brain-Derived Neurotrophic Factor (BDNF) and TrkB to Modulate ERK Signaling in Adult Striatal Slices

In the striatum, the input nucleus of the basal ganglia, the extracellular-signal-regulated kinase (ERK) pathway, necessary for various forms of behavioral plasticity, is triggered by the combined engagement of dopamine D1 and ionotropic glutamate receptors. In this study, we investigated the potential crosstalk between glutamatergic, dopaminergic, and brain-derived neurotrophic factor (BDNF)-TrkB inputs to ERK cascade by using an ex vivo model of mouse striatal slices. Our results confirmed that the concomitant stimulation of D1 and glutamate receptors is necessary to activate ERK in striatal medium spiny neurons (MSNs). Moreover, we found that ERK activation is significantly enhanced when BDNF is co-applied either with glutamate or the D1 agonist SKF38393, supporting the idea of possible integration between BDNF, glutamate, and D1R-mediated signaling. Interestingly, ERK activation via BDNF-TrkB is upregulated upon blockade of either AMPAR/NMDAR or D1 receptors, suggesting a negative regulatory action of these two neurotransmitter systems on BDNF-mediated signaling. However, the observed enhancement of ERK1/2 phosphorylation does not result in corresponding downstream signaling changes at the nuclear level. Conversely, the TrkB antagonist cyclotraxin B partially prevents glutamate- and D1-mediated ERK activation. Altogether, these results suggest a complex and unexpected interaction among dopaminergic, glutamatergic, and BDNF receptor systems to modulate the ERK pathway in striatal neurons.

β1-Integrins in the Developing Orbitofrontal Cortex Are Necessary for Expectancy Updating in Mice

Navigating a changing environment requires associating stimuli and actions with their likely outcomes and modifying these associations when they change. These processes involve the orbitofrontal cortex (OFC). Although some molecular mediators have been identified, developmental factors are virtually unknown. We hypothesized that the cell adhesion factor β1-integrin is essential to OFC function, anticipating developmental windows during which β1-integrins might be more influential than others. We discovered that OFC-selective β1-integrin silencing before adolescence, but not later, impaired the ability of mice to extinguish conditioned fear and select actions based on their likely outcomes. Early-life knock-down also reduced the densities of dendritic spines, the primary sites of excitatory plasticity in the brain, and weakened sensitivity to cortical inputs. Notwithstanding these defects in male mice, females were resilient to OFC (but not hippocampal) β1-integrin loss. Existing literature suggests that resilience may be explained by estradiol-mediated transactivation of β1-integrins and tropomyosin receptor kinase B (trkB). Accordingly, we discovered that a trkB agonist administered during adolescence corrected reward-related decision making in β1-integrin-deficient males. In sum, developmental β1-integrins are indispensable for OFC function later in life.SIGNIFICANCE STATEMENT The orbitofrontal cortex (OFC) is a subregion of the frontal cortex that allows organisms to link behaviors and stimuli with anticipated outcomes, and to make predictions about the consequences of one's behavior. Aspects of OFC development are particularly prolonged, extending well into adolescence, likely optimizing organisms' abilities to prospectively calculate the consequences of their actions and select behaviors appropriately; these decision making strategies improve as young individuals mature into adulthood. Molecular factors are not, however, well understood. Our experiments reveal that a cell adhesion protein termed "β1-integrin" is necessary for OFC neuronal maturation and function. Importantly, β1-integrins operate during a critical period equivalent to early adolescence in humans to optimize the ability of organisms to update expectancies later in life.

From learning to action: the integration of dorsal striatal input and output pathways in instrumental conditioning

Considerable evidence suggests that the learning and performance of instrumental actions depend on activity in basal ganglia circuitry; however, these two functions have generally been considered independently. Whereas research investigating the associative mechanisms underlying instrumental conditioning has identified critical cortical and limbic input pathways to the dorsal striatum, the performance of instrumental actions has largely been attributed to activity in the dorsal striatal output pathways, with direct and indirect pathway projection neurons mediating action initiation, perseveration and cessation. Here, we discuss evidence that the dorsal striatal input and basal ganglia output pathways mediate the learning and performance of instrumental actions, respectively, with the dorsal striatum functioning as a transition point. From this perspective, the issue of how multiple striatal inputs are integrated at the level of the dorsal striatum and converted into relatively restricted outputs becomes one of critical significance for understanding how learning is translated into action. So too does the question of how learning signals are modulated by recent experience. We propose that this occurs through recurrent corticostriatothalamic feedback circuits that serve to integrate performance signals by updating ongoing action-related learning.

Insular and Ventrolateral Orbitofrontal Cortices Differentially Contribute to Goal-Directed Behavior in Rodents

The medial prefrontal cortex (mPFC) has long been considered a critical site in action control. However, recent evidence indicates that the contribution of cortical areas to goal-directed behavior likely extends beyond mPFC. Here, we examine the function of both insular (IC) and ventrolateral orbitofrontal (vlOFC) cortices in action-dependent learning. We used chemogenetics to study the consequences of IC or vlOFC inhibition on acquisition and performance of instrumental actions using the outcome devaluation task. Rats first learned to associate actions with desirable outcomes. Then, one of these outcomes was devalued and we assessed the rats' choice between the 2 actions. Typically, rats will bias their selection towards the action that delivers the still valued outcome. We show that chemogenetic-induced inhibition of IC during choice abolishes goal-directed control whereas inhibition during instrumental acquisition is without effect. IC is therefore necessary for action selection based on current outcome value. By contrast, vlOFC inhibition during acquisition or the choice test impaired goal-directed behavior but only following a shift in the instrumental contingencies. Our results provide clear evidence that vlOFC plays a critical role in action-dependent learning, which challenges the popular idea that this region of OFC is exclusively involved in stimulus-dependent behaviors.

The Bilateral Prefronto-striatal Pathway Is Necessary for Learning New Goal-Directed Actions

The acquisition of new goal-directed actions requires the encoding of action-outcome associations. At a neural level, this encoding has been hypothesized to involve a prefronto-striatal circuit extending between the prelimbic cortex (PL) and the posterior dorsomedial striatum (pDMS); however, no research identifying this pathway with any precision has been reported. We started by mapping the prelimbic input to the dorsal and ventral striatum using a combination of retrograde and anterograde tracing with CLARITY and established that PL-pDMS projections share some overlap with projections to the nucleus accumbens core (NAc) in rats. We then tested whether each of these pathways were functionally required for goal-directed learning; we used a pathway-specific dual-virus chemogenetic approach to selectively silence pDMS-projecting or NAc-projecting PL neurons during instrumental training and tested rats for goal-directed action. We found that silencing PL-pDMS projections abolished goal-directed learning, whereas silencing PL-NAc projections left goal-directed learning intact. Finally, we used a three-virus approach to silence bilateral and contralateral pDMS-projecting PL neurons and again blocked goal-directed learning. These results establish that the acquisition of new goal-directed actions depends on the bilateral PL-pDMS pathway driven by intratelencephalic cortical neurons.

Thalamocortical and corticothalamic pathways differentially contribute to goal-directed behaviors in the rat

Highly distributed neural circuits are thought to support adaptive decision-making in volatile and complex environments. Notably, the functional interactions between prefrontal and reciprocally connected thalamic nuclei areas may be important when choices are guided by current goal value or action-outcome contingency. We examined the functional involvement of selected thalamocortical and corticothalamic pathways connecting the dorsomedial prefrontal cortex (dmPFC) and the mediodorsal thalamus (MD) in the behaving rat. Using a chemogenetic approach to inhibit projection-defined dmPFC and MD neurons during an instrumental learning task, we show that thalamocortical and corticothalamic pathways differentially support goal attributes. Both pathways participate in adaptation to the current goal value, but only thalamocortical neurons are required to integrate current causal relationships. These data indicate that antiparallel flow of information within thalamocortical circuits may convey qualitatively distinct aspects of adaptive decision-making and highlight the importance of the direction of information flow within neural circuits.

Planning and decision-making rely upon a region of the brain called the prefrontal cortex. But the prefrontal cortex does not act in isolation. Instead, it works together with a number of other brain regions. These include the thalamus, an area long thought to pass information on to the cortex for further processing. But signals also travel in the opposite direction, from the cortex back to the thalamus. Does the cortex-to-thalamus pathway carry the same information as the thalamus-to-cortex pathway?

To find out, Alcaraz et al. blocked each pathway in rats performing a decision-making task. The rats had learned that pressing a lever led to one type of reward, whereas moving a rod led to another. Alcaraz et al. reduced the desirability of one of the rewards by giving the rats free access to it for an hour. Afterwards, the rats opted mainly for the action associated with the reward that had remained desirable. However, blocking either the thalamus-to-cortex or cortex-to-thalamus pathway prevented this preference from emerging. This suggests that an information flow in both directions is necessary to update knowledge about the value of a reward.

In a second experiment, Alcaraz et al. removed the link between one of the actions and its reward. The reward instead appeared at random, irrespective of the rat’s own behavior. Control rats responded by focusing their efforts on the action that still delivered a reliable reward, and by performing the other action less often. Blocking the thalamus-to-cortex pathway prevented this response, but blocking the cortex-to-thalamus pathway did not. This suggests that only the former pathway is necessary to re-evaluate the relationship between an action and an outcome.

Two key aspects of goal-directed behavior – recognizing the value of a reward and the link between an action and an outcome – thus depend differently on the thalamus-to-cortex and cortex-to-thalamus pathways. This same principle may also be at work in other neural circuits with bidirectional connections. Understanding such principles may lead to better strategies for treating disorders of brain connectivity, such as schizophrenia.

Prefrontal Corticostriatal Disconnection Blocks the Acquisition of Goal-Directed Action

The acquisition of goal-directed action requires encoding of the association between an action and its specific consequences or outcome. At a neural level, this encoding has been hypothesized to involve a prefrontal corticostriatal circuit involving the projection from the prelimbic cortex (PL) to the posterior dorsomedial striatum (pDMS); however, no direct evidence for this claim has been reported. In a series of experiments, we performed functional disconnection of this pathway using targeted lesions of the anterior corpus callosum to disrupt contralateral corticostriatal projections with asymmetrical lesions of the PL and/or pDMS to block plasticity in this circuit in rats. We first demonstrated that unilaterally blocking the PL input to the pDMS prevented the phosphorylation of extracellular signal-related kinase/mitogen activated protein kinase (pERK/pMAPK) induced by instrumental training. Next, we used a full bilateral disconnection of the PL from the pDMS and assessed goal-directed action using an outcome-devaluation test. Importantly, we found evidence that rats maintaining an ipsilateral and/or contralateral connection between the PL and the pDMS were able to acquire goal-directed actions. In contrast, bilateral PL-pDMS disconnection abolished the acquisition of goal-directed actions. Finally, we used a temporary pharmacological disconnection to disrupt PL inputs to the pDMS by infusing the NMDA antagonist dl-2-amino-5-phosphonopentanoic acid into the pDMS during instrumental training and found that this manipulation also disrupted goal-directed learning. These results establish that, in rats, the acquisition of new goal-directed actions depends on a prefrontal-corticostriatal circuit involving a connection between the PL and the pDMS.SIGNIFICANCE STATEMENT It has been hypothesized that the prelimbic cortex (PL) and posterior dorsomedial striatum (pDMS) in rodents interact in a corticostriatal circuit to mediate goal-directed learning. However, no direct evidence supporting this claim has been reported. Using targeted lesions, we performed functional disconnection of the PL-pDMS pathway to assess its role in goal-directed learning. In the first experiment, we demonstrated that PL input to the pDMS is necessary for instrumental training-induced neuronal activity. Next, we disrupted ipsilateral, contralateral, or bilateral PL-pDMS connections and found that only bilateral PL-pDMS disconnection disrupted the acquisition of goal-directed actions, a finding we replicated in our final study using a pharmacological disconnection procedure.

Inhibiting Rho kinase promotes goal-directed decision making and blocks habitual responding for cocaine

The prelimbic prefrontal cortex is necessary for associating actions with their consequences, enabling goal-directed decision making. We find that the strength of action–outcome conditioning correlates with dendritic spine density in prelimbic cortex, suggesting that new action–outcome learning involves dendritic spine plasticity. To test this, we inhibited the cytoskeletal regulatory factor Rho kinase. We find that the inhibitor fasudil enhances action–outcome memory, resulting in goal-directed behavior in mice that would otherwise express stimulus-response habits. Fasudil transiently reduces prelimbic cortical dendritic spine densities during a period of presumed memory consolidation, but only when paired with new learning. Fasudil also blocks habitual responding for cocaine, an effect that persists over time, across multiple contexts, and depends on actin polymerization. We suggest that Rho kinase inhibition promotes goal-oriented action selection by augmenting the plasticity of prelimbic cortical dendritic spines during the formation of new action–outcome memories.

Action-outcome learning requires the prelimbic prefrontal cortex. Here the authors report that fasudil, a Rho kinase inhibitor, reduces dendritic spine densities on prelimbic neurons in an activity-dependent manner, stimulating goal-directed actions, and reducing habitual responding for cocaine.

Successful pharmacotherapy for the treatment of severe feeding aversion with mechanistic insights from cross-species neuronal remodeling

Pediatric feeding disorders affect up to 5% of children, causing severe food intake problems that can result in serious medical and developmental outcomes. Behavioral intervention (BI) is effective in extinguishing feeding aversions, and also expert-dependent, time/labor-intensive and not well understood at a neurobiological level. Here we first conducted a double-blind, placebo-controlled trial comparing BI with BI plus d-cycloserine (DCS). DCS is a partial N-methyl-d-aspartate (NMDA) receptor agonist shown to augment extinction therapies in multiple anxiety disorders. We examined whether DCS enhanced extinction of feeding aversion in 15 children with avoidant/restrictive food intake disorder (ages 20-58 months). After five treatment days, BI improved feeding by 37%. By contrast, BI+DCS improved feeding by 76%. To gain insight into possible mechanisms of successful intervention, we next tested the neurobiological consequences of DCS in a murine model of feeding aversion and avoidance. In mice with conditioned food aversion, DCS enhanced avoidance extinction across a broad dose range. Confocal fluorescence microscopy and three-dimensional neuronal reconstruction indicated that DCS enlarged dendritic spine heads-the primary sites of excitatory plasticity in the brain-within the orbitofrontal prefrontal cortex, a sensory-cognition integration hub. DCS also increased phosphorylation of the plasticity-associated extracellular signal-regulated kinase 1/2. In summary, DCS successfully augments the extinction of food aversion in children and mice, an effect that may involve plasticity in the orbitofrontal cortex. These results warrant a larger-scale efficacy study of DCS for the treatment of pediatric feeding disorders and further investigations of neural mechanisms.