Endocannabinoid Modulation of Orbitostriatal Circuits Gates Habit Formation

Interfacing behavioral and neural circuit models for habit formation

Habits are an important mechanism by which organisms can automate the control of behavior to alleviate cognitive demand. However, transitions to habitual control are risky because they lead to inflexible responding in the face of change. The question of how the brain controls transitions into habit is thus an intriguing one. How do we regulate when our repeated actions become automated? When is it advantageous or disadvantageous to release actions from cognitive control? Decades of research have identified a variety of methods for eliciting habitual responding in animal models. Progress has also been made to understand which brain areas and neural circuits control transitions into habit. Here, I discuss existing research on behavioral and neural circuit models for habit formation (with an emphasis on striatal circuits), and discuss strategies for combining information from different paradigms and levels of analysis to prompt further progress in the field.

Lesion of striatal patches disrupts habitual behaviors and increases behavioral variability

Habits are automated behaviors that are insensitive to changes in behavioral outcomes. Habitual responding is thought to be mediated by the striatum, with medial striatum guiding goal-directed action and lateral striatum promoting habits. However, interspersed throughout the striatum are neurochemically differing subcompartments known as patches, which are characterized by distinct molecular profiles relative to the surrounding matrix tissue. These structures have been thoroughly characterized neurochemically and anatomically, but little is known regarding their function. Patches have been shown to be selectively activated during inflexible motor stereotypies elicited by stimulants, suggesting that patches may subserve habitual behaviors. To explore this possibility, we utilized transgenic mice (Sepw1 NP67) preferentially expressing Cre recombinase in striatal patch neurons to target these neurons for ablation with a virus driving Cre-dependent expression of caspase 3. Mice were then trained to press a lever for sucrose rewards on a variable interval schedule to elicit habitual responding. Mice were not impaired on the acquisition of this task, but lesioning striatal patches disrupted behavioral stability across training, and lesioned mice utilized a more goal-directed behavioral strategy during training. Similarly, when mice were forced to omit responses to receive sucrose rewards, habitual responding was impaired in lesioned mice. To rule out effects of lesion on motor behaviors, mice were then tested for impairments in motor learning on a rotarod and locomotion in an open field. We found that patch lesions partially impaired initial performance on the rotarod without modifying locomotor behaviors in open field. This work indicates that patches promote behavioral stability and habitual responding, adding to a growing literature implicating striatal patches in stimulus-response behaviors.

Action-Outcome Expectancies Require Orbitofrontal Neurotrophin Systems in Naïve and Cocaine-Exposed Mice

Cocaine use during adolescence decreases the likelihood that individuals will seek treatment for recurrent drug use. In rodents, developmental cocaine exposure weakens action-consequence decision-making, causing a deferral to familiar, habit-like behavioral response strategies. Here, we aimed to improve action-outcome decision-making. We found that acute pharmacological stimulation of the tyrosine/tropomyosin receptor kinase B (trkB) via 7,8-dihydroxyflavone (7,8-DHF) or 3,4-methylenedioxymethamphetamine (MDMA) blocked cocaine-induced habit biases by strengthening memory for action-outcome associations. We believe that MDMA acts by stimulating neurotrophin/trkB systems in the orbitofrontal cortex (OFC), a region involved in prospectively evaluating the consequences of one's action, because 1) MDMA also increased brain-derived neurotrophic factor (BDNF) in the OFC, 2) MDMA corrected habit biases due to Bdnf loss in the OFC, and 3) overexpression of a truncated isoform of trkB occluded the memory-enhancing effects of MDMA. Thus, selecting actions based on their consequences requires BDNF-trkB in the OFC, the stimulation of which may improve goal attainment in both drug-naïve and cocaine-exposed individuals. SIGNIFICANCE STATEMENT: Cocaine use during adolescence decreases the likelihood that individuals will seek treatment for recurrent drug use, even as adults. Understanding how early-life cocaine exposure impacts goal-oriented action and prospective decision-making in adulthood is thus important. One key aspect of goal-directed decision-making is anticipating the consequences of one's actions, a process that likely involves the orbitofrontal cortex (OFC). In rodents, developmental cocaine exposure weakens action-consequence decision-making, causing a deferral to familiar, habit-like behavioral response strategies. Here, we report that we can improve memory for action-consequence relationships by stimulating neurotrophic factors, which support cell survival, development, and plasticity in the brain. With strengthened action-consequence associations, cocaine-exposed mice regain the ability to optimally select actions based on their likely outcomes. Brain region-selective manipulations reveal that neurotrophin systems in the OFC are necessary for stable memory of action-consequence relationships.

Cannabis Improves Obsessive-Compulsive Disorder-Case Report and Review of the Literature

Although several lines of evidence support the hypothesis of a dysregulation of serotoninergic neurotransmission in the pathophysiology of obsessive-compulsive disorder (OCD), there is also evidence for an involvement of other pathways such as the GABAergic, glutamatergic, and dopaminergic systems. Only recently, data obtained from a small number of animal studies alternatively suggested an involvement of the endocannabinoid system in the pathophysiology of OCD reporting beneficial effects in OCD-like behavior after use of substances that stimulate the endocannabinoid system. In humans, until today, only two case reports are available reporting successful treatment with dronabinol (tetrahydrocannabinol, THC), an agonist at central cannabinoid CB1 receptors, in patients with otherwise treatment refractory OCD. In addition, data obtained from a small open uncontrolled trial using the THC analogue nabilone suggest that the combination of nabilone plus exposure-based psychotherapy is more effective than each treatment alone. These reports are in line with data from a limited number of case studies and small controlled trials in patients with Tourette syndrome (TS), a chronic motor and vocal tic disorder often associated with comorbid obsessive compulsive behavior (OCB), reporting not only an improvement of tics, but also of comorbid OCB after use of different kinds of cannabis-based medicines including THC, cannabis extracts, and flowers. Here we present the case of a 22-year-old male patient, who suffered from severe OCD since childhood and significantly improved after treatment with medicinal cannabis with markedly reduced OCD and depression resulting in a considerable improvement of quality of life. In addition, we give a review of current literature on the effects of cannabinoids in animal models and patients with OCD and suggest a cannabinoid hypothesis of OCD.

mTORC1 in the orbitofrontal cortex promotes habitual alcohol seeking

The mechanistic target of rapamycin complex 1 (mTORC1) plays an important role in dendritic translation and in learning and memory. We previously showed that heavy alcohol use activates mTORC1 in the orbitofrontal cortex (OFC) of rodents (Laguesse et al., 2017a). Here, we set out to determine the consequences of alcohol-dependent mTORC1 activation in the OFC. We found that inhibition of mTORC1 activity in the OFC attenuates alcohol seeking and restores sensitivity to outcome devaluation in rats that habitually seek alcohol. In contrast, habitual responding for sucrose was unaltered by mTORC1 inhibition, suggesting that mTORC1’s role in habitual behavior is specific to alcohol. We further show that inhibition of GluN2B in the OFC attenuates alcohol-dependent mTORC1 activation, alcohol seeking and habitual responding for alcohol. Together, these data suggest that the GluN2B/mTORC1 axis in the OFC drives alcohol seeking and habit.

Cerebellar alterations in cannabis users: A systematic review

Cannabis is the most used illicit substance in the world. As many countries are moving towards decriminalization, it is crucial to determine whether and how cannabis use affects human brain and behavior. The role of the cerebellum in cognition, emotion, learning, and addiction is increasingly recognized. Because of its high density in CB1 receptors, it is expected to be highly affected by cannabis use. The aim of this systematic review is to investigate how cannabis use affects cerebellar structure and function, as well as cerebellar-dependent behavioral tasks. Three databases were searched for peer-reviewed literature published until March 2018. We included studies that focused on cannabis effects on cerebellar structure, function, or cerebellar-dependent behavioral tasks. A total of 348 unique records were screened, and 40 studies were included in the qualitative synthesis. The most consistent findings include (1) increases in cerebellar gray matter volume after chronic cannabis use, (2) alteration of cerebellar resting state activity after acute or chronic use, and (3) deficits in memory, decision making, and associative learning. Age of onset and higher exposure to cannabis use were frequently associated with increased cannabis-induced alterations. Chronic cannabis use is associated with alterations in cerebellar structure and function, as well as with deficits in behavioral paradigms that involve the cerebellum (eg, eyeblink conditioning, memory, and decision making). Future studies should consider tobacco as confounding factor and use standardized methods for assessing cannabis use. Paradigms exploring the functional activity of the cerebellum may prove useful as monitoring tools of cannabis-induced impairment.

Fractionating the all-or-nothing definition of goal-directed and habitual decision-making

Goal-directed and habitual decision-making are fundamental processes that support the ongoing adaptive behavior. There is a growing interest in examining their disruption in psychiatric disease, often with a focus on a disease shifting control from one process to the other, usually a shift from goal-directed to habitual control. However, several different experimental procedures can be used to probe whether decision-making is under goal-directed or habitual control, including outcome devaluation and contingency degradation. These different experimental procedures may recruit diverse behavioral and neural processes. Thus, there are potentially many opportunities for these disease phenotypes to manifest as alterations to both goal-directed and habitual controls. In this review, we highlight the examples of behavioral and neural circuit divergence and similarity, and suggest that interpretation based on behavioral processes recruited during testing may leave more room for goal-directed and habitual decision-making to coexist. Furthermore, this may improve our understanding of precisely what the involved neural mechanisms underlying aspects of goal-directed and habitual behavior are, as well as how disease affects behavior and these circuits.

Goal-directed control on interval schedules does not depend on the action-outcome correlation

When an organism's action is based on an anticipation of its consequences, that action is said to be goal-directed. It has long been thought that goal-directed control is made possible by experiencing a strong correlation between response rates and reward rates (Dickinson, 1985). To test this idea, we designed a set of experiments to determine whether the response rate-reward rate correlation is a reliable predictor of goal-directed control on interval schedules. In Experiment 1, rats were trained on random interval (RI) schedules in which the response rate-reward rate correlation was manipulated across groups. In tests of reward devaluation, rats behaved in a goal-directed manner regardless of the experienced correlation. In Experiment 2, rats once again experienced either a strong or weak correlation, but on RI schedules with lower overall reward densities. This time, behavior appeared habitual regardless of the experienced correlation. Experiment 3 confirmed that the density of the RI schedule influences goal-directed control, and also revealed that extensive training on these schedules resulted in goal-directed action. Finally, in Experiment 4 goal-directed responding was greater and emerged sooner on fixed than random interval schedules, but, again, was manifest after extensive training on the RI schedule. Taken together, our data suggest that goal-directed and habitual control are not determined by the correlation between response rates and reward rates. We discuss the importance of temporal uncertainty, action-outcome contiguity, and reinforcement probability in goal-directed control. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Acute alcohol and cognition: Remembering what it causes us to forget

Addiction has been conceptualized as a specific form of memory that appropriates typically adaptive neural mechanisms of learning to produce the progressive spiral of drug-seeking and drug-taking behavior, perpetuating the path to addiction through aberrant processes of drug-related learning and memory. From that perspective, to understand the development of alcohol use disorders, it is critical to identify how a single exposure to alcohol enters into or alters the processes of learning and memory, so that involvement of and changes in neuroplasticity processes responsible for learning and memory can be identified early. This review characterizes the effects produced by acute alcohol intoxication as a function of brain region and memory neurocircuitry. In general, exposure to ethanol doses that produce intoxicating effects causes consistent impairments in learning and memory processes mediated by specific brain circuitry, whereas lower doses either have no effect or produce a facilitation of memory under certain task conditions. Therefore, acute ethanol does not produce a global impairment of learning and memory, and can actually facilitate particular types of memory, perhaps particular types of memory that facilitate the development of excessive alcohol use. In addition, the effects on cognition are dependent on brain region, task demands, dose received, pharmacokinetics, and tolerance. Additionally, we explore the underlying alterations in neurophysiology produced by acute alcohol exposure that help to explain these changes in cognition and highlight future directions for research. Through understanding the impact that acute alcohol intoxication has on cognition, the preliminary changes potentially causing a problematic addiction memory can better be identified.

Aberrant habit formation in the Sapap3-knockout mouse model of obsessive-compulsive disorder

Motor behavior can be executed deliberately to achieve specific goals. With repetition, such behavior can become habitual and noncontingent on actions-outcomes. The formation of habits is a natural process that can become pathological, such as in obsessive-compulsive disorder (OCD). The present study used the Sapap3-knockout (KO) mouse model of OCD to assess habit formation based on reward devaluation. We also tested wildtype mice under different training and food-restriction schedules to assess the extent of natural habit formation. We found that Sapap3-KO mice were insensitive to the devaluation of a sucrose reward under conditions in which wildtype littermates were sensitive to devaluation. Moreover, food restriction favored goal-directed action in wildtype mice, whereas mice that were fed ad libitum were more likely to form habitual behavior but nevertheless maintained partly goal-directed lever-press behavior. In conclusion, only Sapap3-KO mice developed behavior that was fully insensitive to reward devaluation, suggesting that pathological habits in OCD patients are recapitulated in the present Sapap3-KO mouse model. In wildtype mice, the extent of habit formation was influenced by the state of satiety during training and the reinforcement schedule.

The Bed Nucleus of the Stria Terminalis, Homeostatic Satiety, and Compulsions: What Can We Learn From Polydipsia?

A compulsive phenotype characterizes several neuropsychiatric illnesses - including but not limited to - schizophrenia and obsessive compulsive disorder. Because of its perceived etiological heterogeneity, it is challenging to disentangle the specific neurophysiology that precipitates compulsive behaving. Using polydipsia (or non-regulatory water drinking), we describe candidate neural substrates of compulsivity. We further postulate that aberrant neuroplasticity within cortically projecting structures [i.e., the bed nucleus of the stria terminalis (BNST)] and circuits that encode homeostatic emotions (thirst, hunger, satiety, etc.) underlie compulsive drinking. By transducing an inaccurate signal that fails to represent true homeostatic state, cortical structures cannot select appropriate and adaptive actions. Additionally, augmented dopamine (DA) reactivity in striatal projections to and from the frontal cortex contribute to aberrant homeostatic signal propagation that ultimately biases cortex-dependent behavioral selection. Responding becomes rigid and corresponds with both erroneous, inflexible encoding in both bottom-up structures and in top-down pathways. How aberrant neuroplasticity in circuits that encode homeostatic emotion result in the genesis and maintenance of compulsive behaviors needs further investigation.

Dorsal Striatal Circuits for Habits, Compulsions and Addictions

Here, we review the neural circuit bases of habits, compulsions, and addictions, behaviors which are all characterized by relatively automatic action performance. We discuss relevant studies, primarily from the rodent literature, and describe how major headway has been made in identifying the brain regions and neural cell types whose activity is modulated during the acquisition and performance of these automated behaviors. The dorsal striatum and cortical inputs to this structure have emerged as key players in the wider basal ganglia circuitry encoding behavioral automaticity, and changes in the activity of different neuronal cell-types in these brain regions have been shown to co-occur with the formation of automatic behaviors. We highlight how disordered functioning of these neural circuits can result in neuropsychiatric disorders, such as obsessive-compulsive disorder (OCD) and drug addiction. Finally, we discuss how the next phase of research in the field may benefit from integration of approaches for access to cells based on their genetic makeup, activity, connectivity and precise anatomical location.

The Endocannabinoid System: A New Treatment Target for Obsessive Compulsive Disorder?

Introduction: Obsessive-compulsive disorder (OCD) is a disabling illness that is associated with significant functional impairment. Although evidence-based pharmacotherapies exist, currently available medications are ineffective in some patients and may cause intolerable side effects in others. There is an urgent need for new treatments. Discussion: A growing body of basic and clinical research has showed that the endocannabinoid system (ECS) plays a role in anxiety, fear, and repetitive behaviors. At the same time, some patients with OCD who smoke cannabis anecdotally report that it relieves their symptoms and mitigates anxiety, and several case reports describe patients whose OCD symptoms improved after they were treated with cannabinoids. Taken together, these findings suggest that the ECS could be a potential target for novel medications for OCD. In this study, we review evidence from both animal and human studies that suggests that the ECS may play a role in OCD and related disorders. We also describe findings from studies in which cannabinoid drugs were shown to impact symptoms of these conditions. Conclusions: An emerging body of evidence suggests that the ECS plays a role in OCD symptoms and may be a target for the development of novel medications. Further exploration of this topic through well-designed human trials is warranted.

Voluntary Ethanol Intake Produces Subregion-Specific Neuroadaptations in Striatal and Cortical Areas of Wistar Rats

BACKGROUND

Addiction has been conceptualized as a shift from controlled recreational use toward compulsive and habitual drug-taking behavior. Although the brain reward system is vital for alcohol reward and reinforcement, other neuronal circuits may be involved in controlling long-term alcohol-seeking and drug-taking behaviors. The aim of this study was to outline alcohol-induced neuroplasticity in defined cortical and striatal subregions, previously implicated in alcohol use disorder.

METHODS

Male Wistar rats were allowed to voluntarily consume ethanol (EtOH) in an intermittent manner for 2 months, after which ex vivo electrophysiological recordings were performed and data compared with isolated water controls housed in parallel.

RESULTS

Field potential recordings revealed an increase in field excitatory postsynaptic potentials (fEPSPs) in the dorsomedial striatum (DMS) of rats consuming EtOH, while a depression of evoked potentials was detected in the dorsolateral striatum (DLS). Mean activity in cortical (medial prefrontal cortex, lateral orbitofrontal cortex [OFC]), and accumbal regions (nucleus accumbens [nAc] core/shell) was not significantly altered as compared to water-drinking controls, but a correlation between the amount of alcohol consumed and evoked potentials could be found in both dorsal striatal subregions, OFC, and nAc core. Removal of EtOH for 1 to 2 days was sufficient to restore neurotransmission in the DLS, while the increase in fEPSP amplitude sustained in the DMS.

CONCLUSIONS

These preclinical findings are in line with clinical observations indicating that alcohol produces neurophysiological transformations in dorsal striatal circuits, which in turn may lead to disruptions in decision-making processes that could further promote alcohol misuse.

Strengthened Inputs from Secondary Motor Cortex to Striatum in a Mouse Model of Compulsive Behavior

Hyperactivity in striatum is associated with compulsive behaviors in obsessive-compulsive disorder (OCD) and related illnesses, but it is unclear whether this hyperactivity is due to intrinsic striatal dysfunction or abnormalities in corticostriatal inputs. Understanding the cellular and circuit properties underlying striatal hyperactivity could help inform the optimization of targeted stimulation treatments for compulsive behavior disorders. To investigate the cellular and synaptic abnormalities that may underlie corticostriatal dysfunction relevant to OCD, we used the Sapap3 knock-out (Sapap3-KO) mouse model of compulsive behaviors, which also exhibits hyperactivity in central striatum. Ex vivo electrophysiology in double-transgenic mice was used to assess intrinsic excitability and functional synaptic input in spiny projection neurons (SPNs) and fast-spiking interneurons (FSIs) in central striatum of Sapap3-KOs and wild-type (WT) littermates. While we found no differences in intrinsic excitability of SPNs or FSIs between Sapap3-KOs and WTs, excitatory drive to FSIs was significantly increased in KOs. Contrary to predictions, lateral orbitofrontal cortex-striatal synapses were not responsible for this increased drive; optogenetic stimulation revealed that lateral orbitofrontal cortex input to SPNs was reduced in KOs (∼3-fold) and unchanged in FSIs. However, secondary motor area (M2) postsynaptic responses in central striatum were significantly increased (∼6-fold) in strength and reliability in KOs relative to WTs. These results suggest that increased M2-striatal drive may contribute to both in vivo striatal hyperactivity and compulsive behaviors, and support a potential role for presupplementary/supplementary motor cortical regions in the pathology and treatment of compulsive behavior disorders.SIGNIFICANCE STATEMENT These findings highlight an unexpected contribution of M2 projections to striatal dysfunction in the Sapap3-KO obsessive-compulsive disorder (OCD)-relevant mouse model, with M2 inputs strengthened by at least sixfold onto both spiny projection neurons and fast-spiking interneurons in central striatum. Because M2 is thought to be homologous to presupplementary/supplementary motor areas (pre-SMA/SMA) in humans, regions important for movement preparation and behavioral sequencing, these data are consistent with a model in which increased drive from M2 leads to excessive selection of sequenced motor patterns. Together with observations of hyperactivity in pre-SMA/SMA in both OCD and Tourette syndrome, and evidence that pre-SMA is a potential target for repetitive transcranial magnetic stimulation treatment in OCD, these results support further dissection of the role of M2 in compulsivity.

An Adenosine A2A Receptor Antagonist Improves Multiple Symptoms of Repeated Quinpirole-Induced Psychosis

Obsessive-compulsive disorder (OCD) is a neuropsychiatric disorder characterized by the repeated rise of concerns (obsessions) and repetitive unwanted behavior (compulsions). Although selective serotonin reuptake inhibitors (SSRIs) is the first-choice drug, response rates to SSRI treatment vary between symptom dimensions. In this study, to find a therapeutic target for SSRI-resilient OCD symptoms, we evaluated treatment responses of quinpirole (QNP) sensitization-induced OCD-related behaviors in mice. SSRI administration rescued the cognitive inflexibility, as well as hyperactivity in the lateral orbitofrontal cortex (lOFC), while no improvement was observed for the repetitive behavior. D₂ receptor signaling in the central striatum (CS) was involved in SSRI-resistant repetitive behavior. An adenosine A_2A antagonist, istradefylline, which rescued abnormal excitatory synaptic function in the CS indirect pathway medium spiny neurons (MSNs) of sensitized mice, alleviated both of the QNP-induced abnormal behaviors with only short-term administration. These results provide a new insight into therapeutic strategies for SSRI-resistant OCD symptoms and indicate the potential of A_2A antagonists as a rapid-acting anti-OCD drug.

Molecular tools to elucidate factors regulating alcohol use

Alcohol use disorder (AUD) is a pervasive societal problem, marked by high levels of alcohol intake and recidivism. Despite these common disease traits, individuals diagnosed with AUD display a range of disordered drinking and alcohol-related behaviors. The diversity in disease presentation, as well as the established polygenic nature of the disorder and complex neurocircuitry, speaks to the variety of neurochemical changes resulting from alcohol intake that may differentially regulate alcohol-related behaviors. Investigations into the molecular adaptations responsible for maladaptive alcohol-related behavioral outcomes require an ever-evolving set of molecular tools to elucidate with increasing precision how alcohol alters behavior through neurochemical changes. This review highlights recent advances in molecular methodology, addressing how incorporation of these cutting-edge techniques not only may enhance current knowledge of the molecular bases of AUD, but also may facilitate identification of improved treatment targets that may be therapeutic in specific subpopulations of AUD individuals.

Bi-directional modulation of food habit expression by the endocannabinoid system

The compulsive, habitual behaviors that have been observed in individuals diagnosed with substance use disorders may be due to disruptions in the neural circuits that mediate goal-directed actions. The endocannabinoid system has been shown to play a critical role in habit learning, but the role of this neuromodulatory system in habit expression is unclear. Here, we investigated the role of the endocannabinoid system in established habitual actions using contingency degradation in male C57BL/6 mice. We found that administration of the endocannabinoid transport inhibitor AM404 reduced habitual responding for food and that antagonism of cannabinoid receptor type 1 (CB1), but not transient receptor potential cation subfamily V (TRPV1), receptors produced a similar reduction in habitual responding. Moreover, pharmacological stimulation of CB1 receptors increased habitual responding for food. Co-administration of an enzyme inhibitor that selectively increases the endocannabinoid 2-arachidonoyl glycerol (2-AG) with AM404 partially restored habitual responding for food. Together, these findings demonstrate an important role for the endocannabinoid system in the expression of habits and provide novel insights into potential pharmacological strategies for reducing habitual behaviors in mental disorders.

Signaling Incentive and Drive in the Primate Ventral Pallidum for Motivational Control of Goal-Directed Action

Processing incentive and drive is essential for control of goal-directed behavior. The limbic part of the basal ganglia has been emphasized in these processes, yet the exact neuronal mechanism has remained elusive. In this study, we examined the neuronal activity of the ventral pallidum (VP) and its upstream area, the rostromedial caudate (rmCD), while two male macaque monkeys performed an instrumental lever release task in which a visual cue indicated the forthcoming reward size. We found that the activity of some neurons in VP and rmCD reflected the expected reward size transiently following the cue. Reward size coding appeared earlier and stronger in VP than in rmCD. We also found that the activity in these areas was modulated by the satiation level of monkeys, which also occurred more frequently in VP than in rmCD. The information regarding reward size and satiation level was independently signaled in the neuronal populations of these areas. The data thus highlighted the neuronal coding of key variables for goal-directed behavior in VP. Furthermore, pharmacological inactivation of VP induced more severe deficit of goal-directed behavior than inactivation of rmCD, which was indicated by abnormal error repetition and diminished satiation effect on the performance. These results suggest that VP encodes incentive value and internal drive and plays a pivotal role in the control of motivation to promote goal-directed behavior.

SIGNIFICANCE STATEMENT The limbic part of the basal ganglia has been implicated in the motivational control of goal-directed action. Here, we investigated how the ventral pallidum (VP) and the rostromedial caudate (rmCD) encode incentive value and internal drive and control goal-directed behavior. Neuronal recording and subsequent pharmacological inactivation revealed that VP had stronger coding of reward size and satiation level than rmCD. Reward size and satiation level were independently encoded in the neuronal population of these areas. Furthermore, VP inactivation impaired goal-directed behavior more severely than rmCD inactivation. These results highlight the central role of VP in the motivational control of goal-directed action.

The role of the orbitofrontal cortex in alcohol use, abuse, and dependence

One of the major functions of the orbitofrontal cortex (OFC) is to promote flexible motivated behavior. It is no surprise, therefore, that recent work has demonstrated a prominent impact of chronic drug use on the OFC and a potential role for OFC disruption in drug abuse and addiction. Among drugs of abuse, the use of alcohol is particularly salient with respect to OFC function. Although a number of studies in humans have implicated OFC dysregulation in alcohol use disorders, animal models investigating the association between OFC and alcohol use are only beginning to be developed, and there is still a great deal to be revealed. The goal of this review is to consider what is currently known regarding the role of the OFC in alcohol use and dependence. I will first provide a brief, general overview of current views of OFC function and its contributions to drug seeking and addiction. I will then discuss research to date related to the OFC and alcohol use, both in human clinical populations and in non-human models. Finally I will consider issues and strategies to guide future study that may identify this brain region as a key player in the transition from moderated to problematic alcohol use and dependence.

Behavioral and neural mechanisms underlying habitual and compulsive drug seeking

Addiction is characterized by compulsive drug use despite negative consequences. Here we review studies that indicate that compulsive drug use, and in particular punishment resistance in animal models of addiction, is related to impaired cortical control over habitual behavior. In humans and animals, instrumental behavior is supported by goal-directed and habitual systems that rely on distinct corticostriatal networks. Chronic exposure to addictive drugs or stress has been shown to bias instrumental response strategies toward habit learning, and impair prefrontal cortical (PFC) control over responding. Moreover, recent work has implicated prelimbic PFC hypofunction in the punishment resistance that has been observed in a subset of animals with an extended history of cocaine self-administration. This may be related to a broader role for prelimbic PFC in mediating adaptive responding and behavioral flexibility, including exerting goal-directed control over behavior. We hypothesize that impaired cortical control and reduced flexibility between habitual and goal-directed systems may be critically involved in the development of maladaptive, compulsive drug use.

Defining the place of habit in substance use disorders

It has long been suggested that alcohol or substance use disorders could emerge from the progressive development and dominance of drug habits. Like habits, drug-related behaviors are often triggered by drug-associated cues. Like habits, addictive behaviors are strong, rigid and "hard to break". Like habits, these behaviors are insensitive to their outcome and persist despite negative consequences. "Pathological habit" thus appears as a good candidate to explain the transition to compulsive drug use. However, drug use could also be considered as a goal-directed choice, driven by the expectation of drug outcomes. For example, drug addicts may engage in drug-seeking behaviors because they view the drug as more valuable than available alternatives. Substance use disorders therefore may not be all about habit, nor fully intentional, and could be considered as resulting from an imbalance between goal-directed and habitual control. The main objective of this review is to disentangle the relative contribution of habit formation and impairment of goal-directed behavior in this unbalanced control of addictive behaviors. Although deficits in goal-directed behavior have been demonstrated in alcohol and substance use disorders, reliable demonstration of abnormal habit formation has been curtailed by the paucity of paradigms designed to assess habit as a positive result. Refining our animal and human model of habit is therefore required to precisely define the place of habit in substance use disorders and develop appropriate and adapted neurobehavioral treatments.

Active Zone Proteins RIM1αβ Are Required for Normal Corticostriatal Transmission and Action Control

Dynamic regulation of synaptic transmission at cortical inputs to the dorsal striatum is considered critical for flexible and efficient action learning and control. Presynaptic mechanisms governing the properties and plasticity of glutamate release from these inputs are not fully understood, and the corticostriatal synaptic processes that support normal action learning and control remain unclear. Here we show in male and female mice that conditional deletion of presynaptic proteins RIM1αβ (RIM1) from excitatory cortical neurons impairs corticostriatal synaptic transmission in the dorsolateral striatum. Key forms of presynaptic G-protein-coupled receptor-mediated short- and long-term striatal plasticity are spared following RIM1 deletion. Conditional RIM1 KO mice show heightened novelty-induced locomotion and impaired motor learning on the accelerating rotarod. They further show heightened self-paced instrumental responding for food and impaired learning of a habitual instrumental response strategy. Together, these findings reveal a selective role for presynaptic RIM1 in neurotransmitter release at prominent basal ganglia synapses, and provide evidence that RIM1-dependent processes help to promote the refinement of skilled actions, constrain goal-directed behaviors, and support the learning and use of habits.SIGNIFICANCE STATEMENT Our daily functioning hinges on the ability to flexibly and efficiently learn and control our actions. How the brain encodes these capacities is unclear. Here we identified a selective role for presynaptic proteins RIM1αβ in controlling glutamate release from cortical inputs to the dorsolateral striatum, a brain structure critical for action learning and control. Behavioral analysis of mice with restricted genetic deletion of RIM1αβ further revealed roles for RIM1αβ-dependent processes in the learning and refinement of motor skills and the balanced expression of goal-directed and habitual actions.

Emerging role of viral vectors for circuit-specific gene interrogation and manipulation in rodent brain

Over the past half century, novel tools have allowed the characterization of myriad molecular underpinnings of neural phenomena including synaptic function, neurogenesis and neurodegeneration, membrane excitability, and neurogenetics/epigenetics. More recently, transgenic mice have made possible cell type-specific explorations of these phenomena and have provided critical models of many neurological and psychiatric diseases. However, it has become clear that many critical areas of study require tools allowing the study and manipulation of individual neural circuits within the brain, and viral vectors have come to the forefront in driving these circuit-specific studies. Here, we present a surface-level review of the general classes of viral vectors used for study of the brain, along with their suitability for circuit-specific studies. We then cover in detail a new long-lasting, retrograde expressing form of herpes simplex virus termed LT-HSV that has become highly useful in circuit-based studies. We detail some of its current uses and propose a variety of future uses for this critical new tool, including circuit-based transgene overexpression, gene editing, and gene expression profiling.

Thinking Outside the Box (and Arrow): Current Themes in Striatal Dysfunction in Movement Disorders

The basal ganglia are an intricately connected assembly of subcortical nuclei, forming the core of an adaptive network connecting cortical and thalamic circuits. For nearly three decades, researchers and medical practitioners have conceptualized how the basal ganglia circuit works, and how its pathology underlies motor disorders such as Parkinson's and Huntington's diseases, using what is often referred to as the "box-and-arrow model": a circuit diagram showing the broad strokes of basal ganglia connectivity and the pathological increases and decreases in the weights of specific connections that occur in disease. While this model still has great utility and has led to groundbreaking strategies to treat motor disorders, our evolving knowledge of basal ganglia function has made it clear that this classic model has several shortcomings that severely limit its predictive and descriptive abilities. In this review, we will focus on the striatum, the main input nucleus of the basal ganglia. We describe recent advances in our understanding of the rich microcircuitry and plastic capabilities of the striatum, factors not captured by the original box-and-arrow model, and provide examples of how such advances inform our current understanding of the circuit pathologies underlying motor disorders.

Bridging the gap between striatal plasticity and learning

The striatum, the main input nucleus of the basal ganglia, controls goal-directed behavior and procedural learning. Striatal projection neurons integrate glutamatergic inputs from cortex and thalamus together with neuromodulatory systems, and are subjected to plasticity. Striatal projection neurons exhibit bidirectional plasticity (LTP and LTD) when exposed to Hebbian paradigms. Importantly, correlative and even causal links between procedural learning and striatal plasticity have recently been shown. This short review summarizes the current view on striatal plasticity (with a focus on spike-timing-dependent plasticity), recent studies aiming at bridging in vivo skill acquisition and striatal plasticity, the temporal credit-assignment problem, and the gaps that remain to be filled.

A competitive model for striatal action selection

The direct and indirect pathway striatal medium spiny neurons (dMSNs and iMSNs) have long been linked to action selection, but the precise roles of these neurons in this process remain unclear. Here, we review different models of striatal pathway function, focusing on the classic "go/no-go" model which posits that dMSNs facilitate movement while iMSNs inhibit movement, and the "complementary" model, which argues that dMSNs facilitate the selection of specific actions while iMSNs inhibit potentially conflicting actions. We discuss the merits and shortcomings of these models and propose a "competitive" model to explain the contribution of these two pathways to behavior. The "competitive" model argues that rather than inhibiting conflicting actions, iMSNs are tuned to the same actions that dMSNs facilitate, and the two populations "compete" to determine the animal's behavioral response. This model provides a theoretical explanation for how these pathways work together to select actions. In addition, it provides a link between action selection and behavioral reinforcement, via modulating synaptic strength at inputs onto dMSNs and iMSNs. Finally, this model makes predictions about how imbalances in the activity of these pathways may underlie behavioral traits associated with psychiatric disorders. Understanding the roles of these striatal pathways in action selection may help to clarify the neuronal mechanisms of decision-making under normal and pathological conditions.

Developmental Trajectories of the Orbitofrontal Cortex and Anhedonia in Middle Childhood and Risk for Substance Use in Adolescence in a Longitudinal Sample of Depressed and Healthy Preschoolers

OBJECTIVE

Deficits in reward processing are established in mood and substance use disorders and are known risk factors for these disorders. Volume reductions of the orbitofrontal cortex and the striatum, regions that subserve neural response to reward, have been shown to be related to anhedonia in depressive and substance use disorders. The authors sought to investigate how structural maturation of these regions in childhood varies with level of anhedonia and predicts later substance use.

METHOD

The study employed data from a sample of depressed and healthy preschoolers studied longitudinally that included three waves of neuroimaging from school age to adolescence. Three years after scan 3, at ages 13-18, participants underwent a comprehensive behavioral and substance use assessment. Multilevel modeling was used to investigate the relationship between anhedonia and the growth trajectories of the striatum and orbitofrontal cortex. Zero-inflated Poisson regression models were then used to determine whether the intercepts and slopes of these trajectories predicted later alcohol and marijuana use frequency in adolescence.

RESULTS

The anhedonia-by-age interaction was significant in the multilevel modeling of orbitofrontal cortical but not striatal volume. Higher anhedonia ratings were significantly associated with steeper decline in orbitofrontal cortical volume with age. Orbitofrontal cortical volume and thickness at age 12 and trajectory over time significantly and negatively predicted subsequent alcohol and marijuana use frequency but not depression during adolescence.

CONCLUSIONS

The findings suggest that the development of the orbitofrontal cortex during childhood is strongly linked to experiences of anhedonia and that these growth trajectories predict substance use during a developmentally critical period.

Control of habitual instrumental actions by anticipation of postingestive sensations

In animal behavioral experiments, extended training causes instrumental actions that deliver ingestible substances to lose sensitivity to outcome devaluation and contingency degradation, and to gain direct sensitivity to the current motivational state. These features of habitual control have been attributed to a process that relies on stimulus-response (S-R) associations linking the context to instrumental actions and Pavlovian associations linking the same context to orally-sensed properties of substances attained there. This Pavlovian process was conceived based on the results of irrelevant incentive experiments, but it is not supported by the results of all such experiments. An alternative process is therefore proposed here. In this process, recall of the instrumental action is evoked by an S-R association, but the rate at which this action is then performed is controlled by anticipation of postingestive sensations that have frequently followed it. This anticipation relies on recall of an association linking the action directly to the postingestive sensations. This association is learned during the formation of a chunked action series that begins with the instrumental action and ends with a consummatory response. It enables a prediction of subjective value that is directly influenced by the current motivational state, but is not influenced by devaluation or non-contingent delivery of the substance that has produced the postingestive sensations.

Cannabinoid receptor-1 signaling contributions to sign-tracking and conditioned reinforcement in rats

RATIONALE

Endocannabinoids (eCBs) are critical gatekeepers of dopaminergic signaling, and disrupting cannabinoid receptor-1 (CB1) signaling alters DA dynamics to attenuate cue-motivated behaviors. Prior studies suggest that dopamine (DA) release plays a critical role in driving sign-tracking.

OBJECTIVES

Here, we determine whether systemic injections of rimonabant, a CB1 receptor inverse agonist, during Pavlovian lever autoshaping impair the expression of sign-tracking. We next examine whether rimonabant blocks the reinforcing properties of the Pavlovian lever cue in a conditioned reinforcement test.

METHODS

In Exp. 1, we trained rats in Pavlovian lever autoshaping prior to systemic rimonabant injections (0, 1, 3 mg/kg) during early and late Pavlovian lever autoshaping sessions. In Exp. 2, we trained rats in Pavlovian lever autoshaping prior to systemic rimonabant injections (0, 1 mg/kg) during a conditioned reinforcement test.

RESULTS

Rimonabant dose-dependently decreased lever contact and probability, and increased sign-tracker's latency to approach the lever cue early in Pavlovian training. With extended training, many previously goal-tracking and intermediate rats shifted to lever approach, which remained dose-dependently sensitive to rimonabant. Rimonabant attenuated cue-evoked food cup approach early, but not late, in conditioning, and did not affect pellet retrieval or consumption. The inserted lever cue served as a robust conditioned reinforcer after Pavlovian lever autoshaping, and 1 mg/kg rimonabant blocked conditioned reinforcement.

CONCLUSIONS

Together, our results suggest that CB1 signaling mediates two critical properties of incentive stimuli; their ability to attract (Exp. 1) and their ability to reinforce (Exp. 2) behavior.

Functional Relevance of Endocannabinoid-Dependent Synaptic Plasticity in the Central Nervous System

The endocannabinoid (eCB) signaling system plays a key role in short-term and long-term synaptic plasticity in brain regions involved in various neural functions ranging from action selection to appetite control. This review will explore the role of eCBs in shaping neural circuit function to regulate behaviors. In particular, we will discuss the behavioral consequences of eCB mediated long-term synaptic plasticity in different brain regions. This review brings together evidence from in vitro and ex vivo studies and points out the need for more in vivo studies.

Role of the endocannabinoid system in drug addiction

Drug addiction is a chronic relapsing disorder that produces a dramaticglobal health burden worldwide. Not effective treatment of drug addiction is currently available probably due to the difficulties to find an appropriate target to manage this complex disease raising the needs for further identification of novel therapeutic approaches. The endocannabinoid system has been found to play a crucial role in the neurobiological substrate underlying drug addiction. Endocannabinoids and cannabinoid receptors are widely expressed in the main areas of the mesocorticolimbic system that participate in the initiation and maintenance of drug consumption and in the development of compulsion and loss of behavioral control occurring during drug addiction. The identification of the important role played by CB1 cannabinoid receptors in drug addiction encouraged the possible used of an early commercialized CB1 receptor antagonist for treating drug addiction. However, the incidence of serious psychiatric adverse events leaded to the sudden withdrawal from the market of this CB1 antagonist and all the research programs developed by pharmaceutical companies to obtain new CB1 antagonists were stopped. Currently, new research strategies are under development to target the endocannabinoid system for drug addiction avoiding these side effects, which include allosteric negative modulators of CB1 receptors and compounds targeting CB2 receptors. Recent studies showing the potential role of CB2 receptors in the addictive properties of different drugs of abuse have open a promising research opportunity to develop novel possible therapeutic approaches.

Dual Dopaminergic Regulation of Corticostriatal Plasticity by Cholinergic Interneurons and Indirect Pathway Medium Spiny Neurons

Endocannabinoid (eCB)-mediated long-term depression (LTD) requires dopamine (DA) D2 receptors (D2Rs) for eCB mobilization. The cellular locus of the D2Rs involved in LTD induction remains highly debated. We directly examined the role in LTD induction of D2Rs expressed by striatal cholinergic interneurons (Chls) and indirect pathway medium spiny neurons (iMSNs) using neuron-specific targeted deletion of D2Rs. Deletion of Chl-D2Rs (Chl-Drd2KO) impaired LTD induction in both subtypes of MSNs. LTD induction was restored in the Chl-Drd2KO mice by an M1-selective muscarinic acetylcholine receptor antagonist. In contrast, after the deletion of iMSN-D2Rs (iMSN-Drd2KO), LTD induction was intact in MSNs. Separate interrogation of direct pathway and iMSNs revealed a deficit in LTD induction only at synapses onto iMSNs that lack D2Rs. LTD induction in iMSNs was restored by D2R agonist application. Our findings suggest that Chl D2Rs strongly modulate LTD induction in MSNs, with iMSN-D2Rs having a weaker, iMSN-specific, modulatory effect.

Habits Are Negatively Regulated by Histone Deacetylase 3 in the Dorsal Striatum

BACKGROUND

Optimal behavior and decision making result from a balance of control between two strategies, one cognitive/goal-directed and one habitual. These systems are known to rely on the anatomically distinct dorsomedial and dorsolateral striatum, respectively. However, the transcriptional regulatory mechanisms required to learn and transition between these strategies are unknown. Here we examined the role of one chromatin-based transcriptional regulator, histone modification via histone deacetylases (HDACs), in this process.

METHODS

We combined procedures that diagnose behavioral strategy in rats with pharmacological and viral-mediated HDAC manipulations, chromatin immunoprecipitation, and messenger RNA quantification.

RESULTS

The results indicate that dorsal striatal HDAC3 activity constrains habit formation. Systemic HDAC inhibition following instrumental (lever press → reward) conditioning increased histone acetylation throughout the dorsal striatum and accelerated habitual control of behavior. HDAC3 was removed from the promoters of key learning-related genes in the dorsal striatum as habits formed with overtraining and with posttraining HDAC inhibition. Decreasing HDAC3 function, either by selective pharmacological inhibition or by expression of dominant-negative mutated HDAC3, in either the dorsolateral striatum or the dorsomedial striatum accelerated habit formation, while HDAC3 overexpression in either region prevented habit.

CONCLUSIONS

These results challenge the strict dissociation between dorsomedial striatum and dorsolateral striatum function in goal-directed versus habitual behavioral control and identify dorsostriatal HDAC3 as a critical molecular directive of the transition to habit. Because this transition is disrupted in many neurodegenerative and psychiatric diseases, these data suggest a potential molecular mechanism for the negative behavioral symptoms of these conditions and a target for therapeutic intervention.

Role of Striatal Direct Pathway 2-Arachidonoylglycerol Signaling in Sociability and Repetitive Behavior

BACKGROUND

Endocannabinoid signaling plays an important role in regulating synaptic transmission in the striatum, a brain region implicated as a central node of dysfunction in autism spectrum disorder. Deficits in signaling mediated by the endocannabinoid 2-arachidonoylglycerol (2-AG) have been reported in mouse models of autism spectrum disorder, but a causal role for striatal 2-AG deficiency in phenotypes relevant to autism spectrum disorder has not been explored.

METHODS

Using conditional knockout mice, we examined the electrophysiological, biochemical, and behavioral effects of 2-AG deficiency by deleting its primary synthetic enzyme, diacylglycerol lipase α (DGLα), from dopamine D1 receptor-expressing or adenosine A2a receptor-expressing medium spiny neurons (MSNs) to determine the role of 2-AG signaling in striatal direct or indirect pathways, respectively. We then used viral-mediated deletion of DGLα to study the effects of 2-AG deficiency in the ventral and dorsal striatum.

RESULTS

Targeted deletion of DGLα from direct-pathway MSNs caused deficits in social interaction, excessive grooming, and decreased exploration of a novel environment. In contrast, deletion from indirect-pathway MSNs had no effect on any measure of behavior examined. Loss of 2-AG in direct-pathway MSNs also led to increased glutamatergic drive, which is consistent with a loss of retrograde feedback inhibition. Subregional DGLα deletion from the dorsal striatum produced deficits in social interaction, whereas deletion from the ventral striatum resulted in repetitive grooming.

CONCLUSIONS

These data suggest a role for 2-AG deficiency in social deficits and repetitive behavior, and they demonstrate a key role for 2-AG in regulating striatal direct-pathway MSNs.

Orbital Frontal Cortex Projections to Secondary Motor Cortex Mediate Exploitation of Learned Rules

Animals face the dilemma between exploiting known opportunities and exploring new ones, a decision-making process supported by cortical circuits. While different types of learning may bias exploration, the circumstances and the degree to which bias occurs is unclear. We used an instrumental lever press task in mice to examine whether learned rules generalize to exploratory situations and the cortical circuits involved. We first trained mice to press one lever for food and subsequently assessed how that learning influenced pressing of a second novel lever. Using outcome devaluation procedures we found that novel lever exploration was not dependent on the food value associated with the trained lever. Further, changes in the temporal uncertainty of when a lever press would produce food did not affect exploration. Instead, accrued experience with the instrumental contingency was strongly predictive of test lever pressing with a positive correlation between experience and trained lever exploitation, but not novel lever exploration. Chemogenetic attenuation of orbital frontal cortex (OFC) projection into secondary motor cortex (M2) biased novel lever exploration, suggesting that experience increases OFC-M2 dependent exploitation of learned associations but leaves exploration constant. Our data suggests exploitation and exploration are parallel decision-making systems that do not necessarily compete.

Insular and Ventrolateral Orbitofrontal Cortices Differentially Contribute to Goal-Directed Behavior in Rodents

The medial prefrontal cortex (mPFC) has long been considered a critical site in action control. However, recent evidence indicates that the contribution of cortical areas to goal-directed behavior likely extends beyond mPFC. Here, we examine the function of both insular (IC) and ventrolateral orbitofrontal (vlOFC) cortices in action-dependent learning. We used chemogenetics to study the consequences of IC or vlOFC inhibition on acquisition and performance of instrumental actions using the outcome devaluation task. Rats first learned to associate actions with desirable outcomes. Then, one of these outcomes was devalued and we assessed the rats' choice between the 2 actions. Typically, rats will bias their selection towards the action that delivers the still valued outcome. We show that chemogenetic-induced inhibition of IC during choice abolishes goal-directed control whereas inhibition during instrumental acquisition is without effect. IC is therefore necessary for action selection based on current outcome value. By contrast, vlOFC inhibition during acquisition or the choice test impaired goal-directed behavior but only following a shift in the instrumental contingencies. Our results provide clear evidence that vlOFC plays a critical role in action-dependent learning, which challenges the popular idea that this region of OFC is exclusively involved in stimulus-dependent behaviors.

Organization of afferents to the orbitofrontal cortex in the rat

The prefrontal cortex (PFC) is usually defined as the frontal cortical area receiving a mediodorsal thalamic (MD) innervation. Certain areas in the medial wall of the rat frontal area receive a MD innervation. A second frontal area that is the target of MD projections is located dorsal to the rhinal sulcus and often referred to as the orbitofrontal cortex (OFC). Both the medial PFC and OFC are comprised of a large number of cytoarchitectonic regions. We assessed the afferent innervation of the different areas of the OFC, with a focus on projections arising from the mediodorsal thalamic nucleus, the basolateral nucleus of the amygdala, and the midbrain dopamine neurons. Although there are specific inputs to various OFC areas, a simplified organizational scheme could be defined, with the medial areas of the OFC receiving thalamic inputs, the lateral areas of the OFC being the recipient of amygdala afferents, and a central zone that was the target of midbrain dopamine neurons. Anterograde tracer data were consistent with this organization of afferents, and revealed that the OFC inputs from these three subcortical sites were largely spatially segregated. This spatial segregation suggests that the central portion of the OFC (pregenual agranular insular cortex) is the only OFC region that is a prefrontal cortical area, analogous to the prelimbic cortex in the medial prefrontal cortex. These findings highlight the heterogeneity of the OFC, and suggest possible functional attributes of the three different OFC areas.

Orbital frontal cortex updates state-induced value change for decision-making

Recent hypotheses have posited that orbital frontal cortex (OFC) is important for using inferred consequences to guide behavior. Less clear is OFC's contribution to goal-directed or model-based behavior, where the decision to act is controlled by previous experience with the consequence or outcome. Investigating OFC's role in learning about changed outcomes separate from decision-making is not trivial and often the two are confounded. Here we adapted an incentive learning task to mice, where we investigated processes controlling experience-based outcome updating independent from inferred action control. We found chemogenetic OFC attenuation did not alter the ability to perceive motivational state-induced changes in outcome value but did prevent the experience-based updating of this change. Optogenetic inhibition of OFC excitatory neuron activity selectively when experiencing an outcome change disrupted the ability to update, leaving mice unable to infer the appropriate behavior. Our findings support a role for OFC in learning that controls decision-making.

Effects of Cocaine Self-Administration and Its Extinction on the Rat Brain Cannabinoid CB1 and CB2 Receptors

The aim of this study was to evaluate changes in the expression of cannabinoid type 1 (CB1) and 2 (CB2) receptor proteins in several brain regions in rats undergoing cocaine self-administration and extinction training. We used a triad-yoked procedure to distinguish between the motivational and pharmacological effects of cocaine. Using immunohistochemistry, we observed a significant decrease in CB1 receptor expression in the prefrontal cortex, dorsal striatum, and the basolateral and basomedial amygdala following cocaine (0.5 mg/kg/infusion) self-administration. Increased CB1 receptor expression in the ventral tegmental area in rats with previous cocaine exposure was also found. Following cocaine abstinence after 10 days of extinction training, we detected increases in the expression of CB1 receptors in the substantia nigra in both cocaine groups and in the subregions of the amygdala for only the yoked cocaine controls, while any method of cocaine exposure resulted in a decrease in CB2 receptor expression in the prefrontal cortex (p < 0.01), nucleus accumbens (p < 0.01), and medial globus pallidus (p < 0.01). Our findings further support the idea that the eCB system and CB1 receptors are involved in cocaine-reinforced behaviors. Moreover, we detected a cocaine-evoked adaptation in CB2 receptors in the amygdala, prefrontal cortex, and globus pallidus.

Pharmacological Blockade of Adenosine A2A but Not A1 Receptors Enhances Goal-Directed Valuation in Satiety-Based Instrumental Behavior

The balance and smooth shift between flexible, goal-directed behaviors and repetitive, habitual actions are critical to optimal performance of behavioral tasks. The striatum plays an essential role in control of goal-directed versus habitual behaviors through a rich interplay of the numerous neurotransmitters and neuromodulators to modify the input, processing and output functions of the striatum. The adenosine receptors (namely A_2AR and A₁R), with their high expression pattern in the striatum and abilities to interact and integrate dopamine, glutamate and cannabinoid signals in the striatum, may represent novel therapeutic targets for modulating instrumental behavior. In this study, we examined the effects of pharmacological blockade of the A_2ARs and A₁Rs on goal-directed versus habitual behaviors in different information processing phases of instrumental learning using a satiety-based instrumental behavior procedure. We found that A_2AR antagonist acts at the coding, consolidation and expression phases of instrumental learning to modulate animals’ sensitivity to goal-directed valuation without modifying action-outcome contingency. However, pharmacological blockade and genetic knockout of A₁Rs did not affect acquisition or sensitivity to goal-valuation of instrumental behavior. These findings provide pharmacological evidence for a potential therapeutic strategy to control abnormal instrumental behaviors associated with drug addiction and obsessive-compulsive disorder by targeting the A_2AR.

Kainate Receptors Inhibit Glutamate Release Via Mobilization of Endocannabinoids in Striatal Direct Pathway Spiny Projection Neurons

Kainate receptors are members of the glutamate receptor family that function by both generating ionotropic currents through an integral ion channel pore and coupling to downstream metabotropic signaling pathways. They are highly expressed in the striatum, yet their roles in regulating striatal synapses are not known. Using mice of both sexes, we demonstrate that GluK2-containing kainate receptors expressed in direct pathway spiny projection neurons (dSPNs) inhibit glutamate release at corticostriatal synapses in the dorsolateral striatum. This inhibition requires postsynaptic kainate-receptor-mediated mobilization of a retrograde endocannabinoid (eCB) signal and activation of presynaptic CB1 receptors. This pathway can be activated during repetitive 25 Hz trains of synaptic stimulation, causing short-term depression of corticostriatal synapses. This is the first study to demonstrate a role for kainate receptors in regulating eCB-mediated plasticity at the corticostriatal synapse and demonstrates an important role for these receptors in regulating basal ganglia circuits.SIGNIFICANCE STATEMENT The GRIK2 gene, encoding the GluK2 subunit of the kainate receptor, has been linked to several neuropsychiatric and neurodevelopmental disorders including obsessive compulsive disorder (OCD). Perseverative behaviors associated with OCD are known to result from pathophysiological changes in the striatum and kainate receptor knock-out mice have striatal-dependent phenotypes. However, the role of kainate receptors in striatal synapses is not known. We demonstrate that GluK2-containing kainate receptors regulate corticostriatal synapses by mobilizing endocannabinoids from direct pathway spiny projection neurons. Synaptic activation of GluK2 receptors during trains of synaptic input causes short-term synaptic depression, demonstrating a novel role for these receptors in regulating striatal circuits.

Recent Insights into Corticostriatal Circuit Mechanisms underlying Habits: Invited review for Current Opinions in Behavioral Sciences

Habits have been studied for decades, but it was not until recent years that experiments began to elucidate the underlying cellular and circuit mechanisms. The latest experiments have been enabled by advances in cell-type specific monitoring and manipulation of activity in large neuronal populations. Here we will review recent efforts to understand the neural substrates underlying habit formation, focusing on rodent studies on corticostriatal circuits.

Altered orbitofrontal activity and dorsal striatal connectivity during emotion processing in dependent marijuana users after 28 days of abstinence

RATIONALE

Intact cognitive and emotional functioning is vital for the long-term success of addiction treatment strategies. Accumulating evidence suggests an association between chronic marijuana use and lasting alterations in cognitive brain function. Despite initial evidence for altered emotion processing in dependent marijuana users after short abstinence periods, adaptations in the domain of emotion processing after longer abstinence remain to be determined.

OBJECTIVE AND METHODS

Using task-based and resting state fMRI, the present study investigated emotion processing in 19 dependent marijuana users and 18 matched non-using controls after an abstinence period of > 28 days.

RESULTS

Relative to the control subjects, negative emotional stimuli elicited increased medial orbitofrontal cortex (mOFC) activity and stronger mOFC-dorsal striatal and mOFC-amygdala functional coupling in dependent marijuana users (p < 0.022, FWE-corrected). Furthermore, mOFC-dorsal striatal functional connectivity was increased at rest in marijuana users (p < 0.03, FWE-corrected). Yet, processing of positive stimuli and subjective ratings of valence and arousal were comparable in both groups.

CONCLUSIONS

Together, the present findings provide the first evidence for persisting emotion processing alterations in dependent marijuana users. Alterations might reflect long-term neural adaptations as a consequence of chronic marijuana use or predisposing risk factors for the development of marijuana dependence.

The cannabinoid-1 receptor is abundantly expressed in striatal striosomes and striosome-dendron bouquets of the substantia nigra

Presynaptic cannabinoid-1 receptors (CB₁-R) bind endogenous and exogenous cannabinoids to modulate neurotransmitter release. CB₁-Rs are expressed throughout the basal ganglia, including striatum and substantia nigra, where they play a role in learning and control of motivated actions. However, the pattern of CB₁-R expression across different striatal compartments, microcircuits and efferent targets, and the contribution of different CB₁-R-expressing neurons to this pattern, are unclear. We use a combination of conventional techniques and novel genetic models to evaluate CB₁-R expression in striosome (patch) and matrix compartments of the striatum, and in nigral targets of striatal medium spiny projection neurons (MSNs). CB₁-R protein and mRNA follow a descending dorsolateral-to-ventromedial intensity gradient in the caudal striatum, with elevated expression in striosomes relative to the surrounding matrix. The lateral predominance of striosome CB₁-Rs contrasts with that of the classical striosomal marker, the mu opioid receptor (MOR), which is expressed most prominently in rostromedial striosomes. The dorsolateral-to-ventromedial CB₁-R gradient is similar to Drd2 dopamine receptor immunoreactivity and opposite to Substance P. This topology of CB₁-R expression is maintained downstream in the globus pallidus and substantia nigra. Dense CB₁-R-expressing striatonigral fibers extend dorsally within the substantia nigra pars reticulata, and colocalize with bundles of ventrally extending, striosome-targeted, dendrites of dopamine-containing neurons in the substantia nigra pars compacta (striosome-dendron bouquets). Within striatum, CB₁-Rs colocalize with fluorescently labeled MSN collaterals within the striosomes. Cre recombinase-mediated deletion of CB₁-Rs from cortical projection neurons or MSNs, and MSN-selective reintroduction of CB₁-Rs in knockout mice, demonstrate that the principal source of CB₁-Rs in dorsolateral striosomes is local MSN collaterals. These data suggest a role for CB₁-Rs in caudal dorsolateral striosome collaterals and striosome-dendron bouquet projections to lateral substantia nigra, where they are anatomically poised to mediate presynaptic disinhibition of both striosomal MSNs and midbrain dopamine neurons in response to endocannabinoids and cannabinomimetics.