Elevated dopamine alters consummatory pattern generation and increases behavioral variability during learning

Dopamine Transporter Deficient Rodents: Perspectives and Limitations for Neuroscience

The key element of dopamine (DA) neurotransmission is undoubtedly DA transporter (DAT), a transmembrane protein responsible for the synaptic reuptake of the mediator. Changes in DAT's function can be a key mechanism of pathological conditions associated with hyperdopaminergia. The first strain of gene-modified rodents with a lack of DAT were created more than 25 years ago. Such animals are characterized by increased levels of striatal DA, resulting in locomotor hyperactivity, increased levels of motor stereotypes, cognitive deficits, and other behavioral abnormalities. The administration of dopaminergic and pharmacological agents affecting other neurotransmitter systems can mitigate those abnormalities. The main purpose of this review is to systematize and analyze (1) known data on the consequences of changes in DAT expression in experimental animals, (2) results of pharmacological studies in these animals, and (3) to estimate the validity of animals lacking DAT as models for discovering new treatments of DA-related disorders.

LIQ HD (Lick Instance Quantifier Home Cage Device): An Open-Source Tool for Recording Undisturbed Two-Bottle Drinking Behavior in a Home Cage Environment

Investigation of rodent drinking behavior has provided insight into drivers of thirst, circadian rhythms, anhedonia, and drug and ethanol consumption. Traditional methods of recording fluid intake involve weighing bottles, which is cumbersome and lacks temporal resolution. Several open-source devices have been designed to improve drink monitoring, particularly for two-bottle choice tasks. However, beam-break sensors lack the ability to detect individual licks for bout microstructure analysis. Thus, we designed LIQ HD (Lick Instance Quantifier Home cage Device) with the goal of using capacitive sensors to increase accuracy and analyze lick microstructure, building a device compatible with ventilated home cages, increasing scale with prolonged undisturbed recordings, and creating a design that is easy to build and use with an intuitive touchscreen graphical user interface. The system tracks two-bottle choice licking behavior in up to 18 rodent cages, or 36 single bottles, on a minute-to-minute timescale controlled by a single Arduino microcontroller. The data are logged to a single SD card, allowing for efficient downstream analysis. LIQ HD accuracy was validated with sucrose, quinine, and ethanol two-bottle choice tasks. The system measures preference over time and changes in bout microstructure, with undisturbed recordings tested up to 7 d. All designs and software are open-source to allow other researchers to build on the system and adapt LIQ HD to their animal home cages.

A critical review of front-loading: A maladaptive drinking pattern driven by alcohol's rewarding effects

Front-loading is a drinking pattern in which alcohol intake is skewed toward the onset of reward access. This phenomenon has been reported across several different alcohol self-administration protocols in a wide variety of species, including humans. The hypothesis of the current review is that front-loading emerges in response to the rewarding effects of alcohol and can be used to measure the motivation to consume alcohol. Alternative or additional hypotheses that we consider and contrast with the main hypothesis are that: (1) front-loading is directed at overcoming behavioral and/or metabolic tolerance and (2) front-loading is driven by negative reinforcement. Evidence for each of these explanations is reviewed. We also consider how front-loading has been evaluated statistically in previous research and make recommendations for defining this intake pattern in future studies. Because front-loading may predict long-term maladaptive alcohol drinking patterns leading to the development of alcohol use disorder (AUD), several future directions are proposed to elucidate the relationship between front-loading and AUD.

Direct and indirect pathway neurons in ventrolateral striatum differentially regulate licking movement and nigral responses

Drinking behavior in rodents is characterized by stereotyped, rhythmic licking movement, which is regulated by the basal ganglia. It is unclear how direct and indirect pathways control the lick bout and individual spout contact. We find that inactivating D1 and D2 receptor-expressing medium spiny neurons (MSNs) in the ventrolateral striatum (VLS) oppositely alters the number of licks in a bout. D1- and D2-MSNs exhibit different patterns of lick-sequence-related activity and different phases of oscillation time-locked to the lick cycle. On the timescale of a lick cycle, transient inactivation of D1-MSNs during tongue protrusion reduces spout contact probability, whereas transiently inactivating D2-MSNs has no effect. On the timescale of a lick bout, inactivation of D1-MSNs (D2-MSNs) causes rate increase (decrease) in a subset of basal ganglia output neurons that decrease firing during licking. Our results reveal the distinct roles of D1- and D2-MSNs in regulating licking at both coarse and fine timescales.

Sex-dependent alterations in behavior, drug responses and dopamine transporter expression in heterozygous DAT-Cre mice

Heterozygous mice that express Cre-recombinase under the dopamine transporter promoter (DAT-Cre knock in mice, or KI) are widely used for targeting midbrain dopamine neurons, under the assumption that their constitutive physiology is not affected. We report here that these mice display striking sex-dependent behavioral and molecular differences in relation to wildtypes (WT). Male and female KI mice were constitutively hyperactive, and male KI mice showed attenuated hyperlocomotor responses to amphetamine. In contrast, female KIs displayed a marked reduction in locomotion ("calming" effect) in response to the same dose of amphetamine. Furthermore, male and female DAT-Cre KI mice showed opposing differences in reinforcement learning, with females showing faster conditioning and males showing slower extinction. Other behavioral variables, including working memory and novelty preference, were not changed compared to WT. These effects were paralleled by differences in striatal DAT expression that disproportionately affected female KI mice. Our findings reveal clear limitations of the DAT-Cre line that must be considered when using this model.

Rodent and fly models in behavioral neuroscience: An evaluation of methodological advances, comparative research, and future perspectives

The assessment of behavioral outcomes is a central component of neuroscientific research, which has required continuous technological innovations to produce more detailed and reliable findings. In this article, we provide an in-depth review on the progress and future implications for three model organisms (mouse, rat, and Drosophila) essential to our current understanding of behavior. By compiling a comprehensive catalog of popular assays, we are able to compare the diversity of tasks and usage of these animal models in behavioral research. This compilation also allows for the evaluation of existing state-of-the-art methods and experimental applications, including optogenetics, machine learning, and high-throughput behavioral assays. We go on to discuss novel apparatuses and inter-species analyses for centrophobism, feeding behavior, aggression and mating paradigms, with the goal of providing a unique view on comparative behavioral research. The challenges and recent advances are evaluated in terms of their translational value, ethical procedures, and trustworthiness for behavioral research.

Opponent regulation of action performance and timing by striatonigral and striatopallidal pathways

The basal ganglia have been implicated in action selection and timing, but the relative contributions of the striatonigral (direct) and striatopallidal (indirect) pathways to these functions remain unclear. We investigated the effects of optogenetic stimulation of D1+ (direct) and A2A+ (indirect) neurons in the ventrolateral striatum in head-fixed mice on a fixed time reinforcement schedule. Direct pathway stimulation initiates licking, whereas indirect pathway stimulation suppresses licking and results in rebound licking after stimulation. Moreover, direct and indirect pathways also play distinct roles in timing. Direct pathway stimulation produced a resetting of the internal timing process, whereas indirect pathway stimulation transiently paused timing, and proportionally delayed the next bout of licking. Our results provide evidence for the continuous and opposing contributions of the direct and indirect pathways in the production and timing of reward-guided behavior.

A Head-Fixation System for Continuous Monitoring of Force Generated During Behavior

Many studies in neuroscience use head-fixed behavioral preparations, which confer a number of advantages, including the ability to limit the behavioral repertoire and use techniques for large-scale monitoring of neural activity. But traditional studies using this approach use extremely limited behavioral measures, in part because it is difficult to detect the subtle movements and postural adjustments that animals naturally exhibit during head fixation. Here we report a new head-fixed setup with analog load cells capable of precisely monitoring the continuous forces exerted by mice. The load cells reveal the dynamic nature of movements generated not only around the time of task-relevant events, such as presentation of stimuli and rewards, but also during periods in between these events, when there is no apparent overt behavior. It generates a new and rich set of behavioral measures that have been neglected in previous experiments. We detail the construction of the system, which can be 3D-printed and assembled at low cost, show behavioral results collected from head-fixed mice, and demonstrate that neural activity can be highly correlated with the subtle, whole-body movements continuously produced during head restraint.

Dopamine and addiction: what have we learned from 40 years of research

Among the neurotransmitters involved in addiction, dopamine (DA) is clearly the best known. The critical role of DA in addiction is supported by converging evidence that has been accumulated in the last 40 years. In the present review, first we describe the dopaminergic system in terms of connectivity, functioning and involvement in reward processes. Second, we describe the functional, structural, and molecular changes induced by drugs within the DA system in terms of neuronal activity, synaptic plasticity and transcriptional and molecular adaptations. Third, we describe how genetic mouse models have helped characterizing the role of DA in addiction. Fourth, we describe the involvement of the DA system in the vulnerability to addiction and the interesting case of addiction DA replacement therapy in Parkinson's disease. Finally, we describe how the DA system has been targeted to treat patients suffering from addiction and the result obtained in clinical settings and we discuss how these different lines of evidence have been instrumental in shaping our understanding of the physiopathology of drug addiction.

Dopamine transporter mutant animals: a translational perspective

The dopamine transporter (DAT) plays an important homeostatic role in the control of both the extracellular and intraneuronal concentrations of dopamine, thereby providing effective control over activity of dopaminergic transmission. Since brain dopamine is known to be involved in numerous neuropsychiatric disorders, investigations using mice with genetically altered DAT function and thus intensity of dopamine-mediated signaling have provided numerous insights into the pathology of these disorders and novel pathological mechanisms that could be targeted to provide new therapeutic approaches for these disorders. In this brief overview, we discuss recent investigations involving animals with genetically altered DAT function, particularly focusing on translational studies providing new insights into pathology and pharmacology of dopamine-related disorders. Perspective applications of these and newly developed models of DAT dysfunction are also discussed.

Effect of ketamine administration, alone and in combination with E-6837, on climbing behavior

Some types of schizophrenia have been associated with repetitive movements lacking specific purpose, also known as stereotyped behavior. Dopamine agonists (D2) and noncompetitive N-methyl-D-aspartate receptor antagonists (e.g. ketamine) have been administered in rodent models to induce stereotyped behavior that resembles some motor symptoms of schizophrenia. Recently, a relationship has been found between 5-HT6 receptors (5-HT6Rs) and dopaminergic activity. The present study evaluates the effect of ketamine (5 and 10 mg/kg), alone and in combination with the 5-HT6R agonist E-6837, on the climbing behavior of male mice. Ketamine was administered with an acute (1 day) and subchronic (5 day) scheme. Later, these doses and schemes were combined with an acute scheme of E-6837 (5 and 10 mg/kg). With both the acute and the subchronic schemes, ketamine increased climbing behavior at a dose of 10 mg/kg, and this effect was reversed by E-6837 (at 5 and 10 mg/kg). The present results suggest that there is an interaction between N-methyl-D-aspartate and 5-HT6 receptors in the regulation of climbing behavior. Further research is necessary to provide more evidence on this interaction.

GluA1 AMPAR subunit deletion reduces the hedonic response to sucrose but leaves satiety and conditioned responses intact

The GluA1 subunit of the AMPA receptor has been implicated in schizophrenia. While GluA1 is important for cognition, it is not clear what the role of GluA1 is in hedonic responses that are relevant to the negative symptoms of disorders such as schizophrenia. Here, we tested mice that lack GluA1 (Gria1^−/− mice) on consumption of sucrose solutions using a licking microstructure analysis. GluA1 deletion drastically reduced palatability (as measured by the mean lick cluster size) across a range of sucrose concentrations. Although initial lick rates were reduced, measures of consumption across long periods of access to sucrose solutions were not affected by GluA1 deletion and Gria1^−/− mice showed normal satiety responses to high sucrose concentrations. GluA1 deletion also failed to impair flavour conditioning, in which increased intake of a flavour occurred as a consequence of prior pairing with a high sucrose concentration. These results demonstrate that GluA1 plays a role in responding on the basis of palatability rather than other properties, such as the automatic and learnt post-ingestive, nutritional consequences of sucrose. Therefore, Gria1^−/− mice provide a potential model of anhedonia, adding converging evidence to the role of glutamatergic dysfunction in various symptoms of schizophrenia and related disorders.

Activation of Glutamatergic Fibers in the Anterior NAc Shell Modulates Reward Activity in the aNAcSh, the Lateral Hypothalamus, and Medial Prefrontal Cortex and Transiently Stops Feeding

Although the release of mesoaccumbal dopamine is certainly involved in rewarding responses, recent studies point to the importance of the interaction between it and glutamate. One important component of this network is the anterior nucleus accumbens shell (aNAcSh), which sends GABAergic projections into the lateral hypothalamus (LH) and receives extensive glutamatergic inputs from, among others, the medial prefrontal cortex (mPFC). The effects of glutamatergic activation of aNAcSh on the ingestion of rewarding stimuli as well as its effect in the LH and mPFC are not well understood. Therefore, we studied behaving mice that express a light-gated channel (ChR2) in glutamatergic fibers in their aNAcSh while recording from neurons in the aNAcSh, or mPFC or LH. In Thy1-ChR2, but not wild-type, mice activation of aNAcSh fibers transiently stopped the mice licking for sucrose or an empty sipper. Stimulation of aNAcSh fibers both activated and inhibited single-unit responses aNAcSh, mPFC, and LH, in a manner that maintains firing rate homeostasis. One population of licking-inhibited pMSNs in the aNAcSh was also activated by optical stimulation, suggesting their relevance in the cessation of feeding. A rewarding aspect of stimulation of glutamatergic inputs was found when the Thy1-ChR2 mice learned to nose-poke to self-stimulate these inputs, indicating that bulky stimulation of these fibers are rewarding in the sense of wanting. Stimulation of excitatory afferents evoked both monosynaptic and polysynaptic responses distributed in the three recorded areas. In summary, we found that activation of glutamatergic aNAcSh fibers is both rewarding and transiently inhibits feeding.

SIGNIFICANCE STATEMENT

We have established that the activation of glutamatergic fibers in the anterior nucleus accumbens shell (aNAcSh) transiently stops feeding and yet, because mice self-stimulate, is rewarding in the sense of wanting. Moreover, we have characterized single-unit responses of distributed components of a hedonic network (comprising the aNAcSh, medial prefrontal cortex, and lateral hypothalamus) recruited by activation of glutamatergic aNAcSh afferents that are involved in encoding a positive valence signal important for the wanting of a reward and that transiently stops ongoing consummatory actions, such as licking.

The Basal Ganglia in Action

The basal ganglia (BG) are the major subcortical nuclei in the brain. Disorders implicating the BG are characterized by diverse symptoms, but it remains unclear what these symptoms have in common or how they can be explained by changes in the BG circuits. This review summarizes recent findings that not only question traditional assumptions about the role of the BG in movement but also elucidate general computations performed by these circuits. To explain these findings, a new conceptual framework is introduced for understanding the role of the BG in behavior. According to this framework, the cortico-BG networks implement transition control in an extended hierarchy of closed loop negative feedback control systems. The transition control model provides a solution to the posture/movement problem, by postulating that BG outputs send descending signals to alter the reference states of downstream position control systems for orientation and body configuration. It also explains major neurological symptoms associated with BG pathology as a result of changes in system parameters such as multiplicative gain and damping.

Activation of Glutamatergic Fibers in the Anterior NAc Shell Modulates Reward Activity in the aNAcSh, the Lateral Hypothalamus, and Medial Prefrontal Cortex and Transiently Stops Feeding

Although the release of mesoaccumbal dopamine is certainly involved in rewarding responses, recent studies point to the importance of the interaction between it and glutamate. One important component of this network is the anterior nucleus accumbens shell (aNAcSh), which sends GABAergic projections into the lateral hypothalamus (LH) and receives extensive glutamatergic inputs from, among others, the medial prefrontal cortex (mPFC). The effects of glutamatergic activation of aNAcSh on the ingestion of rewarding stimuli as well as its effect in the LH and mPFC are not well understood. Therefore, we studied behaving mice that express a light-gated channel (ChR2) in glutamatergic fibers in their aNAcSh while recording from neurons in the aNAcSh, or mPFC or LH. In Thy1-ChR2, but not wild-type, mice activation of aNAcSh fibers transiently stopped the mice licking for sucrose or an empty sipper. Stimulation of aNAcSh fibers both activated and inhibited single-unit responses aNAcSh, mPFC, and LH, in a manner that maintains firing rate homeostasis. One population of licking-inhibited pMSNs in the aNAcSh was also activated by optical stimulation, suggesting their relevance in the cessation of feeding. A rewarding aspect of stimulation of glutamatergic inputs was found when the Thy1-ChR2 mice learned to nose-poke to self-stimulate these inputs, indicating that bulky stimulation of these fibers are rewarding in the sense of wanting. Stimulation of excitatory afferents evoked both monosynaptic and polysynaptic responses distributed in the three recorded areas. In summary, we found that activation of glutamatergic aNAcSh fibers is both rewarding and transiently inhibits feeding.

SIGNIFICANCE STATEMENT

We have established that the activation of glutamatergic fibers in the anterior nucleus accumbens shell (aNAcSh) transiently stops feeding and yet, because mice self-stimulate, is rewarding in the sense of wanting. Moreover, we have characterized single-unit responses of distributed components of a hedonic network (comprising the aNAcSh, medial prefrontal cortex, and lateral hypothalamus) recruited by activation of glutamatergic aNAcSh afferents that are involved in encoding a positive valence signal important for the wanting of a reward and that transiently stops ongoing consummatory actions, such as licking.

A GABAergic nigrotectal pathway for coordination of drinking behavior

The contribution of basal ganglia outputs to consummatory behavior remains poorly understood. We recorded from the substantia nigra pars reticulata (SNR), the major basal ganglia output nucleus, during self-initiated drinking. The firing rates of many lateral SNR neurons were time-locked to individual licks. These neurons send GABAergic projections to the deep layers of the orofacial region of the lateral tectum (superior colliculus, SC). Many tectal neurons are also time-locked to licking, but their activity is usually antiphase to that of SNR neurons, suggesting inhibitory nigrotectal projections. We used optogenetics to selectively activate the GABAergic nigrotectal afferents in the deep layers of the SC. Photo-stimulation of the nigrotectal projections transiently inhibited the activity of the lick-related tectal neurons, disrupted their licking-related oscillatory pattern, and suppressed self-initiated drinking. These results demonstrate that GABAergic nigrotectal projections play a crucial role in coordinating drinking behavior.

Beyond reward prediction errors: the role of dopamine in movement kinematics

We recorded activity of dopamine (DA) neurons in the substantia nigra pars compacta in unrestrained mice while monitoring their movements with video tracking. Our approach allows an unbiased examination of the continuous relationship between single unit activity and behavior. Although DA neurons show characteristic burst firing following cue or reward presentation, as previously reported, their activity can be explained by the representation of actual movement kinematics. Unlike neighboring pars reticulata GABAergic output neurons, which can represent vector components of position, DA neurons represent vector components of velocity or acceleration. We found neurons related to movements in four directions-up, down, left, right. For horizontal movements, there is significant lateralization of neurons: the left nigra contains more rightward neurons, whereas the right nigra contains more leftward neurons. The relationship between DA activity and movement kinematics was found on both appetitive trials using sucrose and aversive trials using air puff, showing that these neurons belong to a velocity control circuit that can be used for any number of purposes, whether to seek reward or to avoid harm. In support of this conclusion, mimicry of the phasic activation of DA neurons with selective optogenetic stimulation could also generate movements. Contrary to the popular hypothesis that DA neurons encode reward prediction errors, our results suggest that nigrostriatal DA plays an essential role in controlling the kinematics of voluntary movements. We hypothesize that DA signaling implements gain adjustment for adaptive transition control, and describe a new model of the basal ganglia (BG) in which DA functions to adjust the gain of the transition controller. This model has significant implications for our understanding of movement disorders implicating DA and the BG.

D1 and D2 antagonists reverse the effects of appetite suppressants on weight loss, food intake, locomotion, and rebalance spiking inhibition in the rat NAc shell

Obesity is a worldwide health problem that has reached epidemic proportions. To ameliorate this problem, one approach is the use of appetite suppressants. These compounds are frequently amphetamine congeners such as diethylpropion (DEP), phentermine (PHEN), and bupropion (BUP), whose effects are mediated through serotonin, norepinephrine, and dopaminergic pathways. The nucleus accumbens (NAc) shell receives dopaminergic inputs and is involved in feeding and motor activity. However, little is known about how appetite suppressants modulate its activity. Therefore, we characterized behavioral and neuronal NAc shell responses to short-term treatments of DEP, PHEN, and BUP. These compounds caused a transient decrease in weight and food intake while increasing locomotion, stereotypy, and insomnia. They evoked a large inhibitory imbalance in NAc shell spiking activity that correlated with the onset of locomotion and stereotypy. Analysis of the local field potentials (LFPs) showed that all three drugs modulated beta, theta, and delta oscillations. These oscillations do not reflect an aversive-malaise brain state, as ascertained from taste aversion experiments, but tracked both the initial decrease in weight and food intake and the subsequent tolerance to these drugs. Importantly, the appetite suppressant-induced weight loss and locomotion were markedly reduced by intragastric (and intra-NAc shell) infusions of dopamine antagonists SCH-23390 (D1 receptor) or raclopride (D2 receptor). Furthermore, both antagonists attenuated appetite suppressant-induced LFP oscillations and partially restored the imbalance in NAc shell activity. These data reveal that appetite suppressant-induced behavioral and neuronal activity recorded in the NAc shell depend, to various extents, on dopaminergic activation and thus point to an important role for D1/D2-like receptors (in the NAc shell) in the mechanism of action for these anorexic compounds.