Mechanisms for multiple activity modes of VTA dopamine neurons

Disruption of Electroencephalogram Coherence between Cortex/Striatum and Midbrain Dopaminergic Regions in the Knock-Out Mice with Combined Loss of Alpha, Beta, and Gamma Synucleins

The malfunctioning of the brain synucleins is associated with pathogenesis of Parkinson's disease. Synucleins' ability to modulate various pre-synaptic processes suggests their modifying effects on the electroencephalogram (EEG) recorded from different brain structures. Disturbances in interrelations between them are critical for the onset and evolution of neurodegenerative diseases. Recently, we have shown that, in mice lacking several synucleins, differences between the frequency spectra of EEG from different brain structures are correlated with specificity of synucleins' combinations. Given that EEG spectra are indirect characteristics of inter-structural relations, in this study, we analyzed a coherence of instantaneous values for EEGs recorded from different structures as a direct measure of "functional connectivity" between them.

METHODS

EEG data from seven groups of knock-out (KO) mice with combined deletions of alpha, beta, and gamma synucleins versus a group of wild-type (WT) mice were compared. EEG coherence was estimated between the cortex (MC), putamen (Pt), ventral tegmental area (VTA), and substantia nigra (SN) in all combinations.

RESULTS

EEG coherence suppression, predominantly in the beta frequency band, was observed in KO mice versus WT littermates. The suppression was minimal in MC-Pt and VTA-SN interrelations in all KO groups and in all inter-structural relations in mice lacking either all synucleins or only beta synuclein. In other combinations of deleted synucleins, significant EEG coherence suppression in KO mice was dominant in relations with VTA and SN.

CONCLUSION

Deletions of the synucleins produced significant attenuation of intra-cerebral EEG coherence depending on the imbalance of different types of synucleins.

Gestational immune activation disrupts hypothalamic neurocircuits of maternal care behavior

Immune activation is one of the most common complications during pregnancy, predominantly evoked by viral infections. Nevertheless, how immune activation affects mother-offspring relationships postpartum remains unknown. Here, by using the polyinosinic-polycytidylic acid (Poly I:C) model of gestational infection we show that viral-like immune activation at mid-gestation persistently changes hypothalamic neurocircuit parameters in mouse dams and, consequently, is adverse to parenting behavior. Poly I:C-exposed dams favor non-pup-directed exploratory behavior at the expense of pup retrieval. These behavioral deficits are underlain by dendrite pruning and lesser immediate early gene activation in Galanin (Gal)+ neurons with dam-specific transcriptional signatures that reside in the medial preoptic area (mPOA). Reduced activation of an exclusively inhibitory contingent of these distal-projecting Gal+ neurons allows for increased feed-forward inhibition onto putative dopaminergic neurons in the ventral tegmental area (VTA) in Poly I:C-exposed dams. Notably, destabilized VTA output specifically accompanies post-pup retrieval epochs. We suggest that gestational immunogenic insults bias both threat processing and reward perception, manifesting as disfavored infant caregiving.

Dynamics of Lateral Habenula-Ventral Tegmental Area Microcircuit on Pain-Related Cognitive Dysfunctions

Chronic pain is a health problem that affects the ability to work and perform other activities, and it generally worsens over time. Understanding the complex pain interaction with brain circuits could help predict which patients are at risk of developing central dysfunctions. Increasing evidence from preclinical and clinical studies suggests that aberrant activity of the lateral habenula (LHb) is associated with depressive symptoms characterized by excessive negative focus, leading to high-level cognitive dysfunctions. The primary output region of the LHb is the ventral tegmental area (VTA), through a bidirectional connection. Recently, there has been growing interest in the complex interactions between the LHb and VTA, particularly regarding their crucial roles in behavior regulation and their potential involvement in the pathological impact of chronic pain on cognitive functions. In this review, we briefly discuss the structural and functional roles of the LHb-VTA microcircuit and their impact on cognition and mood disorders in order to support future studies addressing brain plasticity during chronic pain conditions.

Inhibition of SK Channels in VTA Affects Dopaminergic Neurons to Improve the Depression-Like Behaviors of Post-Stroke Depression Rats

Purpose

This study aimed to investigate the effect of small-conductance calcium-activated potassium channels (SK channels) on the dopaminergic (DA) neuron pathways in the ventral tegmental area (VTA) during the pathogenesis of post-stroke depression (PSD) and explore the improvement of PSD by inhibiting the SK channels.

Patients and Methods

Four groups of Sprague-Dawley rats were randomly divided: Control, PSD, SK channel inhibitor (apamin) and SK channel activator (CyPPA) groups. In both control and CyPPA groups, sham surgery was performed. In the other two groups, middle cerebral arteries were occluded. The behavioral indicators related to depression in different groups were compared. Immunofluorescence was used to measure the activity of DA neurons in the VTA, while qRT-PCR was used to assess the expression of SK channel genes.

Results

The results showed that apamin treatment improved behavioral indicators related to depression compared to the PSD group. Furthermore, the qRT-PCR analysis revealed differential expression of the KCNN1 and KCNN3 subgenes of the SK channels in each group. Immunofluorescence analysis revealed an increase in the expression of DA neurons in the VTA of the PSD group, which was subsequently reduced upon apamin intervention.

Conclusion

This study suggests that SK channel activation following stroke contributes to depression-related behaviors in PSD rats through increased expression of DA neurons in the VTA. And depression-related behavior is improved in PSD rats by inhibiting the SK channels. The results of this study provide a new understanding of PSD pathogenesis and the possibility of developing new strategies to prevent PSD by targeting SK channels.

PET-measured human dopamine synthesis capacity and receptor availability predict trading rewards and time-costs during foraging

Foraging behavior requires weighing costs of time to decide when to leave one reward patch to search for another. Computational and animal studies suggest that striatal dopamine is key to this process; however, the specific role of dopamine in foraging behavior in humans is not well characterized. We use positron emission tomography (PET) imaging to directly measure dopamine synthesis capacity and D1 and D2/3 receptor availability in 57 healthy adults who complete a computerized foraging task. Using voxelwise data and principal component analysis to identify patterns of variation across PET measures, we show that striatal D1 and D2/3 receptor availability and a pattern of mesolimbic and anterior cingulate cortex dopamine function are important for adjusting the threshold for leaving a patch to explore, with specific sensitivity to changes in travel time. These findings suggest a key role for dopamine in trading reward benefits against temporal costs to modulate behavioral adaptions to changes in the reward environment critical for foraging.

Sex-specific adaptations to VTA circuits following subchronic stress

Dysregulation of the mesolimbic reward circuitry is implicated in the pathophysiology of stress-related illnesses such as depression and anxiety. These disorders are more frequently diagnosed in females, and sex differences in the response to stress are likely to be one factor that leads to enhanced vulnerability of females. In this study, we use subchronic variable stress (SCVS), a model in which females are uniquely vulnerable to behavioral disturbances, to investigate sexually divergent mechanisms of regulation of the ventral tegmental area by stress. Using slice electrophysiology, we find that female, but not male mice have a reduction in the ex vivo firing rate of VTA dopaminergic neurons following SCVS. Surprisingly, both male and female animals show an increase in inhibitory tone onto VTA dopaminergic neurons and an increase in the firing rate of VTA GABAergic neurons. In males, however, this is accompanied by a robust increase in excitatory synaptic tone onto VTA dopamine neurons. This supports a model by which SCVS recruits VTA GABA neurons to inhibit dopaminergic neurons in both male and female mice, but males are protected from diminished functioning of the dopaminergic system by a compensatory upregulation of excitatory synapses.

Nonlinear relationship between CAN current and C a 2 + influx underpins synergistic action of muscarinic and NMDA receptors on bursts induction in midbrain dopaminergic neurons

Bursting of midbrain dopamine (DA) neurons is believed to represent an important reward signal that instructs and reinforces goal-directed behaviors. In DA neurons, many afferents, including cholinergic and glutamatergic inputs, induce bursting, and it is suggested that a synergy exists between these afferents in bursting induction. However, the underlying mechanisms of the role and the synergy of muscarinic receptors (mAChRs) and NMDA receptors (NMDARs) in bursting induction remain unclear. Present work bestowed analysis using a mathematical model of DA neurons to demonstrate the underlying mechanisms. Activation of mAChRs, leading to rapid translocation of TRPC channels to cell surface, recruited C a 2 + -activated nonspecific (CAN) current ( I CAN ), meanwhile NMDARs excitation triggered C a 2 + influx, which induced the positive feedback loop of C a 2 + and I CAN , respectively, yielded a robust ramping depolarization with a superimposed high-frequency spiking. In some DA cells, neither NMDARs nor mAChRs induced positive feedback loop unless they were activated simultaneously to induce bursting. Our experimental results verified those theoretical findings. These together unveil the underlying mechanisms of the role and synergy of mAChRs and NMDARs in bursting induction emerge from the nonlinear relationship between C a 2 + influx and I CAN . Given the diverse and complex nature of neural circuitry and the DA neuron heterogeneity, our work provides new insights to understand specific afferents, the synergy between those afferents, and the differences in intrinsic excitability to be integrated by the bursting to accurately characterize the dopamine signals in the valances of reward and reinforcement, and a broad spectrum of neuropsychiatric disorders.

Characterisation of methylphenidate-induced excitation in midbrain dopamine neurons, an electrophysiological study in the rat brain

Methylphenidate (MPH) is a drug routinely used for patients with attention deficit and hyperactivity disorder (ADHD). Concerns arise about psychostimulant use, with dramatic increases in prescriptions. Besides, antipsychotic drugs are often administered in combination with MPH. In this study, we examine the consequences of MPH exposure in combination with dopamine D₂ receptor antagonism (eticlopride) on midbrain dopaminergic neurons in anaesthetised rodents, using in vivo extracellular single-cell electrophysiology. As expected, we show that methylphenidate (2 mg/kg, i.v.) decreases the firing and bursting activities of ventral tegmental area (VTA) dopamine neurons, an effect that is reversed with eticlopride (0.2 mg/kg, i.v.). However, using such a paradigm, we observed higher firing and bursting activities than under baseline conditions. Furthermore, we demonstrate that such an effect is dependent on dual alpha-1 and dopamine D₁ receptors, as well as glutamatergic transmission, through glutamate N-Methyl-D-aspartate (NMDA) receptor activation. Chronic MPH treatment during adolescence greatly dampens MPH-induced excitatory effects measured at adulthood. To conclude, we demonstrated here that a combination of methylphenidate and a dopamine D₂ receptor antagonist produced long-lasting consequences on midbrain dopamine neurons, via glutamatergic-dependent mechanisms.

Ih blockade reduces cocaine-induced firing patterns of putative dopaminergic neurons of the ventral tegmental area in the anesthetized rat

The hyperpolarization-activated cation current (Ih) is a determinant of intrinsic excitability in various cells, including dopaminergic neurons (DA) of the ventral tegmental area (VTA). In contrast to other cellular conductances, Ih is activated by hyperpolarization negative to -55 mV and activating Ih produces a time-dependent depolarizing current. Our laboratory demonstrated that cocaine sensitization, a chronic cocaine behavioral model, significantly reduces Ih amplitude in VTA DA neurons. Despite this reduction in Ih, the spontaneous firing of VTA DA cells after cocaine sensitization remained similar to control groups. Although the role of Ih in controlling VTA DA excitability is still poorly understood, our hypothesis is that Ih reduction could play a role of a homeostatic controller compensating for cocaine-induced change in excitability. Using in vivo single-unit extracellular electrophysiology in isoflurane anesthetized rats, we explored the contribution of Ih on spontaneous firing patterns of VTA DA neurons. A key feature of spontaneous excitability is bursting activity; bursting is defined as trains of two or more spikes occurring within a short interval and followed by a prolonged period of inactivity. Burst activity increases the reliability of information transfer. To elucidate the contribution of Ih to spontaneous firing patterns of VTA DA neurons, we locally infused an Ih blocker (ZD 7288, 8.3 μM) and evaluated its effect. Ih blockade significantly reduced firing rate, bursting frequency, and percent of spikes within a burst. In addition, Ih blockade significantly reduced acute cocaine-induced spontaneous firing rate, bursting frequency, and percent of spikes within a burst. Using whole-cell patch-clamp, we determine the progressive reduction of Ih after acute and chronic cocaine administration (15 mg/k.g intraperitoneally). Our data show a significant reduction (~25%) in Ih amplitude after 24 but not 2 h of acute cocaine administration. These results suggest that a progressive reduction of Ih could serve as a homeostatic regulator of cocaine-induced spontaneous firing patterns related to VTA DA excitability.

Brain-specific heterozygous loss-of-function of ATP2A2, endoplasmic reticulum Ca2+ pump responsible for Darier's disease, causes behavioral abnormalities and a hyper-dopaminergic state

A report of a family of Darier's disease with mood disorders drew attention when the causative gene was identified as ATP2A2 (or SERCA2), which encodes a Ca2+ pump on the endoplasmic reticulum (ER) membrane and is important for intracellular Ca2+ signaling. Recently, it was found that loss-of-function mutations of ATP2A2 confer a risk of neuropsychiatric disorders including depression, bipolar disorder and schizophrenia. In addition, a genome-wide association study found an association between ATP2A2 and schizophrenia. However, the mechanism of how ATP2A2 contributes to vulnerability to these mental disorders is unknown. Here, we analyzed Atp2a2 heterozygous brain-specific conditional knockout (hetero cKO) mice. The ER membranes prepared from the hetero cKO mouse brain showed decreased Ca2+ uptake activity. In Atp2a2 heterozygous neurons, decays of cytosolic Ca2+ level were slower than control neurons after depolarization. The hetero cKO mice showed altered behavioral responses to novel environments and impairments in fear memory, suggestive of enhanced dopamine signaling. In vivo dialysis demonstrated that extracellular dopamine levels in the NAc were indeed higher in the hetero cKO mice. These results altogether indicate that the haploinsufficiency of Atp2a2 in the brain causes prolonged cytosolic Ca2+ transients, which possibly results in enhanced dopamine signaling, a common feature of mood disorders and schizophrenia. These findings elucidate how ATP2A2 mutations causing a dermatological disease may exert their pleiotropic effects on the brain and confer a risk for mental disorders.

Early Pup Removal Leads to Social Dysfunction and Dopamine Deficit in Late Postpartum Rats: Prevention by Social Support

Offspring interaction is among the most highly motivated behaviors in maternal mammals and is mediated by mesolimbic dopamine (DA) system activation. Disruption or loss of significant social relationships is among the strongest individual predictors of affective dysregulation and depression onset in humans. However, little is known regarding the effects of disrupted mother–infant attachment (pup removal) in rat dams. Here, we tested the effects of permanent pup removal in rat dams, which were assigned to one of three groups on postpartum day (PD) 1: pups; pups removed, single-housed; or pups removed, co-housed with another dam who also had pups removed; and underwent a behavioral test battery during PD 21–23. In vivo electrophysiological recordings of ventral tegmental area (VTA) DA neurons were performed on PD 22 and 23 in a subset of animals. Pup removal did not impact sucrose consumption or anxiety-like behavior, but increased passive forced swim test (FST) coping responses. Pup-removal effects on social behavior and VTA activity were sensitive to social buffering: only single-housed dams exhibited reduced social motivation and decreased numbers of active DA neurons. Dams that had pups removed and were co-housed did not exhibit changes in social behavior or VTA function. Moreover, no changes in social behavior, FST coping, or VTA activity were found in socially isolated adult virgin females, indicating that effects observed in dams are specific to pup loss. This study showed that deprivation of species-expected social relationships (pups) during the postpartum precipitates an enduring negative affect state (enhanced passive coping, blunted social motivation) and attenuated VTA DA function in the dam, and that a subset of these effects is partially ameliorated through social buffering.

Physiology and Therapeutic Potential of SK, H, and M Medium AfterHyperPolarization Ion Channels

SK, HCN, and M channels are medium afterhyperpolarization (mAHP)-mediating ion channels. The three channels co-express in various brain regions, and their collective action strongly influences cellular excitability. However, significant diversity exists in the expression of channel isoforms in distinct brain regions and various subcellular compartments, which contributes to an equally diverse set of specific neuronal functions. The current review emphasizes the collective behavior of the three classes of mAHP channels and discusses how these channels function together although they play specialized roles. We discuss the biophysical properties of these channels, signaling pathways that influence the activity of the three mAHP channels, various chemical modulators that alter channel activity and their therapeutic potential in treating various neurological anomalies. Additionally, we discuss the role of mAHP channels in the pathophysiology of various neurological diseases and how their modulation can alleviate some of the symptoms.

Two opposite voltage-dependent currents control the unusual early development pattern of embryonic Renshaw cell electrical activity

Renshaw cells (V1^R) are excitable as soon as they reach their final location next to the spinal motoneurons and are functionally heterogeneous. Using multiple experimental approaches, in combination with biophysical modeling and dynamical systems theory, we analyzed, for the first time, the mechanisms underlying the electrophysiological properties of V1^R during early embryonic development of the mouse spinal cord locomotor networks (E11.5–E16.5). We found that these interneurons are subdivided into several functional clusters from E11.5 and then display an unexpected transitory involution process during which they lose their ability to sustain tonic firing. We demonstrated that the essential factor controlling the diversity of the discharge pattern of embryonic V1^R is the ratio of a persistent sodium conductance to a delayed rectifier potassium conductance. Taken together, our results reveal how a simple mechanism, based on the synergy of two voltage-dependent conductances that are ubiquitous in neurons, can produce functional diversity in embryonic V1^R and control their early developmental trajectory.

Interstitial ions: A key regulator of state-dependent neural activity?

Throughout the nervous system, ion gradients drive fundamental processes. Yet, the roles of interstitial ions in brain functioning is largely forgotten. Emerging literature is now revitalizing this area of neuroscience by showing that interstitial cations (K+, Ca2+ and Mg2+) are not static quantities but change dynamically across states such as sleep and locomotion. In turn, these state-dependent changes are capable of sculpting neuronal activity; for example, changing the local interstitial ion composition in the cortex is sufficient for modulating the prevalence of slow-frequency neuronal oscillations, or potentiating the gain of visually evoked responses. Disturbances in interstitial ionic homeostasis may also play a central role in the pathogenesis of central nervous system diseases. For example, impairments in K+ buffering occur in a number of neurodegenerative diseases, and abnormalities in neuronal activity in disease models disappear when interstitial K+ is normalized. Here we provide an overview of the roles of interstitial ions in physiology and pathology. We propose the brain uses interstitial ion signaling as a global mechanism to coordinate its complex activity patterns, and ion homeostasis failure contributes to central nervous system diseases affecting cognitive functions and behavior.

Maternal deprivation induces persistent adaptations in putative dopamine neurons in rat ventral tegmental area: in vivo electrophysiological study

Early life aversive experiences can trigger persistent deficits in neuronal signaling within the mesolimbic pathway, most notably in the dopamine (DA) neurons of the ventral tegmental area (VTA). The identity of such cellular mechanisms currently appears as an important issue. To address this concern, we investigated whether early life maternal deprivation (MD) would affect the electrical activity of VTA DA neurons, via in vivo extracellular single-unit recording. Male Wistar rats were deprived of their dams for 3 h per day from postnatal days (PND) 1-14. Thereafter, the adult animals (PND 70-80) were tested for the discharge activity of putative VTA DA neurons. The VTA DA neurons displayed a decrease in firing rate and an increase in the variability of baseline discharge activity in deprived animals. MD also caused a decrease in burst firing of VTA DA neurons compared to control subjects. In summary, early life MD induces a hypoactive VTA DA system, which may contribute to lifespan psychopathologies.

Context-Dependent Multiplexing by Individual VTA Dopamine Neurons

Dopamine (DA) neurons of the VTA track cues and rewards to generate a reward prediction error signal during Pavlovian conditioning. Here we explored how these neurons respond to a self-paced, operant task in freely moving mice. The animal could trigger a reward-predicting cue by remaining in a specific location of an operant box for a brief time before moving to a spout for reward collection. VTA DA neurons were identified using DAT-Cre male mice that carried an optrode with minimal impact on the behavioral task. In vivo single-unit recordings revealed transient fast spiking responses to the cue and reward in correct trials, while for incorrect ones the activity paused, reflecting positive and negative error signals of a reward prediction. In parallel, a majority of VTA DA neurons simultaneously encoded multiple actions (e.g., movement velocity, acceleration, distance to goal, and licking) in sustained slow firing modulation. Applying a GLM, we show that such multiplexed encoding of rewarding and motor variables by individual DA neurons was only apparent while the mouse was engaged in the task. Downstream targets may exploit such goal-directed multiplexing of VTA DA neurons to adjust actions to optimize the task's outcome.SIGNIFICANCE STATEMENT VTA DA neurons code for multiple functions, including the reward prediction error but also motivation and locomotion. Here we show that about half of the recorded VTA DA neurons perform multiplexing: they exploit the phasic and tonic activity modes to encode, respectively, the cue/reward responses and motor parameters, most prominently when the mouse engages in a self-paced operand task. VTA non-DA neurons, by contrast, encode motor parameters regardless of task engagement.

Antidepressant efficacy of a selective organic cation transporter blocker in a mouse model of depression

Current antidepressants act principally by blocking monoamine reuptake by high-affinity transporters in the brain. However, these antidepressants show important shortcomings such as slow action onset and limited efficacy in nearly a third of patients with major depression disorder. Here, we report the development of a prodrug targeting organic cation transporters (OCT), atypical monoamine transporters recently implicated in the regulation of mood. Using molecular modeling, we designed a selective OCT2 blocker, which was modified to increase brain penetration. This compound, H2-cyanome, was tested in a rodent model of chronic depression induced by 7-week corticosterone exposure. In male mice, prolonged administration of H2-cyanome induced positive effects on several behaviors mimicking symptoms of depression, including anhedonia, anxiety, social withdrawal, and memory impairment. Importantly, in this validated model, H2-cyanome compared favorably with the classical antidepressant fluoxetine, with a faster action on anhedonia and better anxiolytic effects. Integrated Z-scoring across these depression-like variables revealed a lower depression score for mice treated with H2-cyanome than for mice treated with fluoxetine for 3 weeks. Repeated H2-cyanome administration increased ventral tegmental area dopaminergic neuron firing, which may underlie its rapid action on anhedonia. H2-cyanome, like fluoxetine, also modulated several intracellular signaling pathways previously involved in antidepressant response. Our findings provide proof-of-concept of antidepressant efficacy of an OCT blocker, and a mechanistic framework for the development of new classes of antidepressants and therapeutic alternatives for resistant depression and other psychiatric disturbances such as anxiety.

Dimensions of control for subthreshold oscillations and spontaneous firing in dopamine neurons

Dopaminergic neurons (DAs) of the rodent substantia nigra pars compacta (SNc) display varied electrophysiological properties in vitro. Despite this, projection patterns and functional inputs from DAs to other structures are conserved, so in vivo delivery of consistent, well-timed dopamine modulation to downstream circuits must be coordinated. Here we show robust coordination by linear parameter controllers, discovered through powerful mathematical analyses of data and models, and from which consistent control of DA subthreshold oscillations (STOs) and spontaneous firing emerges. These units of control represent coordinated intracellular variables, sufficient to regulate complex cellular properties with radical simplicity. Using an evolutionary algorithm and dimensionality reduction, we discovered metaparameters, which when regressed against STO features, revealed a 2-dimensional control plane for the neuron’s 22-dimensional parameter space that fully maps the natural range of DA subthreshold electrophysiology. This plane provided a basis for spiking currents to reproduce a large range of the naturally occurring spontaneous firing characteristics of SNc DAs. From it we easily produced a unique population of models, derived using unbiased parameter search, that show good generalization to channel blockade and compensatory intracellular mechanisms. From this population of models, we then discovered low-dimensional controllers for regulating spontaneous firing properties, and gain insight into how currents active in different voltage regimes interact to produce the emergent activity of SNc DAs. Our methods therefore reveal simple regulators of neuronal function lurking in the complexity of combined ion channel dynamics.

Electrophysiological activity of the neuronal membrane and concomitant ion channel properties are highly variable within groups of neurons of the same type from the same brain region. Reconciliation of the mechanisms generating neuronal activity is challenging due to the complexity of the interactions between the channel currents involved. Here we present a set of mathematical analyses that uncover the low-dimensional intracellular parameter combinations capable of regulating features of subthreshold oscillations and spontaneous firing in empirically constrained models of nigral dopaminergic neurons. This method generates, from a naive starting point, linear combinations of ion channel properties that are surprisingly capable of reliably controlling a wide variety of emergent electrophysiological activity, thereby predicting drug effects and shedding light on unsuspected compensatory mechanisms that contribute to neuronal function.

GABA in the suprachiasmatic nucleus refines circadian output rhythms in mice

In mammals, the circadian rhythms are regulated by the central clock located in the hypothalamic suprachiasmatic nucleus (SCN), which is composed of heterogeneous neurons with various neurotransmitters. Among them an inhibitory neurotransmitter, γ-Amino-Butyric-Acid (GABA), is expressed in almost all SCN neurons, however, its role in the circadian physiology is still unclear. Here, we show that the SCN of fetal mice lacking vesicular GABA transporter (VGAT-/-) or GABA synthesizing enzyme, glutamate decarboxylase (GAD65-/-/67-/-), shows burst firings associated with large Ca2+ spikes throughout 24 hours, which spread over the entire SCN slice in synchrony. By contrast, circadian PER2 rhythms in VGAT-/- and GAD65-/-/67-/- SCN remain intact. SCN-specific VGAT deletion in adult mice dampens circadian behavior rhythm. These findings indicate that GABA in the fetal SCN is necessary for refinement of the circadian firing rhythm and, possibly, for stabilizing the output signals, but not for circadian integration of multiple cellular oscillations.

Forgetting in Reinforcement Learning Links Sustained Dopamine Signals to Motivation

It has been suggested that dopamine (DA) represents reward-prediction-error (RPE) defined in reinforcement learning and therefore DA responds to unpredicted but not predicted reward. However, recent studies have found DA response sustained towards predictable reward in tasks involving self-paced behavior, and suggested that this response represents a motivational signal. We have previously shown that RPE can sustain if there is decay/forgetting of learned-values, which can be implemented as decay of synaptic strengths storing learned-values. This account, however, did not explain the suggested link between tonic/sustained DA and motivation. In the present work, we explored the motivational effects of the value-decay in self-paced approach behavior, modeled as a series of ‘Go’ or ‘No-Go’ selections towards a goal. Through simulations, we found that the value-decay can enhance motivation, specifically, facilitate fast goal-reaching, albeit counterintuitively. Mathematical analyses revealed that underlying potential mechanisms are twofold: (1) decay-induced sustained RPE creates a gradient of ‘Go’ values towards a goal, and (2) value-contrasts between ‘Go’ and ‘No-Go’ are generated because while chosen values are continually updated, unchosen values simply decay. Our model provides potential explanations for the key experimental findings that suggest DA's roles in motivation: (i) slowdown of behavior by post-training blockade of DA signaling, (ii) observations that DA blockade severely impairs effortful actions to obtain rewards while largely sparing seeking of easily obtainable rewards, and (iii) relationships between the reward amount, the level of motivation reflected in the speed of behavior, and the average level of DA. These results indicate that reinforcement learning with value-decay, or forgetting, provides a parsimonious mechanistic account for the DA's roles in value-learning and motivation. Our results also suggest that when biological systems for value-learning are active even though learning has apparently converged, the systems might be in a state of dynamic equilibrium, where learning and forgetting are balanced.

Dopamine (DA) has been suggested to have two reward-related roles: (1) representing reward-prediction-error (RPE), and (2) providing motivational drive. Role(1) is based on the physiological results that DA responds to unpredicted but not predicted reward, whereas role(2) is supported by the pharmacological results that blockade of DA signaling causes motivational impairments such as slowdown of self-paced behavior. So far, these two roles are considered to be played by two different temporal patterns of DA signals: role(1) by phasic signals and role(2) by tonic/sustained signals. However, recent studies have found sustained DA signals with features indicative of both roles (1) and (2), complicating this picture. Meanwhile, whereas synaptic/circuit mechanisms for role(1), i.e., how RPE is calculated in the upstream of DA neurons and how RPE-dependent update of learned-values occurs through DA-dependent synaptic plasticity, have now become clarified, mechanisms for role(2) remain unclear. In this work, we modeled self-paced behavior by a series of ‘Go’ or ‘No-Go’ selections in the framework of reinforcement-learning assuming DA's role(1), and demonstrated that incorporation of decay/forgetting of learned-values, which is presumably implemented as decay of synaptic strengths storing learned-values, provides a potential unified mechanistic account for the DA's two roles, together with its various temporal patterns.

Implications of cellular models of dopamine neurons for disease

This review addresses the present state of single-cell models of the firing pattern of midbrain dopamine neurons and the insights that can be gained from these models into the underlying mechanisms for diseases such as Parkinson's, addiction, and schizophrenia. We will explain the analytical technique of separation of time scales and show how it can produce insights into mechanisms using simplified single-compartment models. We also use morphologically realistic multicompartmental models to address spatially heterogeneous aspects of neural signaling and neural metabolism. Separation of time scale analyses are applied to pacemaking, bursting, and depolarization block in dopamine neurons. Differences in subpopulations with respect to metabolic load are addressed using multicompartmental models.

Reversal of Alcohol-Induced Dysregulation in Dopamine Network Dynamics May Rescue Maladaptive Decision-making

Alcohol is the most commonly abused substance among adolescents, promoting the development of substance use disorders and compromised decision-making in adulthood. We have previously demonstrated, with a preclinical model in rodents, that adolescent alcohol use results in adult risk-taking behavior that positively correlates with phasic dopamine transmission in response to risky options, but the underlying mechanisms remain unknown. Here, we show that adolescent alcohol use may produce maladaptive decision-making through a disruption in dopamine network dynamics via increased GABAergic transmission within the ventral tegmental area (VTA). Indeed, we find that increased phasic dopamine signaling after adolescent alcohol use is attributable to a midbrain circuit, including the input from the pedunculopontine tegmentum to the VTA. Moreover, we demonstrate that VTA dopamine neurons from adult rats exhibit enhanced IPSCs after adolescent alcohol exposure corresponding to decreased basal dopamine levels in adulthood that negatively correlate with risk-taking. Building on these findings, we develop a model where increased inhibitory tone on dopamine neurons leads to a persistent decrease in tonic dopamine levels and results in a potentiation of stimulus-evoked phasic dopamine release that may drive risky choice behavior. Based on this model, we take a pharmacological approach to the reversal of risk-taking behavior through normalization of this pattern in dopamine transmission. These results isolate the underlying circuitry involved in alcohol-induced maladaptive decision-making and identify a novel therapeutic target.

SIGNIFICANCE STATEMENT

One of the primary problems resulting from chronic alcohol use is persistent, maladaptive decision-making that is associated with ongoing addiction vulnerability and relapse. Indeed, studies with the Iowa Gambling Task, a standard measure of risk-based decision-making, have reliably shown that alcohol-dependent individuals make riskier, more maladaptive choices than nondependent individuals, even after periods of prolonged abstinence. Using a preclinical model, in the current work, we identify a selective disruption in dopamine network dynamics that may promote maladaptive decision-making after chronic adolescent alcohol use and demonstrate its pharmacological reversal in adulthood. Together, these results highlight a novel neural mechanism underlying heightened risk-taking behavior in alcohol-dependent individuals and provide a potential therapeutic target for further investigation.