Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning

Knockdown of Piccolo in the Nucleus Accumbens Suppresses Methamphetamine-Induced Hyperlocomotion and Conditioned Place Preference in Mice

Methamphetamine (METH), the most widely distributed psychostimulant, aberrantly activates the reward system in the brain to induce addictive behaviors. The presynaptic protein "Piccolo", encoded by Pclo, was identified as a METH-responsive protein with enhanced expression in the nucleus accumbens (NAc) in mice. Although the physiological and pathological significance of Piccolo has been identified in dopaminergic signaling, its role in METH-induced behavioral abnormalities and the underlying mechanisms remain unclear. To clarify such functions, mice with Piccolo knockdown in the NAc (NAc-miPiccolo mice) by local injection of an adeno-associated virus vector carrying miRNA targeting Pclo were generated and investigated. NAc-miPiccolo mice exhibited suppressed hyperlocomotion, sensitization, and conditioned place preference behavior induced by systemic administration of METH. The excessive release of dopamine in the NAc was reduced in NAc-miPiccolo mice at baseline and in response to METH. These results suggest that Piccolo in the NAc is involved in METH-induced behavioral alterations and is a candidate therapeutic target for the treatment of drug addiction.

The dopamine circuit as a reward-taxis navigation system

Studying the brain circuits that control behavior is challenging, since in addition to their structural complexity there are continuous feedback interactions between actions and sensed inputs from the environment. It is therefore important to identify mathematical principles that can be used to develop testable hypotheses. In this study, we use ideas and concepts from systems biology to study the dopamine system, which controls learning, motivation, and movement. Using data from neuronal recordings in behavioral experiments, we developed a mathematical model for dopamine responses and the effect of dopamine on movement. We show that the dopamine system shares core functional analogies with bacterial chemotaxis. Just as chemotaxis robustly climbs chemical attractant gradients, the dopamine circuit performs ‘reward-taxis’ where the attractant is the expected value of reward. The reward-taxis mechanism provides a simple explanation for scale-invariant dopaminergic responses and for matching in free operant settings, and makes testable quantitative predictions. We propose that reward-taxis is a simple and robust navigation strategy that complements other, more goal-directed navigation mechanisms.

Connecting the dots between cell populations, whole-brain activity, and behavior

Simultaneously manipulating and monitoring both microscopic and macroscopic brain activity in vivo and identifying the linkage to behavior are powerful tools in neuroscience research. These capabilities have been realized with the recent technical advances of optogenetics and its combination with fMRI, here termed "opto-fMRI." Opto-fMRI allows for targeted brain region-, cell-type-, or projection-specific manipulation and targeted Ca 2 + activity measurement to be linked with global brain signaling and behavior. We cover the history, technical advances, applications, and important considerations of opto-fMRI in anesthetized and awake rodents and the future directions of the combined techniques in neuroscience and neuroimaging.

Dopamine errors drive excitatory and inhibitory components of backward conditioning in an outcome-specific manner

For over two decades, phasic activity in midbrain dopamine neurons was considered synonymous with the prediction error in temporal-difference reinforcement learning.^1-4 Central to this proposal is the notion that reward-predictive stimuli become endowed with the scalar value of predicted rewards. When these cues are subsequently encountered, their predictive value is compared to the value of the actual reward received, allowing for the calculation of prediction errors.^5,6 Phasic firing of dopamine neurons was proposed to reflect this computation,^1,2 facilitating the backpropagation of value from the predicted reward to the reward-predictive stimulus, thus reducing future prediction errors. There are two critical assumptions of this proposal: (1) that dopamine errors can only facilitate learning about scalar value and not more complex features of predicted rewards, and (2) that the dopamine signal can only be involved in anticipatory cue-reward learning in which cues or actions precede rewards. Recent work^7-15 has challenged the first assumption, demonstrating that phasic dopamine signals across species are involved in learning about more complex features of the predicted outcomes, in a manner that transcends this value computation. Here, we tested the validity of the second assumption. Specifically, we examined whether phasic midbrain dopamine activity would be necessary for backward conditioning-when a neutral cue reliably follows a rewarding outcome.^16-20 Using a specific Pavlovian-to-instrumental transfer (PIT) procedure,^21-23 we show rats learn both excitatory and inhibitory components of a backward association, and that this association entails knowledge of the specific identity of the reward and cue. We demonstrate that brief optogenetic inhibition of VTA_DA neurons timed to the transition between the reward and cue reduces both of these components of backward conditioning. These findings suggest VTA_DA neurons are capable of facilitating associations between contiguously occurring events, regardless of the content of those events. We conclude that these data may be in line with suggestions that the VTA_DA error acts as a universal teaching signal. This may provide insight into why dopamine function has been implicated in myriad psychological disorders that are characterized by very distinct reinforcement-learning deficits.

Racing and Pacing in the Reward System: A Multi-Clock Circadian Control Over Dopaminergic Signalling

Level of motivation, responsiveness to rewards and punishment, invigoration of exploratory behaviours, and motor performance are subject to daily fluctuations that emerge from circadian rhythms in neuronal activity of the midbrain’s dopaminergic system. While endogenous circadian rhythms are weak in the ventral tegmental area and substantia nigra pars compacta, daily changes in expression of core clock genes, ion channels, neurotransmitter receptors, dopamine-synthesising enzymes, and dopamine transporters, accompanied by changes in electrical activity, are readily observed in these nuclei. These processes cause dopamine levels released in structures innervated by midbrain dopaminergic neurons (e.g., the striatum) to oscillate in a circadian fashion. Additionally, growing evidence show that the master circadian clock located in the suprachiasmatic nucleus of the hypothalamus (SCN) rhythmically influences the activity of the dopaminergic system through various intermediate targets. Thus, circadian changes in the activity of the dopaminergic system and concomitant dopamine release observed on a daily scale are likely to be generated both intrinsically and entrained by the master clock. Previous studies have shown that the information about the value and salience of stimuli perceived by the animal is encoded in the neuronal activity of brain structures innervating midbrain dopaminergic centres. Some of these structures themselves are relatively autonomous oscillators, while others exhibit a weak endogenous circadian rhythm synchronised by the SCN. Here, we place the dopaminergic system as a hub in the extensive network of extra-SCN circadian oscillators and discuss the possible consequences of its daily entrainment for animal physiology and behaviour.

Tether-free photothermal deep-brain stimulation in freely behaving mice via wide-field illumination in the near-infrared-II window

Neural circuitry is typically modulated via invasive brain implants and tethered optical fibres in restrained animals. Here we show that wide-field illumination in the second near-infrared spectral window (NIR-II) enables implant-and-tether-free deep-brain stimulation in freely behaving mice with stereotactically injected macromolecular photothermal transducers activating neurons ectopically expressing the temperature-sensitive transient receptor potential cation channel subfamily V member 1 (TRPV1). The macromolecular transducers, ~40 nm in size and consisting of a semiconducting polymer core and an amphiphilic polymer shell, have a photothermal conversion efficiency of 71% at 1,064 nm, the wavelength at which light attenuation by brain tissue is minimized (within the 400-1,800 nm spectral window). TRPV1-expressing neurons in the hippocampus, motor cortex and ventral tegmental area of mice can be activated with minimal thermal damage on wide-field NIR-II illumination from a light source placed at distances higher than 50 cm above the animal's head and at an incident power density of 10 mW mm-2. Deep-brain stimulation via wide-field NIR-II illumination may open up opportunities for social behavioural studies in small animals.

The PACAP Paradox: Dynamic and Surprisingly Pleiotropic Actions in the Central Regulation of Energy Homeostasis

Pituitary Adenylate Cyclase-Activating Polypeptide (PACAP), a pleiotropic neuropeptide, is widely distributed throughout the body. The abundance of PACAP expression in the central and peripheral nervous systems, and years of accompanying experimental evidence, indicates that PACAP plays crucial roles in diverse biological processes ranging from autonomic regulation to neuroprotection. In addition, PACAP is also abundantly expressed in the hypothalamic areas like the ventromedial and arcuate nuclei (VMN and ARC, respectively), as well as other brain regions such as the nucleus accumbens (NAc), bed nucleus of stria terminalis (BNST), and ventral tegmental area (VTA) - suggesting that PACAP is capable of regulating energy homeostasis via both the homeostatic and hedonic energy balance circuitries. The evidence gathered over the years has increased our appreciation for its function in controlling energy balance. Therefore, this review aims to further probe how the pleiotropic actions of PACAP in regulating energy homeostasis is influenced by sex and dynamic changes in energy status. We start with a general overview of energy homeostasis, and then introduce the integral components of the homeostatic and hedonic energy balance circuitries. Next, we discuss sex differences inherent to the regulation of energy homeostasis via these two circuitries, as well as the activational effects of sex steroid hormones that bring about these intrinsic disparities between males and females. Finally, we explore the multifaceted role of PACAP in regulating homeostatic and hedonic feeding through its actions in regions like the NAc, BNST, and in particular the ARC, VMN and VTA that occur in sex- and energy status-dependent ways.

Anatomy and Function of Ventral Tegmental Area Glutamate Neurons

The ventral tegmental area (VTA) is well known for regulating reward consumption, learning, memory, and addiction behaviors through mediating dopamine (DA) release in downstream regions. Other than DA neurons, the VTA is known to be heterogeneous and contains other types of neurons, including glutamate neurons. In contrast to the well-studied and established functions of DA neurons, the role of VTA glutamate neurons is understudied, presumably due to their relatively small quantity and a lack of effective means to study them. Yet, emerging studies have begun to reveal the importance of glutamate release from VTA neurons in regulating diverse behavioral repertoire through a complex intra-VTA and long-range neuronal network. In this review, we summarize the features of VTA glutamate neurons from three perspectives, namely, cellular properties, neural connections, and behavioral functions. Delineation of VTA glutamatergic pathways and their interactions with VTA DA neurons in regulating behaviors may reveal previously unappreciated functions of the VTA in other physiological processes.

Implantable Aptamer-Graphene Microtransistors for Real-Time Monitoring of Neurochemical Release in Vivo

The real-time monitoring of neurochemical release in vivo plays a critical role in understanding the biochemical process of the complex nervous system. Current technologies for such applications, including microdialysis and fast-scan cyclic voltammetry, suffer from limited spatiotemporal resolution or poor selectivity. Here, we report a soft implantable aptamer-graphene microtransistor probe for real-time monitoring of neurochemical release. As a demonstration, we show the monitoring of dopamine with nearly cellular-scale spatial resolution, high selectivity (dopamine sensor >19-fold over norepinephrine), and picomolar sensitivity, simultaneously. Systematic benchtop evaluations, ex vivo experiments, and in vivo studies in mice models highlight the key features and demonstrate the capability of capturing the dopamine release dynamics evoked by pharmacological stimulation, suggesting the potential applications in basic neuroscience studies and studying neurological disease-related processes. The developed system can be easily adapted for monitoring other neurochemicals and drugs by simply replacing the aptamers functionalized on the graphene microtransistors.

The incentive amplifying effects of nicotine: Roles in alcohol seeking and consumption

Nicotine has a unique profile among drugs of abuse. To the noninitiated user, nicotine has powerful aversive effects and its relatively weak euphorigenic effects undergo rapid tolerance. Despite this, nicotine is commonly abused despite negative heath consequences, and nicotine users have enormous difficulty quitting. Further, nicotine is one of the most commonly co-abused substances, in that it is often taken in combination with other drugs. One explanation of this polydrug use is that nicotine has multiple appetitive and consummatory conditioning effects. For example, nicotine is a reinforcement enhancer in that it can potently increase the incentive value of other stimuli, including those surrounding drugs of abuse such as alcohol. In addition, nicotine also has a unique profile of neurobiological effects that alter regulation of alcohol intake and interoception. This review discusses the psychological and biological mechanisms surrounding nicotine's appetitive conditioning and consummatory effects, particularly its interactions with alcohol.

Role of upregulation of the KATP channel subunit SUR1 in dopaminergic neuron degeneration in Parkinson's disease

Accumulating evidence suggests that ATP‐sensitive potassium (K_ATP) channels play an important role in the selective degeneration of dopaminergic neurons in the substantia nigra (SN). Furthermore, the expression of the K_ATP channel subunit sulfonylurea receptor 1 (SUR1) is upregulated in the remaining nigral dopaminergic neurons in Parkinson's disease (PD). However, the mechanism underlying this selective upregulation of the SUR1 subunit and its subsequent roles in PD progression are largely unknown. In 3‐, 6‐, and 9‐month‐old A53T α‐synuclein transgenic (α‐SynA53T^+/+) mice, only the SUR1 subunit and not SUR2B or Kir6.2 was upregulated, accompanied by neuronal damage. Moreover, the occurrence of burst firing in dopaminergic neurons was increased with the upregulation of the SUR1 subunit, whereas no changes in the firing rate were observed except in 9‐month‐old α‐SynA53T^+/+ mice. After interference with SUR1 expression by injection of lentivirus into the SN, the progression of dopaminergic neuron degeneration was delayed. Further studies showed that elevated expression of the transcription factors FOXA1 and FOXA2 could cause the upregulation of the SUR1 subunit in α‐SynA53T^+/+ mice. Our findings revealed the regulatory mechanism of the SUR1 subunit and the role of K_ATP channels in the progression of dopaminergic neuron degeneration, providing a new target for PD drug therapy.

Natural VTA activity during NREM sleep influences future exploratory behavior

During wakefulness, the VTA represents the valence of experiences and mediates affective response to the outside world. Recent work revealed that two major VTA populations – dopamine and GABA neurons – are highly active during REM sleep and less active during NREM sleep. Using long-term cell type and brain state-specific recordings, machine learning, and optogenetics, we examined the role that the sleep-activity of these neurons plays in subsequent awake behavior. We found that VTA activity during NREM (but not REM) sleep correlated with exploratory features of the next day’s behavior. Disrupting natural VTA activity during NREM (but not REM) sleep reduced future tendency to explore and increased preferences for familiarity and goal-directed actions, with no direct effect on learning or memory. Our data suggest that, during deep sleep, VTA neurons engage in offline processing, consolidating not memories but affective responses to remembered environments, shaping the way that animals respond to future experiences.

•

Dopamine and GABA neurons in the VTA are active during NREM as well as REM sleep

•

VTA activity during NREM-sleep — but not REM-sleep — is correlated with exploration the next day

•

Inhibiting this activity during NREM-sleep — but not REM-sleep — reduces future exploration

A D2 to D1 shift in dopaminergic inputs to midbrain 5-HT neurons causes anorexia in mice

Midbrain dopamine (DA) and serotonin (5-HT) neurons regulate motivated behaviors, including feeding, but less is known about how these circuits may interact. In this study, we found that DA neurons in the mouse ventral tegmental area bidirectionally regulate the activity of 5-HT neurons in the dorsal raphe nucleus (DRN), with weaker stimulation causing DRD2-dependent inhibition and overeating, while stronger stimulation causing DRD1-dependent activation and anorexia. Furthermore, in the activity-based anorexia (ABA) paradigm, which is a mouse model mimicking some clinical features of human anorexia nervosa (AN), we observed a DRD2 to DRD1 shift of DA neurotransmission on 5-HT^DRN neurons, which causes constant activation of these neurons and contributes to AN-like behaviors. Finally, we found that systemic administration of a DRD1 antagonist can prevent anorexia and weight loss in ABA. Our results revealed regulation of feeding behavior by stimulation strength-dependent interactions between DA and 5-HT neurons, which may contribute to the pathophysiology of AN.

Context coding in the mouse nucleus accumbens modulates motivationally relevant information

Neural activity in the nucleus accumbens (NAc) is thought to track fundamentally value-centric quantities linked to reward and effort. However, the NAc also contributes to flexible behavior in ways that are difficult to explain based on value signals alone, raising the question of if and how nonvalue signals are encoded in NAc. We recorded NAc neural ensembles while head-fixed mice performed an odor-based biconditional discrimination task where an initial discrete cue modulated the behavioral significance of a subsequently presented reward-predictive cue. We extracted single-unit and population-level correlates related to the cues and found value-independent coding for the initial, context-setting cue. This context signal occupied a population-level coding space orthogonal to outcome-related representations and was predictive of subsequent behaviorally relevant responses to the reward-predictive cues. Together, these findings support a gating model for how the NAc contributes to behavioral flexibility and provide a novel population-level perspective from which to view NAc computations.

An atlas of transcriptionally defined cell populations in the rat ventral tegmental area

The ventral tegmental area (VTA) is a complex brain region that is essential for reward function and frequently implicated in neuropsychiatric disease. While decades of research on VTA function have focused on dopamine neurons, recent evidence has identified critical roles for GABAergic and glutamatergic neurons in reward processes. Additionally, although subsets of VTA neurons express genes involved in the synthesis and transport of multiple neurotransmitters, characterization of these combinatorial populations has largely relied on low-throughput methods. To comprehensively define the molecular architecture of the VTA, we performed single-nucleus RNA sequencing on 21,600 cells from the rat VTA. Analysis of neuronal subclusters identifies selective markers for dopamine and combinatorial neurons, reveals expression profiles for receptors targeted by drugs of abuse, and demonstrates population-specific enrichment of gene sets linked to brain disorders. These results highlight the heterogeneity of the VTA and provide a resource for further exploration of VTA gene expression.

The Convergence Model of Brain Reward Circuitry: Implications for Relief of Treatment-Resistant Depression by Deep-Brain Stimulation of the Medial Forebrain Bundle

Deep-brain stimulation of the medial forebrain bundle (MFB) can provide effective, enduring relief of treatment-resistant depression. Panksepp provided an explanatory framework: the MFB constitutes the core of the neural circuitry subserving the anticipation and pursuit of rewards: the “SEEKING” system. On that view, the SEEKING system is hypoactive in depressed individuals; background electrical stimulation of the MFB alleviates symptoms by normalizing activity. Panksepp attributed intracranial self-stimulation to excitation of the SEEKING system in which the ascending projections of midbrain dopamine neurons are an essential component. In parallel with Panksepp’s qualitative work, intracranial self-stimulation has long been studied quantitatively by psychophysical means. That work argues that the predominant directly stimulated substrate for MFB self-stimulation are myelinated, non-dopaminergic fibers, more readily excited by brief electrical current pulses than the thin, unmyelinated axons of the midbrain dopamine neurons. The series-circuit hypothesis reconciles this view with the evidence implicating dopamine in MFB self-stimulation as follows: direct activation of myelinated MFB fibers is rewarding due to their trans-synaptic activation of midbrain dopamine neurons. A recent study in which rats worked for optogenetic stimulation of midbrain dopamine neurons challenges the series-circuit hypothesis and provides a new model of intracranial self-stimulation in which the myelinated non-dopaminergic neurons and the midbrain dopamine projections access the behavioral final common path for reward seeking via separate, converging routes. We explore the potential implications of this convergence model for the interpretation of the antidepressant effect of MFB stimulation. We also discuss the consistent finding that psychomotor stimulants, which boost dopaminergic neurotransmission, fail to provide a monotherapy for depression. We propose that non-dopaminergic MFB components may contribute to the therapeutic effect in parallel to, in synergy with, or even instead of, a dopaminergic component.

The D2-like Dopamine Receptor Agonist Quinpirole Microinjected Into the Ventral Pallidum Dose-Dependently Inhibits the VTA and Induces Place Aversion

BACKGROUND

The ventral pallidum (VP) is a dopaminoceptive forebrain structure regulating the ventral tegmental area (VTA) dopaminergic population activity. We have recently demonstrated that in the VP, the D2-like dopamine (DA) receptor agonist quinpirole dose dependently facilitates memory consolidation in inhibitory avoidance and spatial learning. According to our hypothesis, quinpirole microinjected into the VP can modulate the VTA DAergic activity and influence motivation and learning processes of rats.

METHODS

Quinpirole was microinjected at 3 different doses into the VP of male rats, and controls received vehicle. Single unit recordings were employed to assess VTA DAergic activity. To investigate the possible reinforcing or aversive effect of quinpirole in the VP, the conditioned place preference paradigm was used.

RESULTS

Our results showed that intra-VP quinpirole microinjection regulates VTA DAergic neurons according to an inverted U-shaped dose-response curve. The largest dose of quinpirole decreased the population activity and strongly reduced burst activity of the DAergic neurons in the first hour after its application. In contrast, the 2 smaller doses increased DA population activity, but their effect started with a delay 1 hour after their microinjection. The CPP experiments revealed that the largest dose of quinpirole in the VP induced place aversion in the rats. Furthermore, the largest dose of quinpirole induced an acute locomotor activity reduction, while the medium dose led to a long-duration increase in locomotion.

CONCLUSIONS

In summary, quinpirole dose dependently regulates VTA DAergic activity as well as the motivation and motor behavior of the rats at the level of the VP.

The Novel Analogue of Modafinil CE-158 Protects Social Memory against Interference and Triggers the Release of Dopamine in the Nucleus Accumbens of Mice

Previous studies have shown that atypical dopamine-transporter-inhibitors such as modafinil and its analogues modify behavioral and cognitive functions in rodents. Here, we tested potential promnestic effects of the novel, more dopamine-transporter selective modafinil analogue CE-158 in the social discrimination memory task in male mice. Systemic administration of CE-158 1 h before the social learning event prevented the impairment of social-recognition memory following retroactive interference 3 h after the learning session of a juvenile conspecific. This effect was dose-dependent, as mice treated with 10 mg/kg, but not with 1 mg/kg CE-158, were able to discriminate between the novel and familiar conspecific despite the presentation of an interference stimulus, both 3 h and 6 h post learning. However, when 10 mg/kg of the drug was administered after learning, CE-158 failed to prevent social memory from interference. Paralleling these behavioral effects, the systemic administration of 10 mg/kg CE-158 caused a rapid and sustained elevation of extracellular dopamine in the nucleus accumbens, a brain area where dopaminergic signaling plays a key role in learning and memory function, of freely moving mice, while 1 mg/kg was not sufficient for altering dopamine levels. Taken together, our findings suggest promnestic effects of the novel dopamine-transporter-inhibitor CE-158 in a social recognition memory test that may be in part mediated via increased dopamine-neurotransmission in the nucleus accumbens. Thus, selective-dopamine-transporter-inhibitors such as CE-158 may represent interesting drug candidates for the treatment of memory complaints observed in humans with cognitive impairments and dementia.

Opposite effects of stress on effortful motivation in high and low anxiety are mediated by CRHR1 in the VTA

Individuals frequently differ in their behavioral and cognitive responses to stress. However, whether motivation is differently affected by acute stress in different individuals remains to be established. By exploiting natural variation in trait anxiety in outbred Wistar rats, we show that acute stress facilitates effort-related motivation in low anxious animals, while dampening effort in high anxious ones. This model allowed us to address the mechanisms underlying acute stress-induced differences in motivated behavior. We show that CRHR1 expression levels in dopamine neurons of the ventral tegmental area (VTA)-a neuronal type implicated in the regulation of motivation-depend on animals' anxiety, and these differences in CRHR1 expression levels explain the divergent effects of stress on both effortful behavior and the functioning of mesolimbic DA neurons. These findings highlight CRHR1 in VTA DA neurons-whose levels vary with individuals' anxiety-as a switching mechanism determining whether acute stress facilitates or dampens motivation.

Social Determinants of Inter-Individual Variability and Vulnerability: The Role of Dopamine

Individuals differ in their traits and preferences, which shape their interactions, their prospects for survival and their susceptibility to diseases. These correlations are well documented, yet the neurophysiological mechanisms underlying the emergence of distinct personalities and their relation to vulnerability to diseases are poorly understood. Social ties, in particular, are thought to be major modulators of personality traits and psychiatric vulnerability, yet the majority of neuroscience studies are performed on rodents in socially impoverished conditions. Rodent micro-society paradigms are therefore key experimental paradigms to understand how social life generates diversity by shaping individual traits. Dopamine circuitry is implicated at the interface between social life experiences, the expression of essential traits, and the emergence of pathologies, thus proving a possible mechanism to link these three concepts at a neuromodulatory level. Evaluating inter-individual variability in automated social testing environments shows great promise for improving our understanding of the link between social life, personality, and precision psychiatry – as well as elucidating the underlying neurophysiological mechanisms.

Developments from Bulk Optogenetics to Single-Cell Strategies to Dissect the Neural Circuits that Underlie Aberrant Motivational States

Motivational states are regulated by complex networks across brain regions that are composed of genetically and functionally distinct neuronal populations. Disruption within these neural circuits leads to aberrant motivational states and are thought to be the root cause of psychiatric disorders related to reward processing and addiction. Critical technological advances in the field have revolutionized the study of neural systems by allowing the use of optical strategies to precisely control and visualize neural activity within genetically identified neural populations in the brain. This review will provide a brief introduction into the history of how technological advances in single-cell strategies have been applied to elucidate the neural circuits that underlie aberrant motivational states that often lead to dysfunction in reward processing and addiction.

Optogenetic stimulation of lateral hypothalamic orexin/dynorphin inputs in the ventral tegmental area potentiates mesolimbic dopamine neurotransmission and promotes reward-seeking behaviours

Reward and reinforcement processes are critical for survival and propagation of genes. While numerous brain systems underlie these processes, a cardinal role is ascribed to mesolimbic dopamine. However, ventral tegmental area (VTA) dopamine neurons receive complex innervation and various neuromodulatory factors, including input from lateral hypothalamic (LH) orexin/hypocretin neurons which also express and co-release the neuropeptide, dynorphin. Dynorphin in the VTA induces aversive conditioning through the Kappa opioid receptor (KOR) and decreases dopamine when administered intra-VTA. Exogenous application of orexin or orexin 1 receptor (oxR1) antagonists in the VTA bidirectionally modulates dopamine-driven motivation and reward-seeking behaviours, including the attribution of motivational value to primary rewards and associated conditioned stimuli. However, the effect of endogenous stimulation of LH orexin/dynorphin-containing projections to the VTA and the potential contribution of co-released dynorphin on mesolimbic dopamine and reward related processes remains uncharacterised. We combined optogenetic, electrochemical, and behavioural approaches to examine this. We found that optical stimulation of LH orexin/dynorphin inputs in the VTA potentiates mesolimbic dopamine neurotransmission in the nucleus accumbens (NAc) core, produces real time and conditioned place preference, and increases the food cue-directed orientation in a Pavlovian conditioning procedure. LH orexin/dynorphin potentiation of NAc dopamine release and real time place preference was blocked by an oxR1, but not KOR antagonist. Thus, rewarding effects associated with optical stimulation of LH orexin/dynorphin inputs in the VTA are predominantly driven by orexin rather than dynorphin.

NAc-VTA circuit underlies emotional stress-induced anxiety-like behavior in the three-chamber vicarious social defeat stress mouse model

Emotional stress is considered a severe pathogenetic factor of psychiatric disorders. However, the circuit mechanisms remain largely unclear. Using a three-chamber vicarious social defeat stress (3C-VSDS) model in mice, we here show that chronic emotional stress (CES) induces anxiety-like behavior and transient social interaction changes. Dopaminergic neurons of ventral tegmental area (VTA) are required to control this behavioral deficit. VTA dopaminergic neuron hyperactivity induced by CES is involved in the anxiety-like behavior in the innate anxiogenic environment. Chemogenetic activation of VTA dopaminergic neurons directly triggers anxiety-like behavior, while chemogenetic inhibition of these neurons promotes resilience to the CES-induced anxiety-like behavior. Moreover, VTA dopaminergic neurons receiving nucleus accumbens (NAc) projections are activated in CES mice. Bidirectional modulation of the NAc-VTA circuit mimics or reverses the CES-induced anxiety-like behavior. In conclusion, we propose that a NAc-VTA circuit critically establishes and regulates the CES-induced anxiety-like behavior. This study not only characterizes a preclinical model that is representative of the nuanced aspect of CES, but also provides insight to the circuit-level neuronal processes that underlie empathy-like behavior.

Phasic firing of dopaminergic neurons in the ventral tegmental area triggers peripheral immune responses

Dopaminergic neurons in the ventral tegmental area (VTA) play a crucial role in the processing of reward-related information. Recent studies with pharmacological manipulations of VTA neuronal activity demonstrated a VTA-induced immunoenhancement in peripheral organs. Here, to examine the detailed physiological dynamics, we took an optogenetic approach in which VTA dopaminergic neurons were selectively activated with millisecond precision. Optogenetic phasic, rather than tonic, stimulation of VTA dopaminergic neurons increased serum cytokine levels, such as IL-2, IL-4 and TNF-α. These results provide direct evidence to link dopaminergic neuronal phasic firing to peripheral immunity. Next, we tested whether cytokine induction in male mice was boosted by female encounters, a natural condition that induces increased active VTA neurons and gamma power. Female encounters increased serum IL-2 levels, which were abolished by pharmacological inhibition of VTA neuronal activity. Taken together, our results highlight the importance of the brain reward system in the treatment and management of immune-related disorders.

Multimodal neural probes for combined optogenetics and electrophysiology

To understand how brain functions arise from interconnected neural networks, it is necessary to develop tools that can allow simultaneous manipulation and recording of neural activities. Multimodal neural probes, especially those that combine optogenetics with electrophysiology, provide a powerful tool for the dissection of neural circuit functions and understanding of brain diseases. In this review, we provide an overview of recent developments in multimodal neural probes. We will focus on materials and integration strategies of multimodal neural probes to achieve combined optogenetic stimulation and electrical recordings with high spatiotemporal precision and low invasiveness. In addition, we will also discuss future opportunities of multimodal neural interfaces in basic and translational neuroscience.

Functional dissociation of behavioral effects from acetylcholine and glutamate released from cholinergic striatal interneurons

In the striatum, cholinergic interneurons (CINs) have the ability to release both acetylcholine and glutamate, due to the expression of the vesicular acetylcholine transporter (VAChT) and the vesicular glutamate transporter 3 (VGLUT3). However, the relationship these neurotransmitters have in the regulation of behavior is not fully understood. Here we used reward‐based touchscreen tests in mice to assess the individual and combined contributions of acetylcholine/glutamate co‐transmission in behavior. We found that reduced levels of the VAChT from CINs negatively impacted dopamine signalling in response to reward, and disrupted complex responses in a sequential chain of events. In contrast, diminished VGLUT3 levels had somewhat opposite effects. When mutant mice were treated with haloperidol in a cue‐based task, the drug did not affect the performance of VAChT mutant mice, whereas VGLUT3 mutant mice were highly sensitive to haloperidol. In mice where both vesicular transporters were deleted from CINs, we observed altered reward‐evoked dopaminergic signalling and behavioral deficits that resemble, but were worse, than those in mice with specific loss of VAChT alone. These results demonstrate that the ability to secrete two different neurotransmitters allows CINs to exert complex modulation of a wide range of behaviors.

Spatial goal coding in the hippocampal formation

The mammalian hippocampal formation contains several distinct populations of neurons involved in representing self-position and orientation. These neurons, which include place, grid, head direction, and boundary-vector cells, are thought to collectively instantiate cognitive maps supporting flexible navigation. However, to flexibly navigate, it is necessary to also maintain internal representations of goal locations, such that goal-directed routes can be planned and executed. Although it has remained unclear how the mammalian brain represents goal locations, multiple neural candidates have recently been uncovered during different phases of navigation. For example, during planning, sequential activation of spatial cells may enable simulation of future routes toward the goal. During travel, modulation of spatial cells by the prospective route, or by distance and direction to the goal, may allow maintenance of route and goal-location information, supporting navigation on an ongoing basis. As the goal is approached, an increased activation of spatial cells may enable the goal location to become distinctly represented within cognitive maps, aiding goal localization. Lastly, after arrival at the goal, sequential activation of spatial cells may represent the just-taken route, enabling route learning and evaluation. Here, we review and synthesize these and other evidence for goal coding in mammalian brains, relate the experimental findings to predictions from computational models, and discuss outstanding questions and future challenges.

Ih blockade reduces cocaine-induced firing patterns of putative dopaminergic neurons of the ventral tegmental area in the anesthetized rat

The hyperpolarization-activated cation current (Ih) is a determinant of intrinsic excitability in various cells, including dopaminergic neurons (DA) of the ventral tegmental area (VTA). In contrast to other cellular conductances, Ih is activated by hyperpolarization negative to -55 mV and activating Ih produces a time-dependent depolarizing current. Our laboratory demonstrated that cocaine sensitization, a chronic cocaine behavioral model, significantly reduces Ih amplitude in VTA DA neurons. Despite this reduction in Ih, the spontaneous firing of VTA DA cells after cocaine sensitization remained similar to control groups. Although the role of Ih in controlling VTA DA excitability is still poorly understood, our hypothesis is that Ih reduction could play a role of a homeostatic controller compensating for cocaine-induced change in excitability. Using in vivo single-unit extracellular electrophysiology in isoflurane anesthetized rats, we explored the contribution of Ih on spontaneous firing patterns of VTA DA neurons. A key feature of spontaneous excitability is bursting activity; bursting is defined as trains of two or more spikes occurring within a short interval and followed by a prolonged period of inactivity. Burst activity increases the reliability of information transfer. To elucidate the contribution of Ih to spontaneous firing patterns of VTA DA neurons, we locally infused an Ih blocker (ZD 7288, 8.3 μM) and evaluated its effect. Ih blockade significantly reduced firing rate, bursting frequency, and percent of spikes within a burst. In addition, Ih blockade significantly reduced acute cocaine-induced spontaneous firing rate, bursting frequency, and percent of spikes within a burst. Using whole-cell patch-clamp, we determine the progressive reduction of Ih after acute and chronic cocaine administration (15 mg/k.g intraperitoneally). Our data show a significant reduction (~25%) in Ih amplitude after 24 but not 2 h of acute cocaine administration. These results suggest that a progressive reduction of Ih could serve as a homeostatic regulator of cocaine-induced spontaneous firing patterns related to VTA DA excitability.

Linking Ethanol-Addictive Behaviors With Brain Catecholamines: Release Pattern Matters

Using a variety of animal models that simulate key features of the alcohol use disorder (AUD), remarkable progress has been made in identifying neurochemical targets that may contribute to the development of alcohol addiction. In this search, the dopamine (DA) and norepinephrine (NE) systems have been long thought to play a leading role in comparison with other brain systems. However, just recent development and application of optogenetic approaches into the alcohol research field provided opportunity to identify neuronal circuits and specific patterns of neurotransmission that govern the key components of ethanol-addictive behaviors. This critical review summarizes earlier findings, which initially disclosed catecholamine substrates of ethanol actions in the brain and shows how the latest methodologies help us to reveal the significance of DA and NE release changes. Specifically, we focused on recent optogenetic investigations aimed to reveal cause-effect relationships between ethanol-drinking (seeking and taking) behaviors and catecholamine dynamics in distinct brain pathways. These studies gain the knowledge that is needed for the better understanding addiction mechanisms and, therefore, for development of more effective AUD treatments. Based on the reviewed findings, new messages for researches were indicated, which may have broad applications beyond the field of alcohol addiction.

Effects of methamphetamine-induced neurotoxicity on striatal long-term potentiation

RATIONALE

Methamphetamine (METH) exposure is associated with damage to central monoamine systems, particularly dopamine signaling. Rodent models of such damage have revealed a decrease in the amplitude of phasic dopamine signals and significant striatal dysfunction, including changes in the molecular, system, and behavioral functions of the striatum. Dopamine signaling through D1 receptors promotes corticostriatal long-term potentiation (LTP), a critical substrate of these striatal functions.

OBJECTIVES

Therefore, the purpose of this study was to determine if METH-induced dopamine neurotoxicity would impair D1 receptor-dependent striatal LTP in mice.

METHODS

Mice were treated with a METH binge regimen (4 × 10 mg/kg d,l-methamphetamine, s.c.) that recapitulates all of the known METH-induced neurotoxic effects observed in humans, including dopamine toxicity. Three weeks later, acute brain slices containing either the dorsomedial striatum (DMS) or dorsolateral striatum (DLS) were prepared, and plasticity was assessed using white matter, high-frequency stimulation (HFS), and striatal extracellular electrophysiology.

RESULTS

Under these conditions, LTP was induced in brain slices containing the DMS from saline-pretreated mice, but not mice with METH-induced neurotoxicity. Furthermore, the LTP observed in DMS slices from saline-pretreated mice was blocked by the dopamine D1 receptor antagonist SCH23390, indicating that this LTP is dopamine D1 receptor-dependent. Finally, acute in vivo treatment of METH-pretreated mice with bupropion (50 mg/kg, i.p.) promoted LTP in DMS slices.

CONCLUSIONS

Together, these studies demonstrate that METH-induced neurotoxicity impairs dopamine D1 receptor-dependent LTP within the DMS and that the FDA-approved drug bupropion restores induction of striatal LTP in mice with METH-induced dopamine neurotoxicity.

Parallel cognition: hybrid intelligence for human-machine interaction and management

As an interdisciplinary research approach, traditional cognitive science adopts mainly the experiment, induction, modeling, and validation paradigm. Such models are sometimes not applicable in cyber-physical-social-systems (CPSSs), where the large number of human users involves severe heterogeneity and dynamics. To reduce the decision-making conflicts between people and machines in human-centered systems, we propose a new research paradigm called parallel cognition that uses the system of intelligent techniques to investigate cognitive activities and functionals in three stages: descriptive cognition based on artificial cognitive systems (ACSs), predictive cognition with computational deliberation experiments, and prescriptive cognition via parallel behavioral prescription. To make iteration of these stages constantly on-line, a hybrid learning method based on both a psychological model and user behavioral data is further proposed to adaptively learn an individual’s cognitive knowledge. Preliminary experiments on two representative scenarios, urban travel behavioral prescription and cognitive visual reasoning, indicate that our parallel cognition learning is effective and feasible for human behavioral prescription, and can thus facilitate human-machine cooperation in both complex engineering and social systems.

Advances in optogenetic studies of depressive-like behaviors and underlying neural circuit mechanisms

BACKGROUNDS

The neural circuit mechanisms underlying depression remain unclear. Recently optogenetics has gradually gained recognition as a novel technique to regulate the activity of neurons with light stimulation. Scientists are now transferring their focus to the function of brain regions and neural circuits in the pathogenic progress of depression. Deciphering the circuitry mechanism of depressive-like behaviors may help us better understand the symptomatology of depression. However, few studies have summarized current progress on optogenetic researches into the neural circuit mechanisms of depressive-like behaviors.

AIMS

This review aimed to introduce fundamental characteristics and methodologies of optogenetics, as well as how this technique achieves specific neuronal control with spatial and temporal accuracy. We mainly summarized recent progress in neural circuit discoveries in depressive-like behaviors using optogenetics and exhibited the potential of optogenetics as a tool to investigate the mechanism and possible optimization underlying antidepressant treatment such as ketamine and deep brain stimulation.

METHODS

A systematic review of the literature published in English mainly from 2010 to the present in databases was performed. The selected literature is then categorized and summarized according to their neural circuits and depressive-like behaviors.

CONCLUSIONS

Many important discoveries have been made utilizing optogenetics. These findings support optogenetics as a powerful and potential tool for studying depression. And our comprehension to the etiology of depression and other psychiatric disorders will also be more thorough with this rapidly developing technique in the near future.

Application of optogenetics and in vivo imaging approaches for elucidating the neurobiology of addiction

The neurobiology of addiction has been an intense topic of investigation for more than 50 years. Over this time, technological innovation in methods for studying brain function rapidly progressed, leading to increasingly sophisticated experimental approaches. To understand how specific brain regions, cell types, and circuits are affected by drugs of abuse and drive behaviors characteristic of addiction, it is necessary both to observe and manipulate neural activity in addiction-related behavioral paradigms. In pursuit of this goal, there have been several key technological advancements in in vivo imaging and neural circuit modulation in recent years, which have shed light on the cellular and circuit mechanisms of addiction. Here we discuss some of these key technologies, including circuit modulation with optogenetics, in vivo imaging with miniaturized single-photon microscopy (miniscope) and fiber photometry, and how the application of these technologies has garnered novel insights into the neurobiology of addiction.

Deep brain stimulation of the "medial forebrain bundle": a strategy to modulate the reward system and manage treatment-resistant depression

The medial forebrain bundle-a white matter pathway projecting from the ventral tegmental area-is a structure that has been under a lot of scrutinies recently due to its implications in the modulation of certain affective disorders such as major depression. In the following, we will discuss major depression in the context of being a disorder dependent on multiple relevant networks, the pathological performance of which is responsible for the manifestation of various symptoms of the disease which extend into emotional, motivational, physiological, and also cognitive domains of daily living. We will focus on the reward system, an evolutionarily conserved pathway whose underperformance leads to anhedonia and lack of motivation, which are key traits in depression. In the field of deep brain stimulation (DBS), different "hypothesis-driven" targets have been chosen as the subject of clinical trials on efficacy in the treatment-resistant depressed patient. The "medial forebrain bundle" is one such target for DBS, and has had remarkably rapid success in alleviating depressive symptoms, improving anhedonia and motivation. We will review what we have learned from pre-clinical animal studies on defining this white matter tract, its connectivity, and the complex molecular (i.e., neurotransmitter) mechanisms by which its modulation exerts its effects. Imaging studies in the form of tractographic depictions have elucidated its presence in the human brain. Such has led to ongoing clinical trials of DBS targeting this pathway to assess efficacy, which is promising yet still lack in sufficient numbers. Ultimately, one must confirm the mechanism of action and validate proof of antidepressant effect in order to have such treatment become mainstream, to promote widespread improvement in the quality of life of suffering patients.

The VTA dopaminergic system as diagnostic and therapeutical target for Alzheimer's disease

Neuropsychiatric symptoms (NPS) occur in nearly all patients with Alzheimer's Disease (AD). Most frequently they appear since the mild cognitive impairment (MCI) stage preceding clinical AD, and have a prognostic importance. Unfortunately, these symptoms also worsen the daily functioning of patients, increase caregiver stress and accelerate the disease progression from MCI to AD. Apathy and depression are the most common of these NPS, and much attention has been given in recent years to understand the biological mechanisms related to their appearance in AD. Although for many decades these symptoms have been known to be related to abnormalities of the dopaminergic ventral tegmental area (VTA), a direct association between deficits in the VTA and NPS in AD has never been investigated. Fortunately, this scenario is changing since recent studies using preclinical models of AD, and clinical studies in MCI and AD patients demonstrated a number of functional, structural and metabolic alterations affecting the VTA dopaminergic neurons and their mesocorticolimbic targets. These findings appear early, since the MCI stage, and seem to correlate with the appearance of NPS. Here, we provide an overview of the recent evidence directly linking the dopaminergic VTA with NPS in AD and propose a setting in which the precocious identification of dopaminergic deficits can be a helpful biomarker for early diagnosis. In this scenario, treatments of patients with dopaminergic drugs might slow down the disease progression and delay the impairment of daily living activities.

Dopamine and fear memory formation in the human amygdala

Learning which environmental cues that predict danger is crucial for survival and accomplished through Pavlovian fear conditioning. In humans and rodents alike, fear conditioning is amygdala-dependent and rests on similar neurocircuitry. Rodent studies have implicated a causative role for dopamine in the amygdala during fear memory formation, but the role of dopamine in aversive learning in humans is unclear. Here, we show dopamine release in the amygdala and striatum during fear learning in humans. Using simultaneous positron emission tomography and functional magnetic resonance imaging, we demonstrate that the amount of dopamine release is linked to strength of conditioned fear responses and linearly coupled to learning-induced activity in the amygdala. Thus, like in rodents, formation of amygdala-dependent fear memories in humans seems to be facilitated by endogenous dopamine release, supporting an evolutionary conserved neurochemical mechanism for aversive memory formation.

The neural basis of delayed gratification

Balancing instant gratification versus delayed but better gratification is important for optimizing survival and reproductive success. Although delayed gratification has been studied through human psychological and brain activity monitoring and animal research, little is known about its neural basis. We successfully trained mice to perform a waiting-for-water-reward delayed gratification task and used these animals in physiological recording and optical manipulation of neuronal activity during the task to explore its neural basis. Our results showed that the activity of dopaminergic (DAergic) neurons in the ventral tegmental area increases steadily during the waiting period. Optical activation or silencing of these neurons, respectively, extends or reduces the duration of waiting. To interpret these data, we developed a reinforcement learning model that reproduces our experimental observations. Steady increases in DAergic activity signal the value of waiting and support the hypothesis that delayed gratification involves real-time deliberation.

Remote Optogenetics Using Up/Down-Conversion Phosphors

Microbial rhodopsins widely used for optogenetics are sensitive to light in the visible spectrum. As visible light is heavily scattered and absorbed by tissue, stimulating light for optogenetic control does not reach deep in the tissue irradiated from outside the subject body. Conventional optogenetics employs fiber optics inserted close to the target, which is highly invasive and poses various problems for researchers. Recent advances in material science integrated with neuroscience have enabled remote optogenetic control of neuronal activities in living animals using up- or down-conversion phosphors. The development of these methodologies has stimulated researchers to test novel strategies for less invasive, wireless control of cellular functions in the brain and other tissues. Here, we review recent reports related to these new technologies and discuss the current limitations and future perspectives toward the establishment of non-invasive optogenetics for clinical applications.

Laterodorsal tegmentum-ventral tegmental area projections encode positive reinforcement signals

The laterodorsal tegmentum (LDT) is a brainstem nucleus classically involved in REM sleep and attention, and that has recently been associated with reward-related behaviors, as it controls the activity of ventral tegmental area (VTA) dopaminergic neurons, modulating dopamine release in the nucleus accumbens. To further understand the role of LDT-VTA inputs in reinforcement, we optogenetically manipulated these inputs during different behavioral paradigms in male rats. We found that in a two-choice instrumental task, optical activation of LDT-VTA projections shifts and amplifies preference to the laser-paired reward in comparison to an otherwise equal reward; the opposite was observed with inhibition experiments. In a progressive ratio task, LDT-VTA activation boosts motivation, that is, enhances the willingness to work to get the reward associated with LDT-VTA stimulation; and the reverse occurs when inhibiting these inputs. Animals abolished preference if the reward was omitted, suggesting that LDT-VTA stimulation adds/decreases value to the stimulation-paired reward. In addition, we show that LDT-VTA optical activation induces robust preference in the conditioned and real-time place preference tests, while optical inhibition induces aversion. The behavioral findings are supported by electrophysiological recordings and c-fos immunofluorescence correlates in downstream target regions. In LDT-VTA ChR2 animals, we observed an increase in the recruitment of lateral VTA dopamine neurons and D1 neurons from nucleus accumbens core and shell; whereas in LDT-VTA NpHR animals, D2 neurons appear to be preferentially recruited. Collectively, these data show that the LDT-VTA inputs encode positive reinforcement signals and are important for different dimensions of reward-related behaviors.

The rostromedial tegmental (RMTg) "brake" on dopamine and behavior: A decade of progress but also much unfinished work

Between 2005 and 2009, several research groups identified a strikingly dense inhibitory input to midbrain dopamine neurons arising from a previously uncharted region posterior to the ventral tegmental area (VTA). This region is now denoted as either the rostromedial tegmental nucleus (RMTg) or the "tail of the VTA" (tVTA), and is recognized to express distinct genetic markers, encode negative "prediction errors" (inverse to dopamine neurons), and play critical roles in behavioral inhibition and punishment learning. RMTg neurons are also influenced by many categories of abused drugs, and may drive some aversive responses to such drugs, particularly cocaine and alcohol. However, despite much progress, many important questions remain about RMTg molecular/genetic properties, diversity of projection targets, and applications to addiction, depression, and other neuropsychiatric disorders. This article is part of the special Issue on 'Neurocircuitry Modulating Drug and Alcohol Abuse'.

Activation of VTA/CeA/mPFC cannabinoid CB1 receptors induced conditioned drug effects via interacting with hippocampal CAMKII-CREB-BDNF signaling pathway in rats

The present study intended to investigate whether the activation of cannabinoid CB1 receptors of the ventral tegmental area (VTA), the central amygdala (CeA) and the medial prefrontal cortex (mPFC) could induce conditioned place preference or aversion (CPP or CPA) in adult male Wistar rats. The involvement of hippocampal signaling pathway of Ca2+/calmodulin-dependent protein kinase II (CaMKII)/cAMP response element-binding protein (CREB)/brain-derived neurotrophic factor (BDNF) was also examined following a 3-day schedule of conditioning with the injection of arachidonylcyclopropylamide (ACPA; a selective cannabinoid CB1 receptors agonist) into the targeted sites. The results showed that intra-VTA injection of the higher dose of ACPA (5 ng/rat) caused a significant CPP associating with the increased hippocampal level of the phosphorylated (p)-CAMKII/CAMKII. Intra-mPFC injection of ACPA at 3 ng/rat caused a significant CPA associating with the decreased p-CAMKII and p-CREB levels and the increased BDNF level in the hippocampus. Moreover, intra-CeA injection of the ACPA (5 ng/rat) induced a significant CPP which was associated with the increased hippocampal levels of p-CAMKII/total (t) CAMKII, p-CREB/tCREB, and BDNF. Exposing the animals to the CPP apparatus after receiving intra-cerebral vehicle injection increased the hippocampal CAMKII/CREB/BDNF signaling pathway, confirming that CPP is an associative learning task. In all experiments, the conditioning treatment with the different doses of ACPA did not affect locomotor activity in the testing phase. Taken together, it can be concluded that cannabinoid CB1 receptors of the VTA, the CeA, and the mPFC are involved in rewarding/aversion effects through the changes in the hippocampal signaling pathways.

Dissociable contributions of phasic dopamine activity to reward and prediction

Sensory cues that precede reward acquire predictive (expected value) and incentive (drive reward-seeking action) properties. Mesolimbic dopamine neurons' responses to sensory cues correlate with both expected value and reward-seeking action. This has led to the proposal that phasic dopamine responses may be sufficient to inform value-based decisions, elicit actions, and/or induce motivational states; however, causal tests are incomplete. Here, we show that direct dopamine neuron stimulation, both calibrated to physiological and greater intensities, at the time of reward can be sufficient to induce and maintain reward seeking (reinforcing) although replacement of a cue with stimulation is insufficient to induce reward seeking or act as an informative cue. Stimulation of descending cortical inputs, one synapse upstream, are sufficient for reinforcement and cues to future reward. Thus, physiological activation of mesolimbic dopamine neurons can be sufficient for reinforcing properties of reward without being sufficient for the predictive and incentive properties of cues.

Serotonergic regulation of the dopaminergic system: Implications for reward-related functions

Serotonin is a critical neuromodulator involved in development and behavior. Its role in reward is however still debated. Here, we first review classical studies involving electrical stimulation protocols and pharmacological approaches. Contradictory results on the serotonergic' involvement in reward emerge from these studies. These differences might be ascribable to either the diversity of cellular types within the raphe nuclei or/and the specific projection pathways of serotonergic neurons. We continue to review more recent work, using optogenetic approaches to activate serotonergic cells in the Raphe to VTA pathway. From these studies, it appears that activation of this pathway can lead to reinforcement learning mediated through the excitation of dopaminergic neurons by serotonergic neurons co-transmitting glutamate. Finally, given the importance of serotonin during development on adult emotion, the effect of abnormal early-life levels of serotonin on the dopaminergic system will also be discussed. Understanding the interaction between the serotonergic and dopaminergic systems during development and adulthood is critical to gain insight into the specific facets of neuropsychiatric disorders.

Dopaminergic Projection from Ventral Tegmental Area to Substantia Nigra Pars Reticulata Mediates Chronic Social Defeat Stress-Induced Hypolocomotion

Numerous human clinical studies have suggested that decreased locomotor activity is a common symptom of major depressive disorder (MDD), as well as other psychiatric diseases. In MDD, the midbrain ventral tegmental area (VTA) dopamine (DA) neurons are closely related to regulate the information processing of reward, motivation, cognition, and aversion. However, the neural circuit mechanism that underlie the relationship between VTA-DA neurons and MDD-related motor impairments, especially hypolocomotion, is still largely unknown. Herein, we investigate how the VTA-DA neurons contribute to the hypolocomotion performance in chronic social defeat stress (CSDS), a mouse model of depression-relevant neurobehavioral states. The results show that CSDS could affect the spontaneous locomotor activity of mice, but not the grip strength and forced locomotor ability. Chemogenetic activation of VTA-DA neurons alleviated CSDS-induced hypolocomotion. Subsequently, quantitative whole-brain mapping revealed decreased projections from VTA-DA neurons to substantia nigra pars reticulata (SNr) after CSDS treatment. Optogenetic activation of dopaminergic projection from VTA to SNr with the stimulation of phasic firing, but not tonic firing, could significantly increase the locomotor activity of mice. Moreover, chemogenetic activation of VTA-SNr dopaminergic circuit in CSDS mice could also rescued the decline of locomotor activity. Taken together, our data suggest that the VTA-SNr dopaminergic projection mediates CSDS-induced hypolocomotion, which provides a theoretical basis and potential therapeutic target for MDD.

Illuminating subcortical GABAergic and glutamatergic circuits for reward and aversion

Reinforcement, reward, and aversion are fundamental processes for guiding appropriate behaviors. Longstanding theories have pointed to dopaminergic neurons of the ventral tegmental area (VTA) and the limbic systems' descending pathways as crucial systems for modulating these behaviors. The application of optogenetic techniques in neurotransmitter- and projection-specific circuits has supported and enhanced many preexisting theories but has also revealed many unexpected results. Here, we review the past decade of optogenetic experiments to study the neural circuitry of reinforcement and reward/aversion with a focus on the mesolimbic dopamine system and brain areas along the medial forebrain bundle (MFB). The cumulation of these studies to date has revealed generalizable findings across molecularly defined cell types in areas of the basal forebrain and anterior hypothalamus. Optogenetic stimulation of GABAergic neurons in these brain regions drives reward and can support positive reinforcement and optogenetic stimulation of glutamatergic neurons in these regions drives aversion. We also review studies of the activity dynamics of neurotransmitter defined populations in these areas which have revealed varied response patterns associated with motivated behaviors.

Throwing open the doors of perception: The role of dopamine in visual processing

Animals form associations between visual cues and behaviours. Although dopamine is known to be critical in many areas of the brain to bind sensory information with appropriate responses, dopamine's role in the visual system is less well understood. Visual signals, which indicate the likely occurrence of a rewarding or aversive stimulus or indicate the context within which such stimuli may arrive, modulate activity in the superior colliculus and alter behaviour. However, such signals primarily originate in cortical and basal ganglia circuits, and evidence of direct signalling from midbrain dopamine neurons to superior colliculus is lacking. Instead, hypothalamic A13 dopamine neurons innervate the superior colliculus, and dopamine receptors are differentially expressed in the superior colliculus, with D1 receptors in superficial layers and D2 receptors in deep layers. However, it remains unknown if A13 dopamine neurons control behaviours through their effect on afferents within the superior colliculus. We propose that A13 dopamine neurons may play a critical role in processing information in the superior colliculus, modifying behavioural responses to visual cues, and propose some testable hypotheses regarding dopamine's effect on visual perception.

Remote control of neural function by X-ray-induced scintillation

Scintillators emit visible luminescence when irradiated with X-rays. Given the unlimited tissue penetration of X-rays, the employment of scintillators could enable remote optogenetic control of neural functions at any depth of the brain. Here we show that a yellow-emitting inorganic scintillator, Ce-doped Gd₃(Al,Ga)₅O₁₂ (Ce:GAGG), can effectively activate red-shifted excitatory and inhibitory opsins, ChRmine and GtACR1, respectively. Using injectable Ce:GAGG microparticles, we successfully activated and inhibited midbrain dopamine neurons in freely moving mice by X-ray irradiation, producing bidirectional modulation of place preference behavior. Ce:GAGG microparticles are non-cytotoxic and biocompatible, allowing for chronic implantation. Pulsed X-ray irradiation at a clinical dose level is sufficient to elicit behavioral changes without reducing the number of radiosensitive cells in the brain and bone marrow. Thus, scintillator-mediated optogenetics enables minimally invasive, wireless control of cellular functions at any tissue depth in living animals, expanding X-ray applications to functional studies of biology and medicine.

Clinical applicability of optogenetic gene regulation

The field of optogenetics is rapidly growing in relevance and number of developed tools. Among other things, the optogenetic repertoire includes light-responsive ion channels and methods for gene regulation. This review will be confined to the optogenetic control of gene expression in mammalian cells as suitable models for clinical applications. Here optogenetic gene regulation might offer an excellent method for spatially and timely regulated gene and protein expression in cell therapeutic approaches. Well-known systems for gene regulation, such as the LOV-, CRY2/CIB-, PhyB/PIF-systems, as well as other, in mammalian cells not yet fully established systems, will be described. Advantages and disadvantages with regard to clinical applications are outlined in detail. Among the many unanswered questions concerning the application of optogenetics, we discuss items such as the use of exogenous chromophores and their effects on the biology of the cells and methods for a gentle, but effective gene transfection method for optogenetic tools for in vivo applications.