Establishing causality for dopamine in neural function and behavior with optogenetics

Neural-hematopoietic-inflammatory axis in nonsmokers, electronic cigarette users, and tobacco smokers

Amygdala activity in context of the splenocardiac model has not been investigated in healthy, young adults and has not been compared between nonsmokers, electronic cigarette users, and smokers. The purpose of the current study was to determine whether fluorodeoxyglucose positron emission tomography/computer tomography (FDG PET/CT) scans would demonstrate positively correlated metabolic activity in the amygdala, bone marrow, spleen, and aorta, elucidating activation of the splenocardiac axis in otherwise healthy young people who use tobacco products compared to nonusers. Moreover, the study was conducted to evaluate whether electronic cigarette users and tobacco smokers have similar levels of inflammation compared to nonusers. In 45 healthy adults (mean age = 25 years), including nonsmoker (n = 15), electronic cigarette user (n = 16), and smoker (n = 14) groups, metabolic activity in the amygdala, spleen, aorta, bone marrow of thoracic vertebrae, and adjacent erector spinae skeletal muscle was quantified through visualization of radioactive glucose (18 FDG) uptake by FDG-PET/CT. The maximum standardized uptake value for each region was calculated for correlation analyses and comparisons between groups. In correlation analyses, metabolic activity of the amygdala correlated with metabolic activity in the aorta (r = 0.757), bone marrow (r = 0.750), and spleen (r = 0.665), respectively. Metabolic activity in the aorta correlated with 18 FDG uptake in the thoracic vertebrae (r = 0.703) and spleen (r = 0.594), respectively. Metabolic activity in the spleen also correlated with 18 FDG uptake in the bone marrow (r = 0.620). Metabolic activity in the adjacent erector spinae skeletal muscle (our control tissue) was not positively correlated with any other region of interest. Finally, there were no statistically significant mean differences in metabolic activity between the three groups: nonsmokers, electronic cigarette users, and smokers in any target tissue. Amygdala metabolic activity, as measured by 18 FDG uptake in FDG-PET/CT scans, positively correlated with inflammation in the splenocardiac tissues, including: the aorta, bone marrow, and spleen, underscoring the existence of a neural-hematopoietic-inflammatory axis in healthy, young adults.

Reversible Photocontrol of Dopaminergic Transmission in Wild-Type Animals

Understanding the dopaminergic system is a priority in neurobiology and neuropharmacology. Dopamine receptors are involved in the modulation of fundamental physiological functions, and dysregulation of dopaminergic transmission is associated with major neurological disorders. However, the available tools to dissect the endogenous dopaminergic circuits have limited specificity, reversibility, resolution, or require genetic manipulation. Here, we introduce azodopa, a novel photoswitchable ligand that enables reversible spatiotemporal control of dopaminergic transmission. We demonstrate that azodopa activates D₁-like receptors in vitro in a light-dependent manner. Moreover, it enables reversibly photocontrolling zebrafish motility on a timescale of seconds and allows separating the retinal component of dopaminergic neurotransmission. Azodopa increases the overall neural activity in the cortex of anesthetized mice and displays illumination-dependent activity in individual cells. Azodopa is the first photoswitchable dopamine agonist with demonstrated efficacy in wild-type animals and opens the way to remotely controlling dopaminergic neurotransmission for fundamental and therapeutic purposes.

Paternal exposure to excessive methionine altered behavior and neurochemical activities in zebrafish offspring

An increase in plasma L-methionine (Met) levels, even if transitory, can cause important toxicological alterations in the affected individuals. Met is essential in the regulation of epigenetic mechanisms and its influence on the subsequent generation has been investigated. However, few studies have explored the influence of a temporary increase in Met levels in parents on their offspring. This study evaluated the behavioral and neurochemical effects of parental exposure to high Met concentration (3 mM) in zebrafish offspring. Adult zebrafish were exposed to Met for 7 days, maintained for additional 7 days in tanks that contained only water, and then used for breeding. The offspring obtained from these fish (F1) were tested in this study. During the early stages of offspring development, morphology, heart rate, survival, locomotion, and anxiety-like behavior were assessed. When these animals reached the adult stage, locomotion, anxiety, aggression, social interaction, memory, oxidative stress, and levels of amino acids and neurotransmitters were analyzed. F1 larvae Met group presented an increase in the distance and mean speed when compared to the control group. F1 adult Met group showed decreased anxiety-like behavior and locomotion. An increase in reactive oxygen species was also observed in the F1 adult Met group whereas lipid peroxidation and antioxidant enzymes did not change when compared to the control group. Dopamine, serotonin, glutamate, and glutathione levels were increased in the F1 adult Met group. Taken together, our data show that even a transient increase in Met in parents can cause behavioral and neurochemical changes in the offspring, promoting transgenerational effects.

Selective filtering of excitatory inputs to nucleus accumbens by dopamine and serotonin

The detailed mechanisms by which dopamine (DA) and serotonin (5-HT) act in the nucleus accumbens (NAc) to influence motivated behaviors in distinct ways remain largely unknown. Here, we examined whether DA and 5-HT selectively modulate excitatory synaptic transmission in NAc medium spiny neurons in an input-specific manner. DA reduced excitatory postsynaptic currents (EPSCs) generated by paraventricular thalamus (PVT) inputs but not by ventral hippocampus (vHip), basolateral amygdala (BLA), or medial prefrontal cortex (mPFC) inputs. In contrast, 5-HT reduced EPSCs generated by inputs from all areas except the mPFC. Release of endogenous DA and 5-HT by methamphetamine (METH) and (±)3,4-methylenedioxymethamphetamine (MDMA), respectively, recapitulated these input-specific synaptic effects. Optogenetic inhibition of PVT inputs enhanced cocaine-conditioned place preference, whereas mPFC input inhibition reduced the enhancement of sociability elicited by MDMA. These findings suggest that the distinct, input-specific filtering of excitatory inputs in the NAc by DA and 5-HT contribute to their discrete behavioral effects.

A Molecular Calcium Integrator Reveals a Striatal Cell Type Driving Aversion

The ability to record transient cellular events in the DNA or RNA of cells would enable precise, large-scale analysis, selection, and reprogramming of heterogeneous cell populations. Here, we report a molecular technology for stable genetic tagging of cells that exhibit activity-related increases in intracellular calcium concentration (FLiCRE). We used FLiCRE to transcriptionally label activated neural ensembles in the nucleus accumbens of the mouse brain during brief stimulation of aversive inputs. Using single-cell RNA sequencing, we detected FLiCRE transcripts among the endogenous transcriptome, providing simultaneous readout of both cell-type and calcium activation history. We identified a cell type in the nucleus accumbens activated downstream of long-range excitatory projections. Taking advantage of FLiCRE's modular design, we expressed an optogenetic channel selectively in this cell type and showed that direct recruitment of this otherwise genetically inaccessible population elicits behavioral aversion. The specificity and minute resolution of FLiCRE enables molecularly informed characterization, manipulation, and reprogramming of activated cellular ensembles.

Amygdala-Midbrain Connections Modulate Appetitive and Aversive Learning

The central amygdala (CeA) orchestrates adaptive responses to emotional events. While CeA substrates for defensive behaviors have been studied extensively, CeA circuits for appetitive behaviors and their relationship to threat-responsive circuits remain poorly defined. Here, we demonstrate that the CeA sends robust inhibitory projections to the lateral substantia nigra (SNL) that contribute to appetitive and aversive learning in mice. CeA→SNL neural responses to appetitive and aversive stimuli were modulated by expectation and magnitude consistent with a population-level salience signal, which was required for Pavlovian conditioned reward-seeking and defensive behaviors. CeA→SNL terminal activation elicited reinforcement when linked to voluntary actions but failed to support Pavlovian associations that rely on incentive value signals. Consistent with a disinhibitory mechanism, CeA inputs preferentially target SNL GABA neurons, and CeA→SNL and SNL dopamine neurons respond similarly to salient stimuli. Collectively, our results suggest that amygdala-nigra interactions represent a previously unappreciated mechanism for influencing emotional behaviors.

Re-examining the role of ventral tegmental area dopaminergic neurons in motor activity and reinforcement by chemogenetic and optogenetic manipulation in mice

The precise contributions of ventral tegmental area (VTA) dopaminergic (DAergic) neurons to reward-related behaviors are a longstanding hot topic of debate. Whether the activity of VTA DAergic neurons directly modulates rewarding behaviors remains uncertain. In the present study, we investigated the fundamental role of VTA DAergic neurons in reward-related movement and reinforcement by employing dopamine transporter (DAT)-Cre transgenic mice expressing hM3Dq, hM4Di or channelrhodopsin 2 (ChR2) in VTA DAergic neurons through Cre-inducible adeno-associated viral vector transfection. On the one hand, locomotion was tested in an open field to examine motor activity when VTA DAergic neurons were stimulated or inhibited by injection of the hM3Dq or hM4Di ligand clozapine-N-oxide (CNO), respectively. CNO injection to selectively activate or inhibit VTA DAergic neurons significantly increased or decreased locomotor activity, respectively, compared with vehicle injection, indicating that VTA DAergic neuron stimulation is directly involved in the regulation of motor activity. On the other hand, we used the optical intracranial self-stimulation (oICSS) model to investigate the causal link between reinforcement and VTA DAergic neurons. Active poking behavior but not inactive poking behavior was significantly escalated in a frequency- and pulse duration-dependent manner. In addition, microdialysis revealed that the concentration of dopamine (DA) in the nucleus accumbens (NAc) was enhanced by selective optogenetic activation of VTA DAergic neurons. Furthermore, systemic administration of a DA D1 receptor antagonist significantly decreased oICSS reinforcement. Our research profoundly demonstrates a direct regulatory role of VTA DAergic neurons in movement and reinforcement and provides meaningful guidance for the development of novel treatment strategies for neuropsychiatric diseases related to the malfunction of the reward system.

Cell-type and projection-specific dopaminergic encoding of aversive stimuli in addiction

Drug addiction is a major public health concern across the world for which there are limited treatment options. In order to develop new therapies to correct the behavioral deficits that result from repeated drug use, we need to understand the neural circuit dysfunction that underlies the pathophysiology of the disorder. Because the initial reinforcing effects of drugs are dependent on increases in dopamine in reward-related brain regions such as the mesolimbic dopamine pathway, a large focus of addiction research has centered on the dysregulation of this system and its control of positive reinforcement and motivation. However, in addition to the processing of positive, rewarding stimuli, there are clear deficits in the encoding and valuation of information about potential negative outcomes and how they control decision making and motivation. Further, aversive stimuli can motivate or suppress behavior depending on the context in which they are encountered. We propose a model where rewarding and aversive information guides the execution of specific motivated actions through mesocortical and mesolimbic dopamine acting on D1- and D2- receptor containing neuronal populations. Volitional drug exposure alters the processing of rewarding and aversive stimuli through remodeling of these dopaminergic circuits, causing maladaptive drug seeking, self-administration in the face of negative consequences, and drug craving. Together, this review discusses the dysfunction of the circuits controlling different types of aversive learning as well as how these guide specific discrete behaviors, and provides a conceptual framework for how they should be considered in preclinical addiction models.

NMDA Receptor-Dependent Cholinergic Modulation of Mesolimbic Dopamine Cell Bodies: Neurochemical and Behavioral Studies

Substance abuse disorders are devastating, costly, and difficult to treat. Identifying the neurochemical mechanisms underlying reinforcement promises to provide critical information in the development of effective treatments. Several lines of evidence suggest that striatal dopamine (DA) release serves as a teaching signal in reinforcement learning, and that shifts in DA release from the primary reward to reward-predicting stimuli play a critical role in the self-administration of both natural and non-natural rewards. However, far less is known about the reinforcing effects of motivationally neutral sensory stimuli, or how these signals can facilitate self-administration behavior. Thus, we trained rats ( n = 7) to perform a visual stimulus-induced instrumental task, which involved lever pressing for activation of a stimulus light. We then microinfused vehicle (phosphate buffered saline), carbachol (acetylcholine receptor agonist), or carbachol in the presence of an N-methyl-d-aspartate (NMDA) receptor-specific drug (NMDA itself, or the antagonist, AP5) into the ventral tegmental area (VTA). This enabled us to directly evaluate how chemical modulation of dopamine cell bodies affects the instrumental behavior, as well as the nature of extracellular dopamine transients recorded in the nucleus accumbens shell (NAc shell) using fast-scan cyclic voltammetry (FSCV). Intra-VTA infusion of carbachol enhanced the magnitude and frequency of dopamine transients in the NAc shell and potentiated active lever responding without altering inactive lever responding, as compared to infusion of vehicle. Coinfusion of carbachol with AP5 abolished dopamine transients recorded in the NAc and attenuated active lever responding without altering inactive lever responding. Finally, coadministration of carbachol and NMDA into the VTA restored both lever pressing and dopaminergic signals recorded in the striatum. Together, these results suggest that acetylcholine and glutamate synergistically act at dopamine cells in the VTA to modulate VTA-NAc shell dopaminergic output, and this underlies motivation to lever press for a motivationally neutral visual stimulus.

Multiple Dopamine Systems: Weal and Woe of Dopamine

The ability to predict future outcomes increases the fitness of the animal. Decades of research have shown that dopamine neurons broadcast reward prediction error (RPE) signals-the discrepancy between actual and predicted reward-to drive learning to predict future outcomes. Recent studies have begun to show, however, that dopamine neurons are more diverse than previously thought. In this review, we will summarize a series of our studies that have shown unique properties of dopamine neurons projecting to the posterior "tail" of the striatum (TS) in terms of anatomy, activity, and function. Specifically, TS-projecting dopamine neurons are activated by a subset of negative events including threats from a novel object, send prediction errors for external threats, and reinforce avoidance behaviors. These results indicate that there are at least two axes of dopamine-mediated reinforcement learning in the brain-one learning from canonical RPEs and another learning from threat prediction errors. We argue that the existence of multiple learning systems is an adaptive strategy that makes possible each system optimized for its own needs. The compartmental organization in the mammalian striatum resembles that of a dopamine-recipient area in insects (mushroom body), pointing to a principle of dopamine function conserved across phyla.

Contributions of nucleus accumbens dopamine to cognitive flexibility

There is a compelling evidence that midbrain dopamine (DA) neurons and their projections to the ventral striatum provide a mechanism for motivating reward-seeking behavior, and for utilizing information about unexpected reward prediction errors (RPEs) to guide behavior based on current, rather than historical, outcomes. When this mechanism is compromised in addictions, it may produce patterns of maladaptive behavior that remain obdurate in the face of contrary information and even adverse consequences. Nonetheless, DAergic contributions to performance on behavioral tasks that rely on the ability to flexibly update stimulus-reward relationships remains incompletly understood. In the current study, we used a discrimination and reversal paradigm to monitor subsecond DA release in mouse NAc core (NAc) using in vivo fast-scan cyclic voltammetry (FSCV). We observed post-choice elevations in phasic NAc DA release; however, increased DA transients were only evident during early reversal when mice made responses at the newly rewarded stimulus. Based on this finding, we used in vivo optogenetic (eNpHR) photosilencing and (Channelrhodopsin2 [ChR2]) photostimulation to assess the effects of manipulating VTA-DAergic fibers in the NAc on reversal performance. Photosilencing the VTA → NAc DAergic pathway during early reversal increased errors, while photostimulation did not demonstrably affect behavior. Taken together, these data provide additional evidence of the importance of NAc DA release as a neural substrate supporting adjustments in learned behavior after a switch in expected stimulus-reward contingencies. These findings have possible implications for furthering understanding the role of DA in persistent, maladaptive decision-making characterizing addictions.

5-HT release in nucleus accumbens rescues social deficits in mouse autism model

Dysfunction in prosocial interactions is a core symptom of autism spectrum disorder. However, the neural mechanisms that underlie sociability are poorly understood, limiting the rational development of therapies to treat social deficits. Here we show in mice that bidirectional modulation of the release of serotonin (5-HT) from dorsal raphe neurons in the nucleus accumbens bidirectionally modifies sociability. In a mouse model of a common genetic cause of autism spectrum disorder-a copy number variation on chromosome 16p11.2-genetic deletion of the syntenic region from 5-HT neurons induces deficits in social behaviour and decreases dorsal raphe 5-HT neuronal activity. These sociability deficits can be rescued by optogenetic activation of dorsal raphe 5-HT neurons, an effect requiring and mimicked by activation of 5-HT1b receptors in the nucleus accumbens. These results demonstrate an unexpected role for 5-HT action in the nucleus accumbens in social behaviours, and suggest that targeting this mechanism may prove therapeutically beneficial.

Nucleus Accumbens Subnuclei Regulate Motivated Behavior via Direct Inhibition and Disinhibition of VTA Dopamine Subpopulations

Mesolimbic dopamine (DA) neurons play a central role in motivation and reward processing. Although the activity of these mesolimbic DA neurons is controlled by afferent inputs, little is known about the circuits in which they are embedded. Using retrograde tracing, electrophysiology, optogenetics, and behavioral assays, we identify principles of afferent-specific control in the mesolimbic DA system. Neurons in the medial shell subdivision of the nucleus accumbens (NAc) exert direct inhibitory control over two separate populations of mesolimbic DA neurons by activating different GABA receptor subtypes. In contrast, NAc lateral shell neurons mainly synapse onto ventral tegmental area (VTA) GABA neurons, resulting in disinhibition of DA neurons that project back to the NAc lateral shell. Lastly, we establish a critical role for NAc subregion-specific input to the VTA underlying motivated behavior. Collectively, our results suggest a distinction in the incorporation of inhibitory inputs between different subtypes of mesolimbic DA neurons.

Activation of ventral tegmental area dopaminergic neurons reverses pathological allodynia resulting from nerve injury or bone cancer

Chronic pain induced by nerve damage due to trauma or invasion of cancer to the bone elicits severe ongoing pain as well as hyperalgesia and allodynia likely reflecting adaptive changes within central circuits that amplify nociceptive signals. The present study explored the possible contribution of the mesolimbic dopaminergic circuit in promoting allodynia related to neuropathic and cancer pain. Mice with ligation of the sciatic nerve or treated with intrafemoral osteosarcoma cells showed allodynia to a thermal stimulus applied to the paw on the injured side. Patch clamp electrophysiology revealed that the intrinsic neuronal excitability of ventral tegmental area (VTA) dopamine neurons projecting to the nucleus accumbens (N.Acc.) was significantly reduced in those mice. We used tyrosine hydroxylase (TH)-cre mice that were microinjected with adeno-associated virus (AAV) to express channelrhodopsin-2 (ChR2) to allow optogenetic stimulation of VTA dopaminergic neurons in the VTA or in their N.Acc. terminals. Optogenetic activation of these cells produced a significant but transient anti-allodynic effect in nerve injured or tumor-bearing mice without increasing response thresholds to thermal stimulation in sham-operated animals. Suppressed activity of mesolimbic dopaminergic neurons is likely to contribute to decreased inhibition of N.Acc. output neurons and to neuropathic or cancer pain-induced allodynia suggesting strategies for modulation of pathological pain states.

Inhibiting Mesolimbic Dopamine Neurons Reduces the Initiation and Maintenance of Instrumental Responding

Mesolimbic dopamine perturbations modulate performance of reward-seeking behavior, with tasks requiring high effort being especially vulnerable to disruption of dopamine signaling. Previous work primarily investigated long-term perturbations such as receptor antagonism and dopamine depletion, which constrain the ability to assess dopamine contributions to effort expenditure in isolation from other behavior events, such as reward consumption. Also unclear is if dopamine is required for both initiation and maintenance when a sequence of multiple instrumental responses is required. Here we used optogenetic inhibition of midbrain TH+  neurons to probe the role of dopamine neuron activity during instrumental responding for reward by varying the time epoch of neural inhibition relative to the time of response initiation. Within a fixed-ratio procedure, requiring eight nosepoke responses per reinforcer delivery, or a progressive ratio (PR) procedure, in which within-session response requirements increased exponentially, inhibiting dopamine neurons while mice were engaged in response bouts decreased the probability of continued responding. If inhibition occurred during each attempted bout, the effect was to decrease total responses, and thus amount of rewards earned, over a session. In contrast, if inhibition was applied only during some bouts, mice increased the number of bouts initiated to earn control levels of reward. Inhibiting dopamine neurons while mice were not responding decreased the probability of initiating an instrumental response but had no effect on the amount of effort exerted over the entire session. We conclude that midbrain dopamine signaling promotes initiation of instrumental responding and maintains motivation to continue ongoing bouts of effortful responses.

Left frontal pole theta burst stimulation decreases orbitofrontal and insula activity in cocaine users and alcohol users

BACKGROUND

Preclinical research has demonstrated a causal relationship between medial prefrontal cortex activity and cocaine self-administration. As a step towards translating those data to a neural circuit-based intervention for patients, this study sought to determine if continuous theta burst stimulation (cTBS) to the left frontal pole (FP), would attenuate frontal-striatal activity in two substance-dependent populations.

METHODS

Forty-nine substance dependent individuals (25 cocaine, 24 alcohol) completed a single-blind, sham-controlled, crossover study wherein they received 6 trains of real or sham cTBS (110% resting motor threshold, FP1) each visit. Baseline evoked BOLD signal was measured immediately before and after real and sham cTBS (interleaved TMS/BOLD imaging: single pulses to left FP; scalp-to-cortex distance covariate, FWE correction p<0.05) RESULTS: Among cocaine users, real cTBS significantly decreased evoked BOLD signal in the caudate, accumbens, anterior cingulate, orbitofrontal (OFC) and parietal cortex relative to sham cTBS. Among alcohol users, real cTBS significantly decreased evoked BOLD signal in left OFC, insula, and lateral sensorimotor cortex. There was no significant difference between the groups.

CONCLUSIONS

These data suggest that 6 trains of left FP cTBS delivered in a single day decreases TMS-evoked BOLD signal in the OFC and several cortical nodes which regulate salience and are typically activated by drug cues. The reliability of this pattern across cocaine- and alcohol-dependent individuals suggests that cTBS may be an effective tool to dampen neural circuits typically engaged by salient drug cues. Multiday studies are required to determine it this has a sustainable effect on the brain or drug use behavior.

Viral vector strategies for investigating midbrain dopamine circuits underlying motivated behaviors

Midbrain dopamine (DA) neurons have received significant attention in brain research because of their central role in reward processing and their dysfunction in neuropsychiatric disorders such as Parkinson's disease, drug addiction, depression and schizophrenia. Until recently, it has been thought that DA neurons form a homogeneous population whose primary function is the computation of reward prediction errors. However, through the implementation of viral vector strategies, an unexpected complexity and diversity has been revealed at the anatomical, molecular and functional level. In this review, we discuss recent viral vector approaches that have been leveraged to dissect how different circuits involving distinct DA neuron subpopulations may contribute to the role of DA in reward- and aversion-related behaviors. We focus on studies that have used cell type- and projection-specific optogenetic manipulations, discuss the strengths and limitations of each approach, and critically examine emergent organizational principles that have led to a reclassification of midbrain DA neurons.

Learning, Reward, and Decision Making

In this review, we summarize findings supporting the existence of multiple behavioral strategies for controlling reward-related behavior, including a dichotomy between the goal-directed or model-based system and the habitual or model-free system in the domain of instrumental conditioning and a similar dichotomy in the realm of Pavlovian conditioning. We evaluate evidence from neuroscience supporting the existence of at least partly distinct neuronal substrates contributing to the key computations necessary for the function of these different control systems. We consider the nature of the interactions between these systems and show how these interactions can lead to either adaptive or maladaptive behavioral outcomes. We then review evidence that an additional system guides inference concerning the hidden states of other agents, such as their beliefs, preferences, and intentions, in a social context. We also describe emerging evidence for an arbitration mechanism between model-based and model-free reinforcement learning, placing such a mechanism within the broader context of the hierarchical control of behavior.

Glutamate neurons are intermixed with midbrain dopamine neurons in nonhuman primates and humans

The rodent ventral tegmental area (VTA) and substantia nigra pars compacta (SNC) contain dopamine neurons intermixed with glutamate neurons (expressing vesicular glutamate transporter 2; VGluT2), which play roles in reward and aversion. However, identifying the neuronal compositions of the VTA and SNC in higher mammals has remained challenging. Here, we revealed VGluT2 neurons within the VTA and SNC of nonhuman primates and humans by simultaneous detection of VGluT2 mRNA and tyrosine hydroxylase (TH; for identification of dopamine neurons). We found that several VTA subdivisions share similar cellular compositions in nonhuman primates and humans; their rostral linear nuclei have a high prevalence of VGluT2 neurons lacking TH; their paranigral and parabrachial pigmented nuclei have mostly TH neurons, and their parabrachial pigmented nuclei have dual VGluT2-TH neurons. Within nonhuman primates and humans SNC, the vast majority of neurons are TH neurons but VGluT2 neurons were detected in the pars lateralis subdivision. The demonstration that midbrain dopamine neurons are intermixed with glutamate or glutamate-dopamine neurons from rodents to humans offers new opportunities for translational studies towards analyzing the roles that each of these neurons play in human behavior and in midbrain-associated illnesses such as addiction, depression, schizophrenia, and Parkinson's disease.

Rapid signalling in distinct dopaminergic axons during locomotion and reward

Dopaminergic projections from the midbrain to striatum are critical for motor control, as their degeneration in Parkinson’s disease results in profound movement deficits. Paradoxically, most recording methods report rapid phasic dopamine signaling (~100ms bursts) to unpredicted rewards, with little evidence for movement-related signaling. The leading model posits that phasic signaling in striatum targeting dopamine neurons drive reward-based learning, while slow variations in firing (tens of seconds to minutes) in these same neurons bias animals towards or away from movement. However, despite widespread acceptance of this model, current methods have provided little evidence to support or refute it. Here, using new optical recording methods, we report the discovery of rapid phasic signaling in striatum-targeting dopaminergic axons that was associated with, and capable of triggering, locomotion in mice. Axons expressing these signals were largely distinct from those signaling during unexpected rewards. These results suggest that dopaminergic neuromodulation can differentially impact motor control and reward learning with sub-second precision and suggest that both precise signal timing and neuronal subtype are important parameters to consider in the treatment of dopamine-related disorders.

Contemporary approaches to neural circuit manipulation and mapping: focus on reward and addiction

Tying complex psychological processes to precisely defined neural circuits is a major goal of systems and behavioural neuroscience. This is critical for understanding adaptive behaviour, and also how neural systems are altered in states of psychopathology, such as addiction. Efforts to relate psychological processes relevant to addiction to activity within defined neural circuits have been complicated by neural heterogeneity. Recent advances in technology allow for manipulation and mapping of genetically and anatomically defined neurons, which when used in concert with sophisticated behavioural models, have the potential to provide great insight into neural circuit bases of behaviour. Here we discuss contemporary approaches for understanding reward and addiction, with a focus on midbrain dopamine and cortico-striato-pallidal circuits.

The neural basis of reversal learning: An updated perspective

Reversal learning paradigms are among the most widely used tests of cognitive flexibility and have been used as assays, across species, for altered cognitive processes in a host of neuropsychiatric conditions. Based on recent studies in humans, non-human primates, and rodents, the notion that reversal learning tasks primarily measure response inhibition, has been revised. In this review, we describe how cognitive flexibility is measured by reversal learning and discuss new definitions of the construct validity of the task that are serving as a heuristic to guide future research in this field. We also provide an update on the available evidence implicating certain cortical and subcortical brain regions in the mediation of reversal learning, and an overview of the principal neurotransmitter systems involved.

Differential activation of accumbens shell and core dopamine by sucrose reinforcement with nose poking and with lever pressing

In order to investigate the role of modus operandi in the changes of nucleus accumbens (NAc) dopamine (DA) transmission in sucrose reinforcement, extracellular DA was monitored by microdialysis in the NAc shell and core of rats trained on a fixed-ratio 1 schedule to respond for sucrose pellets by nose poking and lever pressing respectively. After training, rats were tested on three different sessions: sucrose reinforcement, extinction and passive sucrose presentation. In rats responding by nose poking dialysate DA increased in the shell but not in the core under reinforced as well as under extinction sessions. In contrast, in rats responding by lever pressing dialysate DA increased both in the accumbens shell and core under reinforced and extinction sessions. Response non-contingent sucrose presentation increased dialysate DA in the shell and core of rats trained to respond for sucrose by nose poking as well as in those trained by lever pressing. In rats trained to respond for sucrose by nose poking on a FR5 schedule dialysate DA also increased selectively in the NAc shell during reinforced responding and in both the shell and core under passive sucrose presentation. These findings, while provide an explanation for the discrepancies existing in the literature over the responsiveness of shell and core DA in rats responding for food, are consistent with the notion that NAc shell and core DA encode different aspects of reinforcement.

Evolution of optogenetic microdevices

Implementation of optogenetic techniques is a recent addition to the neuroscientists' preclinical research arsenal, helping to expose the intricate connectivity of the brain and allowing for on-demand direct modulation of specific neural pathways. Developing an optogenetic system requires thorough investigation of the optogenetic technique and of previously fabricated devices, which this review accommodates. Many experiments utilize bench-top systems that are bulky, expensive, and necessitate tethering to the animal. However, these bench-top systems can make use of power-demanding technologies, such as concurrent electrical recording. Newer portable microdevices and implantable systems carried by freely moving animals are being fabricated that take advantage of wireless energy harvesting to power a system and allow for natural movements that are vital for behavioral testing and analysis. An investigation of the evolution of tethered, portable, and implantable optogenetic microdevices is presented, and an analysis of benefits and detriments of each system, including optical power output, device dimensions, electrode width, and weight is given. Opsins, light sources, and optical fiber coupling are also discussed to optimize device parameters and maximize efficiency from the light source to the fiber, respectively. These attributes are important considerations when designing and developing improved optogenetic microdevices.

What goes up, can come down: Novel brain stimulation paradigms may attenuate craving and craving-related neural circuitry in substance dependent individuals

Vulnerability to drug related cues is one of the leading causes for continued use and relapse among substance dependent individuals. Using drugs in the face of cues may be associated with dysfunction in at least two frontal-striatal neural circuits: (1) elevated activity in medial and ventral areas that govern limbic arousal (including the medial prefrontal cortex (MPFC) and ventral striatum) or (2) depressed activity in dorsal and lateral areas that govern cognitive control (including the dorsolateral prefrontal cortex (DLPFC) and dorsal striatum). Transcranial magnetic stimulation (TMS) is emerging as a promising new tool for the attenuation of craving among multiple substance dependent populations. To date however, nearly all repetitive TMS studies in addiction have focused on amplifying activity in frontal-striatal circuits that govern cognitive control. This manuscript reviews recent work using TMS as a tool to decrease craving for multiple substances and provides a theoretical model for how clinical researchers might approach target and frequency selection for TMS of addiction. To buttress this model, preliminary data from a single-blind, sham-controlled, crossover study of 11 cocaine-dependent individuals is also presented. These results suggest that attenuating MPFC activity through theta burst stimulation decreases activity in the striatum and anterior insula. It is also more likely to attenuate craving than sham TMS. Hence, while many TMS studies are focused on applying LTP-like stimulation to the DLPFC, the MPFC might be a new, efficacious, and treatable target for craving in cocaine dependent individuals.

Toward sophisticated basal ganglia neuromodulation: Review on basal ganglia deep brain stimulation

This review presents state-of-the-art knowledge about the roles of the basal ganglia (BG) in action-selection, cognition, and motivation, and how this knowledge has been used to improve deep brain stimulation (DBS) treatment of neurological and psychiatric disorders. Such pathological conditions include Parkinson's disease, Huntington's disease, Tourette syndrome, depression, and obsessive-compulsive disorder. The first section presents evidence supporting current hypotheses of how the cortico-BG circuitry works to select motor and emotional actions, and how defects in this circuitry can cause symptoms of the BG diseases. Emphasis is given to the role of striatal dopamine on motor performance, motivated behaviors and learning of procedural memories. Next, the use of cutting-edge electrochemical techniques in animal and human studies of BG functioning under normal and disease conditions is discussed. Finally, functional neuroimaging studies are reviewed; these works have shown the relationship between cortico-BG structures activated during DBS and improvement of disease symptoms.

Illuminating circuitry relevant to psychiatric disorders with optogenetics

The brain's remarkable capacity to generate cognition and behavior is mediated by an extraordinarily complex set of neural interactions that remain largely mysterious. This complexity poses a significant challenge in developing therapeutic interventions to ameliorate psychiatric disease. Accordingly, few new classes of drugs have been made available for patients with mental illness since the 1950s. Optogenetics offers the ability to selectively manipulate individual neural circuit elements that underlie disease-relevant behaviors and is currently accelerating the pace of preclinical research into neurobiological mechanisms of disease. In this review, we highlight recent findings from studies that employ optogenetic approaches to gain insight into normal and aberrant brain function relevant to mental illness. Emerging data from these efforts offers an exquisitely detailed picture of disease-relevant neural circuits in action, and hints at the potential of optogenetics to open up entirely new avenues in the treatment of psychiatric disorders.

Effect of salt-tolerant yeast of Candida versatilis and Zygosaccharomyces rouxii on the production of biogenic amines during soy sauce fermentation

BACKGROUND

This study aimed to enhance and improve the quality and safety of soy sauce. In the present work, the change of biogenic amines, such as histamine, tyramine, cadaverine, spermidine, was examined by the treatment of Candida versatilis and Zygosaccharomyces rouxii, and the influence of salt-tolerant yeast on biogenic amines was analysed during the whole fermentation process.

RESULTS

The results showed that the content of biogenic amines was elevated after yeast treatment and the content of biogenic amines was influenced by using yeast. The dominating biogenic amine in soy sauce was tyramine. At the end of fermentation, the concentrations of biogenic amines produced by Zygosaccharomyces rouxii and Candida versatilis in the soy mash were 122.71 mg kg(-1) and 69.96 mg kg(-1) .

CONCLUSIONS

The changes of biogenic amines in high-salt liquid soy mash during fermentation process indicated that a variety of biogenic amines were increased in the fermentation ageing period, which may be due to amino acid decarboxylation to form biogenic amines by yeast decarboxylase. The fermentation period of soy sauce should be longer than 5 months because biogenic amines began to decline after this time period.

Positive reinforcement mediated by midbrain dopamine neurons requires D1 and D2 receptor activation in the nucleus accumbens

The neural basis of positive reinforcement is often studied in the laboratory using intracranial self-stimulation (ICSS), a simple behavioral model in which subjects perform an action in order to obtain exogenous stimulation of a specific brain area. Recently we showed that activation of ventral tegmental area (VTA) dopamine neurons supports ICSS behavior, consistent with proposed roles of this neural population in reinforcement learning. However, VTA dopamine neurons make connections with diverse brain regions, and the specific efferent target(s) that mediate the ability of dopamine neuron activation to support ICSS have not been definitively demonstrated. Here, we examine in transgenic rats whether dopamine neuron-specific ICSS relies on the connection between the VTA and the nucleus accumbens (NAc), a brain region also implicated in positive reinforcement. We find that optogenetic activation of dopaminergic terminals innervating the NAc is sufficient to drive ICSS, and that ICSS driven by optical activation of dopamine neuron somata in the VTA is significantly attenuated by intra-NAc injections of D1 or D2 receptor antagonists. These data demonstrate that the NAc is a critical efferent target sustaining dopamine neuron-specific ICSS, identify receptor subtypes through which dopamine acts to promote this behavior, and ultimately help to refine our understanding of the neural circuitry mediating positive reinforcement.

Positive reinforcement mediated by midbrain dopamine neurons requires D1 and D2 receptor activation in the nucleus accumbens

The neural basis of positive reinforcement is often studied in the laboratory using intracranial self-stimulation (ICSS), a simple behavioral model in which subjects perform an action in order to obtain exogenous stimulation of a specific brain area. Recently we showed that activation of ventral tegmental area (VTA) dopamine neurons supports ICSS behavior, consistent with proposed roles of this neural population in reinforcement learning. However, VTA dopamine neurons make connections with diverse brain regions, and the specific efferent target(s) that mediate the ability of dopamine neuron activation to support ICSS have not been definitively demonstrated. Here, we examine in transgenic rats whether dopamine neuron-specific ICSS relies on the connection between the VTA and the nucleus accumbens (NAc), a brain region also implicated in positive reinforcement. We find that optogenetic activation of dopaminergic terminals innervating the NAc is sufficient to drive ICSS, and that ICSS driven by optical activation of dopamine neuron somata in the VTA is significantly attenuated by intra-NAc injections of D1 or D2 receptor antagonists. These data demonstrate that the NAc is a critical efferent target sustaining dopamine neuron-specific ICSS, identify receptor subtypes through which dopamine acts to promote this behavior, and ultimately help to refine our understanding of the neural circuitry mediating positive reinforcement.

Long-term consumption of dried bonito dashi (a traditional Japanese fish stock) reduces anxiety and modifies central amino acid levels in rats

Dried bonito dashi, a traditional Japanese fish stock, enhances palatability of various dishes because of its specific flavor. Daily intake of dashi has also been shown to improve mood status such as tension-anxiety in humans. This study aimed at investigating beneficial effects of dashi ingestion on anxiety/depression-like behaviors and changes in amino acid levels in the brain and plasma in rats. Male Wistar rats were given either dried bonito dashi or water for long-term (29 days; Experiment 1) or single oral administration (Experiment 2). Anxiety and depression-like behaviors were tested using the open field and forced swimming tests, respectively. Concentrations of amino acids were measured in the hippocampus, hypothalamus, cerebellum, and jugular vein. During the long-term (29 days) consumption, rats given 2% dashi frequently entered the center zone and spent more time compared with the water controls in the open field test. However, the dashi was ineffective on depression-like behavior. In the hippocampus, concentrations of hydroxyproline, anserine, and valine were increased by dashi while those of asparagine and phenylalanine were decreased. In the hypothalamus, the methionine concentration was decreased. In a single oral administration experiment, the dashi (1%, 2% or 10%) showed no effects on behaviors. Significance was observed only in the concentrations of α-aminoadipic acid, cystathionine, and ornithine in the hippocampus. Dried bonito dashi is a functional food having anxiolytic-like effects. Daily ingestion of the dashi, even at lower concentrations found in the cuisine, reduces anxiety and alters amino acid levels in the brain.

Optogenetic stimulation of VTA dopamine neurons reveals that tonic but not phasic patterns of dopamine transmission reduce ethanol self-administration

There is compelling evidence that acute ethanol exposure stimulates ventral tegmental area (VTA) dopamine cell activity and that VTA-dependent dopamine release in terminal fields within the nucleus accumbens plays an integral role in the regulation of ethanol drinking behaviors. Unfortunately, due to technical limitations, the specific temporal dynamics linking VTA dopamine cell activation and ethanol self-administration are not known. In fact, establishing a causal link between specific patterns of dopamine transmission and ethanol drinking behaviors has proven elusive. Here, we sought to address these gaps in our knowledge using a newly developed viral-mediated gene delivery strategy to selectively express Channelrhodopsin-2 (ChR2) on dopamine cells in the VTA of wild-type rats. We then used this approach to precisely control VTA dopamine transmission during voluntary ethanol drinking sessions. The results confirmed that ChR2 was selectively expressed on VTA dopamine cells and delivery of blue light pulses to the VTA induced dopamine release in accumbal terminal fields with very high temporal and spatial precision. Brief high frequency VTA stimulation induced phasic patterns of dopamine release in the nucleus accumbens. Lower frequency stimulation, applied for longer periods mimicked tonic increases in accumbal dopamine. Notably, using this optogenetic approach in rats engaged in an intermittent ethanol drinking procedure, we found that tonic, but not phasic, stimulation of VTA dopamine cells selectively attenuated ethanol drinking behaviors. Collectively, these data demonstrate the effectiveness of a novel viral targeting strategy that can be used to restrict opsin expression to dopamine cells in standard outbred animals and provide the first causal evidence demonstrating that tonic activation of VTA dopamine neurons selectively decreases ethanol self-administration behaviors.

Opening the black box: dopamine, predictions, and learning

Dopamine neurons are thought to promote learning by signaling prediction errors, that is, the difference between actual and expected outcomes. Whether these signals are sufficient for associative learning, however, remains untested. A recent study used optogenetics in a classic behavioral paradigm to confirm the role of dopamine prediction errors in learning.

Reward and aversion in a heterogeneous midbrain dopamine system

The ventral tegmental area (VTA) is a heterogeneous brain structure that serves a central role in motivation and reward processing. Abnormalities in the function of VTA dopamine (DA) neurons and the targets they influence are implicated in several prominent neuropsychiatric disorders including addiction and depression. Recent studies suggest that the midbrain DA system is composed of anatomically and functionally heterogeneous DA subpopulations with different axonal projections. These findings may explain a number of previously confusing observations that suggested a role for DA in processing both rewarding as well as aversive events. Here we will focus on recent advances in understanding the neural circuits mediating reward and aversion in the VTA and how stress as well as drugs of abuse, in particular cocaine, alter circuit function within a heterogeneous midbrain DA system. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'.

Optogenetic interrogations of the neural circuits underlying addiction

Exposure to addictive drugs can result in maladaptive alterations in neural circuit function. This review highlights recent progress made in identifying the organization, function, and cellular plasticity of the ventral tegmental area (VTA) and nucleus accumbens (NAc), two brain regions strongly implicated in substance use disorders. Emphasis is given to advances made with new research methodologies, particularly optogenetics, which have provided scientists with an unprecedented ability to map neural circuitry and pinpoint drug-induced synaptic modifications. A better understanding of these adaptive events will aid the development of pharmacological treatments for drug addiction and, more generally, further our understanding of motivated behaviors.