The mysterious motivational functions of mesolimbic dopamine

Catecholaminergic connectivity to the inner ear, central auditory, and vocal motor circuitry in the plainfin midshipman fish porichthys notatus

Although the neuroanatomical distribution of catecholaminergic (CA) neurons has been well documented across all vertebrate classes, few studies have examined CA connectivity to physiologically and anatomically identified neural circuitry that controls behavior. The goal of this study was to characterize CA distribution in the brain and inner ear of the plainfin midshipman fish (Porichthys notatus) with particular emphasis on their relationship with anatomically labeled circuitry that both produces and encodes social acoustic signals in this species. Neurobiotin labeling of the main auditory end organ, the saccule, combined with tyrosine hydroxylase immunofluorescence (TH-ir) revealed a strong CA innervation of both the peripheral and central auditory system. Diencephalic TH-ir neurons in the periventricular posterior tuberculum, known to be dopaminergic, send ascending projections to the ventral telencephalon and prominent descending projections to vocal-acoustic integration sites, notably the hindbrain octavolateralis efferent nucleus, as well as onto the base of hair cells in the saccule via nerve VIII. Neurobiotin backfills of the vocal nerve in combination with TH-ir revealed CA terminals on all components of the vocal pattern generator, which appears to largely originate from local TH-ir neurons but may include input from diencephalic projections as well. This study provides strong neuroanatomical evidence that catecholamines are important modulators of both auditory and vocal circuitry and acoustic-driven social behavior in midshipman fish. This demonstration of TH-ir terminals in the main end organ of hearing in a nonmammalian vertebrate suggests a conserved and important anatomical and functional role for dopamine in normal audition.

Safety signals as instrumental reinforcers during free-operant avoidance

Safety signals provide "relief" through predicting the absence of an aversive event. At issue is whether these signals also act as instrumental reinforcers. Four experiments were conducted using a free-operant lever-press avoidance paradigm in which each press avoided shock and was followed by the presentation of a 5-sec auditory safety signal. When given a choice between two levers in Experiment 1, both avoiding shock, rats preferentially responded on the lever that produced the safety signal as feedback, even when footshock was omitted. Following avoidance training with a single lever in Experiment 2, removal of the signal led to a decrease in avoidance responses and an increase in responses during the safety period normally denoted by the signal. These behavioral changes demonstrate the dual conditioned reinforcing and fear inhibiting properties of the safety signal. The associative processes that support the reinforcing properties of a safety signal were tested using a novel revaluation procedure. Prior experience of systemic morphine during safety signal presentations resulted in an increased rate of avoidance responses to produce the safety signal during a drug-free extinction test, a finding not seen with d-amphetamine in Experiment 3. Morphine revaluation of the safety signal was repeated in Experiment 4 followed by a drug-free extinction test in which responses did not produce the signal for the first 10 min of the session. Instrumental avoidance in the absence of the signal was shown to be insensitive to prior signal revaluation, suggesting that the signal reinforces free-operant avoidance behavior through a habit-like mechanism.

Overlapping patterns of brain activation to food and cocaine cues in cocaine abusers: association to striatal D2/D3 receptors

Cocaine, through its activation of dopamine (DA) signaling, usurps pathways that process natural rewards. However, the extent to which there is overlap between the networks that process natural and drug rewards and whether DA signaling associated with cocaine abuse influences these networks have not been investigated in humans. We measured brain activation responses to food and cocaine cues with fMRI, and D2/D3 receptors in the striatum with [11C]raclopride and Positron emission tomography in 20 active cocaine abusers. Compared to neutral cues, food and cocaine cues increasingly engaged cerebellum, orbitofrontal, inferior frontal, and premotor cortices and insula and disengaged cuneus and default mode network (DMN). These fMRI signals were proportional to striatal D2/D3 receptors. Surprisingly cocaine and food cues also deactivated ventral striatum and hypothalamus. Compared to food cues, cocaine cues produced lower activation in insula and postcentral gyrus, and less deactivation in hypothalamus and DMN regions. Activation in cortical regions and cerebellum increased in proportion to the valence of the cues, and activation to food cues in somatosensory and orbitofrontal cortices also increased in proportion to body mass. Longer exposure to cocaine was associated with lower activation to both cues in occipital cortex and cerebellum, which could reflect the decreases in D2/D3 receptors associated with chronicity. These findings show that cocaine cues activate similar, though not identical, pathways to those activated by food cues and that striatal D2/D3 receptors modulate these responses, suggesting that chronic cocaine exposure might influence brain sensitivity not just to drugs but also to food cues.

Chronic pain. Decreased motivation during chronic pain requires long-term depression in the nucleus accumbens

Several symptoms associated with chronic pain, including fatigue and depression, are characterized by reduced motivation to initiate or complete goal-directed tasks. However, it is unknown whether maladaptive modifications in neural circuits that regulate motivation occur during chronic pain. Here, we demonstrate that the decreased motivation elicited in mice by two different models of chronic pain requires a galanin receptor 1-triggered depression of excitatory synaptic transmission in indirect pathway nucleus accumbens medium spiny neurons. These results demonstrate a previously unknown pathological adaption in a key node of motivational neural circuitry that is required for one of the major sequela of chronic pain states and syndromes.

Balancing reward and work: anticipatory brain activation in NAcc and VTA predict effort differentially

Complex decision-making involves anticipation of future rewards to bias effort for obtaining it. Using fMRI, we investigated 50 participants employing an instrumental-motivation task that cued reinforcement levels before the onset of the motor-response phase. We extracted timecourses from regions of interest (ROI) in the mesocorticolimbic system and used a three-level hierarchical model to separate anticipatory brain responses predicting value and subsequent effort on a trial-by-trial basis. Whereas all ROIs scaled positively with value, higher effort was predicted by higher anticipatory activation in nucleus accumbens (NAcc) but lower activation in ventral tegmental area/substantia nigra (VTA/SN). Moreover, anticipatory activation in the dorsal striatum predicted average effort whereas higher activation in the amygdala predicted above-average effort. Thus, anticipatory activation entails the appetitive drive towards reinforcement that requires effort in order to be obtained. Our results support the role of NAcc as the main hub supported by the salience network operating on a trial-by-trial basis, while the dorsal striatum incorporates habitual responding.

Synthetic biology and therapeutic strategies for the degenerating brain: Synthetic biology approaches can transform classical cell and gene therapies, to provide new cures for neurodegenerative diseases

Synthetic biology is an emerging engineering discipline that attempts to design and rewire biological components, so as to achieve new functions in a robust and predictable manner. The new tools and strategies provided by synthetic biology have the potential to improve therapeutics for neurodegenerative diseases. In particular, synthetic biology will help design small molecules, proteins, gene networks, and vectors to target disease-related genes. Ultimately, new intelligent delivery systems will provide targeted and sustained therapeutic benefits. New treatments will arise from combining ‘protect and repair’ strategies: the use of drug treatments, the promotion of neurotrophic factor synthesis, and gene targeting. Going beyond RNAi and artificial transcription factors, site-specific genome modification is likely to play an increasing role, especially with newly available gene editing tools such as CRISPR/Cas9 systems. Taken together, these advances will help develop safe and long-term therapies for many brain diseases in human patients.

Differential sensitivity of ethanol-elicited ERK phosphorylation in nucleus accumbens of Sardinian alcohol-preferring and -non preferring rats

Sardinian alcohol-preferring (sP) and -non preferring (sNP) rats have been selectively bred for opposite ethanol preference and consumption; sP rats represent a validated experimental tool to model several aspects of excessive ethanol drinking in humans. Phosphorylated Extracellular signal-Regulated Kinase (pERK) in dopamine-rich terminal areas plays a critical role in several psychopharmacological effects of addictive drugs, including ethanol. This study was aimed at investigating whether ethanol-elicited ERK activation may differ in key brain areas of ethanol-naïve sP and sNP rats. To this end, the effects of ethanol (0, 0.5, 1, and 2 g/kg, administered intra-gastrically [i.g.]) on ERK phosphorylation were assessed by pERK immunohistochemistry in the shell (AcbSh) and core (AcbC) of the nucleus accumbens (Acb) as well as in the prelimbic (PrL) and infralimbic (IL) prefrontal cortex (PFCx), in the bed nucleus of stria terminalis (BSTL) and in the central nucleus of the amygdala (CeA). Ethanol (1 g/kg) significantly increased pERK immunoreactivity in AcbSh and AcbC of sP but not sNP rats. Conversely, ethanol failed to affect pERK expression in PrL and IL PFCx as well as in BSTL and CeA of both sP and sNP rats. These results suggest that selective breeding of these rat lines results in differential effects of acute ethanol on ERK phosphorylation in brain regions critical for the psychopharmacological effects of ethanol.

Aberrant glutamate signaling in the prefrontal cortex and striatum of the spontaneously hypertensive rat model of attention-deficit/hyperactivity disorder

RATIONALE

Attention-deficit/hyperactivity disorder (ADHD) is thought to involve hypofunctional catecholamine systems in the striatum, nucleus accumbens, and prefrontal cortex (PFC); however, recent clinical evidence has implicated glutamate dysfunction in the pathophysiology of ADHD. Recent studies show that increased stimulation of dopamine D2 and D4 receptors causes inhibition of N-methyl-D-aspartate and α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid receptors, respectively. The spontaneously hypertensive rat (SHR) model of ADHD combined type (C) has been found to have a hypofunctional dopamine system in the ventral striatum, nucleus accumbens, and PFC compared to the control Wistar Kyoto (WKY) strain.

OBJECTIVES

Based on the current understanding of typical dopamine-glutamate interactions, we hypothesized that the SHR model of ADHD would have a hyperfunctional glutamate system terminating in the striatum, nucleus accumbens, and PFC.

RESULTS

High-speed amperometric recordings combined with four-channel microelectrode arrays to directly measure glutamate dynamics showed increased evoked glutamate release in the PFC (cingulate and infralimbic cortices, p < 0.05) and also in the striatum (p < 0.05) of the SHR (ADHD-C) as compared to the WKY. Finally, glutamate uptake was discovered to be aberrant in the PFC, but not the striatum, of the SHR when compared to the control WKY strain.

CONCLUSIONS

These results suggest that the glutamatergic system in the PFC of the SHR model of ADHD is hyperfunctional and that targeting glutamate in the PFC could lead to the development of novel therapeutics for the treatment of ADHD.

Faster, better, stronger: towards new antidepressant therapeutic strategies

Major depression is a highly prevalent disorder and is predicted to be the second leading cause of disease burden by 2020. Although many antidepressant drugs are currently available, they are far from optimal. Approximately 50% of patients do not respond to initial first line antidepressant treatment, while approximately one third fail to achieve remission following several pharmacological interventions. Furthermore, several weeks or months of treatment are often required before clinical improvement, if any, is reported. Moreover, most of the commonly used antidepressants have been primarily designed to increase synaptic availability of serotonin and/or noradrenaline and although they are of therapeutic benefit to many patients, it is clear that other therapeutic targets are required if we are going to improve the response and remission rates. It is clear that more effective, rapid-acting antidepressants with novel mechanisms of action are required. The purpose of this review is to outline the current strategies that are being taken in both preclinical and clinical settings for identifying superior antidepressant drugs. The realisation that ketamine has rapid antidepressant-like effects in treatment resistant patients has reenergised the field. Further, developing an understanding of the mechanisms underlying the rapid antidepressant effects in treatment-resistant patients by drugs such as ketamine may uncover novel therapeutic targets that can be exploited to meet the Olympian challenge of developing faster, better and stronger antidepressant drugs.

Amygdala-ventral pallidum pathway decreases dopamine activity after chronic mild stress in rats

BACKGROUND

Major depressive disorder affects more than 15% of the population across their lifespan. In this study, we used the well-characterized unpredictable chronic mild stress (CMS) model of depression to examine this condition.

METHODS

Sprague-Dawley rats were presented randomly with mild stressors for 4 weeks, with body weight and sucrose intake monitored weekly. Locomotor activity and elevated plus maze test/forced swim test were conducted on Week 5; ventral tegmental area dopamine (DA) neuron activity was assessed within 1 week after the behavioral test with three indices: DA neuron population activity (defined as the number of spontaneously firing DA neurons); mean firing rate; and percent burst firing (i.e., the proportion of action potentials occurring in bursts).

RESULTS

Consistent with previous studies, we found that, compared with control subjects, rats that underwent the CMS procedure were slower in gaining body weight and developed anxiety- and despair-like behavior. We now report a significant decrease in DA neuron population activity of CMS rats, and this decrease is restored by pharmacologically attenuating the activity of either the basolateral nucleus of the amygdala (BLA) or the ventral pallidum (VP). Moreover, pharmacological activation of the amygdala in nonstressed rats decreases DA neuron population activity similar to that with CMS, which is reversed by blocking the BLA-VP pathway.

CONCLUSIONS

The CMS rat depression model is associated with a BLA-VP-ventral tegmental area inhibition of DA neuron activity. This information can provide insight into the circuitry underlying major depressive disorder and serve as a template for refining therapeutic approaches to this disorder.

Combining non-pharmacological treatments with pharmacotherapies for neurological disorders: a unique interface of the brain, drug-device, and intellectual property

Mobile medical applications (mHealth), music, and video games are being developed and tested for their ability to improve pharmacotherapy outcomes and medication adherence. Pleiotropic mechanism of music and gamification engages an intrinsic motivation and the brain reward system, supporting therapies in patients with neurological disorders, including neuropathic pain, depression, anxiety, or neurodegenerative disorders. Based on accumulating results from clinical trials, an innovative combination treatment of epilepsy seizures, comorbidities, and the medication non-adherence can be designed, consisting of antiepileptic drugs and disease self-management software delivering clinically beneficial music. Since creative elements and art expressed in games, music, and software are copyrighted, therefore clinical and regulatory challenges in developing copyrighted, drug–device therapies may be offset by a value proposition of the exclusivity due to the patent–independent protection, which can last for over 70 years. Taken together, development of copyrighted non-pharmacological treatments (e-therapies), and their combinations with pharmacotherapies, offer incentives to chronically ill patients and outcome-driven health care industries.

A comparison of neural responses to appetitive and aversive stimuli in humans and other mammals

Distinguishing potentially harmful or beneficial stimuli is necessary for the self-preservation and well-being of all organisms. This assessment requires the ongoing valuation of environmental stimuli. Despite much work on the processing of aversive- and appetitive-related brain signals, it is not clear to what degree these two processes interact across the brain. To help clarify this issue, this report used a cross-species comparative approach in humans (i.e. meta-analysis of imaging data) and other mammals (i.e. targeted review of functional neuroanatomy in rodents and non-human primates). Human meta-analysis results suggest network components that appear selective for appetitive (e.g. ventromedial prefrontal cortex, ventral tegmental area) or aversive (e.g. cingulate/supplementary motor cortex, periaqueductal grey) processing, or that reflect overlapping (e.g. anterior insula, amygdala) or asymmetrical, i.e. apparently lateralized, activity (e.g. orbitofrontal cortex, ventral striatum). However, a closer look at the known value-related mechanisms from the animal literature suggests that all of these macroanatomical regions are involved in the processing of both appetitive and aversive stimuli. Differential spatiotemporal network dynamics may help explain similarities and differences in appetitive- and aversion-related activity.

The VMAT-2 inhibitor tetrabenazine affects effort-related decision making in a progressive ratio/chow feeding choice task: reversal with antidepressant drugs

Behavioral activation is a fundamental feature of motivation, and organisms frequently make effort-related decisions based upon evaluations of reinforcement value and response costs. Furthermore, people with major depression and other disorders often show anergia, psychomotor retardation, fatigue, and alterations in effort-related decision making. Tasks measuring effort-based decision making can be used as animal models of the motivational symptoms of depression, and the present studies characterized the effort-related effects of the vesicular monoamine transport (VMAT-2) inhibitor tetrabenazine. Tetrabenazine induces depressive symptoms in humans, and also preferentially depletes dopamine (DA). Rats were assessed using a concurrent progressive ratio (PROG)/chow feeding task, in which they can either lever press on a PROG schedule for preferred high-carbohydrate food, or approach and consume a less-preferred lab chow that is freely available in the chamber. Previous work has shown that the DA antagonist haloperidol reduced PROG work output on this task, but did not reduce chow intake, effects that differed substantially from those of reinforcer devaluation or appetite suppressant drugs. The present work demonstrated that tetrabenazine produced an effort-related shift in responding on the PROG/chow procedure, reducing lever presses, highest ratio achieved and time spent responding, but not reducing chow intake. Similar effects were produced by administration of the subtype selective DA antagonists ecopipam (D1) and eticlopride (D2), but not by the cannabinoid CB1 receptor neutral antagonist and putative appetite suppressant AM 4413, which suppressed both lever pressing and chow intake. The adenosine A_2A antagonist MSX-3, the antidepressant and catecholamine uptake inhibitor bupropion, and the MAO-B inhibitor deprenyl, all reversed the impairments induced by tetrabenazine. This work demonstrates the potential utility of the PROG/chow procedure as a rodent model of the effort-related deficits observed in depressed patients.

Serotoninergic and dopaminergic modulation of cortico-striatal circuit in executive and attention deficits induced by NMDA receptor hypofunction in the 5-choice serial reaction time task

Executive functions are an emerging propriety of neuronal processing in circuits encompassing frontal cortex and other cortical and subcortical brain regions such as basal ganglia and thalamus. Glutamate serves as the major neurotrasmitter in these circuits where glutamate receptors of NMDA type play key role. Serotonin and dopamine afferents are in position to modulate intrinsic glutamate neurotransmission along these circuits and in turn to optimize circuit performance for specific aspects of executive control over behavior. In this review, we focus on the 5-choice serial reaction time task which is able to provide various measures of attention and executive control over performance in rodents and the ability of prefrontocortical and striatal serotonin 5-HT_1A, 5-HT_2A, and 5-HT_2C as well as dopamine D₁- and D₂-like receptors to modulate different aspects of executive and attention disturbances induced by NMDA receptor hypofunction in the prefrontal cortex. These behavioral studies are integrated with findings from microdialysis studies. These studies illustrate the control of attention selectivity by serotonin 5-HT_1A, 5-HT_2A, 5-HT_2C, and dopamine D₁- but not D₂-like receptors and a distinct contribution of these cortical and striatal serotonin and dopamine receptors to the control of different aspects of executive control over performance such as impulsivity and compulsivity. An association between NMDA antagonist-induced increase in glutamate release in the prefrontal cortex and attention is suggested. Collectively, this review highlights the functional interaction of serotonin and dopamine with NMDA dependent glutamate neurotransmission in the cortico-striatal circuitry for specific cognitive demands and may shed some light on how dysregulation of neuronal processing in these circuits may be implicated in specific neuropsychiatric disorders.

Apathy in Parkinson's disease: neurophysiological evidence of impaired incentive processing

Apathy is one of the most common and debilitating nonmotor manifestations of Parkinson's disease (PD) and is characterized by diminished motivation, decreased goal-directed behavior, and flattened affect. Despite its high prevalence, its underlying mechanisms are still poorly understood, having been associated with executive dysfunction, and impaired emotional processing and decision making. Apathy, as a syndrome, has recently been associated with reduced activation in the ventral striatum, suggesting that early- to middle-stage Parkinson's disease patients with this manifestation may have a compromised mesocorticolimbic dopaminergic pathway and impaired incentive processing. To test this hypothesis, we measured the amplitude of the feedback-related negativity, an event-related brain potential associated with performance outcome valence, following monetary gains and losses in human PD patients (12 women) and healthy controls (6 women) performing a gambling task. Early- to middle-stage PD patients presenting clinically meaningful symptoms of apathy were compared with nonapathetic PD patients and healthy controls. Patients with cognitive impairment, depression, and other psychiatric disturbances were excluded. Results showed that the amplitude of the feedback-related negativity, measured as the difference wave in the event-related brain potential between gains and losses, was significantly reduced in PD patients with apathy compared with nonapathetic patients and healthy controls. These findings indicate impaired incentive processing and suggest a compromised mesocorticolimbic pathway in cognitively intact PD patients with apathy.

N-terminal tagging of the dopamine transporter impairs protein expression and trafficking in vivo

The dopamine transporter (DAT) is the primary protein responsible for the uptake of dopamine from the extracellular space back into presynaptic neurons. As such, it plays an important role in the cessation of dopaminergic neurotransmission and in the maintenance of extracellular dopamine homeostasis. Here, we report the development of a new BAC transgenic mouse line that expresses DAT with an N-terminal HA-epitope (HAD-Tg). In this line, two copies of the HA-DAT BAC are incorporated into the genome, increasing DAT mRNA levels by 47%. Despite the increase in mRNA levels, HAD-Tg mice show no significant increase in the level of DAT protein in the striatum, indicating a defect in protein trafficking or stability. By crossing HAD-Tg mice with DAT knockout mice (DAT-KO), we engineered mice that exclusively express HA-tagged DAT in the absence of endogenous DAT (DAT-KO/HAD-Tg). We show that DAT-KO/HAD-Tg mice express only 8.5% of WT DAT levels in the striatum. Importantly, the HA-tagged DAT that is present in DAT-KO/HAD-Tg mice is functional, as it is able to partially rescue the DAT-KO hyperactive phenotype. Finally, we provide evidence that the HA-tagged DAT is retained in the cell body based on a reduction in the striatum:midbrain protein ratio. These results demonstrate that the presence of the N-terminal tag leads to impaired DAT protein expression in vivo due in part to improper trafficking of the tagged transporter, and highlight the importance of the N-terminus in the transport of DAT to striatal terminals.

Role of the primate ventral tegmental area in reinforcement and motivation

Monkey electrophysiology suggests that the activity of the ventral tegmental area (VTA) helps regulate reinforcement learning and motivated behavior, in part by broadcasting prediction error signals throughout the reward system. However, electrophysiological studies do not allow causal inferences regarding the activity of VTA neurons with respect to these processes because they require artificial manipulation of neuronal firing. Rodent studies fulfilled this requirement by demonstrating that electrical and optogenetic VTA stimulation can induce learning and modulate downstream structures. Still, the primate dopamine system has diverged significantly from that of rodents, exhibiting greatly expanded and uniquely distributed cortical and subcortical innervation patterns. Here, we bridge the gap between rodent perturbation studies and monkey electrophysiology using chronic electrical microstimulation of macaque VTA (VTA-EM). VTA-EM was found to reinforce cue selection in an operant task and to motivate future cue selection using a Pavlovian paradigm. Moreover, by combining VTA-EM with concurrent fMRI, we demonstrated that VTA-EM increased fMRI activity throughout most of the dopaminergic reward system. These results establish a causative role for primate VTA in regulating stimulus-specific reinforcement and motivation as well as in modulating activity throughout the reward system.

It's MORe exciting than mu: crosstalk between mu opioid receptors and glutamatergic transmission in the mesolimbic dopamine system

Opioids selective for the G protein-coupled mu opioid receptor (MOR) produce potent analgesia and euphoria. Heroin, a synthetic opioid, is considered one of the most addictive substances, and the recent exponential rise in opioid addiction and overdose deaths has made treatment development a national public health priority. Existing medications (methadone, buprenorphine, and naltrexone), when combined with psychosocial therapies, have proven efficacy in reducing aspects of opioid addiction. Unfortunately, these medications have critical limitations including those associated with opioid agonist therapies (e.g., sustained physiological dependence and opioid withdrawal leading to high relapse rates upon discontinuation), non-adherence to daily dosing, and non-renewal of monthly injection with extended-release naltrexone. Furthermore, current medications fail to ameliorate key aspects of addiction such as powerful conditioned associations that trigger relapse (e.g., cues, stress, the drug itself). Thus, there is a need for developing novel treatments that target neural processes corrupted with chronic opioid use. This requires a basic understanding of molecular and cellular mechanisms underlying effects of opioids on synaptic transmission and plasticity within reward-related neural circuits. The focus of this review is to discuss how crosstalk between MOR-associated G protein signaling and glutamatergic neurotransmission leads to immediate and long-term effects on emotional states (e.g., euphoria, depression) and motivated behavior (e.g., drug-seeking, relapse). Our goal is to integrate findings on how opioids modulate synaptic release of glutamate and postsynaptic transmission via α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid and N-methyl-D-aspartate receptors in the nucleus accumbens and ventral tegmental area with the clinical (neurobehavioral) progression of opioid dependence, as well as to identify gaps in knowledge that can be addressed in future studies.

Ghrelin acts as an interface between physiological state and phasic dopamine signaling

Brief, high-concentration (phasic) spikes in nucleus accumbens dopamine critically participate in aspects of food reward. Although physiological state (e.g., hunger, satiety) and associated hormones are known to affect dopamine tone in general, whether they modulate food-evoked, phasic dopamine specifically is unknown. Here, we used fast-scan cyclic voltammetry in awake, behaving rats to record dopamine spikes evoked by delivery of sugar pellets while pharmacologically manipulating central receptors for the gut "hunger" hormone ghrelin. Lateral ventricular (LV) ghrelin increased, while LV ghrelin receptor antagonism suppressed the magnitude of dopamine spikes evoked by food. Ghrelin was effective when infused directly into the lateral hypothalamus (LH), but not the ventral tegmental area (VTA). LH infusions were made in close proximity to orexin neurons, which are regulated by ghrelin and project to the VTA. Thus, we also investigated and found potentiation of food-evoked dopamine spikes by intra-VTA orexin-A. Importantly, intra-VTA blockade of orexin receptors attenuated food intake induced by LV ghrelin, thus establishing a behaviorally relevant connection between central ghrelin and VTA orexin. Further analysis revealed that food restriction increased the magnitude of dopamine spikes evoked by food independent of any pharmacological manipulations. The results support the regulation of food-evoked dopamine spikes by physiological state with endogenous fluctuations in ghrelin as a key contributor. Our data highlight a novel mechanism by which signals relating physiological state could influence food reinforcement and food-directed behavior.

Operant conditioning of synaptic and spiking activity patterns in single hippocampal neurons

Learning is a process of plastic adaptation through which a neural circuit generates a more preferable outcome; however, at a microscopic level, little is known about how synaptic activity is patterned into a desired configuration. Here, we report that animals can generate a specific form of synaptic activity in a given neuron in the hippocampus. In awake, head-restricted mice, we applied electrical stimulation to the lateral hypothalamus, a reward-associated brain region, when whole-cell patch-clamped CA1 neurons exhibited spontaneous synaptic activity that met preset criteria. Within 15 min, the mice learned to generate frequently the excitatory synaptic input pattern that satisfied the criteria. This reinforcement learning of synaptic activity was not observed for inhibitory input patterns. When a burst unit activity pattern was conditioned in paired and nonpaired paradigms, the frequency of burst-spiking events increased and decreased, respectively. The burst reinforcement occurred in the conditioned neuron but not in other adjacent neurons; however, ripple field oscillations were concomitantly reinforced. Neural conditioning depended on activation of NMDA receptors and dopamine D1 receptors. Acutely stressed mice and depression model mice that were subjected to forced swimming failed to exhibit the neural conditioning. This learning deficit was rescued by repetitive treatment with fluoxetine, an antidepressant. Therefore, internally motivated animals are capable of routing an ongoing action potential series into a specific neural pathway of the hippocampal network.

Differences between the nonselective adenosine receptor antagonists caffeine and theophylline in motor and mood effects: studies using medium to high doses in animal models

RATIONALE

Caffeine and theophylline are methylxanthines that are broadly consumed, sometimes at high doses, and act as minor psychostimulants. Both are nonselective adenosine antagonists for A1 and A2A receptors, which are colocalized with dopamine D1 and D2 receptors in striatal areas. Adenosine antagonists generally have opposite actions to those of dopamine antagonists. Although the effects of caffeine are widely known, theophylline has been much less well characterized, especially at high doses.

METHODS

Adult male CD1 mice were used to study the effect of a broad range of doses (25.0, 50.0 or 100.0mg/kg) of caffeine and theophylline on measures of spontaneous locomotion and coordination, as well as the pattern of c-Fos immunoreactivity in brain areas rich in adenosine and dopamine receptors. In addition, we evaluated possible anxiety and stress effects of these doses.

RESULTS

Caffeine, at these doses, impaired or suppressed locomotion in several paradigms. However, theophylline was less potent than caffeine at suppressing motor parameters, and even stimulated locomotion. Both drugs induced corticosterone release, however caffeine was more efficacious at intermediate doses. While caffeine showed an anxiogenic profile at all doses, theophylline only did so at the highest dose used (50mg/kg). Only theophylline increased c-Fos immunoreactivity in cortical areas.

CONCLUSION

Theophylline has fewer disruptive effects than caffeine on motor parameters and produces less stress and anxiety effects. These results are relevant for understanding the potential side effects of methylxanthines when consumed at high doses.

Dopamine genetic risk score predicts depressive symptoms in healthy adults and adults with depression

BACKGROUND

Depression is a common source of human disability for which etiologic insights remain limited. Although abnormalities of monoamine neurotransmission, including dopamine, are theorized to contribute to the pathophysiology of depression, evidence linking dopamine-related genes to depression has been mixed. The current study sought to address this knowledge-gap by examining whether the combined effect of dopamine polymorphisms was associated with depressive symptomatology in both healthy individuals and individuals with depression.

METHODS

Data were drawn from three independent samples: (1) a discovery sample of healthy adult participants (n = 273); (2) a replication sample of adults with depression (n = 1,267); and (3) a replication sample of healthy adult participants (n = 382). A genetic risk score was created by combining functional polymorphisms from five genes involved in synaptic dopamine availability (COMT and DAT) and dopamine receptor binding (DRD1, DRD2, DRD3).

RESULTS

In the discovery sample, the genetic risk score was associated with depressive symptomatology (β = -0.80, p = 0.003), with lower dopamine genetic risk scores (indicating lower dopaminergic neurotransmission) predicting higher levels of depression. This result was replicated with a similar genetic risk score based on imputed genetic data from adults with depression (β = -0.51, p = 0.04). Results were of similar magnitude and in the expected direction in a cohort of healthy adult participants (β = -0.86, p = 0.15).

CONCLUSIONS

Sequence variation in multiple genes regulating dopamine neurotransmission may influence depressive symptoms, in a manner that appears to be additive. Further studies are required to confirm the role of genetic variation in dopamine metabolism and depression.

Molecular-level functional magnetic resonance imaging of dopaminergic signaling

We demonstrate a technique for mapping brain activity that combines molecular specificity and spatial coverage using a neurotransmitter sensor detectable by magnetic resonance imaging (MRI). This molecular functional MRI (fMRI) method yielded time-resolved volumetric measurements of dopamine release evoked by reward-related lateral hypothalamic brain stimulation of rats injected with the neurotransmitter sensor. Peak dopamine concentrations and release rates were observed in the anterior nucleus accumbens core. Substantial dopamine transients were also present in more caudal areas. Dopamine-release amplitudes correlated with the rostrocaudal stimulation coordinate, suggesting participation of hypothalamic circuitry in modulating dopamine responses. This work provides a foundation for development and application of quantitative molecular fMRI techniques targeted toward numerous components of neural physiology.

Effort, anhedonia, and function in schizophrenia: reduced effort allocation predicts amotivation and functional impairment

One of the most debilitating aspects of schizophrenia is an apparent interest in or ability to exert effort for rewards. Such "negative symptoms" may prevent individuals from obtaining potentially beneficial outcomes in educational, occupational, or social domains. In animal models, dopamine abnormalities decrease willingness to work for rewards, implicating dopamine (DA) function as a candidate substrate for negative symptoms given that schizophrenia involves dysregulation of the dopamine system. We used the effort-expenditure for rewards task (EEfRT) to assess the degree to which individuals with schizophrenia were wiling to exert increased effort for either larger magnitude rewards or for rewards that were more probable. Fifty-nine individuals with schizophrenia and 39 demographically similar controls performed the EEfRT task, which involves making choices between "easy" and "hard" tasks to earn potential rewards. Individuals with schizophrenia showed less of an increase in effort allocation as either reward magnitude or probability increased. In controls, the frequency of choosing the hard task in high reward magnitude and probability conditions was negatively correlated with depression severity and anhedonia. In schizophrenia, fewer hard task choices were associated with more severe negative symptoms and worse community and work function as assessed by a caretaker. Consistent with patterns of disrupted dopamine functioning observed in animal models of schizophrenia, these results suggest that 1 mechanism contributing to impaired function and motivational drive in schizophrenia may be a reduced allocation of greater effort for higher magnitude or higher probability rewards.

Distinct dopaminergic control of the direct and indirect pathways in reward-based and avoidance learning behaviors

The nucleus accumbens (NAc) plays a pivotal role in reward and aversive learning and learning flexibility. Outputs of the NAc are transmitted through two parallel routes termed the direct and indirect pathways and controlled by the dopamine (DA) neurotransmitter. To explore how reward-based and avoidance learning is controlled in the NAc of the mouse, we developed the reversible neurotransmission-blocking (RNB) technique, in which transmission of each pathway could be selectively and reversibly blocked by the pathway-specific expression of transmission-blocking tetanus toxin and the asymmetric RNB technique, in which one side of the NAc was blocked by the RNB technique and the other intact side was pharmacologically manipulated by a transmitter agonist or antagonist. Our studies demonstrated that the activation of D1 receptors in the direct pathway and the inactivation of D2 receptors in the indirect pathway are key determinants that distinctly control reward-based and avoidance learning, respectively. The D2 receptor inactivation is also critical for flexibility of reward learning. Furthermore, reward and aversive learning is regulated by a set of common downstream receptors and signaling cascades, all of which are involved in the induction of long-term potentiation at cortico-accumbens synapses of the two pathways. In this article, we review our studies that specify the regulatory mechanisms of each pathway in learning behavior and propose a mechanistic model to explain how dynamic DA modulation promotes selection of actions that achieve reward-seeking outcomes and avoid aversive ones. The biological significance of the network organization consisting of two parallel transmission pathways is also discussed from the point of effective and prompt selection of neural outcomes in the neural network.

Dopamine precursor depletion influences pain affect rather than pain sensation

Pain is a multidimensional experience, which includes sensory, cognitive, and affective aspects. Converging lines of evidence indicate that dopaminergic neurotransmission plays an important role in human pain perception. However, the precise effects of dopamine on different aspects of pain perception remain to be elucidated. To address this question, we experimentally decreased dopaminergic neurotransmission in 22 healthy human subjects using Acute Phenylalanine and Tyrosine Depletion (APTD). During APTD and a control condition we applied brief painful laser stimuli to the hand, assessed different aspects of pain perception, and recorded electroencephalographic responses. APTD-induced decreases of cerebral dopaminergic activity did not influence sensory aspects of pain perception. In contrast, APTD yielded increases of pain unpleasantness. The increases of unpleasantness ratings positively correlated with effectiveness of APTD. Our finding of an influence of dopaminergic neurotransmission on affective but not sensory aspects of phasic pain suggests that analgesic effects of dopamine might be mediated by indirect effects on pain affect rather than by direct effects on ascending nociceptive signals. These findings contribute to our understanding of the complex relationship between dopamine and pain perception, which may play a role in various clinical pain states.

Positive reinforcement mediated by midbrain dopamine neurons requires D1 and D2 receptor activation in the nucleus accumbens

The neural basis of positive reinforcement is often studied in the laboratory using intracranial self-stimulation (ICSS), a simple behavioral model in which subjects perform an action in order to obtain exogenous stimulation of a specific brain area. Recently we showed that activation of ventral tegmental area (VTA) dopamine neurons supports ICSS behavior, consistent with proposed roles of this neural population in reinforcement learning. However, VTA dopamine neurons make connections with diverse brain regions, and the specific efferent target(s) that mediate the ability of dopamine neuron activation to support ICSS have not been definitively demonstrated. Here, we examine in transgenic rats whether dopamine neuron-specific ICSS relies on the connection between the VTA and the nucleus accumbens (NAc), a brain region also implicated in positive reinforcement. We find that optogenetic activation of dopaminergic terminals innervating the NAc is sufficient to drive ICSS, and that ICSS driven by optical activation of dopamine neuron somata in the VTA is significantly attenuated by intra-NAc injections of D1 or D2 receptor antagonists. These data demonstrate that the NAc is a critical efferent target sustaining dopamine neuron-specific ICSS, identify receptor subtypes through which dopamine acts to promote this behavior, and ultimately help to refine our understanding of the neural circuitry mediating positive reinforcement.

Positive reinforcement mediated by midbrain dopamine neurons requires D1 and D2 receptor activation in the nucleus accumbens

The neural basis of positive reinforcement is often studied in the laboratory using intracranial self-stimulation (ICSS), a simple behavioral model in which subjects perform an action in order to obtain exogenous stimulation of a specific brain area. Recently we showed that activation of ventral tegmental area (VTA) dopamine neurons supports ICSS behavior, consistent with proposed roles of this neural population in reinforcement learning. However, VTA dopamine neurons make connections with diverse brain regions, and the specific efferent target(s) that mediate the ability of dopamine neuron activation to support ICSS have not been definitively demonstrated. Here, we examine in transgenic rats whether dopamine neuron-specific ICSS relies on the connection between the VTA and the nucleus accumbens (NAc), a brain region also implicated in positive reinforcement. We find that optogenetic activation of dopaminergic terminals innervating the NAc is sufficient to drive ICSS, and that ICSS driven by optical activation of dopamine neuron somata in the VTA is significantly attenuated by intra-NAc injections of D1 or D2 receptor antagonists. These data demonstrate that the NAc is a critical efferent target sustaining dopamine neuron-specific ICSS, identify receptor subtypes through which dopamine acts to promote this behavior, and ultimately help to refine our understanding of the neural circuitry mediating positive reinforcement.

Psychostimulants, antidepressants and neurokinin-1 receptor antagonists ('motor disinhibitors') have overlapping, but distinct, effects on monoamine transmission: the involvement of L-type Ca2+ channels and implications for the treatment of ADHD

Both psychostimulants and antidepressants target monoamine transporters and, as a consequence, augment monoamine transmission. These two groups of drugs also increase motor activity in preclinical behavioural screens for antidepressants. Substance P-preferring receptor (NK1R) antagonists similarly increase both motor activity in these tests and monoamine transmission in the brain. In this article, the neurochemical and behavioural responses to these three groups of drugs are compared. It becomes evident that NK1R antagonists represent a distinct class of compounds ('motor disinhibitors') that differ substantially from both psychostimulants and antidepressants, especially during states of heightened arousal or stress. Also, all three groups of drugs influence the activation of voltage-gated Ca(v)1.2 and Ca(v)1.3 L-type channels (LTCCs) in the brain, albeit in different ways. This article discusses evidence that points to disruption of these functional interactions between NK1R and LTCCs as a contributing factor in the cognitive and behavioural abnormalities that are prominent features of Attention Deficit Hyperactivity Disorder (ADHD). Arising from this is the interesting possibility that the hyperactivity and impulsivity (as in ADHD) and psychomotor retardation (as in depression) reflect opposite poles of a behavioural continuum. A better understanding of this pharmacological network could help explain why psychostimulants augment motor behaviour during stress (e.g., in preclinical screens for antidepressants) and yet reduce locomotor activity and impulsivity in ADHD. This article is part of the Special Issue entitled 'CNS Stimulants'.

An update on the connections of the ventral mesencephalic dopaminergic complex

This review covers the intrinsic organization and afferent and efferent connections of the midbrain dopaminergic complex, comprising the substantia nigra, ventral tegmental area and retrorubral field, which house, respectively, the A9, A10 and A8 groups of nigrostriatal, mesolimbic and mesocortical dopaminergic neurons. In addition, A10dc (dorsal, caudal) and A10rv (rostroventral) extensions into, respectively, the ventrolateral periaqueductal gray and supramammillary nucleus are discussed. Associated intrinsic and extrinsic connections of the midbrain dopaminergic complex that utilize gamma-aminobutyric acid (GABA), glutamate and neuropeptides and various co-expressed combinations of these compounds are considered in conjunction with the dopamine-containing systems. A framework is provided for understanding the organization of massive afferent systems descending and ascending to the midbrain dopaminergic complex from the telencephalon and brainstem, respectively. Within the context of this framework, the basal ganglia direct and indirect output pathways are treated in some detail. Findings from rodent brain are briefly compared with those from primates, including humans. Recent literature is emphasized, including traditional experimental neuroanatomical and modern gene transfer and optogenetic studies. An attempt was made to provide sufficient background and cite a representative sampling of earlier primary papers and reviews so that people new to the field may find this to be a relatively comprehensive treatment of the subject.

P300 amplitude variation is related to ventral striatum BOLD response during gain and loss anticipation: an EEG and fMRI experiment

The anticipation of favourable or unfavourable events is a key component in our daily life. However, the temporal dynamics of anticipation processes in relation to brain activation are still not fully understood. A modified version of the monetary incentive delay task was administered during separate functional magnetic resonance imaging (fMRI) and electroencephalogram (EEG) sessions in the same 25 participants to assess anticipatory processes with a multi-modal neuroimaging set-up. During fMRI, gain and loss anticipation were both associated with heightened activation in ventral striatum and reward-related areas. EEG revealed most pronounced P300 amplitudes for gain anticipation, whereas CNV amplitudes distinguished neutral from gain and loss anticipation. Importantly, P300, but not CNV amplitudes, were correlated to neural activation in the ventral striatum for both gain and loss anticipation. Larger P300 amplitudes indicated higher ventral striatum blood oxygen level dependent (BOLD) response. Early stimulus evaluation processes indexed by EEG seem to be positively related to higher activation levels in the ventral striatum, indexed by fMRI, which are usually associated with reward processing. The current results, however, point towards a more general motivational mechanism processing salient stimuli during anticipation.

The role of the striatum in effort-based decision-making in the absence of reward

Decision-making involves weighing costs against benefits, for instance, in terms of the effort it takes to obtain a reward of a given magnitude. This evaluation process has been linked to the dorsal anterior cingulate cortex (dACC) and the striatum, with activation in these brain structures reflecting the discounting effect of effort on reward. Here, we investigate how cognitive effort influences neural choice processes in the absence of an extrinsic reward. Using functional magnetic resonance imaging in humans, we used an effort-based decision-making task in which participants were required to choose between two options for a subsequent flanker task that differed in the amount of cognitive effort. Cognitive effort was manipulated by varying the proportion of incongruent trials associated with each choice option. Choice-locked activation in the striatum was higher when participants chose voluntarily for the more effortful alternative but displayed the opposite trend on forced-choice trials. The dACC revealed a similar, yet only trend-level significant, activation pattern. Our results imply that activation levels in the striatum reflect a cost-benefit analysis, in which a balance is made between effort discounting and the intrinsic motivation to choose a cognitively challenging task. Moreover, our findings indicate that it matters whether this challenge is voluntarily chosen or externally imposed. As such, the present findings contrast with classical findings on effort discounting that found reductions in striatum activation for higher effort by finding enhancements of the same neural circuits when a cognitively challenging task is voluntarily selected and does not entail the danger of losing reward.

Protracted maturation of forebrain afferent connections of the ventral tegmental area in the rat

The mesocorticolimbic dopamine system has long attracted the interest of researchers concerned with the unique gamut of behavioral and mental health vulnerabilities associated with adolescence. Accordingly, the development of the mesocorticolimbic system has been studied extensively, but almost exclusively with regard to dopaminergic output, particularly in the nucleus accumbens and medial prefrontal cortex. To the contrary, the ontogeny of inputs to the ventral tegmental area (VTA), the source of mesocorticolimbic dopamine, has been neglected. This is not a trivial oversight, as the activity of VTA neurons, which reflects their capacity to transmit information about salient events, is sensitively modulated by inputs. Here, we assessed the development of VTA afferent connections using the β subunit of cholera toxin (Ctβ) as a retrograde axonal tracer in adolescent (postnatal day 39) and early adult (8-9-week-old) rats. After intra-VTA injections of Ctβ, adolescent and early adult animals exhibited qualitatively similar distributions of retrogradely labeled neurons in the sense that VTA-projecting neurons were present at all of the same rostrocaudal levels in all of the same structures in both age groups. However, quantitation of retrogradely labeled neurons revealed that adolescent brains, compared with early adult brains, had significantly fewer VTA-projecting neurons preferentially within an interconnected network of cortical and striatopallidal forebrain structures. These findings provide a novel perspective on the development of the mesocorticolimbic dopamine system and may have important implications for age-dependent specificity in the function of this system, particularly with regard to adolescent impulsivity and mental health vulnerabilities.

Assessment of the abuse liability of a dual orexin receptor antagonist: a crossover study of almorexant and zolpidem in recreational drug users

BACKGROUND

Dual orexin receptor antagonists (DORAs) enable initiation and maintenance of sleep in patients with primary insomnia. Blockade of the orexin system has shown reduction of drug-seeking behavior in animal studies, supporting the role of orexin antagonism as a novel approach for treating substance abuse. Since hypnotics are traditionally associated with misuse, a lack of abuse liability of DORAs would offer significant benefits over current therapies for sleep disorders.

METHODS

In this randomized, crossover, proof-of-concept study, single oral doses of the DORA almorexant (200, 400, and 1,000 mg) were administered to healthy subjects with previous non-therapeutic experience with central nervous system depressants and were compared with placebo and single oral doses of zolpidem (20 and 40 mg), a benzodiazepine-like drug. Subjective measures of abuse potential (visual analog scales [VAS], Addiction Research Center Inventory, and Subjective Drug Value) and objective measures (divided attention [DA]) were evaluated over 24 h post-dose in 33 evaluable subjects.

RESULTS

Drug Liking VAS peak effect (E max; primary endpoint) was significantly higher for all doses of almorexant and zolpidem compared with placebo (p<0.001). Almorexant 200 mg showed significantly less 'Drug Liking' than both zolpidem doses (p<0.01), and almorexant 400 mg had smaller effects than zolpidem 20 mg (p<0.05), while almorexant 1,000 mg was not different from either zolpidem dose. Results were similar for other subjective measures, although almorexant generally showed smaller negative and perceptual effects compared with zolpidem. Almorexant also showed less cognitive impairment compared with zolpidem on most DA endpoints.

CONCLUSION

This study in humans investigating single doses of almorexant is the first to explore and show abuse liability of a DORA, a class of compounds that is not only promising for the treatment of sleep disorders, but also of addiction.

Nucleus accumbens neuronal maturation differences in young rats bred for low versus high voluntary running behaviour

We compared the nucleus accumbens (NAc) transcriptomes of generation 8 (G8), 34-day-old rats selectively bred for low (LVR) versus high voluntary running (HVR) behaviours in rats that never ran (LVR(non-run) and HVR(non-run)), as well as in rats after 6 days of voluntary wheel running (LVR(run) and HVR(run)). In addition, the NAc transcriptome of wild-type Wistar rats was compared. The purpose of this transcriptomics approach was to generate testable hypotheses as to possible NAc features that may be contributing to running motivation differences between lines. Ingenuity Pathway Analysis and Gene Ontology analyses suggested that 'cell cycle'-related transcripts and the running-induced plasticity of dopamine-related transcripts were lower in LVR versus HVR rats. From these data, a hypothesis was generated that LVR rats might have less NAc neuron maturation than HVR rats. Follow-up immunohistochemistry in G9-10 LVR(non-run) rats suggested that the LVR line inherently possessed fewer mature medium spiny (Darpp-32-positive) neurons (P < 0.001) and fewer immature (Dcx-positive) neurons (P < 0.001) than their G9-10 HVR counterparts. However, voluntary running wheel access in our G9-10 LVRs uniquely increased their Darpp-32-positive and Dcx-positive neuron densities. In summary, NAc cellularity differences and/or the lack of running-induced plasticity in dopamine signalling-related transcripts may contribute to low voluntary running motivation in LVR rats.

Overlapping neural systems represent cognitive effort and reward anticipation

Anticipating a potential benefit and how difficult it will be to obtain it are valuable skills in a constantly changing environment. In the human brain, the anticipation of reward is encoded by the Anterior Cingulate Cortex (ACC) and Striatum. Naturally, potential rewards have an incentive quality, resulting in a motivational effect improving performance. Recently it has been proposed that an upcoming task requiring effort induces a similar anticipation mechanism as reward, relying on the same cortico-limbic network. However, this overlapping anticipatory activity for reward and effort has only been investigated in a perceptual task. Whether this generalizes to high-level cognitive tasks remains to be investigated. To this end, an fMRI experiment was designed to investigate anticipation of reward and effort in cognitive tasks. A mental arithmetic task was implemented, manipulating effort (difficulty), reward, and delay in reward delivery to control for temporal confounds. The goal was to test for the motivational effect induced by the expectation of bigger reward and higher effort. The results showed that the activation elicited by an upcoming difficult task overlapped with higher reward prospect in the ACC and in the striatum, thus highlighting a pivotal role of this circuit in sustaining motivated behavior.

Imaging the pathophysiology of major depressive disorder - from localist models to circuit-based analysis

The neuroimaging literature of Major Depressive Disorder (MDD) has grown substantially over the last several decades, facilitating great advances in the identification of specific brain regions, neurotransmitter systems and networks associated with depressive illness. Despite this progress, fundamental questions remain about the pathophysiology and etiology of MDD. More importantly, this body of work has yet to directly influence clinical practice. It has long been a goal for the fields of clinical psychology and psychiatry to have a means of making objective diagnoses of mental disorders. Frustratingly little movement has been achieved on this front, however, and the 'gold-standard’ of diagnostic validity and reliability remains expert consensus. In light of this challenge, the focus of the current review is to provide a critical summary of key findings from different neuroimaging approaches in MDD research, including structural, functional and neurochemical imaging studies. Following this summary, we discuss some of the current conceptual obstacles to better understanding the pathophysiology of depression, and conclude with recommendations for future neuroimaging research.

Personality traits and vulnerability or resilience to substance use disorders

Clear evidence supports a genetic basis for substance use disorders (SUD). Yet, the search to identify individual gene contributions to SUD has been unsuccessful. Here, we argue for the study of endophenotypes within the frame of individual differences, and identify three high-order personality traits that are tied to specific brain systems and genes, and that offer a tractable approach to studying SUD. These personality traits, and the genes that moderate them, interact dynamically with the environment and with the drugs themselves to determine ultimately an individual's vulnerability or resilience to developing SUD.

Impact of appetitive and aversive outcomes on brain responses: linking the animal and human literatures

Decision-making is motivated by the possibility of obtaining reward and/or avoiding punishment. Though many have investigated behavior associated with appetitive or aversive outcomes, few have examined behaviors that rely on both. Fewer still have addressed questions related to how anticipated appetitive and aversive outcomes interact to alter neural signals related to expected value, motivation, and salience. Here we review recent rodent, monkey, and human research that address these issues. Further development of this area will be fundamental to understanding the etiology behind human psychiatric diseases and cultivating more effective treatments.

Ventral tegmental area/midbrain functional connectivity and response to antipsychotic medication in schizophrenia

Medication management in schizophrenia is a lengthy process, as the lack of clinical response can only be confirmed after at least 4 weeks of antipsychotic treatment at a therapeutic dose. Thus, there is a clear need for the discovery of biomarkers that have the potential to accelerate the management of treatment. Using resting-state functional MRI, we examined the functional connectivity of the ventral tegmental area (VTA), the origin of the mesocorticolimbic dopamine projections, in 21 healthy controls and 21 unmedicated patients with schizophrenia at baseline (pre-treatment) and after 1 week of treatment with the antipsychotic drug risperidone (1-week post-treatment). Group-level functional connectivity maps were obtained and group differences in connectivity were assessed on the groups' participant-level functional connectivity maps. We also examined the relationship between pre-treatment/1-week post-treatment functional connectivity and treatment response. Compared with controls, patients exhibited significantly reduced pre-treatment VTA/midbrain connectivity to multiple cortical and subcortical regions, including the dorsal anterior cingulate cortex (dACC) and thalamus. After 1 week of treatment, VTA/midbrain connectivity to bilateral regions of the thalamus was re-established. Pre-treatment VTA/midbrain connectivity strength to dACC was positively correlated with good response to a 6-week course of risperidone, whereas pre-treatment VTA/midbrain connectivity strength to the default mode network was negatively correlated. Our findings suggest that VTA/midbrain resting-state connectivity may be a useful biomarker for the prediction of treatment response.

A genetic polymorphism of the endogenous opioid dynorphin modulates monetary reward anticipation in the corticostriatal loop

The dynorphin/κ-opioid receptor (KOP-R) system has been shown to play a role in different types of behavior regulation, including reward-related behavior and drug craving. It has been shown that alleles with 3 or 4 repeats (HH genotype) of the variable nucleotide tandem repeat (68-bp VNTR) functional polymorphism of the prodynorphin (PDYN) gene are associated with higher levels of dynorphin peptides than alleles with 1 or 2 repeats (LL genotype). We used fMRI on N = 71 prescreened healthy participants to investigate the effect of this polymorphism on cerebral activation in the limbic-corticostriatal loop during reward anticipation. Individuals with the HH genotype showed higher activation than those with the LL genotype in the medial orbitofrontal cortex (mOFC) when anticipating a possible monetary reward. In addition, the HH genotype showed stronger functional coupling (as assessed by effective connectivity analyses) of mOFC with VMPFC, subgenual anterior cingulate cortex, and ventral striatum during reward anticipation. This hints at a larger sensitivity for upcoming rewards in individuals with the HH genotype, resulting in a higher motivation to attain these rewards. These findings provide first evidence in humans that the PDYN polymorphism modulates neural processes associated with the anticipation of rewards, which ultimately may help to explain differences between genotypes with respect to addiction and drug abuse.

Coming to terms with fear

The brain mechanisms of fear have been studied extensively using Pavlovian fear conditioning, a procedure that allows exploration of how the brain learns about and later detects and responds to threats. However, mechanisms that detect and respond to threats are not the same as those that give rise to conscious fear. This is an important distinction because symptoms based on conscious and nonconscious processes may be vulnerable to different predisposing factors and may also be treatable with different approaches in people who suffer from uncontrolled fear or anxiety. A conception of so-called fear conditioning in terms of circuits that operate nonconsciously, but that indirectly contribute to conscious fear, is proposed as way forward.

Action versus valence in decision making

•

Pavlovian responses couple action and valence.

•

This coupling interferes with instrumental learning and performance.

•

Action dominates valence in the striatum and dopaminergic midbrain.

•

Boosting dopamine enhances the dominance of action over valence in the striatum.

•

Boosting dopamine decreases the extent of the behavioral coupling between action and valence.

The selection of actions, and the vigor with which they are executed, are influenced by the affective valence of predicted outcomes. This interaction between action and valence significantly influences appropriate and inappropriate choices and is implicated in the expression of psychiatric and neurological abnormalities, including impulsivity and addiction. We review a series of recent human behavioral, neuroimaging, and pharmacological studies whose key design feature is an orthogonal manipulation of action and valence. These studies find that the interaction between the two is subject to the critical influence of dopamine. They also challenge existing views that neural representations in the striatum focus on valence, showing instead a dominance of the anticipation of action.

Better get back to work: a role for motor beta desynchronization in incentive motivation

Much research has been devoted to characterizing brain representations of reward and movement. However, the mechanisms allowing expected rewards to influence motor commands remain poorly understood. Unraveling such mechanisms is crucial to providing explanations of how behavior can be driven by goals, hence accounting for apathy cases in clinics. Here, we propose that the reduction of motor beta synchrony (MBS) before movement onset could participate in this incentive motivation process. To test this hypothesis, we recorded brain activity using magnetoencenphalography (MEG) while human participants were exerting physical effort to win monetary incentives. Knowing that the payoff was proportional to the time spent above a target force, subjects spontaneously took breaks when exhausted and resumed effort production when repleted. Behavioral data indicated that the rest periods were shorter when higher incentives were at stake. MEG data showed that the amplitude of MBS reduction correlated to both incentive level and rest duration. Moreover, the time of effort initiation could be predicted by MBS reduction measured at the beginning of rest periods. Incentive effects on MBS reduction and rest duration were also correlated across subjects. Finally, Bayesian comparison between possible causal models suggested that MBS reduction mediates the impact of incentive level on rest duration. We conclude that MBS reduction could represent a neural mechanism that speeds the initiation of effort production when the effort is more rewarded.