Convergent processing of both positive and negative motivational signals by the VTA dopamine neuronal populations

Brain region specific regulation of anandamide (down) and sphingosine-1-phosphate (up) in association with anxiety (AEA) and resilience (S1P) in a mouse model of chronic unpredictable mild stress

Chronic unpredictable and unavoidable stress is associated with mental health problems such as depression and anxiety, whereas cycles of stress and stress relief strengthen resilience. It has been suggested that increased breakdown of brain endocannabinoids (eCB) promotes a feeling of adversity. To assess the impact of stress on bioactive lipid homeostasis, we analyzed eCB, sphingolipids, and ceramides in seven brain regions and plasma in a mouse model of chronic unpredictable mild stress. Chronic unpredictable mild stress (CUMS) was associated with low levels of anandamide in hippocampus and prefrontal cortex in association with indicators of anxiety (elevated plus maze). Oppositely, CUMS caused elevated levels of sphingosine-1-phosphate (S1P d18:1) and sphinganine-1-phosphate (S1P d18:0) in the midbrain and thalamus, which was associated with readouts of increased stress resilience, i.e., marble burying and struggling in the tail suspension tests. In the periphery, elevated plasma levels of ceramides revealed similarities with human major depression and suggested unfavorable effects of stress on metabolism, but plasma lipids were not associated with body weight, sucrose consumption, or behavioral features of depression or anxiety. The observed brain site-specific lipid changes suggest that the forebrain succumbs to adverse stress effects while the midbrain takes up defensive adjustments.

Muscarinic receptor activation preferentially inhibits rebound in vulnerable dopaminergic neurons

Dopaminergic subpopulations of the substantia nigra pars compacta (SNc) differentially degenerate in Parkinson's disease and are characterized by unique electrophysiological properties. The vulnerable population expresses a T-type calcium channel-mediated afterdepolarization (ADP) and shows rebound activity upon release from inhibition, whereas the resilient population does not have an ADP and is slower to fire after hyperpolarization. This rebound activity can trigger dopamine release in the striatum, an important component of basal ganglia function. Using whole-cell patch clamp electrophysiology on ex vivo slices from adult mice of both sexes, we find that muscarinic activation with the non-selective muscarinic agonist Oxotremorine inhibits rebound activity more strongly in vulnerable vs resilient SNc neurons. Here, we show that this effect depends on the direct activation of muscarinic receptors on the SNc dopaminergic neurons. Through a series of pharmacological and transgenic knock-out experiments, we tested whether the muscarinic inhibition of rebound was mediated through the canonical rebound-related ion channels: T-type calcium channels, hyperpolarization-activated cation channels (HCN), and A-type potassium channels. We find that muscarinic receptor activation inhibits HCN-mediated current (Ih) in vulnerable SNc neurons, but that Ih activity is not necessary for the muscarinic inhibition of rebound activity. Similarly, we find that Oxotremorine inhibits rebound activity independently of T-type calcium channels and A-type potassium channels. Together these findings reveal new principles governing acetylcholine and dopamine interactions, showing that muscarinic receptors directly affect SNc rebound activity in the midbrain at the somatodendritic level and differentially modify information processing in distinct SNc subpopulations.

Ventral pallidum GABA and glutamate neurons drive approach and avoidance through distinct modulation of VTA cell types

The ventral pallidum (VP) contains GABA and glutamate neurons projecting to ventral tegmental area (VTA) whose stimulation drives approach and avoidance, respectively. Yet little is known about the mechanisms by which VP cell types shape VTA activity and drive behavior. Here, we found that both VP GABA and glutamate neurons were activated during approach to reward or by delivery of an aversive stimulus. Stimulation of VP GABA neurons inhibited VTA GABA, but activated dopamine and glutamate neurons. Remarkably, stimulation-evoked activation was behavior-contingent such that VTA recruitment was inhibited when evoked by the subject's own action. Conversely, VP glutamate neurons activated VTA GABA, as well as dopamine and glutamate neurons, despite driving aversion. However, VP glutamate neurons evoked dopamine in aversion-associated ventromedial nucleus accumbens (NAc), but reduced dopamine release in reward-associated dorsomedial NAc. These findings show how heterogeneous VP projections to VTA can be engaged to shape approach and avoidance behaviors.

Behavioural and dopaminergic signatures of resilience

Chronic stress can have lasting adverse consequences in some individuals, yet others are resilient to the same stressor1,2. Susceptible and resilient individuals exhibit differences in the intrinsic properties of mesolimbic dopamine (DA) neurons after the stressful experience is over3-8. However, the causal links between DA, behaviour during stress and individual differences in resilience are unknown. Here we recorded behaviour in mice simultaneously with DA neuron activity in projections to the nucleus accumbens (NAc) (which signals reward9-12) and the tail striatum (TS) (which signals threat13-16) during social defeat. Supervised and unsupervised behavioural quantification revealed that during stress, resilient and susceptible mice use different behavioural strategies and have distinct activity patterns in DA terminals in the NAc (but not the TS). Neurally, resilient mice have greater activity near the aggressor, including at the onset of fighting back. Conversely, susceptible mice have greater activity at the offset of attacks and onset of fleeing. We also performed optogenetic stimulation of NAc-projecting DA neurons in open loop (randomly timed) during defeat or timed to specific behaviours using real-time behavioural classification. Both open-loop and fighting-back-timed activation promoted resilience and reorganized behaviour during defeat towards resilience-associated patterns. Together, these data provide a link between DA neural activity, resilience and resilience-associated behaviour during the experience of stress.

Midbrain dopaminergic innervation of the hippocampus is sufficient to modulate formation of aversive memories

Aversive memories are important for survival, and dopaminergic signaling in the hippocampus has been implicated in aversive learning. However, the source and mode of action of hippocampal dopamine remain controversial. Here, we utilize anterograde and retrograde viral tracing methods to label midbrain dopaminergic projections to the dorsal hippocampus. We identify a population of midbrain dopaminergic neurons near the border of the substantia nigra pars compacta and the lateral ventral tegmental area that sends direct projections to the dorsal hippocampus. Using optogenetic manipulations and mutant mice to control dopamine transmission in the hippocampus, we show that midbrain dopamine potently modulates aversive memory formation during encoding of contextual fear. Moreover, we demonstrate that dopaminergic transmission in the dorsal CA1 is required for the acquisition of contextual fear memories, and that this acquisition is sustained in the absence of catecholamine release from noradrenergic terminals. Our findings identify a cluster of midbrain dopamine neurons that innervate the hippocampus and show that the midbrain dopamine neuromodulation in the dorsal hippocampus is sufficient to maintain aversive memory formation.

The Role of Dopamine in Associative Learning in Drosophila: An Updated Unified Model

Learning to associate a positive or negative experience with an unrelated cue after the presentation of a reward or a punishment defines associative learning. The ability to form associative memories has been reported in animal species as complex as humans and as simple as insects and sea slugs. Associative memory has even been reported in tardigrades [1], species that diverged from other animal phyla 500 million years ago. Understanding the mechanisms of memory formation is a fundamental goal of neuroscience research. In this article, we work on resolving the current contradictions between different Drosophila associative memory circuit models and propose an updated version of the circuit model that predicts known memory behaviors that current models do not. Finally, we propose a model for how dopamine may function as a reward prediction error signal in Drosophila, a dopamine function that is well-established in mammals but not in insects [2, 3].

Functional Dissection of Basal Ganglia Inhibitory Inputs onto Substantia Nigra Dopaminergic Neurons

Substantia nigra (SNc) dopaminergic neurons respond to aversive stimuli with inhibitory pauses in firing followed by transient rebound activation. We tested integration of inhibitory synaptic inputs onto SNc neurons from genetically defined populations in dorsal striatum (striosome and matrix) and external globus pallidus (GPe; parvalbumin- and Lhx6-positive), and examined their contribution to pause-rebound firing. Activation of striosome projections, which target "dendron bouquets" in the pars reticulata (SNr), consistently quiets firing and relief from striosome inhibition triggers rebound activity. Striosomal inhibitory postsynaptic currents (IPSCs) display a prominent GABA-B receptor-mediated component that strengthens the impact of SNr dendrite synapses on somatic excitability and enables rebounding. By contrast, GPe projections activate GABA-A receptors on the soma and proximal dendrites but do not result in rebounding. Lastly, optical mapping shows that dorsal striatum selectively inhibits the ventral population of SNc neurons, which are intrinsically capable of rebounding. Therefore, we define a distinct striatonigral circuit for generating dopamine rebound.

Distinct signals in medial and lateral VTA dopamine neurons modulate fear extinction at different times

Dopamine (DA) neurons are thought to encode reward prediction error (RPE), in addition to other signals, such as salience. While RPE is known to support learning, the role of salience in learning remains less clear. To address this, we recorded and manipulated VTA DA neurons in mice during fear extinction. We applied deep learning to classify mouse freezing behavior, eliminating the need for human scoring. Our fiber photometry recordings showed DA neurons in medial and lateral VTA have distinct activity profiles during fear extinction: medial VTA activity more closely reflected RPE, while lateral VTA activity more closely reflected a salience-like signal. Optogenetic inhibition of DA neurons in either region slowed fear extinction, with the relevant time period for inhibition differing across regions. Our results indicate salience-like signals can have similar downstream consequences to RPE-like signals, although with different temporal dependencies.

Real-Time Accumbal Dopamine Response to Negative Stimuli: Effects of Ethanol

Activity in the mesolimbic dopamine (DA) pathway is known to have a role in reward processing and related behaviors. The mesolimbic DA response to reward has been well-examined, while the response to aversive or negative stimuli has been studied to a lesser extent and produced inconclusive results. However, a brief increase in the DA concentration in terminals during nociceptive activation has become an established but not well-characterized phenomenon. Consequently, the interpretation of the significance of this neurochemical response is still elusive. The present study was designed to further explore these increases in subsecond DA dynamics triggered by negative stimuli using voltammetry in anesthetized rats. Our experiments revealed that repeated exposure to a tail pinch resulted in more efficacious DA release in rat nucleus accumbens. This fact may suggest a protective nature of immediate DA efflux. Furthermore, a sensitized DA response to a neutral stimulus, such as a touch, was discovered following several noxious pinches, while a touch applied before these pinches did not trigger DA release. Finally, it was found that the pinch-evoked DA efflux was significantly decreased by ethanol acutely administrated at an analgesic dose. Taken together, these results support the hypothesis that subsecond DA release in the nucleus accumbens may serve as an endogenous antinociceptive signal.

Financial gain- and loss-related BOLD signals in the human ventral tegmental area and substantia nigra pars compacta

Neurons in the ventral tegmental area (VTA) and substantia nigra pars compacta (SNC) play central roles in reward-related behaviours. Nonhuman animal studies suggest that these neurons also process aversive events. However, our understanding of how the human VTA and SNC responds to such events is limited and has been hindered by the technical challenge of using functional magnetic resonance imaging (fMRI) to investigate a small structure where the signal is particularly vulnerable to physiological noise. Here we show, using methods optimized specifically for the midbrain (including high-resolution imaging, a novel registration protocol, and physiological noise modelling), a BOLD (blood-oxygen-level dependent) signal to both financial gain and loss in the VTA and SNC, along with a response to nil outcomes that are better or worse than expected in the VTA. Taken together, these findings suggest that the human VTA and SNC are involved in the processing of both appetitive and aversive financial outcomes in humans.

Dopamine Neurons Reflect the Uncertainty in Fear Generalization

Generalized fear is a maladaptive behavior in which non-threatening stimuli elicit a fearful response. Here, we demonstrate that discrimination between predictive and non-predictive threat stimuli is highly sensitive to probabilistic discounting and increasing threat intensity in mice. We find that dopamine neurons of the ventral tegmental area (VTA) encode both the negative valence of threat-predictive cues and the certainty of threat prediction. As fear generalization emerges, the dopamine neurons that are activated by a threat predictive cue (CS+) decrease the amplitude of activation and an equivalent signal emerges to a non-predictive cue (CS-). Temporally precise enhancement of dopamine neurons during threat conditioning to high threat levels or uncertain threats can prevent generalization. Moreover, phasic enhancement of genetically captured dopamine neurons activated by threat cues can reverse fear generalization. These findings demonstrate the dopamine neurons reflect the certainty of threat prediction that can be used to inform and update the fear engram.

Pharmacological Dopamine Manipulation Does Not Alter Reward-Based Improvements in Memory Retention during a Visuomotor Adaptation Task

Motor adaptation tasks investigate our ability to adjust motor behaviors to an ever-changing and unpredictable world. Previous work has shown that punishment-based feedback delivered during a visuomotor adaptation task enhances error-reduction, whereas reward increases memory retention. While the neural underpinnings of the influence of punishment on the adaptation phase remain unclear, reward has been hypothesized to increase retention through dopaminergic mechanisms. We directly tested this hypothesis through pharmacological manipulation of the dopaminergic system. A total of 96 young healthy human participants were tested in a placebo-controlled double-blind between-subjects design in which they adapted to a 40° visuomotor rotation under reward or punishment conditions. We confirmed previous evidence that reward enhances retention, but the dopamine (DA) precursor levodopa (LD) or the DA antagonist haloperidol failed to influence performance. We reason that such a negative result could be due to experimental limitations or it may suggest that the effect of reward on motor memory retention is not driven by dopaminergic processes. This provides further insight regarding the role of motivational feedback in optimizing motor learning, and the basis for further decomposing the effect of reward on the subprocesses known to underlie motor adaptation paradigms.

Reinforcement signaling of punishment versus relief in fruit flies

Painful events establish opponent memories: cues that precede pain are remembered negatively, whereas cues that follow pain, thus coinciding with relief are recalled positively. How do individual reinforcement-signaling neurons contribute to this “timing-dependent valence-reversal?” We addressed this question using an optogenetic approach in the fruit fly. Two types of fly dopaminergic neuron, each comprising just one paired cell, indeed established learned avoidance of odors that preceded their photostimulation during training, and learned approach to odors that followed the photostimulation. This is in striking parallel to punishment versus relief memories reinforced by a real noxious event. For only one of these neuron types, both effects were strong enough for further analyses. Notably, interfering with dopamine biosynthesis in these neurons partially impaired the punishing effect, but not the relieving after-effect of their photostimulation. We discuss how this finding constraints existing computational models of punishment versus relief memories and introduce a new model, which also incorporates findings from mammals. Furthermore, whether using dopaminergic neuron photostimulation or a real noxious event, more prolonged punishment led to stronger relief. This parametric feature of relief may also apply to other animals and may explain particular aspects of related behavioral dysfunction in humans.

Pleasure: The missing link in the regulation of sleep

Although largely unrecognized by sleep scholars, sleeping is a pleasure. This report aims first, to fill the gap: sleep, like food, water and sex, is a primary reinforcer. The levels of extracellular mesolimbic dopamine show circadian oscillations and mark the "wanting" for pro-homeostatic stimuli. Further, the dopamine levels decrease during waking and are replenished during sleep, in opposition to sleep propensity. The wanting of sleep, therefore, may explain the homeostatic and circadian regulation of sleep. Accordingly, sleep onset occurs when the displeasure of excessive waking is maximal, coinciding with the minimal levels of mesolimbic dopamine. Reciprocally, sleep ends after having replenished the limbic dopamine levels. Given the direct relation between waking and mesolimbic dopamine, sleep must serve primarily to gain an efficient waking. Pleasant sleep (i.e. emotional sleep), can only exist in animals capable of feeling emotions. Therefore, although sleep-like states have been described in invertebrates and primitive vertebrates, the association sleep-pleasure clearly marks a difference between the sleep of homeothermic vertebrates and cool blooded animals.

Disrupting Glutamate Co-transmission Does Not Affect Acquisition of Conditioned Behavior Reinforced by Dopamine Neuron Activation

Dopamine neurons in the ventral tegmental area (VTA) were previously found to express vesicular glutamate transporter 2 (VGLUT2) and to co-transmit glutamate in the ventral striatum (VStr). This capacity may play an important role in reinforcement learning. Although it is known that activation of the VTA-VStr dopamine system readily reinforces behavior, little is known about the role of glutamate co-transmission in such reinforcement. By combining electrode recording and optogenetics, we found that stimulation of VTA dopamine neurons in vivo evoked fast excitatory responses in many VStr neurons of adult mice. Whereas conditional knockout of the gene encoding VGLUT2 in dopamine neurons largely eliminated fast excitatory responses, it had little effect on the acquisition of conditioned responses reinforced by dopamine neuron activation. Therefore, glutamate co-transmission appears dispensable for acquisition of conditioned responding reinforced by DA neuron activation.

Enhanced Sensitivity to Hyperpolarizing Inhibition in Mesoaccumbal Relative to Nigrostriatal Dopamine Neuron Subpopulations

Midbrain dopamine neurons recorded in vivo pause their firing in response to reward omission and aversive stimuli. While the initiation of pauses typically involves synaptic or modulatory input, intrinsic membrane properties may also enhance or limit hyperpolarization, raising the question of how intrinsic conductances shape pauses in dopamine neurons. Using retrograde labeling and electrophysiological techniques combined with computational modeling, we examined the intrinsic conductances that shape pauses evoked by current injections and synaptic stimulation in subpopulations of dopamine neurons grouped according to their axonal projections to the nucleus accumbens or dorsal striatum in mice. Testing across a range of conditions and pulse durations, we found that mesoaccumbal and nigrostriatal neurons differ substantially in rebound properties with mesoaccumbal neurons displaying significantly longer delays to spiking following hyperpolarization. The underlying mechanism involves an inactivating potassium (I_A) current with decay time constants of up to 225 ms, and small-amplitude hyperpolarization-activated currents (I_H), characteristics that were most often observed in mesoaccumbal neurons. Pharmacological block of I_A completely abolished rebound delays and, importantly, shortened synaptically evoked inhibitory pauses, thereby demonstrating the involvement of A-type potassium channels in prolonging pauses evoked by GABAergic inhibition. Therefore, these results show that mesoaccumbal and nigrostriatal neurons display differential responses to hyperpolarizing inhibitory stimuli that favors a higher sensitivity to inhibition in mesoaccumbal neurons. These findings may explain, in part, observations from in vivo experiments that ventral tegmental area neurons tend to exhibit longer aversive pauses relative to SNc neurons.SIGNIFICANCE STATEMENT Our study examines rebound, postburst, and synaptically evoked inhibitory pauses in subpopulations of midbrain dopamine neurons. We show that pauses in dopamine neuron firing, evoked by either stimulation of GABAergic inputs or hyperpolarizing current injections, are enhanced by a subclass of potassium conductances that are recruited at voltages below spike threshold. Importantly, A-type potassium currents recorded in mesoaccumbal neurons displayed substantially slower inactivation kinetics, which, combined with weaker expression of hyperpolarization-activated currents, lengthened hyperpolarization-induced delays in spiking relative to nigrostriatal neurons. These results suggest that input integration differs among dopamine neurons favoring higher sensitivity to inhibition in mesoaccumbal neurons and may partially explain in vivo observations that ventral tegmental area neurons exhibit longer aversive pauses relative to SNc neurons.

An Exploratory Randomized Controlled Trial of Personalized Lifestyle Advice and Tandem Skydives as a Means to Reduce Anhedonia

Anhedonia is a major public health concern and has proven particularly difficult to counteract. It has been hypothesized that anhedonia can be deterred by engagement in rewarding social and physical events. The aims of the present study were to examine (1) the effects of personalized lifestyle advice based on observed individual patterns of lifestyle factors and experienced pleasure in anhedonic young adults; and (2) whether a tandem skydive can enhance the motivation to carry out the recommended lifestyle changes. Participants (N = 69; M_age = 21.5, SD = 2.0; 79.7% female) were selected through an online screening survey among young adults. Inclusion criteria were persistent anhedonia and willingness to perform a tandem skydive. Participants filled out questionnaires on their smartphones for 2 consecutive months (3 times per day). After the first month, they were randomly assigned to one of three groups: (1) no intervention, (2) lifestyle advice, and (3) lifestyle advice and tandem skydive. The momentary questionnaire data were analyzed using interrupted time series analyses (ITSA) in a multilevel model and monthly pleasure and depression questionnaires by repeated measures ANOVA. No group differences were found in monthly depression and pleasure scores, but the momentary data showed higher positive affect (PA) and pleasure ratings in the month following the intervention in the two intervention groups than in the control group. The tandem skydive did not have any effects above the effects of the lifestyle advice. Our results indicate that providing personalized lifestyle advice to anhedonic young adults can be an effective way to increase PA and pleasure.

Amygdala Circuits for Fear Memory: A Key Role for Dopamine Regulation

In addition to modulating a number of cognitive functions including reward, punishment, motivation, and salience, dopamine (DA) plays a pivotal role in regulating threat-related emotional memory. Changes in neural circuits of the amygdala nuclei are also critically involved in the acquisition and expression of emotional memory. In this review, we summarize the regulation of amygdala circuits by DA. Specifically, we describe DA signaling in the amygdala, and DA regulation of synaptic transmission and synaptic plasticity of the amygdala neurons. Finally, we discuss a potential contribution of DA-related mechanisms to the pathogenesis of posttraumatic stress disorder.

Brain Computation Is Organized via Power-of-Two-Based Permutation Logic

There is considerable scientific interest in understanding how cell assemblies—the long-presumed computational motif—are organized so that the brain can generate intelligent cognition and flexible behavior. The Theory of Connectivity proposes that the origin of intelligence is rooted in a power-of-two-based permutation logic (N = 2ⁱ–1), producing specific-to-general cell-assembly architecture capable of generating specific perceptions and memories, as well as generalized knowledge and flexible actions. We show that this power-of-two-based permutation logic is widely used in cortical and subcortical circuits across animal species and is conserved for the processing of a variety of cognitive modalities including appetitive, emotional and social information. However, modulatory neurons, such as dopaminergic (DA) neurons, use a simpler logic despite their distinct subtypes. Interestingly, this specific-to-general permutation logic remained largely intact although NMDA receptors—the synaptic switch for learning and memory—were deleted throughout adulthood, suggesting that the logic is developmentally pre-configured. Moreover, this computational logic is implemented in the cortex via combining a random-connectivity strategy in superficial layers 2/3 with nonrandom organizations in deep layers 5/6. This randomness of layers 2/3 cliques—which preferentially encode specific and low-combinatorial features and project inter-cortically—is ideal for maximizing cross-modality novel pattern-extraction, pattern-discrimination and pattern-categorization using sparse code, consequently explaining why it requires hippocampal offline-consolidation. In contrast, the nonrandomness in layers 5/6—which consists of few specific cliques but a higher portion of more general cliques projecting mostly to subcortical systems—is ideal for feedback-control of motivation, emotion, consciousness and behaviors. These observations suggest that the brain’s basic computational algorithm is indeed organized by the power-of-two-based permutation logic. This simple mathematical logic can account for brain computation across the entire evolutionary spectrum, ranging from the simplest neural networks to the most complex.

GABA levels in the ventromedial prefrontal cortex during the viewing of appetitive and disgusting food images

Characterizing how the brain appraises the psychological dimensions of reward is one of the central topics of neuroscience. It has become clear that dopamine neurons are implicated in the transmission of both rewarding information and aversive and alerting events through two different neuronal populations involved in encoding the motivational value and the motivational salience of stimuli, respectively. Nonetheless, there is less agreement on the role of the ventromedial prefrontal cortex (vmPFC) and the related neurotransmitter release during the processing of biologically relevant stimuli. To address this issue, we employed magnetic resonance spectroscopy (MRS), a non-invasive methodology that allows detection of some metabolites in the human brain in vivo, in order to assess the role of the vmPFC in encoding stimulus value rather than stimulus salience. Specifically, we measured gamma-aminobutyric acid (GABA) and, with control purposes, Glx levels in healthy subjects during the observation of appetitive and disgusting food images. We observed a decrease of GABA and no changes in Glx concentration in the vmPFC in both conditions. Furthermore, a comparatively smaller GABA reduction during the observation of appetitive food images than during the observation of disgusting food images was positively correlated with the scores obtained to the body image concerns sub-scale of Body Uneasiness Test (BUT). These results are consistent with the idea that the vmPFC plays a crucial role in processing both rewarding and aversive stimuli, possibly by encoding stimulus salience through glutamatergic and/or noradrenergic projections to deeper mesencephalic and limbic areas.

Functional evidence for a direct excitatory projection from the lateral habenula to the ventral tegmental area in the rat

The lateral habenula, a phylogenetically conserved epithalamic structure, is activated by aversive stimuli and reward omission. Excitatory efferents from the lateral habenula predominately inhibit midbrain dopamine neuronal firing through a disynaptic, feedforward inhibitory mechanism involving the rostromedial tegmental nucleus. However, the lateral habenula also directly targets dopamine neurons within the ventral tegmental area, suggesting that opposing actions may result from increased lateral habenula activity. In the present study, we tested the effect of habenular efferent stimulation on dopamine and nondopamine neurons in the ventral tegmental area of Sprague-Dawley rats using a parasagittal brain slice preparation. Single pulse stimulation of the fasciculus retroflexus excited 48% of dopamine neurons and 51% of nondopamine neurons in the ventral tegmental area of rat pups. These proportions were not altered by excision of the rostromedial tegmental nucleus and were evident in both cortical- and striatal-projecting dopamine neurons. Glutamate receptor antagonists blocked this excitation, and fasciculus retroflexus stimulation elicited evoked excitatory postsynaptic potentials with a nearly constant onset latency, indicative of a monosynaptic, glutamatergic connection. Comparison of responses in rat pups and young adults showed no significant difference in the proportion of neurons excited by fasciculus retroflexus stimulation. Our data indicate that the well-known, indirect inhibitory effect of lateral habenula activation on midbrain dopamine neurons is complemented by a significant, direct excitatory effect. This pathway may contribute to the role of midbrain dopamine neurons in processing aversive stimuli and salience.

Viral vector-based tools advance knowledge of basal ganglia anatomy and physiology

Viral vectors were originally developed to deliver genes into host cells for therapeutic potential. However, viral vector use in neuroscience research has increased because they enhance interpretation of the anatomy and physiology of brain circuits compared with conventional tract tracing or electrical stimulation techniques. Viral vectors enable neuronal or glial subpopulations to be labeled or stimulated, which can be spatially restricted to a single target nucleus or pathway. Here we review the use of viral vectors to examine the structure and function of motor and limbic basal ganglia (BG) networks in normal and pathological states. We outline the use of viral vectors, particularly lentivirus and adeno-associated virus, in circuit tracing, optogenetic stimulation, and designer drug stimulation experiments. Key studies that have used viral vectors to trace and image pathways and connectivity at gross or ultrastructural levels are reviewed. We explain how optogenetic stimulation and designer drugs used to modulate a distinct pathway and neuronal subpopulation have enhanced our mechanistic understanding of BG function in health and pathophysiology in disease. Finally, we outline how viral vector technology may be applied to neurological and psychiatric conditions to offer new treatments with enhanced outcomes for patients.

Principles of Intelligence: On Evolutionary Logic of the Brain

Humans and animals may encounter numerous events, objects, scenes, foods and countless social interactions in a lifetime. This means that the brain is constructed by evolution to deal with uncertainties and various possibilities. What is the architectural abstraction of intelligence that enables the brain to discover various possible patterns and knowledge about complex, evolving worlds? Here, I discuss the Theory of Connectivity–a “power-of-two” based, operational principle that can serve as a unified wiring and computational logic for organizing and constructing cell assemblies into the microcircuit-level building block, termed as functional connectivity motif (FCM). Defined by the power-of-two based equation, N = 2ⁱ−1, each FCM consists of the principal projection neuron cliques (N), ranging from those specific cliques receiving specific information inputs (i) to those general and sub-general cliques receiving various combinatorial convergent inputs. As the evolutionarily conserved logic, its validation requires experimental demonstrations of the following three major properties: (1) Anatomical prevalence—FCMs are prevalent across neural circuits, regardless of gross anatomical shapes; (2) Species conservancy—FCMs are conserved across different animal species; and (3) Cognitive universality—FCMs serve as a universal computational logic at the cell assembly level for processing a variety of cognitive experiences and flexible behaviors. More importantly, this Theory of Connectivity further predicts that the specific-to-general combinatorial connectivity pattern within FCMs should be preconfigured by evolution, and emerge innately from development as the brain’s computational primitives. This proposed design-principle can also explain the general purpose of the layered cortex and serves as its core computational algorithm.

Dopamine Rebound-Excitation Theory: Putting Brakes on PTSD

It is not uncommon for humans or animals to experience traumatic events in their lifetimes. However, the majority of individuals are resilient to long-term detrimental changes turning into anxiety and depression, such as post-traumatic stress disorder (PTSD). What underlying neural mechanism accounts for individual variability in stress resilience? Hyperactivity in fear circuits, such as the amygdalar system, is well-known to be the major pathophysiological basis for PTSD, much like a "stuck accelerator." Interestingly, increasing evidence demonstrates that dopamine (DA) - traditionally known for its role in motivation, reward prediction, and addiction - is also crucial in regulating fear learning and anxiety. Yet, how dopaminergic (DAergic) neurons control stress resilience is unclear, especially given that DAergic neurons have multiple subtypes with distinct temporal dynamics. Here, we propose the Rebound-Excitation Theory, which posits that DAergic neurons' rebound-excitation at the termination of fearful experiences serves as an important "brake" by providing intrinsic safety-signals to fear-processing neural circuits in a spatially and temporally controlled manner. We discuss how DAergic neuron rebound-excitation may be regulated by genetics and experiences, and how such physiological properties may be used as a brain-activity biomarker to predict and confer individual resilience to stress and anxiety.

Effects of social defeat on dopamine neurons in the ventral tegmental area in male and female California mice

Dopamine neurons in the ventral tegmental area (VTA) have important functions related to rewards but are also activated in aversive contexts. Electrophysiology studies suggest that the degree to which VTA dopamine neurons respond to noxious stimuli is topographically organized across the dorsal-ventral extent. We used c-fos immunohistochemistry to examine the responses of VTA dopamine neurons in contexts of social defeat and social approach. Studying monogamous California mice (Peromyscus californicus) allowed us to observe the effects of social defeat on both males and females. Females exposed to three episodes of defeat, but not a single episode, had more tyrosine hydroxylase (TH)/c-fos-positive cells in the ventral (but not dorsal) VTA compared with controls. This observation suggests that repeated exposure to aversive contexts is necessary to trigger activation of VTA dopamine neurons. Defeat did not affect TH/c-fos colocalizations in males. We also examined the long-term effects of defeat on c-fos expression in a social interaction test. As previously reported, defeat reduced social interaction in females but not males. Surprisingly, there were no effects of defeat stress on TH/c-fos colocalizations in any subregion of the VTA. However, females had more TH/c-fos-positive cells than males across the entire VTA, and also had greater c-fos-positive cell counts in posterior subregions of the nucleus accumbens shell. Our results show that dopamine neurons in the VTA are more responsive to social contexts in females and that the ventral VTA in particular is sensitive to aversive contexts.

Norepinephrine and dopamine transmission in 2 limbic regions differentially respond to acute noxious stimulation

Central dopamine and norepinephrine regulate behavioral and physiological responses during rewarding and aversive stimuli. Here, we investigated and compared norepinephrine and dopamine transmission in 2 limbic structures, the ventral bed nucleus of the stria terminalis and the nucleus accumbens shell of anesthetized rats, respectively, in response to acute tail pinch, a noxious stimulus. Norepinephrine release in the ventral bed nucleus of the stria terminalis responded monophasically, increasing at the time of the tail pinch and remaining elevated for a period after its cessation. In contrast, dopamine transmission in the nucleus accumbens shell displayed a heterogeneous and time-locked response to tail pinch. For most trials, there was a suppression of extracellular dopamine concentration throughout the duration of the stimuli. At the termination of the stimuli, however, extracellular dopamine either recovered back to or spiked above the initial baseline concentration. These signaling patterns were more clearly observed after administration of selective catecholamine autoreceptor and transporter inhibitors. The results suggest that the opposing responses of these catecholamines can provide integration of noxious inputs to influence behavioral outputs appropriate for survival such as escape or fighting.

Computational Classification Approach to Profile Neuron Subtypes from Brain Activity Mapping Data

The analysis of cell type-specific activity patterns during behaviors is important for better understanding of how neural circuits generate cognition, but has not been well explored from in vivo neurophysiological datasets. Here, we describe a computational approach to uncover distinct cell subpopulations from in vivo neural spike datasets. This method, termed “inter-spike-interval classification-analysis” (ISICA), is comprised of four major steps: spike pattern feature-extraction, pre-clustering analysis, clustering classification, and unbiased classification-dimensionality selection. By using two key features of spike dynamic - namely, gamma distribution shape factors and a coefficient of variation of inter-spike interval - we show that this ISICA method provides invariant classification for dopaminergic neurons or CA1 pyramidal cell subtypes regardless of the brain states from which spike data were collected. Moreover, we show that these ISICA-classified neuron subtypes underlie distinct physiological functions. We demonstrate that the uncovered dopaminergic neuron subtypes encoded distinct aspects of fearful experiences such as valence or value, whereas distinct hippocampal CA1 pyramidal cells responded differentially to ketamine-induced anesthesia. This ISICA method should be useful to better data mining of large-scale in vivo neural datasets, leading to novel insights into circuit dynamics associated with cognitions.

Beyond reward prediction errors: the role of dopamine in movement kinematics

We recorded activity of dopamine (DA) neurons in the substantia nigra pars compacta in unrestrained mice while monitoring their movements with video tracking. Our approach allows an unbiased examination of the continuous relationship between single unit activity and behavior. Although DA neurons show characteristic burst firing following cue or reward presentation, as previously reported, their activity can be explained by the representation of actual movement kinematics. Unlike neighboring pars reticulata GABAergic output neurons, which can represent vector components of position, DA neurons represent vector components of velocity or acceleration. We found neurons related to movements in four directions-up, down, left, right. For horizontal movements, there is significant lateralization of neurons: the left nigra contains more rightward neurons, whereas the right nigra contains more leftward neurons. The relationship between DA activity and movement kinematics was found on both appetitive trials using sucrose and aversive trials using air puff, showing that these neurons belong to a velocity control circuit that can be used for any number of purposes, whether to seek reward or to avoid harm. In support of this conclusion, mimicry of the phasic activation of DA neurons with selective optogenetic stimulation could also generate movements. Contrary to the popular hypothesis that DA neurons encode reward prediction errors, our results suggest that nigrostriatal DA plays an essential role in controlling the kinematics of voluntary movements. We hypothesize that DA signaling implements gain adjustment for adaptive transition control, and describe a new model of the basal ganglia (BG) in which DA functions to adjust the gain of the transition controller. This model has significant implications for our understanding of movement disorders implicating DA and the BG.

A role for phasic dopamine release within the nucleus accumbens in encoding aversion: a review of the neurochemical literature

Survival is dictated by an organism's fitness in approaching positive stimuli and avoiding harm. While a rich literature outlines a role for mesolimbic dopamine in reward and appetitive behaviors, dopamine's involvement in aversion and avoidance behaviors remains controversial. Debate surrounding dopamine's function in the processing of negative stimuli likely stems from conflicting results reported by single-unit electrophysiological studies. Indeed, a number of studies suggest that midbrain dopaminergic cells are inhibited by the presentation of negative or fearful stimuli, while others report no change, or even an increase, in their activity. These disparate results may be due to population heterogeneity. Recent evidence demonstrates that midbrain dopamine neurons are heterogeneous in their projection targets, responses to environmental stimuli, pharmacology, and influences on motivated behavior. Thus, in order to assemble an accurate account of dopamine function during aversive stimulus experience and related behavior, it is necessary to examine the functional output of dopamine neural activity at mesolimbic terminal regions. This Review presents a growing body of evidence that dopamine release in the nucleus accumbens encodes not only reward, but also aversion. For example, our laboratory recently utilized fast-scan cyclic voltammetry to show that real-time changes in accumbal dopamine release are detected when animals are presented with predictors of aversion and its avoidance. These data, along with other reports, support a considerably more nuanced view of dopamine neuron function, wherein accumbal dopamine release is differentially modulated by positive and negative affective stimuli to promote adaptive behaviors.

GABAA receptor drugs and neuronal plasticity in reward and aversion: focus on the ventral tegmental area

GABA_A receptors are the main fast inhibitory neurotransmitter receptors in the mammalian brain, and targets for many clinically important drugs widely used in the treatment of anxiety disorders, insomnia and in anesthesia. Nonetheless, there are significant risks associated with the long-term use of these drugs particularly related to development of tolerance and addiction. Addictive mechanisms of GABA_A receptor drugs are poorly known, but recent findings suggest that those drugs may induce aberrant neuroadaptations in the brain reward circuitry. Recently, benzodiazepines, acting on synaptic GABA_A receptors, and modulators of extrasynaptic GABA_A receptors (THIP and neurosteroids) have been found to induce plasticity in the ventral tegmental area (VTA) dopamine neurons and their main target projections. Furthermore, depending whether synaptic or extrasynaptic GABA_A receptor populations are activated, the behavioral outcome of repeated administration seems to correlate with rewarding or aversive behavioral responses, respectively. The VTA dopamine neurons project to forebrain centers such as the nucleus accumbens and medial prefrontal cortex, and receive afferent projections from these brain regions and especially from the extended amygdala and lateral habenula, forming the major part of the reward and aversion circuitry. Both synaptic and extrasynaptic GABA_A drugs inhibit the VTA GABAergic interneurons, thus activating the VTA DA neurons by disinhibition and this way inducing glutamatergic synaptic plasticity. However, the GABA_A drugs failed to alter synaptic spine numbers as studied from Golgi-Cox-stained VTA dendrites. Since the GABAergic drugs are known to depress the brain metabolism and gene expression, their likely way of inducing neuroplasticity in mature neurons is by disinhibiting the principal neurons, which remains to be rigorously tested for a number of clinically important anxiolytics, sedatives and anesthetics in different parts of the circuitry.

Role of dopamine D2 receptors in optimizing choice strategy in a dynamic and uncertain environment

In order to investigate roles of dopamine receptor subtypes in reward-based learning, we examined choice behavior of dopamine D1 and D2 receptor-knockout (D1R-KO and D2R-KO, respectively) mice in an instrumental learning task with progressively increasing reversal frequency and a dynamic two-armed bandit task. Performance of D2R-KO mice was progressively impaired in the former as the frequency of reversal increased and profoundly impaired in the latter even with prolonged training, whereas D1R-KO mice showed relatively minor performance deficits. Choice behavior in the dynamic two-armed bandit task was well explained by a hybrid model including win-stay-lose-switch and reinforcement learning terms. A model-based analysis revealed increased win-stay, but impaired value updating and decreased value-dependent action selection in D2R-KO mice, which were detrimental to maximizing rewards in the dynamic two-armed bandit task. These results suggest an important role of dopamine D2 receptors in learning from past choice outcomes for rapid adjustment of choice behavior in a dynamic and uncertain environment.

Visualization of plasticity in fear-evoked calcium signals in midbrain dopamine neurons

Dopamine is broadly implicated in fear-related processes, yet we know very little about signaling dynamics in these neurons during active fear conditioning. We describe the direct imaging of calcium signals of dopamine neurons during Pavlovian fear conditioning using fiber-optic confocal microscopy coupled with the genetically encoded calcium indicator GCaMP3. We observed calcium transients in a subset of dopamine neurons to an unconditioned fear stimulus on the first day of Pavlovian fear conditioning. On the second day, calcium transients occurred in response to conditioned and unconditioned stimuli. These results demonstrate plasticity in dopamine neuron calcium signals and the occurrence of activity-dependent processes in these neurons during fear conditioning.

Optical suppression of drug-evoked phasic dopamine release

Brief fluctuations in dopamine concentration (dopamine transients) play a key role in behavior towards rewards, including drugs of abuse. Drug-evoked dopamine transients may result from actions at both dopamine cell bodies and dopamine terminals. Inhibitory opsins can be targeted to dopamine neurons permitting their firing activity to be suppressed. However, as dopamine transients can become uncoupled from firing, it is unknown whether optogenetic hyperpolarization at the level of the soma is able to suppress dopamine transients. Here, we used in vivo fast-scan cyclic voltammetry to record transients evoked by cocaine and raclopride in nucleus accumbens (NAc) of urethane-anesthetized rats. We targeted halorhodopsin (NpHR) specifically to dopamine cells by injecting Cre-inducible virus into ventral tegmental area (VTA) of transgenic rats that expressed Cre recombinase under control of the tyrosine hydroxylase promoter (TH-Cre⁺ rats). Consistent with previous work, co-administration of cocaine and raclopride led to the generation of dopamine transients in NAc shell. Illumination of VTA with laser strongly suppressed the frequency of transients in NpHR-expressing rats, but not in control rats. Laser did not have any effect on amplitude of transients. Thus, optogenetics can effectively reduce the occurrence of drug-evoked transients and is therefore a suitable approach for studying the functional role of such transients in drug-associated behavior.

Heterogeneity of dopamine neuron activity across traits and states

Midbrain dopamine neurons fire irregularly, with interspersed clusters of high-frequency spikes, commonly called 'bursts'. In this review we examine such heterogeneity in activity, and provide insight into how it can participate in psychiatric conditions such as drug addiction. We first describe several techniques used to evaluate dopamine neuron activity, and comment on the different measures that each provides. We next describe the activity of dopamine neurons in 'basal' conditions. Specifically, we discuss how the use of anesthesia and reduced preparations may alter aspects of dopamine cell activity, and how there is heterogeneity across species and regions. We also describe how dopamine cell firing changes throughout the peri-adolescent period and how dopamine neuron activity differs across the population. In the final section, we discuss how dopamine neuron activity changes in response to life events. First, we focus attention on drugs of abuse. Drugs themselves change firing activity through a variety of mechanisms, with effects on firing while drug is present differing from those seen after drug discontinuation. We then review how stimuli that are rewarding, aversive, or salient can evoke changes in firing rate and discharge pattern of dopamine neurons, and provide behavioral relevance of dopamine signaling. Finally, we discuss how stress can modulate dopamine neuron firing and how this may contribute to the role that stressful experiences play in psychiatric disorders such as addiction and depression.

A comparison of neural responses to appetitive and aversive stimuli in humans and other mammals

Distinguishing potentially harmful or beneficial stimuli is necessary for the self-preservation and well-being of all organisms. This assessment requires the ongoing valuation of environmental stimuli. Despite much work on the processing of aversive- and appetitive-related brain signals, it is not clear to what degree these two processes interact across the brain. To help clarify this issue, this report used a cross-species comparative approach in humans (i.e. meta-analysis of imaging data) and other mammals (i.e. targeted review of functional neuroanatomy in rodents and non-human primates). Human meta-analysis results suggest network components that appear selective for appetitive (e.g. ventromedial prefrontal cortex, ventral tegmental area) or aversive (e.g. cingulate/supplementary motor cortex, periaqueductal grey) processing, or that reflect overlapping (e.g. anterior insula, amygdala) or asymmetrical, i.e. apparently lateralized, activity (e.g. orbitofrontal cortex, ventral striatum). However, a closer look at the known value-related mechanisms from the animal literature suggests that all of these macroanatomical regions are involved in the processing of both appetitive and aversive stimuli. Differential spatiotemporal network dynamics may help explain similarities and differences in appetitive- and aversion-related activity.

Role of nicotinic acetylcholine receptors in regulating dopamine neuron activity

Midbrain dopamine (DA) neurons play a central role in a wide range of behaviors, from attention and motivation to motor control and reinforcement. The release of DA is modulated by a number of factors, and its deregulation has been implicated in multiple psychiatric disorders, such as addiction. In particular, nicotinic acetylcholine receptors (nAChRs) are key modulators of DA cells. Nicotine, the main addictive component in tobacco, strongly interacts with these receptors in the midbrain DA systems, resulting in reinforcing effects that are at the core of tobacco addiction. nAChRs are virtually expressed on every cell of the DA system, both at pre-, post- and extra-synaptic locations. The complex issue of interpreting the role of the large portfolio of different nAChR subtypes expressed on ventral tegmental area (VTA) and substantia nigra pars compacta (SNc) neurons, and especially their role in defining functional DAergic subpopulations, is far from being solved. In this review we will try to provide the reader with an integrative view of the nicotinic modulation of DA neurons and its influence at the cellular, systemic and behavioral levels (exploratory behavior), as well as its implication in the reinforcing effects of nicotine.

Phasic excitation of ventral tegmental dopamine neurons potentiates the initiation of conditioned approach behavior: parametric and reinforcement-schedule analyses

Midbrain dopamine neurons are implicated in motivation and learning. However, it is unclear how phasic excitation of dopamine neurons, which is implicated in learning, is involved in motivation. Here we used a self-stimulation procedure to examine how mice seek for optogenetically-induced phasic excitation of dopamine neurons, with an emphasis on the temporal dimension. TH-Cre transgenic mice received adeno-associated viral vectors encoding channelrhodopsin-2 into the ventral tegmental area, resulting in selective expression of the opsin in dopamine neurons. These mice were trained to press on a lever for photo-pulse trains that phasically excited dopamine neurons. They learned to self-stimulate in a fast, constant manner, and rapidly reduced pressing during extinction. We first determined effective parameters of photo-pulse trains in self-stimulation. Lever-press rates changed as a function of the manipulation of pulse number, duration, intensity, and frequency. We then examined effects of interval and ratio schedules of reinforcement on photo-pulse train reinforcement, which was contrasted with food reinforcement. Reinforcement with food inhibited lever pressing for a few seconds, after which pressing was robustly regulated in a goal-directed manner. In contrast, phasic excitation of dopamine neurons robustly potentiated the initiation of lever pressing; however, this effect did not last more than 1 s and quickly diminished. Indeed, response rates markedly decreased when lever pressing was reinforced with inter-reinforcement interval schedules of 3 or 10 s or ratio schedules requiring multiple responses per reinforcement. Thus, phasic excitation of dopamine neurons briefly potentiates the initiation of approach behavior with apparent lack of long-term motivational regulation.

Heart rate and heart rate variability assessment identifies individual differences in fear response magnitudes to earthquake, free fall, and air puff in mice

Fear behaviors and fear memories in rodents have been traditionally assessed by the amount of freezing upon the presentation of conditioned cues or unconditioned stimuli. However, many experiences, such as encountering earthquakes or accidental fall from tree branches, may produce long-lasting fear memories but are behaviorally difficult to measure using freezing parameters. Here, we have examined changes in heartbeat interval dynamics as physiological readout for assessing fearful reactions as mice were subjected to sudden air puff, free-fall drop inside a small elevator, and a laboratory-version earthquake. We showed that these fearful events rapidly increased heart rate (HR) with simultaneous reduction of heart rate variability (HRV). Cardiac changes can be further analyzed in details by measuring three distinct phases: namely, the rapid rising phase in HR, the maximum plateau phase during which HRV is greatly decreased, and the recovery phase during which HR gradually recovers to baseline values. We showed that durations of the maximum plateau phase and HR recovery speed were quite sensitive to habituation over repeated trials. Moreover, we have developed the fear resistance index based on specific cardiac response features. We demonstrated that the fear resistance index remained largely consistent across distinct fearful events in a given animal, thereby enabling us to compare and rank individual mouse’s fear responsiveness among the group. Therefore, the fear resistance index described here can represent a useful parameter for measuring personality traits or individual differences in stress-susceptibility in both wild-type mice and post-traumatic stress disorder (PTSD) models.

Pain anticipation recruits the mesolimbic system and differentially modulates subsequent recognition memory

The ability to encode information into long-term memory is not a passive process but can be influenced by motivational factors. While the mesolimbic system has long been associated with reward-driven memory enhancement, the precise neurobiology of processing aversive events and their effects on declarative learning remain unclear. To address this issue, human subjects encoded a series of scene images, which was combined with cues predicting an aversive electric shock with different probabilities (0.2, 0.5, 0.8). Subsequently, recognition memory for the scenes was tested using a remember/know procedure. In a behavioral experiment, shock probability had linear effects on familiarity and inverted u-shaped effects on recollection. While the behavioral effect was absent in experiment 2 (fMRI), at the neural level encoding-related activity in the hippocampus mimicked the recollection specific quadratic effect, whereas activity in the anterior parahippocampal gyrus mirrored the familiarity specific linear relationship that was evident in experiment 1. Importantly, the probability of upcoming shocks was linearly coded in the substantia nigra / ventral tegmental area, and pain associated brain regions, such as the insula, responded to shock delivery. Our results demonstrate that anticipating primary aversive events recruits the human mesolimbic system and differentially modulates declarative memory functions via medial temporal lobe structures.

Optogenetic and chemogenetic insights into the food addiction hypothesis

Obesity is clinically diagnosed by a simple formula based on the weight and height of a person (body mass index), but is associated with a host of other behavioral symptoms that are likely neurological in origin. In recent years, many scientists have asked whether similar behavioral and cognitive changes occur in drug addiction and obesity, lending many to discuss the potential for “food addiction”. Advances in understanding the circuitry underlying both feeding behaviors and drug addiction may allow us to consider this question from the viewpoint of neural circuits, to complement behavioral perspectives. Here, we review advances in understanding of these circuits and use them to consider whether drawing comparisons to drug addiction is helpful for understanding certain forms of obesity.

On brain activity mapping: insights and lessons from Brain Decoding Project to map memory patterns in the hippocampus

The BRAIN project recently announced by the president Obama is the reflection of unrelenting human quest for cracking the brain code, the patterns of neuronal activity that define who we are and what we are. While the Brain Activity Mapping proposal has rightly emphasized on the need to develop new technologies for measuring every spike from every neuron, it might be helpful to consider both the theoretical and experimental aspects that would accelerate our search for the organizing principles of the brain code. Here we share several insights and lessons from the similar proposal, namely, Brain Decoding Project that we initiated since 2007. We provide a specific example in our initial mapping of real-time memory traces from one part of the memory circuit, namely, the CA1 region of the mouse hippocampus. We show how innovative behavioral tasks and appropriate mathematical analyses of large datasets can play equally, if not more, important roles in uncovering the specific-to-general feature-coding cell assembly mechanism by which episodic memory, semantic knowledge, and imagination are generated and organized. Our own experiences suggest that the bottleneck of the Brain Project is not only at merely developing additional new technologies, but also the lack of efficient avenues to disseminate cutting edge platforms and decoding expertise to neuroscience community. Therefore, we propose that in order to harness unique insights and extensive knowledge from various investigators working in diverse neuroscience subfields, ranging from perception and emotion to memory and social behaviors, the BRAIN project should create a set of International and National Brain Decoding Centers at which cutting-edge recording technologies and expertise on analyzing large datasets analyses can be made readily available to the entire community of neuroscientists who can apply and schedule to perform cutting-edge research.

Unexpected downshifts in reward magnitude induce variation in human behavior

We investigated how changes in outcome magnitude affect behavioral variation in human volunteers. Our participants entered strings of characters using a computer keyboard, receiving feedback (gaining a number of points) for any string at least ten characters long. During a "surprise" phase in which the number of points awarded was changed, participants only increased their behavioral variability when the reward value was downshifted to a lower amount, and only when such a shift was novel. Upshifts in reward did not have a systematic effect on variability.

On initial Brain Activity Mapping of episodic and semantic memory code in the hippocampus

It has been widely recognized that the understanding of the brain code would require large-scale recording and decoding of brain activity patterns. In 2007 with support from Georgia Research Alliance, we have launched the Brain Decoding Project Initiative with the basic idea which is now similarly advocated by BRAIN project or Brain Activity Map proposal. As the planning of the BRAIN project is currently underway, we share our insights and lessons from our efforts in mapping real-time episodic memory traces in the hippocampus of freely behaving mice. We show that appropriate large-scale statistical methods are essential to decipher and measure real-time memory traces and neural dynamics. We also provide an example of how the carefully designed, sometime thinking-outside-the-box, behavioral paradigms can be highly instrumental to the unraveling of memory-coding cell assembly organizing principle in the hippocampus. Our observations to date have led us to conclude that the specific-to-general categorical and combinatorial feature-coding cell assembly mechanism represents an emergent property for enabling the neural networks to generate and organize not only episodic memory, but also semantic knowledge and imagination.

Electrical stimulation of lateral habenula during learning: frequency-dependent effects on acquisition but not retrieval of a two-way active avoidance response

The lateral habenula (LHb) is an epithalamic structure involved in signaling reward omission and aversive stimuli, and it inhibits dopaminergic neurons during motivated behavior. Less is known about LHb involvement in the acquisition and retrieval of avoidance learning. Our previous studies indicated that brief electrical stimulation of the LHb, time-locked to the avoidance of aversive footshock (presumably during the positive affective “relief” state that occurs when an aversive outcome is averted), inhibited the acquisition of avoidance learning. In the present study, we used the same paradigm to investigate different frequencies of LHb stimulation. The effect of 20 Hz vs. 50 Hz vs. 100 Hz stimulation was investigated during two phases, either during acquisition or retrieval in Mongolian gerbils. The results indicated that 50 Hz, but not 20 Hz, was sufficient to produce a long-term impairment in avoidance learning, and was somewhat more effective than 100 Hz in this regard. None of the stimulation parameters led to any effects on retrieval of avoidance learning, nor did they affect general motor activity. This suggests that, at frequencies in excess of the observed tonic firing rates of LHb neurons (>1–20 Hz), LHb stimulation may serve to interrupt the consolidation of new avoidance memories. However, these stimulation parameters are not capable of modifying avoidance memories that have already undergone extensive consolidation.

Mild blast events alter anxiety, memory, and neural activity patterns in the anterior cingulate cortex

There is a general interest in understanding of whether and how exposure to emotionally traumatizing events can alter memory function and anxiety behaviors. Here we have developed a novel laboratory-version of mild blast exposure comprised of high decibel bomb explosion sound coupled with strong air blast to mice. This model allows us to isolate the effects of emotionally fearful components from those of traumatic brain injury or bodily injury typical associated with bomb blasts. We demonstrate that this mild blast exposure is capable of impairing object recognition memory, increasing anxiety in elevated O-maze test, and resulting contextual generalization. Our in vivo neural ensemble recording reveal that such mild blast exposures produced diverse firing changes in the anterior cingulate cortex, a region processing emotional memory and inhibitory control. Moreover, we show that these real-time neural ensemble patterns underwent post-event reverberations, indicating rapid consolidation of those fearful experiences. Identification of blast-induced neural activity changes in the frontal brain may allow us to better understand how mild blast experiences result in abnormal changes in memory functions and excessive fear generalization related to post-traumatic stress disorder.