Basolateral amygdala rapid glutamate release encodes an outcome-specific representation vital for reward-predictive cues to selectively invigorate reward-seeking actions

Neuronal Ensembles in the Amygdala Allow Social Information to Motivate Later Decisions

Social experiences carry tremendous weight in our decision-making, even when social partners are not present. To determine mechanisms, we trained female mice to respond for two food reinforcers. Then, one food was paired with a novel conspecific. Mice later favored the conspecific-associated food, even in the absence of the conspecific. Chemogenetically silencing projections from the prelimbic subregion (PL) of the medial prefrontal cortex to the basolateral amygdala (BLA) obstructed this preference while leaving social discrimination intact, indicating that these projections are necessary for socially driven choice. Further, mice that performed the task had greater densities of dendritic spines on excitatory BLA neurons relative to mice that did not. We next induced chemogenetic receptors in cells active during social interactions-when mice were encoding information that impacted later behavior. BLA neurons stimulated by social experience were necessary for mice to later favor rewards associated with social conspecifics but not make other choices. This profile contrasted with that of PL neurons stimulated by social experience, which were necessary for choice behavior in social and nonsocial contexts alike. The PL may convey a generalized signal allowing mice to favor particular rewards, while units in the BLA process more specialized information, together supporting choice motivated by social information.

Dopamine projections to the basolateral amygdala drive the encoding of identity-specific reward memories

To make adaptive decisions, we build an internal model of the associative relationships in an environment and use it to make predictions and inferences about specific available outcomes. Detailed, identity-specific cue-reward memories are a core feature of such cognitive maps. Here we used fiber photometry, cell-type and pathway-specific optogenetic manipulation, Pavlovian cue-reward conditioning and decision-making tests in male and female rats, to reveal that ventral tegmental area dopamine (VTADA) projections to the basolateral amygdala (BLA) drive the encoding of identity-specific cue-reward memories. Dopamine is released in the BLA during cue-reward pairing; VTADA→BLA activity is necessary and sufficient to link the identifying features of a reward to a predictive cue but does not assign general incentive properties to the cue or mediate reinforcement. These data reveal a dopaminergic pathway for the learning that supports adaptive decision-making and help explain how VTADA neurons achieve their emerging multifaceted role in learning.

Dopamine in the dorsal bed nucleus of stria terminalis signals Pavlovian sign-tracking and reward violations

Midbrain and striatal dopamine signals have been extremely well characterized over the past several decades, yet novel dopamine signals and functions in reward learning and motivation continue to emerge. A similar characterization of real-time sub-second dopamine signals in areas outside of the striatum has been limited. Recent advances in fluorescent sensor technology and fiber photometry permit the measurement of dopamine binding correlates, which can divulge basic functions of dopamine signaling in non-striatal dopamine terminal regions, like the dorsal bed nucleus of the stria terminalis (dBNST). Here, we record GRABDA signals in the dBNST during a Pavlovian lever autoshaping task. We observe greater Pavlovian cue-evoked dBNST GRABDA signals in sign-tracking (ST) compared to goal-tracking/intermediate (GT/INT) rats and the magnitude of cue-evoked dBNST GRABDA signals decreases immediately following reinforcer-specific satiety. When we deliver unexpected rewards or omit expected rewards, we find that dBNST dopamine signals encode bidirectional reward prediction errors in GT/INT rats, but only positive prediction errors in ST rats. Since sign- and goal-tracking approach strategies are associated with distinct drug relapse vulnerabilities, we examined the effects of experimenter-administered fentanyl on dBNST dopamine associative encoding. Systemic fentanyl injections do not disrupt cue discrimination but generally potentiate dBNST dopamine signals. These results reveal multiple dBNST dopamine correlates of learning and motivation that depend on the Pavlovian approach strategy employed.

Metabotropic group II glutamate receptors mediate cue-triggered increases in reward-seeking behaviour

RATIONALE

Reward-associated cues can invigorate reward-seeking actions via Pavlovian-to-instrumental transfer (PIT). Glutamatergic neurotransmission mediates the appetitive effects of reward-associated cues. We characterized the expression of PIT and its mediation by metabotropic group II glutamate (mGlu_2/3) receptor activity in female and male rats.

OBJECTIVES

Across the sexes, we used PIT procedures to determine (i) cue-triggered increases in instrumental responding for water reward (experiment 1) and (ii) the respective influences of the mGlu_2/3 receptor agonist LY379268 and thirst satiation on this effect (experiment 2).

METHODS

Water-restricted female and male Sprague-Dawley rats learned to lever press for water. Separately, they learned that one of two auditory stimuli predicts free water (CS + vs CS -). On PIT test days, the CS + and CS - were presented independent of instrumental responding, and we measured effects on lever pressing under extinction (no water). In experiment 1, we characterized PIT across the sexes. In experiment 2, we measured PIT after systemic LY379268 administration (0, 0.3 and 1 mg/kg) and thirst satiation, respectively.

RESULTS

Female and male rats showed similar PIT, with CS + but not CS - presentations potentiating water-seeking behaviour. LY379268 (1 mg/kg) attenuated CS + evoked increases in both water-associated lever pressing and conditioned approach to the water port. Thirst satiation attenuated both water-seeking and CS + evoked conditioned approach behaviour.

CONCLUSIONS

The sexes show similar cue-triggered increases in reward seeking, and thirst satiation suppresses both water-seeking and cue-triggered anticipation of water reward. Finally, across the sexes, mGlu_2/3 receptor activity mediates cue-triggered increases in reward seeking.

Dorsomedial prefrontal cortex activation disrupts Pavlovian incentive motivation

The dorsomedial prefrontal cortex (dmPFC) is known to make important contributions to flexible, reward-motivated behavior. However, it remains unclear if the dmPFC is involved in regulating the expression of Pavlovian incentive motivation, the process through which reward-paired cues promote instrumental reward-seeking behavior, which is modeled in rats using the Pavlovian-instrumental transfer (PIT) task. The current study examined this question using a bidirectional chemogenetic strategy in which inhibitory (hM4Di) or excitatory (hM3Dq) designer G-protein coupled receptors were virally expressed in dmPFC neurons, allowing us to later stimulate or inhibit this region by administering CNO prior to PIT testing. We found that dmPFC inhibition did not alter the tendency for a reward-paired cue to instigate instrumental reward-seeking behavior, whereas dmPFC stimulation disrupted the expression of this motivational influence. Neither treatment altered cue-elicited anticipatory activity at the reward-delivery port, indicating that dmPFC stimulation did not lead to more widespread motor suppression. A reporter-only control experiment indicated that our CNO treatment did not have non-specific behavioral effects. Thus, the dmPFC does not mediate the expression of Pavlovian incentive motivation but instead has the capacity to exert pronounced inhibitory control over this process, suggesting that it is involved in adaptively regulating cue-motivated behavior.

Amygdala-cortical collaboration in reward learning and decision making

Adaptive reward-related decision making requires accurate prospective consideration of the specific outcome of each option and its current desirability. These mental simulations are informed by stored memories of the associative relationships that exist within an environment. In this review, I discuss recent investigations of the function of circuitry between the basolateral amygdala (BLA) and lateral (lOFC) and medial (mOFC) orbitofrontal cortex in the learning and use of associative reward memories. I draw conclusions from data collected using sophisticated behavioral approaches to diagnose the content of appetitive memory in combination with modern circuit dissection tools. I propose that, via their direct bidirectional connections, the BLA and OFC collaborate to help us encode detailed, outcome-specific, state-dependent reward memories and to use those memories to enable the predictions and inferences that support adaptive decision making. Whereas lOFC→BLA projections mediate the encoding of outcome-specific reward memories, mOFC→BLA projections regulate the ability to use these memories to inform reward pursuit decisions. BLA projections to lOFC and mOFC both contribute to using reward memories to guide decision making. The BLA→lOFC pathway mediates the ability to represent the identity of a specific predicted reward and the BLA→mOFC pathway facilitates understanding of the value of predicted events. Thus, I outline a neuronal circuit architecture for reward learning and decision making and provide new testable hypotheses as well as implications for both adaptive and maladaptive decision making.

Social incentivization of instrumental choice in mice requires amygdala-prelimbic cortex-nucleus accumbens connectivity

Social experiences influence decision making, including decision making lacking explicit social content, yet mechanistic factors are unclear. We developed a new procedure, social incentivization of future choice (SIFC). Female mice are trained to nose poke for equally-preferred foods, then one food is paired with a novel conspecific, and the other with a novel object. Mice later respond more for the conspecific-associated food. Thus, prior social experience incentivizes later instrumental choice. SIFC is pervasive, occurring following multiple types of social experiences, and is not attributable to warmth or olfactory cues alone. SIFC requires the prelimbic prefrontal cortex (PL), but not the neighboring orbitofrontal cortex. Further, inputs from the basolateral amygdala to the PL and outputs to the nucleus accumbens are necessary for SIFC, but not memory for a conspecific. Basolateral amygdala→PL connections may signal the salience of social information, leading to the prioritization of coincident rewards via PL→nucleus accumbens outputs.

Prefrontal cortex interactions with the amygdala in primates

This review addresses functional interactions between the primate prefrontal cortex (PFC) and the amygdala, with emphasis on their contributions to behavior and cognition. The interplay between these two telencephalic structures contributes to adaptive behavior and to the evolutionary success of all primate species. In our species, dysfunction in this circuitry creates vulnerabilities to psychopathologies. Here, we describe amygdala-PFC contributions to behaviors that have direct relevance to Darwinian fitness: learned approach and avoidance, foraging, predator defense, and social signaling, which have in common the need for flexibility and sensitivity to specific and rapidly changing contexts. Examples include the prediction of positive outcomes, such as food availability, food desirability, and various social rewards, or of negative outcomes, such as threats of harm from predators or conspecifics. To promote fitness optimally, these stimulus-outcome associations need to be rapidly updated when an associative contingency changes or when the value of a predicted outcome changes. We review evidence from nonhuman primates implicating the PFC, the amygdala, and their functional interactions in these processes, with links to experimental work and clinical findings in humans where possible.

Simulated Performance of Electroenzymatic Glutamate Biosensors In Vivo Illuminates the Complex Connection to Calibration In Vitro

Detailed simulations show that the relationship between electroenzymatic glutamate (Glut) sensor performance in vitro and that modeled in vivo is complicated by the influence of both resistances to mass transfer and clearance rates of Glut and H₂O₂ in the brain extracellular space (ECS). Mathematical modeling provides a powerful means to illustrate how these devices are expected to respond to a variety of conditions in vivo in ways that cannot be accomplished readily using existing experimental techniques. Through the use of transient model simulations in one spatial dimension, it is shown that the sensor response in vivo may exhibit much greater dependence on H₂O₂ mass transfer and clearance in the surrounding tissue than previously thought. This dependence may lead to sensor signals more than double the expected values (based on prior sensor calibration in vitro) for Glut release events within a few microns of the sensor surface. The sensor response in general is greatly affected by the distance between the device and location of Glut release, and apparent concentrations reported by simulated sensors consistently are well below the actual Glut levels for events occurring at distances greater than a few microns. Simulations of transient Glut concentrations, including a physiologically relevant bolus release, indicate that detection of Glut signaling likely is limited to events within 30 μm of the sensor surface based on representative sensor detection limits. It follows that important limitations also exist with respect to interpretation of decays in sensor signals, including relation of such data to actual Glut concentration declines in vivo. Thus, the use of sensor signal data to determine quantitatively the rates of Glut uptake from the brain ECS likely is problematic. The model is designed to represent a broad range of relevant physiological conditions, and although limited to one dimension, provides much needed guidance regarding the interpretation in general of electroenzymatic sensor data gathered in vivo.

Metabotropic group II glutamate receptors in the basolateral amygdala mediate cue-triggered increases in incentive motivation

RATIONALE

Reward-associated cues can trigger incentive motivation for reward and invigorate reward-seeking behaviour via Pavlovian-to-instrumental transfer (PIT). Glutamate signaling within the basolateral amygdala (BLA) modulates cue-triggered increases in incentive motivation. However, the role of BLA metabotropic group II glutamate (mGlu_2/3) receptors is largely unknown.

OBJECTIVES

In Experiment 1, we characterized cue-triggered increases in incentive motivation for water reward using the PIT paradigm. In Experiment 2, we assessed the influence of intra-BLA microinjections of the mGlu_2/3 receptor agonist LY379268 on this effect.

METHODS

Water-restricted male Sprague-Dawley rats learned to press a lever for water. Separately, they learned to associate one of two auditory cues with free water. On test days, rats could lever press under extinction conditions (no water), with intermittent, non-contingent CS+ and CS- presentations. In Experiment 1, rats were tested under baseline conditions. In Experiment 2, rats received intra-BLA microinjections of LY379268 (0, 3 and 6 [Formula: see text]g/hemisphere) before testing.

RESULTS

Across experiments, CS+, but not CS-, presentations increased water-associated lever pressing during testing, even though responding was reinforced neither by water nor the CS+. Intra-BLA LY379268 abolished both CS+ potentiated pressing on the water-associated lever and CS+ evoked conditioned approach to the site of water delivery. LY379268 did not influence locomotion or instrumental and Pavlovian response rates during intervals between CS presentations or during the CS-, indicating no motor effects.

CONCLUSIONS

mGlu_2/3 receptor activity in the BLA mediates cue-triggered potentiation of incentive motivation for reward, suppressing both cue-induced increases in instrumental pursuit of the reward and anticipatory approach behaviour.

Choose your path: Divergent basolateral amygdala efferents differentially mediate incentive motivation, flexibility and decision-making

To survive in a complex environment, individuals form associations between environmental stimuli and rewards to organize and optimize reward seeking behaviors. The basolateral amygdala (BLA) uses these learned associations to inform decision-making processes. In this review, we describe functional projections between BLA and its cortical and striatal targets that promote learning and motivational processes central to decision-making. Specifically, we compare and contrast divergent projections from the BLA to the orbitofrontal (OFC) and to the nucleus accumbens (NAc) and examine the roles of these pathways in associative learning, value-guided decision-making, choice behaviors, as well as cue and context-driven drug seeking. Finally, we consider how these projections are involved in disorders of motivation, with a focus on Substance Use Disorder.

A bidirectional corticoamygdala circuit for the encoding and retrieval of detailed reward memories

Adaptive reward-related decision making often requires accurate and detailed representation of potential available rewards. Environmental reward-predictive stimuli can facilitate these representations, allowing one to infer which specific rewards might be available and choose accordingly. This process relies on encoded relationships between the cues and the sensory-specific details of the rewards they predict. Here, we interrogated the function of the basolateral amygdala (BLA) and its interaction with the lateral orbitofrontal cortex (lOFC) in the ability to learn such stimulus-outcome associations and use these memories to guide decision making. Using optical recording and inhibition approaches, Pavlovian cue-reward conditioning, and the outcome-selective Pavlovian-to-instrumental transfer (PIT) test in male rats, we found that the BLA is robustly activated at the time of stimulus-outcome learning and that this activity is necessary for sensory-specific stimulus-outcome memories to be encoded, so they can subsequently influence reward choices. Direct input from the lOFC was found to support the BLA in this function. Based on prior work, activity in BLA projections back to the lOFC was known to support the use of stimulus-outcome memories to influence decision making. By multiplexing optogenetic and chemogenetic inhibition we performed a serial circuit disconnection and found that the lOFC→BLA and BLA→lOFC pathways form a functional circuit regulating the encoding (lOFC→BLA) and subsequent use (BLA→lOFC) of the stimulus-dependent, sensory-specific reward memories that are critical for adaptive, appetitive decision making.

Valence encoding in the amygdala influences motivated behavior

The amygdala is critical for emotional processing and motivated behavior. Its role in these functions is due to its processing of the valence of environmental stimuli. The amygdala receives direct sensory input from sensory thalamus and cortical regions to integrate sensory information from the environment with aversive and/or appetitive outcomes. As many reviews have discussed the amygdala's role in threat processing and fear conditioning, this review will focus on how the amygdala encodes positive valence and the mechanisms that allow it to distinguish between stimuli of positive and negative valence. These findings are also extended to consider how valence encoding populations in the amygdala contribute to local and long-range circuits including those that integrate environmental cues and positive valence. Understanding the complexity of valence encoding in the amygdala is crucial as these mechanisms are implicated in a variety of disease states including anxiety disorders and substance use disorders.

Noninvasive Brain Stimulation Rescues Cocaine-Induced Prefrontal Hypoactivity and Restores Flexible Behavior

BACKGROUND

To obtain desirable goals, individuals must predict the outcome of specific choices, use that information to direct appropriate actions, and adjust behavior accordingly in changing environments (behavioral flexibility). Substance use disorders are marked by impairments in behavioral flexibility along with decreased prefrontal cortical function that limits the efficacy of treatment strategies. Restoring prefrontal hypoactivity, ideally in a noninvasive manner, is an intriguing target for improving flexible behavior and treatment outcomes.

METHODS

A behavioral flexibility task was used in Long-Evans male rats (n = 97) in conjunction with electrophysiology, optogenetics, and a novel rat model of transcranial alternating current stimulation (tACS) to examine the prelimbic cortex (PrL) to nucleus accumbens (NAc) core circuit in behavioral flexibility and determine whether tACS can restore cocaine-induced neural and cognitive dysfunction.

RESULTS

Optogenetic inactivation revealed that the PrL-NAc core circuit is necessary for the ability to learn strategies to flexibly shift behavior. Cocaine self-administration history caused aberrant PrL-NAc core neural encoding and deficits in flexibility. Optogenetics that selectively activated the PrL-NAc core pathway prior to learning rescued cocaine-induced cognitive flexibility deficits. Remarkably, tACS prior to learning the task reestablished adaptive signaling in the PrL-NAc circuit and restored flexible behavior in a relatively noninvasive and frequency-specific manner.

CONCLUSIONS

We establish a role of NAc core-projecting PrL neurons in behavioral flexibility and provide a novel noninvasive brain stimulation method in rats to rescue cocaine-induced frontal hypofunction and restore flexible behavior, supporting a role of tACS as a therapeutic to treat cognitive deficits in substance use disorders.

Electroenzymatic choline sensing at near the theoretical performance limit

A high performance, electroenzymatic microsensor for choline based on choline oxidase (ChOx) immobilized on Pt coated with permselective polymer layers has been created that exhibits sensitivity approaching the theoretical performance limit. Sensor construction was guided by simulations performed with a detailed mathematical model. Implantable microsensors with an array of electroenzymatic sensing sites provide a means to record concentration changes of choline, an effective surrogate for acetylcholine due to its very rapid turnover in the brain, and other neurochemicals in vivo. However, electroenzymatic sensors generally have insufficient sensitivity and response time to monitor neurotransmitter signaling on the millisecond timescale with cellular-level spatial resolution. Model simulations suggested that choline sensor performance can be improved significantly by optimizing immobilized ChOx layer thickness and minimizing the thicknesses of permselective polymer coatings as well. Electroenzymatic choline sensors constructed with a ∼5 μm-thick crosslinked ChOx layer atop 200 nm-thick permselective films (poly(m-phenylenediamine) and Nafion) exhibited unprecedented sensitivity and response time of 660 ± 40 nA μM^-1 cm^-2 at 37 °C and 0.36 ± 0.05 s, respectively, while maintaining excellent selectivity. Such performance characteristics provide greater flexibility in the design of microelectrode array (MEA) probes with near cellular-scale sensing sites arranged in more dense arrays. Also, faster response times enable better resolution of transient acetylcholine signals and better correlation of these events with electrophysiological recordings so as to advance study of brain function.

Electroenzymatic glutamate sensing at near the theoretical performance limit

The sensitivity and response time of glutamate sensors based on glutamate oxidase immobilized on planar platinum microelectrodes have been improved to near the theoretical performance limits predicted by a detailed mathematical model. Microprobes with an array of electroenzymatic sensing sites have emerged as useful tools for the monitoring of glutamate and other neurotransmitters in vivo; and implemented as such, they can be used to study many complex neurological diseases and disorders including Parkinson's disease and drug addiction. However, less than optimal sensitivity and response time has limited the spatiotemporal resolution of these promising research tools. A mathematical model has guided systematic improvement of an electroenzymatic glutamate microsensor constructed with a 1-2 μm-thick crosslinked glutamate oxidase layer and underlying permselective coating of polyphenylenediamine and Nafion reduced to less than 200 nm thick. These design modifications led to a nearly 6-fold improvement in sensitivity to 320 ± 20 nA μM-1 cm-2 at 37 °C and a ∼10-fold reduction in response time to 80 ± 10 ms. Importantly, the sensitivity and response times were attained while maintaining a low detection limit and excellent selectivity. Direct measurement of the transport properties of the enzyme and polymer layers used to create the biosensors enabled improvement of the mathematical model as well. Subsequent model simulations indicated that the performance characteristics achieved with the optimized biosensors approach the theoretical limits predicted for devices of this construction. Such high-performance glutamate biosensors will be more effective in vivo at a size closer to cellular dimension and will enable better correlation of glutamate signaling events with electrical recordings.

Biomarkers and neuromodulation techniques in substance use disorders

Addictive disorders are a severe health concern. Conventional therapies have just moderate success and the probability of relapse after treatment remains high. Brain stimulation techniques, such as transcranial Direct Current Stimulation (tDCS) and Deep Brain Stimulation (DBS), have been shown to be effective in reducing subjectively rated substance craving. However, there are few objective and measurable parameters that reflect neural mechanisms of addictive disorders and relapse. Key electrophysiological features that characterize substance related changes in neural processing are Event-Related Potentials (ERP). These high temporal resolution measurements of brain activity are able to identify neurocognitive correlates of addictive behaviours. Moreover, ERP have shown utility as biomarkers to predict treatment outcome and relapse probability. A future direction for the treatment of addiction might include neural interfaces able to detect addiction-related neurophysiological parameters and deploy neuromodulation adapted to the identified pathological features in a closed-loop fashion. Such systems may go beyond electrical recording and stimulation to employ sensing and neuromodulation in the pharmacological domain as well as advanced signal analysis and machine learning algorithms. In this review, we describe the state-of-the-art in the treatment of addictive disorders with electrical brain stimulation and its effect on addiction-related neurophysiological markers. We discuss advanced signal processing approaches and multi-modal neural interfaces as building blocks in future bioelectronics systems for treatment of addictive disorders.

Nucleus Accumbens Cholinergic Interneurons Oppose Cue-Motivated Behavior

BACKGROUND

Environmental reward-predictive stimuli provide a major source of motivation for adaptive reward pursuit behavior. This cue-motivated behavior is known to be mediated by the nucleus accumbens (NAc) core. The cholinergic interneurons in the NAc are tonically active and densely arborized and thus well suited to modulate NAc function. However, their causal contribution to adaptive behavior remains unknown. Here we investigated the function of NAc cholinergic interneurons in cue-motivated behavior.

METHODS

We used chemogenetics, optogenetics, pharmacology, and a translationally analogous Pavlovian-to-instrumental transfer behavioral task designed to assess the motivating influence of a reward-predictive cue over reward-seeking actions in male and female rats.

RESULTS

The data show that NAc cholinergic interneuron activity critically opposes the motivating influence of appetitive cues. Chemogenetic inhibition of NAc cholinergic interneurons augmented cue-motivated behavior. Optical stimulation of acetylcholine release from NAc cholinergic interneurons prevented cues from invigorating reward-seeking behavior, an effect that was mediated by activation of β2-containing nicotinic acetylcholine receptors.

CONCLUSIONS

NAc cholinergic interneurons provide a critical regulatory influence over adaptive cue-motivated behavior and therefore are a potential therapeutic target for the maladaptive cue-motivated behavior that marks many psychiatric conditions, including addiction and depression.

Occasion setting

Occasion setting refers to the ability of 1 stimulus, an occasion setter, to modulate the efficacy of the association between another, conditioned stimulus (CS) and an unconditioned stimulus (US) or reinforcer. Occasion setters and simple CSs are readily distinguished. For example, occasion setters are relatively immune to extinction and counterconditioning, and their combination and transfer functions differ substantially from those of simple CSs. Similarly, the acquisition of occasion setting is favored when stimuli are separated by longer intervals, by empty trace intervals, and are of different modalities, whereas the opposite conditions typically favor the acquisition of simple associations. Furthermore, the simple conditioning and occasion setting properties of a single stimulus can be independent, for example, that stimulus may simultaneously predict the occurrence of a reinforcer and indicate that another stimulus will not be reinforced. Many behavioral phenomena that are intractable to simple associative analysis are better understood within an occasion setting framework. Besides capturing the distinction between direct and modulatory control common to many arenas in neuroscience, occasion setting provides a model for the hierarchical organization of memory for events and event relations, and for contextual control more broadly. Although early lesion studies further differentiated between occasion setting and simple conditioning functions, little is known about the neurobiology of occasion setting. Modern techniques for precise manipulation and monitoring of neuronal activity in multiple brain regions are ideally suited for disentangling contributions of simple conditioning and occasion setting in associative learning. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Electrochemistry at the Synapse

Electrochemical measurements of neurotransmitters provide insight into the dynamics of neurotransmission. In this review, we describe the development of electrochemical measurements of neurotransmitters and how they started with extrasynaptic measurements but now are pushing toward synaptic measurements. Traditionally, biosensors or fast-scan cyclic voltammetry have monitored extrasynaptic levels of neurotransmitters, such as dopamine, serotonin, adenosine, glutamate, and acetylcholine. Amperometry and electrochemical cytometry techniques have revealed mechanisms of exocytosis, suggesting partial release. Advances in nanoelectrodes now allow spatially resolved, electrochemical measurements in a synapse, which is only 20-100 nm wide. Synaptic measurements of dopamine and acetylcholine have been made. In this article, electrochemical measurements are also compared to optical imaging and mass spectrometry measurements, and while these other techniques provide enhanced spatial or chemical information, electrochemistry is best at monitoring real-time neurotransmission. Future challenges include combining electrochemistry with these other techniques in order to facilitate multisite and multianalyte monitoring.

Frontiers in Electrochemical Sensors for Neurotransmitter Detection: Towards Measuring Neurotransmitters as Chemical Diagnostics for Brain Disorders

It is extremely challenging to chemically diagnose disorders of the brain. There is hence great interest in designing and optimizing tools for direct detection of chemical biomarkers implicated in neurological disorders to improve diagnosis and treatment. Tools that are capable of monitoring brain chemicals, neurotransmitters in particular, need to be biocompatible, perform with high spatiotemporal resolution, and ensure high selectivity and sensitivity. Recent advances in electrochemical methods are addressing these criteria; the resulting devices demonstrate great promise for in vivo neurotransmitter detection. None of these devices are currently used for diagnostic purposes, however these cutting-edge technologies are promising more sensitive, selective, faster, and less invasive measurements. Via this review we highlight significant technical advances and in vivo studies, performed in the last 5 years, that we believe will facilitate the development of diagnostic tools for brain disorders.

Slow escape decisions are swayed by trait anxiety

Theoretical models distinguish between neural responses elicited by distal threats and those evoked by more immediate threats^1-3. Specifically, slower 'cognitive' fear responses towards distal threats involve a network of brain regions including the ventral hippocampus (vHPC) and medial prefrontal cortex (mPFC), while immediate 'reactive' fear responses rely on regions such as the periaqueductal grey^4,5. However, it is unclear how anxiety and its neural substrates relate to these distinct defensive survival circuits. We tested whether individual differences in trait anxiety would impact escape behaviour and neural responses to slow and fast attacking predators: conditions designed to evoke cognitive and reactive fear, respectively. Behaviourally, we found that trait anxiety was not related to escape decisions for fast threats, but individuals with higher trait anxiety escaped earlier during slow threats. Functional magnetic resonance imaging showed that when subjects faced slow threats, trait anxiety positively correlated with activity in the vHPC, mPFC, amygdala and insula. Furthermore, the strength of functional coupling between two components of the cognitive circuit-the vHPC and mPFC-was correlated with the degree of trait anxiety. This suggests that anxiety predominantly affects cognitive fear circuits that are involved in volitional strategic escape.

Distinct cortical-amygdala projections drive reward value encoding and retrieval

The value of an anticipated rewarding event is a crucial component of the decision to engage in its pursuit. But little is known of the networks responsible for encoding and retrieving this value. By using biosensors and pharmacological manipulations, we found that basolateral amygdala (BLA) glutamatergic activity tracks and mediates encoding and retrieval of the state-dependent incentive value of a palatable food reward. Projection-specific, bidirectional chemogenetic and optogenetic manipulations revealed that the orbitofrontal cortex (OFC) supports the BLA in these processes. Critically, the function of ventrolateral and medial OFC→BLA projections is doubly dissociable. Whereas lateral OFC→BLA projections are necessary and sufficient for encoding of the positive value of a reward, medial OFC→BLA projections are necessary and sufficient for retrieving this value from memory. These data reveal a new circuit for adaptive reward valuation and pursuit and provide insight into the dysfunction in these processes that characterizes myriad psychiatric diseases.

Inter-individual differences in serotonin and glutamate co-transmission reflect differentiation in context-induced conditioned 50-kHz USVs response after morphine withdrawal

A growing body of research provides compelling evidence that in rats 50-kHz USVs are a form of expression of positive emotions. Context-induced 50-kHz USVs emission is variable among rats, indicating individual differences in contextual response bound up with pharmacological reward. The aims of this study were to: extract the most important neurotransmitters related to context-induced conditioned 50-kHz USVs response; find biological basis of existing inter-individual differences in context-induced conditioned 50-kHz USVs response; create a model of all-to-all neurotransmitters correlations. The data collected here confirms that re-exposure to the context of morphine administration after the withdrawal period increases the level of 50-kHz USVs and this contextual response is associated with elevated serotonin concentrations in amygdala, hippocampus and mPFC and with increased Glu/Gln ratio in nucleus accumbens. The concentration of serotonin increases simultaneously in amygdala, nucleus accumbens and hippocampus. Moreover, 5-HT concentration in amygdala is bound up with glutamate level in this structure as well as in hippocampus. Furthermore, Glu/Gln ratio in nucleus accumbens has strong associations with Glu/Gln ratio simultaneously in VTA, amygdala, striatum and hippocampus. All-to-all-analysis indicate that concentration of glutamate in hippocampus is proportional to glutamate in VTA and GABA concentration in the hippocampus. We have also demonstrated that Glu/GABA ratio in VTA and amygdala was elevated after post withdrawal re-exposure to the pharmacological reward paired context. Presented analysis indicates a strong correlation between serotonergic and glutamatergic systems in context-induced conditioned response. The strength of this co-transmission correlates with the number of 50-kHz USVs emitted in response to morphine-paired context.

Validated multi-step approach for in vivo recording and analysis of optogenetically evoked glutamate in the mouse globus pallidus

Precise quantification of extracellular glutamate concentrations upon neuronal activation is crucial for the understanding of brain function and neurological disorders. While optogenetics is an outstanding method for the correlation between distinct neurons and their role in circuitry and behavior, the electrochemically inactive nature of glutamate has proven challenging for recording upon optogenetic stimulations. This difficulty is due to the necessity for using enzyme-coated microelectrodes and the risk for light-induced artifacts. In this study, we establish a method for the combination of in vivo optogenetic stimulation with selective measurement of glutamate concentrations using enzyme-coated multielectrode arrays and amperometry. The glutamatergic subthalamic nucleus (STN), which is the main electrode target site in deep brain stimulation treatment of advanced Parkinson's disease, has recently proven opotogenetically targetable in Pitx2-Cre-transgenic mice and was here used as model system. Upon stereotactic injection of viral Channelrhodopsin2-eYFP constructs into the STN, amperometric recordings were performed at a range of optogenetic stimulation frequencies in the globus pallidus, the main STN target area, in anesthetized mice. Accurate quantification was enabled through a multi-step analysis approach based on self-referencing microelectrodes and repetition of the experimental protocol at two holding potentials, which allowed for the identification, isolation and removal of photoelectric and photoelectrochemical artifacts. This study advances the field of in vivo glutamate detection with combined optogenetics and amperometric recordings by providing a validated analysis framework for application in a wide variety of glutamate-based approaches in neuroscience.

Nicotine-induced CREB and DeltaFosB activity is modified by caffeine in the brain reward system of the rat

Coffee and nicotine consumption are frequently combined, indicating possible intensifying effect of caffeine on smoking behavior, although neurobiological background of this phenomenon remains unknown. We aimed at determining the effect of caffeine and nicotine, applied separately or simultaneously, on activation of six structures of the brain reward system: nucleus accumbens (NAc), ventral tegmental area (VTA), amygdala (Amg), hippocampus (Hip), medial prefrontal cortex (mPfr) and dorsal striatum (CdP) in the adult male Wistar rats. Activation of two transcription factors, the phosphorylated form of cyclic AMP-response element binding protein (pCREB) and DeltaFosB (ΔFosB) was assessed by immunohistochemistry after multiple-dose five-days psychostimulants administration followed by 20min and 24h survival, respectively. Nicotine evoked the highest increase of pCREB-immunoreactivity (-ir) in NAc, while caffeine exerted the weakest effect in mPfr and CdP. Nicotine/caffeine co-administration resulted in decrease of pCREB-ir in NAc and increase in Amg, compared with the effect of each psychostimulant used separately. Nicotine was the strongest psychostimulant activating ΔFosB-ir in Amg, whereas caffeine - in Hip. Nicotine/caffeine-exerted effect upon ΔFosB-ir in Amg was weaker, whereas in mPfr stronger, than nicotine-evoked effect in these structures. In summary, pCREB and ΔFosB activation is dependent on the type of stimulus, brain structure and functional context. Activation of both transcription factors is responsible for caffeine's modifying effect upon nicotine-related behaviors and must be taken into account while quitting cigarette smoking.

A Detailed Model of Electroenzymatic Glutamate Biosensors To Aid in Sensor Optimization and in Applications in Vivo

Simulations conducted with a detailed model of glutamate biosensor performance describe the observed sensor performance well, illustrate the limits of sensor performance, and suggest a path toward sensor optimization. Glutamate is the most important excitatory neurotransmitter in the brain, and electroenzymatic sensors have emerged as a useful tool for the monitoring of glutamate signaling in vivo. However, the utility of these sensors currently is limited by their sensitivity and response time. A mathematical model of a typical glutamate biosensor consisting of a Pt electrode coated with a permselective polymer film and a top layer of cross-linked glutamate oxidase has been constructed in terms of differential material balances on glutamate, H₂O₂, and O₂ in one spatial dimension. Simulations suggest that reducing thicknesses of the permselective polymer and enzyme layers can increase sensitivity ∼6-fold and reduce response time ∼7-fold, and thereby improve resolution of transient glutamate signals. At currently employed enzyme layer thicknesses, both intrinsic enzyme kinetics and enzyme deactivation likely are masked by mass transfer. However, O₂-dependence studies show essentially no reduction in signal at the lowest anticipated O₂ concentrations for expected glutamate concentrations in the brain and that O₂ transport limitations in vitro are anticipated only at glutamate concentrations in the mM range. Finally, the limitations of current biosensors in monitoring glutamate transients is simulated and used to illustrate the need for optimized biosensors to report glutamate signaling accurately on a subsecond time scale. This work demonstrates how a detailed model can be used to guide optimization of electroenzymatic sensors similar to that for glutamate and to ensure appropriate interpretation of data gathered using such biosensors.

Basolateral Amygdala to Orbitofrontal Cortex Projections Enable Cue-Triggered Reward Expectations

To make an appropriate decision, one must anticipate potential future rewarding events, even when they are not readily observable. These expectations are generated by using observable information (e.g., stimuli or available actions) to retrieve often quite detailed memories of available rewards. The basolateral amygdala (BLA) and orbitofrontal cortex (OFC) are two reciprocally connected key nodes in the circuitry supporting such outcome-guided behaviors. But there is much unknown about the contribution of this circuit to decision making, and almost nothing known about the whether any contribution is via direct, monosynaptic projections, or the direction of information transfer. Therefore, here we used designer receptor-mediated inactivation of OFC→BLA or BLA→OFC projections to evaluate their respective contributions to outcome-guided behaviors in rats. Inactivation of BLA terminals in the OFC, but not OFC terminals in the BLA, disrupted the selective motivating influence of cue-triggered reward representations over reward-seeking decisions as assayed by Pavlovian-to-instrumental transfer. BLA→OFC projections were also required when a cued reward representation was used to modify Pavlovian conditional goal-approach responses according to the reward's current value. These projections were not necessary when actions were guided by reward expectations generated based on learned action-reward contingencies, or when rewards themselves, rather than stored memories, directed action. These data demonstrate that BLA→OFC projections enable the cue-triggered reward expectations that can motivate the execution of specific action plans and allow adaptive conditional responding.SIGNIFICANCE STATEMENT Deficits anticipating potential future rewarding events are associated with many psychiatric diseases. Presently, we know little about the neural circuits supporting such reward expectation. Here we show that basolateral amygdala to orbitofrontal cortex projections are required for expectations of specific available rewards to influence reward seeking and decision making. The necessity of these projections was limited to situations in which expectations were elicited by reward-predictive cues. These projections therefore facilitate adaptive behavior by enabling the orbitofrontal cortex to use environmental stimuli to generate expectations of potential future rewarding events.

Amygdala mu-opioid receptors mediate the motivating influence of cue-triggered reward expectations

Environmental reward-predictive stimuli can retrieve from memory a specific reward expectation that allows them to motivate action and guide choice. This process requires the basolateral amygdala (BLA), but little is known about the signaling systems necessary within this structure. Here we examined the role of the neuromodulatory opioid receptor system in the BLA in such cue-directed action using the outcome-specific Pavlovian-to-instrumental transfer (PIT) test in rats. Inactivation of BLA mu-, but not delta-opioid receptors was found to dose-dependently attenuate the ability of a reward-predictive cue to selectively invigorate the performance of actions directed at the same unique predicted reward (i.e. to express outcome-specific PIT). BLA mu-opioid receptor inactivation did not affect the ability of a reward itself to similarly motivate action (outcome-specific reinstatement), suggesting a more selective role for the BLA mu-opioid receptor in the motivating influence of currently unobservable rewarding events. These data reveal a new role for BLA mu-opioid receptor activation in the cued recall of precise reward memories and the use of this information to motivate specific action plans.

Modulation of cue-triggered reward seeking by cholinergic signaling in the dorsomedial striatum

The dorsomedial striatum (DMS) has been strongly implicated in flexible, outcome-based decision making, including the outcome-specific Pavlovian-to-instrumental transfer effect (PIT), which measures the tendency for a reward-predictive cue to preferentially motivate actions that have been associated with the predicted reward over actions associated with different rewards. Although the neurochemical underpinnings of this effect are not well understood, there is growing evidence that striatal acetylcholine signaling may play an important role. This study investigated this hypothesis by assessing the effects of intra-DMS infusions of the nicotinic antagonist mecamylamine or the muscarinic antagonist scopolamine on expression of specific PIT in rats. These treatments produced dissociable behavioral effects. Mecamylamine infusions enhanced rats' tendency to use specific cue-elicited outcome expectations to select whichever action was trained with the predicted outcome, relative to their performance when tested after vehicle infusions. In contrast, scopolamine infusions appeared to render instrumental performance insensitive to this motivational influence of reward-paired cues. These drug treatments had no detectable effect on conditioned food cup approach behavior, indicating that they selectively perturbed cue-guided action selection without producing more wide-ranging alterations in behavioral control. Our findings reveal an important role for DMS acetylcholine signaling in modulating the impact of cue-evoked reward expectations on instrumental action selection.

Nucleus Accumbens Acetylcholine Receptors Modulate Dopamine and Motivation

Environmental reward-predictive cues can motivate reward-seeking behaviors. Although this influence is normally adaptive, it can become maladaptive in disordered states, such as addiction. Dopamine release in the nucleus accumbens core (NAc) is known to mediate the motivational impact of reward-predictive cues, but little is known about how other neuromodulatory systems contribute to cue-motivated behavior. Here, we examined the role of the NAc cholinergic receptor system in cue-motivated behavior using a Pavlovian-to-instrumental transfer task designed to assess the motivating influence of a reward-predictive cue over an independently-trained instrumental action. Disruption of NAc muscarinic acetylcholine receptor activity attenuated, whereas blockade of nicotinic receptors augmented cue-induced invigoration of reward seeking. We next examined a potential dopaminergic mechanism for this behavioral effect by combining fast-scan cyclic voltammetry with local pharmacological acetylcholine receptor manipulation. The data show evidence of opposing modulation of cue-evoked dopamine release, with muscarinic and nicotinic receptor antagonists causing suppression and augmentation, respectively, consistent with the behavioral effects of these manipulations. In addition to demonstrating cholinergic modulation of naturally-evoked and behaviorally-relevant dopamine signaling, these data suggest that NAc cholinergic receptors may gate the expression of cue-motivated behavior through modulation of phasic dopamine release.

Nucleus accumbens core dopamine signaling tracks the need-based motivational value of food-paired cues

Environmental reward-predictive stimuli provide a major source of motivation for instrumental reward-seeking activity and this has been linked to dopamine signaling in the nucleus accumbens (NAc) core. This cue-induced incentive motivation can be quite general, not restricted to instrumental actions that earn the same unique reward, and is also typically regulated by one's current need state, such that cues only motivate actions when this is adaptive. But it remains unknown whether cue-evoked dopamine signaling is similarly regulated by need state. Here, we used fast-scan cyclic voltammetry to monitor dopamine concentration changes in the NAc core of rats during a Pavlovian-to-instrumental transfer task in which the motivating influence of two cues, each signaling a distinct food reward (sucrose or food pellets), over an action earning a third unique food reward (polycose) was assessed in a state of hunger and of satiety. Both cues elicited a robust NAc dopamine response when hungry. The magnitude of the sucrose cue-evoked dopamine response correlated with the Pavlovian-to-instrumental transfer effect that was selectively induced by this stimulus. Satiety attenuated these cue-evoked dopamine responses and behavioral responding, even though rats had never experienced the specific food rewards in this state. These data demonstrate that cue-evoked NAc core responses are sensitive to current need state, one critical variable that determines the current adaptive utility of cue-motivated behavior. Food-predictive stimuli motivate food-seeking behavior. Here, we show that food cues evoke a robust nucleus accumbens core dopamine response when hungry that correlates with the cue's ability to invigorate general food seeking. This response is attenuated when sated, demonstrating that food cue-evoked accumbens dopamine responses are sensitive to the need state information that determines the current adaptive utility of cue-motivated action.

The Origins and Organization of Vertebrate Pavlovian Conditioning

Pavlovian conditioning is the process by which we learn relationships between stimuli and thus constitutes a basic building block for how the brain constructs representations of the world. We first review the major concepts of Pavlovian conditioning and point out many of the pervasive misunderstandings about just what conditioning is. This brings us to a modern redefinition of conditioning as the process whereby experience with a conditional relationship between stimuli bestows these stimuli with the ability to promote adaptive behavior patterns that did not occur before the experience. Working from this framework, we provide an in-depth analysis of two examples, fear conditioning and food-based appetitive conditioning, which include a description of the only partially overlapping neural circuitry of each. We also describe how these circuits promote the basic characteristics that define Pavlovian conditioning, such as error-correction-driven regulation of learning.

The basolateral amygdala in reward learning and addiction

Sophisticated behavioral paradigms partnered with the emergence of increasingly selective techniques to target the basolateral amygdala (BLA) have resulted in an enhanced understanding of the role of this nucleus in learning and using reward information. Due to the wide variety of behavioral approaches many questions remain on the circumscribed role of BLA in appetitive behavior. In this review, we integrate conclusions of BLA function in reward-related behavior using traditional interference techniques (lesion, pharmacological inactivation) with those using newer methodological approaches in experimental animals that allow in vivo manipulation of cell type-specific populations and neural recordings. Secondly, from a review of appetitive behavioral tasks in rodents and monkeys and recent computational models of reward procurement, we derive evidence for BLA as a neural integrator of reward value, history, and cost parameters. Taken together, BLA codes specific and temporally dynamic outcome representations in a distributed network to orchestrate adaptive responses. We provide evidence that experiences with opiates and psychostimulants alter these outcome representations in BLA, resulting in long-term modified action.