Nicotinic receptors in the ventral tegmental area promote uncertainty-seeking

Mesolimbic Neural Response Dynamics Predict Future Individual Alcohol Drinking in Mice

BACKGROUND

Individual variability in response to rewarding stimuli is a striking but understudied phenomenon. The mesolimbic dopamine system is critical in encoding the reinforcing properties of both natural reward and alcohol; however, how innate or baseline differences in the response dynamics of this circuit define individual behavior and shape future vulnerability to alcohol remain unknown.

METHODS

Using naturalistic behavioral assays, a voluntary alcohol drinking paradigm, in vivo fiber photometry, in vivo electrophysiology, and chemogenetics, we investigated how differences in mesolimbic neural circuit activity contribute to the individual variability seen in reward processing and, by proxy, alcohol drinking.

RESULTS

We first characterized heterogeneous behavioral and neural responses to natural reward and defined how these baseline responses predicted future individual alcohol-drinking phenotypes in male mice. We then determined spontaneous ventral tegmental area dopamine neuron firing profiles associated with responses to natural reward that predicted alcohol drinking. Using a dual chemogenetic approach, we mimicked specific mesolimbic dopamine neuron firing activity before or during voluntary alcohol drinking to link unique neurophysiological profiles to individual phenotype. We show that hyperdopaminergic individuals exhibit a lower neuronal response to both natural reward and alcohol that predicts lower levels of alcohol consumption in the future.

CONCLUSIONS

These findings reveal unique, circuit-specific neural signatures that predict future individual vulnerability or resistance to alcohol and expand the current knowledge base on how some individuals are able to titrate their alcohol consumption whereas others go on to engage in unhealthy alcohol-drinking behaviors.

Protocol for implementing medial forebrain bundle stimulation as a reward for perceptual tasks in mice

Training mice to perform perceptual tasks is a vital part of integrative neuroscience. Replacing classical rewards like water with medial forebrain bundle (MFB) stimulation allows experimenters to avoid deprivation and obtain higher trial numbers per session. Here, we provide a protocol for implementing MFB-based reward in mice. We describe steps for MFB electrode implantation, efficacy testing, and stimulation calibration. After these steps, MFB reward can be used to facilitate sensory discrimination task training and enable nuanced characterization of psychophysical abilities. For complete details on the use and execution of this protocol, please refer to Verdier et al. (2022).1.

Aging, uncertainty, and decision making-A review

There is a great deal of uncertainty in the world. One common source of uncertainty results from incomplete or missing information about probabilistic outcomes (i.e., outcomes that may occur), which influences how people make decisions. The impact of this type of uncertainty may particularly pronounced for older adults, who, as the primary leaders around the world, make highly impactful decisions with lasting outcomes. This review examines the ways in which uncertainty about probabilistic outcomes is perceived, handled, and represented in the aging brain, with an emphasis on how uncertainty may specifically affect decision making in later life. We describe the role of uncertainty in decision making and aging from four perspectives, including 1) theoretical, 2) self-report, 3) behavioral, and 4) neuroscientific. We report evidence of any age-related differences in uncertainty among these contexts and describe how these changes may affect decision making. We then integrate the findings across the distinct perspectives, followed by a discussion of important future directions for research on aging and uncertainty, including prospection, domain-specificity in risk-taking behaviors, and choice overload.

Dopaminergic and prefrontal dynamics co-determine mouse decisions in a spatial gambling task

The neural mechanisms by which animals initiate goal-directed actions, choose between options, or explore opportunities remain unknown. Here, we develop a spatial gambling task in which mice, to obtain intracranial self-stimulation rewards, self-determine the initiation, direction, vigor, and pace of their actions based on their knowledge of the outcomes. Using electrophysiological recordings, pharmacology, and optogenetics, we identify a sequence of oscillations and firings in the ventral tegmental area (VTA), orbitofrontal cortex (OFC), and prefrontal cortex (PFC) that co-encodes and co-determines self-initiation and choices. This sequence appeared with learning as an uncued realignment of spontaneous dynamics. Interactions between the structures varied with the reward context, particularly the uncertainty associated with the different options. We suggest that self-generated choices arise from a distributed circuit based on an OFC-VTA core determining whether to wait for or initiate actions, while the PFC is specifically engaged by reward uncertainty in action selection and pace.

β2 nAChR Activation on VTA DA Neurons Is Sufficient for Nicotine Reinforcement in Rats

Mesolimbic nicotinic acetylcholine receptor (nAChRs) activation is necessary for nicotine reinforcement behavior, but it is unknown whether selective activation of nAChRs in the dopamine (DA) reward pathway is sufficient to support nicotine reinforcement. In this study, we tested the hypothesis that activation of β2-containing (β2*) nAChRs on VTA neurons is sufficient for intravenous nicotine self-administration (SA). We expressed β2 nAChR subunits with enhanced sensitivity to nicotine (referred to as β2Leu9'Ser) in the VTA of male Sprague Dawley (SD) rats, enabling very low concentrations of nicotine to selectively activate β2* nAChRs on transduced neurons. Rats expressing β2Leu9'Ser subunits acquired nicotine SA at 1.5 μg/kg/infusion, a dose too low to support acquisition in control rats. Saline substitution extinguished responding for 1.5 μg/kg/inf, verifying that this dose was reinforcing. β2Leu9'Ser nAChRs also supported acquisition at the typical training dose in rats (30 μg/kg/inf) and reducing the dose to 1.5 μg/kg/inf caused a significant increase in the rate of nicotine SA. Viral expression of β2Leu9'Ser subunits only in VTA DA neurons (via TH-Cre rats) also enabled acquisition of nicotine SA at 1.5 μg/kg/inf, and saline substitution significantly attenuated responding. Next, we examined electrically-evoked DA release in slices from β2Leu9'Ser rats with a history of nicotine SA. Single-pulse evoked DA release and DA uptake rate were reduced in β2Leu9'Ser NAc slices, but relative increases in DA following a train of stimuli were preserved. These results are the first to report that β2* nAChR activation on VTA neurons is sufficient for nicotine reinforcement in rats.

Enhanced perceptual task performance without deprivation in mice using medial forebrain bundle stimulation

Perceptual decision-making tasks are essential to many fields of neuroscience. Current protocols generally reward deprived animals with water. However, balancing animals' deprivation level with their well-being is challenging, and trial number is limited by satiation. Here, we present electrical stimulation of the medial forebrain bundle (MFB) as an alternative that avoids deprivation while yielding stable motivation for thousands of trials. Using licking or lever press as a report, MFB animals learnt auditory discrimination tasks at similar speed to water-deprived mice. Moreover, they more reliably reached higher accuracy in harder tasks, performing up to 4,500 trials per session without loss of motivation. MFB stimulation did not impact the underlying sensory behavior since psychometric parameters and response times are preserved. MFB mice lacked signs of metabolic or behavioral stress compared with water-deprived mice. Overall, MFB stimulation is a highly promising tool for task learning because it enhances task performance while avoiding deprivation.

Design Principles for Neurorobotics

In their book “How the Body Shapes the Way We Think: A New View of Intelligence,” Pfeifer and Bongard put forth an embodied approach to cognition. Because of this position, many of their robot examples demonstrated “intelligent” behavior despite limited neural processing. It is our belief that neurorobots should attempt to follow many of these principles. In this article, we discuss a number of principles to consider when designing neurorobots and experiments using robots to test brain theories. These principles are strongly inspired by Pfeifer and Bongard, but build on their design principles by grounding them in neuroscience and by adding principles based on neuroscience research. Our design principles fall into three categories. First, organisms must react quickly and appropriately to events. Second, organisms must have the ability to learn and remember over their lifetimes. Third, organisms must weigh options that are crucial for survival. We believe that by following these design principles a robot's behavior will be more naturalistic and more successful.

Rational arbitration between statistics and rules in human sequence processing

Detecting and learning temporal regularities is essential to accurately predict the future. A long-standing debate in cognitive science concerns the existence in humans of a dissociation between two systems, one for handling statistical regularities governing the probabilities of individual items and their transitions, and another for handling deterministic rules. Here, to address this issue, we used finger tracking to continuously monitor the online build-up of evidence, confidence, false alarms and changes-of-mind during sequence processing. All these aspects of behaviour conformed tightly to a hierarchical Bayesian inference model with distinct hypothesis spaces for statistics and rules, yet linked by a single probabilistic currency. Alternative models based either on a single statistical mechanism or on two non-commensurable systems were rejected. Our results indicate that a hierarchical Bayesian inference mechanism, capable of operating over distinct hypothesis spaces for statistics and rules, underlies the human capability for sequence processing.

Social Determinants of Inter-Individual Variability and Vulnerability: The Role of Dopamine

Individuals differ in their traits and preferences, which shape their interactions, their prospects for survival and their susceptibility to diseases. These correlations are well documented, yet the neurophysiological mechanisms underlying the emergence of distinct personalities and their relation to vulnerability to diseases are poorly understood. Social ties, in particular, are thought to be major modulators of personality traits and psychiatric vulnerability, yet the majority of neuroscience studies are performed on rodents in socially impoverished conditions. Rodent micro-society paradigms are therefore key experimental paradigms to understand how social life generates diversity by shaping individual traits. Dopamine circuitry is implicated at the interface between social life experiences, the expression of essential traits, and the emergence of pathologies, thus proving a possible mechanism to link these three concepts at a neuromodulatory level. Evaluating inter-individual variability in automated social testing environments shows great promise for improving our understanding of the link between social life, personality, and precision psychiatry – as well as elucidating the underlying neurophysiological mechanisms.

Seeking motivation and reward: roles of dopamine, hippocampus and supramammillo-septal pathway

Reinforcement learning and goal-seeking behavior are thought to be mediated by midbrain dopamine neurons. However, little is known about neural substrates of curiosity and exploratory behavior, which occur in the absence of clear goal or reward. This is despite behavioral scientists having long suggested that curiosity and exploratory behaviors are regulated by an innate drive. We refer to such behavior as information-seeking behavior and propose 1) key neural substrates and 2) the concept of environment prediction error as a framework to understand information-seeking processes. The cognitive aspect of information-seeking behavior, including the perception of salience and uncertainty, involves, in part, the pathways from the posterior hypothalamic supramammillary region to the hippocampal formation. The vigor of such behavior is modulated by the following: supramammillary glutamatergic neurons; their projections to medial septal glutamatergic neurons; and the projections of medial septal glutamatergic neurons to ventral tegmental dopaminergic neurons. Phasic responses of dopaminergic neurons are characterized as signaling potentially important stimuli rather than rewards. This paper describes how novel stimuli and uncertainty trigger seeking motivation and how these neural substrates modulate information-seeking behavior.

Neurobiological Mechanisms of Nicotine Reward and Aversion

Neuronal nicotinic acetylcholine receptors (nAChRs) regulate the rewarding actions of nicotine contained in tobacco that establish and maintain the smoking habit. nAChRs also regulate the aversive properties of nicotine, sensitivity to which decreases tobacco use and protects against tobacco use disorder. These opposing behavioral actions of nicotine reflect nAChR expression in brain reward and aversion circuits. nAChRs containing α4 and β2 subunits are responsible for the high-affinity nicotine binding sites in the brain and are densely expressed by reward-relevant neurons, most notably dopaminergic, GABAergic, and glutamatergic neurons in the ventral tegmental area. High-affinity nAChRs can incorporate additional subunits, including β3, α6, or α5 subunits, with the resulting nAChR subtypes playing discrete and dissociable roles in the stimulatory actions of nicotine on brain dopamine transmission. nAChRs in brain dopamine circuits also participate in aversive reactions to nicotine and the negative affective state experienced during nicotine withdrawal. nAChRs containing α3 and β4 subunits are responsible for the low-affinity nicotine binding sites in the brain and are enriched in brain sites involved in aversion, including the medial habenula, interpeduncular nucleus, and nucleus of the solitary tract, brain sites in which α5 nAChR subunits are also expressed. These aversion-related brain sites regulate nicotine avoidance behaviors, and genetic variation that modifies the function of nAChRs in these sites increases vulnerability to tobacco dependence and smoking-related diseases. Here, we review the molecular, cellular, and circuit-level mechanisms through which nicotine elicits reward and aversion and the adaptations in these processes that drive the development of nicotine dependence. SIGNIFICANCE STATEMENT: Tobacco use disorder in the form of habitual cigarette smoking or regular use of other tobacco-related products is a major cause of death and disease worldwide. This article reviews the actions of nicotine in the brain that contribute to tobacco use disorder.

Chronic nicotine increases midbrain dopamine neuron activity and biases individual strategies towards reduced exploration in mice

Long-term exposure to nicotine alters brain circuits and induces profound changes in decision-making strategies, affecting behaviors both related and unrelated to drug seeking and consumption. Using an intracranial self-stimulation reward-based foraging task, we investigated in mice the impact of chronic nicotine on midbrain dopamine neuron activity and its consequence on the trade-off between exploitation and exploration. Model-based and archetypal analysis revealed substantial inter-individual variability in decision-making strategies, with mice passively exposed to nicotine shifting toward a more exploitative profile compared to non-exposed animals. We then mimicked the effect of chronic nicotine on the tonic activity of dopamine neurons using optogenetics, and found that photo-stimulated mice adopted a behavioral phenotype similar to that of mice exposed to chronic nicotine. Our results reveal a key role of tonic midbrain dopamine in the exploration/exploitation trade-off and highlight a potential mechanism by which nicotine affects the exploration/exploitation balance and decision-making.

Smoking status links habenular volume to glycated hemoglobin: Findings from the Human Connectome Project-Young Adult

BACKGROUND

The habenula-pancreas axis regulates the stimulatory effects of nicotine on blood glucose levels and may participate in the emergence of type 2 diabetes in human tobacco smokers. This secondary analysis of young adults from the Human Connectome Project (HCP-YA) evaluated whether smoking status links the relationship between habenular volume and glycated hemoglobin (HbA1c), a marker of long-term glycemic control.

METHODS

Habenula segmentation was performed using a fully-automated myelin content-based approach in HCP-YA participants and the results were inspected visually (n = 693; aged 22-37 years). A linear regression analysis was used with habenular volume as the dependent variable, the smoking-by-HbA1c interaction as the independent variable of interest, and age, gender, race, ethnicity, education, income, employment status, body mass index, and total gray matter volume as covariates.

RESULTS

Habenula volume and HbA1c were similar in smokers and nonsmokers. There was a significant interaction effect (F_{(1, 673)}= 5.03, p = 0.025) indicating that habenular volume was related to HbA1c in a manner that depended on smoking status. Among participants who were smokers (n = 120), higher HbA1c was associated with apparently larger habenular volume (β = 6.74, standard error=2.36, p = 0.005). No such association between habenular volume and HbA1c was noted among participants who were nonsmokers (n = 573).

DISCUSSION

Blood glucose levels over an extended time period, reflected by HbA1c, were correlated with habenular volume in smokers, consistent with a relationship between the habenula and blood glucose homeostasis in smokers. Future studies are needed to evaluate how habenular function relates to glycemic control in smokers and nonsmokers.

Cholinergic and dopaminergic effects on prediction error and uncertainty responses during sensory associative learning

Navigating the physical world requires learning probabilistic associations between sensory events and their change in time (volatility). Bayesian accounts of this learning process rest on hierarchical prediction errors (PEs) that are weighted by estimates of uncertainty (or its inverse, precision). In a previous fMRI study we found that low-level precision-weighted PEs about visual outcomes (that update beliefs about associations) activated the putative dopaminergic midbrain; by contrast, precision-weighted PEs about cue-outcome associations (that update beliefs about volatility) activated the cholinergic basal forebrain. These findings suggested selective dopaminergic and cholinergic influences on precision-weighted PEs at different hierarchical levels. Here, we tested this hypothesis, repeating our fMRI study under pharmacological manipulations in healthy participants. Specifically, we performed two pharmacological fMRI studies with a between-subject double-blind placebo-controlled design: study 1 used antagonists of dopaminergic (amisulpride) and muscarinic (biperiden) receptors, study 2 used enhancing drugs of dopaminergic (levodopa) and cholinergic (galantamine) modulation. Pooled across all pharmacological conditions of study 1 and study 2, respectively, we found that low-level precision-weighted PEs activated the midbrain and high-level precision-weighted PEs the basal forebrain as in our previous study. However, we found pharmacological effects on brain activity associated with these computational quantities only when splitting the precision-weighted PEs into their PE and precision components: in a brainstem region putatively containing cholinergic (pedunculopontine and laterodorsal tegmental) nuclei, biperiden (compared to placebo) enhanced low-level PE responses and attenuated high-level PE activity, while amisulpride reduced high-level PE responses. Additionally, in the putative dopaminergic midbrain, galantamine compared to placebo enhanced low-level PE responses (in a body-weight dependent manner) and amisulpride enhanced high-level precision activity. Task behaviour was not affected by any of the drugs. These results do not support our hypothesis of a clear-cut dichotomy between different hierarchical inference levels and neurotransmitter systems, but suggest a more complex interaction between these neuromodulatory systems and hierarchical Bayesian quantities. However, our present results may have been affected by confounds inherent to pharmacological fMRI. We discuss these confounds and outline improved experimental tests for the future.

Distinct Temporal Structure of Nicotinic ACh Receptor Activation Determines Responses of VTA Neurons to Endogenous ACh and Nicotine

The addictive component of tobacco, nicotine, acts via nicotinic acetylcholine receptors (nAChRs). The β2 subunit-containing nAChRs (β2-nAChRs) play a crucial role in the rewarding properties of nicotine and are particularly densely expressed in the mesolimbic dopamine (DA) system. Specifically, nAChRs directly and indirectly affect DA neurons in the ventral tegmental area (VTA). The understanding of ACh and nicotinic regulation of DA neuron activity is incomplete. By computational modeling, we provide mechanisms for several apparently contradictory experimental results. First, systemic knockout of β2-containing nAChRs drastically reduces DA neurons bursting, although the major glutamatergic (Glu) afferents that have been shown to evoke this bursting stay intact. Second, the most intuitive way to rescue this bursting—by re-expressing the nAChRs on VTA DA neurons—fails. Third, nAChR re-expression on VTA GABA neurons rescues bursting in DA neurons and increases their firing rate under the influence of ACh input, whereas nicotinic application results in the opposite changes in firing. Our model shows that, first, without ACh receptors, Glu excitation of VTA DA and GABA neurons remains balanced and GABA inhibition cancels the direct excitation. Second, re-expression of ACh receptors on DA neurons provides an input that impedes membrane repolarization and is ineffective in restoring firing of DA neurons. Third, the distinct responses to ACh and nicotine occur because of distinct temporal patterns of these inputs: pulsatile versus continuous. Altogether, this study highlights how β2-nAChRs influence coactivation of the VTA DA and GABA neurons required for motivation and saliency signals carried by DA neuron activity.

Noradrenergic But Not Dopaminergic Neurons Signal Task State Changes and Predict Reengagement After a Failure

The two catecholamines, noradrenaline and dopamine, have been shown to play comparable roles in behavior. Both noradrenergic and dopaminergic neurons respond to cues predicting reward availability and novelty. However, even though both are thought to be involved in motivating actions, their roles in motivation have seldom been directly compared. We therefore examined the activity of putative noradrenergic neurons in the locus coeruleus and putative midbrain dopaminergic neurons in monkeys cued to perform effortful actions for rewards. The activity in both regions correlated with engagement with a presented option. By contrast, only noradrenaline neurons were also (i) predictive of engagement in a subsequent trial following a failure to engage and (ii) more strongly activated in nonrepeated trials, when cues indicated a new task condition. This suggests that while both catecholaminergic neurons are involved in promoting action, noradrenergic neurons are sensitive to task state changes, and their influence on behavior extends beyond the immediately rewarded action.

Neuromodulated attention and goal-driven perception in uncertain domains

In uncertain domains, the goals are often unknown and need to be predicted by the organism or system. In this paper, contrastive Excitation Backprop (c-EB) was used in two goal-driven perception tasks - one with pairs of noisy MNIST digits and the other with a robot in an action-based attention scenario. The first task included attending to even, odd, low, and high digits, whereas the second task included action goals, such as "eat", "work-on-computer", "read", and "say-hi" that led to attention to objects associated with those actions. The system needed to increase attention to target items and decrease attention to distractor items and background noise. Because the valid goal was unknown, an online learning model based on the cholinergic and noradrenergic neuromodulatory systems was used to predict a noisy goal (expected uncertainty) and re-adapt when the goal changed (unexpected uncertainty). This neurobiologically plausible model demonstrates how neuromodulatory systems can predict goals in uncertain domains and how attentional mechanisms can enhance the perception for that goal.

Mice adaptively generate choice variability in a deterministic task

Can decisions be made solely by chance? Can variability be intrinsic to the decision-maker or is it inherited from environmental conditions? To investigate these questions, we designed a deterministic setting in which mice are rewarded for non-repetitive choice sequences, and modeled the experiment using reinforcement learning. We found that mice progressively increased their choice variability. Although an optimal strategy based on sequences learning was theoretically possible and would be more rewarding, animals used a pseudo-random selection which ensures high success rate. This was not the case if the animal is exposed to a uniform probabilistic reward delivery. We also show that mice were blind to changes in the temporal structure of reward delivery once they learned to choose at random. Overall, our results demonstrate that a decision-making process can self-generate variability and randomness, even when the rules governing reward delivery are neither stochastic nor volatile.

Dopamine blockade impairs the exploration-exploitation trade-off in rats

In a volatile environment where rewards are uncertain, successful performance requires a delicate balance between exploitation of the best option and exploration of alternative choices. It has theoretically been proposed that dopamine contributes to the control of this exploration-exploitation trade-off, specifically that the higher the level of tonic dopamine, the more exploitation is favored. We demonstrate here that there is a formal relationship between the rescaling of dopamine positive reward prediction errors and the exploration-exploitation trade-off in simple non-stationary multi-armed bandit tasks. We further show in rats performing such a task that systemically antagonizing dopamine receptors greatly increases the number of random choices without affecting learning capacities. Simulations and comparison of a set of different computational models (an extended Q-learning model, a directed exploration model, and a meta-learning model) fitted on each individual confirm that, independently of the model, decreasing dopaminergic activity does not affect learning rate but is equivalent to an increase in random exploration rate. This study shows that dopamine could adapt the exploration-exploitation trade-off in decision-making when facing changing environmental contingencies.

Minimal Circuit Model of Reward Prediction Error Computations and Effects of Nicotinic Modulations

Dopamine (DA) neurons in the ventral tegmental area (VTA) are thought to encode reward prediction errors (RPE) by comparing actual and expected rewards. In recent years, much work has been done to identify how the brain uses and computes this signal. While several lines of evidence suggest the interplay of the DA and the inhibitory interneurons in the VTA implements the RPE computation, it still remains unclear how the DA neurons learn key quantities, for example the amplitude and the timing of primary rewards during conditioning tasks. Furthermore, endogenous acetylcholine and exogenous nicotine, also likely affect these computations by acting on both VTA DA and GABA (γ -aminobutyric acid) neurons via nicotinic-acetylcholine receptors (nAChRs). To explore the potential circuit-level mechanisms for RPE computations during classical-conditioning tasks, we developed a minimal computational model of the VTA circuitry. The model was designed to account for several reward-related properties of VTA afferents and recent findings on VTA GABA neuron dynamics during conditioning. With our minimal model, we showed that the RPE can be learned by a two-speed process computing reward timing and magnitude. By including models of nAChR-mediated currents in the VTA DA-GABA circuit, we showed that nicotine should reduce the acetylcholine action on the VTA GABA neurons by receptor desensitization and potentially boost DA responses to reward-related signals in a non-trivial manner. Together, our results delineate the mechanisms by which RPE are computed in the brain, and suggest a hypothesis on nicotine-mediated effects on reward-related perception and decision-making.

Nicotine and alcohol: the role of midbrain dopaminergic neurons in drug reinforcement

Nicotine and alcohol addiction are leading causes of preventable death worldwide and continue to constitute a huge socio-economic burden. Both nicotine and alcohol perturb the brain's mesocorticolimbic system. Dopamine (DA) neurons projecting from the ventral tegmental area (VTA) to multiple downstream structures, including the nucleus accumbens, prefrontal cortex, and amygdala, are highly involved in the maintenance of healthy brain function. VTA DA neurons play a crucial role in associative learning and reinforcement. Nicotine and alcohol usurp these functions, promoting reinforcement of drug taking behaviors. In this review, we will first describe how nicotine and alcohol individually affect VTA DA neurons by examining how drug exposure alters the heterogeneous VTA microcircuit and network-wide projections. We will also examine how coadministration or previous exposure to nicotine or alcohol may augment the reinforcing effects of the other. Additionally, this review briefly summarizes the role of VTA DA neurons in nicotine, alcohol, and their synergistic effects in reinforcement and also addresses the remaining questions related to the circuit-function specificity of the dopaminergic system in mediating nicotine/alcohol reinforcement and comorbidity.

Manipulating midbrain dopamine neurons and reward-related behaviors with light-controllable nicotinic acetylcholine receptors

Dopamine (DA) neurons of the ventral tegmental area (VTA) integrate cholinergic inputs to regulate key functions such as motivation and goal-directed behaviors. Yet the temporal dynamic range and mechanism of action of acetylcholine (ACh) on the modulation of VTA circuits and reward-related behaviors are not known. Here, we used a chemical-genetic approach for rapid and precise optical manipulation of nicotinic neurotransmission in VTA neurons in living mice. We provide direct evidence that the ACh tone fine-tunes the firing properties of VTA DA neurons through β2-containing (β2*) nicotinic ACh receptors (nAChRs). Furthermore, locally photo-antagonizing these receptors in the VTA was sufficient to reversibly switch nicotine reinforcement on and off. By enabling control of nicotinic transmission in targeted brain circuits, this technology will help unravel the various physiological functions of nAChRs and may assist in the design of novel therapies relevant to neuropsychiatric disorders.

Social interactions impact on the dopaminergic system and drive individuality

Individuality is a striking feature of animal behavior. Individual animals differ in traits and preferences which shape their interactions and their prospects for survival. However, the mechanisms underlying behavioral individuation are poorly understood and are generally considered to be genetic-based. Here, we devised a large environment, Souris City, in which mice live continuously in large groups. We observed the emergence of individual differences in social behavior, activity levels, and cognitive traits, even though the animals had low genetic diversity (inbred C57BL/6J strain). We further show that the phenotypic divergence in individual behaviors was mirrored by developing differences in midbrain dopamine neuron firing properties. Strikingly, modifying the social environment resulted in a fast re-adaptation of both the animal's traits and its dopamine firing pattern. Individuality can rapidly change upon social challenges, and does not just depend on the genetic status or the accumulation of small differences throughout development.

Genetic inhibition of neurotransmission reveals role of glutamatergic input to dopamine neurons in high-effort behavior

Midbrain dopamine neurons are crucial for many behavioral and cognitive functions. As the major excitatory input, glutamatergic afferents are important for control of the activity and plasticity of dopamine neurons. However, the role of glutamatergic input as a whole onto dopamine neurons remains unclear. Here we developed a mouse line in which glutamatergic inputs onto dopamine neurons are specifically impaired, and utilized this genetic model to directly test the role of glutamatergic inputs in dopamine-related functions. We found that while motor coordination and reward learning were largely unchanged, these animals showed prominent deficits in effort-related behavioral tasks. These results provide genetic evidence that glutamatergic transmission onto dopaminergic neurons underlies incentive motivation, a willingness to exert high levels of effort to obtain reinforcers, and have important implications for understanding the normal function of the midbrain dopamine system.

[Optically dissecting brain nicotinic receptor function with photo-controllable designer receptors]

Nicotinic acetylcholine receptors (nAChRs) are pentameric ligand-gated ion channels widely expressed in the central nervous system and the periphery. They play an important modulatory role in learning, memory and attention, and have been implicated in various diseases such as Alzheimer's disease, Parkinson's disease, epilepsy, schizophrenia and addiction. These receptors are activated by the endogenous neurotransmitter acetylcholine, or by nicotine, the alkaloid found in tobacco leaves. Both molecules open the ion channel and cause the movement of cations across the membrane, which directly affects neuronal excitability and synaptic plasticity. nAChRs are very heterogeneous in their subunit composition (α2-10 et β2-4), in their brain distribution (cortex, midbrain, striatum…) and in their sub-cellular localization (pre- vs post-synaptic, axonal, dendritic…). This heterogeneity highly contributes to the very diverse roles these receptors have in health and disease. The ability to activate or block a specific nAChR subtype, at a defined time and space within the brain, would greatly help obtaining a clearer picture of these various functions. To this aim, we are developing novel optogenetic pharmacology strategies for optically controlling endogenous nAChR isoforms within the mouse brain. The idea is to tether a chemical photoswitch on the surface of a cysteine-modified nAChR, and use light for rapidly and reversibly turning that receptor mutant on and off. Here we will discuss the history of optogenetic pharmacology, and the recent advances for the optical control of brain nicotinic receptors in vivo.

Effects of nicotine on homeostatic and hedonic components of food intake

Chronic tobacco use leads to nicotine addiction that is characterized by exaggerated urges to use the drug despite the accompanying negative health and socioeconomic burdens. Interestingly, nicotine users are found to be leaner than the general population. Review of the existing literature revealed that nicotine affects energy homeostasis and food consumption via altering the activity of neurons containing orexigenic and anorexigenic peptides in the brain. Hypothalamus is one of the critical brain areas that regulates energy balance via the action of these neuropeptides. The equilibrium between these two groups of peptides can be shifted by nicotine leading to decreased food intake and weight loss. The aim of this article is to review the existing literature on the effect of nicotine on food intake and energy homeostasis and report on the changes that nicotine brings about in the level of these peptides and their receptors that may explain changes in food intake and body weight induced by nicotine. Furthermore, we review the effect of nicotine on the hedonic aspect of food intake. Finally, we discuss the involvement of different subtypes of nicotinic acetylcholine receptors in the regulatory action of nicotine on food intake and energy homeostasis.

A Primer on Foraging and the Explore/Exploit Trade-Off for Psychiatry Research

Foraging is a fundamental behavior, and many types of animals appear to have solved foraging problems using a shared set of mechanisms. Perhaps the most common foraging problem is the choice between exploiting a familiar option for a known reward and exploring unfamiliar options for unknown rewards-the so-called explore/exploit trade-off. This trade-off has been studied extensively in behavioral ecology and computational neuroscience, but is relatively new to the field of psychiatry. Explore/exploit paradigms can offer psychiatry research a new approach to studying motivation, outcome valuation, and effort-related processes, which are disrupted in many mental and emotional disorders. In addition, the explore/exploit trade-off encompasses elements of risk-taking and impulsivity-common behaviors in psychiatric disorders-and provides a novel framework for understanding these behaviors within an ecological context. Here we explain relevant concepts and some common paradigms used to measure explore/exploit decisions in the laboratory, review clinically relevant research on the neurobiology and neuroanatomy of explore/exploit decision making, and discuss how computational psychiatry can benefit from foraging theory.

Nicotinic receptors in mouse prefrontal cortex modulate ultraslow fluctuations related to conscious processing

The prefrontal cortex (PFC) plays an important role in cognitive processes, including access to consciousness. The PFC receives significant cholinergic innervation and nicotinic acetylcholine receptors (nAChRs) contribute greatly to the effects of acetylcholine signaling. Using in vivo two-photon imaging of both awake and anesthetized mice, we recorded spontaneous, ongoing neuronal activity in layer II/III in the PFC of WT mice and mice deleted for different nAChR subunits. As in humans, this activity is characterized by synchronous ultraslow fluctuations and neuronal synchronicity is disrupted by light general anesthesia. Both the α7 and β2 nAChR subunits play an important role in the generation of ultraslow fluctuations that occur to a different extent during quiet wakefulness and light general anesthesia. The β2 subunit is specifically required for synchronized activity patterns. Furthermore, chronic application of mecamylamine, an antagonist of nAChRs, disrupts the generation of ultraslow fluctuations. Our findings provide new insight into the ongoing spontaneous activity in the awake and anesthetized state, and the role of cholinergic neurotransmission in the orchestration of cognitive functions.