Optogenetic Activation of Dorsal Raphe Serotonin Neurons Enhances Patience for Future Rewards

Effects of chronic stress on cognitive function - From neurobiology to intervention

Exposure to chronic stress contributes considerably to the development of cognitive impairments in psychiatric disorders such as depression, generalized anxiety disorder (GAD), obsessive-compulsive disorder (OCD), post-traumatic stress disorder (PTSD), and addictive behavior. Unfortunately, unlike mood-related symptoms, cognitive impairments are not effectively treated by available therapies, a situation in part resulting from a still incomplete knowledge of the neurobiological substrates that underly cognitive domains and the difficulty in generating interventions that are both efficacious and safe. In this review, we will present an overview of the cognitive domains affected by stress with a specific focus on cognitive flexibility, behavioral inhibition, and working memory. We will then consider the effects of stress on neuronal correlates of cognitive function and the factors which may modulate the interaction of stress and cognition. Finally, we will discuss intervention strategies for treatment of stress-related disorders and gaps in knowledge with emerging new treatments under development. Understanding how cognitive impairment occurs during exposure to chronic stress is crucial to make progress towards the development of new and effective therapeutic approaches.

Striatal Serotonin Release Signals Reward Value

Serotonin modulates diverse phenotypes and functions including depressive, aggressive, impulsive, and feeding behaviors, all of which have reward-related components. To date, research has focused on understanding these effects by measuring and manipulating dorsal raphe serotonin neurons and using single-receptor approaches. These studies have led to a better understanding of the heterogeneity of serotonin actions on behavior; however, they leave open many questions about the timing and location of serotonin's actions modulating the neural circuits that drive these behaviors. Recent advances in genetically encoded fluorescent biosensors, including the GPCR activation-based sensor for serotonin (GRAB-5-HT), enable the measurement of serotonin release in mice on a timescale compatible with a single rewarding event without corelease confounds. Given substantial evidence from slice electrophysiology experiments showing that serotonin influences neural activity of the striatal circuitry, and the known role of the dorsal medial striatal (DMS) in reward-directed behavior, we focused on understanding the parameters and timing that govern serotonin release in the DMS in the context of reward consumption, external reward value, internal state, and cued reward. Overall, we found that serotonin release is associated with each of these and encodes reward anticipation, value, approach, and consumption in the DMS.

The differential effect of optogenetic serotonergic manipulation on sustained motor actions and waiting for future rewards in mice

Serotonin is an essential neuromodulator that affects behavioral and cognitive functions. Previous studies have shown that activation of serotonergic neurons in the dorsal raphe nucleus (DRN) promotes patience to wait for future rewards. However, it is still unclear whether serotonergic neurons also regulate persistence to act for future rewards. Here we used optogenetic activation and inhibition of DRN serotonergic neurons to examine their effects on sustained motor actions for future rewards. We trained mice to perform waiting and repeated lever-pressing tasks with variable reward delays and tested effects of optogenetic activation and inhibition of DRN serotonergic neurons on task performance. Interestingly, in the lever-pressing task, mice tolerated longer delays as they repeatedly pressed a lever than in the waiting task, suggesting that lever-pressing actions may not simply be costly, but may also be subjectively rewarding. Optogenetic activation of DRN serotonergic neurons prolonged waiting duration in the waiting task, consistent with previous studies. However, its effect on lever presses was nuanced, and was detected only by focusing on the period before premature reward check and by subtracting the trends within and across sessions using generalized linear model. While optogenetic inhibition decreased waiting, it did not affect lever pressing time or numbers. These results revealed that the necessity of motor actions may increase motivation for delayed rewards and that DRN serotonergic neurons more significantly promote waiting rather than persistent motor actions for future rewards.

Revisiting serotonin's role in spatial memory: A call for sensitive analytical approaches

The serotonergic system is involved in various psychiatric and neurological conditions, with serotonergic drugs often used in treatment. These conditions frequently affect spatial memory, which can serve as a model of declarative memory due to well-known cellular components and advanced methods that track neural activity and behavior with high temporal resolution. However, most findings on serotonin's effects on spatial learning and memory come from studies lacking refined analytical techniques and modern approaches needed to uncover the underlying neuronal mechanisms. This In Focus review critically investigates available studies to identify areas for further exploration. It finds that well-established behavioral models could yield more insights with modern tracking and data analysis approaches, while the cellular aspects of spatial memory remain underexplored. The review highlights the complex role of serotonin in spatial memory, which holds the potential for better understanding and treating memory-related disorders.

Role of serotonin neurons in the dorsal raphe nucleus in heroin self-administration and punishment

One hallmark of substance use disorder is continued drug use despite negative consequences. When drug-taking behavior is punished with aversive stimuli, i.e. footshock, rats can also be categorized into punishment-resistant or compulsive vs. punishment-sensitive or non-compulsive phenotypes. The serotonin (5-hydroxytryptamine, 5-HT) system modulates responses to both reward and punishment. The goal of the current study was to examine punishment phenotypes in heroin self-administration and to determine the role of dorsal raphe nucleus (DRN) 5-HT neurons in both basal and punished heroin self-administration. First, rats were exposed to punished heroin self-administration and neuronal excitability of DRN 5-HT neurons was compared between punishment-resistant and punishment-sensitive phenotypes using ex vivo electrophysiology. Second, DRN 5-HT neuronal activity was manipulated in vivo during basal and punished heroin self-administration using chemogenetic tools in a Tph2-iCre rat line. While rats separated into punishment-resistant and punishment-sensitive phenotypes for punished heroin self-administration, DRN 5-HT neuronal excitability did not differ between the phenotypes. While chemogenetic inhibition of DRN 5-HT neurons was without effect, chemogenetic activation of DRN 5-HT neurons increased both basal and punished heroin self-administration selectively in punishment-resistant animals. Additionally, the responsiveness to chemogenetic activation of DRN 5-HT neurons in basal self-administration and motivation for heroin in progressive ratio each predicted resistance to punishment. Therefore, our data support the role for the DRN 5-HT system in compulsive heroin self-administration.

Role of the circadian nuclear receptor REV-ERBα in dorsal raphe serotonin synthesis in mood regulation

Affective disorders are frequently associated with disrupted circadian rhythms. The existence of rhythmic secretion of central serotonin (5-hydroxytryptamine, 5-HT) pattern has been reported; however, the functional mechanism underlying the circadian control of 5-HTergic mood regulation remains largely unknown. Here, we investigate the role of the circadian nuclear receptor REV-ERBα in regulating tryptophan hydroxylase 2 (Tph2), the rate-limiting enzyme of 5-HT synthesis. We demonstrate that the REV-ERBα expressed in dorsal raphe (DR) 5-HTergic neurons functionally competes with PET-1-a nuclear activator crucial for 5-HTergic neuron development. In mice, genetic ablation of DR 5-HTergic REV-ERBα increases Tph2 expression, leading to elevated DR 5-HT levels and reduced depression-like behaviors at dusk. Further, pharmacological manipulation of the mice DR REV-ERBα activity increases DR 5-HT levels and affects despair-related behaviors. Our findings provide valuable insights into the molecular and cellular link between the circadian rhythm and the mood-controlling DR 5-HTergic systems.

The nucleus accumbens in reward and aversion processing: insights and implications

The nucleus accumbens (NAc), a central component of the brain's reward circuitry, has been implicated in a wide range of behaviors and emotional states. Emerging evidence, primarily drawing from recent rodent studies, suggests that the function of the NAc in reward and aversion processing is multifaceted. Prolonged stress or drug use induces maladaptive neuronal function in the NAc circuitry, which results in pathological conditions. This review aims to provide comprehensive and up-to-date insights on the role of the NAc in motivated behavior regulation and highlights areas that demand further in-depth analysis. It synthesizes the latest findings on how distinct NAc neuronal populations and pathways contribute to the processing of opposite valences. The review examines how a range of neuromodulators, especially monoamines, influence the NAc's control over various motivational states. Furthermore, it delves into the complex underlying mechanisms of psychiatric disorders such as addiction and depression and evaluates prospective interventions to restore NAc functionality.

Dorsal raphe neurons integrate the values of reward amount, delay, and uncertainty in multi-attribute decision-making

The dorsal raphe nucleus (DRN) is implicated in psychiatric disorders that feature impaired sensitivity to reward amount, impulsivity when facing reward delays, and risk-seeking when confronting reward uncertainty. However, it has been unclear whether and how DRN neurons signal reward amount, reward delay, and reward uncertainty during multi-attribute value-based decision-making, where subjects consider these attributes to make a choice. We recorded DRN neurons as monkeys chose between offers whose attributes, namely expected reward amount, reward delay, and reward uncertainty, varied independently. Many DRN neurons signaled offer attributes, and this population tended to integrate the attributes in a manner that reflected monkeys' preferences for amount, delay, and uncertainty. After decision-making, in response to post-decision feedback, these same neurons signaled signed reward prediction errors, suggesting a broader role in tracking value across task epochs and behavioral contexts. Our data illustrate how the DRN participates in value computations, guiding theories about the role of the DRN in decision-making and psychiatric disease.

Optogenetic activation of dorsal raphe serotonin neurons induces brain-wide activation

Serotonin is a neuromodulator that affects multiple behavioral and cognitive functions. Nonetheless, how serotonin causes such a variety of effects via brain-wide projections and various receptors remains unclear. Here we measured brain-wide responses to optogenetic stimulation of serotonin neurons in the dorsal raphe nucleus (DRN) of the male mouse brain using functional MRI with an 11.7 T scanner and a cryoprobe. Transient activation of DRN serotonin neurons caused brain-wide activation, including the medial prefrontal cortex, the striatum, and the ventral tegmental area. The same stimulation under anesthesia with isoflurane decreased brain-wide activation, including the hippocampal complex. These brain-wide response patterns can be explained by DRN serotonergic projection topography and serotonin receptor expression profiles, with enhanced weights on 5-HT1 receptors. Together, these results provide insight into the DR serotonergic system, which is consistent with recent discoveries of its functions in adaptive behaviors.

Aggression modulator: Understanding the multifaceted role of the dorsal raphe nucleus

Aggressive behavior is instinctively driven behavior that helps animals to survive and reproduce and is closely related to multiple behavioral and physiological processes. The dorsal raphe nucleus (DRN) is an evolutionarily conserved midbrain structure that regulates aggressive behavior by integrating diverse brain inputs. The DRN consists predominantly of serotonergic (5-HT:5-hydroxytryptamine) neurons and decreased 5-HT activity was classically thought to increase aggression. However, recent studies challenge this 5-HT deficiency model, revealing a more complex role for the DRN 5-HT system in aggression. Furthermore, emerging evidence has shown that non-5-HT populations in the DRN and specific neural circuits contribute to the escalation of aggressive behavior. This review argues that the DRN serves as a multifaceted modulator of aggression, acting not only via 5-HT but also via other neurotransmitters and neural pathways, as well as different subsets of 5-HT neurons. In addition, we discuss the contribution of DRN neurons in the behavioral and physiological aspects implicated in aggressive behavior, such as arousal, reward, and impulsivity, to further our understanding of DRN-mediated aggression modulation.

Maturation of cortical input to dorsal raphe nucleus increases behavioral persistence in mice

The ability to persist toward a desired objective is a fundamental aspect of behavioral control whose impairment is implicated in several behavioral disorders. One of the prominent features of behavioral persistence is that its maturation occurs relatively late in development. This is presumed to echo the developmental time course of a corresponding circuit within late-maturing parts of the brain, such as the prefrontal cortex, but the specific identity of the responsible circuits is unknown. Here, we used a genetic approach to describe the maturation of the projection from layer 5 neurons of the neocortex to the dorsal raphe nucleus in mice. Using optogenetic-assisted circuit mapping, we show that this projection undergoes a dramatic increase in synaptic potency between postnatal weeks 3 and 8, corresponding to the transition from juvenile to adult. We then show that this period corresponds to an increase in the behavioral persistence that mice exhibit in a foraging task. Finally, we used a genetic targeting strategy that primarily affected neurons in the medial prefrontal cortex, to selectively ablate this pathway in adulthood and show that mice revert to a behavioral phenotype similar to juveniles. These results suggest that frontal cortical to dorsal raphe input is a critical anatomical and functional substrate of the development and manifestation of behavioral persistence.

Synthetic surprise as the foundation of the psychedelic experience

Psychedelic agents, such as LSD and psilocybin, induce marked alterations in consciousness via activation of the 5-HT2A receptor (5-HT2ARs). We hypothesize that psychedelics enforce a state of synthetic surprise through the biased activation of the 5-HTRs system. This idea is informed by recent insights into the role of 5-HT in signaling surprise. The effects on consciousness, explained by the cognitive penetrability of perception, can be described within the predictive coding framework where surprise corresponds to prediction error, the mismatch between predictions and actual sensory input. Crucially, the precision afforded to the prediction error determines its effect on priors, enabling a dynamic interaction between top-down expectations and incoming sensory data. By integrating recent findings on predictive coding circuitry and 5-HT2ARs transcriptomic data, we propose a biological implementation with emphasis on the role of inhibitory interneurons. Implications arise for the clinical use of psychedelics, which may rely primarily on their inherent capacity to induce surprise in order to disrupt maladaptive patterns.

Brain mechanisms of temporal processing in impulsivity: Relevance to attention-deficit hyperactivity disorder

In this article, we critique the hypothesis that different varieties of impulsivity, including impulsiveness present in attention-deficit hyperactivity disorder, encompass an accelerated perception of time. This conceptualisation provides insights into how individuals with attention-deficit hyperactivity disorder have the capacity to maximise cognitive capabilities by more closely aligning themselves with appropriate environmental contexts (e.g. fast paced tasks that prevent boredom). We discuss the evidence for altered time perception in attention-deficit hyperactivity disorder alongside putative underlying neurobiological substrates, including a distributed brain network mediating time perception over multiple timescales. In particular, we explore the importance of temporal representations across the brain for time perception and symptom manifestation in attention-deficit hyperactivity disorder, including a prominent role of the hippocampus and other temporal lobe regions. We also reflect on how abnormalities in the perception of time may be relevant for understanding the aetiology of attention-deficit hyperactivity disorder and mechanism of action of existing medications.

Serotonin neurons in mating female mice are activated by male ejaculation

Sexual stimulation triggers changes in female physiology and behavior, including sexual satiety and preparing the uterus for pregnancy. Serotonin (5-HT) is an important regulator of reproductive physiology and sexual receptivity, but the relationship between sexual stimulation and 5-HT neural activity in females is poorly understood. Here, we investigated dorsal raphe 5-HT neural activity in female mice during sexual behavior. We found that 5-HT neural activity in mating females peaked specifically upon male ejaculation and remained elevated above baseline until disengagement. Artificial intravaginal mechanical stimulation was sufficient to elicit increased 5-HT neural activity but the delivery of ejaculatory fluids was not. Distal penis expansion ("penile cupping") at ejaculation and forceful expulsion of ejaculatory fluid each provided sufficient mechanical stimulation to elicit 5-HT neuron activation. Our study identifies a female ejaculation-specific signal in a major neuromodulatory system and shows that intravaginal mechanosensory stimulation is necessary and sufficient to drive this signal.

Dorsal raphe neurons signal integrated value during multi-attribute decision-making

The dorsal raphe nucleus (DRN) is implicated in psychiatric disorders that feature impaired sensitivity to reward amount, impulsivity when facing reward delays, and risk-seeking when grappling with reward uncertainty. However, whether and how DRN neurons signal reward amount, reward delay, and reward uncertainty during multi-attribute value-based decision-making, where subjects consider all these attributes to make a choice, is unclear. We recorded DRN neurons as monkeys chose between offers whose attributes, namely expected reward amount, reward delay, and reward uncertainty, varied independently. Many DRN neurons signaled offer attributes. Remarkably, these neurons commonly integrated offer attributes in a manner that reflected monkeys' overall preferences for amount, delay, and uncertainty. After decision-making, in response to post-decision feedback, these same neurons signaled signed reward prediction errors, suggesting a broader role in tracking value across task epochs and behavioral contexts. Our data illustrate how DRN participates in integrated value computations, guiding theories of DRN in decision-making and psychiatric disease.

Serotonin neurons in mating female mice are activated by male ejaculation

Sexual stimulation triggers changes in female physiology and behavior, including sexual satiety and preparing the uterus for pregnancy. Serotonin is an important regulator of reproductive physiology and sexual receptivity, but the relationship between sexual stimulation and serotonin neural activity in females is poorly understood. Here, we investigated dorsal raphe serotonin neural activity in females during sexual behavior. We found that serotonin neural activity in mating females peaked specifically upon male ejaculation, and remained elevated above baseline until disengagement. Artificial intravaginal mechanical stimulation was sufficient to elicit increased 5-HT neural activity but the delivery of ejaculatory fluids was not. Distal penis erectile enlargement ("penile cupping") at ejaculation and forceful expulsion of ejaculatory fluid each provided sufficient mechanical stimulation to elicit serotonin neuron activation. Our study identifies a female ejaculation-specific signal in a major neuromodulatory system and shows that intravaginal mechanosensory stimulation is necessary and sufficient to drive this signal.

Boosting Serotonin Increases Information Gathering by Reducing Subjective Cognitive Costs

Serotonin is implicated in the valuation of aversive costs, such as delay or physical effort. However, its role in governing sensitivity to cognitive effort, for example, deliberation costs during information gathering, is unclear. We show that treatment with a serotonergic antidepressant in healthy human individuals of either sex enhances a willingness to gather information when trying to maximize reward. Using computational modeling, we show this arises from a diminished sensitivity to subjective deliberation costs during the sampling process. This result is consistent with the notion that serotonin alleviates sensitivity to aversive costs in a domain-general fashion, with implications for its potential contribution to a positive impact on motivational deficits in psychiatric disorders.SIGNIFICANCE STATEMENT Gathering information about the world is essential for successfully navigating it. However, sampling information is costly, and we need to balance between gathering too little and too much information. The neurocomputational mechanisms underlying this arbitration between a putative gain, such as reward, and the associated costs, such as allocation of cognitive resources, remain unclear. In this study, we show that week-long daily treatment with a serotonergic antidepressant enhances a willingness to gather information when trying to maximize reward. Computational modeling indicates this arises from a reduced perception of aversive costs, rendering information gathering less cognitively effortful. This finding points to a candidate mechanism by which serotonergic treatment might help alleviate motivational deficits in a range of mental illnesses.

Neuroscience: Merging multisensory memories

How animals form and retain memories across multiple sensory modalities and how multisensory learning can enhance memory is largely unknown. A recent study sheds light on the neural mechanism underlying multisensory memory convergence in the Drosophila melanogaster brain.

Local 5-HT signaling bi-directionally regulates the coincidence time window for associative learning

The coincidence between conditioned stimulus (CS) and unconditioned stimulus (US) is essential for associative learning; however, the mechanism regulating the duration of this temporal window remains unclear. Here, we found that serotonin (5-HT) bi-directionally regulates the coincidence time window of olfactory learning in Drosophila and affects synaptic plasticity of Kenyon cells (KCs) in the mushroom body (MB). Utilizing GPCR-activation-based (GRAB) neurotransmitter sensors, we found that KC-released acetylcholine (ACh) activates a serotonergic dorsal paired medial (DPM) neuron, which in turn provides inhibitory feedback to KCs. Physiological stimuli induce spatially heterogeneous 5-HT signals, which proportionally gate the intrinsic coincidence time windows of different MB compartments. Artificially reducing or increasing the DPM neuron-released 5-HT shortens or prolongs the coincidence window, respectively. In a sequential trace conditioning paradigm, this serotonergic neuromodulation helps to bridge the CS-US temporal gap. Altogether, we report a model circuitry for perceiving the temporal coincidence and determining the causal relationship between environmental events.

Medial Prefrontal Cortex Serotonin Input Regulates Cognitive Flexibility in Mice

The medial prefrontal cortex (mPFC) regulates cognitive flexibility and emotional behavior. Neurons that release serotonin project to the mPFC, and serotonergic drugs influence emotion and cognition. Yet, the specific roles of endogenous serotonin release in the mPFC on neurophysiology and behavior are unknown. We show that axonal serotonin release in the mPFC directly inhibits the major mPFC output neurons. In serotonergic neurons projecting from the dorsal raphe to the mPFC, we find endogenous activity signatures pre-reward retrieval and at reward retrieval during a cognitive flexibility task. In vivo optogenetic activation of this pathway during pre-reward retrieval selectively improved extradimensional rule shift performance while inhibition impaired it, demonstrating sufficiency and necessity for mPFC serotonin release in cognitive flexibility. Locomotor activity and anxiety-like behavior were not affected by either optogenetic manipulation. Collectively, our data reveal a powerful and specific modulatory role of endogenous serotonin release from dorsal raphe-to-mPFC projecting neurons in cognitive flexibility.

Fifty years on: Serotonin and depression

It has been over 50 years since the original serotonin hypothesis was proposed by the British Psychiatrist Alec Coppen. Recently, some authors have questioned the validity of the hypothesis. In this narrative review, we summarise the evidence for the serotonin hypothesis of depression, focusing on psychopharmacology and molecular imaging, as well as systems-level neuroscience.

Effect of psilocybin on decision-making and motivation in the healthy rat

Psilocybin and its active metabolite psilocin are hallucinogenic serotonergic agonists with high affinity for several serotonin receptors. In addition to underlying the hallucinogenic effects of these compounds, serotonin receptor activation also has important effects on decision-making and goal-directed behaviors. The impact of psilocybin and psilocin on these cognitive systems, however, remains unclear. This study investigated the effects of psilocybin treatment on decision-making and motivation in healthy male and female rats. We compared probability and delay discounting performance of psilocybin treated (1 mg/kg) to vehicle rats (n = 10/sex/group), and further assessed motivation in each group using a progressive ratio task. We also confirmed drug action by assessing head twitch responses after psilocybin treatment (1 mg/kg). Results from this study demonstrated that exposure to 1 mg/kg psilocybin did not affect decision-making in the probability and delay discounting tasks and did not reduce response rates in the progressive ratio task. However, psilocybin treatment did cause the expected increase in head twitch responses in both male and female rats, demonstrating that the drug was delivered at a pharmacologically relevant dosage. Combined, these results suggest that psilocybin may not impair or improve decision-making and motivation. Considering recent interest in psilocybin as a potential fast-acting therapeutic for a variety of mental health disorders, our findings also suggest the therapeutic effects of this drug may not be mediated by changes to the brain systems underlying reward and decision-making. Finally, these results may have important implications regarding the relative safety of this compound, suggesting that widespread cognitive impairments may not be seen in subjects, even after chronic treatment.

Temporal derivative computation in the dorsal raphe network revealed by an experimentally driven augmented integrate-and-fire modeling framework

By means of an expansive innervation, the serotonin (5-HT) neurons of the dorsal raphe nucleus (DRN) are positioned to enact coordinated modulation of circuits distributed across the entire brain in order to adaptively regulate behavior. Yet the network computations that emerge from the excitability and connectivity features of the DRN are still poorly understood. To gain insight into these computations, we began by carrying out a detailed electrophysiological characterization of genetically identified mouse 5-HT and somatostatin (SOM) neurons. We next developed a single-neuron modeling framework that combines the realism of Hodgkin-Huxley models with the simplicity and predictive power of generalized integrate-and-fire models. We found that feedforward inhibition of 5-HT neurons by heterogeneous SOM neurons implemented divisive inhibition, while endocannabinoid-mediated modulation of excitatory drive to the DRN increased the gain of 5-HT output. Our most striking finding was that the output of the DRN encodes a mixture of the intensity and temporal derivative of its input, and that the temporal derivative component dominates this mixture precisely when the input is increasing rapidly. This network computation primarily emerged from prominent adaptation mechanisms found in 5-HT neurons, including a previously undescribed dynamic threshold. By applying a bottom-up neural network modeling approach, our results suggest that the DRN is particularly apt to encode input changes over short timescales, reflecting one of the salient emerging computations that dominate its output to regulate behavior.

Regulation of social hierarchy learning by serotonin transporter availability

Learning one's status in a group is a fundamental process in building social hierarchies. Although animal studies suggest that serotonin (5-HT) signaling modulates learning social hierarchies, direct evidence in humans is lacking. Here we determined the relationship between serotonin transporter (SERT) availability and brain systems engaged in learning social ranks combining computational approaches with simultaneous PET-fMRI acquisition in healthy males. We also investigated the link between SERT availability and brain activity in a non-social control condition involving learning the payoffs of slot machines. Learning social ranks was modulated by the dorsal raphe nucleus (DRN) 5-HT function. BOLD ventral striatal response, tracking the rank of opponents, decreased with DRN SERT levels. Moreover, this link was specific to the social learning task. These findings demonstrate that 5-HT plays an influence on the computations required to learn social ranks.

Understanding the effects of serotonin in the brain through its role in the gastrointestinal tract

The neuromodulatory arousal system imbues the nervous system with the flexibility and robustness required to facilitate adaptive behaviour. While there are well-understood mechanisms linking dopamine, noradrenaline and acetylcholine to distinct behavioural states, similar conclusions have not been as readily available for serotonin. Fascinatingly, despite clear links between serotonergic function and cognitive capacities as diverse as reward processing, exploration, and the psychedelic experience, over 95% of the serotonin in the body is released in the gastrointestinal tract, where it controls digestive muscle contractions (peristalsis). Here, we argue that framing neural serotonin as a rostral extension of the gastrointestinal serotonergic system dissolves much of the mystery associated with the central serotonergic system. Specifically, we outline that central serotonin activity mimics the effects of a digestion/satiety circuit mediated by hypothalamic control over descending serotonergic nuclei in the brainstem. We review commonalities and differences between these two circuits, with a focus on the heterogeneous expression of different classes of serotonin receptors in the brain. Much in the way that serotonin-induced peristalsis facilitates the work of digestion, serotonergic influences over cognition can be reframed as performing the work of cognition. Extending this analogy, we argue that the central serotonergic system allows the brain to arbitrate between different cognitive modes as a function of serotonergic tone: low activity facilitates cognitive automaticity, whereas higher activity helps to identify flexible solutions to problems, particularly if and when the initial responses fail. This perspective sheds light on otherwise disparate capacities mediated by serotonin, and also helps to understand why there are such pervasive links between serotonergic pathology and the symptoms of psychiatric disorders.

Importin α3 (KPNA3) Deficiency Augments Effortful Reward-Seeking Behavior in Mice

Importin α3 (Gene: Kpna3, the ortholog of human Importin α4) is a member of the importin α family and participates in nucleocytoplasmic transport by forming trimeric complexes between cargo proteins and importin β1. Evidence from human studies has indicated that single nucleotide polymorphisms (SNP) in the KPNA3 gene are associated with the occurrence of several psychiatric disorders accompanied by abnormal reward-related behavior, including schizophrenia, major depression, and substance addiction. However, the precise roles of importin α3 in controlling reward processing and motivation are still unclear. In this study, we evaluated the behavioral effects of Kpna3 knockout (KO) in mice on performance in touchscreen operant chamber-based tasks evaluating simple (fixed-ratio) and effortful (progressive-ratio) reward-seeking behaviors. While Kpna3 KO mice showed no significant differences in operant reward learning on a fixed-ratio schedule, they demonstrated significantly increased motivation (increased break point) to instrumentally respond for sucrose on a progressive-ratio schedule. We additionally measured the number of c-Fos-positive cells, a marker of neural activity, in 20 regions of the brain and identified a network of brain regions based on their interregional correlation coefficients. Network and graph-theoretic analyses suggested that Kpna3 deficiency enhanced overall interregional functional connectivity. These findings suggest the importance of Kpna3 in motivational control and indicate that Kpna3 KO mice may be an attractive line for modeling motivational abnormalities associated with several psychiatric disorders.

Freezing revisited: coordinated autonomic and central optimization of threat coping

Animals have sophisticated mechanisms for coping with danger. Freezing is a unique state that, upon threat detection, allows evidence to be gathered, response possibilities to be previsioned and preparations to be made for worst-case fight or flight. We propose that - rather than reflecting a passive fear state - the particular somatic and cognitive characteristics of freezing help to conceal overt responses, while optimizing sensory processing and action preparation. Critical for these functions are the neurotransmitters noradrenaline and acetylcholine, which modulate neural information processing and also control the sympathetic and parasympathetic branches of the autonomic nervous system. However, the interactions between autonomic systems and the brain during freezing, and the way in which they jointly coordinate responses, remain incompletely explored. We review the joint actions of these systems and offer a novel computational framework to describe their temporally harmonized integration. This reconceptualization of freezing has implications for its role in decision-making under threat and for psychopathology.

Sleep-Wake Neurochemistry

Behavioral states naturally alternate between wakefulness and the sleep phases rapid eye movement and nonrapid eye movement sleep. Waking and sleep states are complex processes that are elegantly orchestrated by spatially fine-tuned neurochemical changes of neurotransmitters and neuromodulators including glutamate, acetylcholine, γ-aminobutyric acid, norepinephrine, dopamine, serotonin, histamine, hypocretin, melanin concentrating hormone, adenosine, and melatonin. However, as highlighted in this brief overview, no single neurotransmitter or neuromodulator, but rather their complex interactions within organized neuronal ensembles, regulate waking and sleep states. The neurochemical pathways presented here are aimed to provide a conceptual framework for the understanding of the effects of currently used sleep medications.

Disordered Decision Making: A Cognitive Framework for Apathy and Impulsivity in Huntington's Disease

A caregiver's all‐too‐familiar narrative ‐ “He doesn't think through what he does, but mostly he does nothing.” Apathy and impulsivity, debilitating and poorly understood, commonly co‐occur in Huntington's disease (HD). HD is a neurodegenerative disease with manifestations bridging clinical neurology and psychiatry. In addition to movement and cognitive symptoms, neurobehavioral disturbances, particularly apathy and impulsivity, are prevalent features of HD, occurring early in the disease course, often worsening with disease progression, and substantially reducing quality of life. Treatments remain limited, in part because of limited mechanistic understanding of these behavioral disturbances. However, emerging work within the field of decision‐making neuroscience and beyond points to common neurobiological mechanisms underpinning these seemingly disparate problems. These insights bridge the gap between underlying disease pathology and clinical phenotype, offering new treatment strategies, novel behavioral and physiological biomarkers of HD, and deeper understanding of human behavior. In this review, we apply the neurobiological framework of cost‐benefit decision making to the problems of apathy and impulsivity in HD. Through this decision‐making lens, we develop a mechanistic model that elucidates the occurrence of these behavioral disturbances and points to potential treatment strategies and crucial research priorities. © 2022 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson Movement Disorder Society.

A Role for Serotonin in Modulating Opposing Drive and Brake Circuits of Impulsivity

Impulsivity generally refers to a deficit in inhibition, with a focus on understanding the neural circuits which constitute the "brake" on actions and gratification. It is likely that increased impulsivity can arise not only from reduced inhibition, but also from a heightened or exaggerated excitatory "drive." For example, an action which has more vigor, or is fueled by either increased incentive salience or a stronger action-outcome association, may be harder to inhibit. From this perspective, this review focuses on impulse control as a competition over behavioral output between an initially learned response-reward outcome association, and a subsequently acquired opposing inhibitory association. Our goal is to present a synthesis of research from humans and animal models that supports this dual-systems approach to understanding the behavioral and neural substrates that contribute to impulsivity, with a focus on the neuromodulatory role of serotonin. We review evidence for the role of serotonin signaling in mediating the balance of the "drive" and "brake" circuits. Additionally, we consider parallels of these competing instrumental systems in impulsivity within classical conditioning processes (e.g., extinction) in order to point us to potential behavioral and neural mechanisms that may modulate the competing instrumental associations. Finally, we consider how the balance of these competing associations might contribute to, or be extracted from, our experimental assessments of impulsivity. A careful understanding of the underlying behavioral and circuit level contributions to impulsivity is important for understanding the pathogenesis of increased impulsivity present in a number of psychiatric disorders. Pathological levels of impulsivity in such disorders are likely subserved by deficits in the balance of motivational and inhibitory processes.

Friend of the Devil: Negative Social Influences Driving Substance Use Disorders

Substance use disorders in humans have significant social influences, both positive and negative. While prosocial behaviors promote group cooperation and are naturally rewarding, distressing social encounters, such as aggression exhibited by a conspecific, are aversive and can enhance the sensitivity to rewarding substances, promote the acquisition of drug-taking, and reinstate drug-seeking. On the other hand, withdrawal and prolonged abstinence from drugs of abuse can promote social avoidance and suppress social motivation, accentuating drug cravings and facilitating relapse. Understanding how complex social states and experiences modulate drug-seeking behaviors as well as the underlying circuit dynamics, such as those interacting with mesolimbic reward systems, will greatly facilitate progress on understanding triggers of drug use, drug relapse and the chronicity of substance use disorders. Here we discuss some of the common circuit mechanisms underlying social and addictive behaviors that may underlie their antagonistic functions. We also highlight key neurochemicals involved in social influences over addiction that are frequently identified in comorbid psychiatric conditions. Finally, we integrate these data with recent findings on (±)3,4-methylenedioxymethamphetamine (MDMA) that suggest functional segregation and convergence of social and reward circuits that may be relevant to substance use disorder treatment through the competitive nature of these two types of reward. More studies focused on the relationship between social behavior and addictive behavior we hope will spur the development of treatment strategies aimed at breaking vicious addiction cycles.

Complementary roles of serotonergic and cholinergic systems in decisions about when to act

Decision-making not only involves deciding about which action to choose but when and whether to initiate an action in the first place. Macaque monkeys tracked number of dots on a screen and could choose when to make a response. The longer the animals waited before responding, the more dots appeared on the screen and the higher the probability of reward. Monkeys waited longer before making a response when a trial’s value was less than the environment’s average value. Recordings of brain activity with fMRI revealed that activity in dorsal raphe nucleus (DRN)—a key source of serotonin (5-HT)—tracked average value of the environment. By contrast, activity in the basal forebrain (BF)—an important source of acetylcholine (ACh)—was related to decision time to act as a function of immediate and recent past context. Interactions between DRN and BF and the anterior cingulate cortex (ACC), another region with action initiation-related activity, occurred as a function of the decision time to act. Next, we performed two psychopharmacological studies. Manipulating systemic 5-HT by citalopram prolonged the time macaques waited to respond for a given opportunity. This effect was more evident during blocks with long inter-trial intervals (ITIs) where good opportunities were sparse. Manipulating systemic acetylcholine (ACh) by rivastigmine reduced the time macaques waited to respond given the immediate and recent past context, a pattern opposite to the effect observed with 5-HT. These findings suggest complementary roles for serotonin/DRN and acetylcholine/BF in decisions about when to initiate an action.

•

Both immediate context and wider environment influence decisions about when to act

•

DRN and 5-HT mediate the influence of wider environment

•

BF and ACh mediate the influence of immediate context

Serotonin neurons modulate learning rate through uncertainty

Regulating how fast to learn is critical for flexible behavior. Learning about the consequences of actions should be slow in stable environments, but accelerate when that environment changes. Recognizing stability and detecting change are difficult in environments with noisy relationships between actions and outcomes. Under these conditions, theories propose that uncertainty can be used to modulate learning rates ("meta-learning"). We show that mice behaving in a dynamic foraging task exhibit choice behavior that varied as a function of two forms of uncertainty estimated from a meta-learning model. The activity of dorsal raphe serotonin neurons tracked both types of uncertainty in the foraging task as well as in a dynamic Pavlovian task. Reversible inhibition of serotonin neurons in the foraging task reproduced changes in learning predicted by a simulated lesion of meta-learning in the model. We thus provide a quantitative link between serotonin neuron activity, learning, and decision making.

Developmental Trajectories of Anhedonia in Preclinical Models

This chapter discusses how the complex concept of anhedonia can be operationalized and studied in preclinical models. It provides information about the development of anhedonia in the context of early-life adversity, and the power of preclinical models to tease out the diverse molecular, epigenetic, and network mechanisms that are responsible for anhedonia-like behaviors.Specifically, we first discuss the term anhedonia, reviewing the conceptual components underlying reward-related behaviors and distinguish anhedonia pertaining to deficits in motivational versus consummatory behaviors. We then describe the repertoire of experimental approaches employed to study anhedonia-like behaviors in preclinical models, and the progressive refinement over the past decade of both experimental instruments (e.g., chemogenetics, optogenetics) and conceptual constructs (salience, valence, conflict). We follow with an overview of the state of current knowledge of brain circuits, nodes, and projections that execute distinct aspects of hedonic-like behaviors, as well as neurotransmitters, modulators, and receptors involved in the generation of anhedonia-like behaviors. Finally, we discuss the special case of anhedonia that arises following early-life adversity as an eloquent example enabling the study of causality, mechanisms, and sex dependence of anhedonia.Together, this chapter highlights the power, potential, and limitations of using preclinical models to advance our understanding of the origin and mechanisms of anhedonia and to discover potential targets for its prevention and mitigation.

How we decide what to eat: Toward an interdisciplinary model of gut-brain interactions

Everyday dietary decisions have important short-term and long-term consequences for health and well-being. How do we decide what to eat, and what physiological and neurobiological systems are involved in those decisions? Here, we integrate findings from thus-far separate literatures: (a) the cognitive neuroscience of dietary decision-making, and (b) growing evidence of gut-brain interactions and especially influences of the gut microbiome on diet and health outcomes. We review findings that suggest that dietary decisions and food consumption influence nutrient sensing, homeostatic signaling in the gut, and the composition of the gut microbiome. In turn, the microbiome can influence host health and behavior. Through reward signaling pathways, the microbiome could potentially affect food and drink decisions. Such bidirectional links between gut microbiome and the brain systems underlying dietary decision-making may lead to self-reinforcing feedback loops that determine long-term dietary patterns, body mass, and health outcomes. This article is categorized under: Economics > Individual Decision-Making Psychology > Brain Function and Dysfunction Psychology > Reasoning and Decision Making.

The dorsal raphe nucleus in the control of energy balance

Energy balance is orchestrated by an extended network of highly interconnected nuclei across the central nervous system. While much is known about the hypothalamic circuits regulating energy homeostasis, the 'extra-hypothalamic' circuits involved are relatively poorly understood. In this review, we focus on the brainstem's dorsal raphe nucleus (DRN), integrating decades of research linking this structure to the physiologic and behavioral responses that maintain proper energy stores. DRN neurons sense and respond to interoceptive and exteroceptive cues related to energy imbalance and in turn induce appropriate alterations in energy intake and expenditure. The DRN is also molecularly differentiable, with different populations playing distinct and often opposing roles in controlling energy balance. These populations are integrated into the extended circuit known to regulate energy balance. Overall, this review summarizes the key evidence demonstrating an important role for the DRN in regulating energy balance.

Gray areas: Neuropeptide circuits linking the Edinger-Westphal and Dorsal Raphe nuclei in addiction

The circuitry of addiction comprises several neural networks including the midbrain - an expansive region critically involved in the control of motivated behaviors. Midbrain nuclei like the Edinger-Westphal (EW) and dorsal raphe (DR) contain unique populations of neurons that synthesize many understudied neuroactive molecules and are encircled by the periaqueductal gray (PAG). Despite the proximity of these special neuron classes to the ventral midbrain complex and surrounding PAG, functions of the EW and DR remain substantially underinvestigated by comparison. Spanning approximately -3.0 to -5.2 mm posterior from bregma in the mouse, these various cell groups form a continuum of neurons that we refer to collectively as the subaqueductal paramedian zone. Defining how these pathways modulate affective behavioral states presents a difficult, yet conquerable challenge for today's technological advances in neuroscience. In this review, we cover the known contributions of different neuronal subtypes of the subaqueductal paramedian zone. We catalogue these cell types based on their spatial, molecular, connectivity, and functional properties and integrate this information with the existing data on the EW and DR in addiction. We next discuss evidence that links the EW and DR anatomically and functionally, highlighting the potential contributions of an EW-DR circuit to addiction-related behaviors. Overall, we aim to derive an integrated framework that emphasizes the contributions of EW and DR nuclei to addictive states and describes how these cell groups function in individuals suffering from substance use disorders. This article is part of the special Issue on 'Neurocircuitry Modulating Drug and Alcohol Abuse'.

Serotonergic regulation of the dopaminergic system: Implications for reward-related functions

Serotonin is a critical neuromodulator involved in development and behavior. Its role in reward is however still debated. Here, we first review classical studies involving electrical stimulation protocols and pharmacological approaches. Contradictory results on the serotonergic' involvement in reward emerge from these studies. These differences might be ascribable to either the diversity of cellular types within the raphe nuclei or/and the specific projection pathways of serotonergic neurons. We continue to review more recent work, using optogenetic approaches to activate serotonergic cells in the Raphe to VTA pathway. From these studies, it appears that activation of this pathway can lead to reinforcement learning mediated through the excitation of dopaminergic neurons by serotonergic neurons co-transmitting glutamate. Finally, given the importance of serotonin during development on adult emotion, the effect of abnormal early-life levels of serotonin on the dopaminergic system will also be discussed. Understanding the interaction between the serotonergic and dopaminergic systems during development and adulthood is critical to gain insight into the specific facets of neuropsychiatric disorders.

Over-representation of fundamental decision variables in the prefrontal cortex underlies decision bias

The brain is organized into anatomically distinct structures consisting of a variety of projection neurons. While such evolutionarily conserved neural circuit organization underlies the innate ability of animals to swiftly adapt to environments, they can cause biased cognition and behavior. Although recent studies have begun to address the causal importance of projection-neuron types as distinct computational units, it remains unclear how projection types are functionally organized in encoding variables during cognitive tasks. This review focuses on the neural computation of decision making in the prefrontal cortex and discusses what decision variables are encoded by single neurons, neuronal populations, and projection type, alongside how specific projection types constrain decision making. We focus particularly on "over-representations" of distinct decision variables in the prefrontal cortex that reflect the biological and subjective significance of the variables for the decision makers. We suggest that task-specific over-representation in the prefrontal cortex involves the refinement of the given decision making, while generalized over-representation of fundamental decision variables is associated with suboptimal decision biases, including pathological ones such as those in patients with psychiatric disorders. Such over-representation of the fundamental decision variables in the prefrontal cortex appear to be tightly constrained by afferent and efferent connections that can be optogenetically intervened on. These ideas may provide critical insights into potential therapeutic targets for psychiatric disorders, including addiction and depression.

Functional and behavioral effects of de novo mutations in calcium-related genes in patients with bipolar disorder

Bipolar disorder is a common mental illness occurring in approximately 1% of individuals and exhibits lifetime prevalence. Although genetic factors are known to contribute to this disorder, the genetic architecture has not yet been completely clarified. Our initial trio-based exome sequencing study of bipolar disorder showed enrichment of de novo, loss-of-function (LOF) or protein-altering mutations in a combined group with bipolar I and schizoaffective disorders, and the identified de novo mutations were enriched in calcium-related genes. These findings suggested a role for de novo mutations in bipolar disorder. The validity of these statistical associations can be demonstrated if the functional impact of the mutations on cellular function and behavior are identified. In this study, we focused on two de novo LOF mutations in calcium-related genes, EHD1 and MACF1, found in patients with bipolar disorder. We first showed that the EHD1 mutation resulted in a truncated protein with diminished effect on neurite outgrowth and inhibited endocytosis. Next, we used CRISPR/Cas9 to establish two knock-in mouse lines to model the in vivo effects of these mutations. We performed behavioral screening using IntelliCage and long-term wheel running analysis. Ehd1 mutant mice showed higher activity in the light phase. Macf1 mutant mice showed diminished attention and persistence to rewards. These behavioral alterations were similar to the phenotypes in previously proposed animal models of bipolar disorder. These findings endorse the possible role of de novo mutations as a component of the genetic architecture of bipolar disorder which was suggested by the statistical evidence.

Neurochemical substrates linked to impulsive and compulsive phenotypes in addiction: A preclinical perspective

Drug compulsion manifests in some but not all individuals and implicates multifaceted processes including failures in top-down cognitive control as drivers for the hazardous pursuit of drug use in some individuals. As a closely related construct, impulsivity encompasses rash or risky behaviour without foresight and underlies most forms of drug taking behaviour, including drug use during adverse emotional states (i.e., negative urgency). While impulsive behavioural dimensions emerge from drug-induced brain plasticity, burgeoning evidence suggests that impulsivity also predates the emergence of compulsive drug use. Although the neural substrates underlying the apparently causal relationship between trait impulsivity and drug compulsion are poorly understood, significant advances have come from the interrogation of defined limbic cortico-striatal circuits involved in motivated behaviour and response inhibition, together with chemical neuromodulatory influences from the ascending neurotransmitter systems. We review what is presently known about the neurochemical mediation of impulsivity, in its various forms, and ask whether commonalities exist in the neurochemistry of compulsive drug-motivated behaviours that might explain individual risk for addiction.

A single dose of escitalopram blunts the neural response in the thalamus and caudate during monetary loss

BACKGROUND

Selective serotonin reuptake inhibitors (SSRIs) show acute effects on the neural processes associated with negative affective bias in healthy people and people with depression. However, whether and how SSRIs also affect reward and punishment processing on a similarly rapid time scale remains unclear.

METHODS

We investigated the effects of an acute and clinically relevant dose (20 mg) of the SSRI escitalopram on brain response during reward and punishment processing in 19 healthy participants. In a doubleblind, placebo-controlled study using functional MRI, participants performed a well-established monetary reward task at 3 time points: at baseline; after receiving placebo or escitalopram; and after receiving placebo or escitalopram following an 8-week washout period.

RESULTS

Acute escitalopram administration reduced blood-oxygen-level-dependent (BOLD) response during punishment feedback in the right thalamus (family-wise error corrected [FWE] p = 0.013 at peak level) and the right caudate head (pFWE = 0.011 at peak level) compared to placebo. We did not detect any significant BOLD changes during reward feedback.

LIMITATIONS

We included only healthy participants, so interpretation of findings are limited to the healthy human brain and require future testing in patient populations. The paradigm we used was based on monetary stimuli, and results may not be generalizable to other forms of reward.

CONCLUSION

Our findings extend theories of rapid SSRI action on the neural processing of rewarding and aversive stimuli and suggest a specific and acute effect of escitalopram in the punishment neurocircuitry.

Serotonergic inhibition of responding for conditioned but not primary reinforcers

Serotonin is widely implicated as a modulator of brain reward function. However, laboratory studies have not yielded a consensus on which specific reward-related processes are influenced by serotonin and in what manner. Here we explored the role of serotonin in cue-reward learning in mice. In a first series of experiments, we found that acute administration of the serotonin reuptake inhibitors citalopram, fluoxetine, or duloxetine all reduced lever pressing reinforced on an FR1 schedule with presentation of a cue that had been previously paired with delivery of food. However, citalopram had no effect on responding that was reinforced with both cue and food on an FR1 schedule. Furthermore, citalopram did not affect nose poke responses that produced no auditory, visual, or proprioceptive cues but were reinforced with food pellets on a progressive ratio schedule. We next performed region-specific knock out of tryptophan hydroxylase-2 (Tph2), the rate-limiting enzyme in serotonin synthesis. Viral delivery of Cre recombinase was targeted to dorsal or median raphe nuclei (DRN, MRN), the major sources of ascending serotonergic projections. MRN but not DRN knockouts were impaired in development of cue-elicited approach during Pavlovian conditioning; both groups were subsequently hyper-responsive when lever pressing for cue presentation. The inhibitory effect of citalopram was attenuated in DRN but not MRN knockouts. Our findings are in agreement with prior studies showing serotonin to suppress responding for conditioned reinforcers. Furthermore, these results suggest an inhibitory role of MRN serotonin neurons in the initial attribution of motivational properties to a reward-predictive cue, but not in its subsequent maintenance. In contrast, the DRN appears to promote the reduction of motivational value attached to a cue when it is presented repeatedly in the absence of primary reward.

Pivotal mental states

This paper introduces a new construct, the 'pivotal mental state', which is defined as a hyper-plastic state aiding rapid and deep learning that can mediate psychological transformation. We believe this new construct bears relevance to a broad range of psychological and psychiatric phenomena. We argue that pivotal mental states serve an important evolutionary function, that is, to aid psychological transformation when actual or perceived environmental pressures demand this. We cite evidence that chronic stress and neurotic traits are primers for a pivotal mental state, whereas acute stress can be a trigger. Inspired by research with serotonin 2A receptor agonist psychedelics, we highlight how activity at this particular receptor can robustly and reliably induce pivotal mental states, but we argue that the capacity for pivotal mental states is an inherent property of the human brain itself. Moreover, we hypothesize that serotonergic psychedelics hijack a system that has evolved to mediate rapid and deep learning when its need is sensed. We cite a breadth of evidences linking stress via a variety of inducers, with an upregulated serotonin 2A receptor system (e.g. upregulated availability of and/or binding to the receptor) and acute stress with 5-HT release, which we argue can activate this primed system to induce a pivotal mental state. The pivotal mental state model is multi-level, linking a specific molecular gateway (increased serotonin 2A receptor signaling) with the inception of a hyper-plastic brain and mind state, enhanced rate of associative learning and the potential mediation of a psychological transformation.

Modulating the Neuromodulators: Dopamine, Serotonin, and the Endocannabinoid System

Dopamine (DA), serotonin (5-hydroxytryptamine, 5-HT), and endocannabinoids (ECs) are key neuromodulators involved in many aspects of motivated behavior, including reward processing, reinforcement learning, and behavioral flexibility. Among the longstanding views about possible relationships between these neuromodulators is the idea of DA and 5-HT acting as opponents. This view has been challenged by emerging evidence that 5-HT supports reward seeking via activation of DA neurons in the ventral tegmental area. Adding an extra layer of complexity to these interactions, the endocannabinoid system is uniquely placed to influence dopaminergic and serotonergic neurotransmission. In this review we discuss how these three neuromodulatory systems interact at the cellular and circuit levels. Technological advances that facilitate precise identification and control of genetically targeted neuronal populations will help to achieve a better understanding of the complex relationship between these essential systems, and the potential relevance for motivated behavior.

Mapping Large-Scale Networks Associated with Action, Behavioral Inhibition and Impulsivity

A key aspect of behavioral inhibition is the ability to wait before acting. Failures in this form of inhibition result in impulsivity and are commonly observed in various neuropsychiatric disorders. Prior evidence has implicated medial frontal cortex, motor cortex, orbitofrontal cortex (OFC), and ventral striatum in various aspects of inhibition. Here, using distributed recordings of brain activity [with local-field potentials (LFPs)] in rodents, we identified oscillatory patterns of activity linked with action and inhibition. Low-frequency (δ) activity within motor and premotor circuits was observed in two distinct networks, the first involved in cued, sensory-based responses and the second more generally in both cued and delayed actions. By contrast, θ activity within prefrontal and premotor regions (medial frontal cortex, OFC, ventral striatum, and premotor cortex) was linked with inhibition. Connectivity at θ frequencies was observed within this network of brain regions. Interestingly, greater connectivity between primary motor cortex (M1) and other motor regions was linked with greater impulsivity, whereas greater connectivity between M1 and inhibitory brain regions (OFC, ventral striatum) was linked with improved inhibition and diminished impulsivity. We observed similar patterns of activity on a parallel task in humans: low-frequency activity in sensorimotor cortex linked with action, θ activity in OFC/ventral prefrontal cortex (PFC) linked with inhibition. Thus, we show that δ and θ oscillations form distinct large-scale networks associated with action and inhibition, respectively.

Relationship between elevated impulsivity and cognitive declines in elderly community-dwelling individuals

Impulse control disorders are recognized as one of the behavioral and psychological symptoms of dementia (BPSD). Majority of studies on the treatment of BPSD related to impulsivity have rather focused on the aggression and agitation. In particular, it has not been investigated how cognitive declines are associated with impulsivity in community-dwelling elderly people. Here, we have measured the cognitive and memory functions and impulsivity of 212 elderly community-dwelling people using a psychometric test battery and analyzed the correlation between their level of impulsivity and cognitive functions by multiple regression analysis. We found an elevation of impulsivity, which was evaluated by the Barratt Impulsiveness Scale-11, closely related to decline of cognitive functions, which were evaluated by the Montreal Cognitive Assessment and the Mini-Mental State Examination, and Logical Memory function, which were evaluated by the Wechsler Memory Scale-Delayed Recall. Then we have divided them into groups based on the severity of cognitive decline and conducted an analysis of each group, the result of which showed that as this tendency was particularly noticeable in the suspected dementia group. Therefore, we have concluded that heightened impulsivity is negatively associated with cognitive and memory functions in community-dwelling elderly people.

Precis of Vigor: Neuroeconomics of movement control

Why do we run toward people we love, but only walk toward others? Why do people in New York seem to walk faster than other cities? Why do our eyes linger longer on things we value more? There is a link between how the brain assigns value to things, and how it controls our movements. This link is an ancient one, developed through shared neural circuits that on one hand teach us how to value things, and on the other hand control the vigor with which we move. As a result, when there is damage to systems that signal reward, like dopamine and serotonin, that damage not only affects our mood and patterns of decision making, but how we move. In this book, we first ask why in principle evolution should have developed a shared system of control between valuation and vigor. We then focus on the neural basis of vigor, synthesizing results from experiments that have measured activity in various brain structures and neuromodulators, during tasks in which animals decide how patiently they should wait for reward, and how vigorously they should move to acquire it. Thus, the way we move unmasks one of our well-guarded secrets: how much we value the thing we are moving toward.