Reward probability and timing uncertainty alter the effect of dorsal raphe serotonin neurons on patience

The nucleus accumbens in reward and aversion processing: insights and implications

The nucleus accumbens (NAc), a central component of the brain's reward circuitry, has been implicated in a wide range of behaviors and emotional states. Emerging evidence, primarily drawing from recent rodent studies, suggests that the function of the NAc in reward and aversion processing is multifaceted. Prolonged stress or drug use induces maladaptive neuronal function in the NAc circuitry, which results in pathological conditions. This review aims to provide comprehensive and up-to-date insights on the role of the NAc in motivated behavior regulation and highlights areas that demand further in-depth analysis. It synthesizes the latest findings on how distinct NAc neuronal populations and pathways contribute to the processing of opposite valences. The review examines how a range of neuromodulators, especially monoamines, influence the NAc's control over various motivational states. Furthermore, it delves into the complex underlying mechanisms of psychiatric disorders such as addiction and depression and evaluates prospective interventions to restore NAc functionality.

Optogenetic activation of dorsal raphe serotonin neurons induces brain-wide activation

Serotonin is a neuromodulator that affects multiple behavioral and cognitive functions. Nonetheless, how serotonin causes such a variety of effects via brain-wide projections and various receptors remains unclear. Here we measured brain-wide responses to optogenetic stimulation of serotonin neurons in the dorsal raphe nucleus (DRN) of the male mouse brain using functional MRI with an 11.7 T scanner and a cryoprobe. Transient activation of DRN serotonin neurons caused brain-wide activation, including the medial prefrontal cortex, the striatum, and the ventral tegmental area. The same stimulation under anesthesia with isoflurane decreased brain-wide activation, including the hippocampal complex. These brain-wide response patterns can be explained by DRN serotonergic projection topography and serotonin receptor expression profiles, with enhanced weights on 5-HT1 receptors. Together, these results provide insight into the DR serotonergic system, which is consistent with recent discoveries of its functions in adaptive behaviors.

Impaired value-based decision-making in Parkinson's disease apathy

Apathy is a common and disabling complication of Parkinson's disease characterized by reduced goal-directed behaviour. Several studies have reported dysfunction within prefrontal cortical regions and projections from brainstem nuclei whose neuromodulators include dopamine, serotonin and noradrenaline. Work in animal and human neuroscience have confirmed contributions of these neuromodulators on aspects of motivated decision-making. Specifically, these neuromodulators have overlapping contributions to encoding the value of decisions, and influence whether to explore alternative courses of action or persist in an existing strategy to achieve a rewarding goal. Building upon this work, we hypothesized that apathy in Parkinson's disease should be associated with an impairment in value-based learning. Using a four-armed restless bandit reinforcement learning task, we studied decision-making in 75 volunteers; 53 patients with Parkinson's disease, with and without clinical apathy, and 22 age-matched healthy control subjects. Patients with apathy exhibited impaired ability to choose the highest value bandit. Task performance predicted an individual patient's apathy severity measured using the Lille Apathy Rating Scale (R = -0.46, P < 0.001). Computational modelling of the patient's choices confirmed the apathy group made decisions that were indifferent to the learnt value of the options, consistent with previous reports of reward insensitivity. Further analysis demonstrated a shift away from exploiting the highest value option and a reduction in perseveration, which also correlated with apathy scores (R = -0.5, P < 0.001). We went on to acquire functional MRI in 59 volunteers; a group of 19 patients with and 20 without apathy and 20 age-matched controls performing the Restless Bandit Task. Analysis of the functional MRI signal at the point of reward feedback confirmed diminished signal within ventromedial prefrontal cortex in Parkinson's disease, which was more marked in apathy, but not predictive of their individual apathy severity. Using a model-based categorization of choice type, decisions to explore lower value bandits in the apathy group activated prefrontal cortex to a similar degree to the age-matched controls. In contrast, Parkinson's patients without apathy demonstrated significantly increased activation across a distributed thalamo-cortical network. Enhanced activity in the thalamus predicted individual apathy severity across both patient groups and exhibited functional connectivity with dorsal anterior cingulate cortex and anterior insula. Given that task performance in patients without apathy was no different to the age-matched control subjects, we interpret the recruitment of this network as a possible compensatory mechanism, which compensates against symptomatic manifestation of apathy in Parkinson's disease.

Maturation of cortical input to dorsal raphe nucleus increases behavioral persistence in mice

The ability to persist toward a desired objective is a fundamental aspect of behavioral control whose impairment is implicated in several behavioral disorders. One of the prominent features of behavioral persistence is that its maturation occurs relatively late in development. This is presumed to echo the developmental time course of a corresponding circuit within late-maturing parts of the brain, such as the prefrontal cortex, but the specific identity of the responsible circuits is unknown. Here, we used a genetic approach to describe the maturation of the projection from layer 5 neurons of the neocortex to the dorsal raphe nucleus in mice. Using optogenetic-assisted circuit mapping, we show that this projection undergoes a dramatic increase in synaptic potency between postnatal weeks 3 and 8, corresponding to the transition from juvenile to adult. We then show that this period corresponds to an increase in the behavioral persistence that mice exhibit in a foraging task. Finally, we used a genetic targeting strategy that primarily affected neurons in the medial prefrontal cortex, to selectively ablate this pathway in adulthood and show that mice revert to a behavioral phenotype similar to juveniles. These results suggest that frontal cortical to dorsal raphe input is a critical anatomical and functional substrate of the development and manifestation of behavioral persistence.

Germinal matrix hemorrhage induces immune responses, brain injury, and motor impairment in neonatal rats

Germinal matrix hemorrhage (GMH) is a major complication of prematurity that causes secondary brain injury and is associated with long-term neurological disabilities. This study used a postnatal day 5 rat model of GMH to explore immune response, brain injury, and neurobehavioral changes after hemorrhagic injury. The results showed that CD45high/CD11b+ immune cells increased in the brain after GMH and were accompanied by increased macrophage-related chemokine/cytokines and inflammatory mediators. Hematoma formed as early as 2 h after injection of collagenase VII and white matter injury appeared not only in the external capsule and hippocampus, but also in the thalamus. In addition, GMH caused abnormal motor function as revealed by gait analysis, and locomotor hyperactivity in the elevated plus maze, though no other obvious anxiety or recognition/memory function changes were noted when examined by the open field test and novel object recognition test. The animal model used here partially reproduces the GMH-induced brain injury and motor dysfunction seen in human neonates and therefore can be used as a valid tool in experimental studies for the development of effective therapeutic strategies for GMH-induced brain injury.

Local 5-HT signaling bi-directionally regulates the coincidence time window for associative learning

The coincidence between conditioned stimulus (CS) and unconditioned stimulus (US) is essential for associative learning; however, the mechanism regulating the duration of this temporal window remains unclear. Here, we found that serotonin (5-HT) bi-directionally regulates the coincidence time window of olfactory learning in Drosophila and affects synaptic plasticity of Kenyon cells (KCs) in the mushroom body (MB). Utilizing GPCR-activation-based (GRAB) neurotransmitter sensors, we found that KC-released acetylcholine (ACh) activates a serotonergic dorsal paired medial (DPM) neuron, which in turn provides inhibitory feedback to KCs. Physiological stimuli induce spatially heterogeneous 5-HT signals, which proportionally gate the intrinsic coincidence time windows of different MB compartments. Artificially reducing or increasing the DPM neuron-released 5-HT shortens or prolongs the coincidence window, respectively. In a sequential trace conditioning paradigm, this serotonergic neuromodulation helps to bridge the CS-US temporal gap. Altogether, we report a model circuitry for perceiving the temporal coincidence and determining the causal relationship between environmental events.

Medial Prefrontal Cortex Serotonin Input Regulates Cognitive Flexibility in Mice

The medial prefrontal cortex (mPFC) regulates cognitive flexibility and emotional behavior. Neurons that release serotonin project to the mPFC, and serotonergic drugs influence emotion and cognition. Yet, the specific roles of endogenous serotonin release in the mPFC on neurophysiology and behavior are unknown. We show that axonal serotonin release in the mPFC directly inhibits the major mPFC output neurons. In serotonergic neurons projecting from the dorsal raphe to the mPFC, we find endogenous activity signatures pre-reward retrieval and at reward retrieval during a cognitive flexibility task. In vivo optogenetic activation of this pathway during pre-reward retrieval selectively improved extradimensional rule shift performance while inhibition impaired it, demonstrating sufficiency and necessity for mPFC serotonin release in cognitive flexibility. Locomotor activity and anxiety-like behavior were not affected by either optogenetic manipulation. Collectively, our data reveal a powerful and specific modulatory role of endogenous serotonin release from dorsal raphe-to-mPFC projecting neurons in cognitive flexibility.

Temporal derivative computation in the dorsal raphe network revealed by an experimentally driven augmented integrate-and-fire modeling framework

By means of an expansive innervation, the serotonin (5-HT) neurons of the dorsal raphe nucleus (DRN) are positioned to enact coordinated modulation of circuits distributed across the entire brain in order to adaptively regulate behavior. Yet the network computations that emerge from the excitability and connectivity features of the DRN are still poorly understood. To gain insight into these computations, we began by carrying out a detailed electrophysiological characterization of genetically identified mouse 5-HT and somatostatin (SOM) neurons. We next developed a single-neuron modeling framework that combines the realism of Hodgkin-Huxley models with the simplicity and predictive power of generalized integrate-and-fire models. We found that feedforward inhibition of 5-HT neurons by heterogeneous SOM neurons implemented divisive inhibition, while endocannabinoid-mediated modulation of excitatory drive to the DRN increased the gain of 5-HT output. Our most striking finding was that the output of the DRN encodes a mixture of the intensity and temporal derivative of its input, and that the temporal derivative component dominates this mixture precisely when the input is increasing rapidly. This network computation primarily emerged from prominent adaptation mechanisms found in 5-HT neurons, including a previously undescribed dynamic threshold. By applying a bottom-up neural network modeling approach, our results suggest that the DRN is particularly apt to encode input changes over short timescales, reflecting one of the salient emerging computations that dominate its output to regulate behavior.

Importance of Path Planning Variability: A Simulation Study

Individuals vary in the way they navigate through space. Some take novel shortcuts, while others rely on known routes to find their way around. We wondered how and why there is so much variation in the population. To address this, we first compared the trajectories of 368 human subjects navigating a virtual maze with simulated trajectories. The simulated trajectories were generated by strategy-based path planning algorithms from robotics. Based on the similarities between human trajectories and different strategy-based simulated trajectories, we found that there is a variation in the type of strategy individuals apply to navigate space, as well as variation within individuals on a trial-by-trial basis. Moreover, we observed variation within a trial when subjects occasionally switched the navigation strategies halfway through a trajectory. In these cases, subjects started with a route strategy, in which they followed a familiar path, and then switched to a survey strategy, in which they took shortcuts by considering the layout of the environment. Then we simulated a second set of trajectories using five different but comparable artificial maps. These trajectories produced the similar pattern of strategy variation within and between trials. Furthermore, we varied the relative cost, that is, the assumed mental effort or required timesteps to choose a learned route over alternative paths. When the learned route was relatively costly, the simulated agents tended to take shortcuts. Conversely, when the learned route was less costly, the simulated agents showed preference toward a route strategy. We suggest that cost or assumed mental effort may be the reason why in previous studies, subjects used survey knowledge when instructed to take the shortest path. We suggest that this variation we observe in humans may be beneficial for robotic swarms or collections of autonomous agents during information gathering.

Regulation of social hierarchy learning by serotonin transporter availability

Learning one's status in a group is a fundamental process in building social hierarchies. Although animal studies suggest that serotonin (5-HT) signaling modulates learning social hierarchies, direct evidence in humans is lacking. Here we determined the relationship between serotonin transporter (SERT) availability and brain systems engaged in learning social ranks combining computational approaches with simultaneous PET-fMRI acquisition in healthy males. We also investigated the link between SERT availability and brain activity in a non-social control condition involving learning the payoffs of slot machines. Learning social ranks was modulated by the dorsal raphe nucleus (DRN) 5-HT function. BOLD ventral striatal response, tracking the rank of opponents, decreased with DRN SERT levels. Moreover, this link was specific to the social learning task. These findings demonstrate that 5-HT plays an influence on the computations required to learn social ranks.

The molecular pathophysiology of depression and the new therapeutics

Major depressive disorder (MDD) is a highly prevalent and disabling disorder. Despite the many hypotheses proposed to understand the molecular pathophysiology of depression, it is still unclear. Current treatments for depression are inadequate for many individuals, because of limited effectiveness, delayed efficacy (usually two weeks), and side effects. Consequently, novel drugs with increased speed of action and effectiveness are required. Ketamine has shown to have rapid, reliable, and long-lasting antidepressant effects in treatment-resistant MDD patients and represent a breakthrough therapy for patients with MDD; however, concerns regarding its efficacy, potential misuse, and side effects remain. In this review, we aimed to summarize molecular mechanisms and pharmacological treatments for depression. We focused on the fast antidepressant treatment and clarified the safety, tolerability, and efficacy of ketamine and its metabolites for the MDD treatment, along with a review of the potential pharmacological mechanisms, research challenges, and future clinical prospects.

Understanding the effects of serotonin in the brain through its role in the gastrointestinal tract

The neuromodulatory arousal system imbues the nervous system with the flexibility and robustness required to facilitate adaptive behaviour. While there are well-understood mechanisms linking dopamine, noradrenaline and acetylcholine to distinct behavioural states, similar conclusions have not been as readily available for serotonin. Fascinatingly, despite clear links between serotonergic function and cognitive capacities as diverse as reward processing, exploration, and the psychedelic experience, over 95% of the serotonin in the body is released in the gastrointestinal tract, where it controls digestive muscle contractions (peristalsis). Here, we argue that framing neural serotonin as a rostral extension of the gastrointestinal serotonergic system dissolves much of the mystery associated with the central serotonergic system. Specifically, we outline that central serotonin activity mimics the effects of a digestion/satiety circuit mediated by hypothalamic control over descending serotonergic nuclei in the brainstem. We review commonalities and differences between these two circuits, with a focus on the heterogeneous expression of different classes of serotonin receptors in the brain. Much in the way that serotonin-induced peristalsis facilitates the work of digestion, serotonergic influences over cognition can be reframed as performing the work of cognition. Extending this analogy, we argue that the central serotonergic system allows the brain to arbitrate between different cognitive modes as a function of serotonergic tone: low activity facilitates cognitive automaticity, whereas higher activity helps to identify flexible solutions to problems, particularly if and when the initial responses fail. This perspective sheds light on otherwise disparate capacities mediated by serotonin, and also helps to understand why there are such pervasive links between serotonergic pathology and the symptoms of psychiatric disorders.

Design Principles for Neurorobotics

In their book “How the Body Shapes the Way We Think: A New View of Intelligence,” Pfeifer and Bongard put forth an embodied approach to cognition. Because of this position, many of their robot examples demonstrated “intelligent” behavior despite limited neural processing. It is our belief that neurorobots should attempt to follow many of these principles. In this article, we discuss a number of principles to consider when designing neurorobots and experiments using robots to test brain theories. These principles are strongly inspired by Pfeifer and Bongard, but build on their design principles by grounding them in neuroscience and by adding principles based on neuroscience research. Our design principles fall into three categories. First, organisms must react quickly and appropriately to events. Second, organisms must have the ability to learn and remember over their lifetimes. Third, organisms must weigh options that are crucial for survival. We believe that by following these design principles a robot's behavior will be more naturalistic and more successful.

A neurobiological perspective on social influence: Serotonin and social adaptation

Humans are inherently social beings. Being suggestible to each other's expectations enables pro-social skills that are crucial for social learning and adaptation. Despite its high relevance for psychiatry, the neurobiological mechanisms underlying social adaptation are still not well understood. This review therefore provides a conceptual framework covering various distinct mechanisms underlying social adaptation and explores the neuropharmacology - in particular the role of the serotonin (5-HT) system - modulating these mechanisms. This article therefore reviews empirical results on social influence processing and reconciles them with recent findings from psychedelic research on social processing to elucidate neurobiological and neuropharmacological underpinnings of social adaptation. Various computational, neurobiological, and neurochemical processes are involved in distinct mechanisms underlying social adaptation such as the multisensory process of social information integration that is crucial for the forming of self-representation and representations of social norms. This is again associated with self- and other-perception during social interactions as well as value-based decision making that guides our behaviour in daily interactions. We highlight the critical role of 5-HT in these processes and suggest that 5-HT can facilitate social learning and may represent an important target for treating psychiatric disorders characterized by impairments in social functioning. This framework also has important implications for psychedelic-assisted therapy as well as for the development of novel treatment approaches and future research directions.

A Role for Serotonin in Modulating Opposing Drive and Brake Circuits of Impulsivity

Impulsivity generally refers to a deficit in inhibition, with a focus on understanding the neural circuits which constitute the “brake” on actions and gratification. It is likely that increased impulsivity can arise not only from reduced inhibition, but also from a heightened or exaggerated excitatory “drive.” For example, an action which has more vigor, or is fueled by either increased incentive salience or a stronger action-outcome association, may be harder to inhibit. From this perspective, this review focuses on impulse control as a competition over behavioral output between an initially learned response-reward outcome association, and a subsequently acquired opposing inhibitory association. Our goal is to present a synthesis of research from humans and animal models that supports this dual-systems approach to understanding the behavioral and neural substrates that contribute to impulsivity, with a focus on the neuromodulatory role of serotonin. We review evidence for the role of serotonin signaling in mediating the balance of the “drive” and “brake” circuits. Additionally, we consider parallels of these competing instrumental systems in impulsivity within classical conditioning processes (e.g., extinction) in order to point us to potential behavioral and neural mechanisms that may modulate the competing instrumental associations. Finally, we consider how the balance of these competing associations might contribute to, or be extracted from, our experimental assessments of impulsivity. A careful understanding of the underlying behavioral and circuit level contributions to impulsivity is important for understanding the pathogenesis of increased impulsivity present in a number of psychiatric disorders. Pathological levels of impulsivity in such disorders are likely subserved by deficits in the balance of motivational and inhibitory processes.

Altered medial prefrontal cortex and dorsal raphé activity predict genotype and correlate with abnormal learning behavior in a mouse model of autism-associated 2p16.3 deletion

2p16.3 deletion, involving NEUREXIN1 (NRXN1) heterozygous deletion, substantially increases the risk of developing autism and other neurodevelopmental disorders. We have a poor understanding of how NRXN1 heterozygosity impacts on brain function and cognition to increase the risk of developing the disorder. Here we characterize the impact of Nrxn1α heterozygosity on cerebral metabolism, in mice, using ¹⁴C‐2‐deoxyglucose imaging. We also assess performance in an olfactory‐based discrimination and reversal learning (OB‐DaRL) task and locomotor activity. We use decision tree classifiers to test the predictive relationship between cerebral metabolism and Nrxn1α genotype. Our data show that Nrxn1α heterozygosity induces prefrontal cortex (medial prelimbic cortex, mPrL) hypometabolism and a contrasting dorsal raphé nucleus (DRN) hypermetabolism. Metabolism in these regions allows for the predictive classification of Nrxn1α genotype. Consistent with reduced mPrL glucose utilization, prefrontal cortex insulin receptor signaling is decreased in Nrxn1α^+/− mice. Behaviorally, Nrxn1α^+/− mice show enhanced learning of a novel discrimination, impaired reversal learning and an increased latency to make correct choices. In addition, male Nrxn1α^+/− mice show hyperlocomotor activity. Correlative analysis suggests that mPrL hypometabolism contributes to the enhanced novel odor discrimination seen in Nrxn1α^+/− mice, while DRN hypermetabolism contributes to their increased latency in making correct choices. The data show that Nrxn1α heterozygosity impacts on prefrontal cortex and serotonin system function, which contribute to the cognitive alterations seen in these animals. The data suggest that Nrxn1α^+/− mice provide a translational model for the cognitive and behavioral alterations seen in autism and other neurodevelopmental disorders associated with 2p16.3 deletion.

Complementary roles of serotonergic and cholinergic systems in decisions about when to act

Decision-making not only involves deciding about which action to choose but when and whether to initiate an action in the first place. Macaque monkeys tracked number of dots on a screen and could choose when to make a response. The longer the animals waited before responding, the more dots appeared on the screen and the higher the probability of reward. Monkeys waited longer before making a response when a trial’s value was less than the environment’s average value. Recordings of brain activity with fMRI revealed that activity in dorsal raphe nucleus (DRN)—a key source of serotonin (5-HT)—tracked average value of the environment. By contrast, activity in the basal forebrain (BF)—an important source of acetylcholine (ACh)—was related to decision time to act as a function of immediate and recent past context. Interactions between DRN and BF and the anterior cingulate cortex (ACC), another region with action initiation-related activity, occurred as a function of the decision time to act. Next, we performed two psychopharmacological studies. Manipulating systemic 5-HT by citalopram prolonged the time macaques waited to respond for a given opportunity. This effect was more evident during blocks with long inter-trial intervals (ITIs) where good opportunities were sparse. Manipulating systemic acetylcholine (ACh) by rivastigmine reduced the time macaques waited to respond given the immediate and recent past context, a pattern opposite to the effect observed with 5-HT. These findings suggest complementary roles for serotonin/DRN and acetylcholine/BF in decisions about when to initiate an action.

•

Both immediate context and wider environment influence decisions about when to act

•

DRN and 5-HT mediate the influence of wider environment

•

BF and ACh mediate the influence of immediate context

Metacognitive resources for adaptive learning⋆

Biological organisms display remarkably flexible behaviours. This is an area of active investigation, in particular in the fields of artificial intelligence, computational and cognitive neuroscience. While inductive biases and broader cognitive functions are undoubtedly important, the ability to monitor and evaluate one's performance or oneself -- metacognition -- strikes as a powerful resource for efficient learning. Often measured as decision confidence in neuroscience and psychology experiments, metacognition appears to reflect a broad range of abstraction levels and downstream behavioural effects. Within this context, the formal investigation of how metacognition interacts with learning processes is a recent endeavour. Of special interest are the neural and computational underpinnings of confidence and reinforcement learning modules. This review discusses a general hierarchy of confidence functions and their neuro-computational relevance for adaptive behaviours. It then introduces novel ways to study the formation and use of meta-representations and nonconscious mental representations related to learning and confidence, and concludes with a discussion on outstanding questions and wider perspectives.

Cortical Serotonergic and Catecholaminergic Denervation in MPTP-Treated Parkinsonian Monkeys

Decreased cortical serotonergic and catecholaminergic innervation of the frontal cortex has been reported at early stages of Parkinson's disease (PD). However, the limited availability of animal models that exhibit these pathological features has hampered our understanding of the functional significance of these changes during the course of the disease. In the present study, we assessed longitudinal changes in cortical serotonin and catecholamine innervation in motor-symptomatic and asymptomatic monkeys chronically treated with low doses of 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine (MPTP). Densitometry and unbiased stereological techniques were used to quantify changes in serotonin and tyrosine hydroxylase (TH) immunoreactivity in frontal cortices of 3 control monkeys and 3 groups of MPTP-treated monkeys (motor-asymptomatic [N = 2], mild parkinsonian [N = 3], and moderate parkinsonian [N = 3]). Our findings revealed a significant decrease (P < 0.001) in serotonin innervation of motor (Areas 4 and 6), dorsolateral prefrontal (Areas 9 and 46), and limbic (Areas 24 and 25) cortical areas in motor-asymptomatic MPTP-treated monkeys. Both groups of symptomatic MPTP-treated animals displayed further serotonin denervation in these cortical regions (P < 0.0001). A significant loss of serotonin-positive dorsal raphe neurons was found in the moderate parkinsonian group. On the other hand, the intensity of cortical TH immunostaining was not significantly affected in motor asymptomatic MPTP-treated monkeys, but underwent a significant reduction in the moderate symptomatic group (P < 0.05). Our results indicate that chronic intoxication with MPTP induces early pathology in the corticopetal serotonergic system, which may contribute to early non-motor symptoms in PD.

Serotonergic regulation of the dopaminergic system: Implications for reward-related functions

Serotonin is a critical neuromodulator involved in development and behavior. Its role in reward is however still debated. Here, we first review classical studies involving electrical stimulation protocols and pharmacological approaches. Contradictory results on the serotonergic' involvement in reward emerge from these studies. These differences might be ascribable to either the diversity of cellular types within the raphe nuclei or/and the specific projection pathways of serotonergic neurons. We continue to review more recent work, using optogenetic approaches to activate serotonergic cells in the Raphe to VTA pathway. From these studies, it appears that activation of this pathway can lead to reinforcement learning mediated through the excitation of dopaminergic neurons by serotonergic neurons co-transmitting glutamate. Finally, given the importance of serotonin during development on adult emotion, the effect of abnormal early-life levels of serotonin on the dopaminergic system will also be discussed. Understanding the interaction between the serotonergic and dopaminergic systems during development and adulthood is critical to gain insight into the specific facets of neuropsychiatric disorders.

Effects of porcine bone marrow-derived platelet-rich plasma on bone marrow-derived mesenchymal stem cells and endothelial progenitor cells

This study investigated the abundance of pro-regenerative growth factors in bone marrow-derived platelet-rich plasma (BM-PRP) and their effects on bone marrow-derived mesenchymal stem cells (BM-MSC) and bone marrow-derived endothelial progenitor cells (BM-EPC). Four 4-5 months-old domestic pigs were included, and each underwent bone marrow aspiration from its humerus bones and processed into bone marrow aspiration concentrate (BMAC) samples. The plasma and cellular portions of BMAC were subsequently separated and collected. The concentration of growth factors including BMP-2, PDGF-BB, TGF-β1 and VEGF in the plasma portion was measured and compared between BM-PRP and bone marrow-derived platelet-poor plasma (BM-PPP). It was found that platelet count was significantly higher in BM-PRP than in BM-PPP, but the concentration of above-mentioned growth factors was not significantly different between BM-PRP and BM-PPP. As most existing literature has indicated the regenerative potency of PRP, this study focused on assessing the effect of BM-PRP treatment on BM-MSC and BM-EPC proliferation, osteogenic differentiation and angiogenesis capacity by comparing samples with 2.5% BM-PRP treatment and samples without BM-PRP treatment (control). In response to BM-PRP treatment, the cellular doubling time increased with culturing time and was significantly shorter in the BM-PRP-treated samples than in control samples. For osteogenic differentiation, BM-PRP-treated BM-MSCs demonstrated a time-dependent increase in alkaline phosphatase (ALP) activity and expression levels of osteogenic differentiation markers. For the expression of angiogenic genes, none of the differences reached statistical significance despite a tendency of stronger expression at day 18 in BM-PRP-treated BM-EPCs. In conclusion, this in vitro study suggests that most BMP-2, PDGF-BB, TGF-β1 and VEGF-A contained in BM-PRP are not platelet-released and BM-PRP may have some stimulation (less than 1-fold) for MSC, EPC proliferation and MSC osteogenic differentiation.

Pivotal mental states

This paper introduces a new construct, the 'pivotal mental state', which is defined as a hyper-plastic state aiding rapid and deep learning that can mediate psychological transformation. We believe this new construct bears relevance to a broad range of psychological and psychiatric phenomena. We argue that pivotal mental states serve an important evolutionary function, that is, to aid psychological transformation when actual or perceived environmental pressures demand this. We cite evidence that chronic stress and neurotic traits are primers for a pivotal mental state, whereas acute stress can be a trigger. Inspired by research with serotonin 2A receptor agonist psychedelics, we highlight how activity at this particular receptor can robustly and reliably induce pivotal mental states, but we argue that the capacity for pivotal mental states is an inherent property of the human brain itself. Moreover, we hypothesize that serotonergic psychedelics hijack a system that has evolved to mediate rapid and deep learning when its need is sensed. We cite a breadth of evidences linking stress via a variety of inducers, with an upregulated serotonin 2A receptor system (e.g. upregulated availability of and/or binding to the receptor) and acute stress with 5-HT release, which we argue can activate this primed system to induce a pivotal mental state. The pivotal mental state model is multi-level, linking a specific molecular gateway (increased serotonin 2A receptor signaling) with the inception of a hyper-plastic brain and mind state, enhanced rate of associative learning and the potential mediation of a psychological transformation.

Phasic Activation of Dorsal Raphe Serotonergic Neurons Increases Pupil Size

Transient variations in pupil size (PS) under constant luminance are coupled to rapid changes in arousal state,1-3 which have been interpreted as vigilance,4 salience,5 or a surprise signal.6-8 Neural control of such fluctuations presumably involves multiple brain regions5,9-11 and neuromodulatory systems,3,12,13 but it is often associated with phasic activity of the noradrenergic system.9,12,14,15 Serotonin (5-HT), a neuromodulator also implicated in aspects of arousal16 such as sleep-wake transitions,17 motivational state regulation,18 and signaling of unexpected events,19 seems to affect PS,20-24 but these effects have not been investigated in detail. Here we show that phasic 5-HT neuron stimulation causes transient PS changes. We used optogenetic activation of 5-HT neurons in the dorsal raphe nucleus (DRN) of head-fixed mice performing a foraging task. 5-HT-driven modulations of PS were maintained throughout the photostimulation period and sustained for a few seconds after the end of stimulation. We found no evidence that the increase in PS with activation of 5-HT neurons resulted from interactions of photostimulation with behavioral variables, such as locomotion or licking. Furthermore, we observed that the effect of 5-HT on PS depended on the level of environmental uncertainty, consistent with the idea that 5-HT could report a surprise signal.19 These results advance our understanding of the neuromodulatory control of PS, revealing a tight relationship between phasic activation of 5-HT neurons and changes in PS.

Between Action and Emotional Survival During the COVID-19 era: Sensorimotor Pathways as Control Systems of Transdiagnostic Anxiety-Related Intolerance to Uncertainty

Objectives: The COVID-19 pandemic and aligned social and physical distancing regulations increase the sense of uncertainty, intensifying the risk for psychopathology globally. Anxiety disorders are associated with intolerance to uncertainty. In this review we describe brain circuits and sensorimotor pathways involved in human reactions to uncertainty. We present the healthy mode of coping with uncertainty and discuss deviations from this mode. Methods: Literature search of PubMed and Google Scholar. Results: As manifestation of anxiety disorders includes peripheral reactions and negative cognitions, we suggest an integrative model of threat cognitions modulated by sensorimotor regions: "The Sensorimotor-Cognitive-Integration-Circuit." The model emphasizes autonomic nervous system coupling with the cortex, addressing peripheral anxious reactions to uncertainty, pathways connecting cortical regions and cost-reward evaluation circuits to sensorimotor regions, filtered by the amygdala and basal ganglia. Of special interest are the ascending and descending tracts for sensory-motor crosstalk in healthy and pathological conditions. We include arguments regarding uncertainty in anxiety reactions to the pandemic and derive from our model treatment suggestions which are supported by scientific evidence. Our model is based on systematic control theories and emphasizes the role of goal conflict regulation in health and pathology. We also address anxiety reactions as a spectrum ranging from healthy to pathological coping with uncertainty, and present this spectrum as a transdiagnostic entity in accordance with recent claims and models. Conclusions: The human need for controllability and predictability suggests that anxiety disorders reactive to the pandemic's uncertainties reflect pathological disorganization of top-down bottom-up signaling and neural noise resulting from non-pathological human needs for coherence in life.

Influence of ovarian hormones on value-based decision-making systems: Contribution to sexual dimorphisms in mental disorders

Women and men exhibit differences in behavior when making value-based decisions. Various hypotheses have been proposed to explain these findings, stressing differences in functional lateralization of the brain, functional activation, neurotransmitter involvement and more recently, sex hormones. While a significant interaction of neurotransmitter systems and sex hormones has been shown for both sexes, decision-making in women might be particularly affected by variations of ovarian hormones. In this review we have gathered information from animal and human studies on how ovarian hormones affect decision-making processes in females by interacting with neurotransmitter systems at functionally relevant brain locations and thus modify the computation of decision aspects. We also review previous findings on impaired decision-making in animals and clinical populations with substance use disorder and depression, emphasizing how little we know about the role of ovarian hormones in aberrant decision-making.

Serotonergic projections to the orbitofrontal and medial prefrontal cortices differentially modulate waiting for future rewards

Optogenetic activation of serotonergic neurons in the dorsal raphe nucleus (DRN) enhances patience when waiting for future rewards, and this effect is maximized by both high probability and high timing uncertainty of reward. Here, we explored which serotonin projection areas contribute to these effects using optogenetic axon terminal stimulation. We found that serotonin stimulation in the orbitofrontal cortex (OFC) is nearly as effective as that in the DRN for promoting waiting, while in the nucleus accumbens, it does not promote waiting. We also found that serotonin stimulation in the medial prefrontal cortex (mPFC) promotes waiting only when the timing of future rewards is uncertain. Our Bayesian decision model of waiting assumed that the OFC and mPFC calculate the posterior probability of reward delivery separately. These results suggest that serotonin in the mPFC affects evaluation of time committed, while serotonin in the OFC is responsible for overall valuation of delayed rewards.

Neurorobots as a Means Toward Neuroethology and Explainable AI

Understanding why deep neural networks and machine learning algorithms act as they do is a difficult endeavor. Neuroscientists are faced with similar problems. One way biologists address this issue is by closely observing behavior while recording neurons or manipulating brain circuits. This has been called neuroethology. In a similar way, neurorobotics can be used to explain how neural network activity leads to behavior. In real world settings, neurorobots have been shown to perform behaviors analogous to animals. Moreover, a neuroroboticist has total control over the network, and by analyzing different neural groups or studying the effect of network perturbations (e.g., simulated lesions), they may be able to explain how the robot's behavior arises from artificial brain activity. In this paper, we review neurorobot experiments by focusing on how the robot's behavior leads to a qualitative and quantitative explanation of neural activity, and vice versa, that is, how neural activity leads to behavior. We suggest that using neurorobots as a form of computational neuroethology can be a powerful methodology for understanding neuroscience, as well as for artificial intelligence and machine learning.

Psychological mechanisms and functions of 5-HT and SSRIs in potential therapeutic change: Lessons from the serotonergic modulation of action selection, learning, affect, and social cognition

Uncertainty regarding which psychological mechanisms are fundamental in mediating SSRI treatment outcomes and wide-ranging variability in their efficacy has raised more questions than it has solved. Since subjective mood states are an abstract scientific construct, only available through self-report in humans, and likely involving input from multiple top-down and bottom-up signals, it has been difficult to model at what level SSRIs interact with this process. Converging translational evidence indicates a role for serotonin in modulating context-dependent parameters of action selection, affect, and social cognition; and concurrently supporting learning mechanisms, which promote adaptability and behavioural flexibility. We examine the theoretical basis, ecological validity, and interaction of these constructs and how they may or may not exert a clinical benefit. Specifically, we bridge crucial gaps between disparate lines of research, particularly findings from animal models and human clinical trials, which often seem to present irreconcilable differences. In determining how SSRIs exert their effects, our approach examines the endogenous functions of 5-HT neurons, how 5-HT manipulations affect behaviour in different contexts, and how their therapeutic effects may be exerted in humans - which may illuminate issues of translational models, hierarchical mechanisms, idiographic variables, and social cognition.

Enhancement of bone marrow aspirate concentrate with local self-healing corticotomies

Bone marrow aspirate concentrate (BMAC) is a potentially useful biological product for bone regeneration. This study investigated whether BMAC can be enriched by local minor corticotomies. Five 4-month-old domestic pigs were used with each pig undergoing two minor corticotomies at one randomly-selected tibia. Two weeks after the operation, bone marrow was aspirated from both tibiae and processed into BMAC samples. The amount of mesenchymal stem cells (MSCs) and the concentration of several regenerative growth factors contained in BMAC, as well as the proliferative and osteogenic differentiation capacity of MSCs, were compared between the corticotomy and the control sides. Another four weeks later, healing of the corticotomies was evaluated by radiographic and histological methods. The results demonstrated that BMAC from the corticotomy side contained significantly more MSCs than the control side. MSCs from the corticotomy side also proliferated significantly faster and tended to have stronger osteogenic differentiation than those from the control side. In contrast, the protein concentration of TGF-β, BMP-2 and PDGF contained in BMAC was only minimally changed by the corticotomies. The corticotomies in all pigs healed uneventfully, showing complete obliteration of the corticotomy gaps on CT images. Comparison between the two sides showed that the corticotomy side had thicker and denser cortical bone and more abundant osteogenic cell differentiation than the control side. These findings suggest that the quantity and proliferative/osteogenic differentiation capacity of MSCs contained in local BMAC can be enhanced by minor corticotomies, and spontaneous healing of the corticotomy can be completed within 6 weeks of the operation.

The Role of Dorsal Raphe Serotonin Neurons in the Balance between Reward and Aversion

BACKGROUND

Reward processing is fundamental for animals to survive and reproduce. Many studies have shown the importance of dorsal raphe nucleus (DRN) serotonin (5-HT) neurons in this process, but the strongly correlative link between the activity of DRN 5-HT neurons and rewarding/aversive potency is under debate. Our primary objective was to reveal this link using two different strategies to transduce DRN 5-HT neurons.

METHODS

For transduction of 5-HT neurons in wildtype mice, adeno-associated virus (AAV) bearing the mouse tryptophan hydroxylase 2 (TPH2) gene promoter was used. For transduction in Tph2-tTA transgenic mice, AAVs bearing the tTA-dependent TetO enhancer were used. To manipulate the activity of 5-HT neurons, optogenetic actuators (CheRiff, eArchT) were expressed by AAVs. For measurement of rewarding/aversive potency, we performed a nose-poke self-stimulation test and conditioned place preference (CPP) test.

RESULTS

We found that stimulation of DRN 5-HT neurons and their projections to the ventral tegmental area (VTA) increased the number of nose-pokes in self-stimulation test and CPP scores in both targeting methods. Concomitantly, CPP scores were decreased by inhibition of DRN 5-HT neurons and their projections to VTA.

CONCLUSION

Our findings indicate that the activity of DRN 5-HT neurons projecting to the VTA is a key modulator of balance between reward and aversion.

Neural circuitry and mechanisms of waiting impulsivity: relevance to addiction

Impatience-the failure to wait or tolerate delayed rewards (e.g. food, drug and monetary incentives)-is a common behavioural tendency in humans. However, when rigidly and rapidly expressed with limited regard for future, often negative consequences, impatient or impulsive actions underlie and confer susceptibility for such diverse brain disorders as drug addiction, attention-deficit hyperactivity disorder (ADHD) and major depressive disorder. Consequently, 'waiting' impulsivity has emerged as a candidate endophenotype to inform translational research on underlying neurobiological mechanisms and biomarker discovery for many of the so-called impulse-control disorders. Indeed, as reviewed in this article, this research enterprise has revealed a number of unexpected targets and mechanisms for intervention. However, in the context of drug addiction, impulsive decisions that maximize short-term gains (e.g. acute drug consumption) over longer-term punishment (e.g. unemployment, homelessness, personal harm) defines one aspect of impulsivity, which may or may not be related to rapid, unrestrained actions over shorter timescales. We discuss the relevance of this distinction in impulsivity subtypes for drug addiction with reference to translational research in humans and other animals. This article is part of the theme issue 'Risk taking and impulsive behaviour: fundamental discoveries, theoretical perspectives and clinical implications'.

Serotonergic afferents from the dorsal raphe decrease the excitability of pyramidal neurons in the anterior piriform cortex

The olfactory system receives extensive serotonergic inputs from the dorsal raphe, a nucleus involved in control of behavior, regulation of mood, and modulation of sensory processing. Although many studies have investigated how serotonin modulates the olfactory bulb, few have focused on the anterior piriform cortex (aPC), a region important for olfactory learning and encoding of odor identity and intensity. Specifically, the mechanism and functional significance of serotonergic modulation of the aPC remain largely unknown. Here we used pharmacologic, optogenetic, and fiber photometry techniques to examine the serotonergic modulation of neural activity in the aPC in vitro and in vivo. We found that serotonin (5-HT) reduces the excitability of pyramidal neurons directly via 5-HT_2C receptors, phospholipase C, and calcium-activated potassium (BK) channels. Furthermore, endogenous serotonin attenuates odor-evoked calcium responses in aPC pyramidal neurons. These findings identify the mechanism underlying serotonergic modulation of the aPC and shed light on its potential role.

The effect of 5-HT1A receptor antagonist on reward-based decision-making

When choosing the best action from several alternatives, we compare each value that depends on the balance between benefit and cost. Previous studies have shown that animals and humans with low brain serotonin (5-HT) level tend to choose smaller immediate reward. We used a decision-making schedule task to investigate whether 5-HT1A receptor is responsible for the decisions related to reward. In this task, the monkeys chose either of two different alternatives that were comprised of 1-4 drops of liquid reward (benefit) and 1-4 repeats of a color discrimination trial (workload cost), then executed the chosen schedule. By the administration of 5-HT1A antagonist, WAY100635, the choice tendency did not change, however, the sensitivity to the amount of reward in the schedule part was diminished. The 5-HT1A could have a role in maintaining reward value to keep track with the promised reward rather than modulating workload discounting of reward value.

Storage and erasure of behavioural experiences at the single neuron level

Although predictions from the past about the future have been of major interest to current neuroscience, how past and present behavioral experience interacts at the level of a single neuron remains largely unknown. Using the pond snail Lymnaea stagnalis we found that recent experience of terrestrial locomotion (exercise) results in a long-term increase in the firing rate of serotonergic pedal (PeA) neurons. Isolation from the CNS preserved the "memory" about previous motor activity in the neurons even after the animals rested for two hours in deep water after the exercise. In contrast, in the CNS, no difference in the firing rate between the control and "exercise-rested" (ER) neurons was seen. ER snails, when placed again on a surface to exercise, nevertheless showed faster locomotor arousal. The difference in the firing rate between the control and ER isolated neurons disappeared when the neurons were placed in the microenvironment of their home ganglia. It is likely that an increased content of dopamine in the CNS masks an increased excitation of PeA neurons after rest: the dopamine receptor antagonist sulpiride produced sustained excitation in PeA neurons from ER snails but not in the control. Therefore, our data suggest the involvement of two mechanisms in the interplay of past and present experiences at the cellular level: intrinsic neuronal changes in the biophysical properties of the cell membrane and extrinsic modulatory environment of the ganglia.

Recent advances in understanding the role of phasic dopamine activity

The latest animal neurophysiology has revealed that the dopamine reward prediction error signal drives neuronal learning in addition to behavioral learning and reflects subjective reward representations beyond explicit contingency. The signal complies with formal economic concepts and functions in real-world consumer choice and social interaction. An early response component is influenced by physical impact, reward environment, and novelty but does not fully code prediction error. Some dopamine neurons are activated by aversive stimuli, which may reflect physical stimulus impact or true aversiveness, but they do not seem to code general negative value or aversive prediction error. The reward prediction error signal is complemented by distinct, heterogeneous, smaller and slower changes reflecting sensory and motor contributors to behavioral activation, such as substantial movement (as opposed to precise motor control), reward expectation, spatial choice, vigor, and motivation. The different dopamine signals seem to defy a simple unifying concept and should be distinguished to better understand phasic dopamine functions.

Prior Activation of 5-HT7 Receptors Modulates the Conditioned Place Preference With Methylphenidate

The serotonin receptor subtype 7 (5-HT7R) is clearly involved in behavioral functions such as learning/memory, mood regulation and circadian rhythm. Recent discoveries proposed modulatory physiological roles for serotonergic systems in reward-guided behavior. However, the interplay between serotonin (5-HT) and dopamine (DA) in reward-related behavioral adaptations needs to be further assessed. TP-22 is a recently developed arylpiperazine-based 5-HT7R agonist, which is also showing high affinity and selectivity towards D1 receptors. Here, we report that TP-22 displays D1 receptor antagonist activity. Moreover, we describe the first in vivo tests with TP-22: first, a pilot experiment (assessing dosage and timing of action) identified the 0.25 mg/kg i.v. dosage for locomotor stimulation of rats. Then, a conditioned place preference (CPP) test with the DA-releasing psychostimulant drug, methylphenidate (MPH), involved three rat groups: prior i.v. administration of TP-22 (0.25 mg/kg), or vehicle (VEH), 90 min before MPH (5 mg/kg), was intended for modulation of conditioning to the white chamber (saline associated to the black chamber); control group (SAL) was conditioned with saline in both chambers. Prior TP-22 further increased the stimulant effect of MPH on locomotor activity. During the place-conditioning test, drug-free activity of TP-22+MPH subjects remained steadily elevated, while VEH+MPH subjects showed a decline. Finally, after a priming injection of TP-22 in MPH-free conditions, rats showed a high preference for the MPH-associated white chamber, which conversely had vanished in VEH-primed MPH-conditioned subjects. Overall, the interaction between MPH and pre-treatment with TP-22 seems to improve both locomotor stimulation and the conditioning of motivational drives to environmental cues. Together with recent studies, a main modulatory role of 5-HT7R for the processing of rewards can be suggested. In the present study, TP-22 proved to be a useful psychoactive tool to better elucidate the role of 5-HT7R and its interplay with DA in reward-related behavior.

Serotonin Regulation of the Prefrontal Cortex: Cognitive Relevance and the Impact of Developmental Perturbation

The prefrontal cortex is essential for both executive function and emotional regulation. The interrelationships among these behavioral domains are increasingly recognized, as well as their sensitivity to serotonin (5-hydroxytryptamine, 5-HT). Prefrontal cortex receives serotonergic inputs from the dorsal and median raphe nuclei and is modulated by multiple subtypes of 5-HT receptor across its layers and cell types. Extremes of serotonergic modulation alter mood regulation in vulnerable individuals, yet the impact of serotonin under more typical physiological parameters remains unclear. In this regard, new tools are permitting a closer examination of the behavioral impact of the serotonin system. Optogenetic and chemogenetic manipulations of dorsal raphe 5-HT neurons reveal that serotonin has a greater impact on executive function than previously appreciated. Domains that appear sensitive to fluctuations in 5-HT neuronal excitability include patience and cognitive flexibility. This work is broadly consistent with ex vivo research investigating how 5-HT regulates prefrontal cortex and its output projections. A growing literature suggests 5-HT modulation of these prefrontal circuits is unexpectedly flexible to alteration during development by genetic, behavioral, environmental or pharmacological manipulations, with lasting repercussions for cognition and emotional regulation. Here, we review the cellular and circuit mechanisms of prefrontal serotonergic modulation, investigate recent research into the cognitive consequences of the serotonergic system, and probe the lasting consequences of developmental perturbations. Understanding both the complexity of the prefrontal serotonin system and its sensitivity during development are essential to learn more about the vulnerabilities of this system in mood and anxiety disorders and the underappreciated cognitive consequences of these disorders and their treatment.

Genomic basis of delayed reward discounting

Delayed reward discounting (DRD) is a behavioral economic measure of impulsivity, reflecting how rapidly a reward loses value based on its temporal distance. In humans, more impulsive DRD is associated with susceptibility to a number of psychiatric diseases (e.g., addiction, ADHD), health outcomes (e.g., obesity), and lifetime outcomes (e.g., educational attainment). Although the determinants of DRD are both genetic and environmental, this review focuses on its genetic basis. Both rodent studies using inbred strains and human twin studies indicate that DRD is moderately heritable, a conclusion that was further supported by a recent human genome-wide association study (GWAS) that used single nucleotide polymorphisms (SNP) to estimate heritability. The GWAS of DRD also identified genetic correlations with psychiatric diagnoses, health outcomes, and measures of cognitive performance. Future research priorities include rodent studies probing putative genetic mechanisms of DRD and human GWASs using larger samples and non-European cohorts. Continuing to characterize genomic influences on DRD has the potential to yield important biological insights with implications for a variety of medically and socially important outcomes.