Serotonin: modulator of a drive to withdraw

Into the deep: Exploring the molecular mechanisms of hyperactive behaviour induced by three rare earth elements in early life-stages of the deep-sea scavenging amphipod Tmetonyx cicada (Lysianassidae)

With increasing socio-economic importance of the rare earth elements and yttrium (REY), Norway has laid out plans for REY mining, from land-based to deep-sea mining, thereby enhancing REY mobility in the marine ecosystem. Little is known about associated environmental consequences, especially in the deep ocean. We explored the toxicity and modes of action of a light (Nd), medium (Gd) and heavy (Yb) REY-Cl3 at four concentrations (3, 30, 300, and 3000 μg L-1) in the Arcto-boreal deep-sea amphipod Tmetonyx cicada. At the highest concentration, REY solubility was limited and increased with atomic weight (Nd < Gd < Yb). Lethal effects were practically restricted to this treatment, with the lighter elements being more acutely toxic than Yb (from ∼50 % mortality in the Gd-group at dissolved 689-504 μg L-1 to <20 % in the Yb-group at ca. 2000 μg L-1), which could be a function of bioavailability. All three REY induced hyperactivity at the low-medium concentrations. Delving into the transcriptome of T. cicada allowed us to determine a whole array of potential (neurotoxic) mechanisms underlying this behaviour. Gd induced the vastest response, affecting serotonin-synthesis; sphingolipid-synthesis; the renin-angiotensin system; mitochondrial and endoplasmic reticulum functioning (Gd, Nd); and lysosome integrity (Gd, Yb); as well as the expression of hemocyanin, potentially governing REY-uptake (Gd, Yb). While Nd and Yb shared only few pathways, suggesting a link between mode of action and atomic weight/radius, almost all discussed mechanisms imply the disruption of organismal Ca-homeostasis. Despite only fragmental genomic information available for crustaceans to date, our results provide novel insight into the toxicophysiology of REY in marine biota. The neurotoxic/behavioural effects in T. cicada at concentrations with potential environmental relevance warn about the possibility of bottom-up ecological consequences in mining exposed fjords and deep-sea ecosystems, calling for follow-up studies and regulatory measures prior to the onset of REY mining in Norway.

Temporal derivative computation in the dorsal raphe network revealed by an experimentally driven augmented integrate-and-fire modeling framework

By means of an expansive innervation, the serotonin (5-HT) neurons of the dorsal raphe nucleus (DRN) are positioned to enact coordinated modulation of circuits distributed across the entire brain in order to adaptively regulate behavior. Yet the network computations that emerge from the excitability and connectivity features of the DRN are still poorly understood. To gain insight into these computations, we began by carrying out a detailed electrophysiological characterization of genetically identified mouse 5-HT and somatostatin (SOM) neurons. We next developed a single-neuron modeling framework that combines the realism of Hodgkin-Huxley models with the simplicity and predictive power of generalized integrate-and-fire models. We found that feedforward inhibition of 5-HT neurons by heterogeneous SOM neurons implemented divisive inhibition, while endocannabinoid-mediated modulation of excitatory drive to the DRN increased the gain of 5-HT output. Our most striking finding was that the output of the DRN encodes a mixture of the intensity and temporal derivative of its input, and that the temporal derivative component dominates this mixture precisely when the input is increasing rapidly. This network computation primarily emerged from prominent adaptation mechanisms found in 5-HT neurons, including a previously undescribed dynamic threshold. By applying a bottom-up neural network modeling approach, our results suggest that the DRN is particularly apt to encode input changes over short timescales, reflecting one of the salient emerging computations that dominate its output to regulate behavior.

Pavlovian-to-Instrumental Transfer across Mental Disorders: A Review

A mechanism known as Pavlovian-to-instrumental transfer (PIT) describes a phenomenon by which the values of environmental cues acquired through Pavlovian conditioning can motivate instrumental behavior. PIT may be one basic mechanism of action control that can characterize mental disorders on a dimensional level beyond current classification systems. Therefore, we review human PIT studies investigating subclinical and clinical mental syndromes. The literature prevails an inhomogeneous picture concerning PIT. While enhanced PIT effects seem to be present in non-substance-related disorders, overweight people, and most studies with AUD patients, no altered PIT effects were reported in tobacco use disorder and obesity. Regarding AUD and relapsing alcohol-dependent patients, there is mixed evidence of enhanced or no PIT effects. Additionally, there is evidence for aberrant corticostriatal activation and genetic risk, e.g., in association with high-risk alcohol consumption and relapse after alcohol detoxification. In patients with anorexia nervosa, stronger PIT effects elicited by low caloric stimuli were associated with increased disease severity. In patients with depression, enhanced aversive PIT effects and a loss of action-specificity associated with poorer treatment outcomes were reported. Schizophrenic patients showed disrupted specific but intact general PIT effects. Patients with chronic back pain showed reduced PIT effects. We provide possible reasons to understand heterogeneity in PIT effects within and across mental disorders. Further, we strengthen the importance of reliable experimental tasks and provide test-retest data of a PIT task showing moderate to good reliability. Finally, we point toward stress as a possible underlying factor that may explain stronger PIT effects in mental disorders, as there is some evidence that stress per se interacts with the impact of environmental cues on behavior by selectively increasing cue-triggered wanting. To conclude, we discuss the results of the literature review in the light of Research Domain Criteria, suggesting future studies that comprehensively assess PIT across psychopathological dimensions.

Design Principles for Neurorobotics

In their book "How the Body Shapes the Way We Think: A New View of Intelligence," Pfeifer and Bongard put forth an embodied approach to cognition. Because of this position, many of their robot examples demonstrated "intelligent" behavior despite limited neural processing. It is our belief that neurorobots should attempt to follow many of these principles. In this article, we discuss a number of principles to consider when designing neurorobots and experiments using robots to test brain theories. These principles are strongly inspired by Pfeifer and Bongard, but build on their design principles by grounding them in neuroscience and by adding principles based on neuroscience research. Our design principles fall into three categories. First, organisms must react quickly and appropriately to events. Second, organisms must have the ability to learn and remember over their lifetimes. Third, organisms must weigh options that are crucial for survival. We believe that by following these design principles a robot's behavior will be more naturalistic and more successful.

Anxiety predicts impulsive-compulsive behaviours in Parkinson's disease: Clinical relevance and theoretical implications

Patients with Parkinson's disease (PD) often present symptoms of anxiety, depression and apathy. These negative affect manifestations have been recently associated with the presence of impulsive compulsive behaviours (ICBs). However, their relation with the use of dopamine replacement therapy (DRT), a renewed risk factor for ICBs, is still not fully understood. Elucidating the role of these different ICBs predictors in PD could inform both prevention/intervention recommendations as well as theoretical models. In the present study, we have analysed data collected in 417 PD patients, 50 patients with Parkinsonian symptoms but with scan without evidence of dopaminergic deficit (SWEDD), and 185 healthy controls (HC). We examined each patient's clinical profile over a two-year time window, investigating the role of both negative affect and DRT on ICBs. Results confirmed the presence of higher levels of anxiety in both the clinical groups, and of higher level of ICBs in SWEDD patients, respect to both PD and HC. Mixed model analyses revealed a statistically significant association between anxiety and ICBs in the SWEDD patients who did not take any DRT. Findings suggest the independence between anxiety and DRT in ICBs development, and provide new evidence for the motivational opponency theoretical framework.

Regulation of Voluntary Physical Activity Behavior: A Review of Evidence Involving Dopaminergic Pathways in the Brain

Physical activity leads to well-established health benefits. Current efforts to enhance physical activity have targeted mainly socioeconomic factors. However, despite these efforts, only a small number of adults engage in regular physical activity to the point of meeting current recommendations. Evidence collected in rodent models and humans establish a strong central nervous system component that regulates physical activity behavior. In particular, dopaminergic pathways in the central nervous system are among the best-characterized biological mechanisms to date with respect to regulating reward, motivation, and habit formation, which are critical for establishing regular physical activity. Herein, we discuss evidence for a role of brain dopamine in the regulation of voluntary physical activity behavior based on selective breeding and pharmacological studies in rodents, as well as genetic studies in both rodents and humans. While these studies establish a role of dopamine and associated mechanisms in the brain in the regulation of voluntary physical activity behavior, there is clearly need for more research on the underlying biology involved in motivation for physical activity and the formation of a physical activity habit. Such knowledge at the basic science level may ultimately be translated into better strategies to enhance physical activity levels within the society.

A role of serotonin and the insula in vigor: Tracking environmental and physiological resources

We describe a neural monitor of environmental and physiological resources that informs effort expenditure. Depending on resources and environmental stability, serotonergic and dopaminergic neuromodulations favor different behavioral controls that are organized in corticostriatal loops. This broader perspective produces some suggestions and questions that may not be covered by the foraging approach to vigor of Shadmehr and Ahmed (2020).

Hypoactive Sexual Desire Disorder in Women: Physiology, Assessment, Diagnosis, and Treatment

Nearly half of women in the United States report problems with sexual function. Many health care providers do not ask about sexual concerns during routine clinical encounters because of personal discomfort, lack of familiarity with treatment, or the belief that they lack adequate time to address this complex issue. This may be especially true for hypoactive sexual desire disorder (HSDD), the most commonly identified sexual problem among women. HSDD is characterized by a deficiency of sexual thoughts, feelings, or receptiveness to sexual stimulation that has been present for at least 6 months, causes personal distress, and is not due to another medical condition. This is an up-to-date overview of HSDD for clinicians, discussing its physiology, assessment, diagnosis, and treatment strategies. Although a definitive physiology of HSDD is still unknown, multiple hormones and neurotransmitters likely participate in a dual-control model to balance excitation and inhibition of sexual desire. For assessment and diagnosis, validated screening tools are discussed, and the importance of a biopsychosocial assessment is emphasized, with guidance on how this can be implemented in clinical encounters. The 2 recently approved medications for HSDD, flibanserin and bremelanotide, are reviewed as well as off-label treatments. Overall, HSDD represents a common yet likely underrecognized disorder that midwives and other health care providers who care for women across the life span are in a unique position to address.

Agonistic experience during development establishes inter-individual differences in approach-avoidance behaviour of crickets

Members of numerous animal species show consistent inter-individual differences in behaviours, but the forces generating animal "personality" or individuality remain unclear. We show that experiences gathered solely from social conflict can establish consistent differences in the decision of male crickets to approach or avoid a stimulus directed at one antenna. Adults isolated for 48 h from a colony already exhibit behavioural differences. Prior to staging a single dyadic contest, prospective winners approached the stimulus whereas prospective losers turned away, as they did also after fighting. In contrast, adults raised as nymphs with adult males present but isolated from them as last instar nymphs, all showed avoidance. Furthermore, adults raised without prior adult contact, showed no preferred directional response. However, following a single fight, winners from both these groups showed approach and losers avoidance, but this difference lasted only one day. In contrast, after 6 successive wins or defeats, the different directional responses of multiple winners and losers remained consistent for at least 6 days. Correlation analysis revealed examples of consistent inter-individual differences in the direction and magnitude of turning responses, which also correlated with individual aggressiveness and motility. Together our data reveal that social subjugation, or lack thereof, during post-embryonic and early adult development forges individuality and supports the notion of a proactive-reactive syndrome in crickets.

Comparative analyses of the Pan lineage reveal selection on gene pathways associated with diet and sociality in bonobos

Chimpanzees (Pan troglodytes) and bonobos (Pan paniscus) diverged into distinct species approximately 1.7 million years ago when the ancestors of modern-day bonobo populations were separated by the Congo River. This geographic boundary separates the two species today and the associated ecological factors, including resource distribution and feeding competition, have likely shaped the divergent social behavior of both species. The most striking behavioral differences pertain to between group interactions in which chimpanzees behave aggressively towards unfamiliar conspecifics, while bonobos display remarkable tolerance. Several hypotheses attempt to explain how different patterns of social behavior have come to exist in the two species, some with specific genetic predictions, likening the evolution of bonobos to a process of domestication. Here, we utilize 73 ape genomes and apply linkage haplotype homozygosity and structure informed allele frequency differentiation methods to identify positively selected regions in bonobos since their split from a common pan ancestor to better understand the environment and processes that resulted in the behavioral differences observed today. We find novel evidence of selection in genetic regions that aid in starch digestion (AMY2) along with support for two genetic predictions related to self-domestication processes hypothesized to have occurred in the bonobo. We also find evidence for selection on neuroendocrine pathways associated with social behavior including the oxytocin, serotonin, and gonadotropin releasing hormone pathways.

An Association Between Serotonin 1A Receptor, Gray Matter Volume, and Sociability in Healthy Subjects and in Autism Spectrum Disorder

Central serotonin is an important molecular pathway, involved in the regulation of social behavior and gray matter volume (GMV). In men with autism spectrum disorders (ASD), the serotonergic system and the GMV have been found disrupted. Here, we investigated the relation between serotonin, GMV, and social personality in men with typical development (TD) and in men with ASD. We combined anatomical magnetic resonance imaging, Positron emission tomography scan with 2'-methoxyphenyl-(N-2'-pyridinyl)-p-18F-fluoro-benzamidoethylpiperazine radioligand and revised NEO personality inventory personality questionnaire to examine the association between serotonin 1A receptor (5-HT_1A R) binding potential, GMV and social personality in 24 adult male TD subjects and 18 male men with ASD. In both groups, we found a positive correlation between 5-HT_1A R binding potential and GMV in a region dependent manner. In the TD group, we observed a negative correlation between 5-HT_1A R and GMV in the left and right posterior putamen. 5HT_1A R binding and GMV in the putamen further correlated with social personality scores in the TD group. None of these associations were found in men with ASD, although no differences were observed for 5-HT_1A R concentration among the two groups. Our findings point to a deregulation of 5-HT_1A R density in the striatum of men with ASD, a failure that might contribute to their social disturbances. Serotonin is suspected to be involved in the pathophysiology of autism. We provide evidence for a role of serotonin 1A receptor in social behavior through a specific regulation of GMV in the putamen region in neurotypical subjects but not in men with autism. This suggests a potential impairment of the serotonergic system in men with autism which may contribute to patients' social disturbances. Our findings suggest further investigation on the role of serotonin 1A receptor and its activity in the striatum to regulate social behavior. Autism Res 2020, 13: 1843-1855. © 2020 International Society for Autism Research and Wiley Periodicals LLC LAY SUMMARY: Serotonin is suspected to be involved in the pathophysiology of autism. We provide evidence for a role of serotonin 1A receptor in social behavior through a specific regulation of gray matter volume in the putamen region in neurotypical subjects but not in men with autism. This suggests a potential impairment of the serotonergic system in men with autism which may contribute to patients' social disturbances. Our findings suggest further investigation on the role of serotonin 1A receptor and its activity in the striatum to regulate social behavior.

Neurobiologically Inspired Self-Monitoring Systems

In this article, we explore neurobiological principles that could be deployed in systems requiring self-preservation, adaptive control, and contextual awareness. We start with low-level control for sensor processing and motor reflexes. We then discuss how critical it is at an intermediate level to maintain homeostasis and predict system set points. We end with a discussion at a high-level, or cognitive level, where planning and prediction can further monitor the system and optimize performance. We emphasize the information flow between these levels both from a systems neuroscience and an engineering point of view. Throughout the paper, we describe the brain systems that carry out these functions and provide examples from artificial intelligence, machine learning, and robotics that include these features. Our goal is to show how biological organisms performing self-monitoring can inspire the design of autonomous and embedded systems.

Serotonin and its metabolites reduce oxidative stress in murine RAW264.7 macrophages and prevent inflammation

In this study, we focused on comparing the effects of serotonin and its metabolites on the functions of RAW264.7 cells (emphasis on oxidative burst and production of nitric oxide and cytokines), thereby expanding the scope of existing knowledge with advent of novel findings in this field. Changes in production of reactive oxygen species (ROS) by RAW264.7 cells after treatment with serotonin, N-acetylserotonin and melatonin were determined using the chemiluminescence (CL) assay. To exclude the direct scavenging effects of the studied compounds on the CL response, the antioxidant properties of all respective compounds were measured using TRAP and amperometrical method. Nitric oxide (NO) production was measured by Griess reagent and inducible NO synthase (iNOS) expression by Western blot. Cytokine production was assessed using the Mouse Cytokine Panel A Array kit and ELISA. We showed that all tested compounds were able to reduce oxidative stress, as well as inhibit production of inflammatory cytokines by macrophages. Of the tested compounds, serotonin and N-acetylserotonin were markedly better antioxidants than melatonin. In comparison, other effects of tested compounds were very similar. It can be concluded that antioxidant capacity of tested compounds is a major advantage in the early stages of inflammation. Since plasma concentrations of N-acetylserotonin and melatonin are lower than serotonin, it can be deduced that serotonin plays a key role in modulation of inflammation and the regulatory functions of immune cells, while also protecting cells against oxidative stress.

The Neural Mechanism Underlying Cognitive and Emotional Processes in Creativity

Creativity is related to both cognition and emotion, which are the two major mental processes, interacting with each other to form psychological processes. Emotion is the major driving force of almost all creativities, sometimes in an unconscious way. Even though there are many studies concerning the relationship between creativity and cognition, there are few studies about the neural mechanisms of the emotional effects on creativity. Here, we introduce a novel model to explain the relationship between emotions and creativities: Three Primary Color model, which proposes that there are four major basic emotions; these basic emotions are subsided by three monoamines, just like the three primary colors: dopamine-joy, norepinephrine-stress (fear and anger), and serotonin-punishment. Interestingly, these three neuromodulators play similar roles in creativity, whose core features are value and novelty (surprise), like the characteristics of the core features of basic emotions (hedonic value and arousal value). Dysfunctions of these neuromodulators may be the reasons for both psychopathology and creativity, in that they can change the thinking styles such as novelty seeking behavior, hyper-connectivity of brain areas, and/or cognitive disinhibition to induce both creativity and psychopathology. This new model will not only help researchers understand the dynamics of basic emotion elements, it can also bring an entirely new perspective into the relationship between psychopathology and creativity.

Pavlovian-instrumental interactions in active avoidance: The bark of neutral trials

In active avoidance tasks, subjects have to learn to execute particular actions in order to avoid an aversive stimulus, such as a shock. Such paradigms pose a number of psychological and neural enigmas, and so have attracted substantial computational interest. However, the ratio of conjecture to confirmation remains high. Here, we perform a theoretical inquiry into a recent experiment by Gentry, Lee, and Roesch ('Phasic dopamine release in the rat nucleus accumbens predicts approach and avoidance performance', Nat. Commun., 7:13154) who measured phasic dopamine concentrations in the nucleus accumbens core of rats whilst they avoided shocks, acquired food, or acted to gain no programmed outcome. These last, neutral, trials turned out to be a perfect probe for the workings of avoidance, partly because of the substantial differences between subjects and sessions revealed in the experiment. We suggest a way to interpret this probe, gaining support for opponency-, safety-, and Pavlovian-influenced treatments of avoidance.

An effect of serotonergic stimulation on learning rates for rewards apparent after long intertrial intervals

Serotonin has widespread, but computationally obscure, modulatory effects on learning and cognition. Here, we studied the impact of optogenetic stimulation of dorsal raphe serotonin neurons in mice performing a non-stationary, reward-driven decision-making task. Animals showed two distinct choice strategies. Choices after short inter-trial-intervals (ITIs) depended only on the last trial outcome and followed a win-stay-lose-switch pattern. In contrast, choices after long ITIs reflected outcome history over multiple trials, as described by reinforcement learning models. We found that optogenetic stimulation during a trial significantly boosted the rate of learning that occurred due to the outcome of that trial, but these effects were only exhibited on choices after long ITIs. This suggests that serotonin neurons modulate reinforcement learning rates, and that this influence is masked by alternate, unaffected, decision mechanisms. These results provide insight into the role of serotonin in treating psychiatric disorders, particularly its modulation of neural plasticity and learning.

Serotonin (5-HT) plays many important roles in reward, punishment, patience and beyond, and optogenetic stimulation of 5-HT neurons has not crisply parsed them. The authors report a novel analysis of a reward-based decision-making experiment, and show that 5-HT stimulation increases the learning rate, but only on a select subset of choices.

The Protective Action Encoding of Serotonin Transients in the Human Brain

The role of serotonin in human brain function remains elusive due, at least in part, to our inability to measure rapidly the local concentration of this neurotransmitter. We used fast-scan cyclic voltammetry to infer serotonergic signaling from the striatum of 14 brains of human patients with Parkinson's disease. Here we report these novel measurements and show that they correlate with outcomes and decisions in a sequential investment game. We find that serotonergic concentrations transiently increase as a whole following negative reward prediction errors, while reversing when counterfactual losses predominate. This provides initial evidence that the serotonergic system acts as an opponent to dopamine signaling, as anticipated by theoretical models. Serotonin transients on one trial were also associated with actions on the next trial in a manner that correlated with decreased exposure to poor outcomes. Thus, the fluctuations observed for serotonin appear to correlate with the inhibition of over-reactions and promote persistence of ongoing strategies in the face of short-term environmental changes. Together these findings elucidate a role for serotonin in the striatum, suggesting it encodes a protective action strategy that mitigates risk and modulates choice selection particularly following negative environmental events.

Appetitive and reactive aggression are differentially associated with the STin2 genetic variant in the serotonin transporter gene

Appetitive aggression is a sub-category of instrumental aggression, characterised by the primary intrinsic enjoyment of aggressive activity. Aggression is heritable, and serotonergic and monoaminergic neurotransmitter systems have been found to contribute to the underlying molecular mechanisms. The aim of this study was to investigate the role that genetic variants in the serotonin transporter (SLC6A4) and monoamine oxidase A (MAOA) genes play in the aetiology of appetitive aggression in South African Xhosa males (n = 290). SLC6A4 5-HTTLPR, rs25531, and STin2 variants, as well as MAOA-uVNTR were investigated for their association with levels of appetitive aggression using Poisson regression analysis. The STin2 VNTR12 allele was found to be associated with increased levels of appetitive aggression (p = 0.003), but with decreased levels of reactive aggression (p = 7 × 10^-5). This study is the first to investigate genetic underpinnings of appetitive aggression in a South African population, with preliminary evidence suggesting that SCL6A4 STin2 variants play a role in its aetiology, and may also be important in differentiating between appetitive and reactive aggression. Although the results require replication, they shed some preliminary light on the molecular dichotomy that may underlie the two forms of aggression.

Neuromodulatory Systems and Their Interactions: A Review of Models, Theories, and Experiments

Neuromodulatory systems, including the noradrenergic, serotonergic, dopaminergic, and cholinergic systems, track environmental signals, such as risks, rewards, novelty, effort, and social cooperation. These systems provide a foundation for cognitive function in higher organisms; attention, emotion, goal-directed behavior, and decision-making derive from the interaction between the neuromodulatory systems and brain areas, such as the amygdala, frontal cortex, hippocampus, and sensory cortices. Given their strong influence on behavior and cognition, these systems also play a key role in disease states and are the primary target of many current treatment strategies. The fact that these systems interact with each other either directly or indirectly, however, makes it difficult to understand how a failure in one or more systems can lead to a particular symptom or pathology. In this review, we explore experimental evidence, as well as focus on computational and theoretical models of neuromodulation. Better understanding of neuromodulatory systems may lead to the development of novel treatment strategies for a number of brain disorders.

The SSRI fluoxetine exhibits mild effects on the reproductive axis in the cichlid fish Cichlasoma dimerus (Teleostei, Cichliformes)

Among the wide variety of pharmaceuticals released into the environment, Fluoxetine (FLX), a selective serotonin reuptake inhibitor, is one of the most prescribed for the treatment of major depression. It inhibits serotonin (5-HT) reuptake at the presinaptic membrane, increasing serotonergic activity. In vertebrates, including fish, the serotonergic system is closely related to the Hypothalamic Pituitary Gonadal (HPG) axis which regulates reproduction. As FLX can act as an endocrine disrupting compound (EDC) by affecting several reproductive parameters in fish, the aim of this study was to provide an integral assessment of the potential effect of FLX on the reproductive axis of the Neotropical freshwater fish Cichlasoma dimerus. Adult fish were intraperitoneally injected with 2 μg g^-1 FLX or saline every third day for 15 days. No significant differences were found on serotonergic turnover (5-HIAA/5-HT ratio). Pituitary βLH content in FLX injected females was significantly higher than control females; no significant differences were seen for βFSH content. Sex steroids remained unaltered, both in males and females fish, after FLX treatment. No plasma vitellogenin was induced in treated males. Some alterations were seen in testes of FLX injected males, such as the presence of foam cells and an acidophilic PAS positive, Alcian-Blue negative secretion in the lobular lumen. Although there is no clear consensus about the effect of this drug on reproductive physiology, these results indicate that FLX is acting as a mild EDC in adults of C. dimerus.

To Cheat or Not To Cheat: Tryptophan Hydroxylase 2 SNP Variants Contribute to Dishonest Behavior

Although, lying (bear false witness) is explicitly prohibited in the Decalogue and a focus of interest in philosophy and theology, more recently the behavioral and neural mechanisms of deception are gaining increasing attention from diverse fields especially economics, psychology, and neuroscience. Despite the considerable role of heredity in explaining individual differences in deceptive behavior, few studies have investigated which specific genes contribute to the heterogeneity of lying behavior across individuals. Also, little is known concerning which specific neurotransmitter pathways underlie deception. Toward addressing these two key questions, we implemented a neurogenetic strategy and modeled deception by an incentivized die-under-cup task in a laboratory setting. The results of this exploratory study provide provisional evidence that SNP variants across the tryptophan hydroxylase 2 (TPH2) gene, that encodes the rate-limiting enzyme in the biosynthesis of brain serotonin, contribute to individual differences in deceptive behavior.

Mesocorticolimbic dopamine functioning in primary psychopathy: A source of within-group heterogeneity

Despite similar emotional deficiencies, primary psychopathic individuals can be situated on a continuum that spans from controlled to disinhibited. The constructs on which primary psychopaths are found to diverge, such as self-control, cognitive flexibility, and executive functioning, are crucially regulated by dopamine (DA). As such, the goal of this review is to examine which specific alterations in the meso-cortico-limbic DA system and corresponding genes (e.g., TH, DAT, COMT, DRD2, DRD4) might bias development towards a more controlled or disinhibited expression of primary psychopathy. Based on empirical data, it is argued that primary psychopathy is generally related to a higher tonic and population activity of striatal DA neurons and lower levels of D2-type DA receptors in meso-cortico-limbic projections, which may boost motivational drive towards incentive-laden goals, dampen punishment sensitivity, and increase future reward-expectancy. However, increasingly higher levels of DA activity in the striatum (moderate versus pathological elevations), lower levels of DA functionality in the prefrontal cortex, and higher D1-to-D2-type receptor ratios in meso-cortico-limbic projections may lead to increasingly disinhibited and impetuous phenotypes of primary psychopathy. Finally, in order to provide a more coherent view on etiological mechanisms, we discuss interactions between DA and serotonin that are relevant for primary psychopathy.

Learning touch preferences with a tactile robot using dopamine modulated STDP in a model of insular cortex

Neurorobots enable researchers to study how behaviors are produced by neural mechanisms in an uncertain, noisy, real-world environment. To investigate how the somatosensory system processes noisy, real-world touch inputs, we introduce a neurorobot called CARL-SJR, which has a full-body tactile sensory area. The design of CARL-SJR is such that it encourages people to communicate with it through gentle touch. CARL-SJR provides feedback to users by displaying bright colors on its surface. In the present study, we show that CARL-SJR is capable of learning associations between conditioned stimuli (CS; a color pattern on its surface) and unconditioned stimuli (US; a preferred touch pattern) by applying a spiking neural network (SNN) with neurobiologically inspired plasticity. Specifically, we modeled the primary somatosensory cortex, prefrontal cortex, striatum, and the insular cortex, which is important for hedonic touch, to process noisy data generated directly from CARL-SJR's tactile sensory area. To facilitate learning, we applied dopamine-modulated Spike Timing Dependent Plasticity (STDP) to our simulated prefrontal cortex, striatum, and insular cortex. To cope with noisy, varying inputs, the SNN was tuned to produce traveling waves of activity that carried spatiotemporal information. Despite the noisy tactile sensors, spike trains, and variations in subject hand swipes, the learning was quite robust. Further, insular cortex activities in the incremental pathway of dopaminergic reward system allowed us to control CARL-SJR's preference for touch direction without heavily pre-processed inputs. The emerged behaviors we found in this model match animal's behaviors wherein they prefer touch in particular areas and directions. Thus, the results in this paper could serve as an explanation on the underlying neural mechanisms for developing tactile preferences and hedonic touch.

Critical periods for the neurodevelopmental processes of externalizing and internalizing

Research on neurobiological development is providing insight into the nature and mechanisms of human neural plasticity. These mechanisms appear to support two different forms of developmental learning. One form of learning could be described as externalizing, in which neural representations are highly responsive to environmental influences, as the child typically operates under a mode of hedonic approach. A second form of learning supports internalizing, in which motive control separates attention and self-regulation from the immediate influences of the context, particularly when the child faces conditions of avoidance and threat. The dorsal cortical networks of externalizing are organized around dorsal limbic (cingulate, septal, lateral hypothalamic, hippocampal, and ventral striatal) circuits. In contrast, the ventral cortical networks of internalizing are organized around ventral limbic (anterior temporal and orbital cortex, extended amygdala, dorsal striatal, and mediodorsal thalamic) circuits. These dual divisions of the limbic system in turn self-regulate their arousal levels through different brain stem and forebrain neuromodulator projection systems, with dorsal corticolimbic networks regulated strongly by locus coeruleus norepinephrine and brain stem raphe nucleus serotonin projection systems, and ventral corticolimbic networks regulated by ventral tegmental dopamine and forebrain acetylcholine projections. Because the arousal control systems appear to regulate specific properties of neural plasticity in development, an analysis of these systems explains differences between externalizing and internalizing at multiple levels of neural and psychological self-regulation. In neuroscience, the concept of critical periods has been applied to times when experience is essential for the maturation of sensory systems. In a more general neuropsychological analysis, certain periods of the child's development require successful self-regulation through the differential capacities for externalizing and internalizing.

Serotonergic neurons signal reward and punishment on multiple timescales

Serotonin's function in the brain is unclear. One challenge in testing the numerous hypotheses about serotonin's function has been observing the activity of identified serotonergic neurons in animals engaged in behavioral tasks. We recorded the activity of dorsal raphe neurons while mice experienced a task in which rewards and punishments varied across blocks of trials. We ‘tagged’ serotonergic neurons with the light-sensitive protein channelrhodopsin-2 and identified them based on their responses to light. We found three main features of serotonergic neuron activity: (1) a large fraction of serotonergic neurons modulated their tonic firing rates over the course of minutes during reward vs punishment blocks; (2) most were phasically excited by punishments; and (3) a subset was phasically excited by reward-predicting cues. By contrast, dopaminergic neurons did not show firing rate changes across blocks of trials. These results suggest that serotonergic neurons signal information about reward and punishment on multiple timescales.

DOI:http://dx.doi.org/10.7554/eLife.06346.001

Rewards and punishments can both encourage animals to change their immediate behavior and influence their mood over a longer term, particularly when given repeatedly. A region of the brain that increases its activity in response to rewards and punishments also contains many neurons that communicate with each other by releasing a chemical called serotonin. This chemical is commonly thought to produce feelings of happiness; however, it remains unclear exactly how these particular ‘serotonergic’ neurons help to process rewards and punishments.

The ideal way to work out the role that a type of neuron plays in a behavior is to measure its electrical activity as the behavior is being performed. However, it is difficult to distinguish the activity of serotonergic neurons from the activity of the non-serotonergic neurons around them. To overcome this problem, Cohen et al. used viruses to force serotonergic neurons to make a type of ion channel that produces electrical currents in response to light. Shining light on these neurons via optical fibers and then measuring the neurons' responses helped to develop criteria that can identify which responses are generated by the serotonergic neurons.

Cohen et al. then recorded the activity of serotonergic neurons in thirsty mice as they experienced a series of rewards (for example, a drop of water) or punishments (such as a puff of air to the eye). Each reward or punishment was preceded by a distinct odor, so that the mice learned to anticipate what was coming.

These experiments revealed that serotonergic neurons respond to rewards and punishments by changing two aspects of their electrical activity: by producing short bursts of high activity, and by altering their baseline activity. Some of the serotonergic neurons fired rapidly in response to punishments, but not rewards; others fired rapidly when the mice detected a scent that meant that a reward was about to be given. The average level of reward or punishment the mice received also affected the baseline activity of many of the serotonergic neurons; this effect lasted for several minutes.

Overall, Cohen et al. suggest that serotonergic neurons can affect how mice respond to rewards or punishments in both the short and long term. Future experiments should aim to understand the diversity of the signals that Cohen et al. observed, and to determine how these signals are used to drive behavior. Ultimately, understanding how neural circuits made up of different types of cells work may aid in understanding the neural basis of behavior.

DOI:http://dx.doi.org/10.7554/eLife.06346.002

Polymorphism in the serotonin receptor 2a (HTR2A) gene as possible predisposal factor for aggressive traits

Aggressive manifestations and their consequences are a major issue of mankind, highlighting the need for understanding the contributory factors. Still, aggression-related genetic analyses have so far mainly been conducted on small population subsets such as individuals suffering from a certain psychiatric disorder or a narrow-range age cohort, but no data on the general population is yet available. In the present study, our aim was to identify polymorphisms in genes affecting neurobiological processes that might explain some of the inter-individual variation between aggression levels in the non-clinical Caucasian adult population. 55 single nucleotide polymorphisms (SNP) were simultaneously determined in 887 subjects who also filled out the self-report Buss-Perry Aggression Questionnaire (BPAQ). Single marker association analyses between genotypes and aggression scores indicated a significant role of rs7322347 located in the HTR2A gene encoding serotonin receptor 2a following Bonferroni correction for multiple testing (p = 0.0007) both for males and females. Taking the four BPAQ subscales individually, scores for Hostility, Anger and Physical Aggression showed significant association with rs7322347 T allele in themselves, while no association was found with Verbal Aggression. Of the subscales, relationship with rs7322347 was strongest in the case of Hostility, where statistical significance virtually equaled that observed with the whole BPAQ. In conclusion, this is the first study to our knowledge analyzing SNPs in a wide variety of genes in terms of aggression in a large sample-size non-clinical adult population, also describing a novel candidate polymorphism as predisposal to aggressive traits.

Serotonin and dopamine differentially affect appetitive and aversive general Pavlovian-to-instrumental transfer

RATIONALE

Human motivation and decision-making is influenced by the interaction of Pavlovian and instrumental systems. The neurotransmitters dopamine and serotonin have been suggested to play a major role in motivation and decision-making, but how they affect this interaction in humans is largely unknown.

OBJECTIVE

We investigated the effect of these neurotransmitters in a general Pavlovian-to-instrumental transfer (PIT) task which measured the nonspecific effect of appetitive and aversive Pavlovian cues on instrumental responses.

METHODS

For that purpose, we used selective dietary depletion of the amino acid precursors of serotonin and dopamine: tryptophan (n = 34) and tyrosine/phenylalanine (n = 35), respectively, and compared the performance of these groups to a control group (n = 34) receiving a nondepleted (balanced) amino acid drink.

RESULTS

We found that PIT differed between groups: Relative to the control group that exhibited only appetitive PIT, we found reduced appetitive PIT in the tyrosine/phenylalanine-depleted group and enhanced aversive PIT in the tryptophan-depleted group.

CONCLUSIONS

These results demonstrate a differential involvement of serotonin and dopamine in motivated behavior. They suggest that reductions in serotonin enhance the motivational influence of aversive stimuli on instrumental behavior and do not affect the influence of appetitive stimuli, while reductions in dopamine diminish the influence of appetitive stimuli. No conclusions could be drawn about how dopamine affects the influence of aversive stimuli. The interplay of both neurotransmitter systems allows for flexible and adaptive responses depending on the behavioral context.

Impulsive action: emotional impulses and their control

This paper presents a novel theoretical view on impulsive action, integrating thus far separate perspectives on non-reflective action, motivation, emotion regulation, and impulse control. We frame impulsive action in terms of directedness of the individual organism toward, away, or against other givens - toward future states and away from one's present state. First, appraisal of a perceived or thought-of event or object on occasion, rapidly and without premonition or conscious deliberation, triggers a motive to modify one's relation to that event or object. Situational specifics of the event as perceived and appraised motivate and guide selection of readiness for a particular kind of purposive action. Second, perception of complex situations can give rise to multiple appraisals, multiple motives, and multiple simultaneous changes in action readiness. Multiple states of action readiness may interact in generating action, by reinforcing or attenuating each other, thereby yielding impulse control. We show how emotion control can itself result from a motive state or state of action readiness. Our view links impulsive action mechanistically to states of action readiness, which is the central feature of what distinguishes one kind of emotion from another. It thus provides a novel theoretical perspective to the somewhat fragmented literature on impulsive action.

An extended reinforcement learning model of basal ganglia to understand the contributions of serotonin and dopamine in risk-based decision making, reward prediction, and punishment learning

Although empirical and neural studies show that serotonin (5HT) plays many functional roles in the brain, prior computational models mostly focus on its role in behavioral inhibition. In this study, we present a model of risk based decision making in a modified Reinforcement Learning (RL)-framework. The model depicts the roles of dopamine (DA) and serotonin (5HT) in Basal Ganglia (BG). In this model, the DA signal is represented by the temporal difference error (δ), while the 5HT signal is represented by a parameter (α) that controls risk prediction error. This formulation that accommodates both 5HT and DA reconciles some of the diverse roles of 5HT particularly in connection with the BG system. We apply the model to different experimental paradigms used to study the role of 5HT: (1) Risk-sensitive decision making, where 5HT controls risk assessment, (2) Temporal reward prediction, where 5HT controls time-scale of reward prediction, and (3) Reward/Punishment sensitivity, in which the punishment prediction error depends on 5HT levels. Thus the proposed integrated RL model reconciles several existing theories of 5HT and DA in the BG.

Chronic exposure to a predator or its scent does not inhibit male-male competition in male mice lacking brain serotonin

Although it is well-known that defective signaling of the 5-HT system in the brain and stressful stimuli can cause psychological disorders, their combined effects on male–male aggression and sexual attractiveness remain unknown. Our research aimed at examining such effects using tryptophan hydroxylase 2 (Tph2) knockout male mice vs. a rat- or rat scent-based chronic stress model. Tph2^+/+ and Tph2^−/− male mice were placed individually into the rat home cage (rat), a cage containing soiled rat bedding (rat scent) or a cage containing fresh bedding (control) for 5 h every other day for 56 consecutive days. In Tph2^+/+ male mice, rat-exposure decreased male–male aggression and sexual attractiveness of urine odor relative to either rat scent-exposure or control; and rat scent-exposure decreased aggression rather than sexual attractiveness of urine odor compared with control. However, such dose-dependent and long-lasting behavioral inhibitory effects vanished in Tph2^−/− male mice. RT-PCR assay further revealed that putative regulatory genes, such as AR, ERα and GluR4 in the prefrontal cortex, and TrkB-Tc and 5-HTR1A in the hippocampus, were down-regulated at the mRNA level in either rat- or rat scent-exposed Tph2^+/+ male mice, but partially in the Tph2^−/− ones. Hence, we suggest that the dose-dependent and long-lasting inhibitory effects of chronic predator exposure on male–male aggression, sexual attractiveness of urine odor, and mRNA expression of central regulatory genes might be mediated through the 5-HT system in the brain of male mice.

Serotonin at the nexus of impulsivity and cue reactivity in cocaine addiction

Cocaine abuse and addiction remain great challenges on the public health agendas in the U.S. and the world. Increasingly sophisticated perspectives on addiction to cocaine and other drugs of abuse have evolved with concerted research efforts over the last 30 years. Relapse remains a particularly powerful clinical problem as, even upon termination of drug use and initiation of abstinence, the recidivism rates can be very high. The cycling course of cocaine intake, abstinence and relapse is tied to a multitude of behavioral and cognitive processes including impulsivity (a predisposition toward rapid unplanned reactions to stimuli without regard to the negative consequences), and cocaine cue reactivity (responsivity to cocaine-associated stimuli) cited as two key phenotypes that contribute to relapse vulnerability even years into recovery. Preclinical studies suggest that serotonin (5-hydroxytryptamine; 5-HT) neurotransmission in key neural circuits may contribute to these interlocked phenotypes well as the altered neurobiological states evoked by cocaine that precipitate relapse events. As such, 5-HT is an important target in the quest to understand the neurobiology of relapse-predictive phenotypes, to successfully treat this complex disorder and improve diagnostic and prognostic capabilities. This review emphasizes the role of 5-HT and its receptor proteins in key addiction phenotypes and the implications of current findings to the future of therapeutics in addiction. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'.

A dynamic, embodied paradigm to investigate the role of serotonin in decision-making

Serotonin (5-HT) is a neuromodulator that has been attributed to cost assessment and harm aversion. In this review, we look at the role 5-HT plays in making decisions when subjects are faced with potential harmful or costly outcomes. We review approaches for examining the serotonergic system in decision-making. We introduce our group’s paradigm used to investigate how 5-HT affects decision-making. In particular, our paradigm combines techniques from computational neuroscience, socioeconomic game theory, human–robot interaction, and Bayesian statistics. We will highlight key findings from our previous studies utilizing this paradigm, which helped expand our understanding of 5-HT’s effect on decision-making in relation to cost assessment. Lastly, we propose a cyclic multidisciplinary approach that may aid in addressing the complexity of exploring 5-HT and decision-making by iteratively updating our assumptions and models of the serotonergic system through exhaustive experimentation.

Serotonin selectively enhances perception and sensory neural responses to stimuli generated by same-sex conspecifics

Centrifugal serotonergic fibers innervating sensory brain areas are seen ubiquitously across systems and species but their function remains unclear. Here we examined the functional role of serotonergic innervation onto electrosensory neurons in weakly electric fish by eliciting endogenous release through electrical stimulation as well as exogenous focal application of serotonin in the vicinity of the cell being recorded from. Both approaches showed that the function of serotonergic input onto electrosensory pyramidal neurons is to render them more excitable by reducing the spike afterhyperpolarization amplitude and thereby promoting burst firing. Further, serotonergic input selectively improved neuronal responses to stimuli that occur during interactions between same-sex conspecifics but not to stimuli associated with either prey or that occur during interactions between opposite-sex conspecifics. Finally, we tested whether serotonin-mediated enhanced pyramidal neuron responses to stimuli associated with same-sex conspecifics actually increase perception by the animal. Our behavioral experiments show that exogenous injection and endogenous release of serotonin both increase the magnitude of behavioral responses to stimuli associated with same-sex conspecifics as well as simultaneously decrease aggressive behaviors. Thus, our data indicate that the serotonergic system inhibits aggressive behavior toward same-sex conspecifics, while at the same time increasing perception of stimuli associated with these individuals. This function is likely to be conserved across systems and species.

Serotonin enhances solitariness in phase transition of the migratory locust

The behavioral plasticity of locusts is a striking trait presented during the reversible phase transition between solitary and gregarious individuals. However, the results of serotonin as a neurotransmitter from the migratory locust Locusta migratoria in phase transition showed an alternative profile compared to the results from the desert locust Schistocerca gregaria. In this study, we investigated the roles of serotonin in the brain during the phase change of the migratory locust. During the isolation of gregarious nymphs, the concentration of serotonin in the brain increased significantly, whereas serotonin receptors (i.e., 5-HT₁, 5-HT₂, and 5-HT₇) we identified here showed invariable expression patterns. Pharmacological intervention showed that serotonin injection in the brain of gregarious nymphs did not induced the behavioral change toward solitariness, but injection of this chemical in isolated gregarious nymphs accelerated the behavioral change from gregarious to solitary phase. During the crowding of solitary nymphs, the concentration of serotonin in the brain remained unchanged, whereas 5-HT₂ increased after 1 h of crowding and maintained stable expression level thereafter. Activation of serotonin-5-HT₂ signaling with a pharmaceutical agonist inhibited the gregariousness of solitary nymphs in crowding treatment. These results indicate that the fluctuations of serotonin content and 5-HT₂ expression are results of locust phase change. Overall, this study demonstrates that serotonin enhances the solitariness of the gregarious locusts. Serotonin may regulate the withdrawal-like behavioral pattern displayed during locust phase change and this mechanism is conserved in different locust species.

Revisiting the serotonin-aggression relation in humans: a meta-analysis

The inverse relation between serotonin and human aggression is often portrayed as "reliable," "strong," and "well established" despite decades of conflicting reports and widely recognized methodological limitations. In this systematic review and meta-analysis, we evaluate the evidence for and against the serotonin deficiency hypothesis of human aggression across 4 methods of assessing serotonin: (a) cerebrospinal fluid levels of 5-hydroxyindoleacetic acid (CSF 5-HIAA), (b) acute tryptophan depletion, (c) pharmacological challenge, and (d) endocrine challenge. Results across 175 independent samples and over 6,500 total participants were heterogeneous, but, in aggregate, revealed a small, inverse correlation between serotonin functioning and aggression, anger, and hostility (r = -.12). Pharmacological challenge studies had the largest mean weighted effect size (r = -.21), and CSF 5-HIAA studies had the smallest (r = -.06). Potential methodological and demographic moderators largely failed to account for variability in study outcomes. Notable exceptions included year of publication (effect sizes tended to diminish with time) and self- versus other-reported aggression (other-reported aggression was positively correlated to serotonin functioning). We discuss 4 possible explanations for the pattern of findings: unreliable measures, ambient correlational noise, an unidentified higher order interaction, and a selective serotonergic effect. Finally, we provide 4 recommendations for bringing much needed clarity to this important area of research: acknowledge contradictory findings and avoid selective reporting practices; focus on improving the reliability and validity of serotonin and aggression measures; test for interactions involving personality and/or environmental moderators; and revise the serotonin deficiency hypothesis to account for serotonin's functional complexity.

Why social attachment and oxytocin protect against addiction and stress: Insights from the dynamics between ventral and dorsal corticostriatal systems

The present article advances a neurobiological model of the reciprocal associations between social attachment and drug abuse, and social attachment and chronic stress, as overlapping systems are involved in stress coping and social attachment. In terms of coping, responding to a novel stressor or challenge involves initial novelty processing and activation of learning mechanisms that allow habituation to the stressor through familiarization. Similarly, social attachments are initially formed by being attracted by rewarding properties of an as-yet novel individual, and subsequently developing feelings of attachment towards the familiarized individual. Attachment and familiarization increase the availability of "internal working models" for the control of behavior and emotion, which may explain why secure attachments are associated with increased resilience in the face of stress, accompanied by less reactive reward responding (i.e., increased resilience against drug addiction). The present article seeks to illuminate the role of the neuropeptide oxytocin, which may be involved in the overlapping mechanisms of stable attachment formation and stress coping by shifting processing from novelty and reward seeking to appreciation of familiarity. Oxytocin may accomplish this by facilitating a ventral-to-dorsal shift in activation in corticostriatal loops, which produces a shift from a reactive reward drive (wanting) to stable appreciation of familiar social aspects ("liking" or "loving"). The authors suggest that through dopaminergic, serotonergic and endogenous opioid mechanisms, oxytocin is involved in shifting the balance between wanting and liking in corticostriatal loops by facilitating consolidation of social information from ventral reactive reward systems to dorsal internal working models that aid in prospectively selecting optimal actions in the future, increasing resilience in the face of stress and addiction.

Sensory neuron-derived eph regulates glomerular arbors and modulatory function of a central serotonergic neuron

Olfactory sensory neurons connect to the antennal lobe of the fly to create the primary units for processing odor cues, the glomeruli. Unique amongst antennal-lobe neurons is an identified wide-field serotonergic neuron, the contralaterally-projecting, serotonin-immunoreactive deutocerebral neuron (CSDn). The CSDn spreads its termini all over the contralateral antennal lobe, suggesting a diffuse neuromodulatory role. A closer examination, however, reveals a restricted pattern of the CSDn arborization in some glomeruli. We show that sensory neuron-derived Eph interacts with Ephrin in the CSDn, to regulate these arborizations. Behavioural analysis of animals with altered Eph-ephrin signaling and with consequent arborization defects suggests that neuromodulation requires local glomerular-specific patterning of the CSDn termini. Our results show the importance of developmental regulation of terminal arborization of even the diffuse modulatory neurons to allow them to route sensory-inputs according to the behavioural contexts.

Serotonin, a major neuromodulatory transmitter, regulates diverse behaviours. Serotonergic dysfunction is implicated in various neuropsychological disorders, such as anxiety and depression, as well as in neurodegenerative disorders. In the central nervous systems, across taxa, serotonergic neurons are often small in number but connect to and act upon multiple brain circuits through their wide-field arborization pattern. We set out to decipher mechanisms by which wide-field serotonergic neurons differentially innervate their target-field to modulate behavior in a context-dependent manner. We took advantage of the sophisticated antennal lobe circuitry, the primary olfactory centre in the adult fruitfly Drosophila melanogaster. Olfactory sensory neurons and projection neurons connect in a partner-specific manner to create glomerular units in the antennal lobe for processing the sense of smell. Our analysis at a single-cell resolution reveals that a wide-field serotonergic neuron connects to all the glomeruli in the antennal lobe but exhibits the glomerular-specific differences in its innervation pattern. Our key finding is that Eph from sensory neurons regulates the glomerular-specific innervation pattern of the central serotonergic neuron, which in turn is essential for modulation of odor-guided behaviours in an odor-specific manner.

Mechanisms of experience dependent control of aggression in crickets

Aggression is a highly plastic behaviour, shaped by numerous experiences, and potential costs and benefits of competing, to optimize fitness and survival. Recent studies on crickets provide insights into how nervous systems achieve this. Their fighting behaviour is promoted by physical exertion, winning disputes and possession of resources. These effects are each mediated by octopamine, the invertebrate analogue of noradrenaline. Submissive behaviour, in less well understood. It is induced when the accumulated sum of the opponent's agonistic signals surpass some critical level, and probably mediated by nitric oxide, serotonin and other neuromodulators. We propose that animals can make the decision to fight or flee by modulating the respective behavioural thresholds in response to potentially rewarding and aversive attributes of experiences.

A neurorobotic platform to test the influence of neuromodulatory signaling on anxious and curious behavior

The vertebrate neuromodulatory systems are critical for appropriate value-laden responses to environmental challenges. Whereas changes in the overall level of dopamine (DA) have an effect on the organism's reward or curiosity-seeking behavior, changes in the level of serotonin (5-HT) can affect its level of anxiety or harm aversion. Moreover, top-down signals from frontal cortex can exert cognitive control on these neuromodulatory systems. The cholinergic (ACh) and noradrenergic (NE) systems affect the ability to filter out noise and irrelevant events. We introduce a neural network for action selection that is based on these principles of neuromodulatory systems. The algorithm tested the hypothesis that high levels of serotonin lead to withdrawn behavior by suppressing DA action and that high levels of DA or low levels of 5-HT lead to curious, exploratory behavior. Furthermore, the algorithm tested the idea that top-down signals from the frontal cortex to neuromodulatory areas are critical for an organism to cope with both stressful and novel events. The neural network was implemented on an autonomous robot and tested in an open-field paradigm. The open-field test is often used to test for models anxiety or exploratory behavior in the rodent and allows for qualitative comparisons with the neurorobot's behavior. The present neurorobotic experiments can lead to a better understanding of how neuromodulatory signaling affects the balance between anxious and curious behavior. Therefore, this experimental paradigm may also be informative in exploring a wide range of neurological diseases such as anxiety, autism, attention deficit disorders, and obsessive-compulsive disorders.

Instrumental vigour in punishment and reward

Recent notions about the vigour of responding in operant conditioning suggest that the long-run average rate of reward should control the alacrity of action in cases in which the actual cost of speed is balanced against the opportunity cost of sloth. The average reward rate is suggested as being reported by tonic activity in the dopamine system and thereby influencing all actions, including ones that do not themselves lead directly to the rewards. This idea is syntactically problematical for the case of punishment. Here, we broaden the scope of the original suggestion, providing a two-factor analysis of obviated punishment in a variety of operant circumstances. We also consider the effects of stochastically successful actions, which turn out to differ rather markedly between appetitive and aversive cases. Finally, we study how to fit these ideas into nascent treatments that extend concepts of opponency between dopamine and serotonin from valence to invigoration.

Simultaneous blockade of dopamine and noradrenaline reuptake promotes disadvantageous decision making in a rat gambling task

RATIONALE

The inability to make profitable long-term decisions has been implicated in several psychiatric disorders. There is emerging evidence to support a role for dopamine (DA) in decision making, but our understanding of the role of noradrenaline (NA) and serotonin (5-HT) in decision making, and of possible interactions between the three monoamines, is limited. Moreover, impulsivity has been associated with aberrant decision making, but the underlying mechanisms are incompletely understood.

OBJECTIVE

The purpose of this study is to improve our understanding of the neuropharmacological mechanisms of decision making and impulse control.

METHODS

We investigated the effects of amphetamine (0.25-1.0 mg/kg) and selective reuptake inhibitors of DA (GBR12909; 2.5-10 mg/kg), NA (atomoxetine; 0.3-3.0 mg/kg), and 5-HT (citalopram; 0.3-3.0 mg/kg) in a rat gambling task (rGT). Since the rGT allows for detection of impulsive action, i.e., premature responding, we also assessed the relationship between decision making and impulsivity.

RESULTS

In the rGT, rats developed an optimal choice strategy from the first session onwards. Elevation of endogenous DA or NA levels increased and decreased impulsivity, respectively, but did not alter decision making. However, simultaneous blockade of DA and NA disrupted decision making, reflected by a relative decrease in choice for the advantageous choice options. Increasing 5-HT neurotransmission did not affect decision making or impulsivity.

CONCLUSIONS

These data suggest important but complementary or redundant roles of DA and NA neurotransmission in decision-making processes based on reward probability and punishment. Moreover, impulse control and decision making in the rGT rely on dissociable mechanisms.

Twenty-five lessons from computational neuromodulation

Neural processing faces three rather different, and perniciously tied, communication problems. First, computation is radically distributed, yet point-to-point interconnections are limited. Second, the bulk of these connections are semantically uniform, lacking differentiation at their targets that could tag particular sorts of information. Third, the brain's structure is relatively fixed, and yet different sorts of input, forms of processing, and rules for determining the output are appropriate under different, and possibly rapidly changing, conditions. Neuromodulators address these problems by their multifarious and broad distribution, by enjoying specialized receptor types in partially specific anatomical arrangements, and by their ability to mold the activity and sensitivity of neurons and the strength and plasticity of their synapses. Here, I offer a computationally focused review of algorithmic and implementational motifs associated with neuromodulators, using decision making in the face of uncertainty as a running example.

Serotonin system gene polymorphisms are associated with impulsivity in a context dependent manner

Impulsivity is a risk factor for adverse outcomes and characterizes several psychiatric disorders and risk for suicide. There is strong evidence that genetic variation influences individual differences in impulsivity, but the details are not yet understood. There is growing interest in better understanding the context dependency of genetic effects that is reflected in studies examining gender specificity, gene×environment interaction and epistasis (gene-gene interaction). In a cross-sectional study we examined whether polymorphisms in six serotonin system candidate genes and the experience of early life trauma (age 0-12) were associated with individual differences in impulsivity in a non-clinical sample of Caucasian university students (N=424). We specifically tested potential gender specific, gene-gene, and gene×environment (early life trauma) effects. In our main analyses with Barratt Impulsiveness Scale (BIS-11) total score, there were significant (i.e. p<.01 and False Discovery Rate <.10) interactions between (1) gender and TPH2 (rs1386483) genotype; (2) gender and HTR2A (rs6313) genotype; and epistatic interactions among (3) 5-HTTLPR and MAOA uVNTR; (4) 5-HTTLPR and rs6313 and (5) HTR1B (rs6296) and rs6313 genotypes. Our results strongly support the explicit investigation of context dependent genetic effects on impulsivity and may help to resolve some of the conflicting reports in the literature.

The decision to fight or flee - insights into underlying mechanism in crickets

Ritualized fighting between conspecifics is an inherently dangerous behavioral strategy, optimized to secure limited resources at minimal cost and risk. To be adaptive, potential rewards, and costs of aggression must be assessed to decide when it would be more opportune to fight or flee. We summarize insights into the proximate mechanisms underlying this decision-making process in field crickets. As in other animals, cricket aggression is enhanced dramatically by motor activity, winning, and the possession of resources. Pharmacological manipulations provide evidence that these cases of experience dependent enhancement of aggression are each mediated by octopamine, the invertebrate counterpart to adrenaline/noradrenaline. The data suggest that both physical exertion and rewarding aspects of experiences can activate the octopaminergic system, which increases the propensity to fight. Octopamine thus represents the motivational component of aggression in insects. For the decision to flee, animals are thought to assess information from agonistic signals exchanged during fighting. Cricket fights conform to the cumulative assessment model, in that they persist in fighting until the sum of their opponent’s actions accumulates to some threshold at which they withdraw. We discuss evidence that serotonin, nitric oxide, and some neuropeptides may promote an insect’s tendency to flee. We propose that the decision to fight or flee in crickets is controlled simply by relative behavioral thresholds. Rewarding experiences increase the propensity to fight to a level determined by the modulatory action of octopamine. The animal will then flee only when the accumulated sum of the opponent’s actions surpasses this level; serotonin and nitric oxide may be involved in this process. This concept is in line with the roles proposed for noradrenaline, serotonin, and nitric oxide in mammals and suggests that basic mechanisms of aggressive modulation may be conserved in phylogeny.