Reward from bugs to bipeds: a comparative approach to understanding how reward circuits function

Drosophila learning and memory centers and the actions of drugs of abuse

Drug addiction and the circuitry for learning and memory are intimately intertwined. Drugs of abuse create strong, inappropriate, and lasting memories that contribute to many of their destructive properties, such as continued use despite negative consequences and exceptionally high rates of relapse. Studies in Drosophila melanogaster are helping us understand how drugs of abuse, especially alcohol, create memories at the level of individual neurons and in the circuits where they function. Drosophila is a premier organism for identifying the mechanisms of learning and memory. Drosophila also respond to drugs of abuse in ways that remarkably parallel humans and rodent models. An emerging consensus is that, for alcohol, the mushroom bodies participate in the circuits that control acute drug sensitivity, not explicitly associative forms of plasticity such as tolerance, and classical associative memories of their rewarding and aversive properties. Moreover, it is becoming clear that drugs of abuse use the mushroom body circuitry differently from other behaviors, potentially providing a basis for their addictive properties.

An approach for prioritizing candidate genes from RNA-seq using preclinical cocaine self-administration datasets as a test case

RNA-sequencing (RNA-seq) technology has led to a surge of neuroscience research using animal models to probe the complex molecular mechanisms underlying brain function and behavior, including substance use disorders. However, findings from rodent studies often fail to be translated into clinical treatments. Here, we developed a novel pipeline for narrowing candidate genes from preclinical studies by translational potential and demonstrated its utility in 2 RNA-seq studies of rodent self-administration. This pipeline uses evolutionary conservation and preferential expression of genes across brain tissues to prioritize candidate genes, increasing the translational utility of RNA-seq in model organisms. Initially, we demonstrate the utility of our prioritization pipeline using an uncorrected P-value. However, we found no differentially expressed genes in either dataset after correcting for multiple testing with false discovery rate (FDR < 0.05 or <0.1). This is likely due to low statistical power that is common across rodent behavioral studies, and, therefore, we additionally illustrate the use of our pipeline on a third dataset with differentially expressed genes corrected for multiple testing (FDR < 0.05). We also advocate for improved RNA-seq data collection, statistical testing, and metadata reporting that will bolster the field's ability to identify reliable candidate genes and improve the translational value of bioinformatics in rodent research.

From Reward to Anhedonia-Dopamine Function in the Global Mental Health Context

When "hijacked" by compulsive behaviors that affect the reward and stress centers of the brain, functional changes in the dopamine circuitry occur as the consequence of pathological brain adaptation. As a brain correlate of mental health, dopamine has a central functional role in behavioral regulation from healthy reward-seeking to pathological adaptation to stress in response to adversity. This narrative review offers a spotlight view of the transition from healthy reward function, under the control of dopamine, to the progressive deregulation of this function in interactions with other brain centers and circuits, producing what may be called an anti-reward brain state. How such deregulation is linked to specific health-relevant behaviors is then explained and linked to pandemic-related adversities and the stresses they engendered. The long lockdown periods where people in social isolation had to rely on drink, food, and digital rewards via the internet may be seen as the major triggers of changes in motivation and reward-seeking behavior worldwide. The pathological adaptation of dopamine-mediated reward circuitry in the brain is discussed. It is argued that, when pushed by fate and circumstance into a physiological brain state of anti-reward, human behavior changes and mental health is affected, depending on individual vulnerabilities. A unified conceptual account that places dopamine function at the centre of the current global mental health context is proposed.

The matricellular protein Drosophila Cellular Communication Network Factor is required for synaptic transmission and female fertility

Within the extracellular matrix, matricellular proteins are dynamically expressed nonstructural proteins that interact with cell surface receptors, growth factors, and proteases, as well as with structural matrix proteins. The cellular communication network factors family of matricellular proteins serve regulatory roles to regulate cell function and are defined by their conserved multimodular organization. Here, we characterize the expression and neuronal requirement for the Drosophila cellular communication network factor family member. Drosophila cellular communication network factor is expressed in the nervous system throughout development including in subsets of monoamine-expressing neurons. Drosophila cellular communication network factor-expressing abdominal ganglion neurons innervate the ovaries and uterus and the loss of Drosophila cellular communication network factor results in reduced female fertility. In addition, Drosophila cellular communication network factor accumulates at the synaptic cleft and is required for neurotransmission at the larval neuromuscular junction. Analyzing the function of the single Drosophila cellular communication network factor family member will enhance our potential to understand how the microenvironment impacts neurotransmitter release in distinct cellular contexts and in response to activity.

Syntaxin 1 Ser14 phosphorylation is required for nonvesicular dopamine release

Amphetamine (AMPH) is a psychostimulant that is commonly abused. The stimulant properties of AMPH are associated with its ability to increase dopamine (DA) neurotransmission. This increase is promoted by nonvesicular DA release mediated by reversal of DA transporter (DAT) function. Syntaxin 1 (Stx1) is a SNARE protein that is phosphorylated at Ser¹⁴ by casein kinase II. We show that Stx1 phosphorylation is critical for AMPH-induced nonvesicular DA release and, in Drosophila melanogaster, regulates the expression of AMPH-induced preference and sexual motivation. Our molecular dynamics simulations of the DAT/Stx1 complex demonstrate that phosphorylation of these proteins is pivotal for DAT to dwell in a DA releasing state. This state is characterized by the breakdown of two key salt bridges within the DAT intracellular gate, causing the opening and hydration of the DAT intracellular vestibule, allowing DA to bind from the cytosol, a mechanism that we hypothesize underlies nonvesicular DA release.

Octopaminergic neurons function in appetitive but not aversive olfactory learning and memory in Bactrocera dorsalis

The biogenic amine octopamine (OA, invertebrate counterpart of noradrenaline) plays critical roles in the regulation of olfactory behavior. Historically, OA has been thought to mediate appetitive but not aversive learning in honeybees, fruit flies (Drosophila), and crickets. However, this viewpoint has recently been challenged because OA activity through a β-adrenergic-like receptor drives both appetitive and aversive learning. Here, we explored the roles of OA neurons in olfactory learning and memory retrieval in Bactrocera dorsalis. We trained flies to associate an orange odor with a sucrose reward or to associate methyl eugenol, a male lure, with N,N-diethyl-3-methyl benzoyl amide (DEET) punishment. We then treated flies with OA receptor antagonists before appetitive or aversive conditioning and a memory retention test. Injection of OA receptor antagonist mianserin or epinastine into the abdomen of flies led to impaired of appetitive learning and memory retention with a sucrose reward, while aversive learning and memory retention with DEET punishment remained intact. Our results suggest that the OA signaling participates in appetitive but not aversive learning and memory retrieval in B. dorsalis through OA receptors.

Drug effect and addiction research with insects - From Drosophila to collective reward in honeybees

Animals and humans share similar reactions to the effects of addictive substances, including those of their brain networks to drugs. Our review focuses on simple invertebrate models, particularly the honeybee (Apis mellifera), and on the effects of drugs on bee behaviour and brain functions. The drug effects in bees are very similar to those described in humans. Furthermore, the honeybee community is a superorganism in which many collective functions outperform the simple sum of individual functions. The distribution of reward functions in this superorganism is unique - although sublimated at the individual level, community reward functions are of higher quality. This phenomenon of collective reward may be extrapolated to other animal species living in close and strictly organised societies, i.e. humans. The relationship between sociality and reward, based on use of similar parts of the neural network (social decision-making network in mammals, mushroom body in bees), suggests a functional continuum of reward and sociality in animals.

Digital Addiction and Sleep

In 2020, the World Health Organization formally recognized addiction to digital technology (connected devices) as a worldwide problem, where excessive online activity and internet use lead to inability to manage time, energy, and attention during daytime and produce disturbed sleep patterns or insomnia during nighttime. Recent studies have shown that the problem has increased in magnitude worldwide during the COVID-19 pandemic. The extent to which dysfunctional sleep is a consequence of altered motivation, memory function, mood, diet, and other lifestyle variables or results from excess of blue-light exposure when looking at digital device screens for long hours at day and night is one of many still unresolved questions. This article offers a narrative overview of some of the most recent literature on this topic. The analysis provided offers a conceptual basis for understanding digital addiction as one of the major reasons why people, and adolescents in particular, sleep less and less well in the digital age. It discusses definitions as well as mechanistic model accounts in context. Digital addiction is identified as functionally equivalent to all addictions, characterized by the compulsive, habitual, and uncontrolled use of digital devices and an excessively repeated engagement in a particular online behavior. Once the urge to be online has become uncontrollable, it is always accompanied by severe sleep loss, emotional distress, depression, and memory dysfunction. In extreme cases, it may lead to suicide. The syndrome has been linked to the known chronic effects of all drugs, producing disturbances in cellular and molecular mechanisms of the GABAergic and glutamatergic neurotransmitter systems. Dopamine and serotonin synaptic plasticity, essential for impulse control, memory, and sleep function, are measurably altered. The full spectrum of behavioral symptoms in digital addicts include eating disorders and withdrawal from outdoor and social life. Evidence pointing towards dysfunctional melatonin and vitamin D metabolism in digital addicts should be taken into account for carving out perspectives for treatment. The conclusions offer a holistic account for digital addiction, where sleep deficit is one of the key factors.

Dynamic functional connectivity in the static connectome of Caenorhabditis elegans

A hallmark of adaptive behavior is the ability to flexibly respond to sensory cues. To understand how neural circuits implement this flexibility, it is critical to resolve how a static anatomical connectome can be modulated such that functional connectivity in the network can be dynamically regulated. Here, we review recent work in the roundworm Caenorhabditis elegans on this topic. EM studies have mapped anatomical connectomes of many C. elegans animals, highlighting the level of stereotypy in the anatomical network. Brain-wide calcium imaging and studies of specified neural circuits have uncovered striking flexibility in the functional coupling of neurons. The coupling between neurons is controlled by neuromodulators that act over long timescales. This gives rise to persistent behavioral states that animals switch between, allowing them to generate adaptive behavioral responses across environmental conditions. Thus, the dynamic coupling of neurons enables multiple behavioral states to be encoded in a physically stereotyped connectome.

Neuroecology of Alcohol Preference in Drosophila

In this review, we highlight sources of alcohols in nature, as well as the behavioral and ecological roles that these fermentation cues play in the short lifespan of Drosophila melanogaster. With a focus on neuroethology, we describe the olfactory detection of alcohol as well as ensuing neural signaling within the brain of the fly. We proceed to explain the plethora of behaviors related to alcohol, including attraction, feeding, and oviposition, as well as general effects on aggression and courtship. All of these behaviors are shaped by physiological state and social contexts. In a comparative perspective, we also discuss inter- and intraspecies differences related to alcohol tolerance and metabolism. Lastly, we provide corollaries with other dipteran and coleopteran insect species that also have olfactory systems attuned to ethanol detection and describe ecological and evolutionary directions for further studies of the natural history of alcohol and the fly.

Addiction-Associated Genetic Variants Implicate Brain Cell Type- and Region-Specific Cis-Regulatory Elements in Addiction Neurobiology

Recent large genome-wide association studies have identified multiple confident risk loci linked to addiction-associated behavioral traits. Most genetic variants linked to addiction-associated traits lie in noncoding regions of the genome, likely disrupting cis-regulatory element (CRE) function. CREs tend to be highly cell type-specific and may contribute to the functional development of the neural circuits underlying addiction. Yet, a systematic approach for predicting the impact of risk variants on the CREs of specific cell populations is lacking. To dissect the cell types and brain regions underlying addiction-associated traits, we applied stratified linkage disequilibrium score regression to compare genome-wide association studies to genomic regions collected from human and mouse assays for open chromatin, which is associated with CRE activity. We found enrichment of addiction-associated variants in putative CREs marked by open chromatin in neuronal (NeuN+) nuclei collected from multiple prefrontal cortical areas and striatal regions known to play major roles in reward and addiction. To further dissect the cell type-specific basis of addiction-associated traits, we also identified enrichments in human orthologs of open chromatin regions of female and male mouse neuronal subtypes: cortical excitatory, D1, D2, and PV. Last, we developed machine learning models to predict mouse cell type-specific open chromatin, enabling us to further categorize human NeuN+ open chromatin regions into cortical excitatory or striatal D1 and D2 neurons and predict the functional impact of addiction-associated genetic variants. Our results suggest that different neuronal subtypes within the reward system play distinct roles in the variety of traits that contribute to addiction.SIGNIFICANCE STATEMENT We combine statistical genetic and machine learning techniques to find that the predisposition to for nicotine, alcohol, and cannabis use behaviors can be partially explained by genetic variants in conserved regulatory elements within specific brain regions and neuronal subtypes of the reward system. Our computational framework can flexibly integrate open chromatin data across species to screen for putative causal variants in a cell type- and tissue-specific manner for numerous complex traits.

A network of phosphatidylinositol (4,5)-bisphosphate (PIP2) binding sites on the dopamine transporter regulates amphetamine behavior in Drosophila Melanogaster

Reward modulates the saliency of a specific drug exposure and is essential for the transition to addiction. Numerous human PET-fMRI studies establish a link between midbrain dopamine (DA) release, DA transporter (DAT) availability, and reward responses. However, how and whether DAT function and regulation directly participate in reward processes remains elusive. Here, we developed a novel experimental paradigm in Drosophila melanogaster to study the mechanisms underlying the psychomotor and rewarding properties of amphetamine (AMPH). AMPH principally mediates its pharmacological and behavioral effects by increasing DA availability through the reversal of DAT function (DA efflux). We have previously shown that the phospholipid, phosphatidylinositol (4, 5)-bisphosphate (PIP₂), directly interacts with the DAT N-terminus to support DA efflux in response to AMPH. In this study, we demonstrate that the interaction of PIP₂ with the DAT N-terminus is critical for AMPH-induced DAT phosphorylation, a process required for DA efflux. We showed that PIP₂ also interacts with intracellular loop 4 at R443. Further, we identified that R443 electrostatically regulates DA efflux as part of a coordinated interaction with the phosphorylated N-terminus. In Drosophila, we determined that a neutralizing substitution at R443 inhibited the psychomotor actions of AMPH. We associated this inhibition with a decrease in AMPH-induced DA efflux in isolated fly brains. Notably, we showed that the electrostatic interactions of R443 specifically regulate the rewarding properties of AMPH without affecting AMPH aversion. We present the first evidence linking PIP₂, DAT, DA efflux, and phosphorylation processes with AMPH reward.

Epigenetic Mechanisms Mediate Nicotine-Induced Reward and Behaviour in Zebrafish

Nicotine induces long-term changes in the neural activity of the mesocorticolimbic reward pathway structures. The mechanisms involved in this process have not been fully characterized. The hypothesis discussed here proposed that epigenetic regulation participates in the installation of persistent adaptations and long-lasting synaptic plasticity generated by nicotine action on the mesolimbic dopamine neurons of zebrafish. The epigenetic mechanisms induced by nicotine entail histone and DNA chemical modifications, which have been described to lead to changes in gene expression. Among the enzymes that catalyze epigenetic chemical modifications, histone deacetylases (HDACs) remove acetyl groups from histones, thereby facilitating DNA relaxation and making DNA more accessible to gene transcription. DNA methylation, which is dependent on DNA methyltransferase (DNMTs) activity, inhibits gene expression by recruiting several methyl binding proteins that prevent RNA polymerase binding to DNA. In zebrafish, phenylbutyrate (PhB), an HDAC inhibitor, abolishes nicotine rewarding properties together with a series of typical reward-associated behaviors. Furthermore, PhB and nicotine alter long- and short-term object recognition memory in zebrafish, respectively. Regarding DNA methylation effects, a methyl group donor L-methionine (L-met) was found to dramatically reduce nicotine-induced conditioned place preference (CPP) in zebrafish. Simultaneous treatment with DNMT inhibitor 5-aza-2’-deoxycytidine (AZA) was found to reverse the L-met effect on nicotine-induced CPP as well as nicotine reward-specific effects on genetic expression in zebrafish. Therefore, pharmacological interventions that modulate epigenetic regulation of gene expression should be considered as a potential therapeutic method to treat nicotine addiction.

Neurochemical Signaling of Reward and Aversion to Ventral Tegmental Area Glutamate Neurons

Ventral tegmental area (VTA) glutamate neurons signal and participate in reward and aversion-based behaviors. However, the neurochemical mechanisms that underlie how these neurons contribute to motivated behaviors is unknown. We used a combination of optical sensors to identify how distinct neurochemical inputs to VTA glutamate neurons participate in motivated behavior within female and male transgenic mice. Activity of glutamate inputs to VTA glutamate neurons increased for both reward-predicting and aversion-predicting cues and aversive outcomes, but subpopulations of glutamate inputs were increased or decreased by reward. For both reward and aversion-based cues and outcomes, activity of GABA inputs to VTA glutamate neurons mostly decreased. GCaMP recordings showed overall population increases in VTA glutamate neuron intracellular calcium during reward and aversion-based cues and outcomes. Electrophysiological recordings of VTA VGluT2 neurons showed that glutamate receptor activation increases firing while loss of excitation via glutamate receptor blockade decreases firing. GABA-A receptor activation decreased VTA glutamate neuron firing but GABA-A receptor blockade did not significantly change VTA glutamate neuron firing. Electrophysiological recordings in coordination with our sensor data suggest that glutamate inputs strongly regulate VTA glutamate neuron participation in diverse motivated behaviors.SIGNIFICANCE STATEMENT Glutamate and GABA are the primary excitatory and inhibitory neurotransmitters of the nervous system. However, identifying how these neurotransmitters regulate motivated behavior has remained challenging because of a lack of tools (1) capable of measuring neurotransmission at the temporal scale of motivated behaviors and (2) capable of capturing chemical signaling onto genetically-distinct neuronal populations. We have overcome these obstacles by implementing genetically-encoded fluorescent indicators to monitor both glutamate and GABA input dynamics exclusively to ventral tegmental area (VTA) glutamate neurons during reward and aversion-based behaviors. We identify that glutamate and GABA inputs to VTA glutamate neurons differentially and dynamically signal reward and aversion-based cues and outcomes. This research provides foundational evidence that links distinct neurotransmitters to motivated behaviors regulated by VTA glutamate neurons.

Associative learning in larval and adult Drosophila is impaired by the dopamine-synthesis inhibitor 3-Iodo-L-tyrosine

Across the animal kingdom, dopamine plays a crucial role in conferring reinforcement signals that teach animals about the causal structure of the world. In the fruit fly Drosophila melanogaster, dopaminergic reinforcement has largely been studied using genetics, whereas pharmacological approaches have received less attention. Here, we apply the dopamine-synthesis inhibitor 3-Iodo-L-tyrosine (3IY), which causes acute systemic inhibition of dopamine signaling, and investigate its effects on Pavlovian conditioning. We find that 3IY feeding impairs sugar-reward learning in larvae while leaving task-relevant behavioral faculties intact, and that additional feeding of a precursor of dopamine (L-3,4-dihydroxyphenylalanine, L-DOPA), rescues this impairment. Concerning a different developmental stage and for the aversive valence domain. Moreover, we demonstrate that punishment learning by activating the dopaminergic neuron PPL1-γ1pedc in adult flies is also impaired by 3IY feeding, and can likewise be rescued by L-DOPA. Our findings exemplify the advantages of using a pharmacological approach in combination with the genetic techniques available in D. melanogaster to manipulate neuronal and behavioral function.

Summary: We surveyed the effects of a dopamine-synthesis inhibitor on associative learning in larval and adult Drosophila. This approach can supplement genetic tools in investigating the conserved reinforcing function of dopamine.

Consolidating the Circuit Model for Addiction

Addiction is a disease characterized by compulsive drug seeking and consumption observed in 20-30% of users. An addicted individual will favor drug reward over natural rewards, despite major negative consequences. Mechanistic research on rodents modeling core components of the disease has identified altered synaptic transmission as the functional substrate of pathological behavior. While the initial version of a circuit model for addiction focused on early drug adaptive behaviors observed in all individuals, it fell short of accounting for the stochastic nature of the transition to compulsion. The model builds on the initial pharmacological effect common to all addictive drugs-an increase in dopamine levels in the mesolimbic system. Here, we consolidate this early model by integrating circuits underlying compulsion and negative reinforcement. We discuss the genetic and epigenetic correlates of individual vulnerability. Many recent data converge on a gain-of-function explanation for circuit remodeling, revealing blueprints for novel addiction therapies.

Drosophila reward system - A summary of current knowledge

The fruit fly Drosophila melanogaster brain is the most extensively investigated model of a reward system in insects. Drosophila can discriminate between rewarding and punishing environmental stimuli and consequently undergo associative learning. Functional models, especially those modelling mushroom bodies, are constantly being developed using newly discovered information, adding to the complexity of creating a simple model of the reward system. This review aims to clarify whether its reward system also includes a hedonic component. Neurochemical systems that mediate the 'wanting' component of reward in the Drosophila brain are well documented, however, the systems that mediate the pleasure component of reward in mammals, including those involving the endogenous opioid and endocannabinoid systems, are unlikely to be present in insects. The mushroom body components exhibit differential developmental age and different functional processes. We propose a hypothetical hierarchy of the levels of reinforcement processing in response to particular stimuli, and the parallel processes that take place concurrently. The possible presence of activity-silencing and meta-satiety inducing levels in Drosophila should be further investigated.

Dopamine modulation of sensory processing and adaptive behavior in flies

Behavioral flexibility for appropriate action selection is an advantage when animals are faced with decisions that will determine their survival or death. In order to arrive at the right decision, animals evaluate information from their external environment, internal state, and past experiences. How these different signals are integrated and modulated in the brain, and how context- and state-dependent behavioral decisions are controlled are poorly understood questions. Studying the molecules that help convey and integrate such information in neural circuits is an important way to approach these questions. Many years of work in different model organisms have shown that dopamine is a critical neuromodulator for (reward based) associative learning. However, recent findings in vertebrates and invertebrates have demonstrated the complexity and heterogeneity of dopaminergic neuron populations and their functional implications in many adaptive behaviors important for survival. For example, dopaminergic neurons can integrate external sensory information, internal and behavioral states, and learned experience in the decision making circuitry. Several recent advances in methodologies and the availability of a synaptic level connectome of the whole-brain circuitry of Drosophila melanogaster make the fly an attractive system to study the roles of dopamine in decision making and state-dependent behavior. In particular, a learning and memory center-the mushroom body-is richly innervated by dopaminergic neurons that enable it to integrate multi-modal information according to state and context, and to modulate decision-making and behavior.

Circuits that encode and guide alcohol-associated preference

A powerful feature of adaptive memory is its inherent flexibility. Alcohol and other addictive substances can remold neural circuits important for memory to reduce this flexibility. However, the mechanism through which pertinent circuits are selected and shaped remains unclear. We show that circuits required for alcohol-associated preference shift from population level dopaminergic activation to select dopamine neurons that predict behavioral choice in Drosophila melanogaster. During memory expression, subsets of dopamine neurons directly and indirectly modulate the activity of interconnected glutamatergic and cholinergic mushroom body output neurons (MBON). Transsynaptic tracing of neurons important for memory expression revealed a convergent center of memory consolidation within the mushroom body (MB) implicated in arousal, and a structure outside the MB implicated in integration of naïve and learned responses. These findings provide a circuit framework through which dopamine neuronal activation shifts from reward delivery to cue onset, and provide insight into the maladaptive nature of memory.

The Neuroscience of Drug Reward and Addiction

Drug consumption is driven by a drug's pharmacological effects, which are experienced as rewarding, and is influenced by genetic, developmental, and psychosocial factors that mediate drug accessibility, norms, and social support systems or lack thereof. The reinforcing effects of drugs mostly depend on dopamine signaling in the nucleus accumbens, and chronic drug exposure triggers glutamatergic-mediated neuroadaptations in dopamine striato-thalamo-cortical (predominantly in prefrontal cortical regions including orbitofrontal cortex and anterior cingulate cortex) and limbic pathways (amygdala and hippocampus) that, in vulnerable individuals, can result in addiction. In parallel, changes in the extended amygdala result in negative emotional states that perpetuate drug taking as an attempt to temporarily alleviate them. Counterintuitively, in the addicted person, the actual drug consumption is associated with an attenuated dopamine increase in brain reward regions, which might contribute to drug-taking behavior to compensate for the difference between the magnitude of the expected reward triggered by the conditioning to drug cues and the actual experience of it. Combined, these effects result in an enhanced motivation to "seek the drug" (energized by dopamine increases triggered by drug cues) and an impaired prefrontal top-down self-regulation that favors compulsive drug-taking against the backdrop of negative emotionality and an enhanced interoceptive awareness of "drug hunger." Treatment interventions intended to reverse these neuroadaptations show promise as therapeutic approaches for addiction.

Come Fly with Me: An overview of dopamine receptors in Drosophila melanogaster

Dopamine (DA) receptors play critical roles in a wide range of behaviours, including sensory processing, motor function, reward and arousal. As such, aberrant DA signalling is associated with numerous neurological and psychiatric disorders. Therefore, understanding the mechanisms by which DA neurotransmission drives intracellular signalling pathways that modulate behaviour can provide critical insights to guide the development of targeted therapeutics. Drosophila melanogaster has emerged as a powerful model with unique advantages to study the mechanisms underlying DA neurotransmission and associated behaviours in a controlled and systematic manner. Many regions in the fly brain innervated by dopaminergic neurons have been mapped and linked to specific behaviours, including associative learning and arousal. Here, we provide an overview of the homology between human and Drosophila dopaminergic systems and review the current literature on the pharmacology, molecular signalling mechanisms and behavioural outcome of DA receptor activation in the Drosophila brain.

Insights from intoxicated Drosophila

Our understanding of alcohol use disorder (AUD), particularly alcohol's effects on the nervous system, has unquestionably benefited from the use of model systems such as Drosophila melanogaster. Here, we briefly introduce the use of flies in alcohol research, and highlight the genetic accessibility and neurobiological contribution that flies have made to our understanding of AUD. Future fly research offers unique opportunities for addressing unresolved questions in the alcohol field, such as the neuromolecular and circuit basis for cravings and alcohol-induced neuroimmune dysfunction. This review strongly advocates for interdisciplinary approaches and translational collaborations with the united goal of confronting the major health problems associated with alcohol abuse and addiction.

The Role of Dopamine in the Collective Regulation of Foraging in Harvester Ants

Colonies of the red harvester ant (Pogonomyrmex barbatus) differ in how they regulate collective foraging activity in response to changes in humidity. We used transcriptomic, physiological, and pharmacological experiments to investigate the molecular basis of this ecologically important variation in collective behavior among colonies. RNA sequencing of forager brain tissue showed an association between colony foraging activity and differential expression of transcripts related to biogenic amine and neurohormonal metabolism and signaling. In field experiments, pharmacological increases in forager brain dopamine titer caused significant increases in foraging activity. Colonies that were naturally most sensitive to humidity were significantly more responsive to the stimulatory effect of exogenous dopamine. In addition, forager brain tissue significantly varied among colonies in biogenic amine content. Neurophysiological variation among colonies associated with individual forager sensitivity to humidity may reflect the heritable molecular variation on which natural selection acts to shape the collective regulation of foraging.

Alcohol Activates Scabrous-Notch to Influence Associated Memories

Drugs of abuse, like alcohol, modulate gene expression in reward circuits and consequently alter behavior. However, the in vivo cellular mechanisms through which alcohol induces lasting transcriptional changes are unclear. We show that Drosophila Notch/Su(H) signaling and the secreted fibrinogen-related protein Scabrous in mushroom body (MB) memory circuitry are important for the enduring preference of cues associated with alcohol's rewarding properties. Alcohol exposure affects Notch responsivity in the adult MB and alters Su(H) targeting at the dopamine-2-like receptor (Dop2R). Alcohol cue training also caused lasting changes to the MB nuclear transcriptome, including changes in the alternative splicing of Dop2R and newly implicated transcripts like Stat92E. Together, our data suggest that alcohol-induced activation of the highly conserved Notch pathway and accompanying transcriptional responses in memory circuitry contribute to addiction. Ultimately, this provides mechanistic insight into the etiology and pathophysiology of alcohol use disorder.

Deep(er) Learning

Animals successfully thrive in noisy environments with finite resources. The necessity to function with resource constraints has led evolution to design animal brains (and bodies) to be optimal in their use of computational power while being adaptable to their environmental niche. A key process undergirding this ability to adapt is the process of learning. Although a complete characterization of the neural basis of learning remains ongoing, scientists for nearly a century have used the brain as inspiration to design artificial neural networks capable of learning, a case in point being deep learning. In this viewpoint, we advocate that deep learning can be further enhanced by incorporating and tightly integrating five fundamental principles of neural circuit design and function: optimizing the system to environmental need and making it robust to environmental noise, customizing learning to context, modularizing the system, learning without supervision, and learning using reinforcement strategies. We illustrate how animals integrate these learning principles using the fruit fly olfactory learning circuit, one of nature's best-characterized and highly optimized schemes for learning. Incorporating these principles may not just improve deep learning but also expose common computational constraints. With judicious use, deep learning can become yet another effective tool to understand how and why brains are designed the way they are.

Early deprivation disruption of associative learning is a developmental pathway to depression and social problems

Exposure to psychosocial deprivation is associated with elevations in numerous forms of impairment throughout the life-course. Disruptions in associative learning may be a key mechanism through which adversity, particularly psychosocial deprivation, increases risk for impairment. Existing data consistent with this claim come entirely from correlational studies. Here, we present the first experimental evidence relating psychosocial deprivation and disruptions in multiple forms of associative learning. Using data from the Bucharest Early Intervention Project, we demonstrate that randomized placement into a family caregiving environment during the infant/toddler period as compared to prolonged institutional care normalizes two forms of associative learning in early adolescence: reward responsivity and implicit motor learning. These forms of associative learning significantly mediate the effect of institutional rearing on depressive symptoms and peer relationships. In sum, we provide evidence for a novel pathway linking early experience to psychopathology and peer relationships through basic associative learning mechanisms.

Early childhood deprivation such as institutionalization can greatly affect early development. Here, the authors study children who were raised in institutions but later randomly placed in foster care vs. not, to understand how early-life deprivation affects associative learning in adolescence.

Mechanisms Underlying the Risk to Develop Drug Addiction, Insights From Studies in Drosophila melanogaster

The ability to adapt to environmental changes is an essential feature of biological systems, achieved in animals by a coordinated crosstalk between neuronal and hormonal programs that allow rapid and integrated organismal responses. Reward systems play a key role in mediating this adaptation by reinforcing behaviors that enhance immediate survival, such as eating or drinking, or those that ensure long-term survival, such as sexual behavior or caring for offspring. Drugs of abuse co-opt neuronal and molecular pathways that mediate natural rewards, which under certain circumstances can lead to addiction. Many factors can contribute to the transition from drug use to drug addiction, highlighting the need to discover mechanisms underlying the progression from initial drug use to drug addiction. Since similar responses to natural and drug rewards are present in very different animals, it is likely that the central systems that process reward stimuli originated early in evolution, and that common ancient biological principles and genes are involved in these processes. Thus, the neurobiology of natural and drug rewards can be studied using simpler model organisms that have their systems stripped of some of the immense complexity that exists in mammalian brains. In this paper we review studies in Drosophila melanogaster that model different aspects of natural and drug rewards, with an emphasis on how motivational states shape the value of the rewarding experience, as an entry point to understanding the mechanisms that contribute to the vulnerability of drug addiction.

A Fly's Eye View of Natural and Drug Reward

Animals encounter multiple stimuli each day. Some of these stimuli are innately appetitive or aversive, while others are assigned valence based on experience. Drugs like ethanol can elicit aversion in the short term and attraction in the long term. The reward system encodes the predictive value for different stimuli, mediating anticipation for attractive or punishing stimuli and driving animal behavior to approach or avoid conditioned stimuli. The neurochemistry and neurocircuitry of the reward system is partly evolutionarily conserved. In both vertebrates and invertebrates, including Drosophila melanogaster, dopamine is at the center of a network of neurotransmitters and neuromodulators acting in concert to encode rewards. Behavioral assays in D. melanogaster have become increasingly sophisticated, allowing more direct comparison with mammalian research. Moreover, recent evidence has established the functional modularity of the reward neural circuits in Drosophila. This functional modularity resembles the organization of reward circuits in mammals. The powerful genetic and molecular tools for D. melanogaster allow characterization and manipulation at the single-cell level. These tools are being used to construct a detailed map of the neural circuits mediating specific rewarding stimuli and have allowed for the identification of multiple genes and molecular pathways that mediate the effects of reinforcing stimuli, including their rewarding effects. This report provides an overview of the research on natural and drug reward in D. melanogaster, including natural rewards such as sugar and other food nutrients, and drug rewards including ethanol, cocaine, amphetamine, methamphetamine, and nicotine. We focused mainly on the known genetic and neural mechanisms underlying appetitive reward for sugar and reward for ethanol. We also include genes, molecular pathways, and neural circuits that have been identified using assays that test the palatability of the rewarding stimulus, the preference for the rewarding stimulus, or other effects of the stimulus that indicate how it can modify behavior. Commonalities between mechanisms of natural and drug reward are highlighted and future directions are presented, putting forward questions best suited for research using D. melanogaster as a model organism.

A subset of sweet-sensing neurons identified by IR56d are necessary and sufficient for fatty acid taste

Fat represents a calorically potent food source that yields approximately twice the amount of energy as carbohydrates or proteins per unit of mass. The highly palatable taste of free fatty acids (FAs), one of the building blocks of fat, promotes food consumption, activates reward circuitry, and is thought to contribute to hedonic feeding underlying many metabolism-related disorders. Despite a role in the etiology of metabolic diseases, little is known about how dietary fats are detected by the gustatory system to promote feeding. Previously, we showed that a broad population of sugar-sensing taste neurons expressing Gustatory Receptor 64f (Gr64f) is required for reflexive feeding responses to both FAs and sugars. Here, we report a genetic silencing screen to identify specific populations of taste neurons that mediate fatty acid (FA) taste. We find neurons identified by expression of Ionotropic Receptor 56d (IR56d) are necessary and sufficient for reflexive feeding response to FAs. Functional imaging reveals that IR56d-expressing neurons are responsive to short- and medium-chain FAs. Silencing IR56d neurons selectively abolishes FA taste, and their activation is sufficient to drive feeding responses. Analysis of co-expression with Gr64f identifies two subpopulations of IR56d-expressing neurons. While physiological imaging reveals that both populations are responsive to FAs, IR56d/Gr64f neurons are activated by medium-chain FAs and are sufficient for reflexive feeding response to FAs. Moreover, flies can discriminate between sugar and FAs in an aversive taste memory assay, indicating that FA taste is a unique modality in Drosophila. Taken together, these findings localize FA taste within the Drosophila gustatory center and provide an opportunity to investigate discrimination between different categories of appetitive tastants.

Fat represents a calorically potent food source that yields approximately twice the amount of energy as carbohydrates or proteins per unit of mass. Dietary lipids are comprised of both triacylglycerides and FAs, and growing evidence suggests that it is the free FAs that are detected by the gustatory system. The highly palatable taste of FAs promotes food consumption, activates reward centers in mammals, and is thought to contribute to hedonic feeding that underlies many metabolism-related disorders. Despite a role in the etiology of metabolic diseases, little is known about how dietary fats are detected by the gustatory system to promote feeding. We have identified a subset of sugar-sensing neurons in the fly that also responds to medium-chain FAs and are necessary and sufficient for behavioral response to FAs. Further, we find that despite being sensed by shared neuronal populations, flies can differentiate between the taste of sugar and FAs, fortifying the notion that FAs and sugar represent distinct taste modalities in flies.

Dissection of the Drosophila neuropeptide F circuit using a high-throughput two-choice assay

In their classic experiments, Olds and Milner showed that rats learn to lever press to receive an electric stimulus in specific brain regions. This led to the identification of mammalian reward centers. Our interest in defining the neuronal substrates of reward perception in the fruit fly Drosophila melanogaster prompted us to develop a simpler experimental approach wherein flies could implement behavior that induces self-stimulation of specific neurons in their brains. The high-throughput assay employs optogenetic activation of neurons when the fly occupies a specific area of a behavioral chamber, and the flies' preferential occupation of this area reflects their choosing to experience optogenetic stimulation. Flies in which neuropeptide F (NPF) neurons are activated display preference for the illuminated side of the chamber. We show that optogenetic activation of NPF neuron is rewarding in olfactory conditioning experiments and that the preference for NPF neuron activation is dependent on NPF signaling. Finally, we identify a small subset of NPF-expressing neurons located in the dorsomedial posterior brain that are sufficient to elicit preference in our assay. This assay provides the means for carrying out unbiased screens to map reward neurons in flies.

Dopaminergic rules of engagement for memory in Drosophila

Dopamine is associated with a variety of conserved responses across species including locomotion, sleep, food consumption, aggression, courtship, addiction and several forms of appetitive and aversive memory. Historically, dopamine has been most prominently associated with dynamics underlying reward, punishment, or salience. Recent emerging evidence from Drosophila supports a role in all of these functions, as well as additional roles in the interplay between external sensation and internal states and forgetting of the very memories dopamine helped encode. We discuss how cell-specific resolution and manipulation are elucidating the rules of dopamine's involvement in encoding valence and memory.

Neurobiology of comorbid post-traumatic stress disorder and alcohol-use disorder

Post-traumatic stress disorder (PTSD) and alcohol-use disorder (AUD) are highly comorbid in humans. Although we have some understanding of the structural and functional brain changes that define each of these disorders, and how those changes contribute to the behavioral symptoms that define them, little is known about the neurobiology of comorbid PTSD and AUD, which may be due in part to a scarcity of adequate animal models for examining this research question. The goal of this review is to summarize the current state-of-the-science on comorbid PTSD and AUD. We summarize epidemiological data documenting the prevalence of this comorbidity, review what is known about the potential neurobiological basis for the frequent co-occurrence of PTSD and AUD and discuss successes and failures of past and current treatment strategies. We also review animal models that aim to examine comorbid PTSD and AUD, highlighting where the models parallel the human condition, and we discuss the strengths and weaknesses of each model. We conclude by discussing key gaps in our knowledge and strategies for addressing them: in particular, we (1) highlight the need for better animal models of the comorbid condition and better clinical trial design, (2) emphasize the need for examination of subpopulation effects and individual differences and (3) urge cross-talk between basic and clinical researchers that is reflected in collaborative work with forward and reverse translational impact.