Reward signal in a recurrent circuit drives appetitive long-term memory formation

The Neural Correlations of Olfactory Associative Reward Memories in Drosophila

Advancing treatment to resolve human cognitive disorders requires a comprehensive understanding of the molecular signaling pathways underlying learning and memory. While most organ systems evolved to maintain homeostasis, the brain developed the capacity to perceive and adapt to environmental stimuli through the continuous modification of interactions within a gene network functioning within a broader neural network. This distinctive characteristic enables significant neural plasticity, but complicates experimental investigations. A thorough examination of the mechanisms underlying behavioral plasticity must integrate multiple levels of biological organization, encompassing genetic pathways within individual neurons, interactions among neural networks providing feedback on gene expression, and observable phenotypic behaviors. Model organisms, such as Drosophila melanogaster, which possess more simple and manipulable nervous systems and genomes than mammals, facilitate such investigations. The evolutionary conservation of behavioral phenotypes and the associated genetics and neural systems indicates that insights gained from flies are pertinent to understanding human cognition. Rather than providing a comprehensive review of the entire field of Drosophila memory research, we focus on olfactory associative reward memories and their related neural circuitry in fly brains, with the objective of elucidating the underlying neural mechanisms, thereby advancing our understanding of brain mechanisms linked to cognitive systems.

Neurotransmitter classification from electron microscopy images at synaptic sites in Drosophila melanogaster

High-resolution electron microscopy of nervous systems has enabled the reconstruction of synaptic connectomes. However, we do not know the synaptic sign for each connection (i.e., whether a connection is excitatory or inhibitory), which is implied by the released transmitter. We demonstrate that artificial neural networks can predict transmitter types for presynapses from electron micrographs: a network trained to predict six transmitters (acetylcholine, glutamate, GABA, serotonin, dopamine, octopamine) achieves an accuracy of 87% for individual synapses, 94% for neurons, and 91% for known cell types across a D. melanogaster whole brain. We visualize the ultrastructural features used for prediction, discovering subtle but significant differences between transmitter phenotypes. We also analyze transmitter distributions across the brain and find that neurons that develop together largely express only one fast-acting transmitter (acetylcholine, glutamate, or GABA). We hope that our publicly available predictions act as an accelerant for neuroscientific hypothesis generation for the fly.

Skewing information flow through pre- and postsynaptic plasticity in the mushroom bodies of Drosophila

Animal brains need to store information to construct a representation of their environment. Knowledge of what happened in the past allows both vertebrates and invertebrates to predict future outcomes by recalling previous experience. Although invertebrate and vertebrate brains share common principles at the molecular, cellular, and circuit-architectural levels, there are also obvious differences as exemplified by the use of acetylcholine versus glutamate as the considered main excitatory neurotransmitters in the respective central nervous systems. Nonetheless, across central nervous systems, synaptic plasticity is thought to be a main substrate for memory storage. Therefore, how brain circuits and synaptic contacts change following learning is of fundamental interest for understanding brain computations tied to behavior in any animal. Recent progress has been made in understanding such plastic changes following olfactory associative learning in the mushroom bodies (MBs) of Drosophila A current framework of memory-guided behavioral selection is based on the MB skew model, in which antagonistic synaptic pathways are selectively changed in strength. Here, we review insights into plasticity at dedicated Drosophila MB output pathways and update what is known about the plasticity of both pre- and postsynaptic compartments of Drosophila MB neurons.

An integrative sensor of body states: how the mushroom body modulates behavior depending on physiological context

The brain constantly compares past and present experiences to predict the future, thereby enabling instantaneous and future behavioral adjustments. Integration of external information with the animal's current internal needs and behavioral state represents a key challenge of the nervous system. Recent advancements in dissecting the function of the Drosophila mushroom body (MB) at the single-cell level have uncovered its three-layered logic and parallel systems conveying positive and negative values during associative learning. This review explores a lesser-known role of the MB in detecting and integrating body states such as hunger, thirst, and sleep, ultimately modulating motivation and sensory-driven decisions based on the physiological state of the fly. State-dependent signals predominantly affect the activity of modulatory MB input neurons (dopaminergic, serotoninergic, and octopaminergic), but also induce plastic changes directly at the level of the MB intrinsic and output neurons. Thus, the MB emerges as a tightly regulated relay station in the insect brain, orchestrating neuroadaptations due to current internal and behavioral states leading to short- but also long-lasting changes in behavior. While these adaptations are crucial to ensure fitness and survival, recent findings also underscore how circuit motifs in the MB may reflect fundamental design principles that contribute to maladaptive behaviors such as addiction or depression-like symptoms.

Beyond prediction error: 25 years of modeling the associations formed in the insect mushroom body

The insect mushroom body has gained increasing attention as a system in which the computational basis of neural learning circuits can be unraveled. We now understand in detail the key locations in this circuit where synaptic associations are formed between sensory patterns and values leading to actions. However, the actual learning rule (or rules) implemented by neural activity and leading to synaptic change is still an open question. Here, I survey the diversity of answers that have been offered in computational models of this system over the past decades, including the recurring assumption-in line with top-down theories of associative learning-that the core function is to reduce prediction error. However, I will argue, a more bottom-up approach may ultimately reveal a richer algorithmic capacity in this still enigmatic brain neuropil.

Drosophila learning and memory centers and the actions of drugs of abuse

Drug addiction and the circuitry for learning and memory are intimately intertwined. Drugs of abuse create strong, inappropriate, and lasting memories that contribute to many of their destructive properties, such as continued use despite negative consequences and exceptionally high rates of relapse. Studies in Drosophila melanogaster are helping us understand how drugs of abuse, especially alcohol, create memories at the level of individual neurons and in the circuits where they function. Drosophila is a premier organism for identifying the mechanisms of learning and memory. Drosophila also respond to drugs of abuse in ways that remarkably parallel humans and rodent models. An emerging consensus is that, for alcohol, the mushroom bodies participate in the circuits that control acute drug sensitivity, not explicitly associative forms of plasticity such as tolerance, and classical associative memories of their rewarding and aversive properties. Moreover, it is becoming clear that drugs of abuse use the mushroom body circuitry differently from other behaviors, potentially providing a basis for their addictive properties.

Roles of feedback and feed-forward networks of dopamine subsystems: insights from Drosophila studies

Across animal species, dopamine-operated memory systems comprise anatomically segregated, functionally diverse subsystems. Although individual subsystems could operate independently to support distinct types of memory, the logical interplay between subsystems is expected to enable more complex memory processing by allowing existing memory to influence future learning. Recent comprehensive ultrastructural analysis of the Drosophila mushroom body revealed intricate networks interconnecting the dopamine subsystems-the mushroom body compartments. Here, we review the functions of some of these connections that are beginning to be understood. Memory consolidation is mediated by two different forms of network: A recurrent feedback loop within a compartment maintains sustained dopamine activity required for consolidation, whereas feed-forward connections across compartments allow short-term memory formation in one compartment to open the gate for long-term memory formation in another compartment. Extinction and reversal of aversive memory rely on a similar feed-forward circuit motif that signals omission of punishment as a reward, which triggers plasticity that counteracts the original aversive memory trace. Finally, indirect feed-forward connections from a long-term memory compartment to short-term memory compartments mediate higher-order conditioning. Collectively, these emerging studies indicate that feedback control and hierarchical connectivity allow the dopamine subsystems to work cooperatively to support diverse and complex forms of learning.

New genetic tools for mushroom body output neurons in Drosophila

How memories of past events influence behavior is a key question in neuroscience. The major associative learning center in Drosophila, the mushroom body (MB), communicates to the rest of the brain through mushroom body output neurons (MBONs). While 21 MBON cell types have their dendrites confined to small compartments of the MB lobes, analysis of EM connectomes revealed the presence of an additional 14 MBON cell types that are atypical in having dendritic input both within the MB lobes and in adjacent brain regions. Genetic reagents for manipulating atypical MBONs and experimental data on their functions have been lacking. In this report we describe new cell-type-specific GAL4 drivers for many MBONs, including the majority of atypical MBONs that extend the collection of MBON driver lines we have previously generated (Aso et al., 2014a; Aso et al., 2016; Aso et al., 2019). Using these genetic reagents, we conducted optogenetic activation screening to examine their ability to drive behaviors and learning. These reagents provide important new tools for the study of complex behaviors in Drosophila.

Prediction error drives associative learning and conditioned behavior in a spiking model of Drosophila larva

Predicting reinforcement from sensory cues is beneficial for goal-directed behavior. In insect brains, underlying associations between cues and reinforcement, encoded by dopaminergic neurons, are formed in the mushroom body. We propose a spiking model of the Drosophila larva mushroom body. It includes a feedback motif conveying learned reinforcement expectation to dopaminergic neurons, which can compute prediction error as the difference between expected and present reinforcement. We demonstrate that this can serve as a driving force in learning. When combined with synaptic homeostasis, our model accounts for theoretically derived features of acquisition and loss of associations that depend on the intensity of the reinforcement and its temporal proximity to the cue. From modeling olfactory learning over the time course of behavioral experiments and simulating the locomotion of individual larvae toward or away from odor sources in a virtual environment, we conclude that learning driven by prediction errors can explain larval behavior.

Minimal circuit motifs for second-order conditioning in the insect mushroom body

In well-established first-order conditioning experiments, the concurrence of a sensory cue with reinforcement forms an association, allowing the cue to predict future reinforcement. In the insect mushroom body, a brain region central to learning and memory, such associations are encoded in the synapses between its intrinsic and output neurons. This process is mediated by the activity of dopaminergic neurons that encode reinforcement signals. In second-order conditioning, a new sensory cue is paired with an already established one that presumably activates dopaminergic neurons due to its predictive power of the reinforcement. We explored minimal circuit motifs in the mushroom body for their ability to support second-order conditioning using mechanistic models. We found that dopaminergic neurons can either be activated directly by the mushroom body's intrinsic neurons or via feedback from the output neurons via several pathways. We demonstrated that the circuit motifs differ in their computational efficiency and robustness. Beyond previous research, we suggest an additional motif that relies on feedforward input of the mushroom body intrinsic neurons to dopaminergic neurons as a promising candidate for experimental evaluation. It differentiates well between trained and novel stimuli, demonstrating robust performance across a range of model parameters.

Forgotten memory storage and retrieval in Drosophila

Inaccessibility of stored memory in ensemble cells through the forgetting process causes animals to be unable to respond to natural recalling cues. While accumulating evidence has demonstrated that reactivating memory-stored cells can switch cells from an inaccessible state to an accessible form and lead to recall of previously learned information, the underlying cellular and molecular mechanisms remain elusive. The current study used Drosophila as a model to demonstrate that the memory of one-trial aversive olfactory conditioning, although inaccessible within a few hours after learning, is stored in KCαβ and retrievable after mild retraining. One-trial aversive conditioning triggers protein synthesis to form a long-lasting cellular memory trace, approximately 20 days, via creb in KCαβ, and a transient cellular memory trace, approximately one day, via orb in MBON-α3. PPL1-α3 negatively regulates forgotten one-trial conditioning memory retrieval. The current study demonstrated that KCαβ, PPL1-α3, and MBON-α3 collaboratively regulate the formation of forgotten one-cycle aversive conditioning memory formation and retrieval.

Brief Change in Dopamine Activity during Consolidation Impairs Long-Term Memory via Sleep Disruption

Sleep disturbances are associated with poor long-term memory (LTM) formation, yet the underlying cell types and neural circuits involved have not been fully decoded. Dopamine neurons (DANs) are involved in memory processing at multiple stages. Here, we show that brief activation of protocerebral anterior medial DANs (PAM-DANs) or inhibition of a pair of dorsal posterior medial (DPM) neurons during the first few hours of memory consolidation impairs 24 h LTM. Interestingly, sleep deprivation elevates the neural activity of PAM-DANs and DPM neurons, and brief thermos-activation of PAM-DANs or inactivation of DPM neurons results in sleep loss and fragmentation. Pharmacological rescue of sleep after this manipulation restores LTM. A specific subset of PAM-DANs, PAM-α1 that synapse onto DPM neurons specify the microcircuit that links sleep and memory. PAM-DANs, including PAM-α1, form functional synapses with DPM neurons mainly via Dop1R1 receptor to inhibit DPM. Our data suggest that the post-training activity of PAM(-α1)-DPM microcircuit, especially during memory consolidation, plays an essential role in maintaining the sleep necessary for LTM consolidation, providing a new cellular and circuit basis for the complex relationship between sleep and memory.

Optogenetic induction of appetitive and aversive taste memories in Drosophila

Tastes typically evoke innate behavioral responses that can be broadly categorized as acceptance or rejection. However, research in Drosophila melanogaster indicates that taste responses also exhibit plasticity through experience-dependent changes in mushroom body circuits. In this study, we develop a novel taste learning paradigm using closed-loop optogenetics. We find that appetitive and aversive taste memories can be formed by pairing gustatory stimuli with optogenetic activation of sensory neurons or dopaminergic neurons encoding reward or punishment. As with olfactory memories, distinct dopaminergic subpopulations drive the parallel formation of short- and long-term appetitive memories. Long-term memories are protein synthesis-dependent and have energetic requirements that are satisfied by a variety of caloric food sources or by direct stimulation of MB-MP1 dopaminergic neurons. Our paradigm affords new opportunities to probe plasticity mechanisms within the taste system and understand the extent to which taste responses depend on experience.

Reward expectations direct learning and drive operant matching in Drosophila

Foraging animals must use decision-making strategies that dynamically adapt to the changing availability of rewards in the environment. A wide diversity of animals do this by distributing their choices in proportion to the rewards received from each option, Herrnstein's operant matching law. Theoretical work suggests an elegant mechanistic explanation for this ubiquitous behavior, as operant matching follows automatically from simple synaptic plasticity rules acting within behaviorally relevant neural circuits. However, no past work has mapped operant matching onto plasticity mechanisms in the brain, leaving the biological relevance of the theory unclear. Here, we discovered operant matching in Drosophila and showed that it requires synaptic plasticity that acts in the mushroom body and incorporates the expectation of reward. We began by developing a dynamic foraging paradigm to measure choices from individual flies as they learn to associate odor cues with probabilistic rewards. We then built a model of the fly mushroom body to explain each fly's sequential choice behavior using a family of biologically realistic synaptic plasticity rules. As predicted by past theoretical work, we found that synaptic plasticity rules could explain fly matching behavior by incorporating stimulus expectations, reward expectations, or both. However, by optogenetically bypassing the representation of reward expectation, we abolished matching behavior and showed that the plasticity rule must specifically incorporate reward expectations. Altogether, these results reveal the first synapse-level mechanisms of operant matching and provide compelling evidence for the role of reward expectation signals in the fly brain.

Circadian clock disruption promotes the degeneration of dopaminergic neurons in male Drosophila

Sleep and circadian rhythm disruptions are frequent comorbidities of Parkinson's disease (PD), a disorder characterized by the progressive loss of dopaminergic (DA) neurons in the substantia nigra. However, the causal role of circadian clocks in the degenerative process remains uncertain. We demonstrated here that circadian clocks regulate the rhythmicity and magnitude of the vulnerability of DA neurons to oxidative stress in male Drosophila. Circadian pacemaker neurons are presynaptic to a subset of DA neurons and rhythmically modulate their susceptibility to degeneration. The arrhythmic period (per) gene null mutation exacerbates the age-dependent loss of DA neurons and, in combination with brief oxidative stress, causes premature animal death. These findings suggest that circadian clock disruption promotes dopaminergic neurodegeneration.

Neural circuit mechanisms for transforming learned olfactory valences into wind-oriented movement

How memories are used by the brain to guide future action is poorly understood. In olfactory associative learning in Drosophila, multiple compartments of the mushroom body act in parallel to assign a valence to a stimulus. Here, we show that appetitive memories stored in different compartments induce different levels of upwind locomotion. Using a photoactivation screen of a new collection of split-GAL4 drivers and EM connectomics, we identified a cluster of neurons postsynaptic to the mushroom body output neurons (MBONs) that can trigger robust upwind steering. These UpWind Neurons (UpWiNs) integrate inhibitory and excitatory synaptic inputs from MBONs of appetitive and aversive memory compartments, respectively. After formation of appetitive memory, UpWiNs acquire enhanced response to reward-predicting odors as the response of the inhibitory presynaptic MBON undergoes depression. Blocking UpWiNs impaired appetitive memory and reduced upwind locomotion during retrieval. Photoactivation of UpWiNs also increased the chance of returning to a location where activation was terminated, suggesting an additional role in olfactory navigation. Thus, our results provide insight into how learned abstract valences are gradually transformed into concrete memory-driven actions through divergent and convergent networks, a neuronal architecture that is commonly found in the vertebrate and invertebrate brains.

The Stage-Based Model of Addiction-Using Drosophila to Investigate Alcohol and Psychostimulant Responses

Addiction is a progressive and complex disease that encompasses a wide range of disorders and symptoms, including substance use disorder (SUD), for which there are few therapeutic treatments. SUD is the uncontrolled and chronic use of substances despite the negative consequences resulting from this use. The progressive nature of addiction is organized into a testable framework, the neurobiological stage-based model, that includes three behavioral stages: (1) binge/intoxication, (2) withdrawal/negative affect, and (3) preoccupation/anticipation. Human studies offer limited opportunities for mechanistic insights into these; therefore, model organisms, like Drosophila melanogaster, are necessary for understanding SUD. Drosophila is a powerful model organism that displays a variety of SUD-like behaviors consistent with human and mammalian substance use, making flies a great candidate to study mechanisms of behavior. Additionally, there are an abundance of genetic tools like the GAL4/UAS and CRISPR/Cas9 systems that can be used to gain insight into the molecular mechanisms underlying the endophenotypes of the three-stage model. This review uses the three-stage framework and discusses how easily testable endophenotypes have been examined with experiments using Drosophila, and it outlines their potential for investigating other endophenotypes.

Neural circuit mechanisms linking courtship and reward in Drosophila males

Courtship has evolved to achieve reproductive success in animal species. However, whether courtship itself has a positive value remains unclear. In the present work, we report that courtship is innately rewarding and can induce the expression of appetitive short-term memory (STM) and long-term memory (LTM) in Drosophila melanogaster males. Activation of male-specific P1 neurons is sufficient to mimic courtship-induced preference and memory performance. Surprisingly, P1 neurons functionally connect to a large proportion of dopaminergic neurons (DANs) in the protocerebral anterior medial (PAM) cluster. The acquisition of STM and LTM depends on two distinct subsets of PAM DANs that convey the courtship-reward signal to the restricted regions of the mushroom body (MB) γ and α/β lobes through two dopamine receptors, D1-like Dop1R1 and D2-like Dop2R. Furthermore, the retrieval of STM stored in the MB α'/β' lobes and LTM stored in the MB α/β lobe relies on two distinct MB output neurons. Finally, LTM consolidation requires two subsets of PAM DANs projecting to the MB α/β lobe and corresponding MB output neurons. Taken together, our findings demonstrate that courtship is a potent rewarding stimulus and reveal the underlying neural circuit mechanisms linking courtship and reward in Drosophila males.

Metamorphosis of memory circuits in Drosophila reveals a strategy for evolving a larval brain

Mushroom bodies (MB) of adult Drosophila have a core of thousands of Kenyon neurons; axons of the early-born g class form a medial lobe and those from later-born α'β' and αβ classes form both medial and vertical lobes. The larva, however, hatches with only γ neurons and forms a vertical lobe 'facsimile' using larval-specific axon branches from its γ neurons. MB input (MBINs) and output (MBONs) neurons divide the Kenyon neuron lobes into discrete computational compartments. The larva has 10 such compartments while the adult has 16. We determined the fates of 28 of the 32 MBONs and MBINs that define the 10 larval compartments. Seven compartments are subsequently incorporated into the adult MB; four of their MBINs die, while 12 MBINs/MBONs remodel to function in adult compartments. The remaining three compartments are larval specific. At metamorphosis their MBIN/MBONs trans-differentiate, leaving the MB for other adult brain circuits. The adult vertical lobes are made de novo using MBONs/MBINs recruited from pools of adult-specific neurons. The combination of cell death, compartment shifting, trans-differentiation, and recruitment of new neurons result in no larval MBIN-MBON connections being maintained through metamorphosis. At this simple level, then, we find no anatomical substrate for a memory trace persisting from larva to adult. The adult phenotype of the trans-differentiating neurons represents their evolutionarily ancestral phenotype while their larval phenotype is a derived adaptation for the larval stage. These cells arise primarily within lineages that also produce permanent MBINs and MBONs, suggesting that larval specifying factors may allow information related to birth-order or sibling identity to be interpreted in a modified manner in the larva to allow these neurons to acquire larval phenotypic modifications. The loss of such factors at metamorphosis then allows these neurons to revert to their ancestral functions in the adult.

Hierarchical architecture of dopaminergic circuits enables second-order conditioning in Drosophila

Dopaminergic neurons with distinct projection patterns and physiological properties compose memory subsystems in a brain. However, it is poorly understood whether or how they interact during complex learning. Here, we identify a feedforward circuit formed between dopamine subsystems and show that it is essential for second-order conditioning, an ethologically important form of higher-order associative learning. The Drosophila mushroom body comprises a series of dopaminergic compartments, each of which exhibits distinct memory dynamics. We find that a slow and stable memory compartment can serve as an effective 'teacher' by instructing other faster and transient memory compartments via a single key interneuron, which we identify by connectome analysis and neurotransmitter prediction. This excitatory interneuron acquires enhanced response to reward-predicting odor after first-order conditioning and, upon activation, evokes dopamine release in the 'student' compartments. These hierarchical connections between dopamine subsystems explain distinct properties of first- and second-order memory long known by behavioral psychologists.

Sleep benefits different stages of memory in Drosophila

Understanding the physiological mechanisms that modulate memory acquisition and consolidation remains among the most ambitious questions in neuroscience. Massive efforts have been dedicated to deciphering how experience affects behavior, and how different physiological and sensory phenomena modulate memory. Our ability to encode, consolidate and retrieve memories depends on internal drives, and sleep stands out among the physiological processes that affect memory: one of the most relatable benefits of sleep is the aiding of memory that occurs in order to both prepare the brain to learn new information, and after a learning task, to consolidate those new memories. Drosophila lends itself to the study of the interactions between memory and sleep. The fruit fly provides incomparable genetic resources, a mapped connectome, and an existing framework of knowledge on the molecular, cellular, and circuit mechanisms of memory and sleep, making the fruit fly a remarkable model to decipher the sophisticated regulation of learning and memory by the quantity and quality of sleep. Research in Drosophila has stablished not only that sleep facilitates learning in wild-type and memory-impaired animals, but that sleep deprivation interferes with the acquisition of new memories. In addition, it is well-accepted that sleep is paramount in memory consolidation processes. Finally, studies in Drosophila have shown that that learning itself can promote sleep drive. Nevertheless, the molecular and network mechanisms underlying this intertwined relationship are still evasive. Recent remarkable work has shed light on the neural substrates that mediate sleep-dependent memory consolidation. In a similar way, the mechanistic insights of the neural switch control between sleep-dependent and sleep-independent consolidation strategies were recently described. This review will discuss the regulation of memory by sleep in Drosophila, focusing on the most recent advances in the field and pointing out questions awaiting to be investigated.

Fast-Scan Cyclic Voltammetry (FSCV) Reveals Behaviorally Evoked Dopamine Release by Sugar Feeding in the Adult Drosophila Mushroom Body

Drosophila melanogaster, the fruit fly, is an excellent model organism for studying dopaminergic mechanisms and simple behaviors, but methods to measure dopamine during behavior are needed. Here, we developed fast-scan cyclic voltammetry (FSCV) to track in vivo dopamine during sugar feeding. First, we employed acetylcholine stimulation to evaluate the feasibility of in vivo measurements in an awake fly. Next, we tested sugar feeding by placing sucrose solution near the fly proboscis. In the mushroom body medial tip, 1 pmol acetylcholine and sugar feeding released 0.49±0.04 μM and 0.31±0.06 μM dopamine, respectively but sugar-evoked release lasted longer than with acetylcholine. Administering the dopamine transporter inhibitor nisoxetine or D2 receptor antagonist flupentixol significantly increased sugar-evoked dopamine. This study develops FSCV to measure behaviorally evoked release in fly, enabling Drosophila studies of neurochemical control of reward, learning, and memory behaviors.

Nutrient responding peptide hormone CCHamide-2 consolidates appetitive memory

CCHamide-2 (CCHa2) is a protostome excitatory peptide ortholog known for various arthropod species. In fruit flies, CCHa2 plays a crucial role in the endocrine system, allowing peripheral tissue to communicate with the central nervous system to ensure proper development and the maintenance of energy homeostasis. Since the formation of odor-sugar associative long-term memory (LTM) depends on the nutrient status in an animal, CCHa2 may play an essential role in linking memory and metabolic systems. Here we show that CCHa2 signals are important for consolidating appetitive memory by acting on the rewarding dopamine neurons. Genetic disruption of CCHa2 using mutant strains abolished appetitive LTM but not short-term memory (STM). A post-learning thermal suppression of CCHa2 expressing cells impaired LTM. In contrast, a post-learning thermal activation of CCHa2 cells stabilized STM induced by non-nutritious sugar into LTM. The receptor of CCHa2, CCHa2-R, was expressed in a subset of dopamine neurons that mediate reward for LTM. In accordance, the receptor expression in these dopamine neurons was required for LTM specifically. We thus concluded that CCHa2 conveys a sugar nutrient signal to the dopamine neurons for memory consolidation. Our finding establishes a direct interplay between brain reward and the putative endocrine system for long-term energy homeostasis.

Dopamine activity in projection neurons regulates short-lasting olfactory approach memory in Drosophila

Survival in many animals requires the ability to associate certain cues with danger and others with safety. In a Drosophila melanogaster aversive olfactory conditioning paradigm, flies are exposed to two odours, one presented coincidentally with electrical shocks, and a second presented 45 s after shock cessation. When flies are later given a choice between these two odours, they avoid the shock‐paired odour and prefer the unpaired odour. While many studies have examined how flies learn to avoid the shock‐paired odour through formation of odour‐fear associations, here we demonstrate that conditioning also causes flies to actively approach the second odour. In contrast to fear memories, which are longer lasting and requires activity of D1‐like dopamine receptors only in the mushroom bodies, approach memory is short‐lasting and requires activity of D1‐like dopamine receptors in projection neurons originating from the antennal lobes, primary olfactory centers. Further, while recall of fear memories requires activity of the mushroom bodies, recall of approach memories does not. Our data suggest that olfactory approach memory is formed using different mechanisms in different brain locations compared to aversive and appetitive olfactory memories.

Interplay between metabolic energy regulation and memory pathways in Drosophila

Regulating energy metabolism is critical to maintain homeostasis of cellular and systemic functions. In the brain, specialised centres for energy storage regulation finely communicate with the periphery and integrate signals about internal states. As a result, the behavioural responses can be directly adjusted accordingly to the energetic demands. In the fruit fly Drosophila melanogaster, one of these regulatory centres is the mushroom bodies (MBs), a brain region involved in olfactory memory. The integration of metabolic cues by the MBs has a crucial impact on learned behaviour. In this review, we explore recent advances supporting the interplay between energy metabolism and memory establishment, as well as the instructive role of energy during the switch between memory phases.

An incentive circuit for memory dynamics in the mushroom body of Drosophila melanogaster

Insects adapt their response to stimuli, such as odours, according to their pairing with positive or negative reinforcements, such as sugar or shock. Recent electrophysiological and imaging findings in Drosophila melanogaster allow detailed examination of the neural mechanisms supporting the acquisition, forgetting, and assimilation of memories. We propose that this data can be explained by the combination of a dopaminergic plasticity rule that supports a variety of synaptic strength change phenomena, and a circuit structure (derived from neuroanatomy) between dopaminergic and output neurons that creates different roles for specific neurons. Computational modelling shows that this circuit allows for rapid memory acquisition, transfer from short term to long term, and exploration/exploitation trade-off. The model can reproduce the observed changes in the activity of each of the identified neurons in conditioning paradigms and can be used for flexible behavioural control.

Associative learning drives longitudinally graded presynaptic plasticity of neurotransmitter release along axonal compartments

Anatomical and physiological compartmentalization of neurons is a mechanism to increase the computational capacity of a circuit, and a major question is what role axonal compartmentalization plays. Axonal compartmentalization may enable localized, presynaptic plasticity to alter neuronal output in a flexible, experience-dependent manner. Here, we show that olfactory learning generates compartmentalized, bidirectional plasticity of acetylcholine release that varies across the longitudinal compartments of Drosophila mushroom body (MB) axons. The directionality of the learning-induced plasticity depends on the valence of the learning event (aversive vs. appetitive), varies linearly across proximal to distal compartments following appetitive conditioning, and correlates with learning-induced changes in downstream mushroom body output neurons (MBONs) that modulate behavioral action selection. Potentiation of acetylcholine release was dependent on the CaV2.1 calcium channel subunit cacophony. In addition, contrast between the positive conditioned stimulus and other odors required the inositol triphosphate receptor, which maintained responsivity to odors upon repeated presentations, preventing adaptation. Downstream from the MB, a set of MBONs that receive their input from the γ3 MB compartment were required for normal appetitive learning, suggesting that they represent a key node through which reward learning influences decision-making. These data demonstrate that learning drives valence-correlated, compartmentalized, bidirectional potentiation, and depression of synaptic neurotransmitter release, which rely on distinct mechanisms and are distributed across axonal compartments in a learning circuit.

Postsynaptic plasticity of cholinergic synapses underlies the induction and expression of appetitive and familiarity memories in Drosophila

In vertebrates, several forms of memory-relevant synaptic plasticity involve postsynaptic rearrangements of glutamate receptors. In contrast, previous work indicates that Drosophila and other invertebrates store memories using presynaptic plasticity of cholinergic synapses. Here, we provide evidence for postsynaptic plasticity at cholinergic output synapses from the Drosophila mushroom bodies (MBs). We find that the nicotinic acetylcholine receptor (nAChR) subunit α5 is required within specific MB output neurons for appetitive memory induction but is dispensable for aversive memories. In addition, nAChR α2 subunits mediate memory expression and likely function downstream of α5 and the postsynaptic scaffold protein discs large (Dlg). We show that postsynaptic plasticity traces can be induced independently of the presynapse, and that in vivo dynamics of α2 nAChR subunits are changed both in the context of associative and non-associative (familiarity) memory formation, underlying different plasticity rules. Therefore, regardless of neurotransmitter identity, key principles of postsynaptic plasticity support memory storage across phyla.

Neuropeptide F inhibits dopamine neuron interference of long-term memory consolidation in Drosophila

Long-term memory (LTM) formation requires consolidation processes to overcome interfering signals that erode memory formation. Olfactory memory in Drosophila involves convergent projection neuron (PN; odor) and dopaminergic neuron (DAN; reinforcement) input to the mushroom body (MB). How post-training DAN activity in the posterior lateral protocerebrum (PPL1) continues to regulate memory consolidation remains unknown. Here we address this question using targeted transgenes in behavior and electrophysiology experiments to show that (1) persistent post-training activity of PPL1-α2α'2 and PPL1-α3 DANs interferes with aversive LTM formation; (2) neuropeptide F (NPF) signaling blocks this interference in PPL1-α2α'2 and PPL1-α3 DANs after spaced training to enable LTM formation; and (3) training-induced NPF release and neurotransmission from two upstream dorsal-anterior-lateral (DAL2) neurons are required to form LTM. Thus, NPF signals from DAL2 neurons to specific PPL1 DANs disinhibit the memory circuit, ensuring that periodic events are remembered as consolidated LTM.

Compartment specific regulation of sleep by mushroom body requires GABA and dopaminergic signaling

Sleep is a fundamental behavioral state important for survival and is universal in animals with sufficiently complex nervous systems. As a highly conserved neurobehavioral state, sleep has been described in species ranging from jellyfish to humans. Biogenic amines like dopamine, serotonin and norepinephrine have been shown to be critical for sleep regulation across species but the precise circuit mechanisms underlying how amines control persistence of sleep, arousal and wakefulness remain unclear. The fruit fly, Drosophila melanogaster, provides a powerful model system for the study of sleep and circuit mechanisms underlying state transitions and persistence of states to meet the organisms motivational and cognitive needs. In Drosophila, two neuropils in the central brain, the mushroom body (MB) and the central complex (CX) have been shown to influence sleep homeostasis and receive aminergic neuromodulator input critical to sleep–wake switch. Dopamine neurons (DANs) are prevalent neuromodulator inputs to the MB but the mechanisms by which they interact with and regulate sleep- and wake-promoting neurons within MB are unknown. Here we investigate the role of subsets of PAM-DANs that signal wakefulness and project to wake-promoting compartments of the MB. We find that PAM-DANs are GABA responsive and require GABA_A-Rdl receptor in regulating sleep. In mapping the pathways downstream of PAM neurons innervating γ5 and β′2 MB compartments we find that wakefulness is regulated by both DopR1 and DopR2 receptors in downstream Kenyon cells (KCs) and mushroom body output neurons (MBONs). Taken together, we have identified and characterized a dopamine modulated sleep microcircuit within the mushroom body that has previously been shown to convey information about positive and negative valence critical for memory formation. These studies will pave way for understanding how flies balance sleep, wakefulness and arousal.

Models of heterogeneous dopamine signaling in an insect learning and memory center

The Drosophila mushroom body exhibits dopamine dependent synaptic plasticity that underlies the acquisition of associative memories. Recordings of dopamine neurons in this system have identified signals related to external reinforcement such as reward and punishment. However, other factors including locomotion, novelty, reward expectation, and internal state have also recently been shown to modulate dopamine neurons. This heterogeneity is at odds with typical modeling approaches in which these neurons are assumed to encode a global, scalar error signal. How is dopamine dependent plasticity coordinated in the presence of such heterogeneity? We develop a modeling approach that infers a pattern of dopamine activity sufficient to solve defined behavioral tasks, given architectural constraints informed by knowledge of mushroom body circuitry. Model dopamine neurons exhibit diverse tuning to task parameters while nonetheless producing coherent learned behaviors. Notably, reward prediction error emerges as a mode of population activity distributed across these neurons. Our results provide a mechanistic framework that accounts for the heterogeneity of dopamine activity during learning and behavior.

Dopamine neurons across the animal kingdom are involved in the formation of associative memories. While numerous studies have recorded activity in these neurons related to external and predicted rewards, the diversity of these neurons’ activity and their tuning to non-reward-related quantities such as novelty, movement, and internal state have proved challenging to account for in traditional modeling approaches. Using a well-characterized model system for learning and memory, the mushroom body of Drosophila fruit flies, Jiang and Litwin-Kumar provide an account of the diversity of signals across dopamine neurons. They show that models optimized to solve tasks like those encountered by flies exhibit heterogeneous activity across dopamine neurons, but nonetheless this activity is sufficient for the system to solve the tasks. The models will be useful to generate testable hypotheses about dopamine neuron activity across different experimental conditions.

Presynaptic inhibition of dopamine neurons controls optimistic bias

Regulation of reward signaling in the brain is critical for appropriate judgement of the environment and self. In Drosophila, the protocerebral anterior medial (PAM) cluster dopamine neurons mediate reward signals. Here, we show that localized inhibitory input to the presynaptic terminals of the PAM neurons titrates olfactory reward memory and controls memory specificity. The inhibitory regulation was mediated by metabotropic gamma-aminobutyric acid (GABA) receptors clustered in presynaptic microdomain of the PAM boutons. Cell type-specific silencing the GABA receptors enhanced memory by augmenting internal reward signals. Strikingly, the disruption of GABA signaling reduced memory specificity to the rewarded odor by changing local odor representations in the presynaptic terminals of the PAM neurons. The inhibitory microcircuit of the dopamine neurons is thus crucial for both reward values and memory specificity. Maladaptive presynaptic regulation causes optimistic cognitive bias.

The Role of Dopamine in Associative Learning in Drosophila: An Updated Unified Model

Learning to associate a positive or negative experience with an unrelated cue after the presentation of a reward or a punishment defines associative learning. The ability to form associative memories has been reported in animal species as complex as humans and as simple as insects and sea slugs. Associative memory has even been reported in tardigrades [1], species that diverged from other animal phyla 500 million years ago. Understanding the mechanisms of memory formation is a fundamental goal of neuroscience research. In this article, we work on resolving the current contradictions between different Drosophila associative memory circuit models and propose an updated version of the circuit model that predicts known memory behaviors that current models do not. Finally, we propose a model for how dopamine may function as a reward prediction error signal in Drosophila, a dopamine function that is well-established in mammals but not in insects [2, 3].

Learning with reinforcement prediction errors in a model of the Drosophila mushroom body

Effective decision making in a changing environment demands that accurate predictions are learned about decision outcomes. In Drosophila, such learning is orchestrated in part by the mushroom body, where dopamine neurons signal reinforcing stimuli to modulate plasticity presynaptic to mushroom body output neurons. Building on previous mushroom body models, in which dopamine neurons signal absolute reinforcement, we propose instead that dopamine neurons signal reinforcement prediction errors by utilising feedback reinforcement predictions from output neurons. We formulate plasticity rules that minimise prediction errors, verify that output neurons learn accurate reinforcement predictions in simulations, and postulate connectivity that explains more physiological observations than an experimentally constrained model. The constrained and augmented models reproduce a broad range of conditioning and blocking experiments, and we demonstrate that the absence of blocking does not imply the absence of prediction error dependent learning. Our results provide five predictions that can be tested using established experimental methods.

A Mechanistic Model for Reward Prediction and Extinction Learning in the Fruit Fly

Extinction learning, the ability to update previously learned information by integrating novel contradictory information, is of high clinical relevance for therapeutic approaches to the modulation of maladaptive memories. Insect models have been instrumental in uncovering fundamental processes of memory formation and memory update. Recent experimental results in Drosophila melanogaster suggest that, after the behavioral extinction of a memory, two parallel but opposing memory traces coexist, residing at different sites within the mushroom body (MB). Here, we propose a minimalistic circuit model of the Drosophila MB that supports classical appetitive and aversive conditioning and memory extinction. The model is tailored to the existing anatomic data and involves two circuit motives of central functional importance. It employs plastic synaptic connections between Kenyon cells (KCs) and MB output neurons (MBONs) in separate and mutually inhibiting appetitive and aversive learning pathways. Recurrent modulation of plasticity through projections from MBONs to reinforcement-mediating dopaminergic neurons (DAN) implements a simple reward prediction mechanism. A distinct set of four MBONs encodes odor valence and predicts behavioral model output. Subjecting our model to learning and extinction protocols reproduced experimental results from recent behavioral and imaging studies. Simulating the experimental blocking of synaptic output of individual neurons or neuron groups in the model circuit confirmed experimental results and allowed formulation of testable predictions. In the temporal domain, our model achieves rapid learning with a step-like increase in the encoded odor value after a single pairing of the conditioned stimulus (CS) with a reward or punishment, facilitating single-trial learning.

The Panopticon-Assessing the Effect of Starvation on Prolonged Fly Activity and Place Preference

Animal behaviours are demonstrably governed by sensory stimulation, previous experience and internal states like hunger. With increasing hunger, priorities shift towards foraging and feeding. During foraging, flies are known to employ efficient path integration strategies. However, general long-term activity patterns for both hungry and satiated flies in conditions of foraging remain to be better understood. Similarly, little is known about how permanent contact chemosensory stimulation affects locomotion. To address these questions, we have developed a novel, simplistic fly activity tracking setup—the Panopticon. Using a 3D-printed Petri dish inset, our assay allows recording of walking behaviour, of several flies in parallel, with all arena surfaces covered by a uniform substrate layer. We tested two constellations of providing food: (i) in single patches and (ii) omnipresent within the substrate layer. Fly tracking is done with FIJI, further assessment, analysis and presentation is done with a custom-built MATLAB analysis framework. We find that starvation history leads to a long-lasting reduction in locomotion, as well as a delayed place preference for food patches which seems to be not driven by immediate hunger motivation.

Predictive olfactory learning in Drosophila

Olfactory learning and conditioning in the fruit fly is typically modelled by correlation-based associative synaptic plasticity. It was shown that the conditioning of an odor-evoked response by a shock depends on the connections from Kenyon cells (KC) to mushroom body output neurons (MBONs). Although on the behavioral level conditioning is recognized to be predictive, it remains unclear how MBONs form predictions of aversive or appetitive values (valences) of odors on the circuit level. We present behavioral experiments that are not well explained by associative plasticity between conditioned and unconditioned stimuli, and we suggest two alternative models for how predictions can be formed. In error-driven predictive plasticity, dopaminergic neurons (DANs) represent the error between the predictive odor value and the shock strength. In target-driven predictive plasticity, the DANs represent the target for the predictive MBON activity. Predictive plasticity in KC-to-MBON synapses can also explain trace-conditioning, the valence-dependent sign switch in plasticity, and the observed novelty-familiarity representation. The model offers a framework to dissect MBON circuits and interpret DAN activity during olfactory learning.

Circuit reorganization in the Drosophila mushroom body calyx accompanies memory consolidation

The formation and consolidation of memories are complex phenomena involving synaptic plasticity, microcircuit reorganization, and the formation of multiple representations within distinct circuits. To gain insight into the structural aspects of memory consolidation, we focus on the calyx of the Drosophila mushroom body. In this essential center, essential for olfactory learning, second- and third-order neurons connect through large synaptic microglomeruli, which we dissect at the electron microscopy level. Focusing on microglomeruli that respond to a specific odor, we reveal that appetitive long-term memory results in increased numbers of precisely those functional microglomeruli responding to the conditioned odor. Hindering memory consolidation by non-coincident presentation of odor and reward, by blocking protein synthesis, or by including memory mutants suppress these structural changes, revealing their tight correlation with the process of memory consolidation. Thus, olfactory long-term memory is associated with input-specific structural modifications in a high-order center of the fly brain.

Dopaminergic mechanism underlying reward-encoding of punishment omission during reversal learning in Drosophila

Animals form and update learned associations between otherwise neutral sensory cues and aversive outcomes (i.e., punishment) to predict and avoid danger in changing environments. When a cue later occurs without punishment, this unexpected omission of aversive outcome is encoded as reward via activation of reward-encoding dopaminergic neurons. How such activation occurs remains unknown. Using real-time in vivo functional imaging, optogenetics, behavioral analysis and synaptic reconstruction from electron microscopy data, we identify the neural circuit mechanism through which Drosophila reward-encoding dopaminergic neurons are activated when an olfactory cue is unexpectedly no longer paired with electric shock punishment. Reduced activation of punishment-encoding dopaminergic neurons relieves depression of olfactory synaptic inputs to cholinergic neurons. Synaptic excitation by these cholinergic neurons of reward-encoding dopaminergic neurons increases their odor response, thus decreasing aversiveness of the odor. These studies reveal how an excitatory cholinergic relay from punishment- to reward-encoding dopaminergic neurons encodes the absence of punishment as reward, revealing a general circuit motif for updating aversive memories that could be present in mammals.

Transsynaptic mapping of Drosophila mushroom body output neurons

The mushroom body (MB) is a well-characterized associative memory structure within the Drosophila brain. Analyzing MB connectivity using multiple approaches is critical for understanding the functional implications of this structure. Using the genetic anterograde transsynaptic tracing tool, trans-Tango, we identified divergent projections across the brain and convergent downstream targets of the MB output neurons (MBONs). Our analysis revealed at least three separate targets that receive convergent input from MBONs: other MBONs, the fan-shaped body (FSB), and the lateral accessory lobe (LAL). We describe, both anatomically and functionally, a multilayer circuit in which inhibitory and excitatory MBONs converge on the same genetic subset of FSB and LAL neurons. This circuit architecture enables the brain to update and integrate information with previous experience before executing appropriate behavioral responses. Our use of trans-Tango provides a genetically accessible anatomical framework for investigating the functional relevance of components within these complex and interconnected circuits.

Mushroom body output differentiates memory processes and distinct memory-guided behaviors

The mushroom body (MB) of Drosophila melanogaster has multiple functions in controlling memory and behavior.^1-9 However, circuit mechanisms that generate this functional diversity are largely unclear. Here, we systematically probed the behavioral contribution of each type of MB output neuron (MBON) by blocking during acquisition, retention, or retrieval of reward or punishment memories. We evaluated the contribution using two conditioned responses: memory-guided odor choice and odor source attraction. Quantitative analysis revealed that these conditioned odor responses are controlled by different sets of MBONs. We found that the valence of memory, rather than the transition of memory steps, has a larger impact on the patterns of required MBONs. Moreover, we found that the glutamatergic MBONs forming recurrent circuits commonly contribute to appetitive memory acquisition, suggesting a pivotal role of this circuit motif for reward processing. Our results provide principles how the MB output circuit processes associative memories of different valence and controls distinct memory-guided behaviors.

Drosophila reward system - A summary of current knowledge

The fruit fly Drosophila melanogaster brain is the most extensively investigated model of a reward system in insects. Drosophila can discriminate between rewarding and punishing environmental stimuli and consequently undergo associative learning. Functional models, especially those modelling mushroom bodies, are constantly being developed using newly discovered information, adding to the complexity of creating a simple model of the reward system. This review aims to clarify whether its reward system also includes a hedonic component. Neurochemical systems that mediate the 'wanting' component of reward in the Drosophila brain are well documented, however, the systems that mediate the pleasure component of reward in mammals, including those involving the endogenous opioid and endocannabinoid systems, are unlikely to be present in insects. The mushroom body components exhibit differential developmental age and different functional processes. We propose a hypothetical hierarchy of the levels of reinforcement processing in response to particular stimuli, and the parallel processes that take place concurrently. The possible presence of activity-silencing and meta-satiety inducing levels in Drosophila should be further investigated.

Dopamine modulation of sensory processing and adaptive behavior in flies

Behavioral flexibility for appropriate action selection is an advantage when animals are faced with decisions that will determine their survival or death. In order to arrive at the right decision, animals evaluate information from their external environment, internal state, and past experiences. How these different signals are integrated and modulated in the brain, and how context- and state-dependent behavioral decisions are controlled are poorly understood questions. Studying the molecules that help convey and integrate such information in neural circuits is an important way to approach these questions. Many years of work in different model organisms have shown that dopamine is a critical neuromodulator for (reward based) associative learning. However, recent findings in vertebrates and invertebrates have demonstrated the complexity and heterogeneity of dopaminergic neuron populations and their functional implications in many adaptive behaviors important for survival. For example, dopaminergic neurons can integrate external sensory information, internal and behavioral states, and learned experience in the decision making circuitry. Several recent advances in methodologies and the availability of a synaptic level connectome of the whole-brain circuitry of Drosophila melanogaster make the fly an attractive system to study the roles of dopamine in decision making and state-dependent behavior. In particular, a learning and memory center-the mushroom body-is richly innervated by dopaminergic neurons that enable it to integrate multi-modal information according to state and context, and to modulate decision-making and behavior.

Changing memories on the fly: the neural circuits of memory re-evaluation in Drosophila melanogaster

Associative learning leads to modifications in neural networks to assign valence to sensory cues. These changes not only allow the expression of learned behavior but also modulate subsequent learning events. In the brain of the adult fruit fly, Drosophila melanogaster, olfactory memories are established as dopamine-driven plasticity in the output of a highly recurrent network, the mushroom body. Recent findings have highlighted how these changes in the network can steer the strengthening, weakening and formation of parallel memories when flies are exposed to subsequent training trials, conflicting situations or the reversal of contingencies. Together, these processes provide an initial understanding of how learned information can be used to guide the re-evaluation of memories.

The connectome of the adult Drosophila mushroom body provides insights into function

Making inferences about the computations performed by neuronal circuits from synapse-level connectivity maps is an emerging opportunity in neuroscience. The mushroom body (MB) is well positioned for developing and testing such an approach due to its conserved neuronal architecture, recently completed dense connectome, and extensive prior experimental studies of its roles in learning, memory, and activity regulation. Here, we identify new components of the MB circuit in Drosophila, including extensive visual input and MB output neurons (MBONs) with direct connections to descending neurons. We find unexpected structure in sensory inputs, in the transfer of information about different sensory modalities to MBONs, and in the modulation of that transfer by dopaminergic neurons (DANs). We provide insights into the circuitry used to integrate MB outputs, connectivity between the MB and the central complex and inputs to DANs, including feedback from MBONs. Our results provide a foundation for further theoretical and experimental work.

Circuits that encode and guide alcohol-associated preference

A powerful feature of adaptive memory is its inherent flexibility. Alcohol and other addictive substances can remold neural circuits important for memory to reduce this flexibility. However, the mechanism through which pertinent circuits are selected and shaped remains unclear. We show that circuits required for alcohol-associated preference shift from population level dopaminergic activation to select dopamine neurons that predict behavioral choice in Drosophila melanogaster. During memory expression, subsets of dopamine neurons directly and indirectly modulate the activity of interconnected glutamatergic and cholinergic mushroom body output neurons (MBON). Transsynaptic tracing of neurons important for memory expression revealed a convergent center of memory consolidation within the mushroom body (MB) implicated in arousal, and a structure outside the MB implicated in integration of naïve and learned responses. These findings provide a circuit framework through which dopamine neuronal activation shifts from reward delivery to cue onset, and provide insight into the maladaptive nature of memory.

Valence and State-Dependent Population Coding in Dopaminergic Neurons in the Fly Mushroom Body

Neuromodulation permits flexibility of synapses, neural circuits, and ultimately behavior. One neuromodulator, dopamine, has been studied extensively in its role as a reward signal during learning and memory across animal species. Newer evidence suggests that dopaminergic neurons (DANs) can modulate sensory perception acutely, thereby allowing an animal to adapt its behavior and decision making to its internal and behavioral state. In addition, some data indicate that DANs are not homogeneous but rather convey different types of information as a heterogeneous population. We have investigated DAN population activity and how it could encode relevant information about sensory stimuli and state by taking advantage of the confined anatomy of DANs innervating the mushroom body (MB) of the fly Drosophila melanogaster. Using in vivo calcium imaging and a custom 3D image registration method, we found that the activity of the population of MB DANs encodes innate valence information of an odor or taste as well as the physiological state of the animal. Furthermore, DAN population activity is strongly correlated with movement, consistent with a role of dopamine in conveying behavioral state to the MB. Altogether, our data and analysis suggest that DAN population activities encode innate odor and taste valence, movement, and physiological state in a MB-compartment-specific manner. We propose that dopamine shapes innate perception through combinatorial population coding of sensory valence, physiological, and behavioral context.

The Drosophila Mushroom Body: From Architecture to Algorithm in a Learning Circuit

The Drosophila brain contains a relatively simple circuit for forming Pavlovian associations, yet it achieves many operations common across memory systems. Recent advances have established a clear framework for Drosophila learning and revealed the following key operations: a) pattern separation, whereby dense combinatorial representations of odors are preprocessed to generate highly specific, nonoverlapping odor patterns used for learning; b) convergence, in which sensory information is funneled to a small set of output neurons that guide behavioral actions; c) plasticity, where changing the mapping of sensory input to behavioral output requires a strong reinforcement signal, which is also modulated by internal state and environmental context; and d) modularization, in which a memory consists of multiple parallel traces, which are distinct in stability and flexibility and exist in anatomically well-defined modules within the network. Cross-module interactions allow for higher-order effects where past experience influences future learning. Many of these operations have parallels with processes of memory formation and action selection in more complex brains.

Carbon Monoxide, a Retrograde Messenger Generated in Postsynaptic Mushroom Body Neurons, Evokes Noncanonical Dopamine Release

Dopaminergic neurons innervate extensive areas of the brain and release dopamine (DA) onto a wide range of target neurons. However, DA release is also precisely regulated. In Drosophila melanogaster brain explant preparations, DA is released specifically onto α3/α'3 compartments of mushroom body (MB) neurons that have been coincidentally activated by cholinergic and glutamatergic inputs. The mechanism for this precise release has been unclear. Here we found that coincidentally activated MB neurons generate carbon monoxide (CO), which functions as a retrograde signal evoking local DA release from presynaptic terminals. CO production depends on activity of heme oxygenase in postsynaptic MB neurons, and CO-evoked DA release requires Ca²⁺ efflux through ryanodine receptors in DA terminals. CO is only produced in MB areas receiving coincident activation, and removal of CO using scavengers blocks DA release. We propose that DA neurons use two distinct modes of transmission to produce global and local DA signaling.SIGNIFICANCE STATEMENT Dopamine (DA) is needed for various higher brain functions, including memory formation. However, DA neurons form extensive synaptic connections, while memory formation requires highly specific and localized DA release. Here we identify a mechanism through which DA release from presynaptic terminals is controlled by postsynaptic activity. Postsynaptic neurons activated by cholinergic and glutamatergic inputs generate carbon monoxide, which acts as a retrograde messenger inducing presynaptic DA release. Released DA is required for memory-associated plasticity. Our work identifies a novel mechanism that restricts DA release to the specific postsynaptic sites that require DA during memory formation.