Heterosynaptic Plasticity Underlies Aversive Olfactory Learning in Drosophila

Hierarchical architecture of dopaminergic circuits enables second-order conditioning in Drosophila

Dopaminergic neurons with distinct projection patterns and physiological properties compose memory subsystems in a brain. However, it is poorly understood whether or how they interact during complex learning. Here, we identify a feedforward circuit formed between dopamine subsystems and show that it is essential for second-order conditioning, an ethologically important form of higher-order associative learning. The Drosophila mushroom body comprises a series of dopaminergic compartments, each of which exhibits distinct memory dynamics. We find that a slow and stable memory compartment can serve as an effective 'teacher' by instructing other faster and transient memory compartments via a single key interneuron, which we identify by connectome analysis and neurotransmitter prediction. This excitatory interneuron acquires enhanced response to reward-predicting odor after first-order conditioning and, upon activation, evokes dopamine release in the 'student' compartments. These hierarchical connections between dopamine subsystems explain distinct properties of first- and second-order memory long known by behavioral psychologists.

Sleep benefits different stages of memory in Drosophila

Understanding the physiological mechanisms that modulate memory acquisition and consolidation remains among the most ambitious questions in neuroscience. Massive efforts have been dedicated to deciphering how experience affects behavior, and how different physiological and sensory phenomena modulate memory. Our ability to encode, consolidate and retrieve memories depends on internal drives, and sleep stands out among the physiological processes that affect memory: one of the most relatable benefits of sleep is the aiding of memory that occurs in order to both prepare the brain to learn new information, and after a learning task, to consolidate those new memories. Drosophila lends itself to the study of the interactions between memory and sleep. The fruit fly provides incomparable genetic resources, a mapped connectome, and an existing framework of knowledge on the molecular, cellular, and circuit mechanisms of memory and sleep, making the fruit fly a remarkable model to decipher the sophisticated regulation of learning and memory by the quantity and quality of sleep. Research in Drosophila has stablished not only that sleep facilitates learning in wild-type and memory-impaired animals, but that sleep deprivation interferes with the acquisition of new memories. In addition, it is well-accepted that sleep is paramount in memory consolidation processes. Finally, studies in Drosophila have shown that that learning itself can promote sleep drive. Nevertheless, the molecular and network mechanisms underlying this intertwined relationship are still evasive. Recent remarkable work has shed light on the neural substrates that mediate sleep-dependent memory consolidation. In a similar way, the mechanistic insights of the neural switch control between sleep-dependent and sleep-independent consolidation strategies were recently described. This review will discuss the regulation of memory by sleep in Drosophila, focusing on the most recent advances in the field and pointing out questions awaiting to be investigated.

Locomotor and olfactory responses in dopamine neurons of the Drosophila superior-lateral brain

The Drosophila brain contains about 50 distinct morphological types of dopamine neurons.^1,2,3,4 Physiological studies of Drosophila dopamine neurons have been largely limited to one brain region, the mushroom body,^{5,6,7,8,9,10,11,12,13} where they are implicated in learning.^{14,15,16,17,18} By comparison, we know little about the physiology of other Drosophila dopamine neurons. Interestingly, a recent whole-brain imaging study found that dopamine neuron activity in several fly brain regions is correlated with locomotion.¹⁹ This is notable because many dopamine neurons in the rodent brain are also correlated with locomotion or other movements^{20,21,22,23,24,25,26,27,28,29,30}; however, most rodent studies have focused on learned and rewarded behaviors, and few have investigated dopamine neuron activity during spontaneous (self-timed) movements. In this study, we monitored dopamine neurons in the Drosophila brain during self-timed locomotor movements, focusing on several previously uncharacterized cell types that arborize in the superior-lateral brain, specifically the lateral horn and superior-lateral protocerebrum. We found that activity of all of these dopamine neurons correlated with spontaneous fluctuations in walking speed, with different cell types showing different speed correlations. Some dopamine neurons also responded to odors, but these responses were suppressed by repeated odor encounters. Finally, we found that the same identifiable dopamine neuron can encode different combinations of locomotion and odor in different individuals. If these dopamine neurons promote synaptic plasticity-like the dopamine neurons of the mushroom body-then, their tuning profiles would imply that plasticity depends on a flexible integration of sensory signals, motor signals, and recent experience.

Dopamine promotes head direction plasticity during orienting movements

In neural networks that store information in their connection weights, there is a tradeoff between sensitivity and stability1,2. Connections must be plastic to incorporate new information, but if they are too plastic, stored information can be corrupted. A potential solution is to allow plasticity only during epochs when task-specific information is rich, on the basis of a 'when-to-learn' signal3. We reasoned that dopamine provides a when-to-learn signal that allows the brain's spatial maps to update when new spatial information is available-that is, when an animal is moving. Here we show that the dopamine neurons innervating the Drosophila head direction network are specifically active when the fly turns to change its head direction. Moreover, their activity scales with moment-to-moment fluctuations in rotational speed. Pairing dopamine release with a visual cue persistently strengthens the cue's influence on head direction cells. Conversely, inhibiting these dopamine neurons decreases the influence of the cue. This mechanism should accelerate learning during moments when orienting movements are providing a rich stream of head direction information, allowing learning rates to be low at other times to protect stored information. Our results show how spatial learning in the brain can be compressed into discrete epochs in which high learning rates are matched to high rates of information intake.

Transient active zone remodeling in the Drosophila mushroom body supports memory

Elucidating how the distinct components of synaptic plasticity dynamically orchestrate the distinct stages of memory acquisition and maintenance within neuronal networks remains a major challenge. Specifically, plasticity processes tuning the functional and also structural state of presynaptic active zone (AZ) release sites are widely observed in vertebrates and invertebrates, but their behavioral relevance remains mostly unclear. We here provide evidence that a transient upregulation of presynaptic AZ release site proteins supports aversive olfactory mid-term memory in the Drosophila mushroom body (MB). Upon paired aversive olfactory conditioning, AZ protein levels (ELKS-family BRP/(m)unc13-family release factor Unc13A) increased for a few hours with MB-lobe-specific dynamics. Kenyon cell (KC, intrinsic MB neurons)-specific knockdown (KD) of BRP did not affect aversive olfactory short-term memory (STM) but strongly suppressed aversive mid-term memory (MTM). Different proteins crucial for the transport of AZ biosynthetic precursors (transport adaptor Aplip1/Jip-1; kinesin motor IMAC/Unc104; small GTPase Arl8) were also specifically required for the formation of aversive olfactory MTM. Consistent with the merely transitory increase of AZ proteins, BRP KD did not interfere with the formation of aversive olfactory long-term memory (LTM; i.e., 1 day). Our data suggest that the remodeling of presynaptic AZ refines the MB circuitry after paired aversive conditioning, over a time window of a few hours, to display aversive olfactory memories.

Input-timing-dependent plasticity at incoming synapses of the mushroom body facilitates olfactory learning in Drosophila

Aversive olfactory conditioning in Drosophila is a valuable model for elucidating the mechanism of associative learning. Much effort has centered around the role of neuroplasticity at the mushroom body (MB)-mushroom body output neuron (MBON) synapses in mapping odors to specific behaviors. By electrophysiological recordings from MB neurons, we discovered a form of input-timing-dependent plasticity at the incoming synapses from projection neurons that controls the efficacy of aversive olfactory memory formation. Importantly, this plasticity is facilitated by the neural activity of PPL1, the neuronal cluster that also modulates MB-MBON connections at the output stage of MB. Unlike the MB-MBON synapses that probably utilize dopamine D1-like receptors, this neuroplasticity is dependent on D2-like receptors that are expressed mainly by γ Kenyon cells noticeably in their somato-dendritic region. The D2-like receptors recruit voltage-gated calcium channels, leading to calcium influx in the soma and dendrites of γ neurons. Together, our results reveal a previously unrecognized synaptic component of the MB circuit architecture that not only could increase the salience of a conditioning odor but also couples the process of memory encoding and valency mapping to drive-associative learning.

Lateral axonal modulation is required for stimulus-specific olfactory conditioning in Drosophila

Effective and stimulus-specific learning is essential for animals' survival. Two major mechanisms are known to aid stimulus specificity of associative learning. One is accurate stimulus-specific representations in neurons. The second is a limited effective temporal window for the reinforcing signals to induce neuromodulation after sensory stimuli. However, these mechanisms are often imperfect in preventing unspecific associations; different sensory stimuli can be represented by overlapping populations of neurons, and more importantly, the reinforcing signals alone can induce neuromodulation even without coincident sensory-evoked neuronal activity. Here, we report a crucial neuromodulatory mechanism that counteracts both limitations and is thereby essential for stimulus specificity of learning. In Drosophila, olfactory signals are sparsely represented by cholinergic Kenyon cells (KCs), which receive dopaminergic reinforcing input. We find that KCs have numerous axo-axonic connections mediated by the muscarinic type-B receptor (mAChR-B). By using functional imaging and optogenetic approaches, we show that these axo-axonic connections suppress both odor-evoked calcium responses and dopamine-evoked cAMP signals in neighboring KCs. Strikingly, behavior experiments demonstrate that mAChR-B knockdown in KCs impairs olfactory learning by inducing undesired changes to the valence of an odor that was not associated with the reinforcer. Thus, this local neuromodulation acts in concert with sparse sensory representations and global dopaminergic modulation to achieve effective and accurate memory formation.

A neural theory for counting memories

Keeping track of the number of times different stimuli have been experienced is a critical computation for behavior. Here, we propose a theoretical two-layer neural circuit that stores counts of stimulus occurrence frequencies. This circuit implements a data structure, called a count sketch, that is commonly used in computer science to maintain item frequencies in streaming data. Our first model implements a count sketch using Hebbian synapses and outputs stimulus-specific frequencies. Our second model uses anti-Hebbian plasticity and only tracks frequencies within four count categories ("1-2-3-many"), which trades-off the number of categories that need to be distinguished with the potential ethological value of those categories. We show how both models can robustly track stimulus occurrence frequencies, thus expanding the traditional novelty-familiarity memory axis from binary to discrete with more than two possible values. Finally, we show that an implementation of the "1-2-3-many" count sketch exists in the insect mushroom body.

Higher-order unimodal olfactory sensory preconditioning in Drosophila

Learning and memory storage is a complex process that has proven challenging to tackle. It is likely that, in nature, the instructive value of reinforcing experiences is acquired rather than innate. The association between seemingly neutral stimuli increases the gamut of possibilities to create meaningful associations and the predictive power of moment-by-moment experiences. Here, we report physiological and behavioral evidence of olfactory unimodal sensory preconditioning in fruit flies. We show that the presentation of a pair of odors (S1 and S2) before one of them (S1) is associated with electric shocks elicits a conditional response not only to the trained odor (S1) but to the odor previously paired with it (S2). This occurs even if the S2 odor was never presented in contiguity with the aversive stimulus. In addition, we show that inhibition of the small G protein Rac1, a known forgetting regulator, facilitates the association between S1/S2 odors. These results indicate that flies can infer value to olfactory stimuli based on the previous associative structure between odors, and that inhibition of Rac1 lengthens the time window of the olfactory 'sensory buffer', allowing the establishment of associations between odors presented in sequence.

Active forgetting requires Sickie function in a dedicated dopamine circuit in Drosophila

Forgetting is an essential component of the brain's memory management system, providing a balance to memory formation processes by removing unused or unwanted memories, or by suppressing their expression. However, the molecular, cellular, and circuit mechanisms underlying forgetting are poorly understood. Here we show that the memory suppressor gene, sickie, functions in a single dopamine neuron (DAn) by supporting the process of active forgetting in Drosophila. RNAi knockdown (KD) of sickie impairs forgetting by reducing the Ca²⁺ influx and DA release from the DAn that promotes forgetting. Coimmunoprecipitation/mass spectrometry analyses identified cytoskeletal and presynaptic active zone (AZ) proteins as candidates that physically interact with Sickie, and a focused RNAi screen of the candidates showed that Bruchpilot (Brp)-a presynaptic AZ protein that regulates calcium channel clustering and neurotransmitter release-impairs active forgetting like sickie KD. In addition, overexpression of brp rescued the impaired forgetting of sickie KD, providing evidence that they function in the same process. Moreover, we show that sickie KD in the DAn reduces the abundance and size of AZ markers but increases their number, suggesting that Sickie controls DAn activity for forgetting by modulating the presynaptic AZ structure. Our results identify a molecular and circuit mechanism for normal levels of active forgetting and reveal a surprising role of Sickie in maintaining presynaptic AZ structure for neurotransmitter release.

Pruning deficits of the developing Drosophila mushroom body result in mild impairment in associative odour learning and cause hyperactivity

The principles of how brain circuits establish themselves during development are largely conserved across animal species. Connections made during embryonic development that are appropriate for an early life stage are frequently remodelled later in ontogeny via pruning and subsequent regrowth to generate adult-specific connectivity. The mushroom body of the fruit fly Drosophila melanogaster is a well-established model circuit for examining the cellular mechanisms underlying neurite remodelling. This central brain circuit integrates sensory information with learned and innate valences to adaptively instruct behavioural decisions. Thereby, the mushroom body organizes adaptive behaviour, such as associative learning. However, little is known about the specific aspects of behaviour that require mushroom body remodelling. Here, we used genetic interventions to prevent the intrinsic neurons of the larval mushroom body (γ-type Kenyon cells) from remodelling. We asked to what degree remodelling deficits resulted in impaired behaviour. We found that deficits caused hyperactivity and mild impairment in differential aversive olfactory learning, but not appetitive learning. Maintenance of circadian rhythm and sleep were not affected. We conclude that neurite pruning and regrowth of γ-type Kenyon cells is not required for the establishment of circuits that mediate associative odour learning per se, but it does improve distinct learning tasks.

A neural circuit for wind-guided olfactory navigation

To navigate towards a food source, animals frequently combine odor cues about source identity with wind direction cues about source location. Where and how these two cues are integrated to support navigation is unclear. Here we describe a pathway to the Drosophila fan-shaped body that encodes attractive odor and promotes upwind navigation. We show that neurons throughout this pathway encode odor, but not wind direction. Using connectomics, we identify fan-shaped body local neurons called h∆C that receive input from this odor pathway and a previously described wind pathway. We show that h∆C neurons exhibit odor-gated, wind direction-tuned activity, that sparse activation of h∆C neurons promotes navigation in a reproducible direction, and that h∆C activity is required for persistent upwind orientation during odor. Based on connectome data, we develop a computational model showing how h∆C activity can promote navigation towards a goal such as an upwind odor source. Our results suggest that odor and wind cues are processed by separate pathways and integrated within the fan-shaped body to support goal-directed navigation.

Not so spontaneous: Multi-dimensional representations of behaviors and context in sensory areas

Sensory areas are spontaneously active in the absence of sensory stimuli. This spontaneous activity has long been studied; however, its functional role remains largely unknown. Recent advances in technology, allowing large-scale neural recordings in the awake and behaving animal, have transformed our understanding of spontaneous activity. Studies using these recordings have discovered high-dimensional spontaneous activity patterns, correlation between spontaneous activity and behavior, and dissimilarity between spontaneous and sensory-driven activity patterns. These findings are supported by evidence from developing animals, where a transition toward these characteristics is observed as the circuit matures, as well as by evidence from mature animals across species. These newly revealed characteristics call for the formulation of a new role for spontaneous activity in neural sensory computation.

Visualization of learning-induced synaptic plasticity in output neurons of the Drosophila mushroom body γ-lobe

By learning, through experience, which stimuli coincide with dangers, it is possible to predict outcomes and act pre-emptively to ensure survival. In insects, this process is localized to the mushroom body (MB), the circuitry of which facilitates the coincident detection of sensory stimuli and punishing or rewarding cues and, downstream, the execution of appropriate learned behaviors. Here, we focused our attention on the mushroom body output neurons (MBONs) of the γ-lobes that act as downstream synaptic partners of the MB γ-Kenyon cells (KCs) to ask how the output of the MB γ-lobe is shaped by olfactory associative conditioning, distinguishing this from non-associative stimulus exposure effects, and without the influence of downstream modulation. This was achieved by employing a subcellularly localized calcium sensor to specifically monitor activity at MBON postsynaptic sites. Therein, we identified a robust associative modulation within only one MBON postsynaptic compartment (MBON-γ1pedc > α/β), which displayed a suppressed postsynaptic response to an aversively paired odor. While this MBON did not undergo non-associative modulation, the reverse was true across the remainder of the γ-lobe, where general odor-evoked adaptation was observed, but no conditioned odor-specific modulation. In conclusion, associative synaptic plasticity underlying aversive olfactory learning is localized to one distinct synaptic γKC-to-γMBON connection.

Age-related memory vulnerability to interfering stimuli is caused by gradual loss of MAPK-dependent protection in Drosophila

Age‐related memory impairment (AMI) is a common phenomenon across species. Vulnerability to interfering stimuli has been proposed to be an important cause of AMI. However, the molecular mechanisms underlying this vulnerability‐related AMI remain unknown. Here we show that learning‐activated MAPK signals are gradually lost with age, leading to vulnerability‐related AMI in Drosophila. Young flies (2‐ or 3‐day‐old) exhibited a significant increase in phosphorylated MAPK levels within 15 min after learning, whereas aged flies (25‐day‐old) did not. Compared to 3‐day‐old flies, significant 1 h memory impairments were observed in 15‐, 20‐, and 30‐day‐old flies, but not in 10‐day‐old flies. However, with post‐learning interfering stimuli such as cooling or electric stimuli, 10‐day‐old flies had worse memory performance at 1 h than 3‐day‐old flies, showing a premature AMI phenomenon. Increasing learning‐activated MAPK signals through acute transgene expression in mushroom body (MB) neurons restored physiological trace of 1 h memory in a pair of MB output neurons in aged flies. Decreasing such signals in young flies mimicked the impairment of 1 h memory trace in aged flies. Restoring learning‐activated MAPK signals in MB neurons in aged flies significantly suppressed AMI even with interfering stimuli. Thus, our data suggest that age‐related loss of learning‐activated neuronal MAPK signals causes memory vulnerability to interfering stimuli, thereby leading to AMI.

Pairing-Dependent Plasticity in a Dissected Fly Brain Is Input-Specific and Requires Synaptic CaMKII Enrichment and Nighttime Sleep

In Drosophila, in vivo functional imaging studies revealed that associative memory formation is coupled to a cascade of neural plasticity events in distinct compartments of the mushroom body (MB). In-depth investigation of the circuit dynamics, however, will require an ex vivo model that faithfully mirrors these events to allow direct manipulations of circuit elements that are inaccessible in the intact fly. The current ex vivo models have been able to reproduce the fundamental plasticity of aversive short-term memory, a potentiation of the MB intrinsic neuron (Kenyon cells [KCs]) responses after artificial learning ex vivo However, this potentiation showed different localization and encoding properties from those reported in vivo and failed to generate the previously reported suppression plasticity in the MB output neurons (MBONs). Here, we develop an ex vivo model using the female Drosophila brain that recapitulates behaviorally evoked plasticity in the KCs and MBONs. We demonstrate that this plasticity accurately localizes to the MB α'3 compartment and is encoded by a coincidence between KC activation and dopaminergic input. The formed plasticity is input-specific, requiring pairing of the conditioned stimulus and unconditioned stimulus pathways; hence, we name it pairing-dependent plasticity. Pairing-dependent plasticity formation requires an intact CaMKII gene and is blocked by previous-night sleep deprivation but is rescued by rebound sleep. In conclusion, we show that our ex vivo preparation recapitulates behavioral and imaging results from intact animals and can provide new insights into mechanisms of memory formation at the level of molecules, circuits, and brain state.SIGNIFICANCE STATEMENT The mammalian ex vivo LTP model enabled in-depth investigation of the hippocampal memory circuit. We develop a parallel model to study the Drosophila mushroom body (MB) memory circuit. Pairing activation of the conditioned stimulus and unconditioned stimulus pathways in dissected brains induces a potentiation pairing-dependent plasticity (PDP) in the axons of α'β' Kenyon cells and a suppression PDP in the dendrites of their postsynaptic MB output neurons, localized in the MB α'3 compartment. This PDP is input-specific and requires the 3' untranslated region of CaMKII Interestingly, ex vivo PDP carries information about the animal's experience before dissection; brains from sleep-deprived animals fail to form PDP, whereas those from animals who recovered 2 h of their lost sleep form PDP.

Optogenetic and thermogenetic manipulation of defined neural circuits and behaviors in Drosophila

Neural network dynamics underlying flexible animal behaviors remain elusive. The fruit fly Drosophila melanogaster is considered an excellent model in behavioral neuroscience because of its simple neuroanatomical architecture and the availability of various genetic methods. Moreover, Drosophila larvae's transparent body allows investigators to use optical methods on freely moving animals, broadening research directions. Activating or inhibiting well-defined events in excitable cells with a fine temporal resolution using optogenetics and thermogenetics led to the association of functions of defined neural populations with specific behavioral outputs such as the induction of associative memory. Furthermore, combining optogenetics and thermogenetics with state-of-the-art approaches, including connectome mapping and machine learning-based behavioral quantification, might provide a complete view of the experience- and time-dependent variations of behavioral responses. These methodologies allow further understanding of the functional connections between neural circuits and behaviors such as chemosensory, motivational, courtship, and feeding behaviors and sleep, learning, and memory.

An incentive circuit for memory dynamics in the mushroom body of Drosophila melanogaster

Insects adapt their response to stimuli, such as odours, according to their pairing with positive or negative reinforcements, such as sugar or shock. Recent electrophysiological and imaging findings in Drosophila melanogaster allow detailed examination of the neural mechanisms supporting the acquisition, forgetting, and assimilation of memories. We propose that this data can be explained by the combination of a dopaminergic plasticity rule that supports a variety of synaptic strength change phenomena, and a circuit structure (derived from neuroanatomy) between dopaminergic and output neurons that creates different roles for specific neurons. Computational modelling shows that this circuit allows for rapid memory acquisition, transfer from short term to long term, and exploration/exploitation trade-off. The model can reproduce the observed changes in the activity of each of the identified neurons in conditioning paradigms and can be used for flexible behavioural control.

Developmental and evolutionary constraints on olfactory circuit selection

SignificanceIn this work, we explore the hypothesis that biological neural networks optimize their architecture, through evolution, for learning. We study early olfactory circuits of mammals and insects, which have relatively similar structure but a huge diversity in size. We approximate these circuits as three-layer networks and estimate, analytically, the scaling of the optimal hidden-layer size with input-layer size. We find that both longevity and information in the genome constrain the hidden-layer size, so a range of allometric scalings is possible. However, the experimentally observed allometric scalings in mammals and insects are consistent with biologically plausible values. This analysis should pave the way for a deeper understanding of both biological and artificial networks.

Associative learning drives longitudinally graded presynaptic plasticity of neurotransmitter release along axonal compartments

Anatomical and physiological compartmentalization of neurons is a mechanism to increase the computational capacity of a circuit, and a major question is what role axonal compartmentalization plays. Axonal compartmentalization may enable localized, presynaptic plasticity to alter neuronal output in a flexible, experience-dependent manner. Here, we show that olfactory learning generates compartmentalized, bidirectional plasticity of acetylcholine release that varies across the longitudinal compartments of Drosophila mushroom body (MB) axons. The directionality of the learning-induced plasticity depends on the valence of the learning event (aversive vs. appetitive), varies linearly across proximal to distal compartments following appetitive conditioning, and correlates with learning-induced changes in downstream mushroom body output neurons (MBONs) that modulate behavioral action selection. Potentiation of acetylcholine release was dependent on the CaV2.1 calcium channel subunit cacophony. In addition, contrast between the positive conditioned stimulus and other odors required the inositol triphosphate receptor, which maintained responsivity to odors upon repeated presentations, preventing adaptation. Downstream from the MB, a set of MBONs that receive their input from the γ3 MB compartment were required for normal appetitive learning, suggesting that they represent a key node through which reward learning influences decision-making. These data demonstrate that learning drives valence-correlated, compartmentalized, bidirectional potentiation, and depression of synaptic neurotransmitter release, which rely on distinct mechanisms and are distributed across axonal compartments in a learning circuit.

Mating-driven variability in olfactory local interneuron wiring

Variations in neuronal connectivity occur widely in nervous systems from invertebrates to mammals. Yet, it is unclear how neuronal variability originates, to what extent and at what time scales it exists, and what functional consequences it might carry. To assess inter- and intraindividual neuronal variability, it would be ideal to analyze the same identified neuron across different brain hemispheres and individuals. Here, using genetic labeling and electron microscopy connectomics, we show that an identified inhibitory olfactory local interneuron, TC-LN, exhibits extraordinary variability in its glomerular innervation patterns. Moreover, TC-LN's innervation of the VL2a glomerulus, which processes food signals and modulates mating behavior, is sexually dimorphic, is influenced by female's courtship experience, and correlates with food intake in mated females. Mating also affects output connectivity of TC-LN to specific local interneurons. We propose that mating-associated variability of TC-LNs regulates how food odor is interpreted by an inhibitory network to modulate feeding.

Connectomic features underlying diverse synaptic connection strengths and subcellular computation

Connectomes generated from electron microscopy images of neural tissue unveil the complex morphology of every neuron and the locations of every synapse interconnecting them. These wiring diagrams may also enable inference of synaptic and neuronal biophysics, such as the functional weights of synaptic connections, but this requires integration with physiological data to properly parameterize. Working with a stereotyped olfactory network in the Drosophila brain, we make direct comparisons of the anatomy and physiology of diverse neurons and synapses with subcellular and subthreshold resolution. We find that synapse density and location jointly predict the amplitude of the somatic postsynaptic potential evoked by a single presynaptic spike. Biophysical models fit to data predict that electrical compartmentalization allows axon and dendrite arbors to balance independent and interacting computations. These findings begin to fill the gap between connectivity maps and activity maps, which should enable new hypotheses about how network structure constrains network function.

Idiosyncratic learning performance in flies

Individuals vary in their innate behaviours, even when they have the same genome and have been reared in the same environment. The extent of individuality in plastic behaviours, like learning, is less well characterized. Also unknown is the extent to which intragenotypic differences in learning generalize: if an individual performs well in one assay, will it perform well in other assays? We investigated this using the fruit fly Drosophila melanogaster, an organism long-used to study the mechanistic basis of learning and memory. We found that isogenic flies, reared in identical laboratory conditions, and subject to classical conditioning that associated odorants with electric shock, exhibit clear individuality in their learning responses. Flies that performed well when an odour was paired with shock tended to perform well when the odour was paired with bitter taste or when other odours were paired with shock. Thus, individuality in learning performance appears to be prominent in isogenic animals reared identically, and individual differences in learning performance generalize across some aversive sensory modalities. Establishing these results in flies opens up the possibility of studying the genetic and neural circuit basis of individual differences in learning in a highly suitable model organism.

Roles for Sleep in Neural and Behavioral Plasticity: Reviewing Variation in the Consequences of Sleep Loss

Sleep is a vital physiological state that has been broadly conserved across the evolution of animal species. While the precise functions of sleep remain poorly understood, a large body of research has examined the negative consequences of sleep loss on neural and behavioral plasticity. While sleep disruption generally results in degraded neural plasticity and cognitive function, the impact of sleep loss can vary widely with age, between individuals, and across physiological contexts. Additionally, several recent studies indicate that sleep loss differentially impacts distinct neuronal populations within memory-encoding circuitry. These findings indicate that the negative consequences of sleep loss are not universally shared, and that identifying conditions that influence the resilience of an organism (or neuron type) to sleep loss might open future opportunities to examine sleep's core functions in the brain. Here, we discuss the functional roles for sleep in adaptive plasticity and review factors that can contribute to individual variations in sleep behavior and responses to sleep loss.

Neural Circuits Underlying Behavioral Flexibility: Insights From Drosophila

Behavioral flexibility is critical to survival. Animals must adapt their behavioral responses based on changes in the environmental context, internal state, or experience. Studies in Drosophila melanogaster have provided insight into the neural circuit mechanisms underlying behavioral flexibility. Here we discuss how Drosophila behavior is modulated by internal and behavioral state, environmental context, and learning. We describe general principles of neural circuit organization and modulation that underlie behavioral flexibility, principles that are likely to extend to other species.

Postsynaptic plasticity of cholinergic synapses underlies the induction and expression of appetitive and familiarity memories in Drosophila

In vertebrates, several forms of memory-relevant synaptic plasticity involve postsynaptic rearrangements of glutamate receptors. In contrast, previous work indicates that Drosophila and other invertebrates store memories using presynaptic plasticity of cholinergic synapses. Here, we provide evidence for postsynaptic plasticity at cholinergic output synapses from the Drosophila mushroom bodies (MBs). We find that the nicotinic acetylcholine receptor (nAChR) subunit α5 is required within specific MB output neurons for appetitive memory induction but is dispensable for aversive memories. In addition, nAChR α2 subunits mediate memory expression and likely function downstream of α5 and the postsynaptic scaffold protein discs large (Dlg). We show that postsynaptic plasticity traces can be induced independently of the presynapse, and that in vivo dynamics of α2 nAChR subunits are changed both in the context of associative and non-associative (familiarity) memory formation, underlying different plasticity rules. Therefore, regardless of neurotransmitter identity, key principles of postsynaptic plasticity support memory storage across phyla.

A non-canonical on-demand dopaminergic transmission underlying olfactory aversive learning

Dopamine (DA) is involved in various brain functions including associative learning. However, it is unclear how a small number of DA neurons appropriately regulates various brain functions. DA neurons have a large number of release sites and release DA non-specifically to a large number of target neurons in the projection area in response to the activity of DA neurons. In contrast to this "broad transmission", recent studies in Drosophila ex vivo functional imaging studies have identified "on-demand transmission" that occurs independent on activity of DA neurons and releases DA specifically onto the target neurons that have produced carbon monoxide (CO) as a retrograde signal for DA release. Whereas broad transmission modulates the global function of the target area, on-demand transmission is suitable for modulating the function of specific circuits, neurons, or synapses. In Drosophila olfactory aversive conditioning, odor and shock information are associated in the brain region called mushroom body (MB) to form olfactory aversive memory. It has been suggested that DA neurons projecting to the MB mediate the transmission of shock information and reinforcement simultaneously. However, the circuit model based on on-demand transmission proposes that transmission of shock information and reinforcement are mediated by distinct neural mechanisms; while shock transmission is glutamatergic, DA neurons mediates reinforcement. On-demand transmission provides mechanical insights into how DA neurons regulate various brain functions.

Neuropeptide F inhibits dopamine neuron interference of long-term memory consolidation in Drosophila

Long-term memory (LTM) formation requires consolidation processes to overcome interfering signals that erode memory formation. Olfactory memory in Drosophila involves convergent projection neuron (PN; odor) and dopaminergic neuron (DAN; reinforcement) input to the mushroom body (MB). How post-training DAN activity in the posterior lateral protocerebrum (PPL1) continues to regulate memory consolidation remains unknown. Here we address this question using targeted transgenes in behavior and electrophysiology experiments to show that (1) persistent post-training activity of PPL1-α2α'2 and PPL1-α3 DANs interferes with aversive LTM formation; (2) neuropeptide F (NPF) signaling blocks this interference in PPL1-α2α'2 and PPL1-α3 DANs after spaced training to enable LTM formation; and (3) training-induced NPF release and neurotransmission from two upstream dorsal-anterior-lateral (DAL2) neurons are required to form LTM. Thus, NPF signals from DAL2 neurons to specific PPL1 DANs disinhibit the memory circuit, ensuring that periodic events are remembered as consolidated LTM.

Compensatory variability in network parameters enhances memory performance in the Drosophila mushroom body

Neural circuits use homeostatic compensation to achieve consistent behavior despite variability in underlying intrinsic and network parameters. However, it remains unclear how compensation regulates variability across a population of the same type of neurons within an individual and what computational benefits might result from such compensation. We address these questions in the Drosophila mushroom body, the fly's olfactory memory center. In a computational model, we show that under sparse coding conditions, memory performance is degraded when the mushroom body's principal neurons, Kenyon cells (KCs), vary realistically in key parameters governing their excitability. However, memory performance is rescued while maintaining realistic variability if parameters compensate for each other to equalize KC average activity. Such compensation can be achieved through both activity-dependent and activity-independent mechanisms. Finally, we show that correlations predicted by our model's compensatory mechanisms appear in the Drosophila hemibrain connectome. These findings reveal compensatory variability in the mushroom body and describe its computational benefits for associative memory.

Serotonin Signals Modulate Mushroom Body Output Neurons for Sustaining Water-Reward Long-Term Memory in Drosophila

Memory consolidation is a time-dependent process through which an unstable learned experience is transformed into a stable long-term memory; however, the circuit and molecular mechanisms underlying this process are poorly understood. The Drosophila mushroom body (MB) is a huge brain neuropil that plays a crucial role in olfactory memory. The MB neurons can be generally classified into three subsets: γ, αβ, and α′β′. Here, we report that water-reward long-term memory (wLTM) consolidation requires activity from α′β′-related mushroom body output neurons (MBONs) in a specific time window. wLTM consolidation requires neurotransmission in MBON-γ3β′1 during the 0–2 h period after training, and neurotransmission in MBON-α′2 is required during the 2–4 h period after training. Moreover, neurotransmission in MBON-α′1α′3 is required during the 0–4 h period after training. Intriguingly, blocking neurotransmission during consolidation or inhibiting serotonin biosynthesis in serotoninergic dorsal paired medial (DPM) neurons also disrupted the wLTM, suggesting that wLTM consolidation requires serotonin signals from DPM neurons. The GFP Reconstitution Across Synaptic Partners (GRASP) data showed the connectivity between DPM neurons and MBON-γ3β′1, MBON-α′2, and MBON-α′1α′3, and RNAi-mediated silencing of serotonin receptors in MBON-γ3β′1, MBON-α′2, or MBON-α′1α′3 disrupted wLTM. Taken together, our results suggest that serotonin released from DPM neurons modulates neuronal activity in MBON-γ3β′1, MBON-α′2, and MBON-α′1α′3 at specific time windows, which is critical for the consolidation of wLTM in Drosophila.

Decision making: An analogue implementation of a drift-diffusion computation in the Drosophila mushroom body

A new study combines electrophysiology, optogenetics, and behavior to investigate a decision-making circuit in the fly brain, revealing all the major features predicted by drift-diffusion models. Strikingly, much of this computation takes place subthreshold, independent of action potentials.

Response competition between neurons and antineurons in the mushroom body

The mushroom bodies of Drosophila contain circuitry compatible with race models of perceptual choice. When flies discriminate odor intensity differences, opponent pools of αβ core Kenyon cells (on and off αβ_c KCs) accumulate evidence for increases or decreases in odor concentration. These sensory neurons and “antineurons” connect to a layer of mushroom body output neurons (MBONs) which bias behavioral intent in opposite ways. All-to-all connectivity between the competing integrators and their MBON partners allows for correct and erroneous decisions; dopaminergic reinforcement sets choice probabilities via reciprocal changes to the efficacies of on and off KC synapses; and pooled inhibition between αβ_c KCs can establish equivalence with the drift-diffusion formalism known to describe behavioral performance. The response competition network gives tangible form to many features envisioned in theoretical models of mammalian decision making, but it differs from these models in one respect: the principal variables—the fill levels of the integrators and the strength of inhibition between them—are represented by graded potentials rather than spikes. In pursuit of similar computational goals, a small brain may thus prioritize the large information capacity of analog signals over the robustness and temporal processing span of pulsatile codes.

•

Mushroom body output neurons respond with excitation to odor on- and offset

•

On and off responses reflect the convergence of oppositely tuned Kenyon cells (KCs)

•

Opponent KCs compete by eliciting inhibitory feedback from a common interneuron pool

•

KCs and interneurons communicate through graded potentials rather than spikes

Circuits for integrating learned and innate valences in the insect brain

Animal behavior is shaped both by evolution and by individual experience. Parallel brain pathways encode innate and learned valences of cues, but the way in which they are integrated during action-selection is not well understood. We used electron microscopy to comprehensively map with synaptic resolution all neurons downstream of all mushroom body (MB) output neurons (encoding learned valences) and characterized their patterns of interaction with lateral horn (LH) neurons (encoding innate valences) in Drosophila larva. The connectome revealed multiple convergence neuron types that receive convergent MB and LH inputs. A subset of these receives excitatory input from positive-valence MB and LH pathways and inhibitory input from negative-valence MB pathways. We confirmed functional connectivity from LH and MB pathways and behavioral roles of two of these neurons. These neurons encode integrated odor value and bidirectionally regulate turning. Based on this, we speculate that learning could potentially skew the balance of excitation and inhibition onto these neurons and thereby modulate turning. Together, our study provides insights into the circuits that integrate learned and innate valences to modify behavior.

A connectome is not enough - what is still needed to understand the brain of Drosophila?

Understanding the structure and operation of any nervous system has been a subject of research for well over a century. A near-term opportunity in this quest is to understand the brain of a model species, the fruit fly Drosophila melanogaster. This is an enticing target given its relatively small size (roughly 200,000 neurons), coupled with the behavioral richness that this brain supports, and the wide variety of techniques now available to study both brain and behavior. It is clear that within a few years we will possess a connectome for D. melanogaster: an electron-microscopy-level description of all neurons and their chemical synaptic connections. Given what we will soon have, what we already know and the research that is currently underway, what more do we need to know to enable us to understand the fly's brain? Here, we itemize the data we will need to obtain, collate and organize in order to build an integrated model of the brain of D. melanogaster.

Context-dependent representations of movement in Drosophila dopaminergic reinforcement pathways

Dopamine plays a central role in motivating and modifying behavior, serving to invigorate current behavioral performance and guide future actions through learning. Here we examine how this single neuromodulator can contribute to such diverse forms of behavioral modulation. By recording from the dopaminergic reinforcement pathways of the Drosophila mushroom body during active odor navigation, we reveal how their ongoing motor-associated activity relates to goal-directed behavior. We found that dopaminergic neurons correlate with different behavioral variables depending on the specific navigational strategy of an animal, such that the activity of these neurons preferentially reflects the actions most relevant to odor pursuit. Furthermore, we show that these motor correlates are translated to ongoing dopamine release, and acutely perturbing dopaminergic signaling alters the strength of odor tracking. Context-dependent representations of movement and reinforcement cues are thus multiplexed within the mushroom body dopaminergic pathways, enabling them to coordinately influence both ongoing and future behavior.

Individual bitter-sensing neurons in Drosophila exhibit both ON and OFF responses that influence synaptic plasticity

The brain generates internal representations that translate sensory stimuli into appropriate behavior. In the taste system, different tastes activate distinct populations of sensory neurons. We investigated the temporal properties of taste responses in Drosophila and discovered that different types of taste sensory neurons show striking differences in their response dynamics. Strong responses to stimulus onset (ON responses) and offset (OFF responses) were observed in bitter-sensing neurons in the labellum, whereas bitter neurons in the leg and other classes of labellar taste neurons showed only an ON response. Individual labellar bitter neurons generate both ON and OFF responses through a cell-intrinsic mechanism that requires canonical bitter receptors. A single receptor complex likely generates both ON and OFF responses to a given bitter ligand. These ON and OFF responses in the periphery are propagated to dopaminergic neurons that mediate aversive learning, and the presence of the OFF response impacts synaptic plasticity when bitter is used as a reinforcement cue. These studies reveal previously unknown features of taste responses that impact neural circuit function and may be important for behavior. Moreover, these studies show that OFF responses can dramatically influence timing-based synaptic plasticity, which is thought to underlie associative learning.

A pair of dopamine neurons mediate chronic stress signals to induce learning deficit in Drosophila melanogaster

Chronic stress could induce severe cognitive impairments. Despite extensive investigations in mammalian models, the underlying mechanisms remain obscure. Here, we show that chronic stress could induce dramatic learning and memory deficits in Drosophila melanogaster The chronic stress-induced learning deficit (CSLD) is long lasting and associated with other depression-like behaviors. We demonstrated that excessive dopaminergic activity provokes susceptibility to CSLD. Remarkably, a pair of PPL1-γ1pedc dopaminergic neurons that project to the mushroom body (MB) γ1pedc compartment play a key role in regulating susceptibility to CSLD so that stress-induced PPL1-γ1pedc hyperactivity facilitates the development of CSLD. Consistently, the mushroom body output neurons (MBON) of the γ1pedc compartment, MBON-γ1pedc>α/β neurons, are important for modulating susceptibility to CSLD. Imaging studies showed that dopaminergic activity is necessary to provoke the development of chronic stress-induced maladaptations in the MB network. Together, our data support that PPL1-γ1pedc mediates chronic stress signals to drive allostatic maladaptations in the MB network that lead to CSLD.

Switch-like and persistent memory formation in individual Drosophila larvae

Associative learning allows animals to use past experience to predict future events. The circuits underlying memory formation support immediate and sustained changes in function, often in response to a single example. Larval Drosophila is a genetic model for memory formation that can be accessed at molecular, synaptic, cellular, and circuit levels, often simultaneously, but existing behavioral assays for larval learning and memory do not address individual animals, and it has been difficult to form long-lasting memories, especially those requiring synaptic reorganization. We demonstrate a new assay for learning and memory capable of tracking the changing preferences of individual larvae. We use this assay to explore how activation of a pair of reward neurons changes the response to the innately aversive gas carbon dioxide (CO2). We confirm that when coupled to CO2 presentation in appropriate temporal sequence, optogenetic reward reduces avoidance of CO2. We find that learning is switch-like: all-or-none and quantized in two states. Memories can be extinguished by repeated unrewarded exposure to CO2 but are stabilized against extinction by repeated training or overnight consolidation. Finally, we demonstrate long-lasting protein synthesis dependent and independent memory formation.

Compartment specific regulation of sleep by mushroom body requires GABA and dopaminergic signaling

Sleep is a fundamental behavioral state important for survival and is universal in animals with sufficiently complex nervous systems. As a highly conserved neurobehavioral state, sleep has been described in species ranging from jellyfish to humans. Biogenic amines like dopamine, serotonin and norepinephrine have been shown to be critical for sleep regulation across species but the precise circuit mechanisms underlying how amines control persistence of sleep, arousal and wakefulness remain unclear. The fruit fly, Drosophila melanogaster, provides a powerful model system for the study of sleep and circuit mechanisms underlying state transitions and persistence of states to meet the organisms motivational and cognitive needs. In Drosophila, two neuropils in the central brain, the mushroom body (MB) and the central complex (CX) have been shown to influence sleep homeostasis and receive aminergic neuromodulator input critical to sleep–wake switch. Dopamine neurons (DANs) are prevalent neuromodulator inputs to the MB but the mechanisms by which they interact with and regulate sleep- and wake-promoting neurons within MB are unknown. Here we investigate the role of subsets of PAM-DANs that signal wakefulness and project to wake-promoting compartments of the MB. We find that PAM-DANs are GABA responsive and require GABA_A-Rdl receptor in regulating sleep. In mapping the pathways downstream of PAM neurons innervating γ5 and β′2 MB compartments we find that wakefulness is regulated by both DopR1 and DopR2 receptors in downstream Kenyon cells (KCs) and mushroom body output neurons (MBONs). Taken together, we have identified and characterized a dopamine modulated sleep microcircuit within the mushroom body that has previously been shown to convey information about positive and negative valence critical for memory formation. These studies will pave way for understanding how flies balance sleep, wakefulness and arousal.

Architectures of neuronal circuits

[Figure: see text].

Models of heterogeneous dopamine signaling in an insect learning and memory center

The Drosophila mushroom body exhibits dopamine dependent synaptic plasticity that underlies the acquisition of associative memories. Recordings of dopamine neurons in this system have identified signals related to external reinforcement such as reward and punishment. However, other factors including locomotion, novelty, reward expectation, and internal state have also recently been shown to modulate dopamine neurons. This heterogeneity is at odds with typical modeling approaches in which these neurons are assumed to encode a global, scalar error signal. How is dopamine dependent plasticity coordinated in the presence of such heterogeneity? We develop a modeling approach that infers a pattern of dopamine activity sufficient to solve defined behavioral tasks, given architectural constraints informed by knowledge of mushroom body circuitry. Model dopamine neurons exhibit diverse tuning to task parameters while nonetheless producing coherent learned behaviors. Notably, reward prediction error emerges as a mode of population activity distributed across these neurons. Our results provide a mechanistic framework that accounts for the heterogeneity of dopamine activity during learning and behavior.

Dopamine neurons across the animal kingdom are involved in the formation of associative memories. While numerous studies have recorded activity in these neurons related to external and predicted rewards, the diversity of these neurons’ activity and their tuning to non-reward-related quantities such as novelty, movement, and internal state have proved challenging to account for in traditional modeling approaches. Using a well-characterized model system for learning and memory, the mushroom body of Drosophila fruit flies, Jiang and Litwin-Kumar provide an account of the diversity of signals across dopamine neurons. They show that models optimized to solve tasks like those encountered by flies exhibit heterogeneous activity across dopamine neurons, but nonetheless this activity is sufficient for the system to solve the tasks. The models will be useful to generate testable hypotheses about dopamine neuron activity across different experimental conditions.

Sleep deprivation results in diverse patterns of synaptic scaling across the Drosophila mushroom bodies

Sleep is essential for a variety of plastic processes, including learning and memory. However, the consequences of insufficient sleep on circuit connectivity remain poorly understood. To better appreciate the effects of sleep loss on synaptic connectivity across a memory-encoding circuit, we examined changes in the distribution of synaptic markers in the Drosophila mushroom body (MB). Protein-trap tags for active zone components indicate that recent sleep time is inversely correlated with Bruchpilot (BRP) abundance in the MB lobes; sleep loss elevates BRP while sleep induction reduces BRP across the MB. Overnight sleep deprivation also elevated levels of dSyd-1 and Cacophony, but not other pre-synaptic proteins. Cell-type-specific genetic reporters show that MB-intrinsic Kenyon cells (KCs) exhibit increased pre-synaptic BRP throughout the axonal lobes after sleep deprivation; similar increases were not detected in projections from large interneurons or dopaminergic neurons that innervate the MB. These results indicate that pre-synaptic plasticity in KCs is responsible for elevated levels of BRP in the MB lobes of sleep-deprived flies. Because KCs provide synaptic inputs to several classes of post-synaptic partners, we next used a fluorescent reporter for synaptic contacts to test whether each class of KC output connections is scaled uniformly by sleep loss. The KC output synapses that we observed here can be divided into three classes: KCs to MB interneurons; KCs to dopaminergic neurons; and KCs to MB output neurons. No single class showed uniform scaling across each constituent member, indicating that different rules may govern plasticity during sleep loss across cell types.

Appetitive olfactory learning suffers in ants when octopamine or dopamine receptors are blocked

Associative learning relies on the detection of coincidence between a stimulus and a reward or punishment. In the insect brain, this process is carried out in the mushroom bodies under the control of octopaminergic and dopaminergic neurons. It was assumed that appetitive learning is governed by octopaminergic neurons, while dopamine is required for aversive learning. This view has recently been challenged: both neurotransmitters are involved in both types of learning in bees and flies. Here, we tested which neurotransmitters are required for appetitive learning in ants. We trained Lasius niger workers to discriminate two mixtures of linear hydrocarbons and to associate one of them with a sucrose reward. We analysed the walking paths of the ants using machine learning and found that the ants spent more time near the rewarded odour than near the other, a preference that was stable for at least 24 h. We then treated the ants before learning with either epinastine, an octopamine receptor blocker, or flupentixol, a dopamine receptor blocker. Ants with blocked octopamine receptors did not prefer the rewarded odour. Octopamine signalling is thus necessary for appetitive learning of olfactory cues, probably because it signals information about odours or reward to the mushroom body. In contrast, ants with blocked dopamine receptors initially learned the rewarded odour but failed to retrieve this memory 24 h later. Dopamine is thus probably required for long-term memory consolidation, independent of short-term memory formation. Our results show that appetitive olfactory learning depends on both octopamine and dopamine signalling in ants.

Prior experience conditionally inhibits the expression of new learning in Drosophila

Prior experience of a stimulus can inhibit subsequent acquisition or expression of a learned association of that stimulus. However, the neuronal manifestations of this learning effect, named latent inhibition (LI), are poorly understood. Here, we show that prior odor exposure can produce context-dependent LI of later appetitive olfactory memory performance in Drosophila. Odor pre-exposure forms a short-lived aversive memory whose lone expression lacks context-dependence. Acquisition of odor pre-exposure memory requires aversively reinforcing dopaminergic neurons that innervate two mushroom body compartments—one group of which exhibits increasing activity with successive odor experience. Odor-specific responses of the corresponding mushroom body output neurons are suppressed, and their output is necessary for expression of both pre-exposure memory and LI of appetitive memory. Therefore, odor pre-exposure attaches negative valence to the odor itself, and LI of appetitive memory results from a temporary and context-dependent retrieval deficit imposed by competition with the parallel short-lived aversive memory.

•

Odor pre-exposure alters the expression of a learned association of that odor

•

Pre-exposure memory only affects subsequent retrieval if context is consistent

•

Pre-exposure memory can complement or compete with a learned association

•

Odor pre-exposure forms a labile mushroom body-dependent aversive memory

Associative learning in larval and adult Drosophila is impaired by the dopamine-synthesis inhibitor 3-Iodo-L-tyrosine

Across the animal kingdom, dopamine plays a crucial role in conferring reinforcement signals that teach animals about the causal structure of the world. In the fruit fly Drosophila melanogaster, dopaminergic reinforcement has largely been studied using genetics, whereas pharmacological approaches have received less attention. Here, we apply the dopamine-synthesis inhibitor 3-Iodo-L-tyrosine (3IY), which causes acute systemic inhibition of dopamine signaling, and investigate its effects on Pavlovian conditioning. We find that 3IY feeding impairs sugar-reward learning in larvae while leaving task-relevant behavioral faculties intact, and that additional feeding of a precursor of dopamine (L-3,4-dihydroxyphenylalanine, L-DOPA), rescues this impairment. Concerning a different developmental stage and for the aversive valence domain. Moreover, we demonstrate that punishment learning by activating the dopaminergic neuron PPL1-γ1pedc in adult flies is also impaired by 3IY feeding, and can likewise be rescued by L-DOPA. Our findings exemplify the advantages of using a pharmacological approach in combination with the genetic techniques available in D. melanogaster to manipulate neuronal and behavioral function.

Summary: We surveyed the effects of a dopamine-synthesis inhibitor on associative learning in larval and adult Drosophila. This approach can supplement genetic tools in investigating the conserved reinforcing function of dopamine.

Presynaptic inhibition of dopamine neurons controls optimistic bias

Regulation of reward signaling in the brain is critical for appropriate judgement of the environment and self. In Drosophila, the protocerebral anterior medial (PAM) cluster dopamine neurons mediate reward signals. Here, we show that localized inhibitory input to the presynaptic terminals of the PAM neurons titrates olfactory reward memory and controls memory specificity. The inhibitory regulation was mediated by metabotropic gamma-aminobutyric acid (GABA) receptors clustered in presynaptic microdomain of the PAM boutons. Cell type-specific silencing the GABA receptors enhanced memory by augmenting internal reward signals. Strikingly, the disruption of GABA signaling reduced memory specificity to the rewarded odor by changing local odor representations in the presynaptic terminals of the PAM neurons. The inhibitory microcircuit of the dopamine neurons is thus crucial for both reward values and memory specificity. Maladaptive presynaptic regulation causes optimistic cognitive bias.

The Role of Dopamine in Associative Learning in Drosophila: An Updated Unified Model

Learning to associate a positive or negative experience with an unrelated cue after the presentation of a reward or a punishment defines associative learning. The ability to form associative memories has been reported in animal species as complex as humans and as simple as insects and sea slugs. Associative memory has even been reported in tardigrades [1], species that diverged from other animal phyla 500 million years ago. Understanding the mechanisms of memory formation is a fundamental goal of neuroscience research. In this article, we work on resolving the current contradictions between different Drosophila associative memory circuit models and propose an updated version of the circuit model that predicts known memory behaviors that current models do not. Finally, we propose a model for how dopamine may function as a reward prediction error signal in Drosophila, a dopamine function that is well-established in mammals but not in insects [2, 3].

Learning with reinforcement prediction errors in a model of the Drosophila mushroom body

Effective decision making in a changing environment demands that accurate predictions are learned about decision outcomes. In Drosophila, such learning is orchestrated in part by the mushroom body, where dopamine neurons signal reinforcing stimuli to modulate plasticity presynaptic to mushroom body output neurons. Building on previous mushroom body models, in which dopamine neurons signal absolute reinforcement, we propose instead that dopamine neurons signal reinforcement prediction errors by utilising feedback reinforcement predictions from output neurons. We formulate plasticity rules that minimise prediction errors, verify that output neurons learn accurate reinforcement predictions in simulations, and postulate connectivity that explains more physiological observations than an experimentally constrained model. The constrained and augmented models reproduce a broad range of conditioning and blocking experiments, and we demonstrate that the absence of blocking does not imply the absence of prediction error dependent learning. Our results provide five predictions that can be tested using established experimental methods.