Integration of Parallel Opposing Memories Underlies Memory Extinction

Compensatory enhancement of input maintains aversive dopaminergic reinforcement in hungry Drosophila

Hungry animals need compensatory mechanisms to maintain flexible brain function, while modulation reconfigures circuits to prioritize resource seeking. In Drosophila, hunger inhibits aversively reinforcing dopaminergic neurons (DANs) to permit the expression of food-seeking memories. Multitasking the reinforcement system for motivation potentially undermines aversive learning. We find that chronic hunger mildly enhances aversive learning and that satiated-baseline and hunger-enhanced learning require endocrine adipokinetic hormone (AKH) signaling. Circulating AKH influences aversive learning via its receptor in four neurons in the ventral brain, two of which are octopaminergic. Connectomics revealed AKH receptor-expressing neurons to be upstream of several classes of ascending neurons, many of which are presynaptic to aversively reinforcing DANs. Octopaminergic modulation of and output from at least one of these ascending pathways is required for shock- and bitter-taste-reinforced aversive learning. We propose that coordinated enhancement of input compensates for hunger-directed inhibition of aversive DANs to preserve reinforcement when required.

Common principles for odour coding across vertebrates and invertebrates

The olfactory system is an ideal and tractable system for exploring how the brain transforms sensory inputs into behaviour. The basic tasks of any olfactory system include odour detection, discrimination and categorization. The challenge for the olfactory system is to transform the high-dimensional space of olfactory stimuli into the much smaller space of perceived objects and valence that endows odours with meaning. Our current understanding of how neural circuits address this challenge has come primarily from observations of the mechanisms of the brain for processing other sensory modalities, such as vision and hearing, in which optimized deep hierarchical circuits are used to extract sensory features that vary along continuous physical dimensions. The olfactory system, by contrast, contends with an ill-defined, high-dimensional stimulus space and discrete stimuli using a circuit architecture that is shallow and parallelized. Here, we present recent observations in vertebrate and invertebrate systems that relate the statistical structure and state-dependent modulation of olfactory codes to mechanisms of perception and odour-guided behaviour.

Behavioral and genetic correlates of heterogeneity in learning performance in individual honeybees, Apis mellifera

Learning an olfactory discrimination task leads to heterogeneous results in honeybees with some bees performing very well and others at low rates. Here we investigated this behavioral heterogeneity and asked whether it was associated with particular gene expression patterns in the bee's brain. Bees were individually conditioned using a sequential conditioning protocol involving several phases of olfactory learning and retention tests. A cumulative score was used to differentiate the tested bees into high and low performers. The rate of CS+ odor learning was found to correlate most strongly with a cumulative performance score extracted from all learning and retention tests. Microarray analysis of gene expression in the mushroom body area of the brains of these bees identified a number of differentially expressed genes between high and low performers. These genes are associated with diverse biological functions, such as neurotransmission, memory formation, cargo trafficking and development.

Functional Imaging of Learning-Induced Plasticity in the Central Nervous System with Genetically Encoded Reporters in Drosophila

Learning and memory allow animals to adjust their behavior based on the predictive value of their past experiences. Memories often exist in complex representations, spread across numerous cells and synapses in the brain. Studying relatively simple forms of memory provides insights into the fundamental processes that underlie multiple forms of memory. Associative learning occurs when an animal learns the relationship between two previously unrelated sensory stimuli, such as when a hungry animal learns that a particular odor is followed by a tasty reward. Drosophila is a particularly powerful model to study how this type of memory works. The fundamental principles are widely shared among animals, and there is a wide range of genetic tools available to study circuit function in flies. In addition, the olfactory structures that mediate associative learning in flies, such as the mushroom body and its associated neurons, are anatomically organized, relatively well-characterized, and readily accessible to imaging. Here, we review the olfactory anatomy and physiology of the olfactory system, describe how plasticity in the olfactory pathway mediates learning and memory, and explain the general principles underlying calcium imaging approaches.

Memory Trace for Fear Extinction: Fragile yet Reinforceable

Fear extinction is a biological process in which learned fear behavior diminishes without anticipated reinforcement, allowing the organism to re-adapt to ever-changing situations. Based on the behavioral hypothesis that extinction is new learning and forms an extinction memory, this new memory is more readily forgettable than the original fear memory. The brain's cellular and synaptic traces underpinning this inherently fragile yet reinforceable extinction memory remain unclear. Intriguing questions are about the whereabouts of the engram neurons that emerged during extinction learning and how they constitute a dynamically evolving functional construct that works in concert to store and express the extinction memory. In this review, we discuss recent advances in the engram circuits and their neural connectivity plasticity for fear extinction, aiming to establish a conceptual framework for understanding the dynamic competition between fear and extinction memories in adaptive control of conditioned fear responses.

Neurotransmitter classification from electron microscopy images at synaptic sites in Drosophila melanogaster

High-resolution electron microscopy of nervous systems has enabled the reconstruction of synaptic connectomes. However, we do not know the synaptic sign for each connection (i.e., whether a connection is excitatory or inhibitory), which is implied by the released transmitter. We demonstrate that artificial neural networks can predict transmitter types for presynapses from electron micrographs: a network trained to predict six transmitters (acetylcholine, glutamate, GABA, serotonin, dopamine, octopamine) achieves an accuracy of 87% for individual synapses, 94% for neurons, and 91% for known cell types across a D. melanogaster whole brain. We visualize the ultrastructural features used for prediction, discovering subtle but significant differences between transmitter phenotypes. We also analyze transmitter distributions across the brain and find that neurons that develop together largely express only one fast-acting transmitter (acetylcholine, glutamate, or GABA). We hope that our publicly available predictions act as an accelerant for neuroscientific hypothesis generation for the fly.

Diverse memory paradigms in Drosophila reveal diverse neural mechanisms

In this review, we aggregated the different types of learning and memory paradigms developed in adult Drosophila and attempted to assess the similarities and differences in the neural mechanisms supporting diverse types of memory. The simplest association memory assays are conditioning paradigms (olfactory, visual, and gustatory). A great deal of work has been done on these memories, revealing hundreds of genes and neural circuits supporting this memory. Variations of conditioning assays (reversal learning, trace conditioning, latent inhibition, and extinction) also reveal interesting memory mechanisms, whereas mechanisms supporting spatial memory (thermal maze, orientation memory, and heat box) and the conditioned suppression of innate behaviors (phototaxis, negative geotaxis, anemotaxis, and locomotion) remain largely unexplored. In recent years, there has been an increased interest in multisensory and multicomponent memories (context-dependent and cross-modal memory) and higher-order memory (sensory preconditioning and second-order conditioning). Some of this work has revealed how the intricate mushroom body (MB) neural circuitry can support more complex memories. Finally, the most complex memories are arguably those involving social memory: courtship conditioning and social learning (mate-copying and egg-laying behaviors). Currently, very little is known about the mechanisms supporting social memories. Overall, the MBs are important for association memories of multiple sensory modalities and multisensory integration, whereas the central complex is important for place, orientation, and navigation memories. Interestingly, several different types of memory appear to use similar or variants of the olfactory conditioning neural circuitry, which are repurposed in different ways.

Skewing information flow through pre- and postsynaptic plasticity in the mushroom bodies of Drosophila

Animal brains need to store information to construct a representation of their environment. Knowledge of what happened in the past allows both vertebrates and invertebrates to predict future outcomes by recalling previous experience. Although invertebrate and vertebrate brains share common principles at the molecular, cellular, and circuit-architectural levels, there are also obvious differences as exemplified by the use of acetylcholine versus glutamate as the considered main excitatory neurotransmitters in the respective central nervous systems. Nonetheless, across central nervous systems, synaptic plasticity is thought to be a main substrate for memory storage. Therefore, how brain circuits and synaptic contacts change following learning is of fundamental interest for understanding brain computations tied to behavior in any animal. Recent progress has been made in understanding such plastic changes following olfactory associative learning in the mushroom bodies (MBs) of Drosophila A current framework of memory-guided behavioral selection is based on the MB skew model, in which antagonistic synaptic pathways are selectively changed in strength. Here, we review insights into plasticity at dedicated Drosophila MB output pathways and update what is known about the plasticity of both pre- and postsynaptic compartments of Drosophila MB neurons.

An octopamine-specific GRAB sensor reveals a monoamine relay circuitry that boosts aversive learning

Octopamine (OA), analogous to norepinephrine in vertebrates, is an essential monoamine neurotransmitter in invertebrates that plays a significant role in various biological functions, including olfactory associative learning. However, the spatial and temporal dynamics of OA in vivo remain poorly understood due to limitations associated with the currently available methods used to detect it. To overcome these limitations, we developed a genetically encoded GPCR  activation-based (GRAB) OA sensor called GRABOA1.0. This sensor is highly selective for OA and exhibits a robust and rapid increase in fluorescence in response to extracellular OA. Using GRABOA1.0, we monitored OA release in the Drosophila mushroom body (MB), the fly's learning center, and found that OA is released in response to both odor and shock stimuli in an aversive learning model. This OA release requires acetylcholine (ACh) released from Kenyon cells, signaling via nicotinic ACh receptors. Finally, we discovered that OA amplifies aversive learning behavior by augmenting dopamine-mediated punishment signals via Octβ1R in dopaminergic neurons, leading to alterations in synaptic plasticity within the MB. Thus, our new GRABOA1.0 sensor can be used to monitor OA release in real time under physiological conditions, providing valuable insights into the cellular and circuit mechanisms that underlie OA signaling.

An integrative sensor of body states: how the mushroom body modulates behavior depending on physiological context

The brain constantly compares past and present experiences to predict the future, thereby enabling instantaneous and future behavioral adjustments. Integration of external information with the animal's current internal needs and behavioral state represents a key challenge of the nervous system. Recent advancements in dissecting the function of the Drosophila mushroom body (MB) at the single-cell level have uncovered its three-layered logic and parallel systems conveying positive and negative values during associative learning. This review explores a lesser-known role of the MB in detecting and integrating body states such as hunger, thirst, and sleep, ultimately modulating motivation and sensory-driven decisions based on the physiological state of the fly. State-dependent signals predominantly affect the activity of modulatory MB input neurons (dopaminergic, serotoninergic, and octopaminergic), but also induce plastic changes directly at the level of the MB intrinsic and output neurons. Thus, the MB emerges as a tightly regulated relay station in the insect brain, orchestrating neuroadaptations due to current internal and behavioral states leading to short- but also long-lasting changes in behavior. While these adaptations are crucial to ensure fitness and survival, recent findings also underscore how circuit motifs in the MB may reflect fundamental design principles that contribute to maladaptive behaviors such as addiction or depression-like symptoms.

Beyond prediction error: 25 years of modeling the associations formed in the insect mushroom body

The insect mushroom body has gained increasing attention as a system in which the computational basis of neural learning circuits can be unraveled. We now understand in detail the key locations in this circuit where synaptic associations are formed between sensory patterns and values leading to actions. However, the actual learning rule (or rules) implemented by neural activity and leading to synaptic change is still an open question. Here, I survey the diversity of answers that have been offered in computational models of this system over the past decades, including the recurring assumption-in line with top-down theories of associative learning-that the core function is to reduce prediction error. However, I will argue, a more bottom-up approach may ultimately reveal a richer algorithmic capacity in this still enigmatic brain neuropil.

Sensory encoding and memory in the mushroom body: signals, noise, and variability

To survive in changing environments, animals need to learn to associate specific sensory stimuli with positive or negative valence. How do they form stimulus-specific memories to distinguish between positively/negatively associated stimuli and other irrelevant stimuli? Solving this task is one of the functions of the mushroom body, the associative memory center in insect brains. Here we summarize recent work on sensory encoding and memory in the Drosophila mushroom body, highlighting general principles such as pattern separation, sparse coding, noise and variability, coincidence detection, and spatially localized neuromodulation, and placing the mushroom body in comparative perspective with mammalian memory systems.

Cyclic nucleotide-induced bidirectional long-term synaptic plasticity in Drosophila mushroom body

Activation of the cAMP pathway is one of the common mechanisms underlying long-term potentiation (LTP). In the Drosophila mushroom body, simultaneous activation of odour-coding Kenyon cells (KCs) and reinforcement-coding dopaminergic neurons activates adenylyl cyclase in KC presynaptic terminals, which is believed to trigger synaptic plasticity underlying olfactory associative learning. However, learning induces long-term depression (LTD) at these synapses, contradicting the universal role of cAMP as a facilitator of transmission. Here, we developed a system to electrophysiologically monitor both short-term and long-term synaptic plasticity at KC output synapses and demonstrated that they are indeed an exception in which activation of the cAMP-protein kinase A pathway induces LTD. Contrary to the prevailing model, our cAMP imaging found no evidence for synergistic action of dopamine and KC activity on cAMP synthesis. Furthermore, we found that forskolin-induced cAMP increase alone was insufficient for plasticity induction; it additionally required simultaneous KC activation to replicate the presynaptic LTD induced by pairing with dopamine. On the other hand, activation of the cGMP pathway paired with KC activation induced slowly developing LTP, proving antagonistic actions of the two second-messenger pathways predicted by behavioural study. Finally, KC subtype-specific interrogation of synapses revealed that different KC subtypes exhibit distinct plasticity duration even among synapses on the same postsynaptic neuron. Thus, our work not only revises the role of cAMP in synaptic plasticity by uncovering the unexpected convergence point of the cAMP pathway and neuronal activity, but also establishes the methods to address physiological mechanisms of synaptic plasticity in this important model. KEY POINTS: Although presynaptic cAMP increase generally facilitates synapses, olfactory associative learning in Drosophila, which depends on dopamine and cAMP signalling genes, induces long-term depression (LTD) at the mushroom body output synapses. By combining electrophysiology, pharmacology and optogenetics, we directly demonstrate that these synapses are an exception where activation of the cAMP-protein kinase A pathway leads to presynaptic LTD. Dopamine- or forskolin-induced cAMP increase alone is not sufficient for LTD induction; neuronal activity, which has been believed to trigger cAMP synthesis in synergy with dopamine input, is required in the downstream pathway of cAMP. In contrast to cAMP, activation of the cGMP pathway paired with neuronal activity induces presynaptic long-term potentiation, which explains behaviourally observed opposing actions of transmitters co-released by dopaminergic neurons. Our work not only revises the role of cAMP in synaptic plasticity, but also provides essential methods to address physiological mechanisms of synaptic plasticity in this important model system.

Roles of feedback and feed-forward networks of dopamine subsystems: insights from Drosophila studies

Across animal species, dopamine-operated memory systems comprise anatomically segregated, functionally diverse subsystems. Although individual subsystems could operate independently to support distinct types of memory, the logical interplay between subsystems is expected to enable more complex memory processing by allowing existing memory to influence future learning. Recent comprehensive ultrastructural analysis of the Drosophila mushroom body revealed intricate networks interconnecting the dopamine subsystems-the mushroom body compartments. Here, we review the functions of some of these connections that are beginning to be understood. Memory consolidation is mediated by two different forms of network: A recurrent feedback loop within a compartment maintains sustained dopamine activity required for consolidation, whereas feed-forward connections across compartments allow short-term memory formation in one compartment to open the gate for long-term memory formation in another compartment. Extinction and reversal of aversive memory rely on a similar feed-forward circuit motif that signals omission of punishment as a reward, which triggers plasticity that counteracts the original aversive memory trace. Finally, indirect feed-forward connections from a long-term memory compartment to short-term memory compartments mediate higher-order conditioning. Collectively, these emerging studies indicate that feedback control and hierarchical connectivity allow the dopamine subsystems to work cooperatively to support diverse and complex forms of learning.

Contemporary neurocognitive models of memory: A descriptive comparative analysis

The great complexity involved in the study of memory has given rise to numerous hypotheses and models associated with various phenomena at different levels of analysis. This has allowed us to delve deeper in our knowledge about memory but has also made it difficult to synthesize and integrate data from different lines of research. In this context, this work presents a descriptive comparative analysis of contemporary models that address the structure and function of multiple memory systems. The main goal is to outline a panoramic view of the key elements that constitute these models in order to visualize both the current state of research and possible future directions. The elements that stand out from different levels of analysis are distributed neural networks, hierarchical organization, predictive coding, homeostasis, and evolutionary perspective.

An octopamine-specific GRAB sensor reveals a monoamine relay circuitry that boosts aversive learning

Octopamine (OA), analogous to norepinephrine in vertebrates, is an essential monoamine neurotransmitter in invertebrates that plays a significant role in various biological functions, including olfactory associative learning. However, the spatial and temporal dynamics of OA in vivo remain poorly understood due to limitations associated with the currently available methods used to detect it. To overcome these limitations, we developed a genetically encoded GPCR activation-based (GRAB) OA sensor called GRABOA1.0. This sensor is highly selective for OA and exhibits a robust and rapid increase in fluorescence in response to extracellular OA. Using GRABOA1.0, we monitored OA release in the Drosophila mushroom body (MB), the fly's learning center, and found that OA is released in response to both odor and shock stimuli in an aversive learning model. This OA release requires acetylcholine (ACh) released from Kenyon cells, signaling via nicotinic ACh receptors. Finally, we discovered that OA amplifies aversive learning behavior by augmenting dopamine-mediated punishment signals via Octβ1R in dopaminergic neurons, leading to alterations in synaptic plasticity within the MB. Thus, our new GRABOA1.0 sensor can be used to monitor OA release in real-time under physiological conditions, providing valuable insights into the cellular and circuit mechanisms that underlie OA signaling.

Heterogeneity of synaptic connectivity in the fly visual system

Visual systems are homogeneous structures, where repeating columnar units retinotopically cover the visual field. Each of these columns contain many of the same neuron types that are distinguished by anatomic, genetic and - generally - by functional properties. However, there are exceptions to this rule. In the 800 columns of the Drosophila eye, there is an anatomically and genetically identifiable cell type with variable functional properties, Tm9. Since anatomical connectivity shapes functional neuronal properties, we identified the presynaptic inputs of several hundred Tm9s across both optic lobes using the full adult female fly brain (FAFB) electron microscopic dataset and FlyWire connectome. Our work shows that Tm9 has three major and many sparsely distributed inputs. This differs from the presynaptic connectivity of other Tm neurons, which have only one major, and more stereotypic inputs than Tm9. Genetic synapse labeling showed that the heterogeneous wiring exists across individuals. Together, our data argue that the visual system uses heterogeneous, distributed circuit properties to achieve robust visual processing.

IR76b-expressing neurons in Drosophila melanogaster are necessary for associative reward learning of an amino acid mixture

Learning where to find nutrients while at the same time avoiding toxic food is essential for survival of any animal. Using Drosophila melanogaster larvae as a study case, we investigate the role of gustatory sensory neurons expressing IR76b for associative learning of amino acids, the building blocks of proteins. We found surprising complexity in the neuronal underpinnings of sensing amino acids, and a functional division of sensory neurons. We found that the IR76b receptor is dispensable for amino acid learning, whereas the neurons expressing IR76b are specifically required for the rewarding but not the punishing effect of amino acids. This unexpected dissociation in neuronal processing of amino acids for different behavioural functions provides a study case for functional divisions of labour in gustatory systems.

Prediction error drives associative learning and conditioned behavior in a spiking model of Drosophila larva

Predicting reinforcement from sensory cues is beneficial for goal-directed behavior. In insect brains, underlying associations between cues and reinforcement, encoded by dopaminergic neurons, are formed in the mushroom body. We propose a spiking model of the Drosophila larva mushroom body. It includes a feedback motif conveying learned reinforcement expectation to dopaminergic neurons, which can compute prediction error as the difference between expected and present reinforcement. We demonstrate that this can serve as a driving force in learning. When combined with synaptic homeostasis, our model accounts for theoretically derived features of acquisition and loss of associations that depend on the intensity of the reinforcement and its temporal proximity to the cue. From modeling olfactory learning over the time course of behavioral experiments and simulating the locomotion of individual larvae toward or away from odor sources in a virtual environment, we conclude that learning driven by prediction errors can explain larval behavior.

Minimal circuit motifs for second-order conditioning in the insect mushroom body

In well-established first-order conditioning experiments, the concurrence of a sensory cue with reinforcement forms an association, allowing the cue to predict future reinforcement. In the insect mushroom body, a brain region central to learning and memory, such associations are encoded in the synapses between its intrinsic and output neurons. This process is mediated by the activity of dopaminergic neurons that encode reinforcement signals. In second-order conditioning, a new sensory cue is paired with an already established one that presumably activates dopaminergic neurons due to its predictive power of the reinforcement. We explored minimal circuit motifs in the mushroom body for their ability to support second-order conditioning using mechanistic models. We found that dopaminergic neurons can either be activated directly by the mushroom body's intrinsic neurons or via feedback from the output neurons via several pathways. We demonstrated that the circuit motifs differ in their computational efficiency and robustness. Beyond previous research, we suggest an additional motif that relies on feedforward input of the mushroom body intrinsic neurons to dopaminergic neurons as a promising candidate for experimental evaluation. It differentiates well between trained and novel stimuli, demonstrating robust performance across a range of model parameters.

Cyclic nucleotide-induced bidirectional long-term synaptic plasticity in Drosophila mushroom body

Activation of the cAMP pathway is one of the common mechanisms underlying long-term potentiation (LTP). In the Drosophila mushroom body, simultaneous activation of odor-coding Kenyon cells (KCs) and reinforcement-coding dopaminergic neurons activates adenylyl cyclase in KC presynaptic terminals, which is believed to trigger synaptic plasticity underlying olfactory associative learning. However, learning induces long-term depression (LTD) at these synapses, contradicting the universal role of cAMP as a facilitator of transmission. Here, we develop a system to electrophysiologically monitor both short-term and long-term synaptic plasticity at KC output synapses and demonstrate that they are indeed an exception where activation of the cAMP/protein kinase A pathway induces LTD. Contrary to the prevailing model, our cAMP imaging finds no evidence for synergistic action of dopamine and KC activity on cAMP synthesis. Furthermore, we find that forskolin-induced cAMP increase alone is insufficient for plasticity induction; it additionally requires simultaneous KC activation to replicate the presynaptic LTD induced by pairing with dopamine. On the other hand, activation of the cGMP pathway paired with KC activation induces slowly developing LTP, proving antagonistic actions of the two second-messenger pathways predicted by behavioral study. Finally, KC subtype-specific interrogation of synapses reveals that different KC subtypes exhibit distinct plasticity duration even among synapses on the same postsynaptic neuron. Thus, our work not only revises the role of cAMP in synaptic plasticity by uncovering the unexpected convergence point of the cAMP pathway and neuronal activity, but also establishes the methods to address physiological mechanisms of synaptic plasticity in this important model.

Dopaminergic systems create reward seeking despite adverse consequences

Resource-seeking behaviours are ordinarily constrained by physiological needs and threats of danger, and the loss of these controls is associated with pathological reward seeking1. Although dysfunction of the dopaminergic valuation system of the brain is known to contribute towards unconstrained reward seeking2,3, the underlying reasons for this behaviour are unclear. Here we describe dopaminergic neural mechanisms that produce reward seeking despite adverse consequences in Drosophila melanogaster. Odours paired with optogenetic activation of a defined subset of reward-encoding dopaminergic neurons become cues that starved flies seek while neglecting food and enduring electric shock punishment. Unconstrained seeking of reward is not observed after learning with sugar or synthetic engagement of other dopaminergic neuron populations. Antagonism between reward-encoding and punishment-encoding dopaminergic neurons accounts for the perseverance of reward seeking despite punishment, whereas synthetic engagement of the reward-encoding dopaminergic neurons also impairs the ordinary need-dependent dopaminergic valuation of available food. Connectome analyses reveal that the population of reward-encoding dopaminergic neurons receives highly heterogeneous input, consistent with parallel representation of diverse rewards, and recordings demonstrate state-specific gating and satiety-related signals. We propose that a similar dopaminergic valuation system dysfunction is likely to contribute to maladaptive seeking of rewards by mammals.

Dopaminergic neurons dynamically update sensory values during olfactory maneuver

Dopaminergic neurons (DANs) drive associative learning to update the value of sensory cues, but their contribution to the assessment of sensory values outside the context of association remains largely unexplored. Here, we show in Drosophila that DANs in the mushroom body encode the innate value of odors and constantly update the current value by inducing plasticity during olfactory maneuver. Our connectome-based network model linking all the way from the olfactory neurons to DANs reproduces the characteristics of DAN responses, proposing a concrete circuit mechanism for computation. Downstream of DANs, odors alone induce value- and dopamine-dependent changes in the activity of mushroom body output neurons, which store the current value of odors. Consistent with this neural plasticity, specific sets of DANs bidirectionally modulate flies' steering in a virtual olfactory environment. Thus, the DAN circuit known for discrete, associative learning also continuously updates odor values in a nonassociative manner.

Reducing Catastrophic Forgetting With Associative Learning: A Lesson From Fruit Flies

Catastrophic forgetting remains an outstanding challenge in continual learning. Recently, methods inspired by the brain, such as continual representation learning and memory replay, have been used to combat catastrophic forgetting. Associative learning (retaining associations between inputs and outputs, even after good representations are learned) plays an important function in the brain; however, its role in continual learning has not been carefully studied. Here, we identified a two-layer neural circuit in the fruit fly olfactory system that performs continual associative learning between odors and their associated valences. In the first layer, inputs (odors) are encoded using sparse, high-dimensional representations, which reduces memory interference by activating nonoverlapping populations of neurons for different odors. In the second layer, only the synapses between odor-activated neurons and the odor's associated output neuron are modified during learning; the rest of the weights are frozen to prevent unrelated memories from being overwritten. We prove theoretically that these two perceptron-like layers help reduce catastrophic forgetting compared to the original perceptron algorithm, under continual learning. We then show empirically on benchmark data sets that this simple and lightweight architecture outperforms other popular neural-inspired algorithms when also using a two-layer feedforward architecture. Overall, fruit flies evolved an efficient continual associative learning algorithm, and circuit mechanisms from neuroscience can be translated to improve machine computation.

The mushroom body output encodes behavioral decision during sensory-motor transformation

Animals form a behavioral decision by evaluating sensory evidence on the background of past experiences and the momentary motivational state. In insects, we still lack understanding of how and at which stage of the recurrent sensory-motor pathway behavioral decisions are formed. The mushroom body (MB), a central brain structure in insects1 and crustaceans,2,3 integrates sensory input of different modalities4,5,6 with the internal state, the behavioral state, and external sensory context7,8,9,10 through a large number of recurrent, mostly neuromodulatory inputs,11,12 implicating a functional role for MBs in state-dependent sensory-motor transformation.13,14 A number of classical conditioning studies in honeybees15,16 and fruit flies17,18,19 have provided accumulated evidence that at its output, the MB encodes the valence of a sensory stimulus with respect to its behavioral relevance. Recent work has extended this notion of valence encoding to the context of innate behaviors.8,20,21,22 Here, we co-analyzed a defined feeding behavior and simultaneous extracellular single-unit recordings from MB output neurons (MBONs) in the cockroach in response to timed sensory stimulation with odors. We show that clear neuronal responses occurred almost exclusively during behaviorally responded trials. Early MBON responses to the sensory stimulus preceded the feeding behavior and predicted its occurrence or non-occurrence from the single-trial population activity. Our results therefore suggest that at its output, the MB does not merely encode sensory stimulus valence. We hypothesize instead that the MB output represents an integrated signal of internal state, momentary environmental conditions, and experience-dependent memory to encode a behavioral decision.

Dopamine-Dependent Plasticity Is Heterogeneously Expressed by Presynaptic Calcium Activity across Individual Boutons of the Drosophila Mushroom Body

The Drosophila mushroom body (MB) is an important model system for studying the synaptic mechanisms of associative learning. In this system, coincidence of odor-evoked calcium influx and dopaminergic input in the presynaptic terminals of Kenyon cells (KCs), the principal neurons of the MB, triggers long-term depression (LTD), which plays a critical role in olfactory learning. However, it is controversial whether such synaptic plasticity is accompanied by a corresponding decrease in odor-evoked calcium activity in the KC presynaptic terminals. Here, we address this question by inducing LTD by pairing odor presentation with optogenetic activation of dopaminergic neurons (DANs). This allows us to rigorously compare the changes at the presynaptic and postsynaptic sites in the same conditions. By imaging presynaptic acetylcholine release in the condition where LTD is reliably observed in the postsynaptic calcium signals, we show that neurotransmitter release from KCs is depressed selectively in the MB compartments innervated by activated DANs, demonstrating the presynaptic nature of LTD. However, total odor-evoked calcium activity of the KC axon bundles does not show concurrent depression. We further conduct calcium imaging in individual presynaptic boutons and uncover the highly heterogeneous nature of calcium plasticity. Namely, only a subset of boutons, which are strongly activated by associated odors, undergo calcium activity depression, while weakly responding boutons show potentiation. Thus, our results suggest an unexpected nonlinear relationship between presynaptic calcium influx and the results of plasticity, challenging the simple view of cooperative actions of presynaptic calcium and dopaminergic input.

Reward expectations direct learning and drive operant matching in Drosophila

Foraging animals must use decision-making strategies that dynamically adapt to the changing availability of rewards in the environment. A wide diversity of animals do this by distributing their choices in proportion to the rewards received from each option, Herrnstein's operant matching law. Theoretical work suggests an elegant mechanistic explanation for this ubiquitous behavior, as operant matching follows automatically from simple synaptic plasticity rules acting within behaviorally relevant neural circuits. However, no past work has mapped operant matching onto plasticity mechanisms in the brain, leaving the biological relevance of the theory unclear. Here, we discovered operant matching in Drosophila and showed that it requires synaptic plasticity that acts in the mushroom body and incorporates the expectation of reward. We began by developing a dynamic foraging paradigm to measure choices from individual flies as they learn to associate odor cues with probabilistic rewards. We then built a model of the fly mushroom body to explain each fly's sequential choice behavior using a family of biologically realistic synaptic plasticity rules. As predicted by past theoretical work, we found that synaptic plasticity rules could explain fly matching behavior by incorporating stimulus expectations, reward expectations, or both. However, by optogenetically bypassing the representation of reward expectation, we abolished matching behavior and showed that the plasticity rule must specifically incorporate reward expectations. Altogether, these results reveal the first synapse-level mechanisms of operant matching and provide compelling evidence for the role of reward expectation signals in the fly brain.

Neural circuit mechanisms for transforming learned olfactory valences into wind-oriented movement

How memories are used by the brain to guide future action is poorly understood. In olfactory associative learning in Drosophila, multiple compartments of the mushroom body act in parallel to assign a valence to a stimulus. Here, we show that appetitive memories stored in different compartments induce different levels of upwind locomotion. Using a photoactivation screen of a new collection of split-GAL4 drivers and EM connectomics, we identified a cluster of neurons postsynaptic to the mushroom body output neurons (MBONs) that can trigger robust upwind steering. These UpWind Neurons (UpWiNs) integrate inhibitory and excitatory synaptic inputs from MBONs of appetitive and aversive memory compartments, respectively. After formation of appetitive memory, UpWiNs acquire enhanced response to reward-predicting odors as the response of the inhibitory presynaptic MBON undergoes depression. Blocking UpWiNs impaired appetitive memory and reduced upwind locomotion during retrieval. Photoactivation of UpWiNs also increased the chance of returning to a location where activation was terminated, suggesting an additional role in olfactory navigation. Thus, our results provide insight into how learned abstract valences are gradually transformed into concrete memory-driven actions through divergent and convergent networks, a neuronal architecture that is commonly found in the vertebrate and invertebrate brains.

Fear extinction relies on ventral hippocampal safety codes shaped by the amygdala

Extinction memory retrieval is influenced by spatial contextual information that determines responding to conditioned stimuli (CS). However, it is poorly understood whether contextual representations are imbued with emotional values to support memory selection. Here, we performed activity-dependent engram tagging and in vivo single-unit electrophysiological recordings from the ventral hippocampus (vH) while optogenetically manipulating basolateral amygdala (BLA) inputs during the formation of cued fear extinction memory. During fear extinction when CS acquire safety properties, we found that CS-related activity in the vH reactivated during sleep consolidation and was strengthened upon memory retrieval. Moreover, fear extinction memory was facilitated when the extinction context exhibited precise coding of its affective zones. Last, these activity patterns along with the retrieval of the fear extinction memory were dependent on glutamatergic transmission from the BLA during extinction learning. Thus, fear extinction memory relies on the formation of contextual and stimulus safety representations in the vH instructed by the BLA.

Neural circuit mechanisms linking courtship and reward in Drosophila males

Courtship has evolved to achieve reproductive success in animal species. However, whether courtship itself has a positive value remains unclear. In the present work, we report that courtship is innately rewarding and can induce the expression of appetitive short-term memory (STM) and long-term memory (LTM) in Drosophila melanogaster males. Activation of male-specific P1 neurons is sufficient to mimic courtship-induced preference and memory performance. Surprisingly, P1 neurons functionally connect to a large proportion of dopaminergic neurons (DANs) in the protocerebral anterior medial (PAM) cluster. The acquisition of STM and LTM depends on two distinct subsets of PAM DANs that convey the courtship-reward signal to the restricted regions of the mushroom body (MB) γ and α/β lobes through two dopamine receptors, D1-like Dop1R1 and D2-like Dop2R. Furthermore, the retrieval of STM stored in the MB α'/β' lobes and LTM stored in the MB α/β lobe relies on two distinct MB output neurons. Finally, LTM consolidation requires two subsets of PAM DANs projecting to the MB α/β lobe and corresponding MB output neurons. Taken together, our findings demonstrate that courtship is a potent rewarding stimulus and reveal the underlying neural circuit mechanisms linking courtship and reward in Drosophila males.

Multisensory learning binds neurons into a cross-modal memory engram

Associating multiple sensory cues with objects and experience is a fundamental brain process that improves object recognition and memory performance. However, neural mechanisms that bind sensory features during learning and augment memory expression are unknown. Here we demonstrate multisensory appetitive and aversive memory in Drosophila. Combining colours and odours improved memory performance, even when each sensory modality was tested alone. Temporal control of neuronal function revealed visually selective mushroom body Kenyon cells (KCs) to be required for enhancement of both visual and olfactory memory after multisensory training. Voltage imaging in head-fixed flies showed that multisensory learning binds activity between streams of modality-specific KCs so that unimodal sensory input generates a multimodal neuronal response. Binding occurs between regions of the olfactory and visual KC axons, which receive valence-relevant dopaminergic reinforcement, and is propagated downstream. Dopamine locally releases GABAergic inhibition to permit specific microcircuits within KC-spanning serotonergic neurons to function as an excitatory bridge between the previously 'modality-selective' KC streams. Cross-modal binding thereby expands the KCs representing the memory engram for each modality into those representing the other. This broadening of the engram improves memory performance after multisensory learning and permits a single sensory feature to retrieve the memory of the multimodal experience.

Local 5-HT signaling bi-directionally regulates the coincidence time window for associative learning

The coincidence between conditioned stimulus (CS) and unconditioned stimulus (US) is essential for associative learning; however, the mechanism regulating the duration of this temporal window remains unclear. Here, we found that serotonin (5-HT) bi-directionally regulates the coincidence time window of olfactory learning in Drosophila and affects synaptic plasticity of Kenyon cells (KCs) in the mushroom body (MB). Utilizing GPCR-activation-based (GRAB) neurotransmitter sensors, we found that KC-released acetylcholine (ACh) activates a serotonergic dorsal paired medial (DPM) neuron, which in turn provides inhibitory feedback to KCs. Physiological stimuli induce spatially heterogeneous 5-HT signals, which proportionally gate the intrinsic coincidence time windows of different MB compartments. Artificially reducing or increasing the DPM neuron-released 5-HT shortens or prolongs the coincidence window, respectively. In a sequential trace conditioning paradigm, this serotonergic neuromodulation helps to bridge the CS-US temporal gap. Altogether, we report a model circuitry for perceiving the temporal coincidence and determining the causal relationship between environmental events.

A circuit mechanism linking past and future learning through shifts in perception

Long-term memory formation is energetically costly. Neural mechanisms that guide an animal to identify fruitful associations therefore have important survival benefits. Here, we elucidate a circuit mechanism in Lymnaea, which enables past memory to shape new memory formation through changes in perception. Specifically, strong classical conditioning drives a positive shift in perception that facilitates the robust learning of a subsequent and otherwise ineffective weak association. Circuit dissection approaches reveal the neural control network responsible, characterized by a mutual inhibition motif. This both sets perceptual state and acts as the master controller for gating new learning. Pharmacological circuit manipulation in vivo fully substitutes for strong paradigm learning, shifting the network into a more receptive state to enable subsequent weak paradigm learning. Thus, perceptual change provides a conduit to link past and future memory storage. We propose that this mechanism alerts animals to learning-rich periods, lowering the threshold for new memory acquisition.

The cellular architecture of memory modules in Drosophila supports stochastic input integration

The ability to associate neutral stimuli with valence information and to store these associations as memories forms the basis for decision making. To determine the underlying computational principles, we build a realistic computational model of a central decision module within the Drosophila mushroom body (MB), the fly's center for learning and memory. Our model combines the electron microscopy-based architecture of one MB output neuron (MBON-α3), the synaptic connectivity of its 948 presynaptic Kenyon cells (KCs), and its membrane properties obtained from patch-clamp recordings. We show that this neuron is electrotonically compact and that synaptic input corresponding to simulated odor input robustly drives its spiking behavior. Therefore, sparse innervation by KCs can efficiently control and modulate MBON activity in response to learning with minimal requirements on the specificity of synaptic localization. This architecture allows efficient storage of large numbers of memories using the flexible stochastic connectivity of the circuit.

Spontaneous recovery of reward memory through active forgetting of extinction memory

Learned behavior can be suppressed by the extinction procedure. Such extinguished memory often returns spontaneously over time, making it difficult to treat diseases such as addiction. However, the biological mechanisms underlying such spontaneous recovery remain unclear. Here, we report that the extinguished reward memory in Drosophila recovers spontaneously because extinction training forms an aversive memory that can be actively forgotten via the Rac1/Dia pathway. Manipulating Rac1 activity does not affect sugar-reward memory and its immediate extinction effect but bidirectionally regulates spontaneous recovery-the decay process of extinction. Experiments using thermogenetic inhibition and functional imaging support that such extinction appears to be coded as an aversive experience. Genetic and pharmacological inhibition of formin Dia, a downstream effector of Rac1, specifically prevents spontaneous recovery after extinction in both behavioral performance and corresponding physiological traces. Together, our data suggest that spontaneous recovery is caused by active forgetting of the opposing extinction memory.

Hierarchical architecture of dopaminergic circuits enables second-order conditioning in Drosophila

Dopaminergic neurons with distinct projection patterns and physiological properties compose memory subsystems in a brain. However, it is poorly understood whether or how they interact during complex learning. Here, we identify a feedforward circuit formed between dopamine subsystems and show that it is essential for second-order conditioning, an ethologically important form of higher-order associative learning. The Drosophila mushroom body comprises a series of dopaminergic compartments, each of which exhibits distinct memory dynamics. We find that a slow and stable memory compartment can serve as an effective 'teacher' by instructing other faster and transient memory compartments via a single key interneuron, which we identify by connectome analysis and neurotransmitter prediction. This excitatory interneuron acquires enhanced response to reward-predicting odor after first-order conditioning and, upon activation, evokes dopamine release in the 'student' compartments. These hierarchical connections between dopamine subsystems explain distinct properties of first- and second-order memory long known by behavioral psychologists.

Food memory circuits regulate eating and energy balance

In mammals, learning circuits play an essential role in energy balance by creating associations between sensory cues and the rewarding qualities of food. This process is altered by diet-induced obesity, but the causes and mechanisms are poorly understood. Here, we exploited the relative simplicity and wealth of knowledge about the D. melanogaster reinforcement learning network, the mushroom body, in order to study the relationship between the dietary environment, dopamine-induced plasticity, and food associations. We show flies that are fed a high-sugar diet cannot make associations between sensory cues and the rewarding properties of sugar. This deficit was caused by diet exposure, not fat accumulation, and specifically by lower dopamine-induced plasticity onto mushroom body output neurons (MBONs) during learning. Importantly, food memories dynamically tune the output of MBONs during eating, which instead remains fixed in sugar-diet animals. Interestingly, manipulating the activity of MBONs influenced eating and fat mass, depending on the diet. Altogether, this work advances our fundamental understanding of the mechanisms, causes, and consequences of the dietary environment on reinforcement learning and ingestive behavior.

Sleep benefits different stages of memory in Drosophila

Understanding the physiological mechanisms that modulate memory acquisition and consolidation remains among the most ambitious questions in neuroscience. Massive efforts have been dedicated to deciphering how experience affects behavior, and how different physiological and sensory phenomena modulate memory. Our ability to encode, consolidate and retrieve memories depends on internal drives, and sleep stands out among the physiological processes that affect memory: one of the most relatable benefits of sleep is the aiding of memory that occurs in order to both prepare the brain to learn new information, and after a learning task, to consolidate those new memories. Drosophila lends itself to the study of the interactions between memory and sleep. The fruit fly provides incomparable genetic resources, a mapped connectome, and an existing framework of knowledge on the molecular, cellular, and circuit mechanisms of memory and sleep, making the fruit fly a remarkable model to decipher the sophisticated regulation of learning and memory by the quantity and quality of sleep. Research in Drosophila has stablished not only that sleep facilitates learning in wild-type and memory-impaired animals, but that sleep deprivation interferes with the acquisition of new memories. In addition, it is well-accepted that sleep is paramount in memory consolidation processes. Finally, studies in Drosophila have shown that that learning itself can promote sleep drive. Nevertheless, the molecular and network mechanisms underlying this intertwined relationship are still evasive. Recent remarkable work has shed light on the neural substrates that mediate sleep-dependent memory consolidation. In a similar way, the mechanistic insights of the neural switch control between sleep-dependent and sleep-independent consolidation strategies were recently described. This review will discuss the regulation of memory by sleep in Drosophila, focusing on the most recent advances in the field and pointing out questions awaiting to be investigated.

Locomotor and olfactory responses in dopamine neurons of the Drosophila superior-lateral brain

The Drosophila brain contains about 50 distinct morphological types of dopamine neurons.^1,2,3,4 Physiological studies of Drosophila dopamine neurons have been largely limited to one brain region, the mushroom body,^{5,6,7,8,9,10,11,12,13} where they are implicated in learning.^{14,15,16,17,18} By comparison, we know little about the physiology of other Drosophila dopamine neurons. Interestingly, a recent whole-brain imaging study found that dopamine neuron activity in several fly brain regions is correlated with locomotion.¹⁹ This is notable because many dopamine neurons in the rodent brain are also correlated with locomotion or other movements^{20,21,22,23,24,25,26,27,28,29,30}; however, most rodent studies have focused on learned and rewarded behaviors, and few have investigated dopamine neuron activity during spontaneous (self-timed) movements. In this study, we monitored dopamine neurons in the Drosophila brain during self-timed locomotor movements, focusing on several previously uncharacterized cell types that arborize in the superior-lateral brain, specifically the lateral horn and superior-lateral protocerebrum. We found that activity of all of these dopamine neurons correlated with spontaneous fluctuations in walking speed, with different cell types showing different speed correlations. Some dopamine neurons also responded to odors, but these responses were suppressed by repeated odor encounters. Finally, we found that the same identifiable dopamine neuron can encode different combinations of locomotion and odor in different individuals. If these dopamine neurons promote synaptic plasticity-like the dopamine neurons of the mushroom body-then, their tuning profiles would imply that plasticity depends on a flexible integration of sensory signals, motor signals, and recent experience.

Connectomics and the neural basis of behaviour

Methods to acquire and process synaptic-resolution electron-microscopy datasets have progressed very rapidly, allowing production and annotation of larger, more complete connectomes. More accurate neuronal matching techniques are enriching cell type data with gene expression, neuron activity, behaviour and developmental information, providing ways to test hypotheses of circuit function. In a variety of behaviours such as learned and innate olfaction, navigation and sexual behaviour, connectomics has already revealed interconnected modules with a hierarchical structure, recurrence and integration of sensory streams. Comparing individual connectomes to determine which circuit features are robust and which are variable is one key research area; new work in comparative connectomics across development, experience, sex and species will establish strong links between neuronal connectivity and brain function.

Structured sampling of olfactory input by the fly mushroom body

Associative memory formation and recall in the fruit fly Drosophila melanogaster is subserved by the mushroom body (MB). Upon arrival in the MB, sensory information undergoes a profound transformation from broadly tuned and stereotyped odorant responses in the olfactory projection neuron (PN) layer to narrowly tuned and nonstereotyped responses in the Kenyon cells (KCs). Theory and experiment suggest that this transformation is implemented by random connectivity between KCs and PNs. However, this hypothesis has been challenging to test, given the difficulty of mapping synaptic connections between large numbers of brain-spanning neurons. Here, we used a recent whole-brain electron microscopy volume of the adult fruit fly to map PN-to-KC connectivity at synaptic resolution. The PN-KC connectome revealed unexpected structure, with preponderantly food-responsive PN types converging at above-chance levels on downstream KCs. Axons of the overconvergent PN types tended to arborize near one another in the MB main calyx, making local KC dendrites more likely to receive input from those types. Overconvergent PN types preferentially co-arborize and connect with dendrites of αβ and α'β' KC subtypes. Computational simulation of the observed network showed degraded discrimination performance compared with a random network, except when all signal flowed through the overconvergent, primarily food-responsive PN types. Additional theory and experiment will be needed to fully characterize the impact of the observed non-random network structure on associative memory formation and recall.

Visualization of learning-induced synaptic plasticity in output neurons of the Drosophila mushroom body γ-lobe

By learning, through experience, which stimuli coincide with dangers, it is possible to predict outcomes and act pre-emptively to ensure survival. In insects, this process is localized to the mushroom body (MB), the circuitry of which facilitates the coincident detection of sensory stimuli and punishing or rewarding cues and, downstream, the execution of appropriate learned behaviors. Here, we focused our attention on the mushroom body output neurons (MBONs) of the γ-lobes that act as downstream synaptic partners of the MB γ-Kenyon cells (KCs) to ask how the output of the MB γ-lobe is shaped by olfactory associative conditioning, distinguishing this from non-associative stimulus exposure effects, and without the influence of downstream modulation. This was achieved by employing a subcellularly localized calcium sensor to specifically monitor activity at MBON postsynaptic sites. Therein, we identified a robust associative modulation within only one MBON postsynaptic compartment (MBON-γ1pedc > α/β), which displayed a suppressed postsynaptic response to an aversively paired odor. While this MBON did not undergo non-associative modulation, the reverse was true across the remainder of the γ-lobe, where general odor-evoked adaptation was observed, but no conditioned odor-specific modulation. In conclusion, associative synaptic plasticity underlying aversive olfactory learning is localized to one distinct synaptic γKC-to-γMBON connection.

Age-related memory vulnerability to interfering stimuli is caused by gradual loss of MAPK-dependent protection in Drosophila

Age‐related memory impairment (AMI) is a common phenomenon across species. Vulnerability to interfering stimuli has been proposed to be an important cause of AMI. However, the molecular mechanisms underlying this vulnerability‐related AMI remain unknown. Here we show that learning‐activated MAPK signals are gradually lost with age, leading to vulnerability‐related AMI in Drosophila. Young flies (2‐ or 3‐day‐old) exhibited a significant increase in phosphorylated MAPK levels within 15 min after learning, whereas aged flies (25‐day‐old) did not. Compared to 3‐day‐old flies, significant 1 h memory impairments were observed in 15‐, 20‐, and 30‐day‐old flies, but not in 10‐day‐old flies. However, with post‐learning interfering stimuli such as cooling or electric stimuli, 10‐day‐old flies had worse memory performance at 1 h than 3‐day‐old flies, showing a premature AMI phenomenon. Increasing learning‐activated MAPK signals through acute transgene expression in mushroom body (MB) neurons restored physiological trace of 1 h memory in a pair of MB output neurons in aged flies. Decreasing such signals in young flies mimicked the impairment of 1 h memory trace in aged flies. Restoring learning‐activated MAPK signals in MB neurons in aged flies significantly suppressed AMI even with interfering stimuli. Thus, our data suggest that age‐related loss of learning‐activated neuronal MAPK signals causes memory vulnerability to interfering stimuli, thereby leading to AMI.

Pairing-Dependent Plasticity in a Dissected Fly Brain Is Input-Specific and Requires Synaptic CaMKII Enrichment and Nighttime Sleep

In Drosophila, in vivo functional imaging studies revealed that associative memory formation is coupled to a cascade of neural plasticity events in distinct compartments of the mushroom body (MB). In-depth investigation of the circuit dynamics, however, will require an ex vivo model that faithfully mirrors these events to allow direct manipulations of circuit elements that are inaccessible in the intact fly. The current ex vivo models have been able to reproduce the fundamental plasticity of aversive short-term memory, a potentiation of the MB intrinsic neuron (Kenyon cells [KCs]) responses after artificial learning ex vivo However, this potentiation showed different localization and encoding properties from those reported in vivo and failed to generate the previously reported suppression plasticity in the MB output neurons (MBONs). Here, we develop an ex vivo model using the female Drosophila brain that recapitulates behaviorally evoked plasticity in the KCs and MBONs. We demonstrate that this plasticity accurately localizes to the MB α'3 compartment and is encoded by a coincidence between KC activation and dopaminergic input. The formed plasticity is input-specific, requiring pairing of the conditioned stimulus and unconditioned stimulus pathways; hence, we name it pairing-dependent plasticity. Pairing-dependent plasticity formation requires an intact CaMKII gene and is blocked by previous-night sleep deprivation but is rescued by rebound sleep. In conclusion, we show that our ex vivo preparation recapitulates behavioral and imaging results from intact animals and can provide new insights into mechanisms of memory formation at the level of molecules, circuits, and brain state.SIGNIFICANCE STATEMENT The mammalian ex vivo LTP model enabled in-depth investigation of the hippocampal memory circuit. We develop a parallel model to study the Drosophila mushroom body (MB) memory circuit. Pairing activation of the conditioned stimulus and unconditioned stimulus pathways in dissected brains induces a potentiation pairing-dependent plasticity (PDP) in the axons of α'β' Kenyon cells and a suppression PDP in the dendrites of their postsynaptic MB output neurons, localized in the MB α'3 compartment. This PDP is input-specific and requires the 3' untranslated region of CaMKII Interestingly, ex vivo PDP carries information about the animal's experience before dissection; brains from sleep-deprived animals fail to form PDP, whereas those from animals who recovered 2 h of their lost sleep form PDP.

Interplay between metabolic energy regulation and memory pathways in Drosophila

Regulating energy metabolism is critical to maintain homeostasis of cellular and systemic functions. In the brain, specialised centres for energy storage regulation finely communicate with the periphery and integrate signals about internal states. As a result, the behavioural responses can be directly adjusted accordingly to the energetic demands. In the fruit fly Drosophila melanogaster, one of these regulatory centres is the mushroom bodies (MBs), a brain region involved in olfactory memory. The integration of metabolic cues by the MBs has a crucial impact on learned behaviour. In this review, we explore recent advances supporting the interplay between energy metabolism and memory establishment, as well as the instructive role of energy during the switch between memory phases.

Honey bees can store and retrieve independent memory traces after complex experiences that combine appetitive and aversive associations

Real-world experiences do often mix appetitive and aversive events. Understanding the ability of animals to extract, store and use this information is an important issue in neurobiology. We used honey bees as model organism to study learning and memory after a differential conditioning that combines appetitive and aversive training trials. First of all, we describe an aversive conditioning paradigm that constitutes a clear opposite of the well known appetitive olfactory conditioning of the proboscis extension response. A neutral odour is presented paired with the bitter substance quinine. Aversive memory is evidenced later as an odour-specific impairment in appetitive conditioning. Then we tested the effect of mixing appetitive and aversive conditioning trials distributed along the same training session. Differential conditioning protocols like this were used before to study the ability to discriminate odours, however they were not focused on whether appetitive and aversive memories are formed. We found that after a differential conditioning, honey bees establish independent appetitive and aversive memories that do not interfere with each other during acquisition or storage. Finally, we moved the question forward to retrieval and memory expression to evaluate what happens when appetitive and the aversive learned odours are mixed during test. Interestingly, opposite memories compete in a way that they do not cancel each other out. Honey bees showed the ability to switch from expressing appetitive to aversive memory depending on their satiation level.

An incentive circuit for memory dynamics in the mushroom body of Drosophila melanogaster

Insects adapt their response to stimuli, such as odours, according to their pairing with positive or negative reinforcements, such as sugar or shock. Recent electrophysiological and imaging findings in Drosophila melanogaster allow detailed examination of the neural mechanisms supporting the acquisition, forgetting, and assimilation of memories. We propose that this data can be explained by the combination of a dopaminergic plasticity rule that supports a variety of synaptic strength change phenomena, and a circuit structure (derived from neuroanatomy) between dopaminergic and output neurons that creates different roles for specific neurons. Computational modelling shows that this circuit allows for rapid memory acquisition, transfer from short term to long term, and exploration/exploitation trade-off. The model can reproduce the observed changes in the activity of each of the identified neurons in conditioning paradigms and can be used for flexible behavioural control.

From Biological Synapses to “Intelligent” Robots

This selective review explores biologically inspired learning as a model for intelligent robot control and sensing technology on the basis of specific examples. Hebbian synaptic learning is discussed as a functionally relevant model for machine learning and intelligence, as explained on the basis of examples from the highly plastic biological neural networks of invertebrates and vertebrates. Its potential for adaptive learning and control without supervision, the generation of functional complexity, and control architectures based on self-organization is brought forward. Learning without prior knowledge based on excitatory and inhibitory neural mechanisms accounts for the process through which survival-relevant or task-relevant representations are either reinforced or suppressed. The basic mechanisms of unsupervised biological learning drive synaptic plasticity and adaptation for behavioral success in living brains with different levels of complexity. The insights collected here point toward the Hebbian model as a choice solution for “intelligent” robotics and sensor systems.