Dopaminergic neurons write and update memories with cell-type-specific rules

Behavioral Modulation by Spontaneous Activity of Dopamine Neurons

Dopamine modulates a variety of animal behaviors that range from sleep and learning to courtship and aggression. Besides its well-known phasic firing to natural reward, a substantial number of dopamine neurons (DANs) are known to exhibit ongoing intrinsic activity in the absence of an external stimulus. While accumulating evidence points at functional implications for these intrinsic "spontaneous activities" of DANs in cognitive processes, a causal link to behavior and its underlying mechanisms has yet to be elucidated. Recent physiological studies in the model organism Drosophila melanogaster have uncovered that DANs in the fly brain are also spontaneously active, and that this activity reflects the behavioral/internal states of the animal. Strikingly, genetic manipulation of basal DAN activity resulted in behavioral alterations in the fly, providing critical evidence that links spontaneous DAN activity to behavioral states. Furthermore, circuit-level analyses have started to reveal cellular and molecular mechanisms that mediate or regulate spontaneous DAN activity. Through reviewing recent findings in different animals with the major focus on flies, we will discuss potential roles of this physiological phenomenon in directing animal behaviors.

Learning from connectomics on the fly

Parallels between invertebrates and vertebrates in nervous system development, organisation and circuits are powerful reasons to use insects to study the mechanistic basis of behaviour. The last few years have seen the generation in Drosophila melanogaster of very large light microscopy data sets, genetic driver lines and tools to report or manipulate neural activity. These resources in conjunction with computational tools are enabling large scale characterisation of neuronal types and their functional properties. These are complemented by 3D electron microscopy, providing synaptic resolution data. A whole brain connectome of the fly larva is approaching completion based on manual reconstruction of electron-microscopy data. An adult whole brain dataset is already publicly available and focussed reconstruction is under way, but its 40× greater volume would require ∼500-5000 person-years of manual labour. Nevertheless rapid technical improvements in imaging and especially automated segmentation will likely deliver a complete adult connectome in the next 5 years. To enhance our understanding of the circuit basis of behaviour, light and electron microscopy outputs must be integrated with functional and physiological information into comprehensive databases. We review presently available data, tools and opportunities in Drosophila. We then consider the limits and potential of future progress and how this may impact neuroscience in rich model systems provided by larger insects and vertebrates.

Dissection of the Drosophila neuropeptide F circuit using a high-throughput two-choice assay

In their classic experiments, Olds and Milner showed that rats learn to lever press to receive an electric stimulus in specific brain regions. This led to the identification of mammalian reward centers. Our interest in defining the neuronal substrates of reward perception in the fruit fly Drosophila melanogaster prompted us to develop a simpler experimental approach wherein flies could implement behavior that induces self-stimulation of specific neurons in their brains. The high-throughput assay employs optogenetic activation of neurons when the fly occupies a specific area of a behavioral chamber, and the flies' preferential occupation of this area reflects their choosing to experience optogenetic stimulation. Flies in which neuropeptide F (NPF) neurons are activated display preference for the illuminated side of the chamber. We show that optogenetic activation of NPF neuron is rewarding in olfactory conditioning experiments and that the preference for NPF neuron activation is dependent on NPF signaling. Finally, we identify a small subset of NPF-expressing neurons located in the dorsomedial posterior brain that are sufficient to elicit preference in our assay. This assay provides the means for carrying out unbiased screens to map reward neurons in flies.

The complete connectome of a learning and memory centre in an insect brain

Associating stimuli with positive or negative reinforcement is essential for survival, but a complete wiring diagram of a higher-order circuit supporting associative memory has not been previously available. Here we reconstruct one such circuit at synaptic resolution, the Drosophila larval mushroom body. We find that most Kenyon cells integrate random combinations of inputs but that a subset receives stereotyped inputs from single projection neurons. This organization maximizes performance of a model output neuron on a stimulus discrimination task. We also report a novel canonical circuit in each mushroom body compartment with previously unidentified connections: reciprocal Kenyon cell to modulatory neuron connections, modulatory neuron to output neuron connections, and a surprisingly high number of recurrent connections between Kenyon cells. Stereotyped connections found between output neurons could enhance the selection of learned behaviours. The complete circuit map of the mushroom body should guide future functional studies of this learning and memory centre.

Long-term memory requires sequential protein synthesis in three subsets of mushroom body output neurons in Drosophila

Creating long-term memory (LTM) requires new protein synthesis to stabilize learning-induced synaptic changes in the brain. In the fruit fly, Drosophila melanogaster, aversive olfactory learning forms several phases of labile memory to associate an odor with coincident punishment in the mushroom body (MB). It remains unclear how the brain consolidates early labile memory into LTM. Here, we survey 183 Gal4 lines containing almost all 21 distinct types of MB output neurons (MBONs) and show that sequential synthesis of learning-induced proteins occurs at three types of MBONs. Downregulation of oo18 RNA-binding proteins (ORBs) in any of these MBONs impaired LTM. And, neurotransmission outputs from these MBONs are all required during LTM retrieval. Together, these results suggest an LTM consolidation model in which transient neural activities of early labile memory in the MB are consolidated into stable LTM at a few postsynaptic MBONs through sequential ORB-regulated local protein synthesis.

A connectome of a learning and memory center in the adult Drosophila brain

Understanding memory formation, storage and retrieval requires knowledge of the underlying neuronal circuits. In Drosophila, the mushroom body (MB) is the major site of associative learning. We reconstructed the morphologies and synaptic connections of all 983 neurons within the three functional units, or compartments, that compose the adult MB’s α lobe, using a dataset of isotropic 8 nm voxels collected by focused ion-beam milling scanning electron microscopy. We found that Kenyon cells (KCs), whose sparse activity encodes sensory information, each make multiple en passant synapses to MB output neurons (MBONs) in each compartment. Some MBONs have inputs from all KCs, while others differentially sample sensory modalities. Only 6% of KC>MBON synapses receive a direct synapse from a dopaminergic neuron (DAN). We identified two unanticipated classes of synapses, KC>DAN and DAN>MBON. DAN activation produces a slow depolarization of the MBON in these DAN>MBON synapses and can weaken memory recall.

DOI:http://dx.doi.org/10.7554/eLife.26975.001

Trace Conditioning in Drosophila Induces Associative Plasticity in Mushroom Body Kenyon Cells and Dopaminergic Neurons

Dopaminergic neurons (DANs) signal punishment and reward during associative learning. In mammals, DANs show associative plasticity that correlates with the discrepancy between predicted and actual reinforcement (prediction error) during classical conditioning. Also in insects, such as Drosophila, DANs show associative plasticity that is, however, less understood. Here, we study associative plasticity in DANs and their synaptic partners, the Kenyon cells (KCs) in the mushroom bodies (MBs), while training Drosophila to associate an odorant with a temporally separated electric shock (trace conditioning). In most MB compartments DANs strengthened their responses to the conditioned odorant relative to untrained animals. This response plasticity preserved the initial degree of similarity between the odorant- and the shock-induced spatial response patterns, which decreased in untrained animals. Contrary to DANs, KCs (α'/β'-type) decreased their responses to the conditioned odorant relative to untrained animals. We found no evidence for prediction error coding by DANs during conditioning. Rather, our data supports the hypothesis that DAN plasticity encodes conditioning-induced changes in the odorant's predictive power.

Representations of Novelty and Familiarity in a Mushroom Body Compartment

Animals exhibit a behavioral response to novel sensory stimuli about which they have no prior knowledge. We have examined the neural and behavioral correlates of novelty and familiarity in the olfactory system of Drosophila. Novel odors elicit strong activity in output neurons (MBONs) of the α'3 compartment of the mushroom body that is rapidly suppressed upon repeated exposure to the same odor. This transition in neural activity upon familiarization requires odor-evoked activity in the dopaminergic neuron innervating this compartment. Moreover, exposure of a fly to novel odors evokes an alerting response that can also be elicited by optogenetic activation of α'3 MBONs. Silencing these MBONs eliminates the alerting behavior. These data suggest that the α'3 compartment plays a causal role in the behavioral response to novel and familiar stimuli as a consequence of dopamine-mediated plasticity at the Kenyon cell-MBONα'3 synapse.

What can tiny mushrooms in fruit flies tell us about learning and memory?

Nervous systems have evolved to translate external stimuli into appropriate behavioral responses. In an ever-changing environment, flexible adjustment of behavioral choice by experience-dependent learning is essential for the animal's survival. Associative learning is a simple form of learning that is widely observed from worms to humans. To understand the whole process of learning, we need to know how sensory information is represented and transformed in the brain, how it is changed by experience, and how the changes are reflected on motor output. To tackle these questions, studying numerically simple invertebrate nervous systems has a great advantage. In this review, I will feature the Pavlovian olfactory learning in the fruit fly, Drosophila melanogaster. The mushroom body is a key brain area for the olfactory learning in this organism. Recently, comprehensive anatomical information and the genetic tool sets were made available for the mushroom body circuit. This greatly accelerated the physiological understanding of the learning process. One of the key findings was dopamine-induced long-term synaptic plasticity that can alter the representations of stimulus valence. I will mostly focus on the new studies within these few years and discuss what we can possibly learn about the vertebrate systems from this model organism.

Neuromodulation and Strategic Action Choice in Drosophila Aggression

In this review, I discuss current knowledge and outstanding questions on the neuromodulators that influence aggressive behavior of the fruit fly Drosophila melanogaster. I first present evidence that Drosophila exchange information during an agonistic interaction and choose appropriate actions based on this information. I then discuss the influence of several biogenic amines and neuropeptides on aggressive behavior. One striking characteristic of neuromodulation is that it can configure a neural circuit dynamically, enabling one circuit to generate multiple outcomes. I suggest a consensus effect of each neuromodulatory molecule on Drosophila aggression, as well as effects of receptor proteins where relevant data are available. Lastly, I consider neuromodulation in the context of strategic action choices during agonistic interactions. Genetic components of neuromodulatory systems are highly conserved across animals, suggesting that molecular and cellular mechanisms controlling Drosophila aggression can shed light on neural principles governing action choice during social interactions.

Suppression of a single pair of mushroom body output neurons in Drosophila triggers aversive associations

Memory includes the processes of acquisition, consolidation and retrieval. In the study of aversive olfactory memory in Drosophila melanogaster, flies are first exposed to an odor (conditioned stimulus, CS+) that is associated with an electric shock (unconditioned stimulus, US), then to another odor (CS−) without the US, before allowing the flies to choose to avoid one of the two odors. The center for memory formation is the mushroom body which consists of Kenyon cells (KCs), dopaminergic neurons (DANs) and mushroom body output neurons (MBONs). However, the roles of individual neurons are not fully understood. We focused on the role of a single pair of GABAergic neurons (MBON‐γ1pedc) and found that it could inhibit the effects of DANs, resulting in the suppression of aversive memory acquisition during the CS− odor presentation, but not during the CS+ odor presentation. We propose that MBON‐γ1pedc suppresses the DAN‐dependent effect that can convey the aversive US during the CS− odor presentation, and thereby prevents an insignificant stimulus from becoming an aversive US.

Dopaminergic rules of engagement for memory in Drosophila

Dopamine is associated with a variety of conserved responses across species including locomotion, sleep, food consumption, aggression, courtship, addiction and several forms of appetitive and aversive memory. Historically, dopamine has been most prominently associated with dynamics underlying reward, punishment, or salience. Recent emerging evidence from Drosophila supports a role in all of these functions, as well as additional roles in the interplay between external sensation and internal states and forgetting of the very memories dopamine helped encode. We discuss how cell-specific resolution and manipulation are elucidating the rules of dopamine's involvement in encoding valence and memory.

Suppression of Dopamine Neurons Mediates Reward

Massive activation of dopamine neurons is critical for natural reward and drug abuse. In contrast, the significance of their spontaneous activity remains elusive. In Drosophila melanogaster, depolarization of the protocerebral anterior medial (PAM) cluster dopamine neurons en masse signals reward to the mushroom body (MB) and drives appetitive memory. Focusing on the functional heterogeneity of PAM cluster neurons, we identified that a single class of PAM neurons, PAM-γ3, mediates sugar reward by suppressing their own activity. PAM-γ3 is selectively required for appetitive olfactory learning, while activation of these neurons in turn induces aversive memory. Ongoing activity of PAM-γ3 gets suppressed upon sugar ingestion. Strikingly, transient inactivation of basal PAM-γ3 activity can substitute for reward and induces appetitive memory. Furthermore, we identified the satiety-signaling neuropeptide Allatostatin A (AstA) as a key mediator that conveys inhibitory input onto PAM-γ3. Our results suggest the significance of basal dopamine release in reward signaling and reveal a circuit mechanism for negative regulation.

Dopamine neurons in the midbrain of mammals fire action potentials in response to rewarding stimuli, while punitive stimuli or omission of reward suppress their activity. Different signs in the activity of dopamine neurons thus can encode appetitive and aversive values; however, how these bidirectional activities directly relate to behavior has yet to be elucidated. In fruit flies Drosophila, en masse activation of dopaminergic neurons in the protocerebral anterior medial (PAM) cluster has been shown to signal reward. Here, we demonstrate that a specific sub-class of these dopaminergic neurons, called PAM-γ3, mediates both aversive and appetitive reinforcement through activation and suppression of their activity, respectively. Notably, transient inactivation of the basal activity of PAM-γ3 neurons substitutes for reward and induces appetitive memory formation. Interestingly, we found that Allatostatin A, a neuropeptide that signals satiety, conveys inhibitory input onto PAM-γ3 neurons. Our results highlight the bidirectional activity of defined dopaminergic neurons, which underlies encoding of behaviorally relevant appetitive and aversive values.

Transient suppression of a specific subset of dopamine neurons signals reward in the fruit fly Drosophila, suggesting that basal dopamine activity underlies behaviorally relevant valence coding.