Heterosynaptic Plasticity Underlies Aversive Olfactory Learning in Drosophila

Neuromodulation and Strategic Action Choice in Drosophila Aggression

In this review, I discuss current knowledge and outstanding questions on the neuromodulators that influence aggressive behavior of the fruit fly Drosophila melanogaster. I first present evidence that Drosophila exchange information during an agonistic interaction and choose appropriate actions based on this information. I then discuss the influence of several biogenic amines and neuropeptides on aggressive behavior. One striking characteristic of neuromodulation is that it can configure a neural circuit dynamically, enabling one circuit to generate multiple outcomes. I suggest a consensus effect of each neuromodulatory molecule on Drosophila aggression, as well as effects of receptor proteins where relevant data are available. Lastly, I consider neuromodulation in the context of strategic action choices during agonistic interactions. Genetic components of neuromodulatory systems are highly conserved across animals, suggesting that molecular and cellular mechanisms controlling Drosophila aggression can shed light on neural principles governing action choice during social interactions.

Suppression of a single pair of mushroom body output neurons in Drosophila triggers aversive associations

Memory includes the processes of acquisition, consolidation and retrieval. In the study of aversive olfactory memory in Drosophila melanogaster, flies are first exposed to an odor (conditioned stimulus, CS+) that is associated with an electric shock (unconditioned stimulus, US), then to another odor (CS−) without the US, before allowing the flies to choose to avoid one of the two odors. The center for memory formation is the mushroom body which consists of Kenyon cells (KCs), dopaminergic neurons (DANs) and mushroom body output neurons (MBONs). However, the roles of individual neurons are not fully understood. We focused on the role of a single pair of GABAergic neurons (MBON‐γ1pedc) and found that it could inhibit the effects of DANs, resulting in the suppression of aversive memory acquisition during the CS− odor presentation, but not during the CS+ odor presentation. We propose that MBON‐γ1pedc suppresses the DAN‐dependent effect that can convey the aversive US during the CS− odor presentation, and thereby prevents an insignificant stimulus from becoming an aversive US.

Optimal Degrees of Synaptic Connectivity

Synaptic connectivity varies widely across neuronal types. Cerebellar granule cells receive five orders of magnitude fewer inputs than the Purkinje cells they innervate, and cerebellum-like circuits, including the insect mushroom body, also exhibit large divergences in connectivity. In contrast, the number of inputs per neuron in cerebral cortex is more uniform and large. We investigate how the dimension of a representation formed by a population of neurons depends on how many inputs each neuron receives and what this implies for learning associations. Our theory predicts that the dimensions of the cerebellar granule-cell and Drosophila Kenyon-cell representations are maximized at degrees of synaptic connectivity that match those observed anatomically, showing that sparse connectivity is sometimes superior to dense connectivity. When input synapses are subject to supervised plasticity, however, dense wiring becomes advantageous, suggesting that the type of plasticity exhibited by a set of synapses is a major determinant of connection density.

Long-range projection neurons in the taste circuit of Drosophila

Taste compounds elicit innate feeding behaviors and act as rewards or punishments to entrain other cues. The neural pathways by which taste compounds influence innate and learned behaviors have not been resolved. Here, we identify three classes of taste projection neurons (TPNs) in Drosophila melanogaster distinguished by their morphology and taste selectivity. TPNs receive input from gustatory receptor neurons and respond selectively to sweet or bitter stimuli, demonstrating segregated processing of different taste modalities. Activation of TPNs influences innate feeding behavior, whereas inhibition has little effect, suggesting parallel pathways. Moreover, two TPN classes are absolutely required for conditioned taste aversion, a learned behavior. The TPNs essential for conditioned aversion project to the superior lateral protocerebrum (SLP) and convey taste information to mushroom body learning centers. These studies identify taste pathways from sensory detection to higher brain that influence innate behavior and are essential for learned responses to taste compounds.

DOI:http://dx.doi.org/10.7554/eLife.23386.001

Dopaminergic rules of engagement for memory in Drosophila

Dopamine is associated with a variety of conserved responses across species including locomotion, sleep, food consumption, aggression, courtship, addiction and several forms of appetitive and aversive memory. Historically, dopamine has been most prominently associated with dynamics underlying reward, punishment, or salience. Recent emerging evidence from Drosophila supports a role in all of these functions, as well as additional roles in the interplay between external sensation and internal states and forgetting of the very memories dopamine helped encode. We discuss how cell-specific resolution and manipulation are elucidating the rules of dopamine's involvement in encoding valence and memory.

A Simple Computational Model of the Bee Mushroom Body Can Explain Seemingly Complex Forms of Olfactory Learning and Memory

Honeybees are models for studying how animals with relatively small brains accomplish complex cognition, displaying seemingly advanced (or "non-elemental") learning phenomena involving multiple conditioned stimuli. These include "peak shift" [1-4]-where animals not only respond to entrained stimuli, but respond even more strongly to similar ones that are farther away from non-rewarding stimuli. Bees also display negative and positive patterning discrimination [5], responding in opposite ways to mixtures of two odors than to individual odors. Since Pavlov, it has often been assumed that such phenomena are more complex than simple associate learning. We present a model of connections between olfactory sensory input and bees' mushroom bodies [6], incorporating empirically determined properties of mushroom body circuitry (random connectivity [7], sparse coding [8], and synaptic plasticity [9, 10]). We chose not to optimize the model's parameters to replicate specific behavioral phenomena, because we were interested in the emergent cognitive capacities that would pop out of a network constructed solely based on empirical neuroscientific information and plausible assumptions for unknown parameters. We demonstrate that the circuitry mediating "simple" associative learning can also replicate the various non-elemental forms of learning mentioned above and can effectively multi-task by replicating a range of different learning feats. We found that PN-KC synaptic plasticity is crucial in controlling the generalization-discrimination trade-off-it facilitates peak shift and hinders patterning discrimination-and that PN-to-KC connection number can affect this trade-off. These findings question the notion that forms of learning that have been regarded as "higher order" are computationally more complex than "simple" associative learning.

The Transition to Minimal Consciousness through the Evolution of Associative Learning

The minimal state of consciousness is sentience. This includes any phenomenal sensory experience - exteroceptive, such as vision and olfaction; interoceptive, such as pain and hunger; or proprioceptive, such as the sense of bodily position and movement. We propose unlimited associative learning (UAL) as the marker of the evolutionary transition to minimal consciousness (or sentience), its phylogenetically earliest sustainable manifestation and the driver of its evolution. We define and describe UAL at the behavioral and functional level and argue that the structural-anatomical implementations of this mode of learning in different taxa entail subjective feelings (sentience). We end with a discussion of the implications of our proposal for the distribution of consciousness in the animal kingdom, suggesting testable predictions, and revisiting the ongoing debate about the function of minimal consciousness in light of our approach.

Factors influencing aversive learning in the oriental fruit fly, Bactrocera dorsalis

Parameters such as the intensity of conditioned and unconditioned stimuli, the inter-trial interval, and starvation time can influence learning. In this study, the parameters that govern aversive learning in the oriental fruit fly, Bactrocera dorsalis, a serious pest of fruits and vegetables, were examined. Male flies were trained to associate the attractive odorant methyl eugenol, a male lure, with a food punishment, sodium chloride solution, and the conditioned suppression of the proboscis-extension response was investigated. We found that high methyl eugenol concentrations support a stronger association. With increasing concentrations of sodium chloride solution, a steady decrease of proboscis-extension response during six training trials was observed. A high level of learning was achieved with an inter-trial interval of 1-10 min. However, extending the inter-trial interval to 15 min led to reduced learning. No effect of physiological status (starvation time) on learning performance was detected, nor was any non-associative learning effect induced by the repeat presentation of odor or punishment alone. The memory formed after six training trials could be retained for at least 3 h. Our results indicate that aversive learning by oriental fruit flies can be affected by odor, punishment concentration and inter-trial interval.

A new brain dopamine-deficient Drosophila and its pharmacological and genetic rescue

Dopamine (DA) is a neurotransmitter with conserved behavioral roles between invertebrate and vertebrate animals. In addition to its neural functions, in insects DA is a critical substrate for cuticle pigmentation and hardening. Drosophila tyrosine hydroxylase (DTH) is the rate limiting enzyme for DA biosynthesis. Viable brain DA-deficient flies were previously generated using tissue-selective GAL4-UAS binary expression rescue of a DTH null mutation and these flies show specific behavioral impairments. To circumvent the limitations of rescue via binary expression, here we achieve rescue utilizing genomically integrated mutant DTH. As expected, our DA-deficient flies have no detectable DTH or DA in the brain, and show reduced locomotor activity. This deficit can be rescued by l-DOPA/carbidopa feeding, similar to human Parkinson's disease treatment. Genetic rescue via GAL4/UAS-DTH was also successful, although this required the generation of a new UAS-DTH1 transgene devoid of most untranslated regions, as existing UAS-DTH transgenes express in the brain without a Gal4 driver via endogenous regulatory elements. A surprising finding of our newly constructed UAS-DTH1m is that it expresses DTH at an undetectable level when regulated by dopaminergic GAL4 drivers even when fully rescuing DA, indicating that DTH immunostaining is not necessarily a valid marker for DA expression. This finding necessitated optimizing DA immunohistochemistry, showing details of DA innervation to the mushroom body and the central complex. When DA rescue is limited to specific DA neurons, DA does not diffuse beyond the DTH-expressing terminals, such that DA signaling can be limited to very specific brain regions.

Developmental experience-dependent plasticity in the first synapse of the Drosophila olfactory circuit

Evidence accumulating over the past 15 years soundly refutes the dogma that the Drosophila nervous system is hardwired. The preponderance of studies reveals activity-dependent neural circuit refinement driving optimization of behavioral outputs. We describe developmental, sensory input-dependent plasticity in the brain olfactory antennal lobe, which we term long-term central adaption (LTCA). LTCA is evoked by prolonged exposure to an odorant during the first week of posteclosion life, resulting in a persistently decreased response to aversive odors and an enhanced response to attractive odors. This limited window of early-use, experience-dependent plasticity represents a critical period of olfactory circuit refinement tuned by initial sensory input. Consequent behavioral adaptations have been associated with changes in the output of olfactory projection neurons to higher brain centers. Recent studies have indicated a central role for local interneuron signaling in LTCA presentation. Genetic and molecular analyses have implicated the mRNA-binding fragile X mental retardation protein and ataxin-2 regulators, Notch trans-synaptic signaling, and cAMP signal transduction as core regulatory steps driving LTCA. In this article, we discuss the structural, functional, and behavioral changes associated with LTCA and review our current understanding of the molecular pathways underlying these developmental, experience-dependent changes in the olfactory circuitry.

Spermidine Suppresses Age-Associated Memory Impairment by Preventing Adverse Increase of Presynaptic Active Zone Size and Release

Memories are assumed to be formed by sets of synapses changing their structural or functional performance. The efficacy of forming new memories declines with advancing age, but the synaptic changes underlying age-induced memory impairment remain poorly understood. Recently, we found spermidine feeding to specifically suppress age-dependent impairments in forming olfactory memories, providing a mean to search for synaptic changes involved in age-dependent memory impairment. Here, we show that a specific synaptic compartment, the presynaptic active zone (AZ), increases the size of its ultrastructural elaboration and releases significantly more synaptic vesicles with advancing age. These age-induced AZ changes, however, were fully suppressed by spermidine feeding. A genetically enforced enlargement of AZ scaffolds (four gene-copies of BRP) impaired memory formation in young animals. Thus, in the Drosophila nervous system, aging AZs seem to steer towards the upper limit of their operational range, limiting synaptic plasticity and contributing to impairment of memory formation. Spermidine feeding suppresses age-dependent memory impairment by counteracting these age-dependent changes directly at the synapse.

Dopaminergic neurons write and update memories with cell-type-specific rules

Associative learning is thought to involve parallel and distributed mechanisms of memory formation and storage. In Drosophila, the mushroom body (MB) is the major site of associative odor memory formation. Previously we described the anatomy of the adult MB and defined 20 types of dopaminergic neurons (DANs) that each innervate distinct MB compartments (Aso et al., 2014a, 2014b). Here we compare the properties of memories formed by optogenetic activation of individual DAN cell types. We found extensive differences in training requirements for memory formation, decay dynamics, storage capacity and flexibility to learn new associations. Even a single DAN cell type can either write or reduce an aversive memory, or write an appetitive memory, depending on when it is activated relative to odor delivery. Our results show that different learning rules are executed in seemingly parallel memory systems, providing multiple distinct circuit-based strategies to predict future events from past experiences.

The good, the bad, and the hungry: how the central brain codes odor valence to facilitate food approach in Drosophila

All animals must eat in order to survive but first they must successfully locate and appraise food resources in a manner consonant with their needs. To accomplish this, external sensory information, in particular olfactory food cues, need to be detected and appropriately categorized. Recent advances in Drosophila point to the existence of parallel processing circuits within the central brain that encode odor valence, supporting approach and avoidance behaviors. Strikingly, many elements within these neural systems are subject to modification as a function of the fly's satiety state. In this review we describe those advances and their potential impact on the decision to feed.

What is memory? The present state of the engram

The mechanism of memory remains one of the great unsolved problems of biology. Grappling with the question more than a hundred years ago, the German zoologist Richard Semon formulated the concept of the engram, lasting connections in the brain that result from simultaneous “excitations”, whose precise physical nature and consequences were out of reach of the biology of his day. Neuroscientists now have the knowledge and tools to tackle this question, however, and this Forum brings together leading contemporary views on the mechanisms of memory and what the engram means today.

Aversive Learning and Appetitive Motivation Toggle Feed-Forward Inhibition in the Drosophila Mushroom Body

In Drosophila, negatively reinforcing dopaminergic neurons also provide the inhibitory control of satiety over appetitive memory expression. Here we show that aversive learning causes a persistent depression of the conditioned odor drive to two downstream feed-forward inhibitory GABAergic interneurons of the mushroom body, called MVP2, or mushroom body output neuron (MBON)-γ1pedc>α/β. However, MVP2 neuron output is only essential for expression of short-term aversive memory. Stimulating MVP2 neurons preferentially inhibits the odor-evoked activity of avoidance-directing MBONs and odor-driven avoidance behavior, whereas their inhibition enhances odor avoidance. In contrast, odor-evoked activity of MVP2 neurons is elevated in hungry flies, and their feed-forward inhibition is required for expression of appetitive memory at all times. Moreover, imposing MVP2 activity promotes inappropriate appetitive memory expression in food-satiated flies. Aversive learning and appetitive motivation therefore toggle alternate modes of a common feed-forward inhibitory MVP2 pathway to promote conditioned odor avoidance or approach.

•

Aversive learning reduces odor-specific feed-forward inhibition in mushroom body

•

Feed-forward inhibition selectively inhibits avoidance-directing neural pathways

•

Appetitive motivation increases feed-forward inhibition in the mushroom body

•

Imposing feed-forward inhibition favors appetitive memory expression

Cell-Type-Specific Transcriptome Analysis in the Drosophila Mushroom Body Reveals Memory-Related Changes in Gene Expression

Learning and memory formation in Drosophila rely on a network of neurons in the mushroom bodies (MBs). Whereas numerous studies have delineated roles for individual cell types within this network in aspects of learning or memory, whether or not these cells can also be distinguished by the genes they express remains unresolved. In addition, the changes in gene expression that accompany long-term memory formation within the MBs have not yet been studied by neuron type. Here, we address both issues by performing RNA sequencing on single cell types (harvested via patch pipets) within the MB. We discover that the expression of genes that encode cell surface receptors is sufficient to identify cell types and that a subset of these genes, required for sensory transduction in peripheral sensory neurons, is not only expressed within individual neurons of the MB in the central brain, but is also critical for memory formation.

Synaptic Vesicle Proteins and Active Zone Plasticity

Neurotransmitter is released from synaptic vesicles at the highly specialized presynaptic active zone (AZ). The complex molecular architecture of AZs mediates the speed, precision and plasticity of synaptic transmission. Importantly, structural and functional properties of AZs vary significantly, even for a given connection. Thus, there appear to be distinct AZ states, which fundamentally influence neuronal communication by controlling the positioning and release of synaptic vesicles. Vice versa, recent evidence has revealed that synaptic vesicle components also modulate organizational states of the AZ. The protein-rich cytomatrix at the active zone (CAZ) provides a structural platform for molecular interactions guiding vesicle exocytosis. Studies in Drosophila have now demonstrated that the vesicle proteins Synaptotagmin-1 (Syt1) and Rab3 also regulate glutamate release by shaping differentiation of the CAZ ultrastructure. We review these unexpected findings and discuss mechanistic interpretations of the reciprocal relationship between synaptic vesicles and AZ states, which has heretofore received little attention.

Direct neural pathways convey distinct visual information to Drosophila mushroom bodies

Previously, we demonstrated that visual and olfactory associative memories of Drosophila share mushroom body (MB) circuits (Vogt et al., 2014). Unlike for odor representation, the MB circuit for visual information has not been characterized. Here, we show that a small subset of MB Kenyon cells (KCs) selectively responds to visual but not olfactory stimulation. The dendrites of these atypical KCs form a ventral accessory calyx (vAC), distinct from the main calyx that receives olfactory input. We identified two types of visual projection neurons (VPNs) directly connecting the optic lobes and the vAC. Strikingly, these VPNs are differentially required for visual memories of color and brightness. The segregation of visual and olfactory domains in the MB allows independent processing of distinct sensory memories and may be a conserved form of sensory representations among insects.

DOI:http://dx.doi.org/10.7554/eLife.14009.001

Memory-Relevant Mushroom Body Output Synapses Are Cholinergic

Memories are stored in the fan-out fan-in neural architectures of the mammalian cerebellum and hippocampus and the insect mushroom bodies. However, whereas key plasticity occurs at glutamatergic synapses in mammals, the neurochemistry of the memory-storing mushroom body Kenyon cell output synapses is unknown. Here we demonstrate a role for acetylcholine (ACh) in Drosophila. Kenyon cells express the ACh-processing proteins ChAT and VAChT, and reducing their expression impairs learned olfactory-driven behavior. Local ACh application, or direct Kenyon cell activation, evokes activity in mushroom body output neurons (MBONs). MBON activation depends on VAChT expression in Kenyon cells and is blocked by ACh receptor antagonism. Furthermore, reducing nicotinic ACh receptor subunit expression in MBONs compromises odor-evoked activation and redirects odor-driven behavior. Lastly, peptidergic corelease enhances ACh-evoked responses in MBONs, suggesting an interaction between the fast- and slow-acting transmitters. Therefore, olfactory memories in Drosophila are likely stored as plasticity of cholinergic synapses.

•

Mushroom body Kenyon cell function requires ChAT and VAChT expression

•

Kenyon cell-released acetylcholine drives mushroom body output neurons

•

Blocking nicotinic receptors impairs mushroom body output neuron activation

•

Acetylcholine interacts with coreleased neuropeptide

Studying small brains to understand the building blocks of cognition

Cognition encompasses a range of higher-order mental processes, such as attention, working memory, and model-based decision-making. These processes are thought to involve the dynamic interaction of multiple central brain regions. A mechanistic understanding of such computations requires not only monitoring and manipulating specific neural populations during behavior, but also knowing the connectivity of the underlying circuitry. These goals are experimentally challenging in mammals, but are feasible in numerically simpler insect brains. In Drosophila melanogaster in particular, genetic tools enable precisely targeted physiology and optogenetics in actively behaving animals. In this article we discuss how these advantages are increasingly being leveraged to study abstract neural representations and sensorimotor computations that may be relevant for cognition in both insects and mammals.