Pavlovian Conditioning of Larval Drosophila: An Illustrated, Multilingual, Hands-On Manual for Odor-Taste Associative Learning in Maggots

Cognitive limits of larval Drosophila: testing for conditioned inhibition, sensory preconditioning, and second-order conditioning

Drosophila larvae are an established model system for studying the mechanisms of innate and simple forms of learned behavior. They have about 10 times fewer neurons than adult flies, and it was the low total number of their neurons that allowed for an electron microscopic reconstruction of their brain at synaptic resolution. Regarding the mushroom body, a central brain structure for many forms of associative learning in insects, it turned out that more than half of the classes of synaptic connection had previously escaped attention. Understanding the function of these circuit motifs, subsequently confirmed in adult flies, is an important current research topic. In this context, we test larval Drosophila for their cognitive abilities in three tasks that are characteristically more complex than those previously studied. Our data provide evidence for (i) conditioned inhibition, as has previously been reported for adult flies and honeybees. Unlike what is described for adult flies and honeybees, however, our data do not provide evidence for (ii) sensory preconditioning or (iii) second-order conditioning in Drosophila larvae. We discuss the methodological features of our experiments as well as four specific aspects of the organization of the larval brain that may explain why these two forms of learning are observed in adult flies and honeybees, but not in larval Drosophila.

IR76b-expressing neurons in Drosophila melanogaster are necessary for associative reward learning of an amino acid mixture

Learning where to find nutrients while at the same time avoiding toxic food is essential for survival of any animal. Using Drosophila melanogaster larvae as a study case, we investigate the role of gustatory sensory neurons expressing IR76b for associative learning of amino acids, the building blocks of proteins. We found surprising complexity in the neuronal underpinnings of sensing amino acids, and a functional division of sensory neurons. We found that the IR76b receptor is dispensable for amino acid learning, whereas the neurons expressing IR76b are specifically required for the rewarding but not the punishing effect of amino acids. This unexpected dissociation in neuronal processing of amino acids for different behavioural functions provides a study case for functional divisions of labour in gustatory systems.

Prediction error drives associative learning and conditioned behavior in a spiking model of Drosophila larva

Predicting reinforcement from sensory cues is beneficial for goal-directed behavior. In insect brains, underlying associations between cues and reinforcement, encoded by dopaminergic neurons, are formed in the mushroom body. We propose a spiking model of the Drosophila larva mushroom body. It includes a feedback motif conveying learned reinforcement expectation to dopaminergic neurons, which can compute prediction error as the difference between expected and present reinforcement. We demonstrate that this can serve as a driving force in learning. When combined with synaptic homeostasis, our model accounts for theoretically derived features of acquisition and loss of associations that depend on the intensity of the reinforcement and its temporal proximity to the cue. From modeling olfactory learning over the time course of behavioral experiments and simulating the locomotion of individual larvae toward or away from odor sources in a virtual environment, we conclude that learning driven by prediction errors can explain larval behavior.

Rewarding Capacity of Optogenetically Activating a Giant GABAergic Central-Brain Interneuron in Larval Drosophila

Larvae of the fruit fly Drosophila melanogaster are a powerful study case for understanding the neural circuits underlying behavior. Indeed, the numerical simplicity of the larval brain has permitted the reconstruction of its synaptic connectome, and genetic tools for manipulating single, identified neurons allow neural circuit function to be investigated with relative ease and precision. We focus on one of the most complex neurons in the brain of the larva (of either sex), the GABAergic anterior paired lateral neuron (APL). Using behavioral and connectomic analyses, optogenetics, Ca2+ imaging, and pharmacology, we study how APL affects associative olfactory memory. We first provide a detailed account of the structure, regional polarity, connectivity, and metamorphic development of APL, and further confirm that optogenetic activation of APL has an inhibiting effect on its main targets, the mushroom body Kenyon cells. All these findings are consistent with the previously identified function of APL in the sparsening of sensory representations. To our surprise, however, we found that optogenetically activating APL can also have a strong rewarding effect. Specifically, APL activation together with odor presentation establishes an odor-specific, appetitive, associative short-term memory, whereas naive olfactory behavior remains unaffected. An acute, systemic inhibition of dopamine synthesis as well as an ablation of the dopaminergic pPAM neurons impair reward learning through APL activation. Our findings provide a study case of complex circuit function in a numerically simple brain, and suggest a previously unrecognized capacity of central-brain GABAergic neurons to engage in dopaminergic reinforcement.SIGNIFICANCE STATEMENT The single, identified giant anterior paired lateral (APL) neuron is one of the most complex neurons in the insect brain. It is GABAergic and contributes to the sparsening of neuronal activity in the mushroom body, the memory center of insects. We provide the most detailed account yet of the structure of APL in larval Drosophila as a neurogenetically accessible study case. We further reveal that, contrary to expectations, the experimental activation of APL can exert a rewarding effect, likely via dopaminergic reward pathways. The present study both provides an example of unexpected circuit complexity in a numerically simple brain, and reports an unexpected effect of activity in central-brain GABAergic circuits.

High-resolution analysis of individual Drosophila melanogaster larvae uncovers individual variability in locomotion and its neurogenetic modulation

Neuronally orchestrated muscular movement and locomotion are defining faculties of multicellular animals. Due to its simple brain and genetic accessibility, the larva of the fruit fly Drosophila melanogaster allows one to study these processes at tractable levels of complexity. However, although the faculty of locomotion clearly pertains to the individual, most studies of locomotion in larvae use measurements aggregated across animals, or animals tested one by one, an extravagance for larger-scale analyses. This prevents grasping the inter- and intra-individual variability in locomotion and its neurogenetic determinants. Here, we present the IMBA (individual maggot behaviour analyser) for analysing the behaviour of individual larvae within groups, reliably resolving individual identity across collisions. We use the IMBA to systematically describe the inter- and intra-individual variability in locomotion of wild-type animals, and how the variability is reduced by associative learning. We then report a novel locomotion phenotype of an adhesion GPCR mutant. We further investigated the modulation of locomotion across repeated activations of dopamine neurons in individual animals, and the transient backward locomotion induced by brief optogenetic activation of the brain-descending 'mooncrawler' neurons. In summary, the IMBA is an easy-to-use toolbox allowing an unprecedentedly rich view of the behaviour and its variability of individual larvae, with utility in multiple biomedical research contexts.

An optogenetics device with smartphone video capture to introduce neurotechnology and systems neuroscience to high school students

Although neurotechnology careers are on the rise, and neuroscience curriculums have significantly grown at the undergraduate and graduate levels, increasing neuroscience and neurotechnology exposure in high school curricula has been an ongoing challenge. This is due, in part, to difficulties in converting cutting-edge neuroscience research into hands-on activities that are accessible for high school students and affordable for high school educators. Here, we describe and characterize a low-cost, easy-to-construct device to enable students to record rapid Drosophila melanogaster (fruit fly) behaviors during optogenetics experiments. The device is generated from inexpensive Arduino kits and utilizes a smartphone for video capture, making it easy to adopt in a standard biology laboratory. We validate this device is capable of replicating optogenetics experiments performed with more sophisticated setups at leading universities and institutes. We incorporate the device into a high school neuroengineering summer workshop. We find student participation in the workshop significantly enhances their understanding of key neuroscience and neurotechnology concepts, demonstrating how this device can be utilized in high school settings and undergraduate research laboratories seeking low-cost alternatives.

Associative learning in larval and adult Drosophila is impaired by the dopamine-synthesis inhibitor 3-Iodo-L-tyrosine

Across the animal kingdom, dopamine plays a crucial role in conferring reinforcement signals that teach animals about the causal structure of the world. In the fruit fly Drosophila melanogaster, dopaminergic reinforcement has largely been studied using genetics, whereas pharmacological approaches have received less attention. Here, we apply the dopamine-synthesis inhibitor 3-Iodo-L-tyrosine (3IY), which causes acute systemic inhibition of dopamine signaling, and investigate its effects on Pavlovian conditioning. We find that 3IY feeding impairs sugar-reward learning in larvae while leaving task-relevant behavioral faculties intact, and that additional feeding of a precursor of dopamine (L-3,4-dihydroxyphenylalanine, L-DOPA), rescues this impairment. Concerning a different developmental stage and for the aversive valence domain. Moreover, we demonstrate that punishment learning by activating the dopaminergic neuron PPL1-γ1pedc in adult flies is also impaired by 3IY feeding, and can likewise be rescued by L-DOPA. Our findings exemplify the advantages of using a pharmacological approach in combination with the genetic techniques available in D. melanogaster to manipulate neuronal and behavioral function.

Summary: We surveyed the effects of a dopamine-synthesis inhibitor on associative learning in larval and adult Drosophila. This approach can supplement genetic tools in investigating the conserved reinforcing function of dopamine.

Aversive teaching signals from individual dopamine neurons in larval Drosophila show qualitative differences in their temporal "fingerprint"

Dopamine serves many functions, and dopamine neurons are correspondingly diverse. We use a combination of optogenetics, behavioral experiments, and high-resolution video-tracking to probe for the functional capacities of two single, identified dopamine neurons in larval Drosophila. The DAN-f1 and the DAN-d1 neuron were recently found to carry aversive teaching signals during Pavlovian olfactory learning. We enquire into a fundamental feature of these teaching signals, namely their temporal "fingerprint". That is, receiving punishment feels bad, whereas being relieved from it feels good, and animals and humans alike learn with opposite valence about the occurrence and the termination of punishment (the same principle applies in the appetitive domain, with opposite sign). We find that DAN-f1 but not DAN-d1 can mediate such timing-dependent valence reversal: presenting an odor before DAN-f1 activation leads to learned avoidance of the odor (punishment memory), whereas presenting the odor upon termination of DAN-f1 activation leads to learned approach (relief memory). In contrast, DAN-d1 confers punishment memory only. These effects are further characterized in terms of the impact of the duration of optogenetic activation, the temporal stability of the memories thus established, and the specific microbehavioral patterns of locomotion through which they are expressed. Together with recent findings in the appetitive domain and from adult Drosophila, our results suggest that heterogeneity in the temporal fingerprint of teaching signals might be a more general principle of reinforcement processing through dopamine neurons.

Rewarding compounds identified from the medicinal plant Rhodiola rosea

Preparations of Rhodiola rosea root are widely used in traditional medicine. They can increase life span in worms and flies, and have various effects related to nervous system function in different animal species and humans. However, which of the compounds in R. rosea is mediating any one of these effects has remained unknown in most cases. Here, an analysis of the volatile and non-volatile low-molecular-weight constituents of R. rosea root samples was accompanied by an investigation of their behavioral impact on Drosophila melanogaster larvae. Rhodiola rosea root samples have an attractive smell and taste to the larvae, and exert a rewarding effect. This rewarding effect was also observed for R. rosea root extracts, and did not require activity of dopamine neurons that mediate known rewards such as sugar. Based on the chemical profiles of R. rosea root extracts and resultant fractions, a bioactivity-correlation analysis (AcorA) was performed to identify candidate rewarding compounds. This suggested positive correlations for - among related compounds - ferulic acid eicosyl ester (FAE-20) and β-sitosterol glucoside. A validation using these as pure compounds confirmed that the correlations were causal. Their rewarding effects can be observed even at low micromolar concentrations and thus at remarkably lower doses than for any known taste reward in the larva. We discuss whether similar rewarding effects, should they be observed in humans, would indicate a habit-forming or addictive potential.

Daughterless, the Drosophila orthologue of TCF4, is required for associative learning and maintenance of the synaptic proteome

Mammalian transcription factor 4 (TCF4) has been linked to schizophrenia and intellectual disabilities, such as Pitt-Hopkins syndrome (PTHS). Here, we show that similarly to mammalian TCF4, fruit fly orthologue Daughterless (Da) is expressed widely in the Drosophila brain. Furthermore, silencing of da, using several central nervous system-specific Gal4 driver lines, impairs appetitive associative learning of the larvae and leads to decreased levels of the synaptic proteins Synapsin (Syn) and Discs large 1 (Dlg1), suggesting the involvement of Da in memory formation. Here, we demonstrate that Syn and dlg1 are direct target genes of Da in adult Drosophila heads, as Da binds to the regulatory regions of these genes and the modulation of Da levels alter the levels of Syn and dlg1 mRNA. Silencing of da also affects negative geotaxis of the adult flies, suggesting the impairment of locomotor function. Overall, our findings suggest that Da regulates Drosophila larval memory and adult negative geotaxis, possibly via its synaptic target genes Syn and dlg1 These behavioural phenotypes can be further used as a PTHS model to screen for therapeutics.This article has an associated First Person interview with the first author of the paper.

Identification of Dopaminergic Neurons That Can Both Establish Associative Memory and Acutely Terminate Its Behavioral Expression

An adaptive transition from exploring the environment in search of vital resources to exploiting these resources once the search was successful is important to all animals. Here we study the neuronal circuitry that allows larval Drosophila melanogaster of either sex to negotiate this exploration-exploitation transition. We do so by combining Pavlovian conditioning with high-resolution behavioral tracking, optogenetic manipulation of individually identified neurons, and EM data-based analyses of synaptic organization. We find that optogenetic activation of the dopaminergic neuron DAN-i1 can both establish memory during training and acutely terminate learned search behavior in a subsequent recall test. Its activation leaves innate behavior unaffected, however. Specifically, DAN-i1 activation can establish associative memories of opposite valence after paired and unpaired training with odor, and its activation during the recall test can terminate the search behavior resulting from either of these memories. Our results further suggest that in its behavioral significance DAN-i1 activation resembles, but does not equal, sugar reward. Dendrogram analyses of all the synaptic connections between DAN-i1 and its two main targets, the Kenyon cells and the mushroom body output neuron MBON-i1, further suggest that the DAN-i1 signals during training and during the recall test could be delivered to the Kenyon cells and to MBON-i1, respectively, within previously unrecognized, locally confined branching structures. This would provide an elegant circuit motif to terminate search on its successful completion.SIGNIFICANCE STATEMENT In the struggle for survival, animals have to explore their environment in search of food. Once food is found, however, it is adaptive to prioritize exploiting it over continuing a search that would now be as pointless as searching for the glasses you are wearing. This exploration-exploitation trade-off is important for animals and humans, as well as for technical search devices. We investigate which of the only 10,000 neurons of a fruit fly larva can tip the balance in this trade-off, and identify a single dopamine neuron called DAN-i1 that can do so. Given the similarities in dopamine neuron function across the animal kingdom, this may reflect a general principle of how search is terminated once it is successful.

An amino-acid mixture can be both rewarding and punishing to larval Drosophila melanogaster

Amino acids are important nutrients for animals because they are necessary for protein synthesis in particular during growth, as well as for neurotransmission. However, little is known about how animals use past experience to guide their search for amino-acid-rich food. We reasoned that the larvae of Drosophila melanogaster are suitable for investigating this topic because they are the feeding and growth stages in the life cycle of these holometabolous insects. Specifically, we investigated whether experiencing an odour with a 20 amino-acid mixture as a semi-natural tastant during training establishes odour-tastant associative memories. Across a broad concentration range (0.01-20 mmol l^-1), such an amino-acid mixture was found to have a rewarding effect, establishing appetitive memory for the odour. To our surprise, however, manipulation of the test conditions revealed that relatively high concentrations of the amino-acid mixture (3.3 mmol l^-1 and higher) in addition establish aversive memory for the odour. We then characterized both of these oppositely valenced memories in terms of their dependency on the number of training trials, their temporal stability, their modulation through starvation and the specific changes in locomotion underlying them. Collectively, and in the light of what is known about the neuronal organization of odour-food memory in larval D . melanogaster, our data suggest that these memories are established in parallel. We discuss the similarity of our results to what has been reported for sodium chloride, and the possible neurogenetic bases for concentration-dependent changes in valence when these tastants are used as reinforcers.

Reversal learning in Drosophila larvae

Adjusting behavior to changed environmental contingencies is critical for survival, and reversal learning provides an experimental handle on such cognitive flexibility. Here, we investigate reversal learning in larval Drosophila Using odor-taste associations, we establish olfactory reversal learning in the appetitive and the aversive domain, using either fructose as a reward or high-concentration sodium chloride as a punishment, respectively. Reversal learning is demonstrated both in differential and in absolute conditioning, in either valence domain. In differential conditioning, the animals are first trained such that an odor A is paired, for example, with the reward whereas odor B is not (A+/B); this is followed by a second training phase with reversed contingencies (A/B+). In absolute conditioning, odor B is omitted, such that the animals are first trained with paired presentations of A and reward, followed by unpaired training in the second training phase. Our results reveal "true" reversal learning in that the opposite associative effects of both the first and the second training phase are detectable after reversed-contingency training. In what is a surprisingly quick, one-trial contingency adjustment in the Drosophila larva, the present study establishes a simple and genetically easy accessible study case of cognitive flexibility.

Modulations of microbehaviour by associative memory strength in Drosophila larvae

Finding food is a vital skill and a constant task for any animal, and associative learning of food-predicting cues gives an advantage in this daily struggle. The strength of the associations between cues and food depends on a number of parameters, such as the salience of the cue, the strength of the food reward and the number of joint cue-food experiences. We investigate what impact the strength of an associative odour-sugar memory has on the microbehaviour of Drosophila melanogaster larvae. We find that larvae form stronger memories with increasing concentrations of sugar or odour, and that these stronger memories manifest themselves in stronger modulations of two aspects of larval microbehaviour, the rate and the direction of lateral reorientation manoeuvres (so-called head casts). These two modulations of larval behaviour are found to be correlated to each other in every experiment performed, which is in line with a model that assumes that both modulations are controlled by a common motor output. Given that the Drosophila larva is a genetically tractable model organism that is well suited to the study of simple circuits at the single-cell level, these analyses can guide future research into the neuronal circuits underlying the translation of associative memories of different strength into behaviour, and may help to understand how these processes are organised in more complex systems.

One-trial learning in larval Drosophila

Animals of many species are capable of “small data” learning, that is, of learning without repetition. Here we introduce larval Drosophila melanogaster as a relatively simple study case for such one-trial learning. Using odor-food associative conditioning, we first show that a sugar that is both sweet and nutritious (fructose) and sugars that are only sweet (arabinose) or only nutritious (sorbitol) all support appetitive one-trial learning. The same is the case for the optogenetic activation of a subset of dopaminergic neurons innervating the mushroom body, the memory center of the insects. In contrast, no one-trial learning is observed for an amino acid reward (aspartic acid). As regards the aversive domain, one-trial learning is demonstrated for high-concentration sodium chloride, but is not observed for a bitter tastant (quinine). Second, we provide follow-up, parametric analyses of odor-fructose learning. Specifically, we ascertain its dependency on the number and duration of training trials, the requirements for the behavioral expression of one-trial odor-fructose memory, its temporal stability, and the feasibility of one-trial differential conditioning. Our results set the stage for a neurogenetic analysis of one-trial learning and define the requirements for modeling mnemonic processes in the larva.

Memory enhancement by ferulic acid ester across species

Cognitive impairments can be devastating for quality of life, and thus, preventing or counteracting them is of great value. To this end, the present study exploits the potential of the plant Rhodiola rosea and identifies the constituent ferulic acid eicosyl ester [icosyl-(2E)-3-(4-hydroxy-3-methoxyphenyl)-prop-2-enoate (FAE-20)] as a memory enhancer. We show that food supplementation with dried root material from R. rosea dose-dependently improves odor-taste reward associative memory scores in larval Drosophila and prevents the age-related decline of this appetitive memory in adult flies. Task-relevant sensorimotor faculties remain unaltered. From a parallel approach, a list of candidate compounds has been derived, including R. rosea-derived FAE-20. Here, we show that both R. rosea-derived FAE-20 and synthetic FAE-20 are effective as memory enhancers in larval Drosophila. Synthetic FAE-20 also partially compensates for age-related memory decline in adult flies, as well as genetically induced early-onset loss of memory function in young flies. Furthermore, it increases excitability in mouse hippocampal CA1 neurons, leads to more stable context-shock aversive associative memory in young adult (3-month-old) mice, and increases memory scores in old (>2-year-old) mice. Given these effects, and given the utility of R. rosea-the plant from which we discovered FAE-20-as a memory enhancer, these results may hold potential for clinical applications.

Associative Learning of Stimuli Paired and Unpaired With Reinforcement: Evaluating Evidence From Maggots, Flies, Bees, and Rats

Finding rewards and avoiding punishments are powerful goals of behavior. To maximize reward and minimize punishment, it is beneficial to learn about the stimuli that predict their occurrence, and decades of research have provided insight into the brain processes underlying such associative reinforcement learning. In addition, it is well known in experimental psychology, yet often unacknowledged in neighboring scientific disciplines, that subjects also learn about the stimuli that predict the absence of reinforcement. Here we evaluate evidence for both these learning processes. We focus on two study cases that both provide a baseline level of behavior against which the effects of associative learning can be assessed. Firstly, we report pertinent evidence from Drosophila larvae. A re-analysis of the literature reveals that through paired presentations of an odor A and a sugar reward (A+) the animals learn that the reward can be found where the odor is, and therefore show an above-baseline preference for the odor. In contrast, through unpaired training (A/+) the animals learn that the reward can be found precisely where the odor is not, and accordingly these larvae show a below-baseline preference for it (the same is the case, with inverted signs, for learning through taste punishment). In addition, we present previously unpublished data demonstrating that also during a two-odor, differential conditioning protocol (A+/B) both these learning processes take place in larvae, i.e., learning about both the rewarded stimulus A and the non-rewarded stimulus B (again, this is likewise the case for differential conditioning with taste punishment). Secondly, after briefly discussing published evidence from adult Drosophila, honeybees, and rats, we report an unpublished data set showing that relative to baseline behavior after truly random presentations of a visual stimulus A and punishment, rats exhibit memories of opposite valence upon paired and unpaired training. Collectively, the evidence conforms to classical findings in experimental psychology and suggests that across species animals associatively learn both through paired and through unpaired presentations of stimuli with reinforcement – with opposite valence. While the brain mechanisms of unpaired learning for the most part still need to be uncovered, the immediate implication is that using unpaired procedures as a mnemonically neutral control for associative reinforcement learning may be leading analyses astray.

Functional architecture of reward learning in mushroom body extrinsic neurons of larval Drosophila

The brain adaptively integrates present sensory input, past experience, and options for future action. The insect mushroom body exemplifies how a central brain structure brings about such integration. Here we use a combination of systematic single-cell labeling, connectomics, transgenic silencing, and activation experiments to study the mushroom body at single-cell resolution, focusing on the behavioral architecture of its input and output neurons (MBINs and MBONs), and of the mushroom body intrinsic APL neuron. Our results reveal the identity and morphology of almost all of these 44 neurons in stage 3 Drosophila larvae. Upon an initial screen, functional analyses focusing on the mushroom body medial lobe uncover sparse and specific functions of its dopaminergic MBINs, its MBONs, and of the GABAergic APL neuron across three behavioral tasks, namely odor preference, taste preference, and associative learning between odor and taste. Our results thus provide a cellular-resolution study case of how brains organize behavior.

The Ol1mpiad: concordance of behavioural faculties of stage 1 and stage 3 Drosophila larvae

Mapping brain function to brain structure is a fundamental task for neuroscience. For such an endeavour, the Drosophila larva is simple enough to be tractable, yet complex enough to be interesting. It features about 10,000 neurons and is capable of various taxes, kineses and Pavlovian conditioning. All its neurons are currently being mapped into a light-microscopical atlas, and Gal4 strains are being generated to experimentally access neurons one at a time. In addition, an electron microscopic reconstruction of its nervous system seems within reach. Notably, this electron microscope-based connectome is being drafted for a stage 1 larva – because stage 1 larvae are much smaller than stage 3 larvae. However, most behaviour analyses have been performed for stage 3 larvae because their larger size makes them easier to handle and observe. It is therefore warranted to either redo the electron microscopic reconstruction for a stage 3 larva or to survey the behavioural faculties of stage 1 larvae. We provide the latter. In a community-based approach we called the Ol1mpiad, we probed stage 1 Drosophila larvae for free locomotion, feeding, responsiveness to substrate vibration, gentle and nociceptive touch, burrowing, olfactory preference and thermotaxis, light avoidance, gustatory choice of various tastants plus odour–taste associative learning, as well as light/dark–electric shock associative learning. Quantitatively, stage 1 larvae show lower scores in most tasks, arguably because of their smaller size and lower speed. Qualitatively, however, stage 1 larvae perform strikingly similar to stage 3 larvae in almost all cases. These results bolster confidence in mapping brain structure and behaviour across developmental stages.