A behavioral odor similarity "space" in larval Drosophila

Prediction error drives associative learning and conditioned behavior in a spiking model of Drosophila larva

Predicting reinforcement from sensory cues is beneficial for goal-directed behavior. In insect brains, underlying associations between cues and reinforcement, encoded by dopaminergic neurons, are formed in the mushroom body. We propose a spiking model of the Drosophila larva mushroom body. It includes a feedback motif conveying learned reinforcement expectation to dopaminergic neurons, which can compute prediction error as the difference between expected and present reinforcement. We demonstrate that this can serve as a driving force in learning. When combined with synaptic homeostasis, our model accounts for theoretically derived features of acquisition and loss of associations that depend on the intensity of the reinforcement and its temporal proximity to the cue. From modeling olfactory learning over the time course of behavioral experiments and simulating the locomotion of individual larvae toward or away from odor sources in a virtual environment, we conclude that learning driven by prediction errors can explain larval behavior.

Toxic effects of formaldehyde and the protective effect of docosahexaenoic acid in Drosophila

Formaldehyde (FA) is a commercially important chemical applied in industry and scientific research. However, FA has a distinct impact on learning and memory. Although the mechanisms of FA toxicity have been well studied, additional research is required to establish the mechanisms of neuroprotection in cases of FA exposure. Docosahexaenoic acid (DHA) is a polyunsaturated fatty acid with a variety of health benefits, including the enhancement of learning and memory. In this study, we investigated the neuroprotective effects of DHA in Drosophila melanogaster that had ingested FA. Our data suggested that DHA enhanced reproductive processes, leading to an increase in the number of eggs, larvae, and adults. Surprisingly, we found that DHA had a mild protective effect against FA-induced impairments in learning and memory.

Structured Odorant Response Patterns across a Complete Olfactory Receptor Neuron Population

Odor perception allows animals to distinguish odors, recognize the same odor across concentrations, and determine concentration changes. How the activity patterns of primary olfactory receptor neurons (ORNs), at the individual and population levels, facilitate distinguishing these functions remains poorly understood. Here, we interrogate the complete ORN population of the Drosophila larva across a broadly sampled panel of odorants at varying concentrations. We find that the activity of each ORN scales with the concentration of any odorant via a fixed dose-response function with a variable sensitivity. Sensitivities across odorants and ORNs follow a power-law distribution. Much of receptor sensitivity to odorants is accounted for by a single geometrical property of molecular structure. Similarity in the shape of temporal response filters across odorants and ORNs extend these relationships to fluctuating environments. These results uncover shared individual- and population-level patterns that together lend structure to support odor perceptions.

Associative Learning of Stimuli Paired and Unpaired With Reinforcement: Evaluating Evidence From Maggots, Flies, Bees, and Rats

Finding rewards and avoiding punishments are powerful goals of behavior. To maximize reward and minimize punishment, it is beneficial to learn about the stimuli that predict their occurrence, and decades of research have provided insight into the brain processes underlying such associative reinforcement learning. In addition, it is well known in experimental psychology, yet often unacknowledged in neighboring scientific disciplines, that subjects also learn about the stimuli that predict the absence of reinforcement. Here we evaluate evidence for both these learning processes. We focus on two study cases that both provide a baseline level of behavior against which the effects of associative learning can be assessed. Firstly, we report pertinent evidence from Drosophila larvae. A re-analysis of the literature reveals that through paired presentations of an odor A and a sugar reward (A+) the animals learn that the reward can be found where the odor is, and therefore show an above-baseline preference for the odor. In contrast, through unpaired training (A/+) the animals learn that the reward can be found precisely where the odor is not, and accordingly these larvae show a below-baseline preference for it (the same is the case, with inverted signs, for learning through taste punishment). In addition, we present previously unpublished data demonstrating that also during a two-odor, differential conditioning protocol (A+/B) both these learning processes take place in larvae, i.e., learning about both the rewarded stimulus A and the non-rewarded stimulus B (again, this is likewise the case for differential conditioning with taste punishment). Secondly, after briefly discussing published evidence from adult Drosophila, honeybees, and rats, we report an unpublished data set showing that relative to baseline behavior after truly random presentations of a visual stimulus A and punishment, rats exhibit memories of opposite valence upon paired and unpaired training. Collectively, the evidence conforms to classical findings in experimental psychology and suggests that across species animals associatively learn both through paired and through unpaired presentations of stimuli with reinforcement – with opposite valence. While the brain mechanisms of unpaired learning for the most part still need to be uncovered, the immediate implication is that using unpaired procedures as a mnemonically neutral control for associative reinforcement learning may be leading analyses astray.

Aversive and Appetitive Learning in Drosophila Larvae: A Simple and Powerful Suite of Laboratory Modules for Classroom or Open-ended Research Projects

A key element of laboratory courses introducing students to neuroscience includes behavioral exercises. Associative learning experiments often conducted in research laboratories are difficult to perform and time consuming. Commonly, these experiments cannot be performed without extensive instrumentation or animal care facilities. Here, we describe three distinct laboratory modules that build on simple chemosensory and memory assays in Drosophila larvae. Additionally, we describe open-ended research projects using these assays that can be developed into semester long independent research experiences. Given that Drosophila is a genetic model organism, these simple behavioral assays can be used to generate multiple hypothesis driven projects aimed at identifying a gene or class of neurons involved in appetitive and aversive learning. These lab modules are ideally suited for undergraduates at all levels to experience and can be incorporated in a lower/upper level neuroscience course or as a high school outreach exercise. Further, these modules enable students to collect their own data sets, work in groups in collating large data sets, performing statistical comparisons, and presenting results in the form of short research papers or traditional laboratory reports that include a short literature review.

Functional architecture of reward learning in mushroom body extrinsic neurons of larval Drosophila

The brain adaptively integrates present sensory input, past experience, and options for future action. The insect mushroom body exemplifies how a central brain structure brings about such integration. Here we use a combination of systematic single-cell labeling, connectomics, transgenic silencing, and activation experiments to study the mushroom body at single-cell resolution, focusing on the behavioral architecture of its input and output neurons (MBINs and MBONs), and of the mushroom body intrinsic APL neuron. Our results reveal the identity and morphology of almost all of these 44 neurons in stage 3 Drosophila larvae. Upon an initial screen, functional analyses focusing on the mushroom body medial lobe uncover sparse and specific functions of its dopaminergic MBINs, its MBONs, and of the GABAergic APL neuron across three behavioral tasks, namely odor preference, taste preference, and associative learning between odor and taste. Our results thus provide a cellular-resolution study case of how brains organize behavior.

Behavioral Evidence for Enhanced Processing of the Minor Component of Binary Odor Mixtures in Larval Drosophila

A fundamental problem in deciding between mutually exclusive options is that the decision needs to be categorical although the properties of the options often differ but in grade. We developed an experimental handle to study this aspect of behavior organization. Larval Drosophila were trained such that in one set of animals odor A was rewarded, but odor B was not (A+/B), whereas a second set of animals was trained reciprocally (A/B+). We then measured the preference of the larvae either for A, or for B, or for "morphed" mixtures of A and B, that is for mixtures differing in the ratio of the two components. As expected, the larvae showed higher preference when only the previously rewarded odor was presented than when only the previously unrewarded odor was presented. For mixtures of A and B that differed in the ratio of the two components, the major component dominated preference behavior-but it dominated less than expected from a linear relationship between mixture ratio and preference behavior. This suggests that a minor component can have an enhanced impact in a mixture, relative to such a linear expectation. The current paradigm may prove useful in understanding how nervous systems generate discrete outputs in the face of inputs that differ only gradually.

The impact of odor-reward memory on chemotaxis in larval Drosophila

How do animals adaptively integrate innate with learned behavioral tendencies? We tackle this question using chemotaxis as a paradigm. Chemotaxis in the Drosophila larva largely results from a sequence of runs and oriented turns. Thus, the larvae minimally need to determine (i) how fast to run, (ii) when to initiate a turn, and (iii) where to direct a turn. We first report how odor-source intensities modulate these decisions to bring about higher levels of chemotactic performance for higher odor-source intensities during innate chemotaxis. We then examine whether the same modulations are responsible for alterations of chemotactic performance by learned odor “valence” (understood throughout as level of attractiveness). We find that run speed (i) is neither modulated by the innate nor by the learned valence of an odor. Turn rate (ii), however, is modulated by both: the higher the innate or learned valence of the odor, the less often larvae turn whenever heading toward the odor source, and the more often they turn when heading away. Likewise, turning direction (iii) is modulated concordantly by innate and learned valence: turning is biased more strongly toward the odor source when either innate or learned valence is high. Using numerical simulations, we show that a modulation of both turn rate and of turning direction is sufficient to account for the empirically found differences in preference scores across experimental conditions. Our results suggest that innate and learned valence organize adaptive olfactory search behavior by their summed effects on turn rate and turning direction, but not on run speed. This work should aid studies into the neural mechanisms by which memory impacts specific aspects of behavior.

Generalization and discrimination tasks yield concordant measures of perceived distance between odours and their binary mixtures in larval Drosophila

Similarity between odours is notoriously difficult to measure. Widely used behavioural approaches in insect olfaction research are cross-adaptation, masking, as well as associative tasks based on olfactory learning and the subsequent testing for how specific the established memory is. A concern with such memory-based approaches is that the learning process required to establish an odour memory may alter the way the odour is processed, such that measures of perception taken at the test are distorted. The present study was therefore designed to see whether behavioural judgements of perceptual distance are different for two different memory-based tasks, namely generalization and discrimination. We used odour–reward learning in larval Drosophila as a study case. In order to challenge the larvae's olfactory system, we chose to work with binary mixtures and their elements (1-octanol, n-amyl acetate, 3-octanol, benzaldehyde and hexyl acetate). We determined the perceptual distance between each mixture and its elements, first in a generalization task, and then in a discrimination task. It turns out that scores of perceptual distance are correlated between both tasks. A re-analysis of published studies looking at element-to-element perceptual distances in larval reward learning and in adult punishment learning confirms this result. We therefore suggest that across a given set of olfactory stimuli, associative training does not grossly alter the pattern of perceptual distances.

Differential associative training enhances olfactory acuity in Drosophila melanogaster

Training can improve the ability to discriminate between similar, confusable stimuli, including odors. One possibility of enhancing behaviorally expressed discrimination (i.e., sensory acuity) relies on differential associative learning, during which animals are forced to detect the differences between similar stimuli. Drosophila represents a key model organism for analyzing neuronal mechanisms underlying both odor processing and olfactory learning. However, the ability of flies to enhance fine discrimination between similar odors through differential associative learning has not been analyzed in detail. We performed associative conditioning experiments using chemically similar odorants that we show to evoke overlapping neuronal activity in the fly's antennal lobes and highly correlated activity in mushroom body lobes. We compared the animals' performance in discriminating between these odors after subjecting them to one of two types of training: either absolute conditioning, in which only one odor is reinforced, or differential conditioning, in which one odor is reinforced and a second odor is explicitly not reinforced. First, we show that differential conditioning decreases behavioral generalization of similar odorants in a choice situation. Second, we demonstrate that this learned enhancement in olfactory acuity relies on both conditioned excitation and conditioned inhibition. Third, inhibitory local interneurons in the antennal lobes are shown to be required for behavioral fine discrimination between the two similar odors. Fourth, differential, but not absolute, training causes decorrelation of odor representations in the mushroom body. In conclusion, differential training with similar odors ultimately induces a behaviorally expressed contrast enhancement between the two similar stimuli that facilitates fine discrimination.

Olfactory memories are intensity specific in larval Drosophila

Learning can rely on stimulus quality, stimulus intensity, or a combination of these. Regarding olfaction, the coding of odour quality is often proposed to be combinatorial along the olfactory pathway, and working hypotheses are available concerning short-term associative memory trace formation of odour quality. However, it is less clear how odour intensity is coded, and whether olfactory memory traces include information about the intensity of the learnt odour. Using odour-sugar associative conditioning in larval Drosophila, we first describe the dose-effect curves of learnability across odour intensities for four different odours (n-amyl acetate, 3-octanol, 1-octen-3-ol and benzaldehyde). We then chose odour intensities such that larvae were trained at an intermediate odour intensity, but were tested for retention with either that trained intermediate odour intensity, or with respectively higher or lower intensities. We observed a specificity of retention for the trained intensity for all four odours used. This adds to the appreciation of the richness in 'content' of olfactory short-term memory traces, even in a system as simple as larval Drosophila, and to define the demands on computational models of associative olfactory memory trace formation. We suggest two kinds of circuit architecture that have the potential to accommodate intensity learning, and discuss how they may be implemented in the insect brain.

CASK regulates CaMKII autophosphorylation in neuronal growth, calcium signaling, and learning

Calcium (Ca²⁺)/calmodulin (CaM)-dependent kinase II (CaMKII) activity plays a fundamental role in learning and memory. A key feature of CaMKII in memory formation is its ability to be regulated by autophosphorylation, which switches its activity on and off during synaptic plasticity. The synaptic scaffolding protein CASK (calcium (Ca²⁺)/calmodulin (CaM) associated serine kinase) is also important for learning and memory, as mutations in CASK result in intellectual disability and neurological defects in humans. We show that in Drosophila larvae, CASK interacts with CaMKII to control neuronal growth and calcium signaling. Furthermore, deletion of the CaMK-like and L27 domains of CASK (CASK β null) or expression of overactive CaMKII (T287D) produced similar effects on synaptic growth and Ca²⁺ signaling. CASK overexpression rescues the effects of CaMKII overactivity, consistent with the notion that CASK and CaMKII act in a common pathway that controls these neuronal processes. The reduction in Ca²⁺ signaling observed in the CASK β null mutant caused a decrease in vesicle trafficking at synapses. In addition, the decrease in Ca²⁺ signaling in CASK mutants was associated with an increase in Ether-à-go-go (EAG) potassium (K⁺) channel localization to synapses. Reducing EAG restored the decrease in Ca²⁺ signaling observed in CASK mutants to the level of wildtype, suggesting that CASK regulates Ca²⁺ signaling via EAG. CASK knockdown reduced both appetitive associative learning and odor evoked Ca²⁺ responses in Drosophila mushroom bodies, which are the learning centers of Drosophila. Expression of human CASK in Drosophila rescued the effect of CASK deletion on the activity state of CaMKII, suggesting that human CASK may also regulate CaMKII autophosphorylation.

Parallel processing in the honeybee olfactory pathway: structure, function, and evolution

Animals face highly complex and dynamic olfactory stimuli in their natural environments, which require fast and reliable olfactory processing. Parallel processing is a common principle of sensory systems supporting this task, for example in visual and auditory systems, but its role in olfaction remained unclear. Studies in the honeybee focused on a dual olfactory pathway. Two sets of projection neurons connect glomeruli in two antennal-lobe hemilobes via lateral and medial tracts in opposite sequence with the mushroom bodies and lateral horn. Comparative studies suggest that this dual-tract circuit represents a unique adaptation in Hymenoptera. Imaging studies indicate that glomeruli in both hemilobes receive redundant sensory input. Recent simultaneous multi-unit recordings from projection neurons of both tracts revealed widely overlapping response profiles strongly indicating parallel olfactory processing. Whereas lateral-tract neurons respond fast with broad (generalistic) profiles, medial-tract neurons are odorant specific and respond slower. In analogy to “what-” and “where” subsystems in visual pathways, this suggests two parallel olfactory subsystems providing “what-” (quality) and “when” (temporal) information. Temporal response properties may support across-tract coincidence coding in higher centers. Parallel olfactory processing likely enhances perception of complex odorant mixtures to decode the diverse and dynamic olfactory world of a social insect.

Parallel processing via a dual olfactory pathway in the honeybee

In their natural environment, animals face complex and highly dynamic olfactory input. Thus vertebrates as well as invertebrates require fast and reliable processing of olfactory information. Parallel processing has been shown to improve processing speed and power in other sensory systems and is characterized by extraction of different stimulus parameters along parallel sensory information streams. Honeybees possess an elaborate olfactory system with unique neuronal architecture: a dual olfactory pathway comprising a medial projection-neuron (PN) antennal lobe (AL) protocerebral output tract (m-APT) and a lateral PN AL output tract (l-APT) connecting the olfactory lobes with higher-order brain centers. We asked whether this neuronal architecture serves parallel processing and employed a novel technique for simultaneous multiunit recordings from both tracts. The results revealed response profiles from a high number of PNs of both tracts to floral, pheromonal, and biologically relevant odor mixtures tested over multiple trials. PNs from both tracts responded to all tested odors, but with different characteristics indicating parallel processing of similar odors. Both PN tracts were activated by widely overlapping response profiles, which is a requirement for parallel processing. The l-APT PNs had broad response profiles suggesting generalized coding properties, whereas the responses of m-APT PNs were comparatively weaker and less frequent, indicating higher odor specificity. Comparison of response latencies within and across tracts revealed odor-dependent latencies. We suggest that parallel processing via the honeybee dual olfactory pathway provides enhanced odor processing capabilities serving sophisticated odor perception and olfactory demands associated with a complex olfactory world of this social insect.

Appetitive associative olfactory learning in Drosophila larvae

In the following we describe the methodological details of appetitive associative olfactory learning in Drosophila larvae. The setup, in combination with genetic interference, provides a handle to analyze the neuronal and molecular fundamentals of specifically associative learning in a simple larval brain. Organisms can use past experience to adjust present behavior. Such acquisition of behavioral potential can be defined as learning, and the physical bases of these potentials as memory traces. Neuroscientists try to understand how these processes are organized in terms of molecular and neuronal changes in the brain by using a variety of methods in model organisms ranging from insects to vertebrates. For such endeavors it is helpful to use model systems that are simple and experimentally accessible. The Drosophila larva has turned out to satisfy these demands based on the availability of robust behavioral assays, the existence of a variety of transgenic techniques and the elementary organization of the nervous system comprising only about 10,000 neurons (albeit with some concessions: cognitive limitations, few behavioral options, and richness of experience questionable). Drosophila larvae can form associations between odors and appetitive gustatory reinforcement like sugar. In a standard assay, established in the lab of B. Gerber, animals receive a two-odor reciprocal training: A first group of larvae is exposed to an odor A together with a gustatory reinforcer (sugar reward) and is subsequently exposed to an odor B without reinforcement. Meanwhile a second group of larvae receives reciprocal training while experiencing odor A without reinforcement and subsequently being exposed to odor B with reinforcement (sugar reward). In the following both groups are tested for their preference between the two odors. Relatively higher preferences for the rewarded odor reflect associative learning--presented as a performance index (PI). The conclusion regarding the associative nature of the performance index is compelling, because apart from the contingency between odors and tastants, other parameters, such as odor and reward exposure, passage of time and handling do not differ between the two groups.

Olfactory responses of Drosophila larvae

We studied complete dose-response curves for 53 odorants in the third instar larvae of Drosophila melanogaster. All odorants, except one, elicited an attraction response. Some odorants also elicited a decrease from their peak response at higher concentrations. This concentration-dependent decrease in olfactory response could be due to either desensitization or repulsion, 2 possibilities that we cannot distinguish in our current assay. We observed high variations in factors like slopes, thresholds, and peaks of responses that, in agreement with previous studies, suggest that the responses of different receptors are quite different for the similar change in concentration of various ligands. We also observed that lower attraction thresholds predicted higher peak amplitude. This suggests that if odor responses encompassed wider concentration range than can be covered by the dynamic range of a single receptor, then responses tend to be high in magnitude.

Olfactory conditioning in the third instar larvae of Drosophila melanogaster using heat shock reinforcement

Adult Drosophila melanogaster has long been a popular model for learning and memory studies. Now the larval stage of the fruit fly is also being used in an increasing number of classical conditioning studies. In this study, we employed heat shock as a novel negative reinforcement for larvae and obtained high learning scores following just one training trial. We demonstrated heat-shock conditioning in both reciprocal and non-reciprocal paradigms and observed that the time window of association for the odor and heat shock reinforcement is on the order of a few minutes. This is slightly wider than the time window for electroshock conditioning reported in previous studies, possibly due to lingering effects of the high temperature. To test the utility of this simplified assay for the identification of new mutations that disrupt learning, we examined flies carrying mutations in the dnc gene. While the sensitivity to heat shock, as tested by writhing, was similar for wild type and dnc homozygotes, dnc mutations strongly diminished learning. We confirmed that the learning defect in dnc flies was indeed due to mutation in the dnc gene using non-complementation analysis. Given that heat shock has not been employed as a reinforcement for larvae in the past, we explored learning as a function of heat shock intensity and found that optimal learning occurred around 41 °C, with higher and lower temperatures both resulting in lower learning scores. In summary, we have developed a very simple, robust paradigm of learning in fruit fly larvae using heat shock reinforcement.

Innate attractiveness and associative learnability of odors can be dissociated in larval Drosophila

We investigate olfactory associative learning in larval Drosophila. A reciprocal training design is used, such that one group of animals receives a reward in the presence of odor X but not in the presence of odor Y (Train: X+ // Y), whereas another group is trained reciprocally (Train: X // Y+). After training, differences in odor preference between these reciprocally trained groups in a choice test (Test: X - Y) reflect associative learning. The current study, after showing which odor pairs can be used for such learning experiments, 1) introduces a one-odor version of such reciprocal paradigm that allows estimating the learnability of single odors. Regarding this reciprocal one-odor paradigm, we show that 2) paired presentations of an odor with a reward increase odor preference above baseline, whereas unpaired presentations of odor and reward decrease odor preference below baseline; this suggests that odors can become predictive either of reward or of reward absence. Furthermore, we show that 3) innate attractiveness and associative learnability can be dissociated. These data deepen our understanding of odor-reward learning in larval Drosophila on the behavioral level, and thus foster its neurogenetic analysis.