Switch-like and persistent memory formation in individual Drosophila larvae

Characterizing the dynamic learning process: Implications of a quantitative analysis

Understanding the neural mechanisms involved in learning processes is crucial for unraveling the complexities of behavior and cognition. Sudden change from the untrained level to the fully-learned level is a pivotal feature of instrumental learning. However, the concept of change point and suitable methods to conveniently analyze the characteristics of sudden change in groups remain elusive, which might hinder a fuller understanding of the neural mechanism underlying dynamic leaning process. In the current study, we investigated the learning processes of mice that were trained in an aversive instrumental learning task, and introduced a novel strategy to analyze behavioral variations in instrumental learning, leading to improved clarity on the concept of sudden change and enabling comprehensive group analysis. By applying this novel strategy, we examined the effects of cocaine and a cannabinoid receptor agonist on instrumental learning. Intriguingly, our analysis revealed significant differences in timing and occurrence of sudden changes that were previously overlooked using traditional analysis. Overall, our research advances understanding of behavioral variation during instrumental learning and the interplay between learning behaviors and neurotransmitter systems, contributing to a deeper comprehension of learning processes and informing future investigations and therapeutic interventions.

Prediction error drives associative learning and conditioned behavior in a spiking model of Drosophila larva

Predicting reinforcement from sensory cues is beneficial for goal-directed behavior. In insect brains, underlying associations between cues and reinforcement, encoded by dopaminergic neurons, are formed in the mushroom body. We propose a spiking model of the Drosophila larva mushroom body. It includes a feedback motif conveying learned reinforcement expectation to dopaminergic neurons, which can compute prediction error as the difference between expected and present reinforcement. We demonstrate that this can serve as a driving force in learning. When combined with synaptic homeostasis, our model accounts for theoretically derived features of acquisition and loss of associations that depend on the intensity of the reinforcement and its temporal proximity to the cue. From modeling olfactory learning over the time course of behavioral experiments and simulating the locomotion of individual larvae toward or away from odor sources in a virtual environment, we conclude that learning driven by prediction errors can explain larval behavior.

Phenylacetaldehyde induced olfactory conditioning in Drosophila melanogaster (Diptera: Drosophilidae) larvae

Phenylacetaldehyde (PAH), an aromatic odorant, exists in varied fruits including overripe bananas and prickly pear cactus, the 2 major host fruits of Drosophila melanogaster. It acts as a potent ligand for the Ionotropic receptor 84a (IR84a) and the Odorant receptor 67a (OR67a), serving as an important food and courtship cue for adult fruit flies. Drosophila melanogaster larvae respond robustly to diverse feeding odorants, such as ethyl acetate (EA), an aliphatic ester. Since the chemical identity and concentration of an odorant are vital neural information handled by the olfactory system, we studied how larvae respond to PAH, an aromatic food odorant with aphrodisiac properties for adult flies. Our findings revealed that PAH attracted larvae significantly in a dose-dependent manner. Larvae could also be trained with PAH associated to appetitive and aversive reinforcers. Thus, like EA, PAH might serve as an important odorant cue for larvae, aiding in food tracking and survival in the wild. Since IR84a/IR8a complex primarily governs PAH response in adult flies, we examined expression of Ir84a and Ir8a in early third-instar larvae. Our experiments showed the presence of Ir8a, a novel finding. However, contrary to adult flies, PAH-responsive Ir84a was not found. Our behavioral experiments with Ir8a1 mutant larvae exhibited normal chemotaxis to PAH, whereas Orco1 mutant showed markedly reduced chemotaxis, indicating an OR-mediated neural circuitry for sensing of PAH in larvae. The results obtained through this study are significantly important as information on how larvae perceive and process PAH odorant at the neuronal level is lacking.

Reward expectations direct learning and drive operant matching in Drosophila

Foraging animals must use decision-making strategies that dynamically adapt to the changing availability of rewards in the environment. A wide diversity of animals do this by distributing their choices in proportion to the rewards received from each option, Herrnstein's operant matching law. Theoretical work suggests an elegant mechanistic explanation for this ubiquitous behavior, as operant matching follows automatically from simple synaptic plasticity rules acting within behaviorally relevant neural circuits. However, no past work has mapped operant matching onto plasticity mechanisms in the brain, leaving the biological relevance of the theory unclear. Here, we discovered operant matching in Drosophila and showed that it requires synaptic plasticity that acts in the mushroom body and incorporates the expectation of reward. We began by developing a dynamic foraging paradigm to measure choices from individual flies as they learn to associate odor cues with probabilistic rewards. We then built a model of the fly mushroom body to explain each fly's sequential choice behavior using a family of biologically realistic synaptic plasticity rules. As predicted by past theoretical work, we found that synaptic plasticity rules could explain fly matching behavior by incorporating stimulus expectations, reward expectations, or both. However, by optogenetically bypassing the representation of reward expectation, we abolished matching behavior and showed that the plasticity rule must specifically incorporate reward expectations. Altogether, these results reveal the first synapse-level mechanisms of operant matching and provide compelling evidence for the role of reward expectation signals in the fly brain.

Learning and memory using Drosophila melanogaster: a focus on advances made in the fifth decade of research

In the last decade, researchers using Drosophila melanogaster have made extraordinary progress in uncovering the mysteries underlying learning and memory. This progress has been propelled by the amazing toolkit available that affords combined behavioral, molecular, electrophysiological, and systems neuroscience approaches. The arduous reconstruction of electron microscopic images resulted in a first-generation connectome of the adult and larval brain, revealing complex structural interconnections between memory-related neurons. This serves as substrate for future investigations on these connections and for building complete circuits from sensory cue detection to changes in motor behavior. Mushroom body output neurons (MBOn) were discovered, which individually forward information from discrete and non-overlapping compartments of the axons of mushroom body neurons (MBn). These neurons mirror the previously discovered tiling of mushroom body axons by inputs from dopamine neurons and have led to a model that ascribes the valence of the learning event, either appetitive or aversive, to the activity of different populations of dopamine neurons and the balance of MBOn activity in promoting avoidance or approach behavior. Studies of the calyx, which houses the MBn dendrites, have revealed a beautiful microglomeruluar organization and structural changes of synapses that occur with long-term memory (LTM) formation. Larval learning has advanced, positioning it to possibly lead in producing new conceptual insights due to its markedly simpler structure over the adult brain. Advances were made in how cAMP response element-binding protein interacts with protein kinases and other transcription factors to promote the formation of LTM. New insights were made on Orb2, a prion-like protein that forms oligomers to enhance synaptic protein synthesis required for LTM formation. Finally, Drosophila research has pioneered our understanding of the mechanisms that mediate permanent and transient active forgetting, an important function of the brain along with acquisition, consolidation, and retrieval. This was catalyzed partly by the identification of memory suppressor genes-genes whose normal function is to limit memory formation.

High-resolution analysis of individual Drosophila melanogaster larvae uncovers individual variability in locomotion and its neurogenetic modulation

Neuronally orchestrated muscular movement and locomotion are defining faculties of multicellular animals. Due to its simple brain and genetic accessibility, the larva of the fruit fly Drosophila melanogaster allows one to study these processes at tractable levels of complexity. However, although the faculty of locomotion clearly pertains to the individual, most studies of locomotion in larvae use measurements aggregated across animals, or animals tested one by one, an extravagance for larger-scale analyses. This prevents grasping the inter- and intra-individual variability in locomotion and its neurogenetic determinants. Here, we present the IMBA (individual maggot behaviour analyser) for analysing the behaviour of individual larvae within groups, reliably resolving individual identity across collisions. We use the IMBA to systematically describe the inter- and intra-individual variability in locomotion of wild-type animals, and how the variability is reduced by associative learning. We then report a novel locomotion phenotype of an adhesion GPCR mutant. We further investigated the modulation of locomotion across repeated activations of dopamine neurons in individual animals, and the transient backward locomotion induced by brief optogenetic activation of the brain-descending 'mooncrawler' neurons. In summary, the IMBA is an easy-to-use toolbox allowing an unprecedentedly rich view of the behaviour and its variability of individual larvae, with utility in multiple biomedical research contexts.

The connectome of an insect brain

Brains contain networks of interconnected neurons and so knowing the network architecture is essential for understanding brain function. We therefore mapped the synaptic-resolution connectome of an entire insect brain (Drosophila larva) with rich behavior, including learning, value computation, and action selection, comprising 3016 neurons and 548,000 synapses. We characterized neuron types, hubs, feedforward and feedback pathways, as well as cross-hemisphere and brain-nerve cord interactions. We found pervasive multisensory and interhemispheric integration, highly recurrent architecture, abundant feedback from descending neurons, and multiple novel circuit motifs. The brain's most recurrent circuits comprised the input and output neurons of the learning center. Some structural features, including multilayer shortcuts and nested recurrent loops, resembled state-of-the-art deep learning architectures. The identified brain architecture provides a basis for future experimental and theoretical studies of neural circuits.

Continuous, long-term crawling behavior characterized by a robotic transport system

Detailed descriptions of behavior provide critical insight into the structure and function of nervous systems. In Drosophila larvae and many other systems, short behavioral experiments have been successful in characterizing rapid responses to a range of stimuli at the population level. However, the lack of long-term continuous observation makes it difficult to dissect comprehensive behavioral dynamics of individual animals and how behavior (and therefore the nervous system) develops over time. To allow for long-term continuous observations in individual fly larvae, we have engineered a robotic instrument that automatically tracks and transports larvae throughout an arena. The flexibility and reliability of its design enables controlled stimulus delivery and continuous measurement over developmental time scales, yielding an unprecedented level of detailed locomotion data. We utilize the new system’s capabilities to perform continuous observation of exploratory behavior over a duration of six hours with and without a thermal gradient present, and in a single larva for over 30 hours. Long-term free-roaming behavior and analogous short-term experiments show similar dynamics that take place at the beginning of each experiment. Finally, characterization of larval thermotaxis in individuals reveals a bimodal distribution in navigation efficiency, identifying distinct phenotypes that are obfuscated when only analyzing population averages.

Optogenetic and thermogenetic manipulation of defined neural circuits and behaviors in Drosophila

Neural network dynamics underlying flexible animal behaviors remain elusive. The fruit fly Drosophila melanogaster is considered an excellent model in behavioral neuroscience because of its simple neuroanatomical architecture and the availability of various genetic methods. Moreover, Drosophila larvae's transparent body allows investigators to use optical methods on freely moving animals, broadening research directions. Activating or inhibiting well-defined events in excitable cells with a fine temporal resolution using optogenetics and thermogenetics led to the association of functions of defined neural populations with specific behavioral outputs such as the induction of associative memory. Furthermore, combining optogenetics and thermogenetics with state-of-the-art approaches, including connectome mapping and machine learning-based behavioral quantification, might provide a complete view of the experience- and time-dependent variations of behavioral responses. These methodologies allow further understanding of the functional connections between neural circuits and behaviors such as chemosensory, motivational, courtship, and feeding behaviors and sleep, learning, and memory.

Idiosyncratic learning performance in flies

Individuals vary in their innate behaviours, even when they have the same genome and have been reared in the same environment. The extent of individuality in plastic behaviours, like learning, is less well characterized. Also unknown is the extent to which intragenotypic differences in learning generalize: if an individual performs well in one assay, will it perform well in other assays? We investigated this using the fruit fly Drosophila melanogaster, an organism long-used to study the mechanistic basis of learning and memory. We found that isogenic flies, reared in identical laboratory conditions, and subject to classical conditioning that associated odorants with electric shock, exhibit clear individuality in their learning responses. Flies that performed well when an odour was paired with shock tended to perform well when the odour was paired with bitter taste or when other odours were paired with shock. Thus, individuality in learning performance appears to be prominent in isogenic animals reared identically, and individual differences in learning performance generalize across some aversive sensory modalities. Establishing these results in flies opens up the possibility of studying the genetic and neural circuit basis of individual differences in learning in a highly suitable model organism.

Switch-like and persistent memory formation in individual Drosophila larvae

Associative learning allows animals to use past experience to predict future events. The circuits underlying memory formation support immediate and sustained changes in function, often in response to a single example. Larval Drosophila is a genetic model for memory formation that can be accessed at molecular, synaptic, cellular, and circuit levels, often simultaneously, but existing behavioral assays for larval learning and memory do not address individual animals, and it has been difficult to form long-lasting memories, especially those requiring synaptic reorganization. We demonstrate a new assay for learning and memory capable of tracking the changing preferences of individual larvae. We use this assay to explore how activation of a pair of reward neurons changes the response to the innately aversive gas carbon dioxide (CO2). We confirm that when coupled to CO2 presentation in appropriate temporal sequence, optogenetic reward reduces avoidance of CO2. We find that learning is switch-like: all-or-none and quantized in two states. Memories can be extinguished by repeated unrewarded exposure to CO2 but are stabilized against extinction by repeated training or overnight consolidation. Finally, we demonstrate long-lasting protein synthesis dependent and independent memory formation.