Reward foraging task and model-based analysis reveal how fruit flies learn value of available options

Exploration-exploitation trade-off is regulated by metabolic state and taste value in Drosophila

Similar to other animals, the fly, Drosophila melanogaster, changes its foraging strategy from exploration to exploitation upon encountering a nutrient-rich food source. However, the impact of metabolic state or taste/nutrient value on exploration vs. exploitation decisions in flies is poorly understood. Here, we developed a one-source foraging assay that uses automated video tracking coupled with high-resolution measurements of food ingestion to investigate the behavioral variables flies use when foraging for food with different taste/caloric values and when in different metabolic states. We found that flies alter their foraging and ingestive behaviors based on their hunger state and the concentration of the sucrose solution. Interestingly, sugar-blind flies did not transition from exploration to exploitation upon finding a high-concentration sucrose solution, suggesting that taste sensory input, as opposed to post-ingestive nutrient feedback, plays a crucial role in determining the foraging decisions of flies. Using a Generalized Linear Model (GLM), we showed that hunger state and sugar volume ingested, but not the nutrient or taste value of the food, influence flies' radial distance to the food source, a strong indicator of exploitation. Our behavioral paradigm and theoretical framework offer a promising avenue for investigating the neural mechanisms underlying state and value-based foraging decisions in flies, setting the stage for systematically identifying the neuronal circuits that drive these behaviors.

Reward expectations direct learning and drive operant matching in Drosophila

Foraging animals must use decision-making strategies that dynamically adapt to the changing availability of rewards in the environment. A wide diversity of animals do this by distributing their choices in proportion to the rewards received from each option, Herrnstein's operant matching law. Theoretical work suggests an elegant mechanistic explanation for this ubiquitous behavior, as operant matching follows automatically from simple synaptic plasticity rules acting within behaviorally relevant neural circuits. However, no past work has mapped operant matching onto plasticity mechanisms in the brain, leaving the biological relevance of the theory unclear. Here, we discovered operant matching in Drosophila and showed that it requires synaptic plasticity that acts in the mushroom body and incorporates the expectation of reward. We began by developing a dynamic foraging paradigm to measure choices from individual flies as they learn to associate odor cues with probabilistic rewards. We then built a model of the fly mushroom body to explain each fly's sequential choice behavior using a family of biologically realistic synaptic plasticity rules. As predicted by past theoretical work, we found that synaptic plasticity rules could explain fly matching behavior by incorporating stimulus expectations, reward expectations, or both. However, by optogenetically bypassing the representation of reward expectation, we abolished matching behavior and showed that the plasticity rule must specifically incorporate reward expectations. Altogether, these results reveal the first synapse-level mechanisms of operant matching and provide compelling evidence for the role of reward expectation signals in the fly brain.

The Panopticon-Assessing the Effect of Starvation on Prolonged Fly Activity and Place Preference

Animal behaviours are demonstrably governed by sensory stimulation, previous experience and internal states like hunger. With increasing hunger, priorities shift towards foraging and feeding. During foraging, flies are known to employ efficient path integration strategies. However, general long-term activity patterns for both hungry and satiated flies in conditions of foraging remain to be better understood. Similarly, little is known about how permanent contact chemosensory stimulation affects locomotion. To address these questions, we have developed a novel, simplistic fly activity tracking setup—the Panopticon. Using a 3D-printed Petri dish inset, our assay allows recording of walking behaviour, of several flies in parallel, with all arena surfaces covered by a uniform substrate layer. We tested two constellations of providing food: (i) in single patches and (ii) omnipresent within the substrate layer. Fly tracking is done with FIJI, further assessment, analysis and presentation is done with a custom-built MATLAB analysis framework. We find that starvation history leads to a long-lasting reduction in locomotion, as well as a delayed place preference for food patches which seems to be not driven by immediate hunger motivation.