1
|
Rozenfeld E, Parnas M. Neuronal circuit mechanisms of competitive interaction between action-based and coincidence learning. SCIENCE ADVANCES 2024; 10:eadq3016. [PMID: 39642217 PMCID: PMC11623277 DOI: 10.1126/sciadv.adq3016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/07/2024] [Accepted: 10/30/2024] [Indexed: 12/08/2024]
Abstract
How information is integrated across different forms of learning is crucial to understanding higher cognitive functions. Animals form classic or operant associations between cues and their outcomes. It is believed that a prerequisite for operant conditioning is the formation of a classical association. Thus, both memories coexist and are additive. However, the two memories can result in opposing behavioral responses, which can be disadvantageous. We show that Drosophila classical and operant olfactory conditioning rely on distinct neuronal pathways leading to different behavioral responses. Plasticity in both pathways cannot be formed simultaneously. If plasticity occurs at both pathways, interference between them occurs and learning is disrupted. Activity of the navigation center is required to prevent plasticity in the classical pathway and enable it in the operant pathway. These findings fundamentally challenge hierarchical views of operant and classical learning and show that active processes prevent coexistence of the two memories.
Collapse
Affiliation(s)
- Eyal Rozenfeld
- Department of Physiology and Pharmacology, Faculty of Medical and Health Sciences, Tel Aviv University, Tel Aviv 69978, Israel
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv 69978, Israel
| | - Moshe Parnas
- Department of Physiology and Pharmacology, Faculty of Medical and Health Sciences, Tel Aviv University, Tel Aviv 69978, Israel
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv 69978, Israel
| |
Collapse
|
2
|
Flores-Valle A, Seelig JD. A place learning assay for tethered walking Drosophila. J Neurosci Methods 2022; 378:109657. [PMID: 35760146 DOI: 10.1016/j.jneumeth.2022.109657] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2021] [Revised: 06/16/2022] [Accepted: 06/20/2022] [Indexed: 11/25/2022]
Abstract
BACKGROUND Drosophila shows a range of visually guided memory and learning behaviors, including place learning. Investigating the dynamics of neural circuits underlying such behaviors requires learning assays in tethered animals, compatible with in vivo imaging experiments. NEW METHOD Here, we introduce an assay for place learning for tethered walking flies. A cylindrical arena is rotated and translated in real time around the fly in concert with the rotational and translational walking activity measured with an air supported ball, resulting in a mechanical virtual reality (VR). RESULTS Navigation together with heat-based operant conditioning allows flies to learn the location of a cool spot with respect to a visual landmark. Flies optimize the time and distance required to find the cool spot over a similar number of trials as observed in assays with freely moving flies. Additionally, a fraction of flies remembers the location of the cool spot also after the conditioning heat is removed. COMPARISON WITH EXISTING METHODS Learning tasks have been implemented in tethered flying as well as walking flies. Mechanically translating and rotating an arena in concert with the fly's walking activity enables navigation in a three dimensional environment. CONCLUSION In the developed mechanical VR flies can learn to remember the location of a cool place within an otherwise hot environment with respect to a visual landmark. Implementing place learning in a tethered walking configuration is a precondition for investigating the underlying circuit dynamics using functional imaging.
Collapse
Affiliation(s)
- Andres Flores-Valle
- Max Planck Institute for Neurobiology of Behavior - caesar (MPINB), Bonn, Germany; International Max Planck Research School for Brain and Behavior, Bonn, Germany
| | - Johannes D Seelig
- Max Planck Institute for Neurobiology of Behavior - caesar (MPINB), Bonn, Germany.
| |
Collapse
|
3
|
Croteau-Chonka EC, Clayton MS, Venkatasubramanian L, Harris SN, Jones BMW, Narayan L, Winding M, Masson JB, Zlatic M, Klein KT. High-throughput automated methods for classical and operant conditioning of Drosophila larvae. eLife 2022; 11:70015. [PMID: 36305588 PMCID: PMC9678368 DOI: 10.7554/elife.70015] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2021] [Accepted: 10/26/2022] [Indexed: 02/02/2023] Open
Abstract
Learning which stimuli (classical conditioning) or which actions (operant conditioning) predict rewards or punishments can improve chances of survival. However, the circuit mechanisms that underlie distinct types of associative learning are still not fully understood. Automated, high-throughput paradigms for studying different types of associative learning, combined with manipulation of specific neurons in freely behaving animals, can help advance this field. The Drosophila melanogaster larva is a tractable model system for studying the circuit basis of behaviour, but many forms of associative learning have not yet been demonstrated in this animal. Here, we developed a high-throughput (i.e. multi-larva) training system that combines real-time behaviour detection of freely moving larvae with targeted opto- and thermogenetic stimulation of tracked animals. Both stimuli are controlled in either open- or closed-loop, and delivered with high temporal and spatial precision. Using this tracker, we show for the first time that Drosophila larvae can perform classical conditioning with no overlap between sensory stimuli (i.e. trace conditioning). We also demonstrate that larvae are capable of operant conditioning by inducing a bend direction preference through optogenetic activation of reward-encoding serotonergic neurons. Our results extend the known associative learning capacities of Drosophila larvae. Our automated training rig will facilitate the study of many different forms of associative learning and the identification of the neural circuits that underpin them.
Collapse
Affiliation(s)
- Elise C Croteau-Chonka
- Department of Zoology, University of CambridgeCambridgeUnited Kingdom,Janelia Research Campus, Howard Hughes Medical InstituteAshburnUnited States
| | | | | | | | | | - Lakshmi Narayan
- Janelia Research Campus, Howard Hughes Medical InstituteAshburnUnited States
| | - Michael Winding
- Department of Zoology, University of CambridgeCambridgeUnited Kingdom,Janelia Research Campus, Howard Hughes Medical InstituteAshburnUnited States
| | - Jean-Baptiste Masson
- Janelia Research Campus, Howard Hughes Medical InstituteAshburnUnited States,Decision and Bayesian Computation, Neuroscience Department & Computational Biology Department, Institut PasteurParisFrance
| | - Marta Zlatic
- Department of Zoology, University of CambridgeCambridgeUnited Kingdom,Janelia Research Campus, Howard Hughes Medical InstituteAshburnUnited States,MRC Laboratory of Molecular BiologyCambridgeUnited Kingdom
| | - Kristina T Klein
- Department of Zoology, University of CambridgeCambridgeUnited Kingdom,Janelia Research Campus, Howard Hughes Medical InstituteAshburnUnited States
| |
Collapse
|
4
|
Wiggin TD, Hsiao Y, Liu JB, Huber R, Griffith LC. Rest Is Required to Learn an Appetitively-Reinforced Operant Task in Drosophila. Front Behav Neurosci 2021; 15:681593. [PMID: 34220464 PMCID: PMC8250850 DOI: 10.3389/fnbeh.2021.681593] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2021] [Accepted: 05/21/2021] [Indexed: 11/13/2022] Open
Abstract
Maladaptive operant conditioning contributes to development of neuropsychiatric disorders. Candidate genes have been identified that contribute to this maladaptive plasticity, but the neural basis of operant conditioning in genetic model organisms remains poorly understood. The fruit fly Drosophila melanogaster is a versatile genetic model organism that readily forms operant associations with punishment stimuli. However, operant conditioning with a food reward has not been demonstrated in flies, limiting the types of neural circuits that can be studied. Here we present the first sucrose-reinforced operant conditioning paradigm for flies. In the paradigm, flies walk along a Y-shaped track with reward locations at the terminus of each hallway. When flies turn in the reinforced direction at the center of the track, they receive a sucrose reward at the end of the hallway. Only flies that rest early in training learn the reward contingency normally. Flies rewarded independently of their behavior do not form a learned association but have the same amount of rest as trained flies, showing that rest is not driven by learning. Optogenetically-induced sleep does not promote learning, indicating that sleep itself is not sufficient for learning the operant task. We validated the sensitivity of this assay to detect the effect of genetic manipulations by testing the classic learning mutant dunce. Dunce flies are learning-impaired in the Y-Track task, indicating a likely role for cAMP in the operant coincidence detector. This novel training paradigm will provide valuable insight into the molecular mechanisms of disease and the link between sleep and learning.
Collapse
Affiliation(s)
- Timothy D. Wiggin
- Department of Biology, National Center for Behavioral Genomics and Volen Center for Complex Systems, Brandeis University, Waltham, MA, United States
| | - Yungyi Hsiao
- Department of Biology, National Center for Behavioral Genomics and Volen Center for Complex Systems, Brandeis University, Waltham, MA, United States
| | - Jeffrey B. Liu
- Department of Biology, National Center for Behavioral Genomics and Volen Center for Complex Systems, Brandeis University, Waltham, MA, United States
| | - Robert Huber
- Radcliffe Institute for Advanced Studies, Harvard University, Cambridge, MA, United States
- Juvatech, Toledo, MA, United States
| | - Leslie C. Griffith
- Department of Biology, National Center for Behavioral Genomics and Volen Center for Complex Systems, Brandeis University, Waltham, MA, United States
| |
Collapse
|
5
|
Seidenbecher SE, Sanders JI, von Philipsborn AC, Kvitsiani D. Reward foraging task and model-based analysis reveal how fruit flies learn value of available options. PLoS One 2020; 15:e0239616. [PMID: 33007023 PMCID: PMC7531776 DOI: 10.1371/journal.pone.0239616] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2020] [Accepted: 09/10/2020] [Indexed: 11/18/2022] Open
Abstract
Foraging animals have to evaluate, compare and select food patches in order to increase their fitness. Understanding what drives foraging decisions requires careful manipulation of the value of alternative options while monitoring animals choices. Value-based decision-making tasks in combination with formal learning models have provided both an experimental and theoretical framework to study foraging decisions in lab settings. While these approaches were successfully used in the past to understand what drives choices in mammals, very little work has been done on fruit flies. This is despite the fact that fruit flies have served as model organism for many complex behavioural paradigms. To fill this gap we developed a single-animal, trial-based decision making task, where freely walking flies experienced optogenetic sugar-receptor neuron stimulation. We controlled the value of available options by manipulating the probabilities of optogenetic stimulation. We show that flies integrate reward history of chosen options and forget value of unchosen options. We further discover that flies assign higher values to rewards experienced early in the behavioural session, consistent with formal reinforcement learning models. Finally, we also show that the probabilistic rewards affect walking trajectories of flies, suggesting that accumulated value is controlling the navigation vector of flies in a graded fashion. These findings establish the fruit fly as a model organism to explore the genetic and circuit basis of reward foraging decisions.
Collapse
Affiliation(s)
- Sophie E Seidenbecher
- Danish Research Institute of Translational Neuroscience - DANDRITE, Nordic-EMBL Partnership for Molecular Medicine, Aarhus, Denmark.,Department of Molecular Biology and Genetics, Aarhus University, Aarhus, Denmark
| | - Joshua I Sanders
- Danish Research Institute of Translational Neuroscience - DANDRITE, Nordic-EMBL Partnership for Molecular Medicine, Aarhus, Denmark.,Department of Molecular Biology and Genetics, Aarhus University, Aarhus, Denmark
| | - Anne C von Philipsborn
- Danish Research Institute of Translational Neuroscience - DANDRITE, Nordic-EMBL Partnership for Molecular Medicine, Aarhus, Denmark.,Department of Molecular Biology and Genetics, Aarhus University, Aarhus, Denmark
| | - Duda Kvitsiani
- Danish Research Institute of Translational Neuroscience - DANDRITE, Nordic-EMBL Partnership for Molecular Medicine, Aarhus, Denmark.,Department of Molecular Biology and Genetics, Aarhus University, Aarhus, Denmark
| |
Collapse
|
6
|
Haberkern H, Basnak MA, Ahanonu B, Schauder D, Cohen JD, Bolstad M, Bruns C, Jayaraman V. Visually Guided Behavior and Optogenetically Induced Learning in Head-Fixed Flies Exploring a Virtual Landscape. Curr Biol 2019; 29:1647-1659.e8. [DOI: 10.1016/j.cub.2019.04.033] [Citation(s) in RCA: 40] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2018] [Revised: 03/22/2019] [Accepted: 04/11/2019] [Indexed: 11/28/2022]
|
7
|
Shi T, Yang W, Ren H. A study on the cognitive model of robot sensorimotor system1. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2015. [DOI: 10.3233/ifs-141204] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Affiliation(s)
- Tao Shi
- School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, China
- College of Electrical Engineering, Hebei United University, HeBei, Tangshan, China
| | - Weidong Yang
- School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, China
| | - Hongge Ren
- College of Electrical Engineering, Hebei United University, HeBei, Tangshan, China
| |
Collapse
|
8
|
Channelrhodopsin-2-XXL, a powerful optogenetic tool for low-light applications. Proc Natl Acad Sci U S A 2014; 111:13972-7. [PMID: 25201989 DOI: 10.1073/pnas.1408269111] [Citation(s) in RCA: 125] [Impact Index Per Article: 11.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Channelrhodopsin-2 (ChR2) has provided a breakthrough for the optogenetic control of neuronal activity. In adult Drosophila melanogaster, however, its applications are severely constrained. This limitation in a powerful model system has curtailed unfolding the full potential of ChR2 for behavioral neuroscience. Here, we describe the D156C mutant, termed ChR2-XXL (extra high expression and long open state), which displays increased expression, improved subcellular localization, elevated retinal affinity, an extended open-state lifetime, and photocurrent amplitudes greatly exceeding those of all heretofore published ChR variants. As a result, neuronal activity could be efficiently evoked with ambient light and even without retinal supplementation. We validated the benefits of the variant in intact flies by eliciting simple and complex behaviors. We demonstrate efficient and prolonged photostimulation of monosynaptic transmission at the neuromuscular junction and reliable activation of a gustatory reflex pathway. Innate male courtship was triggered in male and female flies, and olfactory memories were written through light-induced associative training.
Collapse
|