1
|
Dan C, Hulse BK, Kappagantula R, Jayaraman V, Hermundstad AM. A neural circuit architecture for rapid learning in goal-directed navigation. Neuron 2024; 112:2581-2599.e23. [PMID: 38795708 DOI: 10.1016/j.neuron.2024.04.036] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Revised: 01/16/2024] [Accepted: 04/30/2024] [Indexed: 05/28/2024]
Abstract
Anchoring goals to spatial representations enables flexible navigation but is challenging in novel environments when both representations must be acquired simultaneously. We propose a framework for how Drosophila uses internal representations of head direction (HD) to build goal representations upon selective thermal reinforcement. We show that flies use stochastically generated fixations and directed saccades to express heading preferences in an operant visual learning paradigm and that HD neurons are required to modify these preferences based on reinforcement. We used a symmetric visual setting to expose how flies' HD and goal representations co-evolve and how the reliability of these interacting representations impacts behavior. Finally, we describe how rapid learning of new goal headings may rest on a behavioral policy whose parameters are flexible but whose form is genetically encoded in circuit architecture. Such evolutionarily structured architectures, which enable rapidly adaptive behavior driven by internal representations, may be relevant across species.
Collapse
Affiliation(s)
- Chuntao Dan
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA 20147, USA
| | - Brad K Hulse
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA 20147, USA
| | - Ramya Kappagantula
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA 20147, USA
| | - Vivek Jayaraman
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA 20147, USA.
| | - Ann M Hermundstad
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA 20147, USA.
| |
Collapse
|
2
|
Kobayashi N, Hasegawa Y, Okada R, Sakura M. Visual learning in tethered bees modifies flight orientation and is impaired by epinastine. J Comp Physiol A Neuroethol Sens Neural Behav Physiol 2023:10.1007/s00359-023-01623-z. [PMID: 36930349 DOI: 10.1007/s00359-023-01623-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2022] [Revised: 02/09/2023] [Accepted: 03/01/2023] [Indexed: 03/18/2023]
Abstract
Visual-orientation learning of a tethered flying bee was investigated using a flight simulator and a novel protocol in which orientation preference toward trained visual targets was assessed in tests performed before and after appetitive conditioning. Either a blue or a green rectangle (conditioned stimulus, CS) was associated with 30% sucrose solution (unconditioned stimulus, US), whereas the other rectangle was not paired with US. Bees were tested in a closed-looped flight simulator 5 min after ten pairings of the US and CS. Conditioned bees were preferentially oriented to the CS after such training. This increase in preference for CS was maintained for 24 h, indicating the presence of long-term memory. Because the total orienting time was not altered by conditioning, conditioning did not enhance orientation activity itself but increased the relative time for orientation to CS. When 0.4 or 4 mM epinastine (an antagonist of octopamine receptors) was injected into the bee's head 30 min prior to the experiment, both short- and long-term memory formation were significantly impaired, suggesting that octopamine, which is crucial for appetitive olfactory learning in insects, is also involved in visual orientation learning.
Collapse
Affiliation(s)
- Norihiro Kobayashi
- Department of Biology, Graduate School of Science, Kobe University, 1-1 Rokkodai-cho, Nada-ku, Kobe, Hyogo, 657-8501, Japan
| | | | - Ryuichi Okada
- Department of Biology, Graduate School of Science, Kobe University, 1-1 Rokkodai-cho, Nada-ku, Kobe, Hyogo, 657-8501, Japan.
| | - Midori Sakura
- Department of Biology, Graduate School of Science, Kobe University, 1-1 Rokkodai-cho, Nada-ku, Kobe, Hyogo, 657-8501, Japan.
| |
Collapse
|
3
|
Autonomous robot navigation based on a hierarchical cognitive model. ROBOTICA 2022. [DOI: 10.1017/s0263574722001539] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Abstract
We propose a hierarchical cognitive navigation model (HCNM) to improve the self-learning and self-adaptive ability of mobile robots in unknown and complex environments. The HCNM model adopts the divide and conquers approach by dividing the path planning task into different levels of sub-tasks in complex environments and solves each sub-task in a smaller state subspace to decrease the state space dimensions. The HCNM model imitates animal asymptotic properties through the study of thermodynamic processes and designs a cognitive learning algorithm to achieve online optimum search strategies. We prove that the learning algorithm designed ensures that the cognitive model can converge to the optimal behavior path with probability one. Robot navigation is studied on the basis of the cognitive process. The experimental results show that the HCNM model has strong adaptability in unknown and environment, and the navigation path is clearer and the convergence time is better. Among them, the convergence time of HCNM model is 25 s, which is 86.5% lower than that of HRLM model. The HCNM model studied in this paper adopts a hierarchical structure, which reduces the learning difficulty and accelerates the learning speed in the unknown environment.
Collapse
|
4
|
Excessive energy expenditure due to acute physical restraint disrupts Drosophila motivational feeding response. Sci Rep 2021; 11:24208. [PMID: 34921197 PMCID: PMC8683507 DOI: 10.1038/s41598-021-03575-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2021] [Accepted: 12/03/2021] [Indexed: 11/22/2022] Open
Abstract
To study the behavior of Drosophila, it is often necessary to restrain and mount individual flies. This requires removal from food, additional handling, anesthesia, and physical restraint. We find a strong positive correlation between the length of time flies are mounted and their subsequent reflexive feeding response, where one hour of mounting is the approximate motivational equivalent to ten hours of fasting. In an attempt to explain this correlation, we rule out anesthesia side-effects, handling, additional fasting, and desiccation. We use respirometric and metabolic techniques coupled with behavioral video scoring to assess energy expenditure in mounted and free flies. We isolate a specific behavior capable of exerting large amounts of energy in mounted flies and identify it as an attempt to escape from restraint. We present a model where physical restraint leads to elevated activity and subsequent faster nutrient storage depletion among mounted flies. This ultimately further accelerates starvation and thus increases reflexive feeding response. In addition, we show that the consequences of the physical restraint profoundly alter aerobic activity, energy depletion, taste, and feeding behavior, and suggest that careful consideration is given to the time-sensitive nature of these highly significant effects when conducting behavioral, physiological or imaging experiments that require immobilization.
Collapse
|
5
|
Tomina Y, Takahata M. Discrimination learning with light stimuli in restrained American lobster. Behav Brain Res 2012; 229:91-105. [DOI: 10.1016/j.bbr.2011.12.044] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2011] [Revised: 12/29/2011] [Accepted: 12/31/2011] [Indexed: 11/29/2022]
|
6
|
Yurkovic A, Wang O, Basu AC, Kravitz EA. Learning and memory associated with aggression in Drosophila melanogaster. Proc Natl Acad Sci U S A 2006; 103:17519-24. [PMID: 17088536 PMCID: PMC1634832 DOI: 10.1073/pnas.0608211103] [Citation(s) in RCA: 111] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Male Drosophila melanogaster (Canton-S strain) exhibit aggression in competition for resources, to defend territory, and for access to mates. In the study reported here, we asked: (i) how long flies fight; (ii) whether flies adopt distinct winning and losing strategies as hierarchical relationships are established; (iii) whether flies exhibit experience-dependent changes in fighting strategies in later fights; and (iv) whether flies fight differently in second fights against familiar or unfamiliar opponents. The results showed that flies fought for up to 5 h. As hierarchical relationships were established, behavioral strategies changed: winners progressively lunged more and retreated less, whereas losers progressively lunged less and retreated more. Encounters between flies were frequent during the first 10 min of pairing and then dropped significantly. To ask whether flies remembered previous fights, they were re-paired with familiar or unfamiliar opponents after 30 min of separation. In familiar pairings, there were fewer encounters during the first 10 min of fighting than in unfamiliar pairings, and former losers fought differently against familiar winners than unfamiliar winners. Former losers lost or no decision was reached in all second fights in pairings with familiar or unfamiliar winners or with naive flies. Winner/winner, loser/loser, and naive/naive pairings revealed that losers used low-intensity strategies in later fights and were unlikely to form new hierarchical relationships, compared with winners or socially naive flies. These results strongly support the idea that learning and memory accompany the changes in social status that result from fruit fly fights.
Collapse
Affiliation(s)
- Alexandra Yurkovic
- Department of Neurobiology, Harvard Medical School, 220 Longwood Avenue, Boston, MA 02115
| | - Oulu Wang
- Department of Neurobiology, Harvard Medical School, 220 Longwood Avenue, Boston, MA 02115
| | - Alo C. Basu
- Department of Neurobiology, Harvard Medical School, 220 Longwood Avenue, Boston, MA 02115
| | - Edward A. Kravitz
- Department of Neurobiology, Harvard Medical School, 220 Longwood Avenue, Boston, MA 02115
- *To whom correspondence should be addressed. E-mail:
| |
Collapse
|
7
|
Abstract
Different modalities of sensation interact in a synergistic or antagonistic manner during sensory perception, but whether there is also interaction during memory acquisition is largely unknown. In Drosophila reinforcement learning, we found that conditioning with concurrent visual and olfactory cues reduced the threshold for unimodal memory retrieval. Furthermore, bimodal preconditioning followed by unimodal conditioning with either a visual or olfactory cue led to crossmodal memory transfer. Crossmodal memory acquisition in Drosophila may contribute significantly to learning in a natural environment.
Collapse
Affiliation(s)
- Jianzeng Guo
- Institute of Neuroscience, Shanghai Institutes for Biological Sciences; Key Laboratory of Neurobiology, Chinese Academy of Sciences, Shanghai 200031, China
| | | |
Collapse
|
8
|
Tang S, Wolf R, Xu S, Heisenberg M. Visual pattern recognition in Drosophila is invariant for retinal position. Science 2004; 305:1020-2. [PMID: 15310908 DOI: 10.1126/science.1099839] [Citation(s) in RCA: 61] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
Abstract
Vision relies on constancy mechanisms. Yet, these are little understood, because they are difficult to investigate in freely moving organisms. One such mechanism, translation invariance, enables organisms to recognize visual patterns independent of the region of their visual field where they had originally seen them. Tethered flies (Drosophila melanogaster) in a flight simulator can recognize visual patterns. Because their eyes are fixed in space and patterns can be displayed in defined parts of their visual field, they can be tested for translation invariance. Here, we show that flies recognize patterns at retinal positions where the patterns had not been presented before.
Collapse
Affiliation(s)
- Shiming Tang
- Institute of Biophysics Academia Sinica, 15 Datun Road, Chaoyang, Beijing 100101, P.R. China.
| | | | | | | |
Collapse
|
9
|
Abstract
We studied the underlying neural mechanism of a simple choice behavior between competing alternatives in Drosophila. In a flight simulator, individual flies were conditioned to choose one of two flight paths in response to color and shape cues; after the training, they were tested with contradictory cues. Wild-type flies made a discrete choice that switched from one alternative to the other as the relative salience of color and shape cues gradually changed, but this ability was greatly diminished in mutant (mbm1) flies with miniature mushroom bodies or with hydroxyurea ablation of mushroom bodies. Thus, Drosophila genetics may be useful for elucidating the neural basis of choice behavior.
Collapse
Affiliation(s)
- S Tang
- Institute of Neuroscience, Shanghai Institute of Biological Sciences, Chinese Academy of Sciences, Shanghai 200031, China
| | | |
Collapse
|