1
|
Dan C, Hulse BK, Kappagantula R, Jayaraman V, Hermundstad AM. A neural circuit architecture for rapid learning in goal-directed navigation. Neuron 2024; 112:2581-2599.e23. [PMID: 38795708 DOI: 10.1016/j.neuron.2024.04.036] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Revised: 01/16/2024] [Accepted: 04/30/2024] [Indexed: 05/28/2024]
Abstract
Anchoring goals to spatial representations enables flexible navigation but is challenging in novel environments when both representations must be acquired simultaneously. We propose a framework for how Drosophila uses internal representations of head direction (HD) to build goal representations upon selective thermal reinforcement. We show that flies use stochastically generated fixations and directed saccades to express heading preferences in an operant visual learning paradigm and that HD neurons are required to modify these preferences based on reinforcement. We used a symmetric visual setting to expose how flies' HD and goal representations co-evolve and how the reliability of these interacting representations impacts behavior. Finally, we describe how rapid learning of new goal headings may rest on a behavioral policy whose parameters are flexible but whose form is genetically encoded in circuit architecture. Such evolutionarily structured architectures, which enable rapidly adaptive behavior driven by internal representations, may be relevant across species.
Collapse
Affiliation(s)
- Chuntao Dan
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA 20147, USA
| | - Brad K Hulse
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA 20147, USA
| | - Ramya Kappagantula
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA 20147, USA
| | - Vivek Jayaraman
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA 20147, USA.
| | - Ann M Hermundstad
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA 20147, USA.
| |
Collapse
|
2
|
Verbe A, Lea KM, Fox JL, Dickerson BH. Flies tune the activity of their multifunctional gyroscope. Curr Biol 2024:S0960-9822(24)00850-9. [PMID: 39053466 DOI: 10.1016/j.cub.2024.06.066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2024] [Revised: 05/21/2024] [Accepted: 06/25/2024] [Indexed: 07/27/2024]
Abstract
Members of the order Diptera, the true flies, are among the most maneuverable flying animals. These aerial capabilities are partially attributed to flies' possession of halteres, tiny club-shaped structures that evolved from the hindwings and play a crucial role in flight control. Halteres are renowned for acting as biological gyroscopes that rapidly detect rotational perturbations and help flies maintain a stable flight posture. Additionally, halteres provide rhythmic input to the wing steering system that can be indirectly modulated by the visual system. The multifunctional capacity of the haltere is thought to depend on arrays of embedded mechanosensors called campaniform sensilla that are arranged in distinct groups on the haltere's dorsal and ventral surfaces. Although longstanding hypotheses suggest that each array provides different information relevant to the flight control circuitry, we know little about how the haltere campaniforms are functionally organized. Here, we use in vivo calcium imaging during tethered flight to obtain population-level recordings of the haltere sensory afferents in specific fields of sensilla. We find that haltere feedback from both dorsal fields is continuously active, modulated under closed-loop flight conditions, and recruited during saccades to help flies actively maneuver. We also find that the haltere's multifaceted role may arise from the steering muscles of the haltere itself, regulating haltere stroke amplitude to modulate campaniform activity. Taken together, our results underscore the crucial role of efferent control in regulating sensor activity and provide insight into how the sensory and motor systems of flies coevolved.
Collapse
Affiliation(s)
- Anna Verbe
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ 08540, USA
| | - Kristianna M Lea
- Department of Biology, Case Western Reserve University, Cleveland, OH 44106, USA
| | - Jessica L Fox
- Department of Biology, Case Western Reserve University, Cleveland, OH 44106, USA
| | - Bradley H Dickerson
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ 08540, USA.
| |
Collapse
|
3
|
Hsu SJ, Deng H, Wang J, Dong H, Cheng B. Wing deformation improves aerodynamic performance of forward flight of bluebottle flies flying in a flight mill. J R Soc Interface 2024; 21:20240076. [PMID: 39016178 PMCID: PMC11253209 DOI: 10.1098/rsif.2024.0076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Revised: 04/11/2024] [Accepted: 06/03/2024] [Indexed: 07/18/2024] Open
Abstract
Insect wings are flexible structures that exhibit deformations of complex spatiotemporal patterns. Existing studies on wing deformation underscore the indispensable role of wing deformation in enhancing aerodynamic performance. Here, we investigated forward flight in bluebottle flies, flying semi-freely in a magnetic flight mill; we quantified wing surface deformation using high-speed videography and marker-less surface reconstruction and studied the effects on aerodynamic forces, power and efficiency using computational fluid dynamics. The results showed that flies' wings exhibited substantial camber near the wing root and twisted along the wingspan, as they were coupled effects of deflection primarily about the claval flexion line. Such deflection was more substantial for supination during the upstroke when most thrust was produced. Compared with deformed wings, the undeformed wings generated 59-98% of thrust and 54-87% of thrust efficiency (i.e. ratio of thrust and power). Wing twist moved the aerodynamic centre of pressure proximally and posteriorly, likely improving aerodynamic efficiency.
Collapse
Affiliation(s)
- Shih-Jung Hsu
- Department of Mechanical Engineering, Pennsylvania State University, University Park, PA16802, USA
| | - Hankun Deng
- Department of Mechanical Engineering, Pennsylvania State University, University Park, PA16802, USA
| | - Junshi Wang
- Department of Mechanical and Aerospace Engineering, University of Virginia, Charlottesville, VA22904, USA
| | - Haibo Dong
- Department of Mechanical and Aerospace Engineering, University of Virginia, Charlottesville, VA22904, USA
| | - Bo Cheng
- Department of Mechanical Engineering, Pennsylvania State University, University Park, PA16802, USA
| |
Collapse
|
4
|
Melis JM, Siwanowicz I, Dickinson MH. Machine learning reveals the control mechanics of an insect wing hinge. Nature 2024; 628:795-803. [PMID: 38632396 DOI: 10.1038/s41586-024-07293-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Accepted: 03/11/2024] [Indexed: 04/19/2024]
Abstract
Insects constitute the most species-rich radiation of metazoa, a success that is due to the evolution of active flight. Unlike pterosaurs, birds and bats, the wings of insects did not evolve from legs1, but are novel structures that are attached to the body via a biomechanically complex hinge that transforms tiny, high-frequency oscillations of specialized power muscles into the sweeping back-and-forth motion of the wings2. The hinge consists of a system of tiny, hardened structures called sclerites that are interconnected to one another via flexible joints and regulated by the activity of specialized control muscles. Here we imaged the activity of these muscles in a fly using a genetically encoded calcium indicator, while simultaneously tracking the three-dimensional motion of the wings with high-speed cameras. Using machine learning, we created a convolutional neural network3 that accurately predicts wing motion from the activity of the steering muscles, and an encoder-decoder4 that predicts the role of the individual sclerites on wing motion. By replaying patterns of wing motion on a dynamically scaled robotic fly, we quantified the effects of steering muscle activity on aerodynamic forces. A physics-based simulation incorporating our hinge model generates flight manoeuvres that are remarkably similar to those of free-flying flies. This integrative, multi-disciplinary approach reveals the mechanical control logic of the insect wing hinge, arguably among the most sophisticated and evolutionarily important skeletal structures in the natural world.
Collapse
Affiliation(s)
- Johan M Melis
- Division of Biology and Bioengineering, California Institute of Technology, Pasadena, CA, USA
| | - Igor Siwanowicz
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Michael H Dickinson
- Division of Biology and Bioengineering, California Institute of Technology, Pasadena, CA, USA.
| |
Collapse
|
5
|
Melis JM, Siwanowicz I, Dickinson MH. Machine learning reveals the control mechanics of an insect wing hinge. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.06.29.547116. [PMID: 37425804 PMCID: PMC10327165 DOI: 10.1101/2023.06.29.547116] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/11/2023]
Abstract
Insects constitute the most species-rich radiation of metazoa, a success due to the evolution of active flight. Unlike pterosaurs, birds, and bats, the wings of insects did not evolve from legs 1 , but are novel structures attached to the body via a biomechanically complex hinge that transforms tiny, high-frequency oscillations of specialized power muscles into the sweeping back-and-forth motion of the wings 2 . The hinge consists of a system of tiny, hardened structures called sclerites that are interconnected to one another via flexible joints and regulated by the activity of specialized control muscles. Here, we imaged the activity of these muscles in a fly using a genetically encoded calcium indicator, while simultaneously tracking the 3D motion of the wings with high-speed cameras. Using machine learning approaches, we created a convolutional neural network 3 that accurately predicts wing motion from the activity of the steering muscles, and an encoder-decoder 4 that predicts the role of the individual sclerites on wing motion. By replaying patterns of wing motion on a dynamically scaled robotic fly, we quantified the effects of steering muscle activity on aerodynamic forces. A physics-based simulation that incorporates our model of the hinge generates flight maneuvers that are remarkably similar to those of free flying flies. This integrative, multi-disciplinary approach reveals the mechanical control logic of the insect wing hinge, arguably among the most sophisticated and evolutionarily important skeletal structures in the natural world.
Collapse
|
6
|
Cellini B, Ferrero M, Mongeau JM. Drosophila flying in augmented reality reveals the vision-based control autonomy of the optomotor response. Curr Biol 2024; 34:68-78.e4. [PMID: 38113890 DOI: 10.1016/j.cub.2023.11.045] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Revised: 10/03/2023] [Accepted: 11/21/2023] [Indexed: 12/21/2023]
Abstract
For walking, swimming, and flying animals, the optomotor response is essential to stabilize gaze. How flexible is the optomotor response? Classic work in Drosophila has argued that flies adapt flight control under augmented visual feedback conditions during goal-directed bar fixation. However, whether the lower-level, reflexive optomotor response can similarly adapt to augmented visual feedback (partially autonomous) or not (autonomous) over long timescales is poorly understood. To address this question, we developed an augmented reality paradigm to study the vision-based control autonomy of the yaw optomotor response of flying fruit flies (Drosophila). Flies were placed in a flight simulator, which permitted free body rotation about the yaw axis. By feeding back body movements in real time to a visual display, we augmented and inverted visual feedback. Thus, this experimental paradigm caused a constant visual error between expected and actual visual feedback to study potential adaptive visuomotor control. By combining experiments with control theory, we demonstrate that the optomotor response is autonomous during augmented reality flight bouts of up to 30 min, which exceeds the reported learning epoch during bar fixation. Agreement between predictions from linear systems theory and experimental data supports the notion that the optomotor response is approximately linear and time invariant within our experimental assay. Even under positive visual feedback, which revealed the stability limit of flies in augmented reality, the optomotor response was autonomous. Our results support a hierarchical motor control architecture in flies with fast and autonomous reflexes at the bottom and more flexible behavior at higher levels.
Collapse
Affiliation(s)
- Benjamin Cellini
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA 16802, USA; Department of Mechanical Engineering, University of Nevada, Reno, NV 89557, USA.
| | - Marioalberto Ferrero
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA 16802, USA.
| | - Jean-Michel Mongeau
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA 16802, USA.
| |
Collapse
|
7
|
Davis BA, Mongeau JM. The influence of saccades on yaw gaze stabilization in fly flight. PLoS Comput Biol 2023; 19:e1011746. [PMID: 38127819 PMCID: PMC10769041 DOI: 10.1371/journal.pcbi.1011746] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Revised: 01/05/2024] [Accepted: 12/08/2023] [Indexed: 12/23/2023] Open
Abstract
In a way analogous to human vision, the fruit fly D. melanogaster and many other flying insects generate smooth and saccadic movements to stabilize and shift their gaze in flight, respectively. It has been hypothesized that this combination of continuous and discrete movements benefits both flight stability and performance, particularly at high frequencies or speeds. Here we develop a hybrid control system model to explore the effects of saccades on the yaw stabilization reflex of D. melanogaster. Inspired from experimental data, the model includes a first order plant, a Proportional-Integral (PI) continuous controller, and a saccadic reset system that fires based on the integrated error of the continuous controller. We explore the gain, delay and switching threshold parameter space to quantify the optimum regions for yaw stability and performance. We show that the addition of saccades to a continuous controller provides benefits to both stability and performance across a range of frequencies. Our model suggests that Drosophila operates near its optimal switching threshold for its experimental gain set. We also show that based on experimental data, D. melanogaster operates in a region that trades off performance and stability. This trade-off increases flight robustness to compensate for internal perturbations such as wing damage.
Collapse
Affiliation(s)
- Brock A. Davis
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, Pennsylvania, United States of America
| | - Jean-Michel Mongeau
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, Pennsylvania, United States of America
| |
Collapse
|
8
|
Cerkvenik U, Belušič G. Drinking on the wing: water collection in polarotactic horseflies. J Comp Physiol A Neuroethol Sens Neural Behav Physiol 2023; 209:943-954. [PMID: 37477716 PMCID: PMC10643286 DOI: 10.1007/s00359-023-01657-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2022] [Revised: 06/28/2023] [Accepted: 07/10/2023] [Indexed: 07/22/2023]
Abstract
Many insects detect water bodies by observing the linearly polarised light which is reflected from the water surface. Polarotactic horseflies exhibit acrobatic manoeuvres above the water and are able to plunge on its surface, collect a droplet and fly away. This behaviour is extremely fast and has not yet been analysed. We recorded the flight patterns and kinematics of drinking horseflies using a pair of high-speed cameras. The animals of both sexes are attracted to water puddles where they make short, millisecond pitstops to collect a droplet of water that is then presumably drank "on the wing". Before the collection, the flies perform several low-altitude flybys above the puddle. After a few passes, the fly suddenly reverses its body orientation, decelerates, briefly touches the water surface and immediately flies away, usually with a droplet carried between its front legs. During the approach flight, the horseflies fly low but do not show any angular preference. Thus, they view the reflections from the sky, sun, or vegetation with a wide band of ventral ommatidia. Polarotaxis in drinking horseflies is a very robust visually guided behaviour, which operates at a broad range of intensities and various spectral compositions of reflected light.
Collapse
Affiliation(s)
- Uroš Cerkvenik
- Department of Biology, Biotechnical Faculty, University of Ljubljana, Večna Pot 111, 1000, Ljubljana, Slovenia
| | - Gregor Belušič
- Department of Biology, Biotechnical Faculty, University of Ljubljana, Večna Pot 111, 1000, Ljubljana, Slovenia.
| |
Collapse
|
9
|
Chen J, Gish CM, Fransen JW, Salazar-Gatzimas E, Clark DA, Borghuis BG. Direct comparison reveals algorithmic similarities in fly and mouse visual motion detection. iScience 2023; 26:107928. [PMID: 37810236 PMCID: PMC10550730 DOI: 10.1016/j.isci.2023.107928] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Revised: 08/07/2023] [Accepted: 09/12/2023] [Indexed: 10/10/2023] Open
Abstract
Evolution has equipped vertebrates and invertebrates with neural circuits that selectively encode visual motion. While similarities in the computations performed by these circuits in mouse and fruit fly have been noted, direct experimental comparisons have been lacking. Because molecular mechanisms and neuronal morphology in the two species are distinct, we directly compared motion encoding in these two species at the algorithmic level, using matched stimuli and focusing on a pair of analogous neurons, the mouse ON starburst amacrine cell (ON SAC) and Drosophila T4 neurons. We find that the cells share similar spatiotemporal receptive field structures, sensitivity to spatiotemporal correlations, and tuning to sinusoidal drifting gratings, but differ in their responses to apparent motion stimuli. Both neuron types showed a response to summed sinusoids that deviates from models for motion processing in these cells, underscoring the similarities in their processing and identifying response features that remain to be explained.
Collapse
Affiliation(s)
- Juyue Chen
- Interdepartmental Neurosciences Program, Yale University, New Haven, CT 06511, USA
| | - Caitlin M Gish
- Department of Physics, Yale University, New Haven, CT 06511, USA
| | - James W Fransen
- Department of Anatomical Sciences and Neurobiology, University of Louisville, Louisville, KY 40202, USA
| | | | - Damon A Clark
- Interdepartmental Neurosciences Program, Yale University, New Haven, CT 06511, USA
- Department of Physics, Yale University, New Haven, CT 06511, USA
- Department of Molecular, Cellular, Developmental Biology, Yale University, New Haven, CT 06511, USA
- Department of Neuroscience, Yale University, New Haven, CT 06511, USA
| | - Bart G Borghuis
- Department of Anatomical Sciences and Neurobiology, University of Louisville, Louisville, KY 40202, USA
| |
Collapse
|
10
|
Salem W, Cellini B, Jaworski E, Mongeau JM. Flies adaptively control flight to compensate for added inertia. Proc Biol Sci 2023; 290:20231115. [PMID: 37817597 PMCID: PMC10565401 DOI: 10.1098/rspb.2023.1115] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Accepted: 09/18/2023] [Indexed: 10/12/2023] Open
Abstract
Animal locomotion is highly adaptive, displaying a large degree of flexibility, yet how this flexibility arises from the integration of mechanics and neural control remains elusive. For instance, animals require flexible strategies to maintain performance as changes in mass or inertia impact stability. Compensatory strategies to mechanical loading are especially critical for animals that rely on flight for survival. To shed light on the capacity and flexibility of flight neuromechanics to mechanical loading, we pushed the performance of fruit flies (Drosophila) near its limit and implemented a control theoretic framework. Flies with added inertia were placed inside a virtual reality arena which permitted free rotation about the vertical (yaw) axis. Adding inertia increased the fly's response time yet had little influence on overall gaze stabilization performance. Flies maintained stability following the addition of inertia by adaptively modulating both visuomotor gain and damping. By contrast, mathematical modelling predicted a significant decrease in gaze stabilization performance. Adding inertia altered saccades, however, flies compensated for the added inertia by increasing saccade torque. Taken together, in response to added inertia flies increase reaction time but maintain flight performance through adaptive neural control. Overall, adding inertia decreases closed-loop flight robustness. Our work highlights the flexibility and capacity of motor control in flight.
Collapse
Affiliation(s)
- Wael Salem
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA, USA
| | - Benjamin Cellini
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA, USA
| | - Eric Jaworski
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA, USA
| | - Jean-Michel Mongeau
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA, USA
| |
Collapse
|
11
|
Haque MN, Cheng B, Tobalske BW, Luo H. Hummingbirds use wing inertial effects to improve manoeuvrability. J R Soc Interface 2023; 20:20230229. [PMID: 37788711 PMCID: PMC10547554 DOI: 10.1098/rsif.2023.0229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Accepted: 09/11/2023] [Indexed: 10/05/2023] Open
Abstract
Hummingbirds outperform other birds in terms of aerial agility at low flight speeds. To reveal the key mechanisms that enable such unparalleled agility, we reconstructed body and wing motion of hummingbird escape manoeuvres from high-speed videos; then, we performed computational fluid dynamics modelling and flight mechanics analysis, in which the time-dependent forces within each wingbeat were resolved. We found that the birds may use the inertia of their wings to achieve peak body rotational acceleration around wing reversal when the aerodynamic forces were small. The aerodynamic forces instead counteracted the reversed inertial forces at a different wingbeat phase, thereby stabilizing the body from inertial oscillations, or they could become dominant and provide additional rotational acceleration. Our results suggest such an inertial steering mechanism was present for all four hummingbird species considered, and it was used by the birds for both pitch-up and roll accelerations. The combined inertial steering and aerodynamic mechanisms made it possible for the hummingbirds to generate instantaneous body acceleration at any phase of a wingbeat, and this feature is probably the key to understanding the unique dexterity distinguishing hummingbirds from other small-size flyers that solely rely on aerodynamics for manoeuvering.
Collapse
Affiliation(s)
| | - Bo Cheng
- Department of Mechanical Engineering, Pennsylvania State University, University Park, PA 16802, USA
| | - Bret W. Tobalske
- Field Research Station at Fort Missoula, Division of Biological Sciences, University of Montana, Missoula, MT 59812, USA
| | - Haoxiang Luo
- Department of Mechanical Engineering, Vanderbilt University, Nashville, TN 37235, USA
| |
Collapse
|
12
|
Braun A, Borst A, Meier M. Disynaptic inhibition shapes tuning of OFF-motion detectors in Drosophila. Curr Biol 2023:S0960-9822(23)00601-2. [PMID: 37236181 DOI: 10.1016/j.cub.2023.05.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2023] [Revised: 04/02/2023] [Accepted: 05/03/2023] [Indexed: 05/28/2023]
Abstract
The circuitry underlying the detection of visual motion in Drosophila melanogaster is one of the best studied networks in neuroscience. Lately, electron microscopy reconstructions, algorithmic models, and functional studies have proposed a common motif for the cellular circuitry of an elementary motion detector based on both supralinear enhancement for preferred direction and sublinear suppression for null-direction motion. In T5 cells, however, all columnar input neurons (Tm1, Tm2, Tm4, and Tm9) are excitatory. So, how is null-direction suppression realized there? Using two-photon calcium imaging in combination with thermogenetics, optogenetics, apoptotics, and pharmacology, we discovered that it is via CT1, the GABAergic large-field amacrine cell, where the different processes have previously been shown to act in an electrically isolated way. Within each column, CT1 receives excitatory input from Tm9 and Tm1 and provides the sign-inverted, now inhibitory input signal onto T5. Ablating CT1 or knocking down GABA-receptor subunit Rdl significantly broadened the directional tuning of T5 cells. It thus appears that the signal of Tm1 and Tm9 is used both as an excitatory input for preferred direction enhancement and, through a sign inversion within the Tm1/Tm9-CT1 microcircuit, as an inhibitory input for null-direction suppression.
Collapse
Affiliation(s)
- Amalia Braun
- Max Planck Institute for Biological Intelligence, Department of Circuits - Computation - Models, Am Klopferspitz 18, 82152 Martinsried, Germany.
| | - Alexander Borst
- Max Planck Institute for Biological Intelligence, Department of Circuits - Computation - Models, Am Klopferspitz 18, 82152 Martinsried, Germany
| | - Matthias Meier
- Max Planck Institute for Biological Intelligence, Department of Circuits - Computation - Models, Am Klopferspitz 18, 82152 Martinsried, Germany.
| |
Collapse
|
13
|
Kim G, An J, Ha S, Kim AJ. A deep learning analysis of Drosophila body kinematics during magnetically tethered flight. J Neurogenet 2023:1-10. [PMID: 37200153 DOI: 10.1080/01677063.2023.2210682] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2022] [Accepted: 05/01/2023] [Indexed: 05/20/2023]
Abstract
Flying Drosophila rely on their vision to detect visual objects and adjust their flight course. Despite their robust fixation on a dark, vertical bar, our understanding of the underlying visuomotor neural circuits remains limited, in part due to difficulties in analyzing detailed body kinematics in a sensitive behavioral assay. In this study, we observed the body kinematics of flying Drosophila using a magnetically tethered flight assay, in which flies are free to rotate around their yaw axis, enabling naturalistic visual and proprioceptive feedback. Additionally, we used deep learning-based video analyses to characterize the kinematics of multiple body parts in flying animals. By applying this pipeline of behavioral experiments and analyses, we characterized the detailed body kinematics during rapid flight turns (or saccades) in two different visual conditions: spontaneous flight saccades under static screen and bar-fixating saccades while tracking a rotating bar. We found that both types of saccades involved movements of multiple body parts and that the overall dynamics were comparable. Our study highlights the importance of sensitive behavioral assays and analysis tools for characterizing complex visual behaviors.
Collapse
Affiliation(s)
- Geonil Kim
- Department of Artificial Intelligence, Hanyang University, Seoul, South Korea
| | - JoonHu An
- Department of Electronic Engineering, Hanyang University, Seoul, South Korea
| | - Subin Ha
- Department of Artificial Intelligence, Hanyang University, Seoul, South Korea
| | - Anmo J Kim
- Department of Artificial Intelligence, Hanyang University, Seoul, South Korea
- Department of Electronic Engineering, Hanyang University, Seoul, South Korea
- Department of Biomedical Engineering, Hanyang University, Seoul, South Korea
| |
Collapse
|
14
|
Egelhaaf M. Optic flow based spatial vision in insects. J Comp Physiol A Neuroethol Sens Neural Behav Physiol 2023:10.1007/s00359-022-01610-w. [PMID: 36609568 DOI: 10.1007/s00359-022-01610-w] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Revised: 12/06/2022] [Accepted: 12/24/2022] [Indexed: 01/09/2023]
Abstract
The optic flow, i.e., the displacement of retinal images of objects in the environment induced by self-motion, is an important source of spatial information, especially for fast-flying insects. Spatial information over a wide range of distances, from the animal's immediate surroundings over several hundred metres to kilometres, is necessary for mediating behaviours, such as landing manoeuvres, collision avoidance in spatially complex environments, learning environmental object constellations and path integration in spatial navigation. To facilitate the processing of spatial information, the complexity of the optic flow is often reduced by active vision strategies. These result in translations and rotations being largely separated by a saccadic flight and gaze mode. Only the translational components of the optic flow contain spatial information. In the first step of optic flow processing, an array of local motion detectors provides a retinotopic spatial proximity map of the environment. This local motion information is then processed in parallel neural pathways in a task-specific manner and used to control the different components of spatial behaviour. A particular challenge here is that the distance information extracted from the optic flow does not represent the distances unambiguously, but these are scaled by the animal's speed of locomotion. Possible ways of coping with this ambiguity are discussed.
Collapse
Affiliation(s)
- Martin Egelhaaf
- Neurobiology and Center for Cognitive Interaction Technology (CITEC), Bielefeld University, Universitätsstraße 25, 33615, Bielefeld, Germany.
| |
Collapse
|
15
|
Harada N, Tanaka H. Kinematic and hydrodynamic analyses of turning manoeuvres in penguins: body banking and wing upstroke generate centripetal force. J Exp Biol 2022; 225:286158. [PMID: 36408785 DOI: 10.1242/jeb.244124] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Accepted: 11/14/2022] [Indexed: 11/22/2022]
Abstract
Penguins perform lift-based swimming by flapping their wings. Previous kinematic and hydrodynamic studies have revealed the basics of wing motion and force generation in penguins. Although these studies have focused on steady forward swimming, the mechanism of turning manoeuvres is not well understood. In this study, we examined the horizontal turning of penguins via 3D motion analysis and quasi-steady hydrodynamic analysis. Free swimming of gentoo penguins (Pygoscelis papua) at an aquarium was recorded, and body and wing kinematics were analysed. In addition, quasi-steady calculations of the forces generated by the wings were performed. Among the selected horizontal swimming manoeuvres, turning was distinguished from straight swimming by the body trajectory for each wingbeat. During the turns, the penguins maintained outward banking through a wingbeat cycle and utilized a ventral force during the upstroke as a centripetal force to turn. Within a single wingbeat during the turns, changes in the body heading and bearing also mainly occurred during the upstroke, while the subsequent downstroke accelerated the body forward. We also found contralateral differences in the wing motion, i.e. the inside wing of the turn became more elevated and pronated. Quasi-steady calculations of the wing force confirmed that the asymmetry of the wing motion contributes to the generation of the centripetal force during the upstroke and the forward force during the downstroke. The results of this study demonstrate that the hydrodynamic force of flapping wings, in conjunction with body banking, is actively involved in the mechanism of turning manoeuvres in penguins.
Collapse
Affiliation(s)
- Natsuki Harada
- School of Engineering, Tokyo Institute of Technology, 2-12-1 Ookayama, Meguro-ku, Tokyo 152-8550, Japan
| | - Hiroto Tanaka
- School of Engineering, Tokyo Institute of Technology, 2-12-1 Ookayama, Meguro-ku, Tokyo 152-8550, Japan
| |
Collapse
|
16
|
Salem W, Cellini B, Kabutz H, Hari Prasad HK, Cheng B, Jayaram K, Mongeau JM. Flies trade off stability and performance via adaptive compensation to wing damage. SCIENCE ADVANCES 2022; 8:eabo0719. [PMID: 36399568 PMCID: PMC9674276 DOI: 10.1126/sciadv.abo0719] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Accepted: 09/30/2022] [Indexed: 06/16/2023]
Abstract
Physical injury often impairs mobility, which can have dire consequences for survival in animals. Revealing mechanisms of robust biological intelligence to prevent system failure can provide critical insights into how complex brains generate adaptive movement and inspiration to design fault-tolerant robots. For flying animals, physical injury to a wing can have severe consequences, as flight is inherently unstable. Using a virtual reality flight arena, we studied how flying fruit flies compensate for damage to one wing. By combining experimental and mathematical methods, we show that flies compensate for wing damage by corrective wing movement modulated by closed-loop sensing and robust mechanics. Injured flies actively increase damping and, in doing so, modestly decrease flight performance but fly as stably as uninjured flies. Quantifying responses to injury can uncover the flexibility and robustness of biological systems while informing the development of bio-inspired fault-tolerant strategies.
Collapse
Affiliation(s)
- Wael Salem
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA 16802, USA
| | - Benjamin Cellini
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA 16802, USA
| | - Heiko Kabutz
- Department of Mechanical Engineering, University of Colorado Boulder, Boulder, CO 80309, USA
| | | | - Bo Cheng
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA 16802, USA
| | - Kaushik Jayaram
- Department of Mechanical Engineering, University of Colorado Boulder, Boulder, CO 80309, USA
| | - Jean-Michel Mongeau
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA 16802, USA
| |
Collapse
|
17
|
Fischer PJ, Schnell B. Multiple mechanisms mediate the suppression of motion vision during escape maneuvers in flying Drosophila. iScience 2022; 25:105143. [PMID: 36185378 PMCID: PMC9523382 DOI: 10.1016/j.isci.2022.105143] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2022] [Revised: 08/15/2022] [Accepted: 09/12/2022] [Indexed: 11/17/2022] Open
Affiliation(s)
- Philippe Jules Fischer
- Emmy Noether Group Neurobiology of Flight Control, Max Planck Institute for Neurobiology of Behavior – caesar, 53175 Bonn, Germany
| | - Bettina Schnell
- Emmy Noether Group Neurobiology of Flight Control, Max Planck Institute for Neurobiology of Behavior – caesar, 53175 Bonn, Germany
- Corresponding author
| |
Collapse
|
18
|
van Breugel F, Jewell R, Houle J. Active anemosensing hypothesis: how flying insects could estimate ambient wind direction through sensory integration and active movement. J R Soc Interface 2022; 19:20220258. [PMID: 36043287 PMCID: PMC9428576 DOI: 10.1098/rsif.2022.0258] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
Estimating the direction of ambient fluid flow is a crucial step during chemical plume tracking for flying and swimming animals. How animals accomplish this remains an open area of investigation. Recent calcium imaging with tethered flying Drosophila has shown that flies encode the angular direction of multiple sensory modalities in their central complex: orientation, apparent wind (or airspeed) direction and direction of motion. Here, we describe a general framework for how these three sensory modalities can be integrated over time to provide a continuous estimate of ambient wind direction. After validating our framework using a flying drone, we use simulations to show that ambient wind direction can be most accurately estimated with trajectories characterized by frequent, large magnitude turns. Furthermore, sensory measurements and estimates of their derivatives must be integrated over a period of time that incorporates at least one of these turns. Finally, we discuss approaches that insects might use to simplify the required computations, and present a list of testable predictions. Together, our results suggest that ambient flow estimation may be an important driver underlying the zigzagging manoeuvres characteristic of plume tracking animals’ trajectories.
Collapse
Affiliation(s)
- Floris van Breugel
- Department of Mechanical Engineering, University of Nevada, Reno, NV, USA
| | - Renan Jewell
- Department of Intelligent Systems Engineering, University of Indiana, Bloomington, IN, USA
| | - Jaleesa Houle
- Department of Mechanical Engineering, University of Nevada, Reno, NV, USA
| |
Collapse
|
19
|
Vo-Doan TT, Dung VT, Sato H. A Cyborg Insect Reveals a Function of a Muscle in Free Flight. CYBORG AND BIONIC SYSTEMS 2022; 2022:9780504. [PMID: 36285304 PMCID: PMC9494732 DOI: 10.34133/2022/9780504] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2022] [Accepted: 03/21/2022] [Indexed: 11/29/2022] Open
Abstract
While engineers put lots of effort, resources, and time in building insect scale micro aerial vehicles (MAVs) that fly like insects, insects themselves are the real masters of flight. What if we would use living insect as platform for MAV instead? Here, we reported a flight control via electrical stimulation of a flight muscle of an insect-computer hybrid robot, which is the interface of a mountable wireless backpack controller and a living beetle. The beetle uses indirect flight muscles to drive wing flapping and three major direct flight muscles (basalar, subalar, and third axilliary (3Ax) muscles) to control the kinematics of the wings for flight maneuver. While turning control was already achieved by stimulating basalar and 3Ax muscles, electrical stimulation of subalar muscles resulted in braking and elevation control in flight. We also demonstrated around 20 degrees of contralateral yaw and roll by stimulating individual subalar muscle. Stimulating both subalar muscles lead to an increase of 20 degrees in pitch and decelerate the flight by 1.5 m/s2 as well as an induce in elevation of 2 m/s2.
Collapse
Affiliation(s)
- T. Thang Vo-Doan
- Nanyang Technological University, School of Mechanical and Aerospace Engineering, Singapore
- University of Freiburg, Institute of Biology I, Germany
| | - V. Than Dung
- Nanyang Technological University, School of Mechanical and Aerospace Engineering, Singapore
| | - Hirotaka Sato
- Nanyang Technological University, School of Mechanical and Aerospace Engineering, Singapore
| |
Collapse
|
20
|
Olejnik DA, Muijres FT, Karásek M, Honfi Camilo L, De Wagter C, de Croon GC. Flying Into the Wind: Insects and Bio-Inspired Micro-Air-Vehicles With a Wing-Stroke Dihedral Steer Passively Into Wind-Gusts. Front Robot AI 2022; 9:820363. [PMID: 35280961 PMCID: PMC8907628 DOI: 10.3389/frobt.2022.820363] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2021] [Accepted: 01/31/2022] [Indexed: 11/23/2022] Open
Abstract
Natural fliers utilize passive and active flight control strategies to cope with windy conditions. This capability makes them incredibly agile and resistant to wind gusts. Here, we study how insects achieve this, by combining Computational Fluid Dynamics (CFD) analyses of flying fruit flies with freely-flying robotic experiments. The CFD analysis shows that flying flies are partly passively stable in side-wind conditions due to their dorsal-ventral wing-beat asymmetry defined as wing-stroke dihedral. Our robotic experiments confirm that this mechanism also stabilizes free-moving flapping robots with similar asymmetric dihedral wing-beats. This shows that both animals and robots with asymmetric wing-beats are dynamically stable in sideways wind gusts. Based on these results, we developed an improved model for the aerodynamic yaw and roll torques caused by the coupling between lateral motion and the stroke dihedral. The yaw coupling passively steers an asymmetric flapping flyer into the direction of a sideways wind gust; in contrast, roll torques are only stabilizing at high air gust velocities, due to non-linear coupling effects. The combined CFD simulations, robot experiments, and stability modeling help explain why the majority of flying insects exhibit wing-beats with positive stroke dihedral and can be used to develop more stable and robust flapping-wing Micro-Air-Vehicles.
Collapse
Affiliation(s)
- Diana A. Olejnik
- MAVLab, Department of Control and Operations, Delft University of Technology, Delft, Netherlands
- *Correspondence: Diana A. Olejnik,
| | - Florian T. Muijres
- Experimental Zoology Group, Department of Animal Sciences, Wageningen University & Research, Wageningen, Netherlands
| | - Matěj Karásek
- MAVLab, Department of Control and Operations, Delft University of Technology, Delft, Netherlands
| | - Leonardo Honfi Camilo
- Experimental Zoology Group, Department of Animal Sciences, Wageningen University & Research, Wageningen, Netherlands
| | - Christophe De Wagter
- MAVLab, Department of Control and Operations, Delft University of Technology, Delft, Netherlands
| | - Guido C.H.E. de Croon
- MAVLab, Department of Control and Operations, Delft University of Technology, Delft, Netherlands
| |
Collapse
|
21
|
A population of descending neurons that regulates the flight motor of Drosophila. Curr Biol 2022; 32:1189-1196.e6. [PMID: 35090590 PMCID: PMC9206711 DOI: 10.1016/j.cub.2022.01.008] [Citation(s) in RCA: 26] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2021] [Revised: 12/06/2021] [Accepted: 01/05/2022] [Indexed: 01/09/2023]
Abstract
Like many insect species, Drosophila melanogaster are capable of maintaining a stable flight trajectory for periods lasting up to several hours1,2. Because aerodynamic torque is roughly proportional to the fifth power of wing length3, even small asymmetries in wing size require the maintenance of subtle bilateral differences in flapping motion to maintain a stable path. Flies can even fly straight after losing half of a wing, a feat they accomplish via very large, sustained kinematic changes to both the damaged and intact wings4. Thus, the neural network responsible for stable flight must be capable of sustaining fine-scaled control over wing motion across a large dynamic range. In this paper, we describe an unusual type of descending neuron (DNg02) that projects directly from visual output regions of the brain to the dorsal flight neuropil of the ventral nerve cord. Unlike many descending neurons, which exist as single bilateral pairs with unique morphology, there is a population of at least 15 DNg02 cell pairs with nearly identical shape. By optogenetically activating different numbers of DNg02 cells, we demonstrate that these neurons regulate wingbeat amplitude over a wide dynamic range via a population code. Using 2-photon functional imaging, we show that DNg02 cells are responsive to visual motion during flight in a manner that would make them well suited to continuously regulate bilateral changes in wing kinematics. Collectively, we have identified a critical set of DNs that provide the sensitivity and dynamic range required for flight control. Using an activation screen in flying flies, Namiki et al. identify a population of descending neurons that regulates wing amplitude over a large dynamic range. Via functional imaging and activation of different numbers of cells, they show that this population is a core component of the flight circuit, allowing the fly to steer and fly straight.
Collapse
|
22
|
|
23
|
Hulse BK, Haberkern H, Franconville R, Turner-Evans DB, Takemura SY, Wolff T, Noorman M, Dreher M, Dan C, Parekh R, Hermundstad AM, Rubin GM, Jayaraman V. A connectome of the Drosophila central complex reveals network motifs suitable for flexible navigation and context-dependent action selection. eLife 2021; 10:66039. [PMID: 34696823 PMCID: PMC9477501 DOI: 10.7554/elife.66039] [Citation(s) in RCA: 118] [Impact Index Per Article: 39.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2020] [Accepted: 09/07/2021] [Indexed: 11/13/2022] Open
Abstract
Flexible behaviors over long timescales are thought to engage recurrent neural networks in deep brain regions, which are experimentally challenging to study. In insects, recurrent circuit dynamics in a brain region called the central complex (CX) enable directed locomotion, sleep, and context- and experience-dependent spatial navigation. We describe the first complete electron-microscopy-based connectome of the Drosophila CX, including all its neurons and circuits at synaptic resolution. We identified new CX neuron types, novel sensory and motor pathways, and network motifs that likely enable the CX to extract the fly's head-direction, maintain it with attractor dynamics, and combine it with other sensorimotor information to perform vector-based navigational computations. We also identified numerous pathways that may facilitate the selection of CX-driven behavioral patterns by context and internal state. The CX connectome provides a comprehensive blueprint necessary for a detailed understanding of network dynamics underlying sleep, flexible navigation, and state-dependent action selection.
Collapse
Affiliation(s)
- Brad K Hulse
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Hannah Haberkern
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Romain Franconville
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | | | | | - Tanya Wolff
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Marcella Noorman
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Marisa Dreher
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Chuntao Dan
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Ruchi Parekh
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | | | - Gerald M Rubin
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Vivek Jayaraman
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| |
Collapse
|
24
|
Cellini B, Salem W, Mongeau JM. Mechanisms of punctuated vision in fly flight. Curr Biol 2021; 31:4009-4024.e3. [PMID: 34329590 DOI: 10.1016/j.cub.2021.06.080] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2021] [Revised: 06/02/2021] [Accepted: 06/25/2021] [Indexed: 11/26/2022]
Abstract
To guide locomotion, animals control gaze via movements of their eyes, head, and/or body, but how the nervous system controls gaze during complex motor tasks remains elusive. In many animals, shifts in gaze consist of periods of smooth movement punctuated by rapid eye saccades. Notably, eye movements are constrained by anatomical limits, which requires resetting eye position. By studying tethered, flying fruit flies (Drosophila), we show that flies perform stereotyped head saccades to reset gaze, analogous to optokinetic nystagmus in primates. Head-reset saccades interrupted head smooth movement for as little as 50 ms-representing less than 5% of the total flight time-thereby enabling punctuated gaze stabilization. By revealing the passive mechanics of the neck joint, we show that head-reset saccades leverage the neck's natural elastic recoil, enabling mechanically assisted redirection of gaze. The consistent head orientation at saccade initiation, the influence of the head's angular position on saccade rate, the decrease in wing saccade frequency in head-fixed flies, and the decrease in head-reset saccade rate in flies with their head range of motion restricted together implicate proprioception as the primary trigger of head-reset saccades. Wing-reset saccades were influenced by head orientation, establishing a causal link between neck sensory signals and the execution of body saccades. Head-reset saccades were abolished when flies switched to a landing state, demonstrating that head movements are gated by behavioral state. We propose a control architecture for active vision systems with limits in sensor range of motion. VIDEO ABSTRACT.
Collapse
Affiliation(s)
- Benjamin Cellini
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA 16802, USA
| | - Wael Salem
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA 16802, USA
| | - Jean-Michel Mongeau
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA 16802, USA.
| |
Collapse
|
25
|
Maximally efficient prediction in the early fly visual system may support evasive flight maneuvers. PLoS Comput Biol 2021; 17:e1008965. [PMID: 34014926 PMCID: PMC8136689 DOI: 10.1371/journal.pcbi.1008965] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2020] [Accepted: 04/13/2021] [Indexed: 11/20/2022] Open
Abstract
The visual system must make predictions to compensate for inherent delays in its processing. Yet little is known, mechanistically, about how prediction aids natural behaviors. Here, we show that despite a 20-30ms intrinsic processing delay, the vertical motion sensitive (VS) network of the blowfly achieves maximally efficient prediction. This prediction enables the fly to fine-tune its complex, yet brief, evasive flight maneuvers according to its initial ego-rotation at the time of detection of the visual threat. Combining a rich database of behavioral recordings with detailed compartmental modeling of the VS network, we further show that the VS network has axonal gap junctions that are critical for optimal prediction. During evasive maneuvers, a VS subpopulation that directly innervates the neck motor center can convey predictive information about the fly’s future ego-rotation, potentially crucial for ongoing flight control. These results suggest a novel sensory-motor pathway that links sensory prediction to behavior. Survival-critical behaviors shape neural circuits to translate sensory information into strikingly fast predictions, e.g. in escaping from a predator faster than the system’s processing delay. We show that the fly visual system implements fast and accurate prediction of its visual experience. This provides crucial information for directing fast evasive maneuvers that unfold over just 40ms. Our work shows how this fast prediction is implemented, mechanistically, and suggests the existence of a novel sensory-motor pathway from the fly visual system to a wing steering motor neuron. Echoing and amplifying previous work in the retina, our work hypothesizes that the efficient encoding of predictive information is a universal design principle supporting fast, natural behaviors.
Collapse
|
26
|
Cellini B, Mongeau JM. Hybrid visual control in fly flight: insights into gaze shift via saccades. CURRENT OPINION IN INSECT SCIENCE 2020; 42:23-31. [PMID: 32896628 DOI: 10.1016/j.cois.2020.08.009] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/01/2020] [Revised: 08/24/2020] [Accepted: 08/26/2020] [Indexed: 06/11/2023]
Abstract
Flies fly by alternating between periods of fixation and body saccades, analogous to how our own eyes move. Gaze fixation via smooth movement in fly flight has been studied extensively, but comparatively less is known about the mechanism by which flies trigger and control body saccades to shift their gaze. Why do flies implement a hybrid fixate-and-saccade locomotion strategy? Here we review recent developments that provide new insights into this question. We focus on the interplay between smooth movement and saccades, the trigger classes of saccades, and the timeline of saccade execution. We emphasize recent mechanistic advances in Drosophila, where genetic tools have enabled cellular circuit analysis at an unprecedented level in a flying insect. In addition, we review trade-offs in behavioral paradigms used to study saccades. Throughout we highlight exciting avenues for future research in the control of fly flight.
Collapse
Affiliation(s)
- Benjamin Cellini
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA, 16801, USA
| | - Jean-Michel Mongeau
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA, 16801, USA.
| |
Collapse
|
27
|
Yao J, Yeo KS. A simplified dynamic model for controlled insect hovering flight and control stability analysis. BIOINSPIRATION & BIOMIMETICS 2019; 14:056005. [PMID: 31239412 DOI: 10.1088/1748-3190/ab2cc5] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
In this paper, the controlled stability of insect hovering flight is analyzed in detail based on a simplified dynamic model of the flyer and flow. The simplified dynamic model incorporates PID-based wing-kinematic controllers. The control stability of the hovering flight is evaluated based on the cycle-mean dynamic equations. The stability analyses and the simplified dynamic model allow us to derive and test the control coefficients for stable free hovering, firstly in the longitudinal mode of flight and then the lateral mode. In this manner, coefficients for wing-kinematic control for full CFD-FSI simulation could be obtained very efficiently. The coefficients thus determined are verified against full-fidelity CFD-FSI free flight simulations.
Collapse
Affiliation(s)
- Jie Yao
- Department of Mechanical Engineering, National University of Singapore, 9 Engineering Drive 1, 117576, Singapore
| | | |
Collapse
|
28
|
van Veen WG, van Leeuwen JL, Muijres FT. A chordwise offset of the wing-pitch axis enhances rotational aerodynamic forces on insect wings: a numerical study. J R Soc Interface 2019; 16:20190118. [PMID: 31213176 DOI: 10.1098/rsif.2019.0118] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Most flying animals produce aerodynamic forces by flapping their wings back and forth with a complex wingbeat pattern. The fluid dynamics that underlies this motion has been divided into separate aerodynamic mechanisms of which rotational lift, that results from fast wing pitch rotations, is particularly important for flight control and manoeuvrability. This rotational force mechanism has been modelled using Kutta-Joukowski theory, which combines the forward stroke motion of the wing with the fast pitch motion to compute forces. Recent studies, however, suggest that hovering insects can produce rotational forces at stroke reversal, without a forward motion of the wing. We have conducted a broad numerical parametric study over a range of wing morphologies and wing kinematics to show that rotational force production depends on two mechanisms: (i) conventional Kutta-Joukowski-based rotational forces and (ii) a rotational force mechanism that enables insects with an offset of the pitch axis relative to the wing's chordwise symmetry axis to generate rotational forces in the absence of forward wing motion. Because flying animals produce control actions frequently near stroke reversal, this pitch-axis-offset dependent aerodynamic mechanism may be particularly important for understanding control and manoeuvrability in natural flyers.
Collapse
Affiliation(s)
- Wouter G van Veen
- Experimental Zoology Group, Wageningen University , Wageningen , The Netherlands
| | - Johan L van Leeuwen
- Experimental Zoology Group, Wageningen University , Wageningen , The Netherlands
| | - Florian T Muijres
- Experimental Zoology Group, Wageningen University , Wageningen , The Netherlands
| |
Collapse
|
29
|
DeAngelis BD, Zavatone-Veth JA, Clark DA. The manifold structure of limb coordination in walking Drosophila. eLife 2019; 8:e46409. [PMID: 31250807 PMCID: PMC6598772 DOI: 10.7554/elife.46409] [Citation(s) in RCA: 58] [Impact Index Per Article: 11.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2019] [Accepted: 06/15/2019] [Indexed: 12/19/2022] Open
Abstract
Terrestrial locomotion requires animals to coordinate their limb movements to efficiently traverse their environment. While previous studies in hexapods have reported that limb coordination patterns can vary substantially, the structure of this variability is not yet well understood. Here, we characterized the symmetric and asymmetric components of variation in walking kinematics in the genetic model organism Drosophila. We found that Drosophila use a single continuum of coordination patterns without evidence for preferred configurations. Spontaneous symmetric variability was associated with modulation of a single control parameter-stance duration-while asymmetric variability consisted of small, limb-specific modulations along multiple dimensions of the underlying symmetric pattern. Commands that modulated walking speed, originating from artificial neural activation or from the visual system, evoked modulations consistent with spontaneous behavior. Our findings suggest that Drosophila employ a low-dimensional control architecture, which provides a framework for understanding the neural circuits that regulate hexapod legged locomotion.
Collapse
Affiliation(s)
- Brian D DeAngelis
- Interdepartmental Neuroscience ProgramYale UniversityNew HavenUnited States
| | | | - Damon A Clark
- Interdepartmental Neuroscience ProgramYale UniversityNew HavenUnited States
- Department of PhysicsYale UniversityNew HavenUnited States
- Department of Molecular, Cellular, and Developmental BiologyYale UniversityNew HavenUnited States
- Department of NeuroscienceYale UniversityNew HavenUnited States
| |
Collapse
|
30
|
Mongeau JM, Cheng KY, Aptekar J, Frye MA. Visuomotor strategies for object approach and aversion in Drosophila melanogaster. ACTA ACUST UNITED AC 2019; 222:jeb.193730. [PMID: 30559298 DOI: 10.1242/jeb.193730] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2018] [Accepted: 12/10/2018] [Indexed: 02/01/2023]
Abstract
Animals classify stimuli to generate appropriate motor actions. In flight, Drosophila melanogaster classify equidistant large and small objects with categorically different behaviors: a tall object evokes approach whereas a small object elicits avoidance. We studied visuomotor behavior in rigidly and magnetically tethered D. melanogaster to reveal strategies that generate aversion to a small object. We discovered that small-object aversion in tethered flight is enabled by aversive saccades and smooth movement, which vary with the stimulus type. Aversive saccades in response to a short bar had different dynamics from approach saccades in response to a tall bar and the distribution of pre-saccade error angles was more stochastic for a short bar. Taken together, we show that aversive responses in D. melanogaster are driven in part by processes that elicit signed saccades with distinct dynamics and trigger mechanisms. Our work generates new hypotheses to study brain circuits that underlie classification of objects in D. melanogaster.
Collapse
Affiliation(s)
- Jean-Michel Mongeau
- Department of Integrative Biology and Physiology, University of California - Los Angeles, Los Angeles, CA 90095-7239, USA
| | - Karen Y Cheng
- Department of Integrative Biology and Physiology, University of California - Los Angeles, Los Angeles, CA 90095-7239, USA
| | - Jacob Aptekar
- Department of Integrative Biology and Physiology, University of California - Los Angeles, Los Angeles, CA 90095-7239, USA
| | - Mark A Frye
- Department of Integrative Biology and Physiology, University of California - Los Angeles, Los Angeles, CA 90095-7239, USA
| |
Collapse
|
31
|
Tomotani BM, Muijres FT. A songbird compensates for wing molt during escape flights by reducing the molt gap and increasing angle-of-attack. J Exp Biol 2019; 222:jeb.195396. [DOI: 10.1242/jeb.195396] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2018] [Accepted: 04/24/2019] [Indexed: 11/20/2022]
Abstract
During molt, birds replace their feathers to retain feather quality and maintain flight performance. However, wing gaps inherent of this process can also reduce flight capacities, which could be detrimental when foraging or escaping predators. Still, many bird species will not stop their normal activities when molting. In this study, we investigated whether and how birds adjust their escape flight behavior to compensate for the reduction in performance when flying with wing gaps. Using stereoscopic high-speed videography, we filmed 146 upward-directed escape flights of 19 and 22 pied flycatchers (Ficedula hypoleuca) with and without simulated molt gaps, respectively. We then reconstructed the three-dimensional body and wing movements throughout each maneuver. By comparing flights with and without gaps, we determined how wing molt gaps affected wing morphology, escape flight performance, and how the birds adjusted their flight kinematics in order to negate possible negative aerodynamic effects. Our manipulations resulted in a lower second-moment-of-area of the wings, but flight speed and net aerodynamic force production did not differ between the two groups. We found that in manipulated birds, the size of the gap was reduced as the flight feathers adjacent to the gap had moved towards each other. Moreover, the experimental decrease in second-moment-of-area was associated with an increase in angle-of-attack, whereas changes in wingbeat-induced speeds were associated with variations in aerodynamic force production. This suggests that the control of escape flight in molting birds might be modular, allowing relatively simple flight control, thus reducing the burden on the neuro-muscular flight control system.
Collapse
Affiliation(s)
- Barbara M. Tomotani
- Experimental Zoology Group, Wageningen University & Research, PO Box 338, 6700 AH Wageningen, The Netherlands
- Department of Animal Ecology, Netherlands Institute of Ecology (NIOO-KNAW), PO Box 50, 6700 AB Wageningen, The Netherlands
- Museum of New Zealand Te Papa Tongarewa, Wellington, New Zealand
| | - Florian T. Muijres
- Experimental Zoology Group, Wageningen University & Research, PO Box 338, 6700 AH Wageningen, The Netherlands
| |
Collapse
|
32
|
Abstract
Turning during flight is a complex behaviour that requires coordination to ensure that the resulting centrifugal force is never large enough to disrupt the intended turning trajectory. The centrifugal force during a turn increases with the curvature (sharpness) of the turn, as well as the speed of flight. Consequently, sharp turns would require lower flight speeds, in order to limit the centrifugal force to a manageable level and prevent unwanted sideslips. We have video-filmed honeybees flying near a hive entrance when the entrance is temporarily blocked. A 3D reconstruction and analysis of the flight trajectories executed during this loitering behaviour reveals that sharper turns are indeed executed at lower speeds. During a turn, the flight speed is matched to the curvature, moment to moment, in such a way as to maintain the centrifugal force at an approximately constant, low level of about 30% of the body weight, irrespective of the instantaneous speed or curvature of the turn. This ensures that turns are well coordinated, with few or no sideslips - as it is evident from analysis of other properties of the flight trajectories.
Collapse
|
33
|
Currier TA, Nagel KI. Multisensory Control of Orientation in Tethered Flying Drosophila. Curr Biol 2018; 28:3533-3546.e6. [PMID: 30393038 DOI: 10.1016/j.cub.2018.09.020] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2018] [Revised: 08/21/2018] [Accepted: 09/11/2018] [Indexed: 11/28/2022]
Abstract
A longstanding goal of systems neuroscience is to quantitatively describe how the brain integrates sensory cues over time. Here, we develop a closed-loop orienting paradigm in Drosophila to study the algorithms by which cues from two modalities are integrated during ongoing behavior. We find that flies exhibit two behaviors when presented simultaneously with an attractive visual stripe and aversive wind cue. First, flies perform a turn sequence where they initially turn away from the wind but later turn back toward the stripe, suggesting dynamic sensory processing. Second, turns toward the stripe are slowed by the presence of competing wind, suggesting summation of turning drives. We develop a model in which signals from each modality are filtered in space and time to generate turn commands and then summed to produce ongoing orienting behavior. This computational framework correctly predicts behavioral dynamics for a range of stimulus intensities and spatial arrangements.
Collapse
Affiliation(s)
- Timothy A Currier
- Neuroscience Institute, New York University Medical Center, 435 E. 30(th) Street, New York, NY 10016, USA; Center for Neural Science, New York University, 4 Washington Place, New York, NY 10003, USA
| | - Katherine I Nagel
- Neuroscience Institute, New York University Medical Center, 435 E. 30(th) Street, New York, NY 10016, USA; Center for Neural Science, New York University, 4 Washington Place, New York, NY 10003, USA.
| |
Collapse
|
34
|
Jakobi T, Kolomenskiy D, Ikeda T, Watkins S, Fisher A, Liu H, Ravi S. Bees with attitude: the effects of directed gusts on flight trajectories. Biol Open 2018; 7:bio.034074. [PMID: 30135080 PMCID: PMC6215418 DOI: 10.1242/bio.034074] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
Flight is a complicated task at the centimetre scale particularly due to unsteady air fluctuations which are ubiquitous in outdoor flight environments. Flying organisms deal with these difficulties using active and passive control mechanisms to steer their body motion. Body attitudes of flapping organisms are linked with their resultant flight trajectories and performance, yet little is understood about how isolated unsteady aerodynamic phenomena affect the interlaced dynamics of such systems. In this study, we examined freely flying bumblebees subject to a single isolated gust to emulate aerodynamic disturbances encountered in nature. Bumblebees are expert commanders of the aerial domain as they persistently forage within complex terrain elements. By tracking the three-dimensional dynamics of bees flying through gusts, we determined the sequences of motion that permit flight in three disturbance conditions: sideward, upward and downward gusts. Bees executed a series of passive impulsive maneuvers followed by active recovery maneuvers. Impulsive motion was unique in each gust direction, maintaining control by passive manipulation of the body. Bees pitched up and slowed down at the beginning of recovery in every disturbance, followed by corrective maneuvers which brought body attitudes back to their original state. Bees were displaced the most by the sideward gust, displaying large lateral translations and roll deviations. Upward gusts were easier for bees to fly through, causing only minor flight changes and minimal recovery times. Downward gusts severely impaired the control response of bees, inflicting strong adverse forces which sharply upset trajectories. Bees used a variety of control strategies when flying in each disturbance, offering new insights into insect-scale flapping flight and bio-inspired robotic systems.This article has an associated First Person interview with the first author of the paper.
Collapse
Affiliation(s)
- Timothy Jakobi
- School of Aerospace Mechanical and Manufacturing Engineering, RMIT University, Melbourne, 3083, Australia
| | - Dmitry Kolomenskiy
- Japan Agency for Marine-Earth Science Technology (JAMSTEC), Yokohama-shi, 236-0001, Japan
| | - Teruaki Ikeda
- Graduate School of Engineering, Chiba University, Chiba-shi, 263-8522, Japan
| | - Simon Watkins
- School of Aerospace Mechanical and Manufacturing Engineering, RMIT University, Melbourne, 3083, Australia
| | - Alex Fisher
- School of Aerospace Mechanical and Manufacturing Engineering, RMIT University, Melbourne, 3083, Australia
| | - Hao Liu
- Graduate School of Engineering, Chiba University, Chiba-shi, 263-8522, Japan
| | - Sridhar Ravi
- School of Aerospace Mechanical and Manufacturing Engineering, RMIT University, Melbourne, 3083, Australia
| |
Collapse
|
35
|
Karásek M, Muijres FT, De Wagter C, Remes BDW, de Croon GCHE. A tailless aerial robotic flapper reveals that flies use torque coupling in rapid banked turns. Science 2018; 361:1089-1094. [DOI: 10.1126/science.aat0350] [Citation(s) in RCA: 176] [Impact Index Per Article: 29.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2018] [Revised: 05/04/2018] [Accepted: 07/20/2018] [Indexed: 02/06/2023]
Abstract
Insects are among the most agile natural flyers. Hypotheses on their flight control cannot always be validated by experiments with animals or tethered robots. To this end, we developed a programmable and agile autonomous free-flying robot controlled through bio-inspired motion changes of its flapping wings. Despite being 55 times the size of a fruit fly, the robot can accurately mimic the rapid escape maneuvers of flies, including a correcting yaw rotation toward the escape heading. Because the robot’s yaw control was turned off, we showed that these yaw rotations result from passive, translation-induced aerodynamic coupling between the yaw torque and the roll and pitch torques produced throughout the maneuver. The robot enables new methods for studying animal flight, and its flight characteristics allow for real-world flight missions.
Collapse
Affiliation(s)
- Matěj Karásek
- Micro Air Vehicle Laboratory, Control and Simulation, Delft University of Technology, Delft, Netherlands
| | - Florian T. Muijres
- Experimental Zoology Group, Wageningen University and Research, Wageningen, Netherlands
| | - Christophe De Wagter
- Micro Air Vehicle Laboratory, Control and Simulation, Delft University of Technology, Delft, Netherlands
| | - Bart D. W. Remes
- Micro Air Vehicle Laboratory, Control and Simulation, Delft University of Technology, Delft, Netherlands
| | - Guido C. H. E. de Croon
- Micro Air Vehicle Laboratory, Control and Simulation, Delft University of Technology, Delft, Netherlands
| |
Collapse
|
36
|
Faruque IA, Muijres FT, Macfarlane KM, Kehlenbeck A, Humbert JS. Identification of optimal feedback control rules from micro-quadrotor and insect flight trajectories. BIOLOGICAL CYBERNETICS 2018; 112:165-179. [PMID: 29299686 DOI: 10.1007/s00422-017-0742-x] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/24/2016] [Accepted: 12/08/2017] [Indexed: 06/07/2023]
Abstract
This paper presents "optimal identification," a framework for using experimental data to identify the optimality conditions associated with the feedback control law implemented in the measurements. The technique compares closed loop trajectory measurements against a reduced order model of the open loop dynamics, and uses linear matrix inequalities to solve an inverse optimal control problem as a convex optimization that estimates the controller optimality conditions. In this study, the optimal identification technique is applied to two examples, that of a millimeter-scale micro-quadrotor with an engineered controller on board, and the example of a population of freely flying Drosophila hydei maneuvering about forward flight. The micro-quadrotor results show that the performance indices used to design an optimal flight control law for a micro-quadrotor may be recovered from the closed loop simulated flight trajectories, and the Drosophila results indicate that the combined effect of the insect longitudinal flight control sensing and feedback acts principally to regulate pitch rate.
Collapse
Affiliation(s)
- Imraan A Faruque
- School of Mechanical and Aerospace Engineering, Oklahoma State University, Stillwater, OK, USA.
| | | | - Kenneth M Macfarlane
- Department of Aerospace Engineering, University of Maryland, College Park, MD, USA
| | - Andrew Kehlenbeck
- Department of Aerospace Engineering, University of Maryland, College Park, MD, USA
| | - J Sean Humbert
- Department of Mechanical Engineering, University of Colorado, Boulder, CO, USA
| |
Collapse
|
37
|
Li Y, Wu J, Sato H. Feedback Control-Based Navigation of a Flying Insect-Machine Hybrid Robot. Soft Robot 2018; 5:365-374. [PMID: 29722607 DOI: 10.1089/soro.2017.0118] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
This study reports the first ever demonstration of the aero navigation of a free-flying insect based on feedback control. Instead of imitating the complicated kinetics and mechanisms of insect locomotion, a live insect can be directly transformed into a soft robot by embedding it with artificial devices. Since many insects can perform acrobatics aerially, thereby exhibiting far greater flexibility than current man-made flyers, correctly commanding the internal structures of an insect to perform based on the instructions would be a breakthrough. Herein, beetles (Mecynorrhina torquata) were chosen as the flying platform, and an inertial measurement unit-implemented electronic backpack was designed and manufactured to remotely command the beetles. To achieve horizontal flight control, multiple flight muscles of the beetles, that is, the basalar and third axillary muscles were stimulated to control the flight directions. However, the beetles were found to gradually adapt to the electrical stimulation, and the flight corrections were elicited by generating compensatory flight forces during a long-lasting stimulation (>300 ms), which were revealed by the decrease in induced lateral force. Based on this finding, a proportional derivative feedback controller was designed to navigate the flying beetles based on the predetermined path using frequency-dependent electrical pulses. To avoid a continuous stimulation, we proposed a stimulation protocol which separated two stimulations with a 50-ms rest. Compared to long stimulations (>300 ms), a 150-ms stimulation with 200-ms update interval was more efficient in correcting the flight direction of the beetles.
Collapse
Affiliation(s)
- Yao Li
- School of Mechanical and Aerospace Engineering, Nanyang Technological University , Singapore, Singapore
| | - Jinbin Wu
- School of Mechanical and Aerospace Engineering, Nanyang Technological University , Singapore, Singapore
| | - Hirotaka Sato
- School of Mechanical and Aerospace Engineering, Nanyang Technological University , Singapore, Singapore
| |
Collapse
|
38
|
Ferris BD, Green J, Maimon G. Abolishment of Spontaneous Flight Turns in Visually Responsive Drosophila. Curr Biol 2018; 28:170-180.e5. [PMID: 29337081 DOI: 10.1016/j.cub.2017.12.008] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2017] [Revised: 10/22/2017] [Accepted: 12/07/2017] [Indexed: 11/18/2022]
Abstract
Animals react rapidly to external stimuli, such as an approaching predator, but in other circumstances, they seem to act spontaneously, without any obvious external trigger. How do the neural processes mediating the execution of reflexive and spontaneous actions differ? We studied this question in tethered, flying Drosophila. We found that silencing a large but genetically defined set of non-motor neurons virtually eliminates spontaneous flight turns while preserving the tethered flies' ability to perform two types of visually evoked turns, demonstrating that, at least in flies, these two modes of action are almost completely dissociable.
Collapse
Affiliation(s)
- Bennett Drew Ferris
- Laboratory of Integrative Brain Function, The Rockefeller University, New York, NY 10065, USA
| | - Jonathan Green
- Laboratory of Integrative Brain Function, The Rockefeller University, New York, NY 10065, USA
| | - Gaby Maimon
- Laboratory of Integrative Brain Function, The Rockefeller University, New York, NY 10065, USA.
| |
Collapse
|
39
|
Hsu SJ, Thakur N, Cheng B. Speed control and force-vectoring of blue bottle flies in a magnetically-levitated flight mill. J Exp Biol 2018; 222:jeb.187211. [DOI: 10.1242/jeb.187211] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2018] [Accepted: 12/13/2018] [Indexed: 11/20/2022]
Abstract
Flies fly at a broad range of speeds and produce sophisticated aerial maneuvers with precisely controlled wing movements. Remarkably, only subtle changes in wing motion are used by flies to produce aerial maneuvers, resulting in little directional tilt of aerodynamic force vector relative to the body. Therefore, it is often considered that flies fly according to a helicopter model and control speed mainly via force-vectoring by body-pitch change. Here we examined the speed control of blue bottle flies using a magnetically-levitated (MAGLEV) flight mill, as they fly at different body pitch angles and with different augmented aerodynamic damping. We identified wing kinematic contributors to the changes of estimated aerodynamic force through testing and comparing two force-vectoring models: i.e., a constant force-vectoring model and a variable force-vectoring model, while using the Akaike's information criterion for the selection of best-approximating model. Results show that the best-approximating variable force-vectoring model, which includes the effects of wing kinematic changes, yields a considerably more accurate prediction of flight speed, particularly in higher velocity range, as compared with those of the constant force-vectoring model. Examining the variable force-vectoring model reveals that, in the flight-mill tethered flight, flies use a collection of wing kinematic variables to control primarily the force magnitude, while the force direction is also modulated, albeit to a smaller extent compared to those due to the changes in body pitch. The roles of these wing kinematic variables are analogous to those of throttle, and collective and cyclic pitch of helicopters.
Collapse
Affiliation(s)
- Shih-Jung Hsu
- Department of Mechanical and Nuclear Engineering, Pennsylvania State University, University Park, PA 16802, USA
| | - Neel Thakur
- Department of Mechanical and Nuclear Engineering, Pennsylvania State University, University Park, PA 16802, USA
| | - Bo Cheng
- Department of Mechanical and Nuclear Engineering, Pennsylvania State University, University Park, PA 16802, USA
| |
Collapse
|
40
|
Li T, Gao L, Pan Q, Li P. Free-form surface parts quality inspection optimization with a novel sampling method. Appl Soft Comput 2018. [DOI: 10.1016/j.asoc.2017.11.010] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
41
|
Mongeau JM, Frye MA. Drosophila Spatiotemporally Integrates Visual Signals to Control Saccades. Curr Biol 2017; 27:2901-2914.e2. [PMID: 28943085 DOI: 10.1016/j.cub.2017.08.035] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2017] [Revised: 07/31/2017] [Accepted: 08/15/2017] [Indexed: 11/16/2022]
Abstract
Like many visually active animals, including humans, flies generate both smooth and rapid saccadic movements to stabilize their gaze. How rapid body saccades and smooth movement interact for simultaneous object pursuit and gaze stabilization is not understood. We directly observed these interactions in magnetically tethered Drosophila free to rotate about the yaw axis. A moving bar elicited sustained bouts of saccades following the bar, with surprisingly little smooth movement. By contrast, a moving panorama elicited robust smooth movement interspersed with occasional optomotor saccades. The amplitude, angular velocity, and torque transients of bar-fixation saccades were finely tuned to the speed of bar motion and were triggered by a threshold in the temporal integral of the bar error angle rather than its absolute retinal position error. Optomotor saccades were tuned to the dynamics of panoramic image motion and were triggered by a threshold in the integral of velocity over time. A hybrid control model based on integrated motion cues simulates saccade trigger and dynamics. We propose a novel algorithm for tuning fixation saccades in flies.
Collapse
Affiliation(s)
- Jean-Michel Mongeau
- Department of Integrative Biology and Physiology, University of California, Los Angeles, Los Angeles, CA 90095-7239, USA
| | - Mark A Frye
- Department of Integrative Biology and Physiology, University of California, Los Angeles, Los Angeles, CA 90095-7239, USA.
| |
Collapse
|
42
|
An Array of Descending Visual Interneurons Encoding Self-Motion in Drosophila. J Neurosci 2017; 36:11768-11780. [PMID: 27852783 DOI: 10.1523/jneurosci.2277-16.2016] [Citation(s) in RCA: 65] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2016] [Revised: 09/22/2016] [Accepted: 09/24/2016] [Indexed: 11/21/2022] Open
Abstract
The means by which brains transform sensory information into coherent motor actions is poorly understood. In flies, a relatively small set of descending interneurons are responsible for conveying sensory information and higher-order commands from the brain to motor circuits in the ventral nerve cord. Here, we describe three pairs of genetically identified descending interneurons that integrate information from wide-field visual interneurons and project directly to motor centers controlling flight behavior. We measured the physiological responses of these three cells during flight and found that they respond maximally to visual movement corresponding to rotation around three distinct body axes. After characterizing the tuning properties of an array of nine putative upstream visual interneurons, we show that simple linear combinations of their outputs can predict the responses of the three descending cells. Last, we developed a machine vision-tracking system that allows us to monitor multiple motor systems simultaneously and found that each visual descending interneuron class is correlated with a discrete set of motor programs. SIGNIFICANCE STATEMENT Most animals possess specialized sensory systems for encoding body rotation, which they use for stabilizing posture and regulating motor actions. In flies and other insects, the visual system contains an array of specialized neurons that integrate local optic flow to estimate body rotation during locomotion. However, the manner in which the output of these cells is transformed by the downstream neurons that innervate motor centers is poorly understood. We have identified a set of three visual descending neurons that integrate the output of nine large-field visual interneurons and project directly to flight motor centers. Our results provide new insight into how the sensory information that encodes body motion is transformed into a code that is appropriate for motor actions.
Collapse
|
43
|
Liu P, Cheng B. Limitations of rotational manoeuvrability in insects and hummingbirds: evaluating the effects of neuro-biomechanical delays and muscle mechanical power. J R Soc Interface 2017; 14:rsif.2017.0068. [PMID: 28679665 DOI: 10.1098/rsif.2017.0068] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2017] [Accepted: 06/05/2017] [Indexed: 11/12/2022] Open
Abstract
Flying animals ranging in size from fruit flies to hummingbirds are nimble fliers with remarkable rotational manoeuvrability. The degrees of manoeuvrability among these animals, however, are noticeably diverse and do not simply follow scaling rules of flight dynamics or muscle power capacity. As all manoeuvres emerge from the complex interactions of neural, physiological and biomechanical processes of an animal's flight control system, these processes give rise to multiple limiting factors that dictate the maximal manoeuvrability attainable by an animal. Here using functional models of an animal's flight control system, we investigate the effects of three such limiting factors, including neural and biomechanical (from limited flapping frequency) delays and muscle mechanical power, for two insect species and two hummingbird species, undergoing roll, pitch and yaw rotations. The results show that for animals with similar degree of manoeuvrability, for example, fruit flies and hummingbirds, the underlying limiting factors are different, as the manoeuvrability of fruit flies is only limited by neural delays and that of hummingbirds could be limited by all three factors. In addition, the manoeuvrability also appears to be the highest about the roll axis as it requires the least muscle mechanical power and can tolerate the largest neural delays.
Collapse
Affiliation(s)
- Pan Liu
- Department of Mechanical and Nuclear Engineering, Pennsylvania State University, University Park, PA 16802, USA
| | - Bo Cheng
- Department of Mechanical and Nuclear Engineering, Pennsylvania State University, University Park, PA 16802, USA
| |
Collapse
|
44
|
Longden KD, Huston SJ, Reiser MB. Sensorimotor Neuroscience: Motor Precision Meets Vision. Curr Biol 2017; 27:R261-R263. [PMID: 28376331 DOI: 10.1016/j.cub.2017.02.047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
Visual motion sensing neurons in the fly also encode a range of behavior-related signals. These nonvisual inputs appear to be used to correct some of the challenges of visually guided locomotion.
Collapse
Affiliation(s)
- Kit D Longden
- Janelia Research Campus19700, Helix Drive, Ashburn, VA 20147, USA
| | - Stephen J Huston
- Janelia Research Campus19700, Helix Drive, Ashburn, VA 20147, USA
| | - Michael B Reiser
- Janelia Research Campus19700, Helix Drive, Ashburn, VA 20147, USA.
| |
Collapse
|
45
|
Chen MW, Wu JH, Sun M. Generation of the pitch moment during the controlled flight after takeoff of fruitflies. PLoS One 2017; 12:e0173481. [PMID: 28296907 PMCID: PMC5351871 DOI: 10.1371/journal.pone.0173481] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2016] [Accepted: 02/21/2017] [Indexed: 11/29/2022] Open
Abstract
In the present paper, the controlled flight of fruitflies after voluntary takeoff is studied. Wing and body kinematics of the insects after takeoff are measured using high-speed video techniques, and the aerodynamic force and moment are calculated by the computational fluid dynamics method based on the measured data. How the control moments are generated is analyzed by correlating the computed moments with the wing kinematics. A fruit-fly has a large pitch-up angular velocity owing to the takeoff jump and the fly controls its body attitude by producing pitching moments. It is found that the pitching moment is produced by changes in both the aerodynamic force and the moment arm. The change in the aerodynamic force is mainly due to the change in angle of attack. The change in the moment arm is mainly due to the change in the mean stroke angle and deviation angle, and the deviation angle plays a more important role than the mean stroke angle in changing the moment arm (note that change in deviation angle implies variation in the position of the aerodynamic stroke plane with respect to the anatomical stroke plane). This is unlike the case of fruitflies correcting pitch perturbations in steady free flight, where they produce pitching moment mainly by changes in mean stroke angle.
Collapse
Affiliation(s)
- Mao Wei Chen
- School of Transportation Science and Engineering, Beihang University, Beijing, China
- * E-mail:
| | - Jiang Hao Wu
- School of Transportation Science and Engineering, Beihang University, Beijing, China
| | - Mao Sun
- Institute of Fluid Mechanics, Beihang University, Beijing, China
| |
Collapse
|
46
|
Muijres FT, Iwasaki NA, Elzinga MJ, Melis JM, Dickinson MH. Flies compensate for unilateral wing damage through modular adjustments of wing and body kinematics. Interface Focus 2017; 7:20160103. [PMID: 28163885 DOI: 10.1098/rsfs.2016.0103] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Using high-speed videography, we investigated how fruit flies compensate for unilateral wing damage, in which loss of area on one wing compromises both weight support and roll torque equilibrium. Our results show that flies control for unilateral damage by rolling their body towards the damaged wing and by adjusting the kinematics of both the intact and damaged wings. To compensate for the reduction in vertical lift force due to damage, flies elevate wingbeat frequency. Because this rise in frequency increases the flapping velocity of both wings, it has the undesired consequence of further increasing roll torque. To compensate for this effect, flies increase the stroke amplitude and advance the timing of pronation and supination of the damaged wing, while making the opposite adjustments on the intact wing. The resulting increase in force on the damaged wing and decrease in force on the intact wing function to maintain zero net roll torque. However, the bilaterally asymmetrical pattern of wing motion generates a finite lateral force, which flies balance by maintaining a constant body roll angle. Based on these results and additional experiments using a dynamically scaled robotic fly, we propose a simple bioinspired control algorithm for asymmetric wing damage.
Collapse
Affiliation(s)
- Florian T Muijres
- Experimental Zoology Group, Wageningen University and Research, Wageningen, The Netherlands; Department of Biology, University of Washington, Seattle, WA, USA
| | - Nicole A Iwasaki
- Department of Biology, University of Washington , Seattle, WA , USA
| | | | - Johan M Melis
- Division of Biology and Bioengineering, California Institute of Technology, Pasadena, CA, USA; Faculty of Aerospace Engineering, Delft University of Technology, Delft, The Netherlands
| | - Michael H Dickinson
- Department of Biology, University of Washington, Seattle, WA, USA; Division of Biology and Bioengineering, California Institute of Technology, Pasadena, CA, USA
| |
Collapse
|
47
|
Lindsay T, Sustar A, Dickinson M. The Function and Organization of the Motor System Controlling Flight Maneuvers in Flies. Curr Biol 2017; 27:345-358. [PMID: 28132816 DOI: 10.1016/j.cub.2016.12.018] [Citation(s) in RCA: 41] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2016] [Revised: 12/06/2016] [Accepted: 12/08/2016] [Indexed: 11/19/2022]
Abstract
Animals face the daunting task of controlling their limbs using a small set of highly constrained actuators. This problem is particularly demanding for insects such as Drosophila, which must adjust wing motion for both quick voluntary maneuvers and slow compensatory reflexes using only a dozen pairs of muscles. To identify strategies by which animals execute precise actions using sparse motor networks, we imaged the activity of a complete ensemble of wing control muscles in intact, flying flies. Our experiments uncovered a remarkably efficient logic in which each of the four skeletal elements at the base of the wing are equipped with both large phasically active muscles capable of executing large changes and smaller tonically active muscles specialized for continuous fine-scaled adjustments. Based on the responses to a broad panel of visual motion stimuli, we have developed a model by which the motor array regulates aerodynamically functional features of wing motion. VIDEO ABSTRACT.
Collapse
Affiliation(s)
- Theodore Lindsay
- Division of Biology and Bioengineering, California Institute of Technology, Pasadena, CA 91125, USA
| | - Anne Sustar
- Department of Genome Sciences, University of Washington, Seattle, WA 98195, USA
| | - Michael Dickinson
- Division of Biology and Bioengineering, California Institute of Technology, Pasadena, CA 91125, USA.
| |
Collapse
|
48
|
Kim AJ, Fenk LM, Lyu C, Maimon G. Quantitative Predictions Orchestrate Visual Signaling in Drosophila. Cell 2017; 168:280-294.e12. [PMID: 28065412 DOI: 10.1016/j.cell.2016.12.005] [Citation(s) in RCA: 73] [Impact Index Per Article: 10.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2016] [Revised: 10/18/2016] [Accepted: 12/01/2016] [Indexed: 11/18/2022]
Abstract
Vision influences behavior, but ongoing behavior also modulates vision in animals ranging from insects to primates. The function and biophysical mechanisms of most such modulations remain unresolved. Here, we combine behavioral genetics, electrophysiology, and high-speed videography to advance a function for behavioral modulations of visual processing in Drosophila. We argue that a set of motion-sensitive visual neurons regulate gaze-stabilizing head movements. We describe how, during flight turns, Drosophila perform a set of head movements that require silencing their gaze-stability reflexes along the primary rotation axis of the turn. Consistent with this behavioral requirement, we find pervasive motor-related inputs to the visual neurons, which quantitatively silence their predicted visual responses to rotations around the relevant axis while preserving sensitivity around other axes. This work proposes a function for a behavioral modulation of visual processing and illustrates how the brain can remove one sensory signal from a circuit carrying multiple related signals.
Collapse
Affiliation(s)
- Anmo J Kim
- Laboratory of Integrative Brain Function, The Rockefeller University, New York, NY 10065, USA
| | - Lisa M Fenk
- Laboratory of Integrative Brain Function, The Rockefeller University, New York, NY 10065, USA
| | - Cheng Lyu
- Laboratory of Integrative Brain Function, The Rockefeller University, New York, NY 10065, USA
| | - Gaby Maimon
- Laboratory of Integrative Brain Function, The Rockefeller University, New York, NY 10065, USA.
| |
Collapse
|
49
|
Lehmann FO, Bartussek J. Neural control and precision of flight muscle activation in Drosophila. J Comp Physiol A Neuroethol Sens Neural Behav Physiol 2017; 203:1-14. [PMID: 27942807 PMCID: PMC5263198 DOI: 10.1007/s00359-016-1133-9] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2016] [Revised: 11/11/2016] [Accepted: 11/14/2016] [Indexed: 01/20/2023]
Abstract
Precision of motor commands is highly relevant in a large context of various locomotor behaviors, including stabilization of body posture, heading control and directed escape responses. While posture stability and heading control in walking and swimming animals benefit from high friction via ground reaction forces and elevated viscosity of water, respectively, flying animals have to cope with comparatively little aerodynamic friction on body and wings. Although low frictional damping in flight is the key to the extraordinary aerial performance and agility of flying birds, bats and insects, it challenges these animals with extraordinary demands on sensory integration and motor precision. Our review focuses on the dynamic precision with which Drosophila activates its flight muscular system during maneuvering flight, considering relevant studies on neural and muscular mechanisms of thoracic propulsion. In particular, we tackle the precision with which flies adjust power output of asynchronous power muscles and synchronous flight control muscles by monitoring muscle calcium and spike timing within the stroke cycle. A substantial proportion of the review is engaged in the significance of visual and proprioceptive feedback loops for wing motion control including sensory integration at the cellular level. We highlight that sensory feedback is the basis for precise heading control and body stability in flies.
Collapse
Affiliation(s)
- Fritz-Olaf Lehmann
- Department of Animal Physiology, University of Rostock, Albert-Einstein-Str. 3, 18059, Rostock, Germany.
| | - Jan Bartussek
- Department of Animal Physiology, University of Rostock, Albert-Einstein-Str. 3, 18059, Rostock, Germany
| |
Collapse
|
50
|
Read TJG, Segre PS, Middleton KM, Altshuler DL. Hummingbirds control turning velocity using body orientation and turning radius using asymmetrical wingbeat kinematics. J R Soc Interface 2016; 13:rsif.2016.0110. [PMID: 27030042 DOI: 10.1098/rsif.2016.0110] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2016] [Accepted: 03/07/2016] [Indexed: 11/12/2022] Open
Abstract
Turning in flight requires reorientation of force, which birds, bats and insects accomplish either by shifting body position and total force in concert or by using left-right asymmetries in wingbeat kinematics. Although both mechanisms have been observed in multiple species, it is currently unknown how each is used to control changes in trajectory. We addressed this problem by measuring body and wingbeat kinematics as hummingbirds tracked a revolving feeder, and estimating aerodynamic forces using a quasi-steady model. During arcing turns, hummingbirds symmetrically banked the stroke plane of both wings, and the body, into turns, supporting a body-dependent mechanism. However, several wingbeat asymmetries were present during turning, including a higher and flatter outer wingtip path and a lower more deviated inner wingtip path. A quasi-steady analysis of arcing turns performed with different trajectories revealed that changes in radius were associated with asymmetrical kinematics and forces, and changes in velocity were associated with symmetrical kinematics and forces. Collectively, our results indicate that both body-dependent and -independent force orientation mechanisms are available to hummingbirds, and that these kinematic strategies are used to meet the separate aerodynamic challenges posed by changes in velocity and turning radius.
Collapse
Affiliation(s)
- Tyson J G Read
- Department of Zoology, University of British Columbia, Vancouver, British Columbia, Canada V6T 1Z4
| | - Paolo S Segre
- Department of Zoology, University of British Columbia, Vancouver, British Columbia, Canada V6T 1Z4
| | - Kevin M Middleton
- Department of Pathology and Anatomical Sciences, University of Missouri, Columbia, MO 65212, USA
| | - Douglas L Altshuler
- Department of Zoology, University of British Columbia, Vancouver, British Columbia, Canada V6T 1Z4
| |
Collapse
|