51
|
A faithful internal representation of walking movements in the Drosophila visual system. Nat Neurosci 2016; 20:72-81. [PMID: 27798632 DOI: 10.1038/nn.4435] [Citation(s) in RCA: 75] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2016] [Accepted: 10/04/2016] [Indexed: 12/13/2022]
Abstract
The integration of sensorimotor signals to internally estimate self-movement is critical for spatial perception and motor control. However, which neural circuits accurately track body motion and how these circuits control movement remain unknown. We found that a population of Drosophila neurons that were sensitive to visual flow patterns typically generated during locomotion, the horizontal system (HS) cells, encoded unambiguous quantitative information about the fly's walking behavior independently of vision. Angular and translational velocity signals were integrated with a behavioral-state signal and generated direction-selective and speed-sensitive graded changes in the membrane potential of these non-spiking cells. The nonvisual direction selectivity of HS cells cooperated with their visual selectivity only when the visual input matched that expected from the fly's movements, thereby revealing a circuit for internally monitoring voluntary walking. Furthermore, given that HS cells promoted leg-based turning, the activity of these cells could be used to control forward walking.
Collapse
|
52
|
Li J, Lindemann JP, Egelhaaf M. Peripheral Processing Facilitates Optic Flow-Based Depth Perception. Front Comput Neurosci 2016; 10:111. [PMID: 27818631 PMCID: PMC5073142 DOI: 10.3389/fncom.2016.00111] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2016] [Accepted: 10/04/2016] [Indexed: 12/19/2022] Open
Abstract
Flying insects, such as flies or bees, rely on consistent information regarding the depth structure of the environment when performing their flight maneuvers in cluttered natural environments. These behaviors include avoiding collisions, approaching targets or spatial navigation. Insects are thought to obtain depth information visually from the retinal image displacements ("optic flow") during translational ego-motion. Optic flow in the insect visual system is processed by a mechanism that can be modeled by correlation-type elementary motion detectors (EMDs). However, it is still an open question how spatial information can be extracted reliably from the responses of the highly contrast- and pattern-dependent EMD responses, especially if the vast range of light intensities encountered in natural environments is taken into account. This question will be addressed here by systematically modeling the peripheral visual system of flies, including various adaptive mechanisms. Different model variants of the peripheral visual system were stimulated with image sequences that mimic the panoramic visual input during translational ego-motion in various natural environments, and the resulting peripheral signals were fed into an array of EMDs. We characterized the influence of each peripheral computational unit on the representation of spatial information in the EMD responses. Our model simulations reveal that information about the overall light level needs to be eliminated from the EMD input as is accomplished under light-adapted conditions in the insect peripheral visual system. The response characteristics of large monopolar cells (LMCs) resemble that of a band-pass filter, which reduces the contrast dependency of EMDs strongly, effectively enhancing the representation of the nearness of objects and, especially, of their contours. We furthermore show that local brightness adaptation of photoreceptors allows for spatial vision under a wide range of dynamic light conditions.
Collapse
Affiliation(s)
- Jinglin Li
- Department of Neurobiology and Center of Excellence Cognitive Interaction Technology, Bielefeld UniversityBielefeld, Germany
| | | | | |
Collapse
|
53
|
Li Y, Cao F, Thang Vo Doan T, Sato H. Controlled banked turns in coleopteran flight measured by a miniature wireless inertial measurement unit. BIOINSPIRATION & BIOMIMETICS 2016; 11:056018. [PMID: 27679933 DOI: 10.1088/1748-3190/11/5/056018] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
The mechanisms and principles of insect flight have long been investigated by researchers working on micro and nano air vehicles (MAVs/NAVs). However, studies of insect flight maneuvers require high speed filming and high spatial resolution in a small experimental space, or the tethering of the insect to a fixed place. Under such artificial conditions, the insects may deviate its flying behavior from that of regular flight. In this study, we mounted a tiny wireless system, or 'backpack', on live beetles (Mecynorrhina torquata; length 62 ± 8 mm; mass 7.4 ± 1.3 g) freely flying in a large laboratory space. The backpack contains a micro inertial measurement unit (IMU) that was especially designed and manufactured for this purpose. Owing to the small mass (∼1.30 g) and dimensions (∼2.3 cm2) of the backpack and the high accuracy of the IMU, we could remotely record the beetle in free flight. The free flight data revealed a strong linear correlation between the roll angle and yaw angular velocity. The strength of the correlation was quantified by the correlation coefficients and mean values. The change in roll angle preceded the change in yaw angular velocity. Moreover, there were frequent fluctuations in the roll angular velocity, which were uncorrelated with the yaw angular velocity. Apart from the strong correlation, these findings imply that Mecynorrhina torquata actively manipulates its roll rotation without coupling to the yaw rotation.
Collapse
Affiliation(s)
- Yao Li
- School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore, Singapore
| | | | | | | |
Collapse
|
54
|
Dickinson MH, Muijres FT. The aerodynamics and control of free flight manoeuvres in Drosophila. Philos Trans R Soc Lond B Biol Sci 2016; 371:20150388. [PMID: 27528778 PMCID: PMC4992712 DOI: 10.1098/rstb.2015.0388] [Citation(s) in RCA: 64] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/18/2016] [Indexed: 11/12/2022] Open
Abstract
A firm understanding of how fruit flies hover has emerged over the past two decades, and recent work has focused on the aerodynamic, biomechanical and neurobiological mechanisms that enable them to manoeuvre and resist perturbations. In this review, we describe how flies manipulate wing movement to control their body motion during active manoeuvres, and how these actions are regulated by sensory feedback. We also discuss how the application of control theory is providing new insight into the logic and structure of the circuitry that underlies flight stability.This article is part of the themed issue 'Moving in a moving medium: new perspectives on flight'.
Collapse
Affiliation(s)
- Michael H Dickinson
- Division of Biology and Bioengineering, California Institute of Technology, Pasadena, CA, USA
| | - Florian T Muijres
- Wageningen University and Research Center, Wageningen, The Netherlands
| |
Collapse
|
55
|
Meng XG, Sun M. Wing and body kinematics of forward flight in drone-flies. BIOINSPIRATION & BIOMIMETICS 2016; 11:056002. [PMID: 27526336 DOI: 10.1088/1748-3190/11/5/056002] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Here, we present a detailed analysis of the wing and body kinematics in drone-flies in free flight over a range of speeds from hovering to about 8.5 m s(-1). The kinematics was measured by high-speed video techniques. As the speed increased, the body angle decreased and the stroke plane angle increased; the wingbeat frequency changed little; the stroke amplitude first decreased and then increased; the ratio of the downstroke duration to the upstroke duration increased; the mean positional angle increased at lower speeds but changed little at speeds above 3 m s(-1). At a speed above about 1.5 m s(-1), wing rotation at supination was delayed and that at pronation was advanced, and consequently the wing rotations were mostly performed in the upstroke. In the downstroke, the relative velocity of the wing increased and the effective angle of attack decreased with speed; in the upstroke, they both decreased with speed at lower speeds, and at higher speeds, the relative velocity became larger but the effective angle of attack became very small. As speed increased, the increasing inclination of the stroke plane ensured that the effective angle of attack in the upstroke would not become negative, and that the wing was in suitable orientations for vertical-force and thrust production.
Collapse
Affiliation(s)
- Xue Guang Meng
- Institute of Fluid Mechanics, Beijing University of Aeronautics & Astronautics, Beijing 100191, People's Republic of China
| | | |
Collapse
|
56
|
Shyy W, Kang CK, Chirarattananon P, Ravi S, Liu H. Aerodynamics, sensing and control of insect-scale flapping-wing flight. Proc Math Phys Eng Sci 2016; 472:20150712. [PMID: 27118897 PMCID: PMC4841661 DOI: 10.1098/rspa.2015.0712] [Citation(s) in RCA: 37] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2015] [Accepted: 01/04/2016] [Indexed: 11/12/2022] Open
Abstract
There are nearly a million known species of flying insects and 13 000 species of flying warm-blooded vertebrates, including mammals, birds and bats. While in flight, their wings not only move forward relative to the air, they also flap up and down, plunge and sweep, so that both lift and thrust can be generated and balanced, accommodate uncertain surrounding environment, with superior flight stability and dynamics with highly varied speeds and missions. As the size of a flyer is reduced, the wing-to-body mass ratio tends to decrease as well. Furthermore, these flyers use integrated system consisting of wings to generate aerodynamic forces, muscles to move the wings, and sensing and control systems to guide and manoeuvre. In this article, recent advances in insect-scale flapping-wing aerodynamics, flexible wing structures, unsteady flight environment, sensing, stability and control are reviewed with perspective offered. In particular, the special features of the low Reynolds number flyers associated with small sizes, thin and light structures, slow flight with comparable wind gust speeds, bioinspired fabrication of wing structures, neuron-based sensing and adaptive control are highlighted.
Collapse
Affiliation(s)
- Wei Shyy
- Department of Mechanical and Aerospace Engineering, Hong Kong University of Science and Technology, Clear Water Bay, Hong Kong
| | - Chang-kwon Kang
- Department of Mechanical and Aerospace Engineering, University of Alabama in Huntsville, Huntsville, AL, USA
| | - Pakpong Chirarattananon
- Department of Mechanical and Biomedical Engineering, City University of Hong Kong, Kowloon Tong, Hong Kong
| | - Sridhar Ravi
- Graduate School of Engineering, Chiba University, Chiba, Japan
- School of Aerospace, Mechanical and Manufacturing Engineering, RMIT University, Melbourne, Victoria, Australia
| | - Hao Liu
- School of Aerospace, Mechanical and Manufacturing Engineering, RMIT University, Melbourne, Victoria, Australia
- Shanghai-Jiao Tong University and Chiba, University International Cooperative Research Centre (SJTU-CU ICRC), Minhang, Shanghai, China
| |
Collapse
|
57
|
Voesenek CJ, Pieters RPM, van Leeuwen JL. Automated Reconstruction of Three-Dimensional Fish Motion, Forces, and Torques. PLoS One 2016; 11:e0146682. [PMID: 26752597 PMCID: PMC4713831 DOI: 10.1371/journal.pone.0146682] [Citation(s) in RCA: 29] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2015] [Accepted: 12/20/2015] [Indexed: 11/23/2022] Open
Abstract
Fish can move freely through the water column and make complex three-dimensional motions to explore their environment, escape or feed. Nevertheless, the majority of swimming studies is currently limited to two-dimensional analyses. Accurate experimental quantification of changes in body shape, position and orientation (swimming kinematics) in three dimensions is therefore essential to advance biomechanical research of fish swimming. Here, we present a validated method that automatically tracks a swimming fish in three dimensions from multi-camera high-speed video. We use an optimisation procedure to fit a parameterised, morphology-based fish model to each set of video images. This results in a time sequence of position, orientation and body curvature. We post-process this data to derive additional kinematic parameters (e.g. velocities, accelerations) and propose an inverse-dynamics method to compute the resultant forces and torques during swimming. The presented method for quantifying 3D fish motion paves the way for future analyses of swimming biomechanics.
Collapse
Affiliation(s)
- Cees J. Voesenek
- Experimental Zoology, Department of Animal Sciences, Wageningen University, Wageningen, Netherlands
- * E-mail:
| | - Remco P. M. Pieters
- Experimental Zoology, Department of Animal Sciences, Wageningen University, Wageningen, Netherlands
| | - Johan L. van Leeuwen
- Experimental Zoology, Department of Animal Sciences, Wageningen University, Wageningen, Netherlands
| |
Collapse
|
58
|
Abstract
We used videography to investigate direct lateral maneuvers, i.e. ‘sideslips’, of the hawkmoth Manduca sexta. M. sexta sideslip by rolling their entire body and wings to reorient their net force vector. During sideslip they increase net aerodynamic force by flapping with greater amplitude, (in both wing elevation and sweep), allowing them to continue to support body weight while rolled. To execute the roll maneuver we observed in sideslips, they use an asymmetric wing stroke; increasing the pitch of the roll-contralateral wing pair, while decreasing that of the roll-ipsilateral pair. They also increase the wing sweep amplitude of, and decrease the elevation amplitude of, the contralateral wing pair relative to the ipsilateral pair. The roll maneuver unfolds in a stairstep manner, with orientation changing more during downstroke than upstroke. This is due to smaller upstroke wing pitch angle asymmetries as well as increased upstroke flapping counter-torque from left-right differences in global reference frame wing velocity about the moth's roll axis. Rolls are also opposed by stabilizing aerodynamic moments from lateral motion, such that rightward roll velocity will be opposed by rightward motion. Computational modeling using blade-element approaches confirm the plausibility of a causal linkage between the previously mentioned wing kinematics and roll/sideslip. Model results also predict high degrees of axial and lateral damping. On the time scale of whole and half wing strokes, left-right wing pair asymmetries directly relate to the first, but not second, derivative of roll. Collectively, these results strongly support a roll-based sideslip with a high degree of roll damping in M. sexta. Summary: We show that hawkmoths fly sideways by rolling in the direction of movement, adding a left- or right-ward component to their net lift vector. The underlying roll maneuvers are produced from a suite of asymmetric wing kinematic changes and are heavily damped.
Collapse
Affiliation(s)
- Jeremy S M Greeter
- Department of Biology, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | - Tyson L Hedrick
- Department of Biology, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| |
Collapse
|
59
|
Cheng B, Tobalske BW, Powers DR, Hedrick TL, Wang Y, Wethington SM, Chiu GTC, Deng X. Flight mechanics and control of escape manoeuvres in hummingbirds II. Aerodynamic force production, flight control and performance limitations. J Exp Biol 2016; 219:3532-3543. [DOI: 10.1242/jeb.137570] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2016] [Accepted: 08/23/2016] [Indexed: 11/20/2022]
Abstract
The superior manoeuvrability of hummingbirds emerges from complex interactions of specialized neural and physiological processes with the unique flight dynamics of flapping wings. Escape manoeuvring is an ecologically relevant, natural behaviour of hummingbirds, from which we can gain understanding into the functional limits of vertebrate locomotor capacity. Here, we extend our kinematic analysis of escape manoeuvres from a companion paper to assess two potential limiting factors of manoeuvring performance of hummingbirds 1) muscle mechanical power output and 2) delays in the neural sensing and control system. We focused on the magnificent hummingbird, (Eugenes fulgens, 7.8g) and black-chinned hummingbird (Archilochus alexandri, 3.1 g), which represent large and small species, respectively. We first estimated the aerodynamic forces, moments and the mechanical power of escape manoeuvres using measured wing kinematics. Comparing active-manoeuvring and passive-damping aerodynamic moments, we found that pitch dynamics were lightly damped and dominated by effect of inertia while roll dynamics were highly damped. To achieve observed closed-loop performance, pitch manoeuvres required faster sensorimotor transduction, as hummingbirds can only tolerate half the delay allowed in roll manoeuvres. Accordingly, our results suggested that pitch control may require a more sophisticated control strategy, such as those based on prediction. For the magnificent hummingbird, we estimated escape manoeuvres required muscle mass-specific power 4.5 times that during hovering. Therefore, in addition to the limitation imposed by sensorimotor delays, muscle power could also limit the performance of escape manoeuvres.
Collapse
Affiliation(s)
- Bo Cheng
- Department of Mechanical and Nuclear Engineering, Pennsylvania State University, University Park, PA 16802, USA
| | - Bret W. Tobalske
- Field Research Station at Fort Missoula, Division of Biological Sciences, University of Montana, Missoula, MT 59812, USA
| | - Donald R. Powers
- Biology & Chemistry Department, George Fox University, Newberg, OR 97132, USA
| | - Tyson L. Hedrick
- Department of Biology, University of North Carolina, Chapel Hill, NC 27599, USA
| | - Yi Wang
- School of Mechanical Engineering, Purdue University, West Lafayette, IN 47907, USA
| | | | - George T.-C. Chiu
- School of Mechanical Engineering, Purdue University, West Lafayette, IN 47907, USA
| | - Xinyan Deng
- School of Mechanical Engineering, Purdue University, West Lafayette, IN 47907, USA
| |
Collapse
|
60
|
Cheng B, Tobalske BW, Powers DR, Hedrick TL, Wethington SM, Chiu GTC, Deng X. Flight mechanics and control of escape manoeuvres in hummingbirds I. Flight kinematics. J Exp Biol 2016; 219:3518-3531. [DOI: 10.1242/jeb.137539] [Citation(s) in RCA: 51] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2016] [Accepted: 08/25/2016] [Indexed: 11/20/2022]
Abstract
Hummingbirds are nature‘s masters of aerobatic manoeuvres. Previous research shows hummingbirds and insects converged evolutionarily upon similar aerodynamic mechanisms and kinematics in hovering. Herein, we use three-dimensional kinematic data to begin to test for similar convergence of kinematics used for escape flight and to explore the effects of body size upon manoeuvring. We studied four hummingbird species in North America including two large species (magnificent hummingbird, Eugenes fulgens, 7.8 g and blue-throated hummingbird, Lampornis clemenciae, 8.0 g) and two smaller species (broad-billed hummingbird, Cynanthus latirostris, 3.4 g and black-chinned hummingbirds Archilochus alexandri, 3.1 g). Starting from a steady hover, hummingbirds consistently manoeuvred away from perceived threats using a drastic escape response that featured body pitch and roll rotations coupled with a large linear acceleration. Hummingbirds changed their flapping frequency and wing trajectory in all three degrees-of-freedom on stroke-by-stroke basis, likely causing rapid and significant alteration of the magnitude and direction of aerodynamic forces. Thus it appears that the flight control of hummingbirds does not obey the “helicopter model” that is valid for similar escape manoeuvres in fruit flies. Except for broad-billed hummingbirds, the hummingbirds had faster reaction times than those reported for visual feedback control in insects. The two larger hummingbird species performed pitch rotations and global-yaw turns with considerably larger magnitude than the smaller species, but roll rates and cumulative roll angles were similar among the four species.
Collapse
Affiliation(s)
- Bo Cheng
- Department of Mechanical and Nuclear Engineering, Pennsylvania State University, University Park, PA 16802, USA
| | - Bret W. Tobalske
- Field Research Station at Fort Missoula, Division of Biological Sciences, University of Montana, Missoula, MT 59812, USA
| | - Donald R. Powers
- Biology & Chemistry Department, George Fox University, Newberg, OR 97132, USA
| | - Tyson L. Hedrick
- Department of Biology, University of North Carolina, Chapel Hill, NC 27599, USA
| | | | - George T. C. Chiu
- School of Mechanical Engineering, Purdue University, West Lafayette, IN 47907, USA
| | - Xinyan Deng
- School of Mechanical Engineering, Purdue University, West Lafayette, IN 47907, USA
| |
Collapse
|
61
|
Functional divisions for visual processing in the central brain of flying Drosophila. Proc Natl Acad Sci U S A 2015; 112:E5523-32. [PMID: 26324910 DOI: 10.1073/pnas.1514415112] [Citation(s) in RCA: 73] [Impact Index Per Article: 8.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Although anatomy is often the first step in assigning functions to neural structures, it is not always clear whether architecturally distinct regions of the brain correspond to operational units. Whereas neuroarchitecture remains relatively static, functional connectivity may change almost instantaneously according to behavioral context. We imaged panneuronal responses to visual stimuli in a highly conserved central brain region in the fruit fly, Drosophila, during flight. In one substructure, the fan-shaped body, automated analysis revealed three layers that were unresponsive in quiescent flies but became responsive to visual stimuli when the animal was flying. The responses of these regions to a broad suite of visual stimuli suggest that they are involved in the regulation of flight heading. To identify the cell types that underlie these responses, we imaged activity in sets of genetically defined neurons with arborizations in the targeted layers. The responses of this collection during flight also segregated into three sets, confirming the existence of three layers, and they collectively accounted for the panneuronal activity. Our results provide an atlas of flight-gated visual responses in a central brain circuit.
Collapse
|
62
|
Cellular evidence for efference copy in Drosophila visuomotor processing. Nat Neurosci 2015; 18:1247-55. [PMID: 26237362 DOI: 10.1038/nn.4083] [Citation(s) in RCA: 117] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2015] [Accepted: 07/09/2015] [Indexed: 12/13/2022]
Abstract
Each time a locomoting fly turns, the visual image sweeps over the retina and generates a motion stimulus. Classic behavioral experiments suggested that flies use active neural-circuit mechanisms to suppress the perception of self-generated visual motion during intended turns. Direct electrophysiological evidence, however, has been lacking. We found that visual neurons in Drosophila receive motor-related inputs during rapid flight turns. These inputs arrived with a sign and latency appropriate for suppressing each targeted cell's visual response to the turn. Precise measurements of behavioral and neuronal response latencies supported the idea that motor-related inputs to optic flow-processing cells represent internal predictions of the expected visual drive induced by voluntary turns. Motor-related inputs to small object-selective visual neurons could reflect either proprioceptive feedback from the turn or internally generated signals. Our results in Drosophila echo the suppression of visual perception during rapid eye movements in primates, demonstrating common functional principles of sensorimotor processing across phyla.
Collapse
|
63
|
Schilling T, Borst A. Local motion detectors are required for the computation of expansion flow-fields. Biol Open 2015; 4:1105-8. [PMID: 26231626 PMCID: PMC4582123 DOI: 10.1242/bio.012690] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/04/2022] Open
Abstract
Avoidance of predators or impending collisions is important for survival. Approaching objects can be mimicked by expanding flow-fields. Tethered flying fruit flies, when confronted with an expansion flow-field, reliably turn away from the pole of expansion when presented laterally, or perform a landing response when presented frontally. Here, we show that the response to an expansion flow-field is independent of the overall luminance change and edge acceleration. As we demonstrate by blocking local motion-sensing neurons T4 and T5, the response depends crucially on the neural computation of appropriately aligned local motion vectors, using the same hardware that also controls the optomotor response to rotational flow-fields.
Collapse
Affiliation(s)
- Tabea Schilling
- Department of Circuits-Computation-Models, Max-Planck-Institute of Neurobiology, Martinsried D-82152, Germany
| | - Alexander Borst
- Department of Circuits-Computation-Models, Max-Planck-Institute of Neurobiology, Martinsried D-82152, Germany
| |
Collapse
|