Mechanisms of punctuated vision in fly flight

Asynchronous haltere input drives specific wing and head movements in Drosophila

Halteres are multifunctional mechanosensory organs unique to the true flies (Diptera). A set of reduced hindwings, the halteres beat at the same frequency as the lift-generating forewings and sense inertial forces via mechanosensory campaniform sensilla. Though haltere ablation makes stable flight impossible, the specific role of wing-synchronous input has not been established. Using small iron filings attached to the halteres of tethered flies and an alternating electromagnetic field, we experimentally decoupled the wings and halteres of flying Drosophila and observed the resulting changes in wingbeat amplitude and head orientation. We find that asynchronous haltere input results in fast amplitude changes in the wing (hitches), but does not appreciably move the head. In multi-modal experiments, we find that wing and gaze optomotor responses are disrupted differently by asynchronous input. These effects of wing-asynchronous haltere input suggest that specific sensory information is necessary for maintaining wing amplitude stability and adaptive gaze control.

Motor neurons generate pose-targeted movements via proprioceptive sculpting

Motor neurons are the final common pathway1 through which the brain controls movement of the body, forming the basic elements from which all movement is composed. Yet how a single motor neuron contributes to control during natural movement remains unclear. Here we anatomically and functionally characterize the individual roles of the motor neurons that control head movement in the fly, Drosophila melanogaster. Counterintuitively, we find that activity in a single motor neuron rotates the head in different directions, depending on the starting posture of the head, such that the head converges towards a pose determined by the identity of the stimulated motor neuron. A feedback model predicts that this convergent behaviour results from motor neuron drive interacting with proprioceptive feedback. We identify and genetically2 suppress a single class of proprioceptive neuron3 that changes the motor neuron-induced convergence as predicted by the feedback model. These data suggest a framework for how the brain controls movements: instead of directly generating movement in a given direction by activating a fixed set of motor neurons, the brain controls movements by adding bias to a continuing proprioceptive-motor loop.

Descending control and regulation of spontaneous flight turns in Drosophila

The clumped distribution of resources in the world has influenced the pattern of foraging behavior since the origins of locomotion, selecting for a common search motif in which straight movements through resource-poor regions alternate with zig-zag exploration in resource-rich domains. For example, during local search, flying flies spontaneously execute rapid flight turns, called body saccades, but suppress these maneuvers during long-distance dispersal or when surging upstream toward an attractive odor. Here, we describe the key cellular components of a neural network in flies that generate spontaneous turns as well as a specialized pair of neurons that inhibits the network and suppresses turning. Using 2-photon imaging, optogenetic activation, and genetic ablation, we show that only four descending neurons appear sufficient to generate the descending commands to execute flight saccades. The network is organized into two functional units-one for right turns and one for left-with each unit consisting of an excitatory (DNae014) and an inhibitory (DNb01) neuron that project to the flight motor neuropil within the ventral nerve cord. Using resources from recently published connectomes of the fly, we identified a pair of large, distinct interneurons (VES041) that form inhibitory connections to all four saccade command neurons and created specific genetic driver lines for this cell. As predicted by its connectivity, activation of VES041 strongly suppresses saccades, suggesting that it promotes straight flight to regulate the transition between local search and long-distance dispersal. These results thus identify the key elements of a network that may play a crucial role in foraging ecology.

Drosophila flying in augmented reality reveals the vision-based control autonomy of the optomotor response

For walking, swimming, and flying animals, the optomotor response is essential to stabilize gaze. How flexible is the optomotor response? Classic work in Drosophila has argued that flies adapt flight control under augmented visual feedback conditions during goal-directed bar fixation. However, whether the lower-level, reflexive optomotor response can similarly adapt to augmented visual feedback (partially autonomous) or not (autonomous) over long timescales is poorly understood. To address this question, we developed an augmented reality paradigm to study the vision-based control autonomy of the yaw optomotor response of flying fruit flies (Drosophila). Flies were placed in a flight simulator, which permitted free body rotation about the yaw axis. By feeding back body movements in real time to a visual display, we augmented and inverted visual feedback. Thus, this experimental paradigm caused a constant visual error between expected and actual visual feedback to study potential adaptive visuomotor control. By combining experiments with control theory, we demonstrate that the optomotor response is autonomous during augmented reality flight bouts of up to 30 min, which exceeds the reported learning epoch during bar fixation. Agreement between predictions from linear systems theory and experimental data supports the notion that the optomotor response is approximately linear and time invariant within our experimental assay. Even under positive visual feedback, which revealed the stability limit of flies in augmented reality, the optomotor response was autonomous. Our results support a hierarchical motor control architecture in flies with fast and autonomous reflexes at the bottom and more flexible behavior at higher levels.

The influence of saccades on yaw gaze stabilization in fly flight

In a way analogous to human vision, the fruit fly D. melanogaster and many other flying insects generate smooth and saccadic movements to stabilize and shift their gaze in flight, respectively. It has been hypothesized that this combination of continuous and discrete movements benefits both flight stability and performance, particularly at high frequencies or speeds. Here we develop a hybrid control system model to explore the effects of saccades on the yaw stabilization reflex of D. melanogaster. Inspired from experimental data, the model includes a first order plant, a Proportional-Integral (PI) continuous controller, and a saccadic reset system that fires based on the integrated error of the continuous controller. We explore the gain, delay and switching threshold parameter space to quantify the optimum regions for yaw stability and performance. We show that the addition of saccades to a continuous controller provides benefits to both stability and performance across a range of frequencies. Our model suggests that Drosophila operates near its optimal switching threshold for its experimental gain set. We also show that based on experimental data, D. melanogaster operates in a region that trades off performance and stability. This trade-off increases flight robustness to compensate for internal perturbations such as wing damage.

Flies adaptively control flight to compensate for added inertia

Animal locomotion is highly adaptive, displaying a large degree of flexibility, yet how this flexibility arises from the integration of mechanics and neural control remains elusive. For instance, animals require flexible strategies to maintain performance as changes in mass or inertia impact stability. Compensatory strategies to mechanical loading are especially critical for animals that rely on flight for survival. To shed light on the capacity and flexibility of flight neuromechanics to mechanical loading, we pushed the performance of fruit flies (Drosophila) near its limit and implemented a control theoretic framework. Flies with added inertia were placed inside a virtual reality arena which permitted free rotation about the vertical (yaw) axis. Adding inertia increased the fly's response time yet had little influence on overall gaze stabilization performance. Flies maintained stability following the addition of inertia by adaptively modulating both visuomotor gain and damping. By contrast, mathematical modelling predicted a significant decrease in gaze stabilization performance. Adding inertia altered saccades, however, flies compensated for the added inertia by increasing saccade torque. Taken together, in response to added inertia flies increase reaction time but maintain flight performance through adaptive neural control. Overall, adding inertia decreases closed-loop flight robustness. Our work highlights the flexibility and capacity of motor control in flight.

Descending control and regulation of spontaneous flight turns in Drosophila

The clumped distribution of resources in the world has influenced the pattern of foraging behavior since the origins of life, selecting for a common locomotor search motif in which straight movements through resource-poor regions alternate with zig -zag exploration in resource-rich domains. For example, flies execute rapid changes in flight heading called body saccades during local search, but suppress these turns during long-distance dispersal or when surging upwind after encountering an attractive odor plume. Here, we describe the key cellular components of a neural network in flies that generates spontaneous turns as well as a specialized neuron that inhibits the network to promote straight flight. Using 2-photon imaging, optogenetic activation, and genetic ablation, we show that only four descending neurons appear sufficient to generate the descending commands to execute flight saccades. The network is organized into two functional couplets-one for right turns and one for left-with each couplet consisting of an excitatory (DNae014) and inhibitory (DNb01) neuron that project to the flight motor neuropil within the ventral nerve cord. Using resources from recently published connectomes of the fly brain, we identified a large, unique interneuron (VES041) that forms inhibitory connections to all four saccade command neurons and created specific genetic driver lines for this cell. As suggested by its connectivity, activation of VES041 strongly suppresses saccades, suggesting that it regulates the transition between local search and long-distance dispersal. These results thus identify the critical elements of a network that not only structures the locomotor behavior of flies, but may also play a crucial role in their natural foraging ecology.

Optic flow enrichment via Drosophila head and retina motions to support inflight position regulation

Developing a functional description of the neural control circuits and visual feedback paths underlying insect flight behaviors is an active research area. Feedback controllers incorporating engineering models of the insect visual system outputs have described some flight behaviors, yet they do not explain how insects are able to stabilize their body position relative to nearby targets such as neighbors or forage sources, especially in challenging environments in which optic flow is poor. The insect experimental community is simultaneously recording a growing library of in-flight head and eye motions that may be linked to increased perception. This study develops a quantitative model of the optic flow experienced by a flying insect or robot during head yawing rotations (distinct from lateral peering motions in previous work) with a single other target in view. This study then applies a model of insect visuomotor feedback to show via analysis and simulation of five species that these head motions sufficiently enrich the optic flow and that the output feedback can provide relative position regulation relative to the single target (asymptotic stability). In the simplifying case of pure rotation relative to the body, theoretical analysis provides a stronger stability guarantee. The results are shown to be robust to anatomical neck angle limits and body vibrations, persist with more detailed Drosophila lateral-directional flight dynamics simulations, and generalize to recent retinal motion studies. Together, these results suggest that the optic flow enrichment provided by head or pseudopupil rotation could be used in an insect's neural processing circuit to enable position regulation.

Muscles that move the retina augment compound eye vision in Drosophila

Most animals have compound eyes, with tens to thousands of lenses attached rigidly to the exoskeleton. A natural assumption is that all of these species must resort to moving either their head or their body to actively change their visual input. However, classic anatomy has revealed that flies have muscles poised to move their retinas under the stable lenses of each compound eye1-3. Here we show that Drosophila use their retinal muscles to smoothly track visual motion, which helps to stabilize the retinal image, and also to perform small saccades when viewing a stationary scene. We show that when the retina moves, visual receptive fields shift accordingly, and that even the smallest retinal saccades activate visual neurons. Using a head-fixed behavioural paradigm, we find that Drosophila perform binocular, vergence movements of their retinas-which could enhance depth perception-when crossing gaps, and impairing the physiology of retinal motor neurons alters gap-crossing trajectories during free behaviour. That flies evolved an ability to actuate their retinas suggests that moving the eye independently of the head is broadly paramount for animals. The similarities of smooth and saccadic movements of the Drosophila retina and the vertebrate eye highlight a notable example of convergent evolution.

Flies trade off stability and performance via adaptive compensation to wing damage

Physical injury often impairs mobility, which can have dire consequences for survival in animals. Revealing mechanisms of robust biological intelligence to prevent system failure can provide critical insights into how complex brains generate adaptive movement and inspiration to design fault-tolerant robots. For flying animals, physical injury to a wing can have severe consequences, as flight is inherently unstable. Using a virtual reality flight arena, we studied how flying fruit flies compensate for damage to one wing. By combining experimental and mathematical methods, we show that flies compensate for wing damage by corrective wing movement modulated by closed-loop sensing and robust mechanics. Injured flies actively increase damping and, in doing so, modestly decrease flight performance but fly as stably as uninjured flies. Quantifying responses to injury can uncover the flexibility and robustness of biological systems while informing the development of bio-inspired fault-tolerant strategies.

Small-amplitude head oscillations result from a multimodal head stabilization reflex in hawkmoths

In flying insects, head stabilization is an essential reflex that helps to reduce motion blur during fast aerial manoeuvres. This reflex is multimodal and requires the integration of visual and antennal mechanosensory feedback in hawkmoths, each operating as a negative-feedback-control loop. As in any negative-feedback system, the head stabilization system possesses inherent oscillatory dynamics that depend on the rate at which the sensorimotor components of the reflex operate. Consistent with this expectation, we observed small-amplitude oscillations in the head motion (or head wobble) of the oleander hawkmoth, Daphnis nerii, which are accentuated when sensory feedback is aberrant. Here, we show that these oscillations emerge from the inherent dynamics of the multimodal reflex underlying gaze stabilization, and that the amplitude of head wobble is a function of both the visual feedback and antennal mechanosensory feedback from the Johnston's organs. Our data support the hypothesis that head wobble results from a multimodal, dynamically stabilized reflex loop that mediates head positioning.

Matched function of the neuropil processing optic flow in flies and crabs: the lobula plate mediates optomotor responses in Neohelice granulata

When an animal rotates (whether it is an arthropod, a fish, a bird or a human) a drift of the visual panorama occurs over its retina, termed optic flow. The image is stabilized by compensatory behaviours (driven by the movement of the eyes, head or the whole body depending on the animal) collectively termed optomotor responses. The dipteran lobula plate has been consistently linked with optic flow processing and the control of optomotor responses. Crabs have a neuropil similarly located and interconnected in the optic lobes, therefore referred to as a lobula plate too. Here we show that the crabs' lobula plate is required for normal optomotor responses since the response was lost or severely impaired in animals whose lobula plate had been lesioned. The effect was behaviour-specific, since avoidance responses to approaching visual stimuli were not affected. Crabs require simpler optic flow processing than flies (because they move slower and in two-dimensional instead of three-dimensional space), consequently their lobula plates are relatively smaller. Nonetheless, they perform the same essential role in the visual control of behaviour. Our findings add a fundamental piece to the current debate on the evolutionary relationship between the lobula plates of insects and crustaceans.

Impact of walking speed and motion adaptation on optokinetic nystagmus-like head movements in the blowfly Calliphora

The optokinetic nystagmus is a gaze-stabilizing mechanism reducing motion blur by rapid eye rotations against the direction of visual motion, followed by slower syndirectional eye movements minimizing retinal slip speed. Flies control their gaze through head turns controlled by neck motor neurons receiving input directly, or via descending neurons, from well-characterized directional-selective interneurons sensitive to visual wide-field motion. Locomotion increases the gain and speed sensitivity of these interneurons, while visual motion adaptation in walking animals has the opposite effects. To find out whether flies perform an optokinetic nystagmus, and how it may be affected by locomotion and visual motion adaptation, we recorded head movements of blowflies on a trackball stimulated by progressive and rotational visual motion. Flies flexibly responded to rotational stimuli with optokinetic nystagmus-like head movements, independent of their locomotor state. The temporal frequency tuning of these movements, though matching that of the upstream directional-selective interneurons, was only mildly modulated by walking speed or visual motion adaptation. Our results suggest flies flexibly control their gaze to compensate for rotational wide-field motion by a mechanism similar to an optokinetic nystagmus. Surprisingly, the mechanism is less state-dependent than the response properties of directional-selective interneurons providing input to the neck motor system.

Complementary feedback control enables effective gaze stabilization in animals

In visually active animals, eye, head, and body movements are coordinated to direct gaze. Given their distinct mechanics, how does the nervous system weight their contribution? By combining experiments in flying flies with control theory, we show that flies implement an elegant solution to this problem: the lower inertia head is recruited for higher-frequency visual tasks and is sensitive to motion acceleration, whereas the higher inertia body is recruited for lower-frequency visual tasks and is sensitive to motion velocity. This complementary division of labor within the nervous system exhibits two hallmarks of optimality: an increase in task performance accompanied with a decrease in mechanical energy expenditure. Our model recapitulates classic primate head-eye coordination responses, suggesting convergent mechanisms across phyla.

Visually active animals coordinate vision and movement to achieve spectacular tasks. An essential prerequisite to guide agile locomotion is to keep gaze level and stable. Since the eyes, head and body can move independently to control gaze, how does the brain effectively coordinate these distinct motor outputs? Furthermore, since the eyes, head, and body have distinct mechanical constraints (e.g., inertia), how does the nervous system adapt its control to these constraints? To address these questions, we studied gaze control in flying fruit flies (Drosophila) using a paradigm which permitted direct measurement of head and body movements. By combining experiments with mathematical modeling, we show that body movements are sensitive to the speed of visual motion whereas head movements are sensitive to its acceleration. This complementary tuning of the head and body permitted flies to stabilize a broader range of visual motion frequencies. We discovered that flies implement proportional-derivative (PD) control, but unlike classical engineering control systems, relay the proportional and derivative signals in parallel to two distinct motor outputs. This scheme, although derived from flies, recapitulated classic primate vision responses thus suggesting convergent mechanisms across phyla. By applying scaling laws, we quantify that animals as diverse as flies, mice, and humans as well as bio-inspired robots can benefit energetically by having a high ratio between head, body, and eye inertias. Our results provide insights into the mechanical constraints that may have shaped the evolution of active vision and present testable neural control hypotheses for visually guided behavior across phyla.

Bumblebees display characteristics of active vision during robust obstacle avoidance flight

Insects are remarkable flyers and capable of navigating through highly cluttered environments. We tracked the head and thorax of bumblebees freely flying in a tunnel containing vertically oriented obstacles to uncover the sensorimotor strategies used for obstacle detection and collision avoidance. Bumblebees presented all the characteristics of active vision during flight by stabilizing their head relative to the external environment and maintained close alignment between their gaze and flightpath. Head stabilization increased motion contrast of nearby features against the background to enable obstacle detection. As bees approached obstacles, they appeared to modulate avoidance responses based on the relative retinal expansion velocity (RREV) of obstacles and their maximum evasion acceleration was linearly related to RREVmax. Finally, bees prevented collisions through rapid roll manoeuvres implemented by their thorax. Overall, the combination of visuo-motor strategies of bumblebees highlights elegant solutions developed by insects for visually guided flight through cluttered environments.

Insect vision: Head saccades to reset the view

Tracking a moving scene requires you to occasionally readjust your gaze as objects slip out of sight. A new study has found how fruit flies use head-turning strategies to reset their gaze and stabilize visual images during flight.