Dynamics of optomotor responses in Drosophila to perturbations in optic flow

Drosophila flying in augmented reality reveals the vision-based control autonomy of the optomotor response

For walking, swimming, and flying animals, the optomotor response is essential to stabilize gaze. How flexible is the optomotor response? Classic work in Drosophila has argued that flies adapt flight control under augmented visual feedback conditions during goal-directed bar fixation. However, whether the lower-level, reflexive optomotor response can similarly adapt to augmented visual feedback (partially autonomous) or not (autonomous) over long timescales is poorly understood. To address this question, we developed an augmented reality paradigm to study the vision-based control autonomy of the yaw optomotor response of flying fruit flies (Drosophila). Flies were placed in a flight simulator, which permitted free body rotation about the yaw axis. By feeding back body movements in real time to a visual display, we augmented and inverted visual feedback. Thus, this experimental paradigm caused a constant visual error between expected and actual visual feedback to study potential adaptive visuomotor control. By combining experiments with control theory, we demonstrate that the optomotor response is autonomous during augmented reality flight bouts of up to 30 min, which exceeds the reported learning epoch during bar fixation. Agreement between predictions from linear systems theory and experimental data supports the notion that the optomotor response is approximately linear and time invariant within our experimental assay. Even under positive visual feedback, which revealed the stability limit of flies in augmented reality, the optomotor response was autonomous. Our results support a hierarchical motor control architecture in flies with fast and autonomous reflexes at the bottom and more flexible behavior at higher levels.

Insect neurobiology: What to do with conflicting evidence?

Sensory systems gather information from the environment so the nervous system can formulate appropriate responses. But what happens when sensory information is inconsistent? A new study demonstrates how flies respond to incompatible visual evidence of their own motion.

Visual processing in the fly, from photoreceptors to behavior

Originally a genetic model organism, the experimental use of Drosophila melanogaster has grown to include quantitative behavioral analyses, sophisticated perturbations of neuronal function, and detailed sensory physiology. A highlight of these developments can be seen in the context of vision, where pioneering studies have uncovered fundamental and generalizable principles of sensory processing. Here we begin with an overview of vision-guided behaviors and common methods for probing visual circuits. We then outline the anatomy and physiology of brain regions involved in visual processing, beginning at the sensory periphery and ending with descending motor control. Areas of focus include contrast and motion detection in the optic lobe, circuits for visual feature selectivity, computations in support of spatial navigation, and contextual associative learning. Finally, we look to the future of fly visual neuroscience and discuss promising topics for further study.

EyeLoop: An Open-Source System for High-Speed, Closed-Loop Eye-Tracking

Eye-trackers are widely used to study nervous system dynamics and neuropathology. Despite this broad utility, eye-tracking remains expensive, hardware-intensive, and proprietary, limiting its use to high-resource facilities. It also does not easily allow for real-time analysis and closed-loop design to link eye movements to neural activity. To address these issues, we developed an open-source eye-tracker – EyeLoop – that uses a highly efficient vectorized pupil detection method to provide uninterrupted tracking and fast online analysis with high accuracy on par with popular eye tracking modules, such as DeepLabCut. This Python-based software easily integrates custom functions using code modules, tracks a multitude of eyes, including in rodents, humans, and non-human primates, and operates at more than 1,000 frames per second on consumer-grade hardware. In this paper, we demonstrate EyeLoop’s utility in an open-loop experiment and in biomedical disease identification, two common applications of eye-tracking. With a remarkably low cost and minimum setup steps, EyeLoop makes high-speed eye-tracking widely accessible.

The impulse response of optic flow-sensitive descending neurons to roll m-sequences

When animals move through the world, their own movements generate widefield optic flow across their eyes. In insects, such widefield motion is encoded by optic lobe neurons. These lobula plate tangential cells (LPTCs) synapse with optic flow-sensitive descending neurons, which in turn project to areas that control neck, wing and leg movements. As the descending neurons play a role in sensorimotor transformation, it is important to understand their spatio-temporal response properties. Recent work shows that a relatively fast and efficient way to quantify such response properties is to use m-sequences or other white noise techniques. Therefore, here we used m-sequences to quantify the impulse responses of optic flow-sensitive descending neurons in male Eristalis tenax hoverflies. We focused on roll impulse responses as hoverflies perform exquisite head roll stabilizing reflexes, and the descending neurons respond particularly well to roll. We found that the roll impulse responses were fast, peaking after 16.5–18.0 ms. This is similar to the impulse response time to peak (18.3 ms) to widefield horizontal motion recorded in hoverfly LPTCs. We found that the roll impulse response amplitude scaled with the size of the stimulus impulse, and that its shape could be affected by the addition of constant velocity roll or lift. For example, the roll impulse response became faster and stronger with the addition of excitatory stimuli, and vice versa. We also found that the roll impulse response had a long return to baseline, which was significantly and substantially reduced by the addition of either roll or lift.

Summary: The impulse response of hoverfly optic flow-sensitive descending neurons to roll m-sequences reaches its time to peak within 20 ms and slowly returns to baseline over the next 100 ms.

Stabilizing responses to sideslip disturbances in Drosophila melanogaster are modulated by the density of moving elements on the ground

Stabilizing responses to sideslip disturbances are a critical part of the flight control system in flies. While strongly mediated by mechanoreception, much of the final response results from the wide-field motion detection system associated with vision. In order to be effective, these responses must match the disturbance they are aimed to correct. To do this, flies must estimate the velocity of the disturbance, although it is not known how they accomplish this task when presented with natural images or dot fields. The recent finding, that motion parallax in dot fields can modulate stabilizing responses only if perceived below the fly, raises the question of whether other image statistics are also processed differently between eye regions. One such parameter is the density of elements moving in translational optic flow. Depending on the habitat, there might be strong differences in the density of elements providing information about self-motion above and below the fly, which in turn could act as selective pressures tuning the visual system to process this parameter on a regional basis. By presenting laterally moving dot fields of different densities we found that, in Drosophila melanogaster, the amplitude of the stabilizing response is significantly affected by the number of elements in the field of view. Flies countersteer strongly within a relatively low and narrow range of element densities. But this effect is exclusive to the ventral region of the eye, and dorsal stimuli elicit an unaltered and stereotypical response regardless of the density of elements in the flow. This highlights local specialization of the eye and suggests the lower region may play a more critical role in translational flight stabilization.

Using a variant of the optomotor response as a visual defect detection assay in zebrafish

We describe a visual stimulus that can be used with both larval and adult zebrafish (Danio rerio). This protocol is a modification of a standard visual behavior analysis, the optomotor response (OMR). The OMR is often used to determine the spatial response or to detect directional visuomotor deficiencies. An OMR can be generated using a high contrast grated pattern, typically vertical bars. The spatial sensitivity is measured by detection and response to a change in grating bar width and is reported in cycles per degree (CPD). This test has been used extensively with zebrafish larvae and adults to identify visual- and/or motor-based mutations. Historically, when tested in adults, the grated pattern was presented from a vertical perspective, using a rotating cylinder around a holding tank, allowing the grating to be seen solely from the sides and front of the organism. In contrast, OMRs in zebrafish larvae are elicited using a stimulus projected below the fish. This difference in methodology means that two different experimental set-ups are required: one for adults and one for larvae. Our visual stimulus modifies the stimulation format so that a single OMR stimulus, suitable for use with both adults and larvae, is being presented underneath the fish. Analysis of visuomotor responses using this method does not require costly behavioral tracking software and, using a single behavioral paradigm, allows the observer to rapidly determine visual spatial response in both zebrafish larvae and adults.

Haltere and visual inputs sum linearly to predict wing (but not gaze) motor output in tethered flying Drosophila

In the true flies (Diptera), the hind wings have evolved into specialized mechanosensory organs known as halteres, which are sensitive to gyroscopic and other inertial forces. Together with the fly's visual system, the halteres direct head and wing movements through a suite of equilibrium reflexes that are crucial to the fly's ability to maintain stable flight. As in other animals (including humans), this presents challenges to the nervous system as equilibrium reflexes driven by the inertial sensory system must be integrated with those driven by the visual system in order to control an overlapping pool of motor outputs shared between the two of them. Here, we introduce an experimental paradigm for reproducibly altering haltere stroke kinematics and use it to quantify multisensory integration of wing and gaze equilibrium reflexes. We show that multisensory wing-steering responses reflect a linear superposition of haltere-driven and visually driven responses, but that multisensory gaze responses are not well predicted by this framework. These models, based on populations, extend also to the responses of individual flies.

Encoding and control of orientation to airflow by a set of Drosophila fan-shaped body neurons

The insect central complex (CX) is thought to underlie goal-oriented navigation but its functional organization is not fully understood. We recorded from genetically-identified CX cell types in Drosophila and presented directional visual, olfactory, and airflow cues known to elicit orienting behavior. We found that a group of neurons targeting the ventral fan-shaped body (ventral P-FNs) are robustly tuned for airflow direction. Ventral P-FNs did not generate a 'map' of airflow direction. Instead, cells in each hemisphere were tuned to 45° ipsilateral, forming a pair of orthogonal bases. Imaging experiments suggest that ventral P-FNs inherit their airflow tuning from neurons that provide input from the lateral accessory lobe (LAL) to the noduli (NO). Silencing ventral P-FNs prevented flies from selecting appropriate corrective turns following changes in airflow direction. Our results identify a group of CX neurons that robustly encode airflow direction and are required for proper orientation to this stimulus.

Ventral motion parallax enhances fruit fly steering to visual sideslip

Flies and other insects use incoherent motion (parallax) to the front and sides to measure distances and identify obstacles during translation. Although additional depth information could be drawn from below, there is no experimental proof that they use it. The finding that blowflies encode motion disparities in their ventral visual fields suggests this may be an important region for depth information. We used a virtual flight arena to measure fruit fly responses to optic flow. The stimuli appeared below (n = 51) or above the fly (n = 44), at different speeds, with or without parallax cues. Dorsal parallax does not affect responses, and similar motion disparities in rotation have no effect anywhere in the visual field. But responses to strong ventral sideslip (206° s⁻¹) change drastically depending on the presence or absence of parallax. Ventral parallax could help resolve ambiguities in cluttered motion fields, and enhance corrective responses to nearby objects.

Animals in Virtual Environments

The core idea in an XR (VR/MR/AR) application is to digitally stimulate one or more sensory systems (e.g. visual, auditory, olfactory) of the human user in an interactive way to achieve an immersive experience. Since the early 2000s biologists have been using Virtual Environments (VE) to investigate the mechanisms of behavior in non-human animals including insects, fish, and mammals. VEs have become reliable tools for studying vision, cognition, and sensory-motor control in animals. In turn, the knowledge gained from studying such behaviors can be harnessed by researchers designing biologically inspired robots, smart sensors, and rnulti-agent artificial intelligence. VE for animals is becoming a widely used application of XR technology but such applications have not previously been reported in the technical literature related to XR. Biologists and computer scientists can benefit greatly from deepening interdisciplinary research in this emerging field and together we can develop new methods for conducting fundamental research in behavioral sciences and engineering. To support our argument we present this review which provides an overview of animal behavior experiments conducted in virtual environments.

Fruit flies increase attention to their frontal visual field during fast forward optic flow

Fruit flies must compensate for the limited light gathered by the tiny facets of their eyes, and image motion during flight lowers light catch even further. Motion blur is especially problematic in fast regions of the visual field, perpendicular to forward motion, but flow fields also contain slower regions, less affected by blur. To test whether fruit flies shift their attention to predictably slower regions of a flow field, we placed flies in an arena simulating forward flight and measured responses to turning cues in different visual areas. We find that during fast forward flight, fruit flies respond more strongly to turning cues presented directly in front, and less strongly to cues presented to the sides, supporting the hypothesis that flying fruit flies shift visual attention to slower moving regions less affected by motion blur.

Flies land upside down on a ceiling using rapid visually mediated rotational maneuvers

Flies and other insects routinely land upside down on a ceiling. These inverted landing maneuvers are among the most remarkable aerobatic feats, yet the full range of these behaviors and their underlying sensorimotor processes remain largely unknown. Here, we report that successful inverted landing in flies involves a serial sequence of well-coordinated behavioral modules, consisting of an initial upward acceleration followed by rapid body rotation and leg extension, before terminating with a leg-assisted body swing pivoted around legs firmly attached to the ceiling. Statistical analyses suggest that rotational maneuvers are triggered when flies' relative retinal expansion velocity reaches a threshold. Also, flies exhibit highly variable pitch and roll rates, which are strongly correlated to and likely mediated by multiple sensory cues. When flying with higher forward or lower upward velocities, flies decrease the pitch rate but increase the degree of leg-assisted swing, thereby leveraging the transfer of body linear momentum.

Representation of Haltere Oscillations and Integration with Visual Inputs in the Fly Central Complex

The reduced hindwings of flies, known as halteres, are specialized mechanosensory organs that detect body rotations during flight. Primary afferents of the haltere encode its oscillation frequency linearly over a wide bandwidth and with precise phase-dependent spiking. However, it is not currently known whether information from haltere primary afferent neurons is sent to higher brain centers where sensory information about body position could be used in decision making, or whether precise spike timing is useful beyond the peripheral circuits that drive wing movements. We show that in cells in the central brain, the timing and rates of neural spiking can be modulated by sensory input from experimental haltere movements (driven by a servomotor). Using multichannel extracellular recording in restrained flesh flies (Sarcophaga bullata of both sexes), we examined responses of central complex cells to a range of haltere oscillation frequencies alone, and in combination with visual motion speeds and directions. Haltere-responsive units fell into multiple response classes, including those responding to any haltere motion and others with firing rates linearly related to the haltere frequency. Cells with multisensory responses showed higher firing rates than the sum of the unisensory responses at higher haltere frequencies. They also maintained visual properties, such as directional selectivity, while increasing response gain nonlinearly with haltere frequency. Although haltere inputs have been described extensively in the context of rapid locomotion control, we find haltere sensory information in a brain region known to be involved in slower, higher-order behaviors, such as navigation.SIGNIFICANCE STATEMENT Many animals use vision for navigation; however, these cues must be interpreted in the context of the body's position. In mammalian brains, hippocampal cells combine visual and vestibular information to encode head direction. A region of the arthropod brain, known as the central complex (CX), similarly encodes heading information, but it is unknown whether proprioceptive information is integrated here as well. We show that CX neurons respond to input from halteres, specialized proprioceptors in flies that detect body rotations. These neurons also respond to visual input, providing one of the few examples of multiple sensory modalities represented in individual CX cells. Haltere stimulation modifies neural responses to visual signals, providing a mechanism for integrating vision with proprioception.

Fruit flies are multistable geniuses

Our sensory systems have evolved to provide us with information about the external world. Such information is useful only insofar as it leads to actions that enhance fitness, and thus, the link between sensation and action has been thoroughly studied in many species. In insects, for example, specific visual stimuli lead to highly stereotyped responses. In contrast, humans can exhibit a wide range of responses to the same stimulus, as occurs most notably in the phenomenon of multistable perception. On this basis, one might think that humans have a fundamentally different way of generating actions from sensory inputs, but Toepfer et al. show that flies show evidence of multistable perception as well. Specifically, when confronted with a sensory stimulus that can yield different motor responses, flies switch from one response to another with temporal dynamics that are similar to those of humans and other animals. This suggests that the mechanisms that give rise to the rich repertoire of sensory experience in humans have correlates in much simpler nervous systems.

Parameters of motion vision in low-light in the hawkmoth, Manduca sexta

The hawkmoth Manduca sexta, is nocturnally active, beginning its flight activity at sunset, and executing rapid controlled maneuvers to search for food and mates in dim light conditions. This moth's visual system has been shown to trade off spatial and temporal resolution for increased sensitivity in these conditions. The study presented here uses tethered flying moths to characterize the flight performance envelope of M. sexta's wide-field-motion-triggered steering response in low light conditions by measuring attempted turning in response to wide-field visual motion. Moths were challenged with a horizontally oscillating sinusoidal grating at a range of luminance, from daylight to starlight conditions. The impact of luminance on response to a range of temporal frequencies and spatial wavelengths was assessed across a range of pattern contrasts. The optomotor response decreased as a function of decreasing luminance, and the lower limit of the moth's contrast sensitivity was found to be between 1% to 5%. The preferred spatial frequency for M. sexta increased from 0.06 to 0.3 cycles/degree as the luminance decreased, but the preferred temporal frequency remained stable at 4.5 Hz across all conditions. The relationship between the optomotor response time to the temporal frequency of the pattern movement did not vary significantly with luminance levels. Taken together, these results suggest that the behavioral response to wide-field visual input in M. sexta is adapted to operate during crepuscular to nocturnal luminance levels, and the decreasing light levels experienced during that period changes visual acuity and does not affect their response time significantly.

Evolution of Biological Image Stabilization

The use of vision to coordinate behavior requires an efficient control design that stabilizes the world on the retina or directs the gaze towards salient features in the surroundings. With a level gaze, visual processing tasks are simplified and behaviorally relevant features from the visual environment can be extracted. No matter how simple or sophisticated the eye design, mechanisms have evolved across phyla to stabilize gaze. In this review, we describe functional similarities in eyes and gaze stabilization reflexes, emphasizing their fundamental role in transforming sensory information into motor commands that support postural and locomotor control. We then focus on gaze stabilization design in flying insects and detail some of the underlying principles. Systems analysis reveals that gaze stabilization often involves several sensory modalities, including vision itself, and makes use of feedback as well as feedforward signals. Independent of phylogenetic distance, the physical interaction between an animal and its natural environment - its available senses and how it moves - appears to shape the adaptation of all aspects of gaze stabilization.

Spike Burst Coding of Translatory Optic Flow and Depth from Motion in the Fly Visual System

Many animals use the visual motion generated by traveling straight-the translatory optic flow-to successfully navigate obstacles: near objects appear larger and to move more quickly than distant objects. Flies are expert at navigating cluttered environments, and while their visual processing of rotatory optic flow is understood in exquisite detail, how they process translatory optic flow remains a mystery. We present novel cell types that have local motion receptive fields matched to translation self-motion, the vertical translation (VT) cells. One of these, the VT1 cell, encodes self-motion in the forward-sideslip direction and fires action potentials in spike bursts as well as single spikes. We show that the spike burst coding is size and speed-tuned and is selectively modulated by motion parallax-the relative motion experienced during translation. These properties are spatially organized, so that the cell is most excited by clutter rather than isolated objects. When the fly is presented with a simulation of flying past an elevated object, the spike burst activity is modulated by the height of the object, and the rate of single spikes is unaffected. When the moving object alone is experienced, the cell is weakly driven. Meanwhile, the VT2-3 cells have motion receptive fields matched to the lift axis. In conjunction with previously described horizontal cells, the VT cells have properties well suited to the visual navigation of clutter and to encode the fly's movements along near cardinal axes of thrust, lift, and forward sideslip.

Drosophila Spatiotemporally Integrates Visual Signals to Control Saccades

Like many visually active animals, including humans, flies generate both smooth and rapid saccadic movements to stabilize their gaze. How rapid body saccades and smooth movement interact for simultaneous object pursuit and gaze stabilization is not understood. We directly observed these interactions in magnetically tethered Drosophila free to rotate about the yaw axis. A moving bar elicited sustained bouts of saccades following the bar, with surprisingly little smooth movement. By contrast, a moving panorama elicited robust smooth movement interspersed with occasional optomotor saccades. The amplitude, angular velocity, and torque transients of bar-fixation saccades were finely tuned to the speed of bar motion and were triggered by a threshold in the temporal integral of the bar error angle rather than its absolute retinal position error. Optomotor saccades were tuned to the dynamics of panoramic image motion and were triggered by a threshold in the integral of velocity over time. A hybrid control model based on integrated motion cues simulates saccade trigger and dynamics. We propose a novel algorithm for tuning fixation saccades in flies.

Object-Detecting Neurons in Drosophila

Many animals rely on vision to detect objects such as conspecifics, predators, and prey. Hypercomplex cells found in feline cortex and small target motion detectors found in dragonfly and hoverfly optic lobes demonstrate robust tuning for small objects, with weak or no response to larger objects or movement of the visual panorama [1-3]. However, the relationship among anatomical, molecular, and functional properties of object detection circuitry is not understood. Here we characterize a specialized object detector in Drosophila, the lobula columnar neuron LC11 [4]. By imaging calcium dynamics with two-photon excitation microscopy, we show that LC11 responds to the omni-directional movement of a small object darker than the background, with little or no responses to static flicker, vertically elongated bars, or panoramic gratings. LC11 dendrites innervate multiple layers of the lobula, and each dendrite spans enough columns to sample 75° of visual space, yet the area that evokes calcium responses is only 20° wide and shows robust responses to a 2.2° object spanning less than half of one facet of the compound eye. The dendrites of neighboring LC11s encode object motion retinotopically, but the axon terminals fuse into a glomerular structure in the central brain where retinotopy is lost. Blocking inhibitory ionic currents abolishes small object sensitivity and facilitates responses to elongated bars and gratings. Our results reveal high-acuity object motion detection in the Drosophila optic lobe.

A visual horizon affects steering responses during flight in fruit flies

To navigate well through three-dimensional environments, animals must in some way gauge the distances to objects and features around them. Humans use a variety of visual cues to do this, but insects, with their small size and rigid eyes, are constrained to a more limited range of possible depth cues. For example, insects attend to relative image motion when they move, but cannot change the optical power of their eyes to estimate distance. On clear days, the horizon is one of the most salient visual features in nature, offering clues about orientation, altitude and, for humans, distance to objects. We set out to determine whether flying fruit flies treat moving features as farther off when they are near the horizon. Tethered flies respond strongly to moving images they perceive as close. We measured the strength of steering responses while independently varying the elevation of moving stimuli and the elevation of a virtual horizon. We found responses to vertical bars are increased by negative elevations of their bases relative to the horizon, closely correlated with the inverse of apparent distance. In other words, a bar that dips far below the horizon elicits a strong response, consistent with using the horizon as a depth cue. Wide-field motion also had an enhanced effect below the horizon, but this was only prevalent when flies were additionally motivated with hunger. These responses may help flies tune behaviors to nearby objects and features when they are too far off for motion parallax.

INSECT FLIGHT. Luminance-dependent visual processing enables moth flight in low light

Animals must operate under an enormous range of light intensities. Nocturnal and twilight flying insects are hypothesized to compensate for dim conditions by integrating light over longer times. This slowing of visual processing would increase light sensitivity but should also reduce movement response times. Using freely hovering moths tracking robotic moving flowers, we showed that the moth's visual processing does slow in dim light. These longer response times are consistent with models of how visual neurons enhance sensitivity at low light intensities, but they could pose a challenge for moths feeding from swaying flowers. Dusk-foraging moths avoid this sensorimotor tradeoff; their nervous systems slow down but not so much as to interfere with their ability to track the movements of real wind-blown flowers.

Spatio-temporal dynamics of impulse responses to figure motion in optic flow neurons

White noise techniques have been used widely to investigate sensory systems in both vertebrates and invertebrates. White noise stimuli are powerful in their ability to rapidly generate data that help the experimenter decipher the spatio-temporal dynamics of neural and behavioral responses. One type of white noise stimuli, maximal length shift register sequences (m-sequences), have recently become particularly popular for extracting response kernels in insect motion vision. We here use such m-sequences to extract the impulse responses to figure motion in hoverfly lobula plate tangential cells (LPTCs). Figure motion is behaviorally important and many visually guided animals orient towards salient features in the surround. We show that LPTCs respond robustly to figure motion in the receptive field. The impulse response is scaled down in amplitude when the figure size is reduced, but its time course remains unaltered. However, a low contrast stimulus generates a slower response with a significantly longer time-to-peak and half-width. Impulse responses in females have a slower time-to-peak than males, but are otherwise similar. Finally we show that the shapes of the impulse response to a figure and a widefield stimulus are very similar, suggesting that the figure response could be coded by the same input as the widefield response.

Computations underlying Drosophila photo-taxis, odor-taxis, and multi-sensory integration

To better understand how organisms make decisions on the basis of temporally varying multi-sensory input, we identified computations made by Drosophila larvae responding to visual and optogenetically induced fictive olfactory stimuli. We modeled the larva's navigational decision to initiate turns as the output of a Linear-Nonlinear-Poisson cascade. We used reverse-correlation to fit parameters to this model; the parameterized model predicted larvae's responses to novel stimulus patterns. For multi-modal inputs, we found that larvae linearly combine olfactory and visual signals upstream of the decision to turn. We verified this prediction by measuring larvae's responses to coordinated changes in odor and light. We studied other navigational decisions and found that larvae integrated odor and light according to the same rule in all cases. These results suggest that photo-taxis and odor-taxis are mediated by a shared computational pathway.

DOI:http://dx.doi.org/10.7554/eLife.06229.001

Living organisms can sense cues from their surroundings and respond in appropriate ways. For example, animals will often move towards the smell of food or away from potential threats, such as predators. However, it is not fully understood how an animal's nervous system is set up to allow sensory information to control how the animal navigates its environment. It is also not clear how animals ‘decide’ what to do when they receive conflicting information from different senses.

Optogenetics is a technique that allows neuroscientists to control the activities of individual nerve cells simply by shining light on to them. Fruit fly larvae have a simple but well-studied nervous system, and they are nearly transparent, so scientists can use optogenetics to activate nerve cells in freely moving larvae.

Fruit fly larvae move in a series of forward ‘runs’ and direction-changing ‘turns’ and use sensory cues to decide when to turn, how large of a turn to make, and whether to turn left or right. Gepner, Mihovilovic Skanata et al. used optogenetics to stimulate different combinations of sensory nerve cells in larvae, while tracking the larvae's movements to discover exactly what information they used to make these decisions. An independent study by Hernandez-Nunez et al. also used a similar approach.

Fruit fly larvae are attracted towards scents from rotting fruit and are repelled by light—in particular, larvae are most sensitive to blue light but cannot detect red light. Therefore, Gepner, Mihovilovic Skanata et al. could expose the larvae to blue light to activate light-sensing nerve cells as normal, and use red light to activate odor-sensing nerve cells via optogenetics. These experiments showed that larvae changed direction more often when the level of blue light was increased or when the level of red light (which simulated the detection of odors from rotting fruits) was decreased.

Analysis of the data from these experiments revealed that larvae essentially assign negative values to the blue light and positive values to the ‘odor-mimicking’ red light. The larvae then use the sum of these two values to dictate their next move. This suggests that navigation in response to both light and odors is supported by the same pathways in a larva's nervous system.

The approach of using optogenetics in combination with quantitative analysis, as used in these two independent studies, is now opening the door to a more complete understanding of the connections between the activities of sensory nerve cells and perception and behavior.

DOI:http://dx.doi.org/10.7554/eLife.06229.002

Dual dimensionality reduction reveals independent encoding of motor features in a muscle synergy for insect flight control

What are the features of movement encoded by changing motor commands? Do motor commands encode movement independently or can they be represented in a reduced set of signals (i.e. synergies)? Motor encoding poses a computational and practical challenge because many muscles typically drive movement, and simultaneous electrophysiology recordings of all motor commands are typically not available. Moreover, during a single locomotor period (a stride or wingstroke) the variation in movement may have high dimensionality, even if only a few discrete signals activate the muscles. Here, we apply the method of partial least squares (PLS) to extract the encoded features of movement based on the cross-covariance of motor signals and movement. PLS simultaneously decomposes both datasets and identifies only the variation in movement that relates to the specific muscles of interest. We use this approach to explore how the main downstroke flight muscles of an insect, the hawkmoth Manduca sexta, encode torque during yaw turns. We simultaneously record muscle activity and turning torque in tethered flying moths experiencing wide-field visual stimuli. We ask whether this pair of muscles acts as a muscle synergy (a single linear combination of activity) consistent with their hypothesized function of producing a left-right power differential. Alternatively, each muscle might individually encode variation in movement. We show that PLS feature analysis produces an efficient reduction of dimensionality in torque variation within a wingstroke. At first, the two muscles appear to behave as a synergy when we consider only their wingstroke-averaged torque. However, when we consider the PLS features, the muscles reveal independent encoding of torque. Using these features we can predictably reconstruct the variation in torque corresponding to changes in muscle activation. PLS-based feature analysis provides a general two-sided dimensionality reduction that reveals encoding in high dimensional sensory or motor transformations.

Understanding movement control is challenging because the brains of nearly all animals send motor command signals to many muscles, and these signals produce complex movements. In studying animal movement, one cannot always record all the motor commands an animal uses or know all the ways in which movement varies in response. A combined approach is necessary to find the relevant patterns: the changes in movement that correspond to changes in the recorded motor commands. Techniques exist to identify simple patterns in either the motor commands or the movements, but in this paper we develop an approach that identifies patterns in both simultaneously. We use this technique to understand how agile flying insects control aerial turns. The two main downstroke muscles of moths are thought to produce turns by creating a power difference between the left and right wings. The moth’s brain may only need to specify the difference in activation between the two muscles. We discover that moth’s brain actually has independent control over each muscle, and this separate control increases the moth’s ability to adjust turning within a single wingstroke. Our computational approach reveals sophisticated patterns of movement processing even in the small nervous systems of insects.

Olfactory neuromodulation of motion vision circuitry in Drosophila

It is well established that perception is largely multisensory [1]; often served by modalities such as touch, vision, and hearing that detect stimuli emanating from a common point in space [2, 3]; and processed by brain tissue maps that are spatially aligned [4]. However, the neural interactions among modalities that share no spatial stimulus domain yet are essential for robust perception within noisy environments remain uncharacterized. Drosophila melanogaster makes its living navigating food odor plumes. Odor acts to increase the strength of gaze-stabilizing optomotor reflexes [5] to keep the animal aligned within an invisible plume, facilitating odor localization in free flight [6–8]. Here, we investigate the cellular mechanism for cross-modal behavioral interactions. We characterize a wide-field motion-selective interneuron of the lobula plate that shares anatomical and physiological similarities with the “Hx” neuron identified in larger flies [9, 10]. Drosophila Hx exhibits cross-modal enhancement of visual responses by paired odor, and presynaptic inputs to the lobula plate are required for behavioral odor tracking but are not themselves the target of odor modulation, nor is the neighboring wide-field “HSE” neuron [11]. Octopaminergic neurons mediating increased visual responses upon flight initiation [12] also show odor-evoked calcium modulations and form connections with Hx dendrites. Finally, restoring synaptic vesicle trafficking within the octopaminergic neurons of animals carrying a null mutation for all aminergic signaling [13] is sufficient to restore odor-tracking behavior. These results are the first to demonstrate cellular mechanisms underlying visual-olfactory integration required for odor localization in fruit flies, which may be representative of adaptive multisensory interactions across taxa.

•

Small-field motion detection neurons are required for odor-tracking behavior

•

Responses of a directional wide-field interneuron (Hx) increase with paired odor

•

Odor activates octopaminergic (OA) neurons that innervate the visual system

•

OA cells contact Hx; OA vesicle trafficking is required for odor-tracking behavior

Method and software for using m-sequences to characterize parallel components of higher-order visual tracking behavior in Drosophila

A moving visual figure may contain first-order signals defined by variation in mean luminance, as well as second-order signals defined by constant mean luminance and variation in luminance envelope, or higher-order signals that cannot be estimated by taking higher moments of the luminance distribution. Separating these properties of a moving figure to experimentally probe the visual subsystems that encode them is technically challenging and has resulted in debated mechanisms of visual object detection by flies. Our prior work took a white noise systems identification approach using a commercially available electronic display system to characterize the spatial variation in the temporal dynamics of two distinct subsystems for first- and higher-order components of visual figure tracking. The method relied on the use of single pixel displacements of two visual stimuli according to two binary maximum length shift register sequences (m-sequences) and cross-correlation of each m-sequence with time-varying flight steering measurements. The resultant spatio-temporal action fields represent temporal impulse responses parameterized by the azimuthal location of the visual figure, one STAF for first-order and another for higher-order components of compound stimuli. Here we review m-sequence and reverse correlation procedures, then describe our application in detail, provide Matlab code, validate the STAFs, and demonstrate the utility and robustness of STAFs by predicting the results of other published experimental procedures. This method has demonstrated how two relatively modest innovations on classical white noise analysis—the inclusion of space as a way to organize response kernels and the use of linear decoupling to measure the response to two channels of visual information simultaneously—could substantially improve our basic understanding of visual processing in the fly.

Cellular mechanisms for integral feedback in visually guided behavior

Sensory feedback is a ubiquitous feature of guidance systems in both animals and engineered vehicles. For example, a common strategy for moving along a straight path is to turn such that the measured rate of rotation is zero. This task can be accomplished by using a feedback signal that is proportional to the instantaneous value of the measured sensory signal. In such a system, the addition of an integral term depending on past values of the sensory input is needed to eliminate steady-state error [proportional-integral (PI) control]. However, the means by which nervous systems implement such a computation are poorly understood. Here, we show that the optomotor responses of flying Drosophila follow a time course consistent with temporal integration of horizontal motion input. To investigate the cellular basis of this effect, we performed whole-cell patch-clamp recordings from the set of identified visual interneurons [horizontal system (HS) cells] thought to control this reflex during tethered flight. At high stimulus speeds, HS cells exhibit steady-state responses during flight that are absent during quiescence, a state-dependent difference in physiology that is explained by changes in their presynaptic inputs. However, even during flight, the membrane potential of the large-field interneurons exhibits no evidence for integration that could explain the behavioral responses. However, using a genetically encoded indicator, we found that calcium accumulates in the terminals of the interneurons along a time course consistent with the behavior and propose that this accumulation provides a mechanism for temporal integration of sensory feedback consistent with PI control.

To keep on track during flight, fruitflies discount the skyward view

When small flying insects go off their intended course, they use the resulting pattern of motion on their eye, or optic flow, to guide corrective steering. A change in heading generates a unique, rotational motion pattern and a change in position generates a translational motion pattern, and each produces corrective responses in the wingbeats. Any image in the flow field can signal rotation, but owing to parallax, only the images of nearby objects can signal translation. Insects that fly near the ground might therefore respond more strongly to translational optic flow that occurs beneath them, as the nearby ground will produce strong optic flow. In these experiments, rigidly tethered fruitflies steered in response to computer-generated flow fields. When correcting for unintended rotations, flies weight the motion in their upper and lower visual fields equally. However, when correcting for unintended translations, flies weight the motion in the lower visual fields more strongly. These results are consistent with the interpretation that fruitflies stabilize by attending to visual areas likely to contain the strongest signals during natural flight conditions.

Vision-based flight control in the hawkmoth Hyles lineata

Vision is a key sensory modality for flying insects, playing an important role in guidance, navigation and control. Here, we use a virtual-reality flight simulator to measure the optomotor responses of the hawkmoth Hyles lineata, and use a published linear-time invariant model of the flight dynamics to interpret the function of the measured responses in flight stabilization and control. We recorded the forces and moments produced during oscillation of the visual field in roll, pitch and yaw, varying the temporal frequency, amplitude or spatial frequency of the stimulus. The moths' responses were strongly dependent upon contrast frequency, as expected if the optomotor system uses correlation-type motion detectors to sense self-motion. The flight dynamics model predicts that roll angle feedback is needed to stabilize the lateral dynamics, and that a combination of pitch angle and pitch rate feedback is most effective in stabilizing the longitudinal dynamics. The moths' responses to roll and pitch stimuli coincided qualitatively with these functional predictions. The moths produced coupled roll and yaw moments in response to yaw stimuli, which could help to reduce the energetic cost of correcting heading. Our results emphasize the close relationship between physics and physiology in the stabilization of insect flight.

Figure-ground discrimination behavior in Drosophila. II. Visual influences on head movement behavior

Visual identification of small moving targets is a challenge for all moving animals. Their own motion generates displacement of the visual surroundings, inducing wide-field optic flow across the retina. Wide-field optic flow is used to sense perturbations in the flight course. Both ego-motion and corrective optomotor responses confound any attempt to track a salient target moving independently of the visual surroundings. What are the strategies that flying animals use to discriminate small-field figure motion from superimposed wide-field background motion? We examined how fruit flies adjust their gaze in response to a compound visual stimulus comprising a small moving figure against an independently moving wide-field ground, which they do by re-orienting their head or their flight trajectory. We found that fixing the head in place impairs object fixation in the presence of ground motion, and that head movements are necessary for stabilizing wing steering responses to wide-field ground motion when a figure is present. When a figure is moving relative to a moving ground, wing steering responses follow components of both the figure and ground trajectories, but head movements follow only the ground motion. To our knowledge, this is the first demonstration that wing responses can be uncoupled from head responses and that the two follow distinct trajectories in the case of simultaneous figure and ground motion. These results suggest that whereas figure tracking by wing kinematics is independent of head movements, head movements are important for stabilizing ground motion during active figure tracking.

Figure-ground discrimination behavior in Drosophila. I. Spatial organization of wing-steering responses

The behavioral algorithms and neural subsystems for visual figure–ground discrimination are not sufficiently described in any model system. The fly visual system shares structural and functional similarity with that of vertebrates and, like vertebrates, flies robustly track visual figures in the face of ground motion. This computation is crucial for animals that pursue salient objects under the high performance requirements imposed by flight behavior. Flies smoothly track small objects and use wide-field optic flow to maintain flight-stabilizing optomotor reflexes. The spatial and temporal properties of visual figure tracking and wide-field stabilization have been characterized in flies, but how the two systems interact spatially to allow flies to actively track figures against a moving ground has not. We took a systems identification approach in flying Drosophila and measured wing-steering responses to velocity impulses of figure and ground motion independently. We constructed a spatiotemporal action field (STAF) – the behavioral analog of a spatiotemporal receptive field – revealing how the behavioral impulse responses to figure tracking and concurrent ground stabilization vary for figure motion centered at each location across the visual azimuth. The figure tracking and ground stabilization STAFs show distinct spatial tuning and temporal dynamics, confirming the independence of the two systems. When the figure tracking system is activated by a narrow vertical bar moving within the frontal field of view, ground motion is essentially ignored despite comprising over 90% of the total visual input.

Contributions of the 12 neuron classes in the fly lamina to motion vision

Motion detection is a fundamental neural computation performed by many sensory systems. In the fly, local motion computation is thought to occur within the first two layers of the visual system, the lamina and medulla. We constructed specific genetic driver lines for each of the 12 neuron classes in the lamina. We then depolarized and hyperpolarized each neuron type and quantified fly behavioral responses to a diverse set of motion stimuli. We found that only a small number of lamina output neurons are essential for motion detection, while most neurons serve to sculpt and enhance these feedforward pathways. Two classes of feedback neurons (C2 and C3), and lamina output neurons (L2 and L4), are required for normal detection of directional motion stimuli. Our results reveal a prominent role for feedback and lateral interactions in motion processing and demonstrate that motion-dependent behaviors rely on contributions from nearly all lamina neuron classes.

Modular use of peripheral input channels tunes motion-detecting circuitry

In the visual system, peripheral processing circuits are often tuned to specific stimulus features. How this selectivity arises and how these circuits are organized to inform specific visual behaviors is incompletely understood. Using forward genetics and quantitative behavioral studies, we uncover an input channel to motion detecting circuitry in Drosophila. The second-order neuron L3 acts combinatorially with two previously known inputs, L1 and L2, to inform circuits specialized to detect moving light and dark edges. In vivo calcium imaging of L3, combined with neuronal silencing experiments, suggests a neural mechanism to achieve selectivity for moving dark edges. We further demonstrate that different innate behaviors, turning and forward movement, can be independently modulated by visual motion. These two behaviors make use of different combinations of input channels. Such modular use of input channels to achieve feature extraction and behavioral specialization likely represents a general principle in sensory systems.

Mapping and cracking sensorimotor circuits in genetic model organisms

One central goal of systems neuroscience is to understand how neural circuits implement the computations that link sensory inputs to behavior. Work combining electrophysiological and imaging-based approaches to measure neural activity with pharmacological and electrophysiological manipulations has provided fundamental insights. More recently, genetic approaches have been used to monitor and manipulate neural activity, opening up new experimental opportunities and challenges. Here, we discuss issues associated with applying genetic approaches to circuit dissection in sensorimotor transformations, outlining important considerations for experimental design and considering how modeling can complement experimental approaches.

Flying fruit flies correct for visual sideslip depending on relative speed of forward optic flow

As a fly flies through its environment, static objects produce moving images on its retina, and this optic flow is essential for steering and course corrections. Different types of rotation and translation produce unique flow fields, which fly brains are wired to identify. However, a feature of optic flow unique to translational motion is that adjacent images may move across the retina at different speeds, depending on their distance from the observer. Many insects take advantage of this depth cue, called motion parallax, to determine the distance to objects. We wanted to know if differential object speeds affect the corrective responses of fruit flies when they experience unplanned course deviations. We presented tethered flying flies with optic flow and measured their corrective responses to sideways perturbations of images with different relative forward speeds. We found that flying flies attend to the relative speed of dots during forward motion, and adjust their corrective responses to sideslip deviations depending on this cue. With no other distinguishing features (such as brightness or size), flies mounted a greater response to sideways deviations that were signaled by faster moving dots in the forward flow field, those that appeared radially closer by their speeds. This is consistent with the interpretation that fruit flies attend to seemingly nearer objects, and correct more strongly when they indicate a perturbation.

Enhanced optomotor efficiency by expression of the human gene superoxide dismutase primarily in Drosophila motorneurons

Mutation of the human gene superoxide dismutase (hSOD1) triggers the fatal neurodegenerative motorneuron disorder, familial amyotrophic lateral sclerosis (ALS or Lou Gehrig's disease). Broad expression of this gene in Drosophila has no effect on longevity or functional senescence. We show here that restricting expression of human SOD1 primarily to motorneurons of Drosophila has significant effects on optomotor efficiency during in-flight tracking of rapidly moving visual targets. Under high-stress workloads with a recursive visual-motion stimulus cycle, young isogenic controls failed to track rapidly changing visual cues, whereas their same-aged hSOD1-activated progeny maintained coordinated in-flight tracking of the target by phase locking to the dynamic visual movement patterns. Several explanations are considered for the observed effects, including antioxidant intervention in motorneurons, changes in signal transduction pathways that regulate patterns of gene expression in other cell types, and expression of hSOD1 in a small set of neurons in the central brain. That hSOD1 overexpression improves sensorimotor coordination in young organisms may suggest possible therapeutic strategies for early-onset ALS in humans.

Discriminating external and internal causes for heading changes in freely flying Drosophila

As animals move through the world in search of resources, they change course in reaction to both external sensory cues and internally-generated programs. Elucidating the functional logic of complex search algorithms is challenging because the observable actions of the animal cannot be unambiguously assigned to externally- or internally-triggered events. We present a technique that addresses this challenge by assessing quantitatively the contribution of external stimuli and internal processes. We apply this technique to the analysis of rapid turns (“saccades”) of freely flying Drosophila melanogaster. We show that a single scalar feature computed from the visual stimulus experienced by the animal is sufficient to explain a majority (93%) of the turning decisions. We automatically estimate this scalar value from the observable trajectory, without any assumption regarding the sensory processing. A posteriori, we show that the estimated feature field is consistent with previous results measured in other experimental conditions. The remaining turning decisions, not explained by this feature of the visual input, may be attributed to a combination of deterministic processes based on unobservable internal states and purely stochastic behavior. We cannot distinguish these contributions using external observations alone, but we are able to provide a quantitative bound of their relative importance with respect to stimulus-triggered decisions. Our results suggest that comparatively few saccades in free-flying conditions are a result of an intrinsic spontaneous process, contrary to previous suggestions. We discuss how this technique could be generalized for use in other systems and employed as a tool for classifying effects into sensory, decision, and motor categories when used to analyze data from genetic behavioral screens.

Researchers have spent considerable effort studying how specific sensory stimuli elicit behavioral responses and how other behaviors may arise independent of external inputs in conditions of sensory deprivation. Yet an animal in its natural context, such as searching for food or mates, turns both in response to external stimuli and intrinsic, possibly stochastic, decisions. We show how to estimate the contribution of vision and internal causes on the observable behavior of freely flying Drosophila. We developed a dimensionality reduction scheme that finds a one-dimensional feature of the visual stimulus that best predicts turning decisions. This visual feature extraction is consistent with previous literature on visually elicited fly turning and predicts a large majority of turns in the tested environment. The rarity of stimulus-independent events suggests that fly behavior is more deterministic than previously suggested and that, more generally, animal search strategies may be dominated by responses to stimuli with only modest contributions from internal causes.

Embodied linearity of speed control in Drosophila melanogaster

Fruitflies regulate flight speed by adjusting their body angle. To understand how low-level posture control serves an overall linear visual speed control strategy, we visually induced free-flight acceleration responses in a wind tunnel and measured the body kinematics using high-speed videography. Subsequently, we reverse engineered the transfer function mapping body pitch angle onto flight speed. A linear model is able to reproduce the behavioural data with good accuracy. Our results show that linearity in speed control is realized already at the level of body posture-mediated speed control and is therefore embodied at the level of the complex aerodynamic mechanisms of body and wings. Together with previous results, this study reveals the existence of a linear hierarchical control strategy, which can provide relevant control principles for biomimetic implementations, such as autonomous flying micro air vehicles.

Blowfly flight characteristics are shaped by environmental features and controlled by optic flow information

Blowfly flight consists of two main components, saccadic turns and intervals of mostly straight gaze direction, although, as a consequence of inertia, flight trajectories usually change direction smoothly. We investigated how flight behavior changes depending on the surroundings and how saccadic turns and intersaccadic translational movements might be controlled in arenas of different width with and without obstacles. Blowflies do not fly in straight trajectories, even when traversing straight flight arenas; rather, they fly in meandering trajectories. Flight speed and the amplitude of meanders increase with arena width. Although saccade duration is largely constant, peak angular velocity and succession into either direction are variable and depend on the visual surroundings. Saccade rate and amplitude also vary with arena layout and are correlated with the 'time-to-contact' to the arena wall. We provide evidence that both saccade and velocity control rely to a large extent on the intersaccadic optic flow generated in eye regions looking well in front of the fly, rather than in the lateral visual field, where the optic flow at least during forward flight tends to be strongest.

Figure tracking by flies is supported by parallel visual streams

Visual figures may be distinguished based on elementary motion or higher-order non-Fourier features, and flies track both. The canonical elementary motion detector, a compact computation for Fourier motion direction and amplitude, can also encode higher-order signals provided elaborate preprocessing. However, the way in which a fly tracks a moving figure containing both elementary and higher-order signals has not been investigated. Using a novel white noise approach, we demonstrate that (1) the composite response to an object containing both elementary motion (EM) and uncorrelated higher-order figure motion (FM) reflects the linear superposition of each component; (2) the EM-driven component is velocity-dependent, whereas the FM component is driven by retinal position; (3) retinotopic variation in EM and FM responses are different from one another; (4) the FM subsystem superimposes saccadic turns upon smooth pursuit; and (5) the two systems in combination are necessary and sufficient to predict the full range of figure tracking behaviors, including those that generate no EM cues at all. This analysis requires an extension of the model that fly motion vision is based on simple elementary motion detectors and provides a novel method to characterize the subsystems responsible for the pursuit of visual figures.

Binocular interactions underlying the classic optomotor responses of flying flies

In response to imposed course deviations, the optomotor reactions of animals reduce motion blur and facilitate the maintenance of stable body posture. In flies, many anatomical and electrophysiological studies suggest that disparate motion cues stimulating the left and right eyes are not processed in isolation but rather are integrated in the brain to produce a cohesive panoramic percept. To investigate the strength of such inter-ocular interactions and their role in compensatory sensory–motor transformations, we utilize a virtual reality flight simulator to record wing and head optomotor reactions by tethered flying flies in response to imposed binocular rotation and monocular front-to-back and back-to-front motion. Within a narrow range of stimulus parameters that generates large contrast insensitive optomotor responses to binocular rotation, we find that responses to monocular front-to-back motion are larger than those to panoramic rotation, but are contrast sensitive. Conversely, responses to monocular back-to-front motion are slower than those to rotation and peak at the lowest tested contrast. Together our results suggest that optomotor responses to binocular rotation result from the influence of non-additive contralateral inhibitory as well as excitatory circuit interactions that serve to confer contrast insensitivity to flight behaviors influenced by rotatory optic flow.

Neural specializations for small target detection in insects

Despite being equipped with low-resolution eyes and tiny brains, many insects show exquisite abilities to detect and pursue targets even in highly textured surrounds. Target tracking behavior is subserved by neurons that are sharply tuned to the motion of small high-contrast targets. These neurons respond robustly to target motion, even against self-generated optic flow. A recent model, supported by neurophysiology, generates target selectivity by being sharply tuned to the unique spatiotemporal profile associated with target motion. Target neurons are likely connected in a complex network where some provide more direct output to behavior, whereas others serve an inter-regulatory role. These interactions may regulate attention and aid in the robust detection of targets in clutter observed in behavior.

An olfactory circuit increases the fidelity of visual behavior

Multimodal integration allows neural circuits to be activated in a behaviorally context-specific manner. In the case of odor plume tracking by Drosophila, an attractive odorant increases the influence of yaw-optic flow on steering behavior in flight, which enhances visual stability reflexes, resulting in straighter flight trajectories within an odor plume. However, it is not well understood whether context-specific changes in optomotor behavior are the result of an increased sensitivity to motion inputs (e.g., through increased visual attention) or direct scaling of motor outputs (i.e., increased steering gain). We address this question by examining the optomotor behavior of Drosophila melanogaster in a tethered flight assay and demonstrate that whereas olfactory cues decrease the gain of the optomotor response to sideslip optic flow, they concomitantly increase the gain of the yaw optomotor response by enhancing the animal's ability to follow transient visual perturbations. Furthermore, ablating the mushroom bodies (MBs) of the fly brain via larval hydroxyurea (HU) treatment results in a loss of olfaction-dependent increase in yaw optomotor fidelity. By expressing either tetanus toxin light chain or diphtheria toxin in gal4-defined neural circuits, we were able to replicate the loss of function observed in the HU treatment within the lines expressing broadly in the mushroom bodies, but not within specific mushroom body lobes. Finally, we were able to genetically separate the yaw responses and sideslip responses in our behavioral assay. Together, our results implicate the MBs in a fast-acting, memory-independent olfactory modification of a visual reflex that is critical for flight control.

Defining the computational structure of the motion detector in Drosophila

Many animals rely on visual motion detection for survival. Motion information is extracted from spatiotemporal intensity patterns on the retina, a paradigmatic neural computation. A phenomenological model, the Hassenstein-Reichardt correlator (HRC), relates visual inputs to neural activity and behavioral responses to motion, but the circuits that implement this computation remain unknown. By using cell-type specific genetic silencing, minimal motion stimuli, and in vivo calcium imaging, we examine two critical HRC inputs. These two pathways respond preferentially to light and dark moving edges. We demonstrate that these pathways perform overlapping but complementary subsets of the computations underlying the HRC. A numerical model implementing differential weighting of these operations displays the observed edge preferences. Intriguingly, these pathways are distinguished by their sensitivities to a stimulus correlation that corresponds to an illusory percept, "reverse phi," that affects many species. Thus, this computational architecture may be widely used to achieve edge selectivity in motion detection.

Frequency response of lift control in Drosophila

The flight control responses of the fruitfly represent a powerful model system to explore neuromotor control mechanisms, whose system level control properties can be suitably characterized with a frequency response analysis. We characterized the lift response dynamics of tethered flying Drosophila in presence of vertically oscillating visual patterns, whose oscillation frequency we varied between 0.1 and 13 Hz. We justified these measurements by showing that the amplitude gain and phase response is invariant to the pattern oscillation amplitude and spatial frequency within a broad dynamic range. We also showed that lift responses are largely linear and time invariant (LTI), a necessary condition for a meaningful analysis of frequency responses and a remarkable characteristic given its nonlinear constituents. The flies responded to increasing oscillation frequencies with a roughly linear decrease in response gain, which dropped to background noise levels at about 6 Hz. The phase lag decreased linearly, consistent with a constant reaction delay of 75 ms. Next, we estimated the free-flight response of the fly to generate a Bode diagram of the lift response. The limitation of lift control to frequencies below 6 Hz is explained with inertial body damping, which becomes dominant at higher frequencies. Our work provides the detailed background and techniques that allow optomotor lift responses of Drosophila to be measured with comparatively simple, affordable and commercially available techniques. The identification of an LTI, pattern velocity dependent, lift control strategy is relevant to the underlying motion computation mechanisms and serves a broader understanding of insects' flight control strategies. The relevance and potential pitfalls of applying system identification techniques in tethered preparations is discussed.

Theta motion processing in fruit flies

The tiny brains of insects presumably impose significant computational limitations on algorithms controlling their behavior. Nevertheless, they perform fast and sophisticated visual maneuvers. This includes tracking features composed of second-order motion, in which the feature is defined by higher-order image statistics, but not simple correlations in luminance. Flies can track the true direction of even theta motions, in which the first-order (luminance) motion is directed opposite the second-order moving feature. We exploited this paradoxical feature tracking response to dissect the particular image properties that flies use to track moving objects. We find that theta motion detection is not simply a result of steering toward any spatially restricted flicker. Rather, our results show that fly high-order feature tracking responses can be broken down into positional and velocity components – in other words, the responses can be modeled as a superposition of two independent steering efforts. We isolate these elements to show that each has differing influence on phase and amplitude of steering responses, and together they explain the time course of second-order motion tracking responses during flight. These observations are relevant to natural scenes, where moving features can be much more complex.

Behavioural system identification of visual flight speed control in Drosophila melanogaster

Behavioural control in many animals involves complex mechanisms with intricate sensory-motor feedback loops. Modelling allows functional aspects to be captured without relying on a description of the underlying complex, and often unknown, mechanisms. A wide range of engineering techniques are available for modelling, but their ability to describe time-continuous processes is rarely exploited to describe sensory-motor control mechanisms in biological systems. We performed a system identification of visual flight speed control in the fruitfly Drosophila, based on an extensive dataset of open-loop responses previously measured under free flight conditions. We identified a second-order under-damped control model with just six free parameters that well describes both the transient and steady-state characteristics of the open-loop data. We then used the identified control model to predict flight speed responses after a visual perturbation under closed-loop conditions and validated the model with behavioural measurements performed in free-flying flies under the same closed-loop conditions. Our system identification of the fruitfly's flight speed response uncovers the high-level control strategy of a fundamental flight control reflex without depending on assumptions about the underlying physiological mechanisms. The results are relevant for future investigations of the underlying neuromotor processing mechanisms, as well as for the design of biomimetic robots, such as micro-air vehicles.