Suppression of motion vision during course-changing, but not course-stabilizing, navigational turns

An open platform for visual stimulation of insects

To study how the nervous system processes visual information, experimenters must record neural activity while delivering visual stimuli in a controlled fashion. In animals with a nearly panoramic field of view, such as flies, precise stimulation of the entire visual field is challenging. We describe a projector-based device for stimulation of the insect visual system under a microscope. The device is based on a bowl-shaped screen that provides a wide and nearly distortion-free field of view. It is compact, cheap, easy to assemble, and easy to operate using the included open-source software for stimulus generation. We validate the virtual reality system technically and demonstrate its capabilities in a series of experiments at two levels: the cellular, by measuring the membrane potential responses of visual interneurons; and the organismal, by recording optomotor and fixation behavior of Drosophila melanogaster in tethered flight. Our experiments reveal the importance of stimulating the visual system of an insect with a wide field of view, and we provide a simple solution to do so.

Organization of an ascending circuit that conveys flight motor state in Drosophila

Natural behaviors are a coordinated symphony of motor acts that drive reafferent (self-induced) sensory activation. Individual sensors cannot disambiguate exafferent (externally induced) from reafferent sources. Nevertheless, animals readily differentiate between these sources of sensory signals to carry out adaptive behaviors through corollary discharge circuits (CDCs), which provide predictive motor signals from motor pathways to sensory processing and other motor pathways. Yet, how CDCs comprehensively integrate into the nervous system remains unexplored. Here, we use connectomics, neuroanatomical, physiological, and behavioral approaches to resolve the network architecture of two pairs of ascending histaminergic neurons (AHNs) in Drosophila, which function as a predictive CDC in other insects. Both AHN pairs receive input primarily from a partially overlapping population of descending neurons, especially from DNg02, which controls wing motor output. Using Ca2+ imaging and behavioral recordings, we show that AHN activation is correlated to flight behavior and precedes wing motion. Optogenetic activation of DNg02 is sufficient to activate AHNs, indicating that AHNs are activated by descending commands in advance of behavior and not as a consequence of sensory input. Downstream, each AHN pair targets predominantly non-overlapping networks, including those that process visual, auditory, and mechanosensory information, as well as networks controlling wing, haltere, and leg sensorimotor control. These results support the conclusion that the AHNs provide a predictive motor signal about wing motor state to mostly non-overlapping sensory and motor networks. Future work will determine how AHN signaling is driven by other descending neurons and interpreted by AHN downstream targets to maintain adaptive sensorimotor performance.

Model organisms and systems in neuroethology: one hundred years of history and a look into the future

The Journal of Comparative Physiology lived up to its name in the last 100 years by including more than 1500 different taxa in almost 10,000 publications. Seventeen phyla of the animal kingdom were represented. The honeybee (Apis mellifera) is the taxon with most publications, followed by locust (Locusta migratoria), crayfishes (Cambarus spp.), and fruitfly (Drosophila melanogaster). The representation of species in this journal in the past, thus, differs much from the 13 model systems as named by the National Institutes of Health (USA). We mention major accomplishments of research on species with specific adaptations, specialist animals, for example, the quantitative description of the processes underlying the axon potential in squid (Loligo forbesii) and the isolation of the first receptor channel in the electric eel (Electrophorus electricus) and electric ray (Torpedo spp.). Future neuroethological work should make the recent genetic and technological developments available for specialist animals. There are many research questions left that may be answered with high yield in specialists and some questions that can only be answered in specialists. Moreover, the adaptations of animals that occupy specific ecological niches often lend themselves to biomimetic applications. We go into some depth in explaining our thoughts in the research of motion vision in insects, sound localization in barn owls, and electroreception in weakly electric fish.

Wind Gates Search States in Free Flight

For any organism tracking a chemical cue to its source, the motion of its surrounding fluid provides crucial information for success. For both swimming and flying animals engaged in olfaction driven search, turning into the direction of oncoming wind or water current is often a critical first step 1, 2 . However, in nature, wind and water currents may not always provide a reliable directional cue 3, 4, 5 . It is unclear how organisms adjust their search strategies accordingly due to the challenges of separately controlling flow and chemical encounters. Here, we use the genetic toolkit of Drosophila melanogaster , a model organism for olfaction 6 , to develop an optogenetic paradigm to deliver temporally precise "virtual" olfactory experiences in free-flying animals while independently manipulating the wind conditions. We show that in free flight, Drosophila melanogaster adopt distinct search routines that are gated by whether they are flying in laminar wind or in still air. We first confirm that in laminar wind flies turn upwind, and further, we show that they achieve this using a rapid turn. In still air, flies adopt remarkably stereotyped "sink and circle" search state characterized by ∼60°turns at 3-4 Hz, biased in a consistent direction. In both laminar wind and still air, immediately after odor onset, flies decelerate and often perform a rapid turn. Both maneuvers are consistent with predictions from recent control theoretic analyses for how insects may estimate properties of wind while in flight 7, 8 . We suggest that flies may use their deceleration and "anemometric" turn as active sensing maneuvers to rapidly gauge properties of their wind environment before initiating a proximal or upwind search routine.

Drosophila flying in augmented reality reveals the vision-based control autonomy of the optomotor response

For walking, swimming, and flying animals, the optomotor response is essential to stabilize gaze. How flexible is the optomotor response? Classic work in Drosophila has argued that flies adapt flight control under augmented visual feedback conditions during goal-directed bar fixation. However, whether the lower-level, reflexive optomotor response can similarly adapt to augmented visual feedback (partially autonomous) or not (autonomous) over long timescales is poorly understood. To address this question, we developed an augmented reality paradigm to study the vision-based control autonomy of the yaw optomotor response of flying fruit flies (Drosophila). Flies were placed in a flight simulator, which permitted free body rotation about the yaw axis. By feeding back body movements in real time to a visual display, we augmented and inverted visual feedback. Thus, this experimental paradigm caused a constant visual error between expected and actual visual feedback to study potential adaptive visuomotor control. By combining experiments with control theory, we demonstrate that the optomotor response is autonomous during augmented reality flight bouts of up to 30 min, which exceeds the reported learning epoch during bar fixation. Agreement between predictions from linear systems theory and experimental data supports the notion that the optomotor response is approximately linear and time invariant within our experimental assay. Even under positive visual feedback, which revealed the stability limit of flies in augmented reality, the optomotor response was autonomous. Our results support a hierarchical motor control architecture in flies with fast and autonomous reflexes at the bottom and more flexible behavior at higher levels.

A synaptic corollary discharge signal suppresses midbrain visual processing during saccade-like locomotion

In motor control, the brain not only sends motor commands to the periphery, but also generates concurrent internal signals known as corollary discharge (CD) that influence sensory information processing around the time of movement. CD signals are important for identifying sensory input arising from self-motion and to compensate for it, but the underlying mechanisms remain unclear. Using whole-cell patch clamp recordings from neurons in the zebrafish optic tectum, we discovered an inhibitory synaptic signal, temporally locked to spontaneous and visually driven locomotion. This motor-related inhibition was appropriately timed to counteract visually driven excitatory input arising from the fish's own motion, and transiently suppressed tectal spiking activity. High-resolution calcium imaging revealed localized motor-related signals in the tectal neuropil and the upstream torus longitudinalis, suggesting that CD enters the tectum via this pathway. Together, our results show how visual processing is suppressed during self-motion by motor-related phasic inhibition. This may help explain perceptual saccadic suppression observed in many species.

Neural mechanisms to incorporate visual counterevidence in self-movement estimation

In selecting appropriate behaviors, animals should weigh sensory evidence both for and against specific beliefs about the world. For instance, animals measure optic flow to estimate and control their own rotation. However, existing models of flow detection can be spuriously triggered by visual motion created by objects moving in the world. Here, we show that stationary patterns on the retina, which constitute evidence against observer rotation, suppress inappropriate stabilizing rotational behavior in the fruit fly Drosophila. In silico experiments show that artificial neural networks (ANNs) that are optimized to distinguish observer movement from external object motion similarly detect stationarity and incorporate negative evidence. Employing neural measurements and genetic manipulations, we identified components of the circuitry for stationary pattern detection, which runs parallel to the fly's local motion and optic-flow detectors. Our results show how the fly brain incorporates negative evidence to improve heading stability, exemplifying how a compact brain exploits geometrical constraints of the visual world.

Neural mechanisms to incorporate visual counterevidence in self motion estimation

In selecting appropriate behaviors, animals should weigh sensory evidence both for and against specific beliefs about the world. For instance, animals measure optic flow to estimate and control their own rotation. However, existing models of flow detection can confuse the movement of external objects with genuine self motion. Here, we show that stationary patterns on the retina, which constitute negative evidence against self rotation, are used by the fruit fly Drosophila to suppress inappropriate stabilizing rotational behavior. In silico experiments show that artificial neural networks optimized to distinguish self and world motion similarly detect stationarity and incorporate negative evidence. Employing neural measurements and genetic manipulations, we identified components of the circuitry for stationary pattern detection, which runs parallel to the fly's motion- and optic flow-detectors. Our results exemplify how the compact brain of the fly incorporates negative evidence to improve heading stability, exploiting geometrical constraints of the visual world.

The self as part of the sensory ecology: how behavior affects sensation from the inside out

Insects exhibit remarkable sensory and motor capabilities to successfully navigate their environment. As insects move, they activate sensory afferents. Hence, insects are inextricably part of their sensory ecology. Insects must correctly attribute self- versus external sources of sensory activation to make adaptive behavioral choices. This is achieved via corollary discharge circuits (CDCs), motor-to-sensory neuronal pathways providing predictive motor signals to sensory networks to coordinate sensory processing within the context of ongoing behavior. While CDCs provide predictive motor signals, their underlying mechanisms of action and functional consequences are diverse. Here, we describe inferred CDCs and identified corollary discharge interneurons (CDIs) in insects, highlighting their anatomical commonalities and our limited understanding of their synaptic integration into the nervous system. By using connectomics information, we demonstrate that the complexity with which identified CDIs integrate into the central nervous system (CNS) can be revealed.

Visual processing in the fly, from photoreceptors to behavior

Originally a genetic model organism, the experimental use of Drosophila melanogaster has grown to include quantitative behavioral analyses, sophisticated perturbations of neuronal function, and detailed sensory physiology. A highlight of these developments can be seen in the context of vision, where pioneering studies have uncovered fundamental and generalizable principles of sensory processing. Here we begin with an overview of vision-guided behaviors and common methods for probing visual circuits. We then outline the anatomy and physiology of brain regions involved in visual processing, beginning at the sensory periphery and ending with descending motor control. Areas of focus include contrast and motion detection in the optic lobe, circuits for visual feature selectivity, computations in support of spatial navigation, and contextual associative learning. Finally, we look to the future of fly visual neuroscience and discuss promising topics for further study.

A deep learning analysis of Drosophila body kinematics during magnetically tethered flight

Flying Drosophila rely on their vision to detect visual objects and adjust their flight course. Despite their robust fixation on a dark, vertical bar, our understanding of the underlying visuomotor neural circuits remains limited, in part due to difficulties in analyzing detailed body kinematics in a sensitive behavioral assay. In this study, we observed the body kinematics of flying Drosophila using a magnetically tethered flight assay, in which flies are free to rotate around their yaw axis, enabling naturalistic visual and proprioceptive feedback. Additionally, we used deep learning-based video analyses to characterize the kinematics of multiple body parts in flying animals. By applying this pipeline of behavioral experiments and analyses, we characterized the detailed body kinematics during rapid flight turns (or saccades) in two different visual conditions: spontaneous flight saccades under static screen and bar-fixating saccades while tracking a rotating bar. We found that both types of saccades involved movements of multiple body parts and that the overall dynamics were comparable. Our study highlights the importance of sensitive behavioral assays and analysis tools for characterizing complex visual behaviors.

Visual and motor signatures of locomotion dynamically shape a population code for feature detection in Drosophila

Natural vision is dynamic: as an animal moves, its visual input changes dramatically. How can the visual system reliably extract local features from an input dominated by self-generated signals? In Drosophila, diverse local visual features are represented by a group of projection neurons with distinct tuning properties. Here, we describe a connectome-based volumetric imaging strategy to measure visually evoked neural activity across this population. We show that local visual features are jointly represented across the population, and a shared gain factor improves trial-to-trial coding fidelity. A subset of these neurons, tuned to small objects, is modulated by two independent signals associated with self-movement, a motor-related signal, and a visual motion signal associated with rotation of the animal. These two inputs adjust the sensitivity of these feature detectors across the locomotor cycle, selectively reducing their gain during saccades and restoring it during intersaccadic intervals. This work reveals a strategy for reliable feature detection during locomotion.

Impact of walking speed and motion adaptation on optokinetic nystagmus-like head movements in the blowfly Calliphora

The optokinetic nystagmus is a gaze-stabilizing mechanism reducing motion blur by rapid eye rotations against the direction of visual motion, followed by slower syndirectional eye movements minimizing retinal slip speed. Flies control their gaze through head turns controlled by neck motor neurons receiving input directly, or via descending neurons, from well-characterized directional-selective interneurons sensitive to visual wide-field motion. Locomotion increases the gain and speed sensitivity of these interneurons, while visual motion adaptation in walking animals has the opposite effects. To find out whether flies perform an optokinetic nystagmus, and how it may be affected by locomotion and visual motion adaptation, we recorded head movements of blowflies on a trackball stimulated by progressive and rotational visual motion. Flies flexibly responded to rotational stimuli with optokinetic nystagmus-like head movements, independent of their locomotor state. The temporal frequency tuning of these movements, though matching that of the upstream directional-selective interneurons, was only mildly modulated by walking speed or visual motion adaptation. Our results suggest flies flexibly control their gaze to compensate for rotational wide-field motion by a mechanism similar to an optokinetic nystagmus. Surprisingly, the mechanism is less state-dependent than the response properties of directional-selective interneurons providing input to the neck motor system.

Walking strides direct rapid and flexible recruitment of visual circuits for course control in Drosophila

Flexible mapping between activity in sensory systems and movement parameters is a hallmark of motor control. This flexibility depends on the continuous comparison of short-term postural dynamics and the longer-term goals of an animal, thereby necessitating neural mechanisms that can operate across multiple timescales. To understand how such body-brain interactions emerge across timescales to control movement, we performed whole-cell patch recordings from visual neurons involved in course control in Drosophila. We show that the activity of leg mechanosensory cells, propagating via specific ascending neurons, is critical for stride-by-stride steering adjustments driven by the visual circuit, and, at longer timescales, it provides information about the moving body’s state to flexibly recruit the visual circuit for course control. Thus, our findings demonstrate the presence of an elegant stride-based mechanism operating at multiple timescales for context-dependent course control. We propose that this mechanism functions as a general basis for the adaptive control of locomotion.

•

HS cells receive stride-coupled signals via ascending neurons

•

The stride-coupled signals reflect an internal motor context

•

Motor context modulates HS cells at multiple timescales

•

HS cells drive rapid steering depending on motor context

From Photons to Behaviors: Neural Implementations of Visual Behaviors in Drosophila

Neural implementations of visual behaviors in Drosophila have been dissected intensively in the past couple of decades. The availability of premiere genetic toolkits, behavioral assays in tethered or freely moving conditions, and advances in connectomics have permitted the understanding of the physiological and anatomical details of the nervous system underlying complex visual behaviors. In this review, we describe recent advances on how various features of a visual scene are detected by the Drosophila visual system and how the neural circuits process these signals and elicit an appropriate behavioral response. Special emphasis was laid on the neural circuits that detect visual features such as brightness, color, local motion, optic flow, and translating or approaching visual objects, which would be important for behaviors such as phototaxis, optomotor response, attraction (or aversion) to moving objects, navigation, and visual learning. This review offers an integrative framework for how the fly brain detects visual features and orchestrates an appropriate behavioral response.

The impulse response of optic flow-sensitive descending neurons to roll m-sequences

When animals move through the world, their own movements generate widefield optic flow across their eyes. In insects, such widefield motion is encoded by optic lobe neurons. These lobula plate tangential cells (LPTCs) synapse with optic flow-sensitive descending neurons, which in turn project to areas that control neck, wing and leg movements. As the descending neurons play a role in sensorimotor transformation, it is important to understand their spatio-temporal response properties. Recent work shows that a relatively fast and efficient way to quantify such response properties is to use m-sequences or other white noise techniques. Therefore, here we used m-sequences to quantify the impulse responses of optic flow-sensitive descending neurons in male Eristalis tenax hoverflies. We focused on roll impulse responses as hoverflies perform exquisite head roll stabilizing reflexes, and the descending neurons respond particularly well to roll. We found that the roll impulse responses were fast, peaking after 16.5–18.0 ms. This is similar to the impulse response time to peak (18.3 ms) to widefield horizontal motion recorded in hoverfly LPTCs. We found that the roll impulse response amplitude scaled with the size of the stimulus impulse, and that its shape could be affected by the addition of constant velocity roll or lift. For example, the roll impulse response became faster and stronger with the addition of excitatory stimuli, and vice versa. We also found that the roll impulse response had a long return to baseline, which was significantly and substantially reduced by the addition of either roll or lift.

Summary: The impulse response of hoverfly optic flow-sensitive descending neurons to roll m-sequences reaches its time to peak within 20 ms and slowly returns to baseline over the next 100 ms.

Efference copies: Context matters when ignoring self-induced motion

Across the animal kingdom, efference copies of neuronal motor commands are used to ensure our senses ignore stimuli generated by our own actions. New work shows that the underlying motivation for an action affects whether visual neurons are responsive to self-generated stimuli.