Estimation of self-motion by optic flow processing in single visual interneurons

Bilateral interactions of optic-flow sensitive neurons coordinate course control in flies

Animals rely on compensatory actions to maintain stability and navigate their environment efficiently. These actions depend on global visual motion cues known as optic-flow. While the optomotor response has been the traditional focus for studying optic-flow compensation in insects, its simplicity has been insufficient to determine the role of the intricate optic-flow processing network involved in visual course control. Here, we reveal a series of course control behaviours in Drosophila and link them to specific neural circuits. We show that bilateral electrical coupling of optic-flow-sensitive neurons in the fly's lobula plate are required for a proper course control. This electrical interaction works alongside chemical synapses within the HS-H2 network to control the dynamics and direction of turning behaviours. Our findings reveal how insects use bilateral motion cues for navigation, assigning a new functional significance to the HS-H2 network and suggesting a previously unknown role for gap junctions in non-linear operations.

Moving object detection based on bioinspired background subtraction

Flying insects rely mainly upon visual motion to detect and track objects. There has been a lot of research on fly inspired algorithms for object detection, but few have been developed based on visual motion alone. One of the daunting difficulties is that the neural and circuit mechanisms underlying the foreground-background segmentation are still unclear. Our previous modeling study proposed that the lobula held parallel pathways with distinct directional selectivity, each of which could retinotopically discriminate figures moving in its own preferred direction based on relative motion cues. The previous model, however, did not address how the multiple parallel pathways gave the only detection output at their common downstream. Since the preferred directions of the pathways along either horizontal or vertical axis were opposite to each other, the background moving in the opposite direction to an object also activated the corresponding lobula pathway. Indiscriminate or ungated projection from all the pathways to their downstream would mix objects with the moving background, making the previous model fail with non-stationary background. Here, we extend the previous model by proposing that the background motion-dependent gating of individual lobula projections is the key to object detection. Large-field lobula plate tangential cells are hypothesized to perform the gating to realize bioinspired background subtraction. The model is shown to be capable of implementing a robust detection of moving objects in video sequences with either a moving camera that induces translational optic flow or a static camera. The model sheds light on the potential of the concise fly algorithm in real-world applications.

Motor neurons generate pose-targeted movements via proprioceptive sculpting

Motor neurons are the final common pathway1 through which the brain controls movement of the body, forming the basic elements from which all movement is composed. Yet how a single motor neuron contributes to control during natural movement remains unclear. Here we anatomically and functionally characterize the individual roles of the motor neurons that control head movement in the fly, Drosophila melanogaster. Counterintuitively, we find that activity in a single motor neuron rotates the head in different directions, depending on the starting posture of the head, such that the head converges towards a pose determined by the identity of the stimulated motor neuron. A feedback model predicts that this convergent behaviour results from motor neuron drive interacting with proprioceptive feedback. We identify and genetically2 suppress a single class of proprioceptive neuron3 that changes the motor neuron-induced convergence as predicted by the feedback model. These data suggest a framework for how the brain controls movements: instead of directly generating movement in a given direction by activating a fixed set of motor neurons, the brain controls movements by adding bias to a continuing proprioceptive-motor loop.

Model organisms and systems in neuroethology: one hundred years of history and a look into the future

The Journal of Comparative Physiology lived up to its name in the last 100 years by including more than 1500 different taxa in almost 10,000 publications. Seventeen phyla of the animal kingdom were represented. The honeybee (Apis mellifera) is the taxon with most publications, followed by locust (Locusta migratoria), crayfishes (Cambarus spp.), and fruitfly (Drosophila melanogaster). The representation of species in this journal in the past, thus, differs much from the 13 model systems as named by the National Institutes of Health (USA). We mention major accomplishments of research on species with specific adaptations, specialist animals, for example, the quantitative description of the processes underlying the axon potential in squid (Loligo forbesii) and the isolation of the first receptor channel in the electric eel (Electrophorus electricus) and electric ray (Torpedo spp.). Future neuroethological work should make the recent genetic and technological developments available for specialist animals. There are many research questions left that may be answered with high yield in specialists and some questions that can only be answered in specialists. Moreover, the adaptations of animals that occupy specific ecological niches often lend themselves to biomimetic applications. We go into some depth in explaining our thoughts in the research of motion vision in insects, sound localization in barn owls, and electroreception in weakly electric fish.

The role of vision in sensory integration models for predicting motion perception and sickness

Users of automated vehicles will engage in other activities and take their eyes off the road, making them prone to motion sickness. To resolve this, the current paper validates models predicting sickness in response to motion and visual conditions. We validate published models of vestibular and visual sensory integration that have been used for predicting motion sickness through sensory conflict. We use naturalistic driving data and laboratory motion (and vection) paradigms, such as sinusoidal translation and rotation at different frequencies, Earth-Vertical Axis Rotation, Off-Vertical Axis Rotation, Centrifugation, Somatogravic Illusion, and Pseudo-Coriolis, to evaluate different models for both motion perception and motion sickness. We investigate the effects of visual motion perception in terms of rotational velocity (visual flow) and verticality. According to our findings, the SVCI model, a 6DOF model based on the Subjective Vertical Conflict (SVC) theory, with visual rotational velocity input is effective at estimating motion sickness. However, it does not correctly replicate motion perception in paradigms such as roll-tilt perception during centrifuge, pitch perception during somatogravic illusion, and pitch perception during pseudo-Coriolis motions. On the other hand, the Multi-Sensory Observer Model (MSOM) accurately models motion perception in all considered paradigms, but does not effectively capture the frequency sensitivity of motion sickness, and the effects of vision on sickness. For both models (SVCI and MSOM), the visual perception of rotational velocity strongly affects sickness and perception. Visual verticality perception does not (yet) contribute to sickness prediction, and contributes to perception prediction only for the somatogravic illusion. In conclusion, the SVCI model with visual rotation velocity feedback is the current preferred option to design vehicle control algorithms for motion sickness reduction, while the MSOM best predicts perception. A unified model that jointly captures perception and motion sickness remains to be developed.

Neural mechanisms to incorporate visual counterevidence in self-movement estimation

In selecting appropriate behaviors, animals should weigh sensory evidence both for and against specific beliefs about the world. For instance, animals measure optic flow to estimate and control their own rotation. However, existing models of flow detection can be spuriously triggered by visual motion created by objects moving in the world. Here, we show that stationary patterns on the retina, which constitute evidence against observer rotation, suppress inappropriate stabilizing rotational behavior in the fruit fly Drosophila. In silico experiments show that artificial neural networks (ANNs) that are optimized to distinguish observer movement from external object motion similarly detect stationarity and incorporate negative evidence. Employing neural measurements and genetic manipulations, we identified components of the circuitry for stationary pattern detection, which runs parallel to the fly's local motion and optic-flow detectors. Our results show how the fly brain incorporates negative evidence to improve heading stability, exemplifying how a compact brain exploits geometrical constraints of the visual world.

Multilevel visual motion opponency in Drosophila

Inhibitory interactions between opponent neuronal pathways constitute a common circuit motif across brain areas and species. However, in most cases, synaptic wiring and biophysical, cellular and network mechanisms generating opponency are unknown. Here, we combine optogenetics, voltage and calcium imaging, connectomics, electrophysiology and modeling to reveal multilevel opponent inhibition in the fly visual system. We uncover a circuit architecture in which a single cell type implements direction-selective, motion-opponent inhibition at all three network levels. This inhibition, mediated by GluClα receptors, is balanced with excitation in strength, despite tenfold fewer synapses. The different opponent network levels constitute a nested, hierarchical structure operating at increasing spatiotemporal scales. Electrophysiology and modeling suggest that distributing this computation over consecutive network levels counteracts a reduction in gain, which would result from integrating large opposing conductances at a single instance. We propose that this neural architecture provides resilience to noise while enabling high selectivity for relevant sensory information.

Direct comparison reveals algorithmic similarities in fly and mouse visual motion detection

Evolution has equipped vertebrates and invertebrates with neural circuits that selectively encode visual motion. While similarities in the computations performed by these circuits in mouse and fruit fly have been noted, direct experimental comparisons have been lacking. Because molecular mechanisms and neuronal morphology in the two species are distinct, we directly compared motion encoding in these two species at the algorithmic level, using matched stimuli and focusing on a pair of analogous neurons, the mouse ON starburst amacrine cell (ON SAC) and Drosophila T4 neurons. We find that the cells share similar spatiotemporal receptive field structures, sensitivity to spatiotemporal correlations, and tuning to sinusoidal drifting gratings, but differ in their responses to apparent motion stimuli. Both neuron types showed a response to summed sinusoids that deviates from models for motion processing in these cells, underscoring the similarities in their processing and identifying response features that remain to be explained.

A comprehensive neuroanatomical survey of the Drosophila Lobula Plate Tangential Neurons with predictions for their optic flow sensitivity

Flying insects exhibit remarkable navigational abilities controlled by their compact nervous systems. Optic flow, the pattern of changes in the visual scene induced by locomotion, is a crucial sensory cue for robust self-motion estimation, especially during rapid flight. Neurons that respond to specific, large-field optic flow patterns have been studied for decades, primarily in large flies, such as houseflies, blowflies, and hover flies. The best-known optic-flow sensitive neurons are the large tangential cells of the dipteran lobula plate, whose visual-motion responses, and to a lesser extent, their morphology, have been explored using single-neuron neurophysiology. Most of these studies have focused on the large, Horizontal and Vertical System neurons, yet the lobula plate houses a much larger set of 'optic-flow' sensitive neurons, many of which have been challenging to unambiguously identify or to reliably target for functional studies. Here we report the comprehensive reconstruction and identification of the Lobula Plate Tangential Neurons in an Electron Microscopy (EM) volume of a whole Drosophila brain. This catalog of 58 LPT neurons (per brain hemisphere) contains many neurons that are described here for the first time and provides a basis for systematic investigation of the circuitry linking self-motion to locomotion control. Leveraging computational anatomy methods, we estimated the visual motion receptive fields of these neurons and compared their tuning to the visual consequence of body rotations and translational movements. We also matched these neurons, in most cases on a one-for-one basis, to stochastically labeled cells in genetic driver lines, to the mirror-symmetric neurons in the same EM brain volume, and to neurons in an additional EM data set. Using cell matches across data sets, we analyzed the integration of optic flow patterns by neurons downstream of the LPTs and find that most central brain neurons establish sharper selectivity for global optic flow patterns than their input neurons. Furthermore, we found that self-motion information extracted from optic flow is processed in distinct regions of the central brain, pointing to diverse foci for the generation of visual behaviors.

Long-timescale anti-directional rotation in Drosophila optomotor behavior

Locomotor movements cause visual images to be displaced across the eye, a retinal slip that is counteracted by stabilizing reflexes in many animals. In insects, optomotor turning causes the animal to turn in the direction of rotating visual stimuli, thereby reducing retinal slip and stabilizing trajectories through the world. This behavior has formed the basis for extensive dissections of motion vision. Here, we report that under certain stimulus conditions, two Drosophila species, including the widely studied Drosophila melanogaster, can suppress and even reverse the optomotor turning response over several seconds. Such 'anti-directional turning' is most strongly evoked by long-lasting, high-contrast, slow-moving visual stimuli that are distinct from those that promote syn-directional optomotor turning. Anti-directional turning, like the syn-directional optomotor response, requires the local motion detecting neurons T4 and T5. A subset of lobula plate tangential cells, CH cells, show involvement in these responses. Imaging from a variety of direction-selective cells in the lobula plate shows no evidence of dynamics that match the behavior, suggesting that the observed inversion in turning direction emerges downstream of the lobula plate. Further, anti-directional turning declines with age and exposure to light. These results show that Drosophila optomotor turning behaviors contain rich, stimulus-dependent dynamics that are inconsistent with simple reflexive stabilization responses.

A look into feedback neural computation upon collision selectivity

Physiological studies have shown that a group of locust's lobula giant movement detectors (LGMDs) has a diversity of collision selectivity to approaching objects, relatively darker or brighter than their backgrounds in cluttered environments. Such diversity of collision selectivity can serve locusts to escape from attack by natural enemies, and migrate in swarm free of collision. For computational studies, endeavours have been made to realize the diverse selectivity which, however, is still one of the most challenging tasks especially in complex and dynamic real world scenarios. The existing models are mainly formulated as multi-layered neural networks with merely feed-forward information processing, and do not take into account the effect of re-entrant signals in feedback loop, which is an essential regulatory loop for motion perception, yet never been explored in looming perception. In this paper, we inaugurate feedback neural computation for constructing a new LGMD-based model, named F-LGMD to look into the efficacy upon implementing different collision selectivity. Accordingly, the proposed neural network model features both feed-forward processing and feedback loop. The feedback control propagates output signals of parallel ON/OFF channels back into their starting neurons, thus makes part of the feed-forward neural network, i.e. the ON/OFF channels and the feedback loop form an iterative cycle system. Moreover, the feedback control is instantaneous, which leads to the existence of a fixed point whereby the fixed point theorem is applied to rigorously derive valid range of feedback coefficients. To verify the effectiveness of the proposed method, we conduct systematic experiments covering synthetic and natural collision datasets, and also online robotic tests. The experimental results show that the F-LGMD, with a unified network, can fulfil the diverse collision selectivity revealed in physiology, which not only reduces considerably the handcrafted parameters compared to previous studies, but also offers a both efficient and robust scheme for collision perception through feedback neural computation.

Circuits for self-motion estimation and walking control in Drosophila

The brain's evolution and operation are inextricably linked to animal movement, and critical functions, such as motor control, spatial perception, and navigation, rely on precise knowledge of body movement. Such internal estimates of self-motion emerge from the integration of mechanosensory and visual feedback with motor-related signals. Thus, this internal representation likely depends on the activity of circuits distributed across the central nervous system. However, the circuits responsible for self-motion estimation, and the exact mechanisms by which motor-sensory coordination occurs within these circuits remain poorly understood. Recent technological advances have positioned Drosophila melanogaster as an advantageous model for investigating the emergence, maintenance, and utilization of self-motion representations during naturalistic walking behaviors. In this review, I will illustrate how the adult fly is providing insights into the fundamental problems of self-motion computations and walking control, which have relevance for all animals.

Neural mechanisms to incorporate visual counterevidence in self motion estimation

In selecting appropriate behaviors, animals should weigh sensory evidence both for and against specific beliefs about the world. For instance, animals measure optic flow to estimate and control their own rotation. However, existing models of flow detection can confuse the movement of external objects with genuine self motion. Here, we show that stationary patterns on the retina, which constitute negative evidence against self rotation, are used by the fruit fly Drosophila to suppress inappropriate stabilizing rotational behavior. In silico experiments show that artificial neural networks optimized to distinguish self and world motion similarly detect stationarity and incorporate negative evidence. Employing neural measurements and genetic manipulations, we identified components of the circuitry for stationary pattern detection, which runs parallel to the fly's motion- and optic flow-detectors. Our results exemplify how the compact brain of the fly incorporates negative evidence to improve heading stability, exploiting geometrical constraints of the visual world.

How Flies See Motion

How neurons detect the direction of motion is a prime example of neural computation: Motion vision is found in the visual systems of virtually all sighted animals, it is important for survival, and it requires interesting computations with well-defined linear and nonlinear processing steps-yet the whole process is of moderate complexity. The genetic methods available in the fruit fly Drosophila and the charting of a connectome of its visual system have led to rapid progress and unprecedented detail in our understanding of how neurons compute the direction of motion in this organism. The picture that emerged incorporates not only the identity, morphology, and synaptic connectivity of each neuron involved but also its neurotransmitters, its receptors, and their subcellular localization. Together with the neurons' membrane potential responses to visual stimulation, this information provides the basis for a biophysically realistic model of the circuit that computes the direction of visual motion.

Bioinspired figure-ground discrimination via visual motion smoothing

Flies detect and track moving targets among visual clutter, and this process mainly relies on visual motion. Visual motion is analyzed or computed with the pathway from the retina to T4/T5 cells. The computation of local directional motion was formulated as an elementary movement detector (EMD) model more than half a century ago. Solving target detection or figure-ground discrimination problems can be equivalent to extracting boundaries between a target and the background based on the motion discontinuities in the output of a retinotopic array of EMDs. Individual EMDs cannot measure true velocities, however, due to their sensitivity to pattern properties such as luminance contrast and spatial frequency content. It remains unclear how local directional motion signals are further integrated to enable figure-ground discrimination. Here, we present a computational model inspired by fly motion vision. Simulations suggest that the heavily fluctuating output of an EMD array is naturally surmounted by a lobula network, which is hypothesized to be downstream of the local motion detectors and have parallel pathways with distinct directional selectivity. The lobula network carries out a spatiotemporal smoothing operation for visual motion, especially across time, enabling the segmentation of moving figures from the background. The model qualitatively reproduces experimental observations in the visually evoked response characteristics of one type of lobula columnar (LC) cell. The model is further shown to be robust to natural scene variability. Our results suggest that the lobula is involved in local motion-based target detection.

Long timescale anti-directional rotation in Drosophila optomotor behavior

Locomotor movements cause visual images to be displaced across the eye, a retinal slip that is counteracted by stabilizing reflexes in many animals. In insects, optomotor turning causes the animal to turn in the direction of rotating visual stimuli, thereby reducing retinal slip and stabilizing trajectories through the world. This behavior has formed the basis for extensive dissections of motion vision. Here, we report that under certain stimulus conditions, two Drosophila species, including the widely studied D. melanogaster, can suppress and even reverse the optomotor turning response over several seconds. Such "anti-directional turning" is most strongly evoked by long-lasting, high-contrast, slow-moving visual stimuli that are distinct from those that promote syn-directional optomotor turning. Anti-directional turning, like the syn-directional optomotor response, requires the local motion detecting neurons T4 and T5. A subset of lobula plate tangential cells, CH cells, show involvement in these responses. Imaging from a variety of direction-selective cells in the lobula plate shows no evidence of dynamics that match the behavior, suggesting that the observed inversion in turning direction emerges downstream of the lobula plate. Further, anti-directional turning declines with age and exposure to light. These results show that Drosophila optomotor turning behaviors contain rich, stimulus-dependent dynamics that are inconsistent with simple reflexive stabilization responses.

A monocular wide-field speed sensor inspired by the crabs' visual system for traffic analysis

The development of visual sensors for traffic analysis can benefit from mimicking two fundamental aspects of the visual system of crabs: their panoramic vision and their visual processing strategy adapted to a flat world. First, the use of omnidirectional cameras in urban environments allows for analyzing the simultaneous movement of many objects of interest over broad areas. This would reduce the costs and complications associated with infrastructure: installation, synchronization, maintenance, and operation of traditional vision systems that use multiple cameras with a limited field of view. Second, in urban traffic analysis, the objects of interest (e.g. vehicles and pedestrians) move on the ground surface. This constraint allows the calculation of the 3D trajectory of the vehicles using a single camera without the need to use binocular vision techniques.The main contribution of this work is to show that the strategy used by crabs to visually analyze their habitat (monocular omnidirectional vision with the assumption of a flat world ) is useful for developing a simple and effective method to estimate the speed of vehicles on long trajectories in urban environments. It is shown that the proposed method estimates the speed with a root mean squared error of 2.7 km h^-1.

Optic flow in the natural habitats of zebrafish supports spatial biases in visual self-motion estimation

Animals benefit from knowing if and how they are moving. Across the animal kingdom, sensory information in the form of optic flow over the visual field is used to estimate self-motion. However, different species exhibit strong spatial biases in how they use optic flow. Here, we show computationally that noisy natural environments favor visual systems that extract spatially biased samples of optic flow when estimating self-motion. The performance associated with these biases, however, depends on interactions between the environment and the animal's brain and behavior. Using the larval zebrafish as a model, we recorded natural optic flow associated with swimming trajectories in the animal's habitat with an omnidirectional camera mounted on a mechanical arm. An analysis of these flow fields suggests that lateral regions of the lower visual field are most informative about swimming speed. This pattern is consistent with the recent findings that zebrafish optomotor responses are preferentially driven by optic flow in the lateral lower visual field, which we extend with behavioral results from a high-resolution spherical arena. Spatial biases in optic-flow sampling are likely pervasive because they are an effective strategy for determining self-motion in noisy natural environments.

Matched function of the neuropil processing optic flow in flies and crabs: the lobula plate mediates optomotor responses in Neohelice granulata

When an animal rotates (whether it is an arthropod, a fish, a bird or a human) a drift of the visual panorama occurs over its retina, termed optic flow. The image is stabilized by compensatory behaviours (driven by the movement of the eyes, head or the whole body depending on the animal) collectively termed optomotor responses. The dipteran lobula plate has been consistently linked with optic flow processing and the control of optomotor responses. Crabs have a neuropil similarly located and interconnected in the optic lobes, therefore referred to as a lobula plate too. Here we show that the crabs' lobula plate is required for normal optomotor responses since the response was lost or severely impaired in animals whose lobula plate had been lesioned. The effect was behaviour-specific, since avoidance responses to approaching visual stimuli were not affected. Crabs require simpler optic flow processing than flies (because they move slower and in two-dimensional instead of three-dimensional space), consequently their lobula plates are relatively smaller. Nonetheless, they perform the same essential role in the visual control of behaviour. Our findings add a fundamental piece to the current debate on the evolutionary relationship between the lobula plates of insects and crustaceans.

Neuronal circuits integrating visual motion information in Drosophila melanogaster

The detection of visual motion enables sophisticated animal navigation, and studies on flies have provided profound insights into the cellular and circuit bases of this neural computation. The fly's directionally selective T4 and T5 neurons encode ON and OFF motion, respectively. Their axons terminate in one of the four retinotopic layers in the lobula plate, where each layer encodes one of the four directions of motion. Although the input circuitry of the directionally selective neurons has been studied in detail, the synaptic connectivity of circuits integrating T4/T5 motion signals is largely unknown. Here, we report a 3D electron microscopy reconstruction, wherein we comprehensively identified T4/T5's synaptic partners in the lobula plate, revealing a diverse set of new cell types and attributing new connectivity patterns to the known cell types. Our reconstruction explains how the ON- and OFF-motion pathways converge. T4 and T5 cells that project to the same layer connect to common synaptic partners and comprise a core motif together with bilayer interneurons, detailing the circuit basis for computing motion opponency. We discovered pathways that likely encode new directions of motion by integrating vertical and horizontal motion signals from upstream T4/T5 neurons. Finally, we identify substantial projections into the lobula, extending the known motion pathways and suggesting that directionally selective signals shape feature detection there. The circuits we describe enrich the anatomical basis for experimental and computations analyses of motion vision and bring us closer to understanding complete sensory-motor pathways.

Impact of walking speed and motion adaptation on optokinetic nystagmus-like head movements in the blowfly Calliphora

The optokinetic nystagmus is a gaze-stabilizing mechanism reducing motion blur by rapid eye rotations against the direction of visual motion, followed by slower syndirectional eye movements minimizing retinal slip speed. Flies control their gaze through head turns controlled by neck motor neurons receiving input directly, or via descending neurons, from well-characterized directional-selective interneurons sensitive to visual wide-field motion. Locomotion increases the gain and speed sensitivity of these interneurons, while visual motion adaptation in walking animals has the opposite effects. To find out whether flies perform an optokinetic nystagmus, and how it may be affected by locomotion and visual motion adaptation, we recorded head movements of blowflies on a trackball stimulated by progressive and rotational visual motion. Flies flexibly responded to rotational stimuli with optokinetic nystagmus-like head movements, independent of their locomotor state. The temporal frequency tuning of these movements, though matching that of the upstream directional-selective interneurons, was only mildly modulated by walking speed or visual motion adaptation. Our results suggest flies flexibly control their gaze to compensate for rotational wide-field motion by a mechanism similar to an optokinetic nystagmus. Surprisingly, the mechanism is less state-dependent than the response properties of directional-selective interneurons providing input to the neck motor system.

Estimating curvilinear self-motion from optic flow with a biologically inspired neural system

Optic flow provides rich information about world-relative self-motion and is used by many animals to guide movement. For example, self-motion along linear, straight paths without eye movements, generates optic flow that radiates from a singularity that specifies the direction of travel (heading). Many neural models of optic flow processing contain heading detectors that are tuned to the position of the singularity, the design of which is informed by brain area MSTd of primate visual cortex that has been linked to heading perception. Such biologically inspired models could be useful for efficient self-motion estimation in robots, but existing systems are tailored to the limited scenario of linear self-motion and neglect sensitivity to self-motion along more natural curvilinear paths. The observer in this case experiences more complex motion patterns, the appearance of which depends on the radius of the curved path (path curvature) and the direction of gaze. Indeed, MSTd neurons have been shown to exhibit tuning to optic flow patterns other than radial expansion, a property that is rarely captured in neural models. We investigated in a computational model whether a population of MSTd-like sensors tuned to radial, spiral, ground, and other optic flow patterns could support the accurate estimation of parameters describing both linear and curvilinear self-motion. We used deep learning to decode self-motion parameters from the signals produced by the diverse population of MSTd-like units. We demonstrate that this system is capable of accurately estimating curvilinear path curvature, clockwise/counterclockwise sign, and gaze direction relative to the path tangent in both synthetic and naturalistic videos of simulated self-motion. Estimates remained stable over time while rapidly adapting to dynamic changes in the observer's curvilinear self-motion. Our results show that coupled biologically inspired and artificial neural network systems hold promise as a solution for robust vision-based self-motion estimation in robots.

Motion vision: Course control in the developing visual system

As we move around, the image pattern on our retina is constantly changing. Nervous systems have evolved to detect such global 'optic flow' patterns. A new study reveals how optic flow is encoded in the larval zebrafish brain and could be used for the estimation of self-motion.

A robust receptive field code for optic flow detection and decomposition during self-motion

The perception of optic flow is essential for any visually guided behavior of a moving animal. To mechanistically predict behavior and understand the emergence of self-motion perception in vertebrate brains, it is essential to systematically characterize the motion receptive fields (RFs) of optic-flow-processing neurons. Here, we present the fine-scale RFs of thousands of motion-sensitive neurons studied in the diencephalon and the midbrain of zebrafish. We found neurons that serve as linear filters and robustly encode directional and speed information of translation-induced optic flow. These neurons are topographically arranged in pretectum according to translation direction. The unambiguous encoding of translation enables the decomposition of translational and rotational self-motion information from mixed optic flow. In behavioral experiments, we successfully demonstrated the predicted decomposition in the optokinetic and optomotor responses. Together, our study reveals the algorithm and the neural implementation for self-motion estimation in a vertebrate visual system.

Binocular mirror-symmetric microsaccadic sampling enables Drosophila hyperacute 3D vision

To move efficiently, animals must continuously work out their x,y,z positions with respect to real-world objects, and many animals have a pair of eyes to achieve this. How photoreceptors actively sample the eyes’ optical image disparity is not understood because this fundamental information-limiting step has not been investigated in vivo over the eyes’ whole sampling matrix. This integrative multiscale study will advance our current understanding of stereopsis from static image disparity comparison to a morphodynamic active sampling theory. It shows how photomechanical photoreceptor microsaccades enable Drosophila superresolution three-dimensional vision and proposes neural computations for accurately predicting these flies’ depth-perception dynamics, limits, and visual behaviors.

Neural mechanisms behind stereopsis, which requires simultaneous disparity inputs from two eyes, have remained mysterious. Here we show how ultrafast mirror-symmetric photomechanical contractions in the frontal forward-facing left and right eye photoreceptors give Drosophila superresolution three-dimensional (3D) vision. By interlinking multiscale in vivo assays with multiscale simulations, we reveal how these photoreceptor microsaccades—by verging, diverging, and narrowing the eyes’ overlapping receptive fields—channel depth information, as phasic binocular image motion disparity signals in time. We further show how peripherally, outside stereopsis, microsaccadic sampling tracks a flying fly’s optic flow field to better resolve the world in motion. These results change our understanding of how insect compound eyes work and suggest a general dynamic stereo-information sampling strategy for animals, robots, and sensors.

Avoiding obstacles while intercepting a moving target: a miniature fly's solution

The miniature robber fly Holcocephala fusca intercepts its targets with behaviour that is approximated by the proportional navigation guidance law. During predatory trials, we challenged the interception of H. fusca performance by placing a large object in its potential flight path. In response, H. fusca deviated from the path predicted by pure proportional navigation, but in many cases still eventually contacted the target. We show that such flight deviations can be explained as the output of two competing navigational systems: pure-proportional navigation and a simple obstacle avoidance algorithm. Obstacle avoidance by H. fusca is here described by a simple feedback loop that uses the visual expansion of the approaching obstacle to mediate the magnitude of the turning-away response. We name the integration of this steering law with proportional navigation 'combined guidance'. The results demonstrate that predatory intent does not operate a monopoly on the fly's steering when attacking a target, and that simple guidance combinations can explain obstacle avoidance during interceptive tasks.

Populations of local direction-selective cells encode global motion patterns generated by self-motion

Self-motion generates visual patterns on the eye that are important for navigation. These optic flow patterns are encoded by the population of local direction–selective cells in the mouse retina, whereas in flies, local direction–selective T4/T5 cells are thought to be uniformly tuned. How complex global motion patterns can be computed downstream is unclear. We show that the population of T4/T5 cells in Drosophila encodes global motion patterns. Whereas the mouse retina encodes four types of optic flow, the fly visual system encodes six. This matches the larger number of degrees of freedom and the increased complexity of translational and rotational motion patterns during flight. The four uniformly tuned T4/T5 subtypes described previously represent a local subset of the population. Thus, a population code for global motion patterns appears to be a general coding principle of visual systems that matches local motion responses to modes of the animal’s movement.

Shallow neural networks trained to detect collisions recover features of visual loom-selective neurons

Animals have evolved sophisticated visual circuits to solve a vital inference problem: detecting whether or not a visual signal corresponds to an object on a collision course. Such events are detected by specific circuits sensitive to visual looming, or objects increasing in size. Various computational models have been developed for these circuits, but how the collision-detection inference problem itself shapes the computational structures of these circuits remains unknown. Here, inspired by the distinctive structures of LPLC2 neurons in the visual system of Drosophila, we build anatomically-constrained shallow neural network models and train them to identify visual signals that correspond to impending collisions. Surprisingly, the optimization arrives at two distinct, opposing solutions, only one of which matches the actual dendritic weighting of LPLC2 neurons. Both solutions can solve the inference problem with high accuracy when the population size is large enough. The LPLC2-like solutions reproduces experimentally observed LPLC2 neuron responses for many stimuli, and reproduces canonical tuning of loom sensitive neurons, even though the models are never trained on neural data. Thus, LPLC2 neuron properties and tuning are predicted by optimizing an anatomically-constrained neural network to detect impending collisions. More generally, these results illustrate how optimizing inference tasks that are important for an animal's perceptual goals can reveal and explain computational properties of specific sensory neurons.

How do humans group non-rigid objects in multiple object tracking?: Evidence from grouping by self-rotation

Previous studies on perceptual grouping found that people can use spatiotemporal and featural information to group spatially separated rigid objects into a unit while tracking moving objects. However, few studies have tested the role of objects' self-motion information in perceptual grouping, although it is of great significance to the motion perception in the three-dimensional space. In natural environments, objects always move in translation and rotation at the same time. The self-rotation of the objects seriously destroys objects' rigidity and topology, creates conflicting movement signals and results in crowding effects. Thus, this study sought to examine the specific role played by self-rotation information on grouping spatially separated non-rigid objects through a modified multiple object tracking (MOT) paradigm with self-rotating objects. Experiment 1 found that people could use self-rotation information to group spatially separated non-rigid objects, even though this information was deleterious for attentive tracking and irrelevant to the task requirements, and people seemed to use it strategically rather than automatically. Experiment 2 provided stronger evidence that this grouping advantage did come from the self-rotation per se rather than surface-level cues arising from self-rotation (e.g. similar 2D motion signals and common shapes). Experiment 3 changed the stimuli to more natural 3D cubes to strengthen the impression of self-rotation and again found that self-rotation improved grouping. Finally, Experiment 4 demonstrated that grouping by self-rotation and grouping by changing shape were statistically comparable but additive, suggesting that they were two different sources of the object information. Thus, grouping by self-rotation mainly benefited from the perceptual differences in motion flow fields rather than in deformation. Overall, this study is the first attempt to identify self-motion as a new feature that people can use to group objects in dynamic scenes and shed light on debates about what entities/units we group and what kinds of information about a target we process while tracking objects.

Insect inspired vision-based velocity estimation through spatial pooling of optic flow during linear motion

Insects rely on the perception of image motion, or optic flow, to estimate their velocity relative to nearby objects. This information provides important sensory input for avoiding obstacles. However, certain behaviors, such as estimating the absolute distance to a landing target, accurately measuring absolute distance traveled, and estimating the ambient wind speed require decoupling optic flow into its component parts: absolute ground velocity and distance to nearby objects. Behavioral experiments suggest that insects perform these calculations, but their mechanism for doing so remains unknown. Here we present a novel algorithm that combines the geometry of dynamic forward motion with known features of insect visual processing to provide a hypothesis for how insects mightdirectlyestimate absolute ground velocity from a combination of optic flow and acceleration information. Our robotics-inspired-biology approach reveals three critical requirements. First, absolute ground velocity can only be directly estimated from optic flow during times of active acceleration and deceleration. Second, spatial pooling of optic flow across a receptive field helps to alleviate the effects of noise and/or low resolution visual systems. Third, averaging velocity estimates from multiple receptive fields further helps to reject noise. Our algorithm provides a hypothesis for how insects might estimate absolute velocity from vision during active maneuvers, and also provides a theoretical framework for designing fast analog circuitry for efficient state estimation that can be applied to insect-sized robots.

A unified mechanism for innate and learned visual landmark guidance in the insect central complex

Insects can navigate efficiently in both novel and familiar environments, and this requires flexiblity in how they are guided by sensory cues. A prominent landmark, for example, can elicit strong innate behaviours (attraction or menotaxis) but can also be used, after learning, as a specific directional cue as part of a navigation memory. However, the mechanisms that allow both pathways to co-exist, interact or override each other are largely unknown. Here we propose a model for the behavioural integration of innate and learned guidance based on the neuroanatomy of the central complex (CX), adapted to control landmark guided behaviours. We consider a reward signal provided either by an innate attraction to landmarks or a long-term visual memory in the mushroom bodies (MB) that modulates the formation of a local vector memory in the CX. Using an operant strategy for a simulated agent exploring a simple world containing a single visual cue, we show how the generated short-term memory can support both innate and learned steering behaviour. In addition, we show how this architecture is consistent with the observed effects of unilateral MB lesions in ants that cause a reversion to innate behaviour. We suggest the formation of a directional memory in the CX can be interpreted as transforming rewarding (positive or negative) sensory signals into a mapping of the environment that describes the geometrical attractiveness (or repulsion). We discuss how this scheme might represent an ideal way to combine multisensory information gathered during the exploration of an environment and support optimal cue integration.

Go with the FLOW: visualizing spatiotemporal dynamics in optical widefield calcium imaging

Widefield calcium imaging has recently emerged as a powerful experimental technique to record coordinated large-scale brain activity. These measurements present a unique opportunity to characterize spatiotemporally coherent structures that underlie neural activity across many regions of the brain. In this work, we leverage analytic techniques from fluid dynamics to develop a visualization framework that highlights features of flow across the cortex, mapping wavefronts that may be correlated with behavioural events. First, we transform the time series of widefield calcium images into time-varying vector fields using optic flow. Next, we extract concise diagrams summarizing the dynamics, which we refer to as FLOW (flow lines in optical widefield imaging) portraits. These FLOW portraits provide an intuitive map of dynamic calcium activity, including regions of initiation and termination, as well as the direction and extent of activity spread. To extract these structures, we use the finite-time Lyapunov exponent technique developed to analyse time-varying manifolds in unsteady fluids. Importantly, our approach captures coherent structures that are poorly represented by traditional modal decomposition techniques. We demonstrate the application of FLOW portraits on three simple synthetic datasets and two widefield calcium imaging datasets, including cortical waves in the developing mouse and spontaneous cortical activity in an adult mouse.

Aerial course stabilization is impaired in motion-blind flies

Visual motion detection is among the best understood neuronal computations. As extensively investigated in tethered flies, visual motion signals are assumed to be crucial to detect and counteract involuntary course deviations. During free flight, however, course changes are also signalled by other sensory systems. Therefore, it is as yet unclear to what extent motion vision contributes to course control. To address this question, we genetically rendered flies motion-blind by blocking their primary motion-sensitive neurons and quantified their free-flight performance. We found that such flies have difficulty maintaining a straight flight trajectory, much like unimpaired flies in the dark. By unilateral wing clipping, we generated an asymmetry in propulsive force and tested the ability of flies to compensate for this perturbation. While wild-type flies showed a remarkable level of compensation, motion-blind animals exhibited pronounced circling behaviour. Our results therefore directly confirm that motion vision is necessary to fly straight under realistic conditions.

Maximally efficient prediction in the early fly visual system may support evasive flight maneuvers

The visual system must make predictions to compensate for inherent delays in its processing. Yet little is known, mechanistically, about how prediction aids natural behaviors. Here, we show that despite a 20-30ms intrinsic processing delay, the vertical motion sensitive (VS) network of the blowfly achieves maximally efficient prediction. This prediction enables the fly to fine-tune its complex, yet brief, evasive flight maneuvers according to its initial ego-rotation at the time of detection of the visual threat. Combining a rich database of behavioral recordings with detailed compartmental modeling of the VS network, we further show that the VS network has axonal gap junctions that are critical for optimal prediction. During evasive maneuvers, a VS subpopulation that directly innervates the neck motor center can convey predictive information about the fly’s future ego-rotation, potentially crucial for ongoing flight control. These results suggest a novel sensory-motor pathway that links sensory prediction to behavior.

Survival-critical behaviors shape neural circuits to translate sensory information into strikingly fast predictions, e.g. in escaping from a predator faster than the system’s processing delay. We show that the fly visual system implements fast and accurate prediction of its visual experience. This provides crucial information for directing fast evasive maneuvers that unfold over just 40ms. Our work shows how this fast prediction is implemented, mechanistically, and suggests the existence of a novel sensory-motor pathway from the fly visual system to a wing steering motor neuron. Echoing and amplifying previous work in the retina, our work hypothesizes that the efficient encoding of predictive information is a universal design principle supporting fast, natural behaviors.

Stabilizing responses to sideslip disturbances in Drosophila melanogaster are modulated by the density of moving elements on the ground

Stabilizing responses to sideslip disturbances are a critical part of the flight control system in flies. While strongly mediated by mechanoreception, much of the final response results from the wide-field motion detection system associated with vision. In order to be effective, these responses must match the disturbance they are aimed to correct. To do this, flies must estimate the velocity of the disturbance, although it is not known how they accomplish this task when presented with natural images or dot fields. The recent finding, that motion parallax in dot fields can modulate stabilizing responses only if perceived below the fly, raises the question of whether other image statistics are also processed differently between eye regions. One such parameter is the density of elements moving in translational optic flow. Depending on the habitat, there might be strong differences in the density of elements providing information about self-motion above and below the fly, which in turn could act as selective pressures tuning the visual system to process this parameter on a regional basis. By presenting laterally moving dot fields of different densities we found that, in Drosophila melanogaster, the amplitude of the stabilizing response is significantly affected by the number of elements in the field of view. Flies countersteer strongly within a relatively low and narrow range of element densities. But this effect is exclusive to the ventral region of the eye, and dorsal stimuli elicit an unaltered and stereotypical response regardless of the density of elements in the flow. This highlights local specialization of the eye and suggests the lower region may play a more critical role in translational flight stabilization.

Rheotaxis revisited: a multi-behavioral and multisensory perspective on how fish orient to flow

Here, we review fish rheotaxis (orientation to flow) with the goal of placing it within a larger behavioral and multisensory context. Rheotaxis is a flexible behavior that is used by fish in a variety of circumstances: to search for upstream sources of current-borne odors, to intercept invertebrate drift and, in general, to conserve energy while preventing downstream displacement. Sensory information available for rheotaxis includes water-motion cues to the lateral line and body-motion cues to visual, vestibular or tactile senses when fish are swept downstream. Although rheotaxis can be mediated by a single sense, each sense has its own limitations. For example, lateral line cues are limited by the spatial characteristics of flow, visual cues by water visibility, and vestibular and other body-motion cues by the ability of fish to withstand downstream displacement. The ability of multiple senses to compensate for any single-sense limitation enables rheotaxis to persist over a wide range of sensory and flow conditions. Here, we propose a mechanism of rheotaxis that can be activated in parallel by one or more senses; a major component of this mechanism is directional selectivity of central neurons to broad patterns of water and/or body motions. A review of central mechanisms for vertebrate orienting behaviors and optomotor reflexes reveals several motorsensory integration sites in the CNS that could be involved in rheotaxis. As such, rheotaxis provides an excellent opportunity for understanding the multisensory control of a simple vertebrate behavior and how a simple motor act is integrated with others to form complex behaviors.

Zebra stripes, tabanid biting flies and the aperture effect

Of all hypotheses advanced for why zebras have stripes, avoidance of biting fly attack receives by far the most support, yet the mechanisms by which stripes thwart landings are not yet understood. A logical and popular hypothesis is that stripes interfere with optic flow patterns needed by flying insects to execute controlled landings. This could occur through disrupting the radial symmetry of optic flow via the aperture effect (i.e. generation of false motion cues by straight edges), or through spatio-temporal aliasing (i.e. misregistration of repeated features) of evenly spaced stripes. By recording and reconstructing tabanid fly behaviour around horses wearing differently patterned rugs, we could tease out these hypotheses using realistic target stimuli. We found that flies avoided landing on, flew faster near, and did not approach as close to striped and checked rugs compared to grey. Our observations that flies avoided checked patterns in a similar way to stripes refutes the hypothesis that stripes disrupt optic flow via the aperture effect, which critically demands parallel striped patterns. Our data narrow the menu of fly-equid visual interactions that form the basis for the extraordinary colouration of zebras.

Direction Selective Neurons Responsive to Horizontal Motion in a Crab Reflect an Adaptation to Prevailing Movements in Flat Environments

All animals need information about the direction of motion to be able to track the trajectory of a target (prey, predator, cospecific) or to control the course of navigation. This information is provided by direction selective (DS) neurons, which respond to images moving in a unique direction. DS neurons have been described in numerous species including many arthropods. In these animals, the majority of the studies have focused on DS neurons dedicated to processing the optic flow generated during navigation. In contrast, only a few studies were performed on DS neurons related to object motion processing. The crab Neohelice is an established experimental model for the study of neurons involved in visually-guided behaviors. Here, we describe in male crabs of this species a new group of DS neurons that are highly directionally selective to moving objects. The neurons were physiologically and morphologically characterized by intracellular recording and staining in the optic lobe of intact animals. Because of their arborization in the lobula complex, we called these cells lobula complex directional cells (LCDCs). LCDCs also arborize in a previously undescribed small neuropil of the lateral protocerebrum. LCDCs are responsive only to horizontal motion. This nicely fits in the behavioral adaptations of a crab inhabiting a flat, densely crowded environment, where most object motions are generated by neighboring crabs moving along the horizontal plane.SIGNIFICANCE STATEMENT Direction selective (DS) neurons are key to a variety of visual behaviors including, target tracking (preys, predators, cospecifics) and course control. Here, we describe the physiology and morphology of a new group of remarkably directional neurons exclusively responsive to horizontal motion in crabs. These neurons arborize in the lobula complex and in a previously undescribed small neuropil of the lateral protocerebrum. The strong sensitivity of these cells for horizontal motion represents a clear example of functional neuronal adaptation to the lifestyle of an animal inhabiting a flat environment.

Ventral motion parallax enhances fruit fly steering to visual sideslip

Flies and other insects use incoherent motion (parallax) to the front and sides to measure distances and identify obstacles during translation. Although additional depth information could be drawn from below, there is no experimental proof that they use it. The finding that blowflies encode motion disparities in their ventral visual fields suggests this may be an important region for depth information. We used a virtual flight arena to measure fruit fly responses to optic flow. The stimuli appeared below (n = 51) or above the fly (n = 44), at different speeds, with or without parallax cues. Dorsal parallax does not affect responses, and similar motion disparities in rotation have no effect anywhere in the visual field. But responses to strong ventral sideslip (206° s⁻¹) change drastically depending on the presence or absence of parallax. Ventral parallax could help resolve ambiguities in cluttered motion fields, and enhance corrective responses to nearby objects.

The combined effect of eye movements improve head centred local motion information during walking

Eye movements play multiple roles in human behaviour—small stabilizing movements are important for keeping the image of the scene steady during locomotion, whilst large scanning movements search for relevant information. It has been proposed that eye movement induced retinal motion interferes with the estimation of self-motion based on optic flow. We investigated the effect of eye movements on retinal motion information during walking. Observers walked towards a target, wearing eye tracking glasses that simultaneously recorded the scene ahead and tracked the movements of both eyes. By realigning the frames of the recording from the scene ahead, relative to the centre of gaze, we could mimic the input received by the retina (retinocentric coordinates) and compare this to the input received by the scene camera (head centred coordinates). We asked which of these coordinate frames resulted in the least noisy motion information. Motion noise was calculated by finding the error in between the optic flow signal and a noise-free motion expansion pattern. We found that eye movements improved the optic flow information available, even when large diversions away from target were made.

Removing a single neuron in a vertebrate brain forever abolishes an essential behavior

The Mauthner cell is the largest neuron known in the vertebrate brain and, in fish, mediates rapid escape behavior. Ablating this neuron has repeatedly failed to eliminate rapid escapes, a survival role of these escapes has not been supported experimentally, and it is unknown which advantage the enormous size and complexity of the cell conveys. By taking care to ensure ablations remove not only the soma but also the giant axon, we find that rapid escapes are lost forever and that this loss directly affects survival in predator–prey assays. The Mauthner cell thus is an example in which a survival-critical function depends on an individual neuron whose axon appears to have unusual capacities to remain functional after severe injury.

The giant Mauthner (M) cell is the largest neuron known in the vertebrate brain. It has enabled major breakthroughs in neuroscience but its ultimate function remains surprisingly unclear: An actual survival value of M cell-mediated escapes has never been supported experimentally and ablating the cell repeatedly failed to eliminate all rapid escapes, suggesting that escapes can equally well be driven by smaller neurons. Here we applied techniques to simultaneously measure escape performance and the state of the giant M axon over an extended period following ablation of its soma. We discovered that the axon survives remarkably long and remains still fully capable of driving rapid escape behavior. By unilaterally removing one of the two M axons and comparing escapes in the same individual that could or could not recruit an M axon, we show that the giant M axon is essential for rapid escapes and that its loss means that rapid escapes are also lost forever. This allowed us to directly test the survival value of the M cell-mediated escapes and to show that the absence of this giant neuron directly affects survival in encounters with a natural predator. These findings not only offer a surprising solution to an old puzzle but demonstrate that even complex brains can trust vital functions to individual neurons. Our findings suggest that mechanisms must have evolved in parallel with the unique significance of these neurons to keep their axons alive and connected.

Dynamic Signal Compression for Robust Motion Vision in Flies

Sensory systems need to reliably extract information from highly variable natural signals. Flies, for instance, use optic flow to guide their course and are remarkably adept at estimating image velocity regardless of image statistics. Current circuit models, however, cannot account for this robustness. Here, we demonstrate that the Drosophila visual system reduces input variability by rapidly adjusting its sensitivity to local contrast conditions. We exhaustively map functional properties of neurons in the motion detection circuit and find that local responses are compressed by surround contrast. The compressive signal is fast, integrates spatially, and derives from neural feedback. Training convolutional neural networks on estimating the velocity of natural stimuli shows that this dynamic signal compression can close the performance gap between model and organism. Overall, our work represents a comprehensive mechanistic account of how neural systems attain the robustness to carry out survival-critical tasks in challenging real-world environments.

Molecular characterization and distribution of the voltage-gated sodium channel, Para, in the brain of the grasshopper and vinegar fly

Voltage-gated sodium (NaV) channels, encoded by the gene para, play a critical role in the rapid processing and propagation of visual information related to collision avoidance behaviors. We investigated their localization by immunostaining the optic lobes and central brain of the grasshopper Schistocerca americana and the vinegar fly Drosophila melanogaster with an antibody that recognizes the channel peptide domain responsible for fast inactivation gating. NaV channels were detected at high density at all stages of development. In the optic lobe, they revealed stereotypically repeating fascicles consistent with the regular structure of the eye. In the central brain, major axonal tracts were strongly labeled, particularly in the grasshopper olfactory system. We used the NaV channel sequence of Drosophila to identify an ortholog in the transcriptome of Schistocerca. The grasshopper, vinegar fly, and human NaV channels exhibit a high degree of conservation at gating and ion selectivity domains. Comparison with three species evolutionarily close to Schistocerca identified splice variants of Para and their relation to those of Drosophila. The anatomical distribution of NaV channels molecularly analogous to those of humans in grasshoppers and vinegar flies provides a substrate for rapid signal propagation and visual processing in the context of visually-guided collision avoidance.

Understanding the retinal basis of vision across species

The vertebrate retina first evolved some 500 million years ago in ancestral marine chordates. Since then, the eyes of different species have been tuned to best support their unique visuoecological lifestyles. Visual specializations in eye designs, large-scale inhomogeneities across the retinal surface and local circuit motifs mean that all species' retinas are unique. Computational theories, such as the efficient coding hypothesis, have come a long way towards an explanation of the basic features of retinal organization and function; however, they cannot explain the full extent of retinal diversity within and across species. To build a truly general understanding of vertebrate vision and the retina's computational purpose, it is therefore important to more quantitatively relate different species' retinal functions to their specific natural environments and behavioural requirements. Ultimately, the goal of such efforts should be to build up to a more general theory of vision.

The diversity of lobula plate tangential cells (LPTCs) in the Drosophila motion vision system

To navigate through the environment, animals rely on visual feedback to control their movements relative to their surroundings. In dipteran flies, visual feedback is provided by the wide-field motion-sensitive neurons in the visual system called lobula plate tangential cells (LPTCs). Understanding the role of LPTCs in fly behaviors can address many fundamental questions on how sensory circuits guide behaviors. The blowfly was estimated to have ~ 60 LPTCs, but only a few have been identified in Drosophila. We conducted a Gal4 driver screen and identified five LPTC subtypes in Drosophila, based on their morphological characteristics: LPTCs have large arborizations in the lobula plate and project to the central brain. We compared their morphologies to the blowfly LPTCs and named them after the most similar blowfly cells: CH, H1, H2, FD1 and FD3, and V1. We further characterized their pre- and post-synaptic organizations, as well as their neurotransmitter profiles. These anatomical features largely agree with the anatomy and function of their likely blowfly counterparts. Nevertheless, several anatomical details indicate the Drosophila LPTCs may have more complex functions. Our characterization of these five LPTCs in Drosophila will facilitate further functional studies to understand their roles in the visual circuits that instruct fly behaviors.

How fly neurons compute the direction of visual motion

Detecting the direction of image motion is a fundamental component of visual computation, essential for survival of the animal. However, at the level of individual photoreceptors, the direction in which the image is shifting is not explicitly represented. Rather, directional motion information needs to be extracted from the photoreceptor array by comparing the signals of neighboring units over time. The exact nature of this process as implemented in the visual system of the fruit fly Drosophila melanogaster has been studied in great detail, and much progress has recently been made in determining the neural circuits giving rise to directional motion information. The results reveal the following: (1) motion information is computed in parallel ON and OFF pathways. (2) Within each pathway, T4 (ON) and T5 (OFF) cells are the first neurons to represent the direction of motion. Four subtypes of T4 and T5 cells exist, each sensitive to one of the four cardinal directions. (3) The core process of direction selectivity as implemented on the dendrites of T4 and T5 cells comprises both an enhancement of signals for motion along their preferred direction as well as a suppression of signals for motion along the opposite direction. This combined strategy ensures a high degree of direction selectivity right at the first stage where the direction of motion is computed. (4) At the subsequent processing stage, tangential cells spatially integrate direct excitation from ON and OFF-selective T4 and T5 cells and indirect inhibition from bi-stratified LPi cells activated by neighboring T4/T5 terminals, thus generating flow-field-selective responses.

Differential Tuning to Visual Motion Allows Robust Encoding of Optic Flow in the Dragonfly

Visual cues provide an important means for aerial creatures to ascertain their self-motion through the environment. In many insects, including flies, moths, and bees, wide-field motion-sensitive neurons in the third optic ganglion are thought to underlie such motion encoding; however, these neurons can only respond robustly over limited speed ranges. The task is more complicated for some species of dragonflies that switch between extended periods of hovering flight and fast-moving pursuit of prey and conspecifics, requiring motion detection over a broad range of velocities. Since little is known about motion processing in these insects, we performed intracellular recordings from hawking, emerald dragonflies (Hemicordulia spp.) and identified a diverse group of motion-sensitive neurons that we named lobula tangential cells (LTCs). Following prolonged visual stimulation with drifting gratings, we observed significant differences in both temporal and spatial tuning of LTCs. Cluster analysis of these changes confirmed several groups of LTCs with distinctive spatiotemporal tuning. These differences were associated with variation in velocity tuning in response to translated, natural scenes. LTCs with differences in velocity tuning ranges and optima may underlie how a broad range of motion velocities are encoded. In the hawking dragonfly, changes in LTC tuning over time are therefore likely to support their extensive range of behaviors, from hovering to fast-speed pursuits.SIGNIFICANCE STATEMENT Understanding how animals navigate the world is an inherently difficult and interesting problem. Insects are useful models for understanding neuronal mechanisms underlying these activities, with neurons that encode wide-field motion previously identified in insects, such as flies, hawkmoths, and butterflies. Like some Dipteran flies, dragonflies exhibit complex aerobatic behaviors, such as hovering, patrolling, and aerial combat. However, dragonflies lack halteres that support such diverse behavior in flies. To understand how dragonflies might address this problem using only visual cues, we recorded from their wide-field motion-sensitive neurons. We found these differ strongly in the ways they respond to sustained motion, allowing them collectively to encode the very broad range of velocities experienced during diverse behavior.