Fly visual course control: behaviour, algorithms and circuits

A review of Musca sorbens (Diptera: Muscidae) and Musca domestica behavior and responses to chemical and visual cues

Musca flies (Diptera: Muscidae) have been found culpable in the mechanical transmission of several infectious agents, including viruses, bacteria, protozoans, and helminths, particularly in low-income settings in tropical regions. In large numbers, these flies can negatively impact the health of communities and their livestock through the transmission of pathogens. In some parts of the world, Musca sorbens is of particular importance because it has been linked with the transmission of trachoma, a leading cause of preventable and irreversible blindness or visual impairment caused by Chlamydia trachomatis, but the contribution these flies make to trachoma transmission has not been quantified and even less is known for other pathogens. Current tools for control and monitoring of house flies remain fairly rudimentary and have focused on the use of environmental management, insecticides, traps, and sticky papers. Given that the behaviors of flies are triggered by chemical cues from their environment, monitoring approaches may be improved by focusing on those activities that are associated with nuisance behaviors or with potential pathogen transmission, and there are opportunities to improve fly control by exploiting behaviors toward semiochemicals that act as attractants or repellents. We review current knowledge on the odor and visual cues that affect the behavior of M. sorbens and Musca domestica, with the aim of better understanding how these can be exploited to support disease monitoring and guide the development of more effective control strategies.

Morphology and synapse topography optimize linear encoding of synapse numbers in Drosophila looming responsive descending neurons

Synapses are often precisely organized on dendritic arbors, yet the role of synaptic topography in dendritic integration remains poorly understood. Utilizing electron microscopy (EM) connectomics we investigate synaptic topography in Drosophila melanogaster looming circuits, focusing on retinotopically tuned visual projection neurons (VPNs) that synapse onto descending neurons (DNs). Synapses of a given VPN type project to non-overlapping regions on DN dendrites. Within these spatially constrained clusters, synapses are not retinotopically organized, but instead adopt near random distributions. To investigate how this organization strategy impacts DN integration, we developed multicompartment models of DNs fitted to experimental data and using precise EM morphologies and synapse locations. We find that DN dendrite morphologies normalize EPSP amplitudes of individual synaptic inputs and that near random distributions of synapses ensure linear encoding of synapse numbers from individual VPNs. These findings illuminate how synaptic topography influences dendritic integration and suggest that linear encoding of synapse numbers may be a default strategy established through connectivity and passive neuron properties, upon which active properties and plasticity can then tune as needed.

Development of the Drosophila Optic Lobe

The Drosophila visual system has been a great model to study fundamental questions in neurobiology, such as neural fate specification, axon guidance, circuit formation, and information processing. The Drosophila visual system is composed of the compound eye and the optic lobe. The optic lobe is divided into four neuropils-namely, the lamina, medulla, lobula, and lobula plate. There are around 200 types of optic lobe neurons, which wire together to form a complex neural structure to processes visual information. These neurons are derived from two neuroepithelial structures-namely, the outer proliferation center (OPC) and the inner proliferation center (IPC), in the larval brain. Recent work on the Drosophila optic lobe has revealed basic principles underlying the development of this complex neural structure, and immunostaining has been a key tool in these studies. Here, we provide a brief overview of the Drosophila optic lobe structure and development, as revealed by immunostaining. First, we introduce the structure of the adult optic lobe. Then, we summarize recent advances in the study of neural fate specification during development of different parts of the optic lobe. Last, we briefly summarize general aspects of axon guidance and neuropil assembly in the optic lobe. With this review, we aim to familiarize readers with this complex neural structure and highlight the power of this great model to study neural development to facilitate further developmental and functional studies using this system.

The motor apparatus of head movements in the Oleander hawkmoth (Daphnis nerii, Lepidoptera)

Head movements of insects play a vital role in diverse locomotory behaviors including flying and walking. Because insect eyes move minimally within their sockets, their head movements are essential to reduce visual blur and maintain a stable gaze. As in most vertebrates, gaze stabilization behavior in insects requires the integration of both visual and mechanosensory feedback by the neck motor neurons. Although visual feedback is derived from the optic flow over the retina of their compound eyes, mechanosensory feedback is derived from their organs of balance, similar to the vestibular system in vertebrates. In Diptera, vestibular feedback is derived from the halteres-modified hindwings that evolved into mechanosensory organs-and is integrated with visual feedback to actuate compensatory head movements. However, non-Dipteran insects, including Lepidoptera, lack halteres. In these insects, vestibular feedback is obtained from the antennal Johnston's organs but it is not well-understood how it integrates with visual feedback during head movements. Indeed, although head movements are well-studied in flies, the underlying motor apparatus in non-Dipteran taxa has received relatively less attention. As a first step toward understanding compensatory head movements in the Oleander hawkmoth Daphnis nerii, we image the anatomy and architecture of their neck joint sclerites and muscles using X-ray microtomography, and the associated motor neurons using fluorescent dye fills and confocal microscopy. Based on these morphological data, we propose testable hypotheses about the putative function of specific neck muscles during head movements, which can shed light on their role in neck movements and gaze stabilization.

Divisive normalization processors in the early visual system of the Drosophila brain

Divisive normalization is a model of canonical computation of brain circuits. We demonstrate that two cascaded divisive normalization processors (DNPs), carrying out intensity/contrast gain control and elementary motion detection, respectively, can model the robust motion detection realized by the early visual system of the fruit fly. We first introduce a model of elementary motion detection and rewrite its underlying phase-based motion detection algorithm as a feedforward divisive normalization processor. We then cascade the DNP modeling the photoreceptor/amacrine cell layer with the motion detection DNP. We extensively evaluate the DNP for motion detection in dynamic environments where light intensity varies by orders of magnitude. The results are compared to other bio-inspired motion detectors as well as state-of-the-art optic flow algorithms under natural conditions. Our results demonstrate the potential of DNPs as canonical building blocks modeling the analog processing of early visual systems. The model highlights analog processing for accurately detecting visual motion, in both vertebrates and invertebrates. The results presented here shed new light on employing DNP-based algorithms in computer vision.

Motion perception based on ON/OFF channels: A survey

Motion perception is an essential ability for animals and artificially intelligent systems interacting effectively, safely with surrounding objects and environments. Biological visual systems, that have naturally evolved over hundreds-million years, are quite efficient and robust for motion perception, whereas artificial vision systems are far from such capability. This paper argues that the gap can be significantly reduced by formulation of ON/OFF channels in motion perception models encoding luminance increment (ON) and decrement (OFF) responses within receptive field, separately. Such signal-bifurcating structure has been found in neural systems of many animal species articulating early motion is split and processed in segregated pathways. However, the corresponding biological substrates, and the necessity for artificial vision systems have never been elucidated together, leaving concerns on uniqueness and advantages of ON/OFF channels upon building dynamic vision systems to address real world challenges. This paper highlights the importance of ON/OFF channels in motion perception through surveying current progress covering both neuroscience and computationally modelling works with applications. Compared to related literature, this paper for the first time provides insights into implementation of different selectivity to directional motion of looming, translating, and small-sized target movement based on ON/OFF channels in keeping with soundness and robustness of biological principles. Existing challenges and future trends of such bio-plausible computational structure for visual perception in connection with hotspots of machine learning, advanced vision sensors like event-driven camera finally are discussed.

How Flies See Motion

How neurons detect the direction of motion is a prime example of neural computation: Motion vision is found in the visual systems of virtually all sighted animals, it is important for survival, and it requires interesting computations with well-defined linear and nonlinear processing steps-yet the whole process is of moderate complexity. The genetic methods available in the fruit fly Drosophila and the charting of a connectome of its visual system have led to rapid progress and unprecedented detail in our understanding of how neurons compute the direction of motion in this organism. The picture that emerged incorporates not only the identity, morphology, and synaptic connectivity of each neuron involved but also its neurotransmitters, its receptors, and their subcellular localization. Together with the neurons' membrane potential responses to visual stimulation, this information provides the basis for a biophysically realistic model of the circuit that computes the direction of visual motion.

Contrast normalization affects response time-course of visual interneurons

In natural environments, light intensities and visual contrasts vary widely, yet neurons have a limited response range for encoding them. Neurons accomplish that by flexibly adjusting their dynamic range to the statistics of the environment via contrast normalization. The effect of contrast normalization is usually measured as a reduction of neural signal amplitudes, but whether it influences response dynamics is unknown. Here, we show that contrast normalization in visual interneurons of Drosophila melanogaster not only suppresses the amplitude but also alters the dynamics of responses when a dynamic surround is present. We present a simple model that qualitatively reproduces the simultaneous effect of the visual surround on the response amplitude and temporal dynamics by altering the cells' input resistance and, thus, their membrane time constant. In conclusion, single-cell filtering properties as derived from artificial stimulus protocols like white-noise stimulation cannot be transferred one-to-one to predict responses under natural conditions.

Behavioral algorithms and neural mechanisms underlying odor-modulated locomotion in insects

Odors released from mates and resources such as a host and food are often the first sensory signals that an animal can detect. Changes in locomotion in response to odors are an important mechanism by which animals access resources important to their survival. Odor-modulated changes in locomotion in insects constitute a whole suite of flexible behaviors that allow insects to close in on these resources from long distances and perform local searches to locate and subsequently assess them. Here, we review changes in odor-mediated locomotion across many insect species. We emphasize that changes in locomotion induced by odors are diverse. In particular, the olfactory stimulus is sporadic at long distances and becomes more continuous at short distances. This distance-dependent change in temporal profile produces a corresponding change in an insect's locomotory strategy. We also discuss the neural circuits underlying odor modulation of locomotion.

Zebras of all stripes repel biting flies at close range

The best-supported hypothesis for why zebras have stripes is that stripes repel biting flies. While this effect is well-established, the mechanism behind it remains elusive. Myriad hypotheses have been suggested, but few experiments have helped narrow the field of possible explanations. In addition, the complex visual features of real zebra pelage and the natural range of stripe widths have been largely left out of experimental designs. In paired-choice field experiments in a Kenyan savannah, we found that hungry Stomoxys flies released in an enclosure strongly preferred to land on uniform tan impala pelts over striped zebra pelts but exhibited no preference between the pelts of the zebra species with the widest stripes and the narrowest stripes. Our findings confirm that zebra stripes repel biting flies under naturalistic conditions and do so at close range (suggesting that several of the mechanisms hypothesized to operate at a distance are unnecessary for the fly-repulsion effect) but indicate that interspecific variation in stripe width is associated with selection pressures other than biting flies.

Integration of visual and antennal mechanosensory feedback during head stabilization in hawkmoths

During flight maneuvers, insects exhibit compensatory head movements which are essential for stabilizing the visual field on their retina, reducing motion blur, and supporting visual self-motion estimation. In Diptera, such head movements are mediated via visual feedback from their compound eyes that detect retinal slip, as well as rapid mechanosensory feedback from their halteres – the modified hindwings that sense the angular rates of body rotations. Because non-Dipteran insects lack halteres, it is not known if mechanosensory feedback about body rotations plays any role in their head stabilization response. Diverse non-Dipteran insects are known to rely on visual and antennal mechanosensory feedback for flight control. In hawkmoths, for instance, reduction of antennal mechanosensory feedback severely compromises their ability to control flight. Similarly, when the head movements of freely flying moths are restricted, their flight ability is also severely impaired. The role of compensatory head movements as well as multimodal feedback in insect flight raises an interesting question: in insects that lack halteres, what sensory cues are required for head stabilization? Here, we show that in the nocturnal hawkmoth Daphnis nerii, compensatory head movements are mediated by combined visual and antennal mechanosensory feedback. We subjected tethered moths to open-loop body roll rotations under different lighting conditions, and measured their ability to maintain head angle in the presence or absence of antennal mechanosensory feedback. Our study suggests that head stabilization in moths is mediated primarily by visual feedback during roll movements at lower frequencies, whereas antennal mechanosensory feedback is required when roll occurs at higher frequency. These findings are consistent with the hypothesis that control of head angle results from a multimodal feedback loop that integrates both visual and antennal mechanosensory feedback, albeit at different latencies. At adequate light levels, visual feedback is sufficient for head stabilization primarily at low frequencies of body roll. However, under dark conditions, antennal mechanosensory feedback is essential for the control of head movements at high frequencies of body roll.

Roles of peripheral clocks: lessons from the fly

To adapt to and anticipate rhythmic changes in the environment such as daily light-dark and temperature cycles, internal timekeeping mechanisms called biological clocks evolved in a diverse set of organisms, from unicellular bacteria to humans. These biological clocks play critical roles in organisms' fitness and survival by temporally aligning physiological and behavioral processes to the external cues. The central clock is located in a small subset of neurons in the brain and drives daily activity rhythms, whereas most peripheral tissues harbor their own clock systems, which generate metabolic and physiological rhythms. Since the discovery of Drosophila melanogaster clock mutants in the early 1970s, the fruit fly has become an extensively studied model organism to investigate the mechanism and functions of circadian clocks. In this review, we primarily focus on D. melanogaster to survey key discoveries and progresses made over the past two decades in our understanding of peripheral clocks. We discuss physiological roles and molecular mechanisms of peripheral clocks in several different peripheral tissues of the fly.

Fly pollination drives convergence of flower coloration

Plant-pollinator interactions provide a natural experiment in signal evolution. Flowers are known to have evolved colour signals that maximise their ease of detection by the visual systems of important pollinators such as bees. Whilst most angiosperms are bee pollinated, our understanding on how the second largest group of pollinating insects, flies, may influence flower colour evolution is limited to the use of categorical models of colour discrimination that do not reflect the small colour differences commonly observed between and within flower species. Here we show by comparing flower signals that occur in different environments including total absence of bees, a mixture of bee and fly pollination within one plant family (Orchidaceae) from a single community, and typical flowers from a broad taxonomic sampling of the same geographic region, that perceptually different colours, empirically measured, do evolve in response to different types of insect pollinators. We show evidence of both convergence among fly-pollinated floral colours but also of divergence and displacement of colour signals in the absence of bee pollinators. Our findings give an insight into how both ecological and agricultural systems may be affected by changes in pollinator distributions around the world.

Insect locomotion: Flies show you how to stay on course

Walking animals are faced with making a trade-off between maintaining a stable posture and gait and pursuing other goals such as keeping a straight path. A new study on exploratory walking in flies provides a sophisticated quantitative account of this behavioural problem, with some intriguing discoveries.

Fast tuning of posture control by visual feedback underlies gaze stabilization in walking Drosophila

Locomotion requires a balance between mechanical stability and movement flexibility to achieve behavioral goals despite noisy neuromuscular systems, but rarely is it considered how this balance is orchestrated. We combined virtual reality tools with quantitative analysis of behavior to examine how Drosophila uses self-generated visual information (reafferent visual feedback) to control gaze during exploratory walking. We found that flies execute distinct motor programs coordinated across the body to maximize gaze stability. However, the presence of inherent variability in leg placement relative to the body jeopardizes fine control of gaze due to posture-stabilizing adjustments that lead to unintended changes in course direction. Surprisingly, whereas visual feedback is dispensable for head-body coordination, we found that self-generated visual signals tune postural reflexes to rapidly prevent turns rather than to promote compensatory rotations, a long-standing idea for visually guided course control. Together, these findings support a model in which visual feedback orchestrates the interplay between posture and gaze stability in a manner that is both goal dependent and motor-context specific.

Heightened condition dependent expression of structural coloration in the faces, but not wings, of male and female flies

Structurally colored sexual signals are a conspicuous and widespread class of ornament used in mate choice, though the extent to which they encode information on the quality of their bearers is not fully resolved. Theory predicts that signaling traits under strong sexual selection as honest indicators should evolve to be more developmentally integrated and exaggerated than nonsexual traits, thereby leading to heightened condition dependence. Here, we test this prediction through examination of the sexually dimorphic faces and wings of the cursorial fly Lispe cana. Males and females possess structural UV-white and golden faces, respectively, and males present their faces and wings to females during close-range, ground-based courtship displays, thereby creating the opportunity for mutual inspection. Across a field-collected sample of individuals, we found that the appearance of the faces of both sexes scaled positively with individual condition, though along separate axes. Males in better condition expressed brighter faces as modeled according to conspecific flies, whereas condition scaled with facial saturation in females. We found no such relationships for their wing interference pattern nor abdomens, with the latter included as a nonsexual control. Our results suggest that the structurally colored faces, but not the iridescent wings, of male and female L. cana are reliable guides to individual quality and support the broader potential for structural colors as honest signals. They also highlight the potential for mutual mate choice in this system, while arguing for 1 of several alternate signaling roles for wing interferences patterns among the myriad taxa which bear them.

Neuroscience: Convergence of biological and artificial networks

A new study shows that an artificial neural network trained to predict visual motion reproduces key properties of motion detecting circuits in the fruit fly.

Disentangling of Local and Wide-Field Motion Adaptation

Motion adaptation has been attributed in flying insects a pivotal functional role in spatial vision based on optic flow. Ongoing motion enhances in the visual pathway the representation of spatial discontinuities, which manifest themselves as velocity discontinuities in the retinal optic flow pattern during translational locomotion. There is evidence for different spatial scales of motion adaptation at the different visual processing stages. Motion adaptation is supposed to take place, on the one hand, on a retinotopic basis at the level of local motion detecting neurons and, on the other hand, at the level of wide-field neurons pooling the output of many of these local motion detectors. So far, local and wide-field adaptation could not be analyzed separately, since conventional motion stimuli jointly affect both adaptive processes. Therefore, we designed a novel stimulus paradigm based on two types of motion stimuli that had the same overall strength but differed in that one led to local motion adaptation while the other did not. We recorded intracellularly the activity of a particular wide-field motion-sensitive neuron, the horizontal system equatorial cell (HSE) in blowflies. The experimental data were interpreted based on a computational model of the visual motion pathway, which included the spatially pooling HSE-cell. By comparing the difference between the recorded and modeled HSE-cell responses induced by the two types of motion adaptation, the major characteristics of local and wide-field adaptation could be pinpointed. Wide-field adaptation could be shown to strongly depend on the activation level of the cell and, thus, on the direction of motion. In contrast, the response gain is reduced by local motion adaptation to a similar extent independent of the direction of motion. This direction-independent adaptation differs fundamentally from the well-known adaptive adjustment of response gain according to the prevailing overall stimulus level that is considered essential for an efficient signal representation by neurons with a limited operating range. Direction-independent adaptation is discussed to result from the joint activity of local motion-sensitive neurons of different preferred directions and to lead to a representation of the local motion direction that is independent of the overall direction of global motion.

Neural specification, targeting, and circuit formation during visual system assembly

Like other sensory systems, the visual system is topographically organized: Its sensory neurons, the photoreceptors, and their targets maintain point-to-point correspondence in physical space, forming a retinotopic map. The iterative wiring of circuits in the visual system conveniently facilitates the study of its development. Over the past few decades, experiments in Drosophila have shed light on the principles that guide the specification and connectivity of visual system neurons. In this review, we describe the main findings unearthed by the study of the Drosophila visual system and compare them with similar events in mammals. We focus on how temporal and spatial patterning generates diverse cell types, how guidance molecules distribute the axons and dendrites of neurons within the correct target regions, how vertebrates and invertebrates generate their retinotopic map, and the molecules and mechanisms required for neuronal migration. We suggest that basic principles used to wire the fly visual system are broadly applicable to other systems and highlight its importance as a model to study nervous system development.

Maximally efficient prediction in the early fly visual system may support evasive flight maneuvers

The visual system must make predictions to compensate for inherent delays in its processing. Yet little is known, mechanistically, about how prediction aids natural behaviors. Here, we show that despite a 20-30ms intrinsic processing delay, the vertical motion sensitive (VS) network of the blowfly achieves maximally efficient prediction. This prediction enables the fly to fine-tune its complex, yet brief, evasive flight maneuvers according to its initial ego-rotation at the time of detection of the visual threat. Combining a rich database of behavioral recordings with detailed compartmental modeling of the VS network, we further show that the VS network has axonal gap junctions that are critical for optimal prediction. During evasive maneuvers, a VS subpopulation that directly innervates the neck motor center can convey predictive information about the fly’s future ego-rotation, potentially crucial for ongoing flight control. These results suggest a novel sensory-motor pathway that links sensory prediction to behavior.

Survival-critical behaviors shape neural circuits to translate sensory information into strikingly fast predictions, e.g. in escaping from a predator faster than the system’s processing delay. We show that the fly visual system implements fast and accurate prediction of its visual experience. This provides crucial information for directing fast evasive maneuvers that unfold over just 40ms. Our work shows how this fast prediction is implemented, mechanistically, and suggests the existence of a novel sensory-motor pathway from the fly visual system to a wing steering motor neuron. Echoing and amplifying previous work in the retina, our work hypothesizes that the efficient encoding of predictive information is a universal design principle supporting fast, natural behaviors.

Insect-machine hybrid robot

Recently, insect-machine hybrid robots have been developed that incorporate insects into robots or incorporate machines into insects. Most previous studies were motivated to use the function of insects for robots, but this technology can also prove to be useful as an experimental tool for neuroethology. We reviewed hybrid robots in terms of the closed-loop between an insect, a robot, and the real environment. The incorporated biological components provided the robot sensory signals that were received by the insects and the adaptive functions of the brain. The incorporated artificial components permitted us to understand the biological system by controlling insect behavior. Hybrid robots thus extend the roles of mobile robot experiments in neuroethology for both model evaluation and brain function analysis.

Modelling Drosophila motion vision pathways for decoding the direction of translating objects against cluttered moving backgrounds

Decoding the direction of translating objects in front of cluttered moving backgrounds, accurately and efficiently, is still a challenging problem. In nature, lightweight and low-powered flying insects apply motion vision to detect a moving target in highly variable environments during flight, which are excellent paradigms to learn motion perception strategies. This paper investigates the fruit fly Drosophila motion vision pathways and presents computational modelling based on cutting-edge physiological researches. The proposed visual system model features bio-plausible ON and OFF pathways, wide-field horizontal-sensitive (HS) and vertical-sensitive (VS) systems. The main contributions of this research are on two aspects: (1) the proposed model articulates the forming of both direction-selective and direction-opponent responses, revealed as principal features of motion perception neural circuits, in a feed-forward manner; (2) it also shows robust direction selectivity to translating objects in front of cluttered moving backgrounds, via the modelling of spatiotemporal dynamics including combination of motion pre-filtering mechanisms and ensembles of local correlators inside both the ON and OFF pathways, which works effectively to suppress irrelevant background motion or distractors, and to improve the dynamic response. Accordingly, the direction of translating objects is decoded as global responses of both the HS and VS systems with positive or negative output indicating preferred-direction or null-direction translation. The experiments have verified the effectiveness of the proposed neural system model, and demonstrated its responsive preference to faster-moving, higher-contrast and larger-size targets embedded in cluttered moving backgrounds.

Parallel Visual Pathways with Topographic versus Nontopographic Organization Connect the Drosophila Eyes to the Central Brain

One hallmark of the visual system is a strict retinotopic organization from the periphery toward the central brain, where functional imaging in Drosophila revealed a spatially accurate representation of visual cues in the central complex. This raised the question how, on a circuit level, the topographic features are implemented, as the majority of visual neurons enter the central brain converge in optic glomeruli. We discovered a spatial segregation of topographic versus nontopographic projections of distinct classes of medullo-tubercular (MeTu) neurons into a specific visual glomerulus, the anterior optic tubercle (AOTU). These parallel channels synapse onto different tubercular-bulbar (TuBu) neurons, which in turn relay visual information onto specific central complex ring neurons in the bulb neuropil. Hence, our results provide the circuit basis for spatially accurate representation of visual information and highlight the AOTU's role as a prominent relay station for spatial information from the retina to the central brain.

•

A Drosophila visual circuit conveys input from the periphery to the central brain

•

Several synaptic pathways form parallel channels using the anterior optic tubercle

•

Some pathways maintain topographic relationships across several synaptic steps

•

Different target neurons in the central brain are identified

Resource-efficient bio-inspired visual processing on the hexapod walking robot HECTOR

Emulating the highly resource-efficient processing of visual motion information in the brain of flying insects, a bio-inspired controller for collision avoidance and navigation was implemented on a novel, integrated System-on-Chip-based hardware module. The hardware module is used to control visually-guided navigation behavior of the stick insect-like hexapod robot HECTOR. By leveraging highly parallelized bio-inspired algorithms to extract nearness information from visual motion in dynamically reconfigurable logic, HECTOR is able to navigate to predefined goal positions without colliding with obstacles. The system drastically outperforms CPU- and graphics card-based implementations in terms of speed and resource efficiency, making it suitable to be also placed on fast moving robots, such as flying drones.

Hawkmoth lamina monopolar cells act as dynamic spatial filters to optimize vision at different light levels

How neural form and function are connected is a central question of neuroscience. One prominent functional hypothesis, from the beginnings of neuroanatomical study, states that laterally extending dendrites of insect lamina monopolar cells (LMCs) spatially integrate visual information. We provide the first direct functional evidence for this hypothesis using intracellular recordings from type II LMCs in the hawkmoth Macroglossum stellatarum. We show that their spatial receptive fields broaden with decreasing light intensities, thus trading spatial resolution for higher sensitivity. These dynamic changes in LMC spatial properties can be explained by the density and lateral extent of their dendritic arborizations. Our results thus provide the first physiological evidence for a century-old hypothesis, directly correlating physiological response properties with distinctive dendritic morphology.

Visual motion sensitivity in descending neurons in the hoverfly

Many animals use motion vision information to control dynamic behaviors. For example, flying insects must decide whether to pursue a prey or not, to avoid a predator, to maintain their current flight trajectory, or to land. The neural mechanisms underlying the computation of visual motion have been particularly well investigated in the fly optic lobes. However, the descending neurons, which connect the optic lobes with the motor command centers of the ventral nerve cord, remain less studied. To address this deficiency, we describe motion vision sensitive descending neurons in the hoverfly Eristalis tenax. We describe how the neurons can be identified based on their receptive field properties, and how they respond to moving targets, looming stimuli and to widefield optic flow. We discuss their similarities with previously published visual neurons, in the optic lobes and ventral nerve cord, and suggest that they can be classified as target-selective, looming sensitive and optic flow sensitive, based on these similarities. Our results highlight the importance of using several visual stimuli as the neurons can rarely be identified based on only one response characteristic. In addition, they provide an understanding of the neurophysiology of visual neurons that are likely to affect behavior.

Dynamic Signal Compression for Robust Motion Vision in Flies

Sensory systems need to reliably extract information from highly variable natural signals. Flies, for instance, use optic flow to guide their course and are remarkably adept at estimating image velocity regardless of image statistics. Current circuit models, however, cannot account for this robustness. Here, we demonstrate that the Drosophila visual system reduces input variability by rapidly adjusting its sensitivity to local contrast conditions. We exhaustively map functional properties of neurons in the motion detection circuit and find that local responses are compressed by surround contrast. The compressive signal is fast, integrates spatially, and derives from neural feedback. Training convolutional neural networks on estimating the velocity of natural stimuli shows that this dynamic signal compression can close the performance gap between model and organism. Overall, our work represents a comprehensive mechanistic account of how neural systems attain the robustness to carry out survival-critical tasks in challenging real-world environments.

Sensory processing by motoneurons: a numerical model for low-level flight control in flies

Rhythmic locomotor behaviour in animals requires exact timing of muscle activation within the locomotor cycle. In rapidly oscillating motor systems, conventional control strategies may be affected by neural delays, making these strategies inappropriate for precise timing control. In flies, wing control thus requires sensory processing within the peripheral nervous system, circumventing the central brain. The underlying mechanism, with which flies integrate graded depolarization of visual interneurons and spiking proprioceptive feedback for precise muscle activation, is under debate. Based on physiological parameters, we developed a numerical model of spike initiation in flight muscles of a blowfly. The simulated Hodgkin–Huxley neuron reproduces multiple experimental findings and explains on the cellular level how vision might control wing kinematics. Sensory processing by single motoneurons appears to be sufficient for control of muscle power during flight in flies and potentially other flying insects, reducing computational load on the central brain during body posture reflexes and manoeuvring flight.

The role of optic flow pooling in insect flight control in cluttered environments

Flight through cluttered environments, such as forests, poses great challenges for animals and machines alike because even small changes in flight path may lead to collisions with nearby obstacles. When flying along narrow corridors, insects use the magnitude of visual motion experienced in each eye to control their position, height, and speed but it is unclear how this strategy would work when the environment contains nearby obstacles against a distant background. To minimise the risk of collisions, we would expect animals to rely on the visual motion generated by only the nearby obstacles but is this the case? To answer this, we combine behavioural experiments with numerical simulations and provide the first evidence that bumblebees extract the maximum rate of image motion in the frontal visual field to steer away from obstacles. Our findings also suggest that bumblebees use different optic flow calculations to control lateral position, speed, and height.

Fuelling on the wing: sensory ecology of hawkmoth foraging

Hawkmoths (Lepidoptera, Sphingidae) comprise around 1500 species, most of which forage on nectar from flowers in their adult stage, usually while hovering in front of the flower. The majority of species have a nocturnal lifestyle and are important nocturnal pollinators, but some species have turned to a diurnal lifestyle. Hawkmoths use visual and olfactory cues including CO₂ and humidity to detect and recognise rewarding flowers; they find the nectary in the flowers by means of mechanoreceptors on the proboscis and vision, evaluate it with gustatory receptors on the proboscis, and control their hovering flight position using antennal mechanoreception and vision. Here, we review what is presently known about the sensory organs and sensory-guided behaviour that control feeding behaviour of this fascinating pollinator taxon. We also suggest that more experiments on hawkmoth behaviour in natural settings are needed to fully appreciate their sensory capabilities.

Towards Computational Models and Applications of Insect Visual Systems for Motion Perception: A Review

Motion perception is a critical capability determining a variety of aspects of insects' life, including avoiding predators, foraging, and so forth. A good number of motion detectors have been identified in the insects' visual pathways. Computational modeling of these motion detectors has not only been providing effective solutions to artificial intelligence, but also benefiting the understanding of complicated biological visual systems. These biological mechanisms through millions of years of evolutionary development will have formed solid modules for constructing dynamic vision systems for future intelligent machines. This article reviews the computational motion perception models originating from biological research on insects' visual systems in the literature. These motion perception models or neural networks consist of the looming-sensitive neuronal models of lobula giant movement detectors (LGMDs) in locusts, the translation-sensitive neural systems of direction-selective neurons (DSNs) in fruit flies, bees, and locusts, and the small-target motion detectors (STMDs) in dragonflies and hoverflies. We also review the applications of these models to robots and vehicles. Through these modeling studies, we summarize the methodologies that generate different direction and size selectivity in motion perception. Finally, we discuss multiple systems integration and hardware realization of these bio-inspired motion perception models.

Bi-directional Control of Walking Behavior by Horizontal Optic Flow Sensors

Moving animals experience constant sensory feedback, such as panoramic image shifts on the retina, termed optic flow. Underlying neuronal signals are thought to be important for exploratory behavior by signaling unintended course deviations and by providing spatial information about the environment [1, 2]. Particularly in insects, the encoding of self-motion-related optic flow is well understood [1-5]. However, a gap remains in understanding how the associated neuronal activity controls locomotor trajectories. In flies, visual projection neurons belonging to two groups encode panoramic horizontal motion: horizontal system (HS) cells respond with depolarization to front-to-back motion and hyperpolarization to the opposite direction [6, 7], and other neurons have the mirror-symmetrical response profile [6, 8, 9]. With primarily monocular sensitivity, the neurons' responses are ambiguous for different rotational and translational self-movement components. Such ambiguities can be greatly reduced by combining signals from both eyes [10-12] to determine turning and movement speed [13-16]. Here, we explore the underlying functional logic by optogenetic HS cell manipulation in tethered walking Drosophila. We show that de- and hyperpolarization evoke opposite turning behavior, indicating that both direction-selective signals are transmitted to descending pathways for course control. Further experiments reveal a negative effect of bilaterally symmetric de- and hyperpolarization on walking velocity. Our results are therefore consistent with a functional architecture in which the HS cells' membrane potential influences walking behavior bi-directionally via two decelerating pathways.

Full reconstruction of large lobula plate tangential cells in Drosophila from a 3D EM dataset

With the advent of neurogenetic methods, the neural basis of behavior is presently being analyzed in more and more detail. This is particularly true for visually driven behavior of Drosophila melanogaster where cell-specific driver lines exist that, depending on the combination with appropriate effector genes, allow for targeted recording, silencing and optogenetic stimulation of individual cell-types. Together with detailed connectomic data of large parts of the fly optic lobe, this has recently led to much progress in our understanding of the neural circuits underlying local motion detection. However, how such local information is combined by optic flow sensitive large-field neurons is still incompletely understood. Here, we aim to fill this gap by a dense reconstruction of lobula plate tangential cells of the fly lobula plate. These neurons collect input from many hundreds of local motion-sensing T4/T5 neurons and connect them to descending neurons or central brain areas. We confirm all basic features of HS and VS cells as published previously from light microscopy. In addition, we identified the dorsal and the ventral centrifugal horizontal, dCH and vCH cell, as well as three VSlike cells, including their distinct dendritic and axonal projection area.

Visual Control of Walking Speed in Drosophila

An animal's self-motion generates optic flow across its retina, and it can use this visual signal to regulate its orientation and speed through the world. While orientation control has been studied extensively in Drosophila and other insects, much less is known about the visual cues and circuits that regulate translational speed. Here, we show that flies regulate walking speed with an algorithm that is tuned to the speed of visual motion, causing them to slow when visual objects are nearby. This regulation does not depend strongly on the spatial structure or the direction of visual stimuli, making it algorithmically distinct from the classic computation that controls orientation. Despite the different algorithms, the visual circuits that regulate walking speed overlap with those that regulate orientation. Taken together, our findings suggest that walking speed is controlled by a hierarchical computation that combines multiple motion detectors with distinct tunings. VIDEO ABSTRACT.

Apparent Motion Perception in the Praying Mantis: Psychophysics and Modelling

Simple Summary

Computer monitors, smart phone screens, and other forms of digital displays present a series of still images (frames) in which objects are displaced in small steps, tricking us into perceiving smooth motion. This illusion is referred to as “apparent motion”. For motion to be perceived, the magnitude of each displacement step must be smaller than a certain limit, referred to as Dmax. Previous studies have investigated the relationship between this limit and object size in humans and found that the maximum displacement is larger for larger objects than for smaller ones. In this work, we investigated the same relationship in the praying mantis Sphodromantis lineola by presenting them with moving random chequerboard patterns on a computer monitor. Even though motion perception in humans and insects are believed to be explained equally well by the same underlying model, we found that Dmax scales differently with object size in mantids. These results suggest that there may be qualitative differences in how mantids perceive apparent motion compared to humans.

Abstract

Apparent motion is the perception of motion created by rapidly presenting still frames in which objects are displaced in space. Observers can reliably discriminate the direction of apparent motion when inter-frame object displacement is below a certain limit, Dmax. Earlier studies of motion perception in humans found that Dmax is lower-bounded at around 15 arcmin, and thereafter scales with the size of the spatial elements in the images. Here, we run corresponding experiments in the praying mantis Sphodromantis lineola to investigate how Dmax scales with the element size. We use random moving chequerboard patterns of varying element and displacement step sizes to elicit the optomotor response, a postural stabilization mechanism that causes mantids to lean in the direction of large-field motion. Subsequently, we calculate Dmax as the displacement step size corresponding to a 50% probability of detecting an optomotor response in the same direction as the stimulus. Our main findings are that the mantis Dmax scales roughly as a square-root of element size and that, in contrast to humans, it is not lower-bounded. We present two models to explain these observations: a simple high-level model based on motion energy in the Fourier domain and a more-detailed one based on the Reichardt Detector. The models present complementary intuitive and physiologically-realistic accounts of how Dmax scales with the element size in insects. We conclude that insect motion perception is limited by only a single stage of spatial filtering, reflecting the optics of the compound eye. In contrast, human motion perception reflects a second stage of spatial filtering, at coarser scales than imposed by human optics, likely corresponding to the magnocellular pathway. After this spatial filtering, mantis and human motion perception and Dmax are qualitatively very similar.

Shaping the collision selectivity in a looming sensitive neuron model with parallel ON and OFF pathways and spike frequency adaptation

Shaping the collision selectivity in vision-based artificial collision-detecting systems is still an open challenge. This paper presents a novel neuron model of a locust looming detector, i.e. the lobula giant movement detector (LGMD1), in order to provide effective solutions to enhance the collision selectivity of looming objects over other visual challenges. We propose an approach to model the biologically plausible mechanisms of ON and OFF pathways and a biophysical mechanism of spike frequency adaptation (SFA) in the proposed LGMD1 visual neural network. The ON and OFF pathways can separate both dark and light looming features for parallel spatiotemporal computations. This works effectively on perceiving a potential collision from dark or light objects that approach; such a bio-plausible structure can also separate LGMD1's collision selectivity to its neighbouring looming detector - the LGMD2. The SFA mechanism can enhance the LGMD1's collision selectivity to approaching objects rather than receding and translating stimuli, which is a significant improvement compared with similar LGMD1 neuron models. The proposed framework has been tested using off-line tests of synthetic and real-world stimuli, as well as on-line bio-robotic tests. The enhanced collision selectivity of the proposed model has been validated in systematic experiments. The computational simplicity and robustness of this work have also been verified by the bio-robotic tests, which demonstrates potential in building neuromorphic sensors for collision detection in both a fast and reliable manner.

Visual Projection Neurons Mediating Directed Courtship in Drosophila

Many animals rely on vision to detect, locate, and track moving objects. In Drosophila courtship, males primarily use visual cues to orient toward and follow females and to select the ipsilateral wing for courtship song. Here, we show that the LC10 visual projection neurons convey essential visual information during courtship. Males with LC10 neurons silenced are unable to orient toward or maintain proximity to the female and do not predominantly use the ipsilateral wing when singing. LC10 neurons preferentially respond to small moving objects using an antagonistic motion-based center-surround mechanism. Unilateral activation of LC10 neurons recapitulates the orienting and ipsilateral wing extension normally elicited by females, and the potency with which LC10 induces wing extension is enhanced in a state of courtship arousal controlled by male-specific P1 neurons. These data suggest that LC10 is a major pathway relaying visual input to the courtship circuits in the male brain.

Descending neurons from the lateral accessory lobe and posterior slope in the brain of the silkmoth Bombyx mori

A population of descending neurons connect the brain and thoracic motor center, playing a critical role in controlling behavior. We examined the anatomical organization of descending neurons (DNs) in the brain of the silkmoth Bombyx mori. Moth pheromone orientation is a good model to investigate neuronal mechanisms of behavior. Based on mass staining and single-cell staining, we evaluated the anatomical organization of neurite distribution by DNs in the brain. Dense innervation was observed in the posterior-ventral part of the brain called the posterior slope (PS). We analyzed the morphology of DNs innervating the lateral accessory lobe (LAL), which is considered important for moth olfactory behavior. We observed that all LAL DNs also innervate the PS, suggesting the integration of signals from the LAL and PS. We also identified a set of DNs innervating the PS but not the LAL. These DNs were sensitive to the sex pheromone, suggesting a role of the PS in motor control for pheromone processing. Here we discuss the organization of descending pathways for pheromone orientation.

A biophysical mechanism for preferred direction enhancement in fly motion vision

Seeing the direction of motion is essential for survival of all sighted animals. Consequently, nerve cells that respond to visual stimuli moving in one but not in the opposite direction, so-called 'direction-selective' neurons, are found abundantly. In general, direction selectivity can arise by either signal amplification for stimuli moving in the cell's preferred direction ('preferred direction enhancement'), signal suppression for stimuli moving along the opposite direction ('null direction suppression'), or a combination of both. While signal suppression can be readily implemented in biophysical terms by a hyperpolarization followed by a rectification corresponding to the nonlinear voltage-dependence of the Calcium channel, the biophysical mechanism for signal amplification has remained unclear so far. Taking inspiration from the fly, I analyze a neural circuit where a direction-selective ON-cell receives inhibitory input from an OFF cell on the preferred side of the dendrite, while excitatory ON-cells contact the dendrite centrally. This way, an ON edge moving along the cell's preferred direction suppresses the inhibitory input, leading to a release from inhibition in the postsynaptic cell. The benefit of such a two-fold signal inversion lies in the resulting increase of the postsynaptic cell's input resistance, amplifying its response to a subsequent excitatory input signal even with a passive dendrite, i.e. without voltage-gated ion channels. A motion detector implementing this mechanism together with null direction suppression shows a high degree of direction selectivity over a large range of temporal frequency, narrow directional tuning, and a large signal-to-noise ratio.

Visual approach computation in feeding hoverflies

On warm sunny days, female hoverflies are often observed feeding from a wide range of wild and cultivated flowers. In doing so, hoverflies serve a vital role as alternative pollinators, and are suggested to be the most important pollinators after bees and bumblebees. Unless the flower hoverflies are feeding from is large, they do not readily share the space with other insects, but instead opt to leave if another insect approaches. We used high-speed videography followed by 3D reconstruction of flight trajectories to quantify how female Eristalis hoverflies respond to approaching bees, wasps and two different hoverfly species. We found that, in 94% of the interactions, the occupant female left the flower when approached by another insect. We found that compared with spontaneous take-offs, the occupant hoverfly's escape response was performed at ∼3 times higher speed (spontaneous take-off at 0.2±0.05 m s⁻¹ compared with 0.55±0.08 m s⁻¹ when approached by another Eristalis). The hoverflies tended to take off upward and forward, while taking the incomer's approach angle into account. Intriguingly, we found that, when approached by wasps, the occupant Eristalis took off at a higher speed and when the wasp was further away. This suggests that feeding hoverflies may be able to distinguish these predators, demanding impressive visual capabilities. Our results, including quantification of the visual information available before occupant take-off, provide important insight into how freely behaving hoverflies perform escape responses from competitors and predators (e.g. wasps) in the wild.

Highlighted Article: Reconstruction of the take-off and flight of feeding female hoverflies when approached by other insects, and quantification of visual parameters, reveals how freely behaving hoverflies perform escape responses from competitors and predators in the wild.

Contrast thresholds reveal different visual masking functions in humans and praying mantises

Recently, we showed a novel property of the Hassenstein–Reichardt detector, namely that insect motion detection can be masked by ‘undetectable’ noise, i.e. visual noise presented at spatial frequencies at which coherently moving gratings do not elicit a response (Tarawneh et al., 2017). That study compared the responses of human and insect motion detectors using different ways of quantifying masking (contrast threshold in humans and masking tuning function in insects). In addition, some adjustments in experimental procedure, such as presenting the stimulus at a short viewing distance, were necessary to elicit a response in insects. These differences offer alternative explanations for the observed difference between human and insect responses to visual motion noise. Here, we report the results of new masking experiments in which we test whether differences in experimental paradigm and stimulus presentation between humans and insects can account for the undetectable noise effect reported earlier. We obtained contrast thresholds at two signal and two noise frequencies in both humans and praying mantises (Sphodromantis lineola), and compared contrast threshold differences when noise has the same versus different spatial frequency as the signal. Furthermore, we investigated whether differences in viewing geometry had any qualitative impact on the results. Consistent with our earlier finding, differences in contrast threshold show that visual noise masks much more effectively when presented at signal spatial frequency in humans (compared to a lower or higher spatial frequency), while in insects, noise is roughly equivalently effective when presented at either the signal spatial frequency or lower (compared to a higher spatial frequency). The characteristic difference between human and insect responses was unaffected by correcting for the stimulus distortion caused by short viewing distances in insects. These findings constitute stronger evidence that the undetectable noise effect reported earlier is a genuine difference between human and insect motion processing, and not an artefact caused by differences in experimental paradigms.

Summary: We investigate alternative explanations for a reported difference between human and insect responses to masked moving gratings, and demonstrate that it is a genuine feature of their visual systems.

Role of side-slip flight in target pursuit: blue-tailed damselflies (Ischnura elegans) avoid body rotation while approaching a moving perch

Visually guided flight control requires processing changes in the visual panorama (optic-flow) resulting from self-movement relative to stationary objects, as well as from moving objects passing through the field of view. We studied the ability of the blue-tailed damselfly, Ischnura elegans, to successfully land on a perch moving unpredictably. We tracked the insects landing on a vertical pole moved linearly 6 cm back and forth with sinusoidal changes in velocity. When the moving perch changed direction at frequencies higher than 1 Hz, the damselflies engaged in manoeuvres that typically involved sideways flight, with minimal changes in body orientation relative to the stationary environment. We show that these flight manoeuvres attempted to fix the target in the centre of the field of view when flying in any direction while keeping body rotation changes about the yaw axis to the minimum. We propose that this pursuit strategy allows the insect to obtain reliable information on self and target motion relative to the stationary environment from the translational optic-flow, while minimizing interference from the rotational optic-flow. The ability of damselflies to fly in any direction, irrespective of body orientation, underlines the superb flight control of these aerial predators.

Spatial Encoding of Translational Optic Flow in Planar Scenes by Elementary Motion Detector Arrays

Elementary Motion Detectors (EMD) are well-established models of visual motion estimation in insects. The response of EMDs are tuned to specific temporal and spatial frequencies of the input stimuli, which matches the behavioural response of insects to wide-field image rotation, called the optomotor response. However, other behaviours, such as speed and position control, cannot be fully accounted for by EMDs because these behaviours are largely unaffected by image properties and appear to be controlled by the ratio between the flight speed and the distance to an object, defined here as relative nearness. We present a method that resolves this inconsistency by extracting an unambiguous estimate of relative nearness from the output of an EMD array. Our method is suitable for estimation of relative nearness in planar scenes such as when flying above the ground or beside large flat objects. We demonstrate closed loop control of the lateral position and forward velocity of a simulated agent flying in a corridor. This finding may explain how insects can measure relative nearness and control their flight despite the frequency tuning of EMDs. Our method also provides engineers with a relative nearness estimation technique that benefits from the low computational cost of EMDs.

Non-uniform weighting of local motion inputs underlies dendritic computation in the fly visual system

The fly visual system offers a unique opportunity to explore computations performed by single neurons. Two previous studies characterized, in vivo, the receptive field (RF) of the vertical system (VS) cells of the blowfly (calliphora vicina), both intracellularly in the axon, and, independently using Ca²⁺ imaging, in hundreds of distal dendritic branchlets. We integrated this information into detailed passive cable and compartmental models of 3D reconstructed VS cells. Within a given VS cell type, the transfer resistance (TR) from different branchlets to the axon differs substantially, suggesting that they contribute unequally to the shaping of the axonal RF. Weighting the local RFs of all dendritic branchlets by their respective TR yielded a faithful reproduction of the axonal RF. The model also predicted that the various dendritic branchlets are electrically decoupled from each other, thus acting as independent local functional subunits. The study suggests that single neurons in the fly visual system filter dendritic noise and compute the weighted average of their inputs.

The promise and perils of causal circuit manipulations

The development of increasingly sophisticated methods for recording and manipulating neural activity is revolutionizing neuroscience. By probing how activity patterns in different types of neurons and circuits contribute to behavior, these tools can help inform mechanistic models of brain function and explain the roles of distinct circuit elements. However, in systems where functions are distributed over large networks, interpreting causality experiments can be challenging. Here we review common assumptions underlying circuit manipulations in behaving animals and discuss the strengths and limitations of different approaches.

Higher-order neural processing tunes motion neurons to visual ecology in three species of hawkmoths

To sample information optimally, sensory systems must adapt to the ecological demands of each animal species. These adaptations can occur peripherally, in the anatomical structures of sensory organs and their receptors; and centrally, as higher-order neural processing in the brain. While a rich body of investigations has focused on peripheral adaptations, our understanding is sparse when it comes to central mechanisms. We quantified how peripheral adaptations in the eyes, and central adaptations in the wide-field motion vision system, set the trade-off between resolution and sensitivity in three species of hawkmoths active at very different light levels: nocturnal Deilephila elpenor, crepuscular Manduca sexta, and diurnal Macroglossum stellatarum. Using optical measurements and physiological recordings from the photoreceptors and wide-field motion neurons in the lobula complex, we demonstrate that all three species use spatial and temporal summation to improve visual performance in dim light. The diurnal Macroglossum relies least on summation, but can only see at brighter intensities. Manduca, with large sensitive eyes, relies less on neural summation than the smaller eyed Deilephila, but both species attain similar visual performance at nocturnal light levels. Our results reveal how the visual systems of these three hawkmoth species are intimately matched to their visual ecologies.

Local motion adaptation enhances the representation of spatial structure at EMD arrays

Neuronal representation and extraction of spatial information are essential for behavioral control. For flying insects, a plausible way to gain spatial information is to exploit distance-dependent optic flow that is generated during translational self-motion. Optic flow is computed by arrays of local motion detectors retinotopically arranged in the second neuropile layer of the insect visual system. These motion detectors have adaptive response characteristics, i.e. their responses to motion with a constant or only slowly changing velocity decrease, while their sensitivity to rapid velocity changes is maintained or even increases. We analyzed by a modeling approach how motion adaptation affects signal representation at the output of arrays of motion detectors during simulated flight in artificial and natural 3D environments. We focused on translational flight, because spatial information is only contained in the optic flow induced by translational locomotion. Indeed, flies, bees and other insects segregate their flight into relatively long intersaccadic translational flight sections interspersed with brief and rapid saccadic turns, presumably to maximize periods of translation (80% of the flight). With a novel adaptive model of the insect visual motion pathway we could show that the motion detector responses to background structures of cluttered environments are largely attenuated as a consequence of motion adaptation, while responses to foreground objects stay constant or even increase. This conclusion even holds under the dynamic flight conditions of insects.