Adaptation of response transients in fly motion vision. II: Model studies

Maximally efficient prediction in the early fly visual system may support evasive flight maneuvers

The visual system must make predictions to compensate for inherent delays in its processing. Yet little is known, mechanistically, about how prediction aids natural behaviors. Here, we show that despite a 20-30ms intrinsic processing delay, the vertical motion sensitive (VS) network of the blowfly achieves maximally efficient prediction. This prediction enables the fly to fine-tune its complex, yet brief, evasive flight maneuvers according to its initial ego-rotation at the time of detection of the visual threat. Combining a rich database of behavioral recordings with detailed compartmental modeling of the VS network, we further show that the VS network has axonal gap junctions that are critical for optimal prediction. During evasive maneuvers, a VS subpopulation that directly innervates the neck motor center can convey predictive information about the fly’s future ego-rotation, potentially crucial for ongoing flight control. These results suggest a novel sensory-motor pathway that links sensory prediction to behavior.

Survival-critical behaviors shape neural circuits to translate sensory information into strikingly fast predictions, e.g. in escaping from a predator faster than the system’s processing delay. We show that the fly visual system implements fast and accurate prediction of its visual experience. This provides crucial information for directing fast evasive maneuvers that unfold over just 40ms. Our work shows how this fast prediction is implemented, mechanistically, and suggests the existence of a novel sensory-motor pathway from the fly visual system to a wing steering motor neuron. Echoing and amplifying previous work in the retina, our work hypothesizes that the efficient encoding of predictive information is a universal design principle supporting fast, natural behaviors.

Fly eyes are not still: a motion illusion in Drosophila flight supports parallel visual processing

Most animals shift gaze by a 'fixate and saccade' strategy, where the fixation phase stabilizes background motion. A logical prerequisite for robust detection and tracking of moving foreground objects, therefore, is to suppress the perception of background motion. In a virtual reality magnetic tether system enabling free yaw movement, Drosophila implemented a fixate and saccade strategy in the presence of a static panorama. When the spatial wavelength of a vertical grating was below the Nyquist wavelength of the compound eyes, flies drifted continuously and gaze could not be maintained at a single location. Because the drift occurs from a motionless stimulus - thus any perceived motion stimuli are generated by the fly itself - it is illusory, driven by perceptual aliasing. Notably, the drift speed was significantly faster than under a uniform panorama, suggesting perceptual enhancement as a result of aliasing. Under the same visual conditions in a rigid-tether paradigm, wing steering responses to the unresolvable static panorama were not distinguishable from those to a resolvable static pattern, suggesting visual aliasing is induced by ego motion. We hypothesized that obstructing the control of gaze fixation also disrupts detection and tracking of objects. Using the illusory motion stimulus, we show that magnetically tethered Drosophila track objects robustly in flight even when gaze is not fixated as flies continuously drift. Taken together, our study provides further support for parallel visual motion processing and reveals the critical influence of body motion on visuomotor processing. Motion illusions can reveal important shared principles of information processing across taxa.

Dynamic Signal Compression for Robust Motion Vision in Flies

Sensory systems need to reliably extract information from highly variable natural signals. Flies, for instance, use optic flow to guide their course and are remarkably adept at estimating image velocity regardless of image statistics. Current circuit models, however, cannot account for this robustness. Here, we demonstrate that the Drosophila visual system reduces input variability by rapidly adjusting its sensitivity to local contrast conditions. We exhaustively map functional properties of neurons in the motion detection circuit and find that local responses are compressed by surround contrast. The compressive signal is fast, integrates spatially, and derives from neural feedback. Training convolutional neural networks on estimating the velocity of natural stimuli shows that this dynamic signal compression can close the performance gap between model and organism. Overall, our work represents a comprehensive mechanistic account of how neural systems attain the robustness to carry out survival-critical tasks in challenging real-world environments.

How fly neurons compute the direction of visual motion

Detecting the direction of image motion is a fundamental component of visual computation, essential for survival of the animal. However, at the level of individual photoreceptors, the direction in which the image is shifting is not explicitly represented. Rather, directional motion information needs to be extracted from the photoreceptor array by comparing the signals of neighboring units over time. The exact nature of this process as implemented in the visual system of the fruit fly Drosophila melanogaster has been studied in great detail, and much progress has recently been made in determining the neural circuits giving rise to directional motion information. The results reveal the following: (1) motion information is computed in parallel ON and OFF pathways. (2) Within each pathway, T4 (ON) and T5 (OFF) cells are the first neurons to represent the direction of motion. Four subtypes of T4 and T5 cells exist, each sensitive to one of the four cardinal directions. (3) The core process of direction selectivity as implemented on the dendrites of T4 and T5 cells comprises both an enhancement of signals for motion along their preferred direction as well as a suppression of signals for motion along the opposite direction. This combined strategy ensures a high degree of direction selectivity right at the first stage where the direction of motion is computed. (4) At the subsequent processing stage, tangential cells spatially integrate direct excitation from ON and OFF-selective T4 and T5 cells and indirect inhibition from bi-stratified LPi cells activated by neighboring T4/T5 terminals, thus generating flow-field-selective responses.

Local motion adaptation enhances the representation of spatial structure at EMD arrays

Neuronal representation and extraction of spatial information are essential for behavioral control. For flying insects, a plausible way to gain spatial information is to exploit distance-dependent optic flow that is generated during translational self-motion. Optic flow is computed by arrays of local motion detectors retinotopically arranged in the second neuropile layer of the insect visual system. These motion detectors have adaptive response characteristics, i.e. their responses to motion with a constant or only slowly changing velocity decrease, while their sensitivity to rapid velocity changes is maintained or even increases. We analyzed by a modeling approach how motion adaptation affects signal representation at the output of arrays of motion detectors during simulated flight in artificial and natural 3D environments. We focused on translational flight, because spatial information is only contained in the optic flow induced by translational locomotion. Indeed, flies, bees and other insects segregate their flight into relatively long intersaccadic translational flight sections interspersed with brief and rapid saccadic turns, presumably to maximize periods of translation (80% of the flight). With a novel adaptive model of the insect visual motion pathway we could show that the motion detector responses to background structures of cluttered environments are largely attenuated as a consequence of motion adaptation, while responses to foreground objects stay constant or even increase. This conclusion even holds under the dynamic flight conditions of insects.

Neural mechanisms underlying sensitivity to reverse-phi motion in the fly

Optical illusions provide powerful tools for mapping the algorithms and circuits that underlie visual processing, revealing structure through atypical function. Of particular note in the study of motion detection has been the reverse-phi illusion. When contrast reversals accompany discrete movement, detected direction tends to invert. This occurs across a wide range of organisms, spanning humans and invertebrates. Here, we map an algorithmic account of the phenomenon onto neural circuitry in the fruit fly Drosophila melanogaster. Through targeted silencing experiments in tethered walking flies as well as electrophysiology and calcium imaging, we demonstrate that ON- or OFF-selective local motion detector cells T4 and T5 are sensitive to certain interactions between ON and OFF. A biologically plausible detector model accounts for subtle features of this particular form of illusory motion reversal, like the re-inversion of turning responses occurring at extreme stimulus velocities. In light of comparable circuit architecture in the mammalian retina, we suggest that similar mechanisms may apply even to human psychophysics.

Spike Burst Coding of Translatory Optic Flow and Depth from Motion in the Fly Visual System

Many animals use the visual motion generated by traveling straight-the translatory optic flow-to successfully navigate obstacles: near objects appear larger and to move more quickly than distant objects. Flies are expert at navigating cluttered environments, and while their visual processing of rotatory optic flow is understood in exquisite detail, how they process translatory optic flow remains a mystery. We present novel cell types that have local motion receptive fields matched to translation self-motion, the vertical translation (VT) cells. One of these, the VT1 cell, encodes self-motion in the forward-sideslip direction and fires action potentials in spike bursts as well as single spikes. We show that the spike burst coding is size and speed-tuned and is selectively modulated by motion parallax-the relative motion experienced during translation. These properties are spatially organized, so that the cell is most excited by clutter rather than isolated objects. When the fly is presented with a simulation of flying past an elevated object, the spike burst activity is modulated by the height of the object, and the rate of single spikes is unaffected. When the moving object alone is experienced, the cell is weakly driven. Meanwhile, the VT2-3 cells have motion receptive fields matched to the lift axis. In conjunction with previously described horizontal cells, the VT cells have properties well suited to the visual navigation of clutter and to encode the fly's movements along near cardinal axes of thrust, lift, and forward sideslip.

Frequency-selective transmission of graded signals in large monopolar neurons of blowfly Calliphora vicina compound eye

The functional roles of voltage-gated K(+)(Kv) channels in visual system interneurons remain poorly studied. We have addressed this problem in the large monopolar cells (LMCs) of the blowfly Calliphora vicina, using intracellular recordings and mathematical modeling methods. Intracellular recordings were performed in two cellular compartments: the synaptic zone, which receives input from photoreceptors, and the axon, which provides graded potential output to the third-order visual neurons. Biophysical properties of Kv conductances in the physiological voltage range were examined in the dark with injections of current in the discontinuous current-clamp mode. Putative LMC types 1/2 and 3 (L1/2 and L3, respectively) had dissimilar Kv channelomes: L1/2 displayed a prominent inactivating Kv conductance in the axon, while L3 cells were characterized by a sustained delayed-rectifier Kv conductance. To study the propagation of voltage signals, the data were incorporated into the previously developed mathematical model. We demonstrate that the complex interaction between the passive membrane properties, Kv conductances, and the neuronal geometry leads to a resonance-like filtering of signals with peak frequencies of transmission near 15 and 40 Hz for L3 and L1/2, respectively. These results point to distinct physiological roles of different types of LMCs.

A Bio-inspired Collision Avoidance Model Based on Spatial Information Derived from Motion Detectors Leads to Common Routes

Avoiding collisions is one of the most basic needs of any mobile agent, both biological and technical, when searching around or aiming toward a goal. We propose a model of collision avoidance inspired by behavioral experiments on insects and by properties of optic flow on a spherical eye experienced during translation, and test the interaction of this model with goal-driven behavior. Insects, such as flies and bees, actively separate the rotational and translational optic flow components via behavior, i.e. by employing a saccadic strategy of flight and gaze control. Optic flow experienced during translation, i.e. during intersaccadic phases, contains information on the depth-structure of the environment, but this information is entangled with that on self-motion. Here, we propose a simple model to extract the depth structure from translational optic flow by using local properties of a spherical eye. On this basis, a motion direction of the agent is computed that ensures collision avoidance. Flying insects are thought to measure optic flow by correlation-type elementary motion detectors. Their responses depend, in addition to velocity, on the texture and contrast of objects and, thus, do not measure the velocity of objects veridically. Therefore, we initially used geometrically determined optic flow as input to a collision avoidance algorithm to show that depth information inferred from optic flow is sufficient to account for collision avoidance under closed-loop conditions. Then, the collision avoidance algorithm was tested with bio-inspired correlation-type elementary motion detectors in its input. Even then, the algorithm led successfully to collision avoidance and, in addition, replicated the characteristics of collision avoidance behavior of insects. Finally, the collision avoidance algorithm was combined with a goal direction and tested in cluttered environments. The simulated agent then showed goal-directed behavior reminiscent of components of the navigation behavior of insects.

Insect-Inspired Self-Motion Estimation with Dense Flow Fields--An Adaptive Matched Filter Approach

The control of self-motion is a basic, but complex task for both technical and biological systems. Various algorithms have been proposed that allow the estimation of self-motion from the optic flow on the eyes. We show that two apparently very different approaches to solve this task, one technically and one biologically inspired, can be transformed into each other under certain conditions. One estimator of self-motion is based on a matched filter approach; it has been developed to describe the function of motion sensitive cells in the fly brain. The other estimator, the Koenderink and van Doorn (KvD) algorithm, was derived analytically with a technical background. If the distances to the objects in the environment can be assumed to be known, the two estimators are linear and equivalent, but are expressed in different mathematical forms. However, for most situations it is unrealistic to assume that the distances are known. Therefore, the depth structure of the environment needs to be determined in parallel to the self-motion parameters and leads to a non-linear problem. It is shown that the standard least mean square approach that is used by the KvD algorithm leads to a biased estimator. We derive a modification of this algorithm in order to remove the bias and demonstrate its improved performance by means of numerical simulations. For self-motion estimation it is beneficial to have a spherical visual field, similar to many flying insects. We show that in this case the representation of the depth structure of the environment derived from the optic flow can be simplified. Based on this result, we develop an adaptive matched filter approach for systems with a nearly spherical visual field. Then only eight parameters about the environment have to be memorized and updated during self-motion.

Near-optimal decoding of transient stimuli from coupled neuronal subpopulations

Coupling between sensory neurons impacts their tuning properties and correlations in their responses. How such coupling affects sensory representations and ultimately behavior remains unclear. We investigated the role of neuronal coupling during visual processing using a realistic biophysical model of the vertical system (VS) cell network in the blow fly. These neurons are thought to encode the horizontal rotation axis during rapid free-flight maneuvers. Experimental findings suggest that neurons of the VS are strongly electrically coupled, and that several downstream neurons driving motor responses to ego-rotation receive inputs primarily from a small subset of VS cells. These downstream neurons must decode information about the axis of rotation from a partial readout of the VS population response. To investigate the role of coupling, we simulated the VS response to a variety of rotating visual scenes and computed optimal Bayesian estimates from the relevant subset of VS cells. Our analysis shows that coupling leads to near-optimal estimates from a subpopulation readout. In contrast, coupling between VS cells has no impact on the quality of encoding in the response of the full population. We conclude that coupling at one level of the fly visual system allows for near-optimal decoding from partial information at the subsequent, premotor level. Thus, electrical coupling may provide a general mechanism to achieve near-optimal information transfer from neuronal subpopulations across organisms and modalities.

Motion as a source of environmental information: a fresh view on biological motion computation by insect brains

Despite their miniature brains insects, such as flies, bees and wasps, are able to navigate by highly erobatic flight maneuvers in cluttered environments. They rely on spatial information that is contained in the retinal motion patterns induced on the eyes while moving around ("optic flow") to accomplish their extraordinary performance. Thereby, they employ an active flight and gaze strategy that separates rapid saccade-like turns from translatory flight phases where the gaze direction is kept largely constant. This behavioral strategy facilitates the processing of environmental information, because information about the distance of the animal to objects in the environment is only contained in the optic flow generated by translatory motion. However, motion detectors as are widespread in biological systems do not represent veridically the velocity of the optic flow vectors, but also reflect textural information about the environment. This characteristic has often been regarded as a limitation of a biological motion detection mechanism. In contrast, we conclude from analyses challenging insect movement detectors with image flow as generated during translatory locomotion through cluttered natural environments that this mechanism represents the contours of nearby objects. Contrast borders are a main carrier of functionally relevant object information in artificial and natural sceneries. The motion detection system thus segregates in a computationally parsimonious way the environment into behaviorally relevant nearby objects and-in many behavioral contexts-less relevant distant structures. Hence, by making use of an active flight and gaze strategy, insects are capable of performing extraordinarily well even with a computationally simple motion detection mechanism.

In search of the Holy Grail of fly motion vision

Detecting the direction of image motion is important for visual navigation as well as predator, prey and mate detection and, thus, essential for the survival of all animals that have eyes. However, the direction of motion is not explicitly represented at the level of the photoreceptors: it rather needs to be computed by subsequent neural circuits, involving a comparison of the signals from neighbouring photoreceptors over time. The exact nature of this process as implemented at the neuronal level has been a long-standing question in the field. Only recently, much progress has been made in Drosophila by genetically targeting individual neuron types to block, activate or record from them. The results obtained this way indicate that: (i) luminance information from fly photoreceptors R1-6 is split into two parallel motion circuits, specialized to detect the motion of luminance increments (ON-Channel) and decrements (OFF-Channel) separately; (ii) lamina neurons L1 and L2 are the primary input neurons to these circuits (L1 → ON-channel, L2 → OFF-channel); and (iii) T4 and T5 cells carry their output signals (ON → T4, OFF → T5).

Fly visual course control: behaviour, algorithms and circuits

Understanding how the brain controls behaviour is undisputedly one of the grand goals of neuroscience research, and the pursuit of this goal has a long tradition in insect neuroscience. However, appropriate techniques were lacking for a long time. Recent advances in genetic and recording techniques now allow the participation of identified neurons in the execution of specific behaviours to be interrogated. By focusing on fly visual course control, I highlight what has been learned about the neuronal circuit modules that control visual guidance in Drosophila melanogaster through the use of these techniques.

Depth information in natural environments derived from optic flow by insect motion detection system: a model analysis

Knowing the depth structure of the environment is crucial for moving animals in many behavioral contexts, such as collision avoidance, targeting objects, or spatial navigation. An important source of depth information is motion parallax. This powerful cue is generated on the eyes during translatory self-motion with the retinal images of nearby objects moving faster than those of distant ones. To investigate how the visual motion pathway represents motion-based depth information we analyzed its responses to image sequences recorded in natural cluttered environments with a wide range of depth structures. The analysis was done on the basis of an experimentally validated model of the visual motion pathway of insects, with its core elements being correlation-type elementary motion detectors (EMDs). It is the key result of our analysis that the absolute EMD responses, i.e., the motion energy profile, represent the contrast-weighted nearness of environmental structures during translatory self-motion at a roughly constant velocity. In other words, the output of the EMD array highlights contours of nearby objects. This conclusion is largely independent of the scale over which EMDs are spatially pooled and was corroborated by scrutinizing the motion energy profile after eliminating the depth structure from the natural image sequences. Hence, the well-established dependence of correlation-type EMDs on both velocity and textural properties of motion stimuli appears to be advantageous for representing behaviorally relevant information about the environment in a computationally parsimonious way.

Space-time wiring specificity supports direction selectivity in the retina

How does the mammalian retina detect motion? This classic problem in visual neuroscience has remained unsolved for 50 years. In search of clues, we reconstructed Off-type starburst amacrine cells (SACs) and bipolar cells (BCs) in serial electron microscopic images with help from EyeWire, an online community of “citizen neuroscientists.” Based on quantitative analyses of contact area and branch depth in the retina, we found evidence that one BC type prefers to wire with a SAC dendrite near the SAC soma, while another BC type prefers to wire far from the soma. The near type is known to lag the far type in time of visual response. A mathematical model shows how such “space-time wiring specificity” could endow SAC dendrites with receptive fields that are oriented in space-time and therefore respond selectively to stimuli that move in the outward direction from the soma.

Neural circuits for elementary motion detection

Detecting the direction of image motion is a fundamental component of visual computation and is essential for survival of the animal. However, at the level of the photoreceptors, the direction in which the image is shifting locally is not explicitly represented. Rather, directional motion information needs to be extracted from the photoreceptor array by comparing the signals of neighboring photoreceptors over time. The exact nature of this process as implemented in the Drosophila visual system is currently being studied in great detail, and much progress has recently been made in determining the neural circuits giving rise to directional motion information in this species.

GABAergic lateral interactions tune the early stages of visual processing in Drosophila

Early stages of visual processing must capture complex, dynamic inputs. While peripheral neurons often implement efficient encoding by exploiting natural stimulus statistics, downstream neurons are specialized to extract behaviorally relevant features. How do these specializations arise? We use two-photon imaging in Drosophila to characterize a first-order interneuron, L2, that provides input to a pathway specialized for detecting moving dark edges. GABAergic interactions, mediated in part presynaptically, create an antagonistic and anisotropic center-surround receptive field. This receptive field is spatiotemporally coupled, applying differential temporal processing to large and small dark objects, achieving significant specialization. GABAergic circuits also mediate OFF responses and balance these with responses to ON stimuli. Remarkably, the functional properties of L2 are strikingly similar to those of bipolar cells, yet emerge through different molecular and circuit mechanisms. Thus, evolution appears to have converged on a common strategy for processing visual information at the first synapse.

Spatial vision in insects is facilitated by shaping the dynamics of visual input through behavioral action

Insects such as flies or bees, with their miniature brains, are able to control highly aerobatic flight maneuvres and to solve spatial vision tasks, such as avoiding collisions with obstacles, landing on objects, or even localizing a previously learnt inconspicuous goal on the basis of environmental cues. With regard to solving such spatial tasks, these insects still outperform man-made autonomous flying systems. To accomplish their extraordinary performance, flies and bees have been shown by their characteristic behavioral actions to actively shape the dynamics of the image flow on their eyes ("optic flow"). The neural processing of information about the spatial layout of the environment is greatly facilitated by segregating the rotational from the translational optic flow component through a saccadic flight and gaze strategy. This active vision strategy thus enables the nervous system to solve apparently complex spatial vision tasks in a particularly efficient and parsimonious way. The key idea of this review is that biological agents, such as flies or bees, acquire at least part of their strength as autonomous systems through active interactions with their environment and not by simply processing passively gained information about the world. These agent-environment interactions lead to adaptive behavior in surroundings of a wide range of complexity. Animals with even tiny brains, such as insects, are capable of performing extraordinarily well in their behavioral contexts by making optimal use of the closed action-perception loop. Model simulations and robotic implementations show that the smart biological mechanisms of motion computation and visually-guided flight control might be helpful to find technical solutions, for example, when designing micro air vehicles carrying a miniaturized, low-weight on-board processor.

Visual motion speed determines a behavioral switch from forward flight to expansion avoidance in Drosophila

As an animal translates through the world, its eyes will experience a radiating pattern of optic flow in which there is a focus of expansion directly in front and a focus of contraction behind. For flying fruit flies, recent experiments indicate that flies actively steer away from patterns of expansion. Whereas such a reflex makes sense for avoiding obstacles, it presents a paradox of sorts because an insect could not navigate stably through a visual scene unless it tolerated flight towards a focus of expansion during episodes of forward translation. One possible solution to this paradox is that a fly's behavior might change such that it steers away from strong expansion, but actively steers towards weak expansion. In this study, we use a tethered flight arena to investigate the influence of stimulus strength on the magnitude and direction of turning responses to visual expansion in flies. These experiments indicate that the expansion-avoidance behavior is speed dependent. At slower speeds of expansion, flies exhibit an attraction to the focus of expansion, whereas the behavior transforms to expansion avoidance at higher speeds. Open-loop experiments indicate that this inversion of the expansion-avoidance response depends on whether or not the head is fixed to the thorax. The inversion of the expansion-avoidance response with stimulus strength has a clear manifestation under closed-loop conditions. Flies will actively orient towards a focus of expansion at low temporal frequency but steer away from it at high temporal frequency. The change in the response with temporal frequency does not require motion stimuli directly in front or behind the fly. Animals in which the stimulus was presented within 120 deg sectors on each side consistently steered towards expansion at low temporal frequency and steered towards contraction at high temporal frequency. A simple model based on an array of Hassenstein-Reichardt type elementary movement detectors suggests that the inversion of the expansion-avoidance reflex can explain the spatial distribution of straight flight segments and collision-avoidance saccades when flies fly freely within an open circular arena.

Neuronal encoding of object and distance information: a model simulation study on naturalistic optic flow processing

We developed a model of the input circuitry of the FD1 cell, an identified motion-sensitive interneuron in the blowfly's visual system. The model circuit successfully reproduces the FD1 cell's most conspicuous property: its larger responses to objects than to spatially extended patterns. The model circuit also mimics the time-dependent responses of FD1 to dynamically complex naturalistic stimuli, shaped by the blowfly's saccadic flight and gaze strategy: the FD1 responses are enhanced when, as a consequence of self-motion, a nearby object crosses the receptive field during intersaccadic intervals. Moreover, the model predicts that these object-induced responses are superimposed by pronounced pattern-dependent fluctuations during movements on virtual test flights in a three-dimensional environment with systematic modifications of the environmental patterns. Hence, the FD1 cell is predicted to detect not unambiguously objects defined by the spatial layout of the environment, but to be also sensitive to objects distinguished by textural features. These ambiguous detection abilities suggest an encoding of information about objects-irrespective of the features by which the objects are defined-by a population of cells, with the FD1 cell presumably playing a prominent role in such an ensemble.

Bio-inspired visual ego-rotation sensor for MAVs

Flies are capable of extraordinary flight maneuvers at very high speeds largely due to their highly elaborate visual system. In this work we present a fly-inspired FPGA based sensor system able to visually sense rotations around different body axes, for use on board micro aerial vehicles (MAVs). Rotation sensing is performed analogously to the fly's VS cell network using zero-crossing detection. An additional key feature of our system is the ease of adding new functionalities akin to the different tasks attributed to the fly's lobula plate tangential cell network, such as object avoidance or collision detection. Our implementation consists of a modified eneo SC-MVC01 SmartCam module and a custom built circuit board, weighing less than 200 g and consuming less than 4 W while featuring 57,600 individual two-dimensional elementary motion detectors, a 185° field of view and a frame rate of 350 frames per second. This makes our sensor system compact in terms of size, weight and power requirements for easy incorporation into MAV platforms, while autonomously performing all sensing and processing on-board and in real time.

Flight activity alters velocity tuning of fly motion-sensitive neurons

Sensory neurons are mostly studied in fixed animals, but their response properties might change when the animal is free to move. Indeed, recent studies found differences between responses of sensory neurons in resting versus moving insects. Since the dynamic range of visual motion stimuli strongly depends on the speed at which an animal is moving, we investigated whether the visual system adapts to such changes in stimulus dynamics as induced by self-motion. Lobula plate tangential cells of flies lend themselves well to study this question because they are known to code for ego-motion based on optic-flow. We recorded the responses of the lobula plate tangential cell H1 to a visual pattern moving at different velocities under three different conditions: fixed flies before and after application of the octopamine agonist chlordimeform (CDM) and tethered flying flies. CDM has been previously shown to induce arousal in flies. We found that flying as well as the application of CDM significantly broadens the velocity tuning of H1 toward higher velocities.

Pattern-dependent response modulations in motion-sensitive visual interneurons--a model study

Even if a stimulus pattern moves at a constant velocity across the receptive field of motion-sensitive neurons, such as lobula plate tangential cells (LPTCs) of flies, the response amplitude modulates over time. The amplitude of these response modulations is related to local pattern properties of the moving retinal image. On the one hand, pattern-dependent response modulations have previously been interpreted as 'pattern-noise', because they deteriorate the neuron's ability to provide unambiguous velocity information. On the other hand, these modulations might also provide the system with valuable information about the textural properties of the environment. We analyzed the influence of the size and shape of receptive fields by simulations of four versions of LPTC models consisting of arrays of elementary motion detectors of the correlation type (EMDs). These models have previously been suggested to account for many aspects of LPTC response properties. Pattern-dependent response modulations decrease with an increasing number of EMDs included in the receptive field of the LPTC models, since spatial changes within the visual field are smoothed out by the summation of spatially displaced EMD responses. This effect depends on the shape of the receptive field, being the more pronounced--for a given total size--the more elongated the receptive field is along the direction of motion. Large elongated receptive fields improve the quality of velocity signals. However, if motion signals need to be localized the velocity coding is only poor but the signal provides--potentially useful--local pattern information. These modelling results suggest that motion vision by correlation type movement detectors is subject to uncertainty: you cannot obtain both an unambiguous and a localized velocity signal from the output of a single cell. Hence, the size and shape of receptive fields of motion sensitive neurons should be matched to their potential computational task.

Binocular integration of visual information: a model study on naturalistic optic flow processing

The computation of visual information from both visual hemispheres is often of functional relevance when solving orientation and navigation tasks. The vCH-cell is a motion-sensitive wide-field neuron in the visual system of the blowfly Calliphora, a model system in the field of optic flow processing. The vCH-cell receives input from various other identified wide-field cells, the receptive fields of which are located in both the ipsilateral and the contralateral visual field. The relevance of this connectivity to the processing of naturalistic image sequences, with their peculiar dynamical characteristics, is still unresolved. To disentangle the contributions of the different input components to the cell's overall response, we used electrophysiologically determined responses of the vCH-cell and its various input elements to tune a model of the vCH-circuit. Their impact on the vCH-cell response could be distinguished by stimulating not only extended parts of the visual field of the fly, but also selected regions in the ipsi- and contralateral visual field with behaviorally generated optic flow. We show that a computational model of the vCH-circuit is able to account for the neuronal activities of the counterparts in the blowfly's visual system. Furthermore, we offer an insight into the dendritic integration of binocular visual input.

Contrast-independent biologically inspired motion detection

Optic flow, i.e., retinal image movement resulting from ego-motion, is a crucial source of information used for obstacle avoidance and course control in flying insects. Optic flow analysis may prove promising for mobile robotics although it is currently not among the standard techniques. Insects have developed a computationally cheap analysis mechanism for image motion. Detailed computational models, the so-called elementary motion detectors (EMDs), describe motion detection in insects. However, the technical application of EMDs is complicated by the strong effect of local pattern contrast on their motion response. Here we present augmented versions of an EMD, the (s)cc-EMDs, which normalise their responses for contrast and thereby reduce the sensitivity to contrast changes. Thus, velocity changes of moving natural images are reflected more reliably in the detector response. The (s)cc-EMDs can easily be implemented in hardware and software and can be a valuable novel visual motion sensor for mobile robots.

Impact of visual motion adaptation on neural responses to objects and its dependence on the temporal characteristics of optic flow

It is still unclear how sensory systems efficiently encode signals with statistics as experienced by animals in the real world and what role adaptation plays during normal behavior. Therefore, we studied the performance of visual motion-sensitive neurons of blowflies, the horizontal system neurons, with optic flow that was reconstructed from the head trajectories of semi-free-flying flies. To test how motion adaptation is affected by optic flow dynamics, we manipulated the seminatural optic flow by targeted modifications of the flight trajectories and assessed to what extent neuronal responses to an object located close to the flight trajectory depend on adaptation dynamics. For all types of adapting optic flow object-induced response increments were stronger in the adapted compared with the nonadapted state. Adaptation with optic flow characterized by the typical alternation between translational and rotational segments produced this effect but also adaptation with optic flow that lacked these distinguishing features and even pure rotation at a constant angular velocity. The enhancement of object-induced response increments had a direction-selective component because preferred-direction rotation and natural optic flow were more efficient adaptors than null-direction rotation. These results indicate that natural dynamics of optic flow is not a basic requirement to adapt neurons in a specific, presumably functionally beneficial way. Our findings are discussed in the light of adaptation mechanisms proposed on the basis of experiments previously done with conventional experimenter-defined stimuli.

Neural action fields for optic flow based navigation: a simulation study of the fly lobula plate network

Optic flow based navigation is a fundamental way of visual course control described in many different species including man. In the fly, an essential part of optic flow analysis is performed in the lobula plate, a retinotopic map of motion in the environment. There, the so-called lobula plate tangential cells possess large receptive fields with different preferred directions in different parts of the visual field. Previous studies demonstrated an extensive connectivity between different tangential cells, providing, in principle, the structural basis for their large and complex receptive fields. We present a network simulation of the tangential cells, comprising most of the neurons studied so far (22 on each hemisphere) with all the known connectivity between them. On their dendrite, model neurons receive input from a retinotopic array of Reichardt-type motion detectors. Model neurons exhibit receptive fields much like their natural counterparts, demonstrating that the connectivity between the lobula plate tangential cells indeed can account for their complex receptive field structure. We describe the tuning of a model neuron to particular types of ego-motion (rotation as well as translation around/along a given body axis) by its ‘action field’. As we show for model neurons of the vertical system (VS-cells), each of them displays a different type of action field, i.e., responds maximally when the fly is rotating around a particular body axis. However, the tuning width of the rotational action fields is relatively broad, comparable to the one with dendritic input only. The additional intra-lobula-plate connectivity mainly reduces their translational action field amplitude, i.e., their sensitivity to translational movements along any body axis of the fly.

Coding efficiency of fly motion processing is set by firing rate, not firing precision

To comprehend the principles underlying sensory information processing, it is important to understand how the nervous system deals with various sources of perturbation. Here, we analyze how the representation of motion information in the fly's nervous system changes with temperature and luminance. Although these two environmental variables have a considerable impact on the fly's nervous system, they do not impede the fly to behave suitably over a wide range of conditions. We recorded responses from a motion-sensitive neuron, the H1-cell, to a time-varying stimulus at many different combinations of temperature and luminance. We found that the mean firing rate, but not firing precision, changes with temperature, while both were affected by mean luminance. Because we also found that information rate and coding efficiency are mainly set by the mean firing rate, our results suggest that, in the face of environmental perturbations, the coding efficiency is improved by an increase in the mean firing rate, rather than by an increased firing precision.

Adaptation accentuates responses of fly motion-sensitive visual neurons to sudden stimulus changes

Adaptation in sensory and neuronal systems usually leads to reduced responses to persistent or frequently presented stimuli. In contrast to simple fatigue, adapted neurons often retain their ability to encode changes in stimulus intensity and to respond when novel stimuli appear. We investigated how the level of adaptation of a fly visual motion-sensitive neuron affects its responses to discontinuities in the stimulus, i.e. sudden brief changes in one of the stimulus parameters (velocity, contrast, grating orientation and spatial frequency). Although the neuron's overall response decreased gradually during ongoing motion stimulation, the response transients elicited by stimulus discontinuities were preserved or even enhanced with adaptation. Moreover, the enhanced sensitivity to velocity changes by adaptation was not restricted to a certain velocity range, but was present regardless of whether the neuron was adapted to a baseline velocity below or above its steady-state velocity optimum. Our results suggest that motion adaptation helps motion-sensitive neurons to preserve their sensitivity to novel stimuli even in the presence of strong tonic stimulation, for example during self-motion.

Drosophila's view on insect vision

Within the last 400 million years, insects have radiated into at least a million species, accounting for more than half of all known living organisms: they are the most successful group in the animal kingdom, found in almost all environments of the planet, ranging in body size from a mere 0.1 mm up to half a meter. Their eyes, together with the respective parts of the nervous system dedicated to the processing of visual information, have long been the subject of intense investigation but, with the exception of some very basic reflexes, it is still not possible to link an insect's visual input to its behavioral output. Fortunately for the field, the fruit fly Drosophila is an insect, too. This genetic workhorse holds great promise for the insect vision field, offering the possibility of recording, suppressing or stimulating any single neuron in its nervous system. Here, I shall give a brief synopsis of what we currently know about insect vision, describe the genetic toolset available in Drosophila and give some recent examples of how the application of these tools have furthered our understanding of color and motion vision in Drosophila.

Bio-inspired motion detection in an FPGA-based smart camera module

Flying insects, despite their relatively coarse vision and tiny nervous system, are capable of carrying out elegant and fast aerial manoeuvres. Studies of the fly visual system have shown that this is accomplished by the integration of signals from a large number of elementary motion detectors (EMDs) in just a few global flow detector cells. We developed an FPGA-based smart camera module with more than 10,000 single EMDs, which is closely modelled after insect motion-detection circuits with respect to overall architecture, resolution and inter-receptor spacing. Input to the EMD array is provided by a CMOS camera with a high frame rate. Designed as an adaptable solution for different engineering applications and as a testbed for biological models, the EMD detector type and parameters such as the EMD time constants, the motion-detection directions and the angle between correlated receptors are reconfigurable online. This allows a flexible and simultaneous detection of complex motion fields such as translation, rotation and looming, such that various tasks, e.g., obstacle avoidance, height/distance control or speed regulation can be performed by the same compact device.

Adaptation of velocity encoding in synaptically coupled neurons in the fly visual system

Although many adaptation-induced effects on neuronal response properties have been described, it is often unknown at what processing stages in the nervous system they are generated. We focused on fly visual motion-sensitive neurons to identify changes in response characteristics during prolonged visual motion stimulation. By simultaneous recordings of synaptically coupled neurons, we were able to directly compare adaptation-induced effects at two consecutive processing stages in the fly visual motion pathway. This allowed us to narrow the potential sites of adaptation effects within the visual system and to relate them to the properties of signal transfer between neurons. Motion adaptation was accompanied by a response reduction, which was somewhat stronger in postsynaptic than in presynaptic cells. We found that the linear representation of motion velocity degrades during adaptation to a white-noise velocity-modulated stimulus. This effect is caused by an increasingly nonlinear velocity representation rather than by an increase of noise and is similarly strong in presynaptic and postsynaptic neurons. In accordance with this similarity, the dynamics and the reliability of interneuronal signal transfer remained nearly constant. Thus, adaptation is mainly based on processes located in the presynaptic neuron or in more peripheral processing stages. In contrast, changes of transfer properties at the analyzed synapse or in postsynaptic spike generation contribute little to changes in velocity coding during motion adaptation.

Response properties of motion-sensitive visual interneurons in the lobula plate of Drosophila melanogaster

The crystalline-like structure of the optic lobes of the fruit fly Drosophila melanogaster has made them a model system for the study of neuronal cell-fate determination, axonal path finding, and target selection. For functional studies, however, the small size of the constituting visual interneurons has so far presented a formidable barrier. We have overcome this problem by establishing in vivo whole-cell recordings from genetically targeted visual interneurons of Drosophila. Here, we describe the response properties of six motion-sensitive large-field neurons in the lobula plate that form a network consisting of individually identifiable, directionally selective cells most sensitive to vertical image motion (VS cells). Individual VS cell responses to visual motion stimuli exhibit all the characteristics that are indicative of presynaptic input from elementary motion detectors of the correlation type. Different VS cells possess distinct receptive fields that are arranged sequentially along the eye's azimuth, corresponding to their characteristic cellular morphology and position within the retinotopically organized lobula plate. In addition, lateral connections between individual VS cells cause strongly overlapping receptive fields that are wider than expected from their dendritic input. Our results suggest that motion vision in different dipteran fly species is accomplished in similar circuitries and according to common algorithmic rules. The underlying neural mechanisms of population coding within the VS cell network and of elementary motion detection, respectively, can now be analyzed by the combination of electrophysiology and genetic intervention in Drosophila.

Adaptation and Information Transmission in Fly Motion Detection

In this work, we studied the adaptation of H1, a motion-sensitive neuron in the fly visual system, to the variance of randomly fluctuating velocity stimuli. We ask two questions. 1) Which components of the motion detection system undergo genuine adaptational changes in response to the variance of the fluctuating velocity signal? 2) What are the consequences of this adaptation for the information processing capabilities of the neuron? To address these questions, we characterized the adaptation of H1 by estimating the changes in the parameters of an associated Reichardt motion detection model under various stimulus conditions. The strongest stimulus dependence was exhibited by the temporal kernel of the motion detector and was parametrized by changes in the model's high-pass time constant (τH). This time constant shortened considerably with increasing velocity fluctuations. We showed that this adaptive process contributes significantly to the shortening of the velocity response time-course but not to velocity gain control. To assess the contribution of time-constant adaptation to information transmission, we compared the information rates generated by our adaptive model motion detector with model simulations in which τH was held fixed at its unadapted value for all stimulus conditions. We found that for intermediate stimulus conditions, fixing τH at its unadapted value led to higher information rates, suggesting that time-constant adaptation does not optimize total information rates about velocity trajectories. We also found that, over the wide range of stimulus conditions tested here, H1 information rates are dependent on the amplitude of velocity fluctuations.

Propagation of photon noise and information transfer in visual motion detection

The extraction of the direction of motion from the time varying retinal images is one of the most basic tasks any visual system is confronted with. However, retinal images are severely corrupted by photon noise, in particular at low light levels, thus limiting the performance of motion detection mechanisms of what sort so ever. Here, we study how photon noise propagates through an array of Reichardt-type motion detectors that are commonly believed to underlie fly motion vision. We provide closed-form analytical expressions of the signal and noise spectra at the output of such a motion detector array. We find that Reichardt detectors reveal favorable noise suppression in the frequency range where most of the signal power resides. Most notably, due to inherent adaptive properties, the transmitted information about stimulus velocity remains nearly constant over a large range of velocity entropies.

Population Coding of Self-Motion: Applying Bayesian Analysis to a Population of Visual Interneurons in the Fly

Coding of sensory information often involves the activity of neuronal populations. We demonstrate how the accuracy of a population code depends on integration time, the size of the population, and noise correlation between the participating neurons. The population we study consists of 10 identified visual interneurons in the blowfly Calliphora vicina involved in optic flow processing. These neurons are assumed to encode the animal's head or body rotations around horizontal axes by means of graded potential changes. From electrophysiological experiments we obtain parameters for modeling the neurons' responses. From applying a Bayesian analysis on the modeled population response we draw three major conclusions. First, integration of neuronal activities over a time period of only 5 ms after response onset is sufficient to decode accurately the rotation axis. Second, noise correlation between neurons has only little impact on the population's performance. And third, although a population of only two neurons would be sufficient to encode any horizontal rotation axis, the population of 10 vertical system neurons is advantageous if the available integration time is short. For the fly, short integration times to decode neuronal responses are important when controlling rapid flight maneuvers.

Responses of blowfly motion-sensitive neurons to reconstructed optic flow along outdoor flight paths

The retinal image flow a blowfly experiences in its daily life on the wing is determined by both the structure of the environment and the animal's own movements. To understand the design of visual processing mechanisms, there is thus a need to analyse the performance of neurons under natural operating conditions. To this end, we recorded flight paths of flies outdoors and reconstructed what they had seen, by moving a panoramic camera along exactly the same paths. The reconstructed image sequences were later replayed on a fast, panoramic flight simulator to identified, motion sensitive neurons of the so-called horizontal system (HS) in the lobula plate of the blowfly, which are assumed to extract self-motion parameters from optic flow. We show that under real life conditions HS-cells not only encode information about self-rotation, but are also sensitive to translational optic flow and, thus, indirectly signal information about the depth structure of the environment. These properties do not require an elaboration of the known model of these neurons, because the natural optic flow sequences generate--at least qualitatively--the same depth-related response properties when used as input to a computational HS-cell model and to real neurons.

On the computations analyzing natural optic flow: quantitative model analysis of the blowfly motion vision pathway

For many animals, including humans, the optic flow generated on the eyes during locomotion is an important source of information about self-motion and the structure of the environment. The blowfly has been used frequently as a model system for experimental analysis of optic flow processing at the microcircuit level. Here, we describe a model of the computational mechanisms implemented by these circuits in the blowfly motion vision pathway. Although this model was originally proposed based on simple experimenter-designed stimuli, we show that it is also capable to quantitatively predict the responses to the complex dynamic stimuli a blowfly encounters in free flight. In particular, the model visual system exploits the active saccadic gaze and flight strategy of blowflies in a similar way, as does its neuronal counterpart. The model circuit extracts information about translation velocity in the intersaccadic intervals and thus, indirectly, about the three-dimensional layout of the environment. By stepwise dissection of the model circuit, we determine which of its components are essential for these remarkable features. When accounting for the responses to complex natural stimuli, the model is much more robust against parameter changes than when explaining the neuronal responses to simple experimenter-defined stimuli. In contrast to conclusions drawn from experiments with simple stimuli, optimization of the parameter set for different segments of natural optic flow stimuli do not indicate pronounced adaptational changes of these parameters during long-lasting stimulation.

Motion adaptation leads to parsimonious encoding of natural optic flow by blowfly motion vision system

Neurons sensitive to visual motion change their response properties during prolonged motion stimulation. These changes have been interpreted as adaptive and were concluded, for instance, to adjust the sensitivity of the visual motion pathway to velocity changes or to increase the reliability of encoding of motion information. These conclusions are based on experiments with experimenter-designed motion stimuli that differ substantially with respect to their dynamical properties from the optic flow an animal experiences during normal behavior. We analyze for the first time motion adaptation under natural stimulus conditions. The experiments are done on the H1-cell, an identified neuron in the blowfly visual motion pathway that has served in many previous studies as a model system for visual motion computation. We reconstructed optic flow perceived by a blowfly in free flight and used this behaviorally generated optic flow to study motion adaptation. A variety of measures (variability in spike count, response latency, jitter of spike timing) suggests that the coding quality does not improve with prolonged stimulation. However, although the number of spikes decreases considerably during stimulation with natural optic flow, the amount of information that is conveyed stays nearly constant. Thus the information per spike increases, and motion adaptation leads to parsimonious coding without sacrificing the reliability with which behaviorally relevant information is encoded.

Function of a fly motion-sensitive neuron matches eye movements during free flight

Sensing is often implicitly assumed to be the passive acquisition of information. However, part of the sensory information is generated actively when animals move. For instance, humans shift their gaze actively in a sequence of saccades towards interesting locations in a scene. Likewise, many insects shift their gaze by saccadic turns of body and head, keeping their gaze fixed between saccades. Here we employ a novel panoramic virtual reality stimulator and show that motion computation in a blowfly visual interneuron is tuned to make efficient use of the characteristic dynamics of retinal image flow. The neuron is able to extract information about the spatial layout of the environment by utilizing intervals of stable vision resulting from the saccadic viewing strategy. The extraction is possible because the retinal image flow evoked by translation, containing information about object distances, is confined to low frequencies. This flow component can be derived from the total optic flow between saccades because the residual intersaccadic head rotations are small and encoded at higher frequencies. Information about the spatial layout of the environment can thus be extracted by the neuron in a computationally parsimonious way. These results on neuronal function based on naturalistic, behaviourally generated optic flow are in stark contrast to conclusions based on conventional visual stimuli that the neuron primarily represents a detector for yaw rotations of the animal.

With the aid of virtual reality, the authors study the neuronal responses to visual motion associated with natural behavior.

Adaptation without parameter change: Dynamic gain control in motion detection

Many sensory systems adapt their input-output relationship to changes in the statistics of the ambient stimulus. Such adaptive behavior has been measured in a motion detection sensitive neuron of the fly visual system, H1. The rapid adaptation of the velocity response gain has been interpreted as evidence of optimal matching of the H1 response to the dynamic range of the stimulus, thereby maximizing its information transmission. Here, we show that correlation-type motion detectors, which are commonly thought to underlie fly motion vision, intrinsically possess adaptive properties. Increasing the amplitude of the velocity fluctuations leads to a decrease of the effective gain and the time constant of the velocity response without any change in the parameters of these detectors. The seemingly complex property of this adaptation turns out to be a straightforward consequence of the multidimensionality of the stimulus and the nonlinear nature of the system.

Adaptation of response transients in fly motion vision. I: Experiments

Two types of transient responses have been investigated in fly motion-sensitive neurons in the past: the impulse and the step response. In response to a brief motion pulse, cells show a sudden rise in activity followed by an exponential decay ('impulse response'). In response to the onset of a constant velocity stimulus, cells exhibit transient oscillations before settling to a steady-state value ('step response'). Since the impulse response has been shown to shorten when tested after presentation of an adapting motion stimulus, we investigated whether adaptation also occurs during the step response. We tested this hypothesis by recording extracellularly the response of the H1-cell in the lobula plate of the blowfly Calliphora vicina to gratings of varying pattern contrasts and drift velocity. We found that the transient oscillations of the step response strongly depend on the pattern contrast: at low contrasts, oscillations lasted for several seconds, whereas at high contrasts, they settled within fractions of a second. This suggests that motion adaptation occurs during the initial period of the stimulus presentation and is dependent on the contrast of the motion stimulus. Using identical stimulus parameters (contrast and temporal frequency) for the adapting stimulus and testing the impulse response afterwards, we found that the impulse response and the transient period in the step response shortened in a similar way. We then analyzed the dynamic of the transients oscillations produced by ongoing motion of a square wave pattern in the anti-preferred direction (null direction) of H1. As observed for preferred direction motion, we found that the duration and amplitude of those transients shortened as the contrast and the velocity of the pattern increased, and that the oscillations disappeared when a blank screen instead of a pattern was presented before the onset of motion. Under both stimulus conditions, i.e. grating and blank screen before motion onset, the steady-state response level showed the same dependence on the contrast and temporal frequency of the pattern. When we analyzed the responses of the cell to pattern of various sizes and contrasts moving in the preferred direction of the cell, we found that increments in the size affected the overall amplitude of both the transient oscillations and the steady-state response level, whereas the duration of the oscillations only depended on the local pattern contrast. We also tested the impulse response before and after the presentation of an adapting stimulus presented in either the same or a different location of the visual field. The response shortened only when both the adapting and the test stimuli were presented at the same location. These last experiments demonstrate a strictly local mechanism of adaptation affecting the response transients of both the impulse and the step response.