Encoding of Naturalistic Optic Flow by a Population of Blowfly Motion-Sensitive Neurons

The impulse response of optic flow-sensitive descending neurons to roll m-sequences

When animals move through the world, their own movements generate widefield optic flow across their eyes. In insects, such widefield motion is encoded by optic lobe neurons. These lobula plate tangential cells (LPTCs) synapse with optic flow-sensitive descending neurons, which in turn project to areas that control neck, wing and leg movements. As the descending neurons play a role in sensorimotor transformation, it is important to understand their spatio-temporal response properties. Recent work shows that a relatively fast and efficient way to quantify such response properties is to use m-sequences or other white noise techniques. Therefore, here we used m-sequences to quantify the impulse responses of optic flow-sensitive descending neurons in male Eristalis tenax hoverflies. We focused on roll impulse responses as hoverflies perform exquisite head roll stabilizing reflexes, and the descending neurons respond particularly well to roll. We found that the roll impulse responses were fast, peaking after 16.5–18.0 ms. This is similar to the impulse response time to peak (18.3 ms) to widefield horizontal motion recorded in hoverfly LPTCs. We found that the roll impulse response amplitude scaled with the size of the stimulus impulse, and that its shape could be affected by the addition of constant velocity roll or lift. For example, the roll impulse response became faster and stronger with the addition of excitatory stimuli, and vice versa. We also found that the roll impulse response had a long return to baseline, which was significantly and substantially reduced by the addition of either roll or lift.

Summary: The impulse response of hoverfly optic flow-sensitive descending neurons to roll m-sequences reaches its time to peak within 20 ms and slowly returns to baseline over the next 100 ms.

Aerial course stabilization is impaired in motion-blind flies

Visual motion detection is among the best understood neuronal computations. As extensively investigated in tethered flies, visual motion signals are assumed to be crucial to detect and counteract involuntary course deviations. During free flight, however, course changes are also signalled by other sensory systems. Therefore, it is as yet unclear to what extent motion vision contributes to course control. To address this question, we genetically rendered flies motion-blind by blocking their primary motion-sensitive neurons and quantified their free-flight performance. We found that such flies have difficulty maintaining a straight flight trajectory, much like unimpaired flies in the dark. By unilateral wing clipping, we generated an asymmetry in propulsive force and tested the ability of flies to compensate for this perturbation. While wild-type flies showed a remarkable level of compensation, motion-blind animals exhibited pronounced circling behaviour. Our results therefore directly confirm that motion vision is necessary to fly straight under realistic conditions.

Towards Computational Models and Applications of Insect Visual Systems for Motion Perception: A Review

Motion perception is a critical capability determining a variety of aspects of insects' life, including avoiding predators, foraging, and so forth. A good number of motion detectors have been identified in the insects' visual pathways. Computational modeling of these motion detectors has not only been providing effective solutions to artificial intelligence, but also benefiting the understanding of complicated biological visual systems. These biological mechanisms through millions of years of evolutionary development will have formed solid modules for constructing dynamic vision systems for future intelligent machines. This article reviews the computational motion perception models originating from biological research on insects' visual systems in the literature. These motion perception models or neural networks consist of the looming-sensitive neuronal models of lobula giant movement detectors (LGMDs) in locusts, the translation-sensitive neural systems of direction-selective neurons (DSNs) in fruit flies, bees, and locusts, and the small-target motion detectors (STMDs) in dragonflies and hoverflies. We also review the applications of these models to robots and vehicles. Through these modeling studies, we summarize the methodologies that generate different direction and size selectivity in motion perception. Finally, we discuss multiple systems integration and hardware realization of these bio-inspired motion perception models.

Bi-directional Control of Walking Behavior by Horizontal Optic Flow Sensors

Moving animals experience constant sensory feedback, such as panoramic image shifts on the retina, termed optic flow. Underlying neuronal signals are thought to be important for exploratory behavior by signaling unintended course deviations and by providing spatial information about the environment [1, 2]. Particularly in insects, the encoding of self-motion-related optic flow is well understood [1-5]. However, a gap remains in understanding how the associated neuronal activity controls locomotor trajectories. In flies, visual projection neurons belonging to two groups encode panoramic horizontal motion: horizontal system (HS) cells respond with depolarization to front-to-back motion and hyperpolarization to the opposite direction [6, 7], and other neurons have the mirror-symmetrical response profile [6, 8, 9]. With primarily monocular sensitivity, the neurons' responses are ambiguous for different rotational and translational self-movement components. Such ambiguities can be greatly reduced by combining signals from both eyes [10-12] to determine turning and movement speed [13-16]. Here, we explore the underlying functional logic by optogenetic HS cell manipulation in tethered walking Drosophila. We show that de- and hyperpolarization evoke opposite turning behavior, indicating that both direction-selective signals are transmitted to descending pathways for course control. Further experiments reveal a negative effect of bilaterally symmetric de- and hyperpolarization on walking velocity. Our results are therefore consistent with a functional architecture in which the HS cells' membrane potential influences walking behavior bi-directionally via two decelerating pathways.

Efficient encoding of motion is mediated by gap junctions in the fly visual system

Understanding the computational implications of specific synaptic connectivity patterns is a fundamental goal in neuroscience. In particular, the computational role of ubiquitous electrical synapses operating via gap junctions remains elusive. In the fly visual system, the cells in the vertical-system network, which play a key role in visual processing, primarily connect to each other via axonal gap junctions. This network therefore provides a unique opportunity to explore the functional role of gap junctions in sensory information processing. Our information theoretical analysis of a realistic VS network model shows that within 10 ms following the onset of the visual input, the presence of axonal gap junctions enables the VS system to efficiently encode the axis of rotation, θ, of the fly’s ego motion. This encoding efficiency, measured in bits, is near-optimal with respect to the physical limits of performance determined by the statistical structure of the visual input itself. The VS network is known to be connected to downstream pathways via a subset of triplets of the vertical system cells; we found that because of the axonal gap junctions, the efficiency of this subpopulation in encoding θ is superior to that of the whole vertical system network and is robust to a wide range of signal to noise ratios. We further demonstrate that this efficient encoding of motion by this subpopulation is necessary for the fly's visually guided behavior, such as banked turns in evasive maneuvers. Because gap junctions are formed among the axons of the vertical system cells, they only impact the system’s readout, while maintaining the dendritic input intact, suggesting that the computational principles implemented by neural circuitries may be much richer than previously appreciated based on point neuron models. Our study provides new insights as to how specific network connectivity leads to efficient encoding of sensory stimuli.

Understanding sensory stimuli from the environment and deciding how best to respond to it behaviorally is essential for survival. What makes organisms efficient in encoding these sensory stimuli? This study provides a novel view on this unresolved issue using the visual system of the fly. We show that a specific synaptic connectivity manifested via gap junctions (GJs) among axons in the Vertical System (VS) network leads to particularly high encoding efficiency of the axis of rotation of the fly’s ego motion. Due to these GJs, triplets of VS neurons (the VS5-6-7 triplet), which connect to a downstream motor system, encode motion stimuli at an efficiency close to the physical limit; this efficient encoding is necessary for evasive maneuvers that are critical for the fly to escape predators. We then suggest why GJs in the VS network enable such high encoding efficiency.

Spatio-temporal dynamics of impulse responses to figure motion in optic flow neurons

White noise techniques have been used widely to investigate sensory systems in both vertebrates and invertebrates. White noise stimuli are powerful in their ability to rapidly generate data that help the experimenter decipher the spatio-temporal dynamics of neural and behavioral responses. One type of white noise stimuli, maximal length shift register sequences (m-sequences), have recently become particularly popular for extracting response kernels in insect motion vision. We here use such m-sequences to extract the impulse responses to figure motion in hoverfly lobula plate tangential cells (LPTCs). Figure motion is behaviorally important and many visually guided animals orient towards salient features in the surround. We show that LPTCs respond robustly to figure motion in the receptive field. The impulse response is scaled down in amplitude when the figure size is reduced, but its time course remains unaltered. However, a low contrast stimulus generates a slower response with a significantly longer time-to-peak and half-width. Impulse responses in females have a slower time-to-peak than males, but are otherwise similar. Finally we show that the shapes of the impulse response to a figure and a widefield stimulus are very similar, suggesting that the figure response could be coded by the same input as the widefield response.

Encoding of yaw in the presence of distractor motion: studies in a fly motion sensitive neuron

Motion estimation is crucial for aerial animals such as the fly, which perform fast and complex maneuvers while flying through a 3-D environment. Motion-sensitive neurons in the lobula plate, a part of the visual brain, of the fly have been studied extensively for their specialized role in motion encoding. However, the visual stimuli used in such studies are typically highly simplified, often move in restricted ways, and do not represent the complexities of optic flow generated during actual flight. Here, we use combined rotations about different axes to study how H1, a wide-field motion-sensitive neuron, encodes preferred yaw motion in the presence of stimuli not aligned with its preferred direction. Our approach is an extension of "white noise" methods, providing a framework that is readily adaptable to quantitative studies into the coding of mixed dynamic stimuli in other systems. We find that the presence of a roll or pitch ("distractor") stimulus reduces information transmitted by H1 about yaw, with the amount of this reduction depending on the variance of the distractor. Spike generation is influenced by features of both yaw and the distractor, where the degree of influence is determined by their relative strengths. Certain distractor features may induce bidirectional responses, which are indicative of an imbalance between global excitation and inhibition resulting from complex optic flow. Further, the response is shaped by the dynamics of the combined stimulus. Our results provide intuition for plausible strategies involved in efficient coding of preferred motion from complex stimuli having multiple motion components.

Influence of environmental information in natural scenes and the effects of motion adaptation on a fly motion-sensitive neuron during simulated flight

Gaining information about the spatial layout of natural scenes is a challenging task that flies need to solve, especially when moving at high velocities. A group of motion sensitive cells in the lobula plate of flies is supposed to represent information about self-motion as well as the environment. Relevant environmental features might be the nearness of structures, influencing retinal velocity during translational self-motion, and the brightness contrast. We recorded the responses of the H1 cell, an individually identifiable lobula plate tangential cell, during stimulation with image sequences, simulating translational motion through natural sceneries with a variety of differing depth structures. A correlation was found between the average nearness of environmental structures within large parts of the cell's receptive field and its response across a variety of scenes, but no correlation was found between the brightness contrast of the stimuli and the cell response. As a consequence of motion adaptation resulting from repeated translation through the environment, the time-dependent response modulations induced by the spatial structure of the environment were increased relatively to the background activity of the cell. These results support the hypothesis that some lobula plate tangential cells do not only serve as sensors of self-motion, but also as a part of a neural system that processes information about the spatial layout of natural scenes.

Motion as a source of environmental information: a fresh view on biological motion computation by insect brains

Despite their miniature brains insects, such as flies, bees and wasps, are able to navigate by highly erobatic flight maneuvers in cluttered environments. They rely on spatial information that is contained in the retinal motion patterns induced on the eyes while moving around ("optic flow") to accomplish their extraordinary performance. Thereby, they employ an active flight and gaze strategy that separates rapid saccade-like turns from translatory flight phases where the gaze direction is kept largely constant. This behavioral strategy facilitates the processing of environmental information, because information about the distance of the animal to objects in the environment is only contained in the optic flow generated by translatory motion. However, motion detectors as are widespread in biological systems do not represent veridically the velocity of the optic flow vectors, but also reflect textural information about the environment. This characteristic has often been regarded as a limitation of a biological motion detection mechanism. In contrast, we conclude from analyses challenging insect movement detectors with image flow as generated during translatory locomotion through cluttered natural environments that this mechanism represents the contours of nearby objects. Contrast borders are a main carrier of functionally relevant object information in artificial and natural sceneries. The motion detection system thus segregates in a computationally parsimonious way the environment into behaviorally relevant nearby objects and-in many behavioral contexts-less relevant distant structures. Hence, by making use of an active flight and gaze strategy, insects are capable of performing extraordinarily well even with a computationally simple motion detection mechanism.

Temporal statistics of natural image sequences generated by movements with insect flight characteristics

Many flying insects, such as flies, wasps and bees, pursue a saccadic flight and gaze strategy. This behavioral strategy is thought to separate the translational and rotational components of self-motion and, thereby, to reduce the computational efforts to extract information about the environment from the retinal image flow. Because of the distinguishing dynamic features of this active flight and gaze strategy of insects, the present study analyzes systematically the spatiotemporal statistics of image sequences generated during saccades and intersaccadic intervals in cluttered natural environments. We show that, in general, rotational movements with saccade-like dynamics elicit fluctuations and overall changes in brightness, contrast and spatial frequency of up to two orders of magnitude larger than translational movements at velocities that are characteristic of insects. Distinct changes in image parameters during translations are only caused by nearby objects. Image analysis based on larger patches in the visual field reveals smaller fluctuations in brightness and spatial frequency composition compared to small patches. The temporal structure and extent of these changes in image parameters define the temporal constraints imposed on signal processing performed by the insect visual system under behavioral conditions in natural environments.

Visual motion-sensitive neurons in the bumblebee brain convey information about landmarks during a navigational task

Bees use visual memories to find the spatial location of previously learnt food sites. Characteristic learning flights help acquiring these memories at newly discovered foraging locations where landmarks—salient objects in the vicinity of the goal location—can play an important role in guiding the animal's homing behavior. Although behavioral experiments have shown that bees can use a variety of visual cues to distinguish objects as landmarks, the question of how landmark features are encoded by the visual system is still open. Recently, it could be shown that motion cues are sufficient to allow bees localizing their goal using landmarks that can hardly be discriminated from the background texture. Here, we tested the hypothesis that motion sensitive neurons in the bee's visual pathway provide information about such landmarks during a learning flight and might, thus, play a role for goal localization. We tracked learning flights of free-flying bumblebees (Bombus terrestris) in an arena with distinct visual landmarks, reconstructed the visual input during these flights, and replayed ego-perspective movies to tethered bumblebees while recording the activity of direction-selective wide-field neurons in their optic lobe. By comparing neuronal responses during a typical learning flight and targeted modifications of landmark properties in this movie we demonstrate that these objects are indeed represented in the bee's visual motion pathway. We find that object-induced responses vary little with object texture, which is in agreement with behavioral evidence. These neurons thus convey information about landmark properties that are useful for view-based homing.

Impact of stride-coupled gaze shifts of walking blowflies on the neuronal representation of visual targets

During locomotion animals rely heavily on visual cues gained from the environment to guide their behavior. Examples are basic behaviors like collision avoidance or the approach to a goal. The saccadic gaze strategy of flying flies, which separates translational from rotational phases of locomotion, has been suggested to facilitate the extraction of environmental information, because only image flow evoked by translational self-motion contains relevant distance information about the surrounding world. In contrast to the translational phases of flight during which gaze direction is kept largely constant, walking flies experience continuous rotational image flow that is coupled to their stride-cycle. The consequences of these self-produced image shifts for the extraction of environmental information are still unclear. To assess the impact of stride-coupled image shifts on visual information processing, we performed electrophysiological recordings from the HSE cell, a motion sensitive wide-field neuron in the blowfly visual system. This cell has been concluded to play a key role in mediating optomotor behavior, self-motion estimation and spatial information processing. We used visual stimuli that were based on the visual input experienced by walking blowflies while approaching a black vertical bar. The response of HSE to these stimuli was dominated by periodic membrane potential fluctuations evoked by stride-coupled image shifts. Nevertheless, during the approach the cell's response contained information about the bar and its background. The response components evoked by the bar were larger than the responses to its background, especially during the last phase of the approach. However, as revealed by targeted modifications of the visual input during walking, the extraction of distance information on the basis of HSE responses is much impaired by stride-coupled retinal image shifts. Possible mechanisms that may cope with these stride-coupled responses are discussed.

Depth information in natural environments derived from optic flow by insect motion detection system: a model analysis

Knowing the depth structure of the environment is crucial for moving animals in many behavioral contexts, such as collision avoidance, targeting objects, or spatial navigation. An important source of depth information is motion parallax. This powerful cue is generated on the eyes during translatory self-motion with the retinal images of nearby objects moving faster than those of distant ones. To investigate how the visual motion pathway represents motion-based depth information we analyzed its responses to image sequences recorded in natural cluttered environments with a wide range of depth structures. The analysis was done on the basis of an experimentally validated model of the visual motion pathway of insects, with its core elements being correlation-type elementary motion detectors (EMDs). It is the key result of our analysis that the absolute EMD responses, i.e., the motion energy profile, represent the contrast-weighted nearness of environmental structures during translatory self-motion at a roughly constant velocity. In other words, the output of the EMD array highlights contours of nearby objects. This conclusion is largely independent of the scale over which EMDs are spatially pooled and was corroborated by scrutinizing the motion energy profile after eliminating the depth structure from the natural image sequences. Hence, the well-established dependence of correlation-type EMDs on both velocity and textural properties of motion stimuli appears to be advantageous for representing behaviorally relevant information about the environment in a computationally parsimonious way.

Gaze characteristics of freely walking blowflies Calliphora vicina in a goal-directed task

In contrast to flying flies, walking flies experience relatively strong rotational gaze shifts, even during overall straight phases of locomotion. These gaze shifts are caused by the walking apparatus and modulated by the stride frequency. Accordingly, even during straight walking phases, the retinal image flow is composed of both translational and rotational optic flow, which might affect spatial vision, as well as fixation behavior. We addressed this issue for an orientation task where walking blowflies approached a black vertical bar. The visual stimulus was stationary, or either the bar or the background moved horizontally. The stride-coupled gaze shifts of flies walking toward the bar had similar amplitudes under all visual conditions tested. This finding indicates that these shifts are an inherent feature of walking, which are not even compensated during a visual goal fixation task. By contrast, approaching flies showed a frequent stop-and-go behavior that was affected by the stimulus conditions. As sustained image rotations may impair distance estimation during walking, we propose a hypothesis that explains how rotation-independent translatory image flow containing distance information can be determined. The algorithm proposed works without requiring differentiation at the behavioral level of the rotational and translational flow components. By contrast, disentangling both has been proposed to be necessary during flight. By comparing the retinal velocities of the edges of the goal, its rotational image motion component can be removed. Consequently, the expansion velocity of the goal and, thus, its proximity can be extracted, irrespective of distance-independent stride-coupled rotational image shifts.

Texture-defined objects influence responses of blowfly motion-sensitive neurons under natural dynamical conditions

The responses of visual interneurons of flies involved in the processing of motion information do not only depend on the velocity, but also on other stimulus parameters, such as the contrast and the spatial frequency content of the stimulus pattern. These dependencies have been known for long, but it is still an open question how they affect the neurons' performance in extracting information about the structure of the environment under the specific dynamical conditions of natural flight. Free-flight of blowflies is characterized by sequences of phases of translational movements lasting for just 30-100 ms interspersed with even shorter and extremely rapid saccade-like rotational shifts in flight and gaze direction. Previous studies already analyzed how nearby objects, leading to relative motion on the retina with respect to a more distant background, influenced the response of a class of fly motion sensitive visual interneurons, the horizontal system (HS) cells. In the present study, we focused on objects that differed from their background by discontinuities either in their brightness contrast or in their spatial frequency content. We found strong object-induced effects on the membrane potential even during the short intersaccadic intervals, if the background contrast was small and the object contrast sufficiently high. The object evoked similar response increments provided that it contained higher spatial frequencies than the background, but not under reversed conditions. This asymmetry in the response behavior is partly a consequence of the depolarization level induced by the background. Thus, our results suggest that, under the specific dynamical conditions of natural flight, i.e., on a very short timescale, the responses of HS cells represent object information depending on the polarity of the difference between object and background contrast and spatial frequency content.

Octopaminergic modulation of the visual flight speed regulator of Drosophila

Recent evidence suggests that flies’ sensitivity to large field optic flow is increased by the release of octopamine during flight. This increase in gain presumably enhances visually-mediated behaviors such as the active regulation of forward speed, a process that involves the comparison of a vision-based estimate of velocity with an internal set point. To determine where in the neural circuit this comparison is made, we selectively silenced the octopamine neurons in the fruit fly, Drosophila, and examined the effect on vision-based velocity regulation in free flying flies. We found that flies with inactivated octopamine neurons accelerated more slowly in response to visual motion than control flies, but maintained nearly the same baseline flight speed. Our results are parsimonious with a circuit architecture in which the internal control signal is injected into the visual motion pathway upstream of the interneuron network that estimates groundspeed.

Octopaminergic modulation of a fly visual motion-sensitive neuron during stimulation with naturalistic optic flow

In a variety of species locomotor activity, like walking or flying, has been demonstrated to alter visual information processing. The neuromodulator octopamine was shown to change the response characteristics of optic flow processing neurons in the fly's visual system in a similar way as locomotor activity. This modulation resulted in enhanced neuronal responses, in particular during sustained stimulation with high temporal frequencies, and in shorter latencies of responses to abrupt onsets of pattern motion. These state-dependent changes were interpreted to adjust neuronal tuning to the range of high velocities encountered during locomotion. Here we assess the significance of these changes for the processing of optic flow as experienced during flight. Naturalistic image sequences were reconstructed based on measurements of the head position and gaze direction of Calliphora vicina flying in an arena. We recorded the responses of the V1 neuron during presentation of these image sequences on a panoramic stimulus device ("FliMax"). Consistent with previous accounts, we found that spontaneous as well as stimulus-induced spike rates were increased by an octopamine agonist and decreased by an antagonist. Moreover, a small but consistent decrease in response latency upon octopaminergic activation was present, which might support fast responses to optic flow cues and limit instabilities during closed-loop optomotor regulation. However, apart from these effects the similarities between the dynamic response properties in the different pharmacologically induced states were surprisingly high, indicating that the processing of naturalistic optic flow is not fundamentally altered by octopaminergic modulation.

Optogenetic control of fly optomotor responses

When confronted with a large-field stimulus rotating around the vertical body axis, flies display a following behavior called "optomotor response." As neural control elements, the large tangential horizontal system (HS) cells of the lobula plate have been prime candidates for long. Here, we applied optogenetic stimulation of HS cells to evaluate their behavioral role in Drosophila. To minimize interference of the optical activation of channelrhodopsin-2 with the visual perception of the flies, we used a bistable variant called ChR2-C128S. By applying pulses of blue and yellow light, we first demonstrate electrophysiologically that lobula plate tangential cells can be activated and deactivated repeatedly with no evident change in depolarization strength over trials. We next show that selective optogenetic activation of HS cells elicits robust yaw head movements and yaw turning responses in fixed and tethered flying flies, respectively.

Encoding of naturalistic optic flow by motion sensitive neurons of nucleus rotundus in the zebra finch (Taeniopygia guttata)

The retinal image changes that occur during locomotion, the optic flow, carry information about self-motion and the three-dimensional structure of the environment. Especially fast moving animals with only little binocular vision depend on these depth cues for maneuvering. They actively control their gaze to facilitate perception of depth based on cues in the optic flow. In the visual system of birds, nucleus rotundus neurons were originally found to respond to object motion but not to background motion. However, when background and object were both moving, responses increased the more the direction and velocity of object and background motion on the retina differed. These properties may play a role in representing depth cues in the optic flow. We therefore investigated, how neurons in nucleus rotundus respond to optic flow that contains depth cues. We presented simplified and naturalistic optic flow on a panoramic LED display while recording from single neurons in nucleus rotundus of anaesthetized zebra finches. Unlike most studies on motion vision in birds, our stimuli included depth information. We found extensive responses of motion selective neurons in nucleus rotundus to optic flow stimuli. Simplified stimuli revealed preferences for optic flow reflecting translational or rotational self-motion. Naturalistic optic flow stimuli elicited complex response modulations, but the presence of objects was signaled by only few neurons. The neurons that did respond to objects in the optic flow, however, show interesting properties.

Texture dependence of motion sensing and free flight behavior in blowflies

MANY FLYING INSECTS EXHIBIT AN ACTIVE FLIGHT AND GAZE STRATEGY: purely translational flight segments alternate with quick turns called saccades. To generate such a saccadic flight pattern, the animals decide the timing, direction, and amplitude of the next saccade during the previous translatory intersaccadic interval. The information underlying these decisions is assumed to be extracted from the retinal image displacements (optic flow), which scale with the distance to objects during the intersaccadic flight phases. In an earlier study we proposed a saccade-generation mechanism based on the responses of large-field motion-sensitive neurons. In closed-loop simulations we achieved collision avoidance behavior in a limited set of environments but observed collisions in others. Here we show by open-loop simulations that the cause of this observation is the known texture-dependence of elementary motion detection in flies, reflected also in the responses of large-field neurons as used in our model. We verified by electrophysiological experiments that this result is not an artifact of the sensory model. Already subtle changes in the texture may lead to qualitative differences in the responses of both our model cells and their biological counterparts in the fly's brain. Nonetheless, free flight behavior of blowflies is only moderately affected by such texture changes. This divergent texture dependence of motion-sensitive neurons and behavioral performance suggests either mechanisms that compensate for the texture dependence of the visual motion pathway at the level of the circuits generating the saccadic turn decisions or the involvement of a hypothetical parallel pathway in saccadic control that provides the information for collision avoidance independent of the textural properties of the environment.

Spatial vision in insects is facilitated by shaping the dynamics of visual input through behavioral action

Insects such as flies or bees, with their miniature brains, are able to control highly aerobatic flight maneuvres and to solve spatial vision tasks, such as avoiding collisions with obstacles, landing on objects, or even localizing a previously learnt inconspicuous goal on the basis of environmental cues. With regard to solving such spatial tasks, these insects still outperform man-made autonomous flying systems. To accomplish their extraordinary performance, flies and bees have been shown by their characteristic behavioral actions to actively shape the dynamics of the image flow on their eyes ("optic flow"). The neural processing of information about the spatial layout of the environment is greatly facilitated by segregating the rotational from the translational optic flow component through a saccadic flight and gaze strategy. This active vision strategy thus enables the nervous system to solve apparently complex spatial vision tasks in a particularly efficient and parsimonious way. The key idea of this review is that biological agents, such as flies or bees, acquire at least part of their strength as autonomous systems through active interactions with their environment and not by simply processing passively gained information about the world. These agent-environment interactions lead to adaptive behavior in surroundings of a wide range of complexity. Animals with even tiny brains, such as insects, are capable of performing extraordinarily well in their behavioral contexts by making optimal use of the closed action-perception loop. Model simulations and robotic implementations show that the smart biological mechanisms of motion computation and visually-guided flight control might be helpful to find technical solutions, for example, when designing micro air vehicles carrying a miniaturized, low-weight on-board processor.

Spectral inputs and ocellar contributions to a pitch-sensitive descending neuron in the honeybee

By measuring insect compensatory optomotor reflexes to visual motion, researchers have examined the computational mechanisms of the motion processing system. However, establishing the spectral sensitivity of the neural pathways that underlie this motion behavior has been difficult, and the contribution of the simple eyes (ocelli) has been rarely examined. In this study we investigate the spectral response properties and ocellar inputs of an anatomically identified descending neuron (DNII(2)) in the honeybee optomotor pathway. Using a panoramic stimulus, we show that it responds selectively to optic flow associated with pitch rotations. The neuron is also stimulated with a custom-built light-emitting diode array that presented moving bars that were either all-green (spectrum 500-600 nm, peak 530 nm) or all-short wavelength (spectrum 350-430 nm, peak 380 nm). Although the optomotor response is thought to be dominated by green-sensitive inputs, we show that DNII(2) is equally responsive to, and direction selective to, both green- and short-wavelength stimuli. The color of the background image also influences the spontaneous spiking behavior of the cell: a green background produces significantly higher spontaneous spiking rates. Stimulating the ocelli produces strong modulatory effects on DNII(2), significantly increasing the amplitude of its responses in the preferred motion direction and decreasing the response latency by adding a directional, short-latency response component. Our results suggest that the spectral sensitivity of the optomotor response in honeybees may be more complicated than previously thought and that ocelli play a significant role in shaping the timing of motion signals.

Impact and sources of neuronal variability in the fly's motion vision pathway

Nervous systems encode information about dynamically changing sensory input by changes in neuronal activity. Neuronal activity changes, however, also arise from noise sources within and outside the nervous system or from changes of the animal's behavioral state. The resulting variability of neuronal responses in representing sensory stimuli limits the reliability with which animals can respond to stimuli and may thus even affect the chances for survival in certain situations. Relevant sources of noise arising at different stages along the motion vision pathway have been investigated from the sensory input to the initiation of behavioral reactions. Here, we concentrate on the reliability of processing visual motion information in flies. Flies rely on visual motion information to guide their locomotion. They are among the best established model systems for the processing of visual motion information allowing us to bridge the gap between behavioral performance and underlying neuronal computations. It has been possible to directly assess the consequences of noise at major stages of the fly's visual motion processing system on the reliability of neuronal signals. Responses of motion sensitive neurons and their variability have been related to optomotor movements as indicators for the overall performance of visual motion computation. We address whether and how noise already inherent in the stimulus, e.g. photon noise for the visual system, influences later processing stages and to what extent variability at the output level of the sensory system limits behavioral performance. Recent advances in circuit analysis and the progress in monitoring neuronal activity in behaving animals should now be applied to understand how the animal meets the requirements of fast and reliable manoeuvres in naturalistic situations.

Blowfly flight characteristics are shaped by environmental features and controlled by optic flow information

Blowfly flight consists of two main components, saccadic turns and intervals of mostly straight gaze direction, although, as a consequence of inertia, flight trajectories usually change direction smoothly. We investigated how flight behavior changes depending on the surroundings and how saccadic turns and intersaccadic translational movements might be controlled in arenas of different width with and without obstacles. Blowflies do not fly in straight trajectories, even when traversing straight flight arenas; rather, they fly in meandering trajectories. Flight speed and the amplitude of meanders increase with arena width. Although saccade duration is largely constant, peak angular velocity and succession into either direction are variable and depend on the visual surroundings. Saccade rate and amplitude also vary with arena layout and are correlated with the 'time-to-contact' to the arena wall. We provide evidence that both saccade and velocity control rely to a large extent on the intersaccadic optic flow generated in eye regions looking well in front of the fly, rather than in the lateral visual field, where the optic flow at least during forward flight tends to be strongest.

Octopaminergic modulation of contrast sensitivity

Sensory systems adapt to prolonged stimulation by decreasing their response to continuous stimuli. Whereas visual motion adaptation has traditionally been studied in immobilized animals, recent work indicates that the animal's behavioral state influences the response properties of higher-order motion vision-sensitive neurons. During insect flight octopamine is released, and pharmacological octopaminergic activation can induce a fictive locomotor state. In the insect optic ganglia, lobula plate tangential cells (LPTCs) spatially pool input from local elementary motion detectors (EMDs) that correlate luminosity changes from two spatially discrete inputs after delaying the signal from one. The LPTC velocity optimum thereby depends on the spatial separation of the inputs and on the EMD's delay properties. Recently it was shown that behavioral activity increases the LPTC velocity optimum, with modeling suggesting this to originate in the EMD's temporal delay filters. However, behavior induces an additional post-EMD effect: the LPTC membrane conductance increases in flying flies. To physiologically investigate the degree to which activity causes presynaptic and postsynaptic effects, we conducted intracellular recordings of Eristalis horizontal system (HS) neurons. We constructed contrast response functions before and after adaptation at different temporal frequencies, with and without the octopamine receptor agonist chlordimeform (CDM). We extracted three motion adaptation components, where two are likely to be generated presynaptically of the LPTCs, and one within them. We found that CDM affected the early, EMD-associated contrast gain reduction, temporal frequency dependently. However, a CDM-induced change of the HS membrane conductance disappeared during and after visual stimulation. This suggests that physical activity mainly affects motion adaptation presynaptically of LPTCs, whereas post-EMD effects have a minimal effect.

Head and body stabilization in blowflies walking on differently structured substrates

Visually guided animals depend heavily on the quality of visual signals in order to obtain functionally relevant information about their environment. To support visual information processing, nature has evolved a large variety of physiological adaptations and behavioral strategies such as compensatory head movements. During self-movement, head rotations compensate for changes in body attitude in order to stabilize gaze. However, how walking animals cope with uneven structured substrates, which may affect body and gaze orientation, is still unknown. We used stereo high-speed video to analyze compensatory head movements of blowflies walking freely on differently structured substrates. We found that even a pronounced asperity of the ground structure, with bumps of almost the size of the animal, was largely compensated by the walking apparatus of the blowfly, which leads to body roll and pitch movements only marginally larger than those on flat substrate. Pitch and roll fluctuations of the head were smaller compared with body fluctuations on all tested substrates, emphasizing the significance of gaze stabilization during walking on structured substrates. Furthermore, we found no impairment in head and body stabilization during walks in darkness, which indicates that the control system mediating compensatory head movements works well without any visual input. Interestingly, blowflies changed their walking style in the dark and seemed to use their forelegs as tactile probes.

A fast and flexible panoramic virtual reality system for behavioural and electrophysiological experiments

Ideally, neuronal functions would be studied by performing experiments with unconstrained animals whilst they behave in their natural environment. Although this is not feasible currently for most animal models, one can mimic the natural environment in the laboratory by using a virtual reality (VR) environment. Here we present a novel VR system based upon a spherical projection of computer generated images using a modified commercial data projector with an add-on fish-eye lens. This system provides equidistant visual stimulation with extensive coverage of the visual field, high spatio-temporal resolution and flexible stimulus generation using a standard computer. It also includes a track-ball system for closed-loop behavioural experiments with walking animals. We present a detailed description of the system and characterize it thoroughly. Finally, we demonstrate the VR system’s performance whilst operating in closed-loop conditions by showing the movement trajectories of the cockroaches during exploratory behaviour in a VR forest.

Neuronal encoding of object and distance information: a model simulation study on naturalistic optic flow processing

We developed a model of the input circuitry of the FD1 cell, an identified motion-sensitive interneuron in the blowfly's visual system. The model circuit successfully reproduces the FD1 cell's most conspicuous property: its larger responses to objects than to spatially extended patterns. The model circuit also mimics the time-dependent responses of FD1 to dynamically complex naturalistic stimuli, shaped by the blowfly's saccadic flight and gaze strategy: the FD1 responses are enhanced when, as a consequence of self-motion, a nearby object crosses the receptive field during intersaccadic intervals. Moreover, the model predicts that these object-induced responses are superimposed by pronounced pattern-dependent fluctuations during movements on virtual test flights in a three-dimensional environment with systematic modifications of the environmental patterns. Hence, the FD1 cell is predicted to detect not unambiguously objects defined by the spatial layout of the environment, but to be also sensitive to objects distinguished by textural features. These ambiguous detection abilities suggest an encoding of information about objects-irrespective of the features by which the objects are defined-by a population of cells, with the FD1 cell presumably playing a prominent role in such an ensemble.

Object representation and distance encoding in three-dimensional environments by a neural circuit in the visual system of the blowfly

Three motion-sensitive key elements of a neural circuit, presumably involved in processing object and distance information, were analyzed with optic flow sequences as experienced by blowflies in a three-dimensional environment. This optic flow is largely shaped by the blowfly's saccadic flight and gaze strategy, which separates translational flight segments from fast saccadic rotations. By modifying this naturalistic optic flow, all three analyzed neurons could be shown to respond during the intersaccadic intervals not only to nearby objects but also to changes in the distance to background structures. In the presence of strong background motion, the three types of neuron differ in their sensitivity for object motion. Object-induced response increments are largest in FD1, a neuron long known to respond better to moving objects than to spatially extended motion patterns, but weakest in VCH, a neuron that integrates wide-field motion from both eyes and, by inhibiting the FD1 cell, is responsible for its object preference. Small but significant object-induced response increments are present in HS cells, which serve both as a major input neuron of VCH and as output neurons of the visual system. In both HS and FD1, intersaccadic background responses decrease with increasing distance to the animal, although much more prominently in FD1. This strong dependence of FD1 on background distance is concluded to be the consequence of the activity of VCH that dramatically increases its activity and, thus, its inhibitory strength with increasing distance.

Visual response properties of neck motor neurons in the honeybee

Recent behavioural studies have demonstrated that honeybees use visual feedback to stabilize their gaze. However, little is known about the neural circuits that perform the visual motor computations that underlie this ability. We investigated the motor neurons that innervate two neck muscles (m44 and m51), which produce stabilizing yaw movements of the head. Intracellular recordings were made from five (out of eight) identified neuron types in the first cervical nerve (IK1) of honeybees. Two motor neurons that innervate muscle 51 were found to be direction-selective, with a preference for horizontal image motion from the contralateral to the ipsilateral side of the head. Three neurons that innervate muscle 44 were tuned to detect motion in the opposite direction (from ipsilateral to contralateral). These cells were binocularly sensitive and responded optimally to frontal stimulation. By combining the directional tuning of the motor neurons in an opponent manner, the neck motor system would be able to mediate reflexive optomotor head turns in the direction of image motion, thus stabilising the retinal image. When the dorsal ocelli were covered, the spontaneous activity of neck motor neurons increased and visual responses were modified, suggesting an ocellar input in addition to that from the compound eyes.

Impact of visual motion adaptation on neural responses to objects and its dependence on the temporal characteristics of optic flow

It is still unclear how sensory systems efficiently encode signals with statistics as experienced by animals in the real world and what role adaptation plays during normal behavior. Therefore, we studied the performance of visual motion-sensitive neurons of blowflies, the horizontal system neurons, with optic flow that was reconstructed from the head trajectories of semi-free-flying flies. To test how motion adaptation is affected by optic flow dynamics, we manipulated the seminatural optic flow by targeted modifications of the flight trajectories and assessed to what extent neuronal responses to an object located close to the flight trajectory depend on adaptation dynamics. For all types of adapting optic flow object-induced response increments were stronger in the adapted compared with the nonadapted state. Adaptation with optic flow characterized by the typical alternation between translational and rotational segments produced this effect but also adaptation with optic flow that lacked these distinguishing features and even pure rotation at a constant angular velocity. The enhancement of object-induced response increments had a direction-selective component because preferred-direction rotation and natural optic flow were more efficient adaptors than null-direction rotation. These results indicate that natural dynamics of optic flow is not a basic requirement to adapt neurons in a specific, presumably functionally beneficial way. Our findings are discussed in the light of adaptation mechanisms proposed on the basis of experiments previously done with conventional experimenter-defined stimuli.

Neural action fields for optic flow based navigation: a simulation study of the fly lobula plate network

Optic flow based navigation is a fundamental way of visual course control described in many different species including man. In the fly, an essential part of optic flow analysis is performed in the lobula plate, a retinotopic map of motion in the environment. There, the so-called lobula plate tangential cells possess large receptive fields with different preferred directions in different parts of the visual field. Previous studies demonstrated an extensive connectivity between different tangential cells, providing, in principle, the structural basis for their large and complex receptive fields. We present a network simulation of the tangential cells, comprising most of the neurons studied so far (22 on each hemisphere) with all the known connectivity between them. On their dendrite, model neurons receive input from a retinotopic array of Reichardt-type motion detectors. Model neurons exhibit receptive fields much like their natural counterparts, demonstrating that the connectivity between the lobula plate tangential cells indeed can account for their complex receptive field structure. We describe the tuning of a model neuron to particular types of ego-motion (rotation as well as translation around/along a given body axis) by its ‘action field’. As we show for model neurons of the vertical system (VS-cells), each of them displays a different type of action field, i.e., responds maximally when the fly is rotating around a particular body axis. However, the tuning width of the rotational action fields is relatively broad, comparable to the one with dendritic input only. The additional intra-lobula-plate connectivity mainly reduces their translational action field amplitude, i.e., their sensitivity to translational movements along any body axis of the fly.

Frequency response of lift control in Drosophila

The flight control responses of the fruitfly represent a powerful model system to explore neuromotor control mechanisms, whose system level control properties can be suitably characterized with a frequency response analysis. We characterized the lift response dynamics of tethered flying Drosophila in presence of vertically oscillating visual patterns, whose oscillation frequency we varied between 0.1 and 13 Hz. We justified these measurements by showing that the amplitude gain and phase response is invariant to the pattern oscillation amplitude and spatial frequency within a broad dynamic range. We also showed that lift responses are largely linear and time invariant (LTI), a necessary condition for a meaningful analysis of frequency responses and a remarkable characteristic given its nonlinear constituents. The flies responded to increasing oscillation frequencies with a roughly linear decrease in response gain, which dropped to background noise levels at about 6 Hz. The phase lag decreased linearly, consistent with a constant reaction delay of 75 ms. Next, we estimated the free-flight response of the fly to generate a Bode diagram of the lift response. The limitation of lift control to frequencies below 6 Hz is explained with inertial body damping, which becomes dominant at higher frequencies. Our work provides the detailed background and techniques that allow optomotor lift responses of Drosophila to be measured with comparatively simple, affordable and commercially available techniques. The identification of an LTI, pattern velocity dependent, lift control strategy is relevant to the underlying motion computation mechanisms and serves a broader understanding of insects' flight control strategies. The relevance and potential pitfalls of applying system identification techniques in tethered preparations is discussed.

Control theoretic interpretation of directional motion preferences in optic flow processing interneurons

In this article, we formalize the processing of optic flow in identified fly lobula plate tangential cells and develop a control theoretic framework that suggests how the signals of these cells may be combined and used to achieve reflex-like navigation behavior. We show that this feedback gain synthesis task can be cast as a combined static state estimation and linear feedback control problem. Our framework allows us to analyze and determine the relationship between optic flow measurements and actuator commands, which greatly simplifies the implementation of biologically inspired control architectures on terrestrial and aerial robotic platforms.

A syntax of hoverfly flight prototypes

Hoverflies such as Eristalis tenax Linnaeus are known for their distinctive flight style. They can hover on the same spot for several seconds and then burst into movement in apparently any possible direction. In order to determine a quantitative and structured description of complex flight manoeuvres, we searched for a set of repeatedly occurring prototypical movements (PMs) and a set of rules for their ordering. PMs were identified by applying clustering algorithms to the translational and rotational velocities of the body of Eristalis during free-flight sequences. This approach led to nine stable and reliable PMs, and thus provided a tremendous reduction in the complexity of behavioural description. This set of PMs together with the probabilities of transition between them constitute a syntactical description of flight behaviour. The PMs themselves can be roughly segregated into fast rotational turns (saccades) and a variety of distinct translational movements (intersaccadic intervals). We interpret this segregation as reflecting an active sensing strategy which facilitates the extraction of spatial information from retinal image displacements. Detailed analysis of saccades shows that they are performed around all rotational axes individually and in all possible combinations. We found the probability of occurrence of a given saccade type to depend on parameters such as the angle between the long body axis and the direction of flight.

Goal seeking in honeybees: matching of optic flow snapshots?

Visual landmarks guide humans and animals including insects to a goal location. Insects, with their miniature brains, have evolved a simple strategy to find their nests or profitable food sources; they approach a goal by finding a close match between the current view and a memorised retinotopic representation of the landmark constellation around the goal. Recent implementations of such a matching scheme use raw panoramic images (‘image matching’) and show that it is well suited to work on robots and even in natural environments. However, this matching scheme works only if relevant landmarks can be detected by their contrast and texture. Therefore, we tested how honeybees perform in localising a goal if the landmarks can hardly be distinguished from the background by such cues. We recorded the honeybees' flight behaviour with high-speed cameras and compared the search behaviour with computer simulations. We show that honeybees are able to use landmarks that have the same contrast and texture as the background and suggest that the bees use relative motion cues between the landmark and the background. These cues are generated on the eyes when the bee moves in a characteristic way in the vicinity of the landmarks. This extraordinary navigation performance can be explained by a matching scheme that includes snapshots based on optic flow amplitudes (‘optic flow matching’). This new matching scheme provides a robust strategy for navigation, as it depends primarily on the depth structure of the environment.

Walking modulates speed sensitivity in Drosophila motion vision

Changes in behavioral state modify neural activity in many systems. In some vertebrates such modulation has been observed and interpreted in the context of attention and sensorimotor coordinate transformations. Here we report state-dependent activity modulations during walking in a visual-motor pathway of Drosophila. We used two-photon imaging to monitor intracellular calcium activity in motion-sensitive lobula plate tangential cells (LPTCs) in head-fixed Drosophila walking on an air-supported ball. Cells of the horizontal system (HS)--a subgroup of LPTCs--showed stronger calcium transients in response to visual motion when flies were walking rather than resting. The amplified responses were also correlated with walking speed. Moreover, HS neurons showed a relatively higher gain in response strength at higher temporal frequencies, and their optimum temporal frequency was shifted toward higher motion speeds. Walking-dependent modulation of HS neurons in the Drosophila visual system may constitute a mechanism to facilitate processing of higher image speeds in behavioral contexts where these speeds of visual motion are relevant for course stabilization.

Localized direction selective responses in the dendrites of visual interneurons of the fly

BACKGROUND

The various tasks of visual systems, including course control, collision avoidance and the detection of small objects, require at the neuronal level the dendritic integration and subsequent processing of many spatially distributed visual motion inputs. While much is known about the pooled output in these systems, as in the medial superior temporal cortex of monkeys or in the lobula plate of the insect visual system, the motion tuning of the elements that provide the input has yet received little attention. In order to visualize the motion tuning of these inputs we examined the dendritic activation patterns of neurons that are selective for the characteristic patterns of wide-field motion, the lobula-plate tangential cells (LPTCs) of the blowfly. These neurons are known to sample direction-selective motion information from large parts of the visual field and combine these signals into axonal and dendro-dendritic outputs.

RESULTS

Fluorescence imaging of intracellular calcium concentration allowed us to take a direct look at the local dendritic activity and the resulting local preferred directions in LPTC dendrites during activation by wide-field motion in different directions. These 'calcium response fields' resembled a retinotopic dendritic map of local preferred directions in the receptive field, the layout of which is a distinguishing feature of different LPTCs.

CONCLUSIONS

Our study reveals how neurons acquire selectivity for distinct visual motion patterns by dendritic integration of the local inputs with different preferred directions. With their spatial layout of directional responses, the dendrites of the LPTCs we investigated thus served as matched filters for wide-field motion patterns.

Dynamics of optomotor responses in Drosophila to perturbations in optic flow

For a small flying insect, correcting unplanned course perturbations is essential for navigating through the world. Visual course control relies on estimating optic flow patterns which, in flies, are encoded by interneurons of the third optic ganglion. However, the rules that translate optic flow into flight motor commands remain poorly understood. Here, we measured the temporal dynamics of optomotor responses in tethered flies to optic flow fields about three cardinal axes. For each condition, we used white noise analysis to determine the optimal linear filters linking optic flow to the sum and difference of left and right wing beat amplitudes. The estimated filters indicate that flies react very quickly to perturbations of the motion field, with pure delays in the order of approximately 20 ms and time-to-peak of approximately 100 ms. By convolution the filters also predict responses to arbitrary stimulus sequences, accounting for over half the variance in 5 of our 6 stimulus types, demonstrating the approximate linearity of the system with respect to optic flow variables. In the remaining case of yaw optic flow we improved predictability by measuring individual flies, which also allowed us to analyze the variability of optomotor responses within a population. Finally, the linear filters at least partly explain the optomotor responses to superimposed and decomposed compound flow fields.

Robust coding of ego-motion in descending neurons of the fly

In many species, motion-sensitive neurons responding to optic flow at higher processing stages are well characterized; however, less is known how this representation of ego-motion is further transformed into an appropriate motor response. Here, we analyzed in the blowfly Calliphora vicina the visuomotor transformation from motion-sensitive neurons in the lobula plate [V2 and vertical system (VS) cells] onto premotor descending neurons [descending neurons of the ocellar and vertical system (DNOVS) cells] feeding into the motor circuit of the fly thoracic ganglion. We found that each of these cells is tuned to rotation of the fly around a particular body axis. Comparing the responses of presynaptic and postsynaptic cells revealed that DNOVS cells have approximately the same tuning widths as V2 and VS cells. However, DNOVS signals cells are less corrupted by fluctuations arising from the spatial structure of the visual input than their presynaptic elements. This leads to a more robust representation of ego-motion at the level of descending neurons. Thus, when moving from lobula plate cells to descending neurons, the selectivity for a particular optic flow remains unaltered, but the robustness of the representation increases.

Visual control of flight speed in Drosophila melanogaster

Flight control in insects depends on self-induced image motion (optic flow), which the visual system must process to generate appropriate corrective steering maneuvers. Classic experiments in tethered insects applied rigorous system identification techniques for the analysis of turning reactions in the presence of rotating pattern stimuli delivered in open-loop. However, the functional relevance of these measurements for visual free-flight control remains equivocal due to the largely unknown effects of the highly constrained experimental conditions. To perform a systems analysis of the visual flight speed response under free-flight conditions, we implemented a 'one-parameter open-loop' paradigm using 'TrackFly' in a wind tunnel equipped with real-time tracking and virtual reality display technology. Upwind flying flies were stimulated with sine gratings of varying temporal and spatial frequencies, and the resulting speed responses were measured from the resulting flight speed reactions. To control flight speed, the visual system of the fruit fly extracts linear pattern velocity robustly over a broad range of spatio-temporal frequencies. The speed signal is used for a proportional control of flight speed within locomotor limits. The extraction of pattern velocity over a broad spatio-temporal frequency range may require more sophisticated motion processing mechanisms than those identified in flies so far. In Drosophila, the neuromotor pathways underlying flight speed control may be suitably explored by applying advanced genetic techniques, for which our data can serve as a baseline. Finally, the high-level control principles identified in the fly can be meaningfully transferred into a robotic context, such as for the robust and efficient control of autonomous flying micro air vehicles.

Variability of blowfly head optomotor responses

Behavioural responses of an animal are variable even when the animal experiences the same sensory input several times. This variability can arise from stochastic processes inherent to the nervous system. Also, the internal state of an animal may influence a particular behavioural response. In the present study, we analyse the variability of visually induced head pitch responses of tethered blowflies by high-speed cinematography. We found these optomotor responses to be highly variable in amplitude. Most of the variability can be attributed to two different internal states of the flies with high and low optomotor gain, respectively. Even within a given activity state, there is some variability of head optomotor responses. The amount of this variability differs for the two optomotor gain states. Moreover, these two activity states can be distinguished on a fine timescale and without visual stimulation, on the basis of the occurrence of peculiar head jitter movements. Head jitter goes along with high gain optomotor responses and haltere oscillations. Halteres are evolutionary transformed hindwings that oscillate when blowflies walk or fly. Their main function is to serve as equilibrium organs by detecting Coriolis forces and to mediate gaze stabilisation. However, their basic oscillating activity was also suggested to provide a gain-modulating signal. Our experiments demonstrate that halteres are not necessary for high gain head pitch to occur. Nevertheless, we find the halteres to be responsible for one component of head jitter movements. This component may be the inevitable consequence of their function as equilibrium and gaze-stabilising organs.

Drosophila's view on insect vision

Within the last 400 million years, insects have radiated into at least a million species, accounting for more than half of all known living organisms: they are the most successful group in the animal kingdom, found in almost all environments of the planet, ranging in body size from a mere 0.1 mm up to half a meter. Their eyes, together with the respective parts of the nervous system dedicated to the processing of visual information, have long been the subject of intense investigation but, with the exception of some very basic reflexes, it is still not possible to link an insect's visual input to its behavioral output. Fortunately for the field, the fruit fly Drosophila is an insect, too. This genetic workhorse holds great promise for the insect vision field, offering the possibility of recording, suppressing or stimulating any single neuron in its nervous system. Here, I shall give a brief synopsis of what we currently know about insect vision, describe the genetic toolset available in Drosophila and give some recent examples of how the application of these tools have furthered our understanding of color and motion vision in Drosophila.

Motion adaptation enhances object-induced neural activity in three-dimensional virtual environment

Many response characteristics of neurons sensitive to visual motion depend on stimulus history and change during prolonged stimulation. Although the changes are usually regarded as adaptive, their functional significance is still not fully understood. With experimenter-defined stimuli, previous research on motion adaptation has mainly focused on enhancing the detection of changes in the stimulus domain, on preventing output saturation and on energy efficient coding. Here we will analyze in the blowfly visual system the functional significance of motion adaptation under the complex stimulus conditions encountered in the three-dimensional world. Identified motion sensitive neurons are confronted with seminatural optic flow as is seen by semi-free-flying animals as well as targeted modifications of it. Motion adaptation is shown to enhance object-induced neural responses in a three-dimensional environment although the overall neuronal response amplitude decreases during prolonged motion stimulation.

Visuomotor transformation in the fly gaze stabilization system

For sensory signals to control an animal's behavior, they must first be transformed into a format appropriate for use by its motor systems. This fundamental problem is faced by all animals, including humans. Beyond simple reflexes, little is known about how such sensorimotor transformations take place. Here we describe how the outputs of a well-characterized population of fly visual interneurons, lobula plate tangential cells (LPTCs), are used by the animal's gaze-stabilizing neck motor system. The LPTCs respond to visual input arising from both self-rotations and translations of the fly. The neck motor system however is involved in gaze stabilization and thus mainly controls compensatory head rotations. We investigated how the neck motor system is able to selectively extract rotation information from the mixed responses of the LPTCs. We recorded extracellularly from fly neck motor neurons (NMNs) and mapped the directional preferences across their extended visual receptive fields. Our results suggest that-like the tangential cells-NMNs are tuned to panoramic retinal image shifts, or optic flow fields, which occur when the fly rotates about particular body axes. In many cases, tangential cells and motor neurons appear to be tuned to similar axes of rotation, resulting in a correlation between the coordinate systems the two neural populations employ. However, in contrast to the primarily monocular receptive fields of the tangential cells, most NMNs are sensitive to visual motion presented to either eye. This results in the NMNs being more selective for rotation than the LPTCs. Thus, the neck motor system increases its rotation selectivity by a comparatively simple mechanism: the integration of binocular visual motion information.

Electric imaging through active electrolocation: implication for the analysis of complex scenes

The electric sense of mormyrids is often regarded as an adaptation to conditions unfavourable for vision and in these fish it has become the dominant sense for active orientation and communication tasks. With this sense, fish can detect and distinguish the electrical properties of the close environment, measure distance, perceive the 3-D shape of objects and discriminate objects according to distance or size and shape, irrespective of conductivity, thus showing a degree of abstraction regarding the interpretation of sensory stimuli. The physical properties of images projected on the sensory surface by the fish's own discharge reveal a "Mexican hat" opposing centre-surround profile. It is likely that computation of the image amplitude to slope ratio is used to measure distance, while peak width and slope give measures of shape and contrast. Modelling has been used to explore how the images of multiple objects superimpose in a complex manner. While electric images are by nature distributed, or 'blurred', behavioural strategies orienting sensory surfaces and the neural architecture of sensory processing networks both contribute to resolving potential ambiguities. Rostral amplification is produced by current funnelling in the head and chin appendage regions, where high density electroreceptor distributions constitute foveal regions. Central magnification of electroreceptive pathways from these regions particularly favours the detection of capacitive properties intrinsic to potential living prey. Swimming movements alter the amplitude and contrast of pre-receptor object-images but image modulation is normalised by central gain-control mechanisms that maintain excitatory and inhibitory balance, removing the contrast-ambiguity introduced by self-motion in much the same way that contrast gain-control is achieved in vision.