Variability of blowfly head optomotor responses

Contrast sensitivity, visual acuity and the effect of behavioural state on optokinetic gain in fiddler crabs

Most animals rely on visual information for a variety of everyday tasks. The information available to a visual system depends in part on its spatial resolving power and contrast sensitivity. Because of their competing demands for physical space within an eye, these traits cannot simultaneously be improved without increasing overall eye size. The contrast sensitivity function is an integrated measure of visual performance that measures both resolution and contrast sensitivity. Its measurement helps us identify how different species have made a trade-off between contrast sensitivity and spatial resolution. It further allows us to identify the evolutionary drivers of sensory processing and visually mediated behaviour. Here, we measured the contrast sensitivity function of the fiddler crab Gelasimus dampieri using its optokinetic responses to wide-field moving sinusoidal intensity gratings of different orientations, spatial frequencies, contrasts and speeds. We further tested whether the behavioural state of the crabs (i.e. whether crabs are actively walking or not) affects their optokinetic gain and contrast sensitivity. Our results from a group of five crabs suggest a minimum perceived contrast of 6% and a horizontal and vertical visual acuity of 0.4 cyc deg-1 and 0.28 cyc deg-1, respectively, in the crabs' region of maximum optomotor sensitivity. Optokinetic gain increased in moving crabs compared with restrained crabs, adding another example of the importance of naturalistic approaches when studying the performance of animals.

Mechanisms of punctuated vision in fly flight

To guide locomotion, animals control gaze via movements of their eyes, head, and/or body, but how the nervous system controls gaze during complex motor tasks remains elusive. In many animals, shifts in gaze consist of periods of smooth movement punctuated by rapid eye saccades. Notably, eye movements are constrained by anatomical limits, which requires resetting eye position. By studying tethered, flying fruit flies (Drosophila), we show that flies perform stereotyped head saccades to reset gaze, analogous to optokinetic nystagmus in primates. Head-reset saccades interrupted head smooth movement for as little as 50 ms-representing less than 5% of the total flight time-thereby enabling punctuated gaze stabilization. By revealing the passive mechanics of the neck joint, we show that head-reset saccades leverage the neck's natural elastic recoil, enabling mechanically assisted redirection of gaze. The consistent head orientation at saccade initiation, the influence of the head's angular position on saccade rate, the decrease in wing saccade frequency in head-fixed flies, and the decrease in head-reset saccade rate in flies with their head range of motion restricted together implicate proprioception as the primary trigger of head-reset saccades. Wing-reset saccades were influenced by head orientation, establishing a causal link between neck sensory signals and the execution of body saccades. Head-reset saccades were abolished when flies switched to a landing state, demonstrating that head movements are gated by behavioral state. We propose a control architecture for active vision systems with limits in sensor range of motion. VIDEO ABSTRACT.

Responses of compass neurons in the locust brain to visual motion and leg motor activity

The central complex, a group of midline neuropils in the insect brain, plays a key role in spatial orientation and navigation. Work in locusts, crickets, dung beetles, bees, and butterflies suggests that it harbors a network of neurons which determines the orientation of the insect relative to the pattern of polarized light in the blue sky. In locusts, these compass cells also respond to simulated approaching objects. Here we investigate in the locust Schistocerca gregaria whether compass cells change their activity when the animal experiences large-field visual motion or when the animal is engaged in walking behavior. We recorded intracellularly from these neurons while the tethered animals were allowed to perform walking movements on a slippery surface. We concurrently presented moving grating stimuli from the side or polarized light through a rotating polarizer from above. Large-field motion was combined with the simulation of approaching objects to evaluate whether responses differed from those presented on a stationary background. Here we show for the first time that compass cells are sensitive to large-field motion. Responses to looming stimuli were often more conspicuous during large-field motion. Walking activity influenced spiking rates at all stages of the network. The strength of responses to the plane of polarized light was affected in some compass cells during leg motor activity. The data show that signaling in compass cells of the locust central complex is modulated by visual context and locomotor activity.

Cortical neurons of bats respond best to echoes from nearest targets when listening to natural biosonar multi-echo streams

Bats orientate in darkness by listening to echoes from their biosonar calls, a behaviour known as echolocation. Recent studies showed that cortical neurons respond in a highly selective manner when stimulated with natural echolocation sequences that contain echoes from single targets. However, it remains unknown how cortical neurons process echolocation sequences containing echo information from multiple objects. In the present study, we used echolocation sequences containing echoes from three, two or one object separated in the space depth as stimuli to study neuronal activity in the bat auditory cortex. Neuronal activity was recorded with multi-electrode arrays placed in the dorsal auditory cortex, where neurons tuned to target-distance are found. Our results show that target-distance encoding neurons are mostly selective to echoes coming from the closest object, and that the representation of echo information from distant objects is selectively suppressed. This suppression extends over a large part of the dorsal auditory cortex and may override possible parallel processing of multiple objects. The presented data suggest that global cortical suppression might establish a cortical "default mode" that allows selectively focusing on close obstacle even without active attention from the animals.

Complementary motion tuning in frontal nerve motor neurons of the blowfly

Flies actively turn their head during flight to stabilize their gaze and reduce motion blur. This optomotor response is triggered by wide-field motion indicating a deviation from a desired flight path. We focus on the neuronal circuit that underlies this behavior in the blowfly Calliphora, studying the integration of optic flow in neck motor neurons that innervate muscles controlling head rotations. Frontal nerve motor neurons (FNMNs) have been described anatomically and recorded from extracellularly before. Here, we assign for the first time to five anatomical classes of FNMNs their visual motion tuning. We measured their responses to optic flow, as produced by rotations around particular body axes, recording intracellularly from single axons. Simultaneous injection of Neurobiotin allowed for the anatomical characterization of the recorded cells and revealed coupling patterns with neighboring neurons. The five FNMN classes can be divided into two groups that complement each other, regarding their preferred axes of rotation. The tuning matches the pulling planes of their innervated neck muscles, serving to rotate the head around its longitudinal axis. Anatomical and physiological findings demonstrate a synaptic connection between one FNMN and a well-described descending neuron, elucidating one important step from visual motion integration to neck motor output.

Saccadic body turns in walking Drosophila

Drosophila melanogaster structures its optic flow during flight by interspersing translational movements with abrupt body rotations. Whether these “body saccades” are accompanied by steering movements of the head is a matter of debate. By tracking single flies moving freely in an arena, we now discovered that walking Drosophila also perform saccades. Movement analysis revealed that the flies separate rotational from translational movements by quickly turning their bodies by 15 degrees within a tenth of a second. Although walking flies moved their heads by up to 20 degrees about their bodies, their heads moved with the bodies during saccadic turns. This saccadic strategy contrasts with the head saccades reported for e.g., blowflies and honeybees, presumably reflecting optical constraints: modeling revealed that head saccades as described for these latter insects would hardly affect the retinal input in Drosophila because of the lower acuity of its compound eye. The absence of head saccades in Drosophila was associated with the absence of haltere oscillations, which seem to guide head movements in other flies. In addition to adding new twists to Drosophila walking behavior, our analysis shows that Drosophila does not turn its head relative to its body when turning during walking.

Towards a biomimetic gyroscope inspired by the fly's haltere using microelectromechanical systems technology

Flies use so-called halteres to sense body rotation based on Coriolis forces for supporting equilibrium reflexes. Inspired by these halteres, a biomimetic gimbal-suspended gyroscope has been developed using microelectromechanical systems (MEMS) technology. Design rules for this type of gyroscope are derived, in which the haltere-inspired MEMS gyroscope is geared towards a large measurement bandwidth and a fast response, rather than towards a high responsivity. Measurements for the biomimetic gyroscope indicate a (drive mode) resonance frequency of about 550 Hz and a damping ratio of 0.9. Further, the theoretical performance of the fly's gyroscopic system and the developed MEMS haltere-based gyroscope is assessed and the potential of this MEMS gyroscope is discussed.

Dynamic use of optic flow during pheromone tracking by the male silkmoth, Bombyx mori

Several insects require both olfactory and visual cues during odour-source localisation to successfully locate an odour source. In the male silkmoth, Bombyx mori, detection of the female sex pheromone triggers a programmed walking pattern, starting from a surge (straight-line walking) followed by zigzag walking. Although pheromone-triggered behaviour in silkmoths is well understood, the role of visual cues remains obscure. To address this question, we performed behavioural experiments on tethered-walking moths by recording their locomotion during stimulation with a pheromone and a visual motion pattern (optic flow). The experiments were conducted under open- and closed-loop visual stimuli. We found that the use of optic flow input was determined by the behavioural state of surge and zigzagging. Silkmoths exhibited an optomotor response, which is a behavioural visual response, by turning towards the same direction as optic flow stimuli only during surge, but not during zigzagging. In addition, modulation of the zigzag walking pattern was observed when the moths were presented with biased closed-loop visual stimuli (visual feedback with biased constant optic flow); however, the directional preference mechanism was different from that of the optomotor response. Based on these findings, we suggest that the optomotor response is utilised for course control during straight-line walking, whereas the absence of optomotor response during zigzagging is used to effectively perform the programmed walking pattern. Considering the neural basis of programmed behaviour, we speculate that at least two visual pathways are involved in the state-dependent use of optic flow during odour tracking behaviour in silkmoths.

Discriminating external and internal causes for heading changes in freely flying Drosophila

As animals move through the world in search of resources, they change course in reaction to both external sensory cues and internally-generated programs. Elucidating the functional logic of complex search algorithms is challenging because the observable actions of the animal cannot be unambiguously assigned to externally- or internally-triggered events. We present a technique that addresses this challenge by assessing quantitatively the contribution of external stimuli and internal processes. We apply this technique to the analysis of rapid turns (“saccades”) of freely flying Drosophila melanogaster. We show that a single scalar feature computed from the visual stimulus experienced by the animal is sufficient to explain a majority (93%) of the turning decisions. We automatically estimate this scalar value from the observable trajectory, without any assumption regarding the sensory processing. A posteriori, we show that the estimated feature field is consistent with previous results measured in other experimental conditions. The remaining turning decisions, not explained by this feature of the visual input, may be attributed to a combination of deterministic processes based on unobservable internal states and purely stochastic behavior. We cannot distinguish these contributions using external observations alone, but we are able to provide a quantitative bound of their relative importance with respect to stimulus-triggered decisions. Our results suggest that comparatively few saccades in free-flying conditions are a result of an intrinsic spontaneous process, contrary to previous suggestions. We discuss how this technique could be generalized for use in other systems and employed as a tool for classifying effects into sensory, decision, and motor categories when used to analyze data from genetic behavioral screens.

Researchers have spent considerable effort studying how specific sensory stimuli elicit behavioral responses and how other behaviors may arise independent of external inputs in conditions of sensory deprivation. Yet an animal in its natural context, such as searching for food or mates, turns both in response to external stimuli and intrinsic, possibly stochastic, decisions. We show how to estimate the contribution of vision and internal causes on the observable behavior of freely flying Drosophila. We developed a dimensionality reduction scheme that finds a one-dimensional feature of the visual stimulus that best predicts turning decisions. This visual feature extraction is consistent with previous literature on visually elicited fly turning and predicts a large majority of turns in the tested environment. The rarity of stimulus-independent events suggests that fly behavior is more deterministic than previously suggested and that, more generally, animal search strategies may be dominated by responses to stimuli with only modest contributions from internal causes.

Spatial vision in insects is facilitated by shaping the dynamics of visual input through behavioral action

Insects such as flies or bees, with their miniature brains, are able to control highly aerobatic flight maneuvres and to solve spatial vision tasks, such as avoiding collisions with obstacles, landing on objects, or even localizing a previously learnt inconspicuous goal on the basis of environmental cues. With regard to solving such spatial tasks, these insects still outperform man-made autonomous flying systems. To accomplish their extraordinary performance, flies and bees have been shown by their characteristic behavioral actions to actively shape the dynamics of the image flow on their eyes ("optic flow"). The neural processing of information about the spatial layout of the environment is greatly facilitated by segregating the rotational from the translational optic flow component through a saccadic flight and gaze strategy. This active vision strategy thus enables the nervous system to solve apparently complex spatial vision tasks in a particularly efficient and parsimonious way. The key idea of this review is that biological agents, such as flies or bees, acquire at least part of their strength as autonomous systems through active interactions with their environment and not by simply processing passively gained information about the world. These agent-environment interactions lead to adaptive behavior in surroundings of a wide range of complexity. Animals with even tiny brains, such as insects, are capable of performing extraordinarily well in their behavioral contexts by making optimal use of the closed action-perception loop. Model simulations and robotic implementations show that the smart biological mechanisms of motion computation and visually-guided flight control might be helpful to find technical solutions, for example, when designing micro air vehicles carrying a miniaturized, low-weight on-board processor.

Impact and sources of neuronal variability in the fly's motion vision pathway

Nervous systems encode information about dynamically changing sensory input by changes in neuronal activity. Neuronal activity changes, however, also arise from noise sources within and outside the nervous system or from changes of the animal's behavioral state. The resulting variability of neuronal responses in representing sensory stimuli limits the reliability with which animals can respond to stimuli and may thus even affect the chances for survival in certain situations. Relevant sources of noise arising at different stages along the motion vision pathway have been investigated from the sensory input to the initiation of behavioral reactions. Here, we concentrate on the reliability of processing visual motion information in flies. Flies rely on visual motion information to guide their locomotion. They are among the best established model systems for the processing of visual motion information allowing us to bridge the gap between behavioral performance and underlying neuronal computations. It has been possible to directly assess the consequences of noise at major stages of the fly's visual motion processing system on the reliability of neuronal signals. Responses of motion sensitive neurons and their variability have been related to optomotor movements as indicators for the overall performance of visual motion computation. We address whether and how noise already inherent in the stimulus, e.g. photon noise for the visual system, influences later processing stages and to what extent variability at the output level of the sensory system limits behavioral performance. Recent advances in circuit analysis and the progress in monitoring neuronal activity in behaving animals should now be applied to understand how the animal meets the requirements of fast and reliable manoeuvres in naturalistic situations.

Octopaminergic modulation of contrast gain adaptation in fly visual motion-sensitive neurons

Locomotor activity like walking or flying has recently been shown to alter visual processing in several species. In insects, the neuromodulator octopamine is thought to play an important role in mediating state changes during locomotion of the animal [K.D. Longden & H.G. Krapp (2009) J. Neurophysiol., 102, 3606-3618; (2010) Front. Syst. Neurosci., 4, 153; S.N. Jung et al. (2011)J. Neurosci., 31, 9231-9237]. Here, we used the octopamine agonist chlordimeform (CDM) to mimic effects of behavioural state changes on visual motion processing. We recorded from identified motion-sensitive visual interneurons in the lobula plate of the blowfly Calliphora vicina. In these neurons, which are thought to be involved in visual guidance of locomotion, motion adaptation leads to a prominent attenuation of contrast sensitivity. Following CDM application, the neurons maintained high contrast sensitivity in the adapted state. This modulation of contrast gain adaptation was independent of the activity of the recorded neurons, because it was also present after stimulation with visual motion that did not result in deviations from the neurons' resting activity. We conclude that CDM affects presynaptic inputs of the recorded neurons. Accordingly, the effect of CDM was weak when adapting and test stimuli were presented in different parts of the receptive field, stimulating separate populations of local presynaptic neurons. In the peripheral visual system adaptation depends on the temporal frequency of the stimulus pattern and is therefore related to pattern velocity. Contrast gain adaptation could therefore be the basis for a shift in the velocity tuning that was previously suggested to contribute to state-dependent processing of visual motion information in the lobula plate interneurons.

Integration of binocular optic flow in cervical neck motor neurons of the fly

Global visual motion elicits an optomotor response of the eye that stabilizes the visual input on the retina. Here, we analyzed the neck motor system of the blowfly to understand binocular integration of visual motion information underlying a head optomotor response. We identified and characterized two cervical nerve motor neurons (called CNMN6 and CNMN7) tuned precisely to an optic flow corresponding to pitch movements of the head. By means of double recordings and dye coupling, we determined that these neurons are connected ipsilaterally to two vertical system cells (VS2 and VS3), and contralaterally to one horizontal system cell (HSS). In addition, CNMN7 turned out to be connected to the ipsilateral CNMN6 and to its contralateral counterpart. To analyze a potential function of this circuit, we performed behavioral experiments and found that the optomotor pitch response of the fly head was only observable when both eyes were intact. Thus, this neural circuit performs two visuomotor transformations: first, by integrating binocular visual information it enhances the tuning to the optic flow resulting from pitch movements of the head, and second it could assure an even head declination by coordinating the activity of the CNMN7 neurons on both sides.

Species-Specific Flight Styles of Flies are Reflected in the Response Dynamics of a Homolog Motion-Sensitive Neuron

Hoverflies and blowflies have distinctly different flight styles. Yet, both species have been shown to structure their flight behavior in a way that facilitates extraction of 3D information from the image flow on the retina (optic flow). Neuronal candidates to analyze the optic flow are the tangential cells in the third optical ganglion - the lobula complex. These neurons are directionally selective and integrate the optic flow over large parts of the visual field. Homolog tangential cells in hoverflies and blowflies have a similar morphology. Because blowflies and hoverflies have similar neuronal layout but distinctly different flight behaviors, they are an ideal substrate to pinpoint potential neuronal adaptations to the different flight styles. In this article we describe the relationship between locomotion behavior and motion vision on three different levels: (1) We compare the different flight styles based on the categorization of flight behavior into prototypical movements. (2) We measure the species-specific dynamics of the optic flow under naturalistic flight conditions. We found the translational optic flow of both species to be very different. (3) We describe possible adaptations of a homolog motion-sensitive neuron. We stimulate this cell in blowflies (Calliphora) and hoverflies (Eristalis) with naturalistic optic flow generated by both species during free flight. The characterized hoverfly tangential cell responds faster to transient changes in the optic flow than its blowfly homolog. It is discussed whether and how the different dynamical response properties aid optic flow analysis.

Relating neuronal to behavioral performance: variability of optomotor responses in the blowfly

Behavioral responses of an animal vary even when they are elicited by the same stimulus. This variability is due to stochastic processes within the nervous system and to the changing internal states of the animal. To what extent does the variability of neuronal responses account for the overall variability at the behavioral level? To address this question we evaluate the neuronal variability at the output stage of the blowfly's (Calliphora vicina) visual system by recording from motion-sensitive interneurons mediating head optomotor responses. By means of a simple modelling approach representing the sensory-motor transformation, we predict head movements on the basis of the recorded responses of motion-sensitive neurons and compare the variability of the predicted head movements with that of the observed ones. Large gain changes of optomotor head movements have previously been shown to go along with changes in the animals' activity state. Our modelling approach substantiates that these gain changes are imposed downstream of the motion-sensitive neurons of the visual system. Moreover, since predicted head movements are clearly more reliable than those actually observed, we conclude that substantial variability is introduced downstream of the visual system.

Contextual modulation of behavioral choice

We review the influence of context on behavioral choice. Context can refer to external (environmental) factors such as the season or presence of predators and it can also refer to the internal or behavioral state of an animal. Usually, animals make decisions in the midst of other ongoing behaviors. We discuss recent findings on the impact of both types of contexts, focusing on how context gets encoded at the intersection between the sensory and motor systems, emphasizing the role of neuromodulators. We also review recent technological advances that have made feasible the exploration of neural correlates of decision making in freely moving, behaving animals.

Towards a scientific concept of free will as a biological trait: spontaneous actions and decision-making in invertebrates

Until the advent of modern neuroscience, free will used to be a theological and a metaphysical concept, debated with little reference to brain function. Today, with ever increasing understanding of neurons, circuits and cognition, this concept has become outdated and any metaphysical account of free will is rightfully rejected. The consequence is not, however, that we become mindless automata responding predictably to external stimuli. On the contrary, accumulating evidence also from brains much smaller than ours points towards a general organization of brain function that incorporates flexible decision-making on the basis of complex computations negotiating internal and external processing. The adaptive value of such an organization consists of being unpredictable for competitors, prey or predators, as well as being able to explore the hidden resource deterministic automats would never find. At the same time, this organization allows all animals to respond efficiently with tried-and-tested behaviours to predictable and reliable stimuli. As has been the case so many times in the history of neuroscience, invertebrate model systems are spearheading these research efforts. This comparatively recent evidence indicates that one common ability of most if not all brains is to choose among different behavioural options even in the absence of differences in the environment and perform genuinely novel acts. Therefore, it seems a reasonable effort for any neurobiologist to join and support a rather illustrious list of scholars who are trying to wrestle the term 'free will' from its metaphysical ancestry. The goal is to arrive at a scientific concept of free will, starting from these recently discovered processes with a strong emphasis on the neurobiological mechanisms underlying them.

Central gating of fly optomotor response

We study the integration of multisensory and central input at the level of an identified fly motoneuron, the ventral cervical nerve motoneuron (VCNM) cell, which controls head movements of the animal. We show that this neuron receives input from a central neuron signaling flight activity, from two identified wide-field motion-sensitive neurons, from the wind-sensitive Johnston organ on the antennae, and from the campaniform sensillae of the halteres. We find that visual motion alone leads to only subthreshold responses. Only when it is combined with flight activity or wind stimuli does the VCNM respond to visual motion by modulating its spike activity in a directionally selective way. This nonlinear enhancement of visual responsiveness in the VCNM by central activity is reflected at the behavioral level, when compensatory head movements are measured in response to visual motion. While head movements of flies have only a small amplitude when flies are at rest, the response amplitude is increased by a factor of 30-40 during flight.

Dynamics of optomotor responses in Drosophila to perturbations in optic flow

For a small flying insect, correcting unplanned course perturbations is essential for navigating through the world. Visual course control relies on estimating optic flow patterns which, in flies, are encoded by interneurons of the third optic ganglion. However, the rules that translate optic flow into flight motor commands remain poorly understood. Here, we measured the temporal dynamics of optomotor responses in tethered flies to optic flow fields about three cardinal axes. For each condition, we used white noise analysis to determine the optimal linear filters linking optic flow to the sum and difference of left and right wing beat amplitudes. The estimated filters indicate that flies react very quickly to perturbations of the motion field, with pure delays in the order of approximately 20 ms and time-to-peak of approximately 100 ms. By convolution the filters also predict responses to arbitrary stimulus sequences, accounting for over half the variance in 5 of our 6 stimulus types, demonstrating the approximate linearity of the system with respect to optic flow variables. In the remaining case of yaw optic flow we improved predictability by measuring individual flies, which also allowed us to analyze the variability of optomotor responses within a population. Finally, the linear filters at least partly explain the optomotor responses to superimposed and decomposed compound flow fields.

Behavioural state affects motion-sensitive neurones in the fly visual system

The strength of stimulus-induced responses at the neuronal and the behavioural level often depends on the internal state of an animal. Within pathways processing sensory information and eventually controlling behavioural responses, such gain changes can originate at several sites. Using motion-sensitive lobula plate tangential cells (LPTCs) of blowflies, we address whether and in which way information processing changes for two different states of motor activity. We distinguish between the two states on the basis of haltere movements. Halteres are the evolutionarily transformed hindwings of flies. They oscillate when the animals walk or fly. LPTCs mediate, amongst other behaviours, head optomotor responses. These are either of large or small amplitude depending on the state of motor activity. Here we find that LPTC responses also depend on the motor activity of flies. In particular, LPTC responses are enhanced when halteres oscillate. Nevertheless, the response changes of LPTCs do not account for the corresponding large gain changes of head movements. Moreover, haltere activity itself does not change the activity of LPTCs. Instead, we propose that a central signal associated with motor activity changes the gain of head optomotor responses and the response properties of LPTCs.

Nonlinear integration of visual and haltere inputs in fly neck motor neurons

Animals use information from multiple sensory organs to generate appropriate behavior. Exactly how these different sensory inputs are fused at the motor system is not well understood. Here we study how fly neck motor neurons integrate information from two well characterized sensory systems: visual information from the compound eye and gyroscopic information from the mechanosensory halteres. Extracellular recordings reveal that a subpopulation of neck motor neurons display "gating-like" behavior: they do not fire action potentials in response to visual stimuli alone but will do so if the halteres are coactivated. Intracellular recordings show that these motor neurons receive small, sustained subthreshold visual inputs in addition to larger inputs that are phase locked to haltere movements. Our results suggest that the nonlinear gating-like effect results from summation of these two inputs with the action potential threshold providing the nonlinearity. As a result of this summation, the sustained visual depolarization is transformed into a temporally structured train of action potentials synchronized to the haltere beating movements. This simple mechanism efficiently fuses two different sensory signals and may also explain the context-dependent effects of visual inputs on fly behavior.