Response properties of motion-sensitive visual interneurons in the lobula plate of Drosophila melanogaster

Neuronal "parts list" and wiring diagram for a visual system

A catalog of neuronal cell types has often been called a "parts list" of the brain, and regarded as a prerequisite for understanding brain function. In the optic lobe of Drosophila, rules of connectivity between cell types have already proven essential for understanding fly vision. Here we analyze the fly connectome to complete the list of cell types intrinsic to the optic lobe, as well as the rules governing their connectivity. We more than double the list of known types. Most new cell types contain between 10 and 100 cells, and integrate information over medium distances in the visual field. Some existing type families (Tm, Li, and LPi) at least double in number of types. We introduce a new Sm interneuron family, which contains more types than any other, and three new families of cross-neuropil types. Self-consistency of cell types is demonstrated through automatic assignment of cells to types by distance in high-dimensional feature space, and further validation is provided by algorithms that select small subsets of discriminative features. Cell types with similar connectivity patterns divide into clusters that are interpretable in terms of motion, object, and color vision. Our work showcases the advantages of connectomic cell typing: complete and unbiased sampling, a rich array of features based on connectivity, and reduction of the connectome to a drastically simpler wiring diagram of cell types, with immediate relevance for brain function and development.

Multilevel visual motion opponency in Drosophila

Inhibitory interactions between opponent neuronal pathways constitute a common circuit motif across brain areas and species. However, in most cases, synaptic wiring and biophysical, cellular and network mechanisms generating opponency are unknown. Here, we combine optogenetics, voltage and calcium imaging, connectomics, electrophysiology and modeling to reveal multilevel opponent inhibition in the fly visual system. We uncover a circuit architecture in which a single cell type implements direction-selective, motion-opponent inhibition at all three network levels. This inhibition, mediated by GluClα receptors, is balanced with excitation in strength, despite tenfold fewer synapses. The different opponent network levels constitute a nested, hierarchical structure operating at increasing spatiotemporal scales. Electrophysiology and modeling suggest that distributing this computation over consecutive network levels counteracts a reduction in gain, which would result from integrating large opposing conductances at a single instance. We propose that this neural architecture provides resilience to noise while enabling high selectivity for relevant sensory information.

A comprehensive neuroanatomical survey of the Drosophila Lobula Plate Tangential Neurons with predictions for their optic flow sensitivity

Flying insects exhibit remarkable navigational abilities controlled by their compact nervous systems. Optic flow, the pattern of changes in the visual scene induced by locomotion, is a crucial sensory cue for robust self-motion estimation, especially during rapid flight. Neurons that respond to specific, large-field optic flow patterns have been studied for decades, primarily in large flies, such as houseflies, blowflies, and hover flies. The best-known optic-flow sensitive neurons are the large tangential cells of the dipteran lobula plate, whose visual-motion responses, and to a lesser extent, their morphology, have been explored using single-neuron neurophysiology. Most of these studies have focused on the large, Horizontal and Vertical System neurons, yet the lobula plate houses a much larger set of 'optic-flow' sensitive neurons, many of which have been challenging to unambiguously identify or to reliably target for functional studies. Here we report the comprehensive reconstruction and identification of the Lobula Plate Tangential Neurons in an Electron Microscopy (EM) volume of a whole Drosophila brain. This catalog of 58 LPT neurons (per brain hemisphere) contains many neurons that are described here for the first time and provides a basis for systematic investigation of the circuitry linking self-motion to locomotion control. Leveraging computational anatomy methods, we estimated the visual motion receptive fields of these neurons and compared their tuning to the visual consequence of body rotations and translational movements. We also matched these neurons, in most cases on a one-for-one basis, to stochastically labeled cells in genetic driver lines, to the mirror-symmetric neurons in the same EM brain volume, and to neurons in an additional EM data set. Using cell matches across data sets, we analyzed the integration of optic flow patterns by neurons downstream of the LPTs and find that most central brain neurons establish sharper selectivity for global optic flow patterns than their input neurons. Furthermore, we found that self-motion information extracted from optic flow is processed in distinct regions of the central brain, pointing to diverse foci for the generation of visual behaviors.

Long-timescale anti-directional rotation in Drosophila optomotor behavior

Locomotor movements cause visual images to be displaced across the eye, a retinal slip that is counteracted by stabilizing reflexes in many animals. In insects, optomotor turning causes the animal to turn in the direction of rotating visual stimuli, thereby reducing retinal slip and stabilizing trajectories through the world. This behavior has formed the basis for extensive dissections of motion vision. Here, we report that under certain stimulus conditions, two Drosophila species, including the widely studied Drosophila melanogaster, can suppress and even reverse the optomotor turning response over several seconds. Such 'anti-directional turning' is most strongly evoked by long-lasting, high-contrast, slow-moving visual stimuli that are distinct from those that promote syn-directional optomotor turning. Anti-directional turning, like the syn-directional optomotor response, requires the local motion detecting neurons T4 and T5. A subset of lobula plate tangential cells, CH cells, show involvement in these responses. Imaging from a variety of direction-selective cells in the lobula plate shows no evidence of dynamics that match the behavior, suggesting that the observed inversion in turning direction emerges downstream of the lobula plate. Further, anti-directional turning declines with age and exposure to light. These results show that Drosophila optomotor turning behaviors contain rich, stimulus-dependent dynamics that are inconsistent with simple reflexive stabilization responses.

Circuits for self-motion estimation and walking control in Drosophila

The brain's evolution and operation are inextricably linked to animal movement, and critical functions, such as motor control, spatial perception, and navigation, rely on precise knowledge of body movement. Such internal estimates of self-motion emerge from the integration of mechanosensory and visual feedback with motor-related signals. Thus, this internal representation likely depends on the activity of circuits distributed across the central nervous system. However, the circuits responsible for self-motion estimation, and the exact mechanisms by which motor-sensory coordination occurs within these circuits remain poorly understood. Recent technological advances have positioned Drosophila melanogaster as an advantageous model for investigating the emergence, maintenance, and utilization of self-motion representations during naturalistic walking behaviors. In this review, I will illustrate how the adult fly is providing insights into the fundamental problems of self-motion computations and walking control, which have relevance for all animals.

How Flies See Motion

How neurons detect the direction of motion is a prime example of neural computation: Motion vision is found in the visual systems of virtually all sighted animals, it is important for survival, and it requires interesting computations with well-defined linear and nonlinear processing steps-yet the whole process is of moderate complexity. The genetic methods available in the fruit fly Drosophila and the charting of a connectome of its visual system have led to rapid progress and unprecedented detail in our understanding of how neurons compute the direction of motion in this organism. The picture that emerged incorporates not only the identity, morphology, and synaptic connectivity of each neuron involved but also its neurotransmitters, its receptors, and their subcellular localization. Together with the neurons' membrane potential responses to visual stimulation, this information provides the basis for a biophysically realistic model of the circuit that computes the direction of visual motion.

Visual processing in the fly, from photoreceptors to behavior

Originally a genetic model organism, the experimental use of Drosophila melanogaster has grown to include quantitative behavioral analyses, sophisticated perturbations of neuronal function, and detailed sensory physiology. A highlight of these developments can be seen in the context of vision, where pioneering studies have uncovered fundamental and generalizable principles of sensory processing. Here we begin with an overview of vision-guided behaviors and common methods for probing visual circuits. We then outline the anatomy and physiology of brain regions involved in visual processing, beginning at the sensory periphery and ending with descending motor control. Areas of focus include contrast and motion detection in the optic lobe, circuits for visual feature selectivity, computations in support of spatial navigation, and contextual associative learning. Finally, we look to the future of fly visual neuroscience and discuss promising topics for further study.

Long timescale anti-directional rotation in Drosophila optomotor behavior

Locomotor movements cause visual images to be displaced across the eye, a retinal slip that is counteracted by stabilizing reflexes in many animals. In insects, optomotor turning causes the animal to turn in the direction of rotating visual stimuli, thereby reducing retinal slip and stabilizing trajectories through the world. This behavior has formed the basis for extensive dissections of motion vision. Here, we report that under certain stimulus conditions, two Drosophila species, including the widely studied D. melanogaster, can suppress and even reverse the optomotor turning response over several seconds. Such "anti-directional turning" is most strongly evoked by long-lasting, high-contrast, slow-moving visual stimuli that are distinct from those that promote syn-directional optomotor turning. Anti-directional turning, like the syn-directional optomotor response, requires the local motion detecting neurons T4 and T5. A subset of lobula plate tangential cells, CH cells, show involvement in these responses. Imaging from a variety of direction-selective cells in the lobula plate shows no evidence of dynamics that match the behavior, suggesting that the observed inversion in turning direction emerges downstream of the lobula plate. Further, anti-directional turning declines with age and exposure to light. These results show that Drosophila optomotor turning behaviors contain rich, stimulus-dependent dynamics that are inconsistent with simple reflexive stabilization responses.

Calcium Imaging of Neural Activity in Fly Photoreceptors

Functional imaging methodologies allow researchers to simultaneously monitor the neural activities of all single neurons in a population, and this ability has led to great advances in neuroscience research. Taking advantage of a genetically tractable model organism, functional imaging in Drosophila provides opportunities to probe scientific questions that were previously unanswerable by electrophysiological recordings. Here, we introduce comprehensive protocols for two-photon calcium imaging in fly visual neurons. We also discuss some challenges in applying optical imaging techniques to study visual systems and consider the best practices for making comparisons between different neuron groups.

Neuronal circuits integrating visual motion information in Drosophila melanogaster

The detection of visual motion enables sophisticated animal navigation, and studies on flies have provided profound insights into the cellular and circuit bases of this neural computation. The fly's directionally selective T4 and T5 neurons encode ON and OFF motion, respectively. Their axons terminate in one of the four retinotopic layers in the lobula plate, where each layer encodes one of the four directions of motion. Although the input circuitry of the directionally selective neurons has been studied in detail, the synaptic connectivity of circuits integrating T4/T5 motion signals is largely unknown. Here, we report a 3D electron microscopy reconstruction, wherein we comprehensively identified T4/T5's synaptic partners in the lobula plate, revealing a diverse set of new cell types and attributing new connectivity patterns to the known cell types. Our reconstruction explains how the ON- and OFF-motion pathways converge. T4 and T5 cells that project to the same layer connect to common synaptic partners and comprise a core motif together with bilayer interneurons, detailing the circuit basis for computing motion opponency. We discovered pathways that likely encode new directions of motion by integrating vertical and horizontal motion signals from upstream T4/T5 neurons. Finally, we identify substantial projections into the lobula, extending the known motion pathways and suggesting that directionally selective signals shape feature detection there. The circuits we describe enrich the anatomical basis for experimental and computations analyses of motion vision and bring us closer to understanding complete sensory-motor pathways.

A robust receptive field code for optic flow detection and decomposition during self-motion

The perception of optic flow is essential for any visually guided behavior of a moving animal. To mechanistically predict behavior and understand the emergence of self-motion perception in vertebrate brains, it is essential to systematically characterize the motion receptive fields (RFs) of optic-flow-processing neurons. Here, we present the fine-scale RFs of thousands of motion-sensitive neurons studied in the diencephalon and the midbrain of zebrafish. We found neurons that serve as linear filters and robustly encode directional and speed information of translation-induced optic flow. These neurons are topographically arranged in pretectum according to translation direction. The unambiguous encoding of translation enables the decomposition of translational and rotational self-motion information from mixed optic flow. In behavioral experiments, we successfully demonstrated the predicted decomposition in the optokinetic and optomotor responses. Together, our study reveals the algorithm and the neural implementation for self-motion estimation in a vertebrate visual system.

From Photons to Behaviors: Neural Implementations of Visual Behaviors in Drosophila

Neural implementations of visual behaviors in Drosophila have been dissected intensively in the past couple of decades. The availability of premiere genetic toolkits, behavioral assays in tethered or freely moving conditions, and advances in connectomics have permitted the understanding of the physiological and anatomical details of the nervous system underlying complex visual behaviors. In this review, we describe recent advances on how various features of a visual scene are detected by the Drosophila visual system and how the neural circuits process these signals and elicit an appropriate behavioral response. Special emphasis was laid on the neural circuits that detect visual features such as brightness, color, local motion, optic flow, and translating or approaching visual objects, which would be important for behaviors such as phototaxis, optomotor response, attraction (or aversion) to moving objects, navigation, and visual learning. This review offers an integrative framework for how the fly brain detects visual features and orchestrates an appropriate behavioral response.

An Artificial Visual System for Motion Direction Detection Based on the Hassenstein–Reichardt Correlator Model

The perception of motion direction is essential for the survival of visual animals. Despite various theoretical and biophysical investigations that have been conducted to elucidate directional selectivity at the neural level, the systemic mechanism of motion direction detection remains elusive. Here, we develop an artificial visual system (AVS) based on the core computation of the Hassenstein–Reichardt correlator (HRC) model for global motion direction detection. With reference to the biological investigations of Drosophila, we first describe a local motion-sensitive, directionally detective neuron that only responds to ON motion signals with high pattern contrast in a particular direction. Then, we use the full-neurons scheme motion direction detection mechanism to detect the global motion direction based on our previous research. The mechanism enables our AVS to detect multiple directions in a two-dimensional view, and the global motion direction is inferred from the outputs of all local motion-sensitive directionally detective neurons. To verify the reliability of our AVS, we conduct a series of experiments and compare its performance with the time-considered convolution neural network (CNN) and the EfficientNetB0 under the same conditions. The experimental results demonstrated that our system is reliable in detecting the direction of motion, and among the three models, our AVS has better motion direction detection capabilities.

Populations of local direction-selective cells encode global motion patterns generated by self-motion

Self-motion generates visual patterns on the eye that are important for navigation. These optic flow patterns are encoded by the population of local direction–selective cells in the mouse retina, whereas in flies, local direction–selective T4/T5 cells are thought to be uniformly tuned. How complex global motion patterns can be computed downstream is unclear. We show that the population of T4/T5 cells in Drosophila encodes global motion patterns. Whereas the mouse retina encodes four types of optic flow, the fly visual system encodes six. This matches the larger number of degrees of freedom and the increased complexity of translational and rotational motion patterns during flight. The four uniformly tuned T4/T5 subtypes described previously represent a local subset of the population. Thus, a population code for global motion patterns appears to be a general coding principle of visual systems that matches local motion responses to modes of the animal’s movement.

Predicting individual neuron responses with anatomically constrained task optimization

Artificial neural networks trained to solve sensory tasks can develop statistical representations that match those in biological circuits. However, it remains unclear whether they can reproduce properties of individual neurons. Here, we investigated how artificial networks predict individual neuron properties in the visual motion circuits of the fruit fly Drosophila. We trained anatomically constrained networks to predict movement in natural scenes, solving the same inference problem as fly motion detectors. Units in the artificial networks adopted many properties of analogous individual neurons, even though they were not explicitly trained to match these properties. Among these properties was the split into ON and OFF motion detectors, which is not predicted by classical motion detection models. The match between model and neurons was closest when models were trained to be robust to noise. These results demonstrate how anatomical, task, and noise constraints can explain properties of individual neurons in a small neural network.

Spherical arena reveals optokinetic response tuning to stimulus location, size, and frequency across entire visual field of larval zebrafish

Many animals have large visual fields, and sensory circuits may sample those regions of visual space most relevant to behaviours such as gaze stabilisation and hunting. Despite this, relatively small displays are often used in vision neuroscience. To sample stimulus locations across most of the visual field, we built a spherical stimulus arena with 14,848 independently controllable LEDs. We measured the optokinetic response gain of immobilised zebrafish larvae to stimuli of different steradian size and visual field locations. We find that the two eyes are less yoked than previously thought and that spatial frequency tuning is similar across visual field positions. However, zebrafish react most strongly to lateral, nearly equatorial stimuli, consistent with previously reported spatial densities of red, green, and blue photoreceptors. Upside-down experiments suggest further extra-retinal processing. Our results demonstrate that motion vision circuits in zebrafish are anisotropic, and preferentially monitor areas with putative behavioural relevance.

Parallel Channels for Motion Feature Extraction in the Pretectum and Tectum of Larval Zebrafish

Non-cortical visual areas in vertebrate brains extract relevant stimulus features, such as motion, object size, and location, to support diverse behavioral tasks. The optic tectum and pretectum, two primary visual areas in zebrafish, are involved in motion processing, and yet their differential neural representation of behaviorally relevant visual features is unclear. Here, we characterize receptive fields (RFs) of motion-sensitive neurons in the diencephalon and midbrain. We show that RFs of many pretectal neurons are large and sample the lower visual field, whereas RFs of tectal neurons are mostly small-size selective and sample the upper nasal visual field more densely. Furthermore, optomotor swimming can reliably be evoked by presenting forward motion in the lower temporal visual field alone, matching the lower visual field bias of the pretectum. Thus, tectum and pretectum extract different visual features from distinct regions of visual space, which is likely a result of their adaptations to hunting and optomotor behavior, respectively.

Reduction of visual stimulus artifacts using a spherical tank for small, aquatic animals

Delivering appropriate stimuli remains a challenge in vision research, particularly for aquatic animals such as zebrafish. Due to the shape of the water tank and the associated optical paths of light rays, the stimulus can be subject to unwanted refraction or reflection artifacts, which may spoil the experiment and result in wrong conclusions. Here, we employ computer graphics simulations and calcium imaging in the zebrafish optic tectum to show, how a spherical glass container optically outperforms many previously used water containers, including Petri dish lids. We demonstrate that aquatic vision experiments suffering from total internal reflection artifacts at the water surface or at the flat container bottom may result in the erroneous detection of visual neurons with bipartite receptive fields and in the apparent absence of neurons selective for vertical motion. Our results and demonstrations will help aquatic vision neuroscientists on optimizing their stimulation setups.

Heterogeneous Temporal Contrast Adaptation in Drosophila Direction-Selective Circuits

In visual systems, neurons adapt both to the mean light level and to the range of light levels, or the contrast. Contrast adaptation has been studied extensively, but it remains unclear how it is distributed among neurons in connected circuits, and how early adaptation affects subsequent computations. Here, we investigated temporal contrast adaptation in neurons across Drosophila's visual motion circuitry. Several ON-pathway neurons showed strong adaptation to changes in contrast over time. One of these neurons, Mi1, showed almost complete adaptation on fast timescales, and experiments ruled out several potential mechanisms for its adaptive properties. When contrast adaptation reduced the gain in ON-pathway cells, it was accompanied by decreased motion responses in downstream direction-selective cells. Simulations show that contrast adaptation can substantially improve motion estimates in natural scenes. The benefits are larger for ON-pathway adaptation, which helps explain the heterogeneous distribution of contrast adaptation in these circuits.

Dynamic Signal Compression for Robust Motion Vision in Flies

Sensory systems need to reliably extract information from highly variable natural signals. Flies, for instance, use optic flow to guide their course and are remarkably adept at estimating image velocity regardless of image statistics. Current circuit models, however, cannot account for this robustness. Here, we demonstrate that the Drosophila visual system reduces input variability by rapidly adjusting its sensitivity to local contrast conditions. We exhaustively map functional properties of neurons in the motion detection circuit and find that local responses are compressed by surround contrast. The compressive signal is fast, integrates spatially, and derives from neural feedback. Training convolutional neural networks on estimating the velocity of natural stimuli shows that this dynamic signal compression can close the performance gap between model and organism. Overall, our work represents a comprehensive mechanistic account of how neural systems attain the robustness to carry out survival-critical tasks in challenging real-world environments.

Dopamine modulates the optomotor response to unreliable visual stimuli in Drosophila melanogaster

State-dependent modulation of sensory systems has been studied in many organisms and is possibly mediated through neuromodulators such as monoamine neurotransmitters. Among these, dopamine is involved in many aspects of animal behaviour, including movement control, attention, motivation and cognition. However, the precise neural mechanism underlying dopaminergic modulation of behaviour induced by sensory stimuli remains poorly understood. Here, we used Drosophila melanogaster to show that dopamine can modulate the optomotor response to moving visual stimuli including noise. The optomotor response is the head-turning response to moving objects, which is observed in most sight-reliant animals including mammals and insects. First, the effects of the dopamine system on the optomotor response were investigated in mutant flies deficient in dopamine receptors D1R1 or D1R2, which are involved in the modulation of sleep-arousal in flies. We examined the optomotor response in D1R1 knockout (D1R1 KO) and D1R2 knockout (D1R2 KO) flies and found that it was not affected in D1R1 KO flies; however, it was significantly reduced in D1R2 KO flies compared with the wild type. Using cell-type-specific expression of an RNA interference construct of D1R2, we identified the fan-shaped body, a part of the central complex, responsible for dopamine-mediated modulation of the optomotor response. In particular, pontine cells in the fan-shaped body seemed important in the modulation of the optomotor response, and their neural activity was required for the optomotor response. These results suggest a novel role of the central complex in the modulation of a behaviour based on the processing of sensory stimulations.

Strategies of locomotion composition

This review aims to highlight the importance of saccades during locomotion as a strategy to reduce sensory information loss while the subject is moving. Acquiring sensory data from the environment during movement results in a temporal flow of information, as the sensory precept changes with the position of the observer. Accordingly, the movement pattern shapes the sensory flow. Therefore, the requirements of locomotion and sensation have to be balanced in the behaviour of the organism. Insect vision provides deep insight into the interplay between action and perception. Insects can shape their optic flow by reducing their rotational movements to fast and short saccades. This generates prolonged phases of translations which provide depth information. Extensive behavioural and physiological studies on insects show how shaping the optic flow facilitates the coding of motion vision. Indeed the saccadic strategy provides an elegant solution to optimise sensory flow. Complementary studies in other taxa reported similar locomotion strategies emphasising the crucial influence of sensory flow on locomotion.

The diversity of lobula plate tangential cells (LPTCs) in the Drosophila motion vision system

To navigate through the environment, animals rely on visual feedback to control their movements relative to their surroundings. In dipteran flies, visual feedback is provided by the wide-field motion-sensitive neurons in the visual system called lobula plate tangential cells (LPTCs). Understanding the role of LPTCs in fly behaviors can address many fundamental questions on how sensory circuits guide behaviors. The blowfly was estimated to have ~ 60 LPTCs, but only a few have been identified in Drosophila. We conducted a Gal4 driver screen and identified five LPTC subtypes in Drosophila, based on their morphological characteristics: LPTCs have large arborizations in the lobula plate and project to the central brain. We compared their morphologies to the blowfly LPTCs and named them after the most similar blowfly cells: CH, H1, H2, FD1 and FD3, and V1. We further characterized their pre- and post-synaptic organizations, as well as their neurotransmitter profiles. These anatomical features largely agree with the anatomy and function of their likely blowfly counterparts. Nevertheless, several anatomical details indicate the Drosophila LPTCs may have more complex functions. Our characterization of these five LPTCs in Drosophila will facilitate further functional studies to understand their roles in the visual circuits that instruct fly behaviors.

Sensory processing by motoneurons: a numerical model for low-level flight control in flies

Rhythmic locomotor behaviour in animals requires exact timing of muscle activation within the locomotor cycle. In rapidly oscillating motor systems, conventional control strategies may be affected by neural delays, making these strategies inappropriate for precise timing control. In flies, wing control thus requires sensory processing within the peripheral nervous system, circumventing the central brain. The underlying mechanism, with which flies integrate graded depolarization of visual interneurons and spiking proprioceptive feedback for precise muscle activation, is under debate. Based on physiological parameters, we developed a numerical model of spike initiation in flight muscles of a blowfly. The simulated Hodgkin–Huxley neuron reproduces multiple experimental findings and explains on the cellular level how vision might control wing kinematics. Sensory processing by single motoneurons appears to be sufficient for control of muscle power during flight in flies and potentially other flying insects, reducing computational load on the central brain during body posture reflexes and manoeuvring flight.

High throughput, rapid receptive field estimation for global motion sensitive neurons using a contiguous motion noise stimulus

BACKGROUND

The systematic characterization of receptive fields (RF) is essential for understanding visual motion processing. The performance of RF estimation depends on the employed stimuli, the complexity of the encoded features, and the quality of the activity readout. Calcium imaging is an attractive readout method for high-throughput neuronal activity recordings. However, calcium recordings are oftentimes noisy and of low temporal resolution. The RF estimation of neurons sensitive to global motion is particularly challenging due to their potentially complex combination of preferred directions across visual field positions.

NEW METHOD

Here, we present a novel noise stimulus, which is enriched with spatiotemporally contiguous motion and thus triggers robust calcium responses. We combined this contiguous motion noise (CMN) stimulus with reverse correlation followed by a two-step nonparametric cluster-based bootstrapping test for efficient and reliable RF estimation.

RESULTS

The in silico evaluation of our approach showed that RF centre positions and preferred directions are reliably detected in most of the simulated neurons. Suppressive RF components were detected in 40% of the simulated neurons. We successfully applied our approach to estimate the RFs of 163 motion-sensitive neurons in vivo within 40 min in the pretectum of zebrafish. Many in vivo neurons were sensitive to elaborate directional flow fields in their RFs.

COMPARISON WITH EXISTING METHODS

Our approach outperforms white noise methods and others due to the optimized motion stimulus statistics and ascertainable fine RF structures.

CONCLUSIONS

The CMN method enables efficient, non-biased RF estimation and will benefit systematic high-throughput investigations of RFs using calcium imaging.

Dynamic nonlinearities enable direction opponency in Drosophila elementary motion detectors

Direction-selective neurons respond to visual motion in a preferred direction. They are direction-opponent if they are also inhibited by motion in the opposite direction. In flies and vertebrates, direction opponency has been observed in second-order direction-selective neurons, which achieve this opponency by subtracting signals from first-order direction-selective cells with opposite directional tunings. Here, we report direction opponency in Drosophila that emerges in first-order direction-selective neurons, the elementary motion detectors T4 and T5. This opponency persists when synaptic output from these cells is blocked, suggesting that it arises from feedforward, not feedback, computations. These observations exclude a broad class of linear-nonlinear models that have been proposed to describe direction-selective computations. However, they are consistent with models that include dynamic nonlinearities. Simulations of opponent models suggest that direction opponency in first-order motion detectors improves motion discriminability by suppressing noise generated by the local structure of natural scenes.

Visual experience drives sleep need in Drosophila

Sleep optimizes waking behavior, however, waking experience may also influence sleep. We used the fruit fly Drosophila melanogaster to investigate the relationship between visual experience and sleep in wild-type and mutant flies. We found that the classical visual mutant, optomotor-blind (omb), which has undeveloped horizontal system/vertical system (HS/VS) motion-processing cells and are defective in motion and visual salience perception, showed dramatically reduced and less consolidated sleep compared to wild-type flies. In contrast, optogenetic activation of the HS/VS motion-processing neurons in wild-type flies led to an increase in sleep following the activation, suggesting an increase in sleep pressure. Surprisingly, exposing wild-type flies to repetitive motion stimuli for extended periods did not increase sleep pressure. However, we observed that exposing flies to more complex image sequences from a movie led to more consolidated sleep, particularly when images were randomly shuffled through time. Our results suggest that specific forms of visual experience that involve motion circuits and complex, nonrepetitive imagery, drive sleep need in Drosophila.

A flexible geometry for panoramic visual and optogenetic stimulation during behavior and physiology

BACKGROUND

To study visual processing, it is necessary to precisely control visual stimuli while recording neural and behavioral responses. It can be important to present stimuli over a broad area of the visual field, which can be technically difficult.

NEW METHOD

We present a simple geometry that can be used to display panoramic stimuli. A single digital light projector generates images that are reflected by mirrors onto flat screens that surround an animal. It can be used for behavioral and neurophysiological measurements, so virtually identical stimuli can be presented. Moreover, this geometry permits light from the projector to be used to activate optogenetic tools.

RESULTS

Using this geometry, we presented panoramic visual stimulation to Drosophila in three paradigms. We presented drifting contrast gratings while recording walking and turning speed. We used the same projector to activate optogenetic channels during visual stimulation. Finally, we used two-photon microscopy to record responses in direction-selective cells to drifting gratings.

COMPARISON WITH EXISTING METHOD(S)

Existing methods have typically required custom hardware or curved screens, while this method requires only flat back projection screens and a digital light projector. The projector generates images in real time and does not require pre-generated images. Finally, while many setups are large, this geometry occupies a 30 × 20 cm footprint with a 25 cm height.

CONCLUSIONS

This flexible geometry enables measurements of behavioral and neural responses to panoramic stimuli. This allows moderate throughput behavioral experiments with simultaneous optogenetic manipulation, with easy comparisons between behavior and neural activity using virtually identical stimuli.

Selective processing of all rotational and translational optic flow directions in the zebrafish pretectum and tectum

Background

The processing of optic flow in the pretectum/accessory optic system allows animals to stabilize retinal images by executing compensatory optokinetic and optomotor behavior. The success of this behavior depends on the integration of information from both eyes to unequivocally identify all possible translational or rotational directions of motion. However, it is still unknown whether the precise direction of ego-motion is already identified in the zebrafish pretectum or later in downstream premotor areas.

Results

Here, we show that the zebrafish pretectum and tectum each contain four populations of motion-sensitive direction-selective (DS) neurons, with each population encoding a different preferred direction upon monocular stimulation. In contrast, binocular stimulation revealed the existence of pretectal and tectal neurons that are specifically tuned to only one of the many possible combinations of monocular motion, suggesting that further downstream sensory processing might not be needed to instruct appropriate optokinetic and optomotor behavior.

Conclusion

Our results suggest that local, task-specific pretectal circuits process DS retinal inputs and carry out the binocular sensory computations necessary for optokinetic and optomotor behavior.

Electronic supplementary material

The online version of this article (10.1186/s12915-019-0648-2) contains supplementary material, which is available to authorized users.

Transcriptional control of morphological properties of direction-selective T4/T5 neurons in Drosophila

In the Drosophila visual system, T4/T5 neurons represent the first stage of computation of the direction of visual motion. T4 and T5 neurons exist in four subtypes, each responding to motion in one of the four cardinal directions and projecting axons into one of the four lobula plate layers. However, all T4/T5 neurons share properties essential for sensing motion. How T4/T5 neurons acquire their properties during development is poorly understood. We reveal that the transcription factors SoxN and Sox102F control the acquisition of properties common to all T4/T5 neuron subtypes, i.e. the layer specificity of dendrites and axons. Accordingly, adult flies are motion blind after disruption of SoxN or Sox102F in maturing T4/T5 neurons. We further find that the transcription factors Ato and Dac are redundantly required in T4/T5 neuron progenitors for SoxN and Sox102F expression in T4/T5 neurons, linking the transcriptional programmes specifying progenitor identity to those regulating the acquisition of morphological properties in neurons. Our work will help to link structure, function and development in a neuronal type performing a computation that is conserved across vertebrate and invertebrate visual systems.

Full reconstruction of large lobula plate tangential cells in Drosophila from a 3D EM dataset

With the advent of neurogenetic methods, the neural basis of behavior is presently being analyzed in more and more detail. This is particularly true for visually driven behavior of Drosophila melanogaster where cell-specific driver lines exist that, depending on the combination with appropriate effector genes, allow for targeted recording, silencing and optogenetic stimulation of individual cell-types. Together with detailed connectomic data of large parts of the fly optic lobe, this has recently led to much progress in our understanding of the neural circuits underlying local motion detection. However, how such local information is combined by optic flow sensitive large-field neurons is still incompletely understood. Here, we aim to fill this gap by a dense reconstruction of lobula plate tangential cells of the fly lobula plate. These neurons collect input from many hundreds of local motion-sensing T4/T5 neurons and connect them to descending neurons or central brain areas. We confirm all basic features of HS and VS cells as published previously from light microscopy. In addition, we identified the dorsal and the ventral centrifugal horizontal, dCH and vCH cell, as well as three VSlike cells, including their distinct dendritic and axonal projection area.

Sequential Nonlinear Filtering of Local Motion Cues by Global Motion Circuits

Many animals guide their movements using optic flow, the displacement of stationary objects across the retina caused by self-motion. How do animals selectively synthesize a global motion pattern from its local motion components? To what extent does this feature selectivity rely on circuit mechanisms versus dendritic processing? Here we used in vivo calcium imaging to identify pre- and postsynaptic mechanisms for processing local motion signals in global motion detection circuits in Drosophila. Lobula plate tangential cells (LPTCs) detect global motion by pooling input from local motion detectors, T4/T5 neurons. We show that T4/T5 neurons suppress responses to adjacent local motion signals whereas LPTC dendrites selectively amplify spatiotemporal sequences of local motion signals consistent with preferred global patterns. We propose that sequential nonlinear suppression and amplification operations allow optic flow circuitry to simultaneously prevent saturating responses to local signals while creating selectivity for global motion patterns critical to behavior.

Apparent Motion Perception in the Praying Mantis: Psychophysics and Modelling

Simple Summary

Computer monitors, smart phone screens, and other forms of digital displays present a series of still images (frames) in which objects are displaced in small steps, tricking us into perceiving smooth motion. This illusion is referred to as “apparent motion”. For motion to be perceived, the magnitude of each displacement step must be smaller than a certain limit, referred to as Dmax. Previous studies have investigated the relationship between this limit and object size in humans and found that the maximum displacement is larger for larger objects than for smaller ones. In this work, we investigated the same relationship in the praying mantis Sphodromantis lineola by presenting them with moving random chequerboard patterns on a computer monitor. Even though motion perception in humans and insects are believed to be explained equally well by the same underlying model, we found that Dmax scales differently with object size in mantids. These results suggest that there may be qualitative differences in how mantids perceive apparent motion compared to humans.

Abstract

Apparent motion is the perception of motion created by rapidly presenting still frames in which objects are displaced in space. Observers can reliably discriminate the direction of apparent motion when inter-frame object displacement is below a certain limit, Dmax. Earlier studies of motion perception in humans found that Dmax is lower-bounded at around 15 arcmin, and thereafter scales with the size of the spatial elements in the images. Here, we run corresponding experiments in the praying mantis Sphodromantis lineola to investigate how Dmax scales with the element size. We use random moving chequerboard patterns of varying element and displacement step sizes to elicit the optomotor response, a postural stabilization mechanism that causes mantids to lean in the direction of large-field motion. Subsequently, we calculate Dmax as the displacement step size corresponding to a 50% probability of detecting an optomotor response in the same direction as the stimulus. Our main findings are that the mantis Dmax scales roughly as a square-root of element size and that, in contrast to humans, it is not lower-bounded. We present two models to explain these observations: a simple high-level model based on motion energy in the Fourier domain and a more-detailed one based on the Reichardt Detector. The models present complementary intuitive and physiologically-realistic accounts of how Dmax scales with the element size in insects. We conclude that insect motion perception is limited by only a single stage of spatial filtering, reflecting the optics of the compound eye. In contrast, human motion perception reflects a second stage of spatial filtering, at coarser scales than imposed by human optics, likely corresponding to the magnocellular pathway. After this spatial filtering, mantis and human motion perception and Dmax are qualitatively very similar.

Visual Projection Neurons Mediating Directed Courtship in Drosophila

Many animals rely on vision to detect, locate, and track moving objects. In Drosophila courtship, males primarily use visual cues to orient toward and follow females and to select the ipsilateral wing for courtship song. Here, we show that the LC10 visual projection neurons convey essential visual information during courtship. Males with LC10 neurons silenced are unable to orient toward or maintain proximity to the female and do not predominantly use the ipsilateral wing when singing. LC10 neurons preferentially respond to small moving objects using an antagonistic motion-based center-surround mechanism. Unilateral activation of LC10 neurons recapitulates the orienting and ipsilateral wing extension normally elicited by females, and the potency with which LC10 induces wing extension is enhanced in a state of courtship arousal controlled by male-specific P1 neurons. These data suggest that LC10 is a major pathway relaying visual input to the courtship circuits in the male brain.

Elementary Motion Detection in Drosophila: Algorithms and Mechanisms

Motion in the visual world provides critical information to guide the behavior of sighted animals. Furthermore, as visual motion estimation requires comparisons of signals across inputs and over time, it represents a paradigmatic and generalizable neural computation. Focusing on the Drosophila visual system, where an explosion of technological advances has recently accelerated experimental progress, we review our understanding of how, algorithmically and mechanistically, motion signals are first computed.

A biophysical mechanism for preferred direction enhancement in fly motion vision

Seeing the direction of motion is essential for survival of all sighted animals. Consequently, nerve cells that respond to visual stimuli moving in one but not in the opposite direction, so-called 'direction-selective' neurons, are found abundantly. In general, direction selectivity can arise by either signal amplification for stimuli moving in the cell's preferred direction ('preferred direction enhancement'), signal suppression for stimuli moving along the opposite direction ('null direction suppression'), or a combination of both. While signal suppression can be readily implemented in biophysical terms by a hyperpolarization followed by a rectification corresponding to the nonlinear voltage-dependence of the Calcium channel, the biophysical mechanism for signal amplification has remained unclear so far. Taking inspiration from the fly, I analyze a neural circuit where a direction-selective ON-cell receives inhibitory input from an OFF cell on the preferred side of the dendrite, while excitatory ON-cells contact the dendrite centrally. This way, an ON edge moving along the cell's preferred direction suppresses the inhibitory input, leading to a release from inhibition in the postsynaptic cell. The benefit of such a two-fold signal inversion lies in the resulting increase of the postsynaptic cell's input resistance, amplifying its response to a subsequent excitatory input signal even with a passive dendrite, i.e. without voltage-gated ion channels. A motion detector implementing this mechanism together with null direction suppression shows a high degree of direction selectivity over a large range of temporal frequency, narrow directional tuning, and a large signal-to-noise ratio.

Eyes Matched to the Prize: The State of Matched Filters in Insect Visual Circuits

Confronted with an ever-changing visual landscape, animals must be able to detect relevant stimuli and translate this information into behavioral output. A visual scene contains an abundance of information: to interpret the entirety of it would be uneconomical. To optimally perform this task, neural mechanisms exist to enhance the detection of important features of the sensory environment while simultaneously filtering out irrelevant information. This can be accomplished by using a circuit design that implements specific "matched filters" that are tuned to relevant stimuli. Following this rule, the well-characterized visual systems of insects have evolved to streamline feature extraction on both a structural and functional level. Here, we review examples of specialized visual microcircuits for vital behaviors across insect species, including feature detection, escape, and estimation of self-motion. Additionally, we discuss how these microcircuits are modulated to weigh relevant input with respect to different internal and behavioral states.

Multi-stability with ambiguous visual stimuli in Drosophila orientation behavior

It is widely accepted for humans and higher animals that vision is an active process in which the organism interprets the stimulus. To find out whether this also holds for lower animals, we designed an ambiguous motion stimulus, which serves as something like a multi-stable perception paradigm in Drosophila behavior. Confronted with a uniform panoramic texture in a closed-loop situation in stationary flight, the flies adjust their yaw torque to stabilize their virtual self-rotation. To make the visual input ambiguous, we added a second texture. Both textures got a rotatory bias to move into opposite directions at a constant relative angular velocity. The results indicate that the fly now had three possible frames of reference for self-rotation: either of the two motion components as well as the integrated motion vector of the two. In this ambiguous stimulus situation, the flies generated a continuous sequence of behaviors, each one adjusted to one or another of the three references.

Vision is considered an active process in humans and higher animals in which the stimulus is interpreted by the subject and can be perceived in different ways if it is ambiguous. We aimed to find out whether this also holds for lower animals, such as the fruit fly Drosophila melanogaster. To provide ambiguity, we exposed flies to transparent motion stimuli in a flight simulator and found their behavior to be multi-stable. These results show that the visual system of the fly can separate the individual components of a transparent motion stimulus, and that this kind of stimulus is ambiguous to the fly. The extent to which the fly shows component selectivity in its behavior depends on several properties of the stimulus, like pattern contrast and element density. The alternations between the different behaviors exhibit a stochasticity reminiscent of the temporal dynamics in human multi-stable perception.

Neural mechanisms underlying sensitivity to reverse-phi motion in the fly

Optical illusions provide powerful tools for mapping the algorithms and circuits that underlie visual processing, revealing structure through atypical function. Of particular note in the study of motion detection has been the reverse-phi illusion. When contrast reversals accompany discrete movement, detected direction tends to invert. This occurs across a wide range of organisms, spanning humans and invertebrates. Here, we map an algorithmic account of the phenomenon onto neural circuitry in the fruit fly Drosophila melanogaster. Through targeted silencing experiments in tethered walking flies as well as electrophysiology and calcium imaging, we demonstrate that ON- or OFF-selective local motion detector cells T4 and T5 are sensitive to certain interactions between ON and OFF. A biologically plausible detector model accounts for subtle features of this particular form of illusory motion reversal, like the re-inversion of turning responses occurring at extreme stimulus velocities. In light of comparable circuit architecture in the mammalian retina, we suggest that similar mechanisms may apply even to human psychophysics.

Sensation during Active Behaviors

A substantial portion of our sensory experience happens during active behaviors such as walking around or paying attention. How do sensory systems work during such behaviors? Neural processing in sensory systems can be shaped by behavior in multiple ways ranging from a modulation of responsiveness or sharpening of tuning to a dynamic change of response properties or functional connectivity. Here, we review recent findings on the modulation of sensory processing during active behaviors in different systems: insect vision, rodent thalamus, and rodent sensory cortices. We discuss the circuit-level mechanisms that might lead to these modulations and their potential role in sensory function. Finally, we highlight the open questions and future perspectives of this exciting new field.

Asymmetry between ON and OFF α ganglion cells of mouse retina: integration of signal and noise from synaptic inputs

KEY POINTS

Bipolar and amacrine cells presynaptic to the ON sustained α cell of mouse retina provide currents with a higher signal-to-noise power ratio (SNR) than those presynaptic to the OFF sustained α cell. Yet the ON cell loses proportionately more SNR from synaptic inputs to spike output than the OFF cell does. The higher SNR of ON bipolar cells at the beginning of the ON pathway compensates for losses incurred by the ON ganglion cell, and improves the processing of positive contrasts.

ABSTRACT

ON and OFF pathways in the retina include functional pairs of neurons that, at first glance, appear to have symmetrically similar responses to brightening and darkening, respectively. Upon careful examination, however, functional pairs exhibit asymmetries in receptive field size and response kinetics. Until now, descriptions of how light-adapted retinal circuitry maintains a preponderance of signal over the noise have not distinguished between ON and OFF pathways. Here I present evidence of marked asymmetries between members of a functional pair of sustained α ganglion cells in the mouse retina. The ON cell exhibited a proportionately greater loss of signal-to-noise power ratio (SNR) from its presynaptic arrays to its postsynaptic currents. Thus the ON cell combines signal and noise from its presynaptic arrays of bipolar and amacrine cells less efficiently than the OFF cell does. Yet the inefficiency of the ON cell is compensated by its presynaptic arrays providing a higher SNR than the arrays presynaptic to the OFF cell, apparently to improve visual processing of positive contrasts. Dynamic clamp experiments were performed that introduced synaptic conductances into ON and OFF cells. When the amacrine-modulated conductance was removed, the ON cell's spike train exhibited an increase in SNR. The OFF cell, however, showed the opposite effect of removing amacrine input, which was a decrease in SNR. Thus ON and OFF cells have different modes of synaptic integration with direct effects on the SNR of the spike output.

Optogenetic Neuronal Silencing in Drosophila during Visual Processing

Optogenetic channels and ion pumps have become indispensable tools in neuroscience to manipulate neuronal activity and thus to establish synaptic connectivity and behavioral causality. Inhibitory channels are particularly advantageous to explore signal processing in neural circuits since they permit the functional removal of selected neurons on a trial-by-trial basis. However, applying these tools to study the visual system poses a considerable challenge because the illumination required for their activation usually also stimulates photoreceptors substantially, precluding the simultaneous probing of visual responses. Here, we explore the utility of the recently discovered anion channelrhodopsins GtACR1 and GtACR2 for application in the visual system of Drosophila. We first characterized their properties using a larval crawling assay. We further obtained whole-cell recordings from cells expressing GtACR1, which mediated strong and light-sensitive photocurrents. Finally, using physiological recordings and a behavioral readout, we demonstrate that GtACR1 enables the fast and reversible silencing of genetically targeted neurons within circuits engaged in visual processing.

Active Mechanisms of Vibration Encoding and Frequency Filtering in Central Mechanosensory Neurons

To better understand biophysical mechanisms of mechanosensory processing, we investigated two cell types in the Drosophila brain (A2 and B1 cells) that are postsynaptic to antennal vibration receptors. A2 cells receive excitatory synaptic currents in response to both directions of movement: thus, twice per vibration cycle. The membrane acts as a low-pass filter, so that voltage and spiking mainly track the vibration envelope rather than individual cycles. By contrast, B1 cells are excited by only forward or backward movement, meaning they are sensitive to vibration phase. They receive oscillatory synaptic currents at the stimulus frequency, and they bandpass filter these inputs to favor specific frequencies. Different cells prefer different frequencies, due to differences in their voltage-gated conductances. Both Na⁺ and K⁺ conductances suppress low-frequency synaptic inputs, so cells with larger voltage-gated conductances prefer higher frequencies. These results illustrate how membrane properties and voltage-gated conductances can extract distinct stimulus features into parallel channels.

A common directional tuning mechanism of Drosophila motion-sensing neurons in the ON and in the OFF pathway

In the fruit fly optic lobe, T4 and T5 cells represent the first direction-selective neurons, with T4 cells responding selectively to moving brightness increments (ON) and T5 cells to brightness decrements (OFF). Both T4 and T5 cells comprise four subtypes with directional tuning to one of the four cardinal directions. We had previously found that upward-sensitive T4 cells implement both preferred direction enhancement and null direction suppression (Haag et al., 2016). Here, we asked whether this mechanism generalizes to OFF-selective T5 cells and to all four subtypes of both cell classes. We found that all four subtypes of both T4 and T5 cells implement both mechanisms, that is preferred direction enhancement and null direction inhibition, on opposing sides of their receptive fields. This gives rise to the high degree of direction selectivity observed in both T4 and T5 cells within each subpopulation.

An Array of Descending Visual Interneurons Encoding Self-Motion in Drosophila

The means by which brains transform sensory information into coherent motor actions is poorly understood. In flies, a relatively small set of descending interneurons are responsible for conveying sensory information and higher-order commands from the brain to motor circuits in the ventral nerve cord. Here, we describe three pairs of genetically identified descending interneurons that integrate information from wide-field visual interneurons and project directly to motor centers controlling flight behavior. We measured the physiological responses of these three cells during flight and found that they respond maximally to visual movement corresponding to rotation around three distinct body axes. After characterizing the tuning properties of an array of nine putative upstream visual interneurons, we show that simple linear combinations of their outputs can predict the responses of the three descending cells. Last, we developed a machine vision-tracking system that allows us to monitor multiple motor systems simultaneously and found that each visual descending interneuron class is correlated with a discrete set of motor programs.

SIGNIFICANCE STATEMENT

Most animals possess specialized sensory systems for encoding body rotation, which they use for stabilizing posture and regulating motor actions. In flies and other insects, the visual system contains an array of specialized neurons that integrate local optic flow to estimate body rotation during locomotion. However, the manner in which the output of these cells is transformed by the downstream neurons that innervate motor centers is poorly understood. We have identified a set of three visual descending neurons that integrate the output of nine large-field visual interneurons and project directly to flight motor centers. Our results provide new insight into how the sensory information that encodes body motion is transformed into a code that is appropriate for motor actions.