51
|
Neuromodulation of insect motion vision. J Comp Physiol A Neuroethol Sens Neural Behav Physiol 2019; 206:125-137. [DOI: 10.1007/s00359-019-01383-9] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2019] [Revised: 11/11/2019] [Accepted: 11/19/2019] [Indexed: 10/25/2022]
|
52
|
How fly neurons compute the direction of visual motion. J Comp Physiol A Neuroethol Sens Neural Behav Physiol 2019; 206:109-124. [PMID: 31691093 PMCID: PMC7069908 DOI: 10.1007/s00359-019-01375-9] [Citation(s) in RCA: 53] [Impact Index Per Article: 10.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2019] [Revised: 10/16/2019] [Accepted: 10/23/2019] [Indexed: 10/25/2022]
Abstract
Detecting the direction of image motion is a fundamental component of visual computation, essential for survival of the animal. However, at the level of individual photoreceptors, the direction in which the image is shifting is not explicitly represented. Rather, directional motion information needs to be extracted from the photoreceptor array by comparing the signals of neighboring units over time. The exact nature of this process as implemented in the visual system of the fruit fly Drosophila melanogaster has been studied in great detail, and much progress has recently been made in determining the neural circuits giving rise to directional motion information. The results reveal the following: (1) motion information is computed in parallel ON and OFF pathways. (2) Within each pathway, T4 (ON) and T5 (OFF) cells are the first neurons to represent the direction of motion. Four subtypes of T4 and T5 cells exist, each sensitive to one of the four cardinal directions. (3) The core process of direction selectivity as implemented on the dendrites of T4 and T5 cells comprises both an enhancement of signals for motion along their preferred direction as well as a suppression of signals for motion along the opposite direction. This combined strategy ensures a high degree of direction selectivity right at the first stage where the direction of motion is computed. (4) At the subsequent processing stage, tangential cells spatially integrate direct excitation from ON and OFF-selective T4 and T5 cells and indirect inhibition from bi-stratified LPi cells activated by neighboring T4/T5 terminals, thus generating flow-field-selective responses.
Collapse
|
53
|
Mano O, Creamer MS, Matulis CA, Salazar-Gatzimas E, Chen J, Zavatone-Veth JA, Clark DA. Using slow frame rate imaging to extract fast receptive fields. Nat Commun 2019; 10:4979. [PMID: 31672963 PMCID: PMC6823504 DOI: 10.1038/s41467-019-12974-0] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2019] [Accepted: 10/11/2019] [Indexed: 11/09/2022] Open
Abstract
In functional imaging, large numbers of neurons are measured during sensory stimulation or behavior. This data can be used to map receptive fields that describe neural associations with stimuli or with behavior. The temporal resolution of these receptive fields has traditionally been limited by image acquisition rates. However, even when acquisitions scan slowly across a population of neurons, individual neurons may be measured at precisely known times. Here, we apply a method that leverages the timing of neural measurements to find receptive fields with temporal resolutions higher than the image acquisition rate. We use this temporal super-resolution method to resolve fast voltage and glutamate responses in visual neurons in Drosophila and to extract calcium receptive fields from cortical neurons in mammals. We provide code to easily apply this method to existing datasets. This method requires no specialized hardware and can be used with any optical indicator of neural activity.
Collapse
Affiliation(s)
- Omer Mano
- Department of Molecular, Cellular, and Developmental Biology, Yale University, New Haven, CT, 06511, USA
| | - Matthew S Creamer
- Interdepartmental Neuroscience Program, Yale University, New Haven, CT, 06511, USA
| | | | | | - Juyue Chen
- Interdepartmental Neuroscience Program, Yale University, New Haven, CT, 06511, USA
| | | | - Damon A Clark
- Department of Molecular, Cellular, and Developmental Biology, Yale University, New Haven, CT, 06511, USA.
- Interdepartmental Neuroscience Program, Yale University, New Haven, CT, 06511, USA.
- Department of Physics, Yale University, New Haven, CT, 06511, USA.
- Department of Neuroscience, Yale University, New Haven, CT, 06511, USA.
| |
Collapse
|
54
|
Chen J, Mandel HB, Fitzgerald JE, Clark DA. Asymmetric ON-OFF processing of visual motion cancels variability induced by the structure of natural scenes. eLife 2019; 8:e47579. [PMID: 31613221 PMCID: PMC6884396 DOI: 10.7554/elife.47579] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2019] [Accepted: 10/12/2019] [Indexed: 02/05/2023] Open
Abstract
Animals detect motion using a variety of visual cues that reflect regularities in the natural world. Experiments in animals across phyla have shown that motion percepts incorporate both pairwise and triplet spatiotemporal correlations that could theoretically benefit motion computation. However, it remains unclear how visual systems assemble these cues to build accurate motion estimates. Here, we used systematic behavioral measurements of fruit fly motion perception to show how flies combine local pairwise and triplet correlations to reduce variability in motion estimates across natural scenes. By generating synthetic images with statistics controlled by maximum entropy distributions, we show that the triplet correlations are useful only when images have light-dark asymmetries that mimic natural ones. This suggests that asymmetric ON-OFF processing is tuned to the particular statistics of natural scenes. Since all animals encounter the world's light-dark asymmetries, many visual systems are likely to use asymmetric ON-OFF processing to improve motion estimation.
Collapse
Affiliation(s)
- Juyue Chen
- Interdepartmental Neuroscience ProgramYale UniversityNew HavenUnited States
| | - Holly B Mandel
- Department of Molecular, Cellular and Developmental BiologyYale UniversityNew HavenUnited States
| | - James E Fitzgerald
- Janelia Research CampusHoward Hughes Medical InstituteAshburnUnited States
| | - Damon A Clark
- Interdepartmental Neuroscience ProgramYale UniversityNew HavenUnited States
- Department of Molecular, Cellular and Developmental BiologyYale UniversityNew HavenUnited States
- Department of PhysicsYale UniversityNew HavenUnited States
- Department of NeuroscienceYale UniversityNew HavenUnited States
| |
Collapse
|
55
|
Differential Tuning to Visual Motion Allows Robust Encoding of Optic Flow in the Dragonfly. J Neurosci 2019; 39:8051-8063. [PMID: 31481434 DOI: 10.1523/jneurosci.0143-19.2019] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2019] [Revised: 07/22/2019] [Accepted: 08/07/2019] [Indexed: 11/21/2022] Open
Abstract
Visual cues provide an important means for aerial creatures to ascertain their self-motion through the environment. In many insects, including flies, moths, and bees, wide-field motion-sensitive neurons in the third optic ganglion are thought to underlie such motion encoding; however, these neurons can only respond robustly over limited speed ranges. The task is more complicated for some species of dragonflies that switch between extended periods of hovering flight and fast-moving pursuit of prey and conspecifics, requiring motion detection over a broad range of velocities. Since little is known about motion processing in these insects, we performed intracellular recordings from hawking, emerald dragonflies (Hemicordulia spp.) and identified a diverse group of motion-sensitive neurons that we named lobula tangential cells (LTCs). Following prolonged visual stimulation with drifting gratings, we observed significant differences in both temporal and spatial tuning of LTCs. Cluster analysis of these changes confirmed several groups of LTCs with distinctive spatiotemporal tuning. These differences were associated with variation in velocity tuning in response to translated, natural scenes. LTCs with differences in velocity tuning ranges and optima may underlie how a broad range of motion velocities are encoded. In the hawking dragonfly, changes in LTC tuning over time are therefore likely to support their extensive range of behaviors, from hovering to fast-speed pursuits.SIGNIFICANCE STATEMENT Understanding how animals navigate the world is an inherently difficult and interesting problem. Insects are useful models for understanding neuronal mechanisms underlying these activities, with neurons that encode wide-field motion previously identified in insects, such as flies, hawkmoths, and butterflies. Like some Dipteran flies, dragonflies exhibit complex aerobatic behaviors, such as hovering, patrolling, and aerial combat. However, dragonflies lack halteres that support such diverse behavior in flies. To understand how dragonflies might address this problem using only visual cues, we recorded from their wide-field motion-sensitive neurons. We found these differ strongly in the ways they respond to sustained motion, allowing them collectively to encode the very broad range of velocities experienced during diverse behavior.
Collapse
|
56
|
Dynamic nonlinearities enable direction opponency in Drosophila elementary motion detectors. Nat Neurosci 2019; 22:1318-1326. [PMID: 31346296 PMCID: PMC6748873 DOI: 10.1038/s41593-019-0443-y] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2018] [Accepted: 06/03/2019] [Indexed: 12/13/2022]
Abstract
Direction-selective neurons respond to visual motion in a preferred direction. They are direction-opponent if they are also inhibited by motion in the opposite direction. In flies and vertebrates, direction opponency has been observed in second-order direction-selective neurons, which achieve this opponency by subtracting signals from first-order direction-selective cells with opposite directional tunings. Here, we report direction opponency in Drosophila that emerges in first-order direction-selective neurons, the elementary motion detectors T4 and T5. This opponency persists when synaptic output from these cells is blocked, suggesting that it arises from feedforward, not feedback, computations. These observations exclude a broad class of linear-nonlinear models that have been proposed to describe direction-selective computations. However, they are consistent with models that include dynamic nonlinearities. Simulations of opponent models suggest that direction opponency in first-order motion detectors improves motion discriminability by suppressing noise generated by the local structure of natural scenes.
Collapse
|
57
|
Olfactory and Neuromodulatory Signals Reverse Visual Object Avoidance to Approach in Drosophila. Curr Biol 2019; 29:2058-2065.e2. [PMID: 31155354 DOI: 10.1016/j.cub.2019.05.010] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2018] [Revised: 04/01/2019] [Accepted: 05/01/2019] [Indexed: 12/15/2022]
Abstract
Behavioral reactions of animals to environmental sensory stimuli are sometimes reflexive and stereotyped but can also vary depending on contextual conditions. Engaging in active foraging or flight provokes a reversal in the valence of carbon dioxide responses from aversion to approach in Drosophila [1, 2], whereas mosquitoes encountering this same chemical cue show enhanced approach toward a small visual object [3]. Sensory plasticity in insects has been broadly attributed to the action of biogenic amines, which modulate behaviors such as olfactory learning, aggression, feeding, and egg laying [4-14]. Octopamine acts rapidly upon the onset of flight to modulate the response gain of directionally selective motion-detecting neurons in Drosophila [15]. How the action of biogenic amines might couple sensory modalities to each other or to locomotive states remains poorly understood. Here, we use a visual flight simulator [16] equipped for odor delivery [17] to confirm that flies avoid a small contrasting visual object in odorless air [18] but that the same animals reverse their preference to approach in the presence of attractive food odor. An aversive odor does not reverse object aversion. Optogenetic activation of either octopaminergic neurons or directionally selective motion-detecting neurons that express octopamine receptors elicits visual valence reversal in the absence of odor. Our results suggest a parsimonious model in which odor-activated octopamine release excites the motion detection pathway to increase the saliency of either a small object or a bar, eliciting tracking responses by both visual features.
Collapse
|
58
|
Extreme Compartmentalization in a Drosophila Amacrine Cell. Curr Biol 2019; 29:1545-1550.e2. [PMID: 31031119 DOI: 10.1016/j.cub.2019.03.070] [Citation(s) in RCA: 31] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2019] [Revised: 03/08/2019] [Accepted: 03/28/2019] [Indexed: 11/22/2022]
Abstract
A neuron is conventionally regarded as a single processing unit. It receives input from one or several presynaptic cells, transforms these signals, and transmits one output signal to its postsynaptic partners. Exceptions exist: amacrine cells in the mammalian retina [1-3] or interneurons in the locust mesothoracic ganglion [4] are thought to represent many electrically isolated microcircuits within one neuron. An extreme case of such an amacrine cell has recently been described in the Drosophila visual system. This cell, called CT1, reaches into two neuropils of the optic lobe, where it visits each of 700 repetitive columns, thereby covering the whole visual field [5, 6]. Due to its unusual morphology, CT1 has been suspected to perform local computations [6, 7], but this has never been proven. Using 2-photon calcium imaging and visual stimulation, we find highly compartmentalized retinotopic response properties in neighboring terminals of CT1, with each terminal acting as an independent functional unit. Model simulations demonstrate that this extreme case of compartmentalization is at the biophysical limit of neural computation.
Collapse
|
59
|
Shinomiya K, Huang G, Lu Z, Parag T, Xu CS, Aniceto R, Ansari N, Cheatham N, Lauchie S, Neace E, Ogundeyi O, Ordish C, Peel D, Shinomiya A, Smith C, Takemura S, Talebi I, Rivlin PK, Nern A, Scheffer LK, Plaza SM, Meinertzhagen IA. Comparisons between the ON- and OFF-edge motion pathways in the Drosophila brain. eLife 2019; 8:40025. [PMID: 30624205 PMCID: PMC6338461 DOI: 10.7554/elife.40025] [Citation(s) in RCA: 80] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2018] [Accepted: 01/02/2019] [Indexed: 02/03/2023] Open
Abstract
Understanding the circuit mechanisms behind motion detection is a long-standing question in visual neuroscience. In Drosophila melanogaster, recently discovered synapse-level connectomes in the optic lobe, particularly in ON-pathway (T4) receptive-field circuits, in concert with physiological studies, suggest a motion model that is increasingly intricate when compared with the ubiquitous Hassenstein-Reichardt model. By contrast, our knowledge of OFF-pathway (T5) has been incomplete. Here, we present a conclusive and comprehensive connectome that, for the first time, integrates detailed connectivity information for inputs to both the T4 and T5 pathways in a single EM dataset covering the entire optic lobe. With novel reconstruction methods using automated synapse prediction suited to such a large connectome, we successfully corroborate previous findings in the T4 pathway and comprehensively identify inputs and receptive fields for T5. Although the two pathways are probably evolutionarily linked and exhibit many similarities, we uncover interesting differences and interactions that may underlie their distinct functional properties.
Collapse
Affiliation(s)
- Kazunori Shinomiya
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Gary Huang
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Zhiyuan Lu
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States.,Department of Psychology and Neuroscience, Dalhousie University, Halifax, Canada
| | - Toufiq Parag
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States.,School of Engineering and Applied Sciences, Harvard University, Cambridge, United States
| | - C Shan Xu
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Roxanne Aniceto
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Namra Ansari
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Natasha Cheatham
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Shirley Lauchie
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Erika Neace
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Omotara Ogundeyi
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Christopher Ordish
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - David Peel
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Aya Shinomiya
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Claire Smith
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Satoko Takemura
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Iris Talebi
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Patricia K Rivlin
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Aljoscha Nern
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Louis K Scheffer
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Stephen M Plaza
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Ian A Meinertzhagen
- Department of Psychology and Neuroscience, Dalhousie University, Halifax, Canada
| |
Collapse
|
60
|
Fu Q, Wang H, Hu C, Yue S. Towards Computational Models and Applications of Insect Visual Systems for Motion Perception: A Review. ARTIFICIAL LIFE 2019; 25:263-311. [PMID: 31397604 DOI: 10.1162/artl_a_00297] [Citation(s) in RCA: 23] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Motion perception is a critical capability determining a variety of aspects of insects' life, including avoiding predators, foraging, and so forth. A good number of motion detectors have been identified in the insects' visual pathways. Computational modeling of these motion detectors has not only been providing effective solutions to artificial intelligence, but also benefiting the understanding of complicated biological visual systems. These biological mechanisms through millions of years of evolutionary development will have formed solid modules for constructing dynamic vision systems for future intelligent machines. This article reviews the computational motion perception models originating from biological research on insects' visual systems in the literature. These motion perception models or neural networks consist of the looming-sensitive neuronal models of lobula giant movement detectors (LGMDs) in locusts, the translation-sensitive neural systems of direction-selective neurons (DSNs) in fruit flies, bees, and locusts, and the small-target motion detectors (STMDs) in dragonflies and hoverflies. We also review the applications of these models to robots and vehicles. Through these modeling studies, we summarize the methodologies that generate different direction and size selectivity in motion perception. Finally, we discuss multiple systems integration and hardware realization of these bio-inspired motion perception models.
Collapse
Affiliation(s)
- Qinbing Fu
- Guangzhou University, School of Mechanical and Electrical Engineering; Machine Life and Intelligence Research Centre
- University of Lincoln, Computational Intelligence Lab, School of Computer Science; Lincoln Centre for Autonomous Systems.
| | - Hongxin Wang
- University of Lincoln, Computational Intelligence Lab, School of Computer Science; Lincoln Centre for Autonomous Systems.
| | - Cheng Hu
- Guangzhou University, School of Mechanical and Electrical Engineering; Machine Life and Intelligence Research Centre
- University of Lincoln, Computational Intelligence Lab, School of Computer Science; Lincoln Centre for Autonomous Systems.
| | - Shigang Yue
- Guangzhou University, School of Mechanical and Electrical Engineering; Machine Life and Intelligence Research Centre
- University of Lincoln, Computational Intelligence Lab, School of Computer Science; Lincoln Centre for Autonomous Systems.
| |
Collapse
|
61
|
Creamer MS, Mano O, Clark DA. Visual Control of Walking Speed in Drosophila. Neuron 2018; 100:1460-1473.e6. [PMID: 30415994 PMCID: PMC6405217 DOI: 10.1016/j.neuron.2018.10.028] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2018] [Revised: 08/29/2018] [Accepted: 10/16/2018] [Indexed: 10/27/2022]
Abstract
An animal's self-motion generates optic flow across its retina, and it can use this visual signal to regulate its orientation and speed through the world. While orientation control has been studied extensively in Drosophila and other insects, much less is known about the visual cues and circuits that regulate translational speed. Here, we show that flies regulate walking speed with an algorithm that is tuned to the speed of visual motion, causing them to slow when visual objects are nearby. This regulation does not depend strongly on the spatial structure or the direction of visual stimuli, making it algorithmically distinct from the classic computation that controls orientation. Despite the different algorithms, the visual circuits that regulate walking speed overlap with those that regulate orientation. Taken together, our findings suggest that walking speed is controlled by a hierarchical computation that combines multiple motion detectors with distinct tunings. VIDEO ABSTRACT.
Collapse
Affiliation(s)
- Matthew S Creamer
- Interdepartmental Neuroscience Program, Yale University, New Haven, CT 06511, USA
| | - Omer Mano
- Department of Molecular, Cellular, and Developmental Biology, Yale University, New Haven, CT 06511, USA
| | - Damon A Clark
- Interdepartmental Neuroscience Program, Yale University, New Haven, CT 06511, USA; Department of Molecular, Cellular, and Developmental Biology, Yale University, New Haven, CT 06511, USA; Department of Physics, Yale University, New Haven, CT 06511, USA.
| |
Collapse
|
62
|
Vasas V, Chittka L. Insect-Inspired Sequential Inspection Strategy Enables an Artificial Network of Four Neurons to Estimate Numerosity. iScience 2018; 11:85-92. [PMID: 30590253 PMCID: PMC6308245 DOI: 10.1016/j.isci.2018.12.009] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2018] [Revised: 11/29/2018] [Accepted: 12/05/2018] [Indexed: 11/25/2022] Open
Abstract
Varying levels of numerical cognition have been found in several animal species. Bees, in particular, have been argued to be able to count up to four items and solve complex numerical tasks. Here we present an exceedingly simple neural circuit that, when provided with the actual visual input that the bee is receiving while carrying out the task, can make reliable estimates on the number of items in the display. Thus we suggest that the elegance of numerical problem solving in bees might not lie in the formation of numerical concepts (such as “more,” “less,” or “zero”), but in the use of specific flight movements to scan targets, which streamlines the visual input and so renders the task of counting computationally inexpensive. Careful examination of the actual inspection strategies used by animals might reveal that animals often employ active scanning behaviors as shortcuts to simplify complex visual pattern discrimination tasks. Small-brained animals such as bees can solve counting tasks Exceedingly small neural circuits can mediate numerosity estimations The method requires a sequential inspection strategy to generate the visual input Active scanning behavior is suggested to play a role in complex cognitive tasks
Collapse
Affiliation(s)
- Vera Vasas
- School of Biological and Chemical Sciences, Queen Mary University of London, London E1 4NS, UK.
| | - Lars Chittka
- School of Biological and Chemical Sciences, Queen Mary University of London, London E1 4NS, UK; Wissenschaftskolleg zu Berlin, Institute for Advanced Study, Berlin 14193, Germany
| |
Collapse
|
63
|
Dalgaty T, Vianello E, De Salvo B, Casas J. Insect-inspired neuromorphic computing. CURRENT OPINION IN INSECT SCIENCE 2018; 30:59-66. [PMID: 30553486 DOI: 10.1016/j.cois.2018.09.006] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/20/2018] [Revised: 08/21/2018] [Accepted: 09/17/2018] [Indexed: 06/09/2023]
Abstract
The steady improvement in the performance of computing systems seen for many decades is levelling off as the miniaturization of semiconducting technology approaches the atomic limit, facing severe physical and technological issues. Neuromorphic computing is an emerging solution which makes use of silicon technology in a different way, inline with the computational principles observed in animal nervous systems. In this article, we argue that the nervous systems of insects in particular offer themselves as an ideal starting point for incorporation into realistic neuromorphic systems and review research in developing insect-inspired neuromorphic systems. We conclude with an exciting yet tangible vision of a full neuromorphic sensory-motor system where a liquid state machine modelling the function of the insect mushroom body links input to output and allows for amalgamation of the work discussed in a hierarchical framework of a full system inspired by the concept of how information flows through insects.
Collapse
Affiliation(s)
| | | | | | - Jerome Casas
- Insect Biology Research Institute, UMR CNRS 7261, University of Tours, Tours 37200, France.
| |
Collapse
|
64
|
Salazar-Gatzimas E, Agrochao M, Fitzgerald JE, Clark DA. The Neuronal Basis of an Illusory Motion Percept Is Explained by Decorrelation of Parallel Motion Pathways. Curr Biol 2018; 28:3748-3762.e8. [PMID: 30471993 DOI: 10.1016/j.cub.2018.10.007] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2018] [Revised: 09/28/2018] [Accepted: 10/02/2018] [Indexed: 10/27/2022]
Abstract
Both vertebrates and invertebrates perceive illusory motion, known as "reverse-phi," in visual stimuli that contain sequential luminance increments and decrements. However, increment (ON) and decrement (OFF) signals are initially processed by separate visual neurons, and parallel elementary motion detectors downstream respond selectively to the motion of light or dark edges, often termed ON- and OFF-edges. It remains unknown how and where ON and OFF signals combine to generate reverse-phi motion signals. Here, we show that each of Drosophila's elementary motion detectors encodes motion by combining both ON and OFF signals. Their pattern of responses reflects combinations of increments and decrements that co-occur in natural motion, serving to decorrelate their outputs. These results suggest that the general principle of signal decorrelation drives the functional specialization of parallel motion detection channels, including their selectivity for moving light or dark edges.
Collapse
Affiliation(s)
- Emilio Salazar-Gatzimas
- Interdepartmental Neuroscience Program, Yale University, 333 Cedar Street, New Haven, CT 06511, USA
| | - Margarida Agrochao
- Department of Molecular Cellular and Developmental Biology, Yale University, 219 Prospect Street, New Haven, CT 06511, USA
| | - James E Fitzgerald
- Janelia Research Campus, Howard Hughes Medical Institute, 19700 Helix Drive, Ashburn, VA 20147, USA
| | - Damon A Clark
- Interdepartmental Neuroscience Program, Yale University, 333 Cedar Street, New Haven, CT 06511, USA; Department of Molecular Cellular and Developmental Biology, Yale University, 219 Prospect Street, New Haven, CT 06511, USA; Department of Physics, Yale University, New Haven, CT 06511, USA.
| |
Collapse
|
65
|
Richter FG, Fendl S, Haag J, Drews MS, Borst A. Glutamate Signaling in the Fly Visual System. iScience 2018; 7:85-95. [PMID: 30267688 PMCID: PMC6135900 DOI: 10.1016/j.isci.2018.08.019] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2018] [Revised: 08/13/2018] [Accepted: 08/23/2018] [Indexed: 10/28/2022] Open
Abstract
For a proper understanding of neural circuit function, it is important to know which signals neurons relay to their downstream partners. Calcium imaging with genetically encoded calcium sensors like GCaMP has become the default approach for mapping these responses. How well such measurements represent the true neurotransmitter output of any given cell, however, remains unclear. Here, we demonstrate the viability of the glutamate sensor iGluSnFR for 2-photon in vivo imaging in Drosophila melanogaster and prove its usefulness for estimating spatiotemporal receptive fields in the visual system. We compare the results obtained with iGluSnFR with the ones obtained with GCaMP6f and find that the spatial aspects of the receptive fields are preserved between indicators. In the temporal domain, however, measurements obtained with iGluSnFR reveal the underlying response properties to be much faster than those acquired with GCaMP6f. Our approach thus offers a more accurate description of glutamatergic neurons in the fruit fly.
Collapse
Affiliation(s)
| | - Sandra Fendl
- Max-Planck-Institute of Neurobiology, 82152 Martinsried, Germany
| | - Jürgen Haag
- Max-Planck-Institute of Neurobiology, 82152 Martinsried, Germany
| | - Michael S Drews
- Max-Planck-Institute of Neurobiology, 82152 Martinsried, Germany
| | - Alexander Borst
- Max-Planck-Institute of Neurobiology, 82152 Martinsried, Germany.
| |
Collapse
|
66
|
Barnhart EL, Wang IE, Wei H, Desplan C, Clandinin TR. Sequential Nonlinear Filtering of Local Motion Cues by Global Motion Circuits. Neuron 2018; 100:229-243.e3. [PMID: 30220510 DOI: 10.1016/j.neuron.2018.08.022] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2018] [Revised: 07/20/2018] [Accepted: 08/17/2018] [Indexed: 11/16/2022]
Abstract
Many animals guide their movements using optic flow, the displacement of stationary objects across the retina caused by self-motion. How do animals selectively synthesize a global motion pattern from its local motion components? To what extent does this feature selectivity rely on circuit mechanisms versus dendritic processing? Here we used in vivo calcium imaging to identify pre- and postsynaptic mechanisms for processing local motion signals in global motion detection circuits in Drosophila. Lobula plate tangential cells (LPTCs) detect global motion by pooling input from local motion detectors, T4/T5 neurons. We show that T4/T5 neurons suppress responses to adjacent local motion signals whereas LPTC dendrites selectively amplify spatiotemporal sequences of local motion signals consistent with preferred global patterns. We propose that sequential nonlinear suppression and amplification operations allow optic flow circuitry to simultaneously prevent saturating responses to local signals while creating selectivity for global motion patterns critical to behavior.
Collapse
Affiliation(s)
- Erin L Barnhart
- Department of Neurobiology, Stanford University, Stanford, CA 94305, USA; Department of Biology, New York University, New York, NY 10003, USA
| | - Irving E Wang
- Department of Neurobiology, Stanford University, Stanford, CA 94305, USA
| | - Huayi Wei
- Department of Biology, New York University, New York, NY 10003, USA
| | - Claude Desplan
- Department of Biology, New York University, New York, NY 10003, USA.
| | - Thomas R Clandinin
- Department of Neurobiology, Stanford University, Stanford, CA 94305, USA.
| |
Collapse
|
67
|
Wienecke CFR, Leong JCS, Clandinin TR. Linear Summation Underlies Direction Selectivity in Drosophila. Neuron 2018; 99:680-688.e4. [PMID: 30057202 DOI: 10.1016/j.neuron.2018.07.005] [Citation(s) in RCA: 27] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2017] [Revised: 05/24/2018] [Accepted: 07/02/2018] [Indexed: 11/28/2022]
Abstract
While linear mechanisms lay the foundations of feature selectivity in many brain areas, direction selectivity in the elementary motion detector (EMD) of the fly has become a paradigm of nonlinear neuronal computation. We have bridged this divide by demonstrating that linear spatial summation can generate direction selectivity in the fruit fly Drosophila. Using linear systems analysis and two-photon imaging of a genetically encoded voltage indicator, we measure the emergence of direction-selective (DS) voltage signals in the Drosophila OFF pathway. Our study is a direct, quantitative investigation of the algorithm underlying directional signals, with the striking finding that linear spatial summation is sufficient for the emergence of direction selectivity. A linear stage of the fly EMD strongly resembles similar computations in vertebrate visual cortex, demands a reappraisal of the role of upstream nonlinearities, and implicates the voltage-to-calcium transformation in the refinement of feature selectivity in this system. VIDEO ABSTRACT.
Collapse
Affiliation(s)
- Carl F R Wienecke
- Department of Neurobiology, Stanford University, Stanford, CA 94305, USA
| | - Jonathan C S Leong
- Department of Neurobiology, Stanford University, Stanford, CA 94305, USA; Brigham and Women's Hospital, 75 Francis Street, Boston, MA 02115, USA
| | - Thomas R Clandinin
- Department of Neurobiology, Stanford University, Stanford, CA 94305, USA.
| |
Collapse
|
68
|
Ribeiro IMA, Drews M, Bahl A, Machacek C, Borst A, Dickson BJ. Visual Projection Neurons Mediating Directed Courtship in Drosophila. Cell 2018; 174:607-621.e18. [PMID: 30033367 DOI: 10.1016/j.cell.2018.06.020] [Citation(s) in RCA: 83] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2017] [Revised: 03/07/2018] [Accepted: 06/10/2018] [Indexed: 11/19/2022]
Abstract
Many animals rely on vision to detect, locate, and track moving objects. In Drosophila courtship, males primarily use visual cues to orient toward and follow females and to select the ipsilateral wing for courtship song. Here, we show that the LC10 visual projection neurons convey essential visual information during courtship. Males with LC10 neurons silenced are unable to orient toward or maintain proximity to the female and do not predominantly use the ipsilateral wing when singing. LC10 neurons preferentially respond to small moving objects using an antagonistic motion-based center-surround mechanism. Unilateral activation of LC10 neurons recapitulates the orienting and ipsilateral wing extension normally elicited by females, and the potency with which LC10 induces wing extension is enhanced in a state of courtship arousal controlled by male-specific P1 neurons. These data suggest that LC10 is a major pathway relaying visual input to the courtship circuits in the male brain.
Collapse
Affiliation(s)
- Inês M A Ribeiro
- Janelia Research Campus, Howard Hughes Medical Institute, 19700 Helix Drive, Ashburn, VA 20147, USA; Max Plank Institute of Neurobiology, Am Klopferspitz 18, 82152 Martinsried, Germany; Institute of Molecular Pathology, Campus-Vienna-Biocenter 1, 1030 Vienna, Austria
| | - Michael Drews
- Max Plank Institute of Neurobiology, Am Klopferspitz 18, 82152 Martinsried, Germany
| | - Armin Bahl
- Max Plank Institute of Neurobiology, Am Klopferspitz 18, 82152 Martinsried, Germany
| | - Christian Machacek
- Institute of Molecular Pathology, Campus-Vienna-Biocenter 1, 1030 Vienna, Austria
| | - Alexander Borst
- Max Plank Institute of Neurobiology, Am Klopferspitz 18, 82152 Martinsried, Germany.
| | - Barry J Dickson
- Janelia Research Campus, Howard Hughes Medical Institute, 19700 Helix Drive, Ashburn, VA 20147, USA; Institute of Molecular Pathology, Campus-Vienna-Biocenter 1, 1030 Vienna, Austria; Queensland Brain Institute, University of Queensland, St. Lucia, QLD 4072, Australia.
| |
Collapse
|
69
|
Abstract
Motion in the visual world provides critical information to guide the behavior of sighted animals. Furthermore, as visual motion estimation requires comparisons of signals across inputs and over time, it represents a paradigmatic and generalizable neural computation. Focusing on the Drosophila visual system, where an explosion of technological advances has recently accelerated experimental progress, we review our understanding of how, algorithmically and mechanistically, motion signals are first computed.
Collapse
Affiliation(s)
- Helen H Yang
- Department of Neurobiology, Stanford University, Stanford, California 94305, USA; .,Current affiliation: Department of Neurobiology, Harvard Medical School, Boston, Massachusetts 02115, USA;
| | - Thomas R Clandinin
- Department of Neurobiology, Stanford University, Stanford, California 94305, USA;
| |
Collapse
|
70
|
Rusanen J, Frolov R, Weckström M, Kinoshita M, Arikawa K. Non-linear amplification of graded voltage signals in the first-order visual interneurons of the butterfly Papilio xuthus. ACTA ACUST UNITED AC 2018; 221:jeb.179085. [PMID: 29712749 DOI: 10.1242/jeb.179085] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2018] [Accepted: 04/26/2018] [Indexed: 11/20/2022]
Abstract
Lamina monopolar cells (LMCs) are the first-order visual interneurons of insects and crustacea, primarily involved in achromatic vision. Here, we investigated morphological and electrophysiological properties of LMCs in the butterfly Papilio xuthus Using intracellular recording coupled with dye injection, we found two types of LMCs. Cells with roundish terminals near the distal surface of the medulla demonstrating no or small depolarizing spikes were classified as L1/2. Cells with elongated terminals deep in the medulla that showed prominent spiking were classified as L3/4. The majority of LMCs of both types had broad spectral sensitivities, peaking between 480 and 570 nm. Depending on the experimental conditions, spikes varied from small to action potential-like events, with their amplitudes and rates decreasing as stimulus brightness increased. When the eye was stimulated with naturalistic contrast-modulated time series, spikes were reliably triggered by high-contrast components of the stimulus. Spike-triggered average functions showed that spikes emphasize rapid membrane depolarizations. Our results suggest that spikes are mediated by voltage-activated Na+ channels, which are mainly inactivated at rest. Strong local minima in the coherence functions of spiking LMCs indicate that the depolarizing conductance contributes to the amplification of graded responses even when detectable spikes are not evoked. We propose that the information transfer strategies of spiking LMCs change with light intensity. In dim light, both graded voltage signals and large spikes are used together without mutual interference, as a result of separate transmission bandwidths. In bright light, signals are non-linearly amplified by the depolarizing conductance in the absence of detectable spikes.
Collapse
Affiliation(s)
- Juha Rusanen
- Nano and Molecular Materials Research Unit, Faculty of Science, University of Oulu, P.O. Box 3000, Oulu 90014, Finland
| | - Roman Frolov
- Nano and Molecular Materials Research Unit, Faculty of Science, University of Oulu, P.O. Box 3000, Oulu 90014, Finland
| | - Matti Weckström
- Nano and Molecular Materials Research Unit, Faculty of Science, University of Oulu, P.O. Box 3000, Oulu 90014, Finland
| | - Michiyo Kinoshita
- Laboratory of Neuroethology, Sokendai (The Graduate University for Advanced Studies), Hayama, Kanagawa 240-0193, Japan
| | - Kentaro Arikawa
- Laboratory of Neuroethology, Sokendai (The Graduate University for Advanced Studies), Hayama, Kanagawa 240-0193, Japan
| |
Collapse
|
71
|
Borst A. A biophysical mechanism for preferred direction enhancement in fly motion vision. PLoS Comput Biol 2018; 14:e1006240. [PMID: 29897917 PMCID: PMC6016951 DOI: 10.1371/journal.pcbi.1006240] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2018] [Revised: 06/25/2018] [Accepted: 05/29/2018] [Indexed: 11/18/2022] Open
Abstract
Seeing the direction of motion is essential for survival of all sighted animals. Consequently, nerve cells that respond to visual stimuli moving in one but not in the opposite direction, so-called 'direction-selective' neurons, are found abundantly. In general, direction selectivity can arise by either signal amplification for stimuli moving in the cell's preferred direction ('preferred direction enhancement'), signal suppression for stimuli moving along the opposite direction ('null direction suppression'), or a combination of both. While signal suppression can be readily implemented in biophysical terms by a hyperpolarization followed by a rectification corresponding to the nonlinear voltage-dependence of the Calcium channel, the biophysical mechanism for signal amplification has remained unclear so far. Taking inspiration from the fly, I analyze a neural circuit where a direction-selective ON-cell receives inhibitory input from an OFF cell on the preferred side of the dendrite, while excitatory ON-cells contact the dendrite centrally. This way, an ON edge moving along the cell's preferred direction suppresses the inhibitory input, leading to a release from inhibition in the postsynaptic cell. The benefit of such a two-fold signal inversion lies in the resulting increase of the postsynaptic cell's input resistance, amplifying its response to a subsequent excitatory input signal even with a passive dendrite, i.e. without voltage-gated ion channels. A motion detector implementing this mechanism together with null direction suppression shows a high degree of direction selectivity over a large range of temporal frequency, narrow directional tuning, and a large signal-to-noise ratio.
Collapse
|
72
|
Kohn JR, Heath SL, Behnia R. Eyes Matched to the Prize: The State of Matched Filters in Insect Visual Circuits. Front Neural Circuits 2018; 12:26. [PMID: 29670512 PMCID: PMC5893817 DOI: 10.3389/fncir.2018.00026] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2017] [Accepted: 03/13/2018] [Indexed: 12/16/2022] Open
Abstract
Confronted with an ever-changing visual landscape, animals must be able to detect relevant stimuli and translate this information into behavioral output. A visual scene contains an abundance of information: to interpret the entirety of it would be uneconomical. To optimally perform this task, neural mechanisms exist to enhance the detection of important features of the sensory environment while simultaneously filtering out irrelevant information. This can be accomplished by using a circuit design that implements specific "matched filters" that are tuned to relevant stimuli. Following this rule, the well-characterized visual systems of insects have evolved to streamline feature extraction on both a structural and functional level. Here, we review examples of specialized visual microcircuits for vital behaviors across insect species, including feature detection, escape, and estimation of self-motion. Additionally, we discuss how these microcircuits are modulated to weigh relevant input with respect to different internal and behavioral states.
Collapse
Affiliation(s)
- Jessica R Kohn
- Department of Neuroscience, Columbia University, New York, NY, United States
| | - Sarah L Heath
- Department of Neuroscience, Columbia University, New York, NY, United States
| | - Rudy Behnia
- Department of Neuroscience, Columbia University, New York, NY, United States
| |
Collapse
|
73
|
Gruntman E, Romani S, Reiser MB. Simple integration of fast excitation and offset, delayed inhibition computes directional selectivity in Drosophila. Nat Neurosci 2018; 21:250-257. [PMID: 29311742 PMCID: PMC5967973 DOI: 10.1038/s41593-017-0046-4] [Citation(s) in RCA: 52] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2017] [Accepted: 11/06/2017] [Indexed: 02/07/2023]
Abstract
A neuron that extracts directionally selective motion information from upstream signals lacking this selectivity must compare visual responses from spatially offset inputs. Distinguishing among prevailing algorithmic models for this computation requires measuring fast neuronal activity and inhibition. In the Drosophila melanogaster visual system, a fourth-order neuron-T4-is the first cell type in the ON pathway to exhibit directionally selective signals. Here we use in vivo whole-cell recordings of T4 to show that directional selectivity originates from simple integration of spatially offset fast excitatory and slow inhibitory inputs, resulting in a suppression of responses to the nonpreferred motion direction. We constructed a passive, conductance-based model of a T4 cell that accurately predicts the neuron's response to moving stimuli. These results connect the known circuit anatomy of the motion pathway to the algorithmic mechanism by which the direction of motion is computed.
Collapse
Affiliation(s)
- Eyal Gruntman
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Sandro Romani
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Michael B Reiser
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA.
| |
Collapse
|
74
|
Li J, Lindemann JP, Egelhaaf M. Local motion adaptation enhances the representation of spatial structure at EMD arrays. PLoS Comput Biol 2017; 13:e1005919. [PMID: 29281631 PMCID: PMC5760083 DOI: 10.1371/journal.pcbi.1005919] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2017] [Revised: 01/09/2018] [Accepted: 11/13/2017] [Indexed: 11/18/2022] Open
Abstract
Neuronal representation and extraction of spatial information are essential for behavioral control. For flying insects, a plausible way to gain spatial information is to exploit distance-dependent optic flow that is generated during translational self-motion. Optic flow is computed by arrays of local motion detectors retinotopically arranged in the second neuropile layer of the insect visual system. These motion detectors have adaptive response characteristics, i.e. their responses to motion with a constant or only slowly changing velocity decrease, while their sensitivity to rapid velocity changes is maintained or even increases. We analyzed by a modeling approach how motion adaptation affects signal representation at the output of arrays of motion detectors during simulated flight in artificial and natural 3D environments. We focused on translational flight, because spatial information is only contained in the optic flow induced by translational locomotion. Indeed, flies, bees and other insects segregate their flight into relatively long intersaccadic translational flight sections interspersed with brief and rapid saccadic turns, presumably to maximize periods of translation (80% of the flight). With a novel adaptive model of the insect visual motion pathway we could show that the motion detector responses to background structures of cluttered environments are largely attenuated as a consequence of motion adaptation, while responses to foreground objects stay constant or even increase. This conclusion even holds under the dynamic flight conditions of insects.
Collapse
Affiliation(s)
- Jinglin Li
- Department of Neurobiology and Cluster of Excellence Cognitive Interaction Technology (CITEC), Bielefeld University, Bielefeld, Germany
- * E-mail:
| | - Jens P. Lindemann
- Department of Neurobiology and Cluster of Excellence Cognitive Interaction Technology (CITEC), Bielefeld University, Bielefeld, Germany
| | - Martin Egelhaaf
- Department of Neurobiology and Cluster of Excellence Cognitive Interaction Technology (CITEC), Bielefeld University, Bielefeld, Germany
| |
Collapse
|
75
|
Neural mechanisms underlying sensitivity to reverse-phi motion in the fly. PLoS One 2017; 12:e0189019. [PMID: 29261684 PMCID: PMC5737883 DOI: 10.1371/journal.pone.0189019] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2017] [Accepted: 11/18/2017] [Indexed: 01/18/2023] Open
Abstract
Optical illusions provide powerful tools for mapping the algorithms and circuits that underlie visual processing, revealing structure through atypical function. Of particular note in the study of motion detection has been the reverse-phi illusion. When contrast reversals accompany discrete movement, detected direction tends to invert. This occurs across a wide range of organisms, spanning humans and invertebrates. Here, we map an algorithmic account of the phenomenon onto neural circuitry in the fruit fly Drosophila melanogaster. Through targeted silencing experiments in tethered walking flies as well as electrophysiology and calcium imaging, we demonstrate that ON- or OFF-selective local motion detector cells T4 and T5 are sensitive to certain interactions between ON and OFF. A biologically plausible detector model accounts for subtle features of this particular form of illusory motion reversal, like the re-inversion of turning responses occurring at extreme stimulus velocities. In light of comparable circuit architecture in the mammalian retina, we suggest that similar mechanisms may apply even to human psychophysics.
Collapse
|
76
|
Abstract
The behavioral state of an animal can dynamically modulate visual processing. In flies, the behavioral state is known to alter the temporal tuning of neurons that carry visual motion information into the central brain. However, where this modulation occurs and how it tunes the properties of this neural circuit are not well understood. Here, we show that the behavioral state alters the baseline activity levels and the temporal tuning of the first directionally selective neuron in the ON motion pathway (T4) as well as its primary input neurons (Mi1, Tm3, Mi4, Mi9). These effects are especially prominent in the inhibitory neuron Mi4, and we show that central octopaminergic neurons provide input to Mi4 and increase its excitability. We further show that octopamine neurons are required for sustained behavioral responses to fast-moving, but not slow-moving, visual stimuli in walking flies. These results indicate that behavioral-state modulation acts directly on the inputs to the directionally selective neurons and supports efficient neural coding of motion stimuli.
Collapse
|
77
|
Dyakova O, Nordström K. Image statistics and their processing in insect vision. CURRENT OPINION IN INSECT SCIENCE 2017; 24:7-14. [PMID: 29208226 DOI: 10.1016/j.cois.2017.08.002] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/16/2017] [Revised: 08/17/2017] [Accepted: 08/24/2017] [Indexed: 06/07/2023]
Abstract
Natural scenes may appear random, but are not only constrained in space and time, but also show strong spatial and temporal correlations. Spatial constraints and correlations can be described by quantifying image statistics, which include intuitive measures such as contrast, color and luminance, but also parameters that need some type of transformation of the image. In this review we will discuss some common tools used to quantify spatial and temporal parameters of naturalistic visual input, and how these tools have been used to inform us about visual processing in insects. In particular, we will review findings that would not have been possible using conventional, experimenter defined stimuli.
Collapse
Affiliation(s)
- Olga Dyakova
- Department of Neuroscience, Uppsala University, Box 593, 751 24 Uppsala, Sweden
| | - Karin Nordström
- Department of Neuroscience, Uppsala University, Box 593, 751 24 Uppsala, Sweden; Centre for Neuroscience, Flinders University, GPO Box 2100, Adelaide, SA 5001, Australia.
| |
Collapse
|
78
|
Optogenetic Neuronal Silencing in Drosophila during Visual Processing. Sci Rep 2017; 7:13823. [PMID: 29061981 PMCID: PMC5653863 DOI: 10.1038/s41598-017-14076-7] [Citation(s) in RCA: 38] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2017] [Accepted: 10/06/2017] [Indexed: 02/04/2023] Open
Abstract
Optogenetic channels and ion pumps have become indispensable tools in neuroscience to manipulate neuronal activity and thus to establish synaptic connectivity and behavioral causality. Inhibitory channels are particularly advantageous to explore signal processing in neural circuits since they permit the functional removal of selected neurons on a trial-by-trial basis. However, applying these tools to study the visual system poses a considerable challenge because the illumination required for their activation usually also stimulates photoreceptors substantially, precluding the simultaneous probing of visual responses. Here, we explore the utility of the recently discovered anion channelrhodopsins GtACR1 and GtACR2 for application in the visual system of Drosophila. We first characterized their properties using a larval crawling assay. We further obtained whole-cell recordings from cells expressing GtACR1, which mediated strong and light-sensitive photocurrents. Finally, using physiological recordings and a behavioral readout, we demonstrate that GtACR1 enables the fast and reversible silencing of genetically targeted neurons within circuits engaged in visual processing.
Collapse
|
79
|
Calhoun AJ, Murthy M. Quantifying behavior to solve sensorimotor transformations: advances from worms and flies. Curr Opin Neurobiol 2017; 46:90-98. [PMID: 28850885 PMCID: PMC5765764 DOI: 10.1016/j.conb.2017.08.006] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2017] [Revised: 08/05/2017] [Accepted: 08/08/2017] [Indexed: 02/09/2023]
Abstract
The development of new computational tools has recently opened up the study of natural behaviors at a precision that was previously unachievable. These tools permit a highly quantitative analysis of behavioral dynamics at timescales that are well matched to the timescales of neural activity. Here we examine how combining these methods with established techniques for estimating an animal's sensory experience presents exciting new opportunities for dissecting the sensorimotor transformations performed by the nervous system. We focus this review primarily on examples from Caenorhabditis elegans and Drosophila melanogaster-for these model systems, computational approaches to characterize behavior, in combination with unparalleled genetic tools for neural activation, silencing, and recording, have already proven instrumental for illuminating underlying neural mechanisms.
Collapse
Affiliation(s)
- Adam J Calhoun
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ 08544, United States
| | - Mala Murthy
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ 08544, United States; Department of Molecular Biology, Princeton University, Princeton, NJ 08544, United States
| |
Collapse
|
80
|
Haag J, Mishra A, Borst A. A common directional tuning mechanism of Drosophila motion-sensing neurons in the ON and in the OFF pathway. eLife 2017; 6:29044. [PMID: 28829040 PMCID: PMC5582866 DOI: 10.7554/elife.29044] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2017] [Accepted: 08/21/2017] [Indexed: 01/19/2023] Open
Abstract
In the fruit fly optic lobe, T4 and T5 cells represent the first direction-selective neurons, with T4 cells responding selectively to moving brightness increments (ON) and T5 cells to brightness decrements (OFF). Both T4 and T5 cells comprise four subtypes with directional tuning to one of the four cardinal directions. We had previously found that upward-sensitive T4 cells implement both preferred direction enhancement and null direction suppression (Haag et al., 2016). Here, we asked whether this mechanism generalizes to OFF-selective T5 cells and to all four subtypes of both cell classes. We found that all four subtypes of both T4 and T5 cells implement both mechanisms, that is preferred direction enhancement and null direction inhibition, on opposing sides of their receptive fields. This gives rise to the high degree of direction selectivity observed in both T4 and T5 cells within each subpopulation.
Collapse
Affiliation(s)
- Juergen Haag
- Max-Planck-Institute of Neurobiology, Martinsried, Germany
| | | | | |
Collapse
|
81
|
Takemura SY, Nern A, Chklovskii DB, Scheffer LK, Rubin GM, Meinertzhagen IA. The comprehensive connectome of a neural substrate for 'ON' motion detection in Drosophila. eLife 2017; 6. [PMID: 28432786 PMCID: PMC5435463 DOI: 10.7554/elife.24394] [Citation(s) in RCA: 123] [Impact Index Per Article: 17.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2016] [Accepted: 04/13/2017] [Indexed: 12/11/2022] Open
Abstract
Analysing computations in neural circuits often uses simplified models because the actual neuronal implementation is not known. For example, a problem in vision, how the eye detects image motion, has long been analysed using Hassenstein-Reichardt (HR) detector or Barlow-Levick (BL) models. These both simulate motion detection well, but the exact neuronal circuits undertaking these tasks remain elusive. We reconstructed a comprehensive connectome of the circuits of Drosophila's motion-sensing T4 cells using a novel EM technique. We uncover complex T4 inputs and reveal that putative excitatory inputs cluster at T4's dendrite shafts, while inhibitory inputs localize to the bases. Consistent with our previous study, we reveal that Mi1 and Tm3 cells provide most synaptic contacts onto T4. We are, however, unable to reproduce the spatial offset between these cells reported previously. Our comprehensive connectome reveals complex circuits that include candidate anatomical substrates for both HR and BL types of motion detectors.
Collapse
Affiliation(s)
- Shin-Ya Takemura
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Aljoscha Nern
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Dmitri B Chklovskii
- Simons Center for Data Analysis, Simons Foundation, New York, United States.,Neuroscience Institute, NYU Medical Center, New York, United States
| | - Louis K Scheffer
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Gerald M Rubin
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
| | - Ian A Meinertzhagen
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States.,Department of Psychology and Neuroscience, Dalhousie University, Halifax, Canada
| |
Collapse
|
82
|
Abstract
Images projected onto the retina of an animal eye are rarely still. Instead, they usually contain motion signals originating either from moving objects or from retinal slip caused by self-motion. Accordingly, motion signals tell the animal in which direction a predator, prey, or the animal itself is moving. At the neural level, visual motion detection has been proposed to extract directional information by a delay-and-compare mechanism, representing a classic example of neural computation. Neurons responding selectively to motion in one but not in the other direction have been identified in many systems, most prominently in the mammalian retina and the fly optic lobe. Technological advances have now allowed researchers to characterize these neurons' upstream circuits in exquisite detail. Focusing on these upstream circuits, we review and compare recent progress in understanding the mechanisms that generate direction selectivity in the early visual system of mammals and flies.
Collapse
Affiliation(s)
- Alex S Mauss
- Max Planck Institute of Neurobiology, 82152 Martinsried, Germany; ,
| | - Anna Vlasits
- Department of Molecular and Cell Biology & Helen Wills Neuroscience Institute, University of California, Berkeley, California 94720; ,
| | - Alexander Borst
- Max Planck Institute of Neurobiology, 82152 Martinsried, Germany; ,
| | - Marla Feller
- Department of Molecular and Cell Biology & Helen Wills Neuroscience Institute, University of California, Berkeley, California 94720; ,
| |
Collapse
|
83
|
Abstract
Visual motion detection in insects is mediated by three-input detectors that compare inputs of different spatiotemporal properties. A new modeling study shows that only a small subset of possible arrangements of the input elements provides high direction-selectivity.
Collapse
Affiliation(s)
- Tirthabir Biswas
- Department of Physics, Loyola University, New Orleans, LA 70118, USA.
| | - Chi-Hon Lee
- Section on Neuronal Connectivity, Institute of Child Health and Human Development, National Institutes of Health, Bethesda, MD 20892, USA.
| |
Collapse
|