Motion parallax in electric sensing

Mormyrid fish as models for investigating sensory-motor integration: A behavioural perspective

Animals possess senses which gather information from their environment. They can tune into important aspects of this information and decide on the most appropriate response, requiring coordination of their sensory and motor systems. This interaction is bidirectional. Animals can actively shape their perception with self-driven motion, altering sensory flow to maximise the environmental information they are able to extract. Mormyrid fish are excellent candidates for studying sensory-motor interactions, because they possess a unique sensory system (the active electric sense) and exhibit notable behaviours that seem to be associated with electrosensing. This review will take a behavioural approach to unpicking this relationship, using active electrolocation as an example where body movements and sensing capabilities are highly related and can be assessed in tandem. Active electrolocation is the process where individuals will generate and detect low-voltage electric fields to locate and recognise nearby objects. We will focus on research in the mormyrid Gnathonemus petersii (G. petersii), given the extensive study of this species, particularly its object recognition abilities. By studying object detection and recognition, we can assess the potential benefits of self-driven movements to enhance selection of biologically relevant information. Finally, these findings are highly relevant to understanding the involvement of movement in shaping the sensory experience of animals that use other sensory modalities. Understanding the overlap between sensory and motor systems will give insight into how different species have become adapted to their environments.

A model for transforming egocentric views into goal-directed behavior

Neurons in the rat postrhinal cortex (POR) respond to the egocentric (observer-centered) bearing and distance of the boundaries, or geometric center, of an enclosed space. Understanding of the precise geometric and sensory properties of the environment that generate these signals is limited. Here we model how this signal may relate to visual perception of motion parallax along environmental boundaries. A behavioral extension of this tuning is the known 'centering response', in which animals follow a spatial gradient function based on boundary parallax to guide behavior toward the center of a corridor or enclosure. Adding an allocentric head direction signal to this representation can translate the gradient across two-dimensional space and provide a new gradient for directing behavior to any location. We propose a model for how this signal may support goal-directed navigation via projections to the dorsomedial striatum. The result is a straightforward code for navigational variables derived from visual geometric properties of the surrounding environment, which may be used to map space and transform incoming sensory information into an appropriate motor output.

Minimal sensor arrays for localizing objects using an electric sense

Weakly electric fish encode perturbations in a self-generated electric field to sense their environment. Localizing objects using this electric sense requires that distance be decoded from a two-dimensional \emph{electric image} of the field perturbations on their skin. Many studies of object localization by weakly electric fish, and by electric sensing in a generic context, have focused on extracting location information from different features of the electric image. Some of these studies have also considered the additional information gained from sampling the electric image at different times, and from different viewpoints. Here, we take a different perspective and instead consider the information available at a single point in space (i.e. a single sensor or receptor) at a single point in time (i.e. constant field). By combining the information from multiple receptors, we show that an object's distance can be unambiguously encoded by as few as four receptors at specific locations on a sensing surface in a manner that is relatively robust to environmental noise. This provides a lower bound on the information (i.e. receptor array size) required to decode the three-dimensional location of an object using an electric sense.

Motion parallax for object localization in electric fields

Parallax, as a visual effect, is used for depth perception of objects. But is there also the effect of parallax in the context of electric field imagery? In this work, the example of weakly electric fish is used to investigate how the self-generated electric field that these fish utilize for orientation and communication alike, may be used as a template to define electric parallax. The skin of the electric fish possesses a vast amount of electroreceptors that detect the self-emitted dipole-like electric field. In this work, the weakly electric fish is abstracted as an electric dipole with a sensor line in between the two emitters. With an analytical description of the object distortion for a uniform electric field, the distortion in a dipole-like field is simplified and simulated. On the basis of this simulation, the parallax effect could be demonstrated in electric field images i.e. by closer inspection of voltage profiles on the sensor line. Therefore, electric parallax can be defined as the relative movement of a signal feature of the voltage profile (here, the maximum or peak of the voltage profile) that travels along the sensor line peak trace (PT). The PT width correlates with the object's vertical distance to the sensor line, as close objects create a large PT and distant objects a small PT, comparable with the effect of visual motion parallax.

Linking active sensing and spatial learning in weakly electric fish

Weakly electric fish can learn the spatial layout of their environment using only their short-range electric sense. During spatial learning, active sensing motions are used to memorize landmark locations so that they can serve as anchors for idiothetic-based navigation. A hindbrain feedback circuit selectively amplifies the electrosensory input arising from these motions. The ascending electrolocation pathway preferentially transmits this information to the pallial regions involved in spatial learning and navigation. Similarities in both behavioral patterns and hindbrain circuitry of gymnotiform and mormyrid fish, two families that independently evolved their electrosense, suggest that amplification and transmission of active sensing motion inputs are fundamental mechanisms for spatial memory acquisition.

Spooky Interaction at a Distance in Cave and Surface Dwelling Electric Fishes

Glass knifefish (Eigenmannia) are a group of weakly electric fishes found throughout the Amazon basin. Their electric organ discharges (EODs) are energetically costly adaptations used in social communication and for localizing conspecifics and other objects including prey at night and in turbid water. Interestingly, a troglobitic population of blind cavefish Eigenmannia vicentespelea survives in complete darkness in a cave system in central Brazil. We examined the effects of troglobitic conditions, which includes a complete loss of visual cues and potentially reduced food sources, by comparing the behavior and movement of freely behaving cavefish to a nearby epigean (surface) population (Eigenmannia trilineata). We found that the strengths of electric discharges in cavefish were greater than in surface fish, which may result from increased reliance on electrosensory perception, larger size, and sufficient food resources. Surface fish were recorded while feeding at night and did not show evidence of territoriality, whereas cavefish appeared to maintain territories. Surprisingly, we routinely found both surface and cavefish with sustained differences in EOD frequencies that were below 10 Hz despite being within close proximity of about 50 cm. A half century of analysis of electrosocial interactions in laboratory tanks suggest that these small differences in EOD frequencies should have triggered the "jamming avoidance response," a behavior in which fish change their EOD frequencies to increase the difference between individuals. Pairs of fish also showed significant interactions between EOD frequencies and relative movements at large distances, over 1.5 m, and at high differences in frequencies, often >50 Hz. These interactions are likely "envelope" responses in which fish alter their EOD frequency in relation to higher order features, specifically changes in the depth of modulation, of electrosocial signals.

Active Sensing: Constancy Requires Change

We constantly generate movements in order to enhance our ability to perceive the external environment. New research on electric fish has used augmented reality to demonstrate that animals dynamically regulate their movements to maintain variability in their sensory input.

Task-Related Sensorimotor Adjustments Increase the Sensory Range in Electrolocation

Perception and motor control traditionally are studied separately. However, motor activity can serve as a scaffold to shape the sensory flow. This tight link between motor actions and sensing is particularly evident in active sensory systems. Here, we investigate how the weakly electric mormyrid fish Gnathonemus petersii of undetermined sex structure their sensing and motor behavior while learning a perceptual task. We find systematic adjustments of the motor behavior that correlate with an increased performance. Using a model to compute the electrosensory input, we show that these behavioral adjustments improve the sensory input. As we find low neuronal detection thresholds at the level of medullary electrosensory neurons, it seems that the behavior-driven improvements of the sensory input are highly suitable to overcome the sensory limitations, thereby increasing the sensory range. Our results show that motor control is an active component of sensory learning, demonstrating that a detailed understanding of contribution of motor actions to sensing is needed to understand even seemingly simple behaviors.SIGNIFICANCE STATEMENT Motor-guided sensation and perception are intertwined, with motor behavior serving as a scaffold to shape the sensory input. We characterized how the weakly electric mormyrid fish Gnathonemus petersii, as it learns a perceptual task, restructures its sensorimotor behavior. We find that systematic adjustments of the motor behavior correlate with increased performance and a shift of the sensory attention of the animal. Analyzing the afferent electrosensory input shows that a significant gain in information results from these sensorimotor adjustments. Our results show that motor control can be an active component of sensory learning. Researching the sensory corollaries of motor control thus can be crucial to understand sensory sensation and perception under naturalistic conditions.

Novel Functions of Feedback in Electrosensory Processing

Environmental signals act as input and are processed across successive stages in the brain to generate a meaningful behavioral output. However, a ubiquitous observation is that descending feedback projections from more central to more peripheral brain areas vastly outnumber ascending feedforward projections. Such projections generally act to modify how sensory neurons respond to afferent signals. Recent studies in the electrosensory system of weakly electric fish have revealed novel functions for feedback pathways in that their transformation of the afferent input generates neural firing rate responses to sensory signals mediating perception and behavior. In this review, we focus on summarizing these novel and recently uncovered functions and put them into context by describing the more "classical" functions of feedback in the electrosensory system. We further highlight the parallels between the electrosensory system and other systems as well as outline interesting future directions.

Electrosensory Contrast Signals for Interacting Weakly Electric Fish

Active sensory systems have evolved to properly encode natural stimuli including those created by conspecifics, yet little is known about the properties of such stimuli. We consider the electrosensory signal at the skin of a fixed weakly electric fish in the presence of a swimming conspecific. The dipole recordings are obtained in parallel with video tracking of the position of the animals. This enables the quantification of the relationships between the recording dipole and the positions of the head, midbody and tail of the freely swimming fish. The contrast of the signal at the skin is shown to be well-fitted by a decreasing exponential function of distance. It is thus anti-correlated with distance; it is also correlated with the second envelope (i.e., the envelope of the envelope) of the raw recorded signal. The variance of the contrast signal is highest at short range. However, the coefficient of variation (CV) of this signal increases with distance. We find a range of position and associated contrast patterns under quasi-2D swimming conditions. This is quantified using global measures of the visit times of the free fish within measurable range, with each visit causing a bump in contrast. The durations of these bumps as well as the times between these bumps are well reproduced by a doubly stochastic process formed by a dichotomous (two-state) noise with Poisson statistics multiplying a colored noise [Ornstein-Uhlenbeck (OU) process]. Certain rapid body movements such as bending or turning are seen to produce contrast drops that may be part of cloaking strategies.

Sensory Cues Modulate Smooth Pursuit and Active Sensing Movements

Animals routinely use autogenous movement to regulate the information encoded by their sensory systems. Weakly electric fish use fore-aft movements to regulate visual and electrosensory feedback as they maintain position within a moving refuge. During refuge tracking, fish produce two categories of movements: smooth pursuit that is approximately linear in its relation to the movement of the refuge and ancillary active sensing movements that are nonlinear. We identified four categories of nonlinear movements which we termed scanning, wiggle, drift, and reset. To examine the relations between sensory cues and production of both linear smooth pursuit and nonlinear active sensing movements, we altered visual and electrosensory cues for refuge tracking and measured the fore-aft movements of the fish. Specifically, we altered the length and structure of the refuge and performed experiments with light and in complete darkness. Linear measures of tracking performance were better for shorter refuges (less than a body length) than longer ones (>1.5 body lengths). The magnitude of nonlinear active sensing movements was strongly modulated by light cues but also increased as a function of both longer refuge length and decreased features. Specifically, fish shifted swimming movements from smooth pursuit to scanning when tracking in dark conditions. Finally, fish appear to use nonlinear movements as an alternate tracking strategy in longer refuges: the fish may use more drifts and resets to avoid exiting the ends of the refuge.

Neural activity in a hippocampus-like region of the teleost pallium is associated with active sensing and navigation

Most vertebrates use active sensing strategies for perception, cognition and control of motor activity. These strategies include directed body/sensor movements or increases in discrete sensory sampling events. The weakly electric fish, Gymnotus sp., uses its active electric sense during navigation in the dark. Electric organ discharge rate undergoes transient increases during navigation to increase electrosensory sampling. Gymnotus also use stereotyped backward swimming as an important form of active sensing that brings objects toward the electroreceptor dense fovea-like head region. We wirelessly recorded neural activity from the pallium of freely swimming Gymnotus. Spiking activity was sparse and occurred only during swimming. Notably, most units tended to fire during backward swims and their activity was on average coupled to increases in sensory sampling. Our results provide the first characterization of neural activity in a hippocampal (CA3)-like region of a teleost fish brain and connects it to active sensing of spatial environmental features.

Spatiotemporal model for depth perception in electric sensing

Electric sensing involves measuring the voltage changes in an actively generated electric field, enabling an environment to be characterized by its electrical properties. It has been applied in a variety of contexts, from geophysics to biomedical imaging. Some species of fish also use an active electric sense to explore their environment in the dark. One of the primary challenges in such electric sensing involves mapping an environment in three-dimensions using voltage measurements that are limited to a two-dimensional sensor array (i.e. a two-dimensional electric image). In some special cases, the distance of simple objects from the sensor array can be estimated by combining properties of the electric image. Here, we describe a novel algorithm for distance estimation based on a single property of the electric image. Our algorithm can be implemented in two simple ways, involving either different electric field strengths or different sensor thresholds, and is robust to changes in object properties and noise.

Population Coding and Correlated Variability in Electrosensory Pathways

The fact that perception and behavior depend on the simultaneous and coordinated activity of neural populations is well established. Understanding encoding through neuronal population activity is however complicated by the statistical dependencies between the activities of neurons, which can be present in terms of both their mean (signal correlations) and their response variability (noise correlations). Here, we review the state of knowledge regarding population coding and the influence of correlated variability in the electrosensory pathways of the weakly electric fish Apteronotus leptorhynchus. We summarize known population coding strategies at the peripheral level, which are largely unaffected by noise correlations. We then move on to the hindbrain, where existing data from the electrosensory lateral line lobe (ELL) shows the presence of noise correlations. We summarize the current knowledge regarding the mechanistic origins of noise correlations and known mechanisms of stimulus dependent correlation shaping in ELL. We finish by considering future directions for understanding population coding in the electrosensory pathways of weakly electric fish, highlighting the benefits of this model system for understanding the origins and impact of noise correlations on population coding.

Application of reduced sensor movement sequences as a precursor for search area partitioning and a selection of discrete EEV contour-ring fragments for active electrolocation

In addition to their visual sense, weakly electric fish use active electrolocation to detect and analyse objects in their nearby environment. Their ability to generate and sense electric fields combined with scanning-like swimming movements are intended to extract further parameters like the size, shape and material properties of objects. Inspired by this biological example, this work introduces an application for active electrolocation based on reduced sensor movement sequences as presented in Wolf-Homeyer et al (2016 Bioinspir. Biomim. 11 055002). Initially, the application is conducted with a simulated receptor-system consisting of an emitter-dipole and an orthogonally arranged pair of sensor-electrodes. Close inspection of a minimal set of scanning movements allows the exclusion of sectors of the general search area early in the proposed localization algorithm (search area partitioning). Furthermore, the proposed algorithm is based on an analytical representation of the electric field and of the so-called EEV (ensemble of electrosensory viewpoints) (Solberg et al 2008 Int. J. Robot. Res. 27 529-48) rather than using computationally expensive FEM simulations, rendering it suitable for embedded computer systems. Two-dimensional discrete EEV contour-ring points (CRPs) of desired accuracy are extracted. In the core of the localization algorithm, fragments of the EEV are selected from valid sectors of the search area, which generates sets of CRPs, one for each sensor-emitter position/orientation. These sets are investigated by means of a nearness metric to find points in different sets which correspond to each other in order to estimate the object position. Two resultant scanning strategies/localization algorithms are introduced.