Fish geometry and electric organ discharge determine functional organization of the electrosensory epithelium

The Use of Supervised Learning Models in Studying Agonistic Behavior and Communication in Weakly Electric Fish

Despite considerable advances, studying electrocommunication of weakly electric fish, particularly in pulse-type species, is challenging as very short signal epochs at variable intervals from a few hertz up to more than 100 Hz need to be assigned to individuals. In this study, we show that supervised learning approaches offer a promising tool to automate or semiautomate the workflow, and thereby allowing the analysis of much longer episodes of behavior in a reasonable amount of time. We provide a detailed workflow mainly based on open resource software. We demonstrate the usefulness by applying the approach to the analysis of dyadic interactions of Gnathonemus petersii. Coupling of the proposed methods with a boundary element modeling approach, we are thereby able to model the information gained and provided during agonistic encounters. The data indicate that the passive electrosensory input, in particular, provides sufficient information to localize a contender during the pre-contest phase, fish did not use or rely on the theoretically also available sensory information of the contest outcome-determining size difference between contenders before engaging in agonistic behavior.

Task-Related Sensorimotor Adjustments Increase the Sensory Range in Electrolocation

Perception and motor control traditionally are studied separately. However, motor activity can serve as a scaffold to shape the sensory flow. This tight link between motor actions and sensing is particularly evident in active sensory systems. Here, we investigate how the weakly electric mormyrid fish Gnathonemus petersii of undetermined sex structure their sensing and motor behavior while learning a perceptual task. We find systematic adjustments of the motor behavior that correlate with an increased performance. Using a model to compute the electrosensory input, we show that these behavioral adjustments improve the sensory input. As we find low neuronal detection thresholds at the level of medullary electrosensory neurons, it seems that the behavior-driven improvements of the sensory input are highly suitable to overcome the sensory limitations, thereby increasing the sensory range. Our results show that motor control is an active component of sensory learning, demonstrating that a detailed understanding of contribution of motor actions to sensing is needed to understand even seemingly simple behaviors.SIGNIFICANCE STATEMENT Motor-guided sensation and perception are intertwined, with motor behavior serving as a scaffold to shape the sensory input. We characterized how the weakly electric mormyrid fish Gnathonemus petersii, as it learns a perceptual task, restructures its sensorimotor behavior. We find that systematic adjustments of the motor behavior correlate with increased performance and a shift of the sensory attention of the animal. Analyzing the afferent electrosensory input shows that a significant gain in information results from these sensorimotor adjustments. Our results show that motor control can be an active component of sensory learning. Researching the sensory corollaries of motor control thus can be crucial to understand sensory sensation and perception under naturalistic conditions.

Neural activity in a hippocampus-like region of the teleost pallium is associated with active sensing and navigation

Most vertebrates use active sensing strategies for perception, cognition and control of motor activity. These strategies include directed body/sensor movements or increases in discrete sensory sampling events. The weakly electric fish, Gymnotus sp., uses its active electric sense during navigation in the dark. Electric organ discharge rate undergoes transient increases during navigation to increase electrosensory sampling. Gymnotus also use stereotyped backward swimming as an important form of active sensing that brings objects toward the electroreceptor dense fovea-like head region. We wirelessly recorded neural activity from the pallium of freely swimming Gymnotus. Spiking activity was sparse and occurred only during swimming. Notably, most units tended to fire during backward swims and their activity was on average coupled to increases in sensory sampling. Our results provide the first characterization of neural activity in a hippocampal (CA3)-like region of a teleost fish brain and connects it to active sensing of spatial environmental features.

Sensory Flow as a Basis for a Novel Distance Cue in Freely Behaving Electric Fish

The sensory input that an animal receives is directly linked to its motor activity. Behavior thus enables animals to influence their sensory input, a concept referred to as active sensing. How such behavior can serve as a scaffold for generating sensory information is of general scientific interest. In this article, we investigate how behavior can shape sensory information by using some unique features of the sensorimotor system of the weakly electric fish. Based on quantitative behavioral characterizations and computational reconstruction of sensory input, we show how electrosensory flow is actively created during highly patterned, spontaneous behavior in Gnathonemus petersii. The spatiotemporal structure of the sensory input provides information for the computation of a novel distance cue, which allows for a continuous estimation of distance. This has significant advantages over previously known nondynamic distance estimators as determined from electric image blur. Our investigation of the sensorimotor interactions in pulsatile electrolocation shows, for the first time, that the electrosensory flow contains behaviorally relevant information accessible only through active behavior. As patterned sensory behaviors are a shared feature of (active) sensory systems, our results have general implications for the understanding of (active) sensing, with the proposed sensory flow-based measure being potentially pertinent to a broad range of sensory modalities.

SIGNIFICANCE STATEMENT

Acquisition of sensory information depends on motion, as either an animal or its sensors move. Behavior can thus actively influence the sensory flow; and in this way, behavior can be seen as a manifestation of the brain's integrative functions. The properties of the active pulsatile electrolocation system in Gnathonemus petersii allow for the sensory input to be computationally reconstructed, enabling us to link the informational content of spatiotemporal sensory dynamics to behavior. Our study reveals a novel sensory cue for estimating depth that is actively generated by the fishes' behavior. The physical and behavioral similarities between electrolocation and other active sensory systems suggest that this may be a mechanism shared by (active) sensory systems.

Waveform sensitivity of electroreceptors in the pulse-type weakly electric fish Gymnotus omarorum

As in most sensory systems, electrosensory images in weakly electric fish are encoded in two parallel pathways, fast and slow. From work on wave-type electric fish, these fast and slow pathways are thought to encode the time and amplitude of electrosensory signals, respectively. The present study focuses on the primary afferents giving origin to the slow path of the pulse-type weakly electric fish Gymnotus omarorum We found that burst duration coders respond with a high-frequency train of spikes to each electric organ discharge. They also show high sensitivity to phase-frequency distortions of the self-generated local electric field. We explored this sensitivity by manipulating the longitudinal impedance of a probe cylinder to modulate the stimulus waveform, while extracellularly recording isolated primary afferents. Resistive loads only affect the amplitude of the re-afferent signals without distorting the waveform. Capacitive loads cause large waveform distortions aside from amplitude changes. Stepping from a resistive to a capacitive load in such a way that the stimulus waveform was distorted, without changing its total energy, caused strong changes in latency, inter-spike interval and number of spikes of primary afferent responses. These burst parameters are well correlated suggesting that they may contribute synergistically in driving downstream neurons. This correlation also suggests that each receptor encodes a single parameter in the stimulus waveform. The finding of waveform distortion sensitivity is relevant because it may contribute to: (a) enhance electroreceptive range in the peripheral 'electrosensory field', (b) a better identification of living prey at the 'foveal electrosensory field' and (c) detect the presence and orientation of conspecifics. Our results also suggest a revision of the classical view of amplitude and time encoding by fast and slow pathways in pulse-type electric fish.

The bioinspiring potential of weakly electric fish

Electric fish are privileged animals for bio-inspiring man-built autonomous systems since they have a multimodal sense that allows underwater navigation, object classification and intraspecific communication. Although there are taxon dependent variations adapted to different environments, this multimodal system can be schematically described as having four main components: active electroreception, passive electroreception, lateral line sense and, proprioception. Amongst these sensory modalities, proprioception and electroreception show 'active' systems that extrct information carried by self generated forms of energy. This ensemble of four sensory modalities is present in African mormyriformes and American gymnotiformes. The convergent evolution of similar imaging, peripheral encoding, and central processing mechanisms suggests that these mechanisms may be the most suitable for dealing with electric images in the context of the other and self generated actions. This review deals with the way in which biological organisms address three of the problems that are faced when designing a bioinspired electroreceptive agent: (a) body shape, material and mobility, (b) peripheral encoding of electric images, and (c) early processing of electrosensory signals. Taking into account biological solutions I propose that the new generation of underwater agents should have electroreceptive arms, use complex peripheral sensors for encoding the images and cerebellum like architecture for image feature extraction and implementing sensory-motor transformations.

Electric organ discharges and near-field spatiotemporal patterns of the electromotive force in a sympatric assemblage of Neotropical electric knifefish

Descriptions of the head-to-tail electric organ discharge (ht-EOD) waveform - typically recorded with electrodes at a distance of approximately 1-2 body lengths from the center of the subject - have traditionally been used to characterize species diversity in gymnotiform electric fish. However, even taxa with relatively simple ht-EODs show spatiotemporally complex fields near the body surface that are determined by site-specific electrogenic properties of the electric organ and electric filtering properties of adjacent tissues and skin. In Brachyhypopomus, a pulse-discharging genus in the family Hypopomidae, the regional characteristics of the electric organ and the role that the complex 'near field' plays in communication and/or electrolocation are not well known. Here we describe, compare, and discuss the functional significance of diversity in the ht-EOD waveforms and near-field spatiotemporal patterns of the electromotive force (emf-EODs) among a species-rich sympatric community of Brachyhypopomus from the upper Amazon.

Passive and active electroreception during agonistic encounters in the weakly electric fish Gymnotus omarorum

Agonistic behaviour related to territorial defence is likely to be costly in terms of energy loss and risk of injury. Hence information about the fighting ability of a potential opponent could influence the outcome of the contest. We here study electric images of the territorial and aggressive weakly electric fish Gymnotus omarorum in the context of agonistic behaviour. We show that passive and active electric images may drive the approach towards an opponent. The likelihood of first attacks can be predicted in these fish based on electric image information, suggesting that aggressive interactions may in fact be triggered through the passive electrosensory information.

Computational modeling of electric imaging in weakly electric fish: insights for physiology, behavior and evolution

Weakly electric fish can sense electric signals produced by other animals whether they are conspecifics, preys or predators. These signals, sensed by passive electroreception, sustain electrocommunication, mating and agonistic behavior. Weakly electric fish can also generate a weak electrical discharge with which they can actively sense the animate and inanimate objects in their surroundings. Understanding both sensory modalities depends on our knowledge of how pre-receptorial electric images are formed and how movements modify them during behavior. The inability of effectively measuring pre-receptorial fields at the level of the skin contrasts with the amount of knowledge on electric fields and the availability of computational methods for estimating them. In this work we review past work on modeling of electric organ discharge and electric images, showing the usefulness of these methods to calculate the field and providing a brief explanation of their principles. In addition, we focus on recent work demonstrating the potential of electric image modeling and what the method has to offer for experimentalists studying sensory physiology, behavior and evolution.

Electric imaging through evolution, a modeling study of commonalities and differences

Modeling the electric field and images in electric fish contributes to a better understanding of the pre-receptor conditioning of electric images. Although the boundary element method has been very successful for calculating images and fields, complex electric organ discharges pose a challenge for active electroreception modeling. We have previously developed a direct method for calculating electric images which takes into account the structure and physiology of the electric organ as well as the geometry and resistivity of fish tissues. The present article reports a general application of our simulator for studying electric images in electric fish with heterogeneous, extended electric organs. We studied three species of Gymnotiformes, including both wave-type (Apteronotus albifrons) and pulse-type (Gymnotus obscurus and Gymnotus coropinae) fish, with electric organs of different complexity. The results are compared with the African (Gnathonemus petersii) and American (Gymnotus omarorum) electric fish studied previously. We address the following issues: 1) how to calculate equivalent source distributions based on experimental measurements, 2) how the complexity of the electric organ discharge determines the features of the electric field and 3) how the basal field determines the characteristics of electric images. Our findings allow us to generalize the hypothesis (previously posed for G. omarorum) in which the perioral region and the rest of the body play different sensory roles. While the "electrosensory fovea" appears suitable for exploring objects in detail, the rest of the body is likened to a "peripheral retina" for detecting the presence and movement of surrounding objects. We discuss the commonalities and differences between species. Compared to African species, American electric fish show a weaker field. This feature, derived from the complexity of distributed electric organs, may endow Gymnotiformes with the ability to emit site-specific signals to be detected in the short range by a conspecific and the possibility to evolve predator avoidance strategies.

Long-term behavioral tracking of freely swimming weakly electric fish

Long-term behavioral tracking can capture and quantify natural animal behaviors, including those occurring infrequently. Behaviors such as exploration and social interactions can be best studied by observing unrestrained, freely behaving animals. Weakly electric fish (WEF) display readily observable exploratory and social behaviors by emitting electric organ discharge (EOD). Here, we describe three effective techniques to synchronously measure the EOD, body position, and posture of a free-swimming WEF for an extended period of time. First, we describe the construction of an experimental tank inside of an isolation chamber designed to block external sources of sensory stimuli such as light, sound, and vibration. The aquarium was partitioned to accommodate four test specimens, and automated gates remotely control the animals' access to the central arena. Second, we describe a precise and reliable real-time EOD timing measurement method from freely swimming WEF. Signal distortions caused by the animal's body movements are corrected by spatial averaging and temporal processing stages. Third, we describe an underwater near-infrared imaging setup to observe unperturbed nocturnal animal behaviors. Infrared light pulses were used to synchronize the timing between the video and the physiological signal over a long recording duration. Our automated tracking software measures the animal's body position and posture reliably in an aquatic scene. In combination, these techniques enable long term observation of spontaneous behavior of freely swimming weakly electric fish in a reliable and precise manner. We believe our method can be similarly applied to the study of other aquatic animals by relating their physiological signals with exploratory or social behaviors.

Sensory flow shaped by active sensing: sensorimotor strategies in electric fish

Goal-directed behavior in most cases is composed of a sequential order of elementary motor patterns shaped by sensorimotor contingencies. The sensory information acquired thus is structured in both space and time. Here we review the role of motion during the generation of sensory flow focusing on how animals actively shape information by behavioral strategies. We use the well-studied examples of vision in insects and echolocation in bats to describe commonalities of sensory-related behavioral strategies across sensory systems, and evaluate what is currently known about comparable active sensing strategies in electroreception of electric fish. In this sensory system the sensors are dispersed across the animal's body and the carrier source emitting energy used for sensing, the electric organ, is moved while the animal moves. Thus ego-motions strongly influence sensory dynamics. We present, for the first time, data of electric flow during natural probing behavior in Gnathonemus petersii (Mormyridae), which provide evidence for this influence. These data reveal a complex interdependency between the physical input to the receptors and the animal's movements, posture and objects in its environment. Although research on spatiotemporal dynamics in electrolocation is still in its infancy, the emerging field of dynamical sensory systems analysis in electric fish is a promising approach to the study of the link between movement and acquisition of sensory information.

Real-Time Localization of Moving Dipole Sources for Tracking Multiple Free-Swimming Weakly Electric Fish

In order to survive, animals must quickly and accurately locate prey, predators, and conspecifics using the signals they generate. The signal source location can be estimated using multiple detectors and the inverse relationship between the received signal intensity (RSI) and the distance, but difficulty of the source localization increases if there is an additional dependence on the orientation of a signal source. In such cases, the signal source could be approximated as an ideal dipole for simplification. Based on a theoretical model, the RSI can be directly predicted from a known dipole location; but estimating a dipole location from RSIs has no direct analytical solution. Here, we propose an efficient solution to the dipole localization problem by using a lookup table (LUT) to store RSIs predicted by our theoretically derived dipole model at many possible dipole positions and orientations. For a given set of RSIs measured at multiple detectors, our algorithm found a dipole location having the closest matching normalized RSIs from the LUT, and further refined the location at higher resolution. Studying the natural behavior of weakly electric fish (WEF) requires efficiently computing their location and the temporal pattern of their electric signals over extended periods. Our dipole localization method was successfully applied to track single or multiple freely swimming WEF in shallow water in real-time, as each fish could be closely approximated by an ideal current dipole in two dimensions. Our optimized search algorithm found the animal’s positions, orientations, and tail-bending angles quickly and accurately under various conditions, without the need for calibrating individual-specific parameters. Our dipole localization method is directly applicable to studying the role of active sensing during spatial navigation, or social interactions between multiple WEF. Furthermore, our method could be extended to other application areas involving dipole source localization.

On the haptic nature of the active electric sense of fish

Electroreception is a sensory modality present in chondrichthyes, actinopterygii, amphibians, and mammalian monotremes. The study of this non-intuitive sensory modality has provided insights for better understanding of sensory systems in general and inspired the development of innovative artificial devices. Here we review evidence obtained from the analysis of electrosensory images, neurophysiological data from the recording of unitary activity in the electrosensory lobe, and psychophysical data from analysis of novelty responses provoked in well-defined stimulus conditions, which all confirm that active electroreception has a short range, and that the influence of exploratory movements on object identification is strong. In active electric images two components can be identified: a "global" image profile depending on the volume, shape and global impedance of an object and a "texture" component depending on its surface attributes. There is a short range of the active electric sense and the progressive "blurring" of object image with distance. Consequently, the lack of precision regarding object location, considered together, challenge the current view of this sense as serving long range electrolocation and the commonly used metaphor of "electric vision". In fact, the active electric sense shares more commonalities with human active touch than with teleceptive senses as vision or audition. Taking into account that other skin exteroceptors and proprioception may be congruently stimulated during fish exploratory movements we propose that electric, mechanoceptive and proprioceptive sensory modalities found in electric fish could be considered together as a single haptic sensory system. This article is part of a Special Issue entitled Neural Coding 2012.

Mind the gap: the minimal detectable separation distance between two objects during active electrolocation

In a food-rewarded two-alternative forced-choice procedure, it was determined how well the weakly electric elephantnose fish Gnathonemus petersii can sense gaps between two objects, some of which were placed in front of complex backgrounds. The results show that at close distances, G. petersii is able to detect gaps between two small metal cubes (2 cm × 2 cm × 2 cm) down to a width of c. 1·5 mm. When larger objects (3 cm × 3 cm × 3 cm) were used, gaps with a width of 2-3 mm could still be detected. Discrimination performance was better (c. 1 mm gap size) when the objects were placed in front of a moving background consisting of plastic stripes or plant leaves, indicating that movement in the environment plays an important role for object identification. In addition, the smallest gap size that could be detected at increasing distances was determined. A linear relationship between object distance and gap size existed. Minimal detectable gap sizes increased from c. 1·5 mm at a distance of 1 cm, to 20 mm at a distance of 7 cm. Measurements and simulations of the electric stimuli occurring during gap detection revealed that the electric images of two close objects influence each other and superimpose. A large gap of 20 mm between two objects induced two clearly separated peaks in the electric image, while a 2 mm gap caused just a slight indentation in the image. Therefore, the fusion of electric images limits spatial resolution during active electrolocation. Relative movements either between the fish and the objects or between object and background might improve spatial resolution by accentuating the fine details of the electric images.

From static electric images to electric flow: towards dynamic perceptual cues in active electroreception

Active electroreception is an ancestral trait found in many aquatic vertebrates and has evolved independently in two teleost lineages, the Gymnotiformes and the Mormyriformes. Unique to these so-called weakly electric fish is their ability to actively generate electrical currents in the water and sense the electrical properties of the environment. How natural behavior contributes to this sensory system has been of interest to neuroethologists since the pioneering works of Lissmann. Here we report on a mutual modeling and experimental study of the stimuli available during active electrolocation of Gnathonemus petersii (Mormyridae). We show the validity of the model (I) by demonstrating that localized spatial patterns of object induced modulations in the electric field (electric images) are comparable to experimentally mapped 2-dimensional electric images and (II) by replicating earlier key findings showing that a normalized metric of electric image width provides an unambiguous cue for distance estimation. We then show that electric images and the distance metric vary systematically when an object is moved along the trunk. These potential ambiguities with regard to localization lead us to a spatiotemporal analysis of electric images. We introduce a new temporal metric for distance estimation that is based on the normalized spatial properties of electrical images. Finally, based on a survey of exploratory behavior, we show how objects situated at the tail, a region previously neglected, cast global electric images that extend over the whole sensory epithelium of the animals.

Active electrolocation in pulse gymnotids: sensory consequences of objects’ mutual polarization

We examined non-linear effects of the presence of one object on the electric image of another placed at the foveal region in Gymnotus omarorum. The sensory consequences of object mutual polarization on electric images were also depicted using behavioral procedures. Image measurements show that objects whose electric image is not detectable may modify the electric image of another placed closer to the fish and suggest that detection range and discrimination parameters used for one object may be affected when the presence of others enriches the scene. Behavioral experiments confirm that these changes in object images resulting from mutual polarization may be exploited for improving perception. While conductive objects close to the skin allow the fish to detect other objects placed out of the active electrodetection range, non-conductive objects may hide objects that otherwise show clear electric images. This suggests that fish movements may orient the self-generated field to exploit object mutual polarization, increasing or decreasing the active electrolocation range. In addition, images of a nearby object may be modulated by the presence of another object placed outside the detection range and the corresponding behavioral responses suggest that a moving or impedance-changing context may modify a fish’s discrimination abilities for closer objects.