Parallel sparse and dense information coding streams in the electrosensory midbrain

Fractional order memcapacitive neuromorphic elements reproduce and predict neuronal function

There is an increasing need to implement neuromorphic systems that are both energetically and computationally efficient. There is also great interest in using electric elements with memory, memelements, that can implement complex neuronal functions intrinsically. A feature not widely incorporated in neuromorphic systems is history-dependent action potential time adaptation which is widely seen in real cells. Previous theoretical work shows that power-law history dependent spike time adaptation, seen in several brain areas and species, can be modeled with fractional order differential equations. Here, we show that fractional order spiking neurons can be implemented using super-capacitors. The super-capacitors have fractional order derivative and memcapacitive properties. We implemented two circuits, a leaky integrate and fire and a Hodgkin-Huxley. Both circuits show power-law spiking time adaptation and optimal coding properties. The spiking dynamics reproduced previously published computer simulations. However, the fractional order Hodgkin-Huxley circuit showed novel dynamics consistent with criticality. We compared the responses of this circuit to recordings from neurons in the weakly-electric fish that have previously been shown to perform fractional order differentiation of their sensory input. The criticality seen in the circuit was confirmed in spontaneous recordings in the live fish. Furthermore, the circuit also predicted long-lasting stimulation that was also corroborated experimentally. Our work shows that fractional order memcapacitors provide intrinsic memory dependence that could allow implementation of computationally efficient neuromorphic devices. Memcapacitors are static elements that consume less energy than the most widely studied memristors, thus allowing the realization of energetically efficient neuromorphic devices.

Population Coding of Natural Electrosensory Stimuli by Midbrain Neurons

Natural stimuli display spatiotemporal characteristics that typically vary over orders of magnitude, and their encoding by sensory neurons remains poorly understood. We investigated population coding of highly heterogeneous natural electrocommunication stimuli in Apteronotus leptorhynchus of either sex. Neuronal activities were positively correlated with one another in the absence of stimulation, and correlation magnitude decayed with increasing distance between recording sites. Under stimulation, we found that correlations between trial-averaged neuronal responses (i.e., signal correlations) were positive and higher in magnitude for neurons located close to another, but that correlations between the trial-to-trial variability (i.e., noise correlations) were independent of physical distance. Overall, signal and noise correlations were independent of stimulus waveform as well as of one another. To investigate how neuronal populations encoded natural electrocommunication stimuli, we considered a nonlinear decoder for which the activities were combined. Decoding performance was best for a timescale of 6 ms, indicating that midbrain neurons transmit information via precise spike timing. A simple summation of neuronal activities (equally weighted sum) revealed that noise correlations limited decoding performance by introducing redundancy. Using an evolution algorithm to optimize performance when considering instead unequally weighted sums of neuronal activities revealed much greater performance values, indicating that midbrain neuron populations transmit information that reliably enable discrimination between different stimulus waveforms. Interestingly, we found that different weight combinations gave rise to similar discriminability, suggesting robustness. Our results have important implications for understanding how natural stimuli are integrated by downstream brain areas to give rise to behavioral responses.SIGNIFICANCE STATEMENT We show that midbrain electrosensory neurons display correlations between their activities and that these can significantly impact performance of decoders. While noise correlations limited discrimination performance by introducing redundancy, considering unequally weighted sums of neuronal activities gave rise to much improved performance and mitigated the deleterious effects of noise correlations. Further analysis revealed that increased discriminability was achieved by making trial-averaged responses more separable, as well as by reducing trial-to-trial variability by eliminating noise correlations. We further found that multiple combinations of weights could give rise to similar discrimination performances, which suggests that such combinatorial codes could be achieved in the brain. We conclude that the activities of midbrain neuronal populations can be used to reliably discriminate between highly heterogeneous stimulus waveforms.

Lower Baseline Variability Gives Rise to Lower Detection Thresholds in Midbrain than Hindbrain Electrosensory Neurons

Understanding how the brain decodes sensory information to give rise to behaviour remains an important problem in systems neuroscience. Across various sensory modalities (e.g. auditory, visual), the time-varying contrast of natural stimuli has been shown to carry behaviourally relevant information. However, it is unclear how such information is actually decoded by the brain to evoke perception and behaviour. Here we investigated how midbrain electrosensory neurons respond to weak contrasts in the electrosensory system of the weakly electric fish Apteronotus leptorhynchus. We found that these neurons displayed lower detection thresholds than their afferent hindbrain electrosensory neurons. Further analysis revealed that the lower detection thresholds of midbrain neurons were not due to increased sensitivity to the stimulus. Rather, these were due to the fact that midbrain neurons displayed lower variability in their firing activities in the absence of stimulation, which is due to lower firing rates. Our results suggest that midbrain neurons play an active role towards enabling the detection of weak stimulus contrasts, which in turn leads to perception and behavioral responses.

Neural Synchrony Gives Rise to Amplitude- and Duration-Invariant Encoding Consistent With Perception of Natural Communication Stimuli

When confronted with a highly variable environment, it remains poorly understood how neural populations encode and classify natural stimuli to give rise to appropriate and consistent behavioral responses. Here we investigated population coding of natural communication signals with different attributes (i.e., amplitude and duration) in the electrosensory system of the weakly electric fish Apteronotus leptorhynchus. Our results show that, while single peripheral neurons encode the detailed timecourse of different stimulus waveforms, measures of population synchrony are effectively unchanged because of coordinated increases and decreases in activity. A phenomenological mathematical model reproduced this invariance and shows that this can be explained by considering homogeneous populations whose responses are solely determined by single neuron firing properties. Moreover, recordings from downstream central neurons reveal that synchronous afferent activity is actually decoded and thus most likely transmitted to higher brain areas. Finally, we demonstrate that the associated behavioral responses at the organism level are invariant. Our results provide a mechanism by which amplitude- and duration-invariant coding of behaviorally relevant sensory input emerges across successive brain areas thereby presumably giving rise to invariant behavioral responses. Such mechanisms are likely to be found in other systems that share anatomical and functional features with the electrosensory system (e.g., auditory, visual, vestibular).

Novel Functions of Feedback in Electrosensory Processing

Environmental signals act as input and are processed across successive stages in the brain to generate a meaningful behavioral output. However, a ubiquitous observation is that descending feedback projections from more central to more peripheral brain areas vastly outnumber ascending feedforward projections. Such projections generally act to modify how sensory neurons respond to afferent signals. Recent studies in the electrosensory system of weakly electric fish have revealed novel functions for feedback pathways in that their transformation of the afferent input generates neural firing rate responses to sensory signals mediating perception and behavior. In this review, we focus on summarizing these novel and recently uncovered functions and put them into context by describing the more "classical" functions of feedback in the electrosensory system. We further highlight the parallels between the electrosensory system and other systems as well as outline interesting future directions.

Encoding and Perception of Electro-communication Signals in Apteronotus leptorhynchus

Animal communication plays an essential role in triggering diverse behaviors. It is believed in this regard that signal production by a sender and its perception by a receiver is co-evolving in order to have beneficial effects such as to ensure that conspecifics remain sensitive to these signals. However, in order to give appropriate responses to a communication signal, the receiver has to first detect and interpret it in a meaningful way. The detection of communication signals can be limited under some circumstances, for example when the signal is masked by the background noise in which it occurs (e.g., the cocktail-party problem). Moreover, some signals are very alike despite having different meanings making it hard to discriminate between them. How the central nervous system copes with these tasks and problems is a central question in systems neuroscience. Gymnotiform weakly electric fish pose an interesting system to answer these questions for various reasons: (1) they use a variety of communication signals called “chirps” during different behavioral encounters; (2) the central physiology of the electrosensory system is well known; and (3) most importantly, these fish give reliable behavioral responses to artificial stimuli that resemble natural communication signals, making it possible to uncover the neural mechanisms that lead to the observed behaviors.

Population Coding and Correlated Variability in Electrosensory Pathways

The fact that perception and behavior depend on the simultaneous and coordinated activity of neural populations is well established. Understanding encoding through neuronal population activity is however complicated by the statistical dependencies between the activities of neurons, which can be present in terms of both their mean (signal correlations) and their response variability (noise correlations). Here, we review the state of knowledge regarding population coding and the influence of correlated variability in the electrosensory pathways of the weakly electric fish Apteronotus leptorhynchus. We summarize known population coding strategies at the peripheral level, which are largely unaffected by noise correlations. We then move on to the hindbrain, where existing data from the electrosensory lateral line lobe (ELL) shows the presence of noise correlations. We summarize the current knowledge regarding the mechanistic origins of noise correlations and known mechanisms of stimulus dependent correlation shaping in ELL. We finish by considering future directions for understanding population coding in the electrosensory pathways of weakly electric fish, highlighting the benefits of this model system for understanding the origins and impact of noise correlations on population coding.

Optimal dynamic coding by mixed-dimensionality neurons in the head-direction system of bats

Ethologically relevant stimuli are often multidimensional. In many brain systems, neurons with “pure” tuning to one stimulus dimension are found along with “conjunctive” neurons that encode several dimensions, forming an apparently redundant representation. Here we show using theoretical analysis that a mixed-dimensionality code can efficiently represent a stimulus in different behavioral regimes: encoding by conjunctive cells is more robust when the stimulus changes quickly, whereas on long timescales pure cells represent the stimulus more efficiently with fewer neurons. We tested our predictions experimentally in the bat head-direction system and found that many head-direction cells switched their tuning dynamically from pure to conjunctive representation as a function of angular velocity—confirming our theoretical prediction. More broadly, our results suggest that optimal dimensionality depends on population size and on the time available for decoding—which might explain why mixed-dimensionality representations are common in sensory, motor, and higher cognitive systems across species.

Multidimensional stimuli are often represented by neurons encoding only a single dimension and those encoding multiple dimensions. Here, the authors present theoretical and experimental analyses to show that mixed representations are optimal to efficiently encode such stimuli under different behavioral modes.

Weakly electric fish distinguish between envelope stimuli arising from different behavioral contexts

Understanding how sensory information is processed by the brain in order to give rise to behavior remains poorly understood in general. Here, we investigated the behavioral responses of the weakly electric fish Apteronotus albifrons to stimuli arising from different contexts, by measuring changes in the electric organ discharge (EOD) frequency. Specifically, we focused on envelopes, which can arise either because of movement (i.e. motion envelopes) or because of interactions between the electric fields of three of more fish (i.e. social envelopes). Overall, we found that the animal's EOD frequency effectively tracked the detailed time course of both motion and social envelopes. In general, behavioral sensitivity (i.e. gain) decreased while phase lag increased with increasing envelope and carrier frequency. However, changes in gain and phase lag as a function of changes in carrier frequency were more prominent for motion than for social envelopes in general. Importantly, we compared behavioral responses to motion and social envelopes with similar characteristics. Although behavioral sensitivities were similar, we observed an increased response lag for social envelopes, primarily for low carrier frequencies. Thus, our results imply that the organism can, based on behavioral responses, distinguish envelope stimuli resulting from movement from those that instead result from social interactions. We discuss the implications of our results for neural coding of envelopes and propose that behavioral responses to motion and social envelopes are mediated by different neural circuits in the brain.

Descending pathways generate perception of and neural responses to weak sensory input

Natural sensory stimuli frequently consist of a fast time-varying waveform whose amplitude or contrast varies more slowly. While changes in contrast carry behaviorally relevant information necessary for sensory perception, their processing by the brain remains poorly understood to this day. Here, we investigated the mechanisms that enable neural responses to and perception of low-contrast stimuli in the electrosensory system of the weakly electric fish Apteronotus leptorhynchus. We found that fish reliably detected such stimuli via robust behavioral responses. Recordings from peripheral electrosensory neurons revealed stimulus-induced changes in firing activity (i.e., phase locking) but not in their overall firing rate. However, central electrosensory neurons receiving input from the periphery responded robustly via both phase locking and increases in firing rate. Pharmacological inactivation of feedback input onto central electrosensory neurons eliminated increases in firing rate but did not affect phase locking for central electrosensory neurons in response to low-contrast stimuli. As feedback inactivation eliminated behavioral responses to these stimuli as well, our results show that it is changes in central electrosensory neuron firing rate that are relevant for behavior, rather than phase locking. Finally, recordings from neurons projecting directly via feedback to central electrosensory neurons revealed that they provide the necessary input to cause increases in firing rate. Our results thus provide the first experimental evidence that feedback generates both neural and behavioral responses to low-contrast stimuli that are commonly found in the natural environment.

Feedback input from more central to more peripheral brain areas is found ubiquitously in the central nervous system of vertebrates. In this study, we used a combination of electrophysiological, behavioral, and pharmacological approaches to reveal a novel function for feedback pathways in generating neural and behavioral responses to weak sensory input in the weakly electric fish. We first determined that weak sensory input gives rise to responses that are phase locked in both peripheral sensory neurons and in the central neurons that are their downstream targets. However, central neurons also responded to weak sensory inputs that were not relayed via a feedforward input from the periphery, because complete inactivation of the feedback pathway abolished increases in firing rate but not the phase locking in response to weak sensory input. Because such inactivation also abolished the behavioral responses, our results show that the increases in firing rate in central neurons, and not the phase locking, are decoded downstream to give rise to perception. Finally, we discovered that the neurons providing feedback input were also activated by weak sensory input, thereby offering further evidence that feedback is necessary to elicit increases in firing rate that are needed for perception.

Optimized Parallel Coding of Second-Order Stimulus Features by Heterogeneous Neural Populations

Efficient processing of sensory input is essential to ensure an organism's survival in its natural environment. Growing evidence suggests that sensory neurons can optimally encode natural stimuli by ensuring that their tuning opposes stimulus statistics, such that the resulting neuronal response contains equal power at all frequencies (i.e., is "white"). Such temporal decorrelation or whitening has been observed across modalities, but the effects of neural heterogeneities on determining tuning and thus responses to natural stimuli have not been investigated. Here, we investigate how heterogeneities in sensory pyramidal neurons organized in three parallel maps representing the body surface determine responses to second-order electrosensory stimulus features in the weakly electric fish Apteronotus leptorhynchus While some sources of heterogeneities such as ON- and OFF-type responses to first-order did not affect responses to second-order electrosensory stimulus features, other sources of heterogeneity within and across the maps strongly determined responses. We found that these cells effectively performed a fractional differentiation operation on their input with exponents ranging from zero (no differentiation) to 0.4 (strong differentiation). Varying adaptation in a simple model explained these heterogeneities and predicted a strong correlation between fractional differentiation and adaptation. Using natural stimuli, we found that only a small fraction of neurons implemented temporal whitening. Rather, a large fraction of neurons did not perform any significant whitening and thus preserved natural input statistics in their responses. We propose that this information is needed to properly decode optimized information sent in parallel through temporally whitened responses based on context.

SIGNIFICANCE STATEMENT

We demonstrate that heterogeneities in the same sensory neuron type can either have no or significant influence on their responses to second-order stimulus features. While an ON- or OFF-type response to first-order stimulus attributes has no significant influence on responses to second-order stimulus features, we found that only a small fraction of sensory neurons optimally encoded natural stimuli through high-pass filtering, thereby implementing temporal whitening. Surprisingly, a large fraction of sensory neurons performed little if no filtering of stimuli, thereby preserving natural stimulus statistics. We hypothesize that this pathway is necessary to properly decode optimized information contained in temporally whitened responses based on context.

Electrosensory neural responses to natural electro-communication stimuli are distributed along a continuum

Neural heterogeneities are seen ubiquitously within the brain and greatly complicate classification efforts. Here we tested whether the responses of an anatomically well-characterized sensory neuron population to natural stimuli could be used for functional classification. To do so, we recorded from pyramidal cells within the electrosensory lateral line lobe (ELL) of the weakly electric fish Apteronotus leptorhynchus in response to natural electro-communication stimuli as these cells can be anatomically classified into six different types. We then used two independent methodologies to functionally classify responses: one relies of reducing the dimensionality of a feature space while the other directly compares the responses themselves. Both methodologies gave rise to qualitatively similar results: while ON and OFF-type cells could easily be distinguished from one another, ELL pyramidal neuron responses are actually distributed along a continuum rather than forming distinct clusters due to heterogeneities. We discuss the implications of our results for neural coding and highlight some potential advantages.

Burst Firing in the Electrosensory System of Gymnotiform Weakly Electric Fish: Mechanisms and Functional Roles

Neurons across sensory systems and organisms often display complex patterns of action potentials in response to sensory input. One example of such a pattern is the tendency of neurons to fire packets of action potentials (i.e., a burst) followed by quiescence. While it is well known that multiple mechanisms can generate bursts of action potentials at both the single-neuron and the network level, the functional role of burst firing in sensory processing is not so well understood to date. Here we provide a comprehensive review of the known mechanisms and functions of burst firing in processing of electrosensory stimuli in gymnotiform weakly electric fish. We also present new evidence from existing data showing that bursts and isolated spikes provide distinct information about stimulus variance. It is likely that these functional roles will be generally applicable to other systems and species.

Adaptation to second order stimulus features by electrosensory neurons causes ambiguity

Understanding the coding strategies used to process sensory input remains a central problem in neuroscience. Growing evidence suggests that sensory systems process natural stimuli efficiently by ensuring a close match between neural tuning and stimulus statistics through adaptation. However, adaptation causes ambiguity as the same response can be elicited by different stimuli. The mechanisms by which the brain resolves ambiguity remain poorly understood. Here we investigated adaptation in electrosensory pyramidal neurons within different parallel maps in the weakly electric fish Apteronotus leptorhynchus. In response to step increases in stimulus variance, we found that pyramidal neurons within the lateral segment (LS) displayed strong scale invariant adaptation whereas those within the centromedial segment (CMS) instead displayed weaker degrees of scale invariant adaptation. Signal detection analysis revealed that strong adaptation in LS neurons significantly reduced stimulus discriminability. In contrast, weaker adaptation displayed by CMS neurons led to significantly lesser impairment of discriminability. Thus, while LS neurons display adaptation that is matched to natural scene statistics, thereby optimizing information transmission, CMS neurons instead display weaker adaptation and would instead provide information about the context in which these statistics occur. We propose that such a scheme is necessary for decoding by higher brain structures.

Neural correlations enable invariant coding and perception of natural stimuli in weakly electric fish

Neural representations of behaviorally relevant stimulus features displaying invariance with respect to different contexts are essential for perception. However, the mechanisms mediating their emergence and subsequent refinement remain poorly understood in general. Here, we demonstrate that correlated neural activity allows for the emergence of an invariant representation of natural communication stimuli that is further refined across successive stages of processing in the weakly electric fish Apteronotus leptorhynchus. Importantly, different patterns of input resulting from the same natural communication stimulus occurring in different contexts all gave rise to similar behavioral responses. Our results thus reveal how a generic neural circuit performs an elegant computation that mediates the emergence and refinement of an invariant neural representation of natural stimuli that most likely constitutes a neural correlate of perception.

DOI:http://dx.doi.org/10.7554/eLife.12993.001

We can effortlessly recognize an object – a car, for example – in many different contexts such as when seen from behind, under different lighting levels or even from different viewpoints. This phenomenon is known as perceptual invariance: objects are correctly recognized, despite variations in exactly what is seen (or otherwise sensed). However, it is still not clear how the brain processes perceptual information to recognize the same object under a wide variety of contexts.

Some fish, such as the brown ghost knifefish, produce a weak electric signal that they can alter to communicate with other members of their species. A communication call may be produced in a variety of contexts that alter which aspects of the signal nearby fish detect. Despite this, fish tend to respond to a given communication call in the same way regardless of its context; this suggests that these fish also have perceptual invariance.

The communication calls of weakly electric fish can be easily mimicked in a laboratory and produce reliable behavioral responses, which makes these fish a good model for understanding how perceptual invariance might be coded in the brain. Therefore, Metzen et al. recorded the activity of the receptor neurons that first respond to communication calls in weakly electric fish. The results revealed that a given communication signal made the firing patterns of all receptor neurons in the fish’s brain more similar to each other, regardless of the signal’s context. This occurs despite the changes in context causing single receptor neurons to respond in different ways. At each stage of the process by which information is transmitted from the receptor neurons to neurons deeper in the brain, the similarity in the neurons’ firing patterns is refined, thereby giving rise to perceptual invariance.

While perceptual invariance to a given object in different contexts is desirable, it is also important to be able to distinguish between different objects. This implies that neurons should respond similarly to stimuli associated with the same object and differently to stimuli associated with different objects. Further studies are now needed to confirm whether this is the case.

DOI:http://dx.doi.org/10.7554/eLife.12993.002