Learning contrast-invariant cancellation of redundant signals in neural systems

Sensorimotor adaptation to destabilizing dynamics in weakly electric fish

Humans and other animals can readily learn to compensate for changes in the dynamics of movement. Such changes can result from an injury or changes in the weight of carried objects. These changes in dynamics can lead not only to reduced performance but also to dramatic instabilities. We evaluated the impacts of compensatory changes in control policies in relation to stability and robustness in Eigenmannia virescens, a species of weakly electric fish. We discovered that these fish retune their sensorimotor control system in response to experimentally generated destabilizing dynamics. Specifically, we used an augmented reality system to manipulate sensory feedback during an image stabilization task in which a fish maintained its position within a refuge. The augmented reality system measured the fish's movements in real time. These movements were passed through a high-pass filter and multiplied by a gain factor before being fed back to the refuge motion. We adjusted the gain factor to gradually destabilize the fish's sensorimotor loop. The fish retuned their sensorimotor control system to compensate for the experimentally induced destabilizing dynamics. This retuning was partially maintained when the augmented reality feedback was abruptly removed. The compensatory changes in sensorimotor control improved tracking performance as well as control-theoretic measures of robustness, including reduced sensitivity to disturbances and improved phase margins.

Fractional order memcapacitive neuromorphic elements reproduce and predict neuronal function

There is an increasing need to implement neuromorphic systems that are both energetically and computationally efficient. There is also great interest in using electric elements with memory, memelements, that can implement complex neuronal functions intrinsically. A feature not widely incorporated in neuromorphic systems is history-dependent action potential time adaptation which is widely seen in real cells. Previous theoretical work shows that power-law history dependent spike time adaptation, seen in several brain areas and species, can be modeled with fractional order differential equations. Here, we show that fractional order spiking neurons can be implemented using super-capacitors. The super-capacitors have fractional order derivative and memcapacitive properties. We implemented two circuits, a leaky integrate and fire and a Hodgkin-Huxley. Both circuits show power-law spiking time adaptation and optimal coding properties. The spiking dynamics reproduced previously published computer simulations. However, the fractional order Hodgkin-Huxley circuit showed novel dynamics consistent with criticality. We compared the responses of this circuit to recordings from neurons in the weakly-electric fish that have previously been shown to perform fractional order differentiation of their sensory input. The criticality seen in the circuit was confirmed in spontaneous recordings in the live fish. Furthermore, the circuit also predicted long-lasting stimulation that was also corroborated experimentally. Our work shows that fractional order memcapacitors provide intrinsic memory dependence that could allow implementation of computationally efficient neuromorphic devices. Memcapacitors are static elements that consume less energy than the most widely studied memristors, thus allowing the realization of energetically efficient neuromorphic devices.

Silences, spikes and bursts: Three-part knot of the neural code

When a neuron breaks silence, it can emit action potentials in a number of patterns. Some responses are so sudden and intense that electrophysiologists felt the need to single them out, labelling action potentials emitted at a particularly high frequency with a metonym - bursts. Is there more to bursts than a figure of speech? After all, sudden bouts of high-frequency firing are expected to occur whenever inputs surge. The burst coding hypothesis advances that the neural code has three syllables: silences, spikes and bursts. We review evidence supporting this ternary code in terms of devoted mechanisms for burst generation, synaptic transmission and synaptic plasticity. We also review the learning and attention theories for which such a triad is beneficial.

Descending pathways increase sensory neural response heterogeneity to facilitate decoding and behavior

The functional role of heterogeneous spiking responses of otherwise similarly tuned neurons to stimulation, which has been observed ubiquitously, remains unclear to date. Here, we demonstrate that such response heterogeneity serves a beneficial function that is used by downstream brain areas to generate behavioral responses that follows the detailed timecourse of the stimulus. Multi-unit recordings from sensory pyramidal cells within the electrosensory system of Apteronotus leptorhynchus were performed and revealed highly heterogeneous responses that were similar for all cell types. By comparing the coding properties of a given neural population before and after inactivation of descending pathways, we found that heterogeneities were beneficial as decoding was then more robust to the addition of noise. Taken together, our results not only reveal that descending pathways actively promote response heterogeneity within a given cell type, but also uncover a beneficial function for such heterogeneity that is used by the brain to generate behavior.

The voltage and spiking responses of subthreshold resonant neurons to structured and fluctuating inputs: persistence and loss of resonance and variability

We systematically investigate the response of neurons to oscillatory currents and synaptic-like inputs and we extend our investigation to non-structured synaptic-like spiking inputs with more realistic distributions of presynaptic spike times. We use two types of chirp-like inputs consisting of (i) a sequence of cycles with discretely increasing frequencies over time, and (ii) a sequence having the same cycles arranged in an arbitrary order. We develop and use a number of frequency-dependent voltage response metrics to capture the different aspects of the voltage response, including the standard impedance (Z) and the peak-to-trough amplitude envelope ([Formula: see text]) profiles. We show that Z-resonant cells (cells that exhibit subthreshold resonance in response to sinusoidal inputs) also show [Formula: see text]-resonance in response to sinusoidal inputs, but generally do not (or do it very mildly) in response to square-wave and synaptic-like inputs. In the latter cases the resonant response using Z is not predictive of the preferred frequencies at which the neurons spike when the input amplitude is increased above subthreshold levels. We also show that responses to conductance-based synaptic-like inputs are attenuated as compared to the response to current-based synaptic-like inputs, thus providing an explanation to previous experimental results. These response patterns were strongly dependent on the intrinsic properties of the participating neurons, in particular whether the unperturbed Z-resonant cells had a stable node or a focus. In addition, we show that variability emerges in response to chirp-like inputs with arbitrarily ordered patterns where all signals (trials) in a given protocol have the same frequency content and the only source of uncertainty is the subset of all possible permutations of cycles chosen for a given protocol. This variability is the result of the multiple different ways in which the autonomous transient dynamics is activated across cycles in each signal (different cycle orderings) and across trials. We extend our results to include high-rate Poisson distributed current- and conductance-based synaptic inputs and compare them with similar results using additive Gaussian white noise. We show that the responses to both Poisson-distributed synaptic inputs are attenuated with respect to the responses to Gaussian white noise. For cells that exhibit oscillatory responses to Gaussian white noise (band-pass filters), the response to conductance-based synaptic inputs are low-pass filters, while the response to current-based synaptic inputs may remain band-pass filters, consistent with experimental findings. Our results shed light on the mechanisms of communication of oscillatory activity among neurons in a network via subthreshold oscillations and resonance and the generation of network resonance.

Statistical Analysis of Decoding Performances of Diverse Populations of Neurons

A central theme in computational neuroscience is determining the neural correlates of efficient and accurate coding of sensory signals. Diversity, or heterogeneity, of intrinsic neural attributes is known to exist in many brain areas and is thought to significantly affect neural coding. Recent theoretical and experimental work has argued that in uncoupled networks, coding is most accurate at intermediate levels of heterogeneity. Here we consider this question with data from in vivo recordings of neurons in the electrosensory system of weakly electric fish subject to the same realization of noisy stimuli; we use a generalized linear model (GLM) to assess the accuracy of (Bayesian) decoding of stimulus given a population spiking response. The long recordings enable us to consider many uncoupled networks and a relatively wide range of heterogeneity, as well as many instances of the stimuli, thus enabling us to address this question with statistical power. The GLM decoding is performed on a single long time series of data to mimic realistic conditions rather than using trial-averaged data for better model fits. For a variety of fixed network sizes, we generally find that the optimal levels of heterogeneity are at intermediate values, and this holds in all core components of GLM. These results are robust to several measures of decoding performance, including the absolute value of the error, error weighted by the uncertainty of the estimated stimulus, and the correlation between the actual and estimated stimulus. Although a quadratic fit to decoding performance as a function of heterogeneity is statistically significant, the result is highly variable with low R2 values. Taken together, intermediate levels of neural heterogeneity are indeed a prominent attribute for efficient coding even within a single time series, but the performance is highly variable.

Neuronal On- and Off-type heterogeneities improve population coding of envelope signals in the presence of stimulus-induced noise

Understanding the mechanisms by which neuronal population activity gives rise to perception and behavior remains a central question in systems neuroscience. Such understanding is complicated by the fact that natural stimuli often have complex structure. Here we investigated how heterogeneities within a sensory neuron population influence the coding of a noisy stimulus waveform (i.e., the noise) and its behaviorally relevant envelope signal (i.e., the signal). We found that On- and Off-type neurons displayed more heterogeneities in their responses to the noise than in their responses to the signal. These differences in heterogeneities had important consequences when quantifying response similarity between pairs of neurons. Indeed, the larger response heterogeneity displayed by On- and Off-type neurons made their pairwise responses to the noise on average more independent than when instead considering pairs of On-type or Off-type neurons. Such relative independence allowed for better averaging out of the noise response when pooling neural activities in a mixed-type (i.e., On- and Off-type) than for same-type (i.e., only On-type or only Off-type), thereby leading to greater information transmission about the signal. Our results thus reveal a function for the combined activities of On- and Off-type neurons towards improving information transmission of envelope stimuli at the population level. Our results will likely generalize because natural stimuli across modalities are characterized by a stimulus waveform whose envelope varies independently as well as because On- and Off-type neurons are observed across systems and species.

Novel Functions of Feedback in Electrosensory Processing

Environmental signals act as input and are processed across successive stages in the brain to generate a meaningful behavioral output. However, a ubiquitous observation is that descending feedback projections from more central to more peripheral brain areas vastly outnumber ascending feedforward projections. Such projections generally act to modify how sensory neurons respond to afferent signals. Recent studies in the electrosensory system of weakly electric fish have revealed novel functions for feedback pathways in that their transformation of the afferent input generates neural firing rate responses to sensory signals mediating perception and behavior. In this review, we focus on summarizing these novel and recently uncovered functions and put them into context by describing the more "classical" functions of feedback in the electrosensory system. We further highlight the parallels between the electrosensory system and other systems as well as outline interesting future directions.

Learning to generalize

Electric fish are able to take what they have learnt about sensory processing in certain situations and apply it in other situations.

Generalization of learned responses in the mormyrid electrosensory lobe

Appropriate generalization of learned responses to new situations is vital for adaptive behavior. We provide a circuit-level account of generalization in the electrosensory lobe (ELL) of weakly electric mormyrid fish. Much is already known in this system about a form of learning in which motor corollary discharge signals cancel responses to the uninformative input evoked by the fish's own electric pulses. However, for this cancellation to be useful under natural circumstances, it must generalize accurately across behavioral regimes, specifically different electric pulse rates. We show that such generalization indeed occurs in ELL neurons, and develop a circuit-level model explaining how this may be achieved. The mechanism involves regularized synaptic plasticity and an approximate matching of the temporal dynamics of motor corollary discharge and electrosensory inputs. Recordings of motor corollary discharge signals in mossy fibers and granule cells provide direct evidence for such matching.

Feedback optimizes neural coding and perception of natural stimuli

Growing evidence suggests that sensory neurons achieve optimal encoding by matching their tuning properties to the natural stimulus statistics. However, the underlying mechanisms remain unclear. Here we demonstrate that feedback pathways from higher brain areas mediate optimized encoding of naturalistic stimuli via temporal whitening in the weakly electric fish Apteronotus leptorhynchus. While one source of direct feedback uniformly enhances neural responses, a separate source of indirect feedback selectively attenuates responses to low frequencies, thus creating a high-pass neural tuning curve that opposes the decaying spectral power of natural stimuli. Additionally, we recorded from two populations of higher brain neurons responsible for the direct and indirect descending inputs. While one population displayed broadband tuning, the other displayed high-pass tuning and thus performed temporal whitening. Hence, our results demonstrate a novel function for descending input in optimizing neural responses to sensory input through temporal whitening that is likely to be conserved across systems and species.

Descending pathways generate perception of and neural responses to weak sensory input

Natural sensory stimuli frequently consist of a fast time-varying waveform whose amplitude or contrast varies more slowly. While changes in contrast carry behaviorally relevant information necessary for sensory perception, their processing by the brain remains poorly understood to this day. Here, we investigated the mechanisms that enable neural responses to and perception of low-contrast stimuli in the electrosensory system of the weakly electric fish Apteronotus leptorhynchus. We found that fish reliably detected such stimuli via robust behavioral responses. Recordings from peripheral electrosensory neurons revealed stimulus-induced changes in firing activity (i.e., phase locking) but not in their overall firing rate. However, central electrosensory neurons receiving input from the periphery responded robustly via both phase locking and increases in firing rate. Pharmacological inactivation of feedback input onto central electrosensory neurons eliminated increases in firing rate but did not affect phase locking for central electrosensory neurons in response to low-contrast stimuli. As feedback inactivation eliminated behavioral responses to these stimuli as well, our results show that it is changes in central electrosensory neuron firing rate that are relevant for behavior, rather than phase locking. Finally, recordings from neurons projecting directly via feedback to central electrosensory neurons revealed that they provide the necessary input to cause increases in firing rate. Our results thus provide the first experimental evidence that feedback generates both neural and behavioral responses to low-contrast stimuli that are commonly found in the natural environment.

Feedback input from more central to more peripheral brain areas is found ubiquitously in the central nervous system of vertebrates. In this study, we used a combination of electrophysiological, behavioral, and pharmacological approaches to reveal a novel function for feedback pathways in generating neural and behavioral responses to weak sensory input in the weakly electric fish. We first determined that weak sensory input gives rise to responses that are phase locked in both peripheral sensory neurons and in the central neurons that are their downstream targets. However, central neurons also responded to weak sensory inputs that were not relayed via a feedforward input from the periphery, because complete inactivation of the feedback pathway abolished increases in firing rate but not the phase locking in response to weak sensory input. Because such inactivation also abolished the behavioral responses, our results show that the increases in firing rate in central neurons, and not the phase locking, are decoded downstream to give rise to perception. Finally, we discovered that the neurons providing feedback input were also activated by weak sensory input, thereby offering further evidence that feedback is necessary to elicit increases in firing rate that are needed for perception.

Serotonin Selectively Increases Detectability of Motion Stimuli in the Electrosensory System

Serotonergic innervation of sensory areas is found ubiquitously across the central nervous system of vertebrates. Here, we used a system's level approach to investigate the role of serotonin on processing motion stimuli in the electrosensory system of the weakly electric fish Apteronotus albifrons. We found that exogenous serotonin application increased the firing activity of pyramidal neural responses to both looming and receding motion. Separating spikes belonging to bursts from those that were isolated revealed that this effect was primarily due to increased burst firing. Moreover, when investigating whether firing activity during stimulation could be discriminated from baseline (i.e., in the absence of stimulation), we found that serotonin increased stimulus discriminability only for some stimuli. This is because increased burst firing was most prominent for these. Further, the effects of serotonin were highly heterogeneous, with some neurons displaying large while others instead displaying minimal changes in responsiveness following serotonin application. Further analysis revealed that serotonin application had the greatest effect on neurons with low baseline firing rates and little to no effect on neurons with high baseline firing rates. Finally, the effects of serotonin on sensory neuron responses were largely independent of object velocity. Our results therefore reveal a novel function for the serotonergic system in selectively enhancing discriminability for motion stimuli.

Electrosensory neural responses to natural electro-communication stimuli are distributed along a continuum

Neural heterogeneities are seen ubiquitously within the brain and greatly complicate classification efforts. Here we tested whether the responses of an anatomically well-characterized sensory neuron population to natural stimuli could be used for functional classification. To do so, we recorded from pyramidal cells within the electrosensory lateral line lobe (ELL) of the weakly electric fish Apteronotus leptorhynchus in response to natural electro-communication stimuli as these cells can be anatomically classified into six different types. We then used two independent methodologies to functionally classify responses: one relies of reducing the dimensionality of a feature space while the other directly compares the responses themselves. Both methodologies gave rise to qualitatively similar results: while ON and OFF-type cells could easily be distinguished from one another, ELL pyramidal neuron responses are actually distributed along a continuum rather than forming distinct clusters due to heterogeneities. We discuss the implications of our results for neural coding and highlight some potential advantages.

Adaptation to second order stimulus features by electrosensory neurons causes ambiguity

Understanding the coding strategies used to process sensory input remains a central problem in neuroscience. Growing evidence suggests that sensory systems process natural stimuli efficiently by ensuring a close match between neural tuning and stimulus statistics through adaptation. However, adaptation causes ambiguity as the same response can be elicited by different stimuli. The mechanisms by which the brain resolves ambiguity remain poorly understood. Here we investigated adaptation in electrosensory pyramidal neurons within different parallel maps in the weakly electric fish Apteronotus leptorhynchus. In response to step increases in stimulus variance, we found that pyramidal neurons within the lateral segment (LS) displayed strong scale invariant adaptation whereas those within the centromedial segment (CMS) instead displayed weaker degrees of scale invariant adaptation. Signal detection analysis revealed that strong adaptation in LS neurons significantly reduced stimulus discriminability. In contrast, weaker adaptation displayed by CMS neurons led to significantly lesser impairment of discriminability. Thus, while LS neurons display adaptation that is matched to natural scene statistics, thereby optimizing information transmission, CMS neurons instead display weaker adaptation and would instead provide information about the context in which these statistics occur. We propose that such a scheme is necessary for decoding by higher brain structures.

Subtractive, divisive and non-monotonic gain control in feedforward nets linearized by noise and delays

The control of input-to-output mappings, or gain control, is one of the main strategies used by neural networks for the processing and gating of information. Using a spiking neural network model, we studied the gain control induced by a form of inhibitory feedforward circuitry-also known as "open-loop feedback"-, which has been experimentally observed in a cerebellum-like structure in weakly electric fish. We found, both analytically and numerically, that this network displays three different regimes of gain control: subtractive, divisive, and non-monotonic. Subtractive gain control was obtained when noise is very low in the network. Also, it was possible to change from divisive to non-monotonic gain control by simply modulating the strength of the feedforward inhibition, which may be achieved via long-term synaptic plasticity. The particular case of divisive gain control has been previously observed in vivo in weakly electric fish. These gain control regimes were robust to the presence of temporal delays in the inhibitory feedforward pathway, which were found to linearize the input-to-output mappings (or f-I curves) via a novel variability-increasing mechanism. Our findings highlight the feedforward-induced gain control analyzed here as a highly versatile mechanism of information gating in the brain.