Dejittered spike-conditioned stimulus waveforms yield improved estimates of neuronal feature selectivity and spike-timing precision of sensory interneurons

An information theoretic method to resolve millisecond-scale spike timing precision in a comprehensive motor program

Sensory inputs in nervous systems are often encoded at the millisecond scale in a precise spike timing code. There is now growing evidence in behaviors ranging from slow breathing to rapid flight for the prevalence of precise timing encoding in motor systems. Despite this, we largely do not know at what scale timing matters in these circuits due to the difficulty of recording a complete set of spike-resolved motor signals and assessing spike timing precision for encoding continuous motor signals. We also do not know if the precision scale varies depending on the functional role of different motor units. We introduce a method to estimate spike timing precision in motor circuits using continuous MI estimation at increasing levels of added uniform noise. This method can assess spike timing precision at fine scales for encoding rich motor output variation. We demonstrate the advantages of this approach compared to a previously established discrete information theoretic method of assessing spike timing precision. We use this method to analyze the precision in a nearly complete, spike resolved recording of the 10 primary wing muscles control flight in an agile hawk moth, Manduca sexta. Tethered moths visually tracked a robotic flower producing a range of turning (yaw) torques. We know that all 10 muscles in this motor program encode the majority of information about yaw torque in spike timings, but we do not know whether individual muscles encode motor information at different levels of precision. We demonstrate that the scale of temporal precision in all motor units in this insect flight circuit is at the sub-millisecond or millisecond-scale, with variation in precision scale present between muscle types. This method can be applied broadly to estimate spike timing precision in sensory and motor circuits in both invertebrates and vertebrates.

Discovering Precise Temporal Patterns in Large-Scale Neural Recordings through Robust and Interpretable Time Warping

Though the temporal precision of neural computation has been studied intensively, a data-driven determination of this precision remains a fundamental challenge. Reproducible spike patterns may be obscured on single trials by uncontrolled temporal variability in behavior and cognition and may not be time locked to measurable signatures in behavior or local field potentials (LFP). To overcome these challenges, we describe a general-purpose time warping framework that reveals precise spike-time patterns in an unsupervised manner, even when these patterns are decoupled from behavior or are temporally stretched across single trials. We demonstrate this method across diverse systems: cued reaching in nonhuman primates, motor sequence production in rats, and olfaction in mice. This approach flexibly uncovers diverse dynamical firing patterns, including pulsatile responses to behavioral events, LFP-aligned oscillatory spiking, and even unanticipated patterns, such as 7 Hz oscillations in rat motor cortex that are not time locked to measured behaviors or LFP.

Invariant neural responses for sensory categories revealed by the time-varying information for communication calls

Although information theoretic approaches have been used extensively in the analysis of the neural code, they have yet to be used to describe how information is accumulated in time while sensory systems are categorizing dynamic sensory stimuli such as speech sounds or visual objects. Here, we present a novel method to estimate the cumulative information for stimuli or categories. We further define a time-varying categorical information index that, by comparing the information obtained for stimuli versus categories of these same stimuli, quantifies invariant neural representations. We use these methods to investigate the dynamic properties of avian cortical auditory neurons recorded in zebra finches that were listening to a large set of call stimuli sampled from the complete vocal repertoire of this species. We found that the time-varying rates carry 5 times more information than the mean firing rates even in the first 100 ms. We also found that cumulative information has slow time constants (100–600 ms) relative to the typical integration time of single neurons, reflecting the fact that the behaviorally informative features of auditory objects are time-varying sound patterns. When we correlated firing rates and information values, we found that average information correlates with average firing rate but that higher-rates found at the onset response yielded similar information values as the lower-rates found in the sustained response: the onset and sustained response of avian cortical auditory neurons provide similar levels of independent information about call identity and call-type. Finally, our information measures allowed us to rigorously define categorical neurons; these categorical neurons show a high degree of invariance for vocalizations within a call-type. Peak invariance is found around 150 ms after stimulus onset. Surprisingly, call-type invariant neurons were found in both primary and secondary avian auditory areas.

Just as the recognition of faces requires neural representations that are invariant to scale and rotation, the recognition of behaviorally relevant auditory objects, such as spoken words, requires neural representations that are invariant to the speaker uttering the word and to his or her location. Here, we used information theory to investigate the time course of the neural representation of bird communication calls and of behaviorally relevant categories of these same calls: the call-types of the bird’s repertoire. We found that neurons in both the primary and secondary avian auditory cortex exhibit invariant responses to call renditions within a call-type, suggestive of a potential role for extracting the meaning of these communication calls. We also found that time plays an important role: first, neural responses carry significantly more information when represented by temporal patterns calculated at the small time scale of 10 ms than when measured as average rates and, second, this information accumulates in a non-redundant fashion up to long integration times of 600 ms. This rich temporal neural representation is matched to the temporal richness found in the communication calls of this species.

Linear-nonlinear-time-warp-poisson models of neural activity

Prominent models of spike trains assume only one source of variability - stochastic (Poisson) spiking - when stimuli and behavior are fixed. However, spike trains may also reflect variability due to internal processes such as planning. For example, we can plan a movement at one point in time and execute it at some arbitrary later time. Neurons involved in planning may thus share an underlying time course that is not precisely locked to the actual movement. Here we combine the standard Linear-Nonlinear-Poisson (LNP) model with Dynamic Time Warping (DTW) to account for shared temporal variability. When applied to recordings from macaque premotor cortex, we find that time warping considerably improves predictions of neural activity. We suggest that such temporal variability is a widespread phenomenon in the brain which should be modeled.

Repair of Physiologic Time Series: Replacement of Anomalous Data Points to Preserve Fractal Exponents

Extraction of fractal exponents via the slope of the power spectrum is common in the analysis of many physiological time series. The fractal structure thus characterized is a manifestation of long-term correlations, for which the temporal order of the sample values is crucial. However, missing data points due to artifacts and dropouts are common in such data sets, which can seriously disrupt the computation of fractal parameters. We evaluated a number of methods for replacing missing data in time series to enable reliable extraction of the fractal exponent and make recommendations as to the preferred replacement method depending on the proportion of missing values and any a priori estimate of the fractal exponent.

How Invariant Feature Selectivity Is Achieved in Cortex

Parsing the visual scene into objects is paramount to survival. Yet, how this is accomplished by the nervous system remains largely unknown, even in the comparatively well understood visual system. It is especially unclear how detailed peripheral signal representations are transformed into the object-oriented representations that are independent of object position and are provided by the final stages of visual processing. This perspective discusses advances in computational algorithms for fitting large-scale models that make it possible to reconstruct the intermediate steps of visual processing based on neural responses to natural stimuli. In particular, it is now possible to characterize how different types of position invariance, such as local (also known as phase invariance) and more global, are interleaved with nonlinear operations to allow for coding of curved contours. Neurons in the mid-level visual area V4 exhibit selectivity to pairs of even- and odd-symmetric profiles along curved contours. Such pairing is reminiscent of the response properties of complex cells in the primary visual cortex (V1) and suggests specific ways in which V1 signals are transformed within subsequent visual cortical areas. These examples illustrate that large-scale models fitted to neural responses to natural stimuli can provide generative models of successive stages of sensory processing.

Spike timing precision changes with spike rate adaptation in the owl's auditory space map

Spike rate adaptation (SRA) is a continuing change of responsiveness to ongoing stimuli, which is ubiquitous across species and levels of sensory systems. Under SRA, auditory responses to constant stimuli change over time, relaxing toward a long-term rate often over multiple timescales. With more variable stimuli, SRA causes the dependence of spike rate on sound pressure level to shift toward the mean level of recent stimulus history. A model based on subtractive adaptation (Benda J, Hennig RM. J Comput Neurosci 24: 113-136, 2008) shows that changes in spike rate and level dependence are mechanistically linked. Space-specific neurons in the barn owl's midbrain, when recorded under ketamine-diazepam anesthesia, showed these classical characteristics of SRA, while at the same time exhibiting changes in spike timing precision. Abrupt level increases of sinusoidally amplitude-modulated (SAM) noise initially led to spiking at higher rates with lower temporal precision. Spike rate and precision relaxed toward their long-term values with a time course similar to SRA, results that were also replicated by the subtractive model. Stimuli whose amplitude modulations (AMs) were not synchronous across carrier frequency evoked spikes in response to stimulus envelopes of a particular shape, characterized by the spectrotemporal receptive field (STRF). Again, abrupt stimulus level changes initially disrupted the temporal precision of spiking, which then relaxed along with SRA. We suggest that shifts in latency associated with stimulus level changes may differ between carrier frequency bands and underlie decreased spike precision. Thus SRA is manifest not simply as a change in spike rate but also as a change in the temporal precision of spiking.

Spike-Triggered Covariance Analysis Reveals Phenomenological Diversity of Contrast Adaptation in the Retina

When visual contrast changes, retinal ganglion cells adapt by adjusting their sensitivity as well as their temporal filtering characteristics. The latter has classically been described by contrast-induced gain changes that depend on temporal frequency. Here, we explored a new perspective on contrast-induced changes in temporal filtering by using spike-triggered covariance analysis to extract multiple parallel temporal filters for individual ganglion cells. Based on multielectrode-array recordings from ganglion cells in the isolated salamander retina, we found that contrast adaptation of temporal filtering can largely be captured by contrast-invariant sets of filters with contrast-dependent weights. Moreover, differences among the ganglion cells in the filter sets and their contrast-dependent contributions allowed us to phenomenologically distinguish three types of filter changes. The first type is characterized by newly emerging features at higher contrast, which can be reproduced by computational models that contain response-triggered gain-control mechanisms. The second type follows from stronger adaptation in the Off pathway as compared to the On pathway in On-Off-type ganglion cells. Finally, we found that, in a subset of neurons, contrast-induced filter changes are governed by particularly strong spike-timing dynamics, in particular by pronounced stimulus-dependent latency shifts that can be observed in these cells. Together, our results show that the contrast dependence of temporal filtering in retinal ganglion cells has a multifaceted phenomenology and that a multi-filter analysis can provide a useful basis for capturing the underlying signal-processing dynamics.

Our sensory systems have to process stimuli under a wide range of environmental conditions. To cope with this challenge, the involved neurons adapt by adjusting their signal processing to the recently encountered intensity range. In the visual system, one finds, for example, that higher visual contrast leads to changes in how visual signals are temporally filtered, making signal processing faster and more band-pass-like at higher contrast. By analyzing signals from neurons in the retina of salamanders, we here found that these adaptation effects can be described by a fixed set of filters, independent of contrast, whose relative contributions change with contrast. Also, we found that different phenomena contribute to this adaptation. In particular, some cells change their relative sensitivity to light increments and light decrements, whereas other cells are influenced by a strong contrast-dependence of the exact timing of their responses. Our results show that contrast adaptation in the retina is not an entirely homogeneous phenomenon, and that models with multiple filters can help in characterizing sensory adaptation.

Dynamic alignment models for neural coding

Recently, there have been remarkable advances in modeling the relationships between the sensory environment, neuronal responses, and behavior. However, most models cannot encompass variable stimulus-response relationships such as varying response latencies and state or context dependence of the neural code. Here, we consider response modeling as a dynamic alignment problem and model stimulus and response jointly by a mixed pair hidden Markov model (MPH). In MPHs, multiple stimulus-response relationships (e.g., receptive fields) are represented by different states or groups of states in a Markov chain. Each stimulus-response relationship features temporal flexibility, allowing modeling of variable response latencies, including noisy ones. We derive algorithms for learning of MPH parameters and for inference of spike response probabilities. We show that some linear-nonlinear Poisson cascade (LNP) models are a special case of MPHs. We demonstrate the efficiency and usefulness of MPHs in simulations of both jittered and switching spike responses to white noise and natural stimuli. Furthermore, we apply MPHs to extracellular single and multi-unit data recorded in cortical brain areas of singing birds to showcase a novel method for estimating response lag distributions. MPHs allow simultaneous estimation of receptive fields, latency statistics, and hidden state dynamics and so can help to uncover complex stimulus response relationships that are subject to variable timing and involve diverse neural codes.

The brain computes using electrical discharges of nerve cells, so called spikes. Specific sensory stimuli, for instance, tones, often lead to specific spiking patterns. The same is true for behavior: specific motor actions are generated by specific spiking patterns. The relationship between neural activity and stimuli or motor actions can be difficult to infer, because of dynamic dependencies and hidden nonlinearities. For instance, in a freely behaving animal a neuron could exhibit variable levels of sensory and motor involvements depending on the state of the animal and on current motor plans—a situation that cannot be accounted for by many existing models. Here we present a new type of model that is specifically designed to cope with such changing regularities. We outline the mathematical framework and show, through computer simulations and application to recorded neural data, how MPHs can advance our understanding of stimulus-response relationships.

Computing loss of efficiency in optimal Bayesian decoders given noisy or incomplete spike trains

We investigate Bayesian methods for optimal decoding of noisy or incompletely-observed spike trains. Information about neural identity or temporal resolution may be lost during spike detection and sorting, or spike times measured near the soma may be corrupted with noise due to stochastic membrane channel effects in the axon. We focus on neural encoding models in which the (discrete) neural state evolves according to stimulus-dependent Markovian dynamics. Such models are sufficiently flexible that we may incorporate realistic stimulus encoding and spiking dynamics, but nonetheless permit exact computation via efficient hidden Markov model forward-backward methods. We analyze two types of signal degradation. First, we quantify the information lost due to jitter or downsampling in the spike-times. Second, we quantify the information lost when knowledge of the identities of different spiking neurons is corrupted. In each case the methods introduced here make it possible to quantify the dependence of the information loss on biophysical parameters such as firing rate, spike jitter amplitude, spike observation noise, etc. In particular, decoders that model the probability distribution of spike-neuron assignments significantly outperform decoders that use only the most likely spike assignments, and are ignorant of the posterior spike assignment uncertainty.

The iso-response method: measuring neuronal stimulus integration with closed-loop experiments

Throughout the nervous system, neurons integrate high-dimensional input streams and transform them into an output of their own. This integration of incoming signals involves filtering processes and complex non-linear operations. The shapes of these filters and non-linearities determine the computational features of single neurons and their functional roles within larger networks. A detailed characterization of signal integration is thus a central ingredient to understanding information processing in neural circuits. Conventional methods for measuring single-neuron response properties, such as reverse correlation, however, are often limited by the implicit assumption that stimulus integration occurs in a linear fashion. Here, we review a conceptual and experimental alternative that is based on exploring the space of those sensory stimuli that result in the same neural output. As demonstrated by recent results in the auditory and visual system, such iso-response stimuli can be used to identify the non-linearities relevant for stimulus integration, disentangle consecutive neural processing steps, and determine their characteristics with unprecedented precision. Automated closed-loop experiments are crucial for this advance, allowing rapid search strategies for identifying iso-response stimuli during experiments. Prime targets for the method are feed-forward neural signaling chains in sensory systems, but the method has also been successfully applied to feedback systems. Depending on the specific question, “iso-response” may refer to a predefined firing rate, single-spike probability, first-spike latency, or other output measures. Examples from different studies show that substantial progress in understanding neural dynamics and coding can be achieved once rapid online data analysis and stimulus generation, adaptive sampling, and computational modeling are tightly integrated into experiments.

Abdicating power for control: a precision timing strategy to modulate function of flight power muscles

Muscles driving rhythmic locomotion typically show strong dependence of power on the timing or phase of activation. This is particularly true in insects' main flight muscles, canonical examples of muscles thought to have a dedicated power function. However, in the moth (Manduca sexta), these muscles normally activate at a phase where the instantaneous slope of the power-phase curve is steep and well below maximum power. We provide four lines of evidence demonstrating that, contrary to the current paradigm, the moth's nervous system establishes significant control authority in these muscles through precise timing modulation: (i) left-right pairs of flight muscles normally fire precisely, within 0.5-0.6 ms of each other; (ii) during a yawing optomotor response, left-right muscle timing differences shift throughout a wider 8 ms timing window, enabling at least a 50 per cent left-right power differential; (iii) timing differences correlate with turning torque; and (iv) the downstroke power muscles alone causally account for 47 per cent of turning torque. To establish (iv), we altered muscle activation during intact behaviour by stimulating individual muscle potentials to impose left-right timing differences. Because many organisms also have muscles operating with high power-phase gains (Δ(power)/Δ(phase)), this motor control strategy may be ubiquitous in locomotor systems.

Abdicating power for control: a precision timing strategy to modulate function of flight power muscles

Muscles driving rhythmic locomotion typically show strong dependence of power on the timing or phase of activation. This is particularly true in insects' main flight muscles, canonical examples of muscles thought to have a dedicated power function. However, in the moth (Manduca sexta), these muscles normally activate at a phase where the instantaneous slope of the power-phase curve is steep and well below maximum power. We provide four lines of evidence demonstrating that, contrary to the current paradigm, the moth's nervous system establishes significant control authority in these muscles through precise timing modulation: (i) left-right pairs of flight muscles normally fire precisely, within 0.5-0.6 ms of each other; (ii) during a yawing optomotor response, left-right muscle timing differences shift throughout a wider 8 ms timing window, enabling at least a 50 per cent left-right power differential; (iii) timing differences correlate with turning torque; and (iv) the downstroke power muscles alone causally account for 47 per cent of turning torque. To establish (iv), we altered muscle activation during intact behaviour by stimulating individual muscle potentials to impose left-right timing differences. Because many organisms also have muscles operating with high power-phase gains (Δ(power)/Δ(phase)), this motor control strategy may be ubiquitous in locomotor systems.

Spike-triggered covariance: geometric proof, symmetry properties, and extension beyond Gaussian stimuli

The space of sensory stimuli is complex and high-dimensional. Yet, single neurons in sensory systems are typically affected by only a small subset of the vast space of all possible stimuli. A proper understanding of the input–output transformation represented by a given cell therefore requires the identification of the subset of stimuli that are relevant in shaping the neuronal response. As an extension to the commonly-used spike-triggered average, the analysis of the spike-triggered covariance matrix provides a systematic methodology to detect relevant stimuli. As originally designed, the consistency of this method is guaranteed only if stimuli are drawn from a Gaussian distribution. Here we present a geometric proof of consistency, which provides insight into the foundations of the method, in particular, into the crucial role played by the geometry of stimulus space and symmetries in the stimulus–response relation. This approach leads to a natural extension of the applicability of the spike-triggered covariance technique to arbitrary spherical or elliptic stimulus distributions. The extension only requires a subtle modification of the original prescription. Furthermore, we present a new resampling method for assessing statistical significance of identified relevant stimuli, applicable to spherical and elliptic stimulus distributions. Finally, we exemplify the modified method and compare it to other prescriptions given in the literature.

Information transmission in cercal giant interneurons is unaffected by axonal conduction noise

What are the fundamental constraints on the precision and accuracy with which nervous systems can process information? One constraint must reflect the intrinsic “noisiness” of the mechanisms that transmit information between nerve cells. Most neurons transmit information through the probabilistic generation and propagation of spikes along axons, and recent modeling studies suggest that noise from spike propagation might pose a significant constraint on the rate at which information could be transmitted between neurons. However, the magnitude and functional significance of this noise source in actual cells remains poorly understood. We measured variability in conduction time along the axons of identified neurons in the cercal sensory system of the cricket Acheta domesticus, and used information theory to calculate the effects of this variability on sensory coding. We found that the variability in spike propagation speed is not large enough to constrain the accuracy of neural encoding in this system.

Identifying temporal codes in spontaneously active sensory neurons

The manner in which information is encoded in neural signals is a major issue in Neuroscience. A common distinction is between rate codes, where information in neural responses is encoded as the number of spikes within a specified time frame (encoding window), and temporal codes, where the position of spikes within the encoding window carries some or all of the information about the stimulus. One test for the existence of a temporal code in neural responses is to add artificial time jitter to each spike in the response, and then assess whether or not information in the response has been degraded. If so, temporal encoding might be inferred, on the assumption that the jitter is small enough to alter the position, but not the number, of spikes within the encoding window. Here, the effects of artificial jitter on various spike train and information metrics were derived analytically, and this theory was validated using data from afferent neurons of the turtle vestibular and paddlefish electrosensory systems, and from model neurons. We demonstrate that the jitter procedure will degrade information content even when coding is known to be entirely by rate. For this and additional reasons, we conclude that the jitter procedure by itself is not sufficient to establish the presence of a temporal code.

Two-dimensional adaptation in the auditory forebrain

Sensory neurons exhibit two universal properties: sensitivity to multiple stimulus dimensions, and adaptation to stimulus statistics. How adaptation affects encoding along primary dimensions is well characterized for most sensory pathways, but if and how it affects secondary dimensions is less clear. We studied these effects for neurons in the avian equivalent of primary auditory cortex, responding to temporally modulated sounds. We showed that the firing rate of single neurons in field L was affected by at least two components of the time-varying sound log-amplitude. When overall sound amplitude was low, neural responses were based on nonlinear combinations of the mean log-amplitude and its rate of change (first time differential). At high mean sound amplitude, the two relevant stimulus features became the first and second time derivatives of the sound log-amplitude. Thus a strikingly systematic relationship between dimensions was conserved across changes in stimulus intensity, whereby one of the relevant dimensions approximated the time differential of the other dimension. In contrast to stimulus mean, increases in stimulus variance did not change relevant dimensions, but selectively increased the contribution of the second dimension to neural firing, illustrating a new adaptive behavior enabled by multidimensional encoding. Finally, we demonstrated theoretically that inclusion of time differentials as additional stimulus features, as seen so prominently in the single-neuron responses studied here, is a useful strategy for encoding naturalistic stimuli, because it can lower the necessary sampling rate while maintaining the robustness of stimulus reconstruction to correlated noise.

Temporal encoding in a nervous system

We examined the extent to which temporal encoding may be implemented by single neurons in the cercal sensory system of the house cricket Acheta domesticus. We found that these neurons exhibit a greater-than-expected coding capacity, due in part to an increased precision in brief patterns of action potentials. We developed linear and non-linear models for decoding the activity of these neurons. We found that the stimuli associated with short-interval patterns of spikes (ISIs of 8 ms or less) could be predicted better by second-order models as compared to linear models. Finally, we characterized the difference between these linear and second-order models in a low-dimensional subspace, and showed that modification of the linear models along only a few dimensions improved their predictive power to parity with the second order models. Together these results show that single neurons are capable of using temporal patterns of spikes as fundamental symbols in their neural code, and that they communicate specific stimulus distributions to subsequent neural structures.

The information coding schemes used within nervous systems have been the focus of an entire field within neuroscience. An unresolved issue within the general coding problem is the determination of the neural “symbols” with which information is encoded in neural spike trains, analogous to the determination of the nucleotide sequences used to represent proteins in molecular biology. The goal of our study was to determine if pairs of consecutive action potentials contain more or different information about the stimuli that elicit them than would be predicted from an analysis of individual action potentials. We developed linear and non-linear coding models and used likelihood analysis to address this question for sensory interneurons in the cricket cercal sensory system. Our results show that these neurons' spike trains can be decomposed into sequences of two neural symbols: isolated single spikes and short-interval spike doublets. Given the ubiquitous nature of similar neural activity reported in other systems, we suspect that the implementation of such temporal encoding schemes may be widespread across animal phyla. Knowledge of the basic coding units used by single cells will help in building the large-scale neural network models necessary for understanding how nervous systems function.

Coding of Stimuli by Ampullary Afferents in Gnathonemus petersii

Weakly electric fish use electroreception for both active and passive electrolocation and for electrocommunication. While both active and passive electrolocation systems are prominent in weakly electric Mormyriform fishes, knowledge of their passive electrolocation ability is still scarce. To better estimate the contribution of passive electric sensing to the orientation toward electric stimuli in weakly electric fishes, we investigated frequency tuning applying classical input-output characterization and stimulus reconstruction methods to reveal the encoding capabilities of ampullary receptor afferents. Ampullary receptor afferents were most sensitive (threshold: 40 μV/cm) at low frequencies (<10 Hz) and appear to be tuned to a mix of amplitude and slope of the input signals. The low-frequency tuning was corroborated by behavioral experiments, but behavioral thresholds were one order of magnitude higher. The integration of simultaneously recorded afferents of similar frequency-tuning resulted in strongly enhanced signal-to-noise ratios and increased mutual information rates but did not increase the range of frequencies detectable by the system. Theoretically the neuronal integration of input from receptors experiencing opposite polarities of a stimulus (left and right side of the fish) was shown to enhance encoding of such stimuli, including an increase of bandwidth. Covariance and coherence analysis showed that spiking of ampullary afferents is sufficiently explained by the spike-triggered average, i.e., receptors respond to a single linear feature of the stimulus. Our data support the notion of a division of labor of the active and passive electrosensory systems in weakly electric fishes based on frequency tuning. Future experiments will address the role of central convergence of ampullary input that we expect to lead to higher sensitivity and encoding power of the system.

Synaptic information transfer in computer models of neocortical columns

Understanding the direction and quantity of information flowing in neuronal networks is a fundamental problem in neuroscience. Brains and neuronal networks must at the same time store information about the world and react to information in the world. We sought to measure how the activity of the network alters information flow from inputs to output patterns. Using neocortical column neuronal network simulations, we demonstrated that networks with greater internal connectivity reduced input/output correlations from excitatory synapses and decreased negative correlations from inhibitory synapses, measured by Kendall's τ correlation. Both of these changes were associated with reduction in information flow, measured by normalized transfer entropy (nTE). Information handling by the network reflected the degree of internal connectivity. With no internal connectivity, the feedforward network transformed inputs through nonlinear summation and thresholding. With greater connectivity strength, the recurrent network translated activity and information due to contribution of activity from intrinsic network dynamics. This dynamic contribution amounts to added information drawn from that stored in the network. At still higher internal synaptic strength, the network corrupted the external information, producing a state where little external information came through. The association of increased information retrieved from the network with increased gamma power supports the notion of gamma oscillations playing a role in information processing.

Should spikes be treated with equal weightings in the generation of spectro-temporal receptive fields?

Knowledge on the trigger features of central auditory neurons is important in the understanding of speech processing. Spectro-temporal receptive fields (STRFs) obtained using random stimuli and spike-triggered averaging allow visualization of trigger features which often appear blurry in the time-versus-frequency plot. For a clearer visualization we have previously developed a dejittering algorithm to sharpen trigger features in the STRF of FM-sensitive cells. Here we extended this algorithm to segregate spikes, based on their dejitter values, into two groups: normal and outlying, and to construct their STRF separately. We found that while the STRF of the normal jitter group resembled full trigger feature in the original STRF, those of the outlying jitter group resembled a different or partial trigger feature. This algorithm allowed the extraction of other weaker trigger features. Due to the presence of different trigger features in a given cell, we proposed that in the generation of STRF, the evoked spikes should not be treated indiscriminately with equal weightings.

Spike timing, spike count, and temporal information for the discrimination of tactile stimuli in the rat ventrobasal complex

The aim of this work was to investigate the role of spike timing for the discrimination of tactile stimuli in the thalamic ventrobasal complex of the rat. We applied information-theoretic measures and computational experiments on neurophysiological data to test the ability of single-neuron responses to discriminate stimulus location and stimulus dynamics using either spike count (40 ms bin size) or spike timing (1 ms bin size). Our main finding is not only that spike timing provides additional information over spike count alone, but specifically that the temporal aspects of the code can be more informative than spike count in the rat ventrobasal complex. Virtually all temporal information--i.e., information exclusively related to when the spikes occur--is conveyed by first spikes, arising mostly from latency differences between the responses to different stimuli. Although the imprecision of first spikes (i.e., the jitter) is highly detrimental for the information conveyed by latency differences, jitter differences can contribute to temporal information, but only if latency differences are close to zero. We conclude that temporal information conveyed by spike timing can be higher than spike count information for the discrimination of somatosensory stimuli in the rat ventrobasal complex.

Representation of time-varying stimuli by a network exhibiting oscillations on a faster time scale

Sensory processing is associated with gamma frequency oscillations (30–80 Hz) in sensory cortices. This raises the question whether gamma oscillations can be directly involved in the representation of time-varying stimuli, including stimuli whose time scale is longer than a gamma cycle. We are interested in the ability of the system to reliably distinguish different stimuli while being robust to stimulus variations such as uniform time-warp. We address this issue with a dynamical model of spiking neurons and study the response to an asymmetric sawtooth input current over a range of shape parameters. These parameters describe how fast the input current rises and falls in time. Our network consists of inhibitory and excitatory populations that are sufficient for generating oscillations in the gamma range. The oscillations period is about one-third of the stimulus duration. Embedded in this network is a subpopulation of excitatory cells that respond to the sawtooth stimulus and a subpopulation of cells that respond to an onset cue. The intrinsic gamma oscillations generate a temporally sparse code for the external stimuli. In this code, an excitatory cell may fire a single spike during a gamma cycle, depending on its tuning properties and on the temporal structure of the specific input; the identity of the stimulus is coded by the list of excitatory cells that fire during each cycle. We quantify the properties of this representation in a series of simulations and show that the sparseness of the code makes it robust to uniform warping of the time scale. We find that resetting of the oscillation phase at stimulus onset is important for a reliable representation of the stimulus and that there is a tradeoff between the resolution of the neural representation of the stimulus and robustness to time-warp.

Sensory processing of time-varying stimuli, such as speech, is associated with high-frequency oscillatory cortical activity, the functional significance of which is still unknown. One possibility is that the oscillations are part of a stimulus-encoding mechanism. Here, we investigate a computational model of such a mechanism, a spiking neuronal network whose intrinsic oscillations interact with external input (waveforms simulating short speech segments in a single acoustic frequency band) to encode stimuli that extend over a time interval longer than the oscillation's period. The network implements a temporally sparse encoding, whose robustness to time warping and neuronal noise we quantify. To our knowledge, this study is the first to demonstrate that a biophysically plausible model of oscillations occurring in the processing of auditory input may generate a representation of signals that span multiple oscillation cycles.

Retinal oscillations carry visual information to cortex

Thalamic relay cells fire action potentials that transmit information from retina to cortex. The amount of information that spike trains encode is usually estimated from the precision of spike timing with respect to the stimulus. Sensory input, however, is only one factor that influences neural activity. For example, intrinsic dynamics, such as oscillations of networks of neurons, also modulate firing pattern. Here, we asked if retinal oscillations might help to convey information to neurons downstream. Specifically, we made whole-cell recordings from relay cells to reveal retinal inputs (EPSPs) and thalamic outputs (spikes) and then analyzed these events with information theory. Our results show that thalamic spike trains operate as two multiplexed channels. One channel, which occupies a low frequency band (<30 Hz), is encoded by average firing rate with respect to the stimulus and carries information about local changes in the visual field over time. The other operates in the gamma frequency band (40–80 Hz) and is encoded by spike timing relative to retinal oscillations. At times, the second channel conveyed even more information than the first. Because retinal oscillations involve extensive networks of ganglion cells, it is likely that the second channel transmits information about global features of the visual scene.

Spatial and temporal jitter distort estimated functional properties of visual sensory neurons

The functional properties of neural sensory cells or small neural ensembles are often characterized by analyzing response-conditioned stimulus ensembles. Many widely used analytical methods, like receptive fields (RF), Wiener kernels or spatio-temporal receptive fields (STRF), rely on simple statistics of those ensembles. They also tend to rely on simple noise models for the residuals of the conditional ensembles. However, in many cases the response-conditioned stimulus set has more complex structure. If not taken explicitly into account, it can bias the estimates of many simple statistics, and lead to erroneous conclusions about the functionality of a neural sensory system. In this article, we consider sensory noise in the visual system generated by small stimulus shifts in two dimensions (2 spatial or 1-space 1-time jitter). We model this noise as the action of a set of translations onto the stimulus that leave the response invariant. The analysis demonstrates that the spike-triggered average is a biased estimator of the model mean, and provides a de-biasing method. We apply this approach to observations from the stimulus/response characteristics of cells in the cat visual cortex and provide improved estimates of the structure of visual receptive fields. In several cases the new estimates differ substantially from the classic receptive fields, to a degree that may require re-evaluation of the functional description of the associated cells.

Estimating linear-nonlinear models using Renyi divergences

This article compares a family of methods for characterizing neural feature selectivity using natural stimuli in the framework of the linear-nonlinear model. In this model, the spike probability depends in a nonlinear way on a small number of stimulus dimensions. The relevant stimulus dimensions can be found by optimizing a Rényi divergence that quantifies a change in the stimulus distribution associated with the arrival of single spikes. Generally, good reconstructions can be obtained based on optimization of Rényi divergence of any order, even in the limit of small numbers of spikes. However, the smallest error is obtained when the Rényi divergence of order 1 is optimized. This type of optimization is equivalent to information maximization, and is shown to saturate the Cramer-Rao bound describing the smallest error allowed for any unbiased method. We also discuss conditions under which information maximization provides a convenient way to perform maximum likelihood estimation of linear-nonlinear models from neural data.

Modeling convergent ON and OFF pathways in the early visual system

For understanding the computation and function of single neurons in sensory systems, one needs to investigate how sensory stimuli are related to a neuron's response and which biological mechanisms underlie this relationship. Mathematical models of the stimulus-response relationship have proved very useful in approaching these issues in a systematic, quantitative way. A starting point for many such analyses has been provided by phenomenological "linear-nonlinear" (LN) models, which comprise a linear filter followed by a static nonlinear transformation. The linear filter is often associated with the neuron's receptive field. However, the structure of the receptive field is generally a result of inputs from many presynaptic neurons, which may form parallel signal processing pathways. In the retina, for example, certain ganglion cells receive excitatory inputs from ON-type as well as OFF-type bipolar cells. Recent experiments have shown that the convergence of these pathways leads to intriguing response characteristics that cannot be captured by a single linear filter. One approach to adjust the LN model to the biological circuit structure is to use multiple parallel filters that capture ON and OFF bipolar inputs. Here, we review these new developments in modeling neuronal responses in the early visual system and provide details about one particular technique for obtaining the required sets of parallel filters from experimental data.

Information transmission in oscillatory neural activity

Periodic neural activity not locked to the stimulus or to motor responses is usually ignored. Here, we present new tools for modeling and quantifying the information transmission based on periodic neural activity that occurs with quasi-random phase relative to the stimulus. We propose a model to reproduce characteristic features of oscillatory spike trains, such as histograms of inter-spike intervals and phase locking of spikes to an oscillatory influence. The proposed model is based on an inhomogeneous Gamma process governed by a density function that is a product of the usual stimulus-dependent rate and a quasi-periodic function. Further, we present an analysis method generalizing the direct method (Rieke et al. in Spikes: exploring the neural code. MIT Press, Cambridge, 1999; Brenner et al. in Neural Comput 12(7):1531-1552, 2000) to assess the information content in such data. We demonstrate these tools on recordings from relay cells in the lateral geniculate nucleus of the cat.

Computational mechanisms of mechanosensory processing in the cricket

Crickets and many other orthopteran insects face the challenge of gathering sensory information from the environment from a set of multi-modal sensory organs and transforming these stimuli into patterns of neural activity that can encode behaviorally relevant stimuli. The cercal mechanosensory system transduces low frequency air movements near the animal's body and is involved in many behaviors including escape from predators, orientation with respect to gravity, flight steering, aggression and mating behaviors. Three populations of neurons are sensitive to both the direction and dynamics of air currents:an array of mechanoreceptor-coupled sensory neurons, identified local interneurons and identified projection interneurons. The sensory neurons form a functional map of air current direction within the central nervous system that represents the direction of air currents as three-dimensional spatio-temporal activity patterns. These dynamic activity patterns provide excitatory input to interneurons whose sensitivity and spiking output depend on the location of the neuronal arbors within the sensory map and the biophysical and electronic properties of the cell structure. Sets of bilaterally symmetric interneurons can encode the direction of an air current stimulus by their ensemble activity patterns, functioning much like a Cartesian coordinate system. These interneurons are capable of responding to specific dynamic stimuli with precise temporal patterns of action potentials that may encode these stimuli using temporal encoding schemes. Thus, a relatively simple mechanosensory system employs a variety of complex computational mechanisms to provide the animal with relevant information about its environment.

Single neuron computation: from dynamical system to feature detector

White noise methods are a powerful tool for characterizing the computation performed by neural systems. These methods allow one to identify the feature or features that a neural system extracts from a complex input and to determine how these features are combined to drive the system's spiking response. These methods have also been applied to characterize the input-output relations of single neurons driven by synaptic inputs, simulated by direct current injection. To interpret the results of white noise analysis of single neurons, we would like to understand how the obtained feature space of a single neuron maps onto the biophysical properties of the membrane, in particular, the dynamics of ion channels. Here, through analysis of a simple dynamical model neuron, we draw explicit connections between the output of a white noise analysis and the underlying dynamical system. We find that under certain assumptions, the form of the relevant features is well defined by the parameters of the dynamical system. Further, we show that under some conditions, the feature space is spanned by the spike-triggered average and its successive order time derivatives.

Information Rate and Spike-Timing Precision of Proprioceptive Afferents

Proprioception in the first two joints of crustacean limbs is mediated by chordotonal organs that utilize spike-mediated information coding and transmission and by nonspiking proprioceptive afferents that use graded transmission at information rates in excess of 2,500 bits/s. Chordotonal organs operate in parallel with the graded receptors, but the information rates of the spiking chordotonal afferents have not been previously determined. Lower-bound estimates of chordotonal afferent information rates were calculated using stimulus reconstruction, which assumes linear encoding of the stimulus. The information rate was also directly estimated from the spike train entropy, which makes no a priori assumptions with respect to the coding scheme used by the system. Lower-bound information rate estimates ranged from 43 to 69 bits/s, whereas the direct estimates ranged from 24 to 278 bits/s. Comparison of both estimates derived from the same data set indicates that a linear decoder could recover an average of 59% of the information from the spike train. Afferent spike timing was found to be extremely precise, with spikes evoked with an average timing jitter of 0.55 ms. Information rate was correlated with the mean jitter and the noise entropy of the spike train could be predicted from the mean firing rate and mean jitter. Direct stimulation of single afferents by current injection into the soma revealed that the average timing jitter was <0.1 ms, indicating that intrinsic membrane properties, spike generation, and mechanotransduction mechanisms are the major sources of timing jitter in this system.

Ontogeny of air-motion sensing in cricket

Juvenile crickets suffer high rates of mortality by natural predators that they can detect using extremely sensitive air-sensing filiform hairs located on their cerci. Although a huge amount of knowledge has accumulated on the physiology, the neurobiology and the biomechanics of this sensory system in adults, the morphological and functional aspects of air sensing have not been as well studied in earlier life history stages. Using scanning electronic microscopy, we performed a survey of all cercal filiform hairs in seven instars of the wood cricket (Nemobius sylvestris). Statistical analyses allowed us to quantify profound changes in the number, the length and the distribution of cercal hairs during development. Of particular importance,we found a fivefold increase in hair number and the development of a bimodal length-frequency distribution of cercal hairs from the second instar onwards. Based on theoretical estimations of filiform hair population coding, we found that the cercal system is functional for a wide range of frequencies of biologically relevant oscillatory flows, even from the first instar. As the cricket develops, the overall sensitivity of the cercal system increases as a result of the appearance of new hairs, but the value of the best tuned frequency remains fixed between 150 and 180 Hz after the second instar. These frequencies nicely match those emitted by natural flying predators, suggesting that the development of the cercal array of hairs may have evolved in response to such signals.

Selectivity for Multiple Stimulus Features in Retinal Ganglion Cells

Under normal viewing conditions, retinal ganglion cells transmit to the brain an encoded version of the visual world. The retina parcels the visual scene into an array of spatiotemporal features, and each ganglion cell conveys information about a small set of these features. We study the temporal features represented by salamander retinal ganglion cells by stimulating with dynamic spatially uniform flicker and recording responses using a multi-electrode array. While standard reverse correlation methods determine a single stimulus feature—the spike-triggered average—multiple features can be relevant to spike generation. We apply covariance analysis to determine the set of features to which each ganglion cell is sensitive. Using this approach, we found that salamander ganglion cells represent a rich vocabulary of different features of a temporally modulated visual stimulus. Individual ganglion cells were sensitive to at least two and sometimes as many as six features in the stimulus. While a fraction of the cells can be described by a filter-and-fire cascade model, many cells have feature selectivity that has not previously been reported. These reverse models were able to account for 80–100% of the information encoded by ganglion cells.

Modeling single-neuron dynamics and computations: a balance of detail and abstraction

The fundamental building block of every nervous system is the single neuron. Understanding how these exquisitely structured elements operate is an integral part of the quest to solve the mysteries of the brain. Quantitative mathematical models have proved to be an indispensable tool in pursuing this goal. We review recent advances and examine how single-cell models on five levels of complexity, from black-box approaches to detailed compartmental simulations, address key questions about neural dynamics and signal processing.

Estimating receptive fields in the presence of spike-time jitter

Neurons in sensory systems are commonly characterized by their receptive fields. These are experimentally often obtained by reverse-correlation analyses, for example, by calculating the spike-triggered average. The reverse-correlation approach, however, generally assumes a fixed temporal relation between spike-generating stimulus features and measured spikes. Temporal jitter of spikes will therefore distort the estimated receptive fields. Here, a novel extension of widely used reverse-correlation techniques (spike-triggered average as well as spike-triggered covariance) is presented that allows accurate measurements of receptive fields even in the presence of considerable spike-time jitter. It is shown that the method correctly recovers the receptive fields from simulated spike trains. When applied to recordings from auditory receptor cells of locusts, a considerable sharpening of receptive fields as compared to standard spike-triggered averages is observed. In addition, the multiple filters that are obtained from a conventional spike-triggered covariance analysis of these data can be collapsed into a single component if spike jitter is accounted for. Finally, it is shown how further effects on spike timing, such as systematic shifts in spike latency, can be included in the approach.

Neuromodulation of spike-timing precision in sensory neurons

The neuropeptide allatostatin decreases the spike rate in response to time-varying stretches of two different crustacean mechanoreceptors, the gastropyloric receptor 2 in the crab Cancer borealis and the coxobasal chordotonal organ (CBCTO) in the crab Carcinus maenas. In each system, the decrease in firing rate is accompanied by an increase in the timing precision of spikes triggered by discrete temporal features in the stimulus. This was quantified by calculating the standard deviation or "jitter" in the times of individual identified spikes elicited in response to repeated presentations of the stimulus. Conversely, serotonin increases the firing rate but decreases the timing precision of the CBCTO response. Intracellular recordings from the afferents of this receptor demonstrate that allatostatin increases the conductance of the neurons, consistent with its inhibitory action on spike rate, whereas serotonin decreases the overall membrane conductance. We conclude that spike-timing precision of mechanoreceptor afferents in response to dynamic stimulation can be altered by neuromodulators acting directly on the afferent neurons.

Nonlinear information processing in a model sensory system

Understanding the mechanisms by which sensory neurons encode and decode information remains an important goal in neuroscience. We quantified the performance of optimal linear and nonlinear encoding models in a well-characterized sensory system: the electric sense of weakly electric fish. We show that linear encoding models generally perform better under spatially localized stimulation than under spatially diffuse stimulation. Through pharmacological blockade of feedback input and spatial saturation of the receptive field center, we show that there is significantly less synaptic noise under spatially diffuse stimuli as compared with spatially localized stimuli. Modeling results suggest that pyramidal cells nonlinearly encode sensory information through shunting in their dendrites and clarify the influence of synaptic noise on the performance of linear encoding models. Finally, we used information theory to quantify the performance of linear decoders. While the optimal linear decoder for spatially localized stimuli could capture 60% of the information in pyramidal cell spike trains, the optimal linear decoder for spatially diffuse stimuli could only capture 40% of the information. These results show that nonlinear decoders are necessary to fully access information in pyramidal cell spike trains, and we discuss potential mechanisms by which higher-order neurons could decode this information.

Effects of stimulus transformations on estimates of sensory neuron selectivity

Stimulus selectivity of sensory systems is often characterized by analyzing response-conditioned stimulus ensembles. However, in many cases these response-triggered stimulus sets have structure that is more complex than assumed. If not taken into account, when present it will bias the estimates of many simple statistics, and distort the estimated stimulus selectivity of a neural sensory system. We present an approach that mitigates these problems by modeling some of the response-conditioned stimulus structure as being generated by a set of transformations acting on a simple stimulus distribution. This approach corrects the estimates of key statistics and counters biases introduced by the transformations. In cases involving temporal spike jitter or spatial jitter of images, the main observed effects of transformations are blurring of the conditional mean and introduction of artefacts in the spectral decomposition of the conditional covariance matrix. We illustrate this approach by analyzing and correcting a set of model stimuli perturbed by temporal and spatial jitter. We apply the approach to neurophysiological data from the cricket cercal sensory system to correct the effects of temporal jitter.