Impact of noise on retinal coding of visual signals

From water to land: Evolution of photoreceptor circuits for vision in air

When vertebrates first conquered the land, they encountered a visual world that was radically distinct from that of their aquatic ancestors. Fish exploit the strong wavelength-dependent interactions of light with water by differentially feeding the signals from up to 5 spectral photoreceptor types into distinct behavioural programmes. However, above the water the same spectral rules do not apply, and this called for an update to visual circuit strategies. Early tetrapods soon evolved the double cone, a still poorly understood pair of new photoreceptors that brought the "ancestral terrestrial" complement from 5 to 7. Subsequent nonmammalian lineages differentially adapted this highly parallelised retinal input strategy for their diverse visual ecologies. By contrast, mammals shed most ancestral photoreceptors and converged on an input strategy that is exceptionally general. In eutherian mammals including in humans, parallelisation emerges gradually as the visual signal traverses the layers of the retina and into the brain.

Encoding visual information in retinal ganglion cells with prosthetic stimulation

Retinal prostheses aim to restore functional vision to those blinded by outer retinal diseases using electric stimulation of surviving retinal neurons. The ability to replicate the spatiotemporal pattern of ganglion cell spike trains present under normal viewing conditions is presumably an important factor for restoring high-quality vision. In order to replicate such activity with a retinal prosthesis, it is important to consider both how visual information is encoded in ganglion cell spike trains, and how retinal neurons respond to electric stimulation. The goal of the current review is to bring together these two concepts in order to guide the development of more effective stimulation strategies. We review the experiments to date that have studied how retinal neurons respond to electric stimulation and discuss these findings in the context of known retinal signaling strategies. The results from such in vitro studies reveal the advantages and disadvantages of activating the ganglion cell directly with the electric stimulus (direct activation) as compared to activation of neurons that are presynaptic to the ganglion cell (indirect activation). While direct activation allows high temporal but low spatial resolution, indirect activation yields improved spatial resolution but poor temporal resolution. Finally, we use knowledge gained from in vitro experiments to infer the patterns of elicited activity in ongoing human trials, providing insights into some of the factors limiting the quality of prosthetic vision.

Neural heterogeneities influence envelope and temporal coding at the sensory periphery

Peripheral sensory neurons respond to stimuli containing a wide range of spatio-temporal frequencies. We investigated electroreceptor neuron coding in the gymnotiform wave-type weakly electric fish Apteronotus leptorhynchus. Previous studies used low to mid temporal frequencies (<256 Hz) and showed that electroreceptor neuron responses to sensory stimuli could be almost exclusively accounted for by linear models, thereby implying a rate code. We instead used temporal frequencies up to 425 Hz, which is in the upper behaviorally relevant range for this species. We show that electroreceptors can: (A) respond up to the highest frequencies tested and (B) display strong nonlinearities in their responses to such stimuli. These nonlinearities were manifested by the fact that the responses to repeated presentations of the same stimulus were coherent at temporal frequencies outside of those contained in the stimulus waveform. Specifically, these consisted of low frequencies corresponding to the time varying contrast or envelope of the stimulus as well as higher harmonics of the frequencies contained in the stimulus. Heterogeneities in the afferent population influenced nonlinear coding as afferents with the lowest baseline firing rates tended to display the strongest nonlinear responses. To understand the link between afferent heterogeneity and nonlinear responsiveness, we used a phenomenological mathematical model of electrosensory afferents. Varying a single parameter in the model was sufficient to account for the variability seen in our experimental data and yielded a prediction: nonlinear responses to the envelope and at higher harmonics are both due to afferents with lower baseline firing rates displaying greater degrees of rectification in their responses. This prediction was verified experimentally as we found that the coherence between the half-wave rectified stimulus and the response resembled the coherence between the responses to repeated presentations of the stimulus in our dataset. This result shows that rectification cannot only give rise to responses to low frequency envelopes but also at frequencies that are higher than those contained in the stimulus. The latter result implies that information is contained in the fine temporal structure of electroreceptor afferent spike trains. Our results show that heterogeneities in peripheral neuronal populations can have dramatic consequences on the nature of the neural code.

Ideal observer analysis of signal quality in retinal circuits

The function of the retina is crucial, for it must encode visual signals so the brain can detect objects in the visual world. However, the biological mechanisms of the retina add noise to the visual signal and therefore reduce its quality and capacity to inform about the world. Because an organism's survival depends on its ability to unambiguously detect visual stimuli in the presence of noise, its retinal circuits must have evolved to maximize signal quality, suggesting that each retinal circuit has a specific functional role. Here we explain how an ideal observer can measure signal quality to determine the functional roles of retinal circuits. In a visual discrimination task the ideal observer can measure from a neural response the increment threshold, the number of distinguishable response levels, and the neural code, which are fundamental measures of signal quality relevant to behavior. It can compare the signal quality in stimulus and response to determine the optimal stimulus, and can measure the specific loss of signal quality by a neuron's receptive field for non-optimal stimuli. Taking into account noise correlations, the ideal observer can track the signal-to-noise ratio available from one stage to the next, allowing one to determine each stage's role in preserving signal quality. A comparison between the ideal performance of the photon flux absorbed from the stimulus and actual performance of a retinal ganglion cell shows that in daylight a ganglion cell and its presynaptic circuit loses a factor of approximately 10-fold in contrast sensitivity, suggesting specific signal-processing roles for synaptic connections and other neural circuit elements. The ideal observer is a powerful tool for characterizing signal processing in single neurons and arrays along a neural pathway.

The maintained discharge of rat retinal ganglion cells

Action potentials were recorded from rat retinal ganglion cell fibers in the presence of a uniform field, and the maintained discharge pattern was characterized. Spike trains recorded under ketaminexylazine. The majority of cells had multimodal interval distributions, with the first peak in the range of 25.00.97). Both ON and OFF cells show serial correlations between adjacent interspike intervals, while ON cells also showed second-order correlations. Cells with multimodal interval distribution showed a strong peak at high frequencies in the power spectra in the range of 28.9-41.4 Hz. Oscillations were present under both anesthetic conditions and persisted in the dark at a slightly lower frequency, implying that the oscillations are generated independent of any light stimulus but can be modulated by light level. The oscillation frequency varied slightly between cells of the same type and in the same eye, suggesting that multiple oscillatory generating mechanisms exist within the retina. Cells with high-frequency oscillations were described well by an integrate-and-fire model with the input consisting of Gaussian noise plus a sinusoid where the phase was jittered randomly to account for the bandwidth present in the oscillations.

Cortical modulations increase in early sessions with brain-machine interface

BACKGROUND

During planning and execution of reaching movements, the activity of cortical motor neurons is modulated by a diversity of motor, sensory, and cognitive signals. Brain-machine interfaces (BMIs) extract part of these modulations to directly control artificial actuators. However, cortical modulations that emerge in the novel context of operating the BMI are poorly understood.

METHODOLOGY/PRINCIPAL FINDINGS

Here we analyzed the changes in neuronal modulations that occurred in different cortical motor areas as monkeys learned to use a BMI to control reaching movements. Using spike-train analysis methods we demonstrate that the modulations of the firing-rates of cortical neurons increased abruptly after the monkeys started operating the BMI. Regression analysis revealed that these enhanced modulations were not correlated with the kinematics of the movement. The initial enhancement in firing rate modulations declined gradually with subsequent training in parallel with the improvement in behavioral performance.

CONCLUSIONS/SIGNIFICANCE

We conclude that the enhanced modulations are related to computational tasks that are significant especially in novel motor contexts. Although the function and neuronal mechanism of the enhanced cortical modulations are open for further inquiries, we discuss their potential role in processing execution errors and representing corrective or explorative activity. These representations are expected to contribute to the formation of internal models of the external actuator and their decoding may facilitate BMI improvement.

Application of multiline two-photon microscopy to functional in vivo imaging

High spatial resolution and low risks of photodamage make two-photon laser-scanning microscopy (TPLSM) the method of choice for biological imaging. However, the study of functional dynamics such as neuronal calcium regulation often also requires a high temporal resolution. Hitherto, acquisition speed is usually increased by line scanning, which restricts spatial resolution to structures along a single axis. To overcome this gap between high spatial and high temporal resolution we performed TPLSM with a beam multiplexer to generate multiple laser foci inside the sample. By detecting the fluorescence emitted from these laser foci with an electron-multiplying camera, it was possible to perform multiple simultaneous linescans. In addition to multiline scanning, the array of up to 64 laser beams could also be used in x-y scan mode to collect entire images at high frame rates. To evaluate the applicability of multiline TPLSM to functional in vivo imaging, calcium signals were monitored in visual motion-sensitive neurons in the brain of flies. The capacity of our method to simultaneously acquire signals at different cellular locations is exemplified by measurements at branched neurites and 'spine'-like structures. Calcium dynamics depended on branch size, but 'spines' did not systematically differ from their 'parent neurites'. The spatial resolution of our setup was critically evaluated by comparing it to confocal microscopy and the negative effect of scattering of emission light during image detection was assessed directly by running the setup in both imaging and point-scanning mode.

Spatiotemporal integration of light by the cat X-cell center under photopic and scotopic conditions

Visual responses to stimulation at high temporal frequency are generally considered to result from signals that avoid light adaptive gain adjustment, simply reflecting linear summation of luminance. Under conditions of high photopic illuminance, the center of the receptive field of the cat X-cell has been shown to expand in size when stimulated at high temporal frequency, raising the possibility that there is spatiotemporal interaction in luminance summation. Here we show that this expansion maintains constant the product of the center's luminance summing area and the temporal period of luminance modulation, implying that spatial and temporal integration of luminance can be traded for one another by the X-cell center. As such the X-cell has a spatiotemporal window for luminance integration that fuses the classical concepts of a spatial window of luminance integration (Ricco's Law) with a temporal window of luminance integration (Bloch's Law). We were interested to determine whether this tradeoff between spatial and temporal summation of luminance occurs also at lower light levels, where the temporal-frequency bandwidth of the X-cell is narrower. We found that it does not. Center radius does not expand with temporal frequency under either low photopic or scotopic conditions. These results are discussed within the context of the known retinal circuitry that underlies the X-cell center for photopic and scotopic conditions.