Focal electrical stimulation of major ganglion cell types in the primate retina for the design of visual prostheses

Comparison of modulation efficiency between normal and degenerated primate retina

With electrical stimulation, retinal prostheses bypass dysfunctional photoreceptors and activate the surviving bipolar or retinal ganglion cells (RGCs). Therefore, the effective modulation of RGCs is crucial for developing retinal prostheses. Substantial research has been performed on the ability of an electrical stimulus to generate a reliable RGC response. However, different experimental conditions show varying levels of how well the electrical stimulation evokes RGC spikes. Therefore, in this study, we attempted to extract an indicator to understand how the electrical stimulation effectively evokes RGC spikes. Six cynomolgus monkeys were used: three as controls and three as an N-methyl-N-nitrosourea (MNU)-induced retinal degeneration model. The retinal recordings were performed using 8 × 8 multi-electrode arrays (MEAs). Electrical stimulation consisted of symmetrical biphasic pulses of varying amplitudes and durations. The number of stimulation conditions that resulted in significantly higher post-stimulation firing rates than pre-stimulus firing rates was defined as the modulation efficiency ratio (MER). The MER was significantly lower in degenerated retinas than in normal retinas. We investigated the relationship between the variables and the MER in normal and degenerated primate RGCs. External variables, such as duration and inter-electrode distance, and internal variables, such as average firing rates and statistics (mean, standard deviation, and coefficient of variation [CV]) of inter-spike intervals (ISIs) of spontaneous spikes, were used. External variables had similar effects on MER in normal and degenerated RGCs. In contrast, internal variables affected MER differently in normal and degenerated RGCs. While in normal RGCs, they were not related to MER, in degenerated RGCs, the mean ISIs were positively correlated with MER, and the CV of ISIs was negatively correlated with MER. The most important variable affecting MER was the mean ISI. A shorter ISI indicates hyperactive firing in the degenerated retina, which prevents electrical stimulation from evoking more RGCs. We believe that this hyperactivity in degenerated retinas results in a lower MER than that in the normal retina. Our findings can be used to optimize the selection of stimulation channels for in vitro MEA experiments and practical calibration methods to achieve higher efficiency when testing retinal prostheses.

Spike sorting in the presence of stimulation artifacts: a dynamical control systems approach

Objective. Bi-directional electronic neural interfaces, capable of both electrical recording and stimulation, communicate with the nervous system to permit precise calibration of electrical inputs by capturing the evoked neural responses. However, one significant challenge is that stimulation artifacts often mask the actual neural signals. To address this issue, we introduce a novel approach that employs dynamical control systems to detect and decipher electrically evoked neural activity despite the presence of electrical artifacts.Approach. Our proposed method leverages the unique spatiotemporal patterns of neural activity and electrical artifacts to distinguish and identify individual neural spikes. We designed distinctive dynamical models for both the stimulation artifact and each neuron observed during spontaneous neural activity. We can estimate which neurons were active by analyzing the recorded voltage responses across multiple electrodes post-stimulation. This technique also allows us to exclude signals from electrodes heavily affected by stimulation artifacts, such as the stimulating electrode itself, yet still accurately differentiate between evoked spikes and electrical artifacts.Main results. We applied our method to high-density multi-electrode recordings from the primate retina in anex vivosetup, using a grid of 512 electrodes. Through repeated electrical stimulations at varying amplitudes, we were able to construct activation curves for each neuron. The curves obtained with our method closely resembled those derived from manual spike sorting. Additionally, the stimulation thresholds we estimated strongly agreed with those determined through manual analysis, demonstrating high reliability (R2=0.951for human 1 andR2=0.944for human 2).Significance. Our method can effectively separate evoked neural spikes from stimulation artifacts by exploiting the distinct spatiotemporal propagation patterns captured by a dense, large-scale multi-electrode array. This technique holds promise for future applications in real-time closed-loop stimulation systems and for managing multi-channel stimulation strategies.

Neural activity of retinal ganglion cells under continuous, dynamically-modulated high frequency electrical stimulation

Objective.Current retinal prosthetics are limited in their ability to precisely control firing patterns of functionally distinct retinal ganglion cell (RGC) types. The aim of this study was to characterise RGC responses to continuous, kilohertz-frequency-varying stimulation to assess its utility in controlling RGC activity.Approach.We usedin vitropatch-clamp experiments to assess electrically-evoked ON and OFF RGC responses to frequency-varying pulse train sequences. In each sequence, the stimulation amplitude was kept constant while the stimulation frequency (0.5-10 kHz) was changed every 40 ms, in either a linearly increasing, linearly decreasing or randomised manner. The stimulation amplitude across sequences was increased from 10 to 300µA.Main results.We found that continuous stimulation without rest periods caused complex and irreproducible stimulus-response relationships, primarily due to strong stimulus-induced response adaptation and influence of the preceding stimulus frequency on the response to a subsequent stimulus. In addition, ON and OFF populations showed different sensitivities to continuous, frequency-varying pulse trains, with OFF cells generally exhibiting more dependency on frequency changes within a sequence. Finally, the ability to maintain spiking behaviour to continuous stimulation in RGCs significantly reduced over longer stimulation durations irrespective of the frequency order.Significance.This study represents an important step in advancing and understanding the utility of continuous frequency modulation in controlling functionally distinct RGCs. Our results indicate that continuous, kHz-frequency-varying stimulation sequences provide very limited control of RGC firing patterns due to inter-dependency between adjacent frequencies and generally, different RGC types do not display different frequency preferences under such stimulation conditions. For future stimulation strategies using kHz frequencies, careful consideration must be given to design appropriate pauses in stimulation, stimulation frequency order and the length of continuous stimulation duration.

The Variation of Electrical Pulse Duration Elicits Reliable Network-Mediated Responses of Retinal Ganglion Cells in Normal, Not in Degenerate Primate Retinas

This study aims to investigate the efficacy of electrical stimulation by comparing network-mediated RGC responses in normal and degenerate retinas using a N-methyl-N-nitrosourea (MNU)-induced non-human primate (NHPs) retinitis pigmentosa (RP) model. Adult cynomolgus monkeys were used for normal and outer retinal degeneration (RD) induced by MNU. The network-mediated RGC responses were recorded from the peripheral retina mounted on an 8 × 8 multielectrode array (MEA). The amplitude and duration of biphasic current pulses were modulated from 1 to 50 μA and 500 to 4000 μs, respectively. The threshold charge density for eliciting a network-mediated RGC response was higher in the RD monkeys than in the normal monkeys (1.47 ± 0.13 mC/cm2 vs. 1.06 ± 0.09 mC/cm2, p < 0.05) at a 500 μs pulse duration. The monkeys required a higher charge density than rodents among the RD models (monkeys; 1.47 ± 0.13 mC/cm2, mouse; 1.04 ± 0.09 mC/cm2, and rat; 1.16 ± 0.16 mC/cm2, p < 0.01). Increasing the pulse amplitude and pulse duration elicited more RGC spikes in the normal primate retinas. However, only pulse amplitude variation elicited more RGC spikes in degenerate primate retinas. Therefore, the pulse strategy for primate RD retinas should be optimized, eventually contributing to retinal prosthetics. Given that RD NHP RGCs are not sensitive to pulse duration, using shorter pulses may potentially be a more charge-effective approach for retinal prosthetics.

Inferring light responses of primate retinal ganglion cells using intrinsic electrical signatures

Objective. Retinal implants are designed to stimulate retinal ganglion cells (RGCs) in a way that restores sight to individuals blinded by photoreceptor degeneration. Reproducing high-acuity vision with these devices will likely require inferring the natural light responses of diverse RGC types in the implanted retina, without being able to measure them directly. Here we demonstrate an inference approach that exploits intrinsic electrophysiological features of primate RGCs.Approach.First, ON-parasol and OFF-parasol RGC types were identified using their intrinsic electrical features in large-scale multi-electrode recordings from macaque retina. Then, the electrically inferred somatic location, inferred cell type, and average linear-nonlinear-Poisson model parameters of each cell type were used to infer a light response model for each cell. The accuracy of the cell type classification and of reproducing measured light responses with the model were evaluated.Main results.A cell-type classifier trained on 246 large-scale multi-electrode recordings from 148 retinas achieved 95% mean accuracy on 29 test retinas. In five retinas tested, the inferred models achieved an average correlation with measured firing rates of 0.49 for white noise visual stimuli and 0.50 for natural scenes stimuli, compared to 0.65 and 0.58 respectively for models fitted to recorded light responses (an upper bound). Linear decoding of natural images from predicted RGC activity in one retina showed a mean correlation of 0.55 between decoded and true images, compared to an upper bound of 0.81 using models fitted to light response data.Significance.These results suggest that inference of RGC light response properties from intrinsic features of their electrical activity may be a useful approach for high-fidelity sight restoration. The overall strategy of first inferring cell type from electrical features and then exploiting cell type to help infer natural cell function may also prove broadly useful to neural interfaces.

Inference of Electrical Stimulation Sensitivity from Recorded Activity of Primate Retinal Ganglion Cells

High-fidelity electronic implants can in principle restore the function of neural circuits by precisely activating neurons via extracellular stimulation. However, direct characterization of the individual electrical sensitivity of a large population of target neurons, to precisely control their activity, can be difficult or impossible. A potential solution is to leverage biophysical principles to infer sensitivity to electrical stimulation from features of spontaneous electrical activity, which can be recorded relatively easily. Here, this approach is developed and its potential value for vision restoration is tested quantitatively using large-scale multielectrode stimulation and recording from retinal ganglion cells (RGCs) of male and female macaque monkeys ex vivo Electrodes recording larger spikes from a given cell exhibited lower stimulation thresholds across cell types, retinas, and eccentricities, with systematic and distinct trends for somas and axons. Thresholds for somatic stimulation increased with distance from the axon initial segment. The dependence of spike probability on injected current was inversely related to threshold, and was substantially steeper for axonal than somatic compartments, which could be identified by their recorded electrical signatures. Dendritic stimulation was largely ineffective for eliciting spikes. These trends were quantitatively reproduced with biophysical simulations. Results from human RGCs were broadly similar. The inference of stimulation sensitivity from recorded electrical features was tested in a data-driven simulation of visual reconstruction, revealing that the approach could significantly improve the function of future high-fidelity retinal implants.SIGNIFICANCE STATEMENT This study demonstrates that individual in situ primate retinal ganglion cells of different types respond to artificially generated, external electrical fields in a systematic manner, in accordance with theoretical predictions, that allows for prediction of electrical stimulus sensitivity from recorded spontaneous activity. It also provides evidence that such an approach could be immensely helpful in the calibration of clinical retinal implants.

High-Fidelity Reproduction of Visual Signals by Electrical Stimulation in the Central Primate Retina

Electrical stimulation of retinal ganglion cells (RGCs) with electronic implants provides rudimentary artificial vision to people blinded by retinal degeneration. However, current devices stimulate indiscriminately and therefore cannot reproduce the intricate neural code of the retina. Recent work has demonstrated more precise activation of RGCs using focal electrical stimulation with multielectrode arrays in the peripheral macaque retina, but it is unclear how effective this can be in the central retina, which is required for high-resolution vision. This work probes the neural code and effectiveness of focal epiretinal stimulation in the central macaque retina, using large-scale electrical recording and stimulation ex vivo The functional organization, light response properties, and electrical properties of the major RGC types in the central retina were mostly similar to the peripheral retina, with some notable differences in density, kinetics, linearity, spiking statistics, and correlations. The major RGC types could be distinguished by their intrinsic electrical properties. Electrical stimulation targeting parasol cells revealed similar activation thresholds and reduced axon bundle activation in the central retina, but lower stimulation selectivity. Quantitative evaluation of the potential for image reconstruction from electrically evoked parasol cell signals revealed higher overall expected image quality in the central retina. An exploration of inadvertent midget cell activation suggested that it could contribute high spatial frequency noise to the visual signal carried by parasol cells. These results support the possibility of reproducing high-acuity visual signals in the central retina with an epiretinal implant.SIGNIFICANCE STATEMENT Artificial restoration of vision with retinal implants is a major treatment for blindness. However, present-day implants do not provide high-resolution visual perception, in part because they do not reproduce the natural neural code of the retina. Here, we demonstrate the level of visual signal reproduction that is possible with a future implant by examining how accurately responses to electrical stimulation of parasol retinal ganglion cells can convey visual signals. Although the precision of electrical stimulation in the central retina was diminished relative to the peripheral retina, the quality of expected visual signal reconstruction in parasol cells was greater. These findings suggest that visual signals could be restored with high fidelity in the central retina using a future retinal implant.

Focal electrical stimulation of human retinal ganglion cells for vision restoration

Objective. Vision restoration with retinal implants is limited by indiscriminate simultaneous activation of many cells and cell types, which is incompatible with reproducing the neural code of the retina. Recent work has shown that primate retinal ganglion cells (RGCs), which transmit visual information to the brain, can be directly electrically activated with single-cell, single-spike, cell-type precision - however, this possibility has never been tested in the human retina. In this study we aim to characterize, for the first time, direct in situ extracellular electrical stimulation of individual human RGCs.Approach. Extracellular electrical stimulation of individual human RGCs was conducted in three human retinas ex vivo using a custom large-scale, multi-electrode array capable of simultaneous recording and stimulation. Measured activation properties were compared directly to extensive results from macaque.Main results. Precise activation was in many cases possible without activating overlying axon bundles, at low stimulation current levels similar to those used in macaque. The major RGC types could be identified and targeted based on their distinctive electrical signatures. The measured electrical activation properties of RGCs, combined with a dynamic stimulation algorithm, was sufficient to produce an evoked visual signal that was nearly optimal given the constraints of the interface.Significance. These results suggest the possibility of high-fidelity vision restoration in humans using bi-directional epiretinal implants.

Implications of Neural Plasticity in Retinal Prosthesis

Retinal degenerative diseases such as retinitis pigmentosa cause a progressive loss of photoreceptors that eventually prevents the affected person from perceiving visual sensations. The absence of a visual input produces a neural rewiring cascade that propagates along the visual system. This remodeling occurs first within the retina. Then, subsequent neuroplastic changes take place at higher visual centers in the brain, produced by either the abnormal neural encoding of the visual inputs delivered by the diseased retina or as the result of an adaptation to visual deprivation. While retinal implants can activate the surviving retinal neurons by delivering electric current, the unselective activation patterns of the different neural populations that exist in the retinal layers differ substantially from those in physiologic vision. Therefore, artificially induced neural patterns are being delivered to a brain that has already undergone important neural reconnections. Whether or not the modulation of this neural rewiring can improve the performance for retinal prostheses remains a critical question whose answer may be the enabler of improved functional artificial vision and more personalized neurorehabilitation strategies.

Correlated Activity in the Degenerate Retina Inhibits Focal Response to Electrical Stimulation

Retinal prostheses have shown some clinical success in patients with retinitis pigmentosa and age-related macular degeneration. However, even after the implantation of a retinal prosthesis, the patient’s visual acuity is at best less than 20/420. Reduced visual acuity may be explained by a decrease in the signal-to-noise ratio due to the spontaneous hyperactivity of retinal ganglion cells (RGCs) found in degenerate retinas. Unfortunately, abnormal retinal rewiring, commonly observed in degenerate retinas, has rarely been considered for the development of retinal prostheses. The purpose of this study was to investigate the aberrant retinal network response to electrical stimulation in terms of the spatial distribution of the electrically evoked RGC population. An 8 × 8 multielectrode array was used to measure the spiking activity of the RGC population. RGC spikes were recorded in wild-type [C57BL/6J; P56 (postnatal day 56)], rd1 (P56), rd10 (P14 and P56) mice, and macaque [wild-type and drug-induced retinal degeneration (RD) model] retinas. First, we performed a spike correlation analysis between RGCs to determine RGC connectivity. No correlation was observed between RGCs in the control group, including wild-type mice, rd10 P14 mice, and wild-type macaque retinas. In contrast, for the RD group, including rd1, rd10 P56, and RD macaque retinas, RGCs, up to approximately 400–600 μm apart, were significantly correlated. Moreover, to investigate the RGC population response to electrical stimulation, the number of electrically evoked RGC spikes was measured as a function of the distance between the stimulation and recording electrodes. With an increase in the interelectrode distance, the number of electrically evoked RGC spikes decreased exponentially in the control group. In contrast, electrically evoked RGC spikes were observed throughout the retina in the RD group, regardless of the inter-electrode distance. Taken together, in the degenerate retina, a more strongly coupled retinal network resulted in the widespread distribution of electrically evoked RGC spikes. This finding could explain the low-resolution vision in prosthesis-implanted patients.

An in-silico analysis of electrically-evoked responses of midget and parasol retinal ganglion cells in different retinal regions

BACKGROUND

Visual outcomes provided by present retinal prostheses that primarily target retinal ganglion cells (RGCs) through epiretinal stimulation remain rudimentary, partly due to the limited knowledge of retinal responses under electrical stimulation. Better understanding of how different retinal regions can be quantitatively controlled with high spatial accuracy, will be beneficial to the design of micro-electrode arrays (MEAs) and stimulation strategies for next-generation wide-view, high-resolution epiretinal implants.

METHODS

A computational model was developed to assess neural activity at different eccentricities (2 mm and 5 mm) within the human retina. This model included midget and parasol RGCs with anatomically accurate cell distribution and cell-specific morphological information. We then performed in silico investigations of region-specific RGC responses to epiretinal electrical stimulation using varied electrode sizes (5 µm - 210 µm diameter), emulating both commercialized retinal implants and recently-developed prototype devices.

RESULTS

Our model of epiretinal stimulation predicted RGC population excitation analogous to the complex percepts reported in human subjects. Following this, our simulations suggest that midget and parasol RGCs have characteristic regional differences in excitation under preferred electrode sizes. Relatively central (2 mm) regions demonstrated higher number of excited RGCs but lower overall activated receptive field (RF) areas under the same stimulus amplitudes (two-way ANOVA, p < 0.05). Furthermore, the activated RGC numbers per unit active RF area (number-RF ratio) were significantly higher in central than in peripheral regions, and higher in the midget than in the parasol population under all tested electrode sizes (two-way ANOVA, p < 0.05). Our simulations also suggested that smaller electrodes exhibit a higher range of controllable stimulation parameters to achieve pre-defined performance of RGC excitation. ..

Selective Activation of Retinal Ganglion Cell Subtypes Through Targeted Electrical Stimulation Parameters

To restore vision to the low vision, epiretinal implants have been developed to electrically stimulate the healthy retinal ganglion cells (RGCs) in the degenerate retina. Given the diversity of retinal ganglion cells as well as the difference in their visual function, selective activation of RGCs subtypes can significantly improve the quality of the restored vision. Our recent results demonstrated that with the proper modulation of the current amplitude, small D1-bistratified cells with the contribution to blue/yellow color opponent pathway can be selectively activated at high frequency (200 Hz). The computational results correlated with the clinical findings revealing the blue sensation of 5/7 subjects with epiretinal implants at high frequency. Here we further explored the impacts of alterations in pulse duration and interphase gap on the response of RGCs at high frequency. We used the developed RGCs, A2-monostratified and D1-bistratified, and examined their response to a range of pulse durations (0.1−1.2 ms) and interphase gaps (0−1 ms). We found that the use of short pulse durations with no interphase gap at high frequency increases the differential response of RGCs, offering better opportunities for selective activation of D1 cells. The presence of the interphase gap has shown to reduce the overall differential response of RGCs. We also explored how the low density of calcium channels enhances the responsiveness of RGCs at high frequency.

Morphological Factors that Underlie Neural Sensitivity to Stimulation in the Retina

Retinal prostheses are a promising therapeutic intervention for patients afflicted by outer retinal degenerative diseases like retinitis pigmentosa and age-related macular degeneration. While significant advances in the development of retinal implants have been made, the quality of vision elicited by these devices remains largely sub-optimal. The variability in the responses produced by retinal devices is most likely due to the differences between the natural cell type-specific signaling that occur in the healthy retina vs. the non-specific activation of multiple cell types arising from artificial stimulation. In order to replicate these natural signaling patterns, stimulation strategies must be capable of preferentially activating specific RGC types. To design more selective stimulation strategies, a better understanding of the morphological factors that underlie the sensitivity to prosthetic stimulation must be developed. This review will focus on the role that different anatomical components play in driving the direct activation of RGCs by extracellular stimulation. Briefly, it will (1) characterize the variability in morphological properties of α-RGCs, (2) detail the influence of morphology on the direct activation of RGCs by electric stimulation, and (3) describe some of the potential biophysical mechanisms that could explain differences in activation thresholds and electrically evoked responses between RGC types.

Spiking Characteristics of Network-Mediated Responses Arising in Direction-Selective Ganglion Cells of Rabbit and Mouse Retinas to Electric Stimulation for Retinal Prostheses

To restore the sight of individuals blinded by outer retinal degeneration, numerous retinal prostheses have been developed. However, the performance of those implants is still hampered by some factors including the lack of comprehensive understanding of the electrically-evoked responses arising in various retinal ganglion cell (RGC) types. In this study, we characterized the electrically-evoked network-mediated responses (hereafter referred to as electric responses) of ON-OFF direction-selective (DS) RGCs in rabbit and mouse retinas for the first time. Interestingly, both species in common demonstrated strong negative correlations between spike counts of electric responses and direction selective indices (DSIs), suggesting electric stimulation activates inhibitory presynaptic neurons that suppress null direction responses for high direction tuning in their light responses. The DS cells of the two species showed several differences including different numbers of bursts. Also, spiking patterns were more heterogeneous across DS RGCs of rabbits than those of mice. The electric response magnitudes of rabbit DS cells showed positive and negative correlations with ON and OFF light response magnitudes to preferred direction motion, respectively. But the mouse DS cells showed positive correlations in both comparisons. Our Fano Factor (FF) and spike time tiling coefficient (STTC) analyses revealed that spiking consistencies across repeats were reduced in late electric responses in both species. Moreover, the response consistencies of DS RGCs were lower than those of non-DS RGCs. Our results indicate the species-dependent retinal circuits may result in different electric response features and therefore suggest a proper animal model may be crucial in prosthetic researches.

Automatic Identification of Axon Bundle Activation for Epiretinal Prosthesis

Objective:

Retinal prostheses must be able to activate cells in a selective way in order to restore high-fidelity vision. However, inadvertent activation of far-away retinal ganglion cells (RGCs) through electrical stimulation of axon bundles can produce irregular and poorly controlled percepts, limiting artificial vision. In this work, we aim to provide an algorithmic solution to the problem of detecting axon bundle activation with a bi-directional epiretinal prostheses.

Methods:

The algorithm utilizes electrical recordings to determine the stimulation current amplitudes above which axon bundle activation occurs. Bundle activation is defined as the axonal stimulation of RGCs with unknown soma and receptive field locations, typically beyond the electrode array. The method exploits spatiotemporal characteristics of electrically-evoked spikes to overcome the challenge of detecting small axonal spikes.

Results:

The algorithm was validated using large-scale, single-electrode and short pulse, ex vivo stimulation and recording experiments in macaque retina, by comparing algorithmically and manually identified bundle activation thresholds. For 88% of the electrodes analyzed, the threshold identified by the algorithm was within ±10% of the manually identified threshold, with a correlation coefficient of 0.95.

Conclusion:

This works presents a simple, accurate and efficient algorithm to detect axon bundle activation in epiretinal prostheses.

Significance:

The algorithm could be used in a closed-loop manner by a future epiretinal prosthesis to reduce poorly controlled visual percepts associated with bundle activation. Activation of distant cells via axonal stimulation will likely occur in other types of retinal implants and cortical implants, and the method may therefore be broadly applicable.

Spatially patterned bi-electrode epiretinal stimulation for axon avoidance at cellular resolution

Objective.Epiretinal prostheses are designed to restore vision to people blinded by photoreceptor degenerative diseases by stimulating surviving retinal ganglion cells (RGCs), which carry visual signals to the brain. However, inadvertent stimulation of RGCs at their axons can result in non-focal visual percepts, limiting the quality of artificial vision. Theoretical work has suggested that axon activation can be avoided with current stimulation designed to minimize the second spatial derivative of the induced extracellular voltage along the axon. However, this approach has not been verified experimentally at the resolution of single cells.Approach.In this work, a custom multi-electrode array (512 electrodes, 10μm diameter, 60μm pitch) was used to stimulate and record RGCs in macaque retinaex vivoat single-cell, single-spike resolution. RGC activation thresholds resulting from bi-electrode stimulation, which consisted of bipolar currents simultaneously delivered through two electrodes straddling an axon, were compared to activation thresholds from traditional single-electrode stimulation.Main results.On average, across three retinal preparations, the bi-electrode stimulation strategy reduced somatic activation thresholds (∼21%) while increasing axonal activation thresholds (∼14%), thus favoring selective somatic activation. Furthermore, individual examples revealed rescued selective activation of somas that was not possible with any individual electrode.Significance.This work suggests that a bi-electrode epiretinal stimulation strategy can reduce inadvertent axonal activation at cellular resolution, for high-fidelity artificial vision.

Advances in Neuroscience, Not Devices, Will Determine the Effectiveness of Visual Prostheses

Background: Innovations in engineering and neuroscience have enabled the development of sophisticated visual prosthetic devices. In clinical trials, these devices have provided visual acuities as high as 20/460, enabled coarse navigation, and even allowed for reading of short words. However, long-term commercial viability arguably rests on attaining even better vision and more definitive improvements in tasks of daily living and quality of life. Purpose: Here we review technological and biological obstacles in the implementation of visual prosthetics. Conclusions: Research in the visual prosthetic field has tackled significant technical challenges, including biocompatibility, signal spread through neural tissue, and inadvertent activation of passing axons; however, significant gaps in knowledge remain in the realm of neuroscience, including the neural code of vision and visual plasticity. We assert that further optimization of prosthetic devices alone will not provide markedly improved visual outcomes without significant advances in our understanding of neuroscience.

Computational challenges and opportunities for a bi-directional artificial retina

A future artificial retina that can restore high acuity vision in blind people will rely on the capability to both read (observe) and write (control) the spiking activity of neurons using an adaptive, bi-directional and high-resolution device. Although current research is focused on overcoming the technical challenges of building and implanting such a device, exploiting its capabilities to achieve more acute visual perception will also require substantial computational advances. Using high-density large-scale recording and stimulation in the primate retina with an ex vivo multi-electrode array lab prototype, we frame several of the major computational problems, and describe current progress and future opportunities in solving them. First, we identify cell types and locations from spontaneous activity in the blind retina, and then efficiently estimate their visual response properties by using a low-dimensional manifold of inter-retina variability learned from a large experimental dataset. Second, we estimate retinal responses to a large collection of relevant electrical stimuli by passing current patterns through an electrode array, spike sorting the resulting recordings and using the results to develop a model of evoked responses. Third, we reproduce the desired responses for a given visual target by temporally dithering a diverse collection of electrical stimuli within the integration time of the visual system. Together, these novel approaches may substantially enhance artificial vision in a next-generation device.

Creation of virtual channels in the retina using synchronous and asynchronous stimulation - a modelling study

OBJECTIVE

Implantable retinal prostheses aim to provide artificial vision to those suffering from retinal degenerative diseases by electrically stimulating the remaining retinal neurons using a multi-electrode array. The spatial resolution of these devices can be improved by creation of so-called virtual channels (VCs) that are commonly achieved through synchronized stimulation of multiple electrodes. It is largely unclear though if VCs can be created using asynchronous stimulation, which was the primary aim of this study.

APPROACH

A computational model of multi-layered retina and epi-retinal dual-electrode stimulation was developed to simulate the neural activity of populations of retinal ganglion cells (RGCs) using the VC strategy under both synchronous and asynchronous stimulation conditions.

MAIN RESULTS

Our simulation suggests that VCs can be created using asynchronous stimulation. VC performance under both synchronous and asynchronous stimulation conditions can be improved by optimizing stimulation parameters such as current intensity, current ratio (α) between two electrodes, electrode spacing and the stimulation waveform. In particular, two VC performance measures; (1) linear displacement of the centroid of RGC activation, and (2) the RGC activation size consistency as a function of different current ratios α, have comparable performance under asynchronous and synchronous stimulation with appropriately selected stimulation parameters.

SIGNIFICANCE

Our findings support the possibility of creating VCs in the retina under both synchronous and asynchronous stimulation conditions. The results provide theoretical evidence for future retinal prosthesis designs with higher spatial resolution and power efficiency whilst reducing the number of current sources required to achieve these outcomes.

The relationship between morphological properties and thresholds to extracellular electric stimulation in α RGCs

OBJECTIVE

Retinal prostheses strive to restore vison to patients that are blind from retinal degeneration by electrically stimulating surviving retinal ganglion cells (RGCs). The quality of elicited percepts remains limited however and it is desirable to develop improved stimulation strategies. Here, we examine how the anatomical and biophysical properties of RGCs influence activation thresholds, including the effects of variations found naturally.

APPROACH

Detailed reconstructions were made of a large number of mouse α RGCs and were used to create an array of model cells; the models were used to study the effects of individual anatomical features on activation threshold to electric stimulation. Stimulation was delivered epiretinally from a point-source or disk electrode and consisted of monophasic or biphasic rectangular pulses.

MAIN RESULTS

Modeling results show that the region of minimum threshold always is within the axon initial segment (AIS). The properties of this region as well as the absolute value of the minimum threshold are dependent on the length of the AIS as well as on the relative composition of sodium channels within the AIS. Other morphological features, including cell size, dendritic field size and the distance between the AIS and the soma had only a minimal influence on thresholds. Introducing even a small number of low-threshold Na_v1.6 channels into the AIS was sufficient to lower minimum thresholds substantially although further increases in Na_v1.6 had diminishing effects. The distance between the AIS and the electrode affects threshold levels while alignment of the electrode with the axon or dendritic parts of the RGC can result in lower thresholds, even if the distance to the cell remains the same.

SIGNIFICANCE

Intrinsic morphological features can influence activation thresholds with the AIS having the strongest influence. However, the combined influence remains limited and may not be large enough to allow for selective activation between different RGC types.

Retinal Drug Delivery: Rethinking Outcomes for the Efficient Replication of Retinal Behavior

The retina is a highly organized structure that is considered to be "an approachable part of the brain." It is attracting the interest of development scientists, as it provides a model neurovascular system. Over the last few years, we have been witnessing significant development in the knowledge of the mechanisms that induce the shape of the retinal vascular system, as well as knowledge of disease processes that lead to retina degeneration. Knowledge and understanding of how our vision works are crucial to creating a hardware-adaptive computational model that can replicate retinal behavior. The neuronal system is nonlinear and very intricate. It is thus instrumental to have a clear view of the neurophysiological and neuroanatomic processes and to take into account the underlying principles that govern the process of hardware transformation to produce an appropriate model that can be mapped to a physical device. The mechanistic and integrated computational models have enormous potential toward helping to understand disease mechanisms and to explain the associations identified in large model-free data sets. The approach used is modulated and based on different models of drug administration, including the geometry of the eye. This work aimed to review the recently used mathematical models to map a directed retinal network.

Stimulation Strategies for Improving the Resolution of Retinal Prostheses

Electrical stimulation using implantable devices with arrays of stimulating electrodes is an emerging therapy for neurological diseases. The performance of these devices depends greatly on their ability to activate populations of neurons with high spatiotemporal resolution. To study electrical stimulation of populations of neurons, retina serves as a useful model because the neural network is arranged in a planar array that is easy to access. Moreover, retinal prostheses are under development to restore vision by replacing the function of damaged light sensitive photoreceptors, which makes retinal research directly relevant for curing blindness. Here we provide a progress review on stimulation strategies developed in recent years to improve the resolution of electrical stimulation in retinal prostheses. We focus on studies performed with explanted retinas, in which electrophysiological techniques are the most advanced. We summarize achievements in improving the spatial and temporal resolution of electrical stimulation of the retina and methods to selectively stimulate neurons with different visual functions. Future directions for retinal prostheses development are also discussed, which could provide insights for other types of neuromodulatory devices in which high-resolution electrical stimulation is required.

Probing and predicting ganglion cell responses to smooth electrical stimulation in healthy and blind mouse retina

Retinal implants are used to replace lost photoreceptors in blind patients suffering from retinopathies such as retinitis pigmentosa. Patients wearing implants regain some rudimentary visual function. However, it is severely limited compared to normal vision because non-physiological stimulation strategies fail to selectively activate different retinal pathways at sufficient spatial and temporal resolution. The development of improved stimulation strategies is rendered difficult by the large space of potential stimuli. Here we systematically explore a subspace of potential stimuli by electrically stimulating healthy and blind mouse retina in epiretinal configuration using smooth Gaussian white noise delivered by a high-density CMOS-based microelectrode array. We identify linear filters of retinal ganglion cells (RGCs) by fitting a linear-nonlinear-Poisson (LNP) model. Our stimulus evokes spatially and temporally confined spiking responses in RGC which are accurately predicted by the LNP model. Furthermore, we find diverse shapes of linear filters in the linear stage of the model, suggesting diverse preferred electrical stimuli of RGCs. The linear filter base identified by our approach could provide a starting point of a model-guided search for improved stimuli for retinal prosthetics.

Extraretinal Spike Normalization in Retinal Ganglion Cell Axons

Spike conduction velocity characteristically differs between myelinated and unmyelinated axons. Here we test whether spikes of myelinated and unmyelinated paths differ in other respects by measuring rat retinal ganglion cell (RGC) spike duration in the intraretinal, unmyelinated nerve fiber layer and the extraretinal, myelinated optic nerve and optic chiasm. We find that rapid spike firing and illumination broaden spikes in intraretinal axons but not in extraretinal axons. RGC axons thus initiate spikes intraretinally and normalize spike duration extraretinally. Additionally, we analyze spikes that were recorded in a previous study of rhesus macaque retinogeniculate transmission and find that rapid spike firing does not broaden spikes in optic tract. The spike normalization we find reduces the number of spike properties that can change during RGC light responses. However, this is not because identical spikes fire in all axons. Instead, our recordings show that different subtypes of RGC generate axonal spikes of different durations and that the differences resemble spike duration increases that alter neurotransmitter release from other neurons. Moreover, previous studies have shown that RGC spikes of shorter duration can fire at higher maximum frequencies. These properties should facilitate signal transfer by different mechanisms at RGC synapses onto subcortical target neurons.

A Three-Dimensional Microelectrode Array to Generate Virtual Electrodes for Epiretinal Prosthesis Based on a Modeling Study

Despite many advances in the development of retinal prostheses, clinical reports show that current retinal prosthesis subjects can only perceive prosthetic vision with poor visual acuity. A possible approach for improving visual acuity is to produce virtual electrodes (VEs) through electric field modulation. Generating controllable and localized VEs is a crucial factor in effectively improving the perceptive resolution of the retinal prostheses. In this paper, we aimed to design a microelectrode array (MEA) that can produce converged and controllable VEs by current steering stimulation strategies. Through computational modeling, we designed a three-dimensional concentric ring–disc MEA and evaluated its performance with different stimulation strategies. Our simulation results showed that electrode–retina distance (ERD) and inter-electrode distance (IED) can dramatically affect the distribution of electric field. Also the converged VEs could be produced when the parameters of the three-dimensional MEA were appropriately set. VE sites can be controlled by manipulating the proportion of current on each adjacent electrode in a current steering group (CSG). In addition, spatial localization of electrical stimulation can be greatly improved under quasi-monopolar (QMP) stimulation. This study may provide support for future application of VEs in epiretinal prosthesis for potentially increasing the visual acuity of prosthetic vision.

Characteristics of prosthetic vision in rats with subretinal flat and pillar electrode arrays

Objective

Retinal prostheses aim to restore sight by electrically stimulating the surviving retinal neurons. In clinical trials of the current retinal implants, prosthetic visual acuity does not exceed 20/550. However, to provide meaningful restoration of central vision in patients blinded by age-related macular degeneration (AMD), prosthetic acuity should be at least 20/200, necessitating a pixel pitch of about 50 μm or lower. With such small pixels, stimulation thresholds are high due to limited penetration of electric field into tissue. Here, we address this challenge with our latest photovoltaic arrays and evaluate their performance in vivo.

Approach

We fabricated photovoltaic arrays with 55 and 40 μm pixels (a) in flat geometry, and (b) with active electrodes on 10 μm tall pillars. The arrays were implanted subretinally into rats with degenerate retina. Stimulation thresholds and grating acuity were evaluated using measurements of the visually evoked potentials (VEP).

Main results

With 55 μm pixels, we measured grating acuity of 48 ± 11 μm, which matches the linear pixel pitch of the hexagonal array. This geometrically corresponds to a visual acuity of 20/192 in a human eye, matching the threshold of legal blindness in the US (20/200). With pillar electrodes, the irradiance threshold was nearly halved, and duration threshold reduced by more than three-fold, compared to flat pixels. With 40 μm pixels, VEP was too low for reliable measurements of the grating acuity, even with pillar electrodes.

Significance

While being helpful for treating a complete loss of sight, current prosthetic technologies are insufficient for addressing the leading cause of untreatable visual impairment—AMD. Subretinal photovoltaic arrays may provide sufficient visual acuity for restoration of central vision in patients blinded by AMD.

STEM CELL THERAPIES, GENE-BASED THERAPIES, OPTOGENETICS, AND RETINAL PROSTHETICS: Current State and Implications for the Future

PURPOSE

To review and discuss current innovations and future implications of promising biotechnology and biomedical offerings in the field of retina. We focus on therapies that have already emerged as clinical offerings or are poised to do so.

METHODS

Literature review and commentary focusing on stem cell therapies, gene-based therapies, optogenetic therapies, and retinal prosthetic devices.

RESULTS

The technologies discussed herein are some of the more recent promising biotechnology and biomedical developments within the field of retina. Retinal prosthetic devices and gene-based therapies both have an FDA-approved product for ophthalmology, and many other offerings (including optogenetics) are in the pipeline. Stem cell therapies offer personalized medicine through novel regenerative mechanisms but entail complex ethical and reimbursement challenges.

CONCLUSION

Stem cell therapies, gene-based therapies, optogenetics, and retinal prosthetic devices represent a new era of biotechnological and biomedical progress. These bring new ethical, regulatory, care delivery, and reimbursement challenges. By addressing these issues proactively, we may accelerate delivery of care to patients in a safe, efficient, and value-based manner.

Epiretinal stimulation with local returns enhances selectivity at cellular resolution

OBJECTIVE

Epiretinal prostheses are designed to restore vision in people blinded by photoreceptor degenerative diseases, by directly activating retinal ganglion cells (RGCs) using an electrode array implanted on the retina. In present-day clinical devices, current spread from the stimulating electrode to a distant return electrode often results in the activation of many cells, potentially limiting the quality of artificial vision. In the laboratory, epiretinal activation of RGCs with cellular resolution has been demonstrated with small electrodes, but distant returns may still cause undesirable current spread. Here, the ability of local return stimulation to improve the selective activation of RGCs at cellular resolution was evaluated.

APPROACH

A custom multi-electrode array (512 electrodes, 10 μm diameter, 60 μm pitch) was used to simultaneously stimulate and record from RGCs in isolated primate retina. Stimulation near the RGC soma with a single electrode and a distant return was compared to stimulation in which the return was provided by six neighboring electrodes.

MAIN RESULTS

Local return stimulation enhanced the capability to activate cells near the central electrode (<30 μm) while avoiding cells farther away (>30 μm). This resulted in an improved ability to selectively activate ON and OFF cells, including cells encoding immediately adjacent regions in the visual field.

SIGNIFICANCE

These results suggest that a device that restricts the electric field through local returns could optimize activation of neurons at cellular resolution, improving the quality of artificial vision.

Simulation of visual perception and learning with a retinal prosthesis

OBJECTIVE

The nature of artificial vision with a retinal prosthesis, and the degree to which the brain can adapt to the unnatural input from such a device, are poorly understood. Therefore, the development of current and future devices may be aided by theory and simulations that help to infer and understand what prosthesis patients see.

APPROACH

A biologically-informed, extensible computational framework is presented here to predict visual perception and the potential effect of learning with a subretinal prosthesis. The framework relies on optimal linear reconstruction of the stimulus from retinal responses to infer the visual information available to the patient. A simulation of the physiological optics of the eye and light responses of the major retinal neurons was used to calculate the optimal linear transformation for reconstructing natural images from retinal activity. The result was then used to reconstruct the visual stimulus during the artificial activation expected from a subretinal prosthesis in a degenerated retina, as a proxy for inferred visual perception.

MAIN RESULTS

Several simple observations reveal the potential utility of such a simulation framework. The inferred perception obtained with prosthesis activation was substantially degraded compared to the inferred perception obtained with normal retinal responses, as expected given the limited resolution and lack of cell type specificity of the prosthesis. Consistent with clinical findings and the importance of cell type specificity, reconstruction using only ON cells, and not OFF cells, was substantially more accurate. Finally, when reconstruction was re-optimized for prosthesis stimulation, simulating the greatest potential for learning by the patient, the accuracy of inferred perception was much closer to that of healthy vision.

SIGNIFICANCE

The reconstruction approach thus provides a more complete method for exploring the potential for treating blindness with retinal prostheses than has been available previously. It may also be useful for interpreting patient data in clinical trials, and for improving prosthesis design.

Restoring Sight with Retinal Prostheses

Vision begins when the eye's optical system-the cornea, iris, and crystalline lens-projects an image onto the retina, the thin and nearly transparent sheet of neural tissue that lines the back of the eye (see figure 1). Photoreceptors located at the back of the retina transduce incident photons into neural signals that are relayed to the brain. Those signals form the basis for visual perception. In humans, cone photoreceptors, which number about 6 million, dominate the central region of the visual field and are responsible for color and high-resolution day vision. Rod photoreceptors, which number about 120 million, dominate the periphery and mediate night vision.

Increasing Electrical Stimulation Efficacy in Degenerated Retina: Stimulus Waveform Design in a Multiscale Computational Model

A computational model of electrical stimulation of the retina is proposed for investigating current waveforms used in prosthetic devices for restoring partial vision lost to retinal degenerative diseases. The model framework combines a connectome-based neural network model characterized by accurate morphological and synaptic properties with an admittance method model of bulk tissue and prosthetic electronics. In this model, the retina was computationally "degenerated," considering cellular death and anatomical changes that occur early in disease, as well as altered neural behavior that develops throughout the neurodegeneration and is likely interfering with current attempts at restoring vision. A resulting analysis of stimulation range and threshold of ON ganglion cells within the retina that are either healthy or in beginning stages of degeneration is presented for currently used stimulation waveforms, and an asymmetric biphasic current stimulation for subduing spontaneous firing to allow increased control over ganglion cell firing patterns in degenerated retina is proposed. Results show that stimulation thresholds of retinal ganglion cells do not notably vary after beginning stages of retina degeneration. In addition, simulation of proposed asymmetric waveforms showed the ability to enhance the control of ganglion cell firing via electrical stimulation.

Minimizing activation of overlying axons with epiretinal stimulation: The role of fiber orientation and electrode configuration

Currently, a challenge in electrical stimulation of the retina with a visual prosthesis (bionic eye) is to excite only the cells lying directly under the electrode in the ganglion cell layer, while avoiding excitation of axon bundles that pass over the surface of the retina in the nerve fiber layer. Stimulation of overlying axons results in irregular visual percepts, limiting perceptual efficacy. This research explores how differences in fiber orientation between the nerve fiber layer and ganglion cell layer leads to differences in the electrical activation of the axon initial segment and axons of passage. Approach. Axons of passage of retinal ganglion cells in the nerve fiber layer are characterized by a narrow distribution of fiber orientations, causing highly anisotropic spread of applied current. In contrast, proximal axons in the ganglion cell layer have a wider distribution of orientations. A four-layer computational model of epiretinal extracellular stimulation that captures the effect of neurite orientation in anisotropic tissue has been developed using a volume conductor model known as the cellular composite model. Simulations are conducted to investigate the interaction of neural tissue orientation, stimulating electrode configuration, and stimulation pulse duration and amplitude. Main results. Our model shows that simultaneous stimulation with multiple electrodes aligned with the nerve fiber layer can be used to achieve selective activation of axon initial segments rather than passing fibers. This result can be achieved while reducing required stimulus charge density and with only modest increases in the spread of activation in the ganglion cell layer, and is shown to extend to the general case of arbitrary electrode array positioning and arbitrary target volume. Significance. These results elucidate a strategy for more targeted stimulation of retinal ganglion cells with experimentally-relevant multi-electrode geometries and achievable stimulation requirements.

Electrical receptive fields of retinal ganglion cells: Influence of presynaptic neurons

Implantable retinal stimulators activate surviving neurons to restore a sense of vision in people who have lost their photoreceptors through degenerative diseases. Complex spatial and temporal interactions occur in the retina during multi-electrode stimulation. Due to these complexities, most existing implants activate only a few electrodes at a time, limiting the repertoire of available stimulation patterns. Measuring the spatiotemporal interactions between electrodes and retinal cells, and incorporating them into a model may lead to improved stimulation algorithms that exploit the interactions. Here, we present a computational model that accurately predicts both the spatial and temporal nonlinear interactions of multi-electrode stimulation of rat retinal ganglion cells (RGCs). The model was verified using in vitro recordings of ON, OFF, and ON-OFF RGCs in response to subretinal multi-electrode stimulation with biphasic pulses at three stimulation frequencies (10, 20, 30 Hz). The model gives an estimate of each cell’s spatiotemporal electrical receptive fields (ERFs); i.e., the pattern of stimulation leading to excitation or suppression in the neuron. All cells had excitatory ERFs and many also had suppressive sub-regions of their ERFs. We show that the nonlinearities in observed responses arise largely from activation of presynaptic interneurons. When synaptic transmission was blocked, the number of sub-regions of the ERF was reduced, usually to a single excitatory ERF. This suggests that direct cell activation can be modeled accurately by a one-dimensional model with linear interactions between electrodes, whereas indirect stimulation due to summated presynaptic responses is nonlinear.

Implantable neural stimulation devices are being widely used and clinically tested for the restoration of lost function (e.g. cochlear implants) and the treatment of neurological disorders. Smart devices that can combine sensing and stimulation will dramatically improve future patient outcomes. To this end, mathematical models that can accurately predict neural responses to electrical stimulation will be critical for the development of smart stimulation devices. Here, we demonstrate a model that predicts neural responses to simultaneous stimulation across multiple electrodes in the retina. We show that the activation of presynaptic neurons leads to nonlinearities in the responses of postsynaptic retinal ganglion cells. The model is accurate and is applicable to a wide range of neural stimulation devices.

Electric stimulus duration alters network-mediated responses depending on retinal ganglion cell type

OBJECTIVE

To improve the quality of artificial vision that arises from retinal prostheses, it is important to bring electrically-elicited neural activity more in line with the physiological signaling patterns that arise normally in the healthy retina. Our previous study reported that indirect activation produces a closer match to physiological responses in ON retinal ganglion cells (RGCs) than in OFF cells (Im and Fried 2015 J. Physiol. 593 3677-96). This suggests that a preferential activation of ON RGCs would shape the overall retinal response closer to natural signaling. Recently, we found that changes to the rate at which stimulation was delivered could bias responses towards a stronger ON component (Im and Fried 2016a J. Neural Eng. 13 025002), raising the possibility that changes to other stimulus parameters can similarly bias towards stronger ON responses. Here, we explore the effects of changing stimulus duration on the responses in ON and OFF types of brisk transient (BT) and brisk sustained (BS) RGCs.

APPROACH

We used cell-attached patch clamp to record RGC spiking in the isolated rabbit retina. Targeted RGCs were first classified as ON or OFF type by their light responses, and further sub-classified as BT or BS types by their responses to both light and electric stimuli. Spiking in targeted RGCs was recorded in response to electric pulses with durations varying from 5 to100 ms. Stimulus amplitude was adjusted at each duration to hold total charge constant for all experiments.

MAIN RESULTS

We found that varying stimulus durations modulated responses differentially for ON versus OFF cells: in ON cells, spike counts decreased significantly with increasing stimulus duration while in OFF cells the changes were more modest. The maximum ratio of ON versus OFF responses occurred at a duration of ~10 ms. The difference in response strength for BT versus BS cells was much larger in ON cells than in OFF cells.

SIGNIFICANCE

The stimulation rates preferred by subjects during clinical trials are similar to the rates that maximize the ON/OFF response ratio in in vitro testing (Im and Fried 2016a J. Neural Eng. 13 025002). Here, we determine the stimulus duration that produces the strongest bias towards ON responses and speculate that it will further enhance clinical effectiveness.

Electrical Stimulation of the Retina to Produce Artificial Vision

Retinal prostheses aim to restore vision to blind individuals suffering from retinal diseases such as retinitis pigmentosa and age-related macular degeneration. These devices function by electrically stimulating surviving retinal neurons, whose activation is interpreted by the brain as a visual percept. Many prostheses are currently under development. They are categorized as epiretinal, subretinal, and suprachoroidal prostheses on the basis of the placement of the stimulating microelectrode array. Each can activate ganglion cells through direct or indirect stimulation. The response of retinal neurons to these modes of stimulation are discussed in detail and are placed in context of the visual percept they are likely to evoke. This article further reviews challenges faced by retinal prosthesis and discusses potential solutions to address them.

Electrical stimulus artifact cancellation and neural spike detection on large multi-electrode arrays

Simultaneous electrical stimulation and recording using multi-electrode arrays can provide a valuable technique for studying circuit connectivity and engineering neural interfaces. However, interpreting these measurements is challenging because the spike sorting process (identifying and segregating action potentials arising from different neurons) is greatly complicated by electrical stimulation artifacts across the array, which can exhibit complex and nonlinear waveforms, and overlap temporarily with evoked spikes. Here we develop a scalable algorithm based on a structured Gaussian Process model to estimate the artifact and identify evoked spikes. The effectiveness of our methods is demonstrated in both real and simulated 512-electrode recordings in the peripheral primate retina with single-electrode and several types of multi-electrode stimulation. We establish small error rates in the identification of evoked spikes, with a computational complexity that is compatible with real-time data analysis. This technology may be helpful in the design of future high-resolution sensory prostheses based on tailored stimulation (e.g., retinal prostheses), and for closed-loop neural stimulation at a much larger scale than currently possible.

An optimized content-aware image retargeting method: toward expanding the perceived visual field of the high-density retinal prosthesis recipients

OBJECTIVE

Retinal prosthesis devices have shown great value in restoring some sight for individuals with profoundly impaired vision, but the visual acuity and visual field provided by prostheses greatly limit recipients' visual experience. In this paper, we employ computer vision approaches to seek to expand the perceptible visual field in patients implanted potentially with a high-density retinal prosthesis while maintaining visual acuity as much as possible.

APPROACH

We propose an optimized content-aware image retargeting method, by introducing salient object detection based on color and intensity-difference contrast, aiming to remap important information of a scene into a small visual field and preserve their original scale as much as possible. It may improve prosthetic recipients' perceived visual field and aid in performing some visual tasks (e.g. object detection and object recognition). To verify our method, psychophysical experiments, detecting object number and recognizing objects, are conducted under simulated prosthetic vision. As control, we use three other image retargeting techniques, including Cropping, Scaling, and seam-assisted shrinkability.

MAIN RESULTS

Results show that our method outperforms in preserving more key features and has significantly higher recognition accuracy in comparison with other three image retargeting methods under the condition of small visual field and low-resolution.

SIGNIFICANCE

The proposed method is beneficial to expand the perceived visual field of prosthesis recipients and improve their object detection and recognition performance. It suggests that our method may provide an effective option for image processing module in future high-density retinal implants.

Activation of ganglion cells and axon bundles using epiretinal electrical stimulation

Epiretinal prostheses for treating blindness activate axon bundles, causing large, arc-shaped visual percepts that limit the quality of artificial vision. Improving the function of epiretinal prostheses therefore requires understanding and avoiding axon bundle activation. This study introduces a method to detect axon bundle activation on the basis of its electrical signature and uses the method to test whether epiretinal stimulation can directly elicit spikes in individual retinal ganglion cells without activating nearby axon bundles. Combined electrical stimulation and recording from isolated primate retina were performed using a custom multielectrode system (512 electrodes, 10-μm diameter, 60-μm pitch). Axon bundle signals were identified by their bidirectional propagation, speed, and increasing amplitude as a function of stimulation current. The threshold for bundle activation varied across electrodes and retinas, and was in the same range as the threshold for activating retinal ganglion cells near their somas. In the peripheral retina, 45% of electrodes that activated individual ganglion cells (17% of all electrodes) did so without activating bundles. This permitted selective activation of 21% of recorded ganglion cells (7% of expected ganglion cells) over the array. In one recording in the central retina, 75% of electrodes that activated individual ganglion cells (16% of all electrodes) did so without activating bundles. The ability to selectively activate a subset of retinal ganglion cells without axon bundles suggests a possible novel architecture for future epiretinal prostheses.NEW & NOTEWORTHY Large-scale multielectrode recording and stimulation were used to test how selectively retinal ganglion cells can be electrically activated without activating axon bundles. A novel method was developed to identify axon activation on the basis of its unique electrical signature and was used to find that a subset of ganglion cells can be activated at single-cell, single-spike resolution without producing bundle activity in peripheral and central retina. These findings have implications for the development of advanced retinal prostheses.

Optimal voltage stimulation parameters for network-mediated responses in wild type and rd10 mouse retinal ganglion cells

To further improve the quality of visual percepts elicited by microelectronic retinal prosthetics, substantial efforts have been made to understand how retinal neurons respond to electrical stimulation. It is generally assumed that a sufficiently strong stimulus will recruit most retinal neurons. However, recent evidence has shown that the responses of some retinal neurons decrease with excessively strong stimuli (a non-monotonic response function). Therefore, it is necessary to identify stimuli that can be used to activate the majority of retinal neurons even when such non-monotonic cells are part of the neuronal population. Taking these non-monotonic responses into consideration, we establish the optimal voltage stimulation parameters (amplitude, duration, and polarity) for epiretinal stimulation of network-mediated (indirect) ganglion cell responses. We recorded responses from 3958 mouse retinal ganglion cells (RGCs) in both healthy (wild type, WT) and a degenerating (rd10) mouse model of retinitis pigmentosa-using flat-mounted retina on a microelectrode array. Rectangular monophasic voltage-controlled pulses were presented with varying voltage, duration, and polarity. We found that in 4-5 weeks old rd10 mice the RGC thresholds were comparable to those of WT. There was a marked response variability among mouse RGCs. To account for this variability, we interpolated the percentage of RGCs activated at each point in the voltage-polarity-duration stimulus space, thus identifying the optimal voltage-controlled pulse (-2.4 V, 0.88 ms). The identified optimal voltage pulse can activate at least 65% of potentially responsive RGCs in both mouse strains. Furthermore, this pulse is well within the range of stimuli demonstrated to be safe and effective for retinal implant patients. Such optimized stimuli and the underlying method used to identify them support a high yield of responsive RGCs and will serve as an effective guideline for future in vitro investigations of retinal electrostimulation by establishing standard stimuli for each unique experimental condition.

Improving the spatial resolution of epiretinal implants by increasing stimulus pulse duration

Retinal prosthetic implants are the only approved treatment for retinitis pigmentosa, a disease of the eye that causes blindness through gradual degeneration of photoreceptors. An array of microelectrodes triggered by input from a camera stimulates surviving retinal neurons, with each electrode acting as a pixel. Unintended stimulation of retinal ganglion cell axons causes patients to see large oblong shapes of light, rather than focal spots, making it difficult to perceive forms. To address this problem, we performed calcium imaging in isolated retinas and mapped the patterns of cells activated by different electrical stimulation protocols. We found that pulse durations two orders of magnitude longer than those typically used in existing implants stimulated inner retinal neurons while avoiding activation of ganglion cell axons, thus confining retinal responses to the site of the electrode. Multielectrode stimulation with 25-ms pulses can pattern letters on the retina corresponding to a Snellen acuity of 20/312. We validated our findings in a patient with an implanted epiretinal prosthesis by demonstrating that 25-ms pulses evoke focal spots of light.

Electronic approaches to restoration of sight

Retinal prostheses are a promising means for restoring sight to patients blinded by the gradual atrophy of photoreceptors due to retinal degeneration. They are designed to reintroduce information into the visual system by electrically stimulating surviving neurons in the retina. This review outlines the concepts and technologies behind two major approaches to retinal prosthetics: epiretinal and subretinal. We describe how the visual system responds to electrical stimulation. We highlight major differences between direct encoding of the retinal output with epiretinal stimulation, and network-mediated response with subretinal stimulation. We summarize results of pre-clinical evaluation of prosthetic visual functions in- and ex vivo, as well as the outcomes of current clinical trials of various retinal implants. We also briefly review alternative, non-electronic, approaches to restoration of sight to the blind, and conclude by suggesting some perspectives for future advancement in the field.

The effects of temperature changes on retinal ganglion cell responses to electrical stimulation

Little is known about how the retina's response to electrical stimulation is modified by temperatures. In vitro experiments are often used to inform in vivo studies, hence it is important to understand what changes occur at physiological temperature. To investigate this, we recorded from eight RGCs in vitro at three temperatures; room temperature (24°C), 30°C and 34°C. Results show that response latencies and thresholds are reduced, bursting spike rates in response to stimulation increases, and the spiking becomes more consistently locked to the stimulus at higher temperatures.

Probing the functional impact of sub-retinal prosthesis

Retinal prostheses are promising tools for recovering visual functions in blind patients but, unfortunately, with still poor gains in visual acuity. Improving their resolution is thus a key challenge that warrants understanding its origin through appropriate animal models. Here, we provide a systematic comparison between visual and prosthetic activations of the rat primary visual cortex (V1). We established a precise V1 mapping as a functional benchmark to demonstrate that sub-retinal implants activate V1 at the appropriate position, scalable to a wide range of visual luminance, but with an aspect-ratio and an extent much larger than expected. Such distorted activation profile can be accounted for by the existence of two sources of diffusion, passive diffusion and activation of ganglion cells’ axons en passant. Reverse-engineered electrical pulses based on impedance spectroscopy is the only solution we tested that decreases the extent and aspect-ratio, providing a promising solution for clinical applications.

DOI:http://dx.doi.org/10.7554/eLife.12687.001

One of the most common causes of blindness is a disorder called retinitis pigmentosa. In a healthy eye, the surface at the back of the eye – called the retina – contains cells called photoreceptors that detect light and convert it into electrical signals for the brain to process. In people with retinitis pigmentosa, these photoreceptor cells die off gradually, which leads to loss of vision.

The only treatment available for retinitis pigmentosa is to have an artificial retina implanted into the eye. The artificial retina consists of an array of tiny electrodes, which take over from the damaged photoreceptors and generate electrical signals. The person with the implant perceives these electrical signals as bright flashes called “phosphenes”. However, the phosphenes are too large and imprecise to provide the person with vision that is good enough for tasks such as walking unaided or reading.

To find out why artificial retinas produce such poor resolution, Roux et al. compared how a rat’s brain responds to either natural visual stimuli or activation of implanted an array of micro-electrodes. Both the micro-electrodes and the natural stimuli activated the same areas of the brain. However, the micro-electrodes produced larger and more elongated patterns of activation. This is because the electrical currents generated by the micro-electrodes diffused throughout the retinal tissue and activated other neurons besides those intended. To overcome this problem, Roux et al. tested different ways of stimulating the micro-electrodes in order to identify those that induce the desired patterns of brain activity. This approach – known as reverse engineering – did indeed improve the performance of the micro-electrode array.

The next step is to extend these findings, which were obtained in healthy rats, to non-human primates or animal models of retinitis pigmentosa to better understand the condition in humans. In addition, combining the current approach with other existing techniques should further improve the vision that can be achieved with artificial retinas.

DOI:http://dx.doi.org/10.7554/eLife.12687.002