1
|
Holiel HA, Fawzi SA, Al-Atabany W. Pre-processing visual scenes for retinal prosthesis systems: A comprehensive review. Artif Organs 2024. [PMID: 39023279 DOI: 10.1111/aor.14824] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Revised: 05/13/2024] [Accepted: 06/21/2024] [Indexed: 07/20/2024]
Abstract
BACKGROUND Retinal prostheses offer hope for individuals with degenerative retinal diseases by stimulating the remaining retinal cells to partially restore their vision. This review delves into the current advancements in retinal prosthesis technology, with a special emphasis on the pivotal role that image processing and machine learning techniques play in this evolution. METHODS We provide a comprehensive analysis of the existing implantable devices and optogenetic strategies, delineating their advantages, limitations, and challenges in addressing complex visual tasks. The review extends to various image processing algorithms and deep learning architectures that have been implemented to enhance the functionality of retinal prosthetic devices. We also illustrate the testing results by demonstrating the clinical trials or using Simulated Prosthetic Vision (SPV) through phosphene simulations, which is a critical aspect of simulating visual perception for retinal prosthesis users. RESULTS Our review highlights the significant progress in retinal prosthesis technology, particularly its capacity to augment visual perception among the visually impaired. It discusses the integration between image processing and deep learning, illustrating their impact on individual interactions and navigations within the environment through applying clinical trials and also illustrating the limitations of some techniques to be used with current devices, as some approaches only use simulation even on sighted-normal individuals or rely on qualitative analysis, where some consider realistic perception models and others do not. CONCLUSION This interdisciplinary field holds promise for the future of retinal prostheses, with the potential to significantly enhance the quality of life for individuals with retinal prostheses. Future research directions should pivot towards optimizing phosphene simulations for SPV approaches, considering the distorted and confusing nature of phosphene perception, thereby enriching the visual perception provided by these prosthetic devices. This endeavor will not only improve navigational independence but also facilitate a more immersive interaction with the environment.
Collapse
Affiliation(s)
- Heidi Ahmed Holiel
- Medical Imaging and Image Processing Research Group, Center for Informatics Science, Nile University, Sheikh Zayed City, Egypt
| | - Sahar Ali Fawzi
- Medical Imaging and Image Processing Research Group, Center for Informatics Science, Nile University, Sheikh Zayed City, Egypt
- Systems and Biomedical Engineering Department, Cairo University, Giza, Egypt
| | - Walid Al-Atabany
- Medical Imaging and Image Processing Research Group, Center for Informatics Science, Nile University, Sheikh Zayed City, Egypt
- Biomedical Engineering Department, Helwan University, Helwan, Egypt
| |
Collapse
|
2
|
Corna A, Cojocaru AE, Bui MT, Werginz P, Zeck G. Avoidance of axonal stimulation with sinusoidal epiretinal stimulation. J Neural Eng 2024; 21:026036. [PMID: 38547529 DOI: 10.1088/1741-2552/ad38de] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Accepted: 03/28/2024] [Indexed: 04/11/2024]
Abstract
Objective.Neuromodulation, particularly electrical stimulation, necessitates high spatial resolution to achieve artificial vision with high acuity. In epiretinal implants, this is hindered by the undesired activation of distal axons. Here, we investigate focal and axonal activation of retinal ganglion cells (RGCs) in epiretinal configuration for different sinusoidal stimulation frequencies.Approach.RGC responses to epiretinal sinusoidal stimulation at frequencies between 40 and 100 Hz were tested inex-vivophotoreceptor degenerated (rd10) isolated retinae. Experiments were conducted using a high-density CMOS-based microelectrode array, which allows to localize RGC cell bodies and axons at high spatial resolution.Main results.We report current and charge density thresholds for focal and distal axon activation at stimulation frequencies of 40, 60, 80, and 100 Hz for an electrode size with an effective area of 0.01 mm2. Activation of distal axons is avoided up to a stimulation amplitude of 0.23µA (corresponding to 17.3µC cm-2) at 40 Hz and up to a stimulation amplitude of 0.28µA (14.8µC cm-2) at 60 Hz. The threshold ratio between focal and axonal activation increases from 1.1 for 100 Hz up to 1.6 for 60 Hz, while at 40 Hz stimulation frequency, almost no axonal responses were detected in the tested intensity range. With the use of synaptic blockers, we demonstrate the underlying direct activation mechanism of the ganglion cells. Finally, using high-resolution electrical imaging and label-free electrophysiological axon tracking, we demonstrate the extent of activation in axon bundles.Significance.Our results can be exploited to define a spatially selective stimulation strategy avoiding axonal activation in future retinal implants, thereby solving one of the major limitations of artificial vision. The results may be extended to other fields of neuroprosthetics to achieve selective focal electrical stimulation.
Collapse
Affiliation(s)
- Andrea Corna
- Institute of Biomedical Electronics, TU Wien, Vienna, Austria
| | | | - Mai Thu Bui
- Institute of Biomedical Electronics, TU Wien, Vienna, Austria
| | - Paul Werginz
- Institute of Biomedical Electronics, TU Wien, Vienna, Austria
| | - Günther Zeck
- Institute of Biomedical Electronics, TU Wien, Vienna, Austria
| |
Collapse
|
3
|
Shokri M, Gogliettino AR, Hottowy P, Sher A, Litke AM, Chichilnisky EJ, Pequito S, Muratore D. Spike sorting in the presence of stimulation artifacts: a dynamical control systems approach. J Neural Eng 2024; 21:016022. [PMID: 38271715 PMCID: PMC10853761 DOI: 10.1088/1741-2552/ad228f] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Revised: 11/08/2023] [Accepted: 01/25/2024] [Indexed: 01/27/2024]
Abstract
Objective. Bi-directional electronic neural interfaces, capable of both electrical recording and stimulation, communicate with the nervous system to permit precise calibration of electrical inputs by capturing the evoked neural responses. However, one significant challenge is that stimulation artifacts often mask the actual neural signals. To address this issue, we introduce a novel approach that employs dynamical control systems to detect and decipher electrically evoked neural activity despite the presence of electrical artifacts.Approach. Our proposed method leverages the unique spatiotemporal patterns of neural activity and electrical artifacts to distinguish and identify individual neural spikes. We designed distinctive dynamical models for both the stimulation artifact and each neuron observed during spontaneous neural activity. We can estimate which neurons were active by analyzing the recorded voltage responses across multiple electrodes post-stimulation. This technique also allows us to exclude signals from electrodes heavily affected by stimulation artifacts, such as the stimulating electrode itself, yet still accurately differentiate between evoked spikes and electrical artifacts.Main results. We applied our method to high-density multi-electrode recordings from the primate retina in anex vivosetup, using a grid of 512 electrodes. Through repeated electrical stimulations at varying amplitudes, we were able to construct activation curves for each neuron. The curves obtained with our method closely resembled those derived from manual spike sorting. Additionally, the stimulation thresholds we estimated strongly agreed with those determined through manual analysis, demonstrating high reliability (R2=0.951for human 1 andR2=0.944for human 2).Significance. Our method can effectively separate evoked neural spikes from stimulation artifacts by exploiting the distinct spatiotemporal propagation patterns captured by a dense, large-scale multi-electrode array. This technique holds promise for future applications in real-time closed-loop stimulation systems and for managing multi-channel stimulation strategies.
Collapse
Affiliation(s)
- Mohammad Shokri
- Delft Center for Systems and Control, Delft University of Technology, Delft 2628 CN, The Netherlands
| | - Alex R Gogliettino
- Neurosciences PhD Program, Stanford University, Stanford, CA 94305, United States of America
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA 94305, United States of America
| | - Paweł Hottowy
- Faculty of Physics and Applied Computer Science, AGH University of Krakow, Krakow, Poland
| | - Alexander Sher
- Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, CA, United States of America
| | - Alan M Litke
- Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, CA, United States of America
| | - E J Chichilnisky
- Departments of Neurosurgery and Ophthalmology, Stanford University, Stanford, CA 94305, United States of America
| | - Sérgio Pequito
- Division of Systems and Control, Department of Information Technology, Uppsala University, 751 05 Uppsala, Sweden
| | - Dante Muratore
- Microelectronics Department, Delft University of Technology, Delft 2628 CN, The Netherlands
| |
Collapse
|
4
|
Lavoie J, Besrour M, Lemaire W, Rouat J, Fontaine R, Plourde E. Learning to see via epiretinal implant stimulation in silicowith model-based deep reinforcement learning. Biomed Phys Eng Express 2024; 10:025006. [PMID: 37595568 DOI: 10.1088/2057-1976/acf1a5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Accepted: 08/18/2023] [Indexed: 08/20/2023]
Abstract
OBJECTIVE Diseases such as age-related macular degeneration and retinitis pigmentosa cause the degradation of the photoreceptor layer. One approach to restore vision is to electrically stimulate the surviving retinal ganglion cells with a microelectrode array such as epiretinal implants. Epiretinal implants are known to generate visible anisotropic shapes elongated along the axon fascicles of neighboring retinal ganglion cells. Recent work has demonstrated that to obtain isotropic pixel-like shapes, it is possible to map axon fascicles and avoid stimulating them by inactivating electrodes or lowering stimulation current levels. Avoiding axon fascicule stimulation aims to remove brushstroke-like shapes in favor of a more reduced set of pixel-like shapes. APPROACH In this study, we propose the use of isotropic and anisotropic shapes to render intelligible images on the retina of a virtual patient in a reinforcement learning environment named rlretina. The environment formalizes the task as using brushstrokes in a stroke-based rendering task. MAIN RESULTS We train a deep reinforcement learning agent that learns to assemble isotropic and anisotropic shapes to form an image. We investigate which error-based or perception-based metrics are adequate to reward the agent. The agent is trained in a model-based data generation fashion using the psychophysically validated axon map model to render images as perceived by different virtual patients. We show that the agent can generate more intelligible images compared to the naive method in different virtual patients. SIGNIFICANCE This work shares a new way to address epiretinal stimulation that constitutes a first step towards improving visual acuity in artificially-restored vision using anisotropic phosphenes.
Collapse
Affiliation(s)
- Jacob Lavoie
- Department of Electrical Engineering and Computer Engineering, Université de Sherbrooke, Sherbrooke, Quebec, J1K 2R1, Canada
| | - Marwan Besrour
- Department of Electrical Engineering and Computer Engineering, Université de Sherbrooke, Sherbrooke, Quebec, J1K 2R1, Canada
| | - William Lemaire
- Department of Electrical Engineering and Computer Engineering, Université de Sherbrooke, Sherbrooke, Quebec, J1K 2R1, Canada
| | - Jean Rouat
- Department of Electrical Engineering and Computer Engineering, Université de Sherbrooke, Sherbrooke, Quebec, J1K 2R1, Canada
| | - Réjean Fontaine
- Department of Electrical Engineering and Computer Engineering, Université de Sherbrooke, Sherbrooke, Quebec, J1K 2R1, Canada
| | - Eric Plourde
- Department of Electrical Engineering and Computer Engineering, Université de Sherbrooke, Sherbrooke, Quebec, J1K 2R1, Canada
| |
Collapse
|
5
|
Ahn J, Yoo Y, Goo YS. Multiple consecutive-biphasic pulse stimulation improves spatially localized firing of retinal ganglion cells in the degenerate retina. THE KOREAN JOURNAL OF PHYSIOLOGY & PHARMACOLOGY : OFFICIAL JOURNAL OF THE KOREAN PHYSIOLOGICAL SOCIETY AND THE KOREAN SOCIETY OF PHARMACOLOGY 2023; 27:541-553. [PMID: 37884286 PMCID: PMC10613570 DOI: 10.4196/kjpp.2023.27.6.541] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Revised: 08/08/2023] [Accepted: 08/22/2023] [Indexed: 10/28/2023]
Abstract
Retinal prostheses have shown some clinical success in restoring vision in patients with retinitis pigmentosa. However, the post-implantation visual acuity does not exceed that of legal blindness. The reason for the poor visual acuity might be that (1) degenerate retinal ganglion cells (RGCs) are less responsive to electrical stimulation than normal RGCs, and (2) electrically-evoked RGC spikes show a more widespread not focal response. The single-biphasic pulse electrical stimulation, commonly used in artificial vision, has limitations in addressing these issues. In this study, we propose the benefit of multiple consecutive-biphasic pulse stimulation. We used C57BL/6J mice and C3H/HeJ (rd1) mice for the normal retina and retinal degeneration model. An 8 × 8 multi-electrode array was used to record electrically-evoked RGC spikes. We compared RGC responses when increasing the amplitude of a single biphasic pulse versus increasing the number of consecutive biphasic pulses at the same stimulus charge. Increasing the amplitude of a single biphasic pulse induced more RGC spike firing while the spatial resolution of RGC populations decreased. For multiple consecutive-biphasic pulse stimulation, RGC firing increased as the number of pulses increased, and the spatial resolution of RGC populations was well preserved even up to 5 pulses. Multiple consecutive-biphasic pulse stimulation using two or three pulses in degenerate retinas induced as much RGC spike firing as in normal retinas. These findings suggest that the newly proposed multiple consecutive-biphasic pulse stimulation can improve the visual acuity in prosthesis-implanted patients.
Collapse
Affiliation(s)
- Jungryul Ahn
- Department of Physiology, Chungbuk National University School of Medicine, Cheongju 28644, Korea
| | - Yongseok Yoo
- School of Computer Science and Engineering, Soongsil University, Seoul 06978, Korea
| | - Yong Sook Goo
- Department of Physiology, Chungbuk National University School of Medicine, Cheongju 28644, Korea
| |
Collapse
|
6
|
Zaidi M, Aggarwal G, Shah NP, Karniol-Tambour O, Goetz G, Madugula SS, Gogliettino AR, Wu EG, Kling A, Brackbill N, Sher A, Litke AM, Chichilnisky EJ. Inferring light responses of primate retinal ganglion cells using intrinsic electrical signatures. J Neural Eng 2023; 20:10.1088/1741-2552/ace657. [PMID: 37433293 PMCID: PMC11067857 DOI: 10.1088/1741-2552/ace657] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Accepted: 07/11/2023] [Indexed: 07/13/2023]
Abstract
Objective. Retinal implants are designed to stimulate retinal ganglion cells (RGCs) in a way that restores sight to individuals blinded by photoreceptor degeneration. Reproducing high-acuity vision with these devices will likely require inferring the natural light responses of diverse RGC types in the implanted retina, without being able to measure them directly. Here we demonstrate an inference approach that exploits intrinsic electrophysiological features of primate RGCs.Approach.First, ON-parasol and OFF-parasol RGC types were identified using their intrinsic electrical features in large-scale multi-electrode recordings from macaque retina. Then, the electrically inferred somatic location, inferred cell type, and average linear-nonlinear-Poisson model parameters of each cell type were used to infer a light response model for each cell. The accuracy of the cell type classification and of reproducing measured light responses with the model were evaluated.Main results.A cell-type classifier trained on 246 large-scale multi-electrode recordings from 148 retinas achieved 95% mean accuracy on 29 test retinas. In five retinas tested, the inferred models achieved an average correlation with measured firing rates of 0.49 for white noise visual stimuli and 0.50 for natural scenes stimuli, compared to 0.65 and 0.58 respectively for models fitted to recorded light responses (an upper bound). Linear decoding of natural images from predicted RGC activity in one retina showed a mean correlation of 0.55 between decoded and true images, compared to an upper bound of 0.81 using models fitted to light response data.Significance.These results suggest that inference of RGC light response properties from intrinsic features of their electrical activity may be a useful approach for high-fidelity sight restoration. The overall strategy of first inferring cell type from electrical features and then exploiting cell type to help infer natural cell function may also prove broadly useful to neural interfaces.
Collapse
Affiliation(s)
- Moosa Zaidi
- Stanford University School of Medicine, Stanford University, Stanford, CA, United States of America
- Neurosurgery, Stanford University, Stanford, CA, United States of America
| | - Gorish Aggarwal
- Neurosurgery, Stanford University, Stanford, CA, United States of America
- Electrical Engineering, Stanford University, Stanford, CA, United States of America
| | - Nishal P Shah
- Neurosurgery, Stanford University, Stanford, CA, United States of America
| | - Orren Karniol-Tambour
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, United States of America
| | - Georges Goetz
- Neurosurgery, Stanford University, Stanford, CA, United States of America
| | - Sasidhar S Madugula
- Stanford University School of Medicine, Stanford University, Stanford, CA, United States of America
- Neurosciences, Stanford University, Stanford, CA, United States of America
| | - Alex R Gogliettino
- Neurosciences, Stanford University, Stanford, CA, United States of America
| | - Eric G Wu
- Electrical Engineering, Stanford University, Stanford, CA, United States of America
| | - Alexandra Kling
- Neurosurgery, Stanford University, Stanford, CA, United States of America
| | - Nora Brackbill
- Physics, Stanford University, Stanford, CA, United States of America
| | - Alexander Sher
- Santa Cruz Institute for Particle Physics, University of California Santa Cruz, Santa Cruz, CA, United States of America
| | - Alan M Litke
- Santa Cruz Institute for Particle Physics, University of California Santa Cruz, Santa Cruz, CA, United States of America
| | - E J Chichilnisky
- Neurosurgery, Stanford University, Stanford, CA, United States of America
- Ophthalmology, Stanford University, Stanford, CA, United States of America
| |
Collapse
|
7
|
Palanker D. Electronic Retinal Prostheses. Cold Spring Harb Perspect Med 2023; 13:a041525. [PMID: 36781222 PMCID: PMC10411866 DOI: 10.1101/cshperspect.a041525] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/15/2023]
Abstract
Retinal prostheses are a promising means for restoring sight to patients blinded by photoreceptor atrophy. They introduce visual information by electrical stimulation of the surviving inner retinal neurons. Subretinal implants target the graded-response secondary neurons, primarily the bipolar cells, which then transfer the information to the ganglion cells via the retinal neural network. Therefore, many features of natural retinal signal processing can be preserved in this approach if the inner retinal network is retained. Epiretinal implants stimulate primarily the ganglion cells, and hence should encode the visual information in spiking patterns, which, ideally, should match the target cell types. Currently, subretinal arrays are being developed primarily for restoration of central vision in patients impaired by age-related macular degeneration (AMD), while epiretinal implants-for patients blinded by retinitis pigmentosa, where the inner retina is less preserved. This review describes the concepts and technologies, preclinical characterization of prosthetic vision and clinical outcomes, and provides a glimpse into future developments.
Collapse
Affiliation(s)
- Daniel Palanker
- Department of Ophthalmology and Hansen Experimental Physics Laboratory, Stanford University, Stanford, California 94305, USA
| |
Collapse
|
8
|
Madugula SS, Vilkhu R, Shah NP, Grosberg LE, Kling A, Gogliettino AR, Nguyen H, Hottowy P, Sher A, Litke AM, Chichilnisky EJ. Inference of Electrical Stimulation Sensitivity from Recorded Activity of Primate Retinal Ganglion Cells. J Neurosci 2023; 43:4808-4820. [PMID: 37268418 PMCID: PMC10312054 DOI: 10.1523/jneurosci.1023-22.2023] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Revised: 05/22/2023] [Accepted: 05/24/2023] [Indexed: 06/04/2023] Open
Abstract
High-fidelity electronic implants can in principle restore the function of neural circuits by precisely activating neurons via extracellular stimulation. However, direct characterization of the individual electrical sensitivity of a large population of target neurons, to precisely control their activity, can be difficult or impossible. A potential solution is to leverage biophysical principles to infer sensitivity to electrical stimulation from features of spontaneous electrical activity, which can be recorded relatively easily. Here, this approach is developed and its potential value for vision restoration is tested quantitatively using large-scale multielectrode stimulation and recording from retinal ganglion cells (RGCs) of male and female macaque monkeys ex vivo Electrodes recording larger spikes from a given cell exhibited lower stimulation thresholds across cell types, retinas, and eccentricities, with systematic and distinct trends for somas and axons. Thresholds for somatic stimulation increased with distance from the axon initial segment. The dependence of spike probability on injected current was inversely related to threshold, and was substantially steeper for axonal than somatic compartments, which could be identified by their recorded electrical signatures. Dendritic stimulation was largely ineffective for eliciting spikes. These trends were quantitatively reproduced with biophysical simulations. Results from human RGCs were broadly similar. The inference of stimulation sensitivity from recorded electrical features was tested in a data-driven simulation of visual reconstruction, revealing that the approach could significantly improve the function of future high-fidelity retinal implants.SIGNIFICANCE STATEMENT This study demonstrates that individual in situ primate retinal ganglion cells of different types respond to artificially generated, external electrical fields in a systematic manner, in accordance with theoretical predictions, that allows for prediction of electrical stimulus sensitivity from recorded spontaneous activity. It also provides evidence that such an approach could be immensely helpful in the calibration of clinical retinal implants.
Collapse
Affiliation(s)
- Sasidhar S Madugula
- Neurosciences PhD Program, Stanford University, Stanford, California 94305
- School of Medicine, Stanford University, Stanford, California 94305
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, California 94305
| | - Ramandeep Vilkhu
- Department of Electrical Engineering, Stanford University, Stanford, California 94305
| | - Nishal P Shah
- Department of Neurosurgery, Stanford University, Stanford, California 94305
- Department of Electrical Engineering, Stanford University, Stanford, California 94305
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, California 94305
| | - Lauren E Grosberg
- Department of Neurosurgery, Stanford University, Stanford, California 94305
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, California 94305
- Facebook Reality Labs, Facebook, Mountain View, California 94040
| | - Alexandra Kling
- Department of Neurosurgery, Stanford University, Stanford, California 94305
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, California 94305
| | - Alex R Gogliettino
- Neurosciences PhD Program, Stanford University, Stanford, California 94305
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, California 94305
| | - Huy Nguyen
- Department of Neurosurgery, Stanford University, Stanford, California 94305
| | - Paweł Hottowy
- Faculty of Physics and Applied Computer Science, AGH University of Science and Technology, Krakow, Poland 30-059
| | - Alexander Sher
- Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, California 95064
| | - Alan M Litke
- Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, California 95064
| | - E J Chichilnisky
- Department of Neurosurgery, Stanford University, Stanford, California 94305
- Department of Ophthalmology, Stanford University, Stanford, California 94305
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, California 94305
| |
Collapse
|
9
|
Gogliettino AR, Madugula SS, Grosberg LE, Vilkhu RS, Brown J, Nguyen H, Kling A, Hottowy P, Dąbrowski W, Sher A, Litke AM, Chichilnisky EJ. High-Fidelity Reproduction of Visual Signals by Electrical Stimulation in the Central Primate Retina. J Neurosci 2023; 43:4625-4641. [PMID: 37188516 PMCID: PMC10286946 DOI: 10.1523/jneurosci.1091-22.2023] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 05/08/2023] [Accepted: 05/10/2023] [Indexed: 05/17/2023] Open
Abstract
Electrical stimulation of retinal ganglion cells (RGCs) with electronic implants provides rudimentary artificial vision to people blinded by retinal degeneration. However, current devices stimulate indiscriminately and therefore cannot reproduce the intricate neural code of the retina. Recent work has demonstrated more precise activation of RGCs using focal electrical stimulation with multielectrode arrays in the peripheral macaque retina, but it is unclear how effective this can be in the central retina, which is required for high-resolution vision. This work probes the neural code and effectiveness of focal epiretinal stimulation in the central macaque retina, using large-scale electrical recording and stimulation ex vivo The functional organization, light response properties, and electrical properties of the major RGC types in the central retina were mostly similar to the peripheral retina, with some notable differences in density, kinetics, linearity, spiking statistics, and correlations. The major RGC types could be distinguished by their intrinsic electrical properties. Electrical stimulation targeting parasol cells revealed similar activation thresholds and reduced axon bundle activation in the central retina, but lower stimulation selectivity. Quantitative evaluation of the potential for image reconstruction from electrically evoked parasol cell signals revealed higher overall expected image quality in the central retina. An exploration of inadvertent midget cell activation suggested that it could contribute high spatial frequency noise to the visual signal carried by parasol cells. These results support the possibility of reproducing high-acuity visual signals in the central retina with an epiretinal implant.SIGNIFICANCE STATEMENT Artificial restoration of vision with retinal implants is a major treatment for blindness. However, present-day implants do not provide high-resolution visual perception, in part because they do not reproduce the natural neural code of the retina. Here, we demonstrate the level of visual signal reproduction that is possible with a future implant by examining how accurately responses to electrical stimulation of parasol retinal ganglion cells can convey visual signals. Although the precision of electrical stimulation in the central retina was diminished relative to the peripheral retina, the quality of expected visual signal reconstruction in parasol cells was greater. These findings suggest that visual signals could be restored with high fidelity in the central retina using a future retinal implant.
Collapse
Affiliation(s)
- Alex R Gogliettino
- Neurosciences PhD Program, Stanford University, Stanford, California 94305
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, California 94305
| | - Sasidhar S Madugula
- Neurosciences PhD Program, Stanford University, Stanford, California 94305
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, California 94305
- Stanford School of Medicine, Stanford University, Stanford, California 94305
| | - Lauren E Grosberg
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, California 94305
- Department of Neurosurgery, Stanford University, Stanford, California 94305
| | - Ramandeep S Vilkhu
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, California 94305
- Department of Electrical Engineering, Stanford University, Stanford, California 94305
| | - Jeff Brown
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, California 94305
- Department of Neurosurgery, Stanford University, Stanford, California 94305
- Department of Electrical Engineering, Stanford University, Stanford, California 94305
| | - Huy Nguyen
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, California 94305
| | - Alexandra Kling
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, California 94305
- Department of Neurosurgery, Stanford University, Stanford, California 94305
| | - Paweł Hottowy
- Faculty of Physics and Applied Computer Science, AGH University of Science and Technology, 30-059, Kraków, Poland
| | - Władysław Dąbrowski
- Faculty of Physics and Applied Computer Science, AGH University of Science and Technology, 30-059, Kraków, Poland
| | - Alexander Sher
- Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, Santa Cruz, California 95064
| | - Alan M Litke
- Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, Santa Cruz, California 95064
| | - E J Chichilnisky
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, California 94305
- Department of Neurosurgery, Stanford University, Stanford, California 94305
- Department of Electrical Engineering, Stanford University, Stanford, California 94305
- Department of Ophthalmology, Stanford University, Stanford, California 94305
| |
Collapse
|
10
|
Wu KY, Mina M, Sahyoun JY, Kalevar A, Tran SD. Retinal Prostheses: Engineering and Clinical Perspectives for Vision Restoration. SENSORS (BASEL, SWITZERLAND) 2023; 23:5782. [PMID: 37447632 PMCID: PMC10347280 DOI: 10.3390/s23135782] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Revised: 06/04/2023] [Accepted: 06/19/2023] [Indexed: 07/15/2023]
Abstract
A retinal prosthesis, also known as a bionic eye, is a device that can be implanted to partially restore vision in patients with retinal diseases that have resulted in the loss of photoreceptors (e.g., age-related macular degeneration and retinitis pigmentosa). Recently, there have been major breakthroughs in retinal prosthesis technology, with the creation of numerous types of implants, including epiretinal, subretinal, and suprachoroidal sensors. These devices can stimulate the remaining cells in the retina with electric signals to create a visual sensation. A literature review of the pre-clinical and clinical studies published between 2017 and 2023 is conducted. This narrative review delves into the retinal anatomy, physiology, pathology, and principles underlying electronic retinal prostheses. Engineering aspects are explored, including electrode-retina alignment, electrode size and material, charge density, resolution limits, spatial selectivity, and bidirectional closed-loop systems. This article also discusses clinical aspects, focusing on safety, adverse events, visual function, outcomes, and the importance of rehabilitation programs. Moreover, there is ongoing debate over whether implantable retinal devices still offer a promising approach for the treatment of retinal diseases, considering the recent emergence of cell-based and gene-based therapies as well as optogenetics. This review compares retinal prostheses with these alternative therapies, providing a balanced perspective on their advantages and limitations. The recent advancements in retinal prosthesis technology are also outlined, emphasizing progress in engineering and the outlook of retinal prostheses. While acknowledging the challenges and complexities of the technology, this article highlights the significant potential of retinal prostheses for vision restoration in individuals with retinal diseases and calls for continued research and development to refine and enhance their performance, ultimately improving patient outcomes and quality of life.
Collapse
Affiliation(s)
- Kevin Y. Wu
- Department of Surgery, Division of Ophthalmology, University of Sherbrooke, Sherbrooke, QC J1G 2E8, Canada; (K.Y.W.)
| | - Mina Mina
- Department of Mechanical and Manufacturing Engineering, University of Calgary, Calgary, AB T2N 1N4, Canada
| | - Jean-Yves Sahyoun
- Faculty of Medicine, University of Montreal, Montreal, QC H3T 1J4, Canada
| | - Ananda Kalevar
- Department of Surgery, Division of Ophthalmology, University of Sherbrooke, Sherbrooke, QC J1G 2E8, Canada; (K.Y.W.)
| | - Simon D. Tran
- Faculty of Dental Medicine and Oral Health Sciences, McGill University, Montreal, QC H3A 1G1, Canada
| |
Collapse
|
11
|
Madugula SS, Gogliettino AR, Zaidi M, Aggarwal G, Kling A, Shah NP, Brown JB, Vilkhu R, Hays MR, Nguyen H, Fan V, Wu EG, Hottowy P, Sher A, Litke AM, Silva RA, Chichilnisky EJ. Focal electrical stimulation of human retinal ganglion cells for vision restoration. J Neural Eng 2022; 19:066040. [PMID: 36533865 PMCID: PMC10010036 DOI: 10.1088/1741-2552/aca5b5] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Accepted: 11/24/2022] [Indexed: 11/25/2022]
Abstract
Objective. Vision restoration with retinal implants is limited by indiscriminate simultaneous activation of many cells and cell types, which is incompatible with reproducing the neural code of the retina. Recent work has shown that primate retinal ganglion cells (RGCs), which transmit visual information to the brain, can be directly electrically activated with single-cell, single-spike, cell-type precision - however, this possibility has never been tested in the human retina. In this study we aim to characterize, for the first time, direct in situ extracellular electrical stimulation of individual human RGCs.Approach. Extracellular electrical stimulation of individual human RGCs was conducted in three human retinas ex vivo using a custom large-scale, multi-electrode array capable of simultaneous recording and stimulation. Measured activation properties were compared directly to extensive results from macaque.Main results. Precise activation was in many cases possible without activating overlying axon bundles, at low stimulation current levels similar to those used in macaque. The major RGC types could be identified and targeted based on their distinctive electrical signatures. The measured electrical activation properties of RGCs, combined with a dynamic stimulation algorithm, was sufficient to produce an evoked visual signal that was nearly optimal given the constraints of the interface.Significance. These results suggest the possibility of high-fidelity vision restoration in humans using bi-directional epiretinal implants.
Collapse
Affiliation(s)
- Sasidhar S Madugula
- Neurosciences PhD Program, Stanford University, Stanford, CA, United States of America
- School of Medicine, Stanford University, Stanford, CA, United States of America
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA, United States of America
| | - Alex R Gogliettino
- Neurosciences PhD Program, Stanford University, Stanford, CA, United States of America
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA, United States of America
| | - Moosa Zaidi
- Department of Neurosurgery, Stanford University, Stanford, CA, United States of America
- School of Medicine, Stanford University, Stanford, CA, United States of America
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA, United States of America
| | - Gorish Aggarwal
- Department of Neurosurgery, Stanford University, Stanford, CA, United States of America
- Department of Electrical Engineering, Stanford University, Stanford, CA, United States of America
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA, United States of America
| | - Alexandra Kling
- Department of Neurosurgery, Stanford University, Stanford, CA, United States of America
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA, United States of America
| | - Nishal P Shah
- Department of Neurosurgery, Stanford University, Stanford, CA, United States of America
- Department of Electrical Engineering, Stanford University, Stanford, CA, United States of America
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA, United States of America
| | - Jeff B Brown
- Department of Electrical Engineering, Stanford University, Stanford, CA, United States of America
| | - Ramandeep Vilkhu
- Department of Electrical Engineering, Stanford University, Stanford, CA, United States of America
| | - Madeline R Hays
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA, United States of America
- Department of Bioengineering, Stanford University, Stanford, CA, United States of America
| | - Huy Nguyen
- Department of Neurosurgery, Stanford University, Stanford, CA, United States of America
| | - Victoria Fan
- Department of Neurosurgery, Stanford University, Stanford, CA, United States of America
| | - Eric G Wu
- Department of Electrical Engineering, Stanford University, Stanford, CA, United States of America
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA, United States of America
| | - Pawel Hottowy
- Faculty of Physics and Applied Computer Science, AGH University of Science and Technology, Krakow, Poland
| | - Alexander Sher
- Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, CA, United States of America
| | - Alan M Litke
- Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, CA, United States of America
| | - Ruwan A Silva
- Department of Ophthalmology, Stanford University, Stanford, CA, United States of America
| | - E J Chichilnisky
- Department of Neurosurgery, Stanford University, Stanford, CA, United States of America
- Department of Ophthalmology, Stanford University, Stanford, CA, United States of America
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA, United States of America
| |
Collapse
|
12
|
Roh H, Otgondemberel Y, Im M. Short pulses of epiretinal prostheses evoke network-mediated responses in retinal ganglion cells by stimulating presynaptic neurons. J Neural Eng 2022; 19. [PMID: 36055185 DOI: 10.1088/1741-2552/ac8ed7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Accepted: 09/02/2022] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Microelectronic retinal implant aims to restore functional vision with electric stimulation. Short pulses are generally known to directly activate retinal ganglion cells (RGCs) with a notion of one or two spike(s) per pulse. In the present work, we systematically explore network-mediated responses that arise from various short pulses in both normal and degenerate retinas. APPROACH Cell-attached patch clamping was used to record spiking responses of RGCs in wild-type (C57BL/6J) and retinal degeneration (rd10) mice. Alpha RGCs of the mouse retinas were targeted by their large soma sizes and classified by their responses to spot flashes. Then, RGCs were electrically stimulated by various conditions such as duration (100-460 μs), count (1-10), amplitude (100-400 μA), and repeating frequency (10-40 Hz) of short pulses. Also, their responses were compared with each own response to a single 4-ms-long pulse which is known to evoke strong indirect responses. MAIN RESULTS Short pulses evoked strong network-mediated responses not only in both ON and OFF types of RGCs in the healthy retinas but also in RGCs of the severely degenerate retina. However, the spike timing consistency across repeats not decreased significantly in the rd10 RGCs compared to the healthy ON and OFF RGCs. Network-mediated responses of ON RGCs were highly dependent on the current amplitude of stimuli but much less on the pulse count and the repetition frequency. In contrast, responses of OFF RGCs were more influenced by the number of stimuli than the current amplitude. SIGNIFICANCE Our results demonstrate that short pulses also elicit indirect responses by activating presynaptic neurons. In the case of the commercial retinal prostheses using repeating short pulses, there is a possibility that the performance of clinical devices is highly related to the preserved retinal circuits. Therefore, examination of surviving retinal neurons in patients would be necessary to improve the efficacy of retinal prostheses.
Collapse
Affiliation(s)
- Hyeonhee Roh
- Korea Institute of Science and Technology (KIST), 5 Hwarang-ro 14-gil, Seongbuk-gu, Seoul, 02792, Korea (the Republic of)
| | - Yanjinsuren Otgondemberel
- Brain Science Institute, Korea Institute of Science and Technology (KIST), 5 Hwarang-ro 14-gil, Seongbuk-gu, Seoul, 02792, Korea (the Republic of)
| | - Maesoon Im
- Brain Science Institute, Center for BioMicrosystems, Korea Institute of Science and Technology, 5 Hwarang-ro 14-gil, Seongbuk-gu, L7325B, Seoul, Seoul, Seoul, 02792, Korea (the Republic of)
| |
Collapse
|
13
|
Yunzab M, Soto-Breceda A, Maturana M, Kirkby S, Slattery M, Newgreen A, Meffin H, Kameneva T, Burkitt AN, Ibbotson M, Tong W. Preferential modulation of individual retinal ganglion cells by electrical stimulation. J Neural Eng 2022; 19. [PMID: 35917811 DOI: 10.1088/1741-2552/ac861f] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2022] [Accepted: 08/01/2022] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Retinal prostheses have been able to recover partial vision in blind patients with retinal degeneration by electrically stimulating surviving cells in the retina, such as retinal ganglion cells (RGCs), but the restored vision is limited. This is partly due to non-preferential stimulation of all RGCs near a single stimulating electrode, which include cells that conflict in their response properties and their contribution to the vision process. Our study proposes a stimulation strategy to preferentially stimulate individual RGCs based on their temporal electrical receptive fields (tERFs). APPROACH We recorded the responses of RGCs using whole-cell current-clamp and demonstrated the stimulation strategy, first using intracellular stimulation, then via extracellular stimulation. MAIN RESULTS We successfully reconstructed the tERFs according to the RGC response to Gaussian white noise current stimulation. The characteristics of the tERFs were extracted and compared according to the morphological and light response types of the cells. By re-delivering stimulation trains that are composed of the tERFs obtained from different cells, we could target individual RGCs as the cells showed lower activation thresholds to their own tERFs. SIGNIFICANCE This proposed stimulation strategy implemented in the next generation of recording and stimulating retinal prostheses may improve the quality of artificial vision.
Collapse
Affiliation(s)
- Molis Yunzab
- National Vision Research Institute, Australian College of Optometry, Corner of Keppel and Cardigan Streets, Carlton, Victoria, 3053, AUSTRALIA
| | - Artemio Soto-Breceda
- National Vision Research Institute, Australian College of Optometry, Corner of Keppel and Cardigan Streets, Carlton, Victoria, 3053, AUSTRALIA
| | - Matias Maturana
- National Vision Research Institute, Australian College of Optometry, Corner of Keppel and Cardigan Streets, Carlton, Victoria, 3053, AUSTRALIA
| | - Stephanie Kirkby
- National Vision Research Institute, Australian College of Optometry, Corner of Keppel and Cardigan Streets, Carlton, Victoria, 3053, AUSTRALIA
| | - Maximilian Slattery
- National Vision Research Institute, Australian College of Optometry, Corner of Keppel and Cardigan Streets, Carlton, Victoria, 3053, AUSTRALIA
| | - Anton Newgreen
- National Vision Research Institute, Australian College of Optometry, Corner of Keppel and Cardigan Streets, Carlton, Victoria, 3053, AUSTRALIA
| | - Hamish Meffin
- Biomedical Engineering, The University of Melbourne, Grattan Street, Melbourne, Victoria, 3010, AUSTRALIA
| | - Tatiana Kameneva
- School of Science, Engineering, and Computing Technologies, Swinburne University of Technology, School of Science, Engineering, and Computing Technologies, Swinburne University of Technology, Hawthorn, Victoria, 3122, AUSTRALIA
| | - Anthony N Burkitt
- Department of Biomedical Engineering, University of Melbourne, University of Melbourne, Parkville, Victoria, 3010, AUSTRALIA
| | - Michael Ibbotson
- National Vision Research Institute, Australian College of Optometry, Corner of Keppel and Cardigan Streets, Carlton, Victoria, 3053, AUSTRALIA
| | - Wei Tong
- University of Melbourne, School of Physics, University of Melbourne, Parkville, Melbourne, Victoria, 3010, AUSTRALIA
| |
Collapse
|
14
|
Fauvel T, Chalk M. Human-in-the-loop optimization of visual prosthetic stimulation. J Neural Eng 2022; 19. [PMID: 35667363 DOI: 10.1088/1741-2552/ac7615] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Accepted: 06/06/2022] [Indexed: 11/12/2022]
Abstract
Retinal prostheses are a promising strategy to restore sight to patients with retinal degenerative diseases. These devices compensate for the loss of photoreceptors by electrically stimulating neurons in the retina. Currently, the visual function that can be recovered with such devices is very limited. This is due, in part, to current spread, unintended axonal activation, and the limited resolution of existing devices. Here we show, using a recent model of prosthetic vision, that optimizing how visual stimuli are encoded by the device can help overcome some of these limitations, leading to dramatic improvements in visual perception. APPROACH We propose a strategy to do this in practice, using patients' feedback in a visual task. The main challenge of our approach comes from the fact that, typically, one only has access to a limited number of noisy responses from patients. We propose two ways to deal with this: first, we use a model of prosthetic vision to constrain and simplify the optimization. We show that, if one knew the parameters of this model for a given patient, it would be possible to greatly improve their perceptual performance. Second we propose a preferential Bayesian optimization to efficiently learn these model parameters for each patient, using minimal trials. MAIN RESULTS To test our approach, we presented healthy subjects with visual stimuli generated by a recent model of prosthetic vision, to replicate the perceptual experience of patients fitted with an implant. Our optimization procedure led to significant and robust improvements in perceived image quality, that transferred to increased performance in other tasks. SIGNIFICANCE Importantly, our strategy is agnostic to the type of prosthesis and thus could readily be implemented in existing implants.
Collapse
Affiliation(s)
- Tristan Fauvel
- Institut de la Vision, INSERM, 17 Rue Moreau, Paris, Île-de-France, 75014, FRANCE
| | - Matthew Chalk
- Institut de l a Vision, INSERM, 17 Rue Moreau, Paris, 75014, FRANCE
| |
Collapse
|
15
|
Italiano ML, Guo T, Lovell NH, Tsai D. Improving the spatial resolution of artificial vision using midget retinal ganglion cell populations modelled at the human fovea. J Neural Eng 2022; 19. [PMID: 35609556 DOI: 10.1088/1741-2552/ac72c2] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Accepted: 05/24/2022] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Retinal prostheses seek to create artificial vision by stimulating surviving retinal neurons of patients with profound vision impairment. Notwithstanding tremendous research efforts, the performance of all implants tested to date has remained rudimentary, incapable of overcoming the threshold for legal blindness. To maximize the perceptual efficacy of retinal prostheses, a device must be capable of controlling retinal neurons with greater spatiotemporal precision. Most studies of retinal stimulation were derived from either non-primate species or the peripheral primate retina. We investigated if artificial stimulation could leverage the high spatial resolution afforded by the neural substrates at the primate fovea and surrounding regions to achieve improved percept qualities. APPROACH We began by developing a new computational model capable of generating anatomically accurate retinal ganglion cell (RGC) populations within the human central retina. Next, multiple RGC populations across the central retina were stimulated in-silico to compare clinical and recently proposed neurostimulation configurations based on their ability to improve perceptual efficacy and reduce activation thresholds. MAIN RESULTS Our model uniquely upholds eccentricity-dependent characteristics such as RGC density and dendritic field diameter, whilst incorporating anatomically accurate features such as axon projection and three-dimensional RGC layering, features often forgone in favor of reduced computational complexity. Following epiretinal stimulation, the RGCs in our model produced response patterns in shapes akin to the complex percepts reported in clinical trials. Our results also demonstrated that even within the neuron-dense central retina, epiretinal stimulation using a multi-return hexapolar electrode arrangement could reliably achieve spatially focused RGC activation and could achieve single-cell excitation in 74% of all tested locations. SIGNIFICANCE This study establishes an anatomically accurate three-dimensional model of the human central retina and demonstrates the potential for an epiretinal hexapolar configuration to achieve consistent, spatially confined retinal responses, even within the neuron-dense foveal region. Our results promote the prospect and optimization of higher spatial resolution in future epiretinal implants.
Collapse
Affiliation(s)
- Michael Lewis Italiano
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, Sydney, New South Wales, 2052, AUSTRALIA
| | - Tianruo Guo
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, Sydney, New South Wales, 2052, AUSTRALIA
| | - Nigel H Lovell
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, Sydney, New South Wales, 2052, AUSTRALIA
| | - David Tsai
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, Sydney, New South Wales, 2052, AUSTRALIA
| |
Collapse
|
16
|
Avraham D, Yitzhaky Y. Simulating the perceptual effects of electrode-retina distance in prosthetic vision. J Neural Eng 2022; 19. [PMID: 35561665 DOI: 10.1088/1741-2552/ac6f82] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2022] [Accepted: 05/13/2022] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Retinal prostheses aim to restore some vision in retinitis pigmentosa and age-related macular degeneration blind patients. Many spatial and temporal aspects have been found to affect prosthetic vision. Our objective is to study the impact of the space-variant distance between the stimulating electrodes and the surface of the retina on prosthetic vision and how to mitigate this impact. APPROACH A prosthetic vision simulation was built to demonstrate the perceptual effects of the electrode-retina distance (ERD) with different random spatial variations, such as size, brightness, shape, dropout, and spatial shifts. Three approaches for reducing the ERD effects are demonstrated: electrode grouping (quads), ERD-based input-image enhancement, and object scanning with and without phosphene persistence. A quantitative assessment for the first two approaches was done based on experiments with 20 subjects and three vision-based computational image similarity metrics. MAIN RESULTS The effects of various ERDs on phosphenes' size, brightness, and shape were simulated. Quads, chosen according to the ERDs, effectively elicit phosphenes without exceeding the safe charge density limit, whereas single electrodes with large ERD cannot do so. Input-image enhancement reduced the ERD effects effectively. These two approaches significantly improved ERD-affected prosthetic vision according to the experiment and image similarity metrics. A further reduction of the ERD effects was achieved by scanning an object while moving the head. SIGNIFICANCE ERD has multiple effects on perception with retinal prostheses. One of them is vision loss caused by the incapability of electrodes with large ERD to evoke phosphenes. The three approaches presented in this study can be used separately or together to mitigate the impact of ERD. A consideration of our approaches in reducing the perceptual effects of the ERD may help improve the perception with current prosthetic technology and influence the design of future prostheses.
Collapse
Affiliation(s)
- David Avraham
- Department of Electro-Optical Engineering, Ben-Gurion University of the Negev, 1 Ben-Gurion Blvd., Beer-Sheva, 84105, ISRAEL
| | - Yitzhak Yitzhaky
- Electro-Optical Engineering, School of Engineering, Ben-Gurion University of the Negev, 1 Ben-Gurion Blvd., Beer-Sheva, Southern, 84105, ISRAEL
| |
Collapse
|
17
|
Ahn J, Cha S, Choi KE, Kim SW, Yoo Y, Goo YS. Correlated Activity in the Degenerate Retina Inhibits Focal Response to Electrical Stimulation. Front Cell Neurosci 2022; 16:889663. [PMID: 35602554 PMCID: PMC9114441 DOI: 10.3389/fncel.2022.889663] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Accepted: 04/13/2022] [Indexed: 11/24/2022] Open
Abstract
Retinal prostheses have shown some clinical success in patients with retinitis pigmentosa and age-related macular degeneration. However, even after the implantation of a retinal prosthesis, the patient’s visual acuity is at best less than 20/420. Reduced visual acuity may be explained by a decrease in the signal-to-noise ratio due to the spontaneous hyperactivity of retinal ganglion cells (RGCs) found in degenerate retinas. Unfortunately, abnormal retinal rewiring, commonly observed in degenerate retinas, has rarely been considered for the development of retinal prostheses. The purpose of this study was to investigate the aberrant retinal network response to electrical stimulation in terms of the spatial distribution of the electrically evoked RGC population. An 8 × 8 multielectrode array was used to measure the spiking activity of the RGC population. RGC spikes were recorded in wild-type [C57BL/6J; P56 (postnatal day 56)], rd1 (P56), rd10 (P14 and P56) mice, and macaque [wild-type and drug-induced retinal degeneration (RD) model] retinas. First, we performed a spike correlation analysis between RGCs to determine RGC connectivity. No correlation was observed between RGCs in the control group, including wild-type mice, rd10 P14 mice, and wild-type macaque retinas. In contrast, for the RD group, including rd1, rd10 P56, and RD macaque retinas, RGCs, up to approximately 400–600 μm apart, were significantly correlated. Moreover, to investigate the RGC population response to electrical stimulation, the number of electrically evoked RGC spikes was measured as a function of the distance between the stimulation and recording electrodes. With an increase in the interelectrode distance, the number of electrically evoked RGC spikes decreased exponentially in the control group. In contrast, electrically evoked RGC spikes were observed throughout the retina in the RD group, regardless of the inter-electrode distance. Taken together, in the degenerate retina, a more strongly coupled retinal network resulted in the widespread distribution of electrically evoked RGC spikes. This finding could explain the low-resolution vision in prosthesis-implanted patients.
Collapse
Affiliation(s)
- Jungryul Ahn
- Department of Physiology, Chungbuk National University School of Medicine, Cheongju, South Korea
| | - Seongkwang Cha
- Department of Physiology, Chungbuk National University School of Medicine, Cheongju, South Korea
| | - Kwang-Eon Choi
- Department of Ophthalmology, Korea University College of Medicine, Seoul, South Korea
| | - Seong-Woo Kim
- Department of Ophthalmology, Korea University College of Medicine, Seoul, South Korea
- *Correspondence: Seong-Woo Kim,
| | - Yongseok Yoo
- Department of Electronics Engineering, Incheon National University, Incheon, South Korea
- Yongseok Yoo,
| | - Yong Sook Goo
- Department of Physiology, Chungbuk National University School of Medicine, Cheongju, South Korea
- Yong Sook Goo,
| |
Collapse
|
18
|
Raghuram V, Werginz P, Fried SI, Timko BP. Morphological Factors that Underlie Neural Sensitivity to Stimulation in the Retina. ADVANCED NANOBIOMED RESEARCH 2022; 1. [PMID: 35399546 DOI: 10.1002/anbr.202100069] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022] Open
Abstract
Retinal prostheses are a promising therapeutic intervention for patients afflicted by outer retinal degenerative diseases like retinitis pigmentosa and age-related macular degeneration. While significant advances in the development of retinal implants have been made, the quality of vision elicited by these devices remains largely sub-optimal. The variability in the responses produced by retinal devices is most likely due to the differences between the natural cell type-specific signaling that occur in the healthy retina vs. the non-specific activation of multiple cell types arising from artificial stimulation. In order to replicate these natural signaling patterns, stimulation strategies must be capable of preferentially activating specific RGC types. To design more selective stimulation strategies, a better understanding of the morphological factors that underlie the sensitivity to prosthetic stimulation must be developed. This review will focus on the role that different anatomical components play in driving the direct activation of RGCs by extracellular stimulation. Briefly, it will (1) characterize the variability in morphological properties of α-RGCs, (2) detail the influence of morphology on the direct activation of RGCs by electric stimulation, and (3) describe some of the potential biophysical mechanisms that could explain differences in activation thresholds and electrically evoked responses between RGC types.
Collapse
Affiliation(s)
- Vineeth Raghuram
- Boston VA Healthcare System, 150 S Huntington Ave, Boston, MA 02130, USA.,Dept. of Biomedical Engineering, Tufts University, 4 Colby Street, Medford, MA 02155, USA.,Dept. of Neurosurgery, Massachusetts General Hospital - Harvard Medical School, 50 Blossom Street, Boston, MA, 02114
| | - Paul Werginz
- Institute for Analysis and Scientific Computing, Vienna University of Technology, Wiedner Hauptstrasse 8-10, Vienna, Austria.,Dept. of Neurosurgery, Massachusetts General Hospital - Harvard Medical School, 50 Blossom Street, Boston, MA, 02114
| | - Shelley I Fried
- Boston VA Healthcare System, 150 S Huntington Ave, Boston, MA 02130, USA.,Dept. of Biomedical Engineering, Tufts University, 4 Colby Street, Medford, MA 02155, USA.,Dept. of Neurosurgery, Massachusetts General Hospital - Harvard Medical School, 50 Blossom Street, Boston, MA, 02114
| | - Brian P Timko
- Dept. of Biomedical Engineering, Tufts University, 4 Colby Street, Medford, MA 02155, USA
| |
Collapse
|
19
|
Sajedi S, Fellner A, Werginz P, Rattay F. Block Phenomena During Electric Micro-Stimulation of Pyramidal Cells and Retinal Ganglion Cells. Front Cell Neurosci 2021; 15:771600. [PMID: 34899192 PMCID: PMC8663762 DOI: 10.3389/fncel.2021.771600] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2021] [Accepted: 11/08/2021] [Indexed: 11/13/2022] Open
Abstract
Electric micro-stimulation of the nervous system is a means to restore various body functions. The stimulus amplitude necessary to generate action potentials, the lower threshold (LT), is well characterized for many neuronal populations. However, electric overstimulation above an upper threshold (UT) prevents action potential generation and therefore hinders optimal neuro-rehabilitation. Previous studies demonstrated the impact of the UT in micro-stimulation of retinal ganglion cells (RGCs). The observed phenomenon is mostly explained by (i) reversed sodium ion flow in the soma membrane, and (ii) anodal surround block that hinders spike conduction in strongly hyperpolarized regions of the axon at high stimulus intensities. However, up to now, no detailed study of the nature of these phenomena has been presented, particularly for different cell types. Here, we present computational analyses of LT and UT for layer 5 pyramidal cells (PCs) as well as alpha RGCs. Model neurons were stimulated in close vicinity to the cell body and LTs and UTs as well as the ratio UT/LT were compared. Aside from a simple point source electrode and monophasic stimuli also realistic electrode and pulse configurations were examined. The analysis showed: (i) in RGCs, the soma contributed to action potential initiation and block for small electrode distances, whereas in PCs the soma played no role in LTs or UTs. (ii) In both cell types, action potential always initiated within the axon initial segment at LT. (iii) In contrast to a complete block of spike conductance at UT that occurred in RGCs, an incomplete block of spiking appeared in PC axon collaterals. (iv) PC axon collateral arrangement influenced UTs but had small impact on LTs. (v) Population responses of RGCs change from circular regions of activation to ring-shaped patterns for increasing stimulus amplitude. A better understanding of the stimulation window that can reliably activate target neurons will benefit the future development of neuroprostheses.
Collapse
Affiliation(s)
- Sogand Sajedi
- Institute for Analysis and Scientific Computing, Vienna University of Technology, Vienna, Austria
| | - Andreas Fellner
- Institute for Analysis and Scientific Computing, Vienna University of Technology, Vienna, Austria
| | - Paul Werginz
- Institute for Analysis and Scientific Computing, Vienna University of Technology, Vienna, Austria
| | - Frank Rattay
- Institute for Analysis and Scientific Computing, Vienna University of Technology, Vienna, Austria
| |
Collapse
|
20
|
Vėbraitė I, David-Pur M, Rand D, Głowacki ED, Hanein Y. Electrophysiological investigation of intact retina with soft printed organic neural interface. J Neural Eng 2021; 18. [PMID: 34736225 DOI: 10.1088/1741-2552/ac36ab] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2021] [Accepted: 11/04/2021] [Indexed: 12/26/2022]
Abstract
Objective.Understanding how the retina converts a natural image or an electrically stimulated one into neural firing patterns is the focus of on-going research activities.Ex vivo, the retina can be readily investigated using multi electrode arrays (MEAs). However, MEA recording and stimulation from an intact retina (in the eye) has been so far insufficient.Approach.In the present study, we report new soft carbon electrode arrays suitable for recording and stimulating neural activity in an intact retina. Screen-printing of carbon ink on 20µm polyurethane (PU) film was used to realize electrode arrays with electrodes as small as 40µm in diameter. Passivation was achieved with a holey membrane, realized using laser drilling in a thin (50µm) PU film. Plasma polymerized 3.4-ethylenedioxythiophene was used to coat the electrode array to improve the electrode specific capacitance. Chick retinas, embryonic stage day 13, both explanted and intact inside an enucleated eye, were used.Main results.A novel fabrication process based on printed carbon electrodes was developed and yielded high capacitance electrodes on a soft substrate.Ex vivoelectrical recording of retina activity with carbon electrodes is demonstrated. With the addition of organic photo-capacitors, simultaneous photo-electrical stimulation and electrical recording was achieved. Finally, electrical activity recordings from an intact chick retina (inside enucleated eyes) were demonstrated. Both photosensitive retinal ganglion cell responses and spontaneous retina waves were recorded and their features analyzed.Significance.Results of this study demonstrated soft electrode arrays with unique properties, suitable for simultaneous recording and photo-electrical stimulation of the retina at high fidelity. This novel electrode technology opens up new frontiers in the study of neural tissuein vivo.
Collapse
Affiliation(s)
- Ieva Vėbraitė
- School of Electrical Engineering, Tel Aviv University, Tel Aviv, 699780, Israel
| | - Moshe David-Pur
- School of Electrical Engineering, Tel Aviv University, Tel Aviv, 699780, Israel
| | - David Rand
- School of Electrical Engineering, Tel Aviv University, Tel Aviv, 699780, Israel
| | - Eric Daniel Głowacki
- Central European Institute of Technology, Brno University of Technology, Brno, 61200, Czech Republic
| | - Yael Hanein
- School of Electrical Engineering, Tel Aviv University, Tel Aviv, 699780, Israel.,Sagol School of Neuroscience, Tel Aviv University, Tel Aviv 699780, Israel
| |
Collapse
|
21
|
Tandon P, Bhaskhar N, Shah N, Madugula S, Grosberg L, Fan VH, Hottowy P, Sher A, Litke AM, Chichilnisky EJ, Mitra S. Automatic Identification of Axon Bundle Activation for Epiretinal Prosthesis. IEEE Trans Neural Syst Rehabil Eng 2021; 29:2496-2502. [PMID: 34784278 PMCID: PMC8860174 DOI: 10.1109/tnsre.2021.3128486] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
Objective: Retinal prostheses must be able to activate cells in a selective way in order to restore high-fidelity vision. However, inadvertent activation of far-away retinal ganglion cells (RGCs) through electrical stimulation of axon bundles can produce irregular and poorly controlled percepts, limiting artificial vision. In this work, we aim to provide an algorithmic solution to the problem of detecting axon bundle activation with a bi-directional epiretinal prostheses. Methods: The algorithm utilizes electrical recordings to determine the stimulation current amplitudes above which axon bundle activation occurs. Bundle activation is defined as the axonal stimulation of RGCs with unknown soma and receptive field locations, typically beyond the electrode array. The method exploits spatiotemporal characteristics of electrically-evoked spikes to overcome the challenge of detecting small axonal spikes. Results: The algorithm was validated using large-scale, single-electrode and short pulse, ex vivo stimulation and recording experiments in macaque retina, by comparing algorithmically and manually identified bundle activation thresholds. For 88% of the electrodes analyzed, the threshold identified by the algorithm was within ±10% of the manually identified threshold, with a correlation coefficient of 0.95. Conclusion: This works presents a simple, accurate and efficient algorithm to detect axon bundle activation in epiretinal prostheses. Significance: The algorithm could be used in a closed-loop manner by a future epiretinal prosthesis to reduce poorly controlled visual percepts associated with bundle activation. Activation of distant cells via axonal stimulation will likely occur in other types of retinal implants and cortical implants, and the method may therefore be broadly applicable.
Collapse
|
22
|
Vilkhu RS, Madugula SS, Grosberg LE, Gogliettino AR, Hottowy P, Dabrowski W, Sher A, Litke AM, Mitra S, Chichilnisky EJ. Spatially patterned bi-electrode epiretinal stimulation for axon avoidance at cellular resolution. J Neural Eng 2021; 18. [PMID: 34710857 DOI: 10.1088/1741-2552/ac3450] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2021] [Accepted: 10/28/2021] [Indexed: 11/12/2022]
Abstract
Objective.Epiretinal prostheses are designed to restore vision to people blinded by photoreceptor degenerative diseases by stimulating surviving retinal ganglion cells (RGCs), which carry visual signals to the brain. However, inadvertent stimulation of RGCs at their axons can result in non-focal visual percepts, limiting the quality of artificial vision. Theoretical work has suggested that axon activation can be avoided with current stimulation designed to minimize the second spatial derivative of the induced extracellular voltage along the axon. However, this approach has not been verified experimentally at the resolution of single cells.Approach.In this work, a custom multi-electrode array (512 electrodes, 10μm diameter, 60μm pitch) was used to stimulate and record RGCs in macaque retinaex vivoat single-cell, single-spike resolution. RGC activation thresholds resulting from bi-electrode stimulation, which consisted of bipolar currents simultaneously delivered through two electrodes straddling an axon, were compared to activation thresholds from traditional single-electrode stimulation.Main results.On average, across three retinal preparations, the bi-electrode stimulation strategy reduced somatic activation thresholds (∼21%) while increasing axonal activation thresholds (∼14%), thus favoring selective somatic activation. Furthermore, individual examples revealed rescued selective activation of somas that was not possible with any individual electrode.Significance.This work suggests that a bi-electrode epiretinal stimulation strategy can reduce inadvertent axonal activation at cellular resolution, for high-fidelity artificial vision.
Collapse
Affiliation(s)
- Ramandeep S Vilkhu
- Department of Electrical Engineering, Stanford University, Stanford, CA, United States of America
| | - Sasidhar S Madugula
- Departments of Neurosurgery, Ophthalmology, and Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA, United States of America
| | - Lauren E Grosberg
- Departments of Neurosurgery, Ophthalmology, and Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA, United States of America
| | - Alex R Gogliettino
- Departments of Neurosurgery, Ophthalmology, and Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA, United States of America
| | - Pawel Hottowy
- Faculty of Physics and Applied Computer Science, AGH University of Science and Technology, Krakow 30-059, Poland
| | - Wladyslaw Dabrowski
- Faculty of Physics and Applied Computer Science, AGH University of Science and Technology, Krakow 30-059, Poland
| | - Alexander Sher
- Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, CA, United States of America
| | - Alan M Litke
- Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, CA, United States of America
| | - Subhasish Mitra
- Department of Electrical Engineering, Stanford University, Stanford, CA, United States of America
| | - E J Chichilnisky
- Departments of Neurosurgery, Ophthalmology, and Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA, United States of America
| |
Collapse
|
23
|
Abstract
Visual retinal prostheses aim to restore vision for blind individuals who suffer from outer retinal degenerative diseases, such as retinitis pigmentosa and age-related macular degeneration. Perception through retinal prostheses is very limited, but it can be improved by applying object isolation. We used an object isolation algorithm based on integral imaging to isolate objects of interest according to their depth from the camera and applied image processing manipulation to the isolated-object images. Subsequently, we applied a spatial prosthetic vision simulation that converted the isolated-object images to phosphene images. We compared the phosphene images for two types of input images, the original image (before applying object isolation), and the isolated-object image to illustrate the effects of object isolation on simulated prosthetic vision without and with multiple spatial variations of phosphenes, such as size and shape variations, spatial shifts, and dropout rate. The results show an improvement in the perceived shape, contrast, and dynamic range (number of gray levels) of objects in the phosphene image.
Collapse
|
24
|
Corna A, Ramesh P, Jetter F, Lee MJ, Macke JH, Zeck G. Discrimination of simple objects decoded from the output of retinal ganglion cells upon sinusoidal electrical stimulation. J Neural Eng 2021; 18. [PMID: 34049288 DOI: 10.1088/1741-2552/ac0679] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2021] [Accepted: 05/28/2021] [Indexed: 11/12/2022]
Abstract
Objective. Most neuroprosthetic implants employ pulsatile square-wave electrical stimuli, which are significantly different from physiological inter-neuronal communication. In case of retinal neuroprosthetics, which use a certain type of pulsatile stimuli, reliable object and contrast discrimination by implanted blind patients remained challenging. Here we investigated to what extent simple objects can be discriminated from the output of retinal ganglion cells (RGCs) upon sinusoidal stimulation.Approach. Spatially confined objects were formed by different combinations of 1024 stimulating microelectrodes. The RGC activity in theex vivoretina of photoreceptor-degenerated mouse, of healthy mouse or of primate was recorded simultaneously using an interleaved recording microelectrode array implemented in a CMOS-based chip.Main results. We report that application of sinusoidal electrical stimuli (40 Hz) in epiretinal configuration instantaneously and reliably modulates the RGC activity in spatially confined areas at low stimulation threshold charge densities (40 nC mm-2). Classification of overlapping but spatially displaced objects (1° separation) was achieved by distinct spiking activity of selected RGCs. A classifier (regularized logistic regression) discriminated spatially displaced objects (size: 5.5° or 3.5°) with high accuracy (90% or 62%). Stimulation with low artificial contrast (10%) encoded by different stimulus amplitudes generated RGC activity, which was classified with an accuracy of 80% for large objects (5.5°).Significance. We conclude that time-continuous smooth-wave stimulation provides robust, localized neuronal activation in photoreceptor-degenerated retina, which may enable future artificial vision at high temporal, spatial and contrast resolution.
Collapse
Affiliation(s)
- Andrea Corna
- Neurophysics, NMI Natural and Medical Sciences Institute at the University Tübingen, Reutlingen, Germany.,Institute for Ophthalmic Research, University of Tübingen, Tübingen, Germany.,Graduate School of Neural Information Processing/International Max Planck Research School, Tübingen, Germany.,Biomedical Electronics and Systems, EMCE Institute, TU Wien, Wien, Austria
| | - Poornima Ramesh
- Computational Neuroengineering, Technical University München, München, Germany.,Machine Learning in Science, University of Tübingen, Tübingen, Germany
| | - Florian Jetter
- Neurophysics, NMI Natural and Medical Sciences Institute at the University Tübingen, Reutlingen, Germany.,Graduate School of Neural Information Processing/International Max Planck Research School, Tübingen, Germany
| | - Meng-Jung Lee
- Neurophysics, NMI Natural and Medical Sciences Institute at the University Tübingen, Reutlingen, Germany.,Graduate School of Neural Information Processing/International Max Planck Research School, Tübingen, Germany
| | - Jakob H Macke
- Computational Neuroengineering, Technical University München, München, Germany.,Machine Learning in Science, University of Tübingen, Tübingen, Germany.,MPI for Intelligent Systems, Tübingen, Germany
| | - Günther Zeck
- Neurophysics, NMI Natural and Medical Sciences Institute at the University Tübingen, Reutlingen, Germany.,Biomedical Electronics and Systems, EMCE Institute, TU Wien, Wien, Austria
| |
Collapse
|
25
|
Abbasi B, Rizzo JF. Advances in Neuroscience, Not Devices, Will Determine the Effectiveness of Visual Prostheses. Semin Ophthalmol 2021; 36:168-175. [PMID: 33734937 DOI: 10.1080/08820538.2021.1887902] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
Background: Innovations in engineering and neuroscience have enabled the development of sophisticated visual prosthetic devices. In clinical trials, these devices have provided visual acuities as high as 20/460, enabled coarse navigation, and even allowed for reading of short words. However, long-term commercial viability arguably rests on attaining even better vision and more definitive improvements in tasks of daily living and quality of life. Purpose: Here we review technological and biological obstacles in the implementation of visual prosthetics. Conclusions: Research in the visual prosthetic field has tackled significant technical challenges, including biocompatibility, signal spread through neural tissue, and inadvertent activation of passing axons; however, significant gaps in knowledge remain in the realm of neuroscience, including the neural code of vision and visual plasticity. We assert that further optimization of prosthetic devices alone will not provide markedly improved visual outcomes without significant advances in our understanding of neuroscience.
Collapse
Affiliation(s)
- Bardia Abbasi
- Neuro-Ophthalmology Service, Department of Ophthalmology, Massachusetts Eye and Ear and Harvard Medical School, Boston, MA, USA
| | - Joseph F Rizzo
- Neuro-Ophthalmology Service, Department of Ophthalmology, Massachusetts Eye and Ear and Harvard Medical School, Boston, MA, USA
| |
Collapse
|
26
|
Chenais NAL, Airaghi Leccardi MJI, Ghezzi D. Naturalistic spatiotemporal modulation of epiretinal stimulation increases the response persistence of retinal ganglion cell. J Neural Eng 2021; 18. [DOI: 10.1088/1741-2552/abcd6f] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2020] [Accepted: 11/24/2020] [Indexed: 12/24/2022]
|
27
|
Shah NP, Chichilnisky EJ. Computational challenges and opportunities for a bi-directional artificial retina. J Neural Eng 2020; 17:055002. [PMID: 33089827 DOI: 10.1088/1741-2552/aba8b1] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
A future artificial retina that can restore high acuity vision in blind people will rely on the capability to both read (observe) and write (control) the spiking activity of neurons using an adaptive, bi-directional and high-resolution device. Although current research is focused on overcoming the technical challenges of building and implanting such a device, exploiting its capabilities to achieve more acute visual perception will also require substantial computational advances. Using high-density large-scale recording and stimulation in the primate retina with an ex vivo multi-electrode array lab prototype, we frame several of the major computational problems, and describe current progress and future opportunities in solving them. First, we identify cell types and locations from spontaneous activity in the blind retina, and then efficiently estimate their visual response properties by using a low-dimensional manifold of inter-retina variability learned from a large experimental dataset. Second, we estimate retinal responses to a large collection of relevant electrical stimuli by passing current patterns through an electrode array, spike sorting the resulting recordings and using the results to develop a model of evoked responses. Third, we reproduce the desired responses for a given visual target by temporally dithering a diverse collection of electrical stimuli within the integration time of the visual system. Together, these novel approaches may substantially enhance artificial vision in a next-generation device.
Collapse
Affiliation(s)
- Nishal P Shah
- Department of Electrical Engineering, Stanford University, Stanford, CA, United States of America. Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA, United States of America. Department of Neurosurgery, Stanford University, Stanford, CA, United States of America. Author to whom any correspondence should be addressed
| | | |
Collapse
|
28
|
Tong W, Hejazi M, Garrett DJ, Esler T, Prawer S, Meffin H, Ibbotson MR. Minimizing axon bundle activation of retinal ganglion cells with oriented rectangular electrodes. J Neural Eng 2020; 17:036016. [PMID: 32375131 DOI: 10.1088/1741-2552/ab909e] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Retinal prostheses aim to restore vision in patients with retinal degenerative diseases, such as age-related macular degeneration and retinitis pigmentosa. By implanting an array of microelectrodes, such a device creates percepts in patients through electrical stimulation of surviving retinal neurons. A challenge for retinal prostheses when trying to return high quality vision is the unintended activation of retinal ganglion cells through the stimulation of passing axon bundles, which leads to patients reporting large, elongated patches of light instead of focal spots. APPROACH In this work, we used calcium imaging to record the responses of retinal ganglion cells to electrical stimulation in explanted retina using rectangular electrodes placed with different orientations relative to the axon bundles. MAIN RESULTS We showed that narrow, rectangular electrodes oriented parallel to the axon bundles can achieve focal stimulation. To further improve the strategy, we studied the impact of different stimulation waveforms and electrode configurations. We found the selectivity for focal stimulation to be higher when using short (33 μs), anodic-first biphasic pulses, with long electrode lengths and at least 50 μm electrode-to-retinal separation. Focal stimulation was, in fact, less selective when the electrodes made direct contact with the retinal surface due to unwanted preferential stimulation of the proximal axon bundles. SIGNIFICANCE When employed in retinal prostheses, the proposed stimulation strategy is expected to provide improved quality of vision to the blind.
Collapse
Affiliation(s)
- Wei Tong
- National Vision Research Institute, Australian College of Optometry, Carlton, VIC, Australia. School of Physics, The University of Melbourne, Parkville, VIC, Australia. Department of Vision Science and Optometry, Faculty of Medicine, Dentistry and Health Sciences, The University of Melbourne, Parkville, VIC, Australia
| | | | | | | | | | | | | |
Collapse
|
29
|
Im M, Kim SW. Neurophysiological and medical considerations for better-performing microelectronic retinal prostheses. J Neural Eng 2020; 17:033001. [PMID: 32329755 DOI: 10.1088/1741-2552/ab8ca9] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Affiliation(s)
- Maesoon Im
- Center for BioMicrosystems, Brain Science Institute, Korea Institute of Science and Technology (KIST), Seoul, Republic of Korea. Division of Bio-Medical Science & Technology, KIST School, University of Science and Technology (UST), Seoul, Republic of Korea
| | | |
Collapse
|
30
|
Tong W, Meffin H, Garrett DJ, Ibbotson MR. Stimulation Strategies for Improving the Resolution of Retinal Prostheses. Front Neurosci 2020; 14:262. [PMID: 32292328 PMCID: PMC7135883 DOI: 10.3389/fnins.2020.00262] [Citation(s) in RCA: 28] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2019] [Accepted: 03/09/2020] [Indexed: 12/17/2022] Open
Abstract
Electrical stimulation using implantable devices with arrays of stimulating electrodes is an emerging therapy for neurological diseases. The performance of these devices depends greatly on their ability to activate populations of neurons with high spatiotemporal resolution. To study electrical stimulation of populations of neurons, retina serves as a useful model because the neural network is arranged in a planar array that is easy to access. Moreover, retinal prostheses are under development to restore vision by replacing the function of damaged light sensitive photoreceptors, which makes retinal research directly relevant for curing blindness. Here we provide a progress review on stimulation strategies developed in recent years to improve the resolution of electrical stimulation in retinal prostheses. We focus on studies performed with explanted retinas, in which electrophysiological techniques are the most advanced. We summarize achievements in improving the spatial and temporal resolution of electrical stimulation of the retina and methods to selectively stimulate neurons with different visual functions. Future directions for retinal prostheses development are also discussed, which could provide insights for other types of neuromodulatory devices in which high-resolution electrical stimulation is required.
Collapse
Affiliation(s)
- Wei Tong
- National Vision Research Institute, Australian College of Optometry, Carlton, VIC, Australia
- Department of Optometry and Vision Sciences, Melbourne School of Health Sciences, The University of Melbourne, Melbourne, VIC, Australia
- School of Physics, The University of Melbourne, Melbourne, VIC, Australia
| | - Hamish Meffin
- National Vision Research Institute, Australian College of Optometry, Carlton, VIC, Australia
- Department of Optometry and Vision Sciences, Melbourne School of Health Sciences, The University of Melbourne, Melbourne, VIC, Australia
- Department of Biomedical Engineering, The University of Melbourne, Melbourne, VIC, Australia
| | - David J. Garrett
- School of Physics, The University of Melbourne, Melbourne, VIC, Australia
| | - Michael R. Ibbotson
- National Vision Research Institute, Australian College of Optometry, Carlton, VIC, Australia
- Department of Optometry and Vision Sciences, Melbourne School of Health Sciences, The University of Melbourne, Melbourne, VIC, Australia
| |
Collapse
|
31
|
Höfling L, Oesterle J, Berens P, Zeck G. Probing and predicting ganglion cell responses to smooth electrical stimulation in healthy and blind mouse retina. Sci Rep 2020; 10:5248. [PMID: 32251331 PMCID: PMC7090015 DOI: 10.1038/s41598-020-61899-y] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2019] [Accepted: 02/19/2020] [Indexed: 11/14/2022] Open
Abstract
Retinal implants are used to replace lost photoreceptors in blind patients suffering from retinopathies such as retinitis pigmentosa. Patients wearing implants regain some rudimentary visual function. However, it is severely limited compared to normal vision because non-physiological stimulation strategies fail to selectively activate different retinal pathways at sufficient spatial and temporal resolution. The development of improved stimulation strategies is rendered difficult by the large space of potential stimuli. Here we systematically explore a subspace of potential stimuli by electrically stimulating healthy and blind mouse retina in epiretinal configuration using smooth Gaussian white noise delivered by a high-density CMOS-based microelectrode array. We identify linear filters of retinal ganglion cells (RGCs) by fitting a linear-nonlinear-Poisson (LNP) model. Our stimulus evokes spatially and temporally confined spiking responses in RGC which are accurately predicted by the LNP model. Furthermore, we find diverse shapes of linear filters in the linear stage of the model, suggesting diverse preferred electrical stimuli of RGCs. The linear filter base identified by our approach could provide a starting point of a model-guided search for improved stimuli for retinal prosthetics.
Collapse
Affiliation(s)
- Larissa Höfling
- Natural and Medical Sciences Institute at the University of Tübingen, Reutlingen, Germany
- Graduate Training Centre of Neuroscience, University of Tübingen, Tübingen, Germany
- Institute for Ophthalmic Research, University of Tübingen, Tübingen, Germany
- Centre for Integrative Neuroscience, University of Tübingen, Tübingen, Germany
| | - Jonathan Oesterle
- Institute for Ophthalmic Research, University of Tübingen, Tübingen, Germany
| | - Philipp Berens
- Institute for Ophthalmic Research, University of Tübingen, Tübingen, Germany
- Bernstein Center for Computational Neuroscience, University of Tübingen, Tübingen, Germany
- Department of Computer Science, University of Tübingen, Tübingen, Germany
| | - Günther Zeck
- Natural and Medical Sciences Institute at the University of Tübingen, Reutlingen, Germany.
- Bernstein Center for Computational Neuroscience, University of Tübingen, Tübingen, Germany.
| |
Collapse
|
32
|
Tong W, Stamp M, Apollo NV, Ganesan K, Meffin H, Prawer S, Garrett DJ, Ibbotson MR. Improved visual acuity using a retinal implant and an optimized stimulation strategy. J Neural Eng 2019; 17:016018. [DOI: 10.1088/1741-2552/ab5299] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
33
|
Chenais NAL, Leccardi MJIA, Ghezzi D. Capacitive-like photovoltaic epiretinal stimulation enhances and narrows the network-mediated activity of retinal ganglion cells by recruiting the lateral inhibitory network. J Neural Eng 2019; 16:066009. [DOI: 10.1088/1741-2552/ab3913] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
34
|
Shadmani A, Viswam V, Chen Y, Bounik R, Dragas J, Radivojevic M, Geissler S, Sitnikov S, Muller J, Hierlemann A. Stimulation and Artifact-Suppression Techniques for In Vitro High-Density Microelectrode Array Systems. IEEE Trans Biomed Eng 2019; 66:2481-2490. [PMID: 30605090 PMCID: PMC6711758 DOI: 10.1109/tbme.2018.2890530] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
Abstract
We present novel voltage stimulation buffers with controlled output current, along with recording circuits featuring adjustable high-pass cut-off filtering to perform efficient stimulation while actively suppressing stimulation artifacts in high-density microelectrode arrays. Owing to the dense packing and close proximity of the electrodes in such systems, a stimulation through one electrode can cause large electrical artifacts on neighboring electrodes that easily saturate the corresponding recording amplifiers. To suppress such artifacts, the high-pass corner frequencies of all available 2048 recording channels can be raised from several Hz to several kHz by applying a "soft-reset" or pole-shifting technique. With the implemented artifact suppression technique, the saturation time of the recording circuits, connected to electrodes in immediate vicinity to the stimulation site, could be reduced to less than 150 μs. For the stimulation buffer, we developed a circuit, which can operate in two modes: either control of only the stimulation voltage or control of current and voltage during stimulation. The voltage-only controlled mode employs a local common-mode feedback operational transconductance amplifier with a near rail-to-rail input/output range, suitable for driving high-capacitive loads. The current/voltage controlled mode is based on a positive current conveyor generating adjustable output currents, whereas its upper and lower output voltages are limited by two feedback loops. The current/voltage controlled circuit can generate stimulation pulses up to 30 μA with less than ±0.1% linearity error in the low-current mode and up to 300 μA with less than ±0.2% linearity error in the high-current mode.
Collapse
|
35
|
A model of ganglion axon pathways accounts for percepts elicited by retinal implants. Sci Rep 2019; 9:9199. [PMID: 31235711 PMCID: PMC6591412 DOI: 10.1038/s41598-019-45416-4] [Citation(s) in RCA: 64] [Impact Index Per Article: 12.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2019] [Accepted: 06/04/2019] [Indexed: 11/09/2022] Open
Abstract
Degenerative retinal diseases such as retinitis pigmentosa and macular degeneration cause irreversible vision loss in more than 10 million people worldwide. Retinal prostheses, now implanted in over 250 patients worldwide, electrically stimulate surviving cells in order to evoke neuronal responses that are interpreted by the brain as visual percepts ('phosphenes'). However, instead of seeing focal spots of light, current implant users perceive highly distorted phosphenes that vary in shape both across subjects and electrodes. We characterized these distortions by asking users of the Argus retinal prosthesis system (Second Sight Medical Products Inc.) to draw electrically elicited percepts on a touchscreen. Using ophthalmic fundus imaging and computational modeling, we show that elicited percepts can be accurately predicted by the topographic organization of optic nerve fiber bundles in each subject's retina, successfully replicating visual percepts ranging from 'blobs' to oriented 'streaks' and 'wedges' depending on the retinal location of the stimulating electrode. This provides the first evidence that activation of passing axon fibers accounts for the rich repertoire of phosphene shape commonly reported in psychophysical experiments, which can severely distort the quality of the generated visual experience. Overall our findings argue for more detailed modeling of biological detail across neural engineering applications.
Collapse
|
36
|
Bosse B, Damle S, Akinin A, Jing Y, Bartsch DU, Cheng L, Oesch N, Lo YH, Cauwenberghs G, Freeman WR. In Vivo Photovoltaic Performance of a Silicon Nanowire Photodiode-Based Retinal Prosthesis. Invest Ophthalmol Vis Sci 2019; 59:5885-5892. [PMID: 30550611 PMCID: PMC6295940 DOI: 10.1167/iovs.18-24554] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023] Open
Abstract
Purpose For more than 20 years, there has been an international, multidisciplinary effort to develop retinal prostheses to restore functional vision to patients blinded by retinal degeneration. We developed a novel subretinal prosthesis with 1512 optically addressed silicon nanowire photodiodes, which transduce incident light into an electrical stimulation of the remaining retinal circuitry. This study was conducted to evaluate the efficacy of optically driving the subretinal prosthesis to produce visual cortex activation via electrical stimulation of the retina. Methods We measured electrically evoked potential responses (EEPs) in rabbit visual cortex in response to illumination of the subretinal nanowire prosthesis with pulsed 852-nm infrared (IR) light. We compared the EEP responses to visually evoked potential responses (VEPs) to pulsed 532-nm visible light (positive control) and pulsed 852-nm IR light (negative control). Results Activating the devices with IR light produced EEP responses with a significantly higher trough-to-peak amplitude (54.17 ± 33.4 μV) than IR light alone (24.07 ± 22.1 μV) or background cortical activity (23.22 ± 17.2 μV). EEP latencies were significantly faster than focal VEP latencies. Focal VEPs produced significantly higher amplitudes (94.88 ± 43.3 μV) than EEPs. We also demonstrated how an electrode placed on the cornea can be used as a noninvasive method to monitor the function of the implant. Conclusions These results show that subretinal electrical stimulation with nanowire electrodes can elicit EEPs in the visual cortex, providing evidence for the viability of a subretinal nanowire prosthetic approach for vision restoration.
Collapse
Affiliation(s)
- Brandon Bosse
- Nanovision Biosciences, Inc., La Jolla, California, United States
| | - Samir Damle
- Department of Bioengineering, University of California, San Diego, California, United States
| | - Abraham Akinin
- Department of Bioengineering, University of California, San Diego, California, United States
| | - Yi Jing
- Nanovision Biosciences, Inc., La Jolla, California, United States
| | - Dirk-Uwe Bartsch
- Jacobs Retina Center at Shiley Eye Institute, Department of Ophthalmology, University of California, San Diego, California, United States
| | - Lingyun Cheng
- Jacobs Retina Center at Shiley Eye Institute, Department of Ophthalmology, University of California, San Diego, California, United States
| | - Nicholas Oesch
- Jacobs Retina Center at Shiley Eye Institute, Department of Ophthalmology, University of California, San Diego, California, United States.,Department of Psychology, University of California, San Diego, California, United States
| | - Yu-Hwa Lo
- Department of Electrical and Computer Engineering, University of California, San Diego, California, United States
| | - Gert Cauwenberghs
- Department of Bioengineering, University of California, San Diego, California, United States
| | - William R Freeman
- Jacobs Retina Center at Shiley Eye Institute, Department of Ophthalmology, University of California, San Diego, California, United States
| |
Collapse
|
37
|
Ronchi S, Fiscella M, Marchetti C, Viswam V, Müller J, Frey U, Hierlemann A. Single-Cell Electrical Stimulation Using CMOS-Based High-Density Microelectrode Arrays. Front Neurosci 2019; 13:208. [PMID: 30918481 PMCID: PMC6424875 DOI: 10.3389/fnins.2019.00208] [Citation(s) in RCA: 31] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2018] [Accepted: 02/22/2019] [Indexed: 01/24/2023] Open
Abstract
Non-invasive electrical stimulation can be used to study and control neural activity in the brain or to alleviate somatosensory dysfunctions. One intriguing prospect is to precisely stimulate individual targeted neurons. Here, we investigated single-neuron current and voltage stimulation in vitro using high-density microelectrode arrays featuring 26,400 bidirectional electrodes at a pitch of 17.5 μm and an electrode area of 5 × 9 μm2. We determined optimal waveforms, amplitudes and durations for both stimulation modes. Owing to the high spatial resolution of our arrays and the close proximity of the electrodes to the respective neurons, we were able to stimulate the axon initial segments (AIS) with charges of less than 2 pC. This resulted in minimal artifact production and reliable readout of stimulation efficiency directly at the soma of the stimulated cell. Stimulation signals as low as 70 mV or 100 nA, with pulse durations as short as 18 μs, yielded measurable action potential initiation and propagation. We found that the required stimulation signal amplitudes decreased with cell growth and development and that stimulation efficiency did not improve at higher electric fields generated by simultaneous multi-electrode stimulation.
Collapse
Affiliation(s)
- Silvia Ronchi
- Department of Biosystems Science and Engineering, ETH Zürich, Basel, Switzerland
| | - Michele Fiscella
- Department of Biosystems Science and Engineering, ETH Zürich, Basel, Switzerland
- MaxWell Biosystems AG, Basel, Switzerland
| | - Camilla Marchetti
- Department of Biosystems Science and Engineering, ETH Zürich, Basel, Switzerland
| | - Vijay Viswam
- Department of Biosystems Science and Engineering, ETH Zürich, Basel, Switzerland
- MaxWell Biosystems AG, Basel, Switzerland
| | - Jan Müller
- Department of Biosystems Science and Engineering, ETH Zürich, Basel, Switzerland
- MaxWell Biosystems AG, Basel, Switzerland
| | - Urs Frey
- Department of Biosystems Science and Engineering, ETH Zürich, Basel, Switzerland
- MaxWell Biosystems AG, Basel, Switzerland
| | - Andreas Hierlemann
- Department of Biosystems Science and Engineering, ETH Zürich, Basel, Switzerland
| |
Collapse
|
38
|
Fan VH, Grosberg LE, Madugula SS, Hottowy P, Dabrowski W, Sher A, Litke AM, Chichilnisky EJ. Epiretinal stimulation with local returns enhances selectivity at cellular resolution. J Neural Eng 2018; 16:025001. [PMID: 30523958 DOI: 10.1088/1741-2552/aaeef1] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
OBJECTIVE Epiretinal prostheses are designed to restore vision in people blinded by photoreceptor degenerative diseases, by directly activating retinal ganglion cells (RGCs) using an electrode array implanted on the retina. In present-day clinical devices, current spread from the stimulating electrode to a distant return electrode often results in the activation of many cells, potentially limiting the quality of artificial vision. In the laboratory, epiretinal activation of RGCs with cellular resolution has been demonstrated with small electrodes, but distant returns may still cause undesirable current spread. Here, the ability of local return stimulation to improve the selective activation of RGCs at cellular resolution was evaluated. APPROACH A custom multi-electrode array (512 electrodes, 10 μm diameter, 60 μm pitch) was used to simultaneously stimulate and record from RGCs in isolated primate retina. Stimulation near the RGC soma with a single electrode and a distant return was compared to stimulation in which the return was provided by six neighboring electrodes. MAIN RESULTS Local return stimulation enhanced the capability to activate cells near the central electrode (<30 μm) while avoiding cells farther away (>30 μm). This resulted in an improved ability to selectively activate ON and OFF cells, including cells encoding immediately adjacent regions in the visual field. SIGNIFICANCE These results suggest that a device that restricts the electric field through local returns could optimize activation of neurons at cellular resolution, improving the quality of artificial vision.
Collapse
Affiliation(s)
- Victoria H Fan
- Departments of Neurosurgery, Ophthalmology, and Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA, United States of America
| | | | | | | | | | | | | | | |
Collapse
|
39
|
Esler TB, Maturana MI, Kerr RR, Grayden DB, Burkitt AN, Meffin H. Biophysical basis of the linear electrical receptive fields of retinal ganglion cells. J Neural Eng 2018; 15:055001. [PMID: 29889051 DOI: 10.1088/1741-2552/aacbaa] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
Responses of retinal ganglion cells to direct electrical stimulation have been shown experimentally to be well described by linear-nonlinear models. These models rely on the simplifying assumption that retinal ganglion cell responses to stimulation with an array of electrodes are driven by a simple linear weighted sum of stimulus current amplitudes from each electrode, known as the 'electrical receptive field'. OBJECTIVE This paper aims to demonstrate the biophysical basis of the linear-nonlinear model and the electrical receptive field to facilitate the development of improved stimulation strategies for retinal implants. APPROACH We compare the linear-nonlinear model of subretinal electrical stimulation with a multi-layered, biophysical, volume conductor model of retinal stimulation. MAIN RESULTS Our results show that the linear electrical receptive field of the linear-nonlinear model matches the transmembrane currents induced by electrodes (the activating function) at the site of the high-density sodium channel band with only minor discrepancies. The discrepancies are mostly eliminated by including axial current flow originating from adjacent cell compartments. Furthermore, for cells where a single linear electrical receptive field is insufficient, we show that cell responses are likely driven by multiple sites of action potential initiation with multiple distinct receptive fields, each of which can be accurately described by the activating function. SIGNIFICANCE This result establishes that the biophysical basis of the electrical receptive field of the linear-nonlinear model is the superposition of transmembrane currents induced by different electrodes at and near the site of action potential initiation. Together with existing experimental support for linear-nonlinear models of electrical stimulation, this provides a firm basis for using this much simplified model to generate more optimal stimulation patterns for retinal implants.
Collapse
Affiliation(s)
- Timothy B Esler
- NeuroEngineering Laboratory, Department of Biomedical Engineering, The University of Melbourne, Australia
| | | | | | | | | | | |
Collapse
|
40
|
Esler TB, Kerr RR, Tahayori B, Grayden DB, Meffin H, Burkitt AN. Minimizing activation of overlying axons with epiretinal stimulation: The role of fiber orientation and electrode configuration. PLoS One 2018; 13:e0193598. [PMID: 29494655 PMCID: PMC5833203 DOI: 10.1371/journal.pone.0193598] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2017] [Accepted: 02/14/2018] [Indexed: 12/19/2022] Open
Abstract
Currently, a challenge in electrical stimulation of the retina with a visual prosthesis (bionic eye) is to excite only the cells lying directly under the electrode in the ganglion cell layer, while avoiding excitation of axon bundles that pass over the surface of the retina in the nerve fiber layer. Stimulation of overlying axons results in irregular visual percepts, limiting perceptual efficacy. This research explores how differences in fiber orientation between the nerve fiber layer and ganglion cell layer leads to differences in the electrical activation of the axon initial segment and axons of passage. Approach. Axons of passage of retinal ganglion cells in the nerve fiber layer are characterized by a narrow distribution of fiber orientations, causing highly anisotropic spread of applied current. In contrast, proximal axons in the ganglion cell layer have a wider distribution of orientations. A four-layer computational model of epiretinal extracellular stimulation that captures the effect of neurite orientation in anisotropic tissue has been developed using a volume conductor model known as the cellular composite model. Simulations are conducted to investigate the interaction of neural tissue orientation, stimulating electrode configuration, and stimulation pulse duration and amplitude. Main results. Our model shows that simultaneous stimulation with multiple electrodes aligned with the nerve fiber layer can be used to achieve selective activation of axon initial segments rather than passing fibers. This result can be achieved while reducing required stimulus charge density and with only modest increases in the spread of activation in the ganglion cell layer, and is shown to extend to the general case of arbitrary electrode array positioning and arbitrary target volume. Significance. These results elucidate a strategy for more targeted stimulation of retinal ganglion cells with experimentally-relevant multi-electrode geometries and achievable stimulation requirements.
Collapse
Affiliation(s)
- Timothy B. Esler
- Department of Biomedical Engineering, The University of Melbourne, Parkville, Victoria, Australia
- * E-mail:
| | - Robert R. Kerr
- Department of Biomedical Engineering, The University of Melbourne, Parkville, Victoria, Australia
- Seer Medical, Melbourne, Victoria, Australia
| | - Bahman Tahayori
- Monash Institute of Medical Engineering, Monash University, Clayton, Victoria, Australia
| | - David B. Grayden
- Department of Biomedical Engineering, The University of Melbourne, Parkville, Victoria, Australia
- Centre for Neural Engineering, The University of Melbourne, Parkville, Victoria, Australia
| | - Hamish Meffin
- National Vision Research Institute, Australian College of Optometry, Carlton, Victoria, Australia
- ARC Centre of Excellence for Integrative Brain Function, Optometry & Vision Science, The University of Melbourne, Parkville, Victoria, Australia
| | - Anthony N. Burkitt
- Department of Biomedical Engineering, The University of Melbourne, Parkville, Victoria, Australia
| |
Collapse
|
41
|
Flores T, Lei X, Huang T, Lorach H, Dalal R, Galambos L, Kamins T, Mathieson K, Palanker D. Optimization of pillar electrodes in subretinal prosthesis for enhanced proximity to target neurons. J Neural Eng 2018; 15:036011. [PMID: 29388561 DOI: 10.1088/1741-2552/aaac39] [Citation(s) in RCA: 39] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
OBJECTIVE High-resolution prosthetic vision requires dense stimulating arrays with small electrodes. However, such miniaturization reduces electrode capacitance and penetration of electric field into tissue. We evaluate potential solutions to these problems with subretinal implants based on utilization of pillar electrodes. APPROACH To study integration of three-dimensional (3D) implants with retinal tissue, we fabricated arrays with varying pillar diameter, pitch, and height, and implanted beneath the degenerate retina in rats (Royal College of Surgeons, RCS). Tissue integration was evaluated six weeks post-op using histology and whole-mount confocal fluorescence imaging. The electric field generated by various electrode configurations was calculated in COMSOL, and stimulation thresholds assessed using a model of network-mediated retinal response. MAIN RESULTS Retinal tissue migrated into the space between pillars with no visible gliosis in 90% of implanted arrays. Pillars with 10 μm height reached the middle of the inner nuclear layer (INL), while 22 μm pillars reached the upper portion of the INL. Electroplated pillars with dome-shaped caps increase the active electrode surface area. Selective deposition of sputtered iridium oxide onto the cap ensures localization of the current injection to the pillar top, obviating the need to insulate the pillar sidewall. According to computational model, pillars having a cathodic return electrode above the INL and active anodic ring electrode at the surface of the implant would enable six times lower stimulation threshold, compared to planar arrays with circumferential return, but suffer from greater cross-talk between the neighboring pixels. SIGNIFICANCE 3D electrodes in subretinal prostheses help reduce electrode-tissue separation and decrease stimulation thresholds to enable smaller pixels, and thereby improve visual acuity of prosthetic vision.
Collapse
Affiliation(s)
- Thomas Flores
- Department of Applied Physics, Stanford University, Stanford, CA, United States of America
| | | | | | | | | | | | | | | | | |
Collapse
|
42
|
Mena GE, Grosberg LE, Madugula S, Hottowy P, Litke A, Cunningham J, Chichilnisky EJ, Paninski L. Electrical stimulus artifact cancellation and neural spike detection on large multi-electrode arrays. PLoS Comput Biol 2017; 13:e1005842. [PMID: 29131818 PMCID: PMC5703587 DOI: 10.1371/journal.pcbi.1005842] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2016] [Revised: 11/27/2017] [Accepted: 10/20/2017] [Indexed: 11/18/2022] Open
Abstract
Simultaneous electrical stimulation and recording using multi-electrode arrays can provide a valuable technique for studying circuit connectivity and engineering neural interfaces. However, interpreting these measurements is challenging because the spike sorting process (identifying and segregating action potentials arising from different neurons) is greatly complicated by electrical stimulation artifacts across the array, which can exhibit complex and nonlinear waveforms, and overlap temporarily with evoked spikes. Here we develop a scalable algorithm based on a structured Gaussian Process model to estimate the artifact and identify evoked spikes. The effectiveness of our methods is demonstrated in both real and simulated 512-electrode recordings in the peripheral primate retina with single-electrode and several types of multi-electrode stimulation. We establish small error rates in the identification of evoked spikes, with a computational complexity that is compatible with real-time data analysis. This technology may be helpful in the design of future high-resolution sensory prostheses based on tailored stimulation (e.g., retinal prostheses), and for closed-loop neural stimulation at a much larger scale than currently possible.
Collapse
Affiliation(s)
- Gonzalo E. Mena
- Statistics Department, Columbia University, New York, New York, United States of America
| | - Lauren E. Grosberg
- Department of Neurosurgery and Hansen Experimental Physics Laboratory, Stanford University, Stanford, California, United States of America
| | - Sasidhar Madugula
- Department of Neurosurgery and Hansen Experimental Physics Laboratory, Stanford University, Stanford, California, United States of America
| | - Paweł Hottowy
- Physics and Applied Computer Science, AGH University of Science and Technology, Krakow, Poland
| | - Alan Litke
- Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, Santa Cruz, California, United States of America
| | - John Cunningham
- Statistics Department, Columbia University, New York, New York, United States of America
- Grossman Center for the Statistics of Mind and Center for Theoretical Neuroscience, Columbia University, New York, New York, United States of America
| | - E. J. Chichilnisky
- Department of Neurosurgery and Hansen Experimental Physics Laboratory, Stanford University, Stanford, California, United States of America
| | - Liam Paninski
- Statistics Department, Columbia University, New York, New York, United States of America
- Grossman Center for the Statistics of Mind and Center for Theoretical Neuroscience, Columbia University, New York, New York, United States of America
| |
Collapse
|