1
|
Fine I, Boynton GM. A virtual patient simulation modeling the neural and perceptual effects of human visual cortical stimulation, from pulse trains to percepts. Sci Rep 2024; 14:17400. [PMID: 39075065 PMCID: PMC11286872 DOI: 10.1038/s41598-024-65337-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Accepted: 06/19/2024] [Indexed: 07/31/2024] Open
Abstract
The field of cortical sight restoration prostheses is making rapid progress with three clinical trials of visual cortical prostheses underway. However, as yet, we have only limited insight into the perceptual experiences produced by these implants. Here we describe a computational model or 'virtual patient', based on the neurophysiological architecture of V1, which successfully predicts the perceptual experience of participants across a wide range of previously published human cortical stimulation studies describing the location, size, brightness and spatiotemporal shape of electrically induced percepts in humans. Our simulations suggest that, in the foreseeable future the perceptual quality of cortical prosthetic devices is likely to be limited by the neurophysiological organization of visual cortex, rather than engineering constraints.
Collapse
Affiliation(s)
- Ione Fine
- Department of Psychology, University of Washington, Seattle, 98195, USA.
- Faculty of Biological Sciences, University of Leeds, Leeds, UK.
| | | |
Collapse
|
2
|
Meital-Kfir N, Pezaris JS. The Influence of Phosphene Synchrony in Driving Object Binding in a Simulation of Artificial Vision. Invest Ophthalmol Vis Sci 2023; 64:5. [PMID: 38051263 DOI: 10.1167/iovs.64.15.5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/07/2023] Open
Abstract
Purpose Electrical microstimulation techniques used in visual prostheses are designed to restore visual function following acquired blindness. Patterns of induced focal percepts, known as phosphenes, are achieved by applying localized electrical pulses to the visual pathway to bypass the impaired site in order to convey images from the external world. Here, we use a simulation of artificial vision to manipulate relationships between individual phosphenes to observe the effects on object binding and perception. We hypothesize that synchronous phosphene presentation will facilitate object perception as compared to asynchronous presentation. Methods A model system that tracks gaze position of normal, sighted participants to present patterns of phosphenes on a computer screen was used to simulate prosthetic vision. Participants performed a reading task at varying font sizes (1.1-1.4 logMAR) and under varying levels of phosphene temporal noise while reading accuracy and speed were measured. Results Reading performance was significantly affected by temporal noise in phosphene presentation, with increasing desynchronization leading to lower reading scores. A drop in performance was also observed when the total latency between the gaze position and phosphene update was increased without adding temporal noise. Conclusions Object perception (here, text perception) is enhanced with synchronously presented phosphenes as compared to asynchronously presented ones. These results are fundamental for developing an efficient temporal pattern of stimulation and for the creation of high-fidelity prosthetic vision.
Collapse
Affiliation(s)
- Noya Meital-Kfir
- Department of Neurosurgery, Massachusetts General Hospital, Boston, Massachusetts, United States
- Department of Neurosurgery, Harvard Medical School, Boston, Massachusetts, United States
| | - John S Pezaris
- Department of Neurosurgery, Massachusetts General Hospital, Boston, Massachusetts, United States
- Department of Neurosurgery, Harvard Medical School, Boston, Massachusetts, United States
| |
Collapse
|
3
|
Granley J, Fauvel T, Chalk M, Beyeler M. Human-in-the-Loop Optimization for Deep Stimulus Encoding in Visual Prostheses. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 2023; 36:79376-79398. [PMID: 38984104 PMCID: PMC11232484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Subscribe] [Scholar Register] [Indexed: 07/11/2024]
Abstract
Neuroprostheses show potential in restoring lost sensory function and enhancing human capabilities, but the sensations produced by current devices often seem unnatural or distorted. Exact placement of implants and differences in individual perception lead to significant variations in stimulus response, making personalized stimulus optimization a key challenge. Bayesian optimization could be used to optimize patient-specific stimulation parameters with limited noisy observations, but is not feasible for high-dimensional stimuli. Alternatively, deep learning models can optimize stimulus encoding strategies, but typically assume perfect knowledge of patient-specific variations. Here we propose a novel, practically feasible approach that overcomes both of these fundamental limitations. First, a deep encoder network is trained to produce optimal stimuli for any individual patient by inverting a forward model mapping electrical stimuli to visual percepts. Second, a preferential Bayesian optimization strategy utilizes this encoder to optimize patient-specific parameters for a new patient, using a minimal number of pairwise comparisons between candidate stimuli. We demonstrate the viability of this approach on a novel, state-of-the-art visual prosthesis model. We show that our approach quickly learns a personalized stimulus encoder, leads to dramatic improvements in the quality of restored vision, and is robust to noisy patient feedback and misspecifications in the underlying forward model. Overall, our results suggest that combining the strengths of deep learning and Bayesian optimization could significantly improve the perceptual experience of patients fitted with visual prostheses and may prove a viable solution for a range of neuroprosthetic technologies.
Collapse
Affiliation(s)
- Jacob Granley
- Department of Computer Science, University of California, Santa Barbara
| | - Tristan Fauvel
- Institut de la Vision, Sorbonne Université, 17 rue Moreau, F-75012 Paris, France, Now with Quinten Health
| | - Matthew Chalk
- Institut de la Vision, Sorbonne Université, 17 rue Moreau, F-75012 Paris, France
| | - Michael Beyeler
- Department of Computer Science, Department of Psychological & Brain Sciences, University of California, Santa Barbara
| |
Collapse
|
4
|
Fine I, Boynton GM. Pulse trains to percepts: A virtual patient describing the perceptual effects of human visual cortical stimulation. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.03.18.532424. [PMID: 36993519 PMCID: PMC10055195 DOI: 10.1101/2023.03.18.532424] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
The field of cortical sight restoration prostheses is making rapid progress with three clinical trials of visual cortical prostheses underway. However, as yet, we have only limited insight into the perceptual experiences produced by these implants. Here we describe a computational model or 'virtual patient', based on the neurophysiological architecture of V1, which successfully predicts the perceptual experience of participants across a wide range of previously published cortical stimulation studies describing the location, size, brightness and spatiotemporal shape of electrically induced percepts in humans. Our simulations suggest that, in the foreseeable future the perceptual quality of cortical prosthetic devices is likely to be limited by the neurophysiological organization of visual cortex, rather than engineering constraints.
Collapse
|
5
|
Wang C, Fang C, Zou Y, Yang J, Sawan M. Artificial intelligence techniques for retinal prostheses: a comprehensive review and future direction. J Neural Eng 2023; 20. [PMID: 36634357 DOI: 10.1088/1741-2552/acb295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Accepted: 01/12/2023] [Indexed: 01/14/2023]
Abstract
Objective. Retinal prostheses are promising devices to restore vision for patients with severe age-related macular degeneration or retinitis pigmentosa disease. The visual processing mechanism embodied in retinal prostheses play an important role in the restoration effect. Its performance depends on our understanding of the retina's working mechanism and the evolvement of computer vision models. Recently, remarkable progress has been made in the field of processing algorithm for retinal prostheses where the new discovery of the retina's working principle and state-of-the-arts computer vision models are combined together.Approach. We investigated the related research on artificial intelligence techniques for retinal prostheses. The processing algorithm in these studies could be attributed to three types: computer vision-related methods, biophysical models, and deep learning models.Main results. In this review, we first illustrate the structure and function of the normal and degenerated retina, then demonstrate the vision rehabilitation mechanism of three representative retinal prostheses. It is necessary to summarize the computational frameworks abstracted from the normal retina. In addition, the development and feature of three types of different processing algorithms are summarized. Finally, we analyze the bottleneck in existing algorithms and propose our prospect about the future directions to improve the restoration effect.Significance. This review systematically summarizes existing processing models for predicting the response of the retina to external stimuli. What's more, the suggestions for future direction may inspire researchers in this field to design better algorithms for retinal prostheses.
Collapse
Affiliation(s)
- Chuanqing Wang
- Center of Excellence in Biomedical Research on Advanced Integrated-on-chips Neurotechnologies, School of Engineering, Westlake University, Hangzhou 310030, People's Republic of China
| | - Chaoming Fang
- Center of Excellence in Biomedical Research on Advanced Integrated-on-chips Neurotechnologies, School of Engineering, Westlake University, Hangzhou 310030, People's Republic of China
| | - Yong Zou
- Beijing Institute of Radiation Medicine, Beijing, People's Republic of China
| | - Jie Yang
- Center of Excellence in Biomedical Research on Advanced Integrated-on-chips Neurotechnologies, School of Engineering, Westlake University, Hangzhou 310030, People's Republic of China
| | - Mohamad Sawan
- Center of Excellence in Biomedical Research on Advanced Integrated-on-chips Neurotechnologies, School of Engineering, Westlake University, Hangzhou 310030, People's Republic of China
| |
Collapse
|
6
|
Carleton M, Oesch NW. Differences in the spatial fidelity of evoked and spontaneous signals in the degenerating retina. Front Cell Neurosci 2022; 16:1040090. [PMID: 36419935 PMCID: PMC9676928 DOI: 10.3389/fncel.2022.1040090] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2022] [Accepted: 10/20/2022] [Indexed: 07/01/2024] Open
Abstract
Vision restoration strategies aim to reestablish vision by replacing the function of lost photoreceptors with optoelectronic hardware or through gene therapy. One complication to these approaches is that retinal circuitry undergoes remodeling after photoreceptor loss. Circuit remodeling following perturbation is ubiquitous in the nervous system and understanding these changes is crucial for treating neurodegeneration. Spontaneous oscillations that arise during retinal degeneration have been well-studied, however, other changes in the spatiotemporal processing of evoked and spontaneous activity have received less attention. Here we use subretinal electrical stimulation to measure the spatial and temporal spread of both spontaneous and evoked activity during retinal degeneration. We found that electrical stimulation synchronizes spontaneous oscillatory activity, over space and through time, thus leading to increased correlations in ganglion cell activity. Intriguingly, we found that spatial selectivity was maintained in rd10 retina for evoked responses, with spatial receptive fields comparable to wt retina. These findings indicate that different biophysical mechanisms are involved in mediating feed forward excitation, and the lateral spread of spontaneous activity in the rd10 retina, lending support toward the possibility of high-resolution vision restoration.
Collapse
Affiliation(s)
- Maya Carleton
- Department of Psychology, University of California, San Diego, La Jolla, CA, United States
| | - Nicholas W. Oesch
- Department of Psychology, University of California, San Diego, La Jolla, CA, United States
- Department of Ophthalmology, University of California, San Diego, La Jolla, CA, United States
- The Neurosciences Graduate Program, University of California, San Diego, La Jolla, CA, United States
| |
Collapse
|
7
|
Wang J, Zhao R, Li P, Fang Z, Li Q, Han Y, Zhou R, Zhang Y. Clinical Progress and Optimization of Information Processing in Artificial Visual Prostheses. SENSORS (BASEL, SWITZERLAND) 2022; 22:6544. [PMID: 36081002 PMCID: PMC9460383 DOI: 10.3390/s22176544] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Revised: 08/22/2022] [Accepted: 08/26/2022] [Indexed: 06/15/2023]
Abstract
Visual prostheses, used to assist in restoring functional vision to the visually impaired, convert captured external images into corresponding electrical stimulation patterns that are stimulated by implanted microelectrodes to induce phosphenes and eventually visual perception. Detecting and providing useful visual information to the prosthesis wearer under limited artificial vision has been an important concern in the field of visual prosthesis. Along with the development of prosthetic device design and stimulus encoding methods, researchers have explored the possibility of the application of computer vision by simulating visual perception under prosthetic vision. Effective image processing in computer vision is performed to optimize artificial visual information and improve the ability to restore various important visual functions in implant recipients, allowing them to better achieve their daily demands. This paper first reviews the recent clinical implantation of different types of visual prostheses, summarizes the artificial visual perception of implant recipients, and especially focuses on its irregularities, such as dropout and distorted phosphenes. Then, the important aspects of computer vision in the optimization of visual information processing are reviewed, and the possibilities and shortcomings of these solutions are discussed. Ultimately, the development direction and emphasis issues for improving the performance of visual prosthesis devices are summarized.
Collapse
Affiliation(s)
- Jing Wang
- School of Information, Shanghai Ocean University, Shanghai 201306, China
- Key Laboratory of Fishery Information, Ministry of Agriculture, Shanghai 200335, China
| | - Rongfeng Zhao
- School of Information, Shanghai Ocean University, Shanghai 201306, China
| | - Peitong Li
- School of Information, Shanghai Ocean University, Shanghai 201306, China
| | - Zhiqiang Fang
- School of Information, Shanghai Ocean University, Shanghai 201306, China
| | - Qianqian Li
- School of Information, Shanghai Ocean University, Shanghai 201306, China
| | - Yanling Han
- School of Information, Shanghai Ocean University, Shanghai 201306, China
| | - Ruyan Zhou
- School of Information, Shanghai Ocean University, Shanghai 201306, China
| | - Yun Zhang
- School of Information, Shanghai Ocean University, Shanghai 201306, China
| |
Collapse
|
8
|
Fauvel T, Chalk M. Human-in-the-loop optimization of visual prosthetic stimulation. J Neural Eng 2022; 19. [PMID: 35667363 DOI: 10.1088/1741-2552/ac7615] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Accepted: 06/06/2022] [Indexed: 11/12/2022]
Abstract
Retinal prostheses are a promising strategy to restore sight to patients with retinal degenerative diseases. These devices compensate for the loss of photoreceptors by electrically stimulating neurons in the retina. Currently, the visual function that can be recovered with such devices is very limited. This is due, in part, to current spread, unintended axonal activation, and the limited resolution of existing devices. Here we show, using a recent model of prosthetic vision, that optimizing how visual stimuli are encoded by the device can help overcome some of these limitations, leading to dramatic improvements in visual perception. APPROACH We propose a strategy to do this in practice, using patients' feedback in a visual task. The main challenge of our approach comes from the fact that, typically, one only has access to a limited number of noisy responses from patients. We propose two ways to deal with this: first, we use a model of prosthetic vision to constrain and simplify the optimization. We show that, if one knew the parameters of this model for a given patient, it would be possible to greatly improve their perceptual performance. Second we propose a preferential Bayesian optimization to efficiently learn these model parameters for each patient, using minimal trials. MAIN RESULTS To test our approach, we presented healthy subjects with visual stimuli generated by a recent model of prosthetic vision, to replicate the perceptual experience of patients fitted with an implant. Our optimization procedure led to significant and robust improvements in perceived image quality, that transferred to increased performance in other tasks. SIGNIFICANCE Importantly, our strategy is agnostic to the type of prosthesis and thus could readily be implemented in existing implants.
Collapse
Affiliation(s)
- Tristan Fauvel
- Institut de la Vision, INSERM, 17 Rue Moreau, Paris, Île-de-France, 75014, FRANCE
| | - Matthew Chalk
- Institut de l a Vision, INSERM, 17 Rue Moreau, Paris, 75014, FRANCE
| |
Collapse
|
9
|
Christie B, Sadeghi R, Kartha A, Caspi A, Tenore FV, Klatzky RL, Dagnelie G, Billings S. Sequential epiretinal stimulation improves discrimination in simple shape discrimination tasks only. J Neural Eng 2022; 19. [PMID: 35613043 DOI: 10.1088/1741-2552/ac7326] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2022] [Accepted: 05/24/2022] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Electrical stimulation of the retina can elicit flashes of light called phosphenes, which can be used to restore rudimentary vision for people with blindness. Functional sight requires stimulation of multiple electrodes to create patterned vision, but phosphenes tend to merge together in an uninterpretable way. Sequentially stimulating electrodes in human visual cortex has recently demonstrated that shapes could be "drawn" with better perceptual resolution relative to simultaneous stimulation. The goal of this study was to evaluate if sequential stimulation would also form clearer shapes when the retina is the neural target. APPROACH Two human participants with retinitis pigmentosa who had Argus® II retinal prostheses participated in this study. We evaluated different temporal parameters for sequential stimulation in phosphene shape mapping and forced-choice discrimination tasks. For the discrimination tasks, performance was compared between stimulating electrodes simultaneously versus sequentially. MAIN RESULTS Phosphenes elicited by different electrodes were reported as vastly different shapes. Sequential electrode stimulation outperformed simultaneous stimulation in simple discrimination tasks, in which shapes were created by stimulating 3-4 electrodes, but not in more complex discrimination tasks involving 5+ electrodes. For sequential stimulation, the optimal pulse train duration was 200 ms when stimulating at 20 Hz and the optimal gap interval was tied between 0 and 50 ms. Efficacy of sequential stimulation also depended strongly on selecting electrodes that elicited phosphenes with similar shapes and sizes. SIGNIFICANCE An epiretinal prosthesis can produce coherent simple shapes with a sequential stimulation paradigm, which can be used as rudimentary visual feedback. However, success in creating more complex shapes, such as letters of the alphabet, is still limited. Sequential stimulation may be most beneficial for epiretinal prostheses in simple tasks, such as basic navigation, rather than complex tasks such as object identification.
Collapse
Affiliation(s)
- Breanne Christie
- Research and Exploratory Development Department, Johns Hopkins University Applied Physics Laboratory, 11100 Johns Hopkins Road, Laurel, Maryland, 20723, UNITED STATES
| | - Roksana Sadeghi
- Department of Biomedical Engineering, Johns Hopkins School of Medicine, 733 N Broadway, Baltimore, Maryland, 21205, UNITED STATES
| | - Arathy Kartha
- Department of Ophthalmology, Johns Hopkins School of Medicine, 1800 Orleans St., Baltimore, Maryland, 21287, UNITED STATES
| | - Avi Caspi
- Jerusalem College of Technology, Ha-Va'ad ha-Le'umi St 21, Jerusalem, 91160, ISRAEL
| | - Francesco V Tenore
- Research and Exploratory Development Department, Johns Hopkins University Applied Physics Laboratory, 11100 Johns Hopkins Road, Laurel, Maryland, 20723, UNITED STATES
| | - Roberta L Klatzky
- Department of Psychology, Carnegie Mellon University, 5000 Forbes Ave, Pittsburgh, Pennsylvania, 15213-3815, UNITED STATES
| | - Gislin Dagnelie
- Department of Ophthalmology, Johns Hopkins School of Medicine, 1800 Orleans St., Baltimore, Maryland, 21287, UNITED STATES
| | - Seth Billings
- Research and Exploratory Development Department, Johns Hopkins University Applied Physics Laboratory, 11100 Johns Hopkins Road, Laurel, Maryland, 20723-6005, UNITED STATES
| |
Collapse
|
10
|
Avraham D, Yitzhaky Y. Simulating the perceptual effects of electrode-retina distance in prosthetic vision. J Neural Eng 2022; 19. [PMID: 35561665 DOI: 10.1088/1741-2552/ac6f82] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2022] [Accepted: 05/13/2022] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Retinal prostheses aim to restore some vision in retinitis pigmentosa and age-related macular degeneration blind patients. Many spatial and temporal aspects have been found to affect prosthetic vision. Our objective is to study the impact of the space-variant distance between the stimulating electrodes and the surface of the retina on prosthetic vision and how to mitigate this impact. APPROACH A prosthetic vision simulation was built to demonstrate the perceptual effects of the electrode-retina distance (ERD) with different random spatial variations, such as size, brightness, shape, dropout, and spatial shifts. Three approaches for reducing the ERD effects are demonstrated: electrode grouping (quads), ERD-based input-image enhancement, and object scanning with and without phosphene persistence. A quantitative assessment for the first two approaches was done based on experiments with 20 subjects and three vision-based computational image similarity metrics. MAIN RESULTS The effects of various ERDs on phosphenes' size, brightness, and shape were simulated. Quads, chosen according to the ERDs, effectively elicit phosphenes without exceeding the safe charge density limit, whereas single electrodes with large ERD cannot do so. Input-image enhancement reduced the ERD effects effectively. These two approaches significantly improved ERD-affected prosthetic vision according to the experiment and image similarity metrics. A further reduction of the ERD effects was achieved by scanning an object while moving the head. SIGNIFICANCE ERD has multiple effects on perception with retinal prostheses. One of them is vision loss caused by the incapability of electrodes with large ERD to evoke phosphenes. The three approaches presented in this study can be used separately or together to mitigate the impact of ERD. A consideration of our approaches in reducing the perceptual effects of the ERD may help improve the perception with current prosthetic technology and influence the design of future prostheses.
Collapse
Affiliation(s)
- David Avraham
- Department of Electro-Optical Engineering, Ben-Gurion University of the Negev, 1 Ben-Gurion Blvd., Beer-Sheva, 84105, ISRAEL
| | - Yitzhak Yitzhaky
- Electro-Optical Engineering, School of Engineering, Ben-Gurion University of the Negev, 1 Ben-Gurion Blvd., Beer-Sheva, Southern, 84105, ISRAEL
| |
Collapse
|
11
|
Salas MA, Bell J, Niketeghad S, Oswalt D, Bosking W, Patel U, Dorn JD, Yoshor D, Greenberg R, Bari A, Pouratian N. Sequence of visual cortex stimulation affects phosphene brightness in blind subjects. Brain Stimul 2022; 15:605-614. [DOI: 10.1016/j.brs.2022.03.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2021] [Revised: 03/12/2022] [Accepted: 03/29/2022] [Indexed: 11/02/2022] Open
|
12
|
Haji Ghaffari D, Akwaboah AD, Mirzakhalili E, Weiland JD. Real-Time Optimization of Retinal Ganglion Cell Spatial Activity in Response to Epiretinal Stimulation. IEEE Trans Neural Syst Rehabil Eng 2021; 29:2733-2741. [PMID: 34941514 PMCID: PMC8851408 DOI: 10.1109/tnsre.2021.3138297] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Retinal prostheses aim to improve visual perception in patients blinded by photoreceptor degeneration. However, shape and letter perception with these devices is currently limited due to low spatial resolution. Previous research has shown the retinal ganglion cell (RGC) spatial activity and phosphene shapes can vary due to the complexity of retina structure and electrode-retina interactions. Visual percepts elicited by single electrodes differ in size and shapes for different electrodes within the same subject, resulting in interference between phosphenes and an unclear image. Prior work has shown that better patient outcomes correlate with spatially separate phosphenes. In this study we use calcium imaging, in vitro retina, neural networks (NN), and an optimization algorithm to demonstrate a method to iteratively search for optimal stimulation parameters that create focal RGC activation. Our findings indicate that we can converge to stimulation parameters that result in focal RGC activation by sampling less than 1/3 of the parameter space. A similar process implemented clinically can reduce time required for optimizing implant operation and enable personalized fitting of retinal prostheses.
Collapse
|
13
|
Abstract
Visual retinal prostheses aim to restore vision for blind individuals who suffer from outer retinal degenerative diseases, such as retinitis pigmentosa and age-related macular degeneration. Perception through retinal prostheses is very limited, but it can be improved by applying object isolation. We used an object isolation algorithm based on integral imaging to isolate objects of interest according to their depth from the camera and applied image processing manipulation to the isolated-object images. Subsequently, we applied a spatial prosthetic vision simulation that converted the isolated-object images to phosphene images. We compared the phosphene images for two types of input images, the original image (before applying object isolation), and the isolated-object image to illustrate the effects of object isolation on simulated prosthetic vision without and with multiple spatial variations of phosphenes, such as size and shape variations, spatial shifts, and dropout rate. The results show an improvement in the perceived shape, contrast, and dynamic range (number of gray levels) of objects in the phosphene image.
Collapse
|
14
|
Avraham D, Jung JH, Yitzhaky Y, Peli E. Retinal prosthetic vision simulation: temporal aspects. J Neural Eng 2021; 18. [PMID: 34359062 DOI: 10.1088/1741-2552/ac1b6c] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2021] [Accepted: 08/06/2021] [Indexed: 11/11/2022]
Abstract
Objective. The perception of individuals fitted with retinal prostheses is not fully understood, although several retinal implants have been tested and commercialized. Realistic simulations of perception with retinal implants would be useful for future development and evaluation of such systems.Approach.We implemented a retinal prosthetic vision simulation, including temporal features, which have not been previously simulated. In particular, the simulation included temporal aspects such as persistence and perceptual fading of phosphenes and the electrode activation rate.Main results.The simulated phosphene persistence showed an effective reduction in flickering at low electrode activation rates. Although persistence has a positive effect on static scenes, it smears dynamic scenes. Perceptual fading following continuous stimulation affects prosthetic vision of both static and dynamic scenes by making them disappear completely or partially. However, we showed that perceptual fading of a static stimulus might be countered by head-scanning motions, which together with the persistence revealed the contours of the faded object. We also showed that changing the image polarity may improve simulated prosthetic vision in the presence of persistence and perceptual fading.Significance.Temporal aspects have important roles in prosthetic vision, as illustrated by the simulations. Considering these aspects may improve the future design, the training with, and evaluation of retinal prostheses.
Collapse
Affiliation(s)
- David Avraham
- Department of Electro-Optical Engineering, School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, Beer Sheva, Israel.,Schepens Eye Research Institute of Massachusetts Eye and Ear, Department of Ophthalmology, Harvard Medical School, Boston, MA, United States of America
| | - Jae-Hyun Jung
- Schepens Eye Research Institute of Massachusetts Eye and Ear, Department of Ophthalmology, Harvard Medical School, Boston, MA, United States of America
| | - Yitzhak Yitzhaky
- Department of Electro-Optical Engineering, School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, Beer Sheva, Israel
| | - Eli Peli
- Schepens Eye Research Institute of Massachusetts Eye and Ear, Department of Ophthalmology, Harvard Medical School, Boston, MA, United States of America
| |
Collapse
|
15
|
Moleirinho S, Whalen AJ, Fried SI, Pezaris JS. The impact of synchronous versus asynchronous electrical stimulation in artificial vision. J Neural Eng 2021; 18. [PMID: 33900206 DOI: 10.1088/1741-2552/abecf1] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2020] [Accepted: 03/09/2021] [Indexed: 11/12/2022]
Abstract
Visual prosthesis devices designed to restore sight to the blind have been under development in the laboratory for several decades. Clinical translation continues to be challenging, due in part to gaps in our understanding of critical parameters such as how phosphenes, the electrically-generated pixels of artificial vision, can be combined to form images. In this review we explore the effects that synchronous and asynchronous electrical stimulation across multiple electrodes have in evoking phosphenes. Understanding how electrical patterns influence phosphene generation to control object binding and perception of visual form is fundamental to creation of a clinically successful prosthesis.
Collapse
Affiliation(s)
- Susana Moleirinho
- Department of Neurosurgery, Massachusetts General Hospital, Boston, MA, United States of America.,Department of Neurosurgery, Harvard Medical School, Boston, MA, United States of America
| | - Andrew J Whalen
- Department of Neurosurgery, Massachusetts General Hospital, Boston, MA, United States of America.,Department of Neurosurgery, Harvard Medical School, Boston, MA, United States of America
| | - Shelley I Fried
- Department of Neurosurgery, Massachusetts General Hospital, Boston, MA, United States of America.,Department of Neurosurgery, Harvard Medical School, Boston, MA, United States of America.,Boston VA Healthcare System, Boston, MA, United States of America
| | - John S Pezaris
- Department of Neurosurgery, Massachusetts General Hospital, Boston, MA, United States of America.,Department of Neurosurgery, Harvard Medical School, Boston, MA, United States of America
| |
Collapse
|
16
|
Hadjinicolaou AE, Meffin H, Maturana MI, Cloherty SL, Ibbotson MR. Prosthetic vision: devices, patient outcomes and retinal research. Clin Exp Optom 2021; 98:395-410. [DOI: 10.1111/cxo.12342] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2015] [Revised: 07/06/2015] [Accepted: 08/04/2015] [Indexed: 12/11/2022] Open
Affiliation(s)
- Alex E Hadjinicolaou
- National Vision Research Institute, Australian College of Optometry, Carlton, Victoria, Australia,
- ARC Centre of Excellence for Integrative Brain Function and Department of Optometry and Vision Sciences, University of Melbourne, Parkville, Victoria, Australia,
| | - Hamish Meffin
- National Vision Research Institute, Australian College of Optometry, Carlton, Victoria, Australia,
- ARC Centre of Excellence for Integrative Brain Function and Department of Optometry and Vision Sciences, University of Melbourne, Parkville, Victoria, Australia,
| | - Matias I Maturana
- National Vision Research Institute, Australian College of Optometry, Carlton, Victoria, Australia,
- Department of Electrical and Electronic Engineering, The University of Melbourne, Parkville, Victoria, Australia,
| | - Shaun L Cloherty
- National Vision Research Institute, Australian College of Optometry, Carlton, Victoria, Australia,
- ARC Centre of Excellence for Integrative Brain Function and Department of Optometry and Vision Sciences, University of Melbourne, Parkville, Victoria, Australia,
- Department of Electrical and Electronic Engineering, The University of Melbourne, Parkville, Victoria, Australia,
| | - Michael R Ibbotson
- National Vision Research Institute, Australian College of Optometry, Carlton, Victoria, Australia,
- ARC Centre of Excellence for Integrative Brain Function and Department of Optometry and Vision Sciences, University of Melbourne, Parkville, Victoria, Australia,
| |
Collapse
|
17
|
Paknahad J, Loizos K, Yue L, Humayun MS, Lazzi G. Color and cellular selectivity of retinal ganglion cell subtypes through frequency modulation of electrical stimulation. Sci Rep 2021; 11:5177. [PMID: 33664347 PMCID: PMC7933163 DOI: 10.1038/s41598-021-84437-w] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2020] [Accepted: 02/15/2021] [Indexed: 01/31/2023] Open
Abstract
Epiretinal prostheses aim at electrically stimulating the inner most surviving retinal cells-retinal ganglion cells (RGCs)-to restore partial sight to the blind. Recent tests in patients with epiretinal implants have revealed that electrical stimulation of the retina results in the percept of color of the elicited phosphenes, which depends on the frequency of stimulation. This paper presents computational results that are predictive of this finding and further support our understanding of the mechanisms of color encoding in electrical stimulation of retina, which could prove pivotal for the design of advanced retinal prosthetics that elicit both percept and color. This provides, for the first time, a directly applicable "amplitude-frequency" stimulation strategy to "encode color" in future retinal prosthetics through a predictive computational tool to selectively target small bistratified cells, which have been shown to contribute to "blue-yellow" color opponency in the retinal circuitry. The presented results are validated with experimental data reported in the literature and correlated with findings in blind patients with a retinal prosthetic implant collected by our group.
Collapse
Affiliation(s)
- Javad Paknahad
- grid.42505.360000 0001 2156 6853Department of Electrical Engineering, University of Southern California, Los Angeles, CA USA ,grid.42505.360000 0001 2156 6853The Institute for Technology and Medical Systems (ITEMS), Keck School of Medicine, University of Southern California, Los Angeles, CA USA
| | - Kyle Loizos
- grid.42505.360000 0001 2156 6853The Institute for Technology and Medical Systems (ITEMS), Keck School of Medicine, University of Southern California, Los Angeles, CA USA
| | - Lan Yue
- grid.42505.360000 0001 2156 6853Roski Eye Institute, University of Southern California, Los Angeles, CA USA
| | - Mark S. Humayun
- grid.42505.360000 0001 2156 6853Roski Eye Institute, University of Southern California, Los Angeles, CA USA ,grid.42505.360000 0001 2156 6853Departments of Ophthalmology and Biomedical Engineering, University of Southern California, Los Angeles, CA USA
| | - Gianluca Lazzi
- grid.42505.360000 0001 2156 6853Department of Electrical Engineering, University of Southern California, Los Angeles, CA USA ,grid.42505.360000 0001 2156 6853The Institute for Technology and Medical Systems (ITEMS), Keck School of Medicine, University of Southern California, Los Angeles, CA USA ,grid.42505.360000 0001 2156 6853Departments of Ophthalmology and Biomedical Engineering, University of Southern California, Los Angeles, CA USA
| |
Collapse
|
18
|
Song X, Guo T, Shivdasani MN, Dokos S, Lovell NH, Li X, Qiu S, Li T, Zheng S, Li L. Creation of virtual channels in the retina using synchronous and asynchronous stimulation - a modelling study. J Neural Eng 2020; 17. [PMID: 33086210 DOI: 10.1088/1741-2552/abc3a9] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2020] [Accepted: 10/21/2020] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Implantable retinal prostheses aim to provide artificial vision to those suffering from retinal degenerative diseases by electrically stimulating the remaining retinal neurons using a multi-electrode array. The spatial resolution of these devices can be improved by creation of so-called virtual channels (VCs) that are commonly achieved through synchronized stimulation of multiple electrodes. It is largely unclear though if VCs can be created using asynchronous stimulation, which was the primary aim of this study. APPROACH A computational model of multi-layered retina and epi-retinal dual-electrode stimulation was developed to simulate the neural activity of populations of retinal ganglion cells (RGCs) using the VC strategy under both synchronous and asynchronous stimulation conditions. MAIN RESULTS Our simulation suggests that VCs can be created using asynchronous stimulation. VC performance under both synchronous and asynchronous stimulation conditions can be improved by optimizing stimulation parameters such as current intensity, current ratio (α) between two electrodes, electrode spacing and the stimulation waveform. In particular, two VC performance measures; (1) linear displacement of the centroid of RGC activation, and (2) the RGC activation size consistency as a function of different current ratios α, have comparable performance under asynchronous and synchronous stimulation with appropriately selected stimulation parameters. SIGNIFICANCE Our findings support the possibility of creating VCs in the retina under both synchronous and asynchronous stimulation conditions. The results provide theoretical evidence for future retinal prosthesis designs with higher spatial resolution and power efficiency whilst reducing the number of current sources required to achieve these outcomes.
Collapse
Affiliation(s)
- Xiaoyu Song
- , Shanghai Jiao Tong University, Shanghai, 200240, CHINA
| | - Tianruo Guo
- GSBME, UNSW, Sydney, New South Wales, 2052, AUSTRALIA
| | - Mohit N Shivdasani
- Graduate School of Biomedical Engineering, University of New South Wales, Lower Ground, Samuels Building (F25), Kensington, New South Wales, AUSTRALIA
| | - Socrates Dokos
- Graduate School of Biomedical Engineering, The University of New South Wales, Sydney 2052, New South Wales, Sydney, New South Wales, 2052, AUSTRALIA
| | - Nigel H Lovell
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, NSW 2052, Sydney, 2052, AUSTRALIA
| | - Xinxin Li
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, CHINA
| | - Shirong Qiu
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, CHINA
| | - Tong Li
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, CHINA
| | - Shiwei Zheng
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, CHINA
| | - Liming Li
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, Shanghai, CHINA
| |
Collapse
|
19
|
Shivdasani MN, Evans M, Burns O, Yeoh J, Allen PJ, Nayagam DAX, Villalobos J, Abbott CJ, Luu CD, Opie NL, Sabu A, Saunders AL, McPhedran M, Cardamone L, McGowan C, Maxim V, Williams RA, Fox KE, Cicione R, Garrett DJ, Ahnood A, Ganesan K, Meffin H, Burkitt AN, Prawer S, Williams CE, Shepherd RK. In vivo feasibility of epiretinal stimulation using ultrananocrystalline diamond electrodes. J Neural Eng 2020; 17:045014. [PMID: 32659750 DOI: 10.1088/1741-2552/aba560] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2023]
Abstract
OBJECTIVE Due to their increased proximity to retinal ganglion cells (RGCs), epiretinal visual prostheses present the opportunity for eliciting phosphenes with low thresholds through direct RGC activation. This study characterised the in vivo performance of a novel prototype monolithic epiretinal prosthesis, containing Nitrogen incorporated ultrananocrystalline (N-UNCD) diamond electrodes. APPROACH A prototype implant containing up to twenty-five 120 × 120 µm N-UNCD electrodes was implanted into 16 anaesthetised cats and attached to the retina either using a single tack or via magnetic coupling with a suprachoroidally placed magnet. Multiunit responses to retinal stimulation using charge-balanced biphasic current pulses were recorded acutely in the visual cortex using a multichannel planar array. Several stimulus parameters were varied including; the stimulating electrode, stimulus polarity, phase duration, return configuration and the number of electrodes stimulated simultaneously. MAIN RESULTS The rigid nature of the device and its form factor necessitated complex surgical procedures. Surgeries were considered successful in 10/16 animals and cortical responses to single electrode stimulation obtained in eight animals. Clinical imaging and histological outcomes showed severe retinal trauma caused by the device in situ in many instances. Cortical measures were found to significantly depend on the surgical outcomes of individual experiments, phase duration, return configuration and the number of electrodes stimulated simultaneously, but not stimulus polarity. Cortical thresholds were also found to increase over time within an experiment. SIGNIFICANCE The study successfully demonstrated that an epiretinal prosthesis containing diamond electrodes could produce cortical activity with high precision, albeit only in a small number of cases. Both surgical approaches were highly challenging in terms of reliable and consistent attachment to and stabilisation against the retina, and often resulted in severe retinal trauma. There are key challenges (device form factor and attachment technique) to be resolved for such a device to progress towards clinical application, as current surgical techniques are unable to address these issues.
Collapse
Affiliation(s)
- Mohit N Shivdasani
- Graduate School of Biomedical Engineering, University of New South Wales, Kensington, NSW 2033, Australia. The Bionics Institute of Australia, East Melbourne, VIC 3002, Australia
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
20
|
Ayton LN, Rizzo JF, Bailey IL, Colenbrander A, Dagnelie G, Geruschat DR, Hessburg PC, McCarthy CD, Petoe MA, Rubin GS, Troyk PR. Harmonization of Outcomes and Vision Endpoints in Vision Restoration Trials: Recommendations from the International HOVER Taskforce. Transl Vis Sci Technol 2020; 9:25. [PMID: 32864194 PMCID: PMC7426586 DOI: 10.1167/tvst.9.8.25] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2019] [Accepted: 12/08/2019] [Indexed: 01/05/2023] Open
Abstract
Translational research in vision prosthetics, gene therapy, optogenetics, stem cell and other forms of transplantation, and sensory substitution is creating new therapeutic options for patients with neural forms of blindness. The technical challenges faced by each of these disciplines differ considerably, but they all face the same challenge of how to assess vision in patients with ultra-low vision (ULV), who will be the earliest subjects to receive new therapies. Historically, there were few tests to assess vision in ULV patients. In the 1990s, the field of visual prosthetics expanded rapidly, and this activity led to a heightened need to develop better tests to quantify end points for clinical studies. Each group tended to develop novel tests, which made it difficult to compare outcomes across groups. The common lack of validation of the tests and the variable use of controls added to the challenge of interpreting the outcomes of these clinical studies. In 2014, at the bi-annual International "Eye and the Chip" meeting of experts in the field of visual prosthetics, a group of interested leaders agreed to work cooperatively to develop the International Harmonization of Outcomes and Vision Endpoints in Vision Restoration Trials (HOVER) Taskforce. Under this banner, more than 80 specialists across seven topic areas joined an effort to formulate guidelines for performing and reporting psychophysical tests in humans who participate in clinical trials for visual restoration. This document provides the complete version of the consensus opinions from the HOVER taskforce, which, together with its rules of governance, will be posted on the website of the Henry Ford Department of Ophthalmology (www.artificialvision.org). Research groups or companies that choose to follow these guidelines are encouraged to include a specific statement to that effect in their communications to the public. The Executive Committee of the HOVER Taskforce will maintain a list of all human psychophysical research in the relevant fields of research on the same website to provide an overview of methods and outcomes of all clinical work being performed in an attempt to restore vision to the blind. This website will also specify which scientific publications contain the statement of certification. The website will be updated every 2 years and continue to exist as a living document of worldwide efforts to restore vision to the blind. The HOVER consensus document has been written by over 80 of the world's experts in vision restoration and low vision and provides recommendations on the measurement and reporting of patient outcomes in vision restoration trials.
Collapse
Affiliation(s)
- Lauren N. Ayton
- Department of Optometry and Vision Sciences and Department of Surgery (Ophthalmology), The University of Melbourne, Parkville, Australia
- Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, Australia
| | - Joseph F. Rizzo
- Department of Ophthalmology, Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, USA
| | - Ian L. Bailey
- School of Optometry, University of California-Berkeley, Berkeley, CA, USA
| | - August Colenbrander
- Smith-Kettlewell Eye Research Institute and California Pacific Medical Center, San Francisco, CA, USA
| | - Gislin Dagnelie
- Lions Vision Research and Rehabilitation Center, Johns Hopkins Wilmer Eye Institute, Baltimore, MD, USA
| | - Duane R. Geruschat
- Lions Vision Research and Rehabilitation Center, Johns Hopkins Wilmer Eye Institute, Baltimore, MD, USA
| | - Philip C. Hessburg
- Detroit Institute of Ophthalmology, Henry Ford Health System, Grosse Pointe Park, MI, USA
| | - Chris D. McCarthy
- Department of Computer Science & Software Engineering, Swinburne University of Technology, Melbourne, Australia
| | | | - Gary S. Rubin
- University College London Institute of Ophthalmology, London, UK
| | - Philip R. Troyk
- Armour College of Engineering, Illinois Institute of Technology, Chicago, IL, USA
| | | |
Collapse
|
21
|
Spatiotemporal integration of visual stimuli and its relevance to the use of a divisional power supply scheme for retinal prosthesis. PLoS One 2020; 15:e0228861. [PMID: 32084146 PMCID: PMC7034871 DOI: 10.1371/journal.pone.0228861] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2019] [Accepted: 01/25/2020] [Indexed: 11/19/2022] Open
Abstract
A wireless photovoltaic retinal prosthesis is currently being studied with the aim of providing prosthetic vision to patients with retinitis pigmentosa (RP) and age-related macular degeneration (AMD). The major challenge of a photovoltaic device is its limited power efficiency. Our retinal prosthetic design implements a unique divisional power supply scheme (DPSS) system that provides the electrical power generated by all of the solar cells to only a subset of electrodes at any moment in time. The aim of the present study was to systematically characterize the spatiotemporal integration performance of the system under various DPSS conditions using human subjects and a psychophysical approach. A 16x16 pixels LED array controlled by Arduino was used to simulate the output signal of the DPSS design, and human performance under different visual stimulations at various update frequencies was then used to assess the spatiotemporal capability of retinal prostheses. The results showed that the contrast polarity of the image, image brightness, and division number influenced the lower limit of the update frequency of the DPSS system, while, on the other hand, visual angle, ambient light level, and stimulation order did not affect performance significantly. Pattern recognition by visual persistence with spatiotemporal integration of multiple frames of sparse dots is a feasible approach in retinal prosthesis design. These findings provide an insight into how to optimize a photovoltaic retinal prosthesis using a DPSS design with an appropriate update frequency for reliable pattern recognition. This will help the development of a wireless device able to restore vision to RP and AMD patients in the future.
Collapse
|
22
|
Alqahtani A, Al Abed A, Lovell NH, Dokos S. Optimizing Stimulation Strategies for Retinal Electrical Stimulation: a Modelling Study. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2019:2872-2875. [PMID: 31946491 DOI: 10.1109/embc.2019.8856918] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
In this research, a continuum multi-compartmental model of retinal electrical stimulation was utilized to find the best strategy for activating retinal ganglion cells (RGCs). Two types of return electrodes configuration placed suprachoroidally were used: monopolar and hexapolar. The current was delivered either simultaneously or sequentially with two kinds of waveforms: biphasic symmetric charge-balanced cathodic and anodic first pulses. Our results revealed there is no significant difference in current threshold between single monopolar and hexapolar stimulation regardless of the applied current stimulus waveform. Moreover, sequential stimulation for both monopolar or hexapolar was more effective in reducing current threshold than simultaneous stimulation when biphasic cathodic first pulses were used. Concurrent monopolar stimulation was significant in reducing the current threshold compared to single monopolar whereas concurrent hexapolar did not alter the current threshold. Overall, concurrent monopolar stimulation was efficacious in reducing current threshold regardless of the stimulus waveforms and sequential stimulation was more useful only with biphasic cathodic first pulses.
Collapse
|
23
|
An update on retinal prostheses. Clin Neurophysiol 2019; 131:1383-1398. [PMID: 31866339 DOI: 10.1016/j.clinph.2019.11.029] [Citation(s) in RCA: 85] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2019] [Revised: 11/13/2019] [Accepted: 11/14/2019] [Indexed: 11/23/2022]
Abstract
Retinal prostheses are designed to restore a basic sense of sight to people with profound vision loss. They require a relatively intact posterior visual pathway (optic nerve, lateral geniculate nucleus and visual cortex). Retinal implants are options for people with severe stages of retinal degenerative disease such as retinitis pigmentosa and age-related macular degeneration. There have now been three regulatory-approved retinal prostheses. Over five hundred patients have been implanted globally over the past 15 years. Devices generally provide an improved ability to localize high-contrast objects, navigate, and perform basic orientation tasks. Adverse events have included conjunctival erosion, retinal detachment, loss of light perception, and the need for revision surgery, but are rare. There are also specific device risks, including overstimulation (which could cause damage to the retina) or delamination of implanted components, but these are very unlikely. Current challenges include how to improve visual acuity, enlarge the field-of-view, and reduce a complex visual scene to its most salient components through image processing. This review encompasses the work of over 40 individual research groups who have built devices, developed stimulation strategies, or investigated the basic physiology underpinning retinal prostheses. Current technologies are summarized, along with future challenges that face the field.
Collapse
|
24
|
A model of ganglion axon pathways accounts for percepts elicited by retinal implants. Sci Rep 2019; 9:9199. [PMID: 31235711 PMCID: PMC6591412 DOI: 10.1038/s41598-019-45416-4] [Citation(s) in RCA: 64] [Impact Index Per Article: 12.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2019] [Accepted: 06/04/2019] [Indexed: 11/09/2022] Open
Abstract
Degenerative retinal diseases such as retinitis pigmentosa and macular degeneration cause irreversible vision loss in more than 10 million people worldwide. Retinal prostheses, now implanted in over 250 patients worldwide, electrically stimulate surviving cells in order to evoke neuronal responses that are interpreted by the brain as visual percepts ('phosphenes'). However, instead of seeing focal spots of light, current implant users perceive highly distorted phosphenes that vary in shape both across subjects and electrodes. We characterized these distortions by asking users of the Argus retinal prosthesis system (Second Sight Medical Products Inc.) to draw electrically elicited percepts on a touchscreen. Using ophthalmic fundus imaging and computational modeling, we show that elicited percepts can be accurately predicted by the topographic organization of optic nerve fiber bundles in each subject's retina, successfully replicating visual percepts ranging from 'blobs' to oriented 'streaks' and 'wedges' depending on the retinal location of the stimulating electrode. This provides the first evidence that activation of passing axon fibers accounts for the rich repertoire of phosphene shape commonly reported in psychophysical experiments, which can severely distort the quality of the generated visual experience. Overall our findings argue for more detailed modeling of biological detail across neural engineering applications.
Collapse
|
25
|
Mesnildrey Q, Macherey O, Herzog P, Venail F. Impedance measures for a better understanding of the electrical stimulation of the inner ear. J Neural Eng 2018; 16:016023. [PMID: 30523898 DOI: 10.1088/1741-2552/aaecff] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
The performance of cochlear implant (CI) listeners is limited by several factors among which the lack of spatial selectivity of the electrical stimulation. Recently, many studies have explored the use of multipolar strategies where several electrodes are stimulated simultaneously to focus the electrical field in a restricted region of the cochlea. OBJECTIVE These strategies are based on several assumptions concerning the electrical properties of the inner ear that need validation. The first, often implicit, assumption is that the medium is purely resistive and that the current waveforms produced by several electrodes sum linearly. The second assumption relates to the estimation of the contribution of each electrode to the overall electrical field. These individual contributions are usually obtained by stimulating each electrode and measuring the resulting voltage with the other inactive electrodes (i.e. the impedance matrix). However, measuring the voltage on active electrodes (i.e. the diagonal of the matrix) is not straightforward because of the polarization of the electrode-fluid interface. In existing multipolar strategies, the diagonal terms of the matrix are therefore inferred using linear extrapolation from measurements made at neighboring electrodes. APPROACH In experiment 1, several impedance measurements were carried out in vitro and in eight CI users using sinusoidal and pulsatile waveforms to test the resistivity and linearity hypotheses. In experiment 2, we used an equivalent electrical model including a constant phase element in order to isolate the polarization component of the contact impedance. MAIN RESULTS In experiment 1, high-resolution voltage recordings (1.1 MHz sampling) showed the resistivity assumption to be valid at 46.4 kHz, the highest frequency tested. However, these measures also revealed the presence of parasitic capacitive effects at high frequency that could be deleterious to multipolar strategies. Experiment 2 showed that the electrical model provides a better account of the high-resolution impedance measurements than previous approaches in the CI field that used resistor-capacitance circuit models. SIGNIFICANCE These results validate the main hypotheses underlying the use of multipolar stimulation but also suggest possible modifications to their implementation, including the use of an impedance model and the modification of the electrical pulse waveform.
Collapse
Affiliation(s)
- Quentin Mesnildrey
- Aix Marseille Univ., CNRS, Centrale Marseille, LMA, 4 impasse Nikola TESLA, CS 40006, F-13453, Marseille Cedex 13, France
| | | | | | | |
Collapse
|
26
|
Effects of Synchronous Electrode Pulses on Neural Recruitment During Multichannel Microstimulation. Sci Rep 2018; 8:13067. [PMID: 30166583 PMCID: PMC6117337 DOI: 10.1038/s41598-018-31247-2] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2018] [Accepted: 08/09/2018] [Indexed: 11/22/2022] Open
Abstract
The recent proliferation of high-density microelectrode arrays has inspired several new applications of electrical microstimulation, including restoration of sensory functions in the visual, auditory, and somatosensory systems. In each case, the goal is to achieve precisely targeted activation of neurons, while patterning the location and timing of stimulation across the array to mimic naturalistic patterns of neural activity. However, when two or more electrodes deliver stimulation pulses at the same time, the electric fields created by each electrode interact. The effects of field interactions on neuronal recruitment depend on several factors, which have been studied extensively at the macro-scale but have been overlooked in the case of high density arrays. Here, we report that field interactions can significantly affect neural recruitment, even with low amplitude stimulation. We created a computational model of peripheral nerve axons to estimate stimulation parameters sufficient to generate neural recruitment during synchronous and asynchronous stimulation on two microelectrodes located within the peripheral nerve. Across a range of stimulus amplitudes, the model predicted that synchronous stimulation on adjacent electrodes (400 µm separation), would recruit 2–3 times more neurons than during asynchronous stimulation. Our results suggest that field interactions should not be ignored when designing multichannel microstimulation paradigms, even at threshold-level stimulus amplitudes.
Collapse
|
27
|
Spencer TC, Fallon JB, Shivdasani MN. Creating virtual electrodes with 2D current steering. J Neural Eng 2018; 15:035002. [DOI: 10.1088/1741-2552/aab1b8] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
|
28
|
Barriga-Rivera A, Guo T, Yang CY, Abed AA, Dokos S, Lovell NH, Morley JW, Suaning GJ. High-amplitude electrical stimulation can reduce elicited neuronal activity in visual prosthesis. Sci Rep 2017; 7:42682. [PMID: 28209965 PMCID: PMC5314337 DOI: 10.1038/srep42682] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2016] [Accepted: 01/13/2017] [Indexed: 12/13/2022] Open
Abstract
Retinal electrostimulation is promising a successful therapy to restore functional vision. However, a narrow stimulating current range exists between retinal neuron excitation and inhibition which may lead to misperformance of visual prostheses. As the conveyance of representation of complex visual scenes may require neighbouring electrodes to be activated simultaneously, electric field summation may contribute to reach this inhibitory threshold. This study used three approaches to assess the implications of relatively high stimulating conditions in visual prostheses: (1) in vivo, using a suprachoroidal prosthesis implanted in a feline model, (2) in vitro through electrostimulation of murine retinal preparations, and (3) in silico by computing the response of a population of retinal ganglion cells. Inhibitory stimulating conditions led to diminished cortical activity in the cat. Stimulus-response relationships showed non-monotonic profiles to increasing stimulating current. This was observed in vitro and in silico as the combined response of groups of neurons (close to the stimulating electrode) being inhibited at certain stimulating amplitudes, whilst other groups (far from the stimulating electrode) being recruited. These findings may explain the halo-like phosphene shapes reported in clinical trials and suggest that simultaneous stimulation in retinal prostheses is limited by the inhibitory threshold of the retinal ganglion cells.
Collapse
Affiliation(s)
| | - Tianruo Guo
- Graduate School of Biomedical Engineering, UNSW, Sydney, 2052, Australia
| | - Chih-Yu Yang
- Graduate School of Biomedical Engineering, UNSW, Sydney, 2052, Australia
| | - Amr Al Abed
- Graduate School of Biomedical Engineering, UNSW, Sydney, 2052, Australia
| | - Socrates Dokos
- Graduate School of Biomedical Engineering, UNSW, Sydney, 2052, Australia
| | - Nigel H Lovell
- Graduate School of Biomedical Engineering, UNSW, Sydney, 2052, Australia
| | - John W Morley
- School of Medicine, Western Sydney University, Sydney, 2753, Australia.,School of Medical Science, UNSW, Sydney, 2052, Australia
| | - Gregg J Suaning
- Graduate School of Biomedical Engineering, UNSW, Sydney, 2052, Australia.,Sydney Medical School, University of Sydney, 2000, Australia
| |
Collapse
|
29
|
Petoe MA, Shivdasani MN. Are long stimulus pulse durations the answer to improving spatial resolution in retinal prostheses? ANNALS OF TRANSLATIONAL MEDICINE 2016; 4:434. [PMID: 27942525 DOI: 10.21037/atm.2016.11.24] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
Retinal prostheses can provide artificial vision to patients with degenerate retinae by electrically stimulating the remaining inner retinal neurons. The evoked perception is generally adequate for light localization, but of limited spatial resolution owing to the indiscriminate activation of multiple retinal cell types, leading to distortions in the perceived image. Here we present a perspective on a recent work by Weitz and colleagues who demonstrate a focal confinement of retinal ganglion cell (RGC) activation when using extended pulse durations in the stimulation waveform. Using real-time calcium imaging, they provide evidence that long pulse durations selectively stimulate inner retinal neurons, whilst avoiding unwanted axonal activations. The application of this stimulation technique may provide enhanced spatial resolution for retinal prosthesis users. These experiments provide a robust analysis of the effects of increasing pulse duration and introduce the potential for alternative stimulation paradigms in retinal prostheses.
Collapse
Affiliation(s)
- Matthew A Petoe
- Bionics Institute, Department of Medical Bionics, University of Melbourne, Melbourne, Australia
| | - Mohit N Shivdasani
- Bionics Institute, Department of Medical Bionics, University of Melbourne, Melbourne, Australia
| |
Collapse
|
30
|
Halupka KJ, Shivdasani MN, Cloherty SL, Grayden DB, Wong YT, Burkitt AN, Meffin H. Prediction of cortical responses to simultaneous electrical stimulation of the retina. J Neural Eng 2016; 14:016006. [DOI: 10.1088/1741-2560/14/1/016006] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
|
31
|
Weitz AC, Nanduri D, Behrend MR, Gonzalez-Calle A, Greenberg RJ, Humayun MS, Chow RH, Weiland JD. Improving the spatial resolution of epiretinal implants by increasing stimulus pulse duration. Sci Transl Med 2016; 7:318ra203. [PMID: 26676610 DOI: 10.1126/scitranslmed.aac4877] [Citation(s) in RCA: 128] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
Abstract
Retinal prosthetic implants are the only approved treatment for retinitis pigmentosa, a disease of the eye that causes blindness through gradual degeneration of photoreceptors. An array of microelectrodes triggered by input from a camera stimulates surviving retinal neurons, with each electrode acting as a pixel. Unintended stimulation of retinal ganglion cell axons causes patients to see large oblong shapes of light, rather than focal spots, making it difficult to perceive forms. To address this problem, we performed calcium imaging in isolated retinas and mapped the patterns of cells activated by different electrical stimulation protocols. We found that pulse durations two orders of magnitude longer than those typically used in existing implants stimulated inner retinal neurons while avoiding activation of ganglion cell axons, thus confining retinal responses to the site of the electrode. Multielectrode stimulation with 25-ms pulses can pattern letters on the retina corresponding to a Snellen acuity of 20/312. We validated our findings in a patient with an implanted epiretinal prosthesis by demonstrating that 25-ms pulses evoke focal spots of light.
Collapse
Affiliation(s)
- Andrew C Weitz
- Department of Ophthalmology, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA. Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA 90089, USA
| | - Devyani Nanduri
- Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA 90089, USA
| | - Matthew R Behrend
- Department of Electrical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA 90089, USA
| | - Alejandra Gonzalez-Calle
- Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA 90089, USA
| | | | - Mark S Humayun
- Department of Ophthalmology, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA. Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA 90089, USA
| | - Robert H Chow
- Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA 90089, USA. Department of Physiology and Biophysics, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA.
| | - James D Weiland
- Department of Ophthalmology, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA. Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA 90089, USA.
| |
Collapse
|
32
|
Luo YHL, da Cruz L. The Argus® II Retinal Prosthesis System. Prog Retin Eye Res 2016; 50:89-107. [PMID: 26404104 DOI: 10.1016/j.preteyeres.2015.09.003] [Citation(s) in RCA: 188] [Impact Index Per Article: 23.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2015] [Revised: 08/25/2015] [Accepted: 09/17/2015] [Indexed: 11/25/2022]
|
33
|
Fine I, Boynton GM. Pulse trains to percepts: the challenge of creating a perceptually intelligible world with sight recovery technologies. Philos Trans R Soc Lond B Biol Sci 2015; 370:20140208. [PMID: 26240423 PMCID: PMC4528820 DOI: 10.1098/rstb.2014.0208] [Citation(s) in RCA: 32] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/13/2015] [Indexed: 11/12/2022] Open
Abstract
An extraordinary variety of sight recovery therapies are either about to begin clinical trials, have begun clinical trials, or are currently being implanted in patients. However, as yet we have little insight into the perceptual experience likely to be produced by these implants. This review focuses on methodologies, such as optogenetics, small molecule photoswitches and electrical prostheses, which use artificial stimulation of the retina to elicit percepts. For each of these technologies, the interplay between the stimulating technology and the underlying neurophysiology is likely to result in distortions of the perceptual experience. Here, we describe some of these potential distortions and discuss how they might be minimized either through changes in the encoding model or through cortical plasticity.
Collapse
Affiliation(s)
- Ione Fine
- Department of Psychology, University of Washington, Seattle, WA, USA
| | | |
Collapse
|
34
|
Yan Y, Sui X, Liu W, Lu Y, Cao P, Ma Z, Chen Y, Chai X, Li L. Spatial characteristics of evoked potentials elicited by a MEMS microelectrode array for suprachoroidal-transretinal stimulation in a rabbit. Graefes Arch Clin Exp Ophthalmol 2015; 253:1515-28. [PMID: 25981117 DOI: 10.1007/s00417-015-3027-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2014] [Revised: 03/26/2015] [Accepted: 04/20/2015] [Indexed: 11/25/2022] Open
Abstract
BACKGROUND Suprachoroidal-transretinal stimulation (STS) can potentially restore vision. This study investigated the spatial characteristics of cortical electrical evoked potentials (EEPs) elicited by STS. METHODS A 4 × 4 thin-film platinum microelectrode stimulating array (200 μm electrode diameter and 400 μm center-to-center distance) was fabricated by a micro-electro-mechanical systems (MEMS) techniques and implanted into the suprachoroidal space of albino rabbits. RESULTS The current threshold to elicit reliable EEPs by a single electrode was 41.6 ± 12.6 μA, corresponding to a 66.2 ± 20.1 μC · cm(-2) charge density per phase, which was lower than the reported safety limits. Spatially differentiated cortical responses could be evoked by STS through different rows or columns of electrical stimulation; furthermore, shifts in the location of the maximum cortical activities were consistent with cortical visuotopic maps; increasing the number of simultaneously stimulating electrodes increased the response amplitudes of EEPs and expanded the spatial spread as well. In addition, long-term implantation and electrical stimulation of the MEMS electrode array in suprachoroidal space are necessary to evaluate systematically the safety and biocompatibility of this approach. CONCLUSIONS This study indicates that the STS approach by a MEMS-based platinum electrode array is a feasible alternative for visual restoration, and relatively high spatial discrimination may be achieved.
Collapse
Affiliation(s)
- Yan Yan
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China,
| | | | | | | | | | | | | | | | | |
Collapse
|
35
|
Fine I, Cepko CL, Landy MS. Vision research special issue: Sight restoration: Prosthetics, optogenetics and gene therapy. Vision Res 2015; 111:115-23. [PMID: 25937376 DOI: 10.1016/j.visres.2015.04.012] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Affiliation(s)
- Ione Fine
- Department of Psychology, University of Washington, Seattle, WA, USA
| | - Connie L Cepko
- Departments of Genetics and Ophthalmology, Howard Hughes Medical Institute, Harvard Medical School, 77 Avenue Louis Pasteur, Boston, MA 02115, USA
| | - Michael S Landy
- Department of Psychology and Center for Neural Science, New York University, New York, NY, USA
| |
Collapse
|
36
|
Abramian M, Lovell NH, Morley JW, Suaning GJ, Dokos S. Activation and inhibition of retinal ganglion cells in response to epiretinal electrical stimulation: a computational modelling study. J Neural Eng 2014; 12:016002. [PMID: 25426958 DOI: 10.1088/1741-2560/12/1/016002] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Retinal prosthetic devices aim to restore sight in visually impaired people by means of electrical stimulation of surviving retinal ganglion cells (RGCs). This modelling study aims to demonstrate that RGC inhibition caused by high-intensity cathodic pulses greatly influences their responses to epiretinal electrical stimulation and to investigate the impact of this inhibition on spatial activation profiles as well as their implications for retinal prosthetic device design. Another aim is to take advantage of this inhibition to reduce axonal activation in the nerve fibre layer. APPROACH A three-dimensional finite-element model of epiretinal electrical stimulation was utilized to obtain RGC activation and inhibition threshold profiles for a range of parameters. MAIN RESULTS RGC activation and inhibition thresholds were highly dependent on cell and stimulus parameters. Activation thresholds were 1.5, 3.4 and 11.3 μA for monopolar electrodes with 5, 20 and 50 μm radii, respectively. Inhibition to activation threshold ratios were mostly within the range 2-10. Inhibition significantly altered spatial patterns of RGC activation. With concentric electrodes and appropriately high levels of stimulus amplitudes, activation of passing axons was greatly reduced. SIGNIFICANCE RGC inhibition significantly impacts their spatial activation profiles, and therefore it most likely influences patterns of perceived phosphenes induced by retinal prosthetic devices. Thus this inhibition should be taken into account in future studies concerning retinal prosthesis development. It might be possible to utilize this inhibitory effect to bypass activation of passing axons and selectively stimulate RGCs near their somas and dendrites to achieve more localized phosphenes.
Collapse
Affiliation(s)
- Miganoosh Abramian
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, Australia
| | | | | | | | | |
Collapse
|
37
|
Jung JH, Aloni D, Yitzhaky Y, Peli E. Active confocal imaging for visual prostheses. Vision Res 2014; 111:182-96. [PMID: 25448710 DOI: 10.1016/j.visres.2014.10.023] [Citation(s) in RCA: 40] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2014] [Revised: 10/14/2014] [Accepted: 10/25/2014] [Indexed: 11/26/2022]
Abstract
There are encouraging advances in prosthetic vision for the blind, including retinal and cortical implants, and other "sensory substitution devices" that use tactile or electrical stimulation. However, they all have low resolution, limited visual field, and can display only few gray levels (limited dynamic range), severely restricting their utility. To overcome these limitations, image processing or the imaging system could emphasize objects of interest and suppress the background clutter. We propose an active confocal imaging system based on light-field technology that will enable a blind user of any visual prosthesis to efficiently scan, focus on, and "see" only an object of interest while suppressing interference from background clutter. The system captures three-dimensional scene information using a light-field sensor and displays only an in-focused plane with objects in it. After capturing a confocal image, a de-cluttering process removes the clutter based on blur difference. In preliminary experiments we verified the positive impact of confocal-based background clutter removal on recognition of objects in low resolution and limited dynamic range simulated phosphene images. Using a custom-made multiple-camera system based on light-field imaging, we confirmed that the concept of a confocal de-cluttered image can be realized effectively.
Collapse
Affiliation(s)
- Jae-Hyun Jung
- Schepens Eye Research Institute, Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, USA
| | - Doron Aloni
- Department of Electro-Optics Engineering, Ben-Gurion University of the Negev, Beer Sheva, Israel
| | - Yitzhak Yitzhaky
- Department of Electro-Optics Engineering, Ben-Gurion University of the Negev, Beer Sheva, Israel
| | - Eli Peli
- Schepens Eye Research Institute, Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, USA.
| |
Collapse
|
38
|
Kiral-Kornek FI, OʼSullivan-Greene E, Savage CO, McCarthy C, Grayden DB, Burkitt AN. Improved visual performance in letter perception through edge orientation encoding in a retinal prosthesis simulation. J Neural Eng 2014; 11:066002. [PMID: 25307496 DOI: 10.1088/1741-2560/11/6/066002] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Objective. Stimulation strategies for retinal prostheses predominately seek to directly encode image brightness values rather than edge orientations. Recent work suggests that the generation of oriented elliptical phosphenes may be possible by controlling interactions between neighboring electrodes. Based on this, we propose a novel stimulation strategy for prosthetic vision that extracts edge orientation information from the intensity image and encodes it as oriented elliptical phosphenes. We test the hypothesis that encoding edge orientation via oriented elliptical phosphenes leads to better alphabetic letter recognition than standard intensity-based encoding. Approach. We conduct a psychophysical study with simulated phosphene vision with 12 normal-sighted volunteers. The two stimulation strategies were compared with variations of letter size, electrode drop-out and spatial offsets of phosphenes. Main results. Mean letter recognition accuracy was significantly better with the new proposed stimulation strategy (65%) compared to direct grayscale encoding (47%). All examined parameters-stimulus size, phosphene dropout, and location shift-were found to influence the performance, with significant two-way interactions between phosphene dropout and stimulus size as well as between phosphene dropout and phosphene location shift. The analysis delivers a model of perception performance. Significance. Displaying available directional information to an implant user may improve their visual performance. We present a model for designing a stimulation strategy under the constraints of existing retinal prostheses that can be exploited by retinal implant developers to strategically employ oriented phosphenes.
Collapse
Affiliation(s)
- F Isabell Kiral-Kornek
- NeuroEngineering Laboratory, Department of Electrical & Electronic Engineering, The University of Melbourne, Australia. Centre for Neural Engineering, The University of Melbourne, Australia. NICTA, c/- Department of Electrical & Electronic Engineering, The University of Melbourne, Australia
| | | | | | | | | | | |
Collapse
|
39
|
Abstract
Retinal prosthesis has been translated from the laboratory to the clinic over the past two decades. Currently, two devices have regulatory approval for the treatment of retinitis pigmentosa. These devices provide partial sight restoration and patients use this improved vision in their everyday lives. Improved mobility and object detection are some of the more notable findings from the clinical trials. However, significant vision restoration will require both better technology and improved understanding of the interaction between electrical stimulation and the retina. This paper reviews the recent clinical trials and highlights technology breakthroughs that will contribute to next generation of retinal prostheses.
Collapse
|
40
|
Abramian M, Lovell NH, Habib A, Morley JW, Suaning GJ, Dokos S. Quasi-monopolar electrical stimulation of the retina: a computational modelling study. J Neural Eng 2014; 11:025002. [PMID: 24556561 DOI: 10.1088/1741-2560/11/2/025002] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE In this study we investigated the feasibility of quasi-monopolar (QMP) electrical stimulation for retinal implant devices, using a computational model of the retinal ganglion cell layer. APPROACH When used with hexagonally arrayed multiple electrodes, QMP stimulation is a hybrid of hexapolar and conventional monopolar stimulus modes. In hexapolar mode, each active electrode is surrounded by six guards which collectively return the stimulus current, whereas in monopolar mode the injected stimulus current is returned through a distant return electrode. The QMP paradigm, on the other hand, distributes the return current between the guard electrodes as well as the distant return. The electrodes tested were 25, 50 and 100 µm in diameter, with hexagonally arranged centre-to-centre spacing of either double or quadruple this diameter. MAIN RESULTS Simulation results indicated that electrode size had minimal effects on subretinal threshold currents, whilst electrode configuration and centre-to-centre spacing played major roles in determining thresholds and spatial activation patterns. Threshold charge densities for 50 and 100 µm electrodes were generally within the safe limit. SIGNIFICANCE We found that QMP stimulation offers greater advantages compared to monopolar and hexapolar stimulation, in that it combines the low thresholds of monopolar stimulation with the localized spatial activation achieved with hexapolar electrodes during parallel stimulation.
Collapse
Affiliation(s)
- Miganoosh Abramian
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, Australia
| | | | | | | | | | | |
Collapse
|
41
|
Bari BA, Ollerenshaw DR, Millard DC, Wang Q, Stanley GB. Behavioral and electrophysiological effects of cortical microstimulation parameters. PLoS One 2013; 8:e82170. [PMID: 24340002 PMCID: PMC3855396 DOI: 10.1371/journal.pone.0082170] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2013] [Accepted: 10/30/2013] [Indexed: 11/23/2022] Open
Abstract
Electrical microstimulation has been widely used to artificially activate neural circuits on fast time scales. Despite the ubiquity of its use, little is known about precisely how it activates neural pathways. Current is typically delivered to neural tissue in a manner that provides a locally balanced injection of positive and negative charge, resulting in negligible net charge delivery to avoid the neurotoxic effects of charge accumulation. Modeling studies have suggested that the most common approach, using a temporally symmetric current pulse waveform as the base unit of stimulation, results in preferential activation of axons, causing diffuse activation of neurons relative to the stimulation site. Altering waveform shape and using an asymmetric current pulse waveform theoretically reverses this bias and preferentially activates cell bodies, providing increased specificity. In separate studies, measurements of downstream cortical activation from sub-cortical microstimulation are consistent with this hypothesis, as are recent measurements of behavioral detection threshold currents from cortical microstimulation. Here, we compared the behavioral and electrophysiological effects of symmetric vs. asymmetric current waveform shape in cortical microstimulation. Using a go/no-go behavioral task, we found that microstimulation waveform shape significantly shifts psychometric performance, where a larger current pulse was necessary when applying an asymmetric waveform to elicit the same behavioral response, across a large range of behaviorally relevant current amplitudes. Using voltage-sensitive dye imaging of cortex in anesthetized animals with simultaneous cortical microstimulation, we found that altering microstimulation waveform shape shifted the cortical activation in a manner that mirrored the behavioral results. Taken together, these results are consistent with the hypothesis that asymmetric stimulation preferentially activates cell bodies, albeit at a higher threshold, as compared to symmetric stimulation. These findings demonstrate the sensitivity of the pathway to varying electrical stimulation parameters and underscore the importance of designing electrical stimuli for optimal activation of neural circuits.
Collapse
Affiliation(s)
- Bilal A. Bari
- Coulter Department of Biomedical Engineering, Georgia Institute of Technology & Emory University, Atlanta, Georgia, United States of America
| | - Douglas R. Ollerenshaw
- Coulter Department of Biomedical Engineering, Georgia Institute of Technology & Emory University, Atlanta, Georgia, United States of America
| | - Daniel C. Millard
- Coulter Department of Biomedical Engineering, Georgia Institute of Technology & Emory University, Atlanta, Georgia, United States of America
| | - Qi Wang
- Coulter Department of Biomedical Engineering, Georgia Institute of Technology & Emory University, Atlanta, Georgia, United States of America
| | - Garrett B. Stanley
- Coulter Department of Biomedical Engineering, Georgia Institute of Technology & Emory University, Atlanta, Georgia, United States of America
- * E-mail:
| |
Collapse
|
42
|
Stronks HC, Dagnelie G. The functional performance of the Argus II retinal prosthesis. Expert Rev Med Devices 2013; 11:23-30. [PMID: 24308734 DOI: 10.1586/17434440.2014.862494] [Citation(s) in RCA: 118] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Visual prostheses are devices to treat profound vision loss by stimulating nerve cells anywhere along the visual pathway, typically with electrical pulses. The Argus II implant, developed by Second Sight Medical Products (SSMP, Sylmar, CA, USA), targets the retina and features 60 electrodes that electrically stimulate the surviving retinal neurons. Of the approximately 20 research groups that are actively developing visual prostheses, SSMP has the longest track record. The Argus II was the first visual prosthesis to become commercially available: it received the European conformity mark in 2011 and FDA approval was granted in early 2013 for humanitarian use in the USA. Meanwhile, the Argus II safety/benefit study has been extended for research purposes, and is still ongoing. In this review, we will discuss the performance of the Argus II in restoring sight to the blind, and we will shed light on its expected developments in the coming years.
Collapse
Affiliation(s)
- H Christiaan Stronks
- NICTA Canberra Research Laboratory, Tower A, 7 London Circuit, Canberra, Australia
| | | |
Collapse
|
43
|
Shepherd RK, Shivdasani MN, Nayagam DAX, Williams CE, Blamey PJ. Visual prostheses for the blind. Trends Biotechnol 2013; 31:562-71. [PMID: 23953722 DOI: 10.1016/j.tibtech.2013.07.001] [Citation(s) in RCA: 100] [Impact Index Per Article: 9.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2013] [Revised: 07/04/2013] [Accepted: 07/05/2013] [Indexed: 10/26/2022]
Abstract
After more than 40 years of research, visual prostheses are moving from the laboratory into the clinic. These devices are designed to provide prosthetic vision to the blind by stimulating localized neural populations in one of the retinotopically organized structures of the visual pathway - typically the retina or visual cortex. The long gestation of this research reflects the many significant technical challenges encountered including surgical access, mechanical stability, hardware miniaturization, hermetic encapsulation, high-density electrode arrays, and signal processing. This review provides an introduction to the pathophysiology of blindness; an overview of existing visual prostheses, their advantages and drawbacks; the perceptual effects evoked by electrical stimulation; as well as the role played by plasticity and training in clinical outcomes.
Collapse
Affiliation(s)
- Robert K Shepherd
- Bionics Institute, 384-388 Albert St East Melbourne, 3002, Victoria, Australia; Medical Bionics Department, University of Melbourne, 384-388 Albert St East Melbourne, 3002, Victoria, Australia.
| | | | | | | | | |
Collapse
|
44
|
John SE, Shivdasani MN, Williams CE, Morley JW, Shepherd RK, Rathbone GD, Fallon JB. Suprachoroidal electrical stimulation: effects of stimulus pulse parameters on visual cortical responses. J Neural Eng 2013; 10:056011. [DOI: 10.1088/1741-2560/10/5/056011] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
45
|
Chen K, Lo YK, Yang Z, Weiland JD, Humayun MS, Liu W. A system verification platform for high-density epiretinal prostheses. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2013; 7:326-337. [PMID: 23853332 DOI: 10.1109/tbcas.2012.2200103] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
Retinal prostheses have restored light perception to people worldwide who have poor or no vision as a consequence of retinal degeneration. To advance the quality of visual stimulation for retinal implant recipients, a higher number of stimulation channels is expected in the next generation retinal prostheses, which poses a great challenge to system design and verification. This paper presents a system verification platform dedicated to the development of retinal prostheses. The system includes primary processing, dual-band power and data telemetry, a high-density stimulator array, and two methods for output verification. End-to-end system validation and individual functional block characterization can be achieved with this platform through visual inspection and software analysis. Custom-built software running on the computers also provides a good way for testing new features before they are realized by the ICs. Real-time visual feedbacks through the video displays make it easy to monitor and debug the system. The characterization of the wireless telemetry and the demonstration of the visual display are reported in this paper using a 256-channel retinal prosthetic IC as an example.
Collapse
Affiliation(s)
- Kuanfu Chen
- Bioengineering Department and the California NanoSystems Institute, University of California at Los Angeles, Los Angeles, CA 90095, USA.
| | | | | | | | | | | |
Collapse
|
46
|
Mueller JK, Grill WM. Model-based analysis of multiple electrode array stimulation for epiretinal visual prostheses. J Neural Eng 2013; 10:036002. [PMID: 23548495 DOI: 10.1088/1741-2560/10/3/036002] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Epiretinal stimulation, which uses an array of electrodes implanted on the inner retinal surface to relay a representation of the visual scene to the neuronal elements of the retina, has seen considerable success. The objective of the present study was to quantify the effects of multi-electrode stimulation on the patterns of neural excitation in a computational model of epiretinal stimulation. APPROACH A computational model of retinal ganglion cells was modified to represent the morphology of human retinal ganglion cells and validated against published experimental data. The ganglion cell model was then combined with a model of an axon of the nerve fiber layer to produce a population model of the inner retina. The response of the population of model neurons to epiretinal stimulation with a multi-electrode array was quantified across a range of electrode geometries using a novel means to quantify the model response-the minimum radius circle bounding the activated model neurons as a proxy for the evoked phosphene. MAIN RESULTS Multi-electrode stimulation created unique phosphenes, uch that the number of potential phosphenes can far exceed the number of electrode contacts. SIGNIFICANCE The ability to exploit the spatial and temporal interactions of stimulation may be critical to improvements in the performance of epiretinal prostheses.
Collapse
|
47
|
da Cruz L, Coley BF, Dorn J, Merlini F, Filley E, Christopher P, Chen FK, Wuyyuru V, Sahel J, Stanga P, Humayun M, Greenberg RJ, Dagnelie G. The Argus II epiretinal prosthesis system allows letter and word reading and long-term function in patients with profound vision loss. Br J Ophthalmol 2013; 97:632-6. [PMID: 23426738 PMCID: PMC3632967 DOI: 10.1136/bjophthalmol-2012-301525] [Citation(s) in RCA: 208] [Impact Index Per Article: 18.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
BACKGROUND Retinal prosthesis systems (RPS) are a novel treatment for profound vision loss in outer retinal dystrophies. Ideal prostheses would offer stable, long-term retinal stimulation and reproducible spatial resolution in a portable form appropriate for daily life. METHODS We report a prospective, internally controlled, multicentre trial of the Argus II system. Twenty-eight subjects with light perception vision received a retinal implant. Controlled, closed-group, forced-choice letter identification, and, open-choice two-, three- and four-letter word identification tests were carried out. RESULTS The mean±SD percentage correct letter identification for 21 subjects tested were: letters L, T, E, J, F, H, I, U, 72.3±24.6% system on and 17.7±12.9% system off; letters A, Z, Q, V, N, W, O, C, D, M, 55.0±27.4% system on and 11.8%±10.7% system off, and letters K, R, G, X, B, Y, S, P, 51.7±28.9% system on and 15.3±7.4% system off. (p<0.001 for all groups). A subgroup of six subjects was able to consistently read letters of reduced size, the smallest measuring 0.9 cm (1.7°) at 30 cm, and four subjects correctly identify unrehearsed two-, three- and four-letter words. Average implant duration was 19.9 months. CONCLUSIONS Multiple blind subjects fitted with the Argus II system consistently identified letters and words using the device, indicating reproducible spatial resolution. This, in combination with stable, long-term function, represents significant progress in the evolution of artificial sight.
Collapse
Affiliation(s)
- Lyndon da Cruz
- NIHR Biomedical Research Centre for Ophthalmology, Moorfields Eye Hospital, 162 City Road, London EC1V 2PD, UK.
| | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
48
|
Eiber CD, Lovell NH, Suaning GJ. Attaining higher resolution visual prosthetics: a review of the factors and limitations. J Neural Eng 2013; 10:011002. [PMID: 23337266 DOI: 10.1088/1741-2560/10/1/011002] [Citation(s) in RCA: 43] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Visual prosthetics is an expanding subfield of functional electrical stimulation which has gained increased interest recently in light of new advances in treatments and technology. These treatments and technology represent a major improvement over prior art, but are still subject to a host of limitations which are dependent on the manner in which one approaches the topic of visual prosthetics. These limitations pose new research challenges whose solutions are directly applicable to the well-being of blind individuals everywhere. In this review, we will outline and critically compare major current approaches to visual prosthetics, and in particular retinal prosthetics. Then, we will engage in an in-depth discussion of the limitations imposed by current technology, physics, and the underlying biology of the retina to highlight several of the challenges currently facing researchers.
Collapse
Affiliation(s)
- Calvin D Eiber
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, NSW 2052, Australia.
| | | | | |
Collapse
|
49
|
Savage CO, Grayden DB, Meffin H, Burkitt AN. Optimized single pulse stimulation strategy for retinal implants. J Neural Eng 2012; 10:016003. [PMID: 23220887 DOI: 10.1088/1741-2560/10/1/016003] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Retinal implants offer prospects of vision restoration for some blind patients by eliciting visual percepts of spots of light called 'phosphenes'. Recently, a mathematical model has been developed that predicts patients' perception of phosphene brightness for current-driven electrical stimulation of the retina. This model is explored for different stimulation parameters on a single electrode, including safety and hardware limitations, to produce phosphenes of specified brightness. We describe a procedure to derive stimulation parameters to account for such constraints, and describe methods to construct optimal stimuli in terms of producing maximal perceived brightness and efficient generation of phosphenes of a given brightness by employing minimal energy. In both cases, it is found that the resulting optimized stimulation waveforms consist of a long stimulation period, and interphase delays between initial and charge-balancing phases.
Collapse
Affiliation(s)
- C O Savage
- NeuroEngineering Laboratory, Department of Electrical and Electronic Engineering, The University of Melbourne, VIC 3010, Australia.
| | | | | | | |
Collapse
|
50
|
O'Brien EE, Greferath U, Vessey KA, Jobling AI, Fletcher EL. Electronic restoration of vision in those with photoreceptor degenerations. Clin Exp Optom 2012; 95:473-83. [PMID: 22823954 DOI: 10.1111/j.1444-0938.2012.00783.x] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2011] [Revised: 06/06/2012] [Accepted: 06/11/2012] [Indexed: 11/27/2022] Open
Abstract
Complete loss of vision is one of the most feared sequelae of retinal disease. Currently, there are few if any treatment options available to patients that may slow or prevent blindness in diseases caused by photoreceptor loss, such as retinitis pigmentosa and age-related macular degeneration. Electronic restoration of vision has emerged over recent years as a safe and viable option for those who have lost substantial numbers of photoreceptors and who are severely vision impaired. Indeed, there has been a dramatic increase in our understanding of what is required to restore vision using an electronic retinal prosthesis. Recent reports show that for some patients, restoration of vision to the point of reading large letters is possible. In this review, we examine the types of implants currently under investigation and the results these devices have achieved clinically. We then consider a range of engineering and biological factors that may need to be considered to improve the visual performance of newer-generation devices. With added research, it is hoped that the level of vision achieved with newer generation devices will steadily improve, resulting in enhanced quality of life for those with severe vision impairment.
Collapse
Affiliation(s)
- Emily E O'Brien
- Department of Anatomy and Cell Biology, The University of Melbourne, Parkville, Victoria, Australia.
| | | | | | | | | |
Collapse
|