1
|
van der Grinten M, de Ruyter van Steveninck J, Lozano A, Pijnacker L, Rueckauer B, Roelfsema P, van Gerven M, van Wezel R, Güçlü U, Güçlütürk Y. Towards biologically plausible phosphene simulation for the differentiable optimization of visual cortical prostheses. eLife 2024; 13:e85812. [PMID: 38386406 PMCID: PMC10883675 DOI: 10.7554/elife.85812] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2022] [Accepted: 01/21/2024] [Indexed: 02/23/2024] Open
Abstract
Blindness affects millions of people around the world. A promising solution to restoring a form of vision for some individuals are cortical visual prostheses, which bypass part of the impaired visual pathway by converting camera input to electrical stimulation of the visual system. The artificially induced visual percept (a pattern of localized light flashes, or 'phosphenes') has limited resolution, and a great portion of the field's research is devoted to optimizing the efficacy, efficiency, and practical usefulness of the encoding of visual information. A commonly exploited method is non-invasive functional evaluation in sighted subjects or with computational models by using simulated prosthetic vision (SPV) pipelines. An important challenge in this approach is to balance enhanced perceptual realism, biologically plausibility, and real-time performance in the simulation of cortical prosthetic vision. We present a biologically plausible, PyTorch-based phosphene simulator that can run in real-time and uses differentiable operations to allow for gradient-based computational optimization of phosphene encoding models. The simulator integrates a wide range of clinical results with neurophysiological evidence in humans and non-human primates. The pipeline includes a model of the retinotopic organization and cortical magnification of the visual cortex. Moreover, the quantitative effects of stimulation parameters and temporal dynamics on phosphene characteristics are incorporated. Our results demonstrate the simulator's suitability for both computational applications such as end-to-end deep learning-based prosthetic vision optimization as well as behavioral experiments. The modular and open-source software provides a flexible simulation framework for computational, clinical, and behavioral neuroscientists working on visual neuroprosthetics.
Collapse
Affiliation(s)
| | | | - Antonio Lozano
- Netherlands Institute for Neuroscience, Vrije Universiteit, Amsterdam, Netherlands
| | - Laura Pijnacker
- Donders Institute for Brain Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, Netherlands
| | - Bodo Rueckauer
- Donders Institute for Brain Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, Netherlands
| | - Pieter Roelfsema
- Netherlands Institute for Neuroscience, Vrije Universiteit, Amsterdam, Netherlands
| | - Marcel van Gerven
- Donders Institute for Brain Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, Netherlands
| | - Richard van Wezel
- Donders Institute for Brain Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, Netherlands
- Biomedical Signals and Systems Group, University of Twente, Enschede, Netherlands
| | - Umut Güçlü
- Donders Institute for Brain Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, Netherlands
| | - Yağmur Güçlütürk
- Donders Institute for Brain Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, Netherlands
| |
Collapse
|
2
|
Wang J, Azimi H, Zhao Y, Kaeser M, Vaca Sánchez P, Vazquez-Guardado A, Rogers JA, Harvey M, Rainer G. Optogenetic activation of visual thalamus generates artificial visual percepts. eLife 2023; 12:e90431. [PMID: 37791662 PMCID: PMC10593406 DOI: 10.7554/elife.90431] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Accepted: 10/03/2023] [Indexed: 10/05/2023] Open
Abstract
The lateral geniculate nucleus (LGN), a retinotopic relay center where visual inputs from the retina are processed and relayed to the visual cortex, has been proposed as a potential target for artificial vision. At present, it is unknown whether optogenetic LGN stimulation is sufficient to elicit behaviorally relevant percepts, and the properties of LGN neural responses relevant for artificial vision have not been thoroughly characterized. Here, we demonstrate that tree shrews pretrained on a visual detection task can detect optogenetic LGN activation using an AAV2-CamKIIα-ChR2 construct and readily generalize from visual to optogenetic detection. Simultaneous recordings of LGN spiking activity and primary visual cortex (V1) local field potentials (LFPs) during optogenetic LGN stimulation show that LGN neurons reliably follow optogenetic stimulation at frequencies up to 60 Hz and uncovered a striking phase locking between the V1 LFP and the evoked spiking activity in LGN. These phase relationships were maintained over a broad range of LGN stimulation frequencies, up to 80 Hz, with spike field coherence values favoring higher frequencies, indicating the ability to relay temporally precise information to V1 using light activation of the LGN. Finally, V1 LFP responses showed sensitivity values to LGN optogenetic activation that were similar to the animal's behavioral performance. Taken together, our findings confirm the LGN as a potential target for visual prosthetics in a highly visual mammal closely related to primates.
Collapse
Affiliation(s)
- Jing Wang
- Department of Medicine, University of FribourgFribourgSwitzerland
- Department of Neurobiology, School of Basic Medical Sciences, Nanjing Medical UniversityNanjingChina
| | - Hamid Azimi
- Department of Medicine, University of FribourgFribourgSwitzerland
| | - Yilei Zhao
- Department of Medicine, University of FribourgFribourgSwitzerland
| | - Melanie Kaeser
- Department of Medicine, University of FribourgFribourgSwitzerland
| | | | | | - John A Rogers
- Querrey Simpson Institute for Bioelectronics, Northwestern UniversityEvanstonUnited States
| | - Michael Harvey
- Department of Medicine, University of FribourgFribourgSwitzerland
| | - Gregor Rainer
- Department of Medicine, University of FribourgFribourgSwitzerland
| |
Collapse
|
3
|
Lestak J, Chod J, Rosina J, Hana K. Visual neuroprosthesis: present and possible perspectives. Biomed Pap Med Fac Univ Palacky Olomouc Czech Repub 2022; 166:251-257. [PMID: 35713333 DOI: 10.5507/bp.2022.027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Accepted: 05/26/2022] [Indexed: 11/23/2022] Open
Abstract
The purpose of this study is to provide an overview of the replacements used in lost vision in the form of the bionic eye, to show their deficiencies and outline other possibilities for non-invasive stimulation of functional areas of the visual cortex. The review highlights the damage not only to the primary altered cellular structures, but also to all other horizontally and vertically localised structures. Based on the results of a large number of functional magnetic resonance imaging and electrophysiological methods, the authors focus on the pathology of the entire visual pathway in pigmentary retinopathy (PR) and age-related macular degeneration (AMD). This study provides a recent overview of the possible systems used to replace lost vision. These range from stimulation with intraocular implants, through stimulation of the optic nerve and lateral geniculate nucleus to the visual cortex. The second part deals with the design of image processing technology and its transformation into the form of transcranial stimulation of undamaged parts of the brain, which is protected by a patent. This is comprehensive overview of the current possibilities of replacement of lost vision and a proposal for a new non-invasive methods of stimulation of functional neurons of the visual cortex.
Collapse
Affiliation(s)
- Jan Lestak
- Faculty of Biomedical Engineering, Czech Technical University in Prague, Czech Republic
| | - Jiri Chod
- Faculty of Electrical Engineering, Czech Technical University in Prague, Czech Republic
| | - Jozef Rosina
- Faculty of Biomedical Engineering, Czech Technical University in Prague, Czech Republic
| | - Karel Hana
- Faculty of Biomedical Engineering, Czech Technical University in Prague, Czech Republic
| |
Collapse
|
4
|
Sharf T, Kalakuntla T, J Lee D, Gokoffski KK. Electrical devices for visual restoration. Surv Ophthalmol 2022; 67:793-800. [PMID: 34487742 PMCID: PMC9241872 DOI: 10.1016/j.survophthal.2021.08.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2021] [Revised: 08/24/2021] [Accepted: 08/30/2021] [Indexed: 11/21/2022]
Abstract
Given the rising number of patients with blindness from macular, optic nerve, and visual pathway disease, there is considerable interest in the potential of electrical stimulation devices to restore vision. Electrical devices for restoration of visual function can be grouped into three categories: (1) visual prostheses whose goal is to bypass damaged areas and directly activate downstream intact portions of the visual pathway; (2) electric field stimulation whose goal is to activate endogenous transcriptional and molecular signaling pathways to promote neuroprotection and neuro-regeneration; and (3) neuromodulation whose stimulation would resuscitate neural circuits vital to coordinating responses to visual input. In this review, we discuss these three approaches, describe advances made in the different fields, and comment on limitations and potential future directions.
Collapse
Affiliation(s)
- Tamara Sharf
- Keck School of Medicine, University of Southern California, CA, USA
| | - Tej Kalakuntla
- Keck School of Medicine, University of Southern California, CA, USA
| | - Darrin J Lee
- Department of Neurological Surgery, University of Southern California, CA, USA
| | - Kimberly K Gokoffski
- Department of Ophthalmology, Roski Eye Institute, University of Southern California, CA, USA.
| |
Collapse
|
5
|
Meikle SJ, Wong YT. Neurophysiological considerations for visual implants. Brain Struct Funct 2021; 227:1523-1543. [PMID: 34773502 DOI: 10.1007/s00429-021-02417-2] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2021] [Accepted: 10/17/2021] [Indexed: 11/26/2022]
Abstract
Neural implants have the potential to restore visual capabilities in blind individuals by electrically stimulating the neurons of the visual system. This stimulation can produce visual percepts known as phosphenes. The ideal location of electrical stimulation for achieving vision restoration is widely debated and dependent on the physiological properties of the targeted tissue. Here, the neurophysiology of several potential target structures within the visual system will be explored regarding their benefits and downfalls in producing phosphenes. These regions will include the lateral geniculate nucleus, primary visual cortex, visual area 2, visual area 3, visual area 4 and the middle temporal area. Based on the existing engineering limitations of neural prostheses, we anticipate that electrical stimulation of any singular brain region will be incapable of achieving high-resolution naturalistic perception including color, texture, shape and motion. As improvements in visual acuity facilitate improvements in quality of life, emulating naturalistic vision should be one of the ultimate goals of visual prostheses. To achieve this goal, we propose that multiple brain areas will need to be targeted in unison enabling different aspects of vision to be recreated.
Collapse
Affiliation(s)
- Sabrina J Meikle
- Department of Electrical and Computer Systems Engineering, Monash University, 14 Alliance Lane, Clayton, Vic, 3800, Australia
- Department of Physiology and Biomedicine Discovery Institute, Monash University, 14 Alliance Lane, Clayton, Vic, 3800, Australia
- Monash Vision Group, Monash University, 14 Alliance Lane, Clayton, Vic, 3800, Australia
| | - Yan T Wong
- Department of Electrical and Computer Systems Engineering, Monash University, 14 Alliance Lane, Clayton, Vic, 3800, Australia.
- Department of Physiology and Biomedicine Discovery Institute, Monash University, 14 Alliance Lane, Clayton, Vic, 3800, Australia.
- Monash Vision Group, Monash University, 14 Alliance Lane, Clayton, Vic, 3800, Australia.
| |
Collapse
|
6
|
Mounier E, Abdullah B, Mahdi H, Eldawlatly S. A deep convolutional visual encoding model of neuronal responses in the LGN. Brain Inform 2021; 8:11. [PMID: 34129111 PMCID: PMC8206408 DOI: 10.1186/s40708-021-00132-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2021] [Accepted: 05/31/2021] [Indexed: 11/10/2022] Open
Abstract
The Lateral Geniculate Nucleus (LGN) represents one of the major processing sites along the visual pathway. Despite its crucial role in processing visual information and its utility as one target for recently developed visual prostheses, it is much less studied compared to the retina and the visual cortex. In this paper, we introduce a deep learning encoder to predict LGN neuronal firing in response to different visual stimulation patterns. The encoder comprises a deep Convolutional Neural Network (CNN) that incorporates visual stimulus spatiotemporal representation in addition to LGN neuronal firing history to predict the response of LGN neurons. Extracellular activity was recorded in vivo using multi-electrode arrays from single units in the LGN in 12 anesthetized rats with a total neuronal population of 150 units. Neural activity was recorded in response to single-pixel, checkerboard and geometrical shapes visual stimulation patterns. Extracted firing rates and the corresponding stimulation patterns were used to train the model. The performance of the model was assessed using different testing data sets and different firing rate windows. An overall mean correlation coefficient between the actual and the predicted firing rates of 0.57 and 0.7 was achieved for the 10 ms and the 50 ms firing rate windows, respectively. Results demonstrate that the model is robust to variability in the spatiotemporal properties of the recorded neurons outperforming other examined models including the state-of-the-art Generalized Linear Model (GLM). The results indicate the potential of deep convolutional neural networks as viable models of LGN firing.
Collapse
Affiliation(s)
- Eslam Mounier
- Computer and Systems Engineering Department, Faculty of Engineering, Ain Shams University, 1 El-Sarayat St., Abbassia, Cairo, Egypt
| | - Bassem Abdullah
- Computer and Systems Engineering Department, Faculty of Engineering, Ain Shams University, 1 El-Sarayat St., Abbassia, Cairo, Egypt
| | - Hani Mahdi
- Computer and Systems Engineering Department, Faculty of Engineering, Ain Shams University, 1 El-Sarayat St., Abbassia, Cairo, Egypt
| | - Seif Eldawlatly
- Computer and Systems Engineering Department, Faculty of Engineering, Ain Shams University, 1 El-Sarayat St., Abbassia, Cairo, Egypt.
- Faculty of Media Engineering and Technology, German University in Cairo, Cairo, Egypt.
| |
Collapse
|
7
|
Moleirinho S, Whalen AJ, Fried SI, Pezaris JS. The impact of synchronous versus asynchronous electrical stimulation in artificial vision. J Neural Eng 2021; 18. [PMID: 33900206 DOI: 10.1088/1741-2552/abecf1] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2020] [Accepted: 03/09/2021] [Indexed: 11/12/2022]
Abstract
Visual prosthesis devices designed to restore sight to the blind have been under development in the laboratory for several decades. Clinical translation continues to be challenging, due in part to gaps in our understanding of critical parameters such as how phosphenes, the electrically-generated pixels of artificial vision, can be combined to form images. In this review we explore the effects that synchronous and asynchronous electrical stimulation across multiple electrodes have in evoking phosphenes. Understanding how electrical patterns influence phosphene generation to control object binding and perception of visual form is fundamental to creation of a clinically successful prosthesis.
Collapse
Affiliation(s)
- Susana Moleirinho
- Department of Neurosurgery, Massachusetts General Hospital, Boston, MA, United States of America.,Department of Neurosurgery, Harvard Medical School, Boston, MA, United States of America
| | - Andrew J Whalen
- Department of Neurosurgery, Massachusetts General Hospital, Boston, MA, United States of America.,Department of Neurosurgery, Harvard Medical School, Boston, MA, United States of America
| | - Shelley I Fried
- Department of Neurosurgery, Massachusetts General Hospital, Boston, MA, United States of America.,Department of Neurosurgery, Harvard Medical School, Boston, MA, United States of America.,Boston VA Healthcare System, Boston, MA, United States of America
| | - John S Pezaris
- Department of Neurosurgery, Massachusetts General Hospital, Boston, MA, United States of America.,Department of Neurosurgery, Harvard Medical School, Boston, MA, United States of America
| |
Collapse
|
8
|
Chen Y, Chen T, Cai X. Light-sensitive circuits related to emotional processing underlie the antidepressant neural targets of light therapy. Behav Brain Res 2020; 396:112862. [PMID: 32827569 DOI: 10.1016/j.bbr.2020.112862] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2020] [Revised: 07/13/2020] [Accepted: 08/11/2020] [Indexed: 02/05/2023]
Abstract
Since Aaron Beck proposed his cognitive model of depression, biased attention, biased processing, and biased rumination (different phases of biased cognition) have been considered as the key elements consistently linked with depression. Increasing evidence suggests that the functional failures in the "emotional processing system (EPS)" underlie the neurological foundation of the biased cognition of depression. Light therapy, a non-intrusive approach, exerts powerful effects on emotion and cognition and affects the activity, functional connectivity, and plasticity of multiple brain structures. Although numerous studies have reported its effectiveness in treating depression, the findings have not been integrated with Beck's cognitive model and EPS, and the neurobiological mechanisms of antidepressant light therapy remain largely unknown. In this review, integrated with the classical theories of Beck's cognitive model of depression and EPS, we identified the key neural circuits and abnormalities involved in the cognitive bias of depression and, accordingly, identified and depicted several light-sensitive circuits (LSCs, neural circuits in the EPS that are responsive to light stimulation) that may underlie the antidepressant neural targets of light therapy, as listed below: In summary, the LSCs above narrow down the research scope of identifying the neural targets of antidepressant light therapy and help elucidate the neuropsychological mechanism of antidepressant light therapy.
Collapse
Affiliation(s)
- Yaodong Chen
- School of Architecture and Design, Southwest JiaoTong University, Chengdu, China.
| | - Taolin Chen
- Huaxi MR Research Center (HMRRC), Functional and Molecular Imaging Key Laboratory of Sichuan Province, Department of Radiology, West China Hospital of Sichuan University, Chengdu, China
| | - Xueli Cai
- School of Architecture and Design, Southwest JiaoTong University, Chengdu, China
| |
Collapse
|
9
|
Nowik K, Langwińska-Wośko E, Skopiński P, Nowik KE, Szaflik JP. Bionic eye review – An update. J Clin Neurosci 2020; 78:8-19. [DOI: 10.1016/j.jocn.2020.05.041] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2020] [Accepted: 05/03/2020] [Indexed: 01/26/2023]
|
10
|
Abstract
Developments of new strategies to restore vision and improving on current strategies by harnessing new advancements in material and electrical sciences, and biological and genetic-based technologies are of upmost health priorities around the world. Federal and private entities are spending billions of dollars on visual prosthetics technologies. This review describes the most current and state-of-the-art bioengineering technologies to restore vision. This includes a thorough description of traditional electrode-based visual prosthetics that have improved substantially since early prototypes. Recent advances in molecular and synthetic biology have transformed vision-assisted technologies; For example, optogenetic technologies that introduce light-responsive proteins offer excellent resolution but cortical applications are restricted by fiber implantation and tissue damage. Other stimulation modalities, such as magnetic fields, have been explored to achieve non-invasive neuromodulation. Miniature magnetic coils are currently being developed to activate select groups of neurons. Magnetically-responsive nanoparticles or exogenous proteins can significantly enhance the coupling between external electromagnetic devices and any neurons affiliated with these modifications. The need to minimize cytotoxic effects for nanoparticle-based therapies will likely restrict the number of usable materials. Nevertheless, advances in identifying and utilizing proteins that respond to magnetic fields may lead to non-invasive, cell-specific stimulation and may overcome many of the limitations that currently exist with other methods. Finally, sensory substitution systems also serve as viable visual prostheses by converting visual input to auditory and somatosensory stimuli. This review also discusses major challenges in the field and offers bioengineering strategies to overcome those.
Collapse
Affiliation(s)
- Alexander Farnum
- Department of Biomedical Engineering, College of Engineering, Michigan State University, East Lansing, MI, United States
- Institute for Quantitative Health Science and Engineering, Michigan State University, East Lansing, MI, United States
| | - Galit Pelled
- Department of Biomedical Engineering, College of Engineering, Michigan State University, East Lansing, MI, United States
- Institute for Quantitative Health Science and Engineering, Michigan State University, East Lansing, MI, United States
- Department of Radiology, College of Human Medicine, Michigan State University, East Lansing, MI, United States
| |
Collapse
|
11
|
Sound- and current-driven laminar profiles and their application method mimicking acoustic responses in the mouse auditory cortex in vivo. Brain Res 2019; 1721:146312. [PMID: 31323198 DOI: 10.1016/j.brainres.2019.146312] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2019] [Revised: 06/14/2019] [Accepted: 06/27/2019] [Indexed: 11/24/2022]
Abstract
The local application of electrical currents to the cortex is one of the most commonly used techniques to activate neurons, and this intracortical stimulation (ICS) could potentially lead to new types of neuroprosthetic devices that can be directly applied to the cortex. To identify whether ICS-activated circuits are physiological vs. profoundly artificial, it is necessary to record in vivo the responses of the same neuronal population to both natural sensory stimuli and artificial electric stimuli. However, few studies have extensively reported simultaneous electrophysiological recordings combined with ICS. Here, we evaluated the similarity between sound- and ICS-driven cortical response patterns in different cortical layers. In the mouse auditory cortex, we performed laminar recordings using 16-channel silicon electrodes and ICS using sharp glass-pipette electrodes containing biocytin for layer identification. In different cortical depths, short current pulses were delivered in vivo to mice under urethane anesthesia. For the recorded data, we mainly analyzed properties of local field potentials and current source densities (CSDs). We demonstrated that electrical stimulation evoked different excitation patterns according to the stimulated cortical layer; responses to electric stimuli in layer 4 were most likely to mimic acoustic responses. Next, we proposed a CSD-based stimulation method to artificially synthesize sound-driven responses, using an approximation method associated with a linear combination of CSD patterns electrically stimulated in the different cortical layers. The result indicates that synthesized responses were consistent with the canonical model of sound processing. Using these approaches, we provide a new technique in which natural sound-driven responses can be mimicked by well-designed computational stimulation pattern sequences in a layer-dependent manner. These findings may aid in the future development of an electrical stimulation methodology for a cortical prosthesis.
Collapse
|
12
|
Bjanes DA, Moritz CT. A Robust Encoding Scheme for Delivering Artificial Sensory Information via Direct Brain Stimulation. IEEE Trans Neural Syst Rehabil Eng 2019; 27:1994-2004. [PMID: 31443035 DOI: 10.1109/tnsre.2019.2936739] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Innovations for creating somatosensation via direct electrical stimulation of the brain will be required for the next generation of bi-directional cortical neuroprostheses. The current lack of tactile perception and proprioceptive input likely imposes a fundamental limit on speed and accuracy of brain-controlled prostheses or re-animated limbs. This study addresses the unique challenge of identifying a robust, high bandwidth sensory encoding scheme in a high-dimensional parameter space. Previous studies demonstrated single dimensional encoding schemes delivering low bandwidth sensory information, but no comparison has been performed across parameters, nor with update rates suitable for real-time operation of a neuroprosthesis. Here, we report the first comprehensive measurement of the resolution of key stimulation parameters such as pulse amplitude, pulse width, frequency, train interval and number of pulses. Surprisingly, modulation of stimulation frequency was largely undetectable. While we initially expected high frequency content to be an ideal candidate for passing high throughput sensory signals to the brain, we found only modulation of very low frequencies were detectable. Instead, the charge-per-phase of each pulse yields the highest resolution sensory signal, and is the key parameter modulating perceived intensity. The stimulation encoding patterns were designed for high-bandwidth information transfer that will be required for bi-directional brain interfaces. Our discovery of the stimulation features which best encode perceived intensity have significant implications for design of any neural interface seeking to convey information directly to the brain via electrical stimulation.
Collapse
|
13
|
Gaillet V, Cutrone A, Artoni F, Vagni P, Mega Pratiwi A, Romero SA, Lipucci Di Paola D, Micera S, Ghezzi D. Spatially selective activation of the visual cortex via intraneural stimulation of the optic nerve. Nat Biomed Eng 2019; 4:181-194. [DOI: 10.1038/s41551-019-0446-8] [Citation(s) in RCA: 33] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2018] [Accepted: 07/18/2019] [Indexed: 01/22/2023]
|
14
|
Abstract
Visual prostheses serve to restore visual function following acquired blindness. Acquired blindness (as opposed to congenital blindness) has many causes, including diseases such as retinitis pigmentosa, glaucoma, and macular degeneration, or trauma such as caused by automobile accident or blast damage from explosions. Many of the blindness-causing diseases target the retina or other ocular structure. Often, despite the loss of sensitivity to light, the remainder of the visual pathway is still functional, enabling electrical devices to deliver effective and meaningful visual information to the brain via arrays of electrodes. These arrays can be placed in any part of the early visual pathway, such as the retina, optic nerve, lateral geniculate nucleus, or visual cortex. A camera or other imaging source is used to drive electrical stimulation of remaining healthy cells or structures to create artificial vision and provide restoration of function. In this review, each approach to visual prostheses is described, including advantages and disadvantages as well as assessments of the current state of the art. Most of the work to-date has been targeting stimulation of (a) the retina, with three devices approved for general use and two more in clinical testing; (b) the lateral geniculate nucleus, with efforts still in the pre-clinical stage; and (c) the cortex, with three devices in clinical testing and none currently approved for general use despite the longest history of investigation of the three major approaches. Each class of device has different medical indications, and different levels of invasiveness required for implantation. All contemporary devices deliver relatively poor vision. There has been remarkable progress since the first proof-of-concept demonstration that used stimulation of the primary visual cortex, with the field exploring all viable options for restoration of function. Much of the progress has been recent, driven by advances in microelectronics and biocompatibility. With three devices currently approved for general use in various parts of the world, and a handful of additional devices well along in the pipeline toward approval, prospects for wide deployment of a device-based therapy to treat acquired blindness are good.
Collapse
|
15
|
Niketeghad S, Pouratian N. Brain Machine Interfaces for Vision Restoration: The Current State of Cortical Visual Prosthetics. Neurotherapeutics 2019; 16:134-143. [PMID: 30194614 PMCID: PMC6361050 DOI: 10.1007/s13311-018-0660-1] [Citation(s) in RCA: 42] [Impact Index Per Article: 8.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023] Open
Abstract
Loss of vision alters the day to day life of blind individuals and may impose a significant burden on their family and the economy. Cortical visual prosthetics have been shown to have the potential of restoring a useful degree of vision via stimulation of primary visual cortex. Due to current advances in electrode design and wireless power and data transmission, development of these prosthetics has gained momentum in the past few years and multiple sites around the world are currently developing and testing their designs. In this review, we briefly outline the visual prosthetic approaches and describe the history of cortical visual prosthetics. Next, we focus on the state of the art of cortical visual prosthesis by briefly explaining the design of current devices that are either under development or in the clinical testing phase. Lastly, we shed light on the challenges of each design and provide some potential solutions.
Collapse
Affiliation(s)
- Soroush Niketeghad
- Department of Bioengineering, University of California Los Angeles, Los Angeles, CA, USA
| | - Nader Pouratian
- Department of Bioengineering, University of California Los Angeles, Los Angeles, CA, USA.
- Department of Neurosurgery, University of California Los Angeles, Los Angeles, CA, USA.
| |
Collapse
|
16
|
Central nervous system microstimulation: Towards selective micro-neuromodulation. CURRENT OPINION IN BIOMEDICAL ENGINEERING 2017. [DOI: 10.1016/j.cobme.2017.09.012] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
|
17
|
David R, Miki N. Development and characterization of a fully flexible stimulation system based on embedded liquid metal channels. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2017; 2017:1720-1723. [PMID: 29060218 DOI: 10.1109/embc.2017.8037174] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Neuronal stimulation systems design is highly impacted by the overall resolution and adaptability of the device to the targeted application and area to stimulate. In this study is proposed a novel design for neural micro-stimulation electrode presenting high resolution and adaptability to any targeted area via a high flexibility. The use of liquid metal micro-channels encapsulated into a polymer allowed micro-stimulation pads at the tip of the channels. It presented a high degree of patternability to match different possible applications, as well as flexibility and interesting mechanic properties to make it insertable and adaptable in soft tissues. The design, fabrication process, and study of the electrical and mechanical behavior and stability of the device are discussed. Conductive U-shaped micro-channels down to a total diameter of 110 μm could be produced.
Collapse
|
18
|
Jawwad A, Abolfotuh HH, Abdullah B, Mahdi HMK, Eldawlatly S. Modulating Lateral Geniculate Nucleus Neuronal Firing for Visual Prostheses: A Kalman Filter-Based Strategy. IEEE Trans Neural Syst Rehabil Eng 2017; 25:1917-1927. [PMID: 28436881 DOI: 10.1109/tnsre.2017.2695004] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Developing visual prostheses that target inner brain structures along the visual pathway represent a new hope for patients with completely damaged early visual pathway sites. One of the major challenges in the development of subcortical and cortical visual prostheses is tuning electrical stimulation that could optimally induce desired visual percepts. In this paper, we propose a Kalman filter-based strategy that could be used to identify electrical stimulation patterns that mimic a specific visual input for thalamic visual prostheses. We demonstrate the performance of the proposed strategy using a population of lateral geniculate nucleus neurons modeled using an adapted generalized non-linear model. A mean correlation of 0.69 is obtained between visually evoked and electrically evoked responses-driven using the proposed strategy-for an optimal electrode-placement setup. In addition, we demonstrate the performance for a random electrode-placement setup in which a mean correlation of 0.26 is obtained. For this latter setup, our analysis reveals an inversely proportional relationship between the obtained correlation and the distance between each neuron and the nearest electrode. The proposed strategy could be thus utilized to tune and enhance the performance of thalamic visual prostheses as well as other prosthesis systems.
Collapse
|
19
|
Transcranial focused ultrasound stimulation of human primary visual cortex. Sci Rep 2016; 6:34026. [PMID: 27658372 PMCID: PMC5034307 DOI: 10.1038/srep34026] [Citation(s) in RCA: 197] [Impact Index Per Article: 24.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2016] [Accepted: 09/06/2016] [Indexed: 12/20/2022] Open
Abstract
Transcranial focused ultrasound (FUS) is making progress as a new non-invasive mode of regional brain stimulation. Current evidence of FUS-mediated neurostimulation for humans has been limited to the observation of subjective sensory manifestations and electrophysiological responses, thus warranting the identification of stimulated brain regions. Here, we report FUS sonication of the primary visual cortex (V1) in humans, resulting in elicited activation not only from the sonicated brain area, but also from the network of regions involved in visual and higher-order cognitive processes (as revealed by simultaneous acquisition of blood-oxygenation-level-dependent functional magnetic resonance imaging). Accompanying phosphene perception was also reported. The electroencephalo graphic (EEG) responses showed distinct peaks associated with the stimulation. None of the participants showed any adverse effects from the sonication based on neuroimaging and neurological examinations. Retrospective numerical simulation of the acoustic profile showed the presence of individual variability in terms of the location and intensity of the acoustic focus. With exquisite spatial selectivity and capability for depth penetration, FUS may confer a unique utility in providing non-invasive stimulation of region-specific brain circuits for neuroscientific and therapeutic applications.
Collapse
|
20
|
Nguyen HT, Tangutooru SM, Rountree CM, Kantzos AJK, Tarlochan F, Yoon WJ, Troy JB. Thalamic Visual Prosthesis. IEEE Trans Biomed Eng 2016; 63:1573-80. [DOI: 10.1109/tbme.2016.2567300] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
21
|
Luo YHL, Fukushige E, Da Cruz L. The potential of the second sight system bionic eye implant for partial sight restoration. Expert Rev Med Devices 2016; 13:673-81. [PMID: 27247995 DOI: 10.1080/17434440.2016.1195257] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
INTRODUCTION Second Sight System bionic eye implant, a commercially available visual prosthesis developed by Second Sight Medical Products, has been implanted in over 125 patients with outer retinal dystrophies such as retinitis pigmentosa. The system has gained regulatory approval in both the USA and Europe, and aims to restore vision by electrical stimulation of the nerve cells of the inner retina. AREAS COVERED In this review, we present the safety profile of this implant from the international clinical trial and discuss the nature and levels of improvement in visual function achieved by patients implanted with the system. Expert commentary: Future developments for the system will be explored following the discussion of the current usefulness of the device, its limitation as and the areas in which further development is necessary.
Collapse
Affiliation(s)
- Yvonne Hsu-Lin Luo
- a Vitreoretinal Research , Moorfields Eye Hospital NHS Foundation Trust , London , UK.,b Institute of Ophthalmology , University College London , London , UK
| | - Eka Fukushige
- a Vitreoretinal Research , Moorfields Eye Hospital NHS Foundation Trust , London , UK
| | - Lyndon Da Cruz
- a Vitreoretinal Research , Moorfields Eye Hospital NHS Foundation Trust , London , UK.,b Institute of Ophthalmology , University College London , London , UK.,c NIHR Biomedical Research Centre , Moorfields Eye Hospital NHS Foundation Trust , London , UK
| |
Collapse
|
22
|
Lewis PM, Ayton LN, Guymer RH, Lowery AJ, Blamey PJ, Allen PJ, Luu CD, Rosenfeld JV. Advances in implantable bionic devices for blindness: a review. ANZ J Surg 2016; 86:654-9. [PMID: 27301783 PMCID: PMC5132139 DOI: 10.1111/ans.13616] [Citation(s) in RCA: 58] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2016] [Revised: 03/03/2016] [Accepted: 03/17/2016] [Indexed: 02/02/2023]
Abstract
Since the 1950s, vision researchers have been working towards the ambitious goal of restoring a functional level of vision to the blind via electrical stimulation of the visual pathways. Groups based in Australia, USA, Germany, France and Japan report progress in the translation of retinal visual prosthetics from the experimental to clinical domains, with two retinal visual prostheses having recently received regulatory approval for clinical use. Regulatory approval for cortical visual prostheses is yet to be obtained; however, several groups report plans to conduct clinical trials in the near future, building upon the seminal clinical studies of Brindley and Dobelle. In this review, we discuss the general principles of visual prostheses employing electrical stimulation of the visual pathways, focusing on the retina and visual cortex as the two most extensively studied stimulation sites. We also discuss the surgical and functional outcomes reported to date for retinal and cortical prostheses, concluding with a brief discussion of novel developments in this field and an outlook for the future.
Collapse
Affiliation(s)
- Philip M Lewis
- Department of Neurosurgery, Alfred Hospital, Melbourne, Victoria, Australia.,Department of Surgery, Central Clinical School, Monash University, Melbourne, Victoria, Australia.,Monash Vision Group, Faculty of Engineering, Monash University, Melbourne, Victoria, Australia.,Monash Institute of Medical Engineering, Monash University, Melbourne, Victoria, Australia
| | - Lauren N Ayton
- Centre for Eye Research Australia, The Royal Victorian Eye and Ear Hospital, Melbourne, Victoria, Australia.,Department of Ophthalmology, The University of Melbourne, Melbourne, Victoria, Australia.,Department of Surgery, The University of Melbourne, Melbourne, Victoria, Australia
| | - Robyn H Guymer
- Centre for Eye Research Australia, The Royal Victorian Eye and Ear Hospital, Melbourne, Victoria, Australia.,Department of Ophthalmology, The University of Melbourne, Melbourne, Victoria, Australia.,Department of Surgery, The University of Melbourne, Melbourne, Victoria, Australia
| | - Arthur J Lowery
- Monash Vision Group, Faculty of Engineering, Monash University, Melbourne, Victoria, Australia.,Monash Institute of Medical Engineering, Monash University, Melbourne, Victoria, Australia
| | - Peter J Blamey
- Bionics Institute, Department of Medical Bionics, The University of Melbourne, Melbourne, Victoria, Australia
| | - Penelope J Allen
- Centre for Eye Research Australia, The Royal Victorian Eye and Ear Hospital, Melbourne, Victoria, Australia.,Department of Ophthalmology, The University of Melbourne, Melbourne, Victoria, Australia.,Department of Surgery, The University of Melbourne, Melbourne, Victoria, Australia
| | - Chi D Luu
- Centre for Eye Research Australia, The Royal Victorian Eye and Ear Hospital, Melbourne, Victoria, Australia.,Department of Ophthalmology, The University of Melbourne, Melbourne, Victoria, Australia.,Department of Surgery, The University of Melbourne, Melbourne, Victoria, Australia
| | - Jeffrey V Rosenfeld
- Department of Neurosurgery, Alfred Hospital, Melbourne, Victoria, Australia.,Department of Surgery, Central Clinical School, Monash University, Melbourne, Victoria, Australia.,Monash Vision Group, Faculty of Engineering, Monash University, Melbourne, Victoria, Australia.,Monash Institute of Medical Engineering, Monash University, Melbourne, Victoria, Australia.,F. Edward Hébert School of Medicine, Uniformed Services University of the Health Sciences, Bethesda, Maryland, USA
| |
Collapse
|
23
|
Barnes N, Scott AF, Lieby P, Petoe MA, McCarthy C, Stacey A, Ayton LN, Sinclair NC, Shivdasani MN, Lovell NH, McDermott HJ, Walker JG. Vision function testing for a suprachoroidal retinal prosthesis: effects of image filtering. J Neural Eng 2016; 13:036013. [DOI: 10.1088/1741-2560/13/3/036013] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
24
|
Daneault V, Dumont M, Massé É, Vandewalle G, Carrier J. Light-sensitive brain pathways and aging. J Physiol Anthropol 2016; 35:9. [PMID: 26980095 PMCID: PMC4791759 DOI: 10.1186/s40101-016-0091-9] [Citation(s) in RCA: 49] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2016] [Accepted: 03/01/2016] [Indexed: 01/08/2023] Open
Abstract
Notwithstanding its effects on the classical visual system allowing image formation, light acts upon several non-image-forming (NIF) functions including body temperature, hormonal secretions, sleep-wake cycle, alertness, and cognitive performance. Studies have shown that NIF functions are maximally sensitive to blue wavelengths (460–480 nm), in comparison to longer light wavelengths. Higher blue light sensitivity has been reported for melatonin suppression, pupillary constriction, vigilance, and performance improvement but also for modulation of cognitive brain functions. Studies investigating acute stimulating effects of light on brain activity during the execution of cognitive tasks have suggested that brain activations progress from subcortical regions involved in alertness, such as the thalamus, the hypothalamus, and the brainstem, before reaching cortical regions associated with the ongoing task. In the course of aging, lower blue light sensitivity of some NIF functions has been reported. Here, we first describe neural pathways underlying effects of light on NIF functions and we discuss eye and cerebral mechanisms associated with aging which may affect NIF light sensitivity. Thereafter, we report results of investigations on pupillary constriction and cognitive brain sensitivity to light in the course of aging. Whereas the impact of light on cognitive brain responses appears to decrease substantially, pupillary constriction seems to remain more intact over the lifespan. Altogether, these results demonstrate that aging research should take into account the diversity of the pathways underlying the effects of light on specific NIF functions which may explain their differences in light sensitivity.
Collapse
Affiliation(s)
- V Daneault
- Functional Neuroimaging Unit, University of Montreal Geriatric Institute, Montreal, QC, Canada. .,Center for Advanced Research in Sleep Medicine, Hôpital du Sacré-Cœur de Montréal, Montreal, QC, Canada. .,Department of Psychology, University of Montreal, Montreal, QC, Canada.
| | - M Dumont
- Center for Advanced Research in Sleep Medicine, Hôpital du Sacré-Cœur de Montréal, Montreal, QC, Canada
| | - É Massé
- Functional Neuroimaging Unit, University of Montreal Geriatric Institute, Montreal, QC, Canada.,Center for Advanced Research in Sleep Medicine, Hôpital du Sacré-Cœur de Montréal, Montreal, QC, Canada
| | - G Vandewalle
- Department of Psychology, University of Montreal, Montreal, QC, Canada.,Cyclotron Research Centre, University of Liège, Liège, Belgium
| | - J Carrier
- Functional Neuroimaging Unit, University of Montreal Geriatric Institute, Montreal, QC, Canada.,Center for Advanced Research in Sleep Medicine, Hôpital du Sacré-Cœur de Montréal, Montreal, QC, Canada.,Department of Psychology, University of Montreal, Montreal, QC, Canada
| |
Collapse
|
25
|
Luo YHL, da Cruz L. The Argus® II Retinal Prosthesis System. Prog Retin Eye Res 2016; 50:89-107. [PMID: 26404104 DOI: 10.1016/j.preteyeres.2015.09.003] [Citation(s) in RCA: 188] [Impact Index Per Article: 23.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2015] [Revised: 08/25/2015] [Accepted: 09/17/2015] [Indexed: 11/25/2022]
|
26
|
Lewis PM, Rosenfeld JV. Electrical stimulation of the brain and the development of cortical visual prostheses: An historical perspective. Brain Res 2015; 1630:208-24. [PMID: 26348986 DOI: 10.1016/j.brainres.2015.08.038] [Citation(s) in RCA: 37] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2015] [Accepted: 08/14/2015] [Indexed: 10/23/2022]
Abstract
Rapid advances are occurring in neural engineering, bionics and the brain-computer interface. These milestones have been underpinned by staggering advances in micro-electronics, computing, and wireless technology in the last three decades. Several cortically-based visual prosthetic devices are currently being developed, but pioneering advances with early implants were achieved by Brindley followed by Dobelle in the 1960s and 1970s. We have reviewed these discoveries within the historical context of the medical uses of electricity including attempts to cure blindness, the discovery of the visual cortex, and opportunities for cortex stimulation experiments during neurosurgery. Further advances were made possible with improvements in electrode design, greater understanding of cortical electrophysiology and miniaturisation of electronic components. Human trials of a new generation of prototype cortical visual prostheses for the blind are imminent. This article is part of a Special Issue entitled Hold Item.
Collapse
Affiliation(s)
- Philip M Lewis
- Monash Vision Group, Department of Electrical and Computer Systems Engineering, Monash University, Wellington Road, Clayton, VIC 3800, Australia; Department of Neurosurgery, Level 1 Old Baker Building, Alfred Hospital, 55 Commercial Road, Melbourne, VIC 3004, Australia; Department of Surgery, Monash University Central Clinical School, Level 6 Alfred Centre, 99 Commercial Road, Melbourne, VIC 3004, Australia; Monash Institute of Medical Engineering, Monash University, Wellington Road, Clayton, VIC 3800, Australia.
| | - Jeffrey V Rosenfeld
- Monash Vision Group, Department of Electrical and Computer Systems Engineering, Monash University, Wellington Road, Clayton, VIC 3800, Australia; Department of Neurosurgery, Level 1 Old Baker Building, Alfred Hospital, 55 Commercial Road, Melbourne, VIC 3004, Australia; Department of Surgery, Monash University Central Clinical School, Level 6 Alfred Centre, 99 Commercial Road, Melbourne, VIC 3004, Australia; Monash Institute of Medical Engineering, Monash University, Wellington Road, Clayton, VIC 3800, Australia; F. Edward Hébert School of Medicine, Uniformed Services University of the Health Sciences, 4301 Jones Bridge Rd., Bethesda, MD 20814, United States.
| |
Collapse
|
27
|
Lewis PM, Ackland HM, Lowery AJ, Rosenfeld JV. Restoration of vision in blind individuals using bionic devices: a review with a focus on cortical visual prostheses. Brain Res 2014; 1595:51-73. [PMID: 25446438 DOI: 10.1016/j.brainres.2014.11.020] [Citation(s) in RCA: 114] [Impact Index Per Article: 11.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2014] [Revised: 11/05/2014] [Accepted: 11/08/2014] [Indexed: 12/13/2022]
Abstract
The field of neurobionics offers hope to patients with sensory and motor impairment. Blindness is a common cause of major sensory loss, with an estimated 39 million people worldwide suffering from total blindness in 2010. Potential treatment options include bionic devices employing electrical stimulation of the visual pathways. Retinal stimulation can restore limited visual perception to patients with retinitis pigmentosa, however loss of retinal ganglion cells precludes this approach. The optic nerve, lateral geniculate nucleus and visual cortex provide alternative stimulation targets, with several research groups actively pursuing a cortically-based device capable of driving several hundred stimulating electrodes. While great progress has been made since the earliest works of Brindley and Dobelle in the 1960s and 1970s, significant clinical, surgical, psychophysical, neurophysiological, and engineering challenges remain to be overcome before a commercially-available cortical implant will be realized. Selection of candidate implant recipients will require assessment of their general, psychological and mental health, and likely responses to visual cortex stimulation. Implant functionality, longevity and safety may be enhanced by careful electrode insertion, optimization of electrical stimulation parameters and modification of immune responses to minimize or prevent the host response to the implanted electrodes. Psychophysical assessment will include mapping the positions of potentially several hundred phosphenes, which may require repetition if electrode performance deteriorates over time. Therefore, techniques for rapid psychophysical assessment are required, as are methods for objectively assessing the quality of life improvements obtained from the implant. These measures must take into account individual differences in image processing, phosphene distribution and rehabilitation programs that may be required to optimize implant functionality. In this review, we detail these and other challenges facing developers of cortical visual prostheses in addition to briefly outlining the epidemiology of blindness, and the history of cortical electrical stimulation in the context of visual prosthetics.
Collapse
Affiliation(s)
- Philip M Lewis
- Department of Neurosurgery, Alfred Hospital, Melbourne, Australia; Department of Surgery, Monash University, Central Clinical School, Melbourne, Australia; Monash Vision Group, Faculty of Engineering, Monash University, Melbourne, Australia; Monash Institute of Medical Engineering, Monash University, Melbourne, Australia.
| | - Helen M Ackland
- Department of Neurosurgery, Alfred Hospital, Melbourne, Australia; Department of Epidemiology and Preventive Medicine, Monash University, Melbourne, Australia.
| | - Arthur J Lowery
- Monash Vision Group, Faculty of Engineering, Monash University, Melbourne, Australia; Monash Institute of Medical Engineering, Monash University, Melbourne, Australia; Department of Electrical and Computer Systems Engineering, Faculty of Engineering, Monash University, Melbourne, Australia.
| | - Jeffrey V Rosenfeld
- Department of Neurosurgery, Alfred Hospital, Melbourne, Australia; Department of Surgery, Monash University, Central Clinical School, Melbourne, Australia; Monash Vision Group, Faculty of Engineering, Monash University, Melbourne, Australia; Monash Institute of Medical Engineering, Monash University, Melbourne, Australia; F. Edward Hébert School of Medicine, Uniformed Services University of the Health Sciences, Bethesda, USA.
| |
Collapse
|
28
|
Ward LM. The thalamus: gateway to the mind. WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2013; 4:609-622. [DOI: 10.1002/wcs.1256] [Citation(s) in RCA: 43] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/06/2013] [Revised: 07/31/2013] [Accepted: 08/06/2013] [Indexed: 11/10/2022]
Affiliation(s)
- Lawrence M. Ward
- Department of Psychology and Brain Research Centre; University of British Columbia; Vancouver BC Canada
| |
Collapse
|
29
|
Visual acuity of simulated thalamic visual prostheses in normally sighted humans. PLoS One 2013; 8:e73592. [PMID: 24086286 PMCID: PMC3785446 DOI: 10.1371/journal.pone.0073592] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2013] [Accepted: 07/24/2013] [Indexed: 11/19/2022] Open
Abstract
Simulation in normally sighted individuals is a crucial tool to evaluate the performance of potential visual prosthesis designs prior to human implantation of a device. Here, we investigated the effects of electrode count on visual acuity, learning rate and response time in 16 normally sighted subjects using a simulated thalamic visual prosthesis, providing the first performance reports for thalamic designs. A new letter recognition paradigm using a multiple-optotype two-alternative forced choice task was adapted from the Snellen eye chart, and specifically devised to be readily communicated to both human and non-human primate subjects. Validation of the method against a standard Snellen acuity test in 21 human subjects showed no significant differences between the two tests. The novel task was then used to address three questions about simulations of the center-weighted phosphene patterns typical of thalamic designs: What are the expected Snellen acuities for devices with varying numbers of contacts, do subjects display rapid adaptation to the new visual modality, and can response time in the task provide clues to the mechanisms of perception in low-resolution artificial vision? Population performance (hit rate) was significantly above chance when viewing Snellen 20/200 optotypes (Log MAR 1.0) with 370 phosphenes in the central 10 degrees of vision, ranging to Snellen 20/800 (Log MAR 1.6) with 25 central phosphenes. Furthermore, subjects demonstrated learning within the 1–2 hours of task experience indicating the potential for an effective rehabilitation and possibly better visual performance after a longer period of training. Response time differences suggest that direct letter perception occurred when hit rate was above 75%, whereas a slower strategy like feature-based pattern matching was used in conditions of lower relative resolution. As pattern matching can substantially boost effective acuity, these results suggest post-implant therapy should specifically address feature detection skills.
Collapse
|
30
|
Shepherd RK, Shivdasani MN, Nayagam DAX, Williams CE, Blamey PJ. Visual prostheses for the blind. Trends Biotechnol 2013; 31:562-71. [PMID: 23953722 DOI: 10.1016/j.tibtech.2013.07.001] [Citation(s) in RCA: 100] [Impact Index Per Article: 9.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2013] [Revised: 07/04/2013] [Accepted: 07/05/2013] [Indexed: 10/26/2022]
Abstract
After more than 40 years of research, visual prostheses are moving from the laboratory into the clinic. These devices are designed to provide prosthetic vision to the blind by stimulating localized neural populations in one of the retinotopically organized structures of the visual pathway - typically the retina or visual cortex. The long gestation of this research reflects the many significant technical challenges encountered including surgical access, mechanical stability, hardware miniaturization, hermetic encapsulation, high-density electrode arrays, and signal processing. This review provides an introduction to the pathophysiology of blindness; an overview of existing visual prostheses, their advantages and drawbacks; the perceptual effects evoked by electrical stimulation; as well as the role played by plasticity and training in clinical outcomes.
Collapse
Affiliation(s)
- Robert K Shepherd
- Bionics Institute, 384-388 Albert St East Melbourne, 3002, Victoria, Australia; Medical Bionics Department, University of Melbourne, 384-388 Albert St East Melbourne, 3002, Victoria, Australia.
| | | | | | | | | |
Collapse
|