1
|
Romeni S, Toni L, Artoni F, Micera S. Decoding electroencephalographic responses to visual stimuli compatible with electrical stimulation. APL Bioeng 2024; 8:026123. [PMID: 38894958 PMCID: PMC11184972 DOI: 10.1063/5.0195680] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2024] [Accepted: 05/20/2024] [Indexed: 06/21/2024] Open
Abstract
Electrical stimulation of the visual nervous system could improve the quality of life of patients affected by acquired blindness by restoring some visual sensations, but requires careful optimization of stimulation parameters to produce useful perceptions. Neural correlates of elicited perceptions could be used for fast automatic optimization, with electroencephalography as a natural choice as it can be acquired non-invasively. Nonetheless, its low signal-to-noise ratio may hinder discrimination of similar visual patterns, preventing its use in the optimization of electrical stimulation. Our work investigates for the first time the discriminability of the electroencephalographic responses to visual stimuli compatible with electrical stimulation, employing a newly acquired dataset whose stimuli encompass the concurrent variation of several features, while neuroscience research tends to study the neural correlates of single visual features. We then performed above-chance single-trial decoding of multiple features of our newly crafted visual stimuli using relatively simple machine learning algorithms. A decoding scheme employing the information from multiple stimulus presentations was implemented, substantially improving our decoding performance, suggesting that such methods should be used systematically in future applications. The significance of the present work relies in the determination of which visual features can be decoded from electroencephalographic responses to electrical stimulation-compatible stimuli and at which granularity they can be discriminated. Our methods pave the way to using electroencephalographic correlates to optimize electrical stimulation parameters, thus increasing the effectiveness of current visual neuroprostheses.
Collapse
Affiliation(s)
| | | | - Fiorenzo Artoni
- Department of Clinical Neurosciences, Faculty of Medicine, University of Geneva, Geneva, Switzerland
| | | |
Collapse
|
2
|
Pratiwi AM, Kekesi O, Suaning GJ. Selective neuromodulation of retinal ganglion cells via a hybrid optic-nerve and retinal neuroprosthesis for visual restoration. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:2381-2384. [PMID: 36086329 DOI: 10.1109/embc48229.2022.9871410] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
A visual neuroprosthesis delivers electrical stimulation to the surviving neural cells of the visual pathway to produce prosthetic vision. While the retina is often chosen as the stimulation site, current retinal prostheses are hindered by the lack of functional selectivity that impairs the resolution. A possible strategy to improve the resolution is to combine the retinal stimulation and the stimulation of the optic nerve bundle, which contains myelinated fibres of retinal ganglion cells (RGCs) axons that vary in diameter. In this study, we used a computational model of retinal ganglion cells (RGCs) with myelinated axons to predict whether the frequency of electrical stimulation delivered to the optic nerve can be modulated to preferentially inhibit a subset of optic nerve fibres classified by diameter. The model combined a finite element model of bipolar penetrating electrodes delivering sinusoidal stimulation in the range of 25-10000 Hz to the optic nerve, and a double-cable model, to represent an optic nerve fibre. We found that the diameter of the axon fibre and ion kinetic properties of the RGC affect the neuron's frequency response, demonstrating the potential of an optic nerve stimulation to produce selective inhibition based on the axon fibre size. Clinical Relevance-This establishes the importance of considering the size of the nerve cell axons, as well as the functional type of the RGC, in stimulating the optic nerve. This can be exploited to facilitate functionally selective neuromodulation when used in conjunction with retinal stimulation.
Collapse
|
3
|
Amplitude modulated transcranial alternating current stimulation (AM-TACS) efficacy evaluation via phosphene induction. Sci Rep 2021; 11:22245. [PMID: 34782626 PMCID: PMC8593032 DOI: 10.1038/s41598-021-01482-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2021] [Accepted: 10/18/2021] [Indexed: 12/01/2022] Open
Abstract
Amplitude modulated transcranial alternating current stimulation (AM-tACS) is a novel method of electrostimulation which enables the recording of electrophysiological signals during stimulation, thanks to an easier removable stimulation artefact compared to classical electrostimulation methods. To gauge the neuromodulatory potential of AM-tACS, we tested its capacity to induce phosphenes as an indicator of stimulation efficacy. AM-tACS was applied via a two-electrode setup, attached on FpZ and below the right eye. AM-tACS waveforms comprised of different carrier (50 Hz, 200 Hz, 1000 Hz) and modulation frequencies (8 Hz, 16 Hz, 28 Hz) were administered with at maximum 2 mA peak-to-peak stimulation strength. TACS conditions in the same frequencies were used as a benchmark for phosphene induction. AM-tACS conditions using a 50 Hz carrier frequency were able to induce phosphenes, but with no difference in phosphene thresholds between modulation frequencies. AM-tACS using a 200 Hz or 1000 Hz carrier frequency did not induce phosphenes. TACS conditions induced phosphenes in line with previous studies. Stimulation effects of AM-tACS conditions were independent of amplitude modulation and instead relied solely on the carrier frequency. A possible explanation may be that AM-tACS needs higher stimulation intensities for its amplitude modulation to have a neuromodulatory effect.
Collapse
|
4
|
Wang J, Zhu H, Liu J, Li H, Han Y, Zhou R, Zhang Y. The application of computer vision to visual prosthesis. Artif Organs 2021; 45:1141-1154. [PMID: 34318520 DOI: 10.1111/aor.14022] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2021] [Revised: 04/28/2021] [Accepted: 05/07/2021] [Indexed: 11/27/2022]
Abstract
A visual prosthesis is an auxiliary device for patients with blinding diseases that cannot be treated with conventional surgery or drugs. It converts captured images into corresponding electrical stimulation patterns, according to which phosphenes are generated through the action of internal electrodes on the visual pathway to form visual perception. However, due to some restrictions such as the few implantable electrodes that the biological tissue can accommodate, the induced perception is far from ideal. Therefore, an important issue in visual prosthesis research is how to detect and present useful information in low-resolution prosthetic vision to improve the visual function of the wearer. In recent years, with the development and broad application of computer vision methods, researchers have investigated the possibility of their utilization in visual prostheses by simulating prosthetic visual percepts. Through the optimization of visual perception by image processing, the efficiency of visual prosthesis devices can be further improved to better meet the needs of prosthesis wearers. In this article, recent works on prosthetic vision centering on implementing computer vision methods are reviewed. Differences, strengths, and weaknesses of the mentioned methods are discussed. The development directions of optimizing prosthetic vision and improving methods of visual perception are analyzed.
Collapse
Affiliation(s)
- Jing Wang
- School of Information, Shanghai Ocean University, Shanghai, China.,Key Laboratory of Fishery Information, Ministry of Agriculture, Shanghai, China
| | - Haiyi Zhu
- School of Information, Shanghai Ocean University, Shanghai, China
| | - Jianyun Liu
- School of Information, Shanghai Ocean University, Shanghai, China
| | - Heng Li
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Yanling Han
- School of Information, Shanghai Ocean University, Shanghai, China
| | - Ruyan Zhou
- School of Information, Shanghai Ocean University, Shanghai, China
| | - Yun Zhang
- School of Information, Shanghai Ocean University, Shanghai, China.,Key Laboratory of Fishery Information, Ministry of Agriculture, Shanghai, China
| |
Collapse
|
5
|
Moleirinho S, Whalen AJ, Fried SI, Pezaris JS. The impact of synchronous versus asynchronous electrical stimulation in artificial vision. J Neural Eng 2021; 18. [PMID: 33900206 DOI: 10.1088/1741-2552/abecf1] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2020] [Accepted: 03/09/2021] [Indexed: 11/12/2022]
Abstract
Visual prosthesis devices designed to restore sight to the blind have been under development in the laboratory for several decades. Clinical translation continues to be challenging, due in part to gaps in our understanding of critical parameters such as how phosphenes, the electrically-generated pixels of artificial vision, can be combined to form images. In this review we explore the effects that synchronous and asynchronous electrical stimulation across multiple electrodes have in evoking phosphenes. Understanding how electrical patterns influence phosphene generation to control object binding and perception of visual form is fundamental to creation of a clinically successful prosthesis.
Collapse
Affiliation(s)
- Susana Moleirinho
- Department of Neurosurgery, Massachusetts General Hospital, Boston, MA, United States of America.,Department of Neurosurgery, Harvard Medical School, Boston, MA, United States of America
| | - Andrew J Whalen
- Department of Neurosurgery, Massachusetts General Hospital, Boston, MA, United States of America.,Department of Neurosurgery, Harvard Medical School, Boston, MA, United States of America
| | - Shelley I Fried
- Department of Neurosurgery, Massachusetts General Hospital, Boston, MA, United States of America.,Department of Neurosurgery, Harvard Medical School, Boston, MA, United States of America.,Boston VA Healthcare System, Boston, MA, United States of America
| | - John S Pezaris
- Department of Neurosurgery, Massachusetts General Hospital, Boston, MA, United States of America.,Department of Neurosurgery, Harvard Medical School, Boston, MA, United States of America
| |
Collapse
|
6
|
Levin EA, Kiselev RS, Vasyatkina AG, Semin PA. Electrophysiological reactions to intraoperative irritation of the optic nerve. Case report and review of possible mechanisms. Neurochirurgie 2021; 68:223-227. [PMID: 33845114 DOI: 10.1016/j.neuchi.2021.03.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2020] [Revised: 02/25/2021] [Accepted: 03/06/2021] [Indexed: 11/20/2022]
Abstract
BACKGROUND Intraoperative control of optic nerve function conservation during neurosurgical operations currently relies mainly on visual evoked potential monitoring. Unfortunately, this detects peril only when the visual pathways are already compromised, sometimes irreversibly. In contrast, electrophysiological stimulation mapping of the nerves can be a fully preventive measure. However, direct sensory nerve mapping requires the patient to be awake during surgery, which is unfeasible for surgeries targeting the optic nerve area. Another possible approach to sensory nerve mapping involves unconditioned electrophysiological responses evoked by sensory nerve stimulation. The key point for this approach is the possibility of obtaining such responses for a particular sensory nerve under surgical anesthesia. CASE REPORT A 52-year-old woman presented with meningioma in the area of right optic nerve and chiasm. She underwent microsurgical removal of the tumor through the transciliary supraorbital approach. During surgery, electrodes at the inferior margin of the right orbit repeatedly recorded electrophysiological reactions following contacts and displacements of the right optic nerve by the surgical instruments. CONCLUSIONS The observed reactions suggest that either the unconditioned blink reflex or antidromic electroretinographic response to optic nerve irritation was conserved under total intravenous anesthesia. This observation might be of value for development of intraoperative optic nerve mapping. This in turn could increase patient safety by identifying the exact optic nerve location before any negative impact on it.
Collapse
Affiliation(s)
- E A Levin
- Department of Angioneurology and Neurosurgery, Meshalkin National Medical Research Centre, Rechkunovskaya street, 15, 630055 Novosibirsk, Russian Federation.
| | - R S Kiselev
- Department of Angioneurology and Neurosurgery, Meshalkin National Medical Research Centre, Rechkunovskaya street, 15, 630055 Novosibirsk, Russian Federation; Department of Neurosurgery, Meshalkin National Medical Research Centre, Rechkunovskaya street, 15, 630055 Novosibirsk, Russian Federation.
| | - A G Vasyatkina
- Department of Neurosurgery, Meshalkin National Medical Research Centre, Rechkunovskaya street, 15, 630055 Novosibirsk, Russian Federation.
| | - P A Semin
- Department of Neurosurgery, Meshalkin National Medical Research Centre, Rechkunovskaya street, 15, 630055 Novosibirsk, Russian Federation.
| |
Collapse
|
7
|
Picaud S, Sahel JA. [Vision restoration: science fiction or reality?]. Med Sci (Paris) 2020; 36:1038-1044. [PMID: 33151850 DOI: 10.1051/medsci/2020213] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
Visual prostheses aim at restoring useful vision to patients who have become blind. This useful vision should enable them to regain autonomy in society for navigation, face recognition or reading. Two retinal prostheses have already obtained market authorization for patients affected by retinal dystrophies while a new device is in clinical trials for patients affected by age-related macular degeneration. Various prostheses, in particular cortical prostheses, are currently in clinical trials for optic neuropathies (glaucoma). Optogenetic therapy, an alternative strategy, has now reached the stage of clinical trials at the retinal level while moving forward at the cortical level. Other innovating strategies have obtained proofs of concepts in rodents but require a further validation in large animals prior to their evaluation on patients. Restoring vision should therefore become a reality for many patients even if this vision will not be as extensive and perfect as natural vision.
Collapse
Affiliation(s)
- Serge Picaud
- Institut de la Vision, Sorbonne Université, Inserm et CNRS, 17 rue Moreau, 75012 Paris, France
| | - José-Alain Sahel
- Institut de la Vision, Sorbonne Université, Inserm et CNRS, 17 rue Moreau, 75012 Paris, France - Department of Ophthalmology, The University of Pittsburgh School of Medicine, Pittsburgh, PA, États-Unis - Centre hospitalier national d'ophtalmologie (CHNO) des Quinze-Vingts, Département hospital-universitaire (DHU) Sight Restore, Inserm-DGOS CIC 1423, Paris, France - Fondation Ophtalmologique Rothschild, Paris, France
| |
Collapse
|
8
|
Nowik K, Langwińska-Wośko E, Skopiński P, Nowik KE, Szaflik JP. Bionic eye review – An update. J Clin Neurosci 2020; 78:8-19. [DOI: 10.1016/j.jocn.2020.05.041] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2020] [Accepted: 05/03/2020] [Indexed: 01/26/2023]
|
9
|
Adair D, Truong D, Esmaeilpour Z, Gebodh N, Borges H, Ho L, Bremner JD, Badran BW, Napadow V, Clark VP, Bikson M. Electrical stimulation of cranial nerves in cognition and disease. Brain Stimul 2020; 13:717-750. [PMID: 32289703 PMCID: PMC7196013 DOI: 10.1016/j.brs.2020.02.019] [Citation(s) in RCA: 72] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2019] [Revised: 02/13/2020] [Accepted: 02/17/2020] [Indexed: 02/06/2023] Open
Abstract
The cranial nerves are the pathways through which environmental information (sensation) is directly communicated to the brain, leading to perception, and giving rise to higher cognition. Because cranial nerves determine and modulate brain function, invasive and non-invasive cranial nerve electrical stimulation methods have applications in the clinical, behavioral, and cognitive domains. Among other neuromodulation approaches such as peripheral, transcranial and deep brain stimulation, cranial nerve stimulation is unique in allowing axon pathway-specific engagement of brain circuits, including thalamo-cortical networks. In this review we amalgamate relevant knowledge of 1) cranial nerve anatomy and biophysics; 2) evidence of the modulatory effects of cranial nerves on cognition; 3) clinical and behavioral outcomes of cranial nerve stimulation; and 4) biomarkers of nerve target engagement including physiology, electroencephalography, neuroimaging, and behavioral metrics. Existing non-invasive stimulation methods cannot feasibly activate the axons of only individual cranial nerves. Even with invasive stimulation methods, selective targeting of one nerve fiber type requires nuance since each nerve is composed of functionally distinct axon-types that differentially branch and can anastomose onto other nerves. None-the-less, precisely controlling stimulation parameters can aid in affecting distinct sets of axons, thus supporting specific actions on cognition and behavior. To this end, a rubric for reproducible dose-response stimulation parameters is defined here. Given that afferent cranial nerve axons project directly to the brain, targeting structures (e.g. thalamus, cortex) that are critical nodes in higher order brain networks, potent effects on cognition are plausible. We propose an intervention design framework based on driving cranial nerve pathways in targeted brain circuits, which are in turn linked to specific higher cognitive processes. State-of-the-art current flow models that are used to explain and design cranial-nerve-activating stimulation technology require multi-scale detail that includes: gross anatomy; skull foramina and superficial tissue layers; and precise nerve morphology. Detailed simulations also predict that some non-invasive electrical or magnetic stimulation approaches that do not intend to modulate cranial nerves per se, such as transcranial direct current stimulation (tDCS) and transcranial magnetic stimulation (TMS), may also modulate activity of specific cranial nerves. Much prior cranial nerve stimulation work was conceptually limited to the production of sensory perception, with individual titration of intensity based on the level of perception and tolerability. However, disregarding sensory emulation allows consideration of temporal stimulation patterns (axon recruitment) that modulate the tone of cortical networks independent of sensory cortices, without necessarily titrating perception. For example, leveraging the role of the thalamus as a gatekeeper for information to the cerebral cortex, preventing or enhancing the passage of specific information depending on the behavioral state. We show that properly parameterized computational models at multiple scales are needed to rationally optimize neuromodulation that target sets of cranial nerves, determining which and how specific brain circuitries are modulated, which can in turn influence cognition in a designed manner.
Collapse
Affiliation(s)
- Devin Adair
- Department of Biomedical Engineering, City College of New York, New York, NY, USA
| | - Dennis Truong
- Department of Biomedical Engineering, City College of New York, New York, NY, USA
| | - Zeinab Esmaeilpour
- Department of Biomedical Engineering, City College of New York, New York, NY, USA.
| | - Nigel Gebodh
- Department of Biomedical Engineering, City College of New York, New York, NY, USA
| | - Helen Borges
- Department of Biomedical Engineering, City College of New York, New York, NY, USA
| | - Libby Ho
- Department of Biomedical Engineering, City College of New York, New York, NY, USA
| | - J Douglas Bremner
- Department of Psychiatry & Behavioral Sciences and Radiology, Emory University School of Medicine, Atlanta, GA, USA; Atlanta VA Medical Center, Decatur, GA, USA
| | - Bashar W Badran
- Department of Psychiatry & Behavioral Sciences, Medical University of South Carolina, Charleston, SC, USA
| | - Vitaly Napadow
- Martinos Center for Biomedical Imaging, Department of Radiology, MGH, Harvard medical school, Boston, MA, USA
| | - Vincent P Clark
- Psychology Clinical Neuroscience Center, Dept. Psychology, MSC03-2220, University of New Mexico, Albuquerque, NM, 87131, USA; Department of Psychology, University of New Mexico, Albuquerque, NM, 87131, USA; The Mind Research Network of the Lovelace Biomedical Research Institute, 1101 Yale Blvd. NE, Albuquerque, NM, 87106, USA
| | - Marom Bikson
- Department of Biomedical Engineering, City College of New York, New York, NY, USA.
| |
Collapse
|
10
|
Abstract
Developments of new strategies to restore vision and improving on current strategies by harnessing new advancements in material and electrical sciences, and biological and genetic-based technologies are of upmost health priorities around the world. Federal and private entities are spending billions of dollars on visual prosthetics technologies. This review describes the most current and state-of-the-art bioengineering technologies to restore vision. This includes a thorough description of traditional electrode-based visual prosthetics that have improved substantially since early prototypes. Recent advances in molecular and synthetic biology have transformed vision-assisted technologies; For example, optogenetic technologies that introduce light-responsive proteins offer excellent resolution but cortical applications are restricted by fiber implantation and tissue damage. Other stimulation modalities, such as magnetic fields, have been explored to achieve non-invasive neuromodulation. Miniature magnetic coils are currently being developed to activate select groups of neurons. Magnetically-responsive nanoparticles or exogenous proteins can significantly enhance the coupling between external electromagnetic devices and any neurons affiliated with these modifications. The need to minimize cytotoxic effects for nanoparticle-based therapies will likely restrict the number of usable materials. Nevertheless, advances in identifying and utilizing proteins that respond to magnetic fields may lead to non-invasive, cell-specific stimulation and may overcome many of the limitations that currently exist with other methods. Finally, sensory substitution systems also serve as viable visual prostheses by converting visual input to auditory and somatosensory stimuli. This review also discusses major challenges in the field and offers bioengineering strategies to overcome those.
Collapse
Affiliation(s)
- Alexander Farnum
- Department of Biomedical Engineering, College of Engineering, Michigan State University, East Lansing, MI, United States
- Institute for Quantitative Health Science and Engineering, Michigan State University, East Lansing, MI, United States
| | - Galit Pelled
- Department of Biomedical Engineering, College of Engineering, Michigan State University, East Lansing, MI, United States
- Institute for Quantitative Health Science and Engineering, Michigan State University, East Lansing, MI, United States
- Department of Radiology, College of Human Medicine, Michigan State University, East Lansing, MI, United States
| |
Collapse
|
11
|
|
12
|
Gaillet V, Cutrone A, Artoni F, Vagni P, Mega Pratiwi A, Romero SA, Lipucci Di Paola D, Micera S, Ghezzi D. Spatially selective activation of the visual cortex via intraneural stimulation of the optic nerve. Nat Biomed Eng 2019; 4:181-194. [DOI: 10.1038/s41551-019-0446-8] [Citation(s) in RCA: 33] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2018] [Accepted: 07/18/2019] [Indexed: 01/22/2023]
|
13
|
Shalbaf F, Lovell NH, Dokos S, Trew M, Vaghefi E. Foveal eccentricity can influence activation threshold in subretinal electrical stimulation. Biomed Phys Eng Express 2019. [DOI: 10.1088/2057-1976/ab0b85] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
14
|
Optimization of Visual Information Presentation for Visual Prosthesis. Int J Biomed Imaging 2018; 2018:3198342. [PMID: 29731769 PMCID: PMC5872628 DOI: 10.1155/2018/3198342] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2017] [Revised: 01/26/2018] [Accepted: 02/07/2018] [Indexed: 11/17/2022] Open
Abstract
Visual prosthesis applying electrical stimulation to restore visual function for the blind has promising prospects. However, due to the low resolution, limited visual field, and the low dynamic range of the visual perception, huge loss of information occurred when presenting daily scenes. The ability of object recognition in real-life scenarios is severely restricted for prosthetic users. To overcome the limitations, optimizing the visual information in the simulated prosthetic vision has been the focus of research. This paper proposes two image processing strategies based on a salient object detection technique. The two processing strategies enable the prosthetic implants to focus on the object of interest and suppress the background clutter. Psychophysical experiments show that techniques such as foreground zooming with background clutter removal and foreground edge detection with background reduction have positive impacts on the task of object recognition in simulated prosthetic vision. By using edge detection and zooming technique, the two processing strategies significantly improve the recognition accuracy of objects. We can conclude that the visual prosthesis using our proposed strategy can assist the blind to improve their ability to recognize objects. The results will provide effective solutions for the further development of visual prosthesis.
Collapse
|
15
|
Scholl HPN, Strauss RW, Singh MS, Dalkara D, Roska B, Picaud S, Sahel JA. Emerging therapies for inherited retinal degeneration. Sci Transl Med 2017; 8:368rv6. [PMID: 27928030 DOI: 10.1126/scitranslmed.aaf2838] [Citation(s) in RCA: 147] [Impact Index Per Article: 21.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2016] [Accepted: 11/17/2016] [Indexed: 12/13/2022]
Abstract
Inherited retinal degenerative diseases, a genetically and phenotypically heterogeneous group of disorders, affect the function of photoreceptor cells and are among the leading causes of blindness. Recent advances in molecular genetics and cell biology are elucidating the pathophysiological mechanisms underlying these disorders and are helping to identify new therapeutic approaches, such as gene therapy, stem cell therapy, and optogenetics. Several of these approaches have entered the clinical phase of development. Artificial replacement of dying photoreceptor cells using retinal prostheses has received regulatory approval. Precise retinal imaging and testing of visual function are facilitating more efficient clinical trial design. In individual patients, disease stage will determine whether the therapeutic strategy should comprise photoreceptor cell rescue to delay or arrest vision loss or retinal replacement for vision restoration.
Collapse
Affiliation(s)
- Hendrik P N Scholl
- Department of Ophthalmology, University of Basel, 4056 Basel, Switzerland. .,Wilmer Eye Institute, Johns Hopkins University, Baltimore, MD 21287, USA
| | - Rupert W Strauss
- Wilmer Eye Institute, Johns Hopkins University, Baltimore, MD 21287, USA.,Moorfields Eye Hospital, London EC1V 2PD, U.K.,UCL Institute of Ophthalmology, University College London, London EC1V 9EL, U.K.,Department of Ophthalmology, Medical University Graz, Graz, Austria.,Department of Ophthalmology, Johannes Kepler University Linz, 4021 Linz, Austria
| | - Mandeep S Singh
- Wilmer Eye Institute, Johns Hopkins University, Baltimore, MD 21287, USA
| | - Deniz Dalkara
- INSERM, UMR S 968, 75012 Paris, France.,Sorbonne Universités, UPMC Univ Paris 06, Institut de la Vision, Paris, France.,CNRS, UMR 7210, 75012 Paris, France
| | - Botond Roska
- Department of Ophthalmology, University of Basel, 4056 Basel, Switzerland.,Neural Circuit Laboratories, Friedrich Miescher Institute for Biomedical Research, 4058 Basel, Switzerland
| | - Serge Picaud
- INSERM, UMR S 968, 75012 Paris, France.,Sorbonne Universités, UPMC Univ Paris 06, Institut de la Vision, Paris, France.,CNRS, UMR 7210, 75012 Paris, France
| | - José-Alain Sahel
- INSERM, UMR S 968, 75012 Paris, France.,Sorbonne Universités, UPMC Univ Paris 06, Institut de la Vision, Paris, France.,CNRS, UMR 7210, 75012 Paris, France.,Fondation Ophtalmologique Adolphe de Rothschild, 75019 Paris, France.,Centre d'Investigation Clinique 1423, INSERM-Center Hospitalier National d'Ophtalmologie des Quinze-Vingts, 75012 Paris, France.,Department of Ophthalmology, University of Pittsburgh School of Medicine, Pittsburgh, PA 15213, USA
| |
Collapse
|
16
|
Irons JL, Gradden T, Zhang A, He X, Barnes N, Scott AF, McKone E. Face identity recognition in simulated prosthetic vision is poorer than previously reported and can be improved by caricaturing. Vision Res 2017; 137:61-79. [PMID: 28688907 DOI: 10.1016/j.visres.2017.06.002] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2017] [Revised: 04/15/2017] [Accepted: 06/08/2017] [Indexed: 10/19/2022]
Abstract
The visual prosthesis (or "bionic eye") has become a reality but provides a low resolution view of the world. Simulating prosthetic vision in normal-vision observers, previous studies report good face recognition ability using tasks that allow recognition to be achieved on the basis of information that survives low resolution well, including basic category (sex, age) and extra-face information (hairstyle, glasses). Here, we test within-category individuation for face-only information (e.g., distinguishing between multiple Caucasian young men with hair covered). Under these conditions, recognition was poor (although above chance) even for a simulated 40×40 array with all phosphene elements assumed functional, a resolution above the upper end of current-generation prosthetic implants. This indicates that a significant challenge is to develop methods to improve face identity recognition. Inspired by "bionic ear" improvements achieved by altering signal input to match high-level perceptual (speech) requirements, we test a high-level perceptual enhancement of face images, namely face caricaturing (exaggerating identity information away from an average face). Results show caricaturing improved identity recognition in memory and/or perception (degree by which two faces look dissimilar) down to a resolution of 32×32 with 30% phosphene dropout. Findings imply caricaturing may offer benefits for patients at resolutions realistic for some current-generation or in-development implants.
Collapse
Affiliation(s)
- Jessica L Irons
- Research School of Psychology, Australian National University, Australia; ARC Centre for Cognition and Its Disorders, Australian National University, Australia.
| | - Tamara Gradden
- Research School of Psychology, Australian National University, Australia
| | - Angel Zhang
- Research School of Psychology, Australian National University, Australia
| | - Xuming He
- National Information and Communication Technology Australia (NICTA), Australia; College of Engineering and Computer Science, Australian National University, Australia; Data61, CSIRO, Australia
| | - Nick Barnes
- National Information and Communication Technology Australia (NICTA), Australia; College of Engineering and Computer Science, Australian National University, Australia; Bionic Vision Australia, Australia; Data61, CSIRO, Australia
| | - Adele F Scott
- National Information and Communication Technology Australia (NICTA), Australia; Bionic Vision Australia, Australia; Data61, CSIRO, Australia
| | - Elinor McKone
- Research School of Psychology, Australian National University, Australia; ARC Centre for Cognition and Its Disorders, Australian National University, Australia.
| |
Collapse
|
17
|
Mathis T, Vignot S, Leal C, Caujolle JP, Maschi C, Mauget-Faÿsse M, Kodjikian L, Baillif S, Herault J, Thariat J. Mechanisms of phosphenes in irradiated patients. Oncotarget 2017; 8:64579-64590. [PMID: 28969095 PMCID: PMC5610027 DOI: 10.18632/oncotarget.18719] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2017] [Accepted: 05/15/2017] [Indexed: 11/25/2022] Open
Abstract
Anomalous visual perceptions have been reported in various diseases of the retina and visual pathways or can be experienced under specific conditions in healthy individuals. Phosphenes are perceptions of light in the absence of ambient light, occurring independently of the physiological and classical photonic stimulation of the retina. They are a frequent symptom in patients irradiated in the region of the central nervous system (CNS), head and neck and the eyes. Phosphenes have historically been attributed to complex physical phenomena such as Cherenkov radiation. While phosphenes are related to Cherenkov radiation under high energy photon/electron irradiation conditions, physical phenomena are unlikely to be responsible for light flashes at energies used for ocular proton therapy. Phosphenes may involve a direct role for ocular photoreceptors and possible interactions between cones and rods. Other mechanisms involving the retinal ganglion cells or ultraweak biophoton emission and rhodopsin bleaching after exposure to free radicals are also likely to be involved. Despite their frequency as shown in our preliminary observations, phosphenes have been underreported probably because their mechanism and impact are poorly understood. Recently, phosphenes have been used to restore the vision and whether they might predict vision loss after therapeutic irradiation is a current field of investigation. We have reviewed and also investigated here the mechanisms related to the occurrence of phosphenes in irradiated patients and especially in patients irradiated by proton therapy for ocular tumors.
Collapse
Affiliation(s)
- Thibaud Mathis
- Department of Ophthalmology, Croix-Rousse University Hospital, 69004 Lyon, France
| | - Stephane Vignot
- Department of Medical Oncology, Jean Godinot Institute, 51100 Reims, France
| | - Cecila Leal
- Department of Ophthalmology, Pasteur II Hospital, 06000 Nice, France
| | | | - Celia Maschi
- Department of Ophthalmology, Pasteur II Hospital, 06000 Nice, France
| | | | - Laurent Kodjikian
- Department of Ophthalmology, Croix-Rousse University Hospital, 69004 Lyon, France
| | - Stéphanie Baillif
- Department of Ophthalmology, Pasteur II Hospital, 06000 Nice, France
| | - Joel Herault
- Proton Therapy Center, Université Nice Sophia Antipolis, 06200 Nice, France
| | - Juliette Thariat
- Proton Therapy Center, Université Nice Sophia Antipolis, 06200 Nice, France.,Department of Radiation Therapy, Centre Francois Baclesse, ARCHADE, 14000 Caen, France
| |
Collapse
|
18
|
FitzGibbon T. Retinal prosthesis that incorporates the organization of the nerve fibre layer. Clin Exp Ophthalmol 2017; 45:401-408. [PMID: 28135031 DOI: 10.1111/ceo.12899] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2016] [Revised: 12/02/2016] [Accepted: 12/05/2016] [Indexed: 12/01/2022]
Abstract
Recent efforts to restore partial vision in blind patients have made significant progress. Currently, prosthetic design concentrates on stimulating as many foveal retinal ganglion cells as possible but is hampered by stimulation of the nerve fibre layer. This results in a nonvisuotopic arrangement of phosphenes (stimulation percepts). This article suggests that by extending the stimulation area well beyond the fovea and stimulating the nerve fibre layer, axons from any remaining ganglion cells in more peripheral regions of the retina (low acuity) can be used to generate a visuotopic map. Stimulation of the fibre layer will generate a large number of stimulation percepts; however, it is unlikely that these will have sufficient topographic order to be immediately useful to the patient. Thus, it will be necessary to recreate an ordered visuotopic map by using appropriate computer algorithms and interactions between the patient and the clinician.
Collapse
Affiliation(s)
- Thomas FitzGibbon
- Physiology Department, School of Medical Sciences, University of Sydney, Sydney, New South Wales, Australia
| |
Collapse
|
19
|
Abstract
Sensory neuroprostheses for restoration of vision are a technical approach for treatment of previously untreatable blindness. These systems consist of a technical sensor such as a camera and an implanted multi-electrode array within the visual system. The image information from the sensor is processed with specially designed integrated circuits in such a way that the stimulation pulses can be determined and presented to the implanted multi-electrode matrix. Energy supply and the transfer of the stimulus pulse information is realized either via direct cable connections within the site of the implant or by telemetric inductive links. Currently, two retinal implant systems are approved in the European Union (EU) to be used in blind patients with retinitis pigmentosa. With both systems basic visual functions can be restored. The complication rate is relatively low given the complexity of the surgical procedure. Other systems are still under development but approval studies by several manufacturers and consortia are already in preparation.
Collapse
Affiliation(s)
- P Walter
- Klinik für Augenheilkunde, Uniklinik RWTH Aachen, Pauwelsstr. 30, 52074, Aachen, Deutschland.
| |
Collapse
|
20
|
Lewis PM, Ayton LN, Guymer RH, Lowery AJ, Blamey PJ, Allen PJ, Luu CD, Rosenfeld JV. Advances in implantable bionic devices for blindness: a review. ANZ J Surg 2016; 86:654-9. [PMID: 27301783 PMCID: PMC5132139 DOI: 10.1111/ans.13616] [Citation(s) in RCA: 58] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2016] [Revised: 03/03/2016] [Accepted: 03/17/2016] [Indexed: 02/02/2023]
Abstract
Since the 1950s, vision researchers have been working towards the ambitious goal of restoring a functional level of vision to the blind via electrical stimulation of the visual pathways. Groups based in Australia, USA, Germany, France and Japan report progress in the translation of retinal visual prosthetics from the experimental to clinical domains, with two retinal visual prostheses having recently received regulatory approval for clinical use. Regulatory approval for cortical visual prostheses is yet to be obtained; however, several groups report plans to conduct clinical trials in the near future, building upon the seminal clinical studies of Brindley and Dobelle. In this review, we discuss the general principles of visual prostheses employing electrical stimulation of the visual pathways, focusing on the retina and visual cortex as the two most extensively studied stimulation sites. We also discuss the surgical and functional outcomes reported to date for retinal and cortical prostheses, concluding with a brief discussion of novel developments in this field and an outlook for the future.
Collapse
Affiliation(s)
- Philip M Lewis
- Department of Neurosurgery, Alfred Hospital, Melbourne, Victoria, Australia.,Department of Surgery, Central Clinical School, Monash University, Melbourne, Victoria, Australia.,Monash Vision Group, Faculty of Engineering, Monash University, Melbourne, Victoria, Australia.,Monash Institute of Medical Engineering, Monash University, Melbourne, Victoria, Australia
| | - Lauren N Ayton
- Centre for Eye Research Australia, The Royal Victorian Eye and Ear Hospital, Melbourne, Victoria, Australia.,Department of Ophthalmology, The University of Melbourne, Melbourne, Victoria, Australia.,Department of Surgery, The University of Melbourne, Melbourne, Victoria, Australia
| | - Robyn H Guymer
- Centre for Eye Research Australia, The Royal Victorian Eye and Ear Hospital, Melbourne, Victoria, Australia.,Department of Ophthalmology, The University of Melbourne, Melbourne, Victoria, Australia.,Department of Surgery, The University of Melbourne, Melbourne, Victoria, Australia
| | - Arthur J Lowery
- Monash Vision Group, Faculty of Engineering, Monash University, Melbourne, Victoria, Australia.,Monash Institute of Medical Engineering, Monash University, Melbourne, Victoria, Australia
| | - Peter J Blamey
- Bionics Institute, Department of Medical Bionics, The University of Melbourne, Melbourne, Victoria, Australia
| | - Penelope J Allen
- Centre for Eye Research Australia, The Royal Victorian Eye and Ear Hospital, Melbourne, Victoria, Australia.,Department of Ophthalmology, The University of Melbourne, Melbourne, Victoria, Australia.,Department of Surgery, The University of Melbourne, Melbourne, Victoria, Australia
| | - Chi D Luu
- Centre for Eye Research Australia, The Royal Victorian Eye and Ear Hospital, Melbourne, Victoria, Australia.,Department of Ophthalmology, The University of Melbourne, Melbourne, Victoria, Australia.,Department of Surgery, The University of Melbourne, Melbourne, Victoria, Australia
| | - Jeffrey V Rosenfeld
- Department of Neurosurgery, Alfred Hospital, Melbourne, Victoria, Australia.,Department of Surgery, Central Clinical School, Monash University, Melbourne, Victoria, Australia.,Monash Vision Group, Faculty of Engineering, Monash University, Melbourne, Victoria, Australia.,Monash Institute of Medical Engineering, Monash University, Melbourne, Victoria, Australia.,F. Edward Hébert School of Medicine, Uniformed Services University of the Health Sciences, Bethesda, Maryland, USA
| |
Collapse
|
21
|
Walter P. Sehprothesen. SPEKTRUM DER AUGENHEILKUNDE 2016. [DOI: 10.1007/s00717-016-0299-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
22
|
Barnes N, Scott AF, Lieby P, Petoe MA, McCarthy C, Stacey A, Ayton LN, Sinclair NC, Shivdasani MN, Lovell NH, McDermott HJ, Walker JG. Vision function testing for a suprachoroidal retinal prosthesis: effects of image filtering. J Neural Eng 2016; 13:036013. [DOI: 10.1088/1741-2560/13/3/036013] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
23
|
Yang K, Liu S, Wang H, Liu W, Wu Y. Effect of Pixel’s Spatial Characteristics on Recognition of Isolated Pixelized Chinese Character. Open Biomed Eng J 2015; 9:234-9. [PMID: 26628934 PMCID: PMC4645899 DOI: 10.2174/1874120701509010234] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2015] [Revised: 05/21/2015] [Accepted: 06/09/2015] [Indexed: 11/22/2022] Open
Abstract
The influence of pixel’s spatial characteristics on recognition of isolated Chinese character was investigated using simulated prosthestic vision. The accuracy of Chinese character recognition with 4 kinds of pixel number (6*6, 8*8, 10*10, and 12*12 pixel array) and 3 kinds of pixel shape (Square, Dot and Gaussian) and different pixel spacing were tested through head-mounted display (HMD). A captured image of Chinese characters in font style of Hei were pixelized with Square, Dot and Gaussian pixel. Results showed that pixel number was the most important factor which could affect the recognition of isolated pixelized Chinese Chartars and the accuracy of recognition increased with the addition of pixel number. 10*10 pixel array could provide enough information for people to recognize an isolated Chinese character. At low resolution (6*6 and 8*8 pixel array), there were little difference of recognition accuracy between different pixel shape and different pixel spacing. While as for high resolution (10*10 and 12*12 pixel array), the fluctuation of pixel shape and pixel spacing could not affect the performance of recognition of isolated pixelized Chinese Character.
Collapse
|
24
|
Yan Y, Sui X, Liu W, Lu Y, Cao P, Ma Z, Chen Y, Chai X, Li L. Spatial characteristics of evoked potentials elicited by a MEMS microelectrode array for suprachoroidal-transretinal stimulation in a rabbit. Graefes Arch Clin Exp Ophthalmol 2015; 253:1515-28. [PMID: 25981117 DOI: 10.1007/s00417-015-3027-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2014] [Revised: 03/26/2015] [Accepted: 04/20/2015] [Indexed: 11/25/2022] Open
Abstract
BACKGROUND Suprachoroidal-transretinal stimulation (STS) can potentially restore vision. This study investigated the spatial characteristics of cortical electrical evoked potentials (EEPs) elicited by STS. METHODS A 4 × 4 thin-film platinum microelectrode stimulating array (200 μm electrode diameter and 400 μm center-to-center distance) was fabricated by a micro-electro-mechanical systems (MEMS) techniques and implanted into the suprachoroidal space of albino rabbits. RESULTS The current threshold to elicit reliable EEPs by a single electrode was 41.6 ± 12.6 μA, corresponding to a 66.2 ± 20.1 μC · cm(-2) charge density per phase, which was lower than the reported safety limits. Spatially differentiated cortical responses could be evoked by STS through different rows or columns of electrical stimulation; furthermore, shifts in the location of the maximum cortical activities were consistent with cortical visuotopic maps; increasing the number of simultaneously stimulating electrodes increased the response amplitudes of EEPs and expanded the spatial spread as well. In addition, long-term implantation and electrical stimulation of the MEMS electrode array in suprachoroidal space are necessary to evaluate systematically the safety and biocompatibility of this approach. CONCLUSIONS This study indicates that the STS approach by a MEMS-based platinum electrode array is a feasible alternative for visual restoration, and relatively high spatial discrimination may be achieved.
Collapse
Affiliation(s)
- Yan Yan
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China,
| | | | | | | | | | | | | | | | | |
Collapse
|
25
|
Xia P, Hu J, Peng Y. Adaptation to Phosphene Parameters Based on Multi-Object Recognition Using Simulated Prosthetic Vision. Artif Organs 2015; 39:1038-45. [DOI: 10.1111/aor.12504] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Affiliation(s)
- Peng Xia
- School of Mechanical Engineering; Shanghai Jiao Tong University; Shanghai China
| | - Jie Hu
- School of Mechanical Engineering; Shanghai Jiao Tong University; Shanghai China
| | - Yinghong Peng
- School of Mechanical Engineering; Shanghai Jiao Tong University; Shanghai China
| |
Collapse
|
26
|
Lewis PM, Ackland HM, Lowery AJ, Rosenfeld JV. Restoration of vision in blind individuals using bionic devices: a review with a focus on cortical visual prostheses. Brain Res 2014; 1595:51-73. [PMID: 25446438 DOI: 10.1016/j.brainres.2014.11.020] [Citation(s) in RCA: 114] [Impact Index Per Article: 11.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2014] [Revised: 11/05/2014] [Accepted: 11/08/2014] [Indexed: 12/13/2022]
Abstract
The field of neurobionics offers hope to patients with sensory and motor impairment. Blindness is a common cause of major sensory loss, with an estimated 39 million people worldwide suffering from total blindness in 2010. Potential treatment options include bionic devices employing electrical stimulation of the visual pathways. Retinal stimulation can restore limited visual perception to patients with retinitis pigmentosa, however loss of retinal ganglion cells precludes this approach. The optic nerve, lateral geniculate nucleus and visual cortex provide alternative stimulation targets, with several research groups actively pursuing a cortically-based device capable of driving several hundred stimulating electrodes. While great progress has been made since the earliest works of Brindley and Dobelle in the 1960s and 1970s, significant clinical, surgical, psychophysical, neurophysiological, and engineering challenges remain to be overcome before a commercially-available cortical implant will be realized. Selection of candidate implant recipients will require assessment of their general, psychological and mental health, and likely responses to visual cortex stimulation. Implant functionality, longevity and safety may be enhanced by careful electrode insertion, optimization of electrical stimulation parameters and modification of immune responses to minimize or prevent the host response to the implanted electrodes. Psychophysical assessment will include mapping the positions of potentially several hundred phosphenes, which may require repetition if electrode performance deteriorates over time. Therefore, techniques for rapid psychophysical assessment are required, as are methods for objectively assessing the quality of life improvements obtained from the implant. These measures must take into account individual differences in image processing, phosphene distribution and rehabilitation programs that may be required to optimize implant functionality. In this review, we detail these and other challenges facing developers of cortical visual prostheses in addition to briefly outlining the epidemiology of blindness, and the history of cortical electrical stimulation in the context of visual prosthetics.
Collapse
Affiliation(s)
- Philip M Lewis
- Department of Neurosurgery, Alfred Hospital, Melbourne, Australia; Department of Surgery, Monash University, Central Clinical School, Melbourne, Australia; Monash Vision Group, Faculty of Engineering, Monash University, Melbourne, Australia; Monash Institute of Medical Engineering, Monash University, Melbourne, Australia.
| | - Helen M Ackland
- Department of Neurosurgery, Alfred Hospital, Melbourne, Australia; Department of Epidemiology and Preventive Medicine, Monash University, Melbourne, Australia.
| | - Arthur J Lowery
- Monash Vision Group, Faculty of Engineering, Monash University, Melbourne, Australia; Monash Institute of Medical Engineering, Monash University, Melbourne, Australia; Department of Electrical and Computer Systems Engineering, Faculty of Engineering, Monash University, Melbourne, Australia.
| | - Jeffrey V Rosenfeld
- Department of Neurosurgery, Alfred Hospital, Melbourne, Australia; Department of Surgery, Monash University, Central Clinical School, Melbourne, Australia; Monash Vision Group, Faculty of Engineering, Monash University, Melbourne, Australia; Monash Institute of Medical Engineering, Monash University, Melbourne, Australia; F. Edward Hébert School of Medicine, Uniformed Services University of the Health Sciences, Bethesda, USA.
| |
Collapse
|
27
|
Moving object recognition under simulated prosthetic vision using background-subtraction-based image processing strategies. Inf Sci (N Y) 2014. [DOI: 10.1016/j.ins.2014.02.136] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
28
|
Wang J, Wu X, Lu Y, Wu H, Kan H, Chai X. Face recognition in simulated prosthetic vision: face detection-based image processing strategies. J Neural Eng 2014; 11:046009. [PMID: 24921713 DOI: 10.1088/1741-2560/11/4/046009] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Given the limited visual percepts elicited by current prosthetic devices, it is essential to optimize image content in order to assist implant wearers to achieve better performance of visual tasks. This study focuses on recognition of familiar faces using simulated prosthetic vision. APPROACH Combined with region-of-interest (ROI) magnification, three face extraction strategies based on a face detection technique were used: the Viola-Jones face region, the statistical face region (SFR) and the matting face region. MAIN RESULTS These strategies significantly enhanced recognition performance compared to directly lowering resolution (DLR) with Gaussian dots. The inclusion of certain external features, such as hairstyle, was beneficial for face recognition. Given the high recognition accuracy achieved and applicable processing speed, SFR-ROI was the preferred strategy. DLR processing resulted in significant face gender recognition differences (i.e. females were more easily recognized than males), but these differences were not apparent with other strategies. SIGNIFICANCE Face detection-based image processing strategies improved visual perception by highlighting useful information. Their use is advisable for face recognition when using low-resolution prosthetic vision. These results provide information for the continued design of image processing modules for use in visual prosthetics, thus maximizing the benefits for future prosthesis wearers.
Collapse
Affiliation(s)
- Jing Wang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, People's Republic of China
| | | | | | | | | | | |
Collapse
|
29
|
Restaino SM, Abliz E, Wachrathit K, Krauthamer V, Shah SB. Biomechanical and functional variation in rat sciatic nerve following cuff electrode implantation. J Neuroeng Rehabil 2014; 11:73. [PMID: 24758405 PMCID: PMC4022540 DOI: 10.1186/1743-0003-11-73] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2013] [Accepted: 04/07/2014] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Nerve cuff electrodes are commonly and successfully used for stimulating peripheral nerves. On the other hand, they occasionally induce functional and morphological changes following chronic implantation, for reasons not always clear. We hypothesize that restriction of nerve mobility due to cuff implantation may alter nerve conduction. METHODS We quantified acute changes in nerve-muscle electrophysiology, using electromyography, and nerve kinematics in anesthetized Sprague Dawley rat sciatic nerves during controlled hindlimb joint movement. We compared electrophysiological and biomechanical response in uncuffed nerves and those secured within a cuff electrode using analysis of variance (ANOVA) and regression analysis. RESULTS Tethering resulting from cuff implantation resulted in altered nerve strain and a complex biomechanical environment during joint movement. Coincident with biomechanical changes, electromyography revealed significantly increased variability in the response of conduction latency and amplitude in cuffed, but not free, nerves following joint movement. CONCLUSION Our findings emphasize the importance of the mechanical interface between peripheral nerves and their devices on neurophysiological performance. This work has implications for nerve device design, implantation, and prediction of long-term efficacy.
Collapse
Affiliation(s)
| | | | | | | | - Sameer B Shah
- Fischell Department of Bioengineering, University of Maryland, College Park, MD, USA.
| |
Collapse
|
30
|
Carozzo S, Martinoli C, Sannita WG. Miscoded Visual Processing in Degenerative Retinal Disorder? J PSYCHOPHYSIOL 2014. [DOI: 10.1027/0269-8803/a000110] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Standard electrophysiological procedures for visual testing were applied to record the retinal and cortical electrophysiological responses to contrast stimulation from 35 subjects with unambiguously diagnosed retinitis pigmentosa and severe impairment of visual acuity and field. Stimuli (central 9° of visual field) were sinusoidal bars with spatial frequencies of 0.6–1.2 cycle/degree and 1.3–5.0 cycle/degree for the retinal (pattern-ERG) and cortical (pattern-VEP) responses, respectively; contrast was 80%; reversal at 2.13 Hz. Structured pattern-ERG above noise level was recorded from 29 subjects at 0.6 cycle/degree and from 24 subjects at 1.2 cycle/degree; latencies were increased and amplitude reduced. Pattern-VEP responses above noise level, with increased latencies and reduced amplitude, were observed in 92% of subjects with unilateral and in all subjects with bilateral retinal response. Both responses were phase-locked to stimulus. No correlation with the residual visual acuity or field was detected. The observation is consistent with evidence of the disease sparing the neuroretina and with unconscious visual processing and suggests miscoding of visual information processing.
Collapse
Affiliation(s)
- Simone Carozzo
- Department of Neuroscience, Ophthalmology and Genetics, University of Genova, Italy
| | - Cristina Martinoli
- The David Chiossone Institute for the Blind and Visually Disabled, Genova, Italy
| | - Walter G. Sannita
- Department of Neuroscience, Ophthalmology and Genetics, University of Genova, Italy
- The David Chiossone Institute for the Blind and Visually Disabled, Genova, Italy
- Department of Psychiatry, State University of New York, Stony Brook, NY, USA
| |
Collapse
|
31
|
Veraart C, Duret F, Brelén M, Oozeer M, Delbeke J. Vision rehabilitation in the case of blindness. Expert Rev Med Devices 2014; 1:139-53. [PMID: 16293017 DOI: 10.1586/17434440.1.1.139] [Citation(s) in RCA: 42] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
This article examines the various vision rehabilitation procedures that are available for early and late blindness. Depending on the pathology involved, several vision rehabilitation procedures exist, or are in development. Visual aids are available for low vision individuals, as are sensory aids for blind persons. Most noninvasive sensory substitution prostheses as well as implanted visual prostheses in development are reviewed. Issues dealing with vision rehabilitation are also discussed, such as problems of biocompatibility, electrical safety, psychosocial aspects, and ethics. Basic studies devoted to vision rehabilitation such as simulation in mathematical models and simulation of artificial vision are also presented. Finally, the importance of accurate rehabilitation assessment is addressed, and tentative market figures are given.
Collapse
Affiliation(s)
- Claude Veraart
- Neural Rehabilitation Engineering Laboratory, Universite catholique de Louvain, 54 Avenue Hippocrate Box UCL-54.46, B-1200 Brussels, Belgium.
| | | | | | | | | |
Collapse
|
32
|
Guenther T, Lovell NH, Suaning GJ. Bionic vision: system architectures – a review. Expert Rev Med Devices 2014; 9:33-48. [DOI: 10.1586/erd.11.58] [Citation(s) in RCA: 63] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
33
|
|
34
|
Lu Y, Wang J, Wu H, Li L, Cao X, Chai X. Recognition of objects in simulated irregular phosphene maps for an epiretinal prosthesis. Artif Organs 2013; 38:E10-20. [PMID: 24117959 DOI: 10.1111/aor.12174] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
Visual prostheses offer a possibility of restoring vision to the blind. It is necessary to determine minimum requirements for daily visual tasks. To investigate the recognition of common objects in daily life based on the simulated irregular phosphene maps, the effect of four parameters (resolution, distortion, dropout percentage, and gray scale) on object recognition was investigated. The results showed that object recognition accuracy significantly increased with an increase of resolution. Distortion and dropout percentage had significant impact on the object recognition; with the increase of distortion level and dropout percentage, the recognition decreased considerably. The accuracy decreased significantly only at gray level 2, whereas the other three gray levels showed no obvious difference. The two image processing methods (merging pixels to lower the resolution and edge extraction before lowering resolution) showed significant difference on the object recognition when there was a high degree of distortion level or dot dropout.
Collapse
Affiliation(s)
- Yanyu Lu
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | | | | | | | | | | |
Collapse
|
35
|
Penetrating electrode stimulation of the rabbit optic nerve: parameters and effects on evoked cortical potentials. Graefes Arch Clin Exp Ophthalmol 2013; 251:2545-54. [PMID: 24013577 DOI: 10.1007/s00417-013-2449-6] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2012] [Revised: 05/13/2013] [Accepted: 08/16/2013] [Indexed: 10/26/2022] Open
Abstract
BACKGROUND Stimulus parameters, in particular pulse shape, are an important consideration in the application of electrical stimulation when experimentally testing a visual prosthesis. We changed the biphasic pulse shape of several asymmetric charge-balanced pulses to investigate their effect on optic nerve (ON) stimulation and the recorded cortical response. METHODS Monopolar platinum-iridium electrodes were implanted into the rabbit's ON behind the eyeball. Electrical evoked potentials (EEPs) were recorded with silver ball electrodes placed on the cortex, and the results quantified. RESULTS Our results indicate that changing the shape of cathodic-first charge-balanced biphasic pulse (CA) while maintaining charge balance could reduce the current thresholds for stimulation. When stimulated at the same charge density, the stimulus having high-amplitude short-duration (HASD) cathodic phase produced a higher amplitude response, with a larger spatial spread but with a lower current threshold compared with other stimuli. Adding an inter-phase gap between the two phases of the stimulus increased the EEP amplitude, but was saturated at a gap of ∼0.2 ms; this was most obvious with CA stimulation, which was able to elicit a larger cortical response than that elicited by asymmetrical charge-balanced stimulus pulses with HASD cathodic phase, in contrast to CA without a gap. As the stimulating frequency increased, the amplitudes of the EEP components elicited by CA monotonically decreased. The fastest component (P0) was present with stimulating frequencies as high as 80 Hz, while the slower P1 and P2 disappeared with stimulating frequencies higher than 40 and 20 Hz, respectively. CONCLUSION A CA stimulus waveform with an inter-phase gap of 0.2 ms was more efficacious for ON stimulation than other stimulus combinations, and therefore should result in less tissue damage, minimal electrode etching, and lower power consumption if used in a visual prosthesis.
Collapse
|
36
|
Hu J, Xia P, Gu C, Qi J, Li S, Peng Y. Recognition of Similar Objects Using Simulated Prosthetic Vision. Artif Organs 2013; 38:159-67. [PMID: 24033534 DOI: 10.1111/aor.12147] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
Affiliation(s)
- Jie Hu
- School of Mechanical Engineering; Shanghai Jiao Tong University; Shanghai China
| | - Peng Xia
- School of Mechanical Engineering; Shanghai Jiao Tong University; Shanghai China
| | - Chaochen Gu
- School of Mechanical Engineering; Shanghai Jiao Tong University; Shanghai China
| | - Jin Qi
- School of Mechanical Engineering; Shanghai Jiao Tong University; Shanghai China
| | - Sheng Li
- School of Mechanical Engineering; Shanghai Jiao Tong University; Shanghai China
| | - Yinghong Peng
- School of Mechanical Engineering; Shanghai Jiao Tong University; Shanghai China
| |
Collapse
|
37
|
Lu Y, Yan Y, Chai X, Ren Q, Chen Y, Li L. Electrical stimulation with a penetrating optic nerve electrode array elicits visuotopic cortical responses in cats. J Neural Eng 2013; 10:036022. [DOI: 10.1088/1741-2560/10/3/036022] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
38
|
Parikh N, Itti L, Humayun M, Weiland J. Performance of visually guided tasks using simulated prosthetic vision and saliency-based cues. J Neural Eng 2013; 10:026017. [PMID: 23449023 DOI: 10.1088/1741-2560/10/2/026017] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
|
39
|
Humayun MS, Fernandes RAB, Weiland JD. Artificial Vision. Retina 2013. [DOI: 10.1016/b978-1-4557-0737-9.00126-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
40
|
Neural stimulation for visual rehabilitation: advances and challenges. ACTA ACUST UNITED AC 2012; 107:421-31. [PMID: 23148976 DOI: 10.1016/j.jphysparis.2012.10.003] [Citation(s) in RCA: 43] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2012] [Revised: 10/04/2012] [Accepted: 10/23/2012] [Indexed: 02/07/2023]
Abstract
Blindness affects tens of million people worldwide and its prevalence constantly increases along with population aging. In some pathologies leading to vision loss, prosthetic approaches are currently the only hope for the patient to recover some visual perception. Here, we review the latest advances in visual prosthetic strategies with their respective strength and weakness. The principle is to electrically stimulate neurons along the visual pathway. Ocular approaches target the remaining retinal cells whereas brain stimulation aims at stimulating higher visual structures directly. Even though ocular approaches are less invasive and easier to implement, brain stimulation can be applied to diseases where the connection between the retina and the brain is lost such as in glaucoma and could therefore benefit to patients with different pathologies. Today, numbers of groups are investigating these strategies and the first devices start being commercialized. However, critical bottlenecks still impair our scientific efforts towards efficient visual implants. These challenges include electrode miniaturization, material optimization, multiplexing of stimulation channels and encoding of visual information into electrical stimuli.
Collapse
|
41
|
Wallace GG, Higgins MJ, Moulton SE, Wang C. Nanobionics: the impact of nanotechnology on implantable medical bionic devices. NANOSCALE 2012; 4:4327-4347. [PMID: 22695635 DOI: 10.1039/c2nr30758h] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
The nexus of any bionic device can be found at the electrode-cellular interface. Overall efficiency is determined by our ability to transfer electronic information across that interface. The nanostructure imparted to electrodes plays a critical role in controlling the cascade of events that determines the composition and structure of that interface. With commonly used conductors: metals, carbon and organic conducting polymers, a number of approaches that promote control over structure in the nanodomain have emerged in recent years with subsequent studies revealing a critical dependency between nanostructure and cellular behaviour. As we continue to develop our understanding of how to create and characterise electromaterials in the nanodomain, this is expected to have a profound effect on the development of next generation bionic devices. In this review, we focus on advances in fabricating nanostructured electrodes that present new opportunities in the field of medical bionics. We also briefly evaluate the interactions of living cells with the nanostructured electromaterials, in addition to highlighting emerging tools used for nanofabrication and nanocharacterisation of the electrode-cellular interface.
Collapse
Affiliation(s)
- G G Wallace
- ARC Centre of Excellence for Electromaterials Science (ACES), Intelligent Polymer Research Institute, AIIM Facility, Innovation Campus, University of Wollongong, NSW 2522, Australia
| | | | | | | |
Collapse
|
42
|
Kar K, Krekelberg B. Transcranial electrical stimulation over visual cortex evokes phosphenes with a retinal origin. J Neurophysiol 2012; 108:2173-8. [PMID: 22855777 DOI: 10.1152/jn.00505.2012] [Citation(s) in RCA: 73] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Transcranial electrical stimulation (tES) is a promising therapeutic tool for a range of neurological diseases. Understanding how the small currents used in tES spread across the scalp and penetrate the brain will be important for the rational design of tES therapies. Alternating currents applied transcranially above visual cortex induce the perception of flashes of light (phosphenes). This makes the visual system a useful model to study tES. One hypothesis is that tES generates phosphenes by direct stimulation of the cortex underneath the transcranial electrode. Here, we provide evidence for the alternative hypothesis that phosphenes are generated in the retina by current spread from the occipital electrode. Building on the existing literature, we first confirm that phosphenes are induced at lower currents when electrodes are placed farther away from visual cortex and closer to the eye. Second, we explain the temporal frequency tuning of phosphenes based on the well-known response properties of primate retinal ganglion cells. Third, we show that there is no difference in the time it takes to evoke phosphenes in the retina or by stimulation above visual cortex. Together, these findings suggest that phosphenes induced by tES over visual cortex originate in the retina. From this, we infer that tES currents spread well beyond the area of stimulation and are unlikely to lead to focal neural activation. Novel stimulation protocols that optimize current distributions are needed to overcome these limitations of tES.
Collapse
Affiliation(s)
- Kohitij Kar
- Center for Molecular and Behavioral Neuroscience, Rutgers, The State University of New Jersey, Newark, NJ, USA.
| | | |
Collapse
|
43
|
Mechanical analysis and fabrication of a penetrating silicon microprobe as an artificial optic nerve visual prosthesis. Int J Artif Organs 2012; 35:34-44. [PMID: 22328332 DOI: 10.5301/ijao.5000034] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/12/2011] [Indexed: 11/20/2022]
Abstract
PURPOSE To investigate the mechanical response of a silicon microprobe while it penetrates the optic nerve. METHODS The finite element method was adopted to analyze models of the mechanical aspects of the silicon microprobe, including the effects of dimensions, the buckling load, lateral load, and the interaction between the microprobe and the tissue of the optic nerve. The silicon microprobe was fabricated based on silicon-on-insulator (SOI) wafer by micro-electro-mechanical system (MEMS) processing techniques. RESULTS The designed microprobe shank was 750 µm long and 110 µm wide with thickness of 15 µm. Lateral barbs were included so as to decrease the stress at stimulating-site regions. The microprobe could withstand a 50 MPa vertical load on the shank tip before buckling, but was more likely to be damaged by a lateral load rather than a vertical one. The silicon microprobe was successfully fabricated by MEMS processing techniques based on a four-inch SOI wafer. Mechanical analysis of the interactions between shank and optic nerve tissue showed that the maximum stress changed during the process of the microprobe insertion. CONCLUSIONS A silicon microprobe was designed as a potential visual prosthesis to be used for optic nerve stimulation. The mechanical issues were analyzed by means of the finite element method, and the implantable microprobe was fabricated based on a silicon-on-insulator wafer to maintain a uniform thickness.
Collapse
|
44
|
Li S, Hu J, Chai X, Peng Y. Image Recognition With a Limited Number of Pixels for Visual Prostheses Design. Artif Organs 2011; 36:266-74. [DOI: 10.1111/j.1525-1594.2011.01347.x] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
45
|
Efficacy and reliability of long-term implantation of multi-channel microelectrode arrays in the optical nerve sheath of rabbit eyes. Vision Res 2011; 51:1897-906. [DOI: 10.1016/j.visres.2011.06.019] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2011] [Revised: 06/19/2011] [Accepted: 06/30/2011] [Indexed: 11/16/2022]
|
46
|
Abstract
Visual prostheses including artificial retinal devices are a novel and revolutionary approach to the treatment of profound visual loss. The development of the field of visual prosthesis began with cortical prosthetic devices but since then, a variety of devices which target different sites along the visual pathway have been developed with the retinal prosthesis being the most advanced. We present a review of the history of these devices, an update on the current state of play and future prospects of this field.
Collapse
Affiliation(s)
- Jong Min Ong
- National Institute of Health Research, Biomedical Research Centre, Moorfields Eye Hospital, London, UK.
| | | |
Collapse
|
47
|
Guo H, Wang Y, Yang Y, Tong S, Zhu Y, Qiu Y. Object recognition under distorted prosthetic vision. Artif Organs 2011; 34:846-56. [PMID: 20545671 DOI: 10.1111/j.1525-1594.2009.00976.x] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
Psychophysical studies have reported the efficacy of phosphene-based prosthetic vision in partly recovering the visual function of blind individuals. However, results by far have been based on evenly aligned phosphene arrays, which neglected the complicated visuotopy in the visual prosthesis system. In this study, we investigated how the objects were recognized under the stimuli with distorted phosphene arrays simulated by transformations of barrel distortion, rotation, or translation. The results revealed that distortions significantly decreased the accuracy of categorization (CA) and showed distinct interactive effects with the factors of object category and phosphene array density. Moreover, the CA changed differently with the increase of distortion levels. Regression analysis suggested a phosphene array of at least 10 × 10 be the essential for achieving a CA over the threshold value (CA(t)=62.5%) under distorted prosthetic vision. It is recommended that discriminative features be extracted to improve the performance of prosthetic vision.
Collapse
Affiliation(s)
- Hong Guo
- Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | | | | | | | | | | |
Collapse
|
48
|
|
49
|
van Rheede JJ, Kennard C, Hicks SL. Simulating prosthetic vision: Optimizing the information content of a limited visual display. J Vis 2010; 10:10.14.32. [PMID: 21191130 DOI: 10.1167/10.14.32] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Visual prostheses for the restoration of functional vision are currently under development. To guide prosthesis research and allow for an accurate prognosis of functional gain, simulating the experience of a retinal prosthesis in healthy individuals is desirable. Current simulation paradigms lack crucial aspects of the prosthetic experience such as realistic head- and eye-position-dependent image presentation. We developed a simulation paradigm that used a head-mounted camera and eye tracker to lock the simulation to the point of fixation. We evaluated visual acuity, object recognition and manipulation, and wayfinding under simulated prosthetic vision. We explored three ways of optimizing the information content of the prosthetic visual image: Full-Field representation (wide visual angle, low sampling frequency), Region of Interest (ROI; narrow visible angle, high sampling frequency), and Fisheye (high sampling frequency in the center, progressively lower resolution toward the edges). Full-Field representation facilitated visual search and navigation, whereas ROI improved visual acuity. The Fisheye representation, designed to incorporate the benefits of both Full-Field representation and ROI, performed similarly to ROI with subjects unable to capitalize on the peripheral data. The observation that different image representation conditions prove advantageous for different tasks should be taken into account in the process of designing and testing new visual prosthesis prototypes.
Collapse
|
50
|
Dai C, Lu M, Zhao Y, Lu Y, Zhou C, Chen Y, Ren Q, Chai X. Correction for Chinese character patterns formed by simulated irregular phosphene map. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2010; 2010:5887-90. [PMID: 21096931 DOI: 10.1109/iembs.2010.5627528] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
To reduce the unfavorable influence of phosphene array irregularity on the form of Chinese character pattern so as to improve recognition accuracy in visual prostheses, two correction methods were put forward. One method was to generate phosphene closest to the target point in regular arrays using weighted nearest neighbor search. The other was to generate phosphene whose center located in the region covered by dilated characters. Based on a simulation system, Chinese character recognition tests were given to fifteen normally sighted subjects under five degrees of array irregularity (0.2, 0.4, 0.6, 0.8, 1.0) without correction. The recognition accuracy decreased with the increase of irregularity. When the recognition accuracy dropped below 80%, two correction methods were applied and their effects were evaluated. With the increase of array irregularity, both effects on the accuracy of recognition grew considerably. Comparison between the two methods revealed that the former method afforded higher recognition accuracy and the latter only applied to phosphene map with serious irregularity.
Collapse
Affiliation(s)
- Cong Dai
- Department of Biomedical Engineering, School of Life Sciences & Biotechnology, Shanghai Jiao Tong University, 200240, China
| | | | | | | | | | | | | | | |
Collapse
|