1
|
Schulz A, Knoll T, Jaeger T, Le Harzic R, Stracke F, Wien SL, Olsommer Y, Meiser I, Wagner S, Rammensee M, Kurz O, Klesy S, Sermeus L, Julich-Haertel H, Schweitzer Y, Januschowski K, Velten T, Szurman P. Photovoltaic, wireless wide-field epiretinal prosthesis to treat retinitis pigmentosa. Acta Ophthalmol 2024. [PMID: 38923194 DOI: 10.1111/aos.16733] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Accepted: 06/11/2024] [Indexed: 06/28/2024]
Abstract
PURPOSE To develop and evaluate a photovoltaic, wireless wide-field epiretinal prosthesis for the treatment of retinitis pigmentosa. METHODS A mosaic array of thinned silicon-based photodiodes with integrated thin-film stimulation electrodes was fabricated with a flexible polyimide substrate film to form a film-based miniaturized electronic system with wireless optical power and signal transmission and integrated electrostimulation. Manufactured implants were characterized with respect to their optoelectronic performance and biocompatibility following DIN EN ISO 10993. RESULTS A 14 mm diameter prosthesis containing 1276 pixels with a maximum sensitivity at a near infrared wavelength of 905 nm and maximized stimulation current density 30-50 μm below the electrodes was developed for direct activation of retinal ganglion cells during epiretinal stimulation. Fabricated prostheses demonstrated mucosal tolerance and the preservation of both metabolic activity, proliferation and membrane integrity of human fibroblasts as well as the retinal functions of bovine retinas. Illumination of the prosthesis, which was placed epiretinally on an isolated perfused bovine retina, with infrared light resulted in electrophysiological recordings reminiscent of an a-wave (hyperpolarization) and b-wave (depolarization). CONCLUSIONS A photovoltaic, wireless wide-field epiretinal prosthesis for the treatment of retinitis pigmentosa using near infrared light for signal transmission was designed, manufactured and its biocompatibility and functionality demonstrated in vitro and ex vivo.
Collapse
Affiliation(s)
- André Schulz
- Eye Clinic Sulzbach, Knappschaft Hospital Saar, Sulzbach, Germany
- Klaus Heimann Eye Research Institute, Sulzbach, Germany
| | - Thorsten Knoll
- Fraunhofer Institute for Biomedical Engineering IBMT, Sulzbach, Germany
| | | | - Ronan Le Harzic
- Fraunhofer Institute for Biomedical Engineering IBMT, Sulzbach, Germany
| | - Frank Stracke
- Fraunhofer Institute for Biomedical Engineering IBMT, Sulzbach, Germany
| | - Sascha L Wien
- Fraunhofer Institute for Biomedical Engineering IBMT, Sulzbach, Germany
| | - Yves Olsommer
- Fraunhofer Institute for Biomedical Engineering IBMT, Sulzbach, Germany
| | - Ina Meiser
- Fraunhofer Institute for Biomedical Engineering IBMT, Sulzbach, Germany
| | - Sylvia Wagner
- Fraunhofer Institute for Biomedical Engineering IBMT, Sulzbach, Germany
| | | | | | | | - Loic Sermeus
- Eye Clinic Sulzbach, Knappschaft Hospital Saar, Sulzbach, Germany
| | - Henrike Julich-Haertel
- Eye Clinic Sulzbach, Knappschaft Hospital Saar, Sulzbach, Germany
- Klaus Heimann Eye Research Institute, Sulzbach, Germany
| | | | - Kai Januschowski
- Eye Clinic Sulzbach, Knappschaft Hospital Saar, Sulzbach, Germany
- Klaus Heimann Eye Research Institute, Sulzbach, Germany
| | - Thomas Velten
- Fraunhofer Institute for Biomedical Engineering IBMT, Sulzbach, Germany
| | - Peter Szurman
- Eye Clinic Sulzbach, Knappschaft Hospital Saar, Sulzbach, Germany
- Klaus Heimann Eye Research Institute, Sulzbach, Germany
| |
Collapse
|
2
|
Kelly AR, Glover DJ. Information Transmission through Biotic-Abiotic Interfaces to Restore or Enhance Human Function. ACS APPLIED BIO MATERIALS 2024; 7:3605-3628. [PMID: 38729914 DOI: 10.1021/acsabm.4c00435] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/12/2024]
Abstract
Advancements in reliable information transfer across biotic-abiotic interfaces have enabled the restoration of lost human function. For example, communication between neuronal cells and electrical devices restores the ability to walk to a tetraplegic patient and vision to patients blinded by retinal disease. These impactful medical achievements are aided by tailored biotic-abiotic interfaces that maximize information transfer fidelity by considering the physical properties of the underlying biological and synthetic components. This Review develops a modular framework to define and describe the engineering of biotic and abiotic components as well as the design of interfaces to facilitate biotic-abiotic information transfer using light or electricity. Delineating the properties of the biotic, interface, and abiotic components that enable communication can serve as a guide for future research in this highly interdisciplinary field. Application of synthetic biology to engineer light-sensitive proteins has facilitated the control of neural signaling and the restoration of rudimentary vision after retinal blindness. Electrophysiological methodologies that use brain-computer interfaces and stimulating implants to bypass spinal column injuries have led to the rehabilitation of limb movement and walking ability. Cellular interfacing methodologies and on-chip learning capability have been made possible by organic transistors that mimic the information processing capacity of neurons. The collaboration of molecular biologists, material scientists, and electrical engineers in the emerging field of biotic-abiotic interfacing will lead to the development of prosthetics capable of responding to thought and experiencing touch sensation via direct integration into the human nervous system. Further interdisciplinary research will improve electrical and optical interfacing technologies for the restoration of vision, offering greater visual acuity and potentially color vision in the near future.
Collapse
Affiliation(s)
- Alexander R Kelly
- School of Biotechnology and Biomolecular Sciences, University of New South Wales, Sydney, NSW 2052, Australia
| | - Dominic J Glover
- School of Biotechnology and Biomolecular Sciences, University of New South Wales, Sydney, NSW 2052, Australia
| |
Collapse
|
3
|
Balamur R, Oh JT, Karatum O, Wang Y, Onal A, Kaleli HN, Pehlivan C, Şahin A, Hasanreisoglu M, Konstantatos G, Nizamoglu S. Capacitive and Efficient Near-Infrared Stimulation of Neurons via an Ultrathin AgBiS 2 Nanocrystal Layer. ACS APPLIED MATERIALS & INTERFACES 2024; 16:29610-29620. [PMID: 38807565 DOI: 10.1021/acsami.4c01964] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/30/2024]
Abstract
Colloidal nanocrystals (NCs) exhibit significant potential for photovoltaic bioelectronic interfaces because of their solution processability, tunable energy levels, and inorganic nature, lending them chemical stability. Silver bismuth sulfide (AgBiS2) NCs, free from toxic heavy-metal elements (e.g., Cd, Hg, and Pb), particularly offer an exceptional absorption coefficient exceeding 105 cm-1 in the near-infrared (NIR), surpassing many of their inorganic counterparts. Here, we integrated an ultrathin (24 nm) AgBiS2 NC layer into a water-stable photovoltaic bioelectronic device architecture that showed a high capacitive photocurrent of 2.3 mA·cm-2 in artificial cerebrospinal fluid (aCSF) and ionic charges over 10 μC·cm-2 at a low NIR intensity of 0.5 mW·mm-2. The device without encapsulation showed a halftime of 12.5 years under passive accelerated aging test and did not show any toxicity on neurons. Furthermore, patch-clamp electrophysiology on primary hippocampal neurons under whole-cell configuration revealed that the device elicited neuron firing at intensity levels more than an order of magnitude below the established ocular safety limits. These findings point to the potential of AgBiS2 NCs for photovoltaic retinal prostheses.
Collapse
Affiliation(s)
- Ridvan Balamur
- Department of Electrical and Electronics Engineering, Koç University, Istanbul 34450, Turkey
| | - Jae Taek Oh
- ICFO-Institut de Ciencies Fotoniques, The Barcelona Institute of Science and Technology, Castelldefels, Barcelona 08860, Spain
| | - Onuralp Karatum
- Department of Electrical and Electronics Engineering, Koç University, Istanbul 34450, Turkey
| | - Yongjie Wang
- ICFO-Institut de Ciencies Fotoniques, The Barcelona Institute of Science and Technology, Castelldefels, Barcelona 08860, Spain
| | - Asim Onal
- Department of Biomedical Science and Engineering, Koç University, Istanbul 34450, Turkey
| | - Humeyra Nur Kaleli
- Research Center for Translational Medicine, Koç University, Istanbul 34450, Turkey
| | - Cigdem Pehlivan
- Research Center for Translational Medicine, Koç University, Istanbul 34450, Turkey
| | - Afsun Şahin
- Research Center for Translational Medicine, Koç University, Istanbul 34450, Turkey
| | - Murat Hasanreisoglu
- Research Center for Translational Medicine, Koç University, Istanbul 34450, Turkey
| | - Gerasimos Konstantatos
- ICFO-Institut de Ciencies Fotoniques, The Barcelona Institute of Science and Technology, Castelldefels, Barcelona 08860, Spain
- ICREA - Institució Catalana de Recerca i Estudiats Avançats, Lluis Companys 23, Barcelona 08010, Spain
| | - Sedat Nizamoglu
- Department of Electrical and Electronics Engineering, Koç University, Istanbul 34450, Turkey
| |
Collapse
|
4
|
Romeni S, Toni L, Artoni F, Micera S. Decoding electroencephalographic responses to visual stimuli compatible with electrical stimulation. APL Bioeng 2024; 8:026123. [PMID: 38894958 PMCID: PMC11184972 DOI: 10.1063/5.0195680] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2024] [Accepted: 05/20/2024] [Indexed: 06/21/2024] Open
Abstract
Electrical stimulation of the visual nervous system could improve the quality of life of patients affected by acquired blindness by restoring some visual sensations, but requires careful optimization of stimulation parameters to produce useful perceptions. Neural correlates of elicited perceptions could be used for fast automatic optimization, with electroencephalography as a natural choice as it can be acquired non-invasively. Nonetheless, its low signal-to-noise ratio may hinder discrimination of similar visual patterns, preventing its use in the optimization of electrical stimulation. Our work investigates for the first time the discriminability of the electroencephalographic responses to visual stimuli compatible with electrical stimulation, employing a newly acquired dataset whose stimuli encompass the concurrent variation of several features, while neuroscience research tends to study the neural correlates of single visual features. We then performed above-chance single-trial decoding of multiple features of our newly crafted visual stimuli using relatively simple machine learning algorithms. A decoding scheme employing the information from multiple stimulus presentations was implemented, substantially improving our decoding performance, suggesting that such methods should be used systematically in future applications. The significance of the present work relies in the determination of which visual features can be decoded from electroencephalographic responses to electrical stimulation-compatible stimuli and at which granularity they can be discriminated. Our methods pave the way to using electroencephalographic correlates to optimize electrical stimulation parameters, thus increasing the effectiveness of current visual neuroprostheses.
Collapse
Affiliation(s)
| | | | - Fiorenzo Artoni
- Department of Clinical Neurosciences, Faculty of Medicine, University of Geneva, Geneva, Switzerland
| | | |
Collapse
|
5
|
Balamur R, Eren GO, Kaleli HN, Karatum O, Kaya L, Hasanreisoglu M, Nizamoglu S. A Retina-Inspired Optoelectronic Synapse Using Quantum Dots for Neuromorphic Photostimulation of Neurons. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2024; 11:e2401753. [PMID: 38447181 PMCID: PMC11095222 DOI: 10.1002/advs.202401753] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/19/2024] [Indexed: 03/08/2024]
Abstract
Neuromorphic electronics, inspired by the functions of neurons, have the potential to enable biomimetic communication with cells. Such systems require operation in aqueous environments, generation of sufficient levels of ionic currents for neurostimulation, and plasticity. However, their implementation requires a combination of separate devices, such as sensors, organic synaptic transistors, and stimulation electrodes. Here, a compact neuromorphic synapse that combines photodetection, memory, and neurostimulation functionalities all-in-one is presented. The artificial photoreception is facilitated by a photovoltaic device based on cell-interfacing InP/ZnS quantum dots, which induces photo-faradaic charge-transfer mediated plasticity. The device sends excitatory post-synaptic currents exhibiting paired-pulse facilitation and post-tetanic potentiation to the hippocampal neurons via the biohybrid synapse. The electrophysiological recordings indicate modulation of the probability of action potential firing due to biomimetic temporal summation of excitatory post-synaptic currents. The results pave the way for the development of novel bioinspired neuroprosthetics and soft robotics and highlight the potential of quantum dots for achieving versatile neuromorphic functionality in aqueous environments.
Collapse
Affiliation(s)
- Ridvan Balamur
- Department of Electrical and Electronics EngineeringKoç UniversityIstanbul34450Türkiye
| | - Guncem Ozgun Eren
- Department of Biomedical Science and EngineeringKoç UniversityIstanbul34450Türkiye
| | - Humeyra Nur Kaleli
- Research Center for Translational MedicineKoç UniversityIstanbul34450Türkiye
| | - Onuralp Karatum
- Department of Electrical and Electronics EngineeringKoç UniversityIstanbul34450Türkiye
| | - Lokman Kaya
- Department of Electrical and Electronics EngineeringKoç UniversityIstanbul34450Türkiye
| | - Murat Hasanreisoglu
- Research Center for Translational MedicineKoç UniversityIstanbul34450Türkiye
| | - Sedat Nizamoglu
- Department of Electrical and Electronics EngineeringKoç UniversityIstanbul34450Türkiye
| |
Collapse
|
6
|
Balamur R, Eren GO, Kaleli HN, Karatum O, Kaya L, Hasanreisoglu M, Nizamoglu S. A Retina-Inspired Optoelectronic Synapse Using Quantum Dots for Neuromorphic Photostimulation of Neurons. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2024; 11:e2306097. [PMID: 38514908 PMCID: PMC11132067 DOI: 10.1002/advs.202306097] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/06/2023] [Revised: 01/08/2024] [Indexed: 03/23/2024]
Abstract
Neuromorphic electronics, inspired by the functions of neurons, have the potential to enable biomimetic communication with cells. Such systems require operation in aqueous environments, generation of sufficient levels of ionic currents for neurostimulation, and plasticity. However, their implementation requires a combination of separate devices, such as sensors, organic synaptic transistors, and stimulation electrodes. Here, a compact neuromorphic synapse that combines photodetection, memory, and neurostimulation functionalities all-in-one is presented. The artificial photoreception is facilitated by a photovoltaic device based on cell-interfacing InP/ZnS quantum dots, which induces photo-faradaic charge-transfer mediated plasticity. The device sends excitatory post-synaptic currents exhibiting paired-pulse facilitation and post-tetanic potentiation to the hippocampal neurons via the biohybrid synapse. The electrophysiological recordings indicate modulation of the probability of action potential firing due to biomimetic temporal summation of excitatory post-synaptic currents. These results pave the way for the development of novel bioinspired neuroprosthetics and soft robotics, and highlight the potential of quantum dots for achieving versatile neuromorphic functionality in aqueous environments.
Collapse
Affiliation(s)
- Ridvan Balamur
- Department of Electrical and Electronics EngineeringKoç UniversityIstanbul34450Türkiye
| | - Guncem Ozgun Eren
- Department of Biomedical Science and EngineeringKoç UniversityIstanbul34450Türkiye
| | - Humeyra Nur Kaleli
- Research Center for Translational MedicineKoç UniversityIstanbul34450Türkiye
| | - Onuralp Karatum
- Department of Electrical and Electronics EngineeringKoç UniversityIstanbul34450Türkiye
| | - Lokman Kaya
- Department of Electrical and Electronics EngineeringKoç UniversityIstanbul34450Türkiye
| | - Murat Hasanreisoglu
- Research Center for Translational MedicineKoç UniversityIstanbul34450Türkiye
| | - Sedat Nizamoglu
- Department of Electrical and Electronics EngineeringKoç UniversityIstanbul34450Türkiye
| |
Collapse
|
7
|
Corna A, Cojocaru AE, Bui MT, Werginz P, Zeck G. Avoidance of axonal stimulation with sinusoidal epiretinal stimulation. J Neural Eng 2024; 21:026036. [PMID: 38547529 DOI: 10.1088/1741-2552/ad38de] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Accepted: 03/28/2024] [Indexed: 04/11/2024]
Abstract
Objective.Neuromodulation, particularly electrical stimulation, necessitates high spatial resolution to achieve artificial vision with high acuity. In epiretinal implants, this is hindered by the undesired activation of distal axons. Here, we investigate focal and axonal activation of retinal ganglion cells (RGCs) in epiretinal configuration for different sinusoidal stimulation frequencies.Approach.RGC responses to epiretinal sinusoidal stimulation at frequencies between 40 and 100 Hz were tested inex-vivophotoreceptor degenerated (rd10) isolated retinae. Experiments were conducted using a high-density CMOS-based microelectrode array, which allows to localize RGC cell bodies and axons at high spatial resolution.Main results.We report current and charge density thresholds for focal and distal axon activation at stimulation frequencies of 40, 60, 80, and 100 Hz for an electrode size with an effective area of 0.01 mm2. Activation of distal axons is avoided up to a stimulation amplitude of 0.23µA (corresponding to 17.3µC cm-2) at 40 Hz and up to a stimulation amplitude of 0.28µA (14.8µC cm-2) at 60 Hz. The threshold ratio between focal and axonal activation increases from 1.1 for 100 Hz up to 1.6 for 60 Hz, while at 40 Hz stimulation frequency, almost no axonal responses were detected in the tested intensity range. With the use of synaptic blockers, we demonstrate the underlying direct activation mechanism of the ganglion cells. Finally, using high-resolution electrical imaging and label-free electrophysiological axon tracking, we demonstrate the extent of activation in axon bundles.Significance.Our results can be exploited to define a spatially selective stimulation strategy avoiding axonal activation in future retinal implants, thereby solving one of the major limitations of artificial vision. The results may be extended to other fields of neuroprosthetics to achieve selective focal electrical stimulation.
Collapse
Affiliation(s)
- Andrea Corna
- Institute of Biomedical Electronics, TU Wien, Vienna, Austria
| | | | - Mai Thu Bui
- Institute of Biomedical Electronics, TU Wien, Vienna, Austria
| | - Paul Werginz
- Institute of Biomedical Electronics, TU Wien, Vienna, Austria
| | - Günther Zeck
- Institute of Biomedical Electronics, TU Wien, Vienna, Austria
| |
Collapse
|
8
|
Leong F, Rahmani B, Psaltis D, Moser C, Ghezzi D. An actor-model framework for visual sensory encoding. Nat Commun 2024; 15:808. [PMID: 38280912 PMCID: PMC10821921 DOI: 10.1038/s41467-024-45105-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Accepted: 01/15/2024] [Indexed: 01/29/2024] Open
Abstract
A fundamental challenge in neuroengineering is determining a proper artificial input to a sensory system that yields the desired perception. In neuroprosthetics, this process is known as artificial sensory encoding, and it holds a crucial role in prosthetic devices restoring sensory perception in individuals with disabilities. For example, in visual prostheses, one key aspect of artificial image encoding is to downsample images captured by a camera to a size matching the number of inputs and resolution of the prosthesis. Here, we show that downsampling an image using the inherent computation of the retinal network yields better performance compared to learning-free downsampling methods. We have validated a learning-based approach (actor-model framework) that exploits the signal transformation from photoreceptors to retinal ganglion cells measured in explanted mouse retinas. The actor-model framework generates downsampled images eliciting a neuronal response in-silico and ex-vivo with higher neuronal reliability than the one produced by a learning-free approach. During the learning process, the actor network learns to optimize contrast and the kernel's weights. This methodological approach might guide future artificial image encoding strategies for visual prostheses. Ultimately, this framework could be applicable for encoding strategies in other sensory prostheses such as cochlear or limb.
Collapse
Affiliation(s)
- Franklin Leong
- Medtronic Chair in Neuroengineering, Center for Neuroprosthetics and Institute of Bioengineering, School of Engineering, École Polytechnique Fédérale de Lausanne, Geneva, Switzerland
| | - Babak Rahmani
- Laboratory of Applied Photonics Devices, Institute of Electrical and Micro Engineering, School of Engineering, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
- Microsoft Research, Cambridge, UK
| | - Demetri Psaltis
- Optics Laboratory, Institute of Electrical and Micro Engineering, School of Engineering, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Christophe Moser
- Laboratory of Applied Photonics Devices, Institute of Electrical and Micro Engineering, School of Engineering, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Diego Ghezzi
- Medtronic Chair in Neuroengineering, Center for Neuroprosthetics and Institute of Bioengineering, School of Engineering, École Polytechnique Fédérale de Lausanne, Geneva, Switzerland.
- Ophthalmic and Neural Technologies Laboratory, Department of Ophthalmology, University of Lausanne, Hôpital ophtalmique Jules-Gonin, Fondation Asile des Aveugles, Lausanne, Switzerland.
| |
Collapse
|
9
|
Krishnan A, Deepak CS, Narayan KS. Investigations on artificially extending the spectral range of natural vision. APL Bioeng 2023; 7:046105. [PMID: 37886014 PMCID: PMC10599790 DOI: 10.1063/5.0156463] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2023] [Accepted: 09/26/2023] [Indexed: 10/28/2023] Open
Abstract
Organic semiconductors are being explored as retinal prosthetics with the prime attributes of bio-compatibility and conformability for seamless integration with the retina. These polymer-based artificial photoreceptor films are self-powered with light-induced signal strength sufficient to elicit neuronal firing events. The molecular aspect of these semiconductors provides wide spectral tunability. Here, we present results from a bulk heterostructure semiconductor blend with a wide spectral response range. This combination elicits clear spiking activity from a developing blind-chick embryonic retina in the subretinal configuration in response to white light. The response is largely triggered by the blue-green spectral regime rather than the red-NIR regime for the present polymer semiconductor layer attributes.
Collapse
Affiliation(s)
- Abhijith Krishnan
- Chemistry and Physics of Materials Unit (CPMU), JNCASR, Bangalore, India
| | - C. S. Deepak
- Chemistry and Physics of Materials Unit (CPMU), JNCASR, Bangalore, India
| | | |
Collapse
|
10
|
Granley J, Fauvel T, Chalk M, Beyeler M. Human-in-the-Loop Optimization for Deep Stimulus Encoding in Visual Prostheses. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 2023; 36:79376-79398. [PMID: 38984104 PMCID: PMC11232484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Subscribe] [Scholar Register] [Indexed: 07/11/2024]
Abstract
Neuroprostheses show potential in restoring lost sensory function and enhancing human capabilities, but the sensations produced by current devices often seem unnatural or distorted. Exact placement of implants and differences in individual perception lead to significant variations in stimulus response, making personalized stimulus optimization a key challenge. Bayesian optimization could be used to optimize patient-specific stimulation parameters with limited noisy observations, but is not feasible for high-dimensional stimuli. Alternatively, deep learning models can optimize stimulus encoding strategies, but typically assume perfect knowledge of patient-specific variations. Here we propose a novel, practically feasible approach that overcomes both of these fundamental limitations. First, a deep encoder network is trained to produce optimal stimuli for any individual patient by inverting a forward model mapping electrical stimuli to visual percepts. Second, a preferential Bayesian optimization strategy utilizes this encoder to optimize patient-specific parameters for a new patient, using a minimal number of pairwise comparisons between candidate stimuli. We demonstrate the viability of this approach on a novel, state-of-the-art visual prosthesis model. We show that our approach quickly learns a personalized stimulus encoder, leads to dramatic improvements in the quality of restored vision, and is robust to noisy patient feedback and misspecifications in the underlying forward model. Overall, our results suggest that combining the strengths of deep learning and Bayesian optimization could significantly improve the perceptual experience of patients fitted with visual prostheses and may prove a viable solution for a range of neuroprosthetic technologies.
Collapse
Affiliation(s)
- Jacob Granley
- Department of Computer Science, University of California, Santa Barbara
| | - Tristan Fauvel
- Institut de la Vision, Sorbonne Université, 17 rue Moreau, F-75012 Paris, France, Now with Quinten Health
| | - Matthew Chalk
- Institut de la Vision, Sorbonne Université, 17 rue Moreau, F-75012 Paris, France
| | - Michael Beyeler
- Department of Computer Science, Department of Psychological & Brain Sciences, University of California, Santa Barbara
| |
Collapse
|
11
|
Ramirez KA, Drew-Bear LE, Vega-Garces M, Betancourt-Belandria H, Arevalo JF. An update on visual prosthesis. Int J Retina Vitreous 2023; 9:73. [PMID: 37996905 PMCID: PMC10668475 DOI: 10.1186/s40942-023-00498-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Accepted: 09/17/2023] [Indexed: 11/25/2023] Open
Abstract
PURPOSE To review the available evidence on the different retinal and visual prostheses for patients with retinitis pigmentosa and new implants for other indications including dry age-related macular degeneration. METHODS The PubMed, GoogleScholar, ScienceDirect, and ClinicalTrials databases were the main resources used to conduct the medical literature search. An extensive search was performed to identify relevant articles concerning the worldwide advances in retinal prosthesis, clinical trials, status of devices and potential future directions up to December 2022. RESULTS Thirteen devices were found to be current and were ordered by stimulation location. Six have active clinical trials. Four have been discontinued, including the Alpha IMS, Alpha AMS, IRIS II, and ARGUS II which had FDA and CE mark approval. Future directions will be presented in the review. CONCLUSION This review provides an update of retinal prosthetic devices, both current and discontinued. While some devices have achieved visual perception in animals and/or humans, the main issues impeding the commercialization of these devices include: increased length of time to observe outcomes, difficulties in finding validated meaures for use in studies, unknown long-term effects, lack of funding, and a low amount of patients simultaneously diagnosed with RP lacking other comorbid conditions. The ARGUS II did get FDA and CE mark approval so it was deemed safe and also effective. However, the company became more focused on a visual cortical implant. Future efforts are headed towards more biocompatible, safe, and efficacious devices.
Collapse
Affiliation(s)
- Kailyn A Ramirez
- Rutgers Robert Wood Johnson Medical School, New Brunswick, NJ, 08901, USA
| | - Laura E Drew-Bear
- The Wilmer Eye Institute, Johns Hopkins University School of Medicine, 600 N. Wolfe Street, Maumenee 713, Baltimore, MD, 21287, USA
| | | | | | - J Fernando Arevalo
- The Wilmer Eye Institute, Johns Hopkins University School of Medicine, 600 N. Wolfe Street, Maumenee 713, Baltimore, MD, 21287, USA.
| |
Collapse
|
12
|
Kerschensteiner D. Losing, preserving, and restoring vision from neurodegeneration in the eye. Curr Biol 2023; 33:R1019-R1036. [PMID: 37816323 PMCID: PMC10575673 DOI: 10.1016/j.cub.2023.08.044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/12/2023]
Abstract
The retina is a part of the brain that sits at the back of the eye, looking out onto the world. The first neurons of the retina are the rod and cone photoreceptors, which convert changes in photon flux into electrical signals that are the basis of vision. Rods and cones are frequent targets of heritable neurodegenerative diseases that cause visual impairment, including blindness, in millions of people worldwide. This review summarizes the diverse genetic causes of inherited retinal degenerations (IRDs) and their convergence onto common pathogenic mechanisms of vision loss. Currently, there are few effective treatments for IRDs, but recent advances in disparate areas of biology and technology (e.g., genome editing, viral engineering, 3D organoids, optogenetics, semiconductor arrays) discussed here enable promising efforts to preserve and restore vision in IRD patients with implications for neurodegeneration in less approachable brain areas.
Collapse
Affiliation(s)
- Daniel Kerschensteiner
- Department of Ophthalmology and Visual Sciences, Washington University School of Medicine, St. Louis, MO 63110, USA; Department of Neuroscience, Washington University School of Medicine, St. Louis, MO 63110, USA; Department of Biomedical Engineering, Washington University School of Medicine, St. Louis, MO 63110, USA.
| |
Collapse
|
13
|
Wu KY, Mina M, Sahyoun JY, Kalevar A, Tran SD. Retinal Prostheses: Engineering and Clinical Perspectives for Vision Restoration. SENSORS (BASEL, SWITZERLAND) 2023; 23:5782. [PMID: 37447632 PMCID: PMC10347280 DOI: 10.3390/s23135782] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Revised: 06/04/2023] [Accepted: 06/19/2023] [Indexed: 07/15/2023]
Abstract
A retinal prosthesis, also known as a bionic eye, is a device that can be implanted to partially restore vision in patients with retinal diseases that have resulted in the loss of photoreceptors (e.g., age-related macular degeneration and retinitis pigmentosa). Recently, there have been major breakthroughs in retinal prosthesis technology, with the creation of numerous types of implants, including epiretinal, subretinal, and suprachoroidal sensors. These devices can stimulate the remaining cells in the retina with electric signals to create a visual sensation. A literature review of the pre-clinical and clinical studies published between 2017 and 2023 is conducted. This narrative review delves into the retinal anatomy, physiology, pathology, and principles underlying electronic retinal prostheses. Engineering aspects are explored, including electrode-retina alignment, electrode size and material, charge density, resolution limits, spatial selectivity, and bidirectional closed-loop systems. This article also discusses clinical aspects, focusing on safety, adverse events, visual function, outcomes, and the importance of rehabilitation programs. Moreover, there is ongoing debate over whether implantable retinal devices still offer a promising approach for the treatment of retinal diseases, considering the recent emergence of cell-based and gene-based therapies as well as optogenetics. This review compares retinal prostheses with these alternative therapies, providing a balanced perspective on their advantages and limitations. The recent advancements in retinal prosthesis technology are also outlined, emphasizing progress in engineering and the outlook of retinal prostheses. While acknowledging the challenges and complexities of the technology, this article highlights the significant potential of retinal prostheses for vision restoration in individuals with retinal diseases and calls for continued research and development to refine and enhance their performance, ultimately improving patient outcomes and quality of life.
Collapse
Affiliation(s)
- Kevin Y. Wu
- Department of Surgery, Division of Ophthalmology, University of Sherbrooke, Sherbrooke, QC J1G 2E8, Canada; (K.Y.W.)
| | - Mina Mina
- Department of Mechanical and Manufacturing Engineering, University of Calgary, Calgary, AB T2N 1N4, Canada
| | - Jean-Yves Sahyoun
- Faculty of Medicine, University of Montreal, Montreal, QC H3T 1J4, Canada
| | - Ananda Kalevar
- Department of Surgery, Division of Ophthalmology, University of Sherbrooke, Sherbrooke, QC J1G 2E8, Canada; (K.Y.W.)
| | - Simon D. Tran
- Faculty of Dental Medicine and Oral Health Sciences, McGill University, Montreal, QC H3A 1G1, Canada
| |
Collapse
|
14
|
Zhou M, Young BK, Valle ED, Koo B, Kim J, Weiland JD. Full-field, conformal epiretinal electrode array using hydrogel and polymer hybrid technology. Sci Rep 2023; 13:6973. [PMID: 37117214 PMCID: PMC10147691 DOI: 10.1038/s41598-023-32976-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Accepted: 04/05/2023] [Indexed: 04/30/2023] Open
Abstract
Shape-morphable electrode arrays can form 3D surfaces to conform to complex neural anatomy and provide consistent positioning needed for next-generation neural interfaces. Retinal prostheses need a curved interface to match the spherical eye and a coverage of several cm to restore peripheral vision. We fabricated a full-field array that can (1) cover a visual field of 57° based on electrode position and of 113° based on the substrate size; (2) fold to form a compact shape for implantation; (3) self-deploy into a curvature fitting the eye after implantation. The full-field array consists of multiple polymer layers, specifically, a sandwich structure of elastomer/polyimide-based-electrode/elastomer, coated on one side with hydrogel. Electrodeposition of high-surface-area platinum/iridium alloy significantly improved the electrical properties of the electrodes. Hydrogel over-coating reduced electrode performance, but the electrodes retained better properties than those without platinum/iridium. The full-field array was rolled into a compact shape and, once implanted into ex vivo pig eyes, restored to a 3D curved surface. The full-field retinal array provides significant coverage of the retina while allowing surgical implantation through an incision 33% of the final device diameter. The shape-changing material platform can be used with other neural interfaces that require conformability to complex neuroanatomy.
Collapse
Affiliation(s)
- Muru Zhou
- Macromolecular Science and Engineering Program, University of Michigan, Ann Arbor, 48105, USA
| | - Benjamin K Young
- Department of Ophthalmology, Oregon Health and Sciences University, Portland, OR, 97239, USA
| | - Elena Della Valle
- Biomedical Engineering, University of Michigan, Ann Arbor, 48105, USA
| | - Beomseo Koo
- Biomedical Engineering, University of Michigan, Ann Arbor, 48105, USA
| | - Jinsang Kim
- Macromolecular Science and Engineering Program, University of Michigan, Ann Arbor, 48105, USA
- Biomedical Engineering, University of Michigan, Ann Arbor, 48105, USA
- Chemical Engineering, University of Michigan, Ann Arbor, 48105, USA
- Materials Science and Engineering, University of Michigan, Ann Arbor, 48105, USA
- Chemistry, University of Michigan, Ann Arbor, 48105, USA
- Biointerfaces Institute, University of Michigan, Ann Arbor, 48105, USA
| | - James D Weiland
- Biomedical Engineering, University of Michigan, Ann Arbor, 48105, USA.
- Biointerfaces Institute, University of Michigan, Ann Arbor, 48105, USA.
- Ophthalmology and Visual Sciences, University of Michigan, Ann Arbor, 48105, USA.
| |
Collapse
|
15
|
Ahnood A, Chambers A, Gelmi A, Yong KT, Kavehei O. Semiconducting electrodes for neural interfacing: a review. Chem Soc Rev 2023; 52:1491-1518. [PMID: 36734845 DOI: 10.1039/d2cs00830k] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
In the past 50 years, the advent of electronic technology to directly interface with neural tissue has transformed the fields of medicine and biology. Devices that restore or even replace impaired bodily functions, such as deep brain stimulators and cochlear implants, have ushered in a new treatment era for previously intractable conditions. Meanwhile, electrodes for recording and stimulating neural activity have allowed researchers to unravel the vast complexities of the human nervous system. Recent advances in semiconducting materials have allowed effective interfaces between electrodes and neuronal tissue through novel devices and structures. Often these are unattainable using conventional metallic electrodes. These have translated into advances in research and treatment. The development of semiconducting materials opens new avenues in neural interfacing. This review considers this emerging class of electrodes and how it can facilitate electrical, optical, and chemical sensing and modulation with high spatial and temporal precision. Semiconducting electrodes have advanced electrically based neural interfacing technologies owing to their unique electrochemical and photo-electrochemical attributes. Key operation modalities, namely sensing and stimulation in electrical, biochemical, and optical domains, are discussed, highlighting their contrast to metallic electrodes from the application and characterization perspective.
Collapse
Affiliation(s)
- Arman Ahnood
- School of Engineering, RMIT University, VIC 3000, Australia
| | - Andre Chambers
- School of Physics, University of Melbourne, Melbourne, Victoria 3010, Australia
| | - Amy Gelmi
- School of Science, RMIT University, VIC 3000, Australia
| | - Ken-Tye Yong
- School of Biomedical Engineering, University of Sydney, Sydney, NSW 2006, Australia.,The University of Sydney Nano Institute, Sydney, NSW 2006, Australia.
| | - Omid Kavehei
- School of Biomedical Engineering, University of Sydney, Sydney, NSW 2006, Australia.,The University of Sydney Nano Institute, Sydney, NSW 2006, Australia.
| |
Collapse
|
16
|
Borda E, Medagoda DI, Airaghi Leccardi MJI, Zollinger EG, Ghezzi D. Conformable neural interface based on off-stoichiometry thiol-ene-epoxy thermosets. Biomaterials 2023; 293:121979. [PMID: 36586146 DOI: 10.1016/j.biomaterials.2022.121979] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Revised: 11/29/2022] [Accepted: 12/21/2022] [Indexed: 12/28/2022]
Abstract
Off-stoichiometry thiol-ene-epoxy (OSTE+) thermosets show low permeability to gases and little absorption of dissolved molecules, allow direct low-temperature dry bonding without surface treatments, have a low Young's modulus, and can be manufactured via UV polymerisation. For these reasons, OSTE+ thermosets have recently gained attention for the rapid prototyping of microfluidic chips. Moreover, their compatibility with standard clean-room processes and outstanding mechanical properties make OSTE+ an excellent candidate as a novel material for neural implants. Here we exploit OSTE+ to manufacture a conformable multilayer micro-electrocorticography array with 16 platinum electrodes coated with platinum black. The mechanical properties allow conformability to curved surfaces such as the brain. The low permeability and strong adhesion between layers improve the stability of the device. Acute experiments in mice show the multimodal capacity of the array to record and stimulate the neural tissue by smoothly conforming to the mouse cortex. Devices are not cytotoxic, and immunohistochemistry stainings reveal only modest foreign body reaction after two and six weeks of chronic implantation. This work introduces OSTE+ as a promising material for implantable neural interfaces.
Collapse
Affiliation(s)
- Eleonora Borda
- Medtronic Chair in Neuroengineering, Center for Neuroprosthetics and Institute of Bioengineering, School of Engineering, École Polytechnique Fédérale de Lausanne, Switzerland
| | - Danashi Imani Medagoda
- Medtronic Chair in Neuroengineering, Center for Neuroprosthetics and Institute of Bioengineering, School of Engineering, École Polytechnique Fédérale de Lausanne, Switzerland
| | - Marta Jole Ildelfonsa Airaghi Leccardi
- Medtronic Chair in Neuroengineering, Center for Neuroprosthetics and Institute of Bioengineering, School of Engineering, École Polytechnique Fédérale de Lausanne, Switzerland
| | - Elodie Geneviève Zollinger
- Medtronic Chair in Neuroengineering, Center for Neuroprosthetics and Institute of Bioengineering, School of Engineering, École Polytechnique Fédérale de Lausanne, Switzerland
| | - Diego Ghezzi
- Medtronic Chair in Neuroengineering, Center for Neuroprosthetics and Institute of Bioengineering, School of Engineering, École Polytechnique Fédérale de Lausanne, Switzerland.
| |
Collapse
|
17
|
Cetkovic A, Bellapianta A, Irimia-Vladu M, Hofinger J, Yumusak C, Corna A, Scharber MC, Zeck G, Sariciftci NS, Bolz M, Salti A. In Vitro Cytotoxicity of D18 and Y6 as Potential Organic Photovoltaic Materials for Retinal Prostheses. Int J Mol Sci 2022; 23:8666. [PMID: 35955800 PMCID: PMC9369111 DOI: 10.3390/ijms23158666] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2022] [Revised: 07/31/2022] [Accepted: 08/02/2022] [Indexed: 02/01/2023] Open
Abstract
Millions of people worldwide are diagnosed with retinal dystrophies such as retinitis pigmentosa and age-related macular degeneration. A retinal prosthesis using organic photovoltaic (OPV) semiconductors is a promising therapeutic device to restore vision to patients at the late onset of the disease. However, an appropriate cytotoxicity approach has to be employed on the OPV materials before using them as retinal implants. In this study, we followed ISO standards to assess the cytotoxicity of D18, Y6, PFN-Br and PDIN individually, and as mixtures of D18/Y6, D18/Y6/PFN-Br and D18/Y6/PDIN. These materials were proven for their high performance as organic solar cells. Human RPE cells were put in direct and indirect contact with these materials to analyze their cytotoxicity by the MTT assay, apoptosis by flow cytometry, and measurements of cell morphology and proliferation by immunofluorescence. We also assessed electrophysiological recordings on mouse retinal explants via microelectrode arrays (MEAs) coated with D18/Y6. In contrast to PFN-Br and PDIN, all in vitro experiments show no cytotoxicity of D18 and Y6 alone or as a D18/Y6 mixture. We conclude that D18/Y6 is safe to be subsequently investigated as a retinal prosthesis.
Collapse
Affiliation(s)
- Ana Cetkovic
- Center for Medical Research, University Clinic for Ophthalmology and Optometry, Johannes Kepler University Linz, 4020 Linz, Austria
| | - Alessandro Bellapianta
- Center for Medical Research, University Clinic for Ophthalmology and Optometry, Johannes Kepler University Linz, 4020 Linz, Austria
| | - Mihai Irimia-Vladu
- Linz Institute of Organic Solar Cells (LIOS), Institute of Physical Chemistry, Johannes Kepler University Linz, Altenbergerstrasse 69, 4040 Linz, Austria
| | - Jakob Hofinger
- Linz Institute of Organic Solar Cells (LIOS), Institute of Physical Chemistry, Johannes Kepler University Linz, Altenbergerstrasse 69, 4040 Linz, Austria
| | - Cigdem Yumusak
- Linz Institute of Organic Solar Cells (LIOS), Institute of Physical Chemistry, Johannes Kepler University Linz, Altenbergerstrasse 69, 4040 Linz, Austria
| | - Andrea Corna
- Institute of Biomedical Electronics, Technische Universität (TU) Wien, 1040 Vienna, Austria
| | - Markus Clark Scharber
- Linz Institute of Organic Solar Cells (LIOS), Institute of Physical Chemistry, Johannes Kepler University Linz, Altenbergerstrasse 69, 4040 Linz, Austria
| | - Günther Zeck
- Institute of Biomedical Electronics, Technische Universität (TU) Wien, 1040 Vienna, Austria
| | - Niyazi Serdar Sariciftci
- Linz Institute of Organic Solar Cells (LIOS), Institute of Physical Chemistry, Johannes Kepler University Linz, Altenbergerstrasse 69, 4040 Linz, Austria
| | - Matthias Bolz
- Center for Medical Research, University Clinic for Ophthalmology and Optometry, Johannes Kepler University Linz, 4020 Linz, Austria
| | - Ahmad Salti
- Center for Medical Research, University Clinic for Ophthalmology and Optometry, Johannes Kepler University Linz, 4020 Linz, Austria
| |
Collapse
|