1
|
Valle G, Alamri AH, Downey JE, Lienkämper R, Jordan PM, Sobinov AR, Endsley LJ, Prasad D, Boninger ML, Collinger JL, Warnke PC, Hatsopoulos NG, Miller LE, Gaunt RA, Greenspon CM, Bensmaia SJ. Tactile edges and motion via patterned microstimulation of the human somatosensory cortex. Science 2025; 387:315-322. [PMID: 39818881 DOI: 10.1126/science.adq5978] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2024] [Accepted: 11/01/2024] [Indexed: 01/19/2025]
Abstract
Intracortical microstimulation (ICMS) of somatosensory cortex evokes tactile sensations whose properties can be systematically manipulated by varying stimulation parameters. However, ICMS currently provides an imperfect sense of touch, limiting manual dexterity and tactile experience. Leveraging our understanding of how tactile features are encoded in the primary somatosensory cortex (S1), we sought to inform individuals with paralysis about local geometry and apparent motion of objects on their skin. We simultaneously delivered ICMS through electrodes with spatially patterned projected fields (PFs), evoking sensations of edges. We then created complex PFs that encode arbitrary tactile shapes and skin indentation patterns. By delivering spatiotemporally patterned ICMS, we evoked sensation of motion across the skin, the speed and direction of which could be controlled. Thus, we improved individuals' tactile experience and use of brain-controlled bionic hands.
Collapse
Affiliation(s)
- Giacomo Valle
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL, USA
- Department of Electrical Engineering, Chalmers University of Technology, Goteborg, Sweden
| | - Ali H Alamri
- Committee on Computational Neuroscience, University of Chicago, Chicago, IL, USA
| | - John E Downey
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL, USA
| | - Robin Lienkämper
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA
| | - Patrick M Jordan
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL, USA
| | - Anton R Sobinov
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL, USA
| | - Linnea J Endsley
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL, USA
| | - Dillan Prasad
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL, USA
| | - Michael L Boninger
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Jennifer L Collinger
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Peter C Warnke
- Department of Neurological Surgery, University of Chicago, Chicago, IL, USA
| | - Nicholas G Hatsopoulos
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL, USA
- Committee on Computational Neuroscience, University of Chicago, Chicago, IL, USA
- Neuroscience Institute, University of Chicago, Chicago, IL, USA
| | - Lee E Miller
- Department of Neuroscience, Northwestern University, Chicago, IL, USA
- Department of Biomedical Engineering, Northwestern University, Evanston, IL, USA
- Department of Physical Medicine and Rehabilitation, Northwestern University, Chicago, IL, USA
- Shirley Ryan Ability Lab, Chicago, IL, USA
| | - Robert A Gaunt
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Charles M Greenspon
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL, USA
| | - Sliman J Bensmaia
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL, USA
- Committee on Computational Neuroscience, University of Chicago, Chicago, IL, USA
- Neuroscience Institute, University of Chicago, Chicago, IL, USA
| |
Collapse
|
2
|
Ienca M, Valle G, Raspopovic S. Clinical trials for implantable neural prostheses: understanding the ethical and technical requirements. Lancet Digit Health 2025:S2589-7500(24)00222-X. [PMID: 39794174 DOI: 10.1016/s2589-7500(24)00222-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2023] [Revised: 08/17/2024] [Accepted: 10/09/2024] [Indexed: 01/13/2025]
Abstract
Neuroprosthetics research has entered a stage in which animal models and proof-of-concept studies are translated into clinical applications, often combining implants with artificial intelligence techniques. This new phase raises the question of how clinical trials should be designed to scientifically and ethically address the unique features of neural prostheses. Neural prostheses are complex cyberbiological devices able to acquire and process data; hence, their assessment is not reducible to only third-party safety and efficacy evaluations as in pharmacological research. In addition, assessment of neural prostheses requires a causal understanding of their mechanisms, and scrutiny of their information security and legal liability standards. Some neural prostheses affect not only human behaviour, but also psychological faculties such as consciousness, cognition, and affective states. In this Viewpoint, we argue that the technological novelty of neural prostheses could generate challenges for technology assessment, clinical validation, and research ethics oversight. To this end, we identify a set of methodological and research ethics challenges specific to this medical technology innovation. We provide insights into relevant ethical guidelines and assess whether oversight mechanisms are well equipped to ensure adequate clinical and ethical use. Finally, we outline patient-centred research ethics requirements for clinical trials involving implantable neural prostheses.
Collapse
Affiliation(s)
- Marcello Ienca
- Laboratory of Ethics of Artificial Intelligence and Neuroscience, Institute for Ethics and History of Medicine, School of Medicine, Techniche Universität München, Munich, Germany; College of Humanities, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Giacomo Valle
- Laboratory for Neuroengineering, Department of Health Science and Technology, Institute for Robotics and Intelligent Systems, ETH Zürich, Zürich, Switzerland; Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL, USA; Department of Electrical Engineering, Chalmers University of Technology, Gothenburg, Sweden
| | - Stanisa Raspopovic
- Laboratory for Neuroengineering, Department of Health Science and Technology, Institute for Robotics and Intelligent Systems, ETH Zürich, Zürich, Switzerland; NeuroEngineering Laboratory, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria.
| |
Collapse
|
3
|
Gozzi N, Chee L, Odermatt I, Kikkert S, Preatoni G, Valle G, Pfender N, Beuschlein F, Wenderoth N, Zipser C, Raspopovic S. Wearable non-invasive neuroprosthesis for targeted sensory restoration in neuropathy. Nat Commun 2024; 15:10840. [PMID: 39738088 DOI: 10.1038/s41467-024-55152-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2024] [Accepted: 11/27/2024] [Indexed: 01/01/2025] Open
Abstract
Peripheral neuropathy (PN), the most common complication of diabetes, leads to sensory loss and associated health issues as pain and increased fall risk. However, present treatments do not counteract sensory loss, but only partially manage its consequences. Electrical neural stimulation holds promise to restore sensations, but its efficacy and benefits in PN damaged nerves are yet unknown. We designed a wearable sensory neuroprosthesis (NeuroStep) providing targeted neurostimulation of the undamaged nerve portion and assessed its functionality in 14 PN participants. Our system partially restored lost sensations in all participants through a purposely calibrated neurostimulation, despite PN nerves being less sensitive than healthy nerves (N = 22). Participants improved cadence and functional gait and reported a decrease of neuropathic pain after one day. Restored sensations activated cortical patterns resembling naturally located foot sensations. NeuroStep restores real-time intuitive sensations in PN participants, holding potential to enhance functional and health outcomes while advancing effective non-invasive neuromodulation.
Collapse
Affiliation(s)
- Noemi Gozzi
- Neuroengineering Laboratory, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
| | - Lauren Chee
- Neuroengineering Laboratory, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
| | - Ingrid Odermatt
- Neural Control of Movement Lab, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
- Neuroscience Center Zurich (ZNZ), University of Zurich and ETH Zurich, Zurich, Switzerland
| | - Sanne Kikkert
- Neural Control of Movement Lab, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
- Neuroscience Center Zurich (ZNZ), University of Zurich and ETH Zurich, Zurich, Switzerland
| | - Greta Preatoni
- Neuroengineering Laboratory, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
| | - Giacomo Valle
- Neuroengineering Laboratory, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
| | - Nikolai Pfender
- Department of Neurology and Neurophysiology, Balgrist University Hospital, Zurich, Switzerland
| | - Felix Beuschlein
- Department of Endocrinology, Diabetology and Clinical Nutrition, University Hospital Zurich (USZ) and University of Zurich (UZH), Zurich, Switzerland
- Medizinische Klinik und Poliklinik IV, Klinikum der Universität, Ludwig-Maximilians-Universität, Munich, Germany
- The LOOP Zurich - Medical Research Center, Zurich, Switzerland
| | - Nicole Wenderoth
- Neural Control of Movement Lab, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
- Neuroscience Center Zurich (ZNZ), University of Zurich and ETH Zurich, Zurich, Switzerland
- Future Health Technologies, Singapore-ETH Centre, Campus for Research Excellence and Technological Enterprise (CREATE), Singapore, Singapore
| | - Carl Zipser
- Department of Neurology and Neurophysiology, Balgrist University Hospital, Zurich, Switzerland
- Spinal Cord Injury Center, Balgrist University Hospital, University of Zurich, Zurich, Switzerland
| | - Stanisa Raspopovic
- Neuroengineering Laboratory, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland.
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria.
| |
Collapse
|
4
|
Lee JH, Kim YN, Lee J, Jeon J, Bae JY, Lee JY, Kim KS, Chae M, Park H, Kim JH, Lee KS, Kim J, Hyun JK, Kang D, Kang SK. Hypersensitive meta-crack strain sensor for real-time biomedical monitoring. SCIENCE ADVANCES 2024; 10:eads9258. [PMID: 39705343 DOI: 10.1126/sciadv.ads9258] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/04/2024] [Accepted: 11/15/2024] [Indexed: 12/22/2024]
Abstract
Real-time monitoring of infinitesimal deformations on complex morphologies is essential for precision biomechanical engineering. While flexible strain sensors facilitate real-time monitoring with shape-adaptive properties, their sensitivity is generally lower than spectroscopic imaging methods. Crack-based strain sensors achieve enhanced sensitivity with gauge factors (GFs) exceeding 30,000; however, such GFs are only attainable at large strains exceeding several percent and decline below 10 for strains under 10-3, rendering them inadequate for minute deformations. Here, we introduce hypersensitive and flexible "meta-crack" sensors detecting infinitesimal strains through previously undiscovered crack-opening mechanisms. These sensors achieve remarkable GFs surpassing 1000 at strains of 10-4 on substrates with a Poisson's ratio of -0.9. The crack orientation-independent gap-widening behavior elucidates the origin of hypersensitivity, corroborated by simplified models and finite element analysis. Additionally, parallel mechanical circuits of meta-cracks effectively address the trade-off between resolution and maximum sensing threshold. In vivo real-time monitoring of cerebrovascular dynamics with a strain resolution of 10-5 underscores the hypersensitivity and conformal adaptability of sensors.
Collapse
Affiliation(s)
- Jae-Hwan Lee
- Department of Materials Science and Engineering, Seoul National University, Seoul 08826, Republic of Korea
| | - Yoon-Nam Kim
- Department of Materials Science and Engineering, Seoul National University, Seoul 08826, Republic of Korea
| | - Junsang Lee
- Weldon School of Biomedical Engineering, Purdue University, West Lafayette, IN 47907, USA
| | - Jooik Jeon
- Department of Nanobiomedical Science and BK21 NBM Global Research Center for Regenerative Medicine, Dankook University, Cheonan 31116, Republic of Korea
| | - Jae-Young Bae
- Department of Materials Science and Engineering, Seoul National University, Seoul 08826, Republic of Korea
| | - Ju-Yong Lee
- Department of Materials Science and Engineering, Seoul National University, Seoul 08826, Republic of Korea
| | - Kyung-Sub Kim
- Department of Materials Science and Engineering, Seoul National University, Seoul 08826, Republic of Korea
| | - Minseong Chae
- Department of Materials Science and Engineering, Seoul National University, Seoul 08826, Republic of Korea
- Biomedical Engineering Research Center, Asan Medical Center, Seoul 05505, Republic of Korea
| | - Hyunjun Park
- Department of Chemical Engineering, Kwangwoon University, Seoul 01897, Republic of Korea
| | - Jong-Hyoung Kim
- Department of Materials Science and Engineering, Pukyong National University, Busan 48513, Republic of Korea
| | - Kang-Sik Lee
- Biomedical Engineering Research Center, Asan Medical Center, Seoul 05505, Republic of Korea
| | - Jeonghyun Kim
- Department of Electronic Convergence Engineering, Kwangwoon University, Seoul 01897, Republic of Korea
| | - Jung Keun Hyun
- Department of Nanobiomedical Science and BK21 NBM Global Research Center for Regenerative Medicine, Dankook University, Cheonan 31116, Republic of Korea
- Department of Rehabilitation Medicine, College of Medicine, Dankook University, Cheonan 31116, Republic of Korea
- Institute of Tissue Regeneration Engineering (ITREN), Dankook University, Cheonan 31116, Republic of Korea
| | - Daeshik Kang
- Department of Mechanical Engineering, Ajou University, Suwon 16499, Republic of Korea
| | - Seung-Kyun Kang
- Department of Materials Science and Engineering, Seoul National University, Seoul 08826, Republic of Korea
- Research Institute of Advanced Materials (RIAM), Seoul National University, Seoul 08826, Republic of Korea
- Nano Systems Institute SOFT Foundry, Seoul National University, Seoul 08826, Republic of Korea
| |
Collapse
|
5
|
Nisky I, Makin TR. A neurocognitive pathway for engineering artificial touch. SCIENCE ADVANCES 2024; 10:eadq6290. [PMID: 39693427 PMCID: PMC11654688 DOI: 10.1126/sciadv.adq6290] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/24/2024] [Accepted: 11/14/2024] [Indexed: 12/20/2024]
Abstract
Artificial haptics has the potential to revolutionize the way we integrate physical and virtual technologies in our daily lives, with implications for teleoperation, motor skill acquisition, rehabilitation, gaming, interpersonal communication, and beyond. Here, we delve into the intricate interplay between the somatosensory system and engineered haptic inputs for perception and action. We critically examine the sensory feedback's fidelity and the cognitive demands of interfacing with these systems. We examine how artificial touch interfaces could be redesigned to better align with human sensory, motor, and cognitive systems, emphasizing the dynamic and context-dependent nature of sensory integration. We consider the various learning processes involved in adapting to artificial haptics, highlighting the need for interfaces that support both explicit and implicit learning mechanisms. We emphasize the need for technologies that are not only physiologically biomimetic but also behaviorally and cognitively congruent with the user, affording a range of alternative solutions to users' needs.
Collapse
Affiliation(s)
- Ilana Nisky
- Department of Biomedical Engineering, Ben-Gurion University of the Negev, Beer Sheva, Israel
- The School of Brain Sciences and Cognition, Ben-Gurion University of the Negev, Israel
| | - Tamar R. Makin
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK
| |
Collapse
|
6
|
Bonnechère B. Animals as Architects: Building the Future of Technology-Supported Rehabilitation with Biomimetic Principles. Biomimetics (Basel) 2024; 9:723. [PMID: 39727727 DOI: 10.3390/biomimetics9120723] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2024] [Revised: 11/19/2024] [Accepted: 11/20/2024] [Indexed: 12/28/2024] Open
Abstract
Rehabilitation science has evolved significantly with the integration of technology-supported interventions, offering objective assessments, personalized programs, and real-time feedback for patients. Despite these advances, challenges remain in fully addressing the complexities of human recovery through the rehabilitation process. Over the last few years, there has been a growing interest in the application of biomimetics to inspire technological innovation. This review explores the application of biomimetic principles in rehabilitation technologies, focusing on the use of animal models to help the design of assistive devices such as robotic exoskeletons, prosthetics, and wearable sensors. Animal locomotion studies have, for example, inspired energy-efficient exoskeletons that mimic natural gait, while insights from neural plasticity research in species like zebrafish and axolotls are advancing regenerative medicine and rehabilitation techniques. Sensory systems in animals, such as the lateral line in fish, have also led to the development of wearable sensors that provide real-time feedback for motor learning. By integrating biomimetic approaches, rehabilitation technologies can better adapt to patient needs, ultimately improving functional outcomes. As the field advances, challenges related to translating animal research to human applications, ethical considerations, and technical barriers must be addressed to unlock the full potential of biomimetic rehabilitation.
Collapse
Affiliation(s)
- Bruno Bonnechère
- REVAL Rehabilitation Research Center, Faculty of Rehabilitation Sciences, Hasselt University, 3590 Diepenbeek, Belgium
- Technology-Supported and Data-Driven Rehabilitation, Data Sciences Institute, Hasselt University, 3590 Diepenbeek, Belgium
- Department of PXL-Healthcare, PXL University of Applied Sciences and Arts, 3500 Hasselt, Belgium
| |
Collapse
|
7
|
Lee AH, Lee J, Leung V, Larson L, Nurmikko A. Patterned electrical brain stimulation by a wireless network of implantable microdevices. Nat Commun 2024; 15:10093. [PMID: 39572612 PMCID: PMC11582589 DOI: 10.1038/s41467-024-54542-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2024] [Accepted: 11/12/2024] [Indexed: 11/24/2024] Open
Abstract
Transmitting meaningful information into brain circuits by electronic means is a challenge facing brain-computer interfaces. A key goal is to find an approach to inject spatially structured local current stimuli across swaths of sensory areas of the cortex. Here, we introduce a wireless approach to multipoint patterned electrical microstimulation by a spatially distributed epicortically implanted network of silicon microchips to target specific areas of the cortex. Each sub-millimeter-sized microchip harvests energy from an external radio-frequency source and converts this into biphasic current injected focally into tissue by a pair of integrated microwires. The amplitude, period, and repetition rate of injected current from each chip are controlled across the implant network by implementing a pre-scheduled, collision-free bitmap wireless communication protocol featuring sub-millisecond latency. As a proof-of-concept technology demonstration, a network of 30 wireless stimulators was chronically implanted into motor and sensory areas of the cortex in a freely moving rat for three months. We explored the effects of patterned intracortical electrical stimulation on trained animal behavior at average RF powers well below regulatory safety limits.
Collapse
Affiliation(s)
- Ah-Hyoung Lee
- School of Engineering, Brown University, Providence, RI, USA
| | - Jihun Lee
- School of Engineering, Brown University, Providence, RI, USA
| | - Vincent Leung
- Electrical and Computer Engineering, Baylor University, Waco, TX, USA
| | - Lawrence Larson
- School of Engineering, Brown University, Providence, RI, USA
| | - Arto Nurmikko
- School of Engineering, Brown University, Providence, RI, USA.
- Carney Institute for Brain Science, Brown University, Providence, RI, USA.
| |
Collapse
|
8
|
Graczyk E, Hutchison B, Valle G, Bjanes D, Gates D, Raspopovic S, Gaunt R. Clinical Applications and Future Translation of Somatosensory Neuroprostheses. J Neurosci 2024; 44:e1237242024. [PMID: 39358021 PMCID: PMC11450537 DOI: 10.1523/jneurosci.1237-24.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2024] [Revised: 07/28/2024] [Accepted: 07/29/2024] [Indexed: 10/04/2024] Open
Abstract
Somatosensory neuroprostheses restore, replace, or enhance tactile and proprioceptive feedback for people with sensory impairments due to neurological disorders or injury. Somatosensory neuroprostheses typically couple sensor inputs from a wearable device, prosthesis, robotic device, or virtual reality system with electrical stimulation applied to the somatosensory nervous system via noninvasive or implanted interfaces. While prior research has mainly focused on technology development and proof-of-concept studies, recent acceleration of clinical studies in this area demonstrates the translational potential of somatosensory neuroprosthetic systems. In this review, we provide an overview of neurostimulation approaches currently undergoing human testing and summarize recent clinical findings on the perceptual, functional, and psychological impact of somatosensory neuroprostheses. We also cover current work toward the development of advanced stimulation paradigms to produce more natural and informative sensory feedback. Finally, we provide our perspective on the remaining challenges that need to be addressed prior to translation of somatosensory neuroprostheses.
Collapse
Affiliation(s)
- Emily Graczyk
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, Ohio 44106
- Louis Stokes Cleveland Department of Veterans Affairs Medical Center, Cleveland, Ohio 44106
| | - Brianna Hutchison
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, Ohio 44106
| | - Giacomo Valle
- Department of Electrical Engineering, Chalmers University of Technology, Goteborg 41296, Sweden
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, Illinois 60637
| | - David Bjanes
- Division of Biology and Biological Engineering and Tianqiao & Chrissy Chen Brain-Machine Interface Center, California Institute of Technology, Pasadena, California 91125
| | - Deanna Gates
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, Michigan 48109
- School of Kinesiology, University of Michigan, Ann Arbor, Michigan 48109
| | - Stanisa Raspopovic
- Laboratory for Neuroengineering, Department of Health Sciences and Technology, Institute for Robotics and Intelligent Systems, ETH Zurich, Zurich 8092, Switzerland
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna 1090, Austria
| | - Robert Gaunt
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, Pennsylvania 15219
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, Pennsylvania 15213
| |
Collapse
|
9
|
Ding K, Rakhshan M, Paredes-Acuña N, Cheng G, Thakor NV. Sensory integration for neuroprostheses: from functional benefits to neural correlates. Med Biol Eng Comput 2024; 62:2939-2960. [PMID: 38760597 DOI: 10.1007/s11517-024-03118-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Accepted: 04/19/2024] [Indexed: 05/19/2024]
Abstract
In the field of sensory neuroprostheses, one ultimate goal is for individuals to perceive artificial somatosensory information and use the prosthesis with high complexity that resembles an intact system. To this end, research has shown that stimulation-elicited somatosensory information improves prosthesis perception and task performance. While studies strive to achieve sensory integration, a crucial phenomenon that entails naturalistic interaction with the environment, this topic has not been commensurately reviewed. Therefore, here we present a perspective for understanding sensory integration in neuroprostheses. First, we review the engineering aspects and functional outcomes in sensory neuroprosthesis studies. In this context, we summarize studies that have suggested sensory integration. We focus on how they have used stimulation-elicited percepts to maximize and improve the reliability of somatosensory information. Next, we review studies that have suggested multisensory integration. These works have demonstrated that congruent and simultaneous multisensory inputs provided cognitive benefits such that an individual experiences a greater sense of authority over prosthesis movements (i.e., agency) and perceives the prosthesis as part of their own (i.e., ownership). Thereafter, we present the theoretical and neuroscience framework of sensory integration. We investigate how behavioral models and neural recordings have been applied in the context of sensory integration. Sensory integration models developed from intact-limb individuals have led the way to sensory neuroprosthesis studies to demonstrate multisensory integration. Neural recordings have been used to show how multisensory inputs are processed across cortical areas. Lastly, we discuss some ongoing research and challenges in achieving and understanding sensory integration in sensory neuroprostheses. Resolving these challenges would help to develop future strategies to improve the sensory feedback of a neuroprosthetic system.
Collapse
Affiliation(s)
- Keqin Ding
- Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MD, 21205, USA.
| | - Mohsen Rakhshan
- Department of Electrical and Computer Engineering, University of Central Florida, Orlando, FL, 32816, USA
- Disability, Aging, and Technology Cluster, University of Central Florida, Orlando, FL, 32816, USA
| | - Natalia Paredes-Acuña
- Institute for Cognitive Systems, School of Computation, Information and Technology, Technical University of Munich, 80333, Munich, Germany
| | - Gordon Cheng
- Institute for Cognitive Systems, School of Computation, Information and Technology, Technical University of Munich, 80333, Munich, Germany
| | - Nitish V Thakor
- Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MD, 21205, USA
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, 21205, USA
| |
Collapse
|
10
|
Cimolato A, Raspopovic S. Closing the sensory feedback loop is necessary for effective neurorehabilitation. PLoS Biol 2024; 22:e3002866. [PMID: 39471129 PMCID: PMC11521242 DOI: 10.1371/journal.pbio.3002866] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/01/2024] Open
Abstract
Recent advances in neurotechnology enable somatosensory feedback restoration in disabled individuals. This Perspective discusses how closing the sensory feedback loop with brain implants and nerve electrodes for stimulation may improve rehabilitation and assistive systems for patients.
Collapse
Affiliation(s)
- Andrea Cimolato
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Stanisa Raspopovic
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| |
Collapse
|
11
|
Micera S, Menciassi A, Cianferotti L, Gruppioni E, Lionetti V. Organ Neuroprosthetics: Connecting Transplanted and Artificial Organs with the Nervous System. Adv Healthc Mater 2024; 13:e2302896. [PMID: 38656615 DOI: 10.1002/adhm.202302896] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Revised: 04/01/2024] [Indexed: 04/26/2024]
Abstract
Implantable neural interfaces with the central and peripheral nervous systems are currently used to restore sensory, motor, and cognitive functions in disabled people with very promising results. They have also been used to modulate autonomic activities to treat diseases such as diabetes or hypertension. Here, this study proposes to extend the use of these technologies to (re-)establish the connection between new (transplanted or artificial) organs and the nervous system in order to increase the long-term efficacy and the effective biointegration of these solutions. In this perspective paper, some clinically relevant applications of this approach are briefly described. Then, the choices that neural engineers must implement about the type, implantation location, and closed-loop control algorithms to successfully realize this approach are highlighted. It is believed that these new "organ neuroprostheses" are going to become more and more valuable and very effective solutions in the years to come.
Collapse
Affiliation(s)
- Silvestro Micera
- The BioRobotics Institute and Department of Excellence in Robotics and AI, Scuola Superiore Sant'Anna, Pisa, 56127, Italy
- Interdisciplinary Research Center Health Science, Scuola Superiore Sant'Anna, Pisa, 56127, Italy
- Bertarelli Foundation Chair in Translational Neuroengineering, Neuro-X Institute, School of Engineering, Ecole Polytechnique Federale de Lausanne (EPFL), Lausanne, 1015, Switzerland
| | - Arianna Menciassi
- The BioRobotics Institute and Department of Excellence in Robotics and AI, Scuola Superiore Sant'Anna, Pisa, 56127, Italy
- Interdisciplinary Research Center Health Science, Scuola Superiore Sant'Anna, Pisa, 56127, Italy
| | - Luisella Cianferotti
- Department of Experimental and Clinical Biomedical Sciences, University of Florence, Florence, 50121, Italy
| | | | - Vincenzo Lionetti
- Interdisciplinary Research Center Health Science, Scuola Superiore Sant'Anna, Pisa, 56127, Italy
- UOSVD Anesthesia and Resuscitation, Fondazione Toscana G. Monasterio, Pisa, 56127, Italy
| |
Collapse
|
12
|
Meng Y, Cheng G. Human somatosensory systems based on sensor-memory-integrated technology. NANOSCALE 2024; 16:11928-11958. [PMID: 38847091 DOI: 10.1039/d3nr06521a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/28/2024]
Abstract
As a representative artificial neural network (ANN) for incorporating sensing functions and memory functions into one system to achieve highly miniaturized and highly integrated devices or systems, artificial sensory systems (ASSs) can have a far-reaching influence on precise instrumentation, sensing, and automation engineering. Artificial sensory systems have enjoyed considerable progress in recent years, from low degree integrations to highly advanced sophisticated integrations, from single-modal perceptions to multimode-fused perceptions. However, there are issues around the large hardware area, power consumption, and communication bandwidth needed during the processes where multimodal sensing signals are converted into a digital mode before they can be processed by a digital processor. Therefore, deepening the research into sensory integration is of great importance. In this review, we briefly introduce fundamental knowledge about the memristor mechanism, describe some representative human somatosensory systems, and elucidate the relationship between the properties of memristor devices and the structure. The electronic character of the sensors, future prospects, and key challenges surrounding sensor-memory integrated technologies are also discussed.
Collapse
Affiliation(s)
- Yanfang Meng
- Institute of Intelligent Flexible Mechatronics, School of Mechanical Engineering, Jiangsu University, Zhenjiang, No. 301 Xuefu Road, Zhenjiang, Jiangsu Province, 212013, China.
| | - Guanggui Cheng
- Institute of Intelligent Flexible Mechatronics, School of Mechanical Engineering, Jiangsu University, Zhenjiang, No. 301 Xuefu Road, Zhenjiang, Jiangsu Province, 212013, China.
| |
Collapse
|
13
|
Barra B, Kumar R, Gopinath C, Mirzakhalili E, Lempka SF, Gaunt RA, Fisher LE. High-frequency amplitude-modulated sinusoidal stimulation induces desynchronized yet controllable neural firing. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.02.14.580219. [PMID: 38405798 PMCID: PMC10888888 DOI: 10.1101/2024.02.14.580219] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/27/2024]
Abstract
Regaining sensory feedback is pivotal for people living with limb amputation. Electrical stimulation of sensory fibers in peripheral nerves has been shown to restore focal percepts in the missing limb. However, conventional rectangular current pulses induce sensations often described as unnatural. This is likely due to the synchronous and periodic nature of activity evoked by these pulses. Here we introduce a fast-oscillating amplitude-modulated sinusoidal (FAMS) stimulation waveform that desynchronizes evoked neural activity. We used a computational model to show that sinusoidal waveforms evoke asynchronous and irregular firing and that firing patterns are frequency dependent. We designed the FAMS waveform to leverage both low- and high-frequency effects and found that membrane non-linearities enhance neuron-specific differences when exposed to FAMS. We implemented this waveform in a feline model of peripheral nerve stimulation and demonstrated that FAMS-evoked activity is more asynchronous than activity evoked by rectangular pulses, while being easily controllable with simple stimulation parameters. These results represent an important step towards biomimetic stimulation strategies useful for clinical applications to restore sensory feedback.
Collapse
Affiliation(s)
- Beatrice Barra
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA
- Neuroscience Institute, New York University Langone Health, New York, USA
| | - Ritesh Kumar
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, USA
| | - Chaitanya Gopinath
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA
| | - Ehsan Mirzakhalili
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA
- Biointerfaces Institute, University of Michigan, Ann Arbor, MI, USA
- Department of Neurosurgery, University of Pennsylvania, Philadelphia, USA
| | - Scott F. Lempka
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA
- Biointerfaces Institute, University of Michigan, Ann Arbor, MI, USA
- Department of Anesthesiology, University of Michigan, Ann Arbor, MI, USA
| | - Robert A. Gaunt
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, USA
- Department of Physical Medicine & Rehabilitation, University of Pittsburgh, Pittsburgh, USA
| | - Lee E Fisher
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, USA
- Department of Physical Medicine & Rehabilitation, University of Pittsburgh, Pittsburgh, USA
| |
Collapse
|