1
|
Ren J, Li J, Chen S, Liu Y, Ta D. Unveiling the potential of ultrasound in brain imaging: Innovations, challenges, and prospects. ULTRASONICS 2025; 145:107465. [PMID: 39305556 DOI: 10.1016/j.ultras.2024.107465] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/25/2024] [Revised: 07/30/2024] [Accepted: 09/08/2024] [Indexed: 11/12/2024]
Abstract
Within medical imaging, ultrasound serves as a crucial tool, particularly in the realms of brain imaging and disease diagnosis. It offers superior safety, speed, and wider applicability compared to Magnetic Resonance Imaging (MRI) and X-ray Computed Tomography (CT). Nonetheless, conventional transcranial ultrasound applications in adult brain imaging face challenges stemming from the significant acoustic impedance contrast between the skull bone and soft tissues. Recent strides in ultrasound technology encompass a spectrum of advancements spanning tissue structural imaging, blood flow imaging, functional imaging, and image enhancement techniques. Structural imaging methods include traditional transcranial ultrasound techniques and ultrasound elastography. Transcranial ultrasound assesses the structure and function of the skull and brain, while ultrasound elastography evaluates the elasticity of brain tissue. Blood flow imaging includes traditional transcranial Doppler (TCD), ultrafast Doppler (UfD), contrast-enhanced ultrasound (CEUS), and ultrasound localization microscopy (ULM), which can be used to evaluate the velocity, direction, and perfusion of cerebral blood flow. Functional ultrasound imaging (fUS) detects changes in cerebral blood flow to create images of brain activity. Image enhancement techniques include full waveform inversion (FWI) and phase aberration correction techniques, focusing on more accurate localization and analysis of brain structures, achieving more precise and reliable brain imaging results. These methods have been extensively studied in clinical animal models, neonates, and adults, showing significant potential in brain tissue structural imaging, cerebral hemodynamics monitoring, and brain disease diagnosis. They represent current hotspots and focal points of ultrasound medical research. This review provides a comprehensive summary of recent developments in brain imaging technologies and methods, discussing their advantages, limitations, and future trends, offering insights into their prospects.
Collapse
Affiliation(s)
- Jiahao Ren
- State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, 92 Weijin Road, Tianjin 300072, China
| | - Jian Li
- State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, 92 Weijin Road, Tianjin 300072, China
| | - Shili Chen
- State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, 92 Weijin Road, Tianjin 300072, China
| | - Yang Liu
- State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, 92 Weijin Road, Tianjin 300072, China; International Institute for Innovative Design and Intelligent Manufacturing of Tianjin University in Zhejiang, Shaoxing 312000, China.
| | - Dean Ta
- School of Information Science and Technology, Fudan University, Shanghai 200433, China.
| |
Collapse
|
2
|
Sitaram R, Sanchez-Corzo A, Vargas G, Cortese A, El-Deredy W, Jackson A, Fetz E. Mechanisms of brain self-regulation: psychological factors, mechanistic models and neural substrates. Philos Trans R Soc Lond B Biol Sci 2024; 379:20230093. [PMID: 39428875 PMCID: PMC11491850 DOI: 10.1098/rstb.2023.0093] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2023] [Revised: 03/22/2024] [Accepted: 06/26/2024] [Indexed: 10/22/2024] Open
Abstract
While neurofeedback represents a promising tool for neuroscience and a brain self-regulation approach to psychological rehabilitation, the field faces several problems and challenges. Current research has shown great variability and even failure among human participants in learning to self-regulate target features of brain activity with neurofeedback. A better understanding of cognitive mechanisms, psychological factors and neural substrates underlying self-regulation might help improve neurofeedback's scientific and clinical practices. This article reviews the current understanding of the neural mechanisms of brain self-regulation by drawing on findings from human and animal studies in neurofeedback, brain-computer/machine interfaces and neuroprosthetics. In this article, we look closer at the following topics: cognitive processes and psychophysiological factors affecting self-regulation, theoretical models and neural substrates underlying self-regulation, and finally, we provide an outlook on the outstanding gaps in knowledge and technical challenges. This article is part of the theme issue 'Neurofeedback: new territories and neurocognitive mechanisms of endogenous neuromodulation'.
Collapse
Affiliation(s)
- Ranganatha Sitaram
- Multimodal Functional Brain Imaging and Neurorehabilitation Hub, Diagnostic Imaging Department, Saint Jude Children’s Research Hospital, 262 Danny Thomas Place Memphis, TN38105, USA
| | - Andrea Sanchez-Corzo
- Multimodal Functional Brain Imaging and Neurorehabilitation Hub, Diagnostic Imaging Department, Saint Jude Children’s Research Hospital, 262 Danny Thomas Place Memphis, TN38105, USA
| | - Gabriela Vargas
- Institute of Biological and Medical Engineering, Pontificia Universidad Católica de Chile, Diagonal Paraguay 362, Santiago de Chile8330074, Chile
| | - Aurelio Cortese
- Department of Decoded Neurofeedback, ATR Computational Neuroscience Laboratories, Kyoto619-0288, Japan
| | - Wael El-Deredy
- Brain Dynamics Lab, Universidad de Valparaíso, Valparaiso, Chile
- ValgrAI: Valencian Graduate School and Research Network of Artificial Intelligence – University of Valencia, Spain, Spain
| | - Andrew Jackson
- Biosciences Institute, Newcastle University, NewcastleNE2 4HH, UK
| | - Eberhard Fetz
- Department of Physiology and Biophysics, Washington National Primate Research Center, University of Washington, Seattle, WA, USA
| |
Collapse
|
3
|
Ruiz S, Valera L, Ramos P, Sitaram R. Neurorights in the Constitution: from neurotechnology to ethics and politics. Philos Trans R Soc Lond B Biol Sci 2024; 379:20230098. [PMID: 39428886 PMCID: PMC11491849 DOI: 10.1098/rstb.2023.0098] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2023] [Revised: 01/16/2024] [Accepted: 01/29/2024] [Indexed: 10/22/2024] Open
Abstract
Neuroimaging technologies such as brain-computer interfaces and neurofeedback have evolved rapidly as new tools for cognitive neuroscience and as potential clinical interventions. However, along with these developments, concern has grown based on the fear of the potential misuse of neurotechnology. In October 2021, Chile became the first country to include neurorights in its Constitution. The present article is divided into two parts. In the first section, we describe the path followed by neurorights that led to its inclusion in the Chilean Constitution, and the neurotechnologies usually involved in neurorights discussions. In the second part, we discuss two potential problems of neurorights. We begin by pointing out some epistemological concerns regarding neurorights, mainly referring to the ambiguity of the concepts used in neurolegislations, the difficult relationship between neuroscience and politics and the weak reasons for urgency in legislating. We then describe the dangers of overprotective laws in medical research, based on the detrimental effect of recent legislation in Chile and the potential risk posed by neurorights to the benefits of neuroscience development. This article aims to engage with the scientific community interested in neurotechnology and neurorights in an interdisciplinary reflection of the potential consequences of neurorights.This article is part of the theme issue 'Neurofeedback: new territories and neurocognitive mechanisms of endogenous neuromodulation'.
Collapse
Affiliation(s)
- Sergio Ruiz
- Psychiatry Department, Interdisciplinary Center for Neurosciences, Medicine School, Pontificia Universidad Católica de Chile, Diagonal Paraguay 362, Santiago de Chile8330074, Chile
- Laboratory for Brain-Machine Interfaces and Neuromodulation, Pontificia Universidad Católica de Chile, Diagonal Paraguay 362, Santiago de Chile8330074, Chile
| | - Luca Valera
- Department of Philosophy, Universidad de Valladolid, Plaza Campus Universitario, Valladolid47011, Spain
- Bioethics Centre, Pontificia Universidad Católica de Chile, Diagonal Paraguay 362, Santiago de Chile8330074, Chile
| | - Paulina Ramos
- Bioethics Centre, Pontificia Universidad Católica de Chile, Diagonal Paraguay 362, Santiago de Chile8330074, Chile
| | - Ranganatha Sitaram
- Psychiatry Department, Interdisciplinary Center for Neurosciences, Medicine School, Pontificia Universidad Católica de Chile, Diagonal Paraguay 362, Santiago de Chile8330074, Chile
- Laboratory for Brain-Machine Interfaces and Neuromodulation, Pontificia Universidad Católica de Chile, Diagonal Paraguay 362, Santiago de Chile8330074, Chile
- Multimodal Functional Brain Imaging and Neurorehabilitation Hub, Diagnostic Imaging Department, St. Jude Children’s Research Hospital, 262, Danny Thomas Place Memphis, TN38105, USA
| |
Collapse
|
4
|
Ninenko I, Medvedeva A, Efimova VL, Kleeva DF, Morozova M, Lebedev MA. Olfactory neurofeedback: current state and possibilities for further development. Front Hum Neurosci 2024; 18:1419552. [PMID: 39677402 PMCID: PMC11638239 DOI: 10.3389/fnhum.2024.1419552] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2024] [Accepted: 10/24/2024] [Indexed: 12/17/2024] Open
Abstract
This perspective considers the novel concept of olfactory neurofeedback (O-NFB) within the framework of brain-computer interfaces (BCIs), where olfactory stimuli are integrated in various BCI control loops. In particular, electroencephalography (EEG)-based O-NFB systems are capable of incorporating different components of complex olfactory processing - from simple discrimination tasks to using olfactory stimuli for rehabilitation of neurological disorders. In our own work, EEG theta and alpha rhythms were probed as control variables for O-NFB. Additionaly, we developed an olfactory-based instructed-delay task. We suggest that the unique functions of olfaction offer numerous medical and consumer applications where O-NFB is combined with sensory inputs of other modalities within a BCI framework to engage brain plasticity. We discuss the ways O-NFB could be implemented, including the integration of different types of olfactory displays in the experiment set-up and EEG features to be utilized. We emphasize the importance of synchronizing O-NFB with respiratory rhythms, which are known to influence EEG patterns and cognitive processing. Overall, we expect that O-NFB systems will contribute to both practical applications in the clinical world and the basic neuroscience of olfaction.
Collapse
Affiliation(s)
- Ivan Ninenko
- Institute for Cognitive Neuroscience, HSE University, Moscow, Russia
- Pedagogy Department, International University of Central Asia, Tokmok, Kyrgyzstan
| | - Alexandra Medvedeva
- V. Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, Moscow, Russia
| | - Victoria L. Efimova
- Developmental Psychology and Family Pedagogic Department, The Herzen State Pedagogical University, Saint Petersburg, Russia
| | - Daria F. Kleeva
- Institute for Cognitive Neuroscience, HSE University, Moscow, Russia
- V. Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, Moscow, Russia
- MSU Institute for Artificial Intelligence, Lomonosov Moscow State University, Moscow, Russia
| | - Marina Morozova
- V. Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, Moscow, Russia
| | - Mikhail A. Lebedev
- Sechenov Institute of Evolutionary Physiology and Biochemistry of the Russian Academy of Sciences, Saint Petersburg, Russia
- Faculty of Mechanics and Mathematics, Lomonosov Moscow State University, Moscow, Russia
| |
Collapse
|
5
|
Soghoyan G, Biktimirov AR, Piliugin NS, Matvienko Y, Kaplan AY, Sintsov MY, Lebedev MA. Restoration of natural somatic sensations to the amputees: finding the right combination of neurostimulation methods. Front Neurosci 2024; 18:1466684. [PMID: 39654645 PMCID: PMC11626906 DOI: 10.3389/fnins.2024.1466684] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2024] [Accepted: 10/18/2024] [Indexed: 12/12/2024] Open
Abstract
Limb amputation results in such devastating consequences as loss of motor and sensory functions and phantom limb pain (PLP). Neurostimulation-based approaches have been developed to treat this condition, which provide artificial somatosensory feedback such as peripheral nerve stimulation (PNS), spinal cord stimulation (SCS), and transcutaneous electrical nerve stimulation (TENS). Yet, the effectiveness of different neurostimulation methods has been rarely tested in the same participants. Meanwhile, such tests would help to select the most effective method or a combination of methods and could contribute to the development of multisensory limb prostheses. In this study, two transhumeral amputees were implanted with stimulating electrodes placed in the medial nerve and over the spinal cord epidurally. PNS and SCS were tested in each participant as approaches to enable tactile and proprioceptive sensations and suppress PLP. Both PNS and SCS induced sensation in different parts of the phantom hand, which correlated with cortical responses detected with electroencephalographic (EEG) recordings. The sensations produced by PNS more often felt natural compared to those produced by SCS. Еvoked response potentials (ERPs) were more lateralized and adapted faster for PNS compared to SCS. In the tasks performed with the bionic hand, neurostimulation-induced sensations enabled discrimination of object size. As the participants practiced with neurostimulation, they improved on the object-size discrimination task and their sensations became more natural. А combination of PNS and TENS enabled sensations that utilized both tactile and proprioceptive information. This combination was effective to convey the perception of object softness. In addition to enabling sensations, neurostimulation led to a decrease in PLP. Clinical trial registration https://clinicaltrials.gov/, identifier, #NCT05650931.
Collapse
Affiliation(s)
- Gurgen Soghoyan
- Vladimir Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, Moscow, Russia
| | - Artur R. Biktimirov
- Laboratory of Experimental and Translational Medicine, School of Biomedicine, Far Eastern Federal University, Vladivostok, Russia
| | - Nikita S. Piliugin
- Vladimir Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, Moscow, Russia
| | | | - Alexander Y. Kaplan
- Vladimir Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, Moscow, Russia
- Faculty of Mechanics and Mathematics, Lomonosov Moscow State University, Moscow, Russia
| | | | - Mikhail A. Lebedev
- Faculty of Mechanics and Mathematics, Lomonosov Moscow State University, Moscow, Russia
- I. M. Sechenov Institute of Evolutionary Physiology and Biochemistry, St. Petersburg, Russia
| |
Collapse
|
6
|
Angulo Medina AS, Aguilar Bonilla MI, Rodríguez Giraldo ID, Montenegro Palacios JF, Cáceres Gutiérrez DA, Liscano Y. Electroencephalography-Based Brain-Computer Interfaces in Rehabilitation: A Bibliometric Analysis (2013-2023). SENSORS (BASEL, SWITZERLAND) 2024; 24:7125. [PMID: 39598903 PMCID: PMC11598414 DOI: 10.3390/s24227125] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/13/2024] [Revised: 09/24/2024] [Accepted: 10/03/2024] [Indexed: 11/29/2024]
Abstract
EEG-based Brain-Computer Interfaces (BCIs) have gained significant attention in rehabilitation due to their non-invasive, accessible ability to capture brain activity and restore neurological functions in patients with conditions such as stroke and spinal cord injuries. This study offers a comprehensive bibliometric analysis of global EEG-based BCI research in rehabilitation from 2013 to 2023. It focuses on primary research and review articles addressing technological innovations, effectiveness, and system advancements in clinical rehabilitation. Data were sourced from databases like Web of Science, and bibliometric tools (bibliometrix R) were used to analyze publication trends, geographic distribution, keyword co-occurrences, and collaboration networks. The results reveal a rapid increase in EEG-BCI research, peaking in 2022, with a primary focus on motor and sensory rehabilitation. EEG remains the most commonly used method, with significant contributions from Asia, Europe, and North America. Additionally, there is growing interest in applying BCIs to mental health, as well as integrating artificial intelligence (AI), particularly machine learning, to enhance system accuracy and adaptability. However, challenges remain, such as system inefficiencies and slow learning curves. These could be addressed by incorporating multi-modal approaches and advanced neuroimaging technologies. Further research is needed to validate the applicability of EEG-BCI advancements in both cognitive and motor rehabilitation, especially considering the high global prevalence of cerebrovascular diseases. To advance the field, expanding global participation, particularly in underrepresented regions like Latin America, is essential. Improving system efficiency through multi-modal approaches and AI integration is also critical. Ethical considerations, including data privacy, transparency, and equitable access to BCI technologies, must be prioritized to ensure the inclusive development and use of these technologies across diverse socioeconomic groups.
Collapse
Affiliation(s)
- Ana Sophia Angulo Medina
- Grupo de Investigación en Salud Integral (GISI), Departamento Facultad de Salud, Universidad Santiago de Cali, Cali 5183000, Colombia; (A.S.A.M.); (M.I.A.B.); (I.D.R.G.)
| | - Maria Isabel Aguilar Bonilla
- Grupo de Investigación en Salud Integral (GISI), Departamento Facultad de Salud, Universidad Santiago de Cali, Cali 5183000, Colombia; (A.S.A.M.); (M.I.A.B.); (I.D.R.G.)
| | - Ingrid Daniela Rodríguez Giraldo
- Grupo de Investigación en Salud Integral (GISI), Departamento Facultad de Salud, Universidad Santiago de Cali, Cali 5183000, Colombia; (A.S.A.M.); (M.I.A.B.); (I.D.R.G.)
| | - John Fernando Montenegro Palacios
- Specialization in Internal Medicine, Department of Health, Universidad Santiago de Cali, Cali 5183000, Colombia; (J.F.M.P.); (D.A.C.G.)
| | - Danilo Andrés Cáceres Gutiérrez
- Specialization in Internal Medicine, Department of Health, Universidad Santiago de Cali, Cali 5183000, Colombia; (J.F.M.P.); (D.A.C.G.)
| | - Yamil Liscano
- Grupo de Investigación en Salud Integral (GISI), Departamento Facultad de Salud, Universidad Santiago de Cali, Cali 5183000, Colombia; (A.S.A.M.); (M.I.A.B.); (I.D.R.G.)
| |
Collapse
|
7
|
Politi K, Weiss PL, Givony K, Zion Golumbic E. Utility of Electroencephalograms for Enhancing Clinical Care and Rehabilitation of Children with Acquired Brain Injury. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2024; 21:1466. [PMID: 39595733 PMCID: PMC11593451 DOI: 10.3390/ijerph21111466] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/01/2024] [Revised: 10/27/2024] [Accepted: 10/30/2024] [Indexed: 11/28/2024]
Abstract
The objective of this literature review was to present evidence from recent studies and applications focused on employing electroencephalogram (EEG) monitoring and methodological approaches during the rehabilitation of children with acquired brain injuries and their related effects. We describe acquired brain injury (ABI) as one of the most common reasons for cognitive and motor disabilities in children that significantly impact their safety, independence, and overall quality of life. These disabilities manifest as dysfunctions in cognition, gait, balance, upper-limb coordination, and hand dexterity. Rehabilitation treatment aims to restore and optimize these impaired functions to help children regain autonomy and enhance their quality of life. Recent advancements in monitoring technologies such as EEG measurements are increasingly playing a role in clinical diagnosis and management. A significant advantage of incorporating EEG technology in pediatric rehabilitation is its ability to provide continuous and objective quantitative monitoring of a child's neurological status. This allows for the real-time assessment of improvement or deterioration in brain function, including, but not limited to, a significant impact on motor function. EEG monitoring enables healthcare providers to tailor and adjust interventions-both pharmacological and rehabilitative-based on the child's current neurological status.
Collapse
Affiliation(s)
- Keren Politi
- ALYN Hospital, Jerusalem 91090, Israel
- Helmsley Pediatric & Adolescent Rehabilitation Research Center, ALYN Hospital, Jerusalem 91090, Israel; (P.L.W.); (K.G.)
| | - Patrice L. Weiss
- Helmsley Pediatric & Adolescent Rehabilitation Research Center, ALYN Hospital, Jerusalem 91090, Israel; (P.L.W.); (K.G.)
- Department of Occupational Therapy, University of Haifa, Haifa 3498838, Israel
| | - Kfir Givony
- Helmsley Pediatric & Adolescent Rehabilitation Research Center, ALYN Hospital, Jerusalem 91090, Israel; (P.L.W.); (K.G.)
- The Faculty of Medicine, Hebrew University of Jerusalem, Jerusalem 91120, Israel
| | - Elana Zion Golumbic
- The Gonda Center for Multidisciplinary Brain Research, Bar Ilan University, Ramat Gan 5290002, Israel;
| |
Collapse
|
8
|
Wohns N, Dorfman N, Klein E. Caregivers in implantable brain-computer interface research: a scoping review. Front Hum Neurosci 2024; 18:1490066. [PMID: 39545148 PMCID: PMC11560881 DOI: 10.3389/fnhum.2024.1490066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2024] [Accepted: 10/22/2024] [Indexed: 11/17/2024] Open
Abstract
Introduction While the ethical significance of caregivers in neurological research has increasingly been recognized, the role of caregivers in brain-computer interface (BCI) research has received relatively less attention. Objectives This report investigates the extent to which caregivers are mentioned in publications describing implantable BCI (iBCI) research for individuals with motor dysfunction, communication impairment, and blindness. Methods The scoping review was conducted in June 2024 using the PubMed and Web of Science bibliographic databases. The articles were systematically searched using query terms for caregivers, family members, and guardians, and the results were quantitatively and qualitatively analyzed. Results Our search yielded 315 unique studies, 78 of which were included in this scoping review. Thirty-four (43.6%) of the 78 articles mentioned the study participant's caregivers. We sorted these into 5 categories: Twenty-two (64.7%) of the 34 articles thanked caregivers in the acknowledgement section, 6 (17.6%) articles described the caregiver's role with regard to the consent process, 12 (35.3%) described the caregiver's role in the technical maintenance and upkeep of the BCI system or in other procedural aspects of the study, 9 (26.5%) discussed how the BCI enhanced participant communication and goal-directed behavior with the help of a caregiver, and 3 (8.8%) articles included general comments that did not fit into the other categories but still related to the importance of caregivers in the lives of the research participants. Discussion Caregivers were mentioned in less than half of BCI studies in this review. The studies that offered more robust discussions of caregivers provide valuable insight into the integral role that caregivers play in supporting the study participants and the research process. Attention to the role of caregivers in successful BCI research studies can help guide the responsible development of future BCI study protocols.
Collapse
Affiliation(s)
- Nicolai Wohns
- Department of Philosophy, University of Washington, Seattle, WA, United States
| | - Natalie Dorfman
- Department of Philosophy, University of Washington, Seattle, WA, United States
| | - Eran Klein
- Department of Philosophy, University of Washington, Seattle, WA, United States
- Oregon Health and Science University, Portland, OR, United States
| |
Collapse
|
9
|
Christensen MB, Cui XT, Rieth L, Warren DJ. Editorial: Biocompatibility of implanted devices, modulation, and repair in the nervous system. Front Neurosci 2024; 18:1505912. [PMID: 39529699 PMCID: PMC11551927 DOI: 10.3389/fnins.2024.1505912] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2024] [Accepted: 10/14/2024] [Indexed: 11/16/2024] Open
Affiliation(s)
- Michael B. Christensen
- Division of Urology, Department of Surgery, University of Utah School of Medicine, Salt Lake City, UT, United States
- Department of Otolaryngology—Head and Neck Surgery, University of Utah School of Medicine, Salt Lake City, UT, United States
| | - Xinyan T. Cui
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, United States
| | - Loren Rieth
- Department of Mechanical and Aerospace Engineering, West Virginia University, Morgantown, WV, United States
- Feinstein Institute for Medical Research, Manhasset, NY, United States
| | - David J. Warren
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States
| |
Collapse
|
10
|
Ji W, Su H, Jin S, Tian Y, Li G, Yang Y, Li J, Zhou Z, Wei X, Tao TH, Qin L, Ye Y, Sun L. A Wireless Bi-Directional Brain-Computer Interface Supporting Both Bluetooth and Wi-Fi Transmission. MICROMACHINES 2024; 15:1283. [PMID: 39597097 PMCID: PMC11596061 DOI: 10.3390/mi15111283] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/09/2024] [Revised: 10/19/2024] [Accepted: 10/21/2024] [Indexed: 11/29/2024]
Abstract
Wireless neural signal transmission is essential for both neuroscience research and neural disorder therapies. However, conventional wireless systems are often constrained by low sampling rates, limited channel counts, and their support of only a single transmission mode. Here, we developed a wireless bi-directional brain-computer interface system featuring dual transmission modes. This system supports both low-power Bluetooth transmission and high-sampling-rate Wi-Fi transmission, providing flexibility for various application scenarios. The Bluetooth mode, with a maximum sampling rate of 14.4 kS/s, is well suited for detecting low-frequency signals, as demonstrated by both in vitro recordings of signals from 10 to 50 Hz and in vivo recordings of 16-channel local field potentials in mice. More importantly, the Wi-Fi mode, offering a maximum sampling rate of 56.8 kS/s, is optimized for recording high-frequency signals. This capability was validated through in vitro recordings of signals from 500 to 2000 Hz and in vivo recordings of single-neuron spike firings with amplitudes reaching hundreds of microvolts and high signal-to-noise ratios. Additionally, the system incorporates a wireless stimulation function capable of delivering current pulses up to 2.55 mA, with adjustable pulse width and polarity. Overall, this dual-mode system provides an efficient and flexible solution for both neural recording and stimulation applications.
Collapse
Affiliation(s)
- Wei Ji
- College of Electronics and Information Engineering, Shanghai University of Electric Power, Shanghai 201306, China; (W.J.); (L.Q.)
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China; (H.S.); (S.J.); (Y.T.); (G.L.); (Y.Y.); (J.L.); (T.H.T.)
| | - Haoyang Su
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China; (H.S.); (S.J.); (Y.T.); (G.L.); (Y.Y.); (J.L.); (T.H.T.)
- School of Graduate Study, University of Chinese Academy of Sciences, Beijing 100049, China; (Z.Z.); (X.W.)
| | - Shuang Jin
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China; (H.S.); (S.J.); (Y.T.); (G.L.); (Y.Y.); (J.L.); (T.H.T.)
| | - Ye Tian
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China; (H.S.); (S.J.); (Y.T.); (G.L.); (Y.Y.); (J.L.); (T.H.T.)
- School of Graduate Study, University of Chinese Academy of Sciences, Beijing 100049, China; (Z.Z.); (X.W.)
| | - Gen Li
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China; (H.S.); (S.J.); (Y.T.); (G.L.); (Y.Y.); (J.L.); (T.H.T.)
- School of Graduate Study, University of Chinese Academy of Sciences, Beijing 100049, China; (Z.Z.); (X.W.)
| | - Yingkang Yang
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China; (H.S.); (S.J.); (Y.T.); (G.L.); (Y.Y.); (J.L.); (T.H.T.)
- School of Graduate Study, University of Chinese Academy of Sciences, Beijing 100049, China; (Z.Z.); (X.W.)
| | - Jiazhi Li
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China; (H.S.); (S.J.); (Y.T.); (G.L.); (Y.Y.); (J.L.); (T.H.T.)
| | - Zhitao Zhou
- School of Graduate Study, University of Chinese Academy of Sciences, Beijing 100049, China; (Z.Z.); (X.W.)
- State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China
| | - Xiaoling Wei
- School of Graduate Study, University of Chinese Academy of Sciences, Beijing 100049, China; (Z.Z.); (X.W.)
- State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China
| | - Tiger H. Tao
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China; (H.S.); (S.J.); (Y.T.); (G.L.); (Y.Y.); (J.L.); (T.H.T.)
- School of Graduate Study, University of Chinese Academy of Sciences, Beijing 100049, China; (Z.Z.); (X.W.)
- State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
- School of Physical Science and Technology, ShanghaiTech University, Shanghai 201210, China
- Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
- Neuroxess Co., Ltd. (Jiangxi), Nanchang 330029, China
- Guangdong Institute of Intelligence Science and Technology, Hengqin, Zhuhai 519031, China
- Tianqiao and Chrissy Chen Institute for Translational Research, Shanghai 200020, China
| | - Lunming Qin
- College of Electronics and Information Engineering, Shanghai University of Electric Power, Shanghai 201306, China; (W.J.); (L.Q.)
| | - Yifei Ye
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China; (H.S.); (S.J.); (Y.T.); (G.L.); (Y.Y.); (J.L.); (T.H.T.)
| | - Liuyang Sun
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China; (H.S.); (S.J.); (Y.T.); (G.L.); (Y.Y.); (J.L.); (T.H.T.)
- School of Graduate Study, University of Chinese Academy of Sciences, Beijing 100049, China; (Z.Z.); (X.W.)
- State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China
| |
Collapse
|
11
|
Li J, Shi W, Li Y. An effective classification approach for EEG-based motor imagery tasks combined with attention mechanisms. Cogn Neurodyn 2024; 18:2689-2707. [PMID: 39555298 PMCID: PMC11564468 DOI: 10.1007/s11571-024-10115-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Revised: 03/28/2024] [Accepted: 04/09/2024] [Indexed: 11/19/2024] Open
Abstract
Currently, electroencephalogram (EEG)-based motor imagery (MI) signals have been received extensive attention, which can assist disabled subjects to control wheelchair, automatic driving and other activities. However, EEG signals are easily affected by some factors, such as muscle movements, wireless devices, power line, etc., resulting in the low signal-to-noise ratios and the worse recognition results on EEG decoding. Therefore, it is crucial to develop a stable model for decoding MI-EEG signals. To address this issue and further improve the decoding performance for MI tasks, a hybrid structure combining convolutional neural networks and bidirectional long short-term memory (BLSTM) model, namely CBLSTM, is developed in this study to handle the various EEG-based MI tasks. Besides, the attention mechanism (AM) model is further adopted to adaptively assign the weight of EEG vital features and enhance the expression which beneficial to classification for MI tasks. First of all, the spatial features and the time series features are extracted by CBLSTM from preprocessed MI-EEG data, respectively. Meanwhile, more effective features information can be mined by the AM model, and the softmax function is utilized to recognize intention categories. Ultimately, the numerical results illustrate that the model presented achieves an average accuracy of 98.40% on the public physioNet dataset and faster training process for decoding MI tasks, which is superior to some other advanced models. Ablation experiment performed also verifies the effectiveness and feasibility of the developed model. Moreover, the established network model provides a good basis for the application of brain-computer interface in rehabilitation medicine.
Collapse
Affiliation(s)
- Jixiang Li
- College of Electrical Engineering and Automation, Fuzhou University, Fuzhou,, 350108 Fujian China
- Fujian Provincial Key Laboratory of Medical Instrument and Pharmaceutical Technology, Fuzhou University, Fuzhou, 350108 Fujian China
| | - Wuxiang Shi
- College of Electrical Engineering and Automation, Fuzhou University, Fuzhou,, 350108 Fujian China
- Fujian Provincial Key Laboratory of Medical Instrument and Pharmaceutical Technology, Fuzhou University, Fuzhou, 350108 Fujian China
| | - Yurong Li
- College of Electrical Engineering and Automation, Fuzhou University, Fuzhou,, 350108 Fujian China
- Fujian Provincial Key Laboratory of Medical Instrument and Pharmaceutical Technology, Fuzhou University, Fuzhou, 350108 Fujian China
| |
Collapse
|
12
|
Jin W, Zhu X, Qian L, Wu C, Yang F, Zhan D, Kang Z, Luo K, Meng D, Xu G. Electroencephalogram-based adaptive closed-loop brain-computer interface in neurorehabilitation: a review. Front Comput Neurosci 2024; 18:1431815. [PMID: 39371523 PMCID: PMC11449715 DOI: 10.3389/fncom.2024.1431815] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2024] [Accepted: 09/10/2024] [Indexed: 10/08/2024] Open
Abstract
Brain-computer interfaces (BCIs) represent a groundbreaking approach to enabling direct communication for individuals with severe motor impairments, circumventing traditional neural and muscular pathways. Among the diverse array of BCI technologies, electroencephalogram (EEG)-based systems are particularly favored due to their non-invasive nature, user-friendly operation, and cost-effectiveness. Recent advancements have facilitated the development of adaptive bidirectional closed-loop BCIs, which dynamically adjust to users' brain activity, thereby enhancing responsiveness and efficacy in neurorehabilitation. These systems support real-time modulation and continuous feedback, fostering personalized therapeutic interventions that align with users' neural and behavioral responses. By incorporating machine learning algorithms, these BCIs optimize user interaction and promote recovery outcomes through mechanisms of activity-dependent neuroplasticity. This paper reviews the current landscape of EEG-based adaptive bidirectional closed-loop BCIs, examining their applications in the recovery of motor and sensory functions, as well as the challenges encountered in practical implementation. The findings underscore the potential of these technologies to significantly enhance patients' quality of life and social interaction, while also identifying critical areas for future research aimed at improving system adaptability and performance. As advancements in artificial intelligence continue, the evolution of sophisticated BCI systems holds promise for transforming neurorehabilitation and expanding applications across various domains.
Collapse
Affiliation(s)
- Wenjie Jin
- Department of Rehabilitation Medicine, Nanjing Medical University, Nanjing, China
- Rehabilitation Medicine Center, Zhejiang Chinese Medical University Affiliated Jiaxing TCM Hospital, Jiaxing, China
| | - XinXin Zhu
- Rehabilitation Medicine Center, Zhejiang Chinese Medical University Affiliated Jiaxing TCM Hospital, Jiaxing, China
| | - Lifeng Qian
- Rehabilitation Medicine Center, Zhejiang Chinese Medical University Affiliated Jiaxing TCM Hospital, Jiaxing, China
| | - Cunshu Wu
- Department of Rehabilitation Medicine, Nanjing Medical University, Nanjing, China
| | - Fan Yang
- Rehabilitation Medicine Center, Zhejiang Chinese Medical University Affiliated Jiaxing TCM Hospital, Jiaxing, China
| | - Daowei Zhan
- Rehabilitation Medicine Center, Zhejiang Chinese Medical University Affiliated Jiaxing TCM Hospital, Jiaxing, China
| | - Zhaoyin Kang
- Rehabilitation Medicine Center, Zhejiang Chinese Medical University Affiliated Jiaxing TCM Hospital, Jiaxing, China
| | - Kaitao Luo
- Rehabilitation Medicine Center, Zhejiang Chinese Medical University Affiliated Jiaxing TCM Hospital, Jiaxing, China
| | - Dianhuai Meng
- Department of Rehabilitation Medicine, Nanjing Medical University, Nanjing, China
- Rehabilitation Medicine Center, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| | - Guangxu Xu
- Department of Rehabilitation Medicine, Nanjing Medical University, Nanjing, China
- Rehabilitation Medicine Center, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| |
Collapse
|
13
|
Ramos T, Ramos J, Pais-Vieira C, Pais-Vieira M. Fronto-Central Changes in Multiple Frequency Bands in Active Tactile Width Discrimination Task. Brain Sci 2024; 14:915. [PMID: 39335410 PMCID: PMC11429623 DOI: 10.3390/brainsci14090915] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2024] [Revised: 09/06/2024] [Accepted: 09/08/2024] [Indexed: 09/30/2024] Open
Abstract
The neural basis of tactile processing in humans has been extensively studied; however, the neurophysiological basis of human width discrimination remains relatively unexplored. In particular, the changes that occur in neural networks underlying active tactile width discrimination learning have yet to be described. Here, it is hypothesized that subjects learning to perform the active version of the width discrimination task would present changes in behavioral data and in the neurophysiological activity, specifically in networks of electrodes relevant for tactile and motor processing. The specific hypotheses tested here were that the performance and response latency of subjects would change between the first and the second blocks; the power of the different frequency bands would change between the first and the second blocks; electrode F4 would encode task performance and response latency through changes in the power of the delta, theta, alpha, beta, and low-gamma frequency bands; the relative power in the alpha and beta frequency bands in electrodes C3 and C4 (Interhemispheric Spectral Difference-ISD) would change because of learning between the first and the second blocks. To test this hypothesis, we recorded and analyzed electroencephalographic (EEG) activity while subjects performed a session where they were tested twice (i.e., two different blocks) in an active tactile width discrimination task using their right index finger. Subjects (n = 18) presented high performances (high discrimination accuracy) already in their first block, and therefore no significant improvements were found in the second block. Meanwhile, a reduction in response latency was observed between the two blocks. EEG recordings revealed an increase in power for the low-gamma frequency band (30-45 Hz) for electrodes F3 and C3 from the first to the second block. This change was correlated with neither performance nor latency. Analysis of the neural activity in electrode F4 revealed that the beta frequency band encoded the subjects' performance. Meanwhile, the delta frequency band in the same electrode revealed a complex pattern where blocks appeared clustered in two different patterns: an Upper Pattern (UP), where power and latency were highly correlated (Rho = 0.950), and a sparser and more uncorrelated Lower Pattern (LP). Blocks belonging to the UP or LP patterns did not differ in performance and were not specific to the first or the second block. However, blocks belonging to the LP presented an increase in response latency, increased variability in performance, and an increased ISD in alpha and beta frequency bands for the pair of electrodes C3-C4, suggesting that the LP may reflect a state related to increased cognitive load or task difficulty. These results suggest that changes in performance and latency in an active tactile width discrimination task are encoded in the delta, alpha, beta, and low-gamma frequency bands in a fronto-central network. The main contribution of this study is therefore related to the description of neural dynamics in frontal and central networks involved in the learning process of active tactile width discrimination.
Collapse
Affiliation(s)
- Tiago Ramos
- iBiMED—Institute of Biomedicine, Department of Medical Sciences, University of Aveiro, 3810-193 Aveiro, Portugal; (T.R.); (J.R.)
| | - Júlia Ramos
- iBiMED—Institute of Biomedicine, Department of Medical Sciences, University of Aveiro, 3810-193 Aveiro, Portugal; (T.R.); (J.R.)
| | - Carla Pais-Vieira
- Faculdade de Ciências da Saúde e Enfermagem, Centro de Investigação Interdisciplinar em Saúde (CIIS), Universidade Católica Portuguesa, 4169-005 Porto, Portugal;
| | - Miguel Pais-Vieira
- iBiMED—Institute of Biomedicine, Department of Medical Sciences, University of Aveiro, 3810-193 Aveiro, Portugal; (T.R.); (J.R.)
| |
Collapse
|
14
|
Yamashiro K, Matsumoto N, Ikegaya Y. Diffusion model-based image generation from rat brain activity. PLoS One 2024; 19:e0309709. [PMID: 39240852 PMCID: PMC11379174 DOI: 10.1371/journal.pone.0309709] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Accepted: 08/16/2024] [Indexed: 09/08/2024] Open
Abstract
Brain-computer interface (BCI) technology has gained recognition in various fields, including clinical applications, assistive technology, and human-computer interaction research. BCI enables communication, control, and monitoring of the affective/cognitive states of users. Recently, BCI has also found applications in the artistic field, enabling real-time art composition using brain activity signals, and engaging performers, spectators, or an entire audience with brain activity-based artistic environments. Existing techniques use specific features of brain activity, such as the P300 wave and SSVEPs, to control drawing tools, rather than directly reflecting brain activity in the output image. In this study, we present a novel approach that uses a latent diffusion model, a type of deep neural network, to generate images directly from continuous brain activity. We demonstrate this technology using local field potentials from the neocortex of freely moving rats. This system continuously converted the recorded brain activity into images. Our end-to-end method for generating images from brain activity opens new possibilities for creative expression and experimentation. Notably, our results show that the generated images successfully reflect the dynamic and stochastic nature of the underlying neural activity, providing a unique procedure for visualization of brain function.
Collapse
Affiliation(s)
- Kotaro Yamashiro
- Graduate School of Pharmaceutical Sciences, The University of Tokyo, Tokyo, Japan
| | - Nobuyoshi Matsumoto
- Graduate School of Pharmaceutical Sciences, The University of Tokyo, Tokyo, Japan
- Institute for AI and Beyond, The University of Tokyo, Tokyo, Japan
| | - Yuji Ikegaya
- Graduate School of Pharmaceutical Sciences, The University of Tokyo, Tokyo, Japan
- Institute for AI and Beyond, The University of Tokyo, Tokyo, Japan
- Center for Information and Neural Networks, National Institute of Information and Communications Technology, Suita City, Osaka, Japan
| |
Collapse
|
15
|
Huang Y, Yao K, Zhang Q, Huang X, Chen Z, Zhou Y, Yu X. Bioelectronics for electrical stimulation: materials, devices and biomedical applications. Chem Soc Rev 2024; 53:8632-8712. [PMID: 39132912 DOI: 10.1039/d4cs00413b] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/13/2024]
Abstract
Bioelectronics is a hot research topic, yet an important tool, as it facilitates the creation of advanced medical devices that interact with biological systems to effectively diagnose, monitor and treat a broad spectrum of health conditions. Electrical stimulation (ES) is a pivotal technique in bioelectronics, offering a precise, non-pharmacological means to modulate and control biological processes across molecular, cellular, tissue, and organ levels. This method holds the potential to restore or enhance physiological functions compromised by diseases or injuries by integrating sophisticated electrical signals, device interfaces, and designs tailored to specific biological mechanisms. This review explains the mechanisms by which ES influences cellular behaviors, introduces the essential stimulation principles, discusses the performance requirements for optimal ES systems, and highlights the representative applications. From this review, we can realize the potential of ES based bioelectronics in therapy, regenerative medicine and rehabilitation engineering technologies, ranging from tissue engineering to neurological technologies, and the modulation of cardiovascular and cognitive functions. This review underscores the versatility of ES in various biomedical contexts and emphasizes the need to adapt to complex biological and clinical landscapes it addresses.
Collapse
Affiliation(s)
- Ya Huang
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China
| | - Kuanming Yao
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China
| | - Qiang Zhang
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China
| | - Xingcan Huang
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China
| | - Zhenlin Chen
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China
| | - Yu Zhou
- Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong, China.
| | - Xinge Yu
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China
| |
Collapse
|
16
|
Dillen A, Omidi M, Díaz MA, Ghaffari F, Roelands B, Vanderborght B, Romain O, De Pauw K. Evaluating the real-world usability of BCI control systems with augmented reality: a user study protocol. Front Hum Neurosci 2024; 18:1448584. [PMID: 39161850 PMCID: PMC11330773 DOI: 10.3389/fnhum.2024.1448584] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2024] [Accepted: 07/18/2024] [Indexed: 08/21/2024] Open
Abstract
Brain-computer interfaces (BCI) enable users to control devices through their brain activity. Motor imagery (MI), the neural activity resulting from an individual imagining performing a movement, is a common control paradigm. This study introduces a user-centric evaluation protocol for assessing the performance and user experience of an MI-based BCI control system utilizing augmented reality. Augmented reality is employed to enhance user interaction by displaying environment-aware actions, and guiding users on the necessary imagined movements for specific device commands. One of the major gaps in existing research is the lack of comprehensive evaluation methodologies, particularly in real-world conditions. To address this gap, our protocol combines quantitative and qualitative assessments across three phases. In the initial phase, the BCI prototype's technical robustness is validated. Subsequently, the second phase involves a performance assessment of the control system. The third phase introduces a comparative analysis between the prototype and an alternative approach, incorporating detailed user experience evaluations through questionnaires and comparisons with non-BCI control methods. Participants engage in various tasks, such as object sorting, picking and placing, and playing a board game using the BCI control system. The evaluation procedure is designed for versatility, intending applicability beyond the specific use case presented. Its adaptability enables easy customization to meet the specific user requirements of the investigated BCI control application. This user-centric evaluation protocol offers a comprehensive framework for iterative improvements to the BCI prototype, ensuring technical validation, performance assessment, and user experience evaluation in a systematic and user-focused manner.
Collapse
Affiliation(s)
- Arnau Dillen
- Human Physiology and Sports Physiotherapy Research Group, Vrije Universiteit Brussel, Brussels, Belgium
- Équipes Traitement de l'Information et Systèmes, UMR 8051, CY Cergy Paris Université, École Nationale Supérieure de l'Électronique et de ses Applications (ENSEA), Centre national de la recherche scientifique (CNRS), Cergy, France
- Brussels Human Robotic Research Center (BruBotics), Vrije Universiteit Brussel, Brussels, Belgium
| | - Mohsen Omidi
- Brussels Human Robotic Research Center (BruBotics), Vrije Universiteit Brussel, Brussels, Belgium
- imec, Brussels, Belgium
| | - María Alejandra Díaz
- Human Physiology and Sports Physiotherapy Research Group, Vrije Universiteit Brussel, Brussels, Belgium
- Brussels Human Robotic Research Center (BruBotics), Vrije Universiteit Brussel, Brussels, Belgium
| | - Fakhreddine Ghaffari
- Équipes Traitement de l'Information et Systèmes, UMR 8051, CY Cergy Paris Université, École Nationale Supérieure de l'Électronique et de ses Applications (ENSEA), Centre national de la recherche scientifique (CNRS), Cergy, France
| | - Bart Roelands
- Human Physiology and Sports Physiotherapy Research Group, Vrije Universiteit Brussel, Brussels, Belgium
- Brussels Human Robotic Research Center (BruBotics), Vrije Universiteit Brussel, Brussels, Belgium
| | - Bram Vanderborght
- Brussels Human Robotic Research Center (BruBotics), Vrije Universiteit Brussel, Brussels, Belgium
- imec, Brussels, Belgium
| | - Olivier Romain
- Équipes Traitement de l'Information et Systèmes, UMR 8051, CY Cergy Paris Université, École Nationale Supérieure de l'Électronique et de ses Applications (ENSEA), Centre national de la recherche scientifique (CNRS), Cergy, France
| | - Kevin De Pauw
- Human Physiology and Sports Physiotherapy Research Group, Vrije Universiteit Brussel, Brussels, Belgium
- Brussels Human Robotic Research Center (BruBotics), Vrije Universiteit Brussel, Brussels, Belgium
| |
Collapse
|
17
|
Yukawa Y, Higashi T, Minakuchi M, Naito E, Murata T. Vibration-Induced Illusory Movement Task Can Induce Functional Recovery in Patients With Subacute Stroke. Cureus 2024; 16:e66667. [PMID: 39262538 PMCID: PMC11388116 DOI: 10.7759/cureus.66667] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/09/2024] [Indexed: 09/13/2024] Open
Abstract
In recent years, mental practice (MP), which involves repetitive motor imagery (MI), has been applied in rehabilitation to actively enhance exercise performance. MP is a method that involves repetitive MI, consciously evoking the intentions and content of the exercise without actual exercise. Combining actual exercise with MP promotes the development of exercise skills. However, it is possible that the MI recall ability differs greatly between individuals, affecting the therapeutic effect. In contrast, the vibration-induced illusory movement (VIM) task acts as a method to induce a motor illusion by somatosensory stimuli without actual motor. VIM, actual movement, and MI are thought to share a common neural basis in the brain. Therefore, it was hypothesized that the VIM task would complement the differences in MI recall in individual patients with hemiplegic stroke and may be a new treatment to enhance MI recall. Accordingly, in this study, we investigated the therapeutic effects of the VIM task in patients with hemiplegic stroke. In Study I, the therapeutic effect of the VIM task in 14 patients with post-stroke hemiplegia was evaluated by motor function assessment. In Study II, treatment effects were investigated by examining the ability of the same group of patients to recall MI and by neurophysiological examination of the electroencephalogram (EEG) during MI recall in four patients who consented to the study. Motor function and MI were assessed four times: before the intervention, after occupational therapy, after the VIM task (which used the motor illusion induced by tendon vibration), and one month after acceptance of therapy. Compared with occupational therapy, the VIM task showed a statistically significant improvement in upper limb function and MI ability. In addition, we found an increase in event-related desynchronization intensity during MI in the affected hemisphere only after the VIM task. It is possible that the VIM task facilitates motor function and MI. VIM task implementation of MI recall variability between individuals, which is a problem in mental practice, possible to increase the effectiveness of the brain-machine interface.
Collapse
Affiliation(s)
- Yoshihiro Yukawa
- Department of Health Sciences, Graduate School of Biomedical Sciences, Health Sciences, Nagasaki University, Nagasaki, JPN
- Department of Rehabilitation, Wakayama Professional University of Rehabilitation, Wakayama, JPN
| | - Toshio Higashi
- Department of Health Sciences, Graduate School of Biomedical Sciences, Health Sciences, Nagasaki University, Nagasaki, JPN
| | - Marina Minakuchi
- Department of Occupational Therapy, Clover Care Medical Co, Tanabe, JPN
| | - Eiichi Naito
- Center for Information and Neural Networks (CiNet), Advanced ICT Research Institute, National Institute of Information and Communications Technology (NICT), Suita-shi, JPN
- Graduate School of Frontier Biosciences, Osaka University, Suita-shi, JPN
| | - Takaho Murata
- Department of Neurosurgery, Murata Hospital, Osaka-shi, JPN
| |
Collapse
|
18
|
Patel D, Shetty S, Acha C, Pantoja IEM, Zhao A, George D, Gracias DH. Microinstrumentation for Brain Organoids. Adv Healthc Mater 2024; 13:e2302456. [PMID: 38217546 DOI: 10.1002/adhm.202302456] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2023] [Revised: 12/10/2023] [Indexed: 01/15/2024]
Abstract
Brain organoids are three-dimensional aggregates of self-organized differentiated stem cells that mimic the structure and function of human brain regions. Organoids bridge the gaps between conventional drug screening models such as planar mammalian cell culture, animal studies, and clinical trials. They can revolutionize the fields of developmental biology, neuroscience, toxicology, and computer engineering. Conventional microinstrumentation for conventional cellular engineering, such as planar microfluidic chips; microelectrode arrays (MEAs); and optical, magnetic, and acoustic techniques, has limitations when applied to three-dimensional (3D) organoids, primarily due to their limits with inherently two-dimensional geometry and interfacing. Hence, there is an urgent need to develop new instrumentation compatible with live cell culture techniques and with scalable 3D formats relevant to organoids. This review discusses conventional planar approaches and emerging 3D microinstrumentation necessary for advanced organoid-machine interfaces. Specifically, this article surveys recently developed microinstrumentation, including 3D printed and curved microfluidics, 3D and fast-scan optical techniques, buckling and self-folding MEAs, 3D interfaces for electrochemical measurements, and 3D spatially controllable magnetic and acoustic technologies relevant to two-way information transfer with brain organoids. This article highlights key challenges that must be addressed for robust organoid culture and reliable 3D spatiotemporal information transfer.
Collapse
Affiliation(s)
- Devan Patel
- Department of Chemical and Biomolecular Engineering, Johns Hopkins University, Baltimore, MD, 21218, USA
| | - Saniya Shetty
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, 21218, USA
| | - Chris Acha
- Department of Chemical and Biomolecular Engineering, Johns Hopkins University, Baltimore, MD, 21218, USA
| | - Itzy E Morales Pantoja
- Center for Alternatives to Animal Testing (CAAT), Department of Environmental Health and Engineering, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, MD, 21205, USA
| | - Alice Zhao
- Department of Biology, Johns Hopkins University, Baltimore, MD, 21218, USA
| | - Derosh George
- Department of Chemical and Biomolecular Engineering, Johns Hopkins University, Baltimore, MD, 21218, USA
| | - David H Gracias
- Department of Chemical and Biomolecular Engineering, Johns Hopkins University, Baltimore, MD, 21218, USA
- Department of Chemistry, Johns Hopkins University, Baltimore, MD, 21218, USA
- Department of Materials Science and Engineering, Johns Hopkins University, Baltimore, MD, 21218, USA
- Department of Oncology, Johns Hopkins University School of Medicine, Baltimore, MD, 21205, USA
- Laboratory for Computational Sensing and Robotics (LCSR), Johns Hopkins University, Baltimore, MD, 21218, USA
- Sidney Kimmel Comprehensive Cancer Center (SKCCC), Johns Hopkins School of Medicine, Baltimore, MD, 21205, USA
- Center for MicroPhysiological Systems (MPS), Johns Hopkins School of Medicine, Baltimore, MD, 21205, USA
| |
Collapse
|
19
|
Manero A, Rivera V, Fu Q, Schwartzman JD, Prock-Gibbs H, Shah N, Gandhi D, White E, Crawford KE, Coathup MJ. Emerging Medical Technologies and Their Use in Bionic Repair and Human Augmentation. Bioengineering (Basel) 2024; 11:695. [PMID: 39061777 PMCID: PMC11274085 DOI: 10.3390/bioengineering11070695] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2024] [Revised: 07/04/2024] [Accepted: 07/07/2024] [Indexed: 07/28/2024] Open
Abstract
As both the proportion of older people and the length of life increases globally, a rise in age-related degenerative diseases, disability, and prolonged dependency is projected. However, more sophisticated biomedical materials, as well as an improved understanding of human disease, is forecast to revolutionize the diagnosis and treatment of conditions ranging from osteoarthritis to Alzheimer's disease as well as impact disease prevention. Another, albeit quieter, revolution is also taking place within society: human augmentation. In this context, humans seek to improve themselves, metamorphosing through self-discipline or more recently, through use of emerging medical technologies, with the goal of transcending aging and mortality. In this review, and in the pursuit of improved medical care following aging, disease, disability, or injury, we first highlight cutting-edge and emerging materials-based neuroprosthetic technologies designed to restore limb or organ function. We highlight the potential for these technologies to be utilized to augment human performance beyond the range of natural performance. We discuss and explore the growing social movement of human augmentation and the idea that it is possible and desirable to use emerging technologies to push the boundaries of what it means to be a healthy human into the realm of superhuman performance and intelligence. This potential future capability is contrasted with limitations in the right-to-repair legislation, which may create challenges for patients. Now is the time for continued discussion of the ethical strategies for research, implementation, and long-term device sustainability or repair.
Collapse
Affiliation(s)
- Albert Manero
- Limbitless Solutions, University of Central Florida, 12703 Research Parkway, Suite 100, Orlando, FL 32826, USA (V.R.)
- Biionix Cluster, University of Central Florida, Orlando, FL 32827, USA; (Q.F.); (K.E.C.)
| | - Viviana Rivera
- Limbitless Solutions, University of Central Florida, 12703 Research Parkway, Suite 100, Orlando, FL 32826, USA (V.R.)
| | - Qiushi Fu
- Biionix Cluster, University of Central Florida, Orlando, FL 32827, USA; (Q.F.); (K.E.C.)
- Department of Mechanical and Aerospace Engineering, University of Central Florida, Orlando, FL 32816, USA
| | - Jonathan D. Schwartzman
- College of Medicine, University of Central Florida, Orlando, FL 32827, USA; (J.D.S.); (H.P.-G.); (N.S.); (D.G.); (E.W.)
| | - Hannah Prock-Gibbs
- College of Medicine, University of Central Florida, Orlando, FL 32827, USA; (J.D.S.); (H.P.-G.); (N.S.); (D.G.); (E.W.)
| | - Neel Shah
- College of Medicine, University of Central Florida, Orlando, FL 32827, USA; (J.D.S.); (H.P.-G.); (N.S.); (D.G.); (E.W.)
| | - Deep Gandhi
- College of Medicine, University of Central Florida, Orlando, FL 32827, USA; (J.D.S.); (H.P.-G.); (N.S.); (D.G.); (E.W.)
| | - Evan White
- College of Medicine, University of Central Florida, Orlando, FL 32827, USA; (J.D.S.); (H.P.-G.); (N.S.); (D.G.); (E.W.)
| | - Kaitlyn E. Crawford
- Biionix Cluster, University of Central Florida, Orlando, FL 32827, USA; (Q.F.); (K.E.C.)
- Department of Materials Science and Engineering, University of Central Florida, Orlando, FL 32816, USA
| | - Melanie J. Coathup
- Biionix Cluster, University of Central Florida, Orlando, FL 32827, USA; (Q.F.); (K.E.C.)
- College of Medicine, University of Central Florida, Orlando, FL 32827, USA; (J.D.S.); (H.P.-G.); (N.S.); (D.G.); (E.W.)
| |
Collapse
|
20
|
Chen W, Wang S, Bao J, Yu C, Jiang Q, Song J, Zheng Y, Hao Y, Xu K. Restoration of coherent reach-grasp-pull movement via sequential intraneural peripheral nerve stimulation in rats. J Neural Eng 2024; 21:046007. [PMID: 38885677 DOI: 10.1088/1741-2552/ad5935] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Accepted: 06/17/2024] [Indexed: 06/20/2024]
Abstract
Objective.Peripheral nerve stimulation (PNS) has been demonstrated as an effective way to selectively activate muscles and to produce fine hand movements. However, sequential multi-joint upper limb movements, which are critical for paralysis rehabilitation, has not been tested with PNS. Here, we aimed to restore multiple upper limb joint movements through an intraneural interface with a single electrode, achieving coherent reach-grasp-pull movement tasks through sequential stimulation.Approach.A transverse intrafascicular multichannel electrode was implanted under the axilla of the rat's upper limb, traversing the musculocutaneous, radial, median, and ulnar nerves. Intramuscular electrodes were implanted into the biceps brachii (BB), triceps brachii (TB), flexor carpi radialis (FCR), and extensor carpi radialis (ECR) muscles to record electromyographic (EMG) activity and video recordings were used to capture the kinematics of elbow, wrist, and digit joints. Charge-balanced biphasic pulses were applied to different channels to recruit distinct upper limb muscles, with concurrent recording of EMG signals and joint kinematics to assess the efficacy of the stimulation. Finally, a sequential stimulation protocol was employed by generating coordinated pulses in different channels.Main results.BB, TB, FCR and ECR muscles were selectively activated and various upper limb movements, including elbow flexion, elbow extension, wrist flexion, wrist extension, digit flexion, and digit extension, were reliably generated. The modulation effects of stimulation parameters, including pulse width, amplitude, and frequency, on induced joint movements were investigated and reach-grasp-pull movement was elicited by sequential stimulation.Significance.Our results demonstrated the feasibility of sequential intraneural stimulation for functional multi-joint movement restoration, providing a new approach for clinical rehabilitation in paralyzed patients.
Collapse
Affiliation(s)
- Weihuang Chen
- Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, People's Republic of China
- Nanhu Brain-computer interface institute, Hangzhou 311100, People's Republic of China
- The State Key Lab of Brain-Machine Intelligence, Zhejiang University, Hangzhou 311100, People's Republic of China
- Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Key Laboratory of Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou, People's Republic of China
| | - Suhao Wang
- Nanhu Brain-computer interface institute, Hangzhou 311100, People's Republic of China
- The State Key Lab of Brain-Machine Intelligence, Zhejiang University, Hangzhou 311100, People's Republic of China
- Department of Engineering Mechanics, Soft Matter Research Center, and Key Laboratory of Soft Machines and Smart Devices of Zhejiang Province, Zhejiang University, Hangzhou 310027, People's Republic of China
| | - Jieting Bao
- Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Key Laboratory of Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou, People's Republic of China
| | - Chaonan Yu
- Nanhu Brain-computer interface institute, Hangzhou 311100, People's Republic of China
| | - Qianqian Jiang
- Nanhu Brain-computer interface institute, Hangzhou 311100, People's Republic of China
- The State Key Lab of Brain-Machine Intelligence, Zhejiang University, Hangzhou 311100, People's Republic of China
- Department of Engineering Mechanics, Soft Matter Research Center, and Key Laboratory of Soft Machines and Smart Devices of Zhejiang Province, Zhejiang University, Hangzhou 310027, People's Republic of China
| | - Jizhou Song
- Nanhu Brain-computer interface institute, Hangzhou 311100, People's Republic of China
- The State Key Lab of Brain-Machine Intelligence, Zhejiang University, Hangzhou 311100, People's Republic of China
- Department of Engineering Mechanics, Soft Matter Research Center, and Key Laboratory of Soft Machines and Smart Devices of Zhejiang Province, Zhejiang University, Hangzhou 310027, People's Republic of China
| | - Yongte Zheng
- Cereblink (Hangzhou) Technology Co., Ltd, Hangzhou, People's Republic of China
| | - Yaoyao Hao
- Nanhu Brain-computer interface institute, Hangzhou 311100, People's Republic of China
- The State Key Lab of Brain-Machine Intelligence, Zhejiang University, Hangzhou 311100, People's Republic of China
| | - Kedi Xu
- Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, People's Republic of China
- Nanhu Brain-computer interface institute, Hangzhou 311100, People's Republic of China
- The State Key Lab of Brain-Machine Intelligence, Zhejiang University, Hangzhou 311100, People's Republic of China
- Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Key Laboratory of Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou, People's Republic of China
| |
Collapse
|
21
|
Jin J, Bai G, Xu R, Qin K, Sun H, Wang X, Cichocki A. A cross-dataset adaptive domain selection transfer learning framework for motor imagery-based brain-computer interfaces. J Neural Eng 2024; 21:036057. [PMID: 38885683 DOI: 10.1088/1741-2552/ad593b] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2023] [Accepted: 06/17/2024] [Indexed: 06/20/2024]
Abstract
Objective. In brain-computer interfaces (BCIs) that utilize motor imagery (MI), minimizing calibration time has become increasingly critical for real-world applications. Recently, transfer learning (TL) has been shown to effectively reduce the calibration time in MI-BCIs. However, variations in data distribution among subjects can significantly influence the performance of TL in MI-BCIs.Approach.We propose a cross-dataset adaptive domain selection transfer learning framework that integrates domain selection, data alignment, and an enhanced common spatial pattern (CSP) algorithm. Our approach uses a huge dataset of 109 subjects as the source domain. We begin by identifying non-BCI illiterate subjects from this huge dataset, then determine the source domain subjects most closely aligned with the target subjects using maximum mean discrepancy. After undergoing Euclidean alignment processing, features are extracted by multiple composite CSP. The final classification is carried out using the support vector machine.Main results.Our findings indicate that the proposed technique outperforms existing methods, achieving classification accuracies of 75.05% and 76.82% in two cross-dataset experiments, respectively.Significance.By reducing the need for extensive training data, yet maintaining high accuracy, our method optimizes the practical implementation of MI-BCIs.
Collapse
Affiliation(s)
- Jing Jin
- Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology, Shanghai 200237, People's Republic of China
| | - Guanglian Bai
- Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology, Shanghai 200237, People's Republic of China
| | - Ren Xu
- Guger Technologies OG, Graz, Austria
| | - Ke Qin
- Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology, Shanghai 200237, People's Republic of China
| | - Hao Sun
- Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology, Shanghai 200237, People's Republic of China
| | - Xingyu Wang
- Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology, Shanghai 200237, People's Republic of China
| | - Andrzej Cichocki
- Systems Research Institute of Polish Academy of Science, Warsaw, Poland
- Department of Informatics, Nicolaus Copernicus University, Torun, Poland
| |
Collapse
|
22
|
Beaubois R, Cheslet J, Duenki T, De Venuto G, Carè M, Khoyratee F, Chiappalone M, Branchereau P, Ikeuchi Y, Levi T. BiœmuS: A new tool for neurological disorders studies through real-time emulation and hybridization using biomimetic Spiking Neural Network. Nat Commun 2024; 15:5142. [PMID: 38902236 PMCID: PMC11190274 DOI: 10.1038/s41467-024-48905-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Accepted: 05/15/2024] [Indexed: 06/22/2024] Open
Abstract
Characterization and modeling of biological neural networks has emerged as a field driving significant advancements in our understanding of brain function and related pathologies. As of today, pharmacological treatments for neurological disorders remain limited, pushing the exploration of promising alternative approaches such as electroceutics. Recent research in bioelectronics and neuromorphic engineering have fostered the development of the new generation of neuroprostheses for brain repair. However, achieving their full potential necessitates a deeper understanding of biohybrid interaction. In this study, we present a novel real-time, biomimetic, cost-effective and user-friendly neural network capable of real-time emulation for biohybrid experiments. Our system facilitates the investigation and replication of biophysically detailed neural network dynamics while prioritizing cost-efficiency, flexibility and ease of use. We showcase the feasibility of conducting biohybrid experiments using standard biophysical interfaces and a variety of biological cells as well as real-time emulation of diverse network configurations. We envision our system as a crucial step towards the development of neuromorphic-based neuroprostheses for bioelectrical therapeutics, enabling seamless communication with biological networks on a comparable timescale. Its embedded real-time functionality enhances practicality and accessibility, amplifying its potential for real-world applications in biohybrid experiments.
Collapse
Affiliation(s)
- Romain Beaubois
- IMS, CNRS UMR5218, Bordeaux INP, University of Bordeaux, Talence, France
- Institute of Industrial Science, The University of Tokyo, Tokyo, Japan
- LIMMS, CNRS-Institute of Industrial Science, UMI 2820, The University of Tokyo, Tokyo, Japan
| | - Jérémy Cheslet
- IMS, CNRS UMR5218, Bordeaux INP, University of Bordeaux, Talence, France
- Institute of Industrial Science, The University of Tokyo, Tokyo, Japan
- LIMMS, CNRS-Institute of Industrial Science, UMI 2820, The University of Tokyo, Tokyo, Japan
| | - Tomoya Duenki
- Institute of Industrial Science, The University of Tokyo, Tokyo, Japan
- LIMMS, CNRS-Institute of Industrial Science, UMI 2820, The University of Tokyo, Tokyo, Japan
- Department of Chemistry and Biotechnology, Graduate School of Engineering, The University of Tokyo, Tokyo, Japan
- Institute for AI and Beyond, The University of Tokyo, Tokyo, Japan
| | | | - Marta Carè
- DIBRIS, University of Genova, Genova, Italy
- IRCCS Ospedale Policlinico San Martino, Genova, Italy
- Rehab Technologies, Istituto Italiano di Tecnologia, Genova, Italy
| | - Farad Khoyratee
- IMS, CNRS UMR5218, Bordeaux INP, University of Bordeaux, Talence, France
| | - Michela Chiappalone
- DIBRIS, University of Genova, Genova, Italy
- IRCCS Ospedale Policlinico San Martino, Genova, Italy
- Rehab Technologies, Istituto Italiano di Tecnologia, Genova, Italy
| | | | - Yoshiho Ikeuchi
- Institute of Industrial Science, The University of Tokyo, Tokyo, Japan
- LIMMS, CNRS-Institute of Industrial Science, UMI 2820, The University of Tokyo, Tokyo, Japan
- Institute for AI and Beyond, The University of Tokyo, Tokyo, Japan
| | - Timothée Levi
- IMS, CNRS UMR5218, Bordeaux INP, University of Bordeaux, Talence, France.
| |
Collapse
|
23
|
Wang R, Chen ZS. Large-scale foundation models and generative AI for BigData neuroscience. Neurosci Res 2024:S0168-0102(24)00075-0. [PMID: 38897235 DOI: 10.1016/j.neures.2024.06.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2023] [Revised: 04/15/2024] [Accepted: 05/15/2024] [Indexed: 06/21/2024]
Abstract
Recent advances in machine learning have led to revolutionary breakthroughs in computer games, image and natural language understanding, and scientific discovery. Foundation models and large-scale language models (LLMs) have recently achieved human-like intelligence thanks to BigData. With the help of self-supervised learning (SSL) and transfer learning, these models may potentially reshape the landscapes of neuroscience research and make a significant impact on the future. Here we present a mini-review on recent advances in foundation models and generative AI models as well as their applications in neuroscience, including natural language and speech, semantic memory, brain-machine interfaces (BMIs), and data augmentation. We argue that this paradigm-shift framework will open new avenues for many neuroscience research directions and discuss the accompanying challenges and opportunities.
Collapse
Affiliation(s)
- Ran Wang
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, USA
| | - Zhe Sage Chen
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, USA; Department of Neuroscience and Physiology, Neuroscience Institute, New York University Grossman School of Medicine, New York, NY 10016, USA; Department of Biomedical Engineering, New York University Tandon School of Engineering, Brooklyn, NY 11201, USA.
| |
Collapse
|
24
|
Soldado-Magraner J, Antonietti A, French J, Higgins N, Young MJ, Larrivee D, Monteleone R. Applying the IEEE BRAIN neuroethics framework to intra-cortical brain-computer interfaces. J Neural Eng 2024; 21:022001. [PMID: 38537269 DOI: 10.1088/1741-2552/ad3852] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Accepted: 03/27/2024] [Indexed: 04/05/2024]
Abstract
Objective. Brain-computer interfaces (BCIs) are neuroprosthetic devices that allow for direct interaction between brains and machines. These types of neurotechnologies have recently experienced a strong drive in research and development, given, in part, that they promise to restore motor and communication abilities in individuals experiencing severe paralysis. While a rich literature analyzes the ethical, legal, and sociocultural implications (ELSCI) of these novel neurotechnologies, engineers, clinicians and BCI practitioners often do not have enough exposure to these topics.Approach. Here, we present the IEEE Neuroethics Framework, an international, multiyear, iterative initiative aimed at developing a robust, accessible set of considerations for diverse stakeholders.Main results. Using the framework, we provide practical examples of ELSCI considerations for BCI neurotechnologies. We focus on invasive technologies, and in particular, devices that are implanted intra-cortically for medical research applications.Significance. We demonstrate the utility of our framework in exposing a wide range of implications across different intra-cortical BCI technology modalities and conclude with recommendations on how to utilize this knowledge in the development and application of ethical guidelines for BCI neurotechnologies.
Collapse
Affiliation(s)
- Joana Soldado-Magraner
- Department of Electrical and Computer Engineering and the Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, United States of America
| | - Alberto Antonietti
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milano 20131, Italy
| | - Jennifer French
- Neurotech Network, St. Petersburg, FL 33733, United States of America
| | - Nathan Higgins
- School of Psychological Sciences, Monash University, Clayton, VIC 3800, Australia
| | - Michael J Young
- Department of Neurology, Massachusetts General Hospital and Harvard Medical School, Boston, MA 02114, United States of America
| | - Denis Larrivee
- Mind and Brain Institute, University of Navarra Medical School, Pamplona, Navarra 31008, Spain
- Loyola University, Chicago, IL 60611, United States of America
| | - Rebecca Monteleone
- Disability Studies Program, University of Toledo, Toledo, OH 43606, United States of America
| |
Collapse
|
25
|
Jang M, Hays M, Yu WH, Lee C, Caragiulo P, Ramkaj A, Wang P, Phillips AJ, Vitale N, Tandon P, Yan P, Mak PI, Chae Y, Chichilnisky EJ, Murmann B, Muratore DG. A 1024-Channel 268 nW/pixel 36×36 μm 2/channel Data-Compressive Neural Recording IC for High-Bandwidth Brain-Computer Interfaces. IEEE JOURNAL OF SOLID-STATE CIRCUITS 2024; 59:1123-1136. [PMID: 39391047 PMCID: PMC11463976 DOI: 10.1109/jssc.2023.3344798] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/12/2024]
Abstract
This paper presents a data-compressive neural recording IC for single-cell resolution high-bandwidth brain-computer interfaces. The IC features wired-OR lossy compression during digitization, thus preventing data deluge and massive data movement. By discarding unwanted baseline samples of the neural signals, the output data rate is reduced by 146× on average while allowing the reconstruction of spike samples. The recording array consists of pulse position modulation-based active digital pixels with a global single-slope analog-to-digital conversion scheme, which enables a low-power and compact pixel design with significantly simple routing and low array readout energy. Fabricated in a 28-nm CMOS process, the neural recording IC features 1024 channels (i.e., 32 × 32 array) with a pixel pitch of 36 μm that can be directly matched to a high-density microelectrode array. The pixel achieves 7.4 μVrms input-referred noise with a -3 dB bandwidth of 300-Hz to 5-kHz while consuming only 268 nW from a single 1-V supply. The IC achieves the smallest area per channel (36 × 36 μm2) and the highest energy efficiency among the state-of-the-art neural recording ICs published to date.
Collapse
Affiliation(s)
- MoonHyung Jang
- Department of Electrical Engineering, Stanford University, CA 94305 USA
| | - Maddy Hays
- Department of Bioengineering, Stanford University, CA 94305 USA
| | - Wei-Han Yu
- Institute of Microelectronics, University of Macau, Avenida da Universidade, Taipa, Macau, China
| | - Changuk Lee
- Department of Electrical Engineering and Computer Sciences, University of California Berkeley, CA 94720, USA
| | - Pietro Caragiulo
- Department of Electrical Engineering, Stanford University, CA 94305 USA
| | - Athanasios Ramkaj
- Department of Electrical Engineering, Stanford University, CA 94305 USA
| | - Pingyu Wang
- Department of Materials Science and Engineering, Stanford University, CA 94305 USA
| | - A J Phillips
- Department of Electrical Engineering, Stanford University, CA 94305 USA
| | - Nick Vitale
- Department of Electrical Engineering, Stanford University, CA 94305 USA
| | - Pulkit Tandon
- Department of Electrical Engineering, Stanford University, CA 94305 USA
| | - Pumiao Yan
- Department of Electrical Engineering, Stanford University, CA 94305 USA
| | - Pui-In Mak
- Institute of Microelectronics, University of Macau, Avenida da Universidade, Taipa, Macau, China
| | - Youngcheol Chae
- Department of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, South Korea
| | - E J Chichilnisky
- Hansen Experimental Physics Laboratory, Department of Neurosurgery and Ophthalmology, Stanford University, CA 94305 USA
| | - Boris Murmann
- Department of Electrical Engineering, Stanford University; Department of Electrical & Computer Engineering, University of Hawaii at Mānoa, HI 96822
| | - Dante G Muratore
- Department of Microelectronics, Delft University of Technology, Delft, The Netherlands
| |
Collapse
|
26
|
Alsuradi H, Khattak A, Fakhry A, Eid M. Individual-finger motor imagery classification: a data-driven approach with Shapley-informed augmentation. J Neural Eng 2024; 21:026013. [PMID: 38479013 DOI: 10.1088/1741-2552/ad33b3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2023] [Accepted: 03/13/2024] [Indexed: 03/23/2024]
Abstract
Objective. Classifying motor imagery (MI) tasks that involve fine motor control of the individual five fingers presents unique challenges when utilizing electroencephalography (EEG) data. In this paper, we systematically assess the classification of MI functions for the individual five fingers using single-trial time-domain EEG signals. This assessment encompasses both within-subject and cross-subject scenarios, supported by data-driven analysis that provides statistical validation of the neural correlate that could potentially discriminate between the five fingers.Approach. We present Shapley-informed augmentation, an informed approach to enhance within-subject classification accuracy. This method is rooted in insights gained from our data-driven analysis, which revealed inconsistent temporal features encoding the five fingers MI across sessions of the same subject. To evaluate its impact, we compare within-subject classification performance both before and after implementing this augmentation technique.Main results. Both the data-driven approach and the model explainability analysis revealed that the parietal cortex contains neural information that helps discriminate the individual five fingers' MI apart. Shapley-informed augmentation successfully improved classification accuracy in sessions severely affected by inconsistent temporal features. The accuracy for sessions impacted by inconsistency in their temporal features increased by an average of26.3%±6.70, thereby enabling a broader range of subjects to benefit from brain-computer interaction (BCI) applications involving five-fingers MI classification. Conversely, non-impacted sessions experienced only a negligible average accuracy decrease of2.01±5.44%. The average classification accuracy achieved is around 60.0% (within-session), 50.0% (within-subject) and 40.0% (leave-one-subject-out).Significance. This research offers data-driven evidence of neural correlates that could discriminate between the individual five fingers MI and introduces a novel Shapley-informed augmentation method to address temporal variability of features, ultimately contributing to the development of personalized systems.
Collapse
Affiliation(s)
- Haneen Alsuradi
- Engineering Division, New York University Abu Dhabi, Saadiyat Island, Abu Dhabi 129188, United Arab Emirates
| | - Arshiya Khattak
- Engineering Division, New York University Abu Dhabi, Saadiyat Island, Abu Dhabi 129188, United Arab Emirates
| | - Ali Fakhry
- Engineering Division, New York University Abu Dhabi, Saadiyat Island, Abu Dhabi 129188, United Arab Emirates
| | - Mohamad Eid
- Engineering Division, New York University Abu Dhabi, Saadiyat Island, Abu Dhabi 129188, United Arab Emirates
| |
Collapse
|
27
|
Mendoza-Halliday D, Major AJ, Lee N, Lichtenfeld MJ, Carlson B, Mitchell B, Meng PD, Xiong YS, Westerberg JA, Jia X, Johnston KD, Selvanayagam J, Everling S, Maier A, Desimone R, Miller EK, Bastos AM. A ubiquitous spectrolaminar motif of local field potential power across the primate cortex. Nat Neurosci 2024; 27:547-560. [PMID: 38238431 PMCID: PMC10917659 DOI: 10.1038/s41593-023-01554-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Accepted: 12/13/2023] [Indexed: 03/08/2024]
Abstract
The mammalian cerebral cortex is anatomically organized into a six-layer motif. It is currently unknown whether a corresponding laminar motif of neuronal activity patterns exists across the cortex. Here we report such a motif in the power of local field potentials (LFPs). Using laminar probes, we recorded LFPs from 14 cortical areas across the cortical hierarchy in five macaque monkeys. The laminar locations of recordings were histologically identified by electrolytic lesions. Across all areas, we found a ubiquitous spectrolaminar pattern characterized by an increasing deep-to-superficial layer gradient of high-frequency power peaking in layers 2/3 and an increasing superficial-to-deep gradient of alpha-beta power peaking in layers 5/6. Laminar recordings from additional species showed that the spectrolaminar pattern is highly preserved among primates-macaque, marmoset and human-but more dissimilar in mouse. Our results suggest the existence of a canonical layer-based and frequency-based mechanism for cortical computation.
Collapse
Affiliation(s)
- Diego Mendoza-Halliday
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA.
| | - Alex James Major
- The Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Noah Lee
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | | | - Brock Carlson
- Department of Psychology, Vanderbilt University, Nashville, TN, USA
- Vanderbilt Vision Research Center, Vanderbilt University, Nashville, TN, USA
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA
| | - Blake Mitchell
- Department of Psychology, Vanderbilt University, Nashville, TN, USA
- Vanderbilt Vision Research Center, Vanderbilt University, Nashville, TN, USA
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA
| | - Patrick D Meng
- Department of Psychology, Vanderbilt University, Nashville, TN, USA
| | - Yihan Sophy Xiong
- Department of Psychology, Vanderbilt University, Nashville, TN, USA
- Vanderbilt Vision Research Center, Vanderbilt University, Nashville, TN, USA
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA
| | - Jacob A Westerberg
- Department of Psychology, Vanderbilt University, Nashville, TN, USA
- Vanderbilt Vision Research Center, Vanderbilt University, Nashville, TN, USA
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA
- Department of Vision and Cognition, Netherlands Institute for Neuroscience, Royal Netherlands Academy of Arts and Sciences, Amsterdam, The Netherlands
| | - Xiaoxuan Jia
- School of Life Sciences, Tsinghua University, Beijing, China
- IDG/McGovern Institute for Brain Research, Tsinghua University, Beijing, China
| | - Kevin D Johnston
- Graduate Program in Neuroscience, Western University, London, ON, Canada
- Centre for Functional and Metabolic Mapping, Robarts Research Institute, University of Western Ontario, London, ON, Canada
- Department of Physiology and Pharmacology, University of Western Ontario, London, ON, Canada
| | - Janahan Selvanayagam
- Graduate Program in Neuroscience, Western University, London, ON, Canada
- Centre for Functional and Metabolic Mapping, Robarts Research Institute, University of Western Ontario, London, ON, Canada
| | - Stefan Everling
- Graduate Program in Neuroscience, Western University, London, ON, Canada
- Centre for Functional and Metabolic Mapping, Robarts Research Institute, University of Western Ontario, London, ON, Canada
- Department of Physiology and Pharmacology, University of Western Ontario, London, ON, Canada
| | - Alexander Maier
- Department of Psychology, Vanderbilt University, Nashville, TN, USA
- Vanderbilt Vision Research Center, Vanderbilt University, Nashville, TN, USA
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA
| | - Robert Desimone
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Earl K Miller
- The Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - André M Bastos
- Department of Psychology, Vanderbilt University, Nashville, TN, USA.
- Vanderbilt Vision Research Center, Vanderbilt University, Nashville, TN, USA.
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA.
| |
Collapse
|
28
|
Sengupta P, Lakshminarayanan K. Cortical activation and BCI performance during brief tactile imagery: A comparative study with motor imagery. Behav Brain Res 2024; 459:114760. [PMID: 37979923 DOI: 10.1016/j.bbr.2023.114760] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Revised: 11/06/2023] [Accepted: 11/11/2023] [Indexed: 11/20/2023]
Abstract
Brain-computer interfaces (BCIs) rely heavily on motor imagery (MI) for operation, yet tactile imagery (TI) presents a novel approach that may be advantageous in situations where visual feedback is impractical. The current study aimed to compare the cortical activity and digit classification performance induced by TI and MI to assess the viability of TI for use in BCIs. Twelve right-handed participants engaged in trials of TI and MI, focusing on their left and right index digits. Event-related desynchronization (ERD) in the mu and beta bands was analyzed, and classification accuracy was determined through an artificial neural network (ANN). Comparable ERD patterns were observed in both TI and MI, with significant decreases in ERD during imagery tasks. The ANN demonstrated high classification accuracy, with TI achieving a mean±SD of 79.30 ± 3.91 % and MI achieving 81.10 ± 2.96 %, with no significant difference between the two (p = 0.11). The study found that TI induces substantial ERD comparable to MI and maintains high classification accuracy, supporting its potential as an effective mental strategy for BCIs. This suggests that TI could be a valuable alternative in BCI applications, particularly for individuals unable to rely on visual cues.
Collapse
Affiliation(s)
- Puja Sengupta
- Neuro-Rehabilitation Lab, Department of Sensors and Biomedical Technology, School of Electronics Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India
| | - Kishor Lakshminarayanan
- Neuro-Rehabilitation Lab, Department of Sensors and Biomedical Technology, School of Electronics Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India.
| |
Collapse
|
29
|
Holt MW, Robinson EC, Shlobin NA, Hanson JT, Bozkurt I. Intracortical brain-computer interfaces for improved motor function: a systematic review. Rev Neurosci 2024; 35:213-223. [PMID: 37845811 DOI: 10.1515/revneuro-2023-0077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2023] [Accepted: 09/23/2023] [Indexed: 10/18/2023]
Abstract
In this systematic review, we address the status of intracortical brain-computer interfaces (iBCIs) applied to the motor cortex to improve function in patients with impaired motor ability. This study followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 Guidelines for Systematic Reviews. Risk Of Bias In Non-randomized Studies - of Interventions (ROBINS-I) and the Effective Public Health Practice Project (EPHPP) were used to assess bias and quality. Advances in iBCIs in the last two decades demonstrated the use of iBCI to activate limbs for functional tasks, achieve neural typing for communication, and other applications. However, the inconsistency of performance metrics employed by these studies suggests the need for standardization. Each study was a pilot clinical trial consisting of 1-4, majority male (64.28 %) participants, with most trials featuring participants treated for more than 12 months (55.55 %). The systems treated patients with various conditions: amyotrophic lateral sclerosis, stroke, spinocerebellar degeneration without cerebellar involvement, and spinal cord injury. All participants presented with tetraplegia at implantation and were implanted with microelectrode arrays via pneumatic insertion, with nearly all electrode locations solely at the precentral gyrus of the motor cortex (88.88 %). The development of iBCI devices using neural signals from the motor cortex to improve motor-impaired patients has enhanced the ability of these systems to return ability to their users. However, many milestones remain before these devices can prove their feasibility for recovery. This review summarizes the achievements and shortfalls of these systems and their respective trials.
Collapse
Affiliation(s)
- Matthew W Holt
- Department of Natural Sciences, University of South Carolina Beaufort, 1 University Blvd, Bluffton, 29909, USA
| | | | - Nathan A Shlobin
- Department of Neurological Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, USA
| | - Jacob T Hanson
- Rocky Vista University College of Osteopathic Medicine, Englewood, CO 80112, USA
| | - Ismail Bozkurt
- Department of Neurosurgery, School of Medicine, Yuksek Ihtisas University, 06530 Ankara, Türkiye
- Department of Neurosurgery, Medical Park Ankara Hospital, 06680 Ankara, Türkiye
| |
Collapse
|
30
|
Richie J, Letner JG, Mclane-Svoboda A, Huan Y, Ghaffari DH, Valle ED, Patel PR, Chiel HJ, Pelled G, Weiland JD, Chestek CA. Fabrication and Validation of Sub-Cellular Carbon Fiber Electrodes. IEEE Trans Neural Syst Rehabil Eng 2024; 32:739-749. [PMID: 38294928 PMCID: PMC10919889 DOI: 10.1109/tnsre.2024.3360866] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2024]
Abstract
Multielectrode arrays for interfacing with neurons are of great interest for a wide range of medical applications. However, current electrodes cause damage over time. Ultra small carbon fibers help to address issues but controlling the electrode site geometry is difficult. Here we propose a methodology to create small, pointed fiber electrodes (SPFe). We compare the SPFe to previously made blowtorched fibers in characterization. The SPFe result in small site sizes [Formula: see text] with consistently sharp points (20.8 ± 7.64°). Additionally, these electrodes were able to record and/or stimulate neurons multiple animal models including rat cortex, mouse retina, Aplysia ganglia and octopus axial cord. In rat cortex, these electrodes recorded significantly higher peak amplitudes than the traditional blowtorched fibers. These SPFe may be applicable to a wide range of applications requiring a highly specific interface with individual neurons.
Collapse
|
31
|
Shokri M, Gogliettino AR, Hottowy P, Sher A, Litke AM, Chichilnisky EJ, Pequito S, Muratore D. Spike sorting in the presence of stimulation artifacts: a dynamical control systems approach. J Neural Eng 2024; 21:016022. [PMID: 38271715 PMCID: PMC10853761 DOI: 10.1088/1741-2552/ad228f] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Revised: 11/08/2023] [Accepted: 01/25/2024] [Indexed: 01/27/2024]
Abstract
Objective. Bi-directional electronic neural interfaces, capable of both electrical recording and stimulation, communicate with the nervous system to permit precise calibration of electrical inputs by capturing the evoked neural responses. However, one significant challenge is that stimulation artifacts often mask the actual neural signals. To address this issue, we introduce a novel approach that employs dynamical control systems to detect and decipher electrically evoked neural activity despite the presence of electrical artifacts.Approach. Our proposed method leverages the unique spatiotemporal patterns of neural activity and electrical artifacts to distinguish and identify individual neural spikes. We designed distinctive dynamical models for both the stimulation artifact and each neuron observed during spontaneous neural activity. We can estimate which neurons were active by analyzing the recorded voltage responses across multiple electrodes post-stimulation. This technique also allows us to exclude signals from electrodes heavily affected by stimulation artifacts, such as the stimulating electrode itself, yet still accurately differentiate between evoked spikes and electrical artifacts.Main results. We applied our method to high-density multi-electrode recordings from the primate retina in anex vivosetup, using a grid of 512 electrodes. Through repeated electrical stimulations at varying amplitudes, we were able to construct activation curves for each neuron. The curves obtained with our method closely resembled those derived from manual spike sorting. Additionally, the stimulation thresholds we estimated strongly agreed with those determined through manual analysis, demonstrating high reliability (R2=0.951for human 1 andR2=0.944for human 2).Significance. Our method can effectively separate evoked neural spikes from stimulation artifacts by exploiting the distinct spatiotemporal propagation patterns captured by a dense, large-scale multi-electrode array. This technique holds promise for future applications in real-time closed-loop stimulation systems and for managing multi-channel stimulation strategies.
Collapse
Affiliation(s)
- Mohammad Shokri
- Delft Center for Systems and Control, Delft University of Technology, Delft 2628 CN, The Netherlands
| | - Alex R Gogliettino
- Neurosciences PhD Program, Stanford University, Stanford, CA 94305, United States of America
- Hansen Experimental Physics Laboratory, Stanford University, Stanford, CA 94305, United States of America
| | - Paweł Hottowy
- Faculty of Physics and Applied Computer Science, AGH University of Krakow, Krakow, Poland
| | - Alexander Sher
- Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, CA, United States of America
| | - Alan M Litke
- Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, CA, United States of America
| | - E J Chichilnisky
- Departments of Neurosurgery and Ophthalmology, Stanford University, Stanford, CA 94305, United States of America
| | - Sérgio Pequito
- Division of Systems and Control, Department of Information Technology, Uppsala University, 751 05 Uppsala, Sweden
| | - Dante Muratore
- Microelectronics Department, Delft University of Technology, Delft 2628 CN, The Netherlands
| |
Collapse
|
32
|
Londei F, Arena G, Ferrucci L, Russo E, Ceccarelli F, Genovesio A. Connecting the dots in the zona incerta: A study of neural assemblies and motifs of inter-area coordination in mice. iScience 2024; 27:108761. [PMID: 38274403 PMCID: PMC10808920 DOI: 10.1016/j.isci.2023.108761] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Revised: 10/23/2023] [Accepted: 11/11/2023] [Indexed: 01/27/2024] Open
Abstract
The zona incerta (ZI), a subthalamic area connected to numerous brain regions, has raised clinical interest because its stimulation alleviates the motor symptoms of Parkinson's disease. To explore its coordinative nature, we studied the assembly formation in a dataset of neural recordings in mice and quantified the degree of functional coordination of ZI with other 24 brain areas. We found that the ZI is a highly integrative area. The analysis in terms of "loop-like" motifs, directional assemblies composed of three neurons spanning two areas, has revealed reciprocal functional interactions with reentrant signals that, in most cases, start and end with the activation of ZI units. In support of its proposed integrative role, we found that almost one-third of the ZI's neurons formed assemblies with more than half of the other recorded areas and that loop-like assemblies may stand out as hyper-integrative motifs compared to other types of activation patterns.
Collapse
Affiliation(s)
- Fabrizio Londei
- Department of Physiology and Pharmacology, Sapienza University of Rome, Piazzale Aldo Moro 5, 00185 Rome, Italy
- PhD Program in Behavioral Neuroscience, Sapienza University of Rome, Rome, Italy
| | - Giulia Arena
- Department of Physiology and Pharmacology, Sapienza University of Rome, Piazzale Aldo Moro 5, 00185 Rome, Italy
- PhD Program in Behavioral Neuroscience, Sapienza University of Rome, Rome, Italy
| | - Lorenzo Ferrucci
- Department of Physiology and Pharmacology, Sapienza University of Rome, Piazzale Aldo Moro 5, 00185 Rome, Italy
| | - Eleonora Russo
- The BioRobotics Institute, Department of Excellence in Robotics and AI, Scuola Superiore Sant’Anna, 56127 Pisa, Italy
| | - Francesco Ceccarelli
- Department of Physiology and Pharmacology, Sapienza University of Rome, Piazzale Aldo Moro 5, 00185 Rome, Italy
| | - Aldo Genovesio
- Department of Physiology and Pharmacology, Sapienza University of Rome, Piazzale Aldo Moro 5, 00185 Rome, Italy
| |
Collapse
|
33
|
Abbaspourazad H, Erturk E, Pesaran B, Shanechi MM. Dynamical flexible inference of nonlinear latent factors and structures in neural population activity. Nat Biomed Eng 2024; 8:85-108. [PMID: 38082181 DOI: 10.1038/s41551-023-01106-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2022] [Accepted: 09/12/2023] [Indexed: 12/26/2023]
Abstract
Modelling the spatiotemporal dynamics in the activity of neural populations while also enabling their flexible inference is hindered by the complexity and noisiness of neural observations. Here we show that the lower-dimensional nonlinear latent factors and latent structures can be computationally modelled in a manner that allows for flexible inference causally, non-causally and in the presence of missing neural observations. To enable flexible inference, we developed a neural network that separates the model into jointly trained manifold and dynamic latent factors such that nonlinearity is captured through the manifold factors and the dynamics can be modelled in tractable linear form on this nonlinear manifold. We show that the model, which we named 'DFINE' (for 'dynamical flexible inference for nonlinear embeddings') achieves flexible inference in simulations of nonlinear dynamics and across neural datasets representing a diversity of brain regions and behaviours. Compared with earlier neural-network models, DFINE enables flexible inference, better predicts neural activity and behaviour, and better captures the latent neural manifold structure. DFINE may advance the development of neurotechnology and investigations in neuroscience.
Collapse
Affiliation(s)
- Hamidreza Abbaspourazad
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, USA
| | - Eray Erturk
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, USA
| | - Bijan Pesaran
- Departments of Neurosurgery, Neuroscience, and Bioengineering, University of Pennsylvania, Philadelphia, PA, USA
| | - Maryam M Shanechi
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, USA.
- Thomas Lord Department of Computer Science, Alfred E. Mann Department of Biomedical Engineering, Neuroscience Graduate Program, University of Southern California, Los Angeles, CA, USA.
| |
Collapse
|
34
|
Zhang M, Zhu F, Jia F, Wu Y, Wang B, Gao L, Chu F, Tang W. Efficacy of brain-computer interfaces on upper extremity motor function rehabilitation after stroke: A systematic review and meta-analysis. NeuroRehabilitation 2024; 54:199-212. [PMID: 38143387 DOI: 10.3233/nre-230215] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2023]
Abstract
BACKGROUND The recovery of upper limb function is crucial to the daily life activities of stroke patients. Brain-computer interface technology may have potential benefits in treating upper limb dysfunction. OBJECTIVE To systematically evaluate the efficacy of brain-computer interfaces (BCI) in the rehabilitation of upper limb motor function in stroke patients. METHODS Six databases up to July 2023 were reviewed according to the PRSIMA guidelines. Randomized controlled trials of BCI-based upper limb functional rehabilitation for stroke patients were selected for meta-analysis by pooling standardized mean difference (SMD) to summarize the evidence. The Cochrane risk of bias tool was used to assess the methodological quality of the included studies. RESULTS Twenty-five studies were included. The studies showed that BCI had a small effect on the improvement of upper limb function after the intervention. In terms of total duration of training, < 12 hours of training may result in better rehabilitation, but training duration greater than 12 hours suggests a non significant therapeutic effect of BCI training. CONCLUSION This meta-analysis suggests that BCI has a slight efficacy in improving upper limb function and has favorable long-term outcomes. In terms of total duration of training, < 12 hours of training may lead to better rehabilitation.
Collapse
Affiliation(s)
- Ming Zhang
- Department of Mechatronic Engineering, China University of Mining and Technology, Jiangsu, China
- The Affiliated Xuzhou Rehabilitation Hospital of Xuzhou Medical University, Xuzhou Medical University, Jiangsu, China
| | - Feilong Zhu
- College of Physical Education and Sports, Beijing Normal University, Beijing, China
| | - Fan Jia
- The Affiliated Xuzhou Rehabilitation Hospital of Xuzhou Medical University, Xuzhou Medical University, Jiangsu, China
| | - Yu Wu
- Department of Sports and Exercise Science, Zhejiang University, Hangzhou, China
| | - Bin Wang
- Departments of Rehabilitation Medicine, the Second Affiliated Hospital of Xi'an Jiaotong University, Xi'an, China
| | - Ling Gao
- The Affiliated Xuzhou Rehabilitation Hospital of Xuzhou Medical University, Xuzhou Medical University, Jiangsu, China
| | - Fengming Chu
- The Affiliated Xuzhou Rehabilitation Hospital of Xuzhou Medical University, Xuzhou Medical University, Jiangsu, China
| | - Wei Tang
- Department of Mechatronic Engineering, China University of Mining and Technology, Jiangsu, China
| |
Collapse
|
35
|
Abstract
Efforts to design devices emulating complex cognitive abilities and response processes of biological systems have long been a coveted goal. Recent advancements in flexible electronics, mirroring human tissue's mechanical properties, hold significant promise. Artificial neuron devices, hinging on flexible artificial synapses, bioinspired sensors, and actuators, are meticulously engineered to mimic the biological systems. However, this field is in its infancy, requiring substantial groundwork to achieve autonomous systems with intelligent feedback, adaptability, and tangible problem-solving capabilities. This review provides a comprehensive overview of recent advancements in artificial neuron devices. It starts with fundamental principles of artificial synaptic devices and explores artificial sensory systems, integrating artificial synapses and bioinspired sensors to replicate all five human senses. A systematic presentation of artificial nervous systems follows, designed to emulate fundamental human nervous system functions. The review also discusses potential applications and outlines existing challenges, offering insights into future prospects. We aim for this review to illuminate the burgeoning field of artificial neuron devices, inspiring further innovation in this captivating area of research.
Collapse
Affiliation(s)
- Ke He
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798, Singapore
| | - Cong Wang
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798, Singapore
| | - Yongli He
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798, Singapore
| | - Jiangtao Su
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798, Singapore
| | - Xiaodong Chen
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798, Singapore
- Institute for Digital Molecular Analytics and Science (IDMxS), Nanyang Technological University, 59 Nanyang Drive, Singapore 636921, Singapore
| |
Collapse
|
36
|
Hooks K, El-Said R, Fu Q. Decoding reach-to-grasp from EEG using classifiers trained with data from the contralateral limb. Front Hum Neurosci 2023; 17:1302647. [PMID: 38021246 PMCID: PMC10663285 DOI: 10.3389/fnhum.2023.1302647] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Accepted: 10/25/2023] [Indexed: 12/01/2023] Open
Abstract
Fundamental to human movement is the ability to interact with objects in our environment. How one reaches an object depends on the object's shape and intended interaction afforded by the object, e.g., grasp and transport. Extensive research has revealed that the motor intention of reach-to-grasp can be decoded from cortical activities using EEG signals. The goal of the present study is to determine the extent to which information encoded in the EEG signals is shared between two limbs to enable cross-hand decoding. We performed an experiment in which human subjects (n = 10) were tasked to interact with a novel object with multiple affordances using either right or left hands. The object had two vertical handles attached to a horizontal base. A visual cue instructs what action (lift or touch) and whether the left or right handle should be used for each trial. EEG was recorded and processed from bilateral frontal-central-parietal regions (30 channels). We trained LDA classifiers using data from trials performed by one limb and tested the classification accuracy using data from trials performed by the contralateral limb. We found that the type of hand-object interaction can be decoded with approximately 59 and 69% peak accuracy in the planning and execution stages, respectively. Interestingly, the decoding accuracy of the reaching directions was dependent on how EEG channels in the testing dataset were spatially mirrored, and whether directions were labeled in the extrinsic (object-centered) or intrinsic (body-centered) coordinates.
Collapse
Affiliation(s)
- Kevin Hooks
- Mechanical and Aerospace Engineering, University of Central Florida, Orlando, FL, United States
| | - Refaat El-Said
- College of Medicine, University of Central Florida, Orlando, FL, United States
| | - Qiushi Fu
- Mechanical and Aerospace Engineering, University of Central Florida, Orlando, FL, United States
- Biionix Cluster, University of Central Florida, Orlando, FL, United States
| |
Collapse
|
37
|
Lai C, Tanaka S, Harris TD, Lee AK. Volitional activation of remote place representations with a hippocampal brain-machine interface. Science 2023; 382:566-573. [PMID: 37917713 PMCID: PMC10683874 DOI: 10.1126/science.adh5206] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Accepted: 09/22/2023] [Indexed: 11/04/2023]
Abstract
The hippocampus is critical for recollecting and imagining experiences. This is believed to involve voluntarily drawing from hippocampal memory representations of people, events, and places, including maplike representations of familiar environments. However, whether representations in such "cognitive maps" can be volitionally accessed is unknown. We developed a brain-machine interface to test whether rats can do so by controlling their hippocampal activity in a flexible, goal-directed, and model-based manner. We found that rats can efficiently navigate or direct objects to arbitrary goal locations within a virtual reality arena solely by activating and sustaining appropriate hippocampal representations of remote places. This provides insight into the mechanisms underlying episodic memory recall, mental simulation and planning, and imagination and opens up possibilities for high-level neural prosthetics that use hippocampal representations.
Collapse
Affiliation(s)
- Chongxi Lai
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, Virginia, USA
| | - Shinsuke Tanaka
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, Virginia, USA
| | - Timothy D. Harris
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, Virginia, USA
| | - Albert K. Lee
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, Virginia, USA
- Howard Hughes Medical Institute and Department of Neurology, Beth Israel Deaconess Medical Center, Boston, MA, USA
| |
Collapse
|
38
|
Zhang X, Chen S, Wang Y. Kernel Reinforcement Learning-Assisted Adaptive Decoder Facilitates Stable and Continuous Brain Control Tasks. IEEE Trans Neural Syst Rehabil Eng 2023; 31:4125-4134. [PMID: 37792657 DOI: 10.1109/tnsre.2023.3321756] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/06/2023]
Abstract
Brain-Machine Interfaces (BMIs) assist paralyzed people to brain control (BC) the neuro-prosthesis continuously moving in space. During the BC process, the subject imagines the movement of the real limb and adapts the brain activity according to the sensory feedback. The neural adaptation in the closed-loop control results in complex and changing brain signals. Simultaneously, the decoder interprets the time-varying functional mapping between neural activity and continuous trajectory. It is crucial and challenging to accurately and adaptively track the mapping to help the subject accomplish the BC task with a stable performance. Existing Kalman Filter (KF) based decoders achieve continuous trajectory control by linearly interpreting neural firing observations into self-evolving prosthetic states. However, the linear neural-state mapping might not accurately reflect the movement intention of the subject. In this paper, we propose a novel method that allows subjects to achieve continuous brain control efficiently and stably. The proposed method incorporates a kernel reinforcement learning method into a state-observation model to decode the nonlinearly neural observation into a continuous trajectory state. The state transition function ensures the continuity of the prosthetic state. The kernel reinforcement learning allows the quick adaptation of the nonlinear neural-movement mapping during the BC process. The proposed method is tested in an online brain control reaching task for rats. Compared with KF, our method achieved more successful trials, faster response time, shorter inter-trial time, and remained stable over days. These results demonstrate that the proposed method is an efficient tool to assist subjects in brain control tasks.
Collapse
|
39
|
Ma R, Chen YF, Jiang YC, Zhang M. A New Compound-Limbs Paradigm: Integrating Upper-Limb Swing Improves Lower-Limb Stepping Intention Decoding From EEG. IEEE Trans Neural Syst Rehabil Eng 2023; 31:3823-3834. [PMID: 37713229 DOI: 10.1109/tnsre.2023.3315717] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/16/2023]
Abstract
Brain-computer interface (BCI) systems based on spontaneous electroencephalography (EEG) hold the promise to implement human voluntary control of lower-extremity powered exoskeletons. However, current EEG-BCI paradigms do not consider the cooperation of upper and lower limbs during walking, which is inconsistent with natural human stepping patterns. To deal with this problem, this study proposed a stepping-matched human EEG-BCI paradigm that involved actions of both unilateral lower and contralateral upper limbs (also referred to as compound-limbs movement). Experiments were conducted in motor execution (ME) and motor imagery (MI) conditions to validate the feasibility. Common spatial pattern (CSP) proposed subject-specific CSP (SSCSP), and filter-bank CSP (FBCSP) methods were applied for feature extraction, respectively. The best average classification results based on SSCSP indicated that the accuracies of compound-limbs paradigms in ME and MI conditions achieved 89.02% ± 12.84% and 73.70% ± 12.47%, respectively. Although they were 2.03% and 5.68% lower than those of the single-upper-limb mode that does not match human stepping patterns, they were 24.30% and 11.02% higher than those of the single-lower-limb mode. These findings indicated that the proposed compound-limbs EEG-BCI paradigm is feasible for decoding human stepping intention and thus provides a potential way for natural human control of walking assistance devices.
Collapse
|
40
|
Chowdhury RR, Muhammad Y, Adeel U. Enhancing Cross-Subject Motor Imagery Classification in EEG-Based Brain-Computer Interfaces by Using Multi-Branch CNN. SENSORS (BASEL, SWITZERLAND) 2023; 23:7908. [PMID: 37765965 PMCID: PMC10536894 DOI: 10.3390/s23187908] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Revised: 08/23/2023] [Accepted: 09/11/2023] [Indexed: 09/29/2023]
Abstract
A brain-computer interface (BCI) is a computer-based system that allows for communication between the brain and the outer world, enabling users to interact with computers using neural activity. This brain signal is obtained from electroencephalogram (EEG) signals. A significant obstacle to the development of BCIs based on EEG is the classification of subject-independent motor imagery data since EEG data are very individualized. Deep learning techniques such as the convolutional neural network (CNN) have illustrated their influence on feature extraction to increase classification accuracy. In this paper, we present a multi-branch (five branches) 2D convolutional neural network that employs several hyperparameters for every branch. The proposed model achieved promising results for cross-subject classification and outperformed EEGNet, ShallowConvNet, DeepConvNet, MMCNN, and EEGNet_Fusion on three public datasets. Our proposed model, EEGNet Fusion V2, achieves 89.6% and 87.8% accuracy for the actual and imagined motor activity of the eegmmidb dataset and scores of 74.3% and 84.1% for the BCI IV-2a and IV-2b datasets, respectively. However, the proposed model has a bit higher computational cost, i.e., it takes around 3.5 times more computational time per sample than EEGNet_Fusion.
Collapse
Affiliation(s)
- Radia Rayan Chowdhury
- Department of Computing & Games, School of Computing, Engineering & Digital Technologies, Teesside University, Middlesbrough TS1 3BX, UK
| | - Yar Muhammad
- Department of Computing & Games, School of Computing, Engineering & Digital Technologies, Teesside University, Middlesbrough TS1 3BX, UK
- Department of Computer Science, School of Physics, Engineering & Computer Science, University of Hertfordshire, Hatfield AL10 9AB, UK
| | - Usman Adeel
- Department of Computing & Games, School of Computing, Engineering & Digital Technologies, Teesside University, Middlesbrough TS1 3BX, UK
| |
Collapse
|
41
|
Tian T, Zhang S, Yang M. Recent progress and challenges in the treatment of spinal cord injury. Protein Cell 2023; 14:635-652. [PMID: 36856750 PMCID: PMC10501188 DOI: 10.1093/procel/pwad003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Accepted: 12/29/2022] [Indexed: 02/12/2023] Open
Abstract
Spinal cord injury (SCI) disrupts the structural and functional connectivity between the higher center and the spinal cord, resulting in severe motor, sensory, and autonomic dysfunction with a variety of complications. The pathophysiology of SCI is complicated and multifaceted, and thus individual treatments acting on a specific aspect or process are inadequate to elicit neuronal regeneration and functional recovery after SCI. Combinatory strategies targeting multiple aspects of SCI pathology have achieved greater beneficial effects than individual therapy alone. Although many problems and challenges remain, the encouraging outcomes that have been achieved in preclinical models offer a promising foothold for the development of novel clinical strategies to treat SCI. In this review, we characterize the mechanisms underlying axon regeneration of adult neurons and summarize recent advances in facilitating functional recovery following SCI at both the acute and chronic stages. In addition, we analyze the current status, remaining problems, and realistic challenges towards clinical translation. Finally, we consider the future of SCI treatment and provide insights into how to narrow the translational gap that currently exists between preclinical studies and clinical practice. Going forward, clinical trials should emphasize multidisciplinary conversation and cooperation to identify optimal combinatorial approaches to maximize therapeutic benefit in humans with SCI.
Collapse
Affiliation(s)
- Ting Tian
- Ministry of Education Key Laboratory of Protein Science, Beijing Advanced Innovation Center for Structural Biology, Beijing Frontier Research Center for Biological Structure, School of Life Sciences, Tsinghua University, Beijing 100084, China
| | - Sensen Zhang
- Ministry of Education Key Laboratory of Protein Science, Beijing Advanced Innovation Center for Structural Biology, Beijing Frontier Research Center for Biological Structure, School of Life Sciences, Tsinghua University, Beijing 100084, China
| | - Maojun Yang
- Ministry of Education Key Laboratory of Protein Science, Beijing Advanced Innovation Center for Structural Biology, Beijing Frontier Research Center for Biological Structure, School of Life Sciences, Tsinghua University, Beijing 100084, China
- Cryo-EM Facility Center, Southern University of Science and Technology, Shenzhen 518055, China
| |
Collapse
|
42
|
Peelen MV, Downing PE. Testing cognitive theories with multivariate pattern analysis of neuroimaging data. Nat Hum Behav 2023; 7:1430-1441. [PMID: 37591984 PMCID: PMC7616245 DOI: 10.1038/s41562-023-01680-z] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Accepted: 07/12/2023] [Indexed: 08/19/2023]
Abstract
Multivariate pattern analysis (MVPA) has emerged as a powerful method for the analysis of functional magnetic resonance imaging, electroencephalography and magnetoencephalography data. The new approaches to experimental design and hypothesis testing afforded by MVPA have made it possible to address theories that describe cognition at the functional level. Here we review a selection of studies that have used MVPA to test cognitive theories from a range of domains, including perception, attention, memory, navigation, emotion, social cognition and motor control. This broad view reveals properties of MVPA that make it suitable for understanding the 'how' of human cognition, such as the ability to test predictions expressed at the item or event level. It also reveals limitations and points to future directions.
Collapse
Affiliation(s)
- Marius V Peelen
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands.
| | - Paul E Downing
- Cognitive Neuroscience Institute, Department of Psychology, Bangor University, Bangor, UK.
| |
Collapse
|
43
|
Li F, Zhang D, Chen J, Tang K, Li X, Hou Z. Research hotspots and trends of brain-computer interface technology in stroke: a bibliometric study and visualization analysis. Front Neurosci 2023; 17:1243151. [PMID: 37732305 PMCID: PMC10507647 DOI: 10.3389/fnins.2023.1243151] [Citation(s) in RCA: 14] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2023] [Accepted: 08/14/2023] [Indexed: 09/22/2023] Open
Abstract
Background The incidence and mortality rates of stroke are escalating due to the growing aging population, which presents a significant hazard to human health. In the realm of stroke, brain-computer interface (BCI) technology has gained considerable attention as a means to enhance treatment efficacy and improve quality of life. Consequently, a bibliometric visualization analysis was performed to investigate the research hotspots and trends of BCI technology in stroke, with the objective of furnishing reference and guidance for future research. Methods This study utilized the Science Citation Index Expanded (SCI-Expanded) within the Web of Science Core Collection (WoSCC) database as the data source, selecting relevant literature published between 2013 and 2022 as research sample. Through the application of VOSviewer 1.6.19 and CiteSpace 6.2.R2 visualization analysis software, as well as the bibliometric online analysis platform, the scientific knowledge maps were constructed and subjected to visualization display, and statistical analysis. Results This study encompasses a total of 693 relevant literature, which were published by 2,556 scholars from 975 institutions across 53 countries/regions and have been collected by 185 journals. In the past decade, BCI technology in stroke research has exhibited an upward trend in both annual publications and citations. China and the United States are high productivity countries, while the University of Tubingen stands out as the most contributing institution. Birbaumer N and Pfurtscheller G are the authors with the highest publication and citation frequency in this field, respectively. Frontiers in Neuroscience has published the most literature, while Journal of Neural Engineering has the highest citation frequency. The research hotspots in this field cover keywords such as stroke, BCI, rehabilitation, motor imagery (MI), motor recovery, electroencephalogram (EEG), neurorehabilitation, neural plasticity, task analysis, functional electrical stimulation (FES), motor impairment, feature extraction, and induced movement therapy, which to a certain extent reflect the development trend and frontier research direction of this field. Conclusion This study comprehensively and visually presents the extensive and in-depth literature resources of BCI technology in stroke research in the form of knowledge maps, which facilitates scholars to gain a more convenient understanding of the development and prospects in this field, thereby promoting further research work.
Collapse
Affiliation(s)
- Fangcun Li
- Department of Rehabilitation Medicine, Guilin Municipal Hospital of Traditional Chinese Medicine, Guilin, China
- Graduate School, Guangxi University of Chinese Medicine, Nanning, China
| | - Ding Zhang
- Graduate School, Guangxi University of Chinese Medicine, Nanning, China
| | - Jie Chen
- Department of Pharmacy, Guilin Municipal Hospital of Traditional Chinese Medicine, Guilin, China
| | - Ke Tang
- Graduate School, Guangxi University of Chinese Medicine, Nanning, China
| | - Xiaomei Li
- Graduate School, Guangxi University of Chinese Medicine, Nanning, China
| | - Zhaomeng Hou
- Graduate School, Guangxi University of Chinese Medicine, Nanning, China
- Department of Orthopedics and Traumatology, Yancheng TCM Hospital Affiliated to Nanjing University of Chinese Medicine, Yancheng, China
- Department of Orthopedics and Traumatology, Yancheng TCM Hospital, Yancheng, China
| |
Collapse
|
44
|
Wu F, Yu P, Mao L. New Opportunities of Electrochemistry for Monitoring, Modulating, and Mimicking the Brain Signals. JACS AU 2023; 3:2062-2072. [PMID: 37654584 PMCID: PMC10466370 DOI: 10.1021/jacsau.3c00220] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Revised: 07/14/2023] [Accepted: 07/28/2023] [Indexed: 09/02/2023]
Abstract
In vivo electrochemistry is a powerful key for unlocking the chemical consequences in neural networks of the brain. The past half-century has witnessed the technology revolutionization in this field along with innovations in electrochemical concepts, principles, methods, and devices. Present applications of electrochemical approaches have extended from measuring neurochemical concentrations to modulating and mimicking brain signals. In this Perspective, newly reported strategies for tackling long-standing challenges of in vivo electrochemical brain monitoring (i.e., basal level measurement, electroactivity dependence, in vivo stability, neuron compatibility, multiplexity, and implantable device fabrication) are highlighted. Moreover, recent progress on neuromodulation tools and neuromorphic devices in electrochemical frameworks is introduced. A glimpse of future opportunities for electrochemistry in brain research is offered at last.
Collapse
Affiliation(s)
- Fei Wu
- College
of Chemistry, Beijing Normal University, Beijing 100875, China
| | - Ping Yu
- Beijing
National Laboratory for Molecular Sciences, Key Laboratory of Analytical
Chemistry for Living Biosystems, Institute
of Chemistry, Chinese Academy of Sciences, Beijing 100190, China
| | - Lanqun Mao
- College
of Chemistry, Beijing Normal University, Beijing 100875, China
| |
Collapse
|
45
|
Li G, Jiang S, Meng J, Wu Z, Jiang H, Fan Z, Hu J, Sheng X, Zhang D, Schalk G, Chen L, Zhu X. Spatio-temporal evolution of human neural activity during visually cued hand movements. Cereb Cortex 2023; 33:9764-9777. [PMID: 37464883 DOI: 10.1093/cercor/bhad242] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Revised: 06/14/2023] [Accepted: 06/15/2023] [Indexed: 07/20/2023] Open
Abstract
Making hand movements in response to visual cues is common in daily life. It has been well known that this process activates multiple areas in the brain, but how these neural activations progress across space and time remains largely unknown. Taking advantage of intracranial electroencephalographic (iEEG) recordings using depth and subdural electrodes from 36 human subjects using the same task, we applied single-trial and cross-trial analyses to high-frequency iEEG activity. The results show that the neural activation was widely distributed across the human brain both within and on the surface of the brain, and focused specifically on certain areas in the parietal, frontal, and occipital lobes, where parietal lobes present significant left lateralization on the activation. We also demonstrate temporal differences across these brain regions. Finally, we evaluated the degree to which the timing of activity within these regions was related to sensory or motor function. The findings of this study promote the understanding of task-related neural processing of the human brain, and may provide important insights for translational applications.
Collapse
Affiliation(s)
- Guangye Li
- Institute of Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Shize Jiang
- Department of Neurosurgery of Huashan Hospital, Fudan University, Shanghai 200040, China
| | - Jianjun Meng
- Institute of Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Zehan Wu
- Department of Neurosurgery of Huashan Hospital, Fudan University, Shanghai 200040, China
| | - Haiteng Jiang
- Department of Neurobiology, Affiliated Mental Health Center & Hangzhou Seventh People's Hospital, Zhejiang University School of Medicine, Hangzhou 310013, China
- MOE Frontier Science Center for Brain Science & Brain-Machine Integration, Zhejiang University, Hangzhou 310058, China
| | - Zhen Fan
- Department of Neurosurgery of Huashan Hospital, Fudan University, Shanghai 200040, China
| | - Jie Hu
- Department of Neurosurgery of Huashan Hospital, Fudan University, Shanghai 200040, China
| | - Xinjun Sheng
- Institute of Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Dingguo Zhang
- Department of Electronic and Electrical Engineering, University of Bath, Bath BA2 7AY, United Kingdom
| | - Gerwin Schalk
- Chen Frontier Lab for Applied Neurotechnology, Tianqiao and Chrissy Chen Institute, Shanghai 200052, China
- Department of Neurosurgery of Huashan Hospital, Fudan University, Shanghai 200040, China
| | - Liang Chen
- Department of Neurosurgery of Huashan Hospital, Fudan University, Shanghai 200040, China
| | - Xiangyang Zhu
- Institute of Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
| |
Collapse
|
46
|
Zohny H, Lyreskog DM, Singh I, Savulescu J. The Mystery of Mental Integrity: Clarifying Its Relevance to Neurotechnologies. NEUROETHICS-NETH 2023; 16:20. [PMID: 37614938 PMCID: PMC10442279 DOI: 10.1007/s12152-023-09525-2] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Accepted: 08/06/2023] [Indexed: 08/25/2023]
Abstract
The concept of mental integrity is currently a significant topic in discussions concerning the regulation of neurotechnologies. Technologies such as deep brain stimulation and brain-computer interfaces are believed to pose a unique threat to mental integrity, and some authors have advocated for a legal right to protect it. Despite this, there remains uncertainty about what mental integrity entails and why it is important. Various interpretations of the concept have been proposed, but the literature on the subject is inconclusive. Here we consider a number of possible interpretations and argue that the most plausible one concerns neurotechnologies that bypass one's reasoning capacities, and do so specifically in ways that reliably lead to alienation from one's mental states. This narrows the scope of what constitutes a threat to mental integrity and offers a more precise role for the concept to play in the ethical evaluation of neurotechnologies.
Collapse
Affiliation(s)
- Hazem Zohny
- Oxford Uehiro Centre for Practical Ethics, University of Oxford, Oxford, UK
- Department of Psychiatry, University of Oxford, Oxford, UK
- Wellcome Centre for Ethics and Humanities, University of Oxford, Oxford, UK
| | - David M. Lyreskog
- Oxford Uehiro Centre for Practical Ethics, University of Oxford, Oxford, UK
- Department of Psychiatry, University of Oxford, Oxford, UK
- Wellcome Centre for Ethics and Humanities, University of Oxford, Oxford, UK
| | - Ilina Singh
- Department of Psychiatry, University of Oxford, Oxford, UK
- Wellcome Centre for Ethics and Humanities, University of Oxford, Oxford, UK
| | - Julian Savulescu
- Oxford Uehiro Centre for Practical Ethics, University of Oxford, Oxford, UK
- Centre for Biomedical Ethics, Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
- Murdoch Children’s Research Institute, Melbourne, Australia
- University of Melbourne, Melbourne, Australia
| |
Collapse
|
47
|
Zhou Y, Yu T, Gao W, Huang W, Lu Z, Huang Q, Li Y. Shared Three-Dimensional Robotic Arm Control Based on Asynchronous BCI and Computer Vision. IEEE Trans Neural Syst Rehabil Eng 2023; 31:3163-3175. [PMID: 37498753 DOI: 10.1109/tnsre.2023.3299350] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/29/2023]
Abstract
OBJECTIVE A brain-computer interface (BCI) can be used to translate neuronal activity into commands to control external devices. However, using noninvasive BCI to control a robotic arm for movements in three-dimensional (3D) environments and accomplish complicated daily tasks, such as grasping and drinking, remains a challenge. APPROACH In this study, a shared robotic arm control system based on hybrid asynchronous BCI and computer vision was presented. The BCI model, which combines steady-state visual evoked potentials (SSVEPs) and blink-related electrooculography (EOG) signals, allows users to freely choose from fifteen commands in an asynchronous mode corresponding to robot actions in a 3D workspace and reach targets with a wide movement range, while computer vision can identify objects and assist a robotic arm in completing more precise tasks, such as grasping a target automatically. RESULTS Ten subjects participated in the experiments and achieved an average accuracy of more than 92% and a high trajectory efficiency for robot movement. All subjects were able to perform the reach-grasp-drink tasks successfully using the proposed shared control method, with fewer error commands and shorter completion time than with direct BCI control. SIGNIFICANCE Our results demonstrated the feasibility and efficiency of generating practical multidimensional control of an intuitive robotic arm by merging hybrid asynchronous BCI and computer vision-based recognition.
Collapse
|
48
|
Abstract
Injectable bioprobes record single-neuron activity from within blood vessels.
Collapse
Affiliation(s)
- Brian P Timko
- Department of Biomedical Engineering, Tufts University, Medford, MA, USA
| |
Collapse
|
49
|
Zhang X, Wang Y. A Kernel Reinforcement Learning Decoding Framework Integrating Neural and Feedback Signals for Brain Control. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38083464 DOI: 10.1109/embc40787.2023.10340203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Brain-Machine Interfaces (BMIs) have the potential to allow subjects to brain control (BC) external devices, where their brain signals could be translated to the action of the neuro-prosthesis by reinforcement learning (RL) based decoder. During the BC task, feedback cues are provided to guide subject's learning. Subjects will adapt the neural signals according to the feedback cues. Concurrently, the RL decoding parameters are adjusted when the subject explores the BC task through trial and error, leading to a co-adaptive process between the subject and the decoder. However, when subjects receive the feedback cues and enhance their learning, the decoder does not actively utilize the feedback cues. If the RL decoder could integrate both neural signals and feedback cues, the training efficiency of the BC task would increase. A major challenge is the different temporal scales of neural signals and feedback cues, making it difficult to integrate them into a single decoder. In this paper, we propose a novel kernel RL decoding method as the first attempt to combine two signals with different temporal scales for RL decoding. The neural signals and the feedback cues comprise the decoding input, which is then projected into individual Reproducing Kernel Hilbert Spaces (RKHSs) respectively. These two RKHSs form a joint feature space, where the action of the neuro-prosthesis could be decoded linearly. We evaluate the proposed method on a simulated brain control cursor-reaching task. Our proposed method is compared with the kernel RL that only uses neural signals as the input. The proposed method has a faster learning speed and better decoding accuracy. The results demonstrate that our proposed method has successfully integrated the information of the feedback cue and facilitates the training procedure for the BC task.Clinical Relevance-This paper provides an integrated reinforcement learning decoding framework, which combines the neural signals and the feedback cues to increase the learning speed and the accuracy of the brain control task. Subjects could learn the task more easily with this decoder.
Collapse
|
50
|
Tan J, Zhang X, Wu S, Wang Y. State-space Model Based Inverse Reinforcement Learning for Reward Function Estimation in Brain-machine Interfaces. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38083150 DOI: 10.1109/embc40787.2023.10340953] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
The use of reinforcement learning (RL) in brain machine interfaces (BMIs) is considered to be a promising method for neural decoding. One key component of RL-based BMIs is the reward signal, which is used to guide decoders to update the parameters. However, designing effective and efficient rewards can be challenging, especially for complex tasks. Inverse reinforcement learning (IRL) is a method that has been proposed to estimate the internal reward function from subjects' neural activity. However, multi-channel neural activity, which may encode many sources of information, builds a large dimensions of state-action space, making it difficult to directly apply IRL methods in BMI systems. In this paper, we propose a state-space model based inverse Q-learning (SSM-IQL) method to improve the performance of the existing IRL method. The state-space model is designed to extract hidden brain state from high-dimensional neural activity. We tested the proposed method on real data collected from rats during a two-lever discrimination task. Preliminary results show that SSM-IQL provides a more accurate and stable estimation of the internal reward function than the traditional IQL algorithm. This suggests that the use of state-space model in IRL method has potential to improve the design of RL-based BMIs.
Collapse
|