1
|
Warsito IF, Komosar M, Bernhard MA, Fiedler P, Haueisen J. Flower electrodes for comfortable dry electroencephalography. Sci Rep 2023; 13:16589. [PMID: 37789022 PMCID: PMC10547758 DOI: 10.1038/s41598-023-42732-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Accepted: 09/14/2023] [Indexed: 10/05/2023] Open
Abstract
Dry electroencephalography (EEG) electrodes provide rapid, gel-free, and easy EEG preparation, but with limited wearing comfort. We propose a novel dry electrode comprising multiple tilted pins in a flower-like arrangement. The novel Flower electrode increases wearing comfort and contact area while maintaining ease of use. In a study with 20 volunteers, we compare the performance of a novel 64-channel dry Flower electrode cap to a commercial dry Multipin electrode cap in sitting and supine positions. The wearing comfort of the Flower cap was rated as significantly improved both in sitting and supine positions. The channel reliability and average impedances of both electrode systems were comparable. Averaged VEP components showed no considerable differences in global field power amplitude and latency, as well as in signal-to-noise ratio and topography. No considerable differences were found in the power spectral density of the resting state EEGs between 1 and 40 Hz. Overall, our findings provide evidence for equivalent channel reliability and signal characteristics of the compared cap systems in the sitting and supine positions. The reliability, signal quality, and significantly improved wearing comfort of the Flower electrode allow new fields of applications for dry EEG in long-term monitoring, sensitive populations, and recording in supine position.
Collapse
Affiliation(s)
- Indhika Fauzhan Warsito
- Institute of Biomedical Engineering and Informatics at the Technische Universität Ilmenau, Ilmenau, Germany
| | - Milana Komosar
- Institute of Biomedical Engineering and Informatics at the Technische Universität Ilmenau, Ilmenau, Germany
| | - Maria Anne Bernhard
- Institute of Biomedical Engineering and Informatics at the Technische Universität Ilmenau, Ilmenau, Germany
| | - Patrique Fiedler
- Institute of Biomedical Engineering and Informatics at the Technische Universität Ilmenau, Ilmenau, Germany
| | - Jens Haueisen
- Institute of Biomedical Engineering and Informatics at the Technische Universität Ilmenau, Ilmenau, Germany.
- Department of Neurology, Biomagnetic Center, University Hospital Jena, Jena, Germany.
| |
Collapse
|
2
|
Sarhan SM, Al-Faiz MZ, Takhakh AM. A review on EMG/EEG based control scheme of upper limb rehabilitation robots for stroke patients. Heliyon 2023; 9:e18308. [PMID: 37533980 PMCID: PMC10391943 DOI: 10.1016/j.heliyon.2023.e18308] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2022] [Revised: 07/03/2023] [Accepted: 07/13/2023] [Indexed: 08/04/2023] Open
Abstract
Stroke is a common worldwide health problem and a crucial contributor to gained disability. The abilities of people, who are subjected to stroke, to live independently are significantly affected since affected upper limbs' functions are essential for our daily life. This review article focuses on emerging trends in BCI-controlled rehabilitation techniques based on EMG, EEG, or EGM + EEG signals in the last few years. Working on developing rehabilitation robotics, is considered a wealthy scientific area for researchers in the last period. There is a significant advantage that the human acquires from the interaction between the machine and his body, rehabilitation for a patient's limb is very important to get the body limb recovery, and this is what is provided mostly by applying robotic devices.
Collapse
Affiliation(s)
- Saad M. Sarhan
- Department of Biomedical Engineering, College of Engineering, Al-Nahrain University, Baghdad, Iraq
| | - Mohammed Z. Al-Faiz
- Department of Control and Computer, College of Information Engineering, Al-Nahrain University, Baghdad, Iraq
| | - Ayad M. Takhakh
- Department of Biomechanics, College of Engineering, Al-Nahrain University, Baghdad, Iraq
| |
Collapse
|
3
|
Arntz A, Weber F, Handgraaf M, Lällä K, Korniloff K, Murtonen KP, Chichaeva J, Kidritsch A, Heller M, Sakellari E, Athanasopoulou C, Lagiou A, Tzonichaki I, Salinas-Bueno I, Martínez-Bueso P, Velasco-Roldán O, Schulz RJ, Grüneberg C. Technologies in Home-Based Digital Rehabilitation: Scoping Review. JMIR Rehabil Assist Technol 2023; 10:e43615. [PMID: 37253381 PMCID: PMC10415951 DOI: 10.2196/43615] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Revised: 03/10/2023] [Accepted: 05/25/2023] [Indexed: 06/01/2023] Open
Abstract
BACKGROUND Due to growing pressure on the health care system, a shift in rehabilitation to home settings is essential. However, efficient support for home-based rehabilitation is lacking. The COVID-19 pandemic has further exacerbated these challenges and has affected individuals and health care professionals during rehabilitation. Digital rehabilitation (DR) could support home-based rehabilitation. To develop and implement DR solutions that meet clients' needs and ease the growing pressure on the health care system, it is necessary to provide an overview of existing, relevant, and future solutions shaping the constantly evolving market of technologies for home-based DR. OBJECTIVE In this scoping review, we aimed to identify digital technologies for home-based DR, predict new or emerging DR trends, and report on the influences of the COVID-19 pandemic on DR. METHODS The scoping review followed the framework of Arksey and O'Malley, with improvements made by Levac et al. A literature search was performed in PubMed, Embase, CINAHL, PsycINFO, and the Cochrane Library. The search spanned January 2015 to January 2022. A bibliometric analysis was performed to provide an overview of the included references, and a co-occurrence analysis identified the technologies for home-based DR. A full-text analysis of all included reviews filtered the trends for home-based DR. A gray literature search supplemented the results of the review analysis and revealed the influences of the COVID-19 pandemic on the development of DR. RESULTS A total of 2437 records were included in the bibliometric analysis and 95 in the full-text analysis, and 40 records were included as a result of the gray literature search. Sensors, robotic devices, gamification, virtual and augmented reality, and digital and mobile apps are already used in home-based DR; however, artificial intelligence and machine learning, exoskeletons, and digital and mobile apps represent new and emerging trends. Advantages and disadvantages were displayed for all technologies. The COVID-19 pandemic has led to an increased use of digital technologies as remote approaches but has not led to the development of new technologies. CONCLUSIONS Multiple tools are available and implemented for home-based DR; however, some technologies face limitations in the application of home-based rehabilitation. However, artificial intelligence and machine learning could be instrumental in redesigning rehabilitation and addressing future challenges of the health care system, and the rehabilitation sector in particular. The results show the need for feasible and effective approaches to implement DR that meet clients' needs and adhere to framework conditions, regardless of exceptional situations such as the COVID-19 pandemic.
Collapse
Affiliation(s)
- Angela Arntz
- Division of Physiotherapy, Department of Applied Health Sciences, University of Applied Health Sciences Bochum, Bochum, Germany
- Faculty of Human Sciences, University of Cologne, Cologne, Germany
| | - Franziska Weber
- Division of Physiotherapy, Department of Applied Health Sciences, University of Applied Health Sciences Bochum, Bochum, Germany
- Department of Rehabilitation, Physiotherapy Science & Sports, University Medical Center Utrecht, Utrecht, Netherlands
| | - Marietta Handgraaf
- Division of Physiotherapy, Department of Applied Health Sciences, University of Applied Health Sciences Bochum, Bochum, Germany
| | - Kaisa Lällä
- Institute of Rehabilitation, Jamk University of Applied Sciences, Jyväskylä, Finland
| | - Katariina Korniloff
- Institute of Rehabilitation, Jamk University of Applied Sciences, Jyväskylä, Finland
| | - Kari-Pekka Murtonen
- Institute of Rehabilitation, Jamk University of Applied Sciences, Jyväskylä, Finland
| | - Julija Chichaeva
- Institute of Rehabilitation, Jamk University of Applied Sciences, Jyväskylä, Finland
| | - Anita Kidritsch
- Institute of Health Sciences, St. Pölten University of Applied Sciences, St. Pölten, Austria
| | - Mario Heller
- Department of Media & Digital Technologies, St. Pölten University of Applied Sciences, St. Pölten, Austria
| | - Evanthia Sakellari
- Department of Public and Community Health, Laboratory of Hygiene and Epidemiology, University of West Attica, Athens, Greece
| | | | - Areti Lagiou
- Department of Public and Community Health, Laboratory of Hygiene and Epidemiology, University of West Attica, Athens, Greece
| | - Ioanna Tzonichaki
- Department of Occupational Therapy, University of West Attica, Athens, Greece
| | - Iosune Salinas-Bueno
- Health Research Institute of the Balearic Islands (IdISBa), Palma de Mallorca, Spain
- Department of Nursing and Physiotherapy, University of the Balearic Islands, Palma de Mallorca, Spain
| | - Pau Martínez-Bueso
- Health Research Institute of the Balearic Islands (IdISBa), Palma de Mallorca, Spain
- Department of Nursing and Physiotherapy, University of the Balearic Islands, Palma de Mallorca, Spain
| | - Olga Velasco-Roldán
- Health Research Institute of the Balearic Islands (IdISBa), Palma de Mallorca, Spain
- Department of Nursing and Physiotherapy, University of the Balearic Islands, Palma de Mallorca, Spain
| | | | - Christian Grüneberg
- Division of Physiotherapy, Department of Applied Health Sciences, University of Applied Health Sciences Bochum, Bochum, Germany
| |
Collapse
|
4
|
Mahoney TB, Liu PC, Grayden DB, John SE. Comparison of Sub-Scalp EEG and Endovascular Stent-Electrode Array for Visual Evoked Potential Brain-Computer Interface. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38083531 DOI: 10.1109/embc40787.2023.10340834] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Brain-computer interfaces (BCI) have the potential to improve the quality of life for persons with paralysis. Sub-scalp EEG provides an alternative BCI signal acquisition method that compromises between the limitations of traditional EEG systems and the risks associated with intracranial electrodes, and has shown promise in long-term seizure monitoring. However, sub-scalp EEG has not yet been assessed for suitability in BCI applications. This study presents a preliminary comparison of visual evoked potentials (VEPs) recorded using sub-scalp and endovascular stent electrodes in a sheep. Sub-scalp electrodes recorded comparable VEP amplitude, signal-to-noise ratio and bandwidth to the stent electrodes.Clinical relevance-This is the first study to report a comparision between sub-scalp and stent electrode array signals. The use of sub-scalp EEG electrodes may aid in the long-term use of brain-computer interfaces.
Collapse
|
5
|
Lyu X, Ding P, Li S, Dong Y, Su L, Zhao L, Gong A, Fu Y. Human factors engineering of BCI: an evaluation for satisfaction of BCI based on motor imagery. Cogn Neurodyn 2023; 17:105-118. [PMID: 36704636 PMCID: PMC9871150 DOI: 10.1007/s11571-022-09808-z] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2022] [Revised: 03/04/2022] [Accepted: 04/01/2022] [Indexed: 01/29/2023] Open
Abstract
Existing brain-computer interface (BCI) research has made great progress in improving the accuracy and information transfer rate (ITR) of BCI systems. However, the practicability of BCI is still difficult to achieve. One of the important reasons for this difficulty is that human factors are not fully considered in the research and development of BCI. As a result, BCI systems have not yet reached users' expectations. In this study, we investigate a BCI system of motor imagery for lower limb synchronous rehabilitation as an example. From the perspective of human factors engineering of BCI, a comprehensive evaluation method of BCI system development is proposed based on the concept of human-centered design and evaluation. Subjects' satisfaction ratings for BCI sensors, visual analog scale (VAS), subjects' satisfaction rating of the BCI system, and the mental workload rating for subjects manipulating the BCI system, as well as interview/follow-up comprehensive evaluation of motor imagery of BCI (MI-BCI) system satisfaction were used. The methods and concepts proposed in this study provide useful insights for the design of personalized MI-BCI. We expect that the human factors engineering of BCI could be applied to the design and satisfaction evaluation of MI-BCI, so as to promote the practical application of this kind of BCI.
Collapse
Affiliation(s)
- Xiaotong Lyu
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, Yunnan China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, Yunnan China
| | - Peng Ding
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, Yunnan China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, Yunnan China
| | - Siyu Li
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, Yunnan China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, Yunnan China
| | - Yuyang Dong
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, Yunnan China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, Yunnan China
| | - Lei Su
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, Yunnan China
| | - Lei Zhao
- Faculty of Science, Kunming University of Science and Technology, Kunming, Yunnan China
| | - Anmin Gong
- School of Information Engineering, Chinese People’s Armed Police Force Engineering University, Xian, Shanxi China
| | - Yunfa Fu
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, Yunnan China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, Yunnan China
| |
Collapse
|
6
|
Davis KC, Meschede-Krasa B, Cajigas I, Prins NW, Alver C, Gallo S, Bhatia S, Abel JH, Naeem JA, Fisher L, Raza F, Rifai WR, Morrison M, Ivan ME, Brown EN, Jagid JR, Prasad A. Design-development of an at-home modular brain-computer interface (BCI) platform in a case study of cervical spinal cord injury. J Neuroeng Rehabil 2022; 19:53. [PMID: 35659259 PMCID: PMC9166490 DOI: 10.1186/s12984-022-01026-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2021] [Accepted: 05/13/2022] [Indexed: 11/10/2022] Open
Abstract
OBJECTIVE The objective of this study was to develop a portable and modular brain-computer interface (BCI) software platform independent of input and output devices. We implemented this platform in a case study of a subject with cervical spinal cord injury (C5 ASIA A). BACKGROUND BCIs can restore independence for individuals with paralysis by using brain signals to control prosthetics or trigger functional electrical stimulation. Though several studies have successfully implemented this technology in the laboratory and the home, portability, device configuration, and caregiver setup remain challenges that limit deployment to the home environment. Portability is essential for transitioning BCI from the laboratory to the home. METHODS The BCI platform implementation consisted of an Activa PC + S generator with two subdural four-contact electrodes implanted over the dominant left hand-arm region of the sensorimotor cortex, a minicomputer fixed to the back of the subject's wheelchair, a custom mobile phone application, and a mechanical glove as the end effector. To quantify the performance for this at-home implementation of the BCI, we quantified system setup time at home, chronic (14-month) decoding accuracy, hardware and software profiling, and Bluetooth communication latency between the App and the minicomputer. We created a dataset of motor-imagery labeled signals to train a binary motor imagery classifier on a remote computer for online, at-home use. RESULTS Average bluetooth data transmission delay between the minicomputer and mobile App was 23 ± 0.014 ms. The average setup time for the subject's caregiver was 5.6 ± 0.83 min. The average times to acquire and decode neural signals and to send those decoded signals to the end-effector were respectively 404.1 ms and 1.02 ms. The 14-month median accuracy of the trained motor imagery classifier was 87.5 ± 4.71% without retraining. CONCLUSIONS The study presents the feasibility of an at-home BCI system that subjects can seamlessly operate using a friendly mobile user interface, which does not require daily calibration nor the presence of a technical person for at-home setup. The study also describes the portability of the BCI system and the ability to plug-and-play multiple end effectors, providing the end-user the flexibility to choose the end effector to accomplish specific motor tasks for daily needs. Trial registration ClinicalTrials.gov: NCT02564419. First posted on 9/30/2015.
Collapse
Affiliation(s)
- Kevin C Davis
- Department of Biomedical Engineering, University of Miami, 1251 Memorial Dr, MEA 204, Coral Gables, Miami, FL, 33146, USA
| | - Benyamin Meschede-Krasa
- Department of Brain and Cognitive Science, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
- Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA, 02114, USA
- Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Iahn Cajigas
- Department of Neurological Surgery, University of Miami, 1095 NW 14th Terrace, Miami, FL, 33136, USA
| | - Noeline W Prins
- Department of Biomedical Engineering, University of Miami, 1251 Memorial Dr, MEA 204, Coral Gables, Miami, FL, 33146, USA
- Department of Electrical and Information Engineering, University of Ruhuna, Matara, Sri Lanka
| | - Charles Alver
- Department of Biomedical Engineering, University of Miami, 1251 Memorial Dr, MEA 204, Coral Gables, Miami, FL, 33146, USA
| | - Sebastian Gallo
- Department of Biomedical Engineering, University of Miami, 1251 Memorial Dr, MEA 204, Coral Gables, Miami, FL, 33146, USA
| | - Shovan Bhatia
- Department of Biomedical Engineering, Georgia Institute of Technology, Atlanta, GA, 30332, USA
| | - John H Abel
- Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA, 02114, USA
- Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
- Division of Sleep Medicine, Harvard Medical School, Boston, MA, 02115, USA
| | - Jasim A Naeem
- Department of Biomedical Engineering, University of Miami, 1251 Memorial Dr, MEA 204, Coral Gables, Miami, FL, 33146, USA
| | - Letitia Fisher
- Miami Project to Cure Paralysis, University of Miami, Miami, FL, 33136, USA
| | - Fouzia Raza
- Harvard John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, 02138, USA
| | - Wesley R Rifai
- Department of Biomedical Engineering, University of Miami, 1251 Memorial Dr, MEA 204, Coral Gables, Miami, FL, 33146, USA
| | - Matthew Morrison
- Department of Biomedical Engineering, University of Miami, 1251 Memorial Dr, MEA 204, Coral Gables, Miami, FL, 33146, USA
| | - Michael E Ivan
- Department of Neurological Surgery, University of Miami, 1095 NW 14th Terrace, Miami, FL, 33136, USA
| | - Emery N Brown
- Department of Brain and Cognitive Science, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
- Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA, 02114, USA
- Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Jonathan R Jagid
- Department of Neurological Surgery, University of Miami, 1095 NW 14th Terrace, Miami, FL, 33136, USA.
- Miami Project to Cure Paralysis, University of Miami, Miami, FL, 33136, USA.
| | - Abhishek Prasad
- Department of Biomedical Engineering, University of Miami, 1251 Memorial Dr, MEA 204, Coral Gables, Miami, FL, 33146, USA.
- Miami Project to Cure Paralysis, University of Miami, Miami, FL, 33136, USA.
| |
Collapse
|
7
|
Camargo-Vargas D, Callejas-Cuervo M, Mazzoleni S. Brain-Computer Interfaces Systems for Upper and Lower Limb Rehabilitation: A Systematic Review. SENSORS (BASEL, SWITZERLAND) 2021; 21:4312. [PMID: 34202546 PMCID: PMC8271710 DOI: 10.3390/s21134312] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Revised: 06/09/2021] [Accepted: 06/18/2021] [Indexed: 12/22/2022]
Abstract
In recent years, various studies have demonstrated the potential of electroencephalographic (EEG) signals for the development of brain-computer interfaces (BCIs) in the rehabilitation of human limbs. This article is a systematic review of the state of the art and opportunities in the development of BCIs for the rehabilitation of upper and lower limbs of the human body. The systematic review was conducted in databases considering using EEG signals, interface proposals to rehabilitate upper/lower limbs using motor intention or movement assistance and utilizing virtual environments in feedback. Studies that did not specify which processing system was used were excluded. Analyses of the design processing or reviews were excluded as well. It was identified that 11 corresponded to applications to rehabilitate upper limbs, six to lower limbs, and one to both. Likewise, six combined visual/auditory feedback, two haptic/visual, and two visual/auditory/haptic. In addition, four had fully immersive virtual reality (VR), three semi-immersive VR, and 11 non-immersive VR. In summary, the studies have demonstrated that using EEG signals, and user feedback offer benefits including cost, effectiveness, better training, user motivation and there is a need to continue developing interfaces that are accessible to users, and that integrate feedback techniques.
Collapse
Affiliation(s)
- Daniela Camargo-Vargas
- Software Research Group, Universidad Pedagógica y Tecnológica de Colombia, Tunja 150002, Colombia;
| | - Mauro Callejas-Cuervo
- School of Computer Science, Universidad Pedagógica y Tecnológica de Colombia, Tunja 150002, Colombia
| | - Stefano Mazzoleni
- Department of Electrical and Information Engineering, Politecnico di Bari, 70126 Bari, Italy;
| |
Collapse
|
8
|
Heo D, Kim M, Kim J, Choi YJ, Kim SP. Effect of Static Posture on Online Performance of P300-Based BCIs for TV Control. SENSORS 2021; 21:s21072278. [PMID: 33805181 PMCID: PMC8036388 DOI: 10.3390/s21072278] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/31/2021] [Revised: 03/16/2021] [Accepted: 03/21/2021] [Indexed: 12/31/2022]
Abstract
To implement a practical brain–computer interface (BCI) for daily use, continuing changes in postures while performing daily tasks must be considered in the design of BCIs. To examine whether the performance of a BCI could depend on postures, we compared the online performance of P300-based BCIs built to select TV channels when subjects took sitting, recline, supine, and right lateral recumbent postures during BCI use. Subjects self-reported the degrees of interference, comfort, and familiarity after BCI control in each posture. We found no significant difference in the BCI performance as well as the amplitude and latency of P300 and N200 among the four postures. However, when we compared BCI accuracy outcomes normalized within individuals between two cases where subjects reported relatively more positively or more negatively about using the BCI in a particular posture, we found higher BCI accuracy in those postures for which individual subjects reported more positively. As a result, although the change of postures did not affect the overall performance of P300-based BCIs, the BCI performance varied depending on the degree of postural comfort felt by individual subjects. Our results suggest considering the postural comfort felt by individual BCI users when using a P300-based BCI at home.
Collapse
|
9
|
Kim M, Kim J, Heo D, Choi Y, Lee T, Kim SP. Effects of Emotional Stimulations on the Online Operation of a P300-Based Brain-Computer Interface. Front Hum Neurosci 2021; 15:612777. [PMID: 33767615 PMCID: PMC7987063 DOI: 10.3389/fnhum.2021.612777] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Accepted: 02/05/2021] [Indexed: 11/23/2022] Open
Abstract
Using P300-based brain-computer interfaces (BCIs) in daily life should take into account the user's emotional state because various emotional conditions are likely to influence event-related potentials (ERPs) and consequently the performance of P300-based BCIs. This study aimed at investigating whether external emotional stimuli affect the performance of a P300-based BCI, particularly built for controlling home appliances. We presented a set of emotional auditory stimuli to subjects, which had been selected for each subject based on individual valence scores evaluated a priori, while they were controlling an electric light device using a P300-based BCI. There were four conditions regarding the auditory stimuli, including high valence, low valence, noise, and no sound. As a result, subjects controlled the electric light device using the BCI in real time with a mean accuracy of 88.14%. The overall accuracy and P300 features over most EEG channels did not show a significant difference between the four auditory conditions (p > 0.05). When we measured emotional states using frontal alpha asymmetry (FAA) and compared FAA across the auditory conditions, we also found no significant difference (p > 0.05). Our results suggest that there is no clear evidence to support a hypothesis that external emotional stimuli influence the P300-based BCI performance or the P300 features while people are controlling devices using the BCI in real time. This study may provide useful information for those who are concerned with the implementation of a P300-based BCI in practice.
Collapse
Affiliation(s)
| | | | | | | | | | - Sung-Phil Kim
- Department of Biomedical Engineering, Ulsan National Institute of Science and Technology, Ulsan, South Korea
| |
Collapse
|
10
|
Zulauf-Czaja A, Al-Taleb MKH, Purcell M, Petric-Gray N, Cloughley J, Vuckovic A. On the way home: a BCI-FES hand therapy self-managed by sub-acute SCI participants and their caregivers: a usability study. J Neuroeng Rehabil 2021; 18:44. [PMID: 33632262 PMCID: PMC7905902 DOI: 10.1186/s12984-021-00838-y] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2020] [Accepted: 02/10/2021] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Regaining hand function is the top priority for people with tetraplegia, however access to specialised therapy outwith clinics is limited. Here we present a system for hand therapy based on brain-computer interface (BCI) which uses a consumer grade electroencephalography (EEG) device combined with functional electrical stimulation (FES), and evaluate its usability among occupational therapists (OTs) and people with spinal cord injury (SCI) and their family members. METHODS Users: Eight people with sub-acute SCI (6 M, 2F, age 55.4 ± 15.6) and their caregivers (3 M, 5F, age 45.3 ± 14.3); four OTs (4F, age 42.3 ± 9.8). User Activity: Researchers trained OTs; OTs subsequently taught caregivers to set up the system for the people with SCI to perform hand therapy. Hand therapy consisted of attempted movement (AM) of one hand to lower the power of EEG sensory-motor rhythm in the 8-12 Hz band and thereby activate FES which induced wrist flexion and extension. Technology: Consumer grade wearable EEG, multichannel FES, custom made BCI application. LOCATION Research space within hospital. Evaluation: donning times, BCI accuracy, BCI and FES parameter repeatability, questionnaires, focus groups and interviews. RESULTS Effectiveness: The BCI accuracy was 70-90%. Efficiency: Median donning times decreased from 40.5 min for initial session to 27 min during last training session (N = 7), dropping to 14 min on the last self-managed session (N = 3). BCI and FES parameters were stable from session to session. Satisfaction: Mean satisfaction with the system among SCI users and caregivers was 3.68 ± 0.81 (max 5) as measured by QUEST questionnaire. Main facilitators for implementing BCI-FES technology were "seeing hand moving", "doing something useful for the loved ones", good level of computer literacy (people with SCI and caregivers), "active engagement in therapy" (OT), while main barriers were technical complexity of setup (all groups) and "lack of clinical evidence" (OT). CONCLUSION BCI-FES has potential to be used as at home hand therapy by people with SCI or stroke, provided it is easy to use and support is provided. Transfer of knowledge of operating BCI is possible from researchers to therapists to users and caregivers. Trial registration Registered with NHS GG&C on December 6th 2017; clinicaltrials.gov reference number NCT03257982, url: https://clinicaltrials.gov/ct2/show/NCT03257982 .
Collapse
Affiliation(s)
- Anna Zulauf-Czaja
- Biomedical Engineering Research Division, University of Glasgow, Glasgow, UK.
| | - Manaf K H Al-Taleb
- Biomedical Engineering Research Division, University of Glasgow, Glasgow, UK.,Wasit University, Wasit, Iraq
| | - Mariel Purcell
- Queen Elizabeth National Spinal Injuries Unit, Elizabeth University Hospital, Glasgow, Queen, UK
| | - Nina Petric-Gray
- Biomedical Engineering Research Division, University of Glasgow, Glasgow, UK
| | - Jennifer Cloughley
- Queen Elizabeth National Spinal Injuries Unit, Elizabeth University Hospital, Glasgow, Queen, UK
| | - Aleksandra Vuckovic
- Biomedical Engineering Research Division, University of Glasgow, Glasgow, UK
| |
Collapse
|
11
|
Shukla PK, Chaurasiya RK, Verma S. Performance improvement of P300-based home appliances control classification using convolution neural network. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2020.102220] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
12
|
Geronimo A, Simmons Z. TeleBCI: remote user training, monitoring, and communication with an evoked-potential brain-computer interface. BRAIN-COMPUTER INTERFACES 2020; 7:57-69. [PMID: 33763499 DOI: 10.1080/2326263x.2020.1848134] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Abstract
Brain-computer interfaces (BCIs) are a movement-independent form of augmentative and alternative communication (AAC) for individuals with amyotrophic lateral sclerosis (ALS). The rare utilization of such devices in the homes of patients stems from a number of factors, one of which is the complexity of providing training and support for users. This paper describes the teleBCI interface used to train the patient and facilitator in the operation of a virtual keyboard using an evoked potential BCI. Fifteen patients with motor neuron disease and their communication partners were included in the study, participating from their homes while receiving remote support from the research team. Patient/caregiver teams completed 8 sessions each of P300 BCI training virtually with the researcher. As they participated in subsequent training sessions, participant teams required less help to complete physical, computer, and BCI-specific tasks associated with device use. A subset of users experienced improved performance over sessions, progressing to utilize the full functionality of the speller and communicate with a nurse partner over a telemedicine interface. Perceptions of device utility varied with accuracy of the BCI system. In the management of ALS, the integration of telemedicine provides new opportunities for care delivery, including how BCI-AAC are deployed and used.
Collapse
Affiliation(s)
- A Geronimo
- Department of Neurosurgery, 500 University Drive, Hershey, PA 17033
| | - Zachary Simmons
- Departments of Neurology and Humanities, 500 University Drive, Hershey, PA 17033
| |
Collapse
|
13
|
Recommendations for Integrating a P300-Based Brain–Computer Interface in Virtual Reality Environments for Gaming: An Update. COMPUTERS 2020. [DOI: 10.3390/computers9040092] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The integration of a P300-based brain–computer interface (BCI) into virtual reality (VR) environments is promising for the video games industry. However, it faces several limitations, mainly due to hardware constraints and limitations engendered by the stimulation needed by the BCI. The main restriction is still the low transfer rate that can be achieved by current BCI technology, preventing movement while using VR. The goal of this paper is to review current limitations and to provide application creators with design recommendations to overcome them, thus significantly reducing the development time and making the domain of BCI more accessible to developers. We review the design of video games from the perspective of BCI and VR with the objective of enhancing the user experience. An essential recommendation is to use the BCI only for non-complex and non-critical tasks in the game. Also, the BCI should be used to control actions that are naturally integrated into the virtual world. Finally, adventure and simulation games, especially if cooperative (multi-user), appear to be the best candidates for designing an effective VR game enriched by BCI technology.
Collapse
|
14
|
Rashid M, Sulaiman N, P P Abdul Majeed A, Musa RM, Ab Nasir AF, Bari BS, Khatun S. Current Status, Challenges, and Possible Solutions of EEG-Based Brain-Computer Interface: A Comprehensive Review. Front Neurorobot 2020; 14:25. [PMID: 32581758 PMCID: PMC7283463 DOI: 10.3389/fnbot.2020.00025] [Citation(s) in RCA: 102] [Impact Index Per Article: 25.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2019] [Accepted: 04/08/2020] [Indexed: 12/12/2022] Open
Abstract
Brain-Computer Interface (BCI), in essence, aims at controlling different assistive devices through the utilization of brain waves. It is worth noting that the application of BCI is not limited to medical applications, and hence, the research in this field has gained due attention. Moreover, the significant number of related publications over the past two decades further indicates the consistent improvements and breakthroughs that have been made in this particular field. Nonetheless, it is also worth mentioning that with these improvements, new challenges are constantly discovered. This article provides a comprehensive review of the state-of-the-art of a complete BCI system. First, a brief overview of electroencephalogram (EEG)-based BCI systems is given. Secondly, a considerable number of popular BCI applications are reviewed in terms of electrophysiological control signals, feature extraction, classification algorithms, and performance evaluation metrics. Finally, the challenges to the recent BCI systems are discussed, and possible solutions to mitigate the issues are recommended.
Collapse
Affiliation(s)
- Mamunur Rashid
- Faculty of Electrical & Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Norizam Sulaiman
- Faculty of Electrical & Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Anwar P P Abdul Majeed
- Innovative Manufacturing, Mechatronics and Sports Laboratory, Faculty of Manufacturing and Mechatronic Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Rabiu Muazu Musa
- Centre for Fundamental and Continuing Education, Universiti Malaysia Terengganu, Kuala Nerus, Malaysia
| | - Ahmad Fakhri Ab Nasir
- Innovative Manufacturing, Mechatronics and Sports Laboratory, Faculty of Manufacturing and Mechatronic Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Bifta Sama Bari
- Faculty of Electrical & Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Sabira Khatun
- Faculty of Electrical & Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| |
Collapse
|
15
|
Letourneau S, Zewdie ET, Jadavji Z, Andersen J, Burkholder LM, Kirton A. Clinician awareness of brain computer interfaces: a Canadian national survey. J Neuroeng Rehabil 2020; 17:2. [PMID: 31907010 PMCID: PMC6945584 DOI: 10.1186/s12984-019-0624-7] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2019] [Accepted: 11/13/2019] [Indexed: 12/13/2022] Open
Abstract
Background Individuals with severe neurological disabilities but preserved cognition, including children, are often precluded from connecting with their environments. Brain computer interfaces (BCI) are a potential solution where advancing technologies create new clinical opportunities. We evaluated clinician awareness as a modifiable barrier to progress and identified eligible populations. Methods We executed a national, population-based, cross-sectional survey of physician specialists caring for persons with severe disability. An evidence- and experience-based survey had three themes: clinician BCI knowledge, eligible populations, and potential impact. A BCI knowledge index was created and scored. Canadian adult and pediatric neurologists, physiatrists and a subset of developmental pediatricians were contacted. Secure, web-based software administered the survey via email with online data collection. Results Of 922 valid emails (664 neurologists, 253 physiatrists), 137 (15%) responded. One third estimated that ≥10% of their patients had severe neurological disability with cognitive capacity. BCI knowledge scores were low with > 40% identifying as less than “vaguely aware” and only 15% as “somewhat familiar” or better. Knowledge did not differ across specialties. Only 6 physicians (4%) had patients using BCI. Communication and wheelchair control rated highest for potentially improving quality of life. Most (81%) felt BCI had high potential to improve quality of life. Estimates suggested that > 13,000 Canadians (36 M population) might benefit from BCI technologies. Conclusions Despite high potential and thousands of patients who might benefit, BCI awareness among clinicians caring for disabled persons is poor. Further, functional priorities for BCI applications may differ between medical professionals and potential BCI users, perhaps reflecting that clinicians possess a less accurate understanding of the desires and needs of potential end-users. Improving knowledge and engaging both clinicians and patients could facilitate BCI program development to improve patient outcomes.
Collapse
Affiliation(s)
- Sasha Letourneau
- Department of Pediatrics, Cumming School of Medicine, University of Calgary, 2500 University Drive N.W., Calgary, AB, T2N 1N4, Canada
| | - Ephrem Takele Zewdie
- Department of Pediatrics, Cumming School of Medicine, University of Calgary, 2500 University Drive N.W., Calgary, AB, T2N 1N4, Canada
| | - Zeanna Jadavji
- Department of Pediatrics, Cumming School of Medicine, University of Calgary, 2500 University Drive N.W., Calgary, AB, T2N 1N4, Canada.,Clinical Neurosciences, Cumming School of Medicine, University of Calgary, 2500 University Drive N.W, Calgary, AB, AB T2N 1N4, Canada
| | - John Andersen
- Department of Pediatrics, University of Alberta, 116 St. and 85 Ave, Edmonton, AB T6G 2R3, Canada
| | - Lee M Burkholder
- Department of Pediatrics, Cumming School of Medicine, University of Calgary, 2500 University Drive N.W., Calgary, AB, T2N 1N4, Canada.,Clinical Neurosciences, Cumming School of Medicine, University of Calgary, 2500 University Drive N.W, Calgary, AB, AB T2N 1N4, Canada
| | - Adam Kirton
- Department of Pediatrics, Cumming School of Medicine, University of Calgary, 2500 University Drive N.W., Calgary, AB, T2N 1N4, Canada. .,Clinical Neurosciences, Cumming School of Medicine, University of Calgary, 2500 University Drive N.W, Calgary, AB, AB T2N 1N4, Canada. .,Department of Pediatrics, University of Alberta, 116 St. and 85 Ave, Edmonton, AB T6G 2R3, Canada. .,Alberta Children's Hospital Research Institute, 28 Oki Drive S.W, Calgary, AB, T3B6A8, Canada. .,Hotchkiss Brain Institute, University of Calgary, 2500 University Drive N.W, Calgary, AB, T2N 1N4, Canada.
| |
Collapse
|
16
|
Philip JT, George ST. Visual P300 Mind-Speller Brain-Computer Interfaces: A Walk Through the Recent Developments With Special Focus on Classification Algorithms. Clin EEG Neurosci 2020; 51:19-33. [PMID: 30997842 DOI: 10.1177/1550059419842753] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Brain-computer interfaces are sophisticated signal processing systems, which directly operate on neuronal signals to identify specific human intents. These systems can be applied to overcome certain disabilities or to enhance the natural capabilities of human beings. The visual P300 mind-speller is a prominent one among them, which has opened up tremendous possibilities in movement and communication applications. Today, there exist many state-of-the-art visual P300 mind-speller implementations in the literature as a result of numerous researches in this domain over the past 2 decades. Each of these systems can be evaluated in terms of performance metrics like classification accuracy, information transfer rate, and processing time. Various classification techniques associated with these systems, which include but are not limited to discriminant analysis, support vector machine, neural network, distance-based and ensemble of classifiers, have major roles in determining the overall system performances. The significance of a proper review on the recent developments in visual P300 mind-spellers with proper emphasis on their classification algorithms is the key insight for this work. This article is organized with a brief introduction to P300, concepts of visual P300 mind-spellers, the survey of literature with special focus on classification algorithms, followed by the discussion of various challenges and future directions.
Collapse
Affiliation(s)
- Jobin T Philip
- Department of Electronics and Communication Engineering, Karunya Institute of Technology and Sciences, Coimbatore, Tamil Nadu, India
| | - S Thomas George
- Department of Electronics and Communication Engineering, Karunya Institute of Technology and Sciences, Coimbatore, Tamil Nadu, India
| |
Collapse
|
17
|
Al-Taleb MKH, Purcell M, Fraser M, Petric-Gray N, Vuckovic A. Home used, patient self-managed, brain-computer interface for the management of central neuropathic pain post spinal cord injury: usability study. J Neuroeng Rehabil 2019; 16:128. [PMID: 31666096 PMCID: PMC6822418 DOI: 10.1186/s12984-019-0588-7] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2018] [Accepted: 09/06/2019] [Indexed: 01/22/2023] Open
Abstract
BACKGROUND Central Neuropathic Pain (CNP) is a frequent chronic condition in people with spinal cord injury (SCI). Previously, we showed that using laboratory brain-computer interface (BCI) technology for neurofeedback (NFB) training, it was possible to reduce CNP in people with SCI. In this study, we show results of patient self-managed treatment in their homes with a BCI-NFB using a consumer EEG device. METHODS Users: People with chronic SCI (17 M, 3 F, 50.6 ± 14.1 years old), and CNP ≥4 on a Visual Numerical Scale. LOCATION Laboratory training (up to 4 sessions) followed by home self-managed NFB. User Activity: Upregulating the EEG alpha band power by 10% above a threshold and at the same time downregulating the theta and upper beta (20-30 Hz) band power by 10% at electrode location C4. Technology: A consumer grade multichannel EEG headset (Epoch, Emotiv, USA), a tablet computer and custom made NFB software. EVALUATION EEG analysis, before and after NFB assessment, interviews and questionnaires. RESULTS Effectiveness: Out of 20 initially assessed participants, 15 took part in the study. Participants used the system for 6.9 ± 5.5 (median 4) weeks. Twelve participants regulated their brainwaves in a frequency specific manner and were most successful upregulating the alpha band power. However they typically upregulated power around their individual alpha peak (7.6 ± 0.8 Hz) that was lower than in people without CNP. The reduction in pain experienced was statistically significant in 12 and clinically significant (greater than 30%) in 8 participants. Efficiency: The donning was between 5 and 15 min, and approximately 10-20% of EEG data recorded in the home environment was noise. Participants were mildly stressed when self-administering NFB at home (2.4 on a scale 1-10). User satisfaction: Nine participants who completed the final assessment reported a high level of satisfaction (QUESQ, 4.5 ± 0.8), naming effectiveness, ease of use and comfort as main priorities. The main factors influencing frequency of NFB training were: health related issues, free time and pain intensity. CONCLUSION Portable NFB is a feasible solution for home-based self-managed treatment of CNP. Compared to pharmacological treatments, NFB has less side effects and provides users with active control over pain. TRIAL REGISTRATION GN15NE124 , Registered 9th June 2016.
Collapse
Affiliation(s)
- M K H Al-Taleb
- Biomedical Engineering Research Division, University of Glasgow, Glasgow, UK.,Wasit University, Wasit, Iraq
| | - M Purcell
- Queen Elizabeth National Spinal Injuries Unit, Queen Elizabeth University Hospital, Glasgow, UK
| | - M Fraser
- Queen Elizabeth National Spinal Injuries Unit, Queen Elizabeth University Hospital, Glasgow, UK
| | - N Petric-Gray
- Biomedical Engineering Research Division, University of Glasgow, Glasgow, UK
| | - A Vuckovic
- Biomedical Engineering Research Division, University of Glasgow, Glasgow, UK.
| |
Collapse
|
18
|
Abstract
Brain–computer interfaces (BCIs) allow patients with paralysis to control external devices by mental commands. Recent advances in home automation and the Internet of things may extend the horizon of BCI applications into daily living environments at home. In this study, we developed an online BCI based on scalp electroencephalography (EEG) to control home appliances. The BCI users controlled TV channels, a digital door-lock system, and an electric light system in an unshielded environment. The BCI was designed to harness P300 and N200 components of event-related potentials (ERPs). On average, the BCI users could control TV channels with an accuracy of 83.0% ± 17.9%, the digital door-lock with 78.7% ± 16.2% accuracy, and the light with 80.0% ± 15.6% accuracy, respectively. Our study demonstrates a feasibility to control multiple home appliances using EEG-based BCIs.
Collapse
|
19
|
Lulé D, Kübler A, Ludolph AC. Ethical Principles in Patient-Centered Medical Care to Support Quality of Life in Amyotrophic Lateral Sclerosis. Front Neurol 2019; 10:259. [PMID: 30967833 PMCID: PMC6439311 DOI: 10.3389/fneur.2019.00259] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2019] [Accepted: 02/26/2019] [Indexed: 12/12/2022] Open
Abstract
It is one of the primary goals of medical care to secure good quality of life (QoL) while prolonging survival. This is a major challenge in severe medical conditions with a prognosis such as amyotrophic lateral sclerosis (ALS). Further, the definition of QoL and the question whether survival in this severe condition is compatible with a good QoL is a matter of subjective and culture-specific debate. Some people without neurodegenerative conditions believe that physical decline is incompatible with satisfactory QoL. Current data provide extensive evidence that psychosocial adaptation in ALS is possible, indicated by a satisfactory QoL. Thus, there is no fatalistic link of loss of QoL when physical health declines. There are intrinsic and extrinsic factors that have been shown to successfully facilitate and secure QoL in ALS which will be reviewed in the following article following the four ethical principles (1) Beneficence, (2) Non-maleficence, (3) Autonomy and (4) Justice, which are regarded as key elements of patient centered medical care according to Beauchamp and Childress. This is a JPND-funded work to summarize findings of the project NEEDSinALS (www.NEEDSinALS.com) which highlights subjective perspectives and preferences in medical decision making in ALS.
Collapse
Affiliation(s)
- Dorothée Lulé
- Department of Neurology, University of Ulm, Ulm, Germany
| | - Andrea Kübler
- Interventional Psychology, Psychology III, University of Würzburg, Würzburg, Germany
| | | |
Collapse
|
20
|
Milekovic T, Bacher D, Sarma AA, Simeral JD, Saab J, Pandarinath C, Yvert B, Sorice BL, Blabe C, Oakley EM, Tringale KR, Eskandar E, Cash SS, Shenoy KV, Henderson JM, Hochberg LR, Donoghue JP. Volitional control of single-electrode high gamma local field potentials by people with paralysis. J Neurophysiol 2019; 121:1428-1450. [PMID: 30785814 DOI: 10.1152/jn.00131.2018] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
Abstract
Intracortical brain-computer interfaces (BCIs) can enable individuals to control effectors, such as a computer cursor, by directly decoding the user's movement intentions from action potentials and local field potentials (LFPs) recorded within the motor cortex. However, the accuracy and complexity of effector control achieved with such "biomimetic" BCIs will depend on the degree to which the intended movements used to elicit control modulate the neural activity. In particular, channels that do not record distinguishable action potentials and only record LFP modulations may be of limited use for BCI control. In contrast, a biofeedback approach may surpass these limitations by letting the participants generate new control signals and learn strategies that improve the volitional control of signals used for effector control. Here, we show that, by using a biofeedback paradigm, three individuals with tetraplegia achieved volitional control of gamma LFPs (40-400 Hz) recorded by a single microelectrode implanted in the precentral gyrus. Control was improved over a pair of consecutive sessions up to 3 days apart. In all but one session, the channel used to achieve control lacked distinguishable action potentials. Our results indicate that biofeedback LFP-based BCIs may potentially contribute to the neural modulation necessary to obtain reliable and useful control of effectors. NEW & NOTEWORTHY Our study demonstrates that people with tetraplegia can volitionally control individual high-gamma local-field potential (LFP) channels recorded from the motor cortex, and that this control can be improved using biofeedback. Motor cortical LFP signals are thought to be both informative and stable intracortical signals and, thus, of importance for future brain-computer interfaces.
Collapse
Affiliation(s)
- Tomislav Milekovic
- Department of Neuroscience, Brown University , Providence, Rhode Island.,Carney Institute for Brain Science, Brown University , Providence, Rhode Island.,Department of Fundamental Neuroscience, Faculty of Medicine, University of Geneva , Geneva , Switzerland
| | - Daniel Bacher
- Carney Institute for Brain Science, Brown University , Providence, Rhode Island.,School of Engineering, Brown University , Providence, Rhode Island
| | - Anish A Sarma
- Carney Institute for Brain Science, Brown University , Providence, Rhode Island.,School of Engineering, Brown University , Providence, Rhode Island.,Center for Neurorestoration and Neurotechnology, Rehabilitation Research & Development Service, Department of Veterans Affairs , Providence, Rhode Island
| | - John D Simeral
- Carney Institute for Brain Science, Brown University , Providence, Rhode Island.,School of Engineering, Brown University , Providence, Rhode Island.,Center for Neurorestoration and Neurotechnology, Rehabilitation Research & Development Service, Department of Veterans Affairs , Providence, Rhode Island
| | - Jad Saab
- Carney Institute for Brain Science, Brown University , Providence, Rhode Island.,School of Engineering, Brown University , Providence, Rhode Island
| | - Chethan Pandarinath
- Department of Neurosurgery, Stanford University , Stanford, California.,Department of Electrical Engineering, Stanford University , Stanford, California.,Stanford Neurosciences Institute, Stanford University , Stanford, California
| | - Blaise Yvert
- Department of Neuroscience, Brown University , Providence, Rhode Island.,Carney Institute for Brain Science, Brown University , Providence, Rhode Island.,Inserm, University of Grenoble, Clinatec-Lab U1205, Grenoble , France
| | - Brittany L Sorice
- Department of Neurology, Massachusetts General Hospital , Boston, Massachusetts
| | - Christine Blabe
- Department of Neurosurgery, Stanford University , Stanford, California
| | - Erin M Oakley
- Department of Neurology, Massachusetts General Hospital , Boston, Massachusetts
| | - Kathryn R Tringale
- Department of Neurology, Massachusetts General Hospital , Boston, Massachusetts
| | - Emad Eskandar
- Department of Neurosurgery, Massachusetts General Hospital , Boston, Massachusetts.,Harvard Medical School , Boston, Massachusetts
| | - Sydney S Cash
- Department of Neurology, Massachusetts General Hospital , Boston, Massachusetts.,Harvard Medical School , Boston, Massachusetts
| | - Krishna V Shenoy
- Department of Electrical Engineering, Stanford University , Stanford, California.,Stanford Neurosciences Institute, Stanford University , Stanford, California.,Neurosciences Program, Stanford University , Stanford, California.,Department of Neurobiology, Stanford University , Stanford, California.,Department of Bioengineering, Stanford University , Stanford, California
| | - Jaimie M Henderson
- Department of Neurosurgery, Stanford University , Stanford, California.,Stanford Neurosciences Institute, Stanford University , Stanford, California.,Department of Neurology and Neurological Sciences, Stanford University , Stanford, California
| | - Leigh R Hochberg
- Carney Institute for Brain Science, Brown University , Providence, Rhode Island.,School of Engineering, Brown University , Providence, Rhode Island.,Center for Neurorestoration and Neurotechnology, Rehabilitation Research & Development Service, Department of Veterans Affairs , Providence, Rhode Island.,Department of Neurology, Massachusetts General Hospital , Boston, Massachusetts.,Harvard Medical School , Boston, Massachusetts
| | - John P Donoghue
- Department of Neuroscience, Brown University , Providence, Rhode Island.,Carney Institute for Brain Science, Brown University , Providence, Rhode Island.,Center for Neurorestoration and Neurotechnology, Rehabilitation Research & Development Service, Department of Veterans Affairs , Providence, Rhode Island
| |
Collapse
|
21
|
Schalk G, Allison BZ. Noninvasive Brain–Computer Interfaces. Neuromodulation 2018. [DOI: 10.1016/b978-0-12-805353-9.00026-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
|
22
|
Trincado-Alonso F, López-Larraz E, Resquín F, Ardanza A, Pérez-Nombela S, Pons JL, Montesano L, Gil-Agudo Á. A Pilot Study of Brain-Triggered Electrical Stimulation with Visual Feedback in Patients with Incomplete Spinal Cord Injury. J Med Biol Eng 2017. [DOI: 10.1007/s40846-017-0343-0] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
23
|
Käthner I, Halder S, Hintermüller C, Espinosa A, Guger C, Miralles F, Vargiu E, Dauwalder S, Rafael-Palou X, Solà M, Daly JM, Armstrong E, Martin S, Kübler A. A Multifunctional Brain-Computer Interface Intended for Home Use: An Evaluation with Healthy Participants and Potential End Users with Dry and Gel-Based Electrodes. Front Neurosci 2017; 11:286. [PMID: 28588442 PMCID: PMC5439234 DOI: 10.3389/fnins.2017.00286] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2017] [Accepted: 05/03/2017] [Indexed: 11/23/2022] Open
Abstract
Current brain-computer interface (BCIs) software is often tailored to the needs of scientists and technicians and therefore complex to allow for versatile use. To facilitate home use of BCIs a multifunctional P300 BCI with a graphical user interface intended for non-expert set-up and control was designed and implemented. The system includes applications for spelling, web access, entertainment, artistic expression and environmental control. In addition to new software, it also includes new hardware for the recording of electroencephalogram (EEG) signals. The EEG system consists of a small and wireless amplifier attached to a cap that can be equipped with gel-based or dry contact electrodes. The system was systematically evaluated with a healthy sample, and targeted end users of BCI technology, i.e., people with a varying degree of motor impairment tested the BCI in a series of individual case studies. Usability was assessed in terms of effectiveness, efficiency and satisfaction. Feedback of users was gathered with structured questionnaires. Two groups of healthy participants completed an experimental protocol with the gel-based and the dry contact electrodes (N = 10 each). The results demonstrated that all healthy participants gained control over the system and achieved satisfactory to high accuracies with both gel-based and dry electrodes (average error rates of 6 and 13%). Average satisfaction ratings were high, but certain aspects of the system such as the wearing comfort of the dry electrodes and design of the cap, and speed (in both groups) were criticized by some participants. Six potential end users tested the system during supervised sessions. The achieved accuracies varied greatly from no control to high control with accuracies comparable to that of healthy volunteers. Satisfaction ratings of the two end-users that gained control of the system were lower as compared to healthy participants. The advantages and disadvantages of the BCI and its applications are discussed and suggestions are presented for improvements to pave the way for user friendly BCIs intended to be used as assistive technology by persons with severe paralysis.
Collapse
Affiliation(s)
- Ivo Käthner
- Institute of Psychology, University of WürzburgWürzburg, Germany
| | - Sebastian Halder
- Institute of Psychology, University of WürzburgWürzburg, Germany
| | | | | | | | - Felip Miralles
- eHealth Unit, Eurecat - Technology Center of CataloniaBarcelona, Spain
| | - Eloisa Vargiu
- eHealth Unit, Eurecat - Technology Center of CataloniaBarcelona, Spain
| | - Stefan Dauwalder
- eHealth Unit, Eurecat - Technology Center of CataloniaBarcelona, Spain
| | | | - Marc Solà
- eHealth Unit, Eurecat - Technology Center of CataloniaBarcelona, Spain
| | | | | | | | - Andrea Kübler
- Institute of Psychology, University of WürzburgWürzburg, Germany
| |
Collapse
|
24
|
Remsik A, Young B, Vermilyea R, Kiekhoefer L, Abrams J, Evander Elmore S, Schultz P, Nair V, Edwards D, Williams J, Prabhakaran V. A review of the progression and future implications of brain-computer interface therapies for restoration of distal upper extremity motor function after stroke. Expert Rev Med Devices 2017; 13:445-54. [PMID: 27112213 DOI: 10.1080/17434440.2016.1174572] [Citation(s) in RCA: 68] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
Stroke is a leading cause of acquired disability resulting in distal upper extremity functional motor impairment. Stroke mortality rates continue to decline with advances in healthcare and medical technology. This has led to an increased demand for advanced, personalized rehabilitation. Survivors often experience some level of spontaneous recovery shortly after their stroke event, yet reach a functional plateau after which there is exiguous motor recovery. Nevertheless, studies have demonstrated the potential for recovery beyond this plateau. Non-traditional neurorehabilitation techniques, such as those incorporating the brain-computer interface (BCI), are being investigated for rehabilitation. BCIs may offer a gateway to the brain's plasticity and revolutionize how humans interact with the world. Non-invasive BCIs work by closing the proprioceptive feedback loop with real-time, multi-sensory feedback allowing for volitional modulation of brain signals to assist hand function. BCI technology potentially promotes neuroplasticity and Hebbian-based motor recovery by rewarding cortical activity associated with sensory-motor rhythms through use with a variety of self-guided and assistive modalities.
Collapse
Affiliation(s)
- Alexander Remsik
- a Department of Radiology Clinical Science Center , University of Wisconsin Madison School of Medicine and Public Health Ringgold Standard Institution , Madison , WI , USA
| | - Brittany Young
- a Department of Radiology Clinical Science Center , University of Wisconsin Madison School of Medicine and Public Health Ringgold Standard Institution , Madison , WI , USA
| | - Rebecca Vermilyea
- a Department of Radiology Clinical Science Center , University of Wisconsin Madison School of Medicine and Public Health Ringgold Standard Institution , Madison , WI , USA
| | - Laura Kiekhoefer
- a Department of Radiology Clinical Science Center , University of Wisconsin Madison School of Medicine and Public Health Ringgold Standard Institution , Madison , WI , USA
| | - Jessica Abrams
- a Department of Radiology Clinical Science Center , University of Wisconsin Madison School of Medicine and Public Health Ringgold Standard Institution , Madison , WI , USA
| | - Samantha Evander Elmore
- a Department of Radiology Clinical Science Center , University of Wisconsin Madison School of Medicine and Public Health Ringgold Standard Institution , Madison , WI , USA
| | - Paige Schultz
- a Department of Radiology Clinical Science Center , University of Wisconsin Madison School of Medicine and Public Health Ringgold Standard Institution , Madison , WI , USA
| | - Veena Nair
- a Department of Radiology Clinical Science Center , University of Wisconsin Madison School of Medicine and Public Health Ringgold Standard Institution , Madison , WI , USA
| | - Dorothy Edwards
- a Department of Radiology Clinical Science Center , University of Wisconsin Madison School of Medicine and Public Health Ringgold Standard Institution , Madison , WI , USA
| | - Justin Williams
- a Department of Radiology Clinical Science Center , University of Wisconsin Madison School of Medicine and Public Health Ringgold Standard Institution , Madison , WI , USA
| | - Vivek Prabhakaran
- a Department of Radiology Clinical Science Center , University of Wisconsin Madison School of Medicine and Public Health Ringgold Standard Institution , Madison , WI , USA
| |
Collapse
|
25
|
Huggins JE, Guger C, Ziat M, Zander TO, Taylor D, Tangermann M, Soria-Frisch A, Simeral J, Scherer R, Rupp R, Ruffini G, Robinson DKR, Ramsey NF, Nijholt A, Müller-Putz G, McFarland DJ, Mattia D, Lance BJ, Kindermans PJ, Iturrate I, Herff C, Gupta D, Do AH, Collinger JL, Chavarriaga R, Chase SM, Bleichner MG, Batista A, Anderson CW, Aarnoutse EJ. Workshops of the Sixth International Brain-Computer Interface Meeting: brain-computer interfaces past, present, and future. BRAIN-COMPUTER INTERFACES 2017; 4:3-36. [PMID: 29152523 PMCID: PMC5693371 DOI: 10.1080/2326263x.2016.1275488] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
The Sixth International Brain-Computer Interface (BCI) Meeting was held 30 May-3 June 2016 at the Asilomar Conference Grounds, Pacific Grove, California, USA. The conference included 28 workshops covering topics in BCI and brain-machine interface research. Topics included BCI for specific populations or applications, advancing BCI research through use of specific signals or technological advances, and translational and commercial issues to bring both implanted and non-invasive BCIs to market. BCI research is growing and expanding in the breadth of its applications, the depth of knowledge it can produce, and the practical benefit it can provide both for those with physical impairments and the general public. Here we provide summaries of each workshop, illustrating the breadth and depth of BCI research and highlighting important issues and calls for action to support future research and development.
Collapse
Affiliation(s)
- Jane E. Huggins
- Department of Physical Medicine and Rehabilitation, Department of Biomedical Engineering, University of Michigan, Ann Arbor, Michigan, USA
| | - Christoph Guger
- G.Tec Medical Engineering GmbH, Guger Technologies OG, Schiedlberg, Austria
| | - Mounia Ziat
- Psychology Department, Northern Michigan University, Marquette, MI, USA
| | - Thorsten O. Zander
- Team PhyPA, Biological Psychology and Neuroergonomics, Technical University of Berlin, Berlin, Germany
| | | | - Michael Tangermann
- Cluster of Excellence BrainLinks-BrainTools, University of Freiburg, Germany
| | | | - John Simeral
- Ctr. For Neurorestoration and Neurotechnology, Rehab. R&D Service, Dept. of VA Medical Center, School of Engineering, Brown University, Providence, RI, USA
| | - Reinhold Scherer
- Institute of Neural Engineering, BCI- Lab, Graz University of Technology, Graz, Austria
| | - Rüdiger Rupp
- Section Experimental Neurorehabilitation, Spinal Cord Injury Center, University Hospital in Heidelberg, Heidelberg, Germany
| | - Giulio Ruffini
- Neuroscience Business Unit, Starlab Barcelona SLU, Barcelona, Spain
- Neuroelectrics Inc., Boston, USA
| | - Douglas K. R. Robinson
- Institute: Laboratoire Interdisciplinaire Sciences Innovations Sociétés (LISIS), Université Paris-Est Marne-la-Vallée, MARNE-LA-VALLÉE, France
| | - Nick F. Ramsey
- Dept Neurology & Neurosurgery, Brain Center Rudolf Magnus, University Medical Center Utrecht, University of Utrecht, Utrecht, Netherlands
| | - Anton Nijholt
- Faculty EEMCS, Enschede, University of Twente, The Netherlands & Imagineering Institute, Iskandar, Malaysia
| | - Gernot Müller-Putz
- Institute of Neural Engineering, BCI- Lab, Graz University of Technology, Graz, Austria
| | - Dennis J. McFarland
- New York State Department of Health, National Center for Adaptive Neurotechnologies, Wadsworth Center, Albany, New York USA
| | - Donatella Mattia
- Clinical Neurophysiology, Fondazione Santa Lucia, Neuroelectrical Imaging and BCI Lab, IRCCS, Rome, Italy
| | - Brent J. Lance
- Human Research and Engineering Directorate, U.S. Army Research Laboratory, Aberdeen Proving Ground, Aberdeen, MD USA
| | | | - Iñaki Iturrate
- Defitech Chair in Brain–machine Interface (CNBI), Center for Neuroprosthetics, École Polytechnique Fédérale de Lausanne, EPFL-STI-CNBI, Campus Biotech H4, Geneva, Switzerland
| | - Christian Herff
- Cognitive Systems Lab, University of Bremen, Bremen, Germany
| | - Disha Gupta
- Brain Mind Research Inst, Weill Cornell Medical College, Early Brain Injury and Recovery Lab, Burke Medical Research Inst, White Plains, New York, USA
| | - An H. Do
- Department of Neurology, UC Irvine Brain Computer Interface Lab, University of California, Irvine, CA, USA
| | - Jennifer L. Collinger
- Department of Physical Medicine and Rehabilitation, Department of Veterans Affairs, VA Pittsburgh Healthcare System, University of Pittsburgh, Pittsburgh, PA, USA
| | - Ricardo Chavarriaga
- Defitech Chair in Brain–machine Interface (CNBI), Center for Neuroprosthetics, École Polytechnique Fédérale de Lausanne, EPFL-STI-CNBI, Campus Biotech H4, Geneva, Switzerland
| | - Steven M. Chase
- Center for the Neural Basis of Cognition and Department Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Martin G. Bleichner
- Neuropsychology Lab, Department of Psychology, European Medical School, Cluster of Excellence Hearing4all, University of Oldenburg, Oldenburg, Germany
| | - Aaron Batista
- Department of Bioengineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA USA
| | - Charles W. Anderson
- Department of Computer Science, Colorado State University, Fort Collins, CO USA
| | - Erik J. Aarnoutse
- Brain Center Rudolf Magnus, Dept Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, The Netherlands
| |
Collapse
|
26
|
A Prototype SSVEP Based Real Time BCI Gaming System. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2016; 2016:3861425. [PMID: 27051414 PMCID: PMC4804071 DOI: 10.1155/2016/3861425] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/15/2015] [Revised: 01/06/2016] [Accepted: 01/10/2016] [Indexed: 11/17/2022]
Abstract
Although brain-computer interface technology is mainly designed with disabled people in mind, it can also be beneficial to healthy subjects, for example, in gaming or virtual reality systems. In this paper we discuss the typical architecture, paradigms, requirements, and limitations of electroencephalogram-based gaming systems. We have developed a prototype three-class brain-computer interface system, based on the steady state visually evoked potentials paradigm and the Emotiv EPOC headset. An online target shooting game, implemented in the OpenViBE environment, has been used for user feedback. The system utilizes wave atom transform for feature extraction, achieving an average accuracy of 78.2% using linear discriminant analysis classifier, 79.3% using support vector machine classifier with a linear kernel, and 80.5% using a support vector machine classifier with a radial basis function kernel.
Collapse
|
27
|
Implementation of an Embedded Web Server Application for Wireless Control of Brain Computer Interface Based Home Environments. J Med Syst 2015; 40:27. [DOI: 10.1007/s10916-015-0386-0] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2015] [Accepted: 10/21/2015] [Indexed: 10/22/2022]
|