1
|
Pitt KM, McKelvey M, Weissling K, Thiessen A. Brain-computer interface for augmentative and alternative communication access: The initial training needs and learning preferences of speech-language pathologists. INTERNATIONAL JOURNAL OF SPEECH-LANGUAGE PATHOLOGY 2024:1-9. [PMID: 39028220 DOI: 10.1080/17549507.2024.2363939] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/20/2024]
Abstract
PURPOSE To enable the codesign of a training framework for brain-computer interfaces for augmentative and alternative communications access (BCI-AAC), the aim of this study is to evaluate the initial BCI-AAC training needs and preferred learning strategies of speech-language pathologists (SLPs) with AAC experience. METHOD Eleven SLPs employed across a broad range of settings completed a semi-structured interview. A grounded theory approach alongside peer debriefing and review, member checking, and triangulation procedures were utilised for thematic analysis to help ensure data reliability and credibility. RESULT Regarding critical training needs, SLPs identified the subthemes of (a) personalisation of intervention, (b) technical aspects, (c) BCI-AAC system types and access, and (d) how to support stakeholders in BCI-AAC implementation. Regarding learning strategy preferences, participants discussed (a) expert guidance and demonstrations, (b) hands-on experience, alongside (c) media and presentations. CONCLUSION Findings present a continuum of critical training needs ranging from more foundational information to more personalised assessment and intervention consideration. These thematic results present a first step in developing a basic framework for SLP training in BCI-AAC to utilise and build from as technology development continues, and provides an important initial starting point for the codesign of clinically focused BCI-AAC trainings.
Collapse
Affiliation(s)
- Kevin M Pitt
- Department of Special Education and Communication Disorders, University of Nebraska-Lincoln, Lincoln, NE, USA
| | - Miechelle McKelvey
- Department of Communication Disorders, University of Nebraska Kearney, Kearney, NE, USA
| | - Kristy Weissling
- Department of Special Education and Communication Disorders, University of Nebraska-Lincoln, Lincoln, NE, USA
| | - Amber Thiessen
- Department of Communication Sciences and Disorders, University of Houston, Houston, TX, USA
| |
Collapse
|
2
|
Peters B, Eddy B, Galvin-McLaughlin D, Betz G, Oken B, Fried-Oken M. A systematic review of research on augmentative and alternative communication brain-computer interface systems for individuals with disabilities. Front Hum Neurosci 2022; 16:952380. [PMID: 35966988 PMCID: PMC9374067 DOI: 10.3389/fnhum.2022.952380] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Accepted: 07/04/2022] [Indexed: 11/13/2022] Open
Abstract
Augmentative and alternative communication brain-computer interface (AAC-BCI) systems are intended to offer communication access to people with severe speech and physical impairment (SSPI) without requiring volitional movement. As the field moves toward clinical implementation of AAC-BCI systems, research involving participants with SSPI is essential. Research has demonstrated variability in AAC-BCI system performance across users, and mixed results for comparisons of performance for users with and without disabilities. The aims of this systematic review were to (1) describe study, system, and participant characteristics reported in BCI research, (2) summarize the communication task performance of participants with disabilities using AAC-BCI systems, and (3) explore any differences in performance for participants with and without disabilities. Electronic databases were searched in May, 2018, and March, 2021, identifying 6065 records, of which 73 met inclusion criteria. Non-experimental study designs were common and sample sizes were typically small, with approximately half of studies involving five or fewer participants with disabilities. There was considerable variability in participant characteristics, and in how those characteristics were reported. Over 60% of studies reported an average selection accuracy ≤70% for participants with disabilities in at least one tested condition. However, some studies excluded participants who did not reach a specific system performance criterion, and others did not state whether any participants were excluded based on performance. Twenty-nine studies included participants both with and without disabilities, but few reported statistical analyses comparing performance between the two groups. Results suggest that AAC-BCI systems show promise for supporting communication for people with SSPI, but they remain ineffective for some individuals. The lack of standards in reporting outcome measures makes it difficult to synthesize data across studies. Further research is needed to demonstrate efficacy of AAC-BCI systems for people who experience SSPI of varying etiologies and severity levels, and these individuals should be included in system design and testing. Consensus in terminology and consistent participant, protocol, and performance description will facilitate the exploration of user and system characteristics that positively or negatively affect AAC-BCI use, and support innovations that will make this technology more useful to a broader group of people. Clinical trial registration https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42018095345, PROSPERO: CRD42018095345.
Collapse
Affiliation(s)
- Betts Peters
- Consortium for Accessible Multimodal Brain-Body Interfaces, United States
- REKNEW Projects, Institute on Development and Disability, Department of Pediatrics, Oregon Health and Science University, Portland, OR, United States
| | - Brandon Eddy
- Consortium for Accessible Multimodal Brain-Body Interfaces, United States
- REKNEW Projects, Institute on Development and Disability, Department of Pediatrics, Oregon Health and Science University, Portland, OR, United States
- Speech and Hearing Sciences Department, Portland State University, Portland, OR, United States
| | - Deirdre Galvin-McLaughlin
- Consortium for Accessible Multimodal Brain-Body Interfaces, United States
- REKNEW Projects, Institute on Development and Disability, Department of Pediatrics, Oregon Health and Science University, Portland, OR, United States
| | - Gail Betz
- Health Sciences and Human Services Library, University of Maryland, Baltimore, MD, United States
| | - Barry Oken
- Consortium for Accessible Multimodal Brain-Body Interfaces, United States
- Department of Neurology, Oregon Health & Science University, Portland, OR, United States
| | - Melanie Fried-Oken
- Consortium for Accessible Multimodal Brain-Body Interfaces, United States
- REKNEW Projects, Institute on Development and Disability, Department of Pediatrics, Oregon Health and Science University, Portland, OR, United States
| |
Collapse
|
3
|
Pitt KM, McKelvey M, Weissling K. The perspectives of augmentative and alternative communication experts on the clinical integration of non-invasive brain-computer interfaces. BRAIN-COMPUTER INTERFACES 2022. [DOI: 10.1080/2326263x.2022.2057758] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Affiliation(s)
- Kevin M. Pitt
- Department of Special Education and Communication Disorders, University of Nebraska–Lincoln, Lincoln, NE, USA
| | - Miechelle McKelvey
- Department of Communication Disorders, University of Nebraska Kearney Kearney, NE, USA
| | - Kristy Weissling
- Department of Special Education and Communication Disorders, University of Nebraska–Lincoln, Lincoln, NE, USA
| |
Collapse
|
4
|
Huggins JE, Krusienski D, Vansteensel MJ, Valeriani D, Thelen A, Stavisky S, Norton JJS, Nijholt A, Müller-Putz G, Kosmyna N, Korczowski L, Kapeller C, Herff C, Halder S, Guger C, Grosse-Wentrup M, Gaunt R, Dusang AN, Clisson P, Chavarriaga R, Anderson CW, Allison BZ, Aksenova T, Aarnoutse E. Workshops of the Eighth International Brain-Computer Interface Meeting: BCIs: The Next Frontier. BRAIN-COMPUTER INTERFACES 2022; 9:69-101. [PMID: 36908334 PMCID: PMC9997957 DOI: 10.1080/2326263x.2021.2009654] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2021] [Accepted: 11/15/2021] [Indexed: 12/11/2022]
Abstract
The Eighth International Brain-Computer Interface (BCI) Meeting was held June 7-9th, 2021 in a virtual format. The conference continued the BCI Meeting series' interactive nature with 21 workshops covering topics in BCI (also called brain-machine interface) research. As in the past, workshops covered the breadth of topics in BCI. Some workshops provided detailed examinations of specific methods, hardware, or processes. Others focused on specific BCI applications or user groups. Several workshops continued consensus building efforts designed to create BCI standards and increase the ease of comparisons between studies and the potential for meta-analysis and large multi-site clinical trials. Ethical and translational considerations were both the primary topic for some workshops or an important secondary consideration for others. The range of BCI applications continues to expand, with more workshops focusing on approaches that can extend beyond the needs of those with physical impairments. This paper summarizes each workshop, provides background information and references for further study, presents an overview of the discussion topics, and describes the conclusion, challenges, or initiatives that resulted from the interactions and discussion at the workshop.
Collapse
Affiliation(s)
- Jane E Huggins
- Department of Physical Medicine and Rehabilitation, Department of Biomedical Engineering, Neuroscience Graduate Program, University of Michigan, Ann Arbor, Michigan, United States 325 East Eisenhower, Room 3017; Ann Arbor, Michigan 48108-5744, 734-936-7177
| | - Dean Krusienski
- Department of Biomedical Engineering, Virginia Commonwealth University, Richmond, VA 23219
| | - Mariska J Vansteensel
- UMC Utrecht Brain Center, Dept of Neurosurgery, University Medical Center Utrecht, The Netherlands
| | | | - Antonia Thelen
- eemagine Medical Imaging Solutions GmbH, Berlin, Germany
| | | | - James J S Norton
- National Center for Adaptive Neurotechnologies, US Department of Veterans Affairs, 113 Holland Ave, Albany, NY 12208
| | - Anton Nijholt
- Faculty EEMCS, University of Twente, Enschede, The Netherlands
| | - Gernot Müller-Putz
- Institute of Neural Engineering, GrazBCI Lab, Graz University of Technology, Stremayrgasse 16/4, 8010 Graz, Austria
| | - Nataliya Kosmyna
- Massachusetts Institute of Technology (MIT), Media Lab, E14-548, Cambridge, MA 02139, Unites States
| | | | | | - Christian Herff
- School of Mental Health and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | | | - Christoph Guger
- g.tec medical engineering GmbH/Guger Technologies OG, Austria, Sierningstrasse 14, 4521 Schiedlberg, Austria, +43725122240-0
| | - Moritz Grosse-Wentrup
- Research Group Neuroinformatics, Faculty of Computer Science, Vienna Cognitive Science Hub, Data Science @ Uni Vienna University of Vienna
| | - Robert Gaunt
- Rehab Neural Engineering Labs, Department of Physical Medicine and Rehabilitation, Center for the Neural Basis of Cognition, University of Pittsburgh, Pittsburgh, PA, USA, 3520 5th Ave, Suite 300, Pittsburgh, PA 15213, 412-383-1426
| | - Aliceson Nicole Dusang
- Department of Electrical and Computer Engineering, School of Engineering, Brown University, Carney Institute for Brain Science, Brown University, Providence, RI
- Department of Veterans Affairs Medical Center, Center for Neurorestoration and Neurotechnology, Rehabilitation R&D Service, Providence, RI
- Center for Neurotechnology and Neurorecovery, Neurology, Massachusetts General Hospital, Boston, MA
| | | | - Ricardo Chavarriaga
- IEEE Standards Association Industry Connections group on neurotechnologies for brain-machine interface, Center for Artificial Intelligence, School of Engineering, ZHAW-Zurich University of Applied Sciences, Switzerland, Switzerland
| | - Charles W Anderson
- Department of Computer Science, Molecular, Cellular and Integrative Neurosience Program, Colorado State University, Fort Collins, CO 80523
| | - Brendan Z Allison
- Dept. of Cognitive Science, Mail Code 0515, University of California at San Diego, La Jolla, United States, 619-534-9754
| | - Tetiana Aksenova
- University Grenoble Alpes, CEA, LETI, Clinatec, Grenoble 38000, France
| | - Erik Aarnoutse
- UMC Utrecht Brain Center, Department of Neurology & Neurosurgery, University Medical Center Utrecht, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands
| |
Collapse
|
5
|
Pitt KM, Dietz A. Applying Implementation Science to Support Active Collaboration in Noninvasive Brain-Computer Interface Development and Translation for Augmentative and Alternative Communication. AMERICAN JOURNAL OF SPEECH-LANGUAGE PATHOLOGY 2022; 31:515-526. [PMID: 34958737 DOI: 10.1044/2021_ajslp-21-00152] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
PURPOSE The purpose of this article is to consider how, alongside engineering advancements, noninvasive brain-computer interface (BCI) for augmentative and alternative communication (AAC; BCI-AAC) developments can leverage implementation science to increase the clinical impact of this technology. We offer the Consolidated Framework for Implementation Research (CFIR) as a structure to help guide future BCI-AAC research. Specifically, we discuss CFIR primary domains that include intervention characteristics, the outer and inner settings, the individuals involved in the intervention, and the process of implementation, alongside pertinent subdomains including adaptability, cost, patient needs and recourses, implementation climate, other personal attributes, and the process of engaging. The authors support their view with current citations from both the AAC and BCI-AAC fields. CONCLUSIONS The article aimed to provide thoughtful considerations for how future research may leverage the CFIR to support meaningful BCI-AAC translation for those with severe physical impairments. We believe that, although significant barriers to BCI-AAC development still exist, incorporating implementation research may be timely for the field of BCI-AAC and help account for diversity in end users, navigate implementation obstacles, and support a smooth and efficient translation of BCI-AAC technology. Moreover, the sooner clinicians, individuals who use AAC, their support networks, and engineers collectively improve BCI-AAC outcomes and the efficiency of translation, the sooner BCI-AAC may become an everyday tool in the AAC arsenal.
Collapse
Affiliation(s)
- Kevin M Pitt
- Department of Special Education and Communication Disorders, University of Nebraska-Lincoln
| | - Aimee Dietz
- Department of Communication Sciences and Disorders, Georgia State University, Atlanta
| |
Collapse
|
6
|
Pitt KM, Brumberg JS. Evaluating person-centered factors associated with brain-computer interface access to a commercial augmentative and alternative communication paradigm. Assist Technol 2021; 34:468-477. [PMID: 33667154 DOI: 10.1080/10400435.2021.1872737] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022] Open
Abstract
Current BCI-AAC systems largely utilize custom-made software and displays that may be unfamiliar to AAC stakeholders. Further, there is limited information available exploring the heterogenous profiles of individuals who may use BCI-AAC. Therefore, in this study, we aimed to evaluate how individuals with amyotrophic lateral sclerosis (ALS) learned to control a motor-based BCI switch in a row-column AAC scanning pattern, and person-centered factors associated with BCI-AAC performance. Four individuals with ALS completed 12 BCI-AAC training sessions, and three individuals without neurological impairment completed 3 BCI-AAC training sessions. To assess person-centered factors associated with BCI-AAC performance, participants completed both initial and recurring assessment measures including levels of cognition, motor ability, fatigue, and motivation. Three of four participants demonstrated either BCI-AAC performance in the range of neurotypical peers, or an improving BCI-AAC learning trajectory. However, BCI-AAC learning trajectories were variable. Assessment measures revealed that two participants presented with a suspicion for cognitive impairment yet achieved the highest levels of BCI-AAC accuracy with their increased levels of performance being possibly supported by largely unimpaired motor skills. Motor-based BCI switch access to a commercial AAC row-column scanning may be feasible for individuals with ALS and possibly supported by timely intervention.
Collapse
Affiliation(s)
- Kevin M Pitt
- Department of Special Education and Communication Disorders, University of Nebraska-Lincoln, Lincoln, Nebraska, USA
| | - Jonathan S Brumberg
- Department of Speech-Language-Hearing: Sciences & Disorders, University of Kansas, Lawrence, Kansas, USA
| |
Collapse
|
7
|
Chowdhury MSN, Dutta A, Robison MK, Blais C, Brewer GA, Bliss DW. Deep Neural Network for Visual Stimulus-Based Reaction Time Estimation Using the Periodogram of Single-Trial EEG. SENSORS (BASEL, SWITZERLAND) 2020; 20:E6090. [PMID: 33120869 PMCID: PMC7662233 DOI: 10.3390/s20216090] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/15/2020] [Revised: 10/19/2020] [Accepted: 10/23/2020] [Indexed: 12/14/2022]
Abstract
Multiplexed deep neural networks (DNN) have engendered high-performance predictive models gaining popularity for decoding brain waves, extensively collected in the form of electroencephalogram (EEG) signals. In this paper, to the best of our knowledge, we introduce a first-ever DNN-based generalized approach to estimate reaction time (RT) using the periodogram representation of single-trial EEG in a visual stimulus-response experiment with 48 participants. We have designed a Fully Connected Neural Network (FCNN) and a Convolutional Neural Network (CNN) to predict and classify RTs for each trial. Though deep neural networks are widely known for classification applications, cascading FCNN/CNN with the Random Forest model, we designed a robust regression-based estimator to predict RT. With the FCNN model, the accuracies obtained for binary and 3-class classification were 93% and 76%, respectively, which further improved with the use of CNN (94% and 78%, respectively). The regression-based approach predicted RTs with correlation coefficients (CC) of 0.78 and 0.80 for FCNN and CNN, respectively. Investigating further, we found that the left central as well as parietal and occipital lobes were crucial for predicting RT, with significant activities in the theta and alpha frequency bands.
Collapse
Affiliation(s)
- Mohammad Samin Nur Chowdhury
- School of Electrical, Computer & Energy Engineering, Arizona State University, Tempe, AZ 85281, USA; (A.D.); (D.W.B.)
| | - Arindam Dutta
- School of Electrical, Computer & Energy Engineering, Arizona State University, Tempe, AZ 85281, USA; (A.D.); (D.W.B.)
| | - Matthew Kyle Robison
- Department of Psychology, The University of Texas at Arlington, Arlington, TX 76019, USA;
| | - Chris Blais
- Department of Psychology, Arizona State University, Tempe, AZ 85281, USA; (C.B.); (G.A.B.)
| | - Gene Arnold Brewer
- Department of Psychology, Arizona State University, Tempe, AZ 85281, USA; (C.B.); (G.A.B.)
| | - Daniel Wesley Bliss
- School of Electrical, Computer & Energy Engineering, Arizona State University, Tempe, AZ 85281, USA; (A.D.); (D.W.B.)
| |
Collapse
|
8
|
Schwarz A, Escolano C, Montesano L, Müller-Putz GR. Analyzing and Decoding Natural Reach-and-Grasp Actions Using Gel, Water and Dry EEG Systems. Front Neurosci 2020; 14:849. [PMID: 32903775 PMCID: PMC7438923 DOI: 10.3389/fnins.2020.00849] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2020] [Accepted: 07/21/2020] [Indexed: 11/13/2022] Open
Abstract
Reaching and grasping is an essential part of everybody's life, it allows meaningful interaction with the environment and is key to independent lifestyle. Recent electroencephalogram (EEG)-based studies have already shown that neural correlates of natural reach-and-grasp actions can be identified in the EEG. However, it is still in question whether these results obtained in a laboratory environment can make the transition to mobile applicable EEG systems for home use. In the current study, we investigated whether EEG-based correlates of natural reach-and-grasp actions can be successfully identified and decoded using mobile EEG systems, namely the water-based EEG-Versatile TM system and the dry-electrodes EEG-Hero TM headset. In addition, we also analyzed gel-based recordings obtained in a laboratory environment (g.USBamp/g.Ladybird, gold standard), which followed the same experimental parameters. For each recording system, 15 study participants performed 80 self-initiated reach-and-grasp actions toward a glass (palmar grasp) and a spoon (lateral grasp). Our results confirmed that EEG-based correlates of reach-and-grasp actions can be successfully identified using these mobile systems. In a single-trial multiclass-based decoding approach, which incorporated both movement conditions and rest, we could show that the low frequency time domain (LFTD) correlates were also decodable. Grand average peak accuracy calculated on unseen test data yielded for the water-based electrode system 62.3% (9.2% STD), whereas for the dry-electrodes headset reached 56.4% (8% STD). For the gel-based electrode system 61.3% (8.6% STD) could be achieved. To foster and promote further investigations in the field of EEG-based movement decoding, as well as to allow the interested community to make their own conclusions, we provide all datasets publicly available in the BNCI Horizon 2020 database (http://bnci-horizon-2020.eu/database/data-sets).
Collapse
Affiliation(s)
- Andreas Schwarz
- Institute of Neural Engineering, Graz University of Technology, Graz, Austria
| | | | - Luis Montesano
- Bitbrain, Zaragoza, Spain.,Departamento de Informática e Ingeniería de Sistemas (DIIS), Instituto de Investigación en Ingeniería de Aragón (I3A), Universidad de Zaragoza, Zaragoza, Spain
| | - Gernot R Müller-Putz
- Institute of Neural Engineering, Graz University of Technology, Graz, Austria.,BioTechMed Graz, Graz, Austria
| |
Collapse
|
9
|
Pitt KM, Brumberg JS, Burnison JD, Mehta J, Kidwai J. Behind the Scenes of Noninvasive Brain-Computer Interfaces: A Review of Electroencephalography Signals, How They Are Recorded, and Why They Matter. ACTA ACUST UNITED AC 2019; 4:1622-1636. [PMID: 32529035 DOI: 10.1044/2019_pers-19-00059] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
Abstract
Purpose Brain-computer interface (BCI) techniques may provide computer access for individuals with severe physical impairments. However, the relatively hidden nature of BCI control obscures how BCI systems work behind the scenes, making it difficult to understand how electroencephalography (EEG) records the BCI related brain signals, what brain signals are recorded by EEG, and why these signals are targeted for BCI control. Furthermore, in the field of speech-language-hearing, signals targeted for BCI application have been of primary interest to clinicians and researchers in the area of augmentative and alternative communication (AAC). However, signals utilized for BCI control reflect sensory, cognitive and motor processes, which are of interest to a range of related disciplines including speech science. Method This tutorial was developed by a multidisciplinary team emphasizing primary and secondary BCI-AAC related signals of interest to speech-language-hearing. Results An overview of BCI-AAC related signals are provided discussing 1) how BCI signals are recorded via EEG, 2) what signals are targeted for non-invasive BCI control, including the P300, sensorimotor rhythms, steady state evoked potentials, contingent negative variation, and the N400, and 3) why these signals are targeted. During tutorial creation, attention was given to help support EEG and BCI understanding for those without an engineering background. Conclusion Tutorials highlighting how BCI-AAC signals are elicited and recorded can help increase interest and familiarity with EEG and BCI techniques and provide a framework for understanding key principles behind BCI-AAC design and implementation.
Collapse
Affiliation(s)
- Kevin M Pitt
- Department of Special Education and Communication Disorders, University of Nebraska-Lincoln, Lincoln, NE
| | - Jonathan S Brumberg
- Department of Speech-Language-Hearing: Sciences & Disorders, University of Kansas, Lawrence, KS
| | | | - Jyutika Mehta
- Department of Communication Sciences & Disorders, Texas Woman's University, Denton, TX
| | - Juhi Kidwai
- Department of Speech-Language-Hearing: Sciences & Disorders, University of Kansas, Lawrence, KS
| |
Collapse
|
10
|
Schwarz A, Ofner P, Pereira J, Sburlea AI, Müller-Putz GR. Decoding natural reach-and-grasp actions from human EEG. J Neural Eng 2019; 15:016005. [PMID: 28853420 DOI: 10.1088/1741-2552/aa8911] [Citation(s) in RCA: 75] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Despite the high number of degrees of freedom of the human hand, most actions of daily life can be executed incorporating only palmar, pincer and lateral grasp. In this study we attempt to discriminate these three different executed reach-and-grasp actions utilizing their EEG neural correlates. APPROACH In a cue-guided experiment, 15 healthy individuals were asked to perform these actions using daily life objects. We recorded 72 trials for each reach-and-grasp condition and from a no-movement condition. MAIN RESULTS Using low-frequency time domain features from 0.3 to 3 Hz, we achieved binary classification accuracies of 72.4%, STD ± 5.8% between grasp types, for grasps versus no-movement condition peak performances of 93.5%, STD ± 4.6% could be reached. In an offline multiclass classification scenario which incorporated not only all reach-and-grasp actions but also the no-movement condition, the highest performance could be reached using a window of 1000 ms for feature extraction. Classification performance peaked at 65.9%, STD ± 8.1%. Underlying neural correlates of the reach-and-grasp actions, investigated over the primary motor cortex, showed significant differences starting from approximately 800 ms to 1200 ms after the movement onset which is also the same time frame where classification performance reached its maximum. SIGNIFICANCE We could show that it is possible to discriminate three executed reach-and-grasp actions prominent in people's everyday use from non-invasive EEG. Underlying neural correlates showed significant differences between all tested conditions. These findings will eventually contribute to our attempt of controlling a neuroprosthesis in a natural and intuitive way, which could ultimately benefit motor impaired end users in their daily life actions.
Collapse
Affiliation(s)
- Andreas Schwarz
- Institute of Neural Engineering, Graz University of Technology, Stremayrgasse 16/IV, 8010 Graz, Austria
| | | | | | | | | |
Collapse
|
11
|
Dan B, Pelc K. Ethics of human enhancement in cerebral palsy. Ann Phys Rehabil Med 2019; 63:389-390. [PMID: 30978528 DOI: 10.1016/j.rehab.2019.03.002] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2019] [Revised: 02/28/2019] [Accepted: 03/14/2019] [Indexed: 12/01/2022]
Affiliation(s)
- Bernard Dan
- Université Libre de Bruxelles (ULB), Centre interuniversitaire de référence pour l'infirmité motrice cérébrale ULB-VUB-ULg, and Inkendaal Rehabilitation Hospital, Inkendaalstraat 1, 1602 Vlezenbeek, Belgium.
| | - Karine Pelc
- Université Libre de Bruxelles (ULB), Centre interuniversitaire de référence pour l'infirmité motrice cérébrale ULB-VUB-ULg, and Inkendaal Rehabilitation Hospital, Inkendaalstraat 1, 1602 Vlezenbeek, Belgium
| |
Collapse
|
12
|
Abstract
Restoration of communication in people with complete motor paralysis—a condition called complete locked-in state (CLIS)—is one of the greatest challenges of brain-computer interface (BCI) research. New findings have recently been presented that bring us one step closer to this goal. However, the validity of the evidence has been questioned: independent reanalysis of the same data yielded significantly different results. Reasons for the failure to replicate the findings must be of a methodological nature. What is the best practice to ensure that results are stringent and conclusive and analyses replicable? Confirmation bias and the counterintuitive nature of probability may lead to an overly optimistic interpretation of new evidence. Lack of detail complicates replicability. This Primer explores a recent debate about brain-computer interface studies, observing that confirmation bias and the counter-intuitive nature of probability may lead to an overly optimistic interpretation of scientific results; furthermore, a lack of details complicates replicability of analyses and experiments.
Collapse
Affiliation(s)
- Reinhold Scherer
- Brain-Computer Interfaces and Neural Engineering Laboratory, School of Computer Science and Electronic Engineering, University of Essex, Wivenhoe Park, Colchester, United Kingdom
- * E-mail:
| |
Collapse
|
13
|
Koch Fager S, Fried-Oken M, Jakobs T, Beukelman DR. New and emerging access technologies for adults with complex communication needs and severe motor impairments: State of the science. Augment Altern Commun 2019; 35:13-25. [PMID: 30663899 DOI: 10.1080/07434618.2018.1556730] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022] Open
Abstract
Individuals with complex communication needs often use alternative access technologies to control their augmentative and alternative communication (AAC) devices, their computers, and mobile technologies. While a range of access devices is available, many challenges continue to exist, particularly for those with severe motor-control limitations. For some, access options may not be readily available or access itself may be inaccurate and frustrating. For others, access may be available but only under optimal conditions and support. There is an urgent need to develop new options for individuals with severe motor impairments and to leverage existing technology to improve efficiency, increase accuracy, and decrease fatigue of access. This paper describes person-centred research and development activities related to new and emerging access technologies, with a particular focus on adults with acquired neurological conditions.
Collapse
|
14
|
Jochumsen M, Shafique M, Hassan A, Niazi IK. Movement intention detection in adolescents with cerebral palsy from single-trial EEG. J Neural Eng 2018; 15:066030. [DOI: 10.1088/1741-2552/aae4b8] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
|
15
|
Taherian S, Davies TC. Caregiver and special education staff perspectives of a commercial brain-computer interface as access technology: a qualitative study. BRAIN-COMPUTER INTERFACES 2018. [DOI: 10.1080/2326263x.2018.1505191] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Affiliation(s)
- Sarvnaz Taherian
- School of Psychology, University of Auckland, Auckland, New Zealand
| | - T. Claire Davies
- Faculty of Engineering and Applied Science, Queens University, Kingston, Ontario, Canada
| |
Collapse
|
16
|
Pitt KM, Brumberg JS. Guidelines for Feature Matching Assessment of Brain-Computer Interfaces for Augmentative and Alternative Communication. AMERICAN JOURNAL OF SPEECH-LANGUAGE PATHOLOGY 2018; 27:950-964. [PMID: 29860376 PMCID: PMC6195025 DOI: 10.1044/2018_ajslp-17-0135] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/30/2017] [Revised: 12/01/2017] [Accepted: 02/27/2018] [Indexed: 06/08/2023]
Abstract
PURPOSE Brain-computer interfaces (BCIs) can provide access to augmentative and alternative communication (AAC) devices using neurological activity alone without voluntary movements. As with traditional AAC access methods, BCI performance may be influenced by the cognitive-sensory-motor and motor imagery profiles of those who use these devices. Therefore, we propose a person-centered, feature matching framework consistent with clinical AAC best practices to ensure selection of the most appropriate BCI technology to meet individuals' communication needs. METHOD The proposed feature matching procedure is based on the current state of the art in BCI technology and published reports on cognitive, sensory, motor, and motor imagery factors important for successful operation of BCI devices. RESULTS Considerations for successful selection of BCI for accessing AAC are summarized based on interpretation from a multidisciplinary team with experience in AAC, BCI, neuromotor disorders, and cognitive assessment. The set of features that support each BCI option are discussed in a hypothetical case format to model possible transition of BCI research from the laboratory into clinical AAC applications. CONCLUSIONS This procedure is an initial step toward consideration of feature matching assessment for the full range of BCI devices. Future investigations are needed to fully examine how person-centered factors influence BCI performance across devices.
Collapse
Affiliation(s)
- Kevin M. Pitt
- Department of Speech-Language-Hearing: Sciences & Disorders, The University of Kansas, Lawrence
| | - Jonathan S. Brumberg
- Department of Speech-Language-Hearing: Sciences & Disorders, Neuroscience Graduate Program, The University of Kansas, Lawrence
| |
Collapse
|
17
|
User’s Emotions and Usability Study of a Brain-Computer Interface Applied to People with Cerebral Palsy. TECHNOLOGIES 2018. [DOI: 10.3390/technologies6010028] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
18
|
Brumberg JS, Pitt KM, Mantie-Kozlowski A, Burnison JD. Brain-Computer Interfaces for Augmentative and Alternative Communication: A Tutorial. AMERICAN JOURNAL OF SPEECH-LANGUAGE PATHOLOGY 2018; 27:1-12. [PMID: 29318256 PMCID: PMC5968329 DOI: 10.1044/2017_ajslp-16-0244] [Citation(s) in RCA: 50] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/31/2016] [Accepted: 08/14/2017] [Indexed: 05/10/2023]
Abstract
PURPOSE Brain-computer interfaces (BCIs) have the potential to improve communication for people who require but are unable to use traditional augmentative and alternative communication (AAC) devices. As BCIs move toward clinical practice, speech-language pathologists (SLPs) will need to consider their appropriateness for AAC intervention. METHOD This tutorial provides a background on BCI approaches to provide AAC specialists foundational knowledge necessary for clinical application of BCI. Tutorial descriptions were generated based on a literature review of BCIs for restoring communication. RESULTS The tutorial responses directly address 4 major areas of interest for SLPs who specialize in AAC: (a) the current state of BCI with emphasis on SLP scope of practice (including the subareas: the way in which individuals access AAC with BCI, the efficacy of BCI for AAC, and the effects of fatigue), (b) populations for whom BCI is best suited, (c) the future of BCI as an addition to AAC access strategies, and (d) limitations of BCI. CONCLUSION Current BCIs have been designed as access methods for AAC rather than a replacement; therefore, SLPs can use existing knowledge in AAC as a starting point for clinical application. Additional training is recommended to stay updated with rapid advances in BCI.
Collapse
Affiliation(s)
- Jonathan S. Brumberg
- Department of Speech-Language-Hearing: Sciences and Disorders, Neuroscience Graduate Program, The University of Kansas, Lawrence
| | - Kevin M. Pitt
- Department of Speech-Language-Hearing: Sciences and Disorders, The University of Kansas, Lawrence
| | | | | |
Collapse
|
19
|
Lazarou I, Nikolopoulos S, Petrantonakis PC, Kompatsiaris I, Tsolaki M. EEG-Based Brain-Computer Interfaces for Communication and Rehabilitation of People with Motor Impairment: A Novel Approach of the 21 st Century. Front Hum Neurosci 2018; 12:14. [PMID: 29472849 PMCID: PMC5810272 DOI: 10.3389/fnhum.2018.00014] [Citation(s) in RCA: 110] [Impact Index Per Article: 18.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2016] [Accepted: 01/12/2018] [Indexed: 12/14/2022] Open
Abstract
People with severe neurological impairments face many challenges in sensorimotor functions and communication with the environment; therefore they have increased demand for advanced, adaptive and personalized rehabilitation. During the last several decades, numerous studies have developed brain-computer interfaces (BCIs) with the goals ranging from providing means of communication to functional rehabilitation. Here we review the research on non-invasive, electroencephalography (EEG)-based BCI systems for communication and rehabilitation. We focus on the approaches intended to help severely paralyzed and locked-in patients regain communication using three different BCI modalities: slow cortical potentials, sensorimotor rhythms and P300 potentials, as operational mechanisms. We also review BCI systems for restoration of motor function in patients with spinal cord injury and chronic stroke. We discuss the advantages and limitations of these approaches and the challenges that need to be addressed in the future.
Collapse
Affiliation(s)
- Ioulietta Lazarou
- Information Technologies Institute, Centre for Research and Technology Hellas, Thessaloniki, Greece.,1st Department of Neurology, University Hospital "AHEPA", School of Medicine, Aristotle University of Thessaloniki, Thessaloniki, Greece.,Greek Association of Alzheimer's Disease and Related Disorders, Thessaloniki, Greece
| | - Spiros Nikolopoulos
- Information Technologies Institute, Centre for Research and Technology Hellas, Thessaloniki, Greece
| | | | - Ioannis Kompatsiaris
- Information Technologies Institute, Centre for Research and Technology Hellas, Thessaloniki, Greece
| | - Magda Tsolaki
- Information Technologies Institute, Centre for Research and Technology Hellas, Thessaloniki, Greece.,1st Department of Neurology, University Hospital "AHEPA", School of Medicine, Aristotle University of Thessaloniki, Thessaloniki, Greece.,Greek Association of Alzheimer's Disease and Related Disorders, Thessaloniki, Greece
| |
Collapse
|
20
|
Müller-Putz GR, Schwarz A, Pereira J, Ofner P. From classic motor imagery to complex movement intention decoding: The noninvasive Graz-BCI approach. PROGRESS IN BRAIN RESEARCH 2017; 228:39-70. [PMID: 27590965 DOI: 10.1016/bs.pbr.2016.04.017] [Citation(s) in RCA: 42] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
In this chapter, we give an overview of the Graz-BCI research, from the classic motor imagery detection to complex movement intentions decoding. We start by describing the classic motor imagery approach, its application in tetraplegic end users, and the significant improvements achieved using coadaptive brain-computer interfaces (BCIs). These strategies have the drawback of not mirroring the way one plans a movement. To achieve a more natural control-and to reduce the training time-the movements decoded by the BCI need to be closely related to the user's intention. Within this natural control, we focus on the kinematic level, where movement direction and hand position or velocity can be decoded from noninvasive recordings. First, we review movement execution decoding studies, where we describe the decoding algorithms, their performance, and associated features. Second, we describe the major findings in movement imagination decoding, where we emphasize the importance of estimating the sources of the discriminative features. Third, we introduce movement target decoding, which could allow the determination of the target without knowing the exact movement-by-movement details. Aside from the kinematic level, we also address the goal level, which contains relevant information on the upcoming action. Focusing on hand-object interaction and action context dependency, we discuss the possible impact of some recent neurophysiological findings in the future of BCI control. Ideally, the goal and the kinematic decoding would allow an appropriate matching of the BCI to the end users' needs, overcoming the limitations of the classic motor imagery approach.
Collapse
Affiliation(s)
- G R Müller-Putz
- Graz University of Technology, Institute of Neural Engineering, Graz, Austria.
| | - A Schwarz
- Graz University of Technology, Institute of Neural Engineering, Graz, Austria
| | - J Pereira
- Graz University of Technology, Institute of Neural Engineering, Graz, Austria
| | - P Ofner
- Graz University of Technology, Institute of Neural Engineering, Graz, Austria
| |
Collapse
|
21
|
Lampe R, Blumenstein T, Turova V, Alves-Pinto A. Mobile communication jacket for people with severe speech impairment. Disabil Rehabil Assist Technol 2017; 13:280-286. [PMID: 28447491 DOI: 10.1080/17483107.2017.1319427] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
PURPOSE Cerebral palsy is a movement disorder caused by damage to motor control areas of the developing brain during early childhood. Motor disorders can also affect the ability to produce clear speech and to communicate. The aim of this study was to develop and to test a prototype of an assistive tool with an embedded mobile communication device to support patients with severe speech impairments. METHODS A prototype was developed by equipping a cycling jacket with a display, a small keyboard, a LED and an alarm system, all controlled by a microcontroller. Functionality of the prototype was tested in six participants (aged 7-20 years) with cerebral palsy and global developmental disorder and three healthy persons. A patient questionnaire consisting of seven items was used as an evaluation tool. RESULTS A working prototype of the communication jacket was developed and tested. The questionnaire elicited positive responses from participants. Improvements to correct revealed weaknesses were proposed. Enhancements like voice output of pre-selected phrases and enlarged display were implemented. CONCLUSIONS Integration in a jacket makes the system mobile and continuously available to the user. The communication jacket may be of great benefit to patients with motor and speech impairments. Implications for Rehabilitation The communication jacket developed can be easily used by people with movement and speech impairment. All technical components are integrated in a garment and do not have to be held with the hands or transported separately. The system is adaptable to individual use. Both expected and unexpected events can be dealt with, which contributes to the quality of life and self-fulfilment.
Collapse
Affiliation(s)
- Renée Lampe
- a Research Unit of the Buhl-Strohmaier-Foundation for Paediatric Neuro-Orthopaedics and Cerebral Palsy of the Clinic for Orthopaedics and Sports Orthopaedics , Clinic 'rechts der Isar' of the Technical University of Munich , Munich , Germany.,b Markus Würth Professor Fellowship , Clinic 'rechts der Isar' of the Technical University of Munich , Munich , Germany
| | - Tobias Blumenstein
- a Research Unit of the Buhl-Strohmaier-Foundation for Paediatric Neuro-Orthopaedics and Cerebral Palsy of the Clinic for Orthopaedics and Sports Orthopaedics , Clinic 'rechts der Isar' of the Technical University of Munich , Munich , Germany
| | - Varvara Turova
- a Research Unit of the Buhl-Strohmaier-Foundation for Paediatric Neuro-Orthopaedics and Cerebral Palsy of the Clinic for Orthopaedics and Sports Orthopaedics , Clinic 'rechts der Isar' of the Technical University of Munich , Munich , Germany
| | - Ana Alves-Pinto
- a Research Unit of the Buhl-Strohmaier-Foundation for Paediatric Neuro-Orthopaedics and Cerebral Palsy of the Clinic for Orthopaedics and Sports Orthopaedics , Clinic 'rechts der Isar' of the Technical University of Munich , Munich , Germany
| |
Collapse
|
22
|
Huggins JE, Guger C, Ziat M, Zander TO, Taylor D, Tangermann M, Soria-Frisch A, Simeral J, Scherer R, Rupp R, Ruffini G, Robinson DKR, Ramsey NF, Nijholt A, Müller-Putz G, McFarland DJ, Mattia D, Lance BJ, Kindermans PJ, Iturrate I, Herff C, Gupta D, Do AH, Collinger JL, Chavarriaga R, Chase SM, Bleichner MG, Batista A, Anderson CW, Aarnoutse EJ. Workshops of the Sixth International Brain-Computer Interface Meeting: brain-computer interfaces past, present, and future. BRAIN-COMPUTER INTERFACES 2017; 4:3-36. [PMID: 29152523 PMCID: PMC5693371 DOI: 10.1080/2326263x.2016.1275488] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
The Sixth International Brain-Computer Interface (BCI) Meeting was held 30 May-3 June 2016 at the Asilomar Conference Grounds, Pacific Grove, California, USA. The conference included 28 workshops covering topics in BCI and brain-machine interface research. Topics included BCI for specific populations or applications, advancing BCI research through use of specific signals or technological advances, and translational and commercial issues to bring both implanted and non-invasive BCIs to market. BCI research is growing and expanding in the breadth of its applications, the depth of knowledge it can produce, and the practical benefit it can provide both for those with physical impairments and the general public. Here we provide summaries of each workshop, illustrating the breadth and depth of BCI research and highlighting important issues and calls for action to support future research and development.
Collapse
Affiliation(s)
- Jane E. Huggins
- Department of Physical Medicine and Rehabilitation, Department of Biomedical Engineering, University of Michigan, Ann Arbor, Michigan, USA
| | - Christoph Guger
- G.Tec Medical Engineering GmbH, Guger Technologies OG, Schiedlberg, Austria
| | - Mounia Ziat
- Psychology Department, Northern Michigan University, Marquette, MI, USA
| | - Thorsten O. Zander
- Team PhyPA, Biological Psychology and Neuroergonomics, Technical University of Berlin, Berlin, Germany
| | | | - Michael Tangermann
- Cluster of Excellence BrainLinks-BrainTools, University of Freiburg, Germany
| | | | - John Simeral
- Ctr. For Neurorestoration and Neurotechnology, Rehab. R&D Service, Dept. of VA Medical Center, School of Engineering, Brown University, Providence, RI, USA
| | - Reinhold Scherer
- Institute of Neural Engineering, BCI- Lab, Graz University of Technology, Graz, Austria
| | - Rüdiger Rupp
- Section Experimental Neurorehabilitation, Spinal Cord Injury Center, University Hospital in Heidelberg, Heidelberg, Germany
| | - Giulio Ruffini
- Neuroscience Business Unit, Starlab Barcelona SLU, Barcelona, Spain
- Neuroelectrics Inc., Boston, USA
| | - Douglas K. R. Robinson
- Institute: Laboratoire Interdisciplinaire Sciences Innovations Sociétés (LISIS), Université Paris-Est Marne-la-Vallée, MARNE-LA-VALLÉE, France
| | - Nick F. Ramsey
- Dept Neurology & Neurosurgery, Brain Center Rudolf Magnus, University Medical Center Utrecht, University of Utrecht, Utrecht, Netherlands
| | - Anton Nijholt
- Faculty EEMCS, Enschede, University of Twente, The Netherlands & Imagineering Institute, Iskandar, Malaysia
| | - Gernot Müller-Putz
- Institute of Neural Engineering, BCI- Lab, Graz University of Technology, Graz, Austria
| | - Dennis J. McFarland
- New York State Department of Health, National Center for Adaptive Neurotechnologies, Wadsworth Center, Albany, New York USA
| | - Donatella Mattia
- Clinical Neurophysiology, Fondazione Santa Lucia, Neuroelectrical Imaging and BCI Lab, IRCCS, Rome, Italy
| | - Brent J. Lance
- Human Research and Engineering Directorate, U.S. Army Research Laboratory, Aberdeen Proving Ground, Aberdeen, MD USA
| | | | - Iñaki Iturrate
- Defitech Chair in Brain–machine Interface (CNBI), Center for Neuroprosthetics, École Polytechnique Fédérale de Lausanne, EPFL-STI-CNBI, Campus Biotech H4, Geneva, Switzerland
| | - Christian Herff
- Cognitive Systems Lab, University of Bremen, Bremen, Germany
| | - Disha Gupta
- Brain Mind Research Inst, Weill Cornell Medical College, Early Brain Injury and Recovery Lab, Burke Medical Research Inst, White Plains, New York, USA
| | - An H. Do
- Department of Neurology, UC Irvine Brain Computer Interface Lab, University of California, Irvine, CA, USA
| | - Jennifer L. Collinger
- Department of Physical Medicine and Rehabilitation, Department of Veterans Affairs, VA Pittsburgh Healthcare System, University of Pittsburgh, Pittsburgh, PA, USA
| | - Ricardo Chavarriaga
- Defitech Chair in Brain–machine Interface (CNBI), Center for Neuroprosthetics, École Polytechnique Fédérale de Lausanne, EPFL-STI-CNBI, Campus Biotech H4, Geneva, Switzerland
| | - Steven M. Chase
- Center for the Neural Basis of Cognition and Department Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Martin G. Bleichner
- Neuropsychology Lab, Department of Psychology, European Medical School, Cluster of Excellence Hearing4all, University of Oldenburg, Oldenburg, Germany
| | - Aaron Batista
- Department of Bioengineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA USA
| | - Charles W. Anderson
- Department of Computer Science, Colorado State University, Fort Collins, CO USA
| | - Erik J. Aarnoutse
- Brain Center Rudolf Magnus, Dept Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, The Netherlands
| |
Collapse
|
23
|
Chavarriaga R, Fried-Oken M, Kleih S, Lotte F, Scherer R. Heading for new shores! Overcoming pitfalls in BCI design. BRAIN-COMPUTER INTERFACES 2016; 4:60-73. [PMID: 29629393 DOI: 10.1080/2326263x.2016.1263916] [Citation(s) in RCA: 53] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
Research in brain-computer interfaces has achieved impressive progress towards implementing assistive technologies for restoration or substitution of lost motor capabilities, as well as supporting technologies for able-bodied subjects. Notwithstanding this progress, effective translation of these interfaces from proof-of concept prototypes into reliable applications remains elusive. As a matter of fact, most of the current BCI systems cannot be used independently for long periods of time by their intended end-users. Multiple factors that impair achieving this goal have already been identified. However, it is not clear how do they affect the overall BCI performance or how they should be tackled. This is worsened by the publication bias where only positive results are disseminated, preventing the research community from learning from its errors. This paper is the result of a workshop held at the 6th International BCI meeting in Asilomar. We summarize here the discussion on concrete research avenues and guidelines that may help overcoming common pitfalls and make BCIs become a useful alternative communication device.
Collapse
Affiliation(s)
- Ricardo Chavarriaga
- Defitech Chair in Brain-Machine Interface (CNBI), Center for Neuroprosthetics, Ecole Polytechnique Fédérale de Lausanne, Switzerland
| | - Melanie Fried-Oken
- Oregon Health & Science University, Institute on Development and Disability, Portland, Oregon USA
| | - Sonja Kleih
- Institute of Psychology, University of Würzburg, Marcusstraße 9-11, Würzburg, 97070, Germany
| | - Fabien Lotte
- Inria Bordeaux Sud-Ouest/LaBRI, 200 avenue de la vieille tour, 33405, Talence cedex, France
| | - Reinhold Scherer
- Institute of Neural Engineering, BCI-Lab, Graz University of Technology, Stremayrgasse 16/IV, 8010 Graz, Austria
| |
Collapse
|
24
|
Pinegger A, Wriessnegger SC, Faller J, Müller-Putz GR. Evaluation of Different EEG Acquisition Systems Concerning Their Suitability for Building a Brain-Computer Interface: Case Studies. Front Neurosci 2016; 10:441. [PMID: 27746714 PMCID: PMC5043223 DOI: 10.3389/fnins.2016.00441] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2015] [Accepted: 09/09/2016] [Indexed: 11/13/2022] Open
Abstract
One important aspect in non-invasive brain-computer interface (BCI) research is to acquire the electroencephalogram (EEG) in a proper way. From an end-user perspective, it means with maximum comfort and without any extra inconveniences (e.g., washing the hair), whereas from a technical perspective, the signal quality has to be optimal to make the BCI work effectively and efficiently. In this work, we evaluated three different commercially available EEG acquisition systems that differ in the type of electrodes (gel-, water-, and dry-based), the amplifier technique, and the data transmission method. Every system was tested regarding three different aspects, namely, technical, BCI effectiveness and efficiency (P300 communication and control), and user satisfaction (comfort). We found that water-based system had the lowest short circuit noise level, the hydrogel-based system had the highest P300 spelling accuracies, and the dry electrode-based system caused the least inconveniences. Therefore, building a reliable BCI is possible with all the evaluated systems, and it is on the user to decide which system meets the given requirements best.
Collapse
Affiliation(s)
- Andreas Pinegger
- Institute of Neural Engineering, Graz University of Technology Graz, Austria
| | | | - Josef Faller
- Laboratory for Intelligent Imaging and Neural Computing, Columbia University in the City of New York New York, NY, USA
| | | |
Collapse
|
25
|
Taherian S, Selitskiy D, Pau J, Claire Davies T. Are we there yet? Evaluating commercial grade brain-computer interface for control of computer applications by individuals with cerebral palsy. Disabil Rehabil Assist Technol 2015; 12:165-174. [PMID: 26699697 DOI: 10.3109/17483107.2015.1111943] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
PURPOSE Using a commercial electroencephalography (EEG)-based brain-computer interface (BCI), the training and testing protocol for six individuals with spastic quadriplegic cerebral palsy (GMFCS and MACS IV and V) was evaluated. METHOD A customised, gamified training paradigm was employed. Over three weeks, the participants spent two sessions exploring the system, and up to six sessions playing the game which focussed on EEG feedback of left and right arm motor imagery. RESULTS The participants showed variable inconclusive results in the ability to produce two distinct EEG patterns. Participant performance was influenced by physical illness, motivation, fatigue and concentration. CONCLUSIONS The results from this case study highlight the infancy of BCIs as a form of assistive technology for people with cerebral palsy. Existing commercial BCIs are not designed according to the needs of end-users. Implications for Rehabilitation Mood, fatigue, physical illness and motivation influence the usability of a brain-computer interface. Commercial brain-computer interfaces are not designed for practical assistive technology use for people with cerebral palsy. Practical brain-computer interface assistive technologies may need to be flexible to suit individual needs.
Collapse
Affiliation(s)
- Sarvnaz Taherian
- a Department of Psychology , University of Auckland , Auckland , New Zealand
| | | | - James Pau
- c Thought-Wired Ltd , Auckland , New Zealand
| | - T Claire Davies
- b Department of Mechanical Engineering , University of Auckland , Auckland , New Zealand
| |
Collapse
|
26
|
Bojorges-Valdez E, Echeverría JC, Yanez-Suarez O. Evaluation of the continuous detection of mental calculation episodes as a BCI control input. Comput Biol Med 2015; 64:155-62. [DOI: 10.1016/j.compbiomed.2015.06.014] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2014] [Revised: 06/16/2015] [Accepted: 06/17/2015] [Indexed: 11/30/2022]
|
27
|
Scherer R, Faller J, Friedrich EVC, Opisso E, Costa U, Kübler A, Müller-Putz GR. Individually adapted imagery improves brain-computer interface performance in end-users with disability. PLoS One 2015; 10:e0123727. [PMID: 25992718 PMCID: PMC4436356 DOI: 10.1371/journal.pone.0123727] [Citation(s) in RCA: 39] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2014] [Accepted: 03/06/2015] [Indexed: 11/19/2022] Open
Abstract
Brain-computer interfaces (BCIs) translate oscillatory electroencephalogram (EEG) patterns into action. Different mental activities modulate spontaneous EEG rhythms in various ways. Non-stationarity and inherent variability of EEG signals, however, make reliable recognition of modulated EEG patterns challenging. Able-bodied individuals who use a BCI for the first time achieve - on average - binary classification performance of about 75%. Performance in users with central nervous system (CNS) tissue damage is typically lower. User training generally enhances reliability of EEG pattern generation and thus also robustness of pattern recognition. In this study, we investigated the impact of mental tasks on binary classification performance in BCI users with central nervous system (CNS) tissue damage such as persons with stroke or spinal cord injury (SCI). Motor imagery (MI), that is the kinesthetic imagination of movement (e.g. squeezing a rubber ball with the right hand), is the "gold standard" and mainly used to modulate EEG patterns. Based on our recent results in able-bodied users, we hypothesized that pair-wise combination of "brain-teaser" (e.g. mental subtraction and mental word association) and "dynamic imagery" (e.g. hand and feet MI) tasks significantly increases classification performance of induced EEG patterns in the selected end-user group. Within-day (How stable is the classification within a day?) and between-day (How well does a model trained on day one perform on unseen data of day two?) analysis of variability of mental task pair classification in nine individuals confirmed the hypothesis. We found that the use of the classical MI task pair hand vs. feed leads to significantly lower classification accuracy - in average up to 15% less - in most users with stroke or SCI. User-specific selection of task pairs was again essential to enhance performance. We expect that the gained evidence will significantly contribute to make imagery-based BCI technology become accessible to a larger population of users including individuals with special needs due to CNS damage.
Collapse
Affiliation(s)
- Reinhold Scherer
- Institute for Knowledge Discovery, Graz University of Technology, 8010 Graz, Austria
- BioTechMed-Graz, Austria
- Clinic Judendorf-Straßengel, 8111 Gratwein-Straßengel, Austria
- * E-mail:
| | - Josef Faller
- Institute for Knowledge Discovery, Graz University of Technology, 8010 Graz, Austria
- BioTechMed-Graz, Austria
| | - Elisabeth V. C. Friedrich
- Institute for Knowledge Discovery, Graz University of Technology, 8010 Graz, Austria
- BioTechMed-Graz, Austria
- Department of Cognitive Science, University of California, San Diego, La Jolla, CA, 92093, USA
| | - Eloy Opisso
- Institut Guttmann, Institut Universitari de Neurorehabilitació adscrit a la UAB, 08916 Badalona, Barcelona, Spain
| | - Ursula Costa
- Institut Guttmann, Institut Universitari de Neurorehabilitació adscrit a la UAB, 08916 Badalona, Barcelona, Spain
| | - Andrea Kübler
- Institute of Psychology, University of Würzburg, 97070 Würzburg, Germany
| | - Gernot R. Müller-Putz
- Institute for Knowledge Discovery, Graz University of Technology, 8010 Graz, Austria
- BioTechMed-Graz, Austria
| |
Collapse
|
28
|
Luauté J, Laffont I. BCIs and physical medicine and rehabilitation: The future is now. Ann Phys Rehabil Med 2015; 58:1-2. [DOI: 10.1016/j.rehab.2014.12.002] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2014] [Revised: 12/18/2014] [Accepted: 12/18/2014] [Indexed: 10/24/2022]
|