1
|
Xavier Macedo de Azevedo F, Heimgärtner R, Nebe K. Development of a metric to evaluate the ergonomic principles of assistive systems, based on the DIN 92419. ERGONOMICS 2023; 66:821-848. [PMID: 36137226 DOI: 10.1080/00140139.2022.2127920] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Accepted: 09/18/2022] [Indexed: 05/24/2023]
Abstract
The DIN 92419 defines six principles for assistive systems' ergonomic design. There is, however, a lack of measurement tools to evaluate assistive systems considering these principles. Consequently, this study developed a measurement tool for the quantitative evaluation of the fulfilment of each principle for assistive systems. A systematic literature review was performed to identify dimensions belonging to the principles, identify how previous research evaluated these dimensions, and develop a measurement tool for assistive systems. Findings show that scales commonly used for evaluating assistive systems disregard several aspects highlighted as relevant by research, implying the need for considering the DIN 92419 principles. Based on established scales and theoretical findings, a questionnaire, and a checklist for evaluating assistive systems were developed. The work provides a grounding for measuring relevant aspects of assistive systems. Further development is needed to substantiate the reliability and validity of the proposed questionnaire scales and items. Practitioner Summary: Responding to the gap of a holistic measurement tool to evaluate assistive systems, a systematic literature review was performed considering the DIN 92419 principles. This resulted in a comprehensive summary of relevant aspects of assistive systems that were made numerically measurable, which proposes better criteria to assess assistive systems. Abbreviations: IoT: internet of things; RQ: research question; TAM: technology acceptance model; UTAUT: unified theory of acceptance and use of technology; AaaS: adaptivity as a service; SAR: socially assistive robots; SEEV: salience, effort, expectancy, and value; PRISMA: preferred reporting items for systematic reviews and meta-analyses; HMI: human-machine interaction; HRI: human-robot interaction; BCI: brain-computer interface; QUEST: Quebec user evaluation of satisfaction with assistive technology; SUS: system usability scale; NASA-TLX: NASA task load index; ATD PA: assistive technology device predisposition assessment; Wheel Con: wheelchair use confidence scale; CATOM: caregiver assistive technology outcome measure; CBI: caregiver burden inventory; RoSAS: robotic social attributes scale; WheelCon: wheelchair use confidence scale; IMI: intrinsic motivation inventory; ATD PA: assistive technology device predisposition assessment; UEQ: User experience questionnaire; USEUQ: usefulness satisfaction and ease of use questionnaire; USPW: usability scale for power wheelchairs; UES: user engagement scale; SUTAQ: service user technology acceptability questionnaire; QUEAD: questionnaire for the evaluation of physical assistive devices; FATCAT: functional assessment tool for cognitive assistive technology; SE-HRI: human-robot interaction scale; SART: situation awareness rating technique; TSQ;WT: tele-healthcare satisfaction questionnaire-wearable technology; PAIF: participants' assessment of the intervention's feasibility; SWAT: subjective workload assessment technique; MARS-HA: measure of audiologic rehabilitation self-efficacy for hearing aids; IOI-HA: International outcome inventory for hearing aids; FMA: functional mobility assessment; FBIS: familiarity and behavioural intention survey; CSQ: client satisfaction questionnaire; COPM: canadian occupational performance measure; ATCS: assistive technology confidence scale; ACC: acceptance; SSP: safety, security and privacy; OPT: optimisation of resultant internal load; CTRL: controllability; ADAPT: adaptability; P&I: perceptibility and identifiability; AAL: ambient assisted living; VR: virtual reality; AS: assistive system; WEIRD: Western, educated, industrialised, rich, and democratic; HEART: horizontal european activities of rehabilitation technology; AAATE: advancement of assistive technology in Europe's; GATE: global collaboration on assistive technology; ATA-C: assistive technology assessment toolkit.
Collapse
Affiliation(s)
| | - Rüdiger Heimgärtner
- Faculty of Communication and Environment, Rhine-Waal University of Applied Sciences, Kamp-Lintfort, Germany
| | - Karsten Nebe
- Faculty of Communication and Environment, Rhine-Waal University of Applied Sciences, Kamp-Lintfort, Germany
| |
Collapse
|
2
|
Peters B, Eddy B, Galvin-McLaughlin D, Betz G, Oken B, Fried-Oken M. A systematic review of research on augmentative and alternative communication brain-computer interface systems for individuals with disabilities. Front Hum Neurosci 2022; 16:952380. [PMID: 35966988 PMCID: PMC9374067 DOI: 10.3389/fnhum.2022.952380] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Accepted: 07/04/2022] [Indexed: 11/13/2022] Open
Abstract
Augmentative and alternative communication brain-computer interface (AAC-BCI) systems are intended to offer communication access to people with severe speech and physical impairment (SSPI) without requiring volitional movement. As the field moves toward clinical implementation of AAC-BCI systems, research involving participants with SSPI is essential. Research has demonstrated variability in AAC-BCI system performance across users, and mixed results for comparisons of performance for users with and without disabilities. The aims of this systematic review were to (1) describe study, system, and participant characteristics reported in BCI research, (2) summarize the communication task performance of participants with disabilities using AAC-BCI systems, and (3) explore any differences in performance for participants with and without disabilities. Electronic databases were searched in May, 2018, and March, 2021, identifying 6065 records, of which 73 met inclusion criteria. Non-experimental study designs were common and sample sizes were typically small, with approximately half of studies involving five or fewer participants with disabilities. There was considerable variability in participant characteristics, and in how those characteristics were reported. Over 60% of studies reported an average selection accuracy ≤70% for participants with disabilities in at least one tested condition. However, some studies excluded participants who did not reach a specific system performance criterion, and others did not state whether any participants were excluded based on performance. Twenty-nine studies included participants both with and without disabilities, but few reported statistical analyses comparing performance between the two groups. Results suggest that AAC-BCI systems show promise for supporting communication for people with SSPI, but they remain ineffective for some individuals. The lack of standards in reporting outcome measures makes it difficult to synthesize data across studies. Further research is needed to demonstrate efficacy of AAC-BCI systems for people who experience SSPI of varying etiologies and severity levels, and these individuals should be included in system design and testing. Consensus in terminology and consistent participant, protocol, and performance description will facilitate the exploration of user and system characteristics that positively or negatively affect AAC-BCI use, and support innovations that will make this technology more useful to a broader group of people. Clinical trial registration https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42018095345, PROSPERO: CRD42018095345.
Collapse
Affiliation(s)
- Betts Peters
- Consortium for Accessible Multimodal Brain-Body Interfaces, United States
- REKNEW Projects, Institute on Development and Disability, Department of Pediatrics, Oregon Health and Science University, Portland, OR, United States
| | - Brandon Eddy
- Consortium for Accessible Multimodal Brain-Body Interfaces, United States
- REKNEW Projects, Institute on Development and Disability, Department of Pediatrics, Oregon Health and Science University, Portland, OR, United States
- Speech and Hearing Sciences Department, Portland State University, Portland, OR, United States
| | - Deirdre Galvin-McLaughlin
- Consortium for Accessible Multimodal Brain-Body Interfaces, United States
- REKNEW Projects, Institute on Development and Disability, Department of Pediatrics, Oregon Health and Science University, Portland, OR, United States
| | - Gail Betz
- Health Sciences and Human Services Library, University of Maryland, Baltimore, MD, United States
| | - Barry Oken
- Consortium for Accessible Multimodal Brain-Body Interfaces, United States
- Department of Neurology, Oregon Health & Science University, Portland, OR, United States
| | - Melanie Fried-Oken
- Consortium for Accessible Multimodal Brain-Body Interfaces, United States
- REKNEW Projects, Institute on Development and Disability, Department of Pediatrics, Oregon Health and Science University, Portland, OR, United States
| |
Collapse
|
3
|
Floreani ED, Kelly D, Rowley D, Irvine B, Kinney-Lang E, Kirton A. Iterative Development of a Software to Facilitate Independent Home Use of BCI Technologies for Children with Quadriplegic Cerebral Palsy. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:3361-3364. [PMID: 36086125 DOI: 10.1109/embc48229.2022.9871105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Brain-computer interfaces (BCIs) are emerging as a new solution for children with severe disabilities to interact with the world. However, BCI technologies have yet to reach end-users in their daily lives due to significant translational gaps. To address these gaps, we applied user-centered design principles to establish a home BCI program for children with quadriplegic cerebral palsy. This work describes the technical development of the software we designed to facilitate BCI use at home. Children and their families were involved at each design stage to evaluate and provide feedback. Since deployment, seven families have successfully used the system independently at home and continue to use BCI at home to further enable participation and independence for their children. Clinical relevance- The design and successful implementation of user-centered software for home use will both inform on the feasibility of BCI as a long-term access solution for children with neurological disabilities as well as decrease barriers of accessibility and availability of BCI technologies for end-users.
Collapse
|
4
|
Cardoso ASS, Andreasen Struijk LNS, Kaeseler RL, Jochumsen M. Comparing the Usability of Alternative EEG Devices to Traditional Electrode Caps for SSVEP-BCI Controlled Assistive Robots. IEEE Int Conf Rehabil Robot 2022; 2022:1-6. [PMID: 36176154 DOI: 10.1109/icorr55369.2022.9896588] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Despite having the potential to improve the lives of severely paralyzed users, non-invasive Brain Computer Interfaces (BCI) have yet to be integrated into their daily lives. The widespread adoption of BCI-driven assistive technology is hindered by its lacking usability, as both end-users and researchers alike find fault with traditional EEG caps. In this paper, we compare the usability of four EEG recording devices for Steady-State Visually Evoked Potentials (SSVEP)-BCI applications: an EEG cap (active gel electrodes), two headbands (passive gel or active dry electrodes), and two adhesive electrodes placed on each mastoid. Ten able-bodied participants tested each device by completing an 8-target SSVEP paradigm. Setup times were recorded, and participants rated their satisfaction with each device. The EEG cap obtained the best classification accuracies (Median = 98.96%), followed by the gel electrode headband (Median = 93.75%), and the dry electrode headband (Median = 91.14%). The mastoid electrodes obtained classification accuracies close to chance level (Med = 29.69%). Unknowing of the classification accuracy, participants found the mastoid electrodes to be the most comfortable and discrete. The dry electrode headband obtained the lowest user satisfaction score and was criticized for being too uncomfortable. Participants also noted that the EEG cap was too conspicuous. The gel-based headband provided a good trade-off between BCI performance and user satisfaction.
Collapse
|
5
|
Loizidou P, Rios E, Marttini A, Keluo-Udeke O, Soetedjo J, Belay J, Perifanos K, Pouratian N, Speier W. Extending Brain-Computer Interface Access with a Multilingual Language Model in the P300 Speller. BRAIN-COMPUTER INTERFACES 2022; 9:36-48. [PMID: 35574291 PMCID: PMC9094140 DOI: 10.1080/2326263x.2021.1993426] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
Brain-computer interfaces (BCI) such as the P300 speller have the potential to restore communication to advanced-stage neuromuscular disease patients. Research has improved typing speed and accuracy through innovations including the use of language models. While significant advances have been made, implementations have largely been restricted to a single language, primarily English. It is unclear whether these improvements would extend to other languages that present potential technical hurdles due to different alphabets and grammatical structures. Here, we adapt a language model-based classifier designed for English to two other languages, Spanish and Greek, to demonstrate the generalizability of these methods. Online experimental trials with 30 healthy native English, Spanish, and Greek speakers showed no significant difference between performances using the different versions of the system (66.20 vs. 61.97 vs. 60.89 bits/minute). Extending these methods across languages allows for expanding access to BCI systems to other populations, particularly in the developing world.
Collapse
Affiliation(s)
- P Loizidou
- Radiological Sciences, University of California, Los Angeles, Los Angeles, CA 90024, USA
| | - E Rios
- Radiology, Stanford University, Stanford, CA 94305, USA
| | - A Marttini
- Radiological Sciences, University of California, Los Angeles, Los Angeles, CA 90024, USA
| | - O Keluo-Udeke
- Computer Science, University of Arkansas at Pine Bluff, Pine Bluff, AR 71601, USA
| | - J Soetedjo
- Bioengineering, University of Washington, Seattle, Washington 98195, USA
| | - J Belay
- Radiological Sciences, University of California, Los Angeles, Los Angeles, CA 90024, USA
| | - K Perifanos
- Linguistics, National and Kapodistrian University of Athens, Athens, Attica 15784, Greece
| | - N Pouratian
- Neurosurgery, University of California, Los Angeles, Los Angeles CA 90024, USA
| | - W Speier
- Radiological Sciences, University of California, Los Angeles, Los Angeles, CA 90024, USA,Corresponding Author: 924 Westwood Blvd, Suite 600, Los Angeles, CA 90024, (215) 206-6007,
| |
Collapse
|
6
|
Sahonero-Alvarez G, Singh AK, Sayrafian K, Bianchi L, Roman-Gonzalez A. A Functional BCI Model by the P2731 Working Group: Transducer. BRAIN-COMPUTER INTERFACES 2021. [DOI: 10.1080/2326263x.2021.1968633] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Affiliation(s)
| | | | - Kamran Sayrafian
- Information Technology Laboratory, National Institute of Standards & Technology, Gaithersburg, USA
| | - Luigi Bianchi
- Civil Engineering and Computer Science Engineering Dept. Tor Vergata University of Rome, Rome, Italy
| | | |
Collapse
|
7
|
Jamil N, Belkacem AN, Ouhbi S, Lakas A. Noninvasive Electroencephalography Equipment for Assistive, Adaptive, and Rehabilitative Brain-Computer Interfaces: A Systematic Literature Review. SENSORS (BASEL, SWITZERLAND) 2021; 21:4754. [PMID: 34300492 PMCID: PMC8309653 DOI: 10.3390/s21144754] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/06/2021] [Revised: 06/28/2021] [Accepted: 07/09/2021] [Indexed: 11/30/2022]
Abstract
Humans interact with computers through various devices. Such interactions may not require any physical movement, thus aiding people with severe motor disabilities in communicating with external devices. The brain-computer interface (BCI) has turned into a field involving new elements for assistive and rehabilitative technologies. This systematic literature review (SLR) aims to help BCI investigator and investors to decide which devices to select or which studies to support based on the current market examination. This examination of noninvasive EEG devices is based on published BCI studies in different research areas. In this SLR, the research area of noninvasive BCIs using electroencephalography (EEG) was analyzed by examining the types of equipment used for assistive, adaptive, and rehabilitative BCIs. For this SLR, candidate studies were selected from the IEEE digital library, PubMed, Scopus, and ScienceDirect. The inclusion criteria (IC) were limited to studies focusing on applications and devices of the BCI technology. The data used herein were selected using IC and exclusion criteria to ensure quality assessment. The selected articles were divided into four main research areas: education, engineering, entertainment, and medicine. Overall, 238 papers were selected based on IC. Moreover, 28 companies were identified that developed wired and wireless equipment as means of BCI assistive technology. The findings of this review indicate that the implications of using BCIs for assistive, adaptive, and rehabilitative technologies are encouraging for people with severe motor disabilities and healthy people. With an increasing number of healthy people using BCIs, other research areas, such as the motivation of players when participating in games or the security of soldiers when observing certain areas, can be studied and collaborated using the BCI technology. However, such BCI systems must be simple (wearable), convenient (sensor fabrics and self-adjusting abilities), and inexpensive.
Collapse
Affiliation(s)
- Nuraini Jamil
- Department of Computer Science and Software Engineering, College of Information Technology, United Arab Emirates University, Al Ain P.O. Box 15551, United Arab Emirates; (N.J.); (S.O.)
| | - Abdelkader Nasreddine Belkacem
- Department of Computer and Network Engineering, College of Information Technology, United Arab Emirates University, Al Ain P.O. Box 15551, United Arab Emirates;
| | - Sofia Ouhbi
- Department of Computer Science and Software Engineering, College of Information Technology, United Arab Emirates University, Al Ain P.O. Box 15551, United Arab Emirates; (N.J.); (S.O.)
| | - Abderrahmane Lakas
- Department of Computer and Network Engineering, College of Information Technology, United Arab Emirates University, Al Ain P.O. Box 15551, United Arab Emirates;
| |
Collapse
|
8
|
Simon C, Bolton DAE, Kennedy NC, Soekadar SR, Ruddy KL. Challenges and Opportunities for the Future of Brain-Computer Interface in Neurorehabilitation. Front Neurosci 2021; 15:699428. [PMID: 34276299 PMCID: PMC8282929 DOI: 10.3389/fnins.2021.699428] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2021] [Accepted: 06/08/2021] [Indexed: 12/18/2022] Open
Abstract
Brain-computer interfaces (BCIs) provide a unique technological solution to circumvent the damaged motor system. For neurorehabilitation, the BCI can be used to translate neural signals associated with movement intentions into tangible feedback for the patient, when they are unable to generate functional movement themselves. Clinical interest in BCI is growing rapidly, as it would facilitate rehabilitation to commence earlier following brain damage and provides options for patients who are unable to partake in traditional physical therapy. However, substantial challenges with existing BCI implementations have prevented its widespread adoption. Recent advances in knowledge and technology provide opportunities to facilitate a change, provided that researchers and clinicians using BCI agree on standardisation of guidelines for protocols and shared efforts to uncover mechanisms. We propose that addressing the speed and effectiveness of learning BCI control are priorities for the field, which may be improved by multimodal or multi-stage approaches harnessing more sensitive neuroimaging technologies in the early learning stages, before transitioning to more practical, mobile implementations. Clarification of the neural mechanisms that give rise to improvement in motor function is an essential next step towards justifying clinical use of BCI. In particular, quantifying the unknown contribution of non-motor mechanisms to motor recovery calls for more stringent control conditions in experimental work. Here we provide a contemporary viewpoint on the factors impeding the scalability of BCI. Further, we provide a future outlook for optimal design of the technology to best exploit its unique potential, and best practices for research and reporting of findings.
Collapse
Affiliation(s)
- Colin Simon
- Trinity College Institute of Neuroscience and School of Psychology, Trinity College Dublin, Dublin, Ireland
| | - David A. E. Bolton
- Department of Kinesiology and Health Science, Utah State University, Logan, UT, United States
| | - Niamh C. Kennedy
- School of Psychology, Ulster University, Coleraine, United Kingdom
| | - Surjo R. Soekadar
- Clinical Neurotechnology Laboratory, Neurowissenschaftliches Forschungszentrum, Department of Psychiatry and Neurosciences, Charité – Universitätsmedizin Berlin, Berlin, Germany
| | - Kathy L. Ruddy
- Trinity College Institute of Neuroscience and School of Psychology, Trinity College Dublin, Dublin, Ireland
| |
Collapse
|
9
|
Asgher U, Khan MJ, Asif Nizami MH, Khalil K, Ahmad R, Ayaz Y, Naseer N. Motor Training Using Mental Workload (MWL) With an Assistive Soft Exoskeleton System: A Functional Near-Infrared Spectroscopy (fNIRS) Study for Brain-Machine Interface (BMI). Front Neurorobot 2021; 15:605751. [PMID: 33815084 PMCID: PMC8012849 DOI: 10.3389/fnbot.2021.605751] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2020] [Accepted: 02/05/2021] [Indexed: 11/24/2022] Open
Abstract
Mental workload is a neuroergonomic human factor, which is widely used in planning a system's safety and areas like brain-machine interface (BMI), neurofeedback, and assistive technologies. Robotic prosthetics methodologies are employed for assisting hemiplegic patients in performing routine activities. Assistive technologies' design and operation are required to have an easy interface with the brain with fewer protocols, in an attempt to optimize mobility and autonomy. The possible answer to these design questions may lie in neuroergonomics coupled with BMI systems. In this study, two human factors are addressed: designing a lightweight wearable robotic exoskeleton hand that is used to assist the potential stroke patients with an integrated portable brain interface using mental workload (MWL) signals acquired with portable functional near-infrared spectroscopy (fNIRS) system. The system may generate command signals for operating a wearable robotic exoskeleton hand using two-state MWL signals. The fNIRS system is used to record optical signals in the form of change in concentration of oxy and deoxygenated hemoglobin (HbO and HbR) from the pre-frontal cortex (PFC) region of the brain. Fifteen participants participated in this study and were given hand-grasping tasks. Two-state MWL signals acquired from the PFC region of the participant's brain are segregated using machine learning classifier-support vector machines (SVM) to utilize in operating a robotic exoskeleton hand. The maximum classification accuracy is 91.31%, using a combination of mean-slope features with an average information transfer rate (ITR) of 1.43. These results show the feasibility of a two-state MWL (fNIRS-based) robotic exoskeleton hand (BMI system) for hemiplegic patients assisting in the physical grasping tasks.
Collapse
Affiliation(s)
- Umer Asgher
- School of Mechanical and Manufacturing Engineering (SMME), National University of Sciences and Technology (NUST), Islamabad, Pakistan
| | - Muhammad Jawad Khan
- School of Mechanical and Manufacturing Engineering (SMME), National University of Sciences and Technology (NUST), Islamabad, Pakistan
| | - Muhammad Hamza Asif Nizami
- School of Mechanical and Manufacturing Engineering (SMME), National University of Sciences and Technology (NUST), Islamabad, Pakistan
- Florida State University College of Engineering, Florida A&M University, Tallahassee, FL, United States
| | - Khurram Khalil
- School of Mechanical and Manufacturing Engineering (SMME), National University of Sciences and Technology (NUST), Islamabad, Pakistan
| | - Riaz Ahmad
- School of Mechanical and Manufacturing Engineering (SMME), National University of Sciences and Technology (NUST), Islamabad, Pakistan
- Directorate of Quality Assurance and International Collaboration, National University of Sciences and Technology (NUST), Islamabad, Pakistan
| | - Yasar Ayaz
- School of Mechanical and Manufacturing Engineering (SMME), National University of Sciences and Technology (NUST), Islamabad, Pakistan
- National Center of Artificial Intelligence (NCAI), National University of Sciences and Technology, Islamabad, Pakistan
| | - Noman Naseer
- Department of Mechatronics and Biomedical Engineering, Air University, Islamabad, Pakistan
| |
Collapse
|
10
|
Fernández-Rodríguez Á, Ron-Angevin R, Sanz-Arigita EJ, Parize A, Esquirol J, Perrier A, Laur S, André JM, Lespinet-Najib V, Garcia L. Effect of Distracting Background Speech in an Auditory Brain-Computer Interface. Brain Sci 2021; 11:brainsci11010039. [PMID: 33401410 PMCID: PMC7823829 DOI: 10.3390/brainsci11010039] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2020] [Revised: 11/12/2020] [Accepted: 12/23/2020] [Indexed: 11/16/2022] Open
Abstract
Studies so far have analyzed the effect of distractor stimuli in different types of brain-computer interface (BCI). However, the effect of a background speech has not been studied using an auditory event-related potential (ERP-BCI), a convenient option when the visual path cannot be adopted by users. Thus, the aim of the present work is to examine the impact of a background speech on selection performance and user workload in auditory BCI systems. Eleven participants tested three conditions: (i) auditory BCI control condition, (ii) auditory BCI with a background speech to ignore (non-attentional condition), and (iii) auditory BCI while the user has to pay attention to the background speech (attentional condition). The results demonstrated that, despite no significant differences in performance, shared attention to auditory BCI and background speech required a higher cognitive workload. In addition, the P300 target stimuli in the non-attentional condition were significantly higher than those in the attentional condition for several channels. The non-attentional condition was the only condition that showed significant differences in the amplitude of the P300 between target and non-target stimuli. The present study indicates that background speech, especially when it is attended to, is an important interference that should be avoided while using an auditory BCI.
Collapse
Affiliation(s)
| | - Ricardo Ron-Angevin
- UMA-BCI Group, Departamento de Tecnología Electrónica, Universidad de Málaga, 29071 Malaga, Spain;
- Correspondence:
| | - Ernesto J. Sanz-Arigita
- Neuro and Aging and Human Cognition, INCIA-UMR 5287-CNRS, Université de Bordeaux, 33076 Bordeaux, France;
| | - Antoine Parize
- Laboratoire IMS, CNRS UMR 5218, Cognitive Team, Bordeaux INP-ENSC, 33400 Talence, France; (A.P.); (J.E.); (A.P.); (S.L.); (J.M.-A.); (V.L.-N.); (L.G.)
| | - Juliette Esquirol
- Laboratoire IMS, CNRS UMR 5218, Cognitive Team, Bordeaux INP-ENSC, 33400 Talence, France; (A.P.); (J.E.); (A.P.); (S.L.); (J.M.-A.); (V.L.-N.); (L.G.)
| | - Alban Perrier
- Laboratoire IMS, CNRS UMR 5218, Cognitive Team, Bordeaux INP-ENSC, 33400 Talence, France; (A.P.); (J.E.); (A.P.); (S.L.); (J.M.-A.); (V.L.-N.); (L.G.)
| | - Simon Laur
- Laboratoire IMS, CNRS UMR 5218, Cognitive Team, Bordeaux INP-ENSC, 33400 Talence, France; (A.P.); (J.E.); (A.P.); (S.L.); (J.M.-A.); (V.L.-N.); (L.G.)
| | - Jean-Marc André
- Laboratoire IMS, CNRS UMR 5218, Cognitive Team, Bordeaux INP-ENSC, 33400 Talence, France; (A.P.); (J.E.); (A.P.); (S.L.); (J.M.-A.); (V.L.-N.); (L.G.)
| | - Véronique Lespinet-Najib
- Laboratoire IMS, CNRS UMR 5218, Cognitive Team, Bordeaux INP-ENSC, 33400 Talence, France; (A.P.); (J.E.); (A.P.); (S.L.); (J.M.-A.); (V.L.-N.); (L.G.)
| | - Liliana Garcia
- Laboratoire IMS, CNRS UMR 5218, Cognitive Team, Bordeaux INP-ENSC, 33400 Talence, France; (A.P.); (J.E.); (A.P.); (S.L.); (J.M.-A.); (V.L.-N.); (L.G.)
| |
Collapse
|
11
|
Geronimo A, Simmons Z. TeleBCI: remote user training, monitoring, and communication with an evoked-potential brain-computer interface. BRAIN-COMPUTER INTERFACES 2020; 7:57-69. [PMID: 33763499 DOI: 10.1080/2326263x.2020.1848134] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Abstract
Brain-computer interfaces (BCIs) are a movement-independent form of augmentative and alternative communication (AAC) for individuals with amyotrophic lateral sclerosis (ALS). The rare utilization of such devices in the homes of patients stems from a number of factors, one of which is the complexity of providing training and support for users. This paper describes the teleBCI interface used to train the patient and facilitator in the operation of a virtual keyboard using an evoked potential BCI. Fifteen patients with motor neuron disease and their communication partners were included in the study, participating from their homes while receiving remote support from the research team. Patient/caregiver teams completed 8 sessions each of P300 BCI training virtually with the researcher. As they participated in subsequent training sessions, participant teams required less help to complete physical, computer, and BCI-specific tasks associated with device use. A subset of users experienced improved performance over sessions, progressing to utilize the full functionality of the speller and communicate with a nurse partner over a telemedicine interface. Perceptions of device utility varied with accuracy of the BCI system. In the management of ALS, the integration of telemedicine provides new opportunities for care delivery, including how BCI-AAC are deployed and used.
Collapse
Affiliation(s)
- A Geronimo
- Department of Neurosurgery, 500 University Drive, Hershey, PA 17033
| | - Zachary Simmons
- Departments of Neurology and Humanities, 500 University Drive, Hershey, PA 17033
| |
Collapse
|
12
|
Recommendations for Integrating a P300-Based Brain–Computer Interface in Virtual Reality Environments for Gaming: An Update. COMPUTERS 2020. [DOI: 10.3390/computers9040092] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The integration of a P300-based brain–computer interface (BCI) into virtual reality (VR) environments is promising for the video games industry. However, it faces several limitations, mainly due to hardware constraints and limitations engendered by the stimulation needed by the BCI. The main restriction is still the low transfer rate that can be achieved by current BCI technology, preventing movement while using VR. The goal of this paper is to review current limitations and to provide application creators with design recommendations to overcome them, thus significantly reducing the development time and making the domain of BCI more accessible to developers. We review the design of video games from the perspective of BCI and VR with the objective of enhancing the user experience. An essential recommendation is to use the BCI only for non-complex and non-critical tasks in the game. Also, the BCI should be used to control actions that are naturally integrated into the virtual world. Finally, adventure and simulation games, especially if cooperative (multi-user), appear to be the best candidates for designing an effective VR game enriched by BCI technology.
Collapse
|
13
|
Sun KT, Hsieh KL, Syu SR. Towards an Accessible Use of a Brain-Computer Interfaces-Based Home Care System through a Smartphone. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2020; 2020:1843269. [PMID: 32908470 PMCID: PMC7474741 DOI: 10.1155/2020/1843269] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/31/2020] [Revised: 06/29/2020] [Accepted: 07/31/2020] [Indexed: 11/17/2022]
Abstract
This study proposes a home care system (HCS) based on a brain-computer interface (BCI) with a smartphone. The HCS provides daily help to motor-disabled people when a caregiver is not present. The aim of the study is two-fold: (1) to develop a BCI-based home care system to help end-users control their household appliances, and (2) to assess whether the architecture of the HCS is easy for motor-disabled people to use. A motion-strip is used to evoke event-related potentials (ERPs) in the brain of the user, and the system immediately processes these potentials to decode the user's intentions. The system, then, translates these intentions into application commands and sends them via Bluetooth to the user's smartphone to make an emergency call or to execute the corresponding app to emit an infrared (IR) signal to control a household appliance. Fifteen healthy and seven motor-disabled subjects (including the one with ALS) participated in the experiment. The average online accuracy was 81.8% and 78.1%, respectively. Using component N2P3 to discriminate targets from nontargets can increase the efficiency of the system. Results showed that the system allows end-users to use smartphone apps as long as they are using their brain waves. More important, only one electrode O1 is required to measure EEG signals, giving the system good practical usability. The HCS can, thus, improve the autonomy and self-reliance of its end-users.
Collapse
Affiliation(s)
- Koun-Tem Sun
- Department of Information and Learning Technology, National University of Tainan, 33, Sec. 2, Shu-Lin St., Tainan 70005, Taiwan
| | - Kai-Lung Hsieh
- Department of Information and Learning Technology, National University of Tainan, 33, Sec. 2, Shu-Lin St., Tainan 70005, Taiwan
| | - Syuan-Rong Syu
- Department of Information and Learning Technology, National University of Tainan, 33, Sec. 2, Shu-Lin St., Tainan 70005, Taiwan
| |
Collapse
|
14
|
Jochumsen M, Knoche H, Kjaer TW, Dinesen B, Kidmose P. EEG Headset Evaluation for Detection of Single-Trial Movement Intention for Brain-Computer Interfaces. SENSORS 2020; 20:s20102804. [PMID: 32423133 PMCID: PMC7287803 DOI: 10.3390/s20102804] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/01/2020] [Revised: 05/10/2020] [Accepted: 05/13/2020] [Indexed: 01/26/2023]
Abstract
Brain-computer interfaces (BCIs) can be used in neurorehabilitation; however, the literature about transferring the technology to rehabilitation clinics is limited. A key component of a BCI is the headset, for which several options are available. The aim of this study was to test four commercially available headsets' ability to record and classify movement intentions (movement-related cortical potentials-MRCPs). Twelve healthy participants performed 100 movements, while continuous EEG was recorded from the headsets on two different days to establish the reliability of the measures: classification accuracies of single-trials, number of rejected epochs, and signal-to-noise ratio. MRCPs could be recorded with the headsets covering the motor cortex, and they obtained the best classification accuracies (73%-77%). The reliability was moderate to good for the best headset (a gel-based headset covering the motor cortex). The results demonstrate that, among the evaluated headsets, reliable recordings of MRCPs require channels located close to the motor cortex and potentially a gel-based headset.
Collapse
Affiliation(s)
- Mads Jochumsen
- Department of Health Science and Technology, Aalborg University, 9220 Aalborg, Denmark;
- Correspondence:
| | - Hendrik Knoche
- Department of Architecture, Design and Media Technology, Aalborg University, 9000 Aalborg, Denmark;
| | - Troels Wesenberg Kjaer
- Department of Neurology, Zealand University Hospital, Roskilde, Denmark. Department of Clinical Medicine, University of Copenhagen, 2200 Copenhagen, Denmark;
| | - Birthe Dinesen
- Department of Health Science and Technology, Aalborg University, 9220 Aalborg, Denmark;
| | - Preben Kidmose
- Department of Engineering—Electrical and Computer Engineering, Aarhus University, 8200 Aarhus, Denmark;
| |
Collapse
|
15
|
Hinrichs H, Scholz M, Baum AK, Kam JWY, Knight RT, Heinze HJ. Comparison between a wireless dry electrode EEG system with a conventional wired wet electrode EEG system for clinical applications. Sci Rep 2020; 10:5218. [PMID: 32251333 PMCID: PMC7090045 DOI: 10.1038/s41598-020-62154-0] [Citation(s) in RCA: 70] [Impact Index Per Article: 17.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2019] [Accepted: 03/06/2020] [Indexed: 11/09/2022] Open
Abstract
Dry electrode electroencephalogram (EEG) recording combined with wireless data transmission offers an alternative tool to conventional wet electrode EEG systems. However, the question remains whether the signal quality of dry electrode recordings is comparable to wet electrode recordings in the clinical context. We recorded the resting state EEG (rsEEG), the visual evoked potentials (VEP) and the visual P300 (P3) from 16 healthy subjects (age range: 26-79 years) and 16 neurological patients who reported subjective memory impairment (age range: 50-83 years). Each subject took part in two recordings on different days, one with 19 dry electrodes and another with 19 wet electrodes. They reported their preferred EEG system. Comparisons of the rsEEG recordings were conducted qualitatively by independent visual evaluation by two neurologists blinded to the EEG system used and quantitatively by spectral analysis of the rsEEG. The P100 visual evoked potential (VEP) and P3 event-related potential (ERP) were compared in terms of latency, amplitude and pre-stimulus noise. The majority of subjects preferred the dry electrode headset. Both neurologists reported that all rsEEG traces were comparable between the wet and dry electrode headsets. Absolute Alpha and Beta power during rest did not statistically differ between the two EEG systems (p > 0.05 in all cases). However, Theta and Delta power was slightly higher with the dry electrodes (p = 0.0004 for Theta and p < 0.0001 for Delta). For ERPs, the mean latencies and amplitudes of the P100 VEP and P3 ERP showed comparable values (p > 0.10 in all cases) with a similar spatial distribution for both wet and dry electrode systems. These results suggest that the signal quality, ease of set-up and portability of the dry electrode EEG headset used in our study comply with the needs of clinical applications.
Collapse
Affiliation(s)
- Hermann Hinrichs
- Department of Neurology, Otto-von-Guericke University, Leipziger Str. 44, 39120, Magdeburg, Germany. .,Department of Behavioural Neurology, Leibniz Institute of Neurobiology, Brenneckestr. 6, 39120, Magdeburg, Germany. .,Center for Behavioural Brain Sciences, Otto-von-Guericke University, Universitätsplatz 2, 39106, Magdeburg, Germany. .,German Centre for Neurodegenerative Diseases, Otto-von-Guericke University, Leipziger Str. 44, 39120, Magdeburg, Germany. .,Forschungscampus STIMULATE, Magdeburg, Germany.
| | - Michael Scholz
- Department of Neurology, Otto-von-Guericke University, Leipziger Str. 44, 39120, Magdeburg, Germany
| | - Anne Katrin Baum
- Department of Neurology, Otto-von-Guericke University, Leipziger Str. 44, 39120, Magdeburg, Germany
| | - Julia W Y Kam
- Helen Wills Neuroscience Institute, University of California - Berkeley, 132 Barker Hall, Berkeley, CA, 94720, USA
| | - Robert T Knight
- Helen Wills Neuroscience Institute, University of California - Berkeley, 132 Barker Hall, Berkeley, CA, 94720, USA.,Department of Psychology, University of California - Berkeley, 130 Barker Hall, Berkeley, CA, 94720, USA
| | - Hans-Jochen Heinze
- Department of Neurology, Otto-von-Guericke University, Leipziger Str. 44, 39120, Magdeburg, Germany.,Department of Behavioural Neurology, Leibniz Institute of Neurobiology, Brenneckestr. 6, 39120, Magdeburg, Germany.,Center for Behavioural Brain Sciences, Otto-von-Guericke University, Universitätsplatz 2, 39106, Magdeburg, Germany.,German Centre for Neurodegenerative Diseases, Otto-von-Guericke University, Leipziger Str. 44, 39120, Magdeburg, Germany
| |
Collapse
|
16
|
Jochumsen M, Knoche H, Kidmose P, Kjær TW, Dinesen BI. Evaluation of EEG Headset Mounting for Brain-Computer Interface-Based Stroke Rehabilitation by Patients, Therapists, and Relatives. Front Hum Neurosci 2020; 14:13. [PMID: 32116602 PMCID: PMC7033449 DOI: 10.3389/fnhum.2020.00013] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2019] [Accepted: 01/13/2020] [Indexed: 12/11/2022] Open
Abstract
Brain-computer interfaces (BCIs) have successfully been used for motor recovery training in stroke patients. However, the setup of BCI systems is complex and may be divided into (1) mounting the headset and (2) calibration of the BCI. One of the major problems is mounting the headset for recording brain activity in a stroke rehabilitation context, and usability testing of this is limited. In this study, the aim was to compare the translational aspects of mounting five different commercially available headsets from a user perspective and investigate the design considerations associated with technology transfer to rehabilitation clinics and home use. No EEG signals were recorded, so the effectiveness of the systems have not been evaluated. Three out of five headsets covered the motor cortex which is needed to pick up movement intentions of attempted movements. The other two were as control and reference for potential design considerations. As primary stakeholders, nine stroke patients, eight therapists and two relatives participated; the stroke patients mounted the headsets themselves. The setup time was recorded, and participants filled in questionnaires related to comfort, aesthetics, setup complexity, overall satisfaction, and general design considerations. The patients had difficulties in mounting all headsets except for a headband with a dry electrode located on the forehead (control). The therapists and relatives were able to mount all headsets. The fastest headset to mount was the headband, and the most preferred headsets were the headband and a behind-ear headset (control). The most preferred headset that covered the motor cortex used water-based electrodes. The patients reported that it was important that they could mount the headset themselves for them to use it every day at home. These results have implications for design considerations for the development of BCI systems to be used in rehabilitation clinics and in the patient’s home.
Collapse
Affiliation(s)
- Mads Jochumsen
- Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| | - Hendrik Knoche
- Department of Architecture, Design and Media Technology, Aalborg University, Aalborg, Denmark
| | - Preben Kidmose
- Department of Engineering - Bioelectrical Instrumentation and Signal Processing, Aarhus University, Aarhus, Denmark
| | | | - Birthe Irene Dinesen
- Laboratory of Welfare Technologies, Telehealth and Telerehabilitation, Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| |
Collapse
|
17
|
Weiss JM, Gaunt RA, Franklin R, Boninger ML, Collinger JL. Demonstration of a portable intracortical brain-computer interface. BRAIN-COMPUTER INTERFACES 2020. [DOI: 10.1080/2326263x.2019.1709260] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Affiliation(s)
- Jeffrey M. Weiss
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA, USA
| | - Robert A. Gaunt
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA
- Center for the Neural Basis of Cognition, Pittsburgh, PA, USA
| | | | - Michael L. Boninger
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA
- Center for the Neural Basis of Cognition, Pittsburgh, PA, USA
- Department of Veterans Affairs, Pittsburgh, PA, USA
| | - Jennifer L. Collinger
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA
- Center for the Neural Basis of Cognition, Pittsburgh, PA, USA
- Department of Veterans Affairs, Pittsburgh, PA, USA
| |
Collapse
|
18
|
Philip JT, George ST. Visual P300 Mind-Speller Brain-Computer Interfaces: A Walk Through the Recent Developments With Special Focus on Classification Algorithms. Clin EEG Neurosci 2020; 51:19-33. [PMID: 30997842 DOI: 10.1177/1550059419842753] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Brain-computer interfaces are sophisticated signal processing systems, which directly operate on neuronal signals to identify specific human intents. These systems can be applied to overcome certain disabilities or to enhance the natural capabilities of human beings. The visual P300 mind-speller is a prominent one among them, which has opened up tremendous possibilities in movement and communication applications. Today, there exist many state-of-the-art visual P300 mind-speller implementations in the literature as a result of numerous researches in this domain over the past 2 decades. Each of these systems can be evaluated in terms of performance metrics like classification accuracy, information transfer rate, and processing time. Various classification techniques associated with these systems, which include but are not limited to discriminant analysis, support vector machine, neural network, distance-based and ensemble of classifiers, have major roles in determining the overall system performances. The significance of a proper review on the recent developments in visual P300 mind-spellers with proper emphasis on their classification algorithms is the key insight for this work. This article is organized with a brief introduction to P300, concepts of visual P300 mind-spellers, the survey of literature with special focus on classification algorithms, followed by the discussion of various challenges and future directions.
Collapse
Affiliation(s)
- Jobin T Philip
- Department of Electronics and Communication Engineering, Karunya Institute of Technology and Sciences, Coimbatore, Tamil Nadu, India
| | - S Thomas George
- Department of Electronics and Communication Engineering, Karunya Institute of Technology and Sciences, Coimbatore, Tamil Nadu, India
| |
Collapse
|
19
|
Abstract
Brain-computer interfaces and wearable neurotechnologies are now used to measure real-time neural and physiologic signals from the human body and hold immense potential for advancements in medical diagnostics, prevention, and intervention. Given the future role that wearable neurotechnologies will likely serve in the health sector, a critical state-of-the-art assessment is necessary to gain a better understanding of their current strengths and limitations. In this chapter we present wearable electroencephalography systems that reflect groundbreaking innovations and improvements in real-time data collection and health monitoring. We focus on specifications reflecting technical advantages and disadvantages, discuss their use in fundamental and clinical research, their current applications, limitations, and future directions. While many methodological and ethical challenges remain, these systems host the potential to facilitate large-scale data collection far beyond the reach of traditional research laboratory settings.
Collapse
|
20
|
Al-Taleb MKH, Purcell M, Fraser M, Petric-Gray N, Vuckovic A. Home used, patient self-managed, brain-computer interface for the management of central neuropathic pain post spinal cord injury: usability study. J Neuroeng Rehabil 2019; 16:128. [PMID: 31666096 PMCID: PMC6822418 DOI: 10.1186/s12984-019-0588-7] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2018] [Accepted: 09/06/2019] [Indexed: 01/22/2023] Open
Abstract
BACKGROUND Central Neuropathic Pain (CNP) is a frequent chronic condition in people with spinal cord injury (SCI). Previously, we showed that using laboratory brain-computer interface (BCI) technology for neurofeedback (NFB) training, it was possible to reduce CNP in people with SCI. In this study, we show results of patient self-managed treatment in their homes with a BCI-NFB using a consumer EEG device. METHODS Users: People with chronic SCI (17 M, 3 F, 50.6 ± 14.1 years old), and CNP ≥4 on a Visual Numerical Scale. LOCATION Laboratory training (up to 4 sessions) followed by home self-managed NFB. User Activity: Upregulating the EEG alpha band power by 10% above a threshold and at the same time downregulating the theta and upper beta (20-30 Hz) band power by 10% at electrode location C4. Technology: A consumer grade multichannel EEG headset (Epoch, Emotiv, USA), a tablet computer and custom made NFB software. EVALUATION EEG analysis, before and after NFB assessment, interviews and questionnaires. RESULTS Effectiveness: Out of 20 initially assessed participants, 15 took part in the study. Participants used the system for 6.9 ± 5.5 (median 4) weeks. Twelve participants regulated their brainwaves in a frequency specific manner and were most successful upregulating the alpha band power. However they typically upregulated power around their individual alpha peak (7.6 ± 0.8 Hz) that was lower than in people without CNP. The reduction in pain experienced was statistically significant in 12 and clinically significant (greater than 30%) in 8 participants. Efficiency: The donning was between 5 and 15 min, and approximately 10-20% of EEG data recorded in the home environment was noise. Participants were mildly stressed when self-administering NFB at home (2.4 on a scale 1-10). User satisfaction: Nine participants who completed the final assessment reported a high level of satisfaction (QUESQ, 4.5 ± 0.8), naming effectiveness, ease of use and comfort as main priorities. The main factors influencing frequency of NFB training were: health related issues, free time and pain intensity. CONCLUSION Portable NFB is a feasible solution for home-based self-managed treatment of CNP. Compared to pharmacological treatments, NFB has less side effects and provides users with active control over pain. TRIAL REGISTRATION GN15NE124 , Registered 9th June 2016.
Collapse
Affiliation(s)
- M K H Al-Taleb
- Biomedical Engineering Research Division, University of Glasgow, Glasgow, UK.,Wasit University, Wasit, Iraq
| | - M Purcell
- Queen Elizabeth National Spinal Injuries Unit, Queen Elizabeth University Hospital, Glasgow, UK
| | - M Fraser
- Queen Elizabeth National Spinal Injuries Unit, Queen Elizabeth University Hospital, Glasgow, UK
| | - N Petric-Gray
- Biomedical Engineering Research Division, University of Glasgow, Glasgow, UK
| | - A Vuckovic
- Biomedical Engineering Research Division, University of Glasgow, Glasgow, UK.
| |
Collapse
|
21
|
Fernández-Rodríguez Á, Velasco-Álvarez F, Medina-Juliá MT, Ron-Angevin R. Evaluation of emotional and neutral pictures as flashing stimuli using a P300 brain-computer interface speller. J Neural Eng 2019; 16:056024. [PMID: 31382248 DOI: 10.1088/1741-2552/ab386d] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Previous works have reported that complex emotional and visual stimuli can increase the amplitude of the P300 brain potential. Thus, the aim of the present work is to assess these kinds of images in a P300 brain-computer interface (BCI) speller as flashing stimuli. APPROACH Twenty-three volunteers controlled four spellers with different sets of flashing stimuli: flashing letters, neutral pictures (NP), emotional pleasant pictures (EPP) and emotional unpleasant pictures (EUP). MAIN RESULTS The sets of pictures showed a higher performance than the letters in accuracy and information transfer rate. These results were supported by the analysis of the P300 signal, where the picture sets offered the greatest amplitudes. The NP and EPP sets were the best evaluated in the subjective questionnaire. SIGNIFICANCE In short, despite the fact that the effect of emotional stimuli could not be observed in the performance metrics, picture sets have offered a high performance and should be considered in future proposals for visual P300-based BCI applications.
Collapse
|
22
|
Halder S, Leinfelder T, Schulz SM, Kübler A. Neural mechanisms of training an auditory event-related potential task in a brain-computer interface context. Hum Brain Mapp 2019; 40:2399-2412. [PMID: 30693612 DOI: 10.1002/hbm.24531] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2018] [Revised: 12/18/2018] [Accepted: 01/11/2019] [Indexed: 11/12/2022] Open
Abstract
Effective use of brain-computer interfaces (BCIs) typically requires training. Improved understanding of the neural mechanisms underlying BCI training will facilitate optimisation of BCIs. The current study examined the neural mechanisms related to training for electroencephalography (EEG)-based communication with an auditory event-related potential (ERP) BCI. Neural mechanisms of training in 10 healthy volunteers were assessed with functional magnetic resonance imaging (fMRI) during an auditory ERP-based BCI task before (t1) and after (t5) three ERP-BCI training sessions outside the fMRI scanner (t2, t3, and t4). Attended stimuli were contrasted with ignored stimuli in the first-level fMRI data analysis (t1 and t5); the training effect was verified using the EEG data (t2-t4); and brain activation was contrasted before and after training in the second-level fMRI data analysis (t1 vs. t5). Training increased the communication speed from 2.9 bits/min (t2) to 4 bits/min (t4). Strong activation was found in the putamen, supplementary motor area (SMA), and superior temporal gyrus (STG) associated with attention to the stimuli. Training led to decreased activation in the superior frontal gyrus and stronger haemodynamic rebound in the STG and supramarginal gyrus. The neural mechanisms of ERP-BCI training indicate improved stimulus perception and reduced mental workload. The ERP task used in the current study showed overlapping activations with a motor imagery based BCI task from a previous study on the neural mechanisms of BCI training in the SMA and putamen. This suggests commonalities between the neural mechanisms of training for both BCI paradigms.
Collapse
Affiliation(s)
- Sebastian Halder
- School of Computer Science and Electronic Engineering, University of Essex, Colchester, United Kingdom.,Institute of Psychology, University of Würzburg, Würzburg, Germany.,Human-Computer Interaction, University of Würzburg, Würzburg, Germany.,Department of Molecular Medicine, University of Oslo, Oslo, Norway
| | | | - Stefan M Schulz
- Institute of Psychology, University of Würzburg, Würzburg, Germany.,Clinical Psychology, Psychotherapy, and Experimental Psychopathology, Johannes Gutenberg University, Mainz, Germany
| | - Andrea Kübler
- Institute of Psychology, University of Würzburg, Würzburg, Germany
| |
Collapse
|
23
|
Ramele R, Villar AJ, Santos JM. EEG Waveform Analysis of P300 ERP with Applications to Brain Computer Interfaces. Brain Sci 2018; 8:brainsci8110199. [PMID: 30453482 PMCID: PMC6266353 DOI: 10.3390/brainsci8110199] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2018] [Revised: 11/09/2018] [Accepted: 11/13/2018] [Indexed: 11/16/2022] Open
Abstract
The Electroencephalography (EEG) is not just a mere clinical tool anymore. It has become the de-facto mobile, portable, non-invasive brain imaging sensor to harness brain information in real time. It is now being used to translate or decode brain signals, to diagnose diseases or to implement Brain Computer Interface (BCI) devices. The automatic decoding is mainly implemented by using quantitative algorithms to detect the cloaked information buried in the signal. However, clinical EEG is based intensively on waveforms and the structure of signal plots. Hence, the purpose of this work is to establish a bridge to fill this gap by reviewing and describing the procedures that have been used to detect patterns in the electroencephalographic waveforms, benchmarking them on a controlled pseudo-real dataset of a P300-Based BCI Speller and verifying their performance on a public dataset of a BCI Competition.
Collapse
Affiliation(s)
- Rodrigo Ramele
- Computer Engineering Department, Instituto Tecnológico de Buenos Aires (ITBA), Buenos Aires 1441, Argentina.
| | - Ana Julia Villar
- Computer Engineering Department, Instituto Tecnológico de Buenos Aires (ITBA), Buenos Aires 1441, Argentina.
| | - Juan Miguel Santos
- Computer Engineering Department, Instituto Tecnológico de Buenos Aires (ITBA), Buenos Aires 1441, Argentina.
| |
Collapse
|
24
|
Systematic comparison between a wireless EEG system with dry electrodes and a wired EEG system with wet electrodes. Neuroimage 2018; 184:119-129. [PMID: 30218769 DOI: 10.1016/j.neuroimage.2018.09.012] [Citation(s) in RCA: 72] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2018] [Revised: 08/30/2018] [Accepted: 09/05/2018] [Indexed: 11/20/2022] Open
Abstract
Recent advances in dry electrodes technology have facilitated the recording of EEG in situations not previously possible, thanks to the relatively swift electrode preparation and avoidance of applying gel to subject's hair. However, to become a true alternative, these systems should be compared to state-of-the-art wet EEG systems commonly used in clinical or research applications. In our study, we conducted a systematic comparison of electrodes application speed, subject comfort, and most critically electrophysiological signal quality between the conventional and wired Biosemi EEG system using wet active electrodes and the compact and wireless F1 EEG system consisting of dry passive electrodes. All subjects (n = 27) participated in two recording sessions on separate days, one with the wet EEG system and one with the dry EEG system, in which the session order was counterbalanced across subjects. In each session, we recorded their EEG during separate rest periods with eyes open and closed followed by two versions of a serial visual presentation target detection task. Each task component allows for a neural measure reflecting different characteristics of the data, including spectral power in canonical low frequency bands, event-related potential components (specifically, the P3b), and single trial classification based on machine learning. The performance across the two systems was similar in most measures, including the P3b amplitude and topography, as well as low frequency (theta, alpha, and beta) spectral power at rest. Both EEG systems performed well above chance in the classification analysis, with a marginal advantage of the wet system over the dry. Critically, all aforementioned electrophysiological metrics showed significant positive correlations (r = 0.54-0.89) between the two EEG systems. This multitude of measures provides a comprehensive comparison that captures different aspects of EEG data, including temporal precision, frequency domain as well as multivariate patterns of activity. Taken together, our results indicate that the dry EEG system used in this experiment can effectively record electrophysiological measures commonly used across the research and clinical contexts with comparable quality to the conventional wet EEG system.
Collapse
|
25
|
Halder S, Takano K, Kansaku K. Comparison of Four Control Methods for a Five-Choice Assistive Technology. Front Hum Neurosci 2018; 12:228. [PMID: 29928196 PMCID: PMC5997833 DOI: 10.3389/fnhum.2018.00228] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2018] [Accepted: 05/16/2018] [Indexed: 12/13/2022] Open
Abstract
Severe motor impairments can affect the ability to communicate. The ability to see has a decisive influence on the augmentative and alternative communication (AAC) systems available to the user. To better understand the initial impressions users have of AAC systems we asked naïve healthy participants to compare two visual (a visual P300 brain-computer interface (BCI) and an eye-tracker) and two non-visual systems (an auditory and a tactile P300 BCI). Eleven healthy participants performed 20 selections in a five choice task with each system. The visual P300 BCI used face stimuli, the auditory P300 BCI used Japanese Hiragana syllables and the tactile P300 BCI used a stimulator on the small left finger, middle left finger, right thumb, middle right finger and small right finger. The eye-tracker required a dwell time of 3 s on the target for selection. We calculated accuracies and information-transfer rates (ITRs) for each control method using the selection time that yielded the highest ITR and an accuracy above 70% for each system. Accuracies of 88% were achieved with the visual P300 BCI (4.8 s selection time, 20.9 bits/min), of 70% with the auditory BCI (19.9 s, 3.3 bits/min), of 71% with the tactile BCI (18 s, 3.4 bits/min) and of 100% with the eye-tracker (5.1 s, 28.2 bits/min). Performance between eye-tracker and visual BCI correlated strongly, correlation between tactile and auditory BCI performance was lower. Our data showed no advantage for either non-visual system in terms of ITR but a lower correlation of performance which suggests that choosing the system which suits a particular user is of higher importance for non-visual systems than visual systems.
Collapse
Affiliation(s)
- Sebastian Halder
- Systems Neuroscience Section, Department of Rehabilitation for Brain Functions, Research Institute of National Rehabilitation Center for Persons with Disabilities, Tokorozawa, Saitama, Japan
- Department of Molecular Medicine, University of Oslo, Oslo, Norway
| | - Kouji Takano
- Systems Neuroscience Section, Department of Rehabilitation for Brain Functions, Research Institute of National Rehabilitation Center for Persons with Disabilities, Tokorozawa, Saitama, Japan
| | - Kenji Kansaku
- Systems Neuroscience Section, Department of Rehabilitation for Brain Functions, Research Institute of National Rehabilitation Center for Persons with Disabilities, Tokorozawa, Saitama, Japan
- Brain Science Inspired Life Support Research Center, The University of Electro-Communications, Tokyo, Japan
- Department of Physiology and Biological Information, Dokkyo Medical University School of Medicine, Tochigi, Japan
| |
Collapse
|
26
|
Recommendations for Integrating a P300-Based Brain Computer Interface in Virtual Reality Environments for Gaming. COMPUTERS 2018. [DOI: 10.3390/computers7020034] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
27
|
|