1
|
Scott SM, Raftery C. Brain-Computer Interfaces and Creative Expression: Interface Considerations for Rehabilitative and Therapeutic Interactions. FRONTIERS IN COMPUTER SCIENCE 2021. [DOI: 10.3389/fcomp.2021.718605] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
By translating brain signals into new kinds of outputs, Brain-Computer Interface (BCI) systems hold tremendous potential as both transformative rehabilitation and communication tools. BCIs can be considered a unique technology, in that they are able to provide a direct link between the brain and the external environment. By affording users with opportunities for communication and self-expression, BCI systems serve as a bridge between abled-bodied and disabled users, in turn reducing existing barriers between these groups. This perspective piece explores the complex shifting relationship between neuroadaptive systems and humans by foregrounding personal experience and embodied interaction as concepts through which to evaluate digital environments cultivated through the design of BCI interfaces. To underscore the importance of fostering human-centered experiences through technologically mediated interactions, this work offers a conceptual framework through which the rehabilitative and therapeutic possibilities of BCI user-system engagement could be furthered. By inviting somatic analysis towards the design of BCI interfaces and incorporating tenets of creative arts therapies practices into hybrid navigation paradigms for self-expressive applications, this work highlights the need for examining individual technological interactions as sites with meaning-making potentiality, as well as those conceived through unique exchanges based on user-specific needs for communication. Designing BCI interfaces in ways that afford users with increased options for navigation, as well as with the ability to share subjective and collective experiences, helps to redefine existing boundaries of digital and physical user-system interactions and encourages the reimagining of these systems as novel digital health tools for recovery.
Collapse
|
2
|
Huggins JE, Guger C, Aarnoutse E, Allison B, Anderson CW, Bedrick S, Besio W, Chavarriaga R, Collinger JL, Do AH, Herff C, Hohmann M, Kinsella M, Lee K, Lotte F, Müller-Putz G, Nijholt A, Pels E, Peters B, Putze F, Rupp R, Schalk G, Scott S, Tangermann M, Tubig P, Zander T. Workshops of the Seventh International Brain-Computer Interface Meeting: Not Getting Lost in Translation. BRAIN-COMPUTER INTERFACES 2019; 6:71-101. [PMID: 33033729 PMCID: PMC7539697 DOI: 10.1080/2326263x.2019.1697163] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2019] [Accepted: 10/30/2019] [Indexed: 12/11/2022]
Abstract
The Seventh International Brain-Computer Interface (BCI) Meeting was held May 21-25th, 2018 at the Asilomar Conference Grounds, Pacific Grove, California, United States. The interactive nature of this conference was embodied by 25 workshops covering topics in BCI (also called brain-machine interface) research. Workshops covered foundational topics such as hardware development and signal analysis algorithms, new and imaginative topics such as BCI for virtual reality and multi-brain BCIs, and translational topics such as clinical applications and ethical assumptions of BCI development. BCI research is expanding in the diversity of applications and populations for whom those applications are being developed. BCI applications are moving toward clinical readiness as researchers struggle with the practical considerations to make sure that BCI translational efforts will be successful. This paper summarizes each workshop, providing an overview of the topic of discussion, references for additional information, and identifying future issues for research and development that resulted from the interactions and discussion at the workshop.
Collapse
Affiliation(s)
- Jane E Huggins
- Department of Physical Medicine and Rehabilitation, Department of Biomedical Engineering, Neuroscience Graduate Program, University of Michigan, Ann Arbor, Michigan, United States, 325 East Eisenhower, Room 3017; Ann Arbor, Michigan 48108-5744
| | - Christoph Guger
- g.tec medical engineering GmbH/Guger Technologies OG, Austria, Sierningstrasse 14, 4521 Schiedlberg, Austria
| | - Erik Aarnoutse
- UMC Utrecht Brain Center, Department of Neurology & Neurosurgery, University Medical Center Utrecht, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands
| | - Brendan Allison
- Dept. of Cognitive Science, Mail Code 0515, University of California at San Diego, La Jolla, United States
| | - Charles W Anderson
- Department of Computer Science, Molecular, Cellular and Integrative Neurosience Program, Colorado State University, Fort Collins, CO 80523
| | - Steven Bedrick
- Center for Spoken Language Understanding, Oregon Health & Science University, Portland, OR 97239
| | - Walter Besio
- Department of Electrical, Computer, & Biomedical Engineering and Interdisciplinary Neuroscience Program, University of Rhode Island, Kingston, Rhode Island, USA, CREmedical Corp. Kingston, Rhode Island, USA
| | - Ricardo Chavarriaga
- Defitech Chair in Brain-Machine Interface (CNBI), Center for Neuroprosthetics, Ecole Polytechnique Fédérale de Lausanne - EPFL, Switzerland
| | - Jennifer L Collinger
- University of Pittsburgh, Department of Physical Medicine and Rehabilitation, VA Pittsburgh Healthcare System, Department of Veterans Affairs, 3520 5th Ave, Pittsburgh, PA, 15213
| | - An H Do
- UC Irvine Brain Computer Interface Lab, Department of Neurology, University of California, Irvine
| | - Christian Herff
- School of Mental Health and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | - Matthias Hohmann
- Max Planck Institute for Intelligent Systems, Department for Empirical Inference, Max-Planck-Ring 4, 72074 Tübingen, Germany
| | - Michelle Kinsella
- Oregon Health & Science University, Institute on Development & Disability, 707 SW Gaines St, #1290, Portland, OR 97239
| | - Kyuhwa Lee
- Swiss Federal Institute of Technology in Lausanne-EPFL
| | - Fabien Lotte
- Inria Bordeaux Sud-Ouest, LaBRI (Univ. Bordeaux/CNRS/Bordeaux INP), 200 avenue de la vieille tour, 33405, Talence Cedex, France
| | | | - Anton Nijholt
- Faculty EEMCS, University of Twente, Enschede, The Netherlands
| | - Elmar Pels
- UMC Utrecht Brain Center, Department of Neurology & Neurosurgery, University Medical Center Utrecht, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands
| | - Betts Peters
- Oregon Health & Science University, Institute on Development & Disability, 707 SW Gaines St, #1290, Portland, OR 97239
| | - Felix Putze
- University of Bremen, Germany, Cognitive Systems Lab, University of Bremen, Enrique-Schmidt-Straße 5 (Cartesium), 28359 Bremen
| | - Rüdiger Rupp
- Spinal Cord Injury Center, Heidelberg University Hospital
| | - Gerwin Schalk
- National Center for Adaptive Neurotechnologies, Wadsworth Center, NYS Dept. of Health, Dept. of Neurology, Albany Medical College, Dept. of Biomed. Sci., State Univ. of New York at Albany, Center for Medical Sciences 2003, 150 New Scotland Avenue, Albany, New York 12208
| | - Stephanie Scott
- Department of Media Communications, Colorado State University, Fort Collins, CO 80523
| | - Michael Tangermann
- Brain State Decoding Lab, Cluster of Excellence BrainLinks-BrainTools, Computer Science Dept., University of Freiburg, Germany, Autonomous Intelligent Systems Lab, Computer Science Dept., University of Freiburg, Germany
| | - Paul Tubig
- Department of Philosophy, Center for Neurotechnology, University of Washington, Savery Hall, Room 361, Seattle, WA 98195
| | - Thorsten Zander
- Team PhyPA, Biological Psychology and Neuroergonomics, Technische Universität Berlin, Berlin, Germany, 7 Zander Laboratories B.V., Amsterdam, The Netherlands
| |
Collapse
|
3
|
Dhindsa K, Acai A, Wagner N, Bosynak D, Kelly S, Bhandari M, Petrisor B, Sonnadara RR. Individualized pattern recognition for detecting mind wandering from EEG during live lectures. PLoS One 2019; 14:e0222276. [PMID: 31513622 PMCID: PMC6742406 DOI: 10.1371/journal.pone.0222276] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2018] [Accepted: 08/26/2019] [Indexed: 01/10/2023] Open
Abstract
Neural correlates of mind wandering The ability to detect mind wandering as it occurs is an important step towards improving our understanding of this phenomenon and studying its effects on learning and performance. Current detection methods typically rely on observable behaviour in laboratory settings, which do not capture the underlying neural processes and may not translate well into real-world settings. We address both of these issues by recording electroencephalography (EEG) simultaneously from 15 participants during live lectures on research in orthopedic surgery. We performed traditional group-level analysis and found neural correlates of mind wandering during live lectures that are similar to those found in some laboratory studies, including a decrease in occipitoparietal alpha power and frontal, temporal, and occipital beta power. However, individual-level analysis of these same data revealed that patterns of brain activity associated with mind wandering were more broadly distributed and highly individualized than revealed in the group-level analysis. Mind wandering detection To apply these findings to mind wandering detection, we used a data-driven method known as common spatial patterns to discover scalp topologies for each individual that reflects their differences in brain activity when mind wandering versus attending to lectures. This approach avoids reliance on known neural correlates primarily established through group-level statistics. Using this method for individual-level machine learning of mind wandering from EEG, we were able to achieve an average detection accuracy of 80–83%. Conclusions Modelling mind wandering at the individual level may reveal important details about its neural correlates that are not reflected when using traditional observational and statistical methods. Using machine learning techniques for this purpose can provide new insight into the varieties of neural activity involved in mind wandering, while also enabling real-time detection of mind wandering in naturalistic settings.
Collapse
Affiliation(s)
- Kiret Dhindsa
- Department of Surgery, McMaster University, Hamilton, Ontario, Canada
- Research and High-Performance Computing Support, McMaster University, Hamilton, Ontario, Canada
- Vector Institute for Artificial Intelligence, Toronto, Ontario, Canada
| | - Anita Acai
- Department of Surgery, McMaster University, Hamilton, Ontario, Canada
- Department of Psychology, Neuroscience, & Behaviour, McMaster University, Hamilton, Ontario, Canada
| | - Natalie Wagner
- Department of Surgery, McMaster University, Hamilton, Ontario, Canada
- Department of Psychology, Neuroscience, & Behaviour, McMaster University, Hamilton, Ontario, Canada
| | - Dan Bosynak
- Research and High-Performance Computing Support, McMaster University, Hamilton, Ontario, Canada
- LIVELab, McMaster University, Hamilton, Ontario, Canada
| | - Stephen Kelly
- Department of Surgery, McMaster University, Hamilton, Ontario, Canada
| | - Mohit Bhandari
- Department of Surgery, McMaster University, Hamilton, Ontario, Canada
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Brad Petrisor
- Department of Surgery, McMaster University, Hamilton, Ontario, Canada
| | - Ranil R. Sonnadara
- Department of Surgery, McMaster University, Hamilton, Ontario, Canada
- Research and High-Performance Computing Support, McMaster University, Hamilton, Ontario, Canada
- Vector Institute for Artificial Intelligence, Toronto, Ontario, Canada
- Department of Psychology, Neuroscience, & Behaviour, McMaster University, Hamilton, Ontario, Canada
- LIVELab, McMaster University, Hamilton, Ontario, Canada
- Department of Surgery, University of Toronto, Toronto, Ontario, Canada
- * E-mail:
| |
Collapse
|
5
|
Shu X, Chen S, Yao L, Sheng X, Zhang D, Jiang N, Jia J, Zhu X. Fast Recognition of BCI-Inefficient Users Using Physiological Features from EEG Signals: A Screening Study of Stroke Patients. Front Neurosci 2018; 12:93. [PMID: 29515363 PMCID: PMC5826359 DOI: 10.3389/fnins.2018.00093] [Citation(s) in RCA: 39] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2017] [Accepted: 02/05/2018] [Indexed: 11/13/2022] Open
Abstract
Motor imagery (MI) based brain-computer interface (BCI) has been developed as an alternative therapy for stroke rehabilitation. However, experimental evidence demonstrates that a significant portion (10-50%) of subjects are BCI-inefficient users (accuracy less than 70%). Thus, predicting BCI performance prior to clinical BCI usage would facilitate the selection of suitable end-users and improve the efficiency of stroke rehabilitation. In the current study, we proposed two physiological variables, i.e., laterality index (LI) and cortical activation strength (CAS), to predict MI-BCI performance. Twenty-four stroke patients and 10 healthy subjects were recruited for this study. Each subject was required to perform two blocks of left- and right-hand MI tasks. Linear regression analyses were performed between the BCI accuracies and two physiological predictors. Here, the predictors were calculated from the electroencephalography (EEG) signals during paretic hand MI tasks (5 trials; approximately 1 min). LI values exhibited a statistically significant correlation with two-class BCI (left vs. right) performance (r = -0.732, p < 0.001), and CAS values exhibited a statistically significant correlation with brain-switch BCI (task vs. idle) performance (r = 0.641, p < 0.001). Furthermore, the BCI-inefficient users were successfully recognized with a sensitivity of 88.2% and a specificity of 85.7% in the two-class BCI. The brain-switch BCI achieved a sensitivity of 100.0% and a specificity of 87.5% in the discrimination of BCI-inefficient users. These results demonstrated that the proposed BCI predictors were promising to promote the BCI usage in stroke rehabilitation and contribute to a better understanding of the BCI-inefficiency phenomenon in stroke patients.
Collapse
Affiliation(s)
- Xiaokang Shu
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
| | - Shugeng Chen
- Department of Rehabilitation, Huashan Hospital, Shanghai, China
| | - Lin Yao
- Department of Systems Design Engineering, Faculty of Engineering, University of Waterloo, Waterloo, ON, Canada
| | - Xinjun Sheng
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
| | - Dingguo Zhang
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
| | - Ning Jiang
- Department of Systems Design Engineering, Faculty of Engineering, University of Waterloo, Waterloo, ON, Canada
| | - Jie Jia
- Department of Rehabilitation, Huashan Hospital, Shanghai, China
| | - Xiangyang Zhu
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|