1
|
Padfield N, Agius Anastasi A, Camilleri T, Fabri S, Bugeja M, Camilleri K. BCI-controlled wheelchairs: end-users' perceptions, needs, and expectations, an interview-based study. Disabil Rehabil Assist Technol 2024; 19:1539-1551. [PMID: 37166297 DOI: 10.1080/17483107.2023.2211602] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Accepted: 05/03/2023] [Indexed: 05/12/2023]
Abstract
PURPOSE Brain-computer interface (BCI)-controlled wheelchairs have the potential to improve the independence of people with mobility impairments. The low uptake of BCI devices has been linked to a lack of knowledge among researchers of the needs of end-users that should influence BCI development. MATERIALS AND METHODS This study used semi-structured interviews to learn about the perceptions, needs, and expectations of spinal cord injury (SCI) patients with regards to a BCI-controlled wheelchair. Topics discussed in the interview include: paradigms, shared control, safety, robustness, channel selection, hardware, and experimental design. The interviews were recorded and then transcribed. Analysis was carried out using coding based on grounded theory principles. RESULTS The majority of participants had a positive view of BCI-controlled wheelchair technology and were willing to use the technology. Core issues were raised regarding safety, cost and aesthetics. Interview discussions were linked to state-of-the-art BCI technology. The results challenge the current reliance of researchers on the motor-imagery paradigm by suggesting end-users expect highly intuitive paradigms. There also needs to be a stronger focus on obstacle avoidance and safety features in BCI wheelchairs. Finally, the development of control approaches that can be personalized for individual users may be instrumental for widespread adoption of these devices. CONCLUSIONS This study, based on interviews with SCI patients, indicates that BCI-controlled wheelchairs are a promising assistive technology that would be well received by end-users. Recommendations for a more person-centered design of BCI controlled wheelchairs are made and clear avenues for future research are identified.
Collapse
Affiliation(s)
- Natasha Padfield
- Centre for Biomedical Cybernetics, University of Malta, Msida, Malta
| | | | - Tracey Camilleri
- Department of Systems and Control Engineering, University of Malta, Msida, Malta
| | - Simon Fabri
- Department of Systems and Control Engineering, University of Malta, Msida, Malta
| | - Marvin Bugeja
- Department of Systems and Control Engineering, University of Malta, Msida, Malta
| | - Kenneth Camilleri
- Centre for Biomedical Cybernetics, University of Malta, Msida, Malta
- Department of Systems and Control Engineering, University of Malta, Msida, Malta
| |
Collapse
|
2
|
Ferrero L, Soriano-Segura P, Navarro J, Jones O, Ortiz M, Iáñez E, Azorín JM, Contreras-Vidal JL. Brain-machine interface based on deep learning to control asynchronously a lower-limb robotic exoskeleton: a case-of-study. J Neuroeng Rehabil 2024; 21:48. [PMID: 38581031 PMCID: PMC10996198 DOI: 10.1186/s12984-024-01342-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 03/15/2024] [Indexed: 04/07/2024] Open
Abstract
BACKGROUND This research focused on the development of a motor imagery (MI) based brain-machine interface (BMI) using deep learning algorithms to control a lower-limb robotic exoskeleton. The study aimed to overcome the limitations of traditional BMI approaches by leveraging the advantages of deep learning, such as automated feature extraction and transfer learning. The experimental protocol to evaluate the BMI was designed as asynchronous, allowing subjects to perform mental tasks at their own will. METHODS A total of five healthy able-bodied subjects were enrolled in this study to participate in a series of experimental sessions. The brain signals from two of these sessions were used to develop a generic deep learning model through transfer learning. Subsequently, this model was fine-tuned during the remaining sessions and subjected to evaluation. Three distinct deep learning approaches were compared: one that did not undergo fine-tuning, another that fine-tuned all layers of the model, and a third one that fine-tuned only the last three layers. The evaluation phase involved the exclusive closed-loop control of the exoskeleton device by the participants' neural activity using the second deep learning approach for the decoding. RESULTS The three deep learning approaches were assessed in comparison to an approach based on spatial features that was trained for each subject and experimental session, demonstrating their superior performance. Interestingly, the deep learning approach without fine-tuning achieved comparable performance to the features-based approach, indicating that a generic model trained on data from different individuals and previous sessions can yield similar efficacy. Among the three deep learning approaches compared, fine-tuning all layer weights demonstrated the highest performance. CONCLUSION This research represents an initial stride toward future calibration-free methods. Despite the efforts to diminish calibration time by leveraging data from other subjects, complete elimination proved unattainable. The study's discoveries hold notable significance for advancing calibration-free approaches, offering the promise of minimizing the need for training trials. Furthermore, the experimental evaluation protocol employed in this study aimed to replicate real-life scenarios, granting participants a higher degree of autonomy in decision-making regarding actions such as walking or stopping gait.
Collapse
Affiliation(s)
- Laura Ferrero
- Brain-Machine Interface Systems Lab, Miguel Hernández University of Elche, Elche, Spain.
- Instituto de Investigación en Ingeniería de Elche-I3E, Miguel Hernández University of Elche, Elche, Spain.
- International Affiliate NSF IUCRC BRAIN Site, Miguel Hernández University of Elche, Elche, Spain.
- NSF IUCRC BRAIN, University of Houston, Houston, USA.
- Non-Invasive Brain Machine Interface Systems, University of Houston, Houston, TX, USA.
| | - Paula Soriano-Segura
- Brain-Machine Interface Systems Lab, Miguel Hernández University of Elche, Elche, Spain
- Instituto de Investigación en Ingeniería de Elche-I3E, Miguel Hernández University of Elche, Elche, Spain
- International Affiliate NSF IUCRC BRAIN Site, Miguel Hernández University of Elche, Elche, Spain
| | - Jacobo Navarro
- NSF IUCRC BRAIN, University of Houston, Houston, USA
- International Affiliate NSF IUCRC BRAIN Site, Tecnológico de Monterrey, Monterrey, Mexico
- Non-Invasive Brain Machine Interface Systems, University of Houston, Houston, TX, USA
| | - Oscar Jones
- NSF IUCRC BRAIN, University of Houston, Houston, USA
- Non-Invasive Brain Machine Interface Systems, University of Houston, Houston, TX, USA
| | - Mario Ortiz
- Brain-Machine Interface Systems Lab, Miguel Hernández University of Elche, Elche, Spain
- Instituto de Investigación en Ingeniería de Elche-I3E, Miguel Hernández University of Elche, Elche, Spain
- International Affiliate NSF IUCRC BRAIN Site, Miguel Hernández University of Elche, Elche, Spain
| | - Eduardo Iáñez
- Brain-Machine Interface Systems Lab, Miguel Hernández University of Elche, Elche, Spain
- Instituto de Investigación en Ingeniería de Elche-I3E, Miguel Hernández University of Elche, Elche, Spain
- International Affiliate NSF IUCRC BRAIN Site, Miguel Hernández University of Elche, Elche, Spain
| | - José M Azorín
- Brain-Machine Interface Systems Lab, Miguel Hernández University of Elche, Elche, Spain
- Instituto de Investigación en Ingeniería de Elche-I3E, Miguel Hernández University of Elche, Elche, Spain
- International Affiliate NSF IUCRC BRAIN Site, Miguel Hernández University of Elche, Elche, Spain
- Valencian Graduate School and Research Network of Artificial Intelligence-valgrAI, Valencia, Spain
| | - José L Contreras-Vidal
- NSF IUCRC BRAIN, University of Houston, Houston, USA
- Non-Invasive Brain Machine Interface Systems, University of Houston, Houston, TX, USA
| |
Collapse
|
3
|
Javvaji CK, Reddy H, Vagha JD, Taksande A, Kommareddy A, Reddy NS. Immersive Innovations: Exploring the Diverse Applications of Virtual Reality (VR) in Healthcare. Cureus 2024; 16:e56137. [PMID: 38618363 PMCID: PMC11016331 DOI: 10.7759/cureus.56137] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2024] [Accepted: 03/14/2024] [Indexed: 04/16/2024] Open
Abstract
Virtual reality (VR) has experienced a remarkable evolution over recent decades, evolving from its initial applications in specific military domains to becoming a ubiquitous and easily accessible technology. This thorough review delves into the intricate domain of VR within healthcare, seeking to offer a comprehensive understanding of its historical evolution, theoretical foundations, and current adoption status. The examination explores the advantages of VR in enhancing the educational experience for medical students, with a particular focus on skill acquisition and retention. Within this exploration, the review dissects the applications of VR across diverse medical disciplines, highlighting its role in surgical training and anatomy/physiology education. While navigating the expansive landscape of VR, the review addresses challenges related to technology and pedagogy, providing insights into overcoming technical hurdles and seamlessly integrating VR into healthcare practices. Additionally, the review looks ahead to future directions and emerging trends, examining the potential impact of technological advancements and innovative applications in healthcare. This review illuminates the transformative potential of VR as a tool poised to revolutionize healthcare practices.
Collapse
Affiliation(s)
- Chaitanya Kumar Javvaji
- Pediatrics, Jawaharlal Nehru Medical College, Datta Meghe Institute of Higher Education and Research, Wardha, IND
| | - Harshitha Reddy
- Internal Medicine, Jawaharlal Nehru Medical College, Datta Meghe Institute of Higher Education and Research, Wardha, IND
| | - Jayant D Vagha
- Pediatrics, Jawaharlal Nehru Medical College, Datta Meghe Institute of Higher Education and Research, Wardha, IND
| | - Amar Taksande
- Pediatrics, Jawaharlal Nehru Medical College, Datta Meghe Institute of Higher Education and Research, Wardha, IND
| | - Anirudh Kommareddy
- Pediatrics, Jawaharlal Nehru Medical College, Datta Meghe Institute of Higher Education and Research, Wardha, IND
| | - Naramreddy Sudheesh Reddy
- Pediatrics, Jawaharlal Nehru Medical College, Datta Meghe Institute of Higher Education and Research, Wardha, IND
| |
Collapse
|
4
|
Tai P, Ding P, Wang F, Gong A, Li T, Zhao L, Su L, Fu Y. Brain-computer interface paradigms and neural coding. Front Neurosci 2024; 17:1345961. [PMID: 38287988 PMCID: PMC10822902 DOI: 10.3389/fnins.2023.1345961] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2023] [Accepted: 12/28/2023] [Indexed: 01/31/2024] Open
Abstract
Brain signal patterns generated in the central nervous system of brain-computer interface (BCI) users are closely related to BCI paradigms and neural coding. In BCI systems, BCI paradigms and neural coding are critical elements for BCI research. However, so far there have been few references that clearly and systematically elaborated on the definition and design principles of the BCI paradigm as well as the definition and modeling principles of BCI neural coding. Therefore, these contents are expounded and the existing main BCI paradigms and neural coding are introduced in the review. Finally, the challenges and future research directions of BCI paradigm and neural coding were discussed, including user-centered design and evaluation for BCI paradigms and neural coding, revolutionizing the traditional BCI paradigms, breaking through the existing techniques for collecting brain signals and combining BCI technology with advanced AI technology to improve brain signal decoding performance. It is expected that the review will inspire innovative research and development of the BCI paradigm and neural coding.
Collapse
Affiliation(s)
- Pengrui Tai
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| | - Peng Ding
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| | - Fan Wang
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| | - Anmin Gong
- School of Information Engineering, Chinese People’s Armed Police Force Engineering University, Xi’an, China
| | - Tianwen Li
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
- Faculty of Science, Kunming University of Science and Technology, Kunming, China
| | - Lei Zhao
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
- Faculty of Science, Kunming University of Science and Technology, Kunming, China
| | - Lei Su
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| | - Yunfa Fu
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| |
Collapse
|
5
|
Rodríguez-Azar PI, Mejía-Muñoz JM, Cruz-Mejía O, Torres-Escobar R, López LVR. Fog Computing for Control of Cyber-Physical Systems in Industry Using BCI. SENSORS (BASEL, SWITZERLAND) 2023; 24:149. [PMID: 38203012 PMCID: PMC10781321 DOI: 10.3390/s24010149] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Revised: 12/23/2023] [Accepted: 12/25/2023] [Indexed: 01/12/2024]
Abstract
Brain-computer interfaces use signals from the brain, such as EEG, to determine brain states, which in turn can be used to issue commands, for example, to control industrial machinery. While Cloud computing can aid in the creation and operation of industrial multi-user BCI systems, the vast amount of data generated from EEG signals can lead to slow response time and bandwidth problems. Fog computing reduces latency in high-demand computation networks. Hence, this paper introduces a fog computing solution for BCI processing. The solution consists in using fog nodes that incorporate machine learning algorithms to convert EEG signals into commands to control a cyber-physical system. The machine learning module uses a deep learning encoder to generate feature images from EEG signals that are subsequently classified into commands by a random forest. The classification scheme is compared using various classifiers, being the random forest the one that obtained the best performance. Additionally, a comparison was made between the fog computing approach and using only cloud computing through the use of a fog computing simulator. The results indicate that the fog computing method resulted in less latency compared to the solely cloud computing approach.
Collapse
Affiliation(s)
- Paula Ivone Rodríguez-Azar
- Departamento de Ingeniería Industrial y Manufactura, Instituto de Ingeniería y Tecnología, Universidad Autónoma de Ciudad Juárez, Ciudad Juárez 32310, Mexico
| | - Jose Manuel Mejía-Muñoz
- Departamento de Ingeniería Eléctrica, Instituto de Ingenieria y Tecnologia, Universidad Autónoma de Ciudad Juárez, Ciudad Juárez 32310, Mexico;
| | - Oliverio Cruz-Mejía
- Departamento de Ingeniería Industrial, FES Aragón, Universidad Nacional Autónoma de México, Mexico 57171, Mexico;
| | | | - Lucero Verónica Ruelas López
- Departamento de Ingeniería Eléctrica, Instituto de Ingenieria y Tecnologia, Universidad Autónoma de Ciudad Juárez, Ciudad Juárez 32310, Mexico;
| |
Collapse
|
6
|
Zapała D, Augustynowicz P, Tokovarov M, Iwanowicz P, Droździel P. Brief Visual Deprivation Effects on Brain Oscillations During Kinesthetic and Visual-motor Imagery. Neuroscience 2023; 532:37-49. [PMID: 37625688 DOI: 10.1016/j.neuroscience.2023.08.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2023] [Revised: 08/10/2023] [Accepted: 08/14/2023] [Indexed: 08/27/2023]
Abstract
It is widely recognized that opening and closing the eyes can direct attention to external or internal stimuli processing. This has been confirmed by studies showing the effects of changes in visual stimulation changes on cerebral activity during different tasks, e.g., motor imagery and execution. However, an essential aspect of creating a mental representation of motion, such as imagery perspective, has not yet been investigated in the present context. Our study aimed to verify the effect of brief visual deprivation (under eyes open [EO] and eyes closed [EC] conditions) on brain wave oscillations and behavioral performance during kinesthetic imagery (KMI) and visual-motor imagery (VMI) tasks. We focused on the alpha and beta rhythms from visual- and motor-related EEG activity sources. Additionally, we used machine learning algorithms to establish whether the registered differences in brain oscillations might affect motor imagery brain-computer interface (MI-BCI) performance. The results showed that the occipital areas in the EC condition presented significantly stronger desynchronization during VMI tasks, which is typical for enhanced visual stimuli processing. Furthermore, the stronger desynchronization of alpha rhythms from motor areas in the EO, than EC condition confirmed previous effects obtained during real movements. It was also found that simulating movement under EC/EO conditions affected signal classification accuracy, which has practical implications for MI-BCI effectiveness. These findings suggest that shifting processing toward external or internal stimuli modulates brain rhythm oscillations associated with different perspectives on the mental representation of movement.
Collapse
Affiliation(s)
- Dariusz Zapała
- Institute of Psychology, Department of Experimental Psychology, The John Paul II Catholic University of Lublin, 20950 Lublin, Poland.
| | - Paweł Augustynowicz
- Institute of Psychology, Department of Experimental Psychology, The John Paul II Catholic University of Lublin, 20950 Lublin, Poland.
| | | | - Paulina Iwanowicz
- Institute of Psychology, Department of Experimental Psychology, The John Paul II Catholic University of Lublin, 20950 Lublin, Poland.
| | - Paulina Droździel
- Institute of Psychology, Department of Experimental Psychology, The John Paul II Catholic University of Lublin, 20950 Lublin, Poland.
| |
Collapse
|
7
|
Gu B, Wang K, Chen L, He J, Zhang D, Xu M, Wang Z, Ming D. Study of the Correlation between the Motor Ability of the Individual Upper Limbs and Motor Imagery Induced Neural Activities. Neuroscience 2023; 530:56-65. [PMID: 37652289 DOI: 10.1016/j.neuroscience.2023.08.032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Revised: 07/13/2023] [Accepted: 08/25/2023] [Indexed: 09/02/2023]
Abstract
Motor imagery based brain-computer interfaces (MI-BCIs) have excellent application prospects in motor enhancement and rehabilitation. However, MI-induced electroencephalogram features applied to MI-BCI usually vary from person to person. This study aimed to investigate whether the motor ability of the individual upper limbs was associated with these features, which helps understand the causes of inter-subject variability. We focused on the behavioral and psychological factors reflecting motor abilities. We first obtained the behavioral scale scores from Edinburgh Handedness Questionnaire, Maximum Grip Strength Test, and Purdue Pegboard Test assessments to evaluate the motor execution ability. We also required the subjects to complete the psychological Movement Imagery Questionnaire-3 estimate, representing MI ability. Then we recorded EEG signals from all twenty-two subjects during MI tasks. Pearson correlation coefficient and stepwise regression were used to analyze the relationships between MI-induced relative event-related desynchronization (rERD) patterns and motor abilities. Both Purdue Pegboard Test and Movement Imagery Questionnaire-3 scores had significant correlations with MI-induced neural oscillation patterns. Notably, the Purdue Pegboard Test of the left hand had the most significant correlation with the alpha rERD. The results of stepwise multiple regression analysis showed that the Purdue Pegboard Test and Movement Imagery Questionnaire-3 could best predict the MI-induced rERD. The results demonstrate that hand dexterity and fine motor coordination are significantly related to MI-induced neural activities. In addition, the method of imagining is also relevant to MI features. Therefore, this study is meaningful for understanding individual differences and the design of user-centered MI-BCI.
Collapse
Affiliation(s)
- Bin Gu
- SUISHI (Tianjin) Intelligence Ltd, China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, China
| | - Kun Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, China.
| | - Long Chen
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, China.
| | - Jiatong He
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Dingze Zhang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Minpeng Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, China
| | - Zhongpeng Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, China
| |
Collapse
|
8
|
Lambert KJM, Chen YY, Donoff C, Elke J, Madan CR, Singhal A. Handedness effects on imagery of dominant- versus non-dominant-hand movements: An electroencephalographic investigation. Eur J Neurosci 2023; 58:3286-3298. [PMID: 37501346 DOI: 10.1111/ejn.16096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2022] [Revised: 05/26/2023] [Accepted: 07/05/2023] [Indexed: 07/29/2023]
Abstract
Mental representations of our bodies are thought to influence how we interact with our surroundings. We can examine these mental representations through motor imagery, the imagination of movement using scalp EEG recordings. The visual modality of motor imagery emphasises 'seeing' the imagined movement and is associated with increased activity in the alpha rhythm (8-14 Hz) measured over the occipital regions. The kinaesthetic modality emphasises 'feeling' the movement and is associated with decreased activity in the mu rhythm (8-14 Hz) measured over the sensorimotor cortices. These two modalities can be engaged in isolation or together. We recorded EEG activity while 37 participants (17 left-hand dominant) completed an objective hand motor imagery task. Left-handers exhibited significant activity differences between occipital and motor regions only during imagery of right-hand (non-dominant-hand) movements. This difference was primarily driven by less oscillatory activity in the mu rhythm, which may reflect a shift in imagery strategy wherein participants placed more effort into generating the kinaesthetic sensations of non-dominant-hand imagery. Spatial features of 8-14 Hz activity generated from principal component analysis (PCA) provide further support for a strategy shift. Right-handers also exhibited significant differences between alpha and mu activity during imagery of non-dominant movements. However, this difference was not primarily driven by either rhythm, and no differences were observed in the group's PCA results. Together, these findings indicate that individuals imagine movement differently when it involves their dominant versus non-dominant hand, and left-handers may be more flexible in their motor imagery strategies.
Collapse
Affiliation(s)
- Kathryn J M Lambert
- Department of Occupational Therapy, University of Alberta, Edmonton, Alberta, Canada
| | - Yvonne Y Chen
- Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Christopher Donoff
- Department of Psychology, University of Alberta, Edmonton, Alberta, Canada
| | - Jonah Elke
- Department of Psychology, University of Alberta, Edmonton, Alberta, Canada
| | | | - Anthony Singhal
- Department of Psychology, University of Alberta, Edmonton, Alberta, Canada
- Neuroscience and Mental Health Institute, University of Alberta, Edmonton, Alberta, Canada
| |
Collapse
|
9
|
Choy CS, Fang Q, Neville K, Ding B, Kumar A, Mahmoud SS, Gu X, Fu J, Jelfs B. Virtual reality and motor imagery for early post-stroke rehabilitation. Biomed Eng Online 2023; 22:66. [PMID: 37407988 PMCID: PMC10320905 DOI: 10.1186/s12938-023-01124-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2022] [Accepted: 06/05/2023] [Indexed: 07/07/2023] Open
Abstract
BACKGROUND Motor impairment is a common consequence of stroke causing difficulty in independent movement. The first month of post-stroke rehabilitation is the most effective period for recovery. Movement imagination, known as motor imagery, in combination with virtual reality may provide a way for stroke patients with severe motor disabilities to begin rehabilitation. METHODS The aim of this study is to verify whether motor imagery and virtual reality help to activate stroke patients' motor cortex. 16 acute/subacute (< 6 months) stroke patients participated in this study. All participants performed motor imagery of basketball shooting which involved the following tasks: listening to audio instruction only, watching a basketball shooting animation in 3D with audio, and also performing motor imagery afterwards. Electroencephalogram (EEG) was recorded for analysis of motor-related features of the brain such as power spectral analysis in the [Formula: see text] and [Formula: see text] frequency bands and spectral entropy. 18 EEG channels over the motor cortex were used for all stroke patients. RESULTS All results are normalised relative to all tasks for each participant. The power spectral densities peak near the [Formula: see text] band for all participants and also the [Formula: see text] band for some participants. Tasks with instructions during motor imagery generally show greater power spectral peaks. The p-values of the Wilcoxon signed-rank test for band power comparison from the 18 EEG channels between different pairs of tasks show a 0.01 significance of rejecting the band powers being the same for most tasks done by stroke subjects. The motor cortex of most stroke patients is more active when virtual reality is involved during motor imagery as indicated by their respective scalp maps of band power and spectral entropy. CONCLUSION The resulting activation of stroke patient's motor cortices in this study reveals evidence that it is induced by imagination of movement and virtual reality supports motor imagery. The framework of the current study also provides an efficient way to investigate motor imagery and virtual reality during post-stroke rehabilitation.
Collapse
Affiliation(s)
- Chi S. Choy
- School of Engineering, RMIT University, Melbourne, Australia
| | - Qiang Fang
- Department of Biomedical Engineering, Shantou University, Shantou, China
| | - Katrina Neville
- School of Engineering, RMIT University, Melbourne, Australia
| | - Bingrui Ding
- Department of Biomedical Engineering, Shantou University, Shantou, China
| | - Akshay Kumar
- Department of Biomedical Engineering, Shantou University, Shantou, China
| | | | - Xudong Gu
- Rehabilitation Center, Jiaxing 2nd Hospital, Jiaxing, 314000 China
| | - Jianming Fu
- Rehabilitation Center, Jiaxing 2nd Hospital, Jiaxing, 314000 China
| | - Beth Jelfs
- Department of Electrical, Electronic & Systems Engineering, University of Birmingham, Birmingham, UK
| |
Collapse
|
10
|
Kwon S, Kim J, Kim T. Neuropsychological Activations and Networks While Performing Visual and Kinesthetic Motor Imagery. Brain Sci 2023; 13:983. [PMID: 37508915 PMCID: PMC10377687 DOI: 10.3390/brainsci13070983] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Revised: 06/18/2023] [Accepted: 06/19/2023] [Indexed: 07/30/2023] Open
Abstract
This study aimed to answer the questions 'What are the neural networks and mechanisms involved in visual and kinesthetic motor imagery?', and 'Is part of cognitive processing included during visual and kinesthetic motor imagery?' by investigating the neurophysiological networks and activations during visual and kinesthetic motor imagery using motor imagery tasks (golf putting). The experiment was conducted with 19 healthy adults. Functional magnetic resonance imaging (fMRI) was used to examine neural activations and networks during visual and kinesthetic motor imagery using golf putting tasks. The findings of the analysis on cerebral activation patterns based on the two distinct types of motor imagery indicate that the posterior lobe, occipital lobe, and limbic lobe exhibited activation, and the right hemisphere was activated during the process of visual motor imagery. The activation of the temporal lobe and the parietal lobe were observed during the process of kinesthetic motor imagery. This study revealed that visual motor imagery elicited stronger activation in the right frontal lobe, whereas kinesthetic motor imagery resulted in greater activation in the left frontal lobe. It seems that kinesthetic motor imagery activates the primary somatosensory cortex (BA 2), the secondary somatosensory cortex (BA 5 and 7), and the temporal lobe areas and induces human sensibility. The present investigation evinced that the neural network and the regions of the brain that are activated exhibit variability contingent on the category of motor imagery.
Collapse
Affiliation(s)
- Sechang Kwon
- Department of Humanities & Arts, Korea Science Academy of KAIST, 105-47, Baegyanggwanmun-ro, Busanjin-gu, Busan 47162, Republic of Korea
- Global Institute for Talented Education, Korea Advanced Institute of Science and Technology (KAIST), 291, Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| | - Jingu Kim
- Department of Physical Education, Kyungpook National University, 80 Daehak-ro, Buk-gu, Daegu 41566, Republic of Korea
| | - Teri Kim
- Institute of Sports Science, Kyungpook National University, 80 Daehak-ro, Buk-gu, Daegu 41566, Republic of Korea
| |
Collapse
|
11
|
Simistira Liwicki F, Gupta V, Saini R, De K, Abid N, Rakesh S, Wellington S, Wilson H, Liwicki M, Eriksson J. Bimodal electroencephalography-functional magnetic resonance imaging dataset for inner-speech recognition. Sci Data 2023; 10:378. [PMID: 37311807 DOI: 10.1038/s41597-023-02286-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Accepted: 06/01/2023] [Indexed: 06/15/2023] Open
Abstract
The recognition of inner speech, which could give a 'voice' to patients that have no ability to speak or move, is a challenge for brain-computer interfaces (BCIs). A shortcoming of the available datasets is that they do not combine modalities to increase the performance of inner speech recognition. Multimodal datasets of brain data enable the fusion of neuroimaging modalities with complimentary properties, such as the high spatial resolution of functional magnetic resonance imaging (fMRI) and the temporal resolution of electroencephalography (EEG), and therefore are promising for decoding inner speech. This paper presents the first publicly available bimodal dataset containing EEG and fMRI data acquired nonsimultaneously during inner-speech production. Data were obtained from four healthy, right-handed participants during an inner-speech task with words in either a social or numerical category. Each of the 8-word stimuli were assessed with 40 trials, resulting in 320 trials in each modality for each participant. The aim of this work is to provide a publicly available bimodal dataset on inner speech, contributing towards speech prostheses.
Collapse
Affiliation(s)
- Foteini Simistira Liwicki
- Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Embedded Intelligent Systems LAB, Luleå, Sweden.
| | - Vibha Gupta
- Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Embedded Intelligent Systems LAB, Luleå, Sweden
| | - Rajkumar Saini
- Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Embedded Intelligent Systems LAB, Luleå, Sweden
| | - Kanjar De
- Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Embedded Intelligent Systems LAB, Luleå, Sweden
| | - Nosheen Abid
- Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Embedded Intelligent Systems LAB, Luleå, Sweden
| | - Sumit Rakesh
- Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Embedded Intelligent Systems LAB, Luleå, Sweden
| | | | - Holly Wilson
- University of Bath, Department of Computer Science, Bath, UK
| | - Marcus Liwicki
- Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Embedded Intelligent Systems LAB, Luleå, Sweden
| | - Johan Eriksson
- Umeå University, Department of Integrative Medical Biology (IMB) and Umeå Center for Functional Brain Imaging (UFBI), Umeå, Sweden
| |
Collapse
|
12
|
Wu Y, Mao Y, Feng K, Wei D, Song L. Decoding of the neural representation of the visual RGB color model. PeerJ Comput Sci 2023; 9:e1376. [PMID: 37346564 PMCID: PMC10280385 DOI: 10.7717/peerj-cs.1376] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Accepted: 04/10/2023] [Indexed: 06/23/2023]
Abstract
RGB color is a basic visual feature. Here we use machine learning and visual evoked potential (VEP) of electroencephalogram (EEG) data to investigate the decoding features of the time courses and space location that extract it, and whether they depend on a common brain cortex channel. We show that RGB color information can be decoded from EEG data and, with the task-irrelevant paradigm, features can be decoded across fast changes in VEP stimuli. These results are consistent with the theory of both event-related potential (ERP) and P300 mechanisms. The latency on time course is shorter and more temporally precise for RGB color stimuli than P300, a result that does not depend on a task-relevant paradigm, suggesting that RGB color is an updating signal that separates visual events. Meanwhile, distribution features are evident for the brain cortex of EEG signal, providing a space correlate of RGB color in classification accuracy and channel location. Finally, space decoding of RGB color depends on the channel classification accuracy and location obtained through training and testing EEG data. The result is consistent with channel power value distribution discharged by both VEP and electrophysiological stimuli mechanisms.
Collapse
Affiliation(s)
- Yijia Wu
- Fudan University, Fudan University, ShangHai, YangPu, China
- Shanghai Key Research Laboratory, Shanghai Key Research Laboratory, ShangHai, PuDong, China
| | - Yanjing Mao
- Fudan University, Fudan University, ShangHai, YangPu, China
| | - Kaiqiang Feng
- Fudan University, Fudan University, ShangHai, YangPu, China
| | - Donglai Wei
- Fudan University, Fudan University, ShangHai, YangPu, China
| | - Liang Song
- Fudan University, Fudan University, ShangHai, YangPu, China
- Shanghai Key Research Laboratory, Shanghai Key Research Laboratory, ShangHai, PuDong, China
| |
Collapse
|
13
|
Kurkin S, Gordleeva S, Savosenkov A, Grigorev N, Smirnov N, Grubov VV, Udoratina A, Maksimenko V, Kazantsev V, Hramov AE. Transcranial Magnetic Stimulation of the Dorsolateral Prefrontal Cortex Increases Posterior Theta Rhythm and Reduces Latency of Motor Imagery. SENSORS (BASEL, SWITZERLAND) 2023; 23:4661. [PMID: 37430576 DOI: 10.3390/s23104661] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/15/2023] [Revised: 05/09/2023] [Accepted: 05/09/2023] [Indexed: 07/12/2023]
Abstract
Experiments show activation of the left dorsolateral prefrontal cortex (DLPFC) in motor imagery (MI) tasks, but its functional role requires further investigation. Here, we address this issue by applying repetitive transcranial magnetic stimulation (rTMS) to the left DLPFC and evaluating its effect on brain activity and the latency of MI response. This is a randomized, sham-controlled EEG study. Participants were randomly assigned to receive sham (15 subjects) or real high-frequency rTMS (15 subjects). We performed EEG sensor-level, source-level, and connectivity analyses to evaluate the rTMS effects. We revealed that excitatory stimulation of the left DLPFC increases theta-band power in the right precuneus (PrecuneusR) via the functional connectivity between them. The precuneus theta-band power negatively correlates with the latency of the MI response, so the rTMS speeds up the responses in 50% of participants. We suppose that posterior theta-band power reflects attention modulation of sensory processing; therefore, high power may indicate attentive processing and cause faster responses.
Collapse
Affiliation(s)
- Semen Kurkin
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236016 Kaliningrad, Russia
| | - Susanna Gordleeva
- Neurodynamics and Cognitive Technology Laboratory, Lobachevsky State University of Nizhny Novgorod, 603105 Nizhniy Novgorod, Russia
| | - Andrey Savosenkov
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236016 Kaliningrad, Russia
- Neurodynamics and Cognitive Technology Laboratory, Lobachevsky State University of Nizhny Novgorod, 603105 Nizhniy Novgorod, Russia
| | - Nikita Grigorev
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236016 Kaliningrad, Russia
- Neurodynamics and Cognitive Technology Laboratory, Lobachevsky State University of Nizhny Novgorod, 603105 Nizhniy Novgorod, Russia
| | - Nikita Smirnov
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236016 Kaliningrad, Russia
| | - Vadim V Grubov
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236016 Kaliningrad, Russia
| | - Anna Udoratina
- Neurodynamics and Cognitive Technology Laboratory, Lobachevsky State University of Nizhny Novgorod, 603105 Nizhniy Novgorod, Russia
| | - Vladimir Maksimenko
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236016 Kaliningrad, Russia
- Neurodynamics and Cognitive Technology Laboratory, Lobachevsky State University of Nizhny Novgorod, 603105 Nizhniy Novgorod, Russia
| | - Victor Kazantsev
- Neurodynamics and Cognitive Technology Laboratory, Lobachevsky State University of Nizhny Novgorod, 603105 Nizhniy Novgorod, Russia
| | - Alexander E Hramov
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236016 Kaliningrad, Russia
- Neurodynamics and Cognitive Technology Laboratory, Lobachevsky State University of Nizhny Novgorod, 603105 Nizhniy Novgorod, Russia
| |
Collapse
|
14
|
Won K, Kim H, Gwon D, Ahn M, Nam CS, Jun SC. Can vibrotactile stimulation and tDCS help inefficient BCI users? J Neuroeng Rehabil 2023; 20:60. [PMID: 37143057 PMCID: PMC10157902 DOI: 10.1186/s12984-023-01181-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Accepted: 04/19/2023] [Indexed: 05/06/2023] Open
Abstract
Brain-computer interface (BCI) has helped people by allowing them to control a computer or machine through brain activity without actual body movement. Despite this advantage, BCI cannot be used widely because some people cannot achieve controllable performance. To solve this problem, researchers have proposed stimulation methods to modulate relevant brain activity to improve BCI performance. However, multiple studies have reported mixed results following stimulation, and the comparative study of different stimulation modalities has been overlooked. Accordingly, this study was designed to compare vibrotactile stimulation and transcranial direct current stimulation's (tDCS) effects on brain activity modulation and motor imagery BCI performance among inefficient BCI users. We recruited 44 subjects and divided them into sham, vibrotactile stimulation, and tDCS groups, and low performers were selected from each stimulation group. We found that the latter's BCI performance in the vibrotactile stimulation group increased significantly by 9.13% (p < 0.01), and while the tDCS group subjects' performance increased by 5.13%, it was not significant. In contrast, sham group subjects showed no increased performance. In addition to BCI performance, pre-stimulus alpha band power and the phase locking values (PLVs) averaged over sensory motor areas showed significant increases in low performers following stimulation in the vibrotactile stimulation and tDCS groups, while sham stimulation group subjects and high performers showed no significant stimulation effects across all groups. Our findings suggest that stimulation effects may differ depending upon BCI efficiency, and inefficient BCI users have greater plasticity than efficient BCI users.
Collapse
Affiliation(s)
- Kyungho Won
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju, South Korea
| | - Heegyu Kim
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju, South Korea
| | - Daeun Gwon
- Department of Computer Science and Electrical Engineering, Handong Global University, Pohang, South Korea
| | - Minkyu Ahn
- Department of Computer Science and Electrical Engineering, Handong Global University, Pohang, South Korea
- School of Computer Science and Electrical Engineering, Handong Global University, Pohang, South Korea
| | - Chang S Nam
- Edward P. Fitts Department of Industrial and Systems Engineering, North Carolina State University, North Carolina, USA
| | - Sung Chan Jun
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju, South Korea.
- Artificial Intelligence Graduate School, Gwangju Institute of Science and Technology, Gwangju, South Korea.
| |
Collapse
|
15
|
Haotian X, Anmin G, Jiangong L, Fan W, Peng D, Yunfa F. Online adaptive classification system for brain–computer interface based on error-related potentials and neurofeedback. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104554] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
|
16
|
Riquelme-Hernández C, Reyes-Barría JP, Vargas A, Gonzalez-Robaina Y, Zapata-Lamana R, Toloza-Ramirez D, Parra-Rizo MA, Cigarroa I. Effects of the Practice of Movement Representation Techniques in People Undergoing Knee and Hip Arthroplasty: A Systematic Review. Sports (Basel) 2022; 10:sports10120198. [PMID: 36548495 PMCID: PMC9782171 DOI: 10.3390/sports10120198] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Revised: 11/23/2022] [Accepted: 11/24/2022] [Indexed: 12/12/2022] Open
Abstract
OBJECTIVE To analyze the effects of movement representation techniques (MRT) combined with conventional physical therapy (CFT) in people undergoing knee and hip arthroplasty compared to conventional physical therapy alone in terms of results in physical and functionality variables, cognitive function, and quality of life. METHODOLOGY the review was carried out according to the criteria of the PRISMA statement, considering studies in the electronic databases PubMed/Medline, Pubmed Central/Medline, Web of Science, EBSCO, and ScienceDirect. RESULTS MRT plus CFT generated therapeutic effects in some aspects of the physical variables: 100% pain (7 of 7 studies); 100% strength (5 out of 5 studies); range of motion 87.5% (7 out of 8 studies); 100% speed (1 of 1 study), functional variables: 100% gait (7 of 7 studies); functional capacity 87.5% (7 out of 8 studies); cognitive variables: 100% motor visualization ability (2 out of 2 studies); cognitive performance 100% (2 of 2 studies); and quality of life 66.6% (2 of 3 studies). When comparing its effects with conventional physical therapy, the variables that reported the greatest statistically significant changes were motor visualization ability, speed, pain, strength and gait. The most used MRT was motor imagery (MI), and the average time extension of therapies was 3.5 weeks. CONCLUSIONS movement representation techniques combined with conventional physical therapy are an innocuous and low-cost therapeutic intervention with therapeutic effects in patients with knee arthroplasty (KA) and hip arthroplasty (HA), and this combination generates greater therapeutic effects in physical, functional, and cognitive variables than conventional physical therapy alone.
Collapse
Affiliation(s)
| | - Juan Pablo Reyes-Barría
- Escuela de Kinesiología, Departamento de Salud, Universidad de los Lagos, Puerto Montt 5480000, Chile
- Clínica Resilient, Puerto Montt 5480000, Chile
| | | | | | | | - David Toloza-Ramirez
- Exercise and Rehabilitation Sciences Institute, School of Speech Therapy, Faculty of Rehabilitation Sciences, Universidad Andres Bello, Santiago 7591538, Chile
- Interdisciplinary Center for Neuroscience, Faculty of Medicine, Pontificia Universidad Católica de Chile, Santiago 8320000, Chile
| | - Maria Antonia Parra-Rizo
- Faculty of Health Sciences, Valencian International University (VIU), 46002 Valencia, Spain
- Department of Health Psychology, Faculty of Social and Health Sciences, Campus of Elche, Miguel Hernández University (UMH), 03202 Elche, Spain
- Correspondence: (M.A.P.-R.); (I.C.)
| | - Igor Cigarroa
- Escuela de Kinesiología, Facultad de Salud, Universidad Santo Tomás, Los Ángeles 4440000, Chile
- Correspondence: (M.A.P.-R.); (I.C.)
| |
Collapse
|
17
|
Cho JH, Jeong JH, Lee SW. NeuroGrasp: Real-Time EEG Classification of High-Level Motor Imagery Tasks Using a Dual-Stage Deep Learning Framework. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:13279-13292. [PMID: 34748509 DOI: 10.1109/tcyb.2021.3122969] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Brain-computer interfaces (BCIs) have been widely employed to identify and estimate a user's intention to trigger a robotic device by decoding motor imagery (MI) from an electroencephalogram (EEG). However, developing a BCI system driven by MI related to natural hand-grasp tasks is challenging due to its high complexity. Although numerous BCI studies have successfully decoded large body parts, such as the movement intention of both hands, arms, or legs, research on MI decoding of high-level behaviors such as hand grasping is essential to further expand the versatility of MI-based BCIs. In this study, we propose NeuroGrasp, a dual-stage deep learning framework that decodes multiple hand grasping from EEG signals under the MI paradigm. The proposed method effectively uses an EEG and electromyography (EMG)-based learning, such that EEG-based inference at test phase becomes possible. The EMG guidance during model training allows BCIs to predict hand grasp types from EEG signals accurately. Consequently, NeuroGrasp improved classification performance offline, and demonstrated a stable classification performance online. Across 12 subjects, we obtained an average offline classification accuracy of 0.68 (±0.09) in four-grasp-type classifications and 0.86 (±0.04) in two-grasp category classifications. In addition, we obtained an average online classification accuracy of 0.65 (±0.09) and 0.79 (±0.09) across six high-performance subjects. Because the proposed method has demonstrated a stable classification performance when evaluated either online or offline, in the future, we expect that the proposed method could contribute to different BCI applications, including robotic hands or neuroprosthetics for handling everyday objects.
Collapse
|
18
|
EEG Channel Selection Techniques in Motor Imagery Applications: A Review and New Perspectives. BIOENGINEERING (BASEL, SWITZERLAND) 2022; 9:bioengineering9120726. [PMID: 36550932 PMCID: PMC9774545 DOI: 10.3390/bioengineering9120726] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Revised: 10/28/2022] [Accepted: 10/30/2022] [Indexed: 11/25/2022]
Abstract
Communication, neuro-prosthetics, and environmental control are just a few applications for disabled persons who use robots and manipulators that use brain-computer interface (BCI) systems. The brain's motor imagery (MI) signal is an essential input for a brain-related task in BCI applications. Due to their noninvasive, portability, and cost-effectiveness, electroencephalography (EEG) signals are the most widely used input in BCI systems. The EEG data are often collected from more than 100 different locations in the brain; channel selection techniques are critical for selecting the optimum channels for a given application. However, when analyzing EEG data, the principal purpose of channel selection is to reduce computational complexity, improve classification accuracy by avoiding overfitting, and reduce setup time. Several channel selection assessment algorithms, both with and without classification-based methods, extracted appropriate channel subsets using defined criteria. Therefore, based on the exhaustive analysis of the EEG channel selection, this manuscript analyses several existing studies to reduce the number of noisy channels and improve system performance. We review several existing works to find the most promising MI-based EEG channel selection algorithms and associated classification methodologies on various datasets. Moreover, we focus on channel selection methods that choose fewer channels with great precision. Finally, our main finding is that a smaller channel set, typically 10-30% of total channels, provided excellent performance compared to other existing studies.
Collapse
|
19
|
Tong J, Wei X, Dong E, Sun Z, Du S, Duan F. Hybrid mental tasks based human computer interface via integration of pronunciation and motor imagery. J Neural Eng 2022; 19. [PMID: 36228578 DOI: 10.1088/1741-2552/ac9a01] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2022] [Accepted: 10/13/2022] [Indexed: 12/24/2022]
Abstract
Objective.Among the existing active brain-computer interfaces (BCI), the motor imagination (MI) is widely used. To operate the MI BCI effectively, subjects need to carry out trainings on corresponding imagining tasks. Here, we studied how to reduce the discomfort and fatigue of active BCI imaginary tasks and the inability to concentrate on them while improving the accuracy.Approach.This paper proposes a hybrid BCI composed of MI and pronunciation imagination (PI). The electroencephalogram signals of ten subjects are recognized by the adaptive Riemannian distance classification and the improved frequency selective filter-bank Common Spatial Pattern recognition.Main results.The results show that under the new paradigm with the combination of MI and PI, the recognition accuracy is higher than the MI alone. The highest recognition rate of the proposed hybrid system can reach more than 90%. Furthermore, through the subjects' scoring results of the operation difficulty, it is concluded that the designed hybrid paradigm is more operable than the traditional BCI paradigm.Significance.The separable tasks in the active BCI are limited and the accuracy needs to be improved. The new hybrid paradigm proposed by us improves the accuracy and operability of the active BCI system, providing a new possibility for the research direction of the active BCI.
Collapse
Affiliation(s)
- Jigang Tong
- Tianjin Key Laboratory of Control Theory and Applications in Complicated Systems, TianjinUniversity of Technology, Tianjin 300384, People's Republic of China
| | - Xiaoying Wei
- Tianjin Key Laboratory of Control Theory and Applications in Complicated Systems, TianjinUniversity of Technology, Tianjin 300384, People's Republic of China
| | - Enzeng Dong
- Tianjin Key Laboratory of Control Theory and Applications in Complicated Systems, TianjinUniversity of Technology, Tianjin 300384, People's Republic of China
| | - Zhe Sun
- Computational Engineering Applications Unit, Head Office for Information Systems and Cybersecurity, RIKEN, Saitama, Japan
| | - Shengzhi Du
- Department of Electrical Engineering, Tshwane University of Technology, Pretoria 0001, South Africa
| | - Feng Duan
- College of Artificial Intelligence, Nankai University, Tianjin, People's Republic of China
| |
Collapse
|
20
|
Patel K, Beaver D, Gruber N, Printezis G, Giannopulu I. Mental imagery of whole-body motion along the sagittal-anteroposterior axis. Sci Rep 2022; 12:14345. [PMID: 35999355 PMCID: PMC9399091 DOI: 10.1038/s41598-022-18323-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2022] [Accepted: 08/09/2022] [Indexed: 12/03/2022] Open
Abstract
Whole-body motor imagery is conceptualised as a mental symbolisation directly and indirectly associated with neural oscillations similar to whole-body motor execution. Motor and somatosensory activity, including vestibular activity, is a typical corticocortical substrate of body motion. Yet, it is not clear how this neural substrate is organised when participants are instructed to imagine moving their body forward or backward along the sagittal-anteroposterior axis. It is the aim of the current study to identify the fingerprint of the neural substrate by recording the cortical activity of 39 participants via a 32 electroencephalography (EEG) device. The participants were instructed to imagine moving their body forward or backward from a first-person perspective. Principal Component Analysis (i.e. PCA) applied to the neural activity of whole-body motor imagery revealed neural interconnections mirroring between forward and backward conditions: beta pre-motor and motor oscillations in the left and right hemisphere overshadowed beta parietal oscillations in forward condition, and beta parietal oscillations in the left and right hemisphere overshadowed beta pre-motor and motor oscillations in backward condition. Although functional significance needs to be discerned, beta pre-motor, motor and somatosensory oscillations might represent specific settings within the corticocortical network and provide meaningful information regarding the neural dynamics of continuous whole-body motion. It was concluded that the evoked multimodal fronto-parietal neural activity would correspond to the neural activity that could be expected if the participants were physically enacting movement of the whole-body in sagittal-anteroposterior plane as they would in their everyday environment.
Collapse
Affiliation(s)
- K Patel
- School of Human Sciences and Humanities, University of Houston, Houston, 77001, USA
| | - D Beaver
- Faculty of Health Sciences and Medicine, Bond University, Gold Coast, 4226, Australia
| | - N Gruber
- Department of Mathematics, University of Innsbruck, 6020, Innsbruck, Austria.,VASCage, 6020, Innsbruck, Austria
| | - G Printezis
- Department of Electrical Engineering, Technological University of Denmark, 2800, Kgs. Lyngby, Denmark
| | - I Giannopulu
- Creative Robotics Lab, UNSW, Sydney, 2021, Australia. .,Clinical Research and Technological Innovation, 75016, Paris, France.
| |
Collapse
|
21
|
Zou Y, Li J, Fan Y, Zhang C, Kong Y. Functional near-infrared spectroscopy during motor imagery and motor execution in healthy adults. ZHONG NAN DA XUE XUE BAO. YI XUE BAN = JOURNAL OF CENTRAL SOUTH UNIVERSITY. MEDICAL SCIENCES 2022; 47:920-927. [PMID: 36039589 PMCID: PMC10930295 DOI: 10.11817/j.issn.1672-7347.2022.210689] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Subscribe] [Scholar Register] [Received: 11/16/2021] [Indexed: 06/15/2023]
Abstract
OBJECTIVES Studies on the influence of motor imagery (MI) on brain structure and function are limited to traditional imaging techniques and the mechanism for MI therapy is not clear. By observing the brain activation mode during MI and motor execution (ME) in healthy adults, this study aims to use near-infrared brain imaging technology to provide theoretical basis for the treatment of MI. METHODS A total of 30 healthy adults recruited to the public from June 2021 to August 2021. The MI and ME of the right knee movement served as the task mode. Block design was repeated 5 times alternately in a 20 s task period and a 30 s resting period. The activation patterns of brain regions were compared between the 2 tasks, and the regression coefficient was calculated to reflect the activation intensity of each brain region by Nirspark and SPSS 23.0 softwares. RESULTS Lane 2, 3, 4, 5, 7, 9, 19, 20, 21, 24, 25, 26, 27, 32, 33, and 34 were significantly activated during the ME task (P<0.05, corrected by FDR) and lane 2, 5, 9, 16, 27, 29, 33, 34, and 35 were significantly activated during the MI task (P<0.05, corrected by FDR). According to the channel brain region registration information, the brain region activation pattern was similar during both MI and ME tasks in healthy adults, including left primary motor cortex (LM1), left primary sensory cortex (LS1), prefrontal pole, Broca area, and right supramarginal gyrus. Both LM1 and left pre-motor cortex (LPMC) were activated during MI in healthy adults, whereas dorsolateral prefrontal cortex (DLPFC) and only LM1 of the motor region were activated during ME. Compared to MI, the activation intensity of left sensory and left motor cortex was significantly enhanced in ME, and that of left and right prefrontal cortex especially left and right pars triangularis Broca's area (P<0.001, corrected by FDR) were significantly enhanced. CONCLUSIONS The rationality of MI therapy is proved by functional near-infrared spectroscopy. The involvement of DLPFC in motor decision-making may regulate the two-way feedback of premoter cortex-M1 during ME; and Broca area, closely related to the motor program understanding, participates in MI and ME.
Collapse
Affiliation(s)
- Ying Zou
- Medical School, Yueyang Vocational Technical College, Yueyang Hunan 414000.
| | - Jing Li
- Department of Rehabilitation, Second Xiangya Hospital, Central South University, Changsha 410011, China
| | - Yongmei Fan
- Department of Rehabilitation, Second Xiangya Hospital, Central South University, Changsha 410011, China
| | - Changjie Zhang
- Department of Rehabilitation, Second Xiangya Hospital, Central South University, Changsha 410011, China
| | - Ying Kong
- Department of Rehabilitation, Second Xiangya Hospital, Central South University, Changsha 410011, China.
| |
Collapse
|
22
|
Le Franc S, Herrera Altamira G, Guillen M, Butet S, Fleck S, Lécuyer A, Bougrain L, Bonan I. Toward an Adapted Neurofeedback for Post-stroke Motor Rehabilitation: State of the Art and Perspectives. Front Hum Neurosci 2022; 16:917909. [PMID: 35911589 PMCID: PMC9332194 DOI: 10.3389/fnhum.2022.917909] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2022] [Accepted: 06/20/2022] [Indexed: 11/28/2022] Open
Abstract
Stroke is a severe health issue, and motor recovery after stroke remains an important challenge in the rehabilitation field. Neurofeedback (NFB), as part of a brain–computer interface, is a technique for modulating brain activity using on-line feedback that has proved to be useful in motor rehabilitation for the chronic stroke population in addition to traditional therapies. Nevertheless, its use and applications in the field still leave unresolved questions. The brain pathophysiological mechanisms after stroke remain partly unknown, and the possibilities for intervention on these mechanisms to promote cerebral plasticity are limited in clinical practice. In NFB motor rehabilitation, the aim is to adapt the therapy to the patient’s clinical context using brain imaging, considering the time after stroke, the localization of brain lesions, and their clinical impact, while taking into account currently used biomarkers and technical limitations. These modern techniques also allow a better understanding of the physiopathology and neuroplasticity of the brain after stroke. We conducted a narrative literature review of studies using NFB for post-stroke motor rehabilitation. The main goal was to decompose all the elements that can be modified in NFB therapies, which can lead to their adaptation according to the patient’s context and according to the current technological limits. Adaptation and individualization of care could derive from this analysis to better meet the patients’ needs. We focused on and highlighted the various clinical and technological components considering the most recent experiments. The second goal was to propose general recommendations and enhance the limits and perspectives to improve our general knowledge in the field and allow clinical applications. We highlighted the multidisciplinary approach of this work by combining engineering abilities and medical experience. Engineering development is essential for the available technological tools and aims to increase neuroscience knowledge in the NFB topic. This technological development was born out of the real clinical need to provide complementary therapeutic solutions to a public health problem, considering the actual clinical context of the post-stroke patient and the practical limits resulting from it.
Collapse
Affiliation(s)
- Salomé Le Franc
- Rehabilitation Medicine Unit, University Hospital of Rennes, Rennes, France
- Hybrid Team, Inria, University of Rennes, Irisa, UMR CNRS 6074, Rennes, France
- *Correspondence: Salomé Le Franc,
| | | | - Maud Guillen
- Hybrid Team, Inria, University of Rennes, Irisa, UMR CNRS 6074, Rennes, France
- Neurology Unit, University Hospital of Rennes, Rennes, France
| | - Simon Butet
- Rehabilitation Medicine Unit, University Hospital of Rennes, Rennes, France
- Empenn Unit U1228, Inserm, Inria, University of Rennes, Irisa, UMR CNRS 6074, Rennes, France
| | - Stéphanie Fleck
- Université de Lorraine, CNRS, LORIA, Nancy, France
- EA7312 Laboratoire de Psychologie Ergonomique et Sociale pour l’Expérience Utilisateurs (PERSEUS), Metz, France
| | - Anatole Lécuyer
- Hybrid Team, Inria, University of Rennes, Irisa, UMR CNRS 6074, Rennes, France
| | | | - Isabelle Bonan
- Rehabilitation Medicine Unit, University Hospital of Rennes, Rennes, France
- Empenn Unit U1228, Inserm, Inria, University of Rennes, Irisa, UMR CNRS 6074, Rennes, France
| |
Collapse
|
23
|
Chi X, Wan C, Wang C, Zhang Y, Chen X, Cui H. A Novel Hybrid Brain-Computer Interface Combining Motor Imagery and Intermodulation Steady-State Visual Evoked Potential. IEEE Trans Neural Syst Rehabil Eng 2022; 30:1525-1535. [PMID: 35657833 DOI: 10.1109/tnsre.2022.3179971] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The hybrid brain-computer interface (hBCI) combining motor imagery (MI) and steady-state visual evoked potential (SSVEP) has been proven to have better performance than a pure MI- or SSVEP-based brain-computer interface (BCI). In most studies on hBCIs, subjects have been required to focus their attention on flickering light-emitting diodes (LEDs) or blocks while imagining body movements. However, these two classical tasks performed concurrently have a poor correlation. Therefore, it is necessary to reduce the task complexity of such a system and improve its user-friendliness. Aiming to achieve this goal, this study proposes a novel hybrid BCI that combines MI and intermodulation SSVEPs. In the proposed system, images of both hands flicker at the same frequency (i.e., 30 Hz) but at different grasp frequencies (i.e., 1 Hz for the left hand, and 1.5 Hz for the right hand), resulting in different intermodulation frequencies for encoding targets. Additionally, movement observation for subjects can help to perform the MI task better. In this study, two types of brain signals are classified independently and then fused by a scoring mechanism based on the probability distribution of relevant parameters. The online verification results showed that the average accuracies of 12 healthy subjects and 11 stroke patients were 92.40 ± 7.45% and 73.07 ± 9.07%, respectively. The average accuracies of 10 healthy subjects in the MI, SSVEP, and hybrid tasks were 84.00 ± 12.81%, 80.75 ± 8.08%, and 89.00 ± 9.94%, respectively. The high recognition accuracy verifies the feasibility and robustness of the proposed system. This study provides a novel and natural paradigm for a hybrid BCI based on MI and SSVEP.
Collapse
|
24
|
Motor Imagery: How to Assess, Improve Its Performance, and Apply It for Psychosis Diagnostics. Diagnostics (Basel) 2022; 12:diagnostics12040949. [PMID: 35453997 PMCID: PMC9025310 DOI: 10.3390/diagnostics12040949] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Revised: 04/03/2022] [Accepted: 04/07/2022] [Indexed: 11/16/2022] Open
Abstract
With this review, we summarize the state-of-the-art of scientific studies in the field of motor imagery (MI) and motor execution (ME). We composed the brain map and description that correlate different brain areas with the type of movements it is responsible for. That gives a more complete and systematic picture of human brain functionality in the case of ME and MI. We systematized the most popular methods for assessing the quality of MI performance and discussed their advantages and disadvantages. We also reviewed the main directions for the use of transcranial magnetic stimulation (TMS) in MI research and considered the principal effects of TMS on MI performance. In addition, we discuss the main applications of MI, emphasizing its use in the diagnostics of various neurodegenerative disorders and psychoses. Finally, we discuss the research gap and possible improvements for further research in the field.
Collapse
|
25
|
|
26
|
Tang S, Jia L, Liu M, Ren J, Li F, Luo J, Huang F. The dynamic monitoring and control mechanism in problem solving: Evidence from theta and alpha oscillations. Int J Psychophysiol 2021; 170:112-120. [PMID: 34699862 DOI: 10.1016/j.ijpsycho.2021.10.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2021] [Revised: 09/22/2021] [Accepted: 10/19/2021] [Indexed: 11/26/2022]
Abstract
Although both originality and value are considered necessary criteria to identify creative ideas, little is known about how original and valuable ideas are generated in the human brain. To reveal how people monitor and control ongoing processing in the pursuit of original and valuable ideas, high-density electroencephalography (EEG) was used to record electrophysiological signals when participants were performing chunk decomposition tasks via novel-appropriate, novel-inappropriate, ordinary-appropriate and ordinary-inappropriate pathways. The results showed that approximately 100 ms after the problem was presented, novel pathways showed increased theta synchronization in the frontal sites compared to ordinary pathways. Novel pathways were associated with increased alpha desynchronization over the entire brain scale. These theta and alpha oscillations likely indicated rapid monitoring and effective control of novel processing in thinking. In the latter stages of problem solving, particularly during the 2000-2600-ms intervals, increased theta synchronization with decreased alpha desynchronization was found between novel-inappropriate and novel-appropriate pathways, which likely indicated slow monitoring and less control of inappropriate processing in novel thinking. The findings demonstrated the dynamic monitoring and control mechanism in the pursuit of original and valuable ideas.
Collapse
Affiliation(s)
- Shuang Tang
- School of Psychology, Jiangxi Normal University, Nanchang 330022, China
| | - Lujia Jia
- School of Psychology, Jiangxi Normal University, Nanchang 330022, China
| | - Mingzhu Liu
- Nanchang Institute of Technology, Nanchang 330044, China
| | - Jingyuan Ren
- Donders Institute for Brain, Cognition and Behaviour, Rodboud University Medical Center, Nijmegen 6525EN, Netherlands
| | - Fuhong Li
- School of Psychology, Jiangxi Normal University, Nanchang 330022, China
| | - Jing Luo
- School of Psychology, Capital Normal University, Beijing 100048, China
| | - Furong Huang
- School of Psychology, Jiangxi Normal University, Nanchang 330022, China.
| |
Collapse
|
27
|
Hehenberger L, Batistic L, Sburlea AI, Müller-Putz GR. Directional Decoding From EEG in a Center-Out Motor Imagery Task With Visual and Vibrotactile Guidance. Front Hum Neurosci 2021; 15:687252. [PMID: 34630055 PMCID: PMC8497713 DOI: 10.3389/fnhum.2021.687252] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2021] [Accepted: 08/30/2021] [Indexed: 11/13/2022] Open
Abstract
Motor imagery is a popular technique employed as a motor rehabilitation tool, or to control assistive devices to substitute lost motor function. In both said areas of application, artificial somatosensory input helps to mirror the sensorimotor loop by providing kinesthetic feedback or guidance in a more intuitive fashion than via visual input. In this work, we study directional and movement-related information in electroencephalographic signals acquired during a visually guided center-out motor imagery task in two conditions, i.e., with and without additional somatosensory input in the form of vibrotactile guidance. Imagined movements to the right and forward could be discriminated in low-frequency electroencephalographic amplitudes with group level peak accuracies of 70% with vibrotactile guidance, and 67% without vibrotactile guidance. The peak accuracies with and without vibrotactile guidance were not significantly different. Furthermore, the motor imagery could be classified against a resting baseline with group level accuracies between 76 and 83%, using either low-frequency amplitude features or μ and β power spectral features. On average, accuracies were higher with vibrotactile guidance, while this difference was only significant in the latter set of features. Our findings suggest that directional information in low-frequency electroencephalographic amplitudes is retained in the presence of vibrotactile guidance. Moreover, they hint at an enhancing effect on motor-related μ and β spectral features when vibrotactile guidance is provided.
Collapse
Affiliation(s)
- Lea Hehenberger
- Institute of Neural Engineering, Graz University of Technology, Graz, Austria
| | - Luka Batistic
- Laboratory for Application of Information Technologies, Faculty of Engineering, Department of Computer Engineering, University of Rijeka, Rijeka, Croatia
| | - Andreea I Sburlea
- Institute of Neural Engineering, Graz University of Technology, Graz, Austria
| | - Gernot R Müller-Putz
- Institute of Neural Engineering, Graz University of Technology, Graz, Austria.,BioTechMed Graz, Graz, Austria
| |
Collapse
|
28
|
Le Franc S, Fleury M, Jeunet C, Butet S, Barillot C, Bonan I, Cogné M, Lécuyer A. Influence of the visuo-proprioceptive illusion of movement and motor imagery of the wrist on EEG cortical excitability among healthy participants. PLoS One 2021; 16:e0256723. [PMID: 34473788 PMCID: PMC8412266 DOI: 10.1371/journal.pone.0256723] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2020] [Accepted: 08/13/2021] [Indexed: 11/18/2022] Open
Abstract
INTRODUCTION Motor Imagery (MI) is a powerful tool to stimulate sensorimotor brain areas and is currently used in motor rehabilitation after a stroke. The aim of our study was to evaluate whether an illusion of movement induced by visuo-proprioceptive immersion (VPI) including tendon vibration (TV) and Virtual moving hand (VR) combined with MI tasks could be more efficient than VPI alone or MI alone on cortical excitability assessed using Electroencephalography (EEG). METHODS We recorded EEG signals in 20 healthy participants in 3 different conditions: MI tasks involving their non-dominant wrist (MI condition); VPI condition; and VPI with MI tasks (combined condition). Each condition lasted 3 minutes, and was repeated 3 times in randomized order. Our main judgment criterion was the Event-Related De-synchronization (ERD) threshold in sensori-motor areas in each condition in the brain motor area. RESULTS The combined condition induced a greater change in the ERD percentage than the MI condition alone, but no significant difference was found between the combined and the VPI condition (p = 0.07) and between the VPI and MI condition (p = 0.20). CONCLUSION This study demonstrated the interest of using a visuo-proprioceptive immersion with MI rather than MI alone in order to increase excitability in motor areas of the brain. Further studies could test this hypothesis among patients with stroke to provide new perspectives for motor rehabilitation in this population.
Collapse
Affiliation(s)
- Salomé Le Franc
- Rehabilitation Medicine Unit, University Hospital of Rennes, Rennes, France
- Hybrid Team, Inria, University of Rennes, Irisa, UMR CNRS 6074, Rennes, France
| | - Mathis Fleury
- Hybrid Team, Inria, University of Rennes, Irisa, UMR CNRS 6074, Rennes, France
- Empenn Unit U1228, Inserm, Inria, University of Rennes, Irisa, UMR CNRS 6074, Rennes, France
| | - Camille Jeunet
- CLLE Lab, CNRS, Univ. Toulouse Jean Jaurès, Toulouse, France
| | - Simon Butet
- Rehabilitation Medicine Unit, University Hospital of Rennes, Rennes, France
- Empenn Unit U1228, Inserm, Inria, University of Rennes, Irisa, UMR CNRS 6074, Rennes, France
| | - Christian Barillot
- Empenn Unit U1228, Inserm, Inria, University of Rennes, Irisa, UMR CNRS 6074, Rennes, France
| | - Isabelle Bonan
- Rehabilitation Medicine Unit, University Hospital of Rennes, Rennes, France
- Empenn Unit U1228, Inserm, Inria, University of Rennes, Irisa, UMR CNRS 6074, Rennes, France
| | - Mélanie Cogné
- Rehabilitation Medicine Unit, University Hospital of Rennes, Rennes, France
- Hybrid Team, Inria, University of Rennes, Irisa, UMR CNRS 6074, Rennes, France
| | - Anatole Lécuyer
- Hybrid Team, Inria, University of Rennes, Irisa, UMR CNRS 6074, Rennes, France
| |
Collapse
|
29
|
Giannopulu I, Mizutani H. Neural Kinesthetic Contribution to Motor Imagery of Body Parts: Tongue, Hands, and Feet. Front Hum Neurosci 2021; 15:602723. [PMID: 34335202 PMCID: PMC8316994 DOI: 10.3389/fnhum.2021.602723] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2020] [Accepted: 05/31/2021] [Indexed: 11/16/2022] Open
Abstract
Motor imagery (MI) is assimilated to a perception-action process, which is mentally represented. Although several models suggest that MI, and its equivalent motor execution, engage very similar brain areas, the mechanisms underlying MI and their associated components are still under investigation today. Using 22 Ag/AgCl EEG electrodes, 19 healthy participants (nine males and 10 females) with an average age of 25.8 years old (sd = 3.5 years) were required to imagine moving several parts of their body (i.e., first-person perspective) one by one: left and right hand, tongue, and feet. Network connectivity analysis based on graph theory, together with a correlational analysis, were performed on the data. The findings suggest evidence for motor and somesthetic neural synchronization and underline the role of the parietofrontal network for the tongue imagery task only. At both unilateral and bilateral cortical levels, only the tongue imagery task appears to be associated with motor and somatosensory representations, that is, kinesthetic representations, which might contribute to verbal actions. As such, the present findings suggest the idea that imagined tongue movements, involving segmentary kinesthetic actions, could be the prerequisite of language.
Collapse
Affiliation(s)
- Irini Giannopulu
- Interdisciplinary Centre for the Artificial Mind, Bond University, Gold Coast, QLD, Australia
| | | |
Collapse
|
30
|
Yokoyama H, Kaneko N, Watanabe K, Nakazawa K. Neural decoding of gait phases during motor imagery and improvement of the decoding accuracy by concurrent action observation. J Neural Eng 2021; 18. [PMID: 34082405 DOI: 10.1088/1741-2552/ac07bd] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2021] [Accepted: 06/03/2021] [Indexed: 12/20/2022]
Abstract
Objective. Brain decoding of motor imagery (MI) not only is crucial for the control of neuroprosthesis but also provides insights into the underlying neural mechanisms. Walking consists of stance and swing phases, which are associated with different biomechanical and neural control features. However, previous knowledge on decoding the MI of gait is limited to simple information (e.g. the classification of 'walking' and 'rest').Approach. Here, we investigated the feasibility of electroencephalogram (EEG) decoding of the two gait phases during the MI of walking and whether the combined use of MI and action observation (AO) would improve decoding accuracy.Main results. We demonstrated that the stance and swing phases could be decoded from EEGs during MI or AO alone. We also demonstrated the decoding accuracy during MI was improved by concurrent AO. The decoding models indicated that the improved decoding accuracy following the combined use of MI and AO was facilitated by the additional information resulting from the concurrent cortical activations related to sensorimotor, visual, and action understanding systems associated with MI and AO.Significance. This study is the first to show that decoding the stance versus swing phases during MI is feasible. The current findings provide fundamental knowledge for neuroprosthetic design and gait rehabilitation, and they expand our understanding of the neural activity underlying AO, MI, and AO + MI of walking.Novelty and significanceBrain decoding of detailed gait-related information during motor imagery (MI) is important for brain-computer interfaces (BCIs) for gait rehabilitation. This study is the first to show the feasibility of EEG decoding of the stance versus swing phases during MI. We also demonstrated that the combined use of MI and action observation (AO) improves decoding accuracy, which is facilitated by the concurrent and synergistic involvement of the cortical activations for MI and AO. These findings extend the current understanding of neural activity and the combined effects of AO and MI and provide a basis for effective techniques for walking rehabilitation.
Collapse
Affiliation(s)
- Hikaru Yokoyama
- Department of Electrical and Electronic Engineering, Tokyo University of Agriculture and Technology, Tokyo, Japan.,Japan Society for the Promotion of Science, Tokyo 102-0083, Japan.,Department of Life Sciences, Graduate School of Arts and Sciences, The University of Tokyo, Tokyo 153-8902, Japan
| | - Naotsugu Kaneko
- Japan Society for the Promotion of Science, Tokyo 102-0083, Japan.,Department of Life Sciences, Graduate School of Arts and Sciences, The University of Tokyo, Tokyo 153-8902, Japan
| | - Katsumi Watanabe
- Faculty of Science and Engineering, Waseda University, Tokyo 169-8555, Japan.,Faculty of Arts, Design, and Architecture, University of New South Wales, Sydney, NSW 2021, Australia
| | - Kimitaka Nakazawa
- Department of Life Sciences, Graduate School of Arts and Sciences, The University of Tokyo, Tokyo 153-8902, Japan
| |
Collapse
|
31
|
田 贵, 陈 俊, 丁 鹏, 龚 安, 王 帆, 罗 建, 董 煜, 赵 磊, 党 彩, 伏 云. [Execution, assessment and improvement methods of motor imagery for brain-computer interface]. SHENG WU YI XUE GONG CHENG XUE ZA ZHI = JOURNAL OF BIOMEDICAL ENGINEERING = SHENGWU YIXUE GONGCHENGXUE ZAZHI 2021; 38:434-446. [PMID: 34180188 PMCID: PMC9927765 DOI: 10.7507/1001-5515.202101037] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 01/12/2021] [Revised: 03/09/2021] [Indexed: 11/03/2022]
Abstract
Motor imagery (MI) is an important paradigm of driving brain computer interface (BCI). However, MI is not easy to control or acquire, and the performance of MI-BCI depends heavily on the performance of the subjects' MI. Therefore, the correct execution of MI mental activities, ability evaluation and improvement methods play important and even critical roles in the improvement and application of MI-BCI system's performance. However, in the research and development of MI-BCI, the existing researches mainly focus on the decoding algorithm of MI, but do not pay enough attention to the above three aspects of MI mental activities. In this paper, these problems of MI-BCI are discussed in detail, and it is pointed out that the subjects tend to use visual motor imagery as kinesthetic motor imagery. In the future, we need to develop some objective, quantitatively visualized MI ability evaluation methods, and develop some effective and less time-consumption training methods to improve MI ability. It is also necessary to solve the differences and commonness of MI problems between and within individuals and MI-BCI illiteracy to a certain extent.
Collapse
Affiliation(s)
- 贵鑫 田
- 昆明理工大学 信息工程与自动化学院(昆明 650500)School of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, P.R.China
- 昆明理工大学 脑认知与脑机智能融合创新团队(昆明 650500)Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming 650500, P.R.China
| | - 俊杰 陈
- 昆明理工大学 信息工程与自动化学院(昆明 650500)School of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, P.R.China
- 昆明理工大学 脑认知与脑机智能融合创新团队(昆明 650500)Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming 650500, P.R.China
| | - 鹏 丁
- 昆明理工大学 信息工程与自动化学院(昆明 650500)School of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, P.R.China
- 昆明理工大学 脑认知与脑机智能融合创新团队(昆明 650500)Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming 650500, P.R.China
| | - 安民 龚
- 昆明理工大学 信息工程与自动化学院(昆明 650500)School of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, P.R.China
| | - 帆 王
- 昆明理工大学 信息工程与自动化学院(昆明 650500)School of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, P.R.China
- 昆明理工大学 脑认知与脑机智能融合创新团队(昆明 650500)Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming 650500, P.R.China
| | - 建功 罗
- 昆明理工大学 信息工程与自动化学院(昆明 650500)School of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, P.R.China
- 昆明理工大学 脑认知与脑机智能融合创新团队(昆明 650500)Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming 650500, P.R.China
| | - 煜阳 董
- 昆明理工大学 信息工程与自动化学院(昆明 650500)School of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, P.R.China
- 昆明理工大学 脑认知与脑机智能融合创新团队(昆明 650500)Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming 650500, P.R.China
| | - 磊 赵
- 昆明理工大学 信息工程与自动化学院(昆明 650500)School of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, P.R.China
- 昆明理工大学 脑认知与脑机智能融合创新团队(昆明 650500)Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming 650500, P.R.China
| | - 彩萍 党
- 昆明理工大学 信息工程与自动化学院(昆明 650500)School of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, P.R.China
| | - 云发 伏
- 昆明理工大学 信息工程与自动化学院(昆明 650500)School of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, P.R.China
- 昆明理工大学 脑认知与脑机智能融合创新团队(昆明 650500)Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming 650500, P.R.China
- 武警工程大学 信息工程学院(西安 710000)College of Information Engineering, Engineering University of PAP, Xi’an 710000, P.R.China
| |
Collapse
|
32
|
Zapała D, Iwanowicz P, Francuz P, Augustynowicz P. Handedness effects on motor imagery during kinesthetic and visual-motor conditions. Sci Rep 2021; 11:13112. [PMID: 34162936 PMCID: PMC8222290 DOI: 10.1038/s41598-021-92467-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2020] [Accepted: 06/09/2021] [Indexed: 11/17/2022] Open
Abstract
Recent studies show that during a simple movement imagery task, the power of sensorimotor rhythms differs according to handedness. However, the effects of motor imagery perspectives on these differences have not been investigated yet. Our study aimed to check how handedness impacts the activity of alpha (8-13 Hz) and beta (15-30 Hz) oscillations during creating a kinesthetic (KMI) or visual-motor (VMI) representation of movement. Forty subjects (20 right-handed and 20 left-handed) who participated in the experiment were tasked with imagining sequential finger movement from a visual or kinesthetic perspective. Both the electroencephalographic (EEG) activity and behavioral correctness of the imagery task performance were measured. After the registration, we used independent component analysis (ICA) on EEG data to localize visual- and motor-related EEG sources of activity shared by both motor imagery conditions. Significant differences were obtained in the visual cortex (the occipital ICs cluster) and the right motor-related area (right parietal ICs cluster). In comparison to right-handers who, regardless of the task, demonstrated the same pattern in the visual area, left-handers obtained higher power in the alpha waves in the VMI task and better performance in this condition. On the other hand, only the right-handed showed different patterns in the alpha waves in the right motor cortex during the KMI condition. The results indicate that left-handers imagine movement differently than right-handers, focusing on visual experience. This provides new empirical evidence on the influence of movement preferences on imagery processes and has possible future implications for research in the area of neurorehabilitation and motor imagery-based brain-computer interfaces (MI-BCIs).
Collapse
Affiliation(s)
- Dariusz Zapała
- Department of Experimental Psychology, The John Paul II Catholic University of Lublin, Al. Racławickie 14, 20-950, Lublin, Poland.
| | - Paulina Iwanowicz
- Department of Experimental Psychology, The John Paul II Catholic University of Lublin, Al. Racławickie 14, 20-950, Lublin, Poland
| | - Piotr Francuz
- Department of Experimental Psychology, The John Paul II Catholic University of Lublin, Al. Racławickie 14, 20-950, Lublin, Poland
| | - Paweł Augustynowicz
- Department of Experimental Psychology, The John Paul II Catholic University of Lublin, Al. Racławickie 14, 20-950, Lublin, Poland
| |
Collapse
|
33
|
Sosnowska A, Gollee H, Vučković A. MRCP as a biomarker of motor action with varying degree of central and peripheral contribution as defined by ultrasound imaging. J Neurophysiol 2021; 126:249-263. [PMID: 33978487 DOI: 10.1152/jn.00028.2021] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Motor imagination is an alternative rehabilitation strategy for people who cannot execute real movements. However, it is still a matter of debate to which degree it involves activation of deeper muscle structures, which cannot be detected by surface electromyography (SEMG). Sixteen able-bodied participants performed cue based isometric ankle plantar flexion (active movement) followed by active relaxation under four conditions: executed movements with two levels of muscle contraction (fully executed and attempted movements, EM and AM) and motor imagination with and without detectable muscle twitches (IT and I). The most prominent peaks and distinctive phases of movement-related cortical potential (MRCP) were compared between conditions. Ultrasound imaging (USI) and SEMG were used to detect movements. IT showed spatially distinctive significant differences compared to both I and AM during active movement preparation and reafferentation phase; further widespread differences were found between IT and AM during active movement execution and posteriorly during preparation for active relaxation. EM and AM showed the largest differences frontally during active movement planning and posteriorly during execution of active relaxation. Movement preparation positivity P1 showed a significant difference in amplitude between IT and AM but not between IT and I. USI can detect subliminal movements (twitches) better than SEMG. MRCP is a biomarker sensitive to different levels of muscle contraction and relaxation. IT is a motor condition distinguishable from both I and AM. EEG biomarkers of movements could be used to identify pathological conditions, that manifest themselves during either active contraction or active relaxation.NEW & NOTEWORTHY Ultrasound imaging can detect subtle muscle movements (twitches) that are not detectable with electromyography. Almost a quarter of trials of imagined movements in able-bodied people are accompanied by twitches. Analysis of movement-related cortical potential showed that motor imagination with twitches is a condition distinguishable from motor imagination without twitches and from motor attempts.
Collapse
Affiliation(s)
- A Sosnowska
- Biomedical Engineering Research Division, School of Engineering, University of Glasgow, Glasgow, United Kingdom
| | - H Gollee
- Biomedical Engineering Research Division, School of Engineering, University of Glasgow, Glasgow, United Kingdom
| | - A Vučković
- Biomedical Engineering Research Division, School of Engineering, University of Glasgow, Glasgow, United Kingdom
| |
Collapse
|
34
|
Jacquet T, Lepers R, Poulin-Charronnat B, Bard P, Pfister P, Pageaux B. Mental fatigue induced by prolonged motor imagery increases perception of effort and the activity of motor areas. Neuropsychologia 2020; 150:107701. [PMID: 33276035 DOI: 10.1016/j.neuropsychologia.2020.107701] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2020] [Revised: 11/04/2020] [Accepted: 11/29/2020] [Indexed: 01/26/2023]
Abstract
Recent literature suggests that when prolonged, motor imagery (MI) induces mental fatigue and negatively impacts subsequent physical exercise. The aim of this study was to confirm this possibility with neurophysiological and self-reported measures. Thirteen participants performed 200 imagined isometric knee extension contractions (Prolonged MI condition) or watched a documentary (Control condition), and then performed 150 actual isometric knee extensions. Electroencephalography was continuously recorded to obtain motor-related cortical potential amplitude at Cz electrode (MRCP, index of motor area activity) for each imagined and actual contraction. Electromyography of the vastus lateralis muscle as well as the perceived effort required to perform prolonged MI, watch the documentary, and perform the actual contractions were measured. During prolonged MI, mental fatigue level, the effort required to imagine the contractions and MRCP amplitude increased over time. The increase in the effort required to imagine the contractions was significantly correlated with the MRCP amplitude. During the physical exercise, a significant condition × time interaction revealed a greater increase over time in perceived effort in the prolonged MI condition compared to the control condition, as well as a specific alteration in EMG RMS of the vastus lateralis muscle. These alterations observed in the presence of mental fatigue during actual contractions, combined with those observed during prolonged MI, suggest that prolonged MI may impair the motor command required to perform imagined or actual contractions. While the observed effect of mental fatigue on MRCP amplitude was clear during MI, future studies should tailor the physical exercise to minimize the exercise-induced decrease in force production capacity and control for its confounding effects on MRCP amplitude in the presence of mental fatigue.
Collapse
Affiliation(s)
- Thomas Jacquet
- LEAD - CNRS UMR5022, Université Bourgogne Franche-Comté, Dijon, 21000, France.
| | - Romuald Lepers
- INSERM UMR1093-CAPS, Université Bourgogne Franche-Comté, UFR des Sciences Du Sport, Dijon, F-21000, France
| | | | - Patrick Bard
- LEAD - CNRS UMR5022, Université Bourgogne Franche-Comté, Dijon, 21000, France
| | - Philippe Pfister
- LEAD - CNRS UMR5022, Université Bourgogne Franche-Comté, Dijon, 21000, France
| | - Benjamin Pageaux
- INSERM UMR1093-CAPS, Université Bourgogne Franche-Comté, UFR des Sciences Du Sport, Dijon, F-21000, France; Ecole de Kinésiologie et des Sciences de l'Activité Physique (EKSAP), Faculté de Médecine, Université de Montréal, Montréal, Québec, Canada; Centre de Recherche de L'Institut Universitaire de Gériatrie de Montréal (CRIUGM), Montréal, Québec, Canada
| |
Collapse
|
35
|
Pavlov AN, Pitsik EN, Frolov NS, Badarin A, Pavlova ON, Hramov AE. Age-Related Distinctions in EEG Signals during Execution of Motor Tasks Characterized in Terms of Long-Range Correlations. SENSORS 2020; 20:s20205843. [PMID: 33076556 PMCID: PMC7602706 DOI: 10.3390/s20205843] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/07/2020] [Revised: 09/23/2020] [Accepted: 10/12/2020] [Indexed: 12/20/2022]
Abstract
The problem of revealing age-related distinctions in multichannel electroencephalograms (EEGs) during the execution of motor tasks in young and elderly adults is addressed herein. Based on the detrended fluctuation analysis (DFA), differences in long-range correlations are considered, emphasizing changes in the scaling exponent α. Stronger responses in elderly subjects are confirmed, including the range and rate of increase in α. Unlike elderly subjects, young adults demonstrated about 2.5 times more pronounced differences between motor task responses with the dominant and non-dominant hand. Knowledge of age-related changes in brain electrical activity is important for understanding consequences of healthy aging and distinguishing them from pathological changes associated with brain diseases. Besides diagnosing age-related effects, the potential of DFA can also be used in the field of brain–computer interfaces.
Collapse
Affiliation(s)
- Alexey N. Pavlov
- Saratov State University, Astrakhanskaya Str. 83, 410012 Saratov, Russia; (A.N.P.); (O.N.P.)
| | - Elena N. Pitsik
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, Universitetskaya Str. 1, 420500 Innopolis, Russia; (E.N.P.); (N.S.F.); (A.B.)
| | - Nikita S. Frolov
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, Universitetskaya Str. 1, 420500 Innopolis, Russia; (E.N.P.); (N.S.F.); (A.B.)
| | - Artem Badarin
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, Universitetskaya Str. 1, 420500 Innopolis, Russia; (E.N.P.); (N.S.F.); (A.B.)
| | - Olga N. Pavlova
- Saratov State University, Astrakhanskaya Str. 83, 410012 Saratov, Russia; (A.N.P.); (O.N.P.)
| | - Alexander E. Hramov
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, Universitetskaya Str. 1, 420500 Innopolis, Russia; (E.N.P.); (N.S.F.); (A.B.)
- Lobachevsky University, 23 Gagarina Avenue, 603950 Nizhny Novgorod, Russia
- Saratov State Medical University, Bolshaya Kazachya Str. 112, 410012 Saratov, Russia
- Correspondence:
| |
Collapse
|
36
|
Garakh Z, Novototsky-Vlasov V, Larionova E, Zaytseva Y. Mu rhythm separation from the mix with alpha rhythm: Principal component analyses and factor topography. J Neurosci Methods 2020; 346:108892. [PMID: 32763271 DOI: 10.1016/j.jneumeth.2020.108892] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2019] [Revised: 07/29/2020] [Accepted: 08/01/2020] [Indexed: 10/23/2022]
Abstract
BACKGROUND EEG mu rhythm suppression is assessed in experiments on the execution, observation and imagination of movements. It is utilised for studying of actions, language, empathy in healthy individuals and preservation of sensorimotor system functions in patients with schizophrenia and autism spectrum disorders. While EEG alpha and mu rhythms are recorded in the same frequency range (8-13 Hz), their specification becomes a serious issue. THE NEW METHOD: is based on the spatial and functional characteristics of the mu wave, which are: (1) the mu rhythm is located over the sensorimotor cortex; (2) it desynchronises during movement processing and does not respond on the eyes opening. In EEG recordings, we analysed the mu rhythm under conditions with eyes opened and eyes closed (baseline), and during a motor imagery task with eyes closed. EEG recordings were processed by principal component analysis (PCA). RESULTS The analysis of EEG data with the proposed approach revealed the maximum spectral power of mu rhythm localised in the sensorimotor areas. During motor imagery, mu rhythm was suppressed more in frontal and central sites than in occipital sites, whereas alpha rhythm was suppressed more in parietal and occipital sites. Mu rhythm desynchronization in sensorimotor sites during motor imagery was greater than alpha rhythm desynchronization. The proposed method enabled EEG mu rhythm separation from its mix with alpha rhythm. CONCLUSIONS EEG mu rhythm separation with the proposed method satisfies its classical definition.
Collapse
Affiliation(s)
- Zhanna Garakh
- Institute of Higher Nervous Activity and Neurophysiology of Russian Academy of Science, Moscow, Russian Federation
| | - Vladimir Novototsky-Vlasov
- Institute of Higher Nervous Activity and Neurophysiology of Russian Academy of Science, Moscow, Russian Federation; Serbsky National Medical Research Centre for Psychiatry and Narcology, Moscow, Russian Federation
| | - Ekaterina Larionova
- Institute of Higher Nervous Activity and Neurophysiology of Russian Academy of Science, Moscow, Russian Federation
| | - Yuliya Zaytseva
- National Institute of Mental Health, Klecany, Czech Republic; Department of Psychiatry and Medical Psychology, 3rd Faculty of Medicine, Charles University in Prague, Prague, Czech Republic; Human Science Centre, Institute of Medical Psychology, Ludwig-Maximilian University, Munich, Germany.
| |
Collapse
|
37
|
Hramov AE, Grubov V, Badarin A, Maksimenko VA, Pisarchik AN. Functional Near-Infrared Spectroscopy for the Classification of Motor-Related Brain Activity on the Sensor-Level. SENSORS 2020; 20:s20082362. [PMID: 32326270 PMCID: PMC7219246 DOI: 10.3390/s20082362] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/12/2020] [Revised: 04/18/2020] [Accepted: 04/20/2020] [Indexed: 11/21/2022]
Abstract
Sensor-level human brain activity is studied during real and imaginary motor execution using functional near-infrared spectroscopy (fNIRS). Blood oxygenation and deoxygenation spatial dynamics exhibit pronounced hemispheric lateralization when performing motor tasks with the left and right hands. This fact allowed us to reveal biomarkers of hemodynamical response of the motor cortex on the motor execution, and use them for designing a sensing method for classification of the type of movement. The recognition accuracy of real movements is close to 100%, while the classification accuracy of imaginary movements is lower but quite high (at the level of 90%). The advantage of the proposed method is its ability to classify real and imaginary movements with sufficiently high efficiency without the need for recalculating parameters. The proposed system can serve as a sensor of motor activity to be used for neurorehabilitation after severe brain injuries, including traumas and strokes.
Collapse
Affiliation(s)
- Alexander E. Hramov
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, Universitetskaja Str., 1, 420500 Innopolis, Russia; (V.G.); (A.B.); (V.A.M.); (A.N.P.)
- Saratov State Medical University, Bolshaya Kazachya Str., 112, 410012 Saratov, Russia
- Correspondence: ; Tel.: +7-927-123-3294
| | - Vadim Grubov
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, Universitetskaja Str., 1, 420500 Innopolis, Russia; (V.G.); (A.B.); (V.A.M.); (A.N.P.)
| | - Artem Badarin
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, Universitetskaja Str., 1, 420500 Innopolis, Russia; (V.G.); (A.B.); (V.A.M.); (A.N.P.)
| | - Vladimir A. Maksimenko
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, Universitetskaja Str., 1, 420500 Innopolis, Russia; (V.G.); (A.B.); (V.A.M.); (A.N.P.)
| | - Alexander N. Pisarchik
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, Universitetskaja Str., 1, 420500 Innopolis, Russia; (V.G.); (A.B.); (V.A.M.); (A.N.P.)
- Center for Biomedical Technology, Technical University of Madrid, Campus Montegancedo, Pozuelo de Alarcón, 28223 Madrid, Spain
| |
Collapse
|
38
|
Pitsik E, Frolov N, Hauke Kraemer K, Grubov V, Maksimenko V, Kurths J, Hramov A. Motor execution reduces EEG signals complexity: Recurrence quantification analysis study. CHAOS (WOODBURY, N.Y.) 2020; 30:023111. [PMID: 32113225 DOI: 10.1063/1.5136246] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/12/2019] [Accepted: 12/27/2019] [Indexed: 05/20/2023]
Abstract
The development of new approaches to detect motor-related brain activity is key in many aspects of science, especially in brain-computer interface applications. Even though some well-known features of motor-related electroencephalograms have been revealed using traditionally applied methods, they still lack a robust classification of motor-related patterns. Here, we introduce new features of motor-related brain activity and uncover hidden mechanisms of the underlying neuronal dynamics by considering event-related desynchronization (ERD) of μ-rhythm in the sensorimotor cortex, i.e., tracking the decrease of the power spectral density in the corresponding frequency band. We hypothesize that motor-related ERD is associated with the suppression of random fluctuations of μ-band neuronal activity. This is due to the lowering of the number of active neuronal populations involved in the corresponding oscillation mode. In this case, we expect more regular dynamics and a decrease in complexity of the EEG signal recorded over the sensorimotor cortex. In order to support this, we apply measures of signal complexity by means of recurrence quantification analysis (RQA). In particular, we demonstrate that certain RQA quantifiers are very useful to detect the moment of movement onset and, therefore, are able to classify the laterality of executed movements.
Collapse
Affiliation(s)
- Elena Pitsik
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, 420500 Innopolis, The Republic of Tatarstan, Russia
| | - Nikita Frolov
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, 420500 Innopolis, The Republic of Tatarstan, Russia
| | - K Hauke Kraemer
- Potsdam Institute for Climate Impact Research, 14473 Potsdam, Germany
| | - Vadim Grubov
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, 420500 Innopolis, The Republic of Tatarstan, Russia
| | - Vladimir Maksimenko
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, 420500 Innopolis, The Republic of Tatarstan, Russia
| | - Jürgen Kurths
- Potsdam Institute for Climate Impact Research, 14473 Potsdam, Germany
| | - Alexander Hramov
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, 420500 Innopolis, The Republic of Tatarstan, Russia
| |
Collapse
|
39
|
Bushkova Y, Ivanova G, Stakhovskaya L, Frolov A. Brain-computer-interface technology with multisensory feedback for controlled ideomotor training in the rehabilitation of stroke patients. BULLETIN OF RUSSIAN STATE MEDICAL UNIVERSITY 2019. [DOI: 10.24075/brsmu.2019.078] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
Abstract
Motor recovery of the upper limb is a priority in the neurorehabilitation of stroke patients. Advances in the brain-computer interface (BCI) technology have significantly improved the quality of rehabilitation. The aim of this study was to explore the factors affecting the recovery of the upper limb in stroke patients undergoing BCI-based rehabilitation with the robotic hand. The study recruited 24 patients (14 men and 10 women) aged 51 to 62 years with a solitary supratentorial stroke lesion. The lesion was left-hemispheric in 11 (45.6%) patients and right-hemispheric in 13 (54.4%) patients. Time elapsed from stroke was 4.0 months (3.0; 12.0). The median MoCa score was 25.0 (23.0; 27.0). The rehabilitation course consisted of 9.5 sessions (8.0; 10.0). We established a significant moderate correlation between motor imagery performance (the MIQ-RS score) and the efficacy of patient-BCI interaction. Patients with high MIQ-RS scores (47.5 (32.0; 54.0) achieved a better control of the BCI-driven hand exoskeleton (63.0 (54.0; 67.0), R = 0.67; p < 0.05). Recovery dynamics were more pronounced in patients with high MIQ-RS scores: the median score on the Fugl-Meyer Assessment scale was 14 (8.0; 16.0) points vs 10 (6.0; 13.0) points in patients with low MIQ-RS scores. However, the difference was not significant. Thus, we established a correlation between a patient’s ability for motor imagery (MIQ-RS) and the efficacy of patient-BCI interaction. A larger patient sample might be necessary to assess the effect of these factors on motor recovery dynamics.
Collapse
Affiliation(s)
- Yu.V. Bushkova
- Research Center of Cerebrovascular Pathology and Stroke, Ministry of Health of the Russian Federation, Moscow, Russia
| | - G.E. Ivanova
- Research Center of Cerebrovascular Pathology and Stroke, Ministry of Health of the Russian Federation, Moscow, Russia
| | - L.V. Stakhovskaya
- Pirogov Russian National Research Medical University, Moscow, Russia
| | - A.A. Frolov
- Institute of Higher Nervous Activity and Neurophysiology, Russian Academy of Sciences, Moscow, Russia
| |
Collapse
|
40
|
Hramov AE, Maksimenko V, Koronovskii A, Runnova AE, Zhuravlev M, Pisarchik AN, Kurths J. Percept-related EEG classification using machine learning approach and features of functional brain connectivity. CHAOS (WOODBURY, N.Y.) 2019; 29:093110. [PMID: 31575147 DOI: 10.1063/1.5113844] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/08/2019] [Accepted: 08/08/2019] [Indexed: 06/10/2023]
Abstract
Machine learning is a promising approach for electroencephalographic (EEG) trials classification. Its efficiency is largely determined by the feature extraction and selection techniques reducing the dimensionality of input data. Dimensionality reduction is usually implemented via the mathematical approaches (e.g., principal component analysis, linear discriminant analysis, etc.) regardless of the origin of analyzed data. We hypothesize that since EEG features are determined by certain neurophysiological processes, they should have distinctive characteristics in spatiotemporal domain. If so, it is possible to specify the set of EEG principal features based on the prior knowledge about underlying neurophysiological processes. To test this hypothesis, we consider the classification of EEG trials related to the perception of ambiguous visual stimuli. We observe that EEG features, underlying the different ambiguous stimuli interpretations, are defined by the network properties of neuronal activity. Having analyzed functional neural interactions, we specify the brain area in which neural network architecture exhibits differences for different classes of EEG trials. We optimize the feedforward multilayer perceptron and develop a strategy for the training set selection to maximize the classification accuracy, being 85% when all channels are used. The revealed localization of the percept-related features allows about 95% accuracy, when the number of channels is reduced up to 90%. Obtained results can be used for classification of EEG trials associated with more complex cognitive tasks. Taking into account that cognitive activity is subserved by a distributed functional cortical network, its topological properties have to be considered when selecting optimal features for EEG trial classification.
Collapse
Affiliation(s)
- Alexander E Hramov
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, 420500 Innopolis, The Republic of Tatarstan, Russia
| | - Vladimir Maksimenko
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, 420500 Innopolis, The Republic of Tatarstan, Russia
| | - Alexey Koronovskii
- Faculty of Nonlinear Processes, Saratov State University, 410012 Saratov, Russia
| | - Anastasiya E Runnova
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, 420500 Innopolis, The Republic of Tatarstan, Russia
| | - Maxim Zhuravlev
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, 420500 Innopolis, The Republic of Tatarstan, Russia
| | - Alexander N Pisarchik
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, 420500 Innopolis, The Republic of Tatarstan, Russia
| | - Jürgen Kurths
- Potsdam Institute for Climate Impact Research, 14473 Potsdam, Germany
| |
Collapse
|