1
|
Novičić M, Djordjević O, Miler-Jerković V, Konstantinović L, Savić AM. Improving the Performance of Electrotactile Brain-Computer Interface Using Machine Learning Methods on Multi-Channel Features of Somatosensory Event-Related Potentials. SENSORS (BASEL, SWITZERLAND) 2024; 24:8048. [PMID: 39771785 PMCID: PMC11679428 DOI: 10.3390/s24248048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/25/2024] [Revised: 12/10/2024] [Accepted: 12/14/2024] [Indexed: 01/11/2025]
Abstract
Traditional tactile brain-computer interfaces (BCIs), particularly those based on steady-state somatosensory-evoked potentials, face challenges such as lower accuracy, reduced bit rates, and the need for spatially distant stimulation points. In contrast, using transient electrical stimuli offers a promising alternative for generating tactile BCI control signals: somatosensory event-related potentials (sERPs). This study aimed to optimize the performance of a novel electrotactile BCI by employing advanced feature extraction and machine learning techniques on sERP signals for the classification of users' selective tactile attention. The experimental protocol involved ten healthy subjects performing a tactile attention task, with EEG signals recorded from five EEG channels over the sensory-motor cortex. We employed sequential forward selection (SFS) of features from temporal sERP waveforms of all EEG channels. We systematically tested classification performance using machine learning algorithms, including logistic regression, k-nearest neighbors, support vector machines, random forests, and artificial neural networks. We explored the effects of the number of stimuli required to obtain sERP features for classification and their influence on accuracy and information transfer rate. Our approach indicated significant improvements in classification accuracy compared to previous studies. We demonstrated that the number of stimuli for sERP generation can be reduced while increasing the information transfer rate without a statistically significant decrease in classification accuracy. In the case of the support vector machine classifier, we achieved a mean accuracy over 90% for 10 electrical stimuli, while for 6 stimuli, the accuracy decreased by less than 7%, and the information transfer rate increased by 60%. This research advances methods for tactile BCI control based on event-related potentials. This work is significant since tactile stimulation is an understudied modality for BCI control, and electrically induced sERPs are the least studied control signals in reactive BCIs. Exploring and optimizing the parameters of sERP elicitation, as well as feature extraction and classification methods, is crucial for addressing the accuracy versus speed trade-off in various assistive BCI applications where the tactile modality may have added value.
Collapse
Affiliation(s)
- Marija Novičić
- School of Electrical Engineering, University of Belgrade, 11000 Belgrade, Serbia
| | - Olivera Djordjević
- Faculty of Medicine, University of Belgrade, 11000 Belgrade, Serbia
- Clinic for Rehabilitation “Dr. Miroslav Zotović”, 11000 Belgrade, Serbia
| | - Vera Miler-Jerković
- Innovation Center of the School of Electrical Engineering, University of Belgrade, 11000 Belgrade, Serbia
| | - Ljubica Konstantinović
- Faculty of Medicine, University of Belgrade, 11000 Belgrade, Serbia
- Clinic for Rehabilitation “Dr. Miroslav Zotović”, 11000 Belgrade, Serbia
| | - Andrej M. Savić
- School of Electrical Engineering, University of Belgrade, 11000 Belgrade, Serbia
| |
Collapse
|
2
|
Morozova M, Yakovlev L, Syrov N, Lebedev M, Kaplan A. Tactile imagery affects cortical responses to vibrotactile stimulation of the fingertip. Heliyon 2024; 10:e40807. [PMID: 39698084 PMCID: PMC11652922 DOI: 10.1016/j.heliyon.2024.e40807] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2024] [Revised: 11/22/2024] [Accepted: 11/27/2024] [Indexed: 12/20/2024] Open
Abstract
Mental imagery is a crucial cognitive process, yet its underlying neural mechanisms remain less understood compared to perception. Furthermore, within the realm of mental imagery, the somatosensory domain is particularly underexplored compared to other sensory modalities. This study aims to investigate the influence of tactile imagery (TI) on cortical somatosensory processing. We explored the cortical manifestations of TI by recording EEG activity in healthy human subjects. We investigated event-related somatosensory oscillatory dynamics during TI compared to actual tactile stimulation, as well as somatosensory evoked potentials (SEPs) in response to short vibrational stimuli, examining their amplitude-temporal characteristics and spatial distribution across the scalp. EEG activity exhibited significant changes during TI compared to the no-imagery baseline. TI caused event-related desynchronization (ERD) of the contralateral μ-rhythm, with a notable correlation between ERD during imagery and real stimulation across subjects. TI also modulated several SEP components in sensorimotor and frontal areas, showing increases in the contralateral P100 and P300, contra- and ipsilateral P300, frontal P200, and parietal P600 components. The results clearly indicate that TI affects cortical processing of somatosensory stimuli, impacting EEG responses in various cortical areas. The assessment of SEPs in EEG could serve as a versatile marker of tactile imagery in practical applications. We propose incorporating TI in imagery-based brain-computer interfaces (BCIs) to enhance sensorimotor restoration and sensory substitution. This approach underscores the importance of somatosensory mental imagery in cognitive neuroscience and its potential applications in neurorehabilitation and assistive technologies.
Collapse
Affiliation(s)
- Marina Morozova
- Vladimir Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, 121205, Moscow, Russia
| | - Lev Yakovlev
- Vladimir Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, 121205, Moscow, Russia
- Faculty of Biology, Shenzhen MSU-BIT University, 518115, Shenzhen, China
| | - Nikolay Syrov
- Vladimir Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, 121205, Moscow, Russia
| | - Mikhail Lebedev
- Faculty of Mechanics and Mathematics, Lomonosov Moscow State University, 119991, Moscow, Russia
- Sechenov Institute of Evolutionary Physiology and Biochemistry of the Russian Academy of Sciences, 194223, Saint Petersburg, Russia
| | - Alexander Kaplan
- Vladimir Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, 121205, Moscow, Russia
- Department of Human and Animal Physiology, Faculty of Biology, Lomonosov Moscow State University, 119234, Moscow, Russia
| |
Collapse
|
3
|
Borirakarawin M, Siribunyaphat N, Aung ST, Punsawad Y. The Development of a Multicommand Tactile Event-Related Potential-Based Brain-Computer Interface Utilizing a Low-Cost Wearable Vibrotactile Stimulator. SENSORS (BASEL, SWITZERLAND) 2024; 24:6378. [PMID: 39409418 PMCID: PMC11479116 DOI: 10.3390/s24196378] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/31/2024] [Revised: 09/26/2024] [Accepted: 09/30/2024] [Indexed: 10/20/2024]
Abstract
A tactile event-related potential (ERP)-based brain-computer interface (BCI) system is an alternative for enhancing the control and communication abilities of quadriplegic patients with visual or auditory impairments. Hence, in this study, we proposed a tactile stimulus pattern using a vibrotactile stimulator for a multicommand BCI system. Additionally, we observed a tactile ERP response to the target from random vibrotactile stimuli placed in the left and right wrist and elbow positions to create commands. An experiment was conducted to explore the location of the proposed vibrotactile stimulus and to verify the multicommand tactile ERP-based BCI system. Using the proposed features and conventional classification methods, we examined the classification efficiency of the four commands created from the selected EEG channels. The results show that the proposed vibrotactile stimulation with 15 stimulus trials produced a prominent ERP response in the Pz channels. The average classification accuracy ranged from 61.9% to 79.8% over 15 stimulus trials, requiring 36 s per command in offline processing. The P300 response in the parietal area yielded the highest average classification accuracy. The proposed method can guide the development of a brain-computer interface system for physically disabled people with visual or auditory impairments to control assistive and rehabilitative devices.
Collapse
Affiliation(s)
- Manorot Borirakarawin
- Faculty of Science and Technology, Nakhon Si Thammarat Rajabhat University, Nakhon Si Thammarat 80280, Thailand;
| | | | - Si Thu Aung
- Department of Mathematics, University at Buffalo, State University of New York, Buffalo, NY 14260-2900, USA;
| | - Yunyong Punsawad
- School of Informatics, Walailak University, Nakhon Si Thammarat 80160, Thailand;
- Informatics Innovative Center of Excellence, Walailak University, Nakhon Si Thammarat 80160, Thailand
| |
Collapse
|
4
|
Savić AM, Novičić M, Miler-Jerković V, Djordjević O, Konstantinović L. Electrotactile BCI for Top-Down Somatosensory Training: Clinical Feasibility Trial of Online BCI Control in Subacute Stroke Patients. BIOSENSORS 2024; 14:368. [PMID: 39194597 DOI: 10.3390/bios14080368] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/14/2024] [Revised: 07/20/2024] [Accepted: 07/23/2024] [Indexed: 08/29/2024]
Abstract
This study investigates the feasibility of a novel brain-computer interface (BCI) device designed for sensory training following stroke. The BCI system administers electrotactile stimuli to the user's forearm, mirroring classical sensory training interventions. Concurrently, selective attention tasks are employed to modulate electrophysiological brain responses (somatosensory event-related potentials-sERPs), reflecting cortical excitability in related sensorimotor areas. The BCI identifies attention-induced changes in the brain's reactions to stimulation in an online manner. The study protocol assesses the feasibility of online binary classification of selective attention focus in ten subacute stroke patients. Each experimental session includes a BCI training phase for data collection and classifier training, followed by a BCI test phase to evaluate online classification of selective tactile attention based on sERP. During online classification tests, patients complete 20 repetitions of selective attention tasks with feedback on attention focus recognition. Using a single electroencephalographic channel, attention classification accuracy ranges from 70% to 100% across all patients. The significance of this novel BCI paradigm lies in its ability to quantitatively measure selective tactile attention resources throughout the therapy session, introducing a top-down approach to classical sensory training interventions based on repeated neuromuscular electrical stimulation.
Collapse
Affiliation(s)
- Andrej M Savić
- University of Belgrade - School of Electrical Engineering, 11000 Belgrade, Serbia
| | - Marija Novičić
- University of Belgrade - School of Electrical Engineering, 11000 Belgrade, Serbia
| | - Vera Miler-Jerković
- Innovation Center of the School of Electrical Engineering, University of Belgrade, 11000 Belgrade, Serbia
| | - Olivera Djordjević
- University of Belgrade - Faculty of Medicine, 11000 Belgrade, Serbia
- Clinic for Rehabilitation "Dr Miroslav Zotović", 11000 Belgrade, Serbia
| | - Ljubica Konstantinović
- University of Belgrade - Faculty of Medicine, 11000 Belgrade, Serbia
- Clinic for Rehabilitation "Dr Miroslav Zotović", 11000 Belgrade, Serbia
| |
Collapse
|
5
|
Yang J, Ren R, Yu Y, Wang W, Tang X, Ejima Y, Wu J. Event-related potential evidence for tactile orientation processing in the human brain. Exp Brain Res 2024:10.1007/s00221-024-06783-1. [PMID: 38400993 DOI: 10.1007/s00221-024-06783-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Accepted: 01/15/2024] [Indexed: 02/26/2024]
Abstract
It is well known that information on stimulus orientation plays an important role in sensory processing. However, the neural mechanisms underlying somatosensory orientation perception are poorly understood. Adaptation has been widely used as a tool for examining sensitivity to specific features of sensory stimuli. Using the adaptation paradigm, we measured event-related potentials (ERPs) in response to tactile orientation stimuli presented pseudo-randomly to the right-hand palm in trials with all the same or different orientations. Twenty participants were asked to count the tactile orientation stimuli. The results showed that the adaptation-related N60 component was observed around contralateral central-parietal areas, possibly indicating orientation processing in the somatosensory regions. Conversely, the adaptation-related N120 component was identified bilaterally across hemispheres, suggesting the involvement of the frontoparietal circuitry in further tactile orientation processing. P300 component was found across the whole brain in all conditions and was associated with task demands, such as attention and stimulus counting. These findings help provide an understanding of the mechanisms of tactile orientation processing in the human brain.
Collapse
Affiliation(s)
- Jiajia Yang
- Graduate School of Interdisciplinary Science and Engineering in Health Systems,, Okayama University, 3-1-1 Tsushima-Naka, Kita-ku, Okayama, 700-8530, Japan.
| | - Rongxia Ren
- Graduate School of Interdisciplinary Science and Engineering in Health Systems,, Okayama University, 3-1-1 Tsushima-Naka, Kita-ku, Okayama, 700-8530, Japan
| | - Yinghua Yu
- Graduate School of Interdisciplinary Science and Engineering in Health Systems,, Okayama University, 3-1-1 Tsushima-Naka, Kita-ku, Okayama, 700-8530, Japan
| | - Wu Wang
- Multisensory Laboratory, School of Psychological and Cognitive Sciences, Peking University, Beijing, 100871, China
| | - Xiaoyu Tang
- School of Psychology, Liaoning Collaborative Innovation Center of Children and Adolescents Healthy Personality Assessment and Cultivation, Liaoning Normal University, Dalian, 116029, China
| | - Yoshimichi Ejima
- Graduate School of Interdisciplinary Science and Engineering in Health Systems,, Okayama University, 3-1-1 Tsushima-Naka, Kita-ku, Okayama, 700-8530, Japan
| | - Jinglong Wu
- Graduate School of Interdisciplinary Science and Engineering in Health Systems,, Okayama University, 3-1-1 Tsushima-Naka, Kita-ku, Okayama, 700-8530, Japan
| |
Collapse
|
6
|
Kida T, Kaneda T, Nishihira Y. ERP evidence of attentional somatosensory processing and stimulus-response coupling under different hand and arm postures. Front Hum Neurosci 2023; 17:1252686. [PMID: 38021238 PMCID: PMC10676239 DOI: 10.3389/fnhum.2023.1252686] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Accepted: 10/16/2023] [Indexed: 12/01/2023] Open
Abstract
We investigated (1) the effects of divided and focused attention on event-related brain potentials (ERPs) elicited by somatosensory stimulation under different response modes, (2) the effects of hand position (closely-placed vs. separated hands) and arm posture (crossed vs. uncrossed forearms) on the attentional modulation of somatosensory ERPs, and (3) changes in the coupling of stimulus- and response-related processes by somatosensory attention using a single-trial analysis of P300 latency and reaction times. Electrocutaneous stimulation was presented randomly to the thumb or middle finger of the left or right hand at random interstimulus intervals (700-900 ms). Subjects attended unilaterally or bilaterally to stimuli in order to detect target stimuli by a motor response or counting. The effects of unilaterally-focused attention were also tested under different hand and arm positions. The amplitude of N140 in the divided attention condition was intermediate between unilaterally attended and unattended stimuli in the unilaterally-focused attention condition in both the mental counting and motor response tasks. Attended infrequent (target) stimuli elicited greater P300 in the unilaterally attention condition than in the divided attention condition. P300 latency was longer in the divided attention condition than in the unilaterally-focused attention condition in the motor response task, but remained unchanged in the counting task. Closely locating the hands had no impact, whereas crossing the forearms decreased the attentional enhancement in N140 amplitude. In contrast, these two manipulations uniformly decreased P300 amplitude and increased P300 latency. The correlation between single-trial P300 latency and RT was decreased by crossed forearms, but not by divided attention or closely-placed hands. Therefore, the present results indicate that focused and divided attention differently affected middle latency and late processing, and that hand position and arm posture also differently affected attentional processes and stimulus-response coupling.
Collapse
Affiliation(s)
- Tetsuo Kida
- Higher Brain Function Unit, Department of Functioning and Disability, Institute for Developmental Research, Aichi Developmental Disability Center, Kasugai, Japan
| | | | - Yoshiaki Nishihira
- Graduate School of Comprehensive Human Sciences, University of Tsukuba, Tsukuba, Japan
| |
Collapse
|