1
|
Wan X, Sun Y, Yao Y, Wan Hasan WZ, Wen D. Spatial Cognitive EEG Feature Extraction and Classification Based on MSSECNN and PCMI. Bioengineering (Basel) 2024; 12:25. [PMID: 39851299 PMCID: PMC11762818 DOI: 10.3390/bioengineering12010025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2024] [Revised: 12/21/2024] [Accepted: 12/26/2024] [Indexed: 01/26/2025] Open
Abstract
With the aging population rising, the decline in spatial cognitive ability has become a critical issue affecting the quality of life among the elderly. Electroencephalogram (EEG) signal analysis presents substantial potential in spatial cognitive assessments. However, conventional methods struggle to effectively classify spatial cognitive states, particularly in tasks requiring multi-class discrimination of pre- and post-training cognitive states. This study proposes a novel approach for EEG signal classification, utilizing Permutation Conditional Mutual Information (PCMI) for feature extraction and a Multi-Scale Squeezed Excitation Convolutional Neural Network (MSSECNN) model for classification. Specifically, the MSSECNN classifies spatial cognitive states into two classes-before and after cognitive training-based on EEG features. First, the PCMI extracts nonlinear spatial features, generating spatial feature matrices across different channels. SENet then adaptively weights these features, highlighting key channels. Finally, the MSCNN model captures local and global features using convolution kernels of varying sizes, enhancing classification accuracy and robustness. This study systematically validates the model using cognitive training data from a brain-controlled car and manually operated UAV tasks, with cognitive state assessments performed through spatial cognition games combined with EEG signals. The experimental findings demonstrate that the proposed model significantly outperforms traditional methods, offering superior classification accuracy, robustness, and feature extraction capabilities. The MSSECNN model's advantages in spatial cognitive state classification provide valuable technical support for early identification and intervention in cognitive decline.
Collapse
Affiliation(s)
- Xianglong Wan
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing 100083, China
- Key Laboratory of Perception and Control of Intelligent Bionic Unmanned Systems, Ministry of Education, Institute of Artificial Intelligence, University of Science and Technology Beijing, Beijing 100083, China
| | - Yue Sun
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing 100083, China
| | - Yiduo Yao
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing 100083, China
- Department of Electrical and Electronic Engineering, Faculty of Engineering, Universiti Putra Malaysia, Serdang 43400, Malaysia
| | - Wan Zuha Wan Hasan
- Department of Electrical and Electronic Engineering, Faculty of Engineering, Universiti Putra Malaysia, Serdang 43400, Malaysia
| | - Dong Wen
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing 100083, China
- Key Laboratory of Perception and Control of Intelligent Bionic Unmanned Systems, Ministry of Education, Institute of Artificial Intelligence, University of Science and Technology Beijing, Beijing 100083, China
| |
Collapse
|
2
|
Giorgi A, Borghini G, Colaiuda F, Menicocci S, Ronca V, Vozzi A, Rossi D, Aricò P, Capotorto R, Sportiello S, Petrelli M, Polidori C, Varga R, Van Gasteren M, Babiloni F, Di Flumeri G. Driving Fatigue Onset and Visual Attention: An Electroencephalography-Driven Analysis of Ocular Behavior in a Driving Simulation Task. Behav Sci (Basel) 2024; 14:1090. [PMID: 39594390 PMCID: PMC11590971 DOI: 10.3390/bs14111090] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2024] [Revised: 11/04/2024] [Accepted: 11/07/2024] [Indexed: 11/28/2024] Open
Abstract
Attentional deficits have tragic consequences on road safety. These deficits are not solely caused by distraction, since they can also arise from other mental impairments such as, most frequently, mental fatigue. Fatigue is among the most prevalent impairing conditions while driving, degrading drivers' cognitive and physical abilities. This issue is particularly relevant for professional drivers, who spend most of their time behind the wheel. While scientific literature already documented the behavioral effects of driving fatigue, most studies have focused on drivers under sleep deprivation or anyhow at severe fatigue degrees, since it is difficult to recognize the onset of fatigue. The present study employed an EEG-driven approach to detect early signs of fatigue in professional drivers during a simulated task, with the aim of studying visual attention as fatigue begins to set in. Short-range and long-range professional drivers were recruited to take part in a 45-min-long simulated driving experiment. Questionnaires were used to validate the experimental protocol. A previously validated EEG index, the MDrow, was adopted as the benchmark measure for identifying the "fatigued" spans. Results of the eye-tracking analysis showed that, when fatigued, professional drivers tended to focus on non-informative portions of the driving environment. This paper presents evidence that an EEG-driven approach can be used to detect the onset of fatigue while driving and to study the related visual attention patterns. It was found that the onset of fatigue did not differentially impact drivers depending on their professional activity (short- vs. long-range delivery).
Collapse
Affiliation(s)
- Andrea Giorgi
- Department of Anatomical, Histological, Forensic and Orthopedic Sciences, Sapienza University of Rome, 00185 Roma, Italy;
| | - Gianluca Borghini
- Department of Molecular Medicine, Faculty of Pharmacy and Medicine, Sapienza University of Rome, 00185 Roma, Italy; (G.B.); (D.R.)
| | - Francesca Colaiuda
- Department of Physiology and Pharmacology, Faculty of Pharmacy and Medicine, Sapienza University of Rome, 00185 Roma, Italy; (F.C.); (S.M.); (F.B.)
| | - Stefano Menicocci
- Department of Physiology and Pharmacology, Faculty of Pharmacy and Medicine, Sapienza University of Rome, 00185 Roma, Italy; (F.C.); (S.M.); (F.B.)
| | - Vincenzo Ronca
- Department of Computer, Automatic and Management Engineering, Faculty of Information Engineering, Computer Science and Statistics, Sapienza University of Rome, 00185 Roma, Italy; (V.R.); (P.A.)
| | | | - Dario Rossi
- Department of Molecular Medicine, Faculty of Pharmacy and Medicine, Sapienza University of Rome, 00185 Roma, Italy; (G.B.); (D.R.)
| | - Pietro Aricò
- Department of Computer, Automatic and Management Engineering, Faculty of Information Engineering, Computer Science and Statistics, Sapienza University of Rome, 00185 Roma, Italy; (V.R.); (P.A.)
| | - Rossella Capotorto
- Department of Anatomical, Histological, Forensic and Orthopedic Sciences, Sapienza University of Rome, 00185 Roma, Italy;
| | - Simone Sportiello
- Department of Civil Engineering, Computer Science and Aeronautical Technologies, Roma Tre University, 00154 Roma, Italy; (S.S.); (M.P.)
- Department of Enterprise Engineering, University of Rome Tor Vergata, 00133 Rome, Italy
| | - Marco Petrelli
- Department of Civil Engineering, Computer Science and Aeronautical Technologies, Roma Tre University, 00154 Roma, Italy; (S.S.); (M.P.)
| | - Carlo Polidori
- Italian Association of Road Safety Professionals (AIPSS), 00186 Rome, Italy;
| | - Rodrigo Varga
- Instituto Tecnologico de Castilla y Leon, 09001 Burgos, Spain; (R.V.); (M.V.G.)
| | | | - Fabio Babiloni
- Department of Physiology and Pharmacology, Faculty of Pharmacy and Medicine, Sapienza University of Rome, 00185 Roma, Italy; (F.C.); (S.M.); (F.B.)
| | - Gianluca Di Flumeri
- Department of Molecular Medicine, Faculty of Pharmacy and Medicine, Sapienza University of Rome, 00185 Roma, Italy; (G.B.); (D.R.)
| |
Collapse
|
3
|
Jin J, Kim K, Lee K, Seo JW, Kim JU. Association Between Cognitive Function and the Autonomic Nervous System by Photoplethysmography. Bioengineering (Basel) 2024; 11:1099. [PMID: 39593763 PMCID: PMC11591508 DOI: 10.3390/bioengineering11111099] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2024] [Revised: 10/29/2024] [Accepted: 10/31/2024] [Indexed: 11/28/2024] Open
Abstract
This study explored the relationship between cognitive function and the autonomic nervous system by categorizing participants into two groups based on their cognitive function scores in each domain of the SNSB-D: a High Cognitive Performance (HCP) group and a Low Cognitive Performance (LCP) group. We analyzed the Pulse Rate Variability (PRV) parameters for each group. Photoplethysmography (PPG) data were collected and processed to remove noise, and the PRV parameters in the time and frequency domains were extracted. To minimize the impact of age and years of education on the PRV parameters, we performed an adjusted analysis using a Generalized Linear Model (GLM). The analysis revealed that the autonomic nervous system, particularly the parasympathetic nervous system, was more activated in the LCP group compared to the HCP group. This finding suggests that in individuals with low cognitive function, the sympathetic nerves in the autonomic nervous system are less activated, so the parasympathetic nerves are relatively more activated. This study investigated the correlation between cognitive function and PRV parameters, highlighting the potential use of these parameters as indicators for the early diagnosis and classification of cognitive decline.
Collapse
Affiliation(s)
- Jaewook Jin
- Digital Health Research Division, Korea Institute of Oriental Medicine, Daejeon 34504, Republic of Korea; (J.J.); (K.K.)
- Korean Convergence Medical Science, University of Science and Technology, Daejeon 34113, Republic of Korea
| | - Kahye Kim
- Digital Health Research Division, Korea Institute of Oriental Medicine, Daejeon 34504, Republic of Korea; (J.J.); (K.K.)
| | - KunHo Lee
- Gwangju Alzheimer’s Disease and Related Dementias (GARD) Cohort Research Center, Chosun University, Gwangju 61452, Republic of Korea;
- Department of Biomedical Science, Chosun University, Gwangju 61452, Republic of Korea
- Dementia Research Group, Korea Brain Research Institute, Daegu 41062, Republic of Korea
| | - Jeong-Woo Seo
- Digital Health Research Division, Korea Institute of Oriental Medicine, Daejeon 34504, Republic of Korea; (J.J.); (K.K.)
| | - Jaeuk U. Kim
- Digital Health Research Division, Korea Institute of Oriental Medicine, Daejeon 34504, Republic of Korea; (J.J.); (K.K.)
- Korean Convergence Medical Science, University of Science and Technology, Daejeon 34113, Republic of Korea
| |
Collapse
|
4
|
K N V, Gupta CN. Systematic review of experimental paradigms and deep neural networks for electroencephalography-based cognitive workload detection. PROGRESS IN BIOMEDICAL ENGINEERING (BRISTOL, ENGLAND) 2024; 6:042004. [PMID: 39655862 DOI: 10.1088/2516-1091/ad8530] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/21/2024] [Accepted: 10/09/2024] [Indexed: 12/18/2024]
Abstract
This article summarizes a systematic literature review of deep neural network-based cognitive workload (CWL) estimation from electroencephalographic (EEG) signals. The focus of this article can be delineated into two main elements: first is the identification of experimental paradigms prevalently employed for CWL induction, and second, is an inquiry about the data structure and input formulations commonly utilized in deep neural networks (DNN)-based CWL detection. The survey revealed several experimental paradigms that can reliably induce either graded levels of CWL or a desired cognitive state due to sustained induction of CWL. This article has characterized them with respect to the number of distinct CWL levels, cognitive states, experimental environment, and agents in focus. Further, this literature analysis found that DNNs can successfully detect distinct levels of CWL despite the inter-subject and inter-session variability typically observed in EEG signals. Several methodologies were found using EEG signals in its native representation of a two-dimensional matrix as input to the classification algorithm, bypassing traditional feature selection steps. More often than not, researchers used DNNs as black-box type models, and only a few studies employed interpretable or explainable DNNs for CWL detection. However, these algorithms were mostly post hoc data analysis and classification schemes, and only a few studies adopted real-time CWL estimation methodologies. Further, it has been suggested that using interpretable deep learning methodologies may shed light on EEG correlates of CWL, but this remains mostly an unexplored area. This systematic review suggests using networks sensitive to temporal dependencies and appropriate input formulations for each type of DNN architecture to achieve robust classification performance. An additional suggestion is to utilize transfer learning methods to achieve high generalizability across tasks (task-independent classifiers), while simple cross-subject data pooling may achieve the same for subject-independent classifiers.
Collapse
Affiliation(s)
- Vishnu K N
- Neural Engineering Lab, Department of Biosciences and Bioengineering, Indian Institute of Technology Guwahati, Assam 781039, India
| | - Cota Navin Gupta
- Neural Engineering Lab, Department of Biosciences and Bioengineering, Indian Institute of Technology Guwahati, Assam 781039, India
| |
Collapse
|
5
|
Bjegojević B, Pušica M, Gianini G, Gligorijević I, Cromie S, Leva MC. Neuroergonomic Attention Assessment in Safety-Critical Tasks: EEG Indices and Subjective Metrics Validation in a Novel Task-Embedded Reaction Time Paradigm. Brain Sci 2024; 14:1009. [PMID: 39452023 PMCID: PMC11506387 DOI: 10.3390/brainsci14101009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2024] [Revised: 09/27/2024] [Accepted: 09/30/2024] [Indexed: 10/26/2024] Open
Abstract
Background/Objectives: This study addresses the gap in methodological guidelines for neuroergonomic attention assessment in safety-critical tasks, focusing on validating EEG indices, including the engagement index (EI) and beta/alpha ratio, alongside subjective ratings. Methods: A novel task-embedded reaction time paradigm was developed to evaluate the sensitivity of these metrics to dynamic attentional demands in a more naturalistic multitasking context. By manipulating attention levels through varying secondary tasks in the NASA MATB-II task while maintaining a consistent primary reaction-time task, this study successfully demonstrated the effectiveness of the paradigm. Results: Results indicate that both the beta/alpha ratio and EI are sensitive to changes in attentional demands, with beta/alpha being more responsive to dynamic variations in attention, and EI reflecting more the overall effort required to sustain performance, especially in conditions where maintaining attention is challenging. Conclusions: The potential for predicting the attention lapses through integration of performance metrics, EEG measures, and subjective assessments was demonstrated, providing a more nuanced understanding of dynamic fluctuations of attention in multitasking scenarios, mimicking those in real-world safety-critical tasks. These findings provide a foundation for advancing methods to monitor attention fluctuations accurately and mitigate risks in critical scenarios, such as train-driving or automated vehicle operation, where maintaining a high attention level is crucial.
Collapse
Affiliation(s)
- Bojana Bjegojević
- Human Factors in Safety and Sustainability (HFISS), Technological University Dublin, D07 EWV4 Dublin, Ireland; (B.B.)
- Centre for Innovative Human Systems (CIHS), Trinity College Dublin, D02 PN40 Dublin, Ireland
| | - Miloš Pušica
- Human Factors in Safety and Sustainability (HFISS), Technological University Dublin, D07 EWV4 Dublin, Ireland; (B.B.)
- mBrainTrain LLC, 11000 Belgrade, Serbia;
| | - Gabriele Gianini
- Department of Informatics Systems and Communication (DISCo), Università degli Studi di Milano-Bicocca, 20126 Milan, Italy
| | | | - Sam Cromie
- Centre for Innovative Human Systems (CIHS), Trinity College Dublin, D02 PN40 Dublin, Ireland
| | - Maria Chiara Leva
- Human Factors in Safety and Sustainability (HFISS), Technological University Dublin, D07 EWV4 Dublin, Ireland; (B.B.)
| |
Collapse
|
6
|
Shi Y, Tu Y, Wang L, Zhu N. AtLSMMs network: An attentional-biLSTM based multi-model prediction for smartphone visual fatigue. DISPLAYS 2024; 84:102754. [DOI: 10.1016/j.displa.2024.102754] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/06/2025]
|
7
|
Zhao Y, Huang Y, Liu Z, Zhou Y. The architecture of functional brain network modulated by driving under train running noise exposure. PLoS One 2024; 19:e0306729. [PMID: 39146301 PMCID: PMC11326564 DOI: 10.1371/journal.pone.0306729] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2023] [Accepted: 06/22/2024] [Indexed: 08/17/2024] Open
Abstract
A noisy environment can considerably impact drivers' attention and fatigue, endangering driving safety. Consequently, this study designed a simulated driving experimental scenario to analyse the effects of noise generated during urban rail transit train operation on drivers' functional brain networks. The experiment recruited 16 participants, and the simulated driving scenario was conducted at noise levels of 50, 60, 70, and 80 dB. Functional connectivity between all electrode pairs across various frequency bands was evaluated using the weighted phase lag index (WPLI), and a brain network based on this was constructed. Graph theoretic analysis employed network global efficiency, degree, and clustering coefficient as metrics. Significant increases in the WPLI values of theta and alpha frequency bands were observed in high noise environments (70 dB, 80 dB), as well as enhanced brain synchronisation. Furthermore, concerning the topological metrics of brain networks, it was observed that the global efficiency of brain networks in theta and alpha frequency ranges, as well as the node degree and clustering coefficients, experienced substantial growth in high noise environments (70 dB, 80 dB) as opposed to 50 dB and 60 dB. This finding indicates that high-noise environments impact the reorganisation of functional brain networks, leading to a preference for network structures with improved global efficiency. Such findings may improve our understanding of the neural mechanisms of driving under noise exposure, and thus potentially reduce road accidents to some extent.
Collapse
Affiliation(s)
- Yashuai Zhao
- School of Urban Rail Transportation, Shanghai University of Engineering Science, Shanghai, P.R. China
| | - Yuanchun Huang
- School of Urban Rail Transportation, Shanghai University of Engineering Science, Shanghai, P.R. China
| | - Zhigang Liu
- School of Urban Rail Transportation, Shanghai University of Engineering Science, Shanghai, P.R. China
| | - Yifan Zhou
- School of Urban Rail Transportation, Shanghai University of Engineering Science, Shanghai, P.R. China
| |
Collapse
|
8
|
Fici A, Bilucaglia M, Casiraghi C, Rossi C, Chiarelli S, Columbano M, Micheletto V, Zito M, Russo V. From E-Commerce to the Metaverse: A Neuroscientific Analysis of Digital Consumer Behavior. Behav Sci (Basel) 2024; 14:596. [PMID: 39062419 PMCID: PMC11274220 DOI: 10.3390/bs14070596] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2024] [Revised: 07/05/2024] [Accepted: 07/11/2024] [Indexed: 07/28/2024] Open
Abstract
The growing interest in consumer behavior in the digital environment is leading scholars and companies to focus on consumer behavior and choices on digital platforms, such as the metaverse. On this immersive digital shopping platform, consumer neuroscience provides an optimal opportunity to explore consumers' emotions and cognitions. In this study, neuroscience techniques (EEG, SC, BVP) were used to compare emotional and cognitive aspects of shopping between metaverse and traditional e-commerce platforms. Participants were asked to purchase the same product once on a metaverse platform (Second Life, SL) and once via an e-commerce website (EC). After each task, questionnaires were administered to measure perceived enjoyment, informativeness, ease of use, cognitive effort, and flow. Statistical analyses were conducted to examine differences between SL and EC at the neurophysiological and self-report levels, as well as between different stages of the purchase process. The results show that SL elicits greater cognitive engagement than EC, but it is also more mentally demanding, with a higher workload and more memorization, and fails to elicit a strong positive emotional response, leading to a poorer shopping experience. These findings provide insights not only for digital-related consumer research but also for companies to improve their metaverse shopping experience. Before investing in the platform or creating a digital retail space, companies should thoroughly analyze it, focusing on how to enhance users' cognition and emotions, ultimately promoting a better consumer experience. Despite its limitations, this pilot study sheds light on the emotional and cognitive aspects of metaverse shopping and suggests potential for further research with a consumer neuroscience approach in the metaverse field.
Collapse
Affiliation(s)
- Alessandro Fici
- Department of Business, Law, Economics and Consumer Behaviour “Carlo A. Ricciardi”, Università IULM, 20143 Milan, Italy; (A.F.); (M.B.); (C.R.); (S.C.); (M.C.); (V.M.); (M.Z.); (V.R.)
- Behavior and Brain Lab IULM—Neuromarketing Research Center, Università IULM, 20143 Milan, Italy
| | - Marco Bilucaglia
- Department of Business, Law, Economics and Consumer Behaviour “Carlo A. Ricciardi”, Università IULM, 20143 Milan, Italy; (A.F.); (M.B.); (C.R.); (S.C.); (M.C.); (V.M.); (M.Z.); (V.R.)
- Behavior and Brain Lab IULM—Neuromarketing Research Center, Università IULM, 20143 Milan, Italy
| | - Chiara Casiraghi
- Department of Business, Law, Economics and Consumer Behaviour “Carlo A. Ricciardi”, Università IULM, 20143 Milan, Italy; (A.F.); (M.B.); (C.R.); (S.C.); (M.C.); (V.M.); (M.Z.); (V.R.)
- Behavior and Brain Lab IULM—Neuromarketing Research Center, Università IULM, 20143 Milan, Italy
| | - Cristina Rossi
- Department of Business, Law, Economics and Consumer Behaviour “Carlo A. Ricciardi”, Università IULM, 20143 Milan, Italy; (A.F.); (M.B.); (C.R.); (S.C.); (M.C.); (V.M.); (M.Z.); (V.R.)
- Behavior and Brain Lab IULM—Neuromarketing Research Center, Università IULM, 20143 Milan, Italy
| | - Simone Chiarelli
- Department of Business, Law, Economics and Consumer Behaviour “Carlo A. Ricciardi”, Università IULM, 20143 Milan, Italy; (A.F.); (M.B.); (C.R.); (S.C.); (M.C.); (V.M.); (M.Z.); (V.R.)
- Behavior and Brain Lab IULM—Neuromarketing Research Center, Università IULM, 20143 Milan, Italy
| | - Martina Columbano
- Department of Business, Law, Economics and Consumer Behaviour “Carlo A. Ricciardi”, Università IULM, 20143 Milan, Italy; (A.F.); (M.B.); (C.R.); (S.C.); (M.C.); (V.M.); (M.Z.); (V.R.)
| | - Valeria Micheletto
- Department of Business, Law, Economics and Consumer Behaviour “Carlo A. Ricciardi”, Università IULM, 20143 Milan, Italy; (A.F.); (M.B.); (C.R.); (S.C.); (M.C.); (V.M.); (M.Z.); (V.R.)
| | - Margherita Zito
- Department of Business, Law, Economics and Consumer Behaviour “Carlo A. Ricciardi”, Università IULM, 20143 Milan, Italy; (A.F.); (M.B.); (C.R.); (S.C.); (M.C.); (V.M.); (M.Z.); (V.R.)
- Behavior and Brain Lab IULM—Neuromarketing Research Center, Università IULM, 20143 Milan, Italy
| | - Vincenzo Russo
- Department of Business, Law, Economics and Consumer Behaviour “Carlo A. Ricciardi”, Università IULM, 20143 Milan, Italy; (A.F.); (M.B.); (C.R.); (S.C.); (M.C.); (V.M.); (M.Z.); (V.R.)
- Behavior and Brain Lab IULM—Neuromarketing Research Center, Università IULM, 20143 Milan, Italy
| |
Collapse
|
9
|
Gogna Y, Tiwari S, Singla R. Evaluating the performance of the cognitive workload model with subjective endorsement in addition to EEG. Med Biol Eng Comput 2024; 62:2019-2036. [PMID: 38433179 DOI: 10.1007/s11517-024-03049-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Accepted: 02/13/2024] [Indexed: 03/05/2024]
Abstract
The aptitude-oriented exercises from almost all domains impose cognitive load on their operators. Evaluating such load poses several challenges owing to many factors like measurement mode and complexity, nature of the load, overloading conditions, etc. Nevertheless, the physiological measurement of a specific genre of cognitive load and subjective measurement have not been reported along with each other. In this study, the electroencephalography (EEG)-driven machine learning (Support Vector Machine (SVM)) model is sought along with the support of NASA's Task Load Index (NASA-TLX) rating scale for a novel purpose in workload exploration of operators. The Cognitive Load Theory (CLT) was used as the foundation to design the intrinsic stimulus (Spot the Difference task), as most workloads operators are exposed to are notably intrinsic. The SVM-based three-level classification accuracy ranged from 85.4 to 97.4% (p < 0.05), and the NASA-TLX-based three-level classification accuracy ranged from 88.33 to 97.33%. The t-test results show that the neurometric indices contributing to the classification significantly differed (p < 0.05) for every level. The NASA-TLX scale was utilised for validation in its basic form after the validity (Pearson correlation coefficients 0.338 to 0.805 (p < 0.05)) and reliability (Cronbach's α = 0.753) test. This modeling is beneficial to phase out particular-level cognitive exercises from the curriculum during under or overload workload (critical) conditions.
Collapse
Affiliation(s)
- Yamini Gogna
- ICE Department, Dr. B. R. Ambedkar NIT Jalandhar, GT Road Bye-Pass, Jalandhar, Punjab, 144008, India.
| | - Sheela Tiwari
- ICE Department, Dr. B. R. Ambedkar NIT Jalandhar, GT Road Bye-Pass, Jalandhar, Punjab, 144008, India
| | - Rajesh Singla
- ICE Department, Dr. B. R. Ambedkar NIT Jalandhar, GT Road Bye-Pass, Jalandhar, Punjab, 144008, India
| |
Collapse
|
10
|
Afghan R, Heysieattalab S, Zangbar HS, Ebrahimi-Kalan A, Jafari-Koshki T, Samadzadehaghdam N. Lavender Essential Oil Inhalation Improves Attentional Shifting and Accuracy: Evidence from Dynamic Changes of Cognitive Flexibility and Power Spectral Density of Electroencephalogram Signals. JOURNAL OF MEDICAL SIGNALS & SENSORS 2024; 14:12. [PMID: 38993201 PMCID: PMC11111129 DOI: 10.4103/jmss.jmss_57_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2023] [Revised: 01/09/2024] [Accepted: 01/30/2024] [Indexed: 07/13/2024]
Abstract
Background Cognitive flexibility, a vital component of executive function, entails the utilization of extended brain networks. Olfactory stimulation has been shown to influence various brain functions, particularly cognitive performance. Method To investigate aroma inhalation's effects on brain activity dynamics associated with cognitive flexibility, 20 healthy adults were recruited to complete a set-shifting task during two experimental conditions: no aroma stimuli vs. lavender essential oil inhalation. Using Thomson's multitaper approach, the normalized power spectral density (NPSD) was assessed for five frequency bands. Results Findings confirm that aroma inhalation significantly affects behavioral indices (i.e., reaction time (RT) and response accuracy) and electroencephalogram (EEG) signatures, especially in the frontal lobe. Participants showed a tremendous increase in theta and alpha NPSD, associated with relaxation, along with beta NPSD, associated with clear and fast thinking after inhaling the aroma. NPSD of the delta band, an indicator of the unconscious mind, significantly decreased when stimulated with lavender essential oil. Further, participants exhibited shorter RT and more accurate responses following aroma inhalation. Conclusion Our findings revealed significant changes in oscillatory power and behavioral performance after aroma inhalation, providing neural evidence that olfactory stimulation with lavender essential oil may facilitate cognitive flexibility.
Collapse
Affiliation(s)
- Reyhaneh Afghan
- Department of Biomedical Engineering, Faculty of Advanced Medical Sciences, Tabriz University of Medical Sciences, Tabriz, Iran
| | | | - Hamid Soltani Zangbar
- Department of Neurosciences and Cognition, Faculty of Advanced Medical Sciences, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Abbas Ebrahimi-Kalan
- Department of Neurosciences and Cognition, Faculty of Advanced Medical Sciences, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Tohid Jafari-Koshki
- Molecular Medicine Research Center, Department of Statistics and Epidemiology, Faculty of Health, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Nasser Samadzadehaghdam
- Department of Biomedical Engineering, Faculty of Advanced Medical Sciences, Tabriz University of Medical Sciences, Tabriz, Iran
| |
Collapse
|
11
|
Attallah O. ADHD-AID: Aiding Tool for Detecting Children's Attention Deficit Hyperactivity Disorder via EEG-Based Multi-Resolution Analysis and Feature Selection. Biomimetics (Basel) 2024; 9:188. [PMID: 38534873 DOI: 10.3390/biomimetics9030188] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Revised: 03/12/2024] [Accepted: 03/13/2024] [Indexed: 03/28/2024] Open
Abstract
The severe effects of attention deficit hyperactivity disorder (ADHD) among adolescents can be prevented by timely identification and prompt therapeutic intervention. Traditional diagnostic techniques are complicated and time-consuming because they are subjective-based assessments. Machine learning (ML) techniques can automate this process and prevent the limitations of manual evaluation. However, most of the ML-based models extract few features from a single domain. Furthermore, most ML-based studies have not examined the most effective electrode placement on the skull, which affects the identification process, while others have not employed feature selection approaches to reduce the feature space dimension and consequently the complexity of the training models. This study presents an ML-based tool for automatically identifying ADHD entitled "ADHD-AID". The present study uses several multi-resolution analysis techniques including variational mode decomposition, discrete wavelet transform, and empirical wavelet decomposition. ADHD-AID extracts thirty features from the time and time-frequency domains to identify ADHD, including nonlinear features, band-power features, entropy-based features, and statistical features. The present study also looks at the best EEG electrode placement for detecting ADHD. Additionally, it looks into the location combinations that have the most significant impact on identification accuracy. Additionally, it uses a variety of feature selection methods to choose those features that have the greatest influence on the diagnosis of ADHD, reducing the classification's complexity and training time. The results show that ADHD-AID has provided scores for accuracy, sensitivity, specificity, F1-score, and Mathew correlation coefficients of 0.991, 0.989, 0.992, 0.989, and 0.982, respectively, in identifying ADHD with 10-fold cross-validation. Also, the area under the curve has reached 0.9958. ADHD-AID's results are significantly higher than those of all earlier studies for the detection of ADHD in adolescents. These notable and trustworthy findings support the use of such an automated tool as a means of assistance for doctors in the prompt identification of ADHD in youngsters.
Collapse
Affiliation(s)
- Omneya Attallah
- Department of Electronics and Communications Engineering, College of Engineering and Technology, Arab Academy for Science, Technology and Maritime Transport, Alexandria 21937, Egypt
- Wearables, Biosensing and Biosignal Processing Laboratory, Arab Academy for Science, Technology and Maritime Transport, Alexandria 21937, Egypt
| |
Collapse
|
12
|
Mark JA, Curtin A, Kraft AE, Ziegler MD, Ayaz H. Mental workload assessment by monitoring brain, heart, and eye with six biomedical modalities during six cognitive tasks. FRONTIERS IN NEUROERGONOMICS 2024; 5:1345507. [PMID: 38533517 PMCID: PMC10963413 DOI: 10.3389/fnrgo.2024.1345507] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Accepted: 02/15/2024] [Indexed: 03/28/2024]
Abstract
Introduction The efficiency and safety of complex high precision human-machine systems such as in aerospace and robotic surgery are closely related to the cognitive readiness, ability to manage workload, and situational awareness of their operators. Accurate assessment of mental workload could help in preventing operator error and allow for pertinent intervention by predicting performance declines that can arise from either work overload or under stimulation. Neuroergonomic approaches based on measures of human body and brain activity collectively can provide sensitive and reliable assessment of human mental workload in complex training and work environments. Methods In this study, we developed a new six-cognitive-domain task protocol, coupling it with six biomedical monitoring modalities to concurrently capture performance and cognitive workload correlates across a longitudinal multi-day investigation. Utilizing two distinct modalities for each aspect of cardiac activity (ECG and PPG), ocular activity (EOG and eye-tracking), and brain activity (EEG and fNIRS), 23 participants engaged in four sessions over 4 weeks, performing tasks associated with working memory, vigilance, risk assessment, shifting attention, situation awareness, and inhibitory control. Results The results revealed varying levels of sensitivity to workload within each modality. While certain measures exhibited consistency across tasks, neuroimaging modalities, in particular, unveiled meaningful differences between task conditions and cognitive domains. Discussion This is the first comprehensive comparison of these six brain-body measures across multiple days and cognitive domains. The findings underscore the potential of wearable brain and body sensing methods for evaluating mental workload. Such comprehensive neuroergonomic assessment can inform development of next generation neuroadaptive interfaces and training approaches for more efficient human-machine interaction and operator skill acquisition.
Collapse
Affiliation(s)
- Jesse A. Mark
- School of Biomedical Engineering, Science, and Health Systems, Drexel University, Philadelphia, PA, United States
| | - Adrian Curtin
- School of Biomedical Engineering, Science, and Health Systems, Drexel University, Philadelphia, PA, United States
| | - Amanda E. Kraft
- Advanced Technology Laboratories, Lockheed Martin, Arlington, VA, United States
| | - Matthias D. Ziegler
- Advanced Technology Laboratories, Lockheed Martin, Arlington, VA, United States
| | - Hasan Ayaz
- School of Biomedical Engineering, Science, and Health Systems, Drexel University, Philadelphia, PA, United States
- Department of Psychological and Brain Sciences, College of Arts and Sciences, Drexel University, Philadelphia, PA, United States
- Drexel Solutions Institute, Drexel University, Philadelphia, PA, United States
- A. J. Drexel Autism Institute, Drexel University, Philadelphia, PA, United States
- Department of Family and Community Health, University of Pennsylvania, Philadelphia, PA, United States
- Center for Injury Research and Prevention, Children's Hospital of Philadelphia, Philadelphia, PA, United States
| |
Collapse
|
13
|
Proost M, Habay J, DE Wachter J, DE Pauw K, Marusic U, Meeusen R, DE Bock S, Roelands B, VAN Cutsem J. The Impact of Mental Fatigue on a Strength Endurance Task: Is There a Role for the Movement-Related Cortical Potential? Med Sci Sports Exerc 2024; 56:435-445. [PMID: 37847068 DOI: 10.1249/mss.0000000000003322] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2023]
Abstract
PURPOSE Several mechanisms have been proposed to explain how mental fatigue degrades sport performance. In terms of endurance performance, a role for an increased perceived exertion has been demonstrated. Using electroencephalography and, more specifically, the movement-related cortical potential (MRCP), the present study explored the neural mechanisms that could underlie the mental fatigue-associated increase in perceived exertion. METHODS Fourteen participants (age, 23 ± 2 yr; 5 women, 9 men) performed one familiarization and two experimental trials in a randomized, blinded, crossover study design. Participants had to complete a submaximal leg extension task after a mentally fatiguing task (EXP; individualized 60-min Stroop task) or control task (CON; documentary). The leg extension task consisted of performing 100 extensions at 35% of 1 repetition maximum, during which multiple physiological (heart rate, electroencephalography) and subjective measures (self-reported feeling of mental fatigue, cognitive load, behand motivation, ratings of perceived exertion) were assessed. RESULTS Self-reported feeling of mental fatigue was higher in EXP (72 ± 18) compared with CON (37 ± 17; P < 0.001). A significant decrease in flanker accuracy was detected only in EXP (from 0.96 ± 0.03% to 0.03%; P < 0.05). No significant differences between conditions were found in MRCP characteristics and perceived exertion. Specifically in EXP, alpha wave power increased during the leg extension task ( P < 0.01). CONCLUSIONS Mental fatigue did not impact the perceived exertion or MRCP characteristics during the leg extension task. This could be related to low perceived exertion and/or the absence of a performance outcome during the leg extension task. The increase in alpha power during the leg extension task in EXP suggests that participants may engage a focused internal attention mechanism to maintain performance and mitigate feelings of fatigue.
Collapse
Affiliation(s)
- Matthias Proost
- Human Physiology and Sports Physiotherapy Research Group, Faculty of Physical Education and Physiotherapy, Vrije Universiteit Brussel, Brussel, BELGIUM
| | | | - Jonas DE Wachter
- Human Physiology and Sports Physiotherapy Research Group, Faculty of Physical Education and Physiotherapy, Vrije Universiteit Brussel, Brussel, BELGIUM
| | | | | | | | | | | | | |
Collapse
|
14
|
Natalizio A, Sieghartsleitner S, Schreiner L, Walchshofer M, Esposito A, Scharinger J, Pretl H, Arpaia P, Parvis M, Solé-Casals J, Sebastián-Romagosa M, Ortner R, Guger C. Real-time estimation of EEG-based engagement in different tasks. J Neural Eng 2024; 21:016014. [PMID: 38237182 DOI: 10.1088/1741-2552/ad200d] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Accepted: 01/18/2024] [Indexed: 02/01/2024]
Abstract
Objective.Recent trends in brain-computer interface (BCI) research concern the passive monitoring of brain activity, which aim to monitor a wide variety of cognitive states. Engagement is such a cognitive state, which is of interest in contexts such as learning, entertainment or rehabilitation. This study proposes a novel approach for real-time estimation of engagement during different tasks using electroencephalography (EEG).Approach.Twenty-three healthy subjects participated in the BCI experiment. A modified version of the d2 test was used to elicit engagement. Within-subject classification models which discriminate between engaging and resting states were trained based on EEG recorded during a d2 test based paradigm. The EEG was recorded using eight electrodes and the classification model was based on filter-bank common spatial patterns and a linear discriminant analysis. The classification models were evaluated in cross-task applications, namely when playing Tetris at different speeds (i.e. slow, medium, fast) and when watching two videos (i.e. advertisement and landscape video). Additionally, subjects' perceived engagement was quantified using a questionnaire.Main results.The models achieved a classification accuracy of 90% on average when tested on an independent d2 test paradigm recording. Subjects' perceived and estimated engagement were found to be greater during the advertisement compared to the landscape video (p= 0.025 andp<0.001, respectively); greater during medium and fast compared to slow Tetris speed (p<0.001, respectively); not different between medium and fast Tetris speeds. Additionally, a common linear relationship was observed for perceived and estimated engagement (rrm= 0.44,p<0.001). Finally, theta and alpha band powers were investigated, which respectively increased and decreased during more engaging states.Significance.This study proposes a task-specific EEG engagement estimation model with cross-task capabilities, offering a framework for real-world applications.
Collapse
Affiliation(s)
- Angela Natalizio
- g.tec medical engineering GmbH, Schiedlberg, Austria
- Augmented Reality for Health Monitoring Laboratory (ARHeMLab), Università degli Studi di Napoli Federico II, Naples, Italy
- Department of Electronics and Telecommunications (DET), Polytechnic of Turin, Turin, Italy
| | - Sebastian Sieghartsleitner
- g.tec medical engineering GmbH, Schiedlberg, Austria
- Institute of Computational Perception, Johannes Kepler University, Linz, Austria
| | - Leonhard Schreiner
- g.tec medical engineering GmbH, Schiedlberg, Austria
- Institute for Integrated Circuits, Johannes Kepler University, Linz, Austria
| | | | - Antonio Esposito
- Augmented Reality for Health Monitoring Laboratory (ARHeMLab), Università degli Studi di Napoli Federico II, Naples, Italy
- Department of Engineering for Innovation University of Salento, Lecce, Italy
| | - Josef Scharinger
- Institute of Computational Perception, Johannes Kepler University, Linz, Austria
| | - Harald Pretl
- Institute for Integrated Circuits, Johannes Kepler University, Linz, Austria
| | - Pasquale Arpaia
- Augmented Reality for Health Monitoring Laboratory (ARHeMLab), Università degli Studi di Napoli Federico II, Naples, Italy
- Department of Electrical Engineering and Information Technology (DIETI), Università degli Studi di Napoli Federico II, Naples, Italy
- Centro Interdipartimentale di Ricerca in Management Sanitario e Innovazione in Sanità (CIRMIS), Università degli Studi di Napoli Federico II, Naples, Italy
| | - Marco Parvis
- Department of Electronics and Telecommunications (DET), Polytechnic of Turin, Turin, Italy
| | - Jordi Solé-Casals
- Data and Signal Processing Research Group, University of Vic-Central, University of Catalonia, Vic, Catalonia, Spain
- Department of Psychiatry, University of Cambridge, Cambridge, United Kingdom
| | | | - Rupert Ortner
- g.tec medical engineering Spain SL, Barcelona, Spain
| | - Christoph Guger
- g.tec medical engineering GmbH, Schiedlberg, Austria
- g.tec medical engineering Spain SL, Barcelona, Spain
| |
Collapse
|
15
|
Theodoridou D, Tsiantis CO, Vlaikou AM, Chondrou V, Zakopoulou V, Christodoulides P, Oikonomou ED, Tzimourta KD, Kostoulas C, Tzallas AT, Tsamis KI, Peschos D, Sgourou A, Filiou MD, Syrrou M. Developmental Dyslexia: Insights from EEG-Based Findings and Molecular Signatures-A Pilot Study. Brain Sci 2024; 14:139. [PMID: 38391714 PMCID: PMC10887023 DOI: 10.3390/brainsci14020139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2023] [Revised: 01/25/2024] [Accepted: 01/26/2024] [Indexed: 02/24/2024] Open
Abstract
Developmental dyslexia (DD) is a learning disorder. Although risk genes have been identified, environmental factors, and particularly stress arising from constant difficulties, have been associated with the occurrence of DD by affecting brain plasticity and function, especially during critical neurodevelopmental stages. In this work, electroencephalogram (EEG) findings were coupled with the genetic and epigenetic molecular signatures of individuals with DD and matched controls. Specifically, we investigated the genetic and epigenetic correlates of key stress-associated genes (NR3C1, NR3C2, FKBP5, GILZ, SLC6A4) with psychological characteristics (depression, anxiety, and stress) often included in DD diagnostic criteria, as well as with brain EEG findings. We paired the observed brain rhythms with the expression levels of stress-related genes, investigated the epigenetic profile of the stress regulator glucocorticoid receptor (GR) and correlated such indices with demographic findings. This study presents a new interdisciplinary approach and findings that support the idea that stress, attributed to the demands of the school environment, may act as a contributing factor in the occurrence of the DD phenotype.
Collapse
Affiliation(s)
- Daniela Theodoridou
- Laboratory of Biology, Faculty of Medicine, School of Health Sciences, University of Ioannina, 45110 Ioannina, Greece
| | - Christos-Orestis Tsiantis
- Laboratory of Biology, Faculty of Medicine, School of Health Sciences, University of Ioannina, 45110 Ioannina, Greece
| | - Angeliki-Maria Vlaikou
- Biomedical Research Institute, Foundation for Research and Technology-Hellas (FORTH), 45110 Ioannina, Greece
- Laboratory of Biochemistry, Department of Biological Applications and Technology, School of Health Sciences, University of Ioannina, 45110 Ioannina, Greece
| | - Vasiliki Chondrou
- Laboratory of Biology, School of Science and Technology, Hellenic Open University, 26335 Patras, Greece
| | - Victoria Zakopoulou
- Department of Speech and Language Therapy, School of Health Sciences, University of Ioannina, 45110 Ioannina, Greece
| | - Pavlos Christodoulides
- Department of Speech and Language Therapy, School of Health Sciences, University of Ioannina, 45110 Ioannina, Greece
- Laboratory of Physiology, Faculty of Medicine, School of Health Sciences, University of Ioannina, 45110 Ioannina, Greece
| | - Emmanouil D Oikonomou
- Department of Informatics and Telecommunications, School of Informatics & Telecommunications, University of Ioannina, 47100 Arta, Greece
| | - Katerina D Tzimourta
- Department of Electrical and Computer Engineering, University of Western Macedonia, 50100 Kozani, Greece
| | - Charilaos Kostoulas
- Laboratory of Medical Genetics, Faculty of Medicine, School of Health Sciences, University of Ioannina, 45110 Ioannina, Greece
| | - Alexandros T Tzallas
- Department of Informatics and Telecommunications, School of Informatics & Telecommunications, University of Ioannina, 47100 Arta, Greece
| | - Konstantinos I Tsamis
- Laboratory of Physiology, Faculty of Medicine, School of Health Sciences, University of Ioannina, 45110 Ioannina, Greece
| | - Dimitrios Peschos
- Laboratory of Physiology, Faculty of Medicine, School of Health Sciences, University of Ioannina, 45110 Ioannina, Greece
| | - Argyro Sgourou
- Laboratory of Biology, School of Science and Technology, Hellenic Open University, 26335 Patras, Greece
| | - Michaela D Filiou
- Biomedical Research Institute, Foundation for Research and Technology-Hellas (FORTH), 45110 Ioannina, Greece
- Laboratory of Biochemistry, Department of Biological Applications and Technology, School of Health Sciences, University of Ioannina, 45110 Ioannina, Greece
| | - Maria Syrrou
- Laboratory of Biology, Faculty of Medicine, School of Health Sciences, University of Ioannina, 45110 Ioannina, Greece
| |
Collapse
|
16
|
Sourkatti H, Pettersson K, van der Sanden B, Lindholm M, Plomp J, Määttänen I, Henttonen P, Närväinen J. Investigation of different ML approaches in classification of emotions induced by acute stress. Heliyon 2024; 10:e23611. [PMID: 38173518 PMCID: PMC10761802 DOI: 10.1016/j.heliyon.2023.e23611] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Revised: 11/02/2023] [Accepted: 12/07/2023] [Indexed: 01/05/2024] Open
Abstract
Background Machine learning is becoming a common tool in monitoring emotion. However, methodological studies of the processing pipeline are scarce, especially ones using subjective appraisals as ground truth. New method A novel protocol was used to induce cognitive load and physical discomfort, and emotional dimensions (arousal, valence, and dominance) were reported after each task. The performance of five common ML models with a versatile set of features (physiological features, task performance data, and personality trait) was compared in binary classification of subjectively assessed emotions. Results The psychophysiological responses proved the protocol was successful in changing the mental state from baseline, also the cognitive and physical tasks were different. The optimization and performance of ML models used for emotion detection were evaluated. Additionally, methods to account for imbalanced classes were applied and shown to improve the classification performance. Comparison with existing methods Classification of human emotional states often assumes the states are determined by the stimuli. However, individual appraisals vary. None of the past studies have classified subjective emotional dimensions with a set of features including biosignals, personality and behavior. Conclusion Our data represent a typical setup in affective computing utilizing psychophysiological monitoring: N is low compared to number of features, inter-individual variability is high, and class imbalance cannot be avoided. Our observations are a) if possible, include features representing physiology, behavior and personality, b) use simple models and limited number of features to improve interpretability, c) address the possible imbalance, d) if the data size allows, use nested cross-validation.
Collapse
Affiliation(s)
- Heba Sourkatti
- VTT Technical Research Center of Finland, Tekniikantie 1, 02150 Espoo, Finland
| | - Kati Pettersson
- VTT Technical Research Center of Finland, Tekniikantie 1, 02150 Espoo, Finland
| | | | - Mikko Lindholm
- VTT Technical Research Center of Finland, Tekniikantie 1, 02150 Espoo, Finland
| | - Johan Plomp
- VTT Technical Research Center of Finland, Tekniikantie 1, 02150 Espoo, Finland
| | - Ilmari Määttänen
- University of Helsinki, Department of Psychology and Logopedics, Faculty of Medicine, P.O. Box 63, 00014 University of Helsinki, Finland
| | - Pentti Henttonen
- University of Helsinki, Department of Psychology and Logopedics, Faculty of Medicine, P.O. Box 63, 00014 University of Helsinki, Finland
| | - Johanna Närväinen
- VTT Technical Research Center of Finland, Tekniikantie 1, 02150 Espoo, Finland
| |
Collapse
|
17
|
Riehm CD, Zuleger T, Diekfuss JA, Arellano E, Myer GD. The Evolution of Neuroimaging Technologies to Evaluate Neural Activity Related to Knee Pain and Injury Risk. Curr Rev Musculoskelet Med 2024; 17:14-22. [PMID: 38109007 PMCID: PMC10766917 DOI: 10.1007/s12178-023-09877-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 11/26/2023] [Indexed: 12/19/2023]
Abstract
PURPOSE OF REVIEW In this review, we present recent findings and advancements in the use of neuroimaging to evaluate neural activity relative to ACL injury risk and patellofemoral pain. In particular, we describe prior work using fMRI and EEG that demonstrate the value of these techniques as well as the necessity of continued development in this area. Our goal is to support future work by providing guidance for the successful application of neuroimaging techniques that most effectively expose pain and injury mechanisms. RECENT FINDINGS Recent studies that utilized both fMRI and EEG indicate that athletes who are at risk for future ACL injury exhibit divergent brain activity both during active lower extremity movement and at rest. Such activity patterns are likely due to alterations to cognitive, visual, and attentional processes that manifest as coordination deficits during naturalistic movement that may result in higher risk of injury. Similarly, in individuals with PFP altered brain activity in a number of key regions is related to subjective pain judgements as well as measures of fear of movement. Although these findings may begin to allow objective pain assessment and identification, continued refinement is needed. One key limitation across both ACL and PFP related work is the restriction of movement during fMRI and EEG data collection, which drastically limits ecological validity. Given the lack of sufficient research using EEG and fMRI within a naturalistic setting, our recommendation is that researchers target the use of mobile, source localized EEG as a primary methodology for exposing neural mechanisms of ACL injury risk and PFP. Our contention is that this method provides an optimal balance of spatial and temporal resolution with ecological validity via naturalistic movement.
Collapse
Affiliation(s)
- Christopher D Riehm
- Emory Sports Performance And Research Center (SPARC), 4450 Falcon Pkwy, Flowery Branch, GA, 30542, USA.
- Emory Sports Medicine Center, Atlanta, GA, USA.
- Department of Orthopaedics, Emory University School of Medicine, Atlanta, GA, USA.
| | - Taylor Zuleger
- Emory Sports Performance And Research Center (SPARC), 4450 Falcon Pkwy, Flowery Branch, GA, 30542, USA
- Emory Sports Medicine Center, Atlanta, GA, USA
- Department of Orthopaedics, Emory University School of Medicine, Atlanta, GA, USA
- Neuroscience Graduate Program, University of Cincinnati School of Medicine, Cincinnati, OH, USA
| | - Jed A Diekfuss
- Emory Sports Performance And Research Center (SPARC), 4450 Falcon Pkwy, Flowery Branch, GA, 30542, USA
- Emory Sports Medicine Center, Atlanta, GA, USA
- Department of Orthopaedics, Emory University School of Medicine, Atlanta, GA, USA
| | - Emilio Arellano
- Department of Orthopaedics, Emory University School of Medicine, Atlanta, GA, USA
| | - Gregory D Myer
- Emory Sports Performance And Research Center (SPARC), 4450 Falcon Pkwy, Flowery Branch, GA, 30542, USA
- Emory Sports Medicine Center, Atlanta, GA, USA
- Department of Orthopaedics, Emory University School of Medicine, Atlanta, GA, USA
- Youth Physical Development Centre, Cardiff Metropolitan University, Wales, UK
- The Micheli Center for Sports Injury Prevention, Waltham, MA, USA
| |
Collapse
|
18
|
Tankisi H, Versace V, Kuppuswamy A, Cole J. The role of clinical neurophysiology in the definition and assessment of fatigue and fatigability. Clin Neurophysiol Pract 2023; 9:39-50. [PMID: 38274859 PMCID: PMC10808861 DOI: 10.1016/j.cnp.2023.12.004] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Revised: 11/24/2023] [Accepted: 12/07/2023] [Indexed: 01/27/2024] Open
Abstract
Though a common symptom, fatigue is difficult to define and investigate, occurs in a wide variety of neurological and systemic disorders, with differing pathological causes. It is also often accompanied by a psychological component. As a symptom of long-term COVID-19 it has gained more attention. In this review, we begin by differentiating fatigue, a perception, from fatigability, quantifiable through biomarkers. Central and peripheral nervous system and muscle disorders associated with these are summarised. We provide a comprehensive and objective framework to help identify potential causes of fatigue and fatigability in a given disease condition. It also considers the effectiveness of neurophysiological tests as objective biomarkers for its assessment. Among these, twitch interpolation, motor cortex stimulation, electroencephalography and magnetencephalography, and readiness potentials will be described for the assessment of central fatigability, and surface and needle electromyography (EMG), single fibre EMG and nerve conduction studies for the assessment of peripheral fatigability. The purpose of this review is to guide clinicians in how to approach fatigue, and fatigability, and to suggest that neurophysiological tests may allow an understanding of their origin and interactions. In this way, their differing types and origins, and hence their possible differing treatments, may also be defined more clearly.
Collapse
Affiliation(s)
- Hatice Tankisi
- Department of Clinical Neurophysiology, Aarhus University Hospital, Aarhus, Denmark
- Institute of Clinical Medicine, Aarhus University, Denmark
| | - Viviana Versace
- Department of Neurorehabilitation, Hospital of Vipiteno (SABES-ASDAA), Teaching Hospital of the Paracelsus Medical Private University (PMU), Vipiteno-Sterzing, Italy
| | - Annapoorna Kuppuswamy
- Department of Clinical and Movement Neuroscience, Institute of Neurology, University College London, WC1N 3BG London, UK
- Department of Biomedical Sciences, University of Leeds, UK
| | - Jonathan Cole
- Clinical Neurophysiology, University Hospitals Dorset (Poole), UK
- University of Bournemouth, Poole, UK
| |
Collapse
|
19
|
Cebral-Loureda M, Sanabria-Z J, Ramírez-Moreno MA, Kaminsky-Castillo I. One hundred years of neurosciences in the arts and humanities, a bibliometric review. Philos Ethics Humanit Med 2023; 18:17. [PMID: 37946225 PMCID: PMC10633938 DOI: 10.1186/s13010-023-00147-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Accepted: 10/26/2023] [Indexed: 11/12/2023] Open
Abstract
BACKGROUND Neuroscientific approaches have historically triggered changes in the conception of creativity and artistic experience, which can be revealed by noting the intersection of these fields of study in terms of variables such as global trends, methodologies, objects of study, or application of new technologies; however, these neuroscientific approaches are still often considered as disciplines detached from the arts and humanities. In this light, the question arises as to what evidence the history of neurotechnologies provides at the intersection of creativity and aesthetic experience. METHODS We conducted a century-long bibliometric analysis of key parameters in multidisciplinary studies published in the Scopus database. Screening techniques based on the PRISMA method and advanced data analysis techniques were applied to 3612 documents metadata from the years 1922 to 2022. We made graphical representations of the results applying algorithmic and clusterization processes to keywords and authors relationships. RESULTS From the analyses, we found a) a shift from a personality-focus quantitative analysis to a field-focus qualitative approach, considering topics such as art, perception, aesthetics and beauty; b) The locus of interest in fMRI-supported neuroanatomy has been shifting toward EEG technologies and models based on machine learning and deep learning in recent years; c) four main clusters were identified in the study approaches: humanistic, creative, neuroaesthetic and medical; d) the neuroaesthetics cluster is the most central and relevant, mediating between creativity and neuroscience; e) neuroaesthetics and neuroethics are two of the neologism that better characterizes the challenges that this convergence of studies will have in the next years. CONCLUSIONS Through a longitudinal analysis, we evidenced the great influence that neuroscience is having on the thematic direction of the arts and humanities. The perspective presented shows how this field is being consolidated and helps to define it as a new opportunity of great potential for future researchers.
Collapse
Affiliation(s)
- Manuel Cebral-Loureda
- Humanistic Studies Department, School of Humanities and Education, Tecnologico de Monterrey, Monterrey, Mexico
| | - Jorge Sanabria-Z
- Institute for the Future of Education, Tecnologico de Monterrey, Monterrey, Mexico.
| | - Mauricio A Ramírez-Moreno
- Mechatronics Department, School of Engineering and Sciences, Tecnologico de Monterrey, Monterrey, Mexico
| | - Irina Kaminsky-Castillo
- Mechatronics Department, School of Engineering and Sciences, Tecnologico de Monterrey, Monterrey, Mexico
| |
Collapse
|
20
|
Schmoigl-Tonis M, Schranz C, Müller-Putz GR. Methods for motion artifact reduction in online brain-computer interface experiments: a systematic review. Front Hum Neurosci 2023; 17:1251690. [PMID: 37920561 PMCID: PMC10619676 DOI: 10.3389/fnhum.2023.1251690] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2023] [Accepted: 09/11/2023] [Indexed: 11/04/2023] Open
Abstract
Brain-computer interfaces (BCIs) have emerged as a promising technology for enhancing communication between the human brain and external devices. Electroencephalography (EEG) is particularly promising in this regard because it has high temporal resolution and can be easily worn on the head in everyday life. However, motion artifacts caused by muscle activity, fasciculation, cable swings, or magnetic induction pose significant challenges in real-world BCI applications. In this paper, we present a systematic review of methods for motion artifact reduction in online BCI experiments. Using the PRISMA filter method, we conducted a comprehensive literature search on PubMed, focusing on open access publications from 1966 to 2022. We evaluated 2,333 publications based on predefined filtering rules to identify existing methods and pipelines for motion artifact reduction in EEG data. We present a lookup table of all papers that passed the defined filters, all used methods, and pipelines and compare their overall performance and suitability for online BCI experiments. We summarize suitable methods, algorithms, and concepts for motion artifact reduction in online BCI applications, highlight potential research gaps, and discuss existing community consensus. This review aims to provide a comprehensive overview of the current state of the field and guide researchers in selecting appropriate methods for motion artifact reduction in online BCI experiments.
Collapse
Affiliation(s)
- Mathias Schmoigl-Tonis
- Laboratory of Collaborative Robotics, Department of Human Motion Analytics, Salzburg Research GmbH, Salzburg, Austria
- Institute of Neural Engineering, Laboratory of Brain-Computer Interfaces, Graz University of Technology, Graz, Austria
| | - Christoph Schranz
- Laboratory of Collaborative Robotics, Department of Human Motion Analytics, Salzburg Research GmbH, Salzburg, Austria
| | - Gernot R. Müller-Putz
- Institute of Neural Engineering, Laboratory of Brain-Computer Interfaces, Graz University of Technology, Graz, Austria
- BioTechMed Graz, Graz, Austria
| |
Collapse
|
21
|
Xu BX, Ding Y, Bilal M, Wang MY. Event-related potentials for investigating the willingness to recycle household medical waste. Heliyon 2023; 9:e20722. [PMID: 37842614 PMCID: PMC10570574 DOI: 10.1016/j.heliyon.2023.e20722] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Revised: 10/03/2023] [Accepted: 10/04/2023] [Indexed: 10/17/2023] Open
Abstract
Household medical waste (HMW) recycling in the reverse supply chain has become a primary channel for infectious, toxic, or radioactive substances for environmental protection and a circular economy. Recycling managers need to understand the recycling decision-making mechanisms of households to improve the intention-behavior gap and recycling participation rate, especially in cognitive neuroscience. This study designed an event-related potential (ERPs) experiment to explore the differences in ERPs components between the willingness and unwillingness to make recycling decisions. Our findings confirmed that willingness and unwillingness to recycle can lead to a significant difference in the P300 and N400 scores. A larger P300 was evoked by willingness rather than unwillingness in the prefrontal, frontal, and frontal-temporal regions. This indicates that willingness to recycle results from a rational choice in the decision-making process. However, a larger N400 was evoked by unwillingness rather than willingness in the parietal, parietal-occipital, and occipital regions. A negative wave was evoked in households unwilling to recycle because they thought it was dangerous and unsanitary, causing a higher conflict with intrinsic cognition. The combination of HMW recycling decisions and neurology may accurately measure pro-environmental decision-making processes through brain science. Advancing the knowledge of psychological and brain mechanism activities for understanding pro-environmental choices. In turn, this can help recycling managers to accurately understand household demands for increasing the recycling intention and designing effective HMW take-back systems to solve the intention-behavior gap related to the global recycling dilemma.
Collapse
Affiliation(s)
- Bin-Xiu Xu
- School of Economics and Management, Anhui Polytechnic University, Wuhu, PR China
| | - Yi Ding
- School of Economics and Management, Anhui Polytechnic University, Wuhu, PR China
| | - Muhammad Bilal
- School of Economics and Management, Anhui Polytechnic University, Wuhu, PR China
| | - Mia Y. Wang
- Department of Computer Science, College of Charleston, SC, USA
| |
Collapse
|
22
|
Anurag S, Singh BK, Krishna D, Prasanna K, Deepeshwar S. Heart-brain Rhythmic Synchronization during Meditation: A Nonlinear Signal Analysis. Int J Yoga 2023; 16:132-139. [PMID: 38204769 PMCID: PMC10775837 DOI: 10.4103/ijoy.ijoy_161_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2023] [Revised: 10/04/2023] [Accepted: 10/05/2023] [Indexed: 01/12/2024] Open
Abstract
Background Heart-brain synchronization is the integration of mind, body, and spirit. It occurs when the electrical activity of the heart and brain is synchronized. In recent years, there has been mounting curiosity to investigate the effects of meditation on heart-brain synchronization with respect to mental and emotional health and well-being. The current investigation aims to explore the rhythmic synchronicity between the brain and the heart during heartfulness meditation (HM) practice. Materials and Methods The study was performed on 45 healthy volunteers who were categorized into three equal groups: long-term meditators (LTMs), short-term meditators (STMs), and nonmeditators (NMs). The electroencephalogram (EEG) signals were recorded to measure the prefrontal activity, and electrocardiogram (ECG) signals were recorded to measure the cardiac activity. The data were recorded in four states: baseline, meditation, transmission, and posttransmission. The detrended fluctuation analysis (DFA) method was used for the analysis of EEG and ECG signals. Results The result indicates that DFA values of EEG and ECG declined during meditation and transmission states as compared to pre- and postmeditation states. Significant results were obtained for the LTM group in all the states. A positive correlation was also observed between DFA of the heart and brain for the LTM group and no significant correlations were observed for the STM and NM groups. Conclusion The shreds of evidence suggest that heart-brain synchronization facilitates mental and emotional stability. HM practice has the potential to regulate the fluctuation of the mind. Regular meditation practice may result in physiological synchrony between cardiac and neural behavior, which can be considered a quality index for meditation practice.
Collapse
Affiliation(s)
- Shrivastava Anurag
- Department of Biomedical Engineering, National Institute of Technology, Raipur, Chhattisgarh, India
| | - Bikesh Kumar Singh
- Department of Biomedical Engineering, National Institute of Technology, Raipur, Chhattisgarh, India
| | - Dwivedi Krishna
- Department of Yoga Life Sciences, Swami Vivekananda Yoga AnusandhanaSamsthana, Bengaluru, Karnataka, India
| | | | - Singh Deepeshwar
- Department of Yoga, School of Yoga, Naturopathy and Cognitive Studies, Babasaheb Bhimrao Ambedkar University, Lucknow, Uttar Pradesh, India
| |
Collapse
|
23
|
Zhou C, Shi Z, Huang T, Zhao H, Kaner J. Impact of swiping direction on the interaction performance of elderly-oriented smart home interface: EEG and eye-tracking evidence. Front Psychol 2023; 14:1089769. [PMID: 36844328 PMCID: PMC9948611 DOI: 10.3389/fpsyg.2023.1089769] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Accepted: 01/23/2023] [Indexed: 02/11/2023] Open
Abstract
Introduction Smart home technology is increasingly popular, yet not all seniors are receptive and comfortable with it. This situation recognizes that the usability of smart home interfaces is particularly important. Most studies on interface swiping direction demonstrate the advantages of horizontal over vertical swiping, but the findings lack age-based as well as gender-specific judgments. Methods In this paper, we use cognitive neural techniques of EEG and eye-tracking, combined with a subjective preference questionnaire, to analyze the preference of older persons for the swiping direction of smart home interfaces in a multimodal manner. Results The EEG data showed that swiping direction had a significant effect on potential values (p = 0.001). Also, the mean power in the δ and the θ band was enhanced during vertical swiping. Gender had no significant effect on potential values (p = 0.085), but the cognitive task was more EEG stimulating for females. The eye-tracking metrics data showed a significant effect of swiping direction on fixation duration (p = 0.047) and a non-significant effect on pupil diameter (p = 0.576). These results were consistent with the results of the subjective preference questionnaire, both demonstrating a preference for vertical swiping among participants. Discussion This paper uses three research tools simultaneously, combining objective perceptions as well as subjective preferences, to make the findings more comprehensive and reliable. Gender differences were also taken into account and differentiated in the data processing. The findings of this paper are different from most previous studies and better reflect the preference of elderly people for swiping directions, which can provide a reference for the future elderly-friendly smart home interface design.
Collapse
Affiliation(s)
- Chengmin Zhou
- College of Furnishings and Industrial Design, Nanjing Forestry University, Nanjing, Jiangsu, China,Jiangsu Co-Innovation Center of Efficient Processing and Utilization of Forest Resources, Nanjing Forestry University, Nanjing, Jiangsu, China,*Correspondence: Chengmin Zhou ✉
| | - Ziyan Shi
- College of Furnishings and Industrial Design, Nanjing Forestry University, Nanjing, Jiangsu, China,Jiangsu Co-Innovation Center of Efficient Processing and Utilization of Forest Resources, Nanjing Forestry University, Nanjing, Jiangsu, China
| | - Ting Huang
- College of Furnishings and Industrial Design, Nanjing Forestry University, Nanjing, Jiangsu, China,Jiangsu Co-Innovation Center of Efficient Processing and Utilization of Forest Resources, Nanjing Forestry University, Nanjing, Jiangsu, China
| | - Hanxiao Zhao
- College of Furnishings and Industrial Design, Nanjing Forestry University, Nanjing, Jiangsu, China,Jiangsu Co-Innovation Center of Efficient Processing and Utilization of Forest Resources, Nanjing Forestry University, Nanjing, Jiangsu, China
| | - Jake Kaner
- School of Art and Design, Nottingham Trent University, Nottingham, United Kingdom
| |
Collapse
|
24
|
Karwowski W, Soekadar SR, Kawala-Sterniuk A. Editorial: Brain imaging relations through simultaneous recordings. Front Neurosci 2023; 17:1139336. [PMID: 36824216 PMCID: PMC9941736 DOI: 10.3389/fnins.2023.1139336] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2023] [Accepted: 01/16/2023] [Indexed: 02/10/2023] Open
Affiliation(s)
- Waldemar Karwowski
- Department of Industrial and Systems Engineering, University of Central Florida, Orlando, FL, United States,*Correspondence: Waldemar Karwowski ✉
| | - Surjo R. Soekadar
- Clinical Neurotechnology Laboratory, Department of Psychiatry and Neurosciences, Charité Campus Mitte (CCM), Charité–Universitätsmedizin Berlin, Berlin, Germany,Surjo R. Soekadar ✉
| | - Aleksandra Kawala-Sterniuk
- Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, Opole, Poland,Aleksandra Kawala-Sterniuk ✉
| |
Collapse
|
25
|
Seghier ML. Multiple functions of the angular gyrus at high temporal resolution. Brain Struct Funct 2023; 228:7-46. [PMID: 35674917 DOI: 10.1007/s00429-022-02512-y] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Accepted: 05/22/2022] [Indexed: 02/07/2023]
Abstract
Here, the functions of the angular gyrus (AG) are evaluated in the light of current evidence from transcranial magnetic/electric stimulation (TMS/TES) and EEG/MEG studies. 65 TMS/TES and 52 EEG/MEG studies were examined in this review. TMS/TES literature points to a causal role in semantic processing, word and number processing, attention and visual search, self-guided movement, memory, and self-processing. EEG/MEG studies reported AG effects at latencies varying between 32 and 800 ms in a wide range of domains, with a high probability to detect an effect at 300-350 ms post-stimulus onset. A three-phase unifying model revolving around the process of sensemaking is then suggested: (1) early AG involvement in defining the current context, within the first 200 ms, with a bias toward the right hemisphere; (2) attention re-orientation and retrieval of relevant information within 200-500 ms; and (3) cross-modal integration at late latencies with a bias toward the left hemisphere. This sensemaking process can favour accuracy (e.g. for word and number processing) or plausibility (e.g. for comprehension and social cognition). Such functions of the AG depend on the status of other connected regions. The much-debated semantic role is also discussed as follows: (1) there is a strong TMS/TES evidence for a causal semantic role, (2) current EEG/MEG evidence is however weak, but (3) the existing arguments against a semantic role for the AG are not strong. Some outstanding questions for future research are proposed. This review recognizes that cracking the role(s) of the AG in cognition is possible only when its exact contributions within the default mode network are teased apart.
Collapse
Affiliation(s)
- Mohamed L Seghier
- Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, UAE. .,Healthcare Engineering Innovation Center (HEIC), Khalifa University of Science and Technology, Abu Dhabi, UAE.
| |
Collapse
|
26
|
Portnova G, Nekrashevich M, Morozova M, Martynova O, Sharaev M. New approaches to Clinical Electroencephalography analysis in typically developing children and children with autism. COGN SYST RES 2022. [DOI: 10.1016/j.cogsys.2022.11.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
27
|
EEG-based analysis of various sensory stimulation effects to reduce visually induced motion sickness in virtual reality. Sci Rep 2022; 12:18043. [PMID: 36302810 PMCID: PMC9613667 DOI: 10.1038/s41598-022-21307-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Accepted: 09/26/2022] [Indexed: 01/24/2023] Open
Abstract
The use of virtual reality (VR) is frequently accompanied by motion sickness, and approaches for preventing it are not yet well established. We explored the effects of synchronized presentations of sound and motion on visually induced motion sickness (VIMS) in order to reduce VIMS. A total of 25 participants bicycle riding for 5 min with or without sound and motion synchronization presented on a head-mounted display. As a result, the VIMS scores measured by the fast motion sickness scale and simulator sickness questionnaire were significantly lower in the participants who experienced the riding scene with sound and motion than those who experienced the riding scene with sound only, motion only, or neither. Furthermore, analysis of the EEG signal showed that the higher the VIMS, the significant increase in alpha and theta waves in the parietal and occipital lobes. Therefore, we demonstrate that the simultaneous presentation of sound and motion, closely associated with synchronous and visual flow speed, is effective in reducing VIMS while experiencing simulated bicycle riding in a VR environment.
Collapse
|
28
|
Effects of Olfactory Stimulation with Aroma Oils on Psychophysiological Responses of Female Adults. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19095196. [PMID: 35564590 PMCID: PMC9102723 DOI: 10.3390/ijerph19095196] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/13/2022] [Revised: 04/06/2022] [Accepted: 04/23/2022] [Indexed: 11/16/2022]
Abstract
This study investigated the effects of olfactory stimulation with aroma oils on the psychophysiological responses in women. Ten aromatic oils (lavender, rosemary, rose, eucalyptus, jasmine, geranium, chamomile, clary sage, thyme, and peppermint) were used on 23 women aged between 20 and 60 years. They inhaled the scent for 90 s through a glass funnel attached to their lab apron, 10 cm below their nose, while the pump was activated. Electroencephalography, blood pressure, and pulse rate were measured before and during inhalation of the aroma oils. The relative alpha (RA) power spectrums indicating relaxation and resting state of the brain significantly increased when lavender, rosemary, eucalyptus, jasmine, chamomile, clary sage, and thyme oils were inhaled compared to those of before olfactory stimulation. The ratio of alpha to high beta (RAHB), an indicator of brain stability and relaxation, significantly increased when rosemary, jasmine, clary sage, and peppermint oils were inhaled. The relative low beta (RLB) power spectrum, an indicator of brain activity in the absence of stress, significantly increased when stimulated with lavender, rosemary, rose, and geranium scents. Further, systolic blood pressure significantly decreased after introduction of all 10 types of aromatic oils, which indicates stress reduction. Thus, olfactory stimulation with aroma oil had a stabilizing effect on the prefrontal cortex and brain activity and decreased systolic blood pressure.
Collapse
|
29
|
Attention Measurement of an Autism Spectrum Disorder User Using EEG Signals: A Case Study. MATHEMATICAL AND COMPUTATIONAL APPLICATIONS 2022. [DOI: 10.3390/mca27020021] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
Autism Spectrum Disorder (ASD) is a neurodevelopmental life condition characterized by problems with social interaction, low verbal and non-verbal communication skills, and repetitive and restricted behavior. People with ASD usually have variable attention levels because they have hypersensitivity and large amounts of environmental information are a problem for them. Attention is a process that occurs at the cognitive level and allows us to orient ourselves towards relevant stimuli, ignoring those that are not, and act accordingly. This paper presents a methodology based on electroencephalographic (EEG) signals for attention measurement in a 13-year-old boy diagnosed with ASD. The EEG signals are acquired with an Epoc+ Brain–Computer Interface (BCI) via the Emotiv Pro platform while developing several learning activities and using Matlab 2019a for signal processing. For this article, we propose to use electrodes F3, F4, P7, and P8. Then, we calculate the band power spectrum density to detect the Theta Relative Power (TRP), Alpha Relative Power (ARP), Beta Relative Power (BRP), Theta–Beta Ratio (TBR), Theta–Alpha Ratio (TAR), and Theta/(Alpha+Beta), which are features related to attention detection and neurofeedback. We train and evaluate several machine learning (ML) models with these features. In this study, the multi-layer perceptron neural network model (MLP-NN) has the best performance, with an AUC of 0.9299, Cohen’s Kappa coefficient of 0.8597, Matthews correlation coefficient of 0.8602, and Hamming loss of 0.0701. These findings make it possible to develop better learning scenarios according to the person’s needs with ASD. Moreover, it makes it possible to obtain quantifiable information on their progress to reinforce the perception of the teacher or therapist.
Collapse
|
30
|
Chen CC, Tsai MC, Wu EHK, Chung CR, Lee Y, Chiu PR, Tsai PY, Sheng SR, Yeh SC. Neuronal Abnormalities Induced by an Intelligent Virtual Reality System for Methamphetamine Use Disorder. IEEE J Biomed Health Inform 2022; 26:3458-3465. [PMID: 35226611 DOI: 10.1109/jbhi.2022.3154759] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Methamphetamine use disorder (MUD) is a brain disease that leads to altered regional neuronal activity. Virtual reality (VR) is used to induce the drug cue reactivity. Previous studies reported significant frequency-specific abnormalities in patients with MUD during VR induction of drug craving. However, whether those patients exhibit neuronal abnormalities after VR induction that could serve as the treatment target remains unclear. Here, we developed an integrated VR system for inducing drug related changes and investigated the neuronal abnormalities after VR exposure in patients. Fifteen patients with MUD and ten healthy subjects were recruited and exposed to drug-related VR environments. Resting-state EEG were recorded for 5 minutes twice-before and after VR and transformed to obtain the frequency-specific data. Three self-reported scales for measurement of the anxiety levels and impulsivity of participants were obtained after VR task. Statistical tests and machine learning methods were employed to reveal the differences between patients and healthy subjects. The result showed that patients with MUD and healthy subjects significantly differed in, and power changes after VR. These neuronal abnormalities in patients were associated with the self-reported behavioral scales, indicating impaired impulse control. Our findings of resting-state EEG abnormalities in patients with MUD after VR exposure have the translation value and can be used to develop the treatment strategies for methamphetamine use disorder.
Collapse
|
31
|
Jaafar N, Che Daud AZ, Ahmad Roslan NF, Mansor W. Mirror Therapy Rehabilitation in Stroke: A Scoping Review of Upper Limb Recovery and Brain Activities. Rehabil Res Pract 2021; 2021:9487319. [PMID: 35003808 PMCID: PMC8741383 DOI: 10.1155/2021/9487319] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2021] [Accepted: 12/10/2021] [Indexed: 11/17/2022] Open
Abstract
BACKGROUND Mirror therapy (MT) has been used as a treatment for various neurological disorders. Recent application of electroencephalogram (EEG) to the MT study allows researchers to gain insight into the changes in brain activity during the therapy. OBJECTIVE This scoping review is aimed at mapping existing evidence and identifying knowledge gaps about the effects of MT on upper limb recovery and its application for individuals with chronic stroke. METHODS AND MATERIALS A scoping review through a systematic literature search was conducted using PubMed, CINAHL, PsycINFO, and Scopus databases. Twenty articles published between 2010 and 2020 met the inclusion criteria. The efficacy of MT on upper limb recovery and brain activity during MT were discussed according to the International Classification of Functioning, Disability and Health (ICF). RESULTS A majority of the studies indicated positive effects of MT on upper limb recovery from the body structure/functional domain. All studies used EEG to indicate brain activation during MT. CONCLUSION MT is a promising intervention for improving upper limb function for individuals with chronic stroke. This review also highlights the need to incorporate EEG into the MT study to capture brain activity and understand the mechanism underlying the therapy.
Collapse
Affiliation(s)
- Nurulhuda Jaafar
- Centre for Occupational Therapy Studies, Faculty of Health Sciences, Universiti Teknologi MARA, Puncak Alam, Selangor, Malaysia
| | - Ahmad Zamir Che Daud
- Centre for Occupational Therapy Studies, Faculty of Health Sciences, Universiti Teknologi MARA, Puncak Alam, Selangor, Malaysia
| | - Nor Faridah Ahmad Roslan
- Department of Rehabilitation Medicine, Faculty of Medicine, Universiti Teknologi MARA, Sungai Buloh, Selangor, Malaysia
| | - Wahidah Mansor
- Microwave Research Institute, Universiti Teknologi MARA, Shah Alam, Selangor, Malaysia
- School of Electrical Engineering, College of Engineering, UiTM Shah Alam, Malaysia
- Computational Intelligence Detection, Health & Wellness ReNeU, UiTM Shah Alam, Malaysia
| |
Collapse
|
32
|
Mental Fatigue-Associated Decrease in Table Tennis Performance: Is There an Electrophysiological Signature? INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:ijerph182412906. [PMID: 34948514 PMCID: PMC8700914 DOI: 10.3390/ijerph182412906] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Revised: 12/01/2021] [Accepted: 12/05/2021] [Indexed: 02/08/2023]
Abstract
Mental fatigue (MF) is a psychobiological state negatively impacting both cognitive and physical performance. Although recent research implies that some table tennis (TT) performance outcomes are impaired by MF, open skill sports such as TT require a more detailed overview of MF-related performance decrements. Moreover, research into MF and sport-specific psychomotor performance lacks the inclusion of brain-related measurements to identify MF mechanisms. Eleven experienced TT players participated in this randomized counterbalanced crossover trial. Participants were either required to perform an individualized Stroop task (MF condition) or watch a documentary (control condition). The primary outcomes were reaction time on a sport-specific visuomotor task and EEG activity throughout the trial. The subjective feeling of MF was significantly different between both conditions and confirmed that the MF condition induced the mentally fatigue state of participants (p < 0.001), though no behavioral indicators (i.e., decrease in performance on Stroop and flanker task) of MF. MF worsened reaction time on the visuomotor task, while other secondary measurements remained largely ambiguous. Spectral power (i.e., decreases in upper α band and θ band) was influenced by MF, while ERPs measured during the visuomotor task remained unaltered. The present study confirms that MF negatively impacts table tennis performance, specifically inhibitory stimuli during the visuomotor task. These findings also further augment our understanding of the effects of MF on human performance.
Collapse
|
33
|
Nürnberger M, Klingner C, Witte OW, Brodoehl S. Mismatch of Visual-Vestibular Information in Virtual Reality: Is Motion Sickness Part of the Brains Attempt to Reduce the Prediction Error? Front Hum Neurosci 2021; 15:757735. [PMID: 34776909 PMCID: PMC8586552 DOI: 10.3389/fnhum.2021.757735] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2021] [Accepted: 10/07/2021] [Indexed: 11/13/2022] Open
Abstract
Visually induced motion sickness (VIMS) is a relevant limiting factor in the use of virtual reality (VR) devices. Understanding the origin of this problem might help to develop strategies to circumvent this limitation. Previous studies have attributed VIMS to a mismatch between visual, and vestibular information, causing ambiguity of the position of the body in relation to its surrounding. Studies using EEG have shown a shift of the power spectrum to lower frequencies while VIMS is experienced. However, little is known about the relationship between the intensity of the VIMS and the changes in these power spectra. Moreover, the effect of different varieties of VIMS on the causal relationship between brain areas is largely unknown. Here, we used EEG to study 14 healthy subjects in a VR environment who were exposed to increasing levels of mismatch between vestibular and visual information. The frequency power and the bivariate transfer entropy as a measure for the information transfer were calculated. We found a direct association between increasing mismatch levels and subjective VIMS. With increasing VIMS, the proportion of slow EEG waves (especially 1–10 Hz) increases, especially in temporo-occipital regions. Furthermore, we found a general decrease in the information flow in most brain areas but especially in brain areas involved in the processing of vestibular signals and the detection of self-motion. We hypothesize that the general shift of frequency power and the decrease in information flow while experiencing high intensity VIMS represent a brain state of a reduced ability to receive, transmit and process information. We further hypothesize that the mechanism of reduced information flow is a general reaction of the brain to an unresolvable mismatch of information. This reaction aims on transforming a currently unstable model with a high prediction error into a stable model in an environment of minimal contradictory information.
Collapse
Affiliation(s)
- Matthias Nürnberger
- Hans Berger Department of Neurology, Jena University Hospital, Friedrich Schiller University Jena, Jena, Germany.,Biomagnetic Center, Jena University Hospital, Friedrich Schiller University Jena, Jena, Germany
| | - Carsten Klingner
- Hans Berger Department of Neurology, Jena University Hospital, Friedrich Schiller University Jena, Jena, Germany.,Biomagnetic Center, Jena University Hospital, Friedrich Schiller University Jena, Jena, Germany
| | - Otto W Witte
- Hans Berger Department of Neurology, Jena University Hospital, Friedrich Schiller University Jena, Jena, Germany
| | - Stefan Brodoehl
- Hans Berger Department of Neurology, Jena University Hospital, Friedrich Schiller University Jena, Jena, Germany.,Biomagnetic Center, Jena University Hospital, Friedrich Schiller University Jena, Jena, Germany
| |
Collapse
|
34
|
Kutafina E, Heiligers A, Popovic R, Brenner A, Hankammer B, Jonas SM, Mathiak K, Zweerings J. Tracking of Mental Workload with a Mobile EEG Sensor. SENSORS 2021; 21:s21155205. [PMID: 34372445 PMCID: PMC8348794 DOI: 10.3390/s21155205] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/08/2021] [Revised: 07/23/2021] [Accepted: 07/28/2021] [Indexed: 12/04/2022]
Abstract
The aim of the present investigation was to assess if a mobile electroencephalography (EEG) setup can be used to track mental workload, which is an important aspect of learning performance and motivation and may thus represent a valuable source of information in the evaluation of cognitive training approaches. Twenty five healthy subjects performed a three-level N-back test using a fully mobile setup including tablet-based presentation of the task and EEG data collection with a self-mounted mobile EEG device at two assessment time points. A two-fold analysis approach was chosen including a standard analysis of variance and an artificial neural network to distinguish the levels of cognitive load. Our findings indicate that the setup is feasible for detecting changes in cognitive load, as reflected by alterations across lobes in different frequency bands. In particular, we observed a decrease of occipital alpha and an increase in frontal, parietal and occipital theta with increasing cognitive load. The most distinct levels of cognitive load could be discriminated by the integrated machine learning models with an accuracy of 86%.
Collapse
Affiliation(s)
- Ekaterina Kutafina
- Institute of Medical Informatics, Medical Faculty, RWTH Aachen University, 52074 Aachen, Germany; (R.P.); (B.H.)
- Faculty of Applied Mathematics, AGH University of Science and Technology, 30-059 Krakow, Poland
- Correspondence:
| | - Anne Heiligers
- Department of Psychiatry, Psychotherapy and Psychosomatics, School of Medicine, RWTH Aachen University, 52074 Aachen, Germany; (A.H.); (K.M.); (J.Z.)
| | - Radomir Popovic
- Institute of Medical Informatics, Medical Faculty, RWTH Aachen University, 52074 Aachen, Germany; (R.P.); (B.H.)
| | - Alexander Brenner
- Institute of Medical Informatics, University of Münster, 48149 Münster, Germany;
| | - Bernd Hankammer
- Institute of Medical Informatics, Medical Faculty, RWTH Aachen University, 52074 Aachen, Germany; (R.P.); (B.H.)
| | - Stephan M. Jonas
- Department of Informatics, Technical University of Munich, 85748 Garching, Germany;
| | - Klaus Mathiak
- Department of Psychiatry, Psychotherapy and Psychosomatics, School of Medicine, RWTH Aachen University, 52074 Aachen, Germany; (A.H.); (K.M.); (J.Z.)
| | - Jana Zweerings
- Department of Psychiatry, Psychotherapy and Psychosomatics, School of Medicine, RWTH Aachen University, 52074 Aachen, Germany; (A.H.); (K.M.); (J.Z.)
| |
Collapse
|
35
|
Jiang S, Deng L, Luo H, Li X, Guo B, Jiang M, Jia Y, Ma J, Sun L, Huang Z. Effect of Fragrant Primula Flowers on Physiology and Psychology in Female College Students: An Empirical Study. Front Psychol 2021; 12:607876. [PMID: 33708159 PMCID: PMC7940201 DOI: 10.3389/fpsyg.2021.607876] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2020] [Accepted: 02/01/2021] [Indexed: 01/08/2023] Open
Abstract
Indoor plants can positively impact physical and mental health in daily life. However, the benefits of viewing indoor plants may be enhanced if the plants emit a fragrant aroma. In this crossover-design study, we measured the physiological and psychological effects of fragrant and non-fragrant Primula plants on 50 female college students, and explored whether aroma stimulation had additive benefits for this group. Non-fragrant Primula malacoides Franch was used as a control stimulus, and Primula forbesii Franch, which has a floral fragrance, was used as an experimental stimulus. We measured blood pressure, pulse rate, and electroencephalogram (EEG) to evaluate physiological responses, and used a mood state profile and the semantic differential (SD) method to evaluate psychological responses. We found that mean blood pressure and pulse rate decreased significantly after the experiment in both conditions. EEGs showed that the mean values of high alpha waves, high beta waves, and relaxation scores were significantly higher in the experimental vs. control condition. The average scores on each subscale of the psychological questionnaire improved after the experiment in both conditions, and the vitality (V) subscale and total emotional state scores were significantly better in the experimental vs. control condition. The results of the SD method showed that the sense of relaxation and comfort were significantly higher in the experimental vs. control condition. Compared with the non-fragrant Primula, the fragrant Primula induced relatively better physiological and psychological effects.
Collapse
Affiliation(s)
- Songlin Jiang
- College of Landscape Architecture, Sichuan Agricultural University, Chengdu, China
| | - Li Deng
- College of Landscape Architecture, Sichuan Agricultural University, Chengdu, China
| | - Hao Luo
- College of Landscape Architecture, Sichuan Agricultural University, Chengdu, China
| | - Xi Li
- College of Landscape Architecture, Sichuan Agricultural University, Chengdu, China
| | - Baimeng Guo
- College of Landscape Architecture, Sichuan Agricultural University, Chengdu, China
| | - Mingyan Jiang
- College of Landscape Architecture, Sichuan Agricultural University, Chengdu, China
| | - Yin Jia
- College of Landscape Architecture, Sichuan Agricultural University, Chengdu, China
| | - Jun Ma
- College of Landscape Architecture, Sichuan Agricultural University, Chengdu, China
| | - Lingxia Sun
- College of Landscape Architecture, Sichuan Agricultural University, Chengdu, China
| | - Zhuo Huang
- College of Landscape Architecture, Sichuan Agricultural University, Chengdu, China
| |
Collapse
|