1
|
Bulaj G, Coleman M, Johansen B, Kraft S, Lam W, Phillips K, Rohaj A. Redesigning Pharmacy to Improve Public Health Outcomes: Expanding Retail Spaces for Digital Therapeutics to Replace Consumer Products That Increase Mortality and Morbidity Risks. PHARMACY 2024; 12:107. [PMID: 39051391 PMCID: PMC11270305 DOI: 10.3390/pharmacy12040107] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2024] [Revised: 06/26/2024] [Accepted: 07/09/2024] [Indexed: 07/27/2024] Open
Abstract
United States healthcare outcomes, including avoidable mortality rates, are among the worst of high-income countries despite the highest healthcare spending per capita. While community pharmacies contribute to chronic disease management and preventive medicine, they also offer consumer products that increase mortality risks and the prevalence of cardiovascular diseases, diabetes, cancer, and depression. To resolve these contradictions, our perspective article describes opportunities for major pharmacy chains (e.g., CVS Pharmacy and Walgreens) to introduce digital health aisles dedicated to prescription and over-the-counter digital therapeutics (DTx), together with mobile apps and wearables that support disease self-management, wellness, and well-being. We provide an evidence-based rationale for digital health aisles to replace spaces devoted to sugar-sweetened beverages and other unhealthy commodities (alcohol, tobacco) that may increase risks for premature death. We discuss how digital health aisles can serve as marketing and patient education resources, informing customers about commercially available DTx and other technologies that support healthy lifestyles. Since pharmacy practice requires symbiotic balancing between profit margins and patient-centered, value-based care, replacing health-harming products with health-promoting technologies could positively impact prevention of chronic diseases, as well as the physical and mental health of patients and caregivers who visit neighborhood pharmacies in order to pick up medicines.
Collapse
Affiliation(s)
- Grzegorz Bulaj
- Department of Medicinal Chemistry, College of Pharmacy, University of Utah, Salt Lake City, UT 84112, USA
| | - Melissa Coleman
- College of Pharmacy, University of Utah, Salt Lake City, UT 84112, USA
| | - Blake Johansen
- College of Pharmacy, University of Utah, Salt Lake City, UT 84112, USA
| | - Sarah Kraft
- Independent Researcher, Salt Lake City, UT 84112, USA
| | - Wayne Lam
- College of Pharmacy, University of Utah, Salt Lake City, UT 84112, USA
| | - Katie Phillips
- College of Pharmacy, University of Utah, Salt Lake City, UT 84112, USA
| | - Aarushi Rohaj
- Department of Medicinal Chemistry, College of Pharmacy, University of Utah, Salt Lake City, UT 84112, USA
- The Spencer Fox Eccles School of Medicine, University of Utah, Salt Lake City, UT 84112, USA
| |
Collapse
|
2
|
Scheutz M, Aeron S, Aygun A, de Ruiter JP, Fantini S, Fernandez C, Haga Z, Nguyen T, Lyu B. Estimating Systemic Cognitive States from a Mixture of Physiological and Brain Signals. Top Cogn Sci 2024; 16:485-526. [PMID: 37389823 DOI: 10.1111/tops.12669] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2021] [Revised: 05/16/2023] [Accepted: 05/16/2023] [Indexed: 07/01/2023]
Abstract
As human-machine teams are being considered for a variety of mixed-initiative tasks, detecting and being responsive to human cognitive states, in particular systematic cognitive states, is among the most critical capabilities for artificial systems to ensure smooth interactions with humans and high overall team performance. Various human physiological parameters, such as heart rate, respiration rate, blood pressure, and skin conductance, as well as brain activity inferred from functional near-infrared spectroscopy or electroencephalogram, have been linked to different systemic cognitive states, such as workload, distraction, or mind-wandering among others. Whether these multimodal signals are indeed sufficient to isolate such cognitive states across individuals performing tasks or whether additional contextual information (e.g., about the task state or the task environment) is required for making appropriate inferences remains an important open problem. In this paper, we introduce an experimental and machine learning framework for investigating these questions and focus specifically on using physiological and neurophysiological measurements to learn classifiers associated with systemic cognitive states like cognitive load, distraction, sense of urgency, mind wandering, and interference. Specifically, we describe a multitasking interactive experimental setting used to obtain a comprehensive multimodal data set which provided the foundation for a first evaluation of various standard state-of-the-art machine learning techniques with respect to their effectiveness in inferring systemic cognitive states. While the classification success of these standard methods based on just the physiological and neurophysiological signals across subjects was modest, which is to be expected given the complexity of the classification problem and the possibility that higher accuracy rates might not in general be achievable, the results nevertheless can serve as a baseline for evaluating future efforts to improve classification, especially methods that take contextual aspects such as task and environmental states into account.
Collapse
Affiliation(s)
| | - Shuchin Aeron
- Department of Electrical and Computer Engineering, Tufts University
| | - Ayca Aygun
- Department of Computer Science, Tufts University
| | - J P de Ruiter
- Department of Computer Science, Tufts University
- Department of Psychology, Tufts University
| | | | | | - Zachary Haga
- Department of Computer Science, Tufts University
| | - Thuan Nguyen
- Department of Computer Science, Tufts University
| | - Boyang Lyu
- Department of Electrical and Computer Engineering, Tufts University
| |
Collapse
|
3
|
Cannard C, Delorme A, Wahbeh H. HRV and EEG correlates of well-being using ultra-short, portable, and low-cost measurements. PROGRESS IN BRAIN RESEARCH 2024; 287:91-109. [PMID: 39097360 DOI: 10.1016/bs.pbr.2024.04.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/05/2024]
Abstract
Wearable electroencephalography (EEG) and electrocardiography (ECG) devices may offer a non-invasive, user-friendly, and cost-effective approach for assessing well-being (WB) in real-world settings. However, challenges remain in dealing with signal artifacts (such as environmental noise and movements) and identifying robust biomarkers. We evaluated the feasibility of using portable hardware to identify potential EEG and heart-rate variability (HRV) correlates of WB. We collected simultaneous ultrashort (2-min) EEG and ECG data from 60 individuals in real-world settings using a wrist ECG electrode connected to a 4-channel wearable EEG headset. These data were processed, assessed for signal quality, and analyzed using the open-source EEGLAB BrainBeats plugin to extract several theory-driven metrics as potential correlates of WB. Namely, the individual alpha frequency (IAF), frontal and posterior alpha asymmetry, and signal entropy for EEG. SDNN, the low/high frequency (LF/HF) ratio, the Poincaré SD1/SD2 ratio, and signal entropy for HRV. We assessed potential associations between these features and the main WB dimensions (hedonic, eudaimonic, global, physical, and social) implementing a pairwise correlation approach, robust Spearman's correlations, and corrections for multiple comparisons. Only eight files showed poor signal quality and were excluded from the analysis. Eudaimonic (psychological) WB was positively correlated with SDNN and the LF/HF ratio. EEG posterior alpha asymmetry was positively correlated with Physical WB (i.e., sleep and pain levels). No relationships were found with the other metrics, or between EEG and HRV metrics. These physiological metrics enable a quick, objective assessment of well-being in real-world settings using scalable, user-friendly tools.
Collapse
Affiliation(s)
- Cédric Cannard
- Centre de Recherche Cerveau et Cognition (CerCo), CNRS, Paul Sabatier University, Toulouse, France; Institute of Noetic Sciences (IONS), Petaluma, CA, United States
| | - Arnaud Delorme
- Centre de Recherche Cerveau et Cognition (CerCo), CNRS, Paul Sabatier University, Toulouse, France; Institute of Noetic Sciences (IONS), Petaluma, CA, United States; Swartz Center of Computational Neuroscience (SCCN), University of California San Diego (UCSD), La Jolla, CA, United States
| | - Helané Wahbeh
- Institute of Noetic Sciences (IONS), Petaluma, CA, United States; Department of Neurology, Oregon Health & Science University, Portland, OR, United States.
| |
Collapse
|
4
|
Risqiwati D, Wibawa AD, Pane ES, Yuniarno EM, Islamiyah WR, Purnomo MH. Effective relax acquisition: a novel approach to classify relaxed state in alpha band EEG-based transformation. Brain Inform 2024; 11:12. [PMID: 38740660 DOI: 10.1186/s40708-024-00225-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2023] [Accepted: 04/17/2024] [Indexed: 05/16/2024] Open
Abstract
A relaxed state is essential for effective hypnotherapy, a crucial component of mental health treatments. During hypnotherapy sessions, neurologists rely on the patient's relaxed state to introduce positive suggestions. While EEG is a widely recognized method for detecting human emotions, analyzing EEG data presents challenges due to its multi-channel, multi-band nature, leading to high-dimensional data. Furthermore, determining the onset of relaxation remains challenging for neurologists. This paper presents the Effective Relax Acquisition (ERA) method designed to identify the beginning of a relaxed state. ERA employs sub-band sampling within the Alpha band for the frequency domain and segments the data into four-period groups for the time domain analysis. Data enhancement strategies include using Window Length (WL) and Overlapping Shifting Windows (OSW) scenarios. Dimensionality reduction is achieved through Principal Component Analysis (PCA) by prioritizing the most significant eigenvector values. Our experimental results indicate that the relaxed state is predominantly observable in the high Alpha sub-band, particularly within the fourth period group. The ERA demonstrates high accuracy with a WL of 3 s and OSW of 0.25 s using the KNN classifier (90.63%). These findings validate the effectiveness of ERA in accurately identifying relaxed states while managing the complexity of EEG data.
Collapse
Affiliation(s)
- Diah Risqiwati
- Departement of Electrical Engineering, Institut Teknologi Sepuluh Nopember, Keputih, Surabaya, 60111, Indonesia
- Departement of Informatics, Universitas Muhammadiyah Malang, Tlogomas, Malang, 65144, Indonesia
| | - Adhi Dharma Wibawa
- Departement of Electrical Engineering, Institut Teknologi Sepuluh Nopember, Keputih, Surabaya, 60111, Indonesia
- Medical Technology, Institut Teknologi Sepuluh Nopember, Keputih, Surabaya, 60111, Indonesia
| | - Evi Septiana Pane
- Industrial Training and Education of Surabaya, Ministry of Industry RI, Gayungan, Surabaya, 60235, Indonesia
| | - Eko Mulyanto Yuniarno
- Departement of Electrical Engineering, Institut Teknologi Sepuluh Nopember, Keputih, Surabaya, 60111, Indonesia
- Departement of Computer Engineering, Institut Teknologi Sepuluh Nopember, Keputih, Surabaya, 60111, Indonesia
| | - Wardah Rahmatul Islamiyah
- Neurology Department, Faculty of Medicine, Universitas Airlangga, Gubeng, Surabaya, 60131, Indonesia
| | - Mauridhi Hery Purnomo
- Departement of Electrical Engineering, Institut Teknologi Sepuluh Nopember, Keputih, Surabaya, 60111, Indonesia.
- Departement of Computer Engineering, Institut Teknologi Sepuluh Nopember, Keputih, Surabaya, 60111, Indonesia.
| |
Collapse
|
5
|
Zolfaghari S, Yousefi Rezaii T, Meshgini S. Applying Common Spatial Pattern and Convolutional Neural Network to Classify Movements via EEG Signals. Clin EEG Neurosci 2024:15500594241234836. [PMID: 38523306 DOI: 10.1177/15500594241234836] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/26/2024]
Abstract
Developing an electroencephalography (EEG)-based brain-computer interface (BCI) system is crucial to enhancing the control of external prostheses by accurately distinguishing various movements through brain signals. This innovation can provide comfortable circumstances for the populace who have movement disabilities. This study combined the most prospering methods used in BCI systems, including one-versus-rest common spatial pattern (OVR-CSP) and convolutional neural network (CNN), to automatically extract features and classify eight different movements of the shoulder, wrist, and elbow via EEG signals. The number of subjects who participated in the experiment was 10, and their EEG signals were recorded while performing movements at fast and slow speeds. We used preprocessing techniques before transforming EEG signals into another space by OVR-CSP, followed by sending signals into the CNN architecture consisting of four convolutional layers. Moreover, we extracted feature vectors after applying OVR-CSP and considered them as inputs to KNN, SVM, and MLP classifiers. Then, the performance of these classifiers was compared with the CNN method. The results demonstrated that the classification of eight movements using the proposed CNN architecture obtained an average accuracy of 97.65% for slow movements and 96.25% for fast movements in the subject-independent model. This method outperformed other classifiers with a substantial difference; ergo, it can be useful in improving BCI systems for better control of prostheses.
Collapse
Affiliation(s)
- Sepideh Zolfaghari
- Department of Biomedical Engineering, Faculty of Electrical and Computer Engineering, University of Tabriz, Tabriz, Iran
| | - Tohid Yousefi Rezaii
- Department of Biomedical Engineering, Faculty of Electrical and Computer Engineering, University of Tabriz, Tabriz, Iran
| | - Saeed Meshgini
- Department of Biomedical Engineering, Faculty of Electrical and Computer Engineering, University of Tabriz, Tabriz, Iran
| |
Collapse
|
6
|
Jeong I, Kaneko N, Takahashi R, Nakazawa K. High-skilled first-person shooting game players have specific frontal lobe activity: Power spectrum analysis in an electroencephalogram study. Neurosci Lett 2024; 825:137685. [PMID: 38367797 DOI: 10.1016/j.neulet.2024.137685] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Revised: 02/01/2024] [Accepted: 02/09/2024] [Indexed: 02/19/2024]
Abstract
First-person shooting (FPS) games are among the most famous video games worldwide. However, cortical activities in environments related to real FPS games have not been studied. This study aimed to determine differences in cortical activity between low- and high-skilled FPS game players using 160-channel electroencephalography. Nine high-skilled FPS game players (official ranks: above the top 10%) and eight low-skilled FPS game players (official ranks: lower than the top 20%) were recruited for the experiment. The task was set for five different conditions using the AimLab program, which was used for the FPS game players' training. Additionally, we recorded the brain activity in the resting condition before and after the task, in which the participants closed their eyes and relaxed. The reaction time and accuracy (the number of hit-and-miss targets) were calculated to evaluate the task performance. The results showed that high-skilled FPS game players have fast reaction times and high accuracy during tasks. High-skilled FPS game players had higher cortical activity in the frontal cortex than low-skilled FPS game players during each task. In low-skilled players, cortical activity level and performance level were associated. These results suggest that high cortical activity levels were critical to achieving high performance in FPS games.
Collapse
Affiliation(s)
- Inhyeok Jeong
- Graduate School of Arts and Sciences, Department of Life Sciences, The University of Tokyo, 3-8-1 Komaba, Meguro, Tokyo 153-8902, Japan
| | - Naotsugu Kaneko
- Graduate School of Arts and Sciences, Department of Life Sciences, The University of Tokyo, 3-8-1 Komaba, Meguro, Tokyo 153-8902, Japan
| | - Ryogo Takahashi
- Graduate School of Arts and Sciences, Department of Life Sciences, The University of Tokyo, 3-8-1 Komaba, Meguro, Tokyo 153-8902, Japan
| | - Kimitaka Nakazawa
- Graduate School of Arts and Sciences, Department of Life Sciences, The University of Tokyo, 3-8-1 Komaba, Meguro, Tokyo 153-8902, Japan.
| |
Collapse
|
7
|
Kleeva D, Ninenko I, Lebedev MA. Resting-state EEG recorded with gel-based vs. consumer dry electrodes: spectral characteristics and across-device correlations. Front Neurosci 2024; 18:1326139. [PMID: 38370431 PMCID: PMC10873917 DOI: 10.3389/fnins.2024.1326139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2023] [Accepted: 01/05/2024] [Indexed: 02/20/2024] Open
Abstract
Introduction Recordings of electroencephalographic (EEG) rhythms and their analyses have been instrumental in basic neuroscience, clinical diagnostics, and the field of brain-computer interfaces (BCIs). While in the past such measurements have been conducted mostly in laboratory settings, recent advancements in dry electrode technology pave way to a broader range of consumer and medical application because of their greater convenience compared to gel-based electrodes. Methods Here we conducted resting-state EEG recordings in two groups of healthy participants using three dry-electrode devices, the PSBD Headband, the PSBD Headphones and the Muse Headband, and one standard gel electrode-based system, the NVX. We examined signal quality for various spatial and spectral ranges which are essential for cognitive monitoring and consumer applications. Results Distinctive characteristics of signal quality were found, with the PSBD Headband showing sensitivity in low-frequency ranges and replicating the modulations of delta, theta and alpha power corresponding to the eyes-open and eyes-closed conditions, and the NVX system performing well in capturing high-frequency oscillations. The PSBD Headphones were more prone to low-frequency artifacts compared to the PSBD Headband, yet recorded modulations in the alpha power and had a strong alignment with the NVX at the higher EEG frequencies. The Muse Headband had several limitations in signal quality. Discussion We suggest that while dry-electrode technology appears to be appropriate for the EEG rhythm-based applications, the potential benefits of these technologies in terms of ease of use and accessibility should be carefully weighed against the capacity of each given system.
Collapse
Affiliation(s)
- Daria Kleeva
- Vladimir Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, Moscow, Russia
- Institute for Cognitive Neuroscience, HSE University, Moscow, Russia
- MSU Institute for Artificial Intelligence, Lomonosov Moscow State University, Moscow, Russia
| | - Ivan Ninenko
- Institute for Cognitive Neuroscience, HSE University, Moscow, Russia
| | - Mikhail A. Lebedev
- Faculty of Mechanics and Mathematics, Lomonosov Moscow State University, Moscow, Russia
- I. M. Sechenov Institute of Evolutionary Physiology and Biochemistry, Saint Petersburg, Russia
| |
Collapse
|
8
|
Motolese F, Stelitano D, Lanzone J, Albergo G, Cruciani A, Masciulli C, Musumeci G, Pilato F, Rossi M, Ribolsi M, Di Lazzaro V, Capone F. Feasibility and efficacy of an at-home, smart-device aided mindfulness program in people with Multiple Sclerosis. Mult Scler Relat Disord 2023; 78:104931. [PMID: 37603929 DOI: 10.1016/j.msard.2023.104931] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2023] [Revised: 07/16/2023] [Accepted: 08/04/2023] [Indexed: 08/23/2023]
Abstract
BACKGROUND Multiple Sclerosis (MS) is a chronic disease with a high prevalence of neuropsychiatric symptoms. Mindfulness is a practice that encourages individuals to cultivate a present-focused, acceptance-based approach for managing psychological distress. Its positive effect on MS has been demonstrated, but learning such technique is expensive and time-consuming. In this study, we investigated the feasibility and efficacy of an 8-week, at-home, smart-device aided mindfulness program in a cohort of MS patients. Specifically, we explored the role of a brain-sensing headband providing real-time auditory feedback as supportive tool for meditation exercises. METHODS The study included two visits, one at baseline and another after the mindfulness program. We measured adherence to the proposed mindfulness treatment and its effect on questionnaires investigating different psychological domains, cognition, fatigue, quality of life and quantitative EEG parameters. All participants received a smart biofeedback device to be used during the therapeutic program consisting of daily meditative exercises. RESULTS Twenty-nine patients were recruited for the present study. Among them, 27 (93%) completed the entire program and 17 (63%) completed more than 80% of the scheduled sessions. We observed a statistically significant reduction of the Ruminative Response Scale score and a significant increase of the Digit Span Backward. Regarding neurophysiological data, we found a significant reduction of the whole-scalp beta and parieto-occipital theta power post intervention. CONCLUSION Our results show that an at-home, smart-device aided mindfulness program is feasible for people with MS. The efficacy in terms of reappraisals of stress, cognitive and emotional coping responses is also supported by our neurophysiological data. Further studies are warranted to better explore the role of such approaches in managing the psychological impact of MS diagnosis.
Collapse
Affiliation(s)
- Francesco Motolese
- Department of Medicine and Surgery, Unit of Neurology, Neurophysiology, Neurobiology and Psichiatry, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo, 21 - 00128 Roma, Italy; Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200 - 00128, Roma, Italy
| | - Domenica Stelitano
- Department of Medicine and Surgery, Unit of Neurology, Neurophysiology, Neurobiology and Psichiatry, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo, 21 - 00128 Roma, Italy
| | - Jacopo Lanzone
- Istituti Clinici Scientifici Maugeri IRCCS, Neurorehabilitation Unit of Milan Institute, Italy
| | - Giuliano Albergo
- Department of Medicine and Surgery, Unit of Neurology, Neurophysiology, Neurobiology and Psichiatry, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo, 21 - 00128 Roma, Italy; Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200 - 00128, Roma, Italy
| | - Alessandro Cruciani
- Department of Medicine and Surgery, Unit of Neurology, Neurophysiology, Neurobiology and Psichiatry, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo, 21 - 00128 Roma, Italy; Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200 - 00128, Roma, Italy
| | | | - Gabriella Musumeci
- Department of Medicine and Surgery, Unit of Neurology, Neurophysiology, Neurobiology and Psichiatry, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo, 21 - 00128 Roma, Italy; Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200 - 00128, Roma, Italy
| | - Fabio Pilato
- Department of Medicine and Surgery, Unit of Neurology, Neurophysiology, Neurobiology and Psichiatry, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo, 21 - 00128 Roma, Italy; Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200 - 00128, Roma, Italy
| | - Mariagrazia Rossi
- Department of Medicine and Surgery, Unit of Neurology, Neurophysiology, Neurobiology and Psichiatry, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo, 21 - 00128 Roma, Italy; Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200 - 00128, Roma, Italy
| | - Michele Ribolsi
- Department of Medicine and Surgery, Unit of Neurology, Neurophysiology, Neurobiology and Psichiatry, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo, 21 - 00128 Roma, Italy; Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200 - 00128, Roma, Italy
| | - Vincenzo Di Lazzaro
- Department of Medicine and Surgery, Unit of Neurology, Neurophysiology, Neurobiology and Psichiatry, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo, 21 - 00128 Roma, Italy; Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200 - 00128, Roma, Italy
| | - Fioravante Capone
- Department of Medicine and Surgery, Unit of Neurology, Neurophysiology, Neurobiology and Psichiatry, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo, 21 - 00128 Roma, Italy; Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200 - 00128, Roma, Italy.
| |
Collapse
|
9
|
Yao Q, Gu H, Wang S, Liang G, Zhao X, Li X. Exploring EEG characteristics of multi-level mental stress based on human-machine system. J Neural Eng 2023; 20:056023. [PMID: 37729925 DOI: 10.1088/1741-2552/acfbba] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Accepted: 09/20/2023] [Indexed: 09/22/2023]
Abstract
Objective.The understanding of cognitive states is important for the development of human-machine systems (HMSs), and one of the fundamental but challenging issues is the understanding and assessment of the operator's mental stress state in real task scenarios.Approach.In this paper, a virtual unmanned vehicle (UAV) driving task with multi-challenge-level was created to explore the operator's mental stress, and the human brain activity during the task was tracked in real time via electroencephalography (EEG). A mental stress analysis dataset for the virtual UAV task was then developed and used to explore the neural activation patterns associated with mental stress activity. Finally, a multiple attention-based convolutional neural network (MACN) was constructed for automatic stress assessment using the extracted stress-sensitive neural activation features.Main Results.The statistical results of EEG power spectral density (PSD) showed that frontal theta-PSD decreased with increasing task difficulty, and central beta-PSD increased with increasing task difficulty, indicating that neural patterns showed different trends under different levels of mental stress. The performance of the proposed MACN was evaluated based on the dimensional model, and results showed that average three-class classification accuracies of 89.49%/89.88% were respectively achieved for arousal/valence.Significance.The results of this paper suggest that objective assessment of mental stress in a HMS based on a virtual UAV scenario is feasible, and the proposed method provides a promising solution for cognitive computing and applications in human-machine tasks.
Collapse
Affiliation(s)
- Qunli Yao
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, People's Republic of China
| | - Heng Gu
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, People's Republic of China
| | - Shaodi Wang
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, People's Republic of China
| | - Guanhao Liang
- Center for Cognition and Neuroergonomics, Beijing Normal University, Zhuhai 519087, People's Republic of China
| | - Xiaochuan Zhao
- Institute of Computer Applied Technology of China North Industries Group Corporation Limited, Beijing 100821, People's Republic of China
| | - Xiaoli Li
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, People's Republic of China
| |
Collapse
|
10
|
Khajuria A, Kumar A, Joshi D, Kumaran SS. Reducing Stress with Yoga: A Systematic Review Based on Multimodal Biosignals. Int J Yoga 2023; 16:156-170. [PMID: 38463652 PMCID: PMC10919405 DOI: 10.4103/ijoy.ijoy_218_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Revised: 12/20/2023] [Accepted: 12/22/2023] [Indexed: 03/12/2024] Open
Abstract
Stress is an enormous concern in our culture because it is the root cause of many health issues. Yoga asanas and mindfulness-based practices are becoming increasingly popular for stress management; nevertheless, the biological effect of these practices on stress reactivity is still a research domain. The purpose of this review is to emphasize various biosignals that reflect stress reduction through various yoga-based practices. A comprehensive synthesis of numerous prior investigations in the existing literature was conducted. These investigations undertook a thorough examination of numerous biosignals. Various features are extracted from these signals, which are further explored to reflect the effectiveness of yoga practice in stress reduction. The multifaceted character of stress and the extensive research undertaken in this field indicate that the proposed approach would rely on multiple modalities. The notable growth of the body of literature pertaining to prospective yoga processes is deserving of attention; nonetheless, there exists a scarcity of research undertaken on these mechanisms. Hence, it is recommended that future studies adopt more stringent yoga methods and ensure the incorporation of suitable participant cohorts.
Collapse
Affiliation(s)
- Aayushi Khajuria
- Department of NMR and MRI Facility, All India Institute of Medical Sciences, New Delhi, India
| | - Amit Kumar
- Center for Biomedical Engineering, Indian Institute of Technology Delhi, New Delhi, India
| | - Deepak Joshi
- Center for Biomedical Engineering, Indian Institute of Technology Delhi, New Delhi, India
| | - S. Senthil Kumaran
- Department of NMR and MRI Facility, All India Institute of Medical Sciences, New Delhi, India
| |
Collapse
|
11
|
Wu R, Li A, Xue C, Chai J, Qiang Y, Zhao J, Wang L. Screening for Mild Cognitive Impairment with Speech Interaction Based on Virtual Reality and Wearable Devices. Brain Sci 2023; 13:1222. [PMID: 37626578 PMCID: PMC10452416 DOI: 10.3390/brainsci13081222] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 08/13/2023] [Accepted: 08/14/2023] [Indexed: 08/27/2023] Open
Abstract
Significant advances in sensor technology and virtual reality (VR) offer new possibilities for early and effective detection of mild cognitive impairment (MCI), and this wealth of data can improve the early detection and monitoring of patients. In this study, we proposed a non-invasive and effective MCI detection protocol based on electroencephalogram (EEG), speech, and digitized cognitive parameters. The EEG data, speech data, and digitized cognitive parameters of 86 participants (44 MCI patients and 42 healthy individuals) were monitored using a wearable EEG device and a VR device during the resting state and task (the VR-based language task we designed). Regarding the features selected under different modality combinations for all language tasks, we performed leave-one-out cross-validation for them using four different classifiers. We then compared the classification performance under multimodal data fusion using features from a single language task, features from all tasks, and using a weighted voting strategy, respectively. The experimental results showed that the collaborative screening of multimodal data yielded the highest classification performance compared to single-modal features. Among them, the SVM classifier using the RBF kernel obtained the best classification results with an accuracy of 87%. The overall classification performance was further improved using a weighted voting strategy with an accuracy of 89.8%, indicating that our proposed method can tap into the cognitive changes of MCI patients. The MCI detection scheme based on EEG, speech, and digital cognitive parameters proposed in this study provides a new direction and support for effective MCI detection, and suggests that VR and wearable devices will be a promising direction for easy-to-perform and effective MCI detection, offering new possibilities for the exploration of VR technology in the field of language cognition.
Collapse
Affiliation(s)
- Ruixuan Wu
- College of Computer Science and Technology (College of Data Science), Taiyuan University of Technology, Taiyuan 030024, China
| | - Aoyu Li
- College of Computer Science and Technology (College of Data Science), Taiyuan University of Technology, Taiyuan 030024, China
| | - Chen Xue
- College of Computer Science and Technology (College of Data Science), Taiyuan University of Technology, Taiyuan 030024, China
| | - Jiali Chai
- College of Computer Science and Technology (College of Data Science), Taiyuan University of Technology, Taiyuan 030024, China
| | - Yan Qiang
- College of Computer Science and Technology (College of Data Science), Taiyuan University of Technology, Taiyuan 030024, China
| | - Juanjuan Zhao
- College of Computer Science and Technology (College of Data Science), Taiyuan University of Technology, Taiyuan 030024, China
- College of Information, Jinzhong College of Information, Jinzhong 030600, China
| | - Long Wang
- College of Information, Jinzhong College of Information, Jinzhong 030600, China
| |
Collapse
|
12
|
Wang Z, Shi N, Zhang Y, Zheng N, Li H, Jiao Y, Cheng J, Wang Y, Zhang X, Chen Y, Chen Y, Wang H, Xie T, Wang Y, Ma Y, Gao X, Feng X. Conformal in-ear bioelectronics for visual and auditory brain-computer interfaces. Nat Commun 2023; 14:4213. [PMID: 37452047 PMCID: PMC10349124 DOI: 10.1038/s41467-023-39814-6] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Accepted: 06/28/2023] [Indexed: 07/18/2023] Open
Abstract
Brain-computer interfaces (BCIs) have attracted considerable attention in motor and language rehabilitation. Most devices use cap-based non-invasive, headband-based commercial products or microneedle-based invasive approaches, which are constrained for inconvenience, limited applications, inflammation risks and even irreversible damage to soft tissues. Here, we propose in-ear visual and auditory BCIs based on in-ear bioelectronics, named as SpiralE, which can adaptively expand and spiral along the auditory meatus under electrothermal actuation to ensure conformal contact. Participants achieve offline accuracies of 95% in 9-target steady state visual evoked potential (SSVEP) BCI classification and type target phrases successfully in a calibration-free 40-target online SSVEP speller experiment. Interestingly, in-ear SSVEPs exhibit significant 2nd harmonic tendencies, indicating that in-ear sensing may be complementary for studying harmonic spatial distributions in SSVEP studies. Moreover, natural speech auditory classification accuracy can reach 84% in cocktail party experiments. The SpiralE provides innovative concepts for designing 3D flexible bioelectronics and assists the development of biomedical engineering and neural monitoring.
Collapse
Affiliation(s)
- Zhouheng Wang
- Laboratory of Flexible Electronics Technology, Tsinghua University, Beijing, 100084, China
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China
| | - Nanlin Shi
- Department of Biomedical Engineering, Tsinghua University, Beijing, 100084, China
| | - Yingchao Zhang
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China
| | - Ning Zheng
- State Key Laboratory of Chemical Engineering, College of Chemical and Biological Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Haicheng Li
- Laboratory of Flexible Electronics Technology, Tsinghua University, Beijing, 100084, China
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China
| | - Yang Jiao
- Laboratory of Flexible Electronics Technology, Tsinghua University, Beijing, 100084, China
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China
| | - Jiahui Cheng
- Laboratory of Flexible Electronics Technology, Tsinghua University, Beijing, 100084, China
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China
| | - Yutong Wang
- Laboratory of Flexible Electronics Technology, Tsinghua University, Beijing, 100084, China
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China
| | - Xiaoqing Zhang
- Department of Otolaryngology-Head and Neck Surgery, Beijing Tongren Hospital, Capital Medical University, Beijing, 100730, China
| | - Ying Chen
- Institute of Flexible Electronics Technology of THU, Zhejiang, Jiaxing, 314000, China
| | - Yihao Chen
- Laboratory of Flexible Electronics Technology, Tsinghua University, Beijing, 100084, China
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China
| | - Heling Wang
- Laboratory of Flexible Electronics Technology, Tsinghua University, Beijing, 100084, China
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China
| | - Tao Xie
- State Key Laboratory of Chemical Engineering, College of Chemical and Biological Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Yijun Wang
- Institute of Semiconductors, Chinese Academy of Sciences, Beijing, 100083, China
| | - Yinji Ma
- Laboratory of Flexible Electronics Technology, Tsinghua University, Beijing, 100084, China.
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China.
| | - Xiaorong Gao
- Department of Biomedical Engineering, Tsinghua University, Beijing, 100084, China.
| | - Xue Feng
- Laboratory of Flexible Electronics Technology, Tsinghua University, Beijing, 100084, China.
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China.
| |
Collapse
|
13
|
Ishaque S, Khan N, Krishnan S. Physiological Signal Analysis and Stress Classification from VR Simulations Using Decision Tree Methods. Bioengineering (Basel) 2023; 10:766. [PMID: 37508793 PMCID: PMC10376313 DOI: 10.3390/bioengineering10070766] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Revised: 05/31/2023] [Accepted: 06/14/2023] [Indexed: 07/30/2023] Open
Abstract
Stress is induced in response to any mental, physical or emotional change associated with our daily experiences. While short term stress can be quite beneficial, prolonged stress is detrimental to the heart, muscle tissues and immune system. In order to be proactive against these symptoms, it is important to assess the impact of stress due to various activities, which is initially determined through the change in the sympathetic (SNS) and parasympathetic (PNS) nervous systems. After acquiring physiological data wirelessly through captive electrocardiogram (ECG), galvanic skin response (GSR) and respiration (RESP) sensors, 21 time, frequency, nonlinear, GSR and respiration features were manually extracted from 15 subjects ensuing a baseline phase, virtual reality (VR) roller coaster simulation, color Stroop task and VR Bubble Bloom game. This paper presents a comprehensive physiological analysis of stress from an experiment involving a VR video game Bubble Bloom to manage stress levels. A personalized classification and regression tree (CART) model was developed using a novel Gini index algorithm in order to effectively classify binary classes of stress. A novel K-means feature was derived from 11 other features and used as an input in the Decision Tree (DT) algorithm, strong learners Ensemble Gradient Boosting (EGB) and Extreme Gradient Boosting (XGBoost (XGB)) embedded in a pipeline to classify 5 classes of stress. Results obtained indicate that heart rate (HR), approximate entropy (ApEN), low frequency and high frequency ratio (LF/HF), low frequency (LF), standard deviation (SD1), GSR and RESP all reduced and high frequency (HF) increased following the VR Bubble Bloom game phase. The personalized CART model was able to classify binary stress with 87.75% accuracy. It proved to be more effective than other related studies. EGB was able to classify binary stress with 100% accuracy, which outperformed every other related study. XGBoost and DT were able to classify five classes of stress with 72.22% using the novel K-means feature. This feature produced less error and better model performance in comparison to using all the features. Results substantiate that our proposed methods were more effective for stress classification than most related studies.
Collapse
Affiliation(s)
- Syem Ishaque
- Department of Electrical, Computer and Biomedical Engineering, Toronto Metropolitan University, Toronto, ON M5B 2K3, Canada
| | - Naimul Khan
- Department of Electrical, Computer and Biomedical Engineering, Toronto Metropolitan University, Toronto, ON M5B 2K3, Canada
| | - Sridhar Krishnan
- Department of Electrical, Computer and Biomedical Engineering, Toronto Metropolitan University, Toronto, ON M5B 2K3, Canada
| |
Collapse
|
14
|
Barki H, Chung WY. Mental Stress Detection Using a Wearable In-Ear Plethysmography. BIOSENSORS 2023; 13:397. [PMID: 36979609 PMCID: PMC10046749 DOI: 10.3390/bios13030397] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Revised: 03/15/2023] [Accepted: 03/16/2023] [Indexed: 06/18/2023]
Abstract
This study presents an ear-mounted photoplethysmography (PPG) system that is designed to detect mental stress. Mental stress is a prevalent condition that can negatively impact an individual's health and well-being. Early detection and treatment of mental stress are crucial for preventing related illnesses and maintaining overall wellness. The study used data from 14 participants that were collected in a controlled environment. The participants were subjected to stress-inducing tasks such as the Stroop color-word test and mathematical calculations. The raw PPG signal was then preprocessed and transformed into scalograms using continuous wavelet transform (CWT). A convolutional neural network classifier was then used to classify the transformed signals as stressed or non-stressed. The results of the study show that the PPG system achieved high levels of accuracy (92.04%) and F1-score (90.8%). Furthermore, by adding white Gaussian noise to the raw PPG signals, the results were improved even more, with an accuracy of 96.02% and an F1-score of 95.24%. The proposed ear-mounted device shows great promise as a reliable tool for the early detection and treatment of mental stress, potentially revolutionizing the field of mental health and well-being.
Collapse
Affiliation(s)
- Hika Barki
- Department of AI Convergence, Pukyong National University, Busan 48513, Republic of Korea;
| | - Wan-Young Chung
- Department of AI Convergence, Pukyong National University, Busan 48513, Republic of Korea;
- Department of Electronic Engineering, Pukyong National University, Busan 48513, Republic of Korea
| |
Collapse
|
15
|
Chai J, Wu R, Li A, Xue C, Qiang Y, Zhao J, Zhao Q, Yang Q. Classification of mild cognitive impairment based on handwriting dynamics and qEEG. Comput Biol Med 2023; 152:106418. [PMID: 36566627 DOI: 10.1016/j.compbiomed.2022.106418] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Revised: 11/01/2022] [Accepted: 12/10/2022] [Indexed: 12/14/2022]
Abstract
Subtle changes in fine motor control and quantitative electroencephalography (qEEG) in patients with mild cognitive impairment (MCI) are important in screening for early dementia in primary care populations. In this study, an automated, non-invasive and rapid detection protocol for mild cognitive impairment based on handwriting kinetics and quantitative EEG analysis was proposed, and a classification model based on a dual fusion of feature and decision layers was designed for clinical decision-marking. Seventy-nine volunteers (39 healthy elderly controls and 40 patients with mild cognitive impairment) were recruited for this study, and the handwritten data and the EEG signals were performed using a tablet and MUSE under four designed handwriting tasks. Sixty-eight features were extracted from the EEG and handwriting parameters of each test. Features selected from both models were fused using a late feature fusion strategy with a weighted voting strategy for decision making, and classification accuracy was compared using three different classifiers under handwritten features, EEG features and fused features respectively. The results show that the dual fusion model can further improve the classification accuracy, with the highest classification accuracy for the combined features and the best classification result of 96.3% using SVM with RBF kernel as the base classifier. In addition, this not only supports the greater significance of multimodal data for differentiating MCI, but also tests the feasibility of using the portable EEG headband as a measure of EEG in patients with cognitive impairment.
Collapse
Affiliation(s)
- Jiali Chai
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China.
| | - Ruixuan Wu
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China
| | - Aoyu Li
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China
| | - Chen Xue
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China
| | - Yan Qiang
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China.
| | - Juanjuan Zhao
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China; Jinzhong College of Information, 030600, Taiyuan, Shanxi, China
| | - Qinghua Zhao
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China
| | - Qianqian Yang
- Jinzhong College of Information, 030600, Taiyuan, Shanxi, China
| |
Collapse
|
16
|
Abromavičius V, Serackis A, Katkevičius A, Kazlauskas M, Sledevič T. Prediction of exam scores using a multi-sensor approach for wearable exam stress dataset with uniform preprocessing. Technol Health Care 2023; 31:2499-2511. [PMID: 37955074 DOI: 10.3233/thc-235015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2023]
Abstract
BACKGROUND Physiological signals, such as skin conductance, heart rate, and temperature, provide valuable insight into the physiological responses of students to stress during examination sessions. OBJECTIVE The primary objective of this research is to explore the effectiveness of physiological signals in predicting grades and to assess the impact of different models and feature selection techniques on predictive performance. METHODS We extracted a comprehensive feature vector comprising 301 distinct features from seven signals and implemented a uniform preprocessing technique for all signals. In addition, we analyzed different algorithmic selection features to design relevant features for robust and accurate predictions. RESULTS The study reveals promising results, with the highest scores achieved using 100 and 150 features. The corresponding values for accuracy, AUROC, and F1-Score are 0.9, 0.89, and 0.87, respectively, indicating the potential of physiological signals for accurate grade prediction. CONCLUSION The findings of this study suggest practical applications in the field of education, where the use of physiological signals can help students cope with exam stress and improve their academic performance. The importance of feature selection and the use of appropriate models highlight the importance of engineering relevant features for precise and reliable predictions.
Collapse
|
17
|
Zhang L, Cui H. Reliability of MUSE 2 and Tobii Pro Nano at capturing mobile application users' real-time cognitive workload changes. Front Neurosci 2022; 16:1011475. [PMID: 36518531 PMCID: PMC9743809 DOI: 10.3389/fnins.2022.1011475] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2022] [Accepted: 10/18/2022] [Indexed: 09/10/2023] Open
Abstract
Introduction Despite the importance of cognitive workload in examining the usability of smartphone applications and the popularity of smartphone usage globally, cognitive workload as one attribute of usability tends to be overlooked in Human-Computer Interaction (HCI) studies. Moreover, limited studies that have examined the cognitive workload aspect often measured some summative workloads using subjective measures (e.g., questionnaires). A significant limitation of subjective measures is that they can only assess the overall, subject-perceived cognitive workload after the procedures/tasks have been completed. Such measurements do not reflect the real-time workload fluctuation during the procedures. The reliability of some devices on a smartphone setting has not been thoroughly evaluated. Methods This study used mixed methods to empirically study the reliability of an eye-tracking device (i.e., Tobii Pro Nano) and a low-cost electroencephalogram (EEG) device (i.e., MUSE 2) for detecting real-time cognitive workload changes during N-back tasks. Results Results suggest that the EEG measurements collected by MUSE 2 are not very useful as indicators of cognitive workload changes in our setting, eye movement measurements collected by Tobii Pro Nano with mobile testing accessory are useful for monitoring cognitive workload fluctuations and tracking down interface design issues in a smartphone setting, and more specifically, the maximum pupil diameter is the preeminent indicator of cognitive workload surges. Discussion In conclusion, the pupil diameter measure combined with other subjective ratings would provide a comprehensive user experience assessment of mobile applications. They can also be used to verify the successfulness of a user interface design solution in improving user experience.
Collapse
Affiliation(s)
- Limin Zhang
- China School of Fine Arts, Huaiyin Normal University, Huaian, China
| | - Hong Cui
- USA School of Information, University of Arizona, Tucson, AZ, United States
| |
Collapse
|
18
|
Fox EL, Ugolini M, Houpt JW. Predictions of task using neural modeling. FRONTIERS IN NEUROERGONOMICS 2022; 3:1007673. [PMID: 38235464 PMCID: PMC10790939 DOI: 10.3389/fnrgo.2022.1007673] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/30/2022] [Accepted: 10/31/2022] [Indexed: 01/19/2024]
Abstract
Introduction A well-designed brain-computer interface (BCI) can make accurate and reliable predictions of a user's state through the passive assessment of their brain activity; in turn, BCI can inform an adaptive system (such as artificial intelligence, or AI) to intelligently and optimally aid the user to maximize the human-machine team (HMT) performance. Various groupings of spectro-temporal neural features have shown to predict the same underlying cognitive state (e.g., workload) but vary in their accuracy to generalize across contexts, experimental manipulations, and beyond a single session. In our work we address an outstanding challenge in neuroergonomic research: we quantify if (how) identified neural features and a chosen modeling approach will generalize to various manipulations defined by the same underlying psychological construct, (multi)task cognitive workload. Methods To do this, we train and test 20 different support vector machine (SVM) models, each given a subset of neural features as recommended from previous research or matching the capabilities of commercial devices. We compute each model's accuracy to predict which (monitoring, communications, tracking) and how many (one, two, or three) task(s) were completed simultaneously. Additionally, we investigate machine learning model accuracy to predict task(s) within- vs. between-sessions, all at the individual-level. Results Our results indicate gamma activity across all recording locations consistently outperformed all other subsets from the full model. Our work demonstrates that modelers must consider multiple types of manipulations which may each influence a common underlying psychological construct. Discussion We offer a novel and practical modeling solution for system designers to predict task through brain activity and suggest next steps in expanding our framework to further contribute to research and development in the neuroergonomics community. Further, we quantified the cost in model accuracy should one choose to deploy our BCI approach using a mobile EEG-systems with fewer electrodes-a practical recommendation from our work.
Collapse
Affiliation(s)
- Elizabeth L. Fox
- Air Force Research Laboratory, Wright-Patterson AFB, Dayton, OH, United States
| | | | - Joseph W. Houpt
- Department of Psychology, The University of Texas at San Antonio, San Antonio, TX, United States
| |
Collapse
|
19
|
Chen P, Kirk U, Dikker S. Trait mindful awareness predicts inter-brain coupling but not individual brain responses during naturalistic face-to-face interactions. Front Psychol 2022; 13:915345. [PMID: 36248509 PMCID: PMC9561904 DOI: 10.3389/fpsyg.2022.915345] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Accepted: 09/13/2022] [Indexed: 11/25/2022] Open
Abstract
In recent years, the possible benefits of mindfulness meditation have sparked much public and academic interest. Mindfulness emphasizes cultivating awareness of our immediate experience and has been associated with compassion, empathy, and various other prosocial traits. However, neurobiological evidence pertaining to the prosocial benefits of mindfulness in social settings is sparse. In this study, we investigate neural correlates of trait mindful awareness during naturalistic dyadic interactions, using both intra-brain and inter-brain measures. We used the Muse headset, a portable electroencephalogram (EEG) device often used to support mindfulness meditation, to record brain activity from dyads as they engaged in naturalistic face-to-face interactions in a museum setting. While we did not replicate prior laboratory-based findings linking trait mindfulness to individual brain responses (N = 379 individuals), self-reported mindful awareness did predict dyadic inter-brain synchrony, in theta (~5–8 Hz) and beta frequencies (~26-27 Hz; N = 62 dyads). These findings underscore the importance of conducting social neuroscience research in ecological settings to enrich our understanding of how (multi-brain) neural correlates of social traits such as mindful awareness manifest during social interaction, while raising critical practical considerations regarding the viability of commercially available EEG systems.
Collapse
Affiliation(s)
- Phoebe Chen
- Psychology Department, New York University, New York City, NY, United States
- *Correspondence: Phoebe Chen,
| | - Ulrich Kirk
- Department of Psychology, University of Southern Denmark, Odense, Denmark
| | - Suzanne Dikker
- Psychology Department, New York University, New York City, NY, United States
- Department of Clinical Psychology, Free University Amsterdam, Amsterdam, Netherlands
- Max Planck - NYU Center for Language Music and Emotion, New York University, New York City, NY, United States
| |
Collapse
|
20
|
EEG based stress analysis using rhythm specific spectral feature for video game play. Comput Biol Med 2022; 148:105849. [PMID: 35870317 DOI: 10.1016/j.compbiomed.2022.105849] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2021] [Revised: 05/10/2022] [Accepted: 05/12/2022] [Indexed: 11/20/2022]
Abstract
BACKGROUND AND OBJECTIVE For the emerging significance of mental stress, various research directives have been established over time to understand better the causes of stress and how to deal with it. In recent years, the rise of video gameplay has been unprecedented, further triggered by the lockdown imposed due to the COVID-19 pandemic. Several researchers and organizations have contributed to the practical analysis of the impacts of such extended periods of gameplay, which lacks coordinated studies to underline the outcomes and reflect those in future game designing and public awareness about video gameplay. Investigations have mainly focused on the "gameplay stress" based on physical syndromes. Some studies have analyzed the effects of video gameplay with Electroencephalogram (EEG), Magnetic resonance imaging (MRI), etc., without concentrating on the relaxation procedure after video gameplay. METHODS This paper presents an end-to-end stress analysis for video gaming stimuli using EEG. The power spectral density (PSD) of the Alpha and Beta bands is computed to calculate the Beta-to-Alpha ratio (BAR). The Alpha and Beta band power is computed, and the Beta-to-Alpha band power ratio (BAR) has been determined. In this article, BAR is used to denote mental stress. Subjects are chosen based on various factors such as gender, gameplay experience, age, and Body mass index (BMI). EEG is recorded using Scan SynAmps2 Express equipment. There are three types of video gameplay: strategic, puzzle, and combinational. Relaxation is accomplished in this study by using music of various pitches. Two types of regression analysis are done to mathematically model stress and relaxation curve. Brain topography is rendered to indicate the stressed and relaxed region of the brain. RESULTS In the relaxed state, the subjects have BAR 0.701, which is considered the baseline value. Non-gamer subjects have an average BAR of 2.403 for 1 h of strategic video gameplay, whereas gamers have 2.218 BAR concurrently. After 12 minutes of listening to low-pitch music, gamers achieved 0.709 BAR, which is nearly the baseline value. In comparison to Quartic regression, the 4PL symmetrical sigmoid function performs regression analysis with fewer parameters and computational power. CONCLUSION Non-gamers experience more stress than gamers, whereas strategic games stress the human brain more. During gameplay, the beta band in the frontal region is mostly activated. For relaxation, low pitch music is the most useful medium. Residual stress is evident in the frontal lobe when the subjects have listened to high pitch music. Quartic regression and 4PL symmetrical sigmoid function have been employed to find the model parameters of the relaxation curve. Among them, quartic regression performs better in terms of Akaike information criterion (AIC) and R2 measure.
Collapse
|
21
|
Mental Stress Assessment Using Ultra Short Term HRV Analysis Based on Non-Linear Method. BIOSENSORS 2022; 12:bios12070465. [PMID: 35884267 PMCID: PMC9313333 DOI: 10.3390/bios12070465] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/06/2022] [Revised: 06/14/2022] [Accepted: 06/24/2022] [Indexed: 11/17/2022]
Abstract
Mental stress is on the rise as one of the major health problems in modern society. It is important to detect and manage mental stress to prevent various diseases caused by stress and to maintain a healthy life. The purpose of this paper is to present new heart rate variability (HRV) features based on empirical mode decomposition and to detect acute mental stress through short-term HRV (5 min) and ultra-short-term HRV (under 5 min) analysis. HRV signals were acquired from 74 young police officers using acute stressors, including the Trier Social Stress Test and horror movie viewing, and a total of 26 features, including the proposed IMF energy features and general HRV features, were extracted. A support vector machine (SVM) classification model is used to classify the stress and non-stress states through leave-one-subject-out cross-validation. The classification accuracies of short-term HRV and ultra-short-term HRV analysis are 86.5% and 90.5%, respectively. In the results of ultra-short-term HRV analysis using various time lengths, we suggest the optimal duration to detect mental stress, which can be applied to wearable devices or healthcare systems.
Collapse
|
22
|
Byun K, Aristizabal S, Wu Y, Mullan AF, Carlin JD, West CP, Mazurek KA. Investigating How Auditory and Visual Stimuli Promote Recovery After Stress With Potential Applications for Workplace Stress and Burnout: Protocol for a Randomized Trial. Front Psychol 2022; 13:897241. [PMID: 35719506 PMCID: PMC9201821 DOI: 10.3389/fpsyg.2022.897241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Accepted: 05/11/2022] [Indexed: 11/13/2022] Open
Abstract
Background Work-related stress is one of the top sources of stress amongst working adults. Relaxation rooms are one organizational strategy being used to reduce workplace stress. Amongst healthcare workers, relaxation rooms have been shown to improve perceived stress levels after 15 min of use. However, few studies have examined physiological and cognitive changes after stress, which may inform why relaxation rooms reduce perceived stress. Understanding the biological mechanisms governing why perceived stress improves when using a relaxation room could lead to more effective strategies to address workplace stress. Objective The purpose of this research study is to understand how physiological measures, cognitive performance, and perceived stress change after acute stress and whether certain sensory features of a relaxation room are more effective at promoting recovery from stress. Methods 80 healthy adults will perform a stress induction task (Trier Social Stress Test, TSST) to evaluate how physiological and cognitive responses after stress are affected by sensory features of a relaxation room. After the stress induction task, participants will recover for 40 min in a MindBreaks™ relaxation room containing auditory and visual stimuli designed to promote relaxation. Participants will be randomized into four cohorts to experience auditory and visual stimuli; auditory stimuli; visual stimuli; or no stimuli in the room. Measures of heart rate and neural activity will be continuously monitored using wearable devices. Participants will perform working memory assessments and rate their perceived stress levels throughout the experiment. These measures will be compared before and after the stress induction task to determine how different sensory stimuli affect the rate at which individuals recover. Results Recruitment started in December 2021 and will continue until December 2022 or until enrollment is completed. Final data collection and subsequent analysis are anticipated by December 2022. We expect all trial results will be available by early 2023. Discussion Findings will provide data and information about which sensory features of a relaxation room are most effective at promoting recovery after acute stress. This information will be useful in determining how these features might be effective at creating individualized and organizational strategies for mitigating the effects of workplace stress.
Collapse
Affiliation(s)
- Kunjoon Byun
- Well Living Lab, Rochester, MN, United States.,Delos Living LLC., New York, NY, United States
| | - Sara Aristizabal
- Well Living Lab, Rochester, MN, United States.,Delos Living LLC., New York, NY, United States
| | - Yihan Wu
- Graduate Program in Cognitive Science, University of Minnesota-Twin Cities, Minneapolis, MN, United States
| | - Aidan F Mullan
- Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN, United States
| | - Jeremiah D Carlin
- Well Living Lab, Rochester, MN, United States.,Delos Living LLC., New York, NY, United States
| | - Colin P West
- Division of General Internal Medicine, Department of Medicine, Mayo Clinic, Rochester, MN, United States.,Division of Clinical Trials and Biostatistics, Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN, United States
| | - Kevin A Mazurek
- Well Living Lab, Rochester, MN, United States.,Delos Living LLC., New York, NY, United States.,Department of Physiology and Biomedical Engineering, Mayo Clinic, Rochester, MN, United States.,Department of Neuroscience, The Del Monte Institute for Neuroscience, University of Rochester School of Medicine and Dentistry, Rochester, NY, United States
| |
Collapse
|
23
|
Ali A, Afridi R, Soomro TA, Khan SA, Khan MYA, Chowdhry BS. A Single-Channel Wireless EEG Headset Enabled Neural Activities Analysis for Mental Healthcare Applications. WIRELESS PERSONAL COMMUNICATIONS 2022; 125:3699-3713. [PMID: 35669180 PMCID: PMC9150628 DOI: 10.1007/s11277-022-09731-w] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 04/14/2022] [Indexed: 06/15/2023]
Abstract
UNLABELLED Electroencephalography (EEG) is a technique of Electrophysiology used in a wide variety of scientific studies and applications. Inadequately, many commercial devices that are available and used worldwide for EEG monitoring are expensive that costs up to thousands of dollars. Over the past few years, because of advancements in technology, different cost-effective EEG recording devices have been made. One such device is a non-invasive single electrode commercial EEG headset called MindWave 002 (MW2), created by NeuroSky Inc that cost less than 100 USD. This work contributes in four distinct ways, first, how mental states such as a focused and relaxed can be identified based on EEG signals recorded by inexpensive MW2 is demonstrated for accurate information extraction. Second, MW2 is considered because apart from cost, the user's comfort level is enhanced due to non-invasive operation, low power consumption, portable small size, and a minimal number of detecting locations of MW2. Third, 2 situations were created to stimulate focus and relaxation states. Prior to analysis, the acquired brain signals were pre-processed to discard artefacts and noise, and band-pass filtering was performed for delta, theta, alpha, beta, and gamma wave extraction. Fourth, analysis of the shapes and nature of extracted waves was performed with power spectral density (PSD), mean amplitude values, and other parameters in LabVIEW. Finally, with comprehensive experiments, the mean values of the focused and relaxed signal EEG signals were found to be 30.23 µV and 15.330 µV respectively. Similarly, average PSD values showed an increase in theta wave value and a decrease in beta wave value related to the focus and relaxed state, respectively. We also analyzed the involuntary and intentional number of blinks recorded by the MW2 device. Our study can be used to check mental health wellness and could provide psychological treatment effects by training the mind to quickly enter a relaxed state and improve the person's ability to focus. In addition, this study can open new avenues for neurofeedback and brain control applications. SUPPLEMENTARY INFORMATION The online version contains supplementary material available at 10.1007/s11277-022-09731-w.
Collapse
Affiliation(s)
- Ahmed Ali
- Electrical Engineering Department Sukkur, IBA University, Sukkur, Pakistan
| | - Riaz Afridi
- Biomedical Engineering Department, Yonsei University, Wonju, 26493 South Korea
| | - Toufique A. Soomro
- Department of Electronic Engineering, Quaid-e-Awam University of Engineering, Science and Technology, Larkana, Pakistan
| | - Saeed Ahmed Khan
- Electrical Engineering Department Sukkur, IBA University, Sukkur, Pakistan
| | | | - Bhawani Shankar Chowdhry
- Faculty of Electrical, Electronics and Computer Engineering, Mehran University of Engineering & Technology, Jamshoro, Pakistan
| |
Collapse
|
24
|
Fu R, Chen YF, Huang Y, Chen S, Duan F, Li J, Wu J, Jiang D, Gao J, Gu J, Zhang M, Chang C. Symmetric Convolutional and Adversarial Neural Network Enables Improved Mental Stress Classification from EEG. IEEE Trans Neural Syst Rehabil Eng 2022; 30:1384-1400. [PMID: 35584065 DOI: 10.1109/tnsre.2022.3174821] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Electroencephalography (EEG) is widely used for mental stress classification, but effective feature extraction and transfer across subjects remain challenging due to its variability. In this paper, a novel deep neural network combining convolutional neural network (CNN) and adversarial theory, named symmetric deep convolutional adversarial network (SDCAN), is proposed for stress classification based on EEG. The adversarial inference is introduced to automatically capture invariant and discriminative features from raw EEG, which aims to improve the classification accuracy and generalization ability across subjects. Experiments were conducted with 22 human subjects, where each participant's stress was induced by the Trier Social Stress Test paradigm while EEG was collected. Stress states were then calibrated into four or five stages according to the changing trend of salivary cortisol concentration. The results show that the proposed network achieves improved accuracies of 87.62% and 81.45% on the classification of four and five stages, respectively, compared to conventional CNN methods. Euclidean space data alignment approach (EA) was applied and the improved generalization ability of EA-SDCAN across subjects was also validated via the leave-one-subject-out-cross-validation, with the accuracies of four and five stages being 60.52% and 48.17%, respectively. These findings indicate that the proposed SDCAN network is more feasible and effective for classifying the stages of mental stress based on EEG compared with other conventional methods.
Collapse
|
25
|
Stress Classification Using Brain Signals Based on LSTM Network. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:7607592. [PMID: 35528348 PMCID: PMC9071939 DOI: 10.1155/2022/7607592] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/31/2021] [Revised: 02/14/2022] [Accepted: 02/28/2022] [Indexed: 12/17/2022]
Abstract
The early diagnosis of stress symptoms is essential for preventing various mental disorder such as depression. Electroencephalography (EEG) signals are frequently employed in stress detection research and are both inexpensive and noninvasive modality. This paper proposes a stress classification system by utilizing an EEG signal. EEG signals from thirty-five volunteers were analysed which were acquired using four EEG sensors using a commercially available 4-electrode Muse EEG headband. Four movie clips were chosen as stress elicitation material. Two clips were selected to induce stress as it contains emotionally inductive scenes. The other two clips were chosen that do not induce stress as it has many comedy scenes. The recorded signals were then used to build the stress classification model. We compared the Multilayer Perceptron (MLP) and Long Short-Term Memory (LSTM) for classifying stress and nonstress group. The maximum classification accuracy of 93.17% was achieved using two-layer LSTM architecture.
Collapse
|
26
|
Muhammad F, Al-Ahmadi S. Human state anxiety classification framework using EEG signals in response to exposure therapy. PLoS One 2022; 17:e0265679. [PMID: 35303027 PMCID: PMC8932601 DOI: 10.1371/journal.pone.0265679] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2021] [Accepted: 03/06/2022] [Indexed: 12/17/2022] Open
Abstract
Human anxiety is a grave mental health concern that needs to be addressed in the appropriate manner in order to develop a healthy society. In this study, an objective human anxiety assessment framework is developed by using physiological signals of electroencephalography (EEG) and recorded in response to exposure therapy. The EEG signals of twenty-three subjects from an existing database called "A Database for Anxious States which is based on a Psychological Stimulation (DASPS)" are used for anxiety quantification into two and four levels. The EEG signals are pre-processed using appropriate noise filtering techniques to remove unwanted ocular and muscular artifacts. Channel selection is performed to select the significantly different electrodes using statistical analysis techniques for binary and four-level classification of human anxiety, respectively. Features are extracted from the data of selected EEG channels in the frequency domain. Frequency band selection is applied to select the appropriate combination of EEG frequency bands, which in this study are theta and beta bands. Feature selection is applied to the features of the selected EEG frequency bands. Finally, the selected subset of features from the appropriate frequency bands of the statistically significant EEG channels were classified using multiple machine learning algorithms. An accuracy of 94.90% and 92.74% is attained for two and four-level anxiety classification using a random forest classifier with 9 and 10 features, respectively. The proposed state anxiety classification framework outperforms the existing anxiety detection framework in terms of accuracy with a smaller number of features which reduces the computational complexity of the algorithm.
Collapse
Affiliation(s)
- Farah Muhammad
- Department of Computer Science, King Saud University, Riyadh, Saudi Arabia
| | - Saad Al-Ahmadi
- Computer Science Department, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia
| |
Collapse
|
27
|
|
28
|
EEG-Based Identification of Emotional Neural State Evoked by Virtual Environment Interaction. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19042158. [PMID: 35206341 PMCID: PMC8872045 DOI: 10.3390/ijerph19042158] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/14/2022] [Revised: 02/11/2022] [Accepted: 02/11/2022] [Indexed: 11/17/2022]
Abstract
Classifying emotional states is critical for brain–computer interfaces and psychology-related domains. In previous studies, researchers have tried to identify emotions using neural data such as electroencephalography (EEG) signals or brain functional magnetic resonance imaging (fMRI). In this study, we propose a machine learning framework for emotion state classification using EEG signals in virtual reality (VR) environments. To arouse emotional neural states in brain signals, we provided three VR stimuli scenarios to 15 participants. Fifty-four features were extracted from the collected EEG signals under each scenario. To find the optimal classification in our research design, three machine learning algorithms (XGBoost classifier, support vector classifier, and logistic regression) were applied. Additionally, various class conditions were used in machine learning classifiers to validate the performance of our framework. To evaluate the classification performance, we utilized five evaluation metrics (precision, recall, f1-score, accuracy, and AUROC). Among the three classifiers, the XGBoost classifiers showed the best performance under all experimental conditions. Furthermore, the usability of features, including differential asymmetry and frequency band pass categories, were checked from the feature importance of XGBoost classifiers. We expect that our framework can be applied widely not only to psychological research but also to mental health-related issues.
Collapse
|
29
|
Enhancing EEG-Based Mental Stress State Recognition Using an Improved Hybrid Feature Selection Algorithm. SENSORS 2021; 21:s21248370. [PMID: 34960469 PMCID: PMC8703860 DOI: 10.3390/s21248370] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/21/2021] [Revised: 12/06/2021] [Accepted: 12/10/2021] [Indexed: 01/15/2023]
Abstract
In real-life applications, electroencephalogram (EEG) signals for mental stress recognition require a conventional wearable device. This, in turn, requires an efficient number of EEG channels and an optimal feature set. This study aims to identify an optimal feature subset that can discriminate mental stress states while enhancing the overall classification performance. We extracted multi-domain features within the time domain, frequency domain, time-frequency domain, and network connectivity features to form a prominent feature vector space for stress. We then proposed a hybrid feature selection (FS) method using minimum redundancy maximum relevance with particle swarm optimization and support vector machines (mRMR-PSO-SVM) to select the optimal feature subset. The performance of the proposed method is evaluated and verified using four datasets, namely EDMSS, DEAP, SEED, and EDPMSC. To further consolidate, the effectiveness of the proposed method is compared with that of the state-of-the-art metaheuristic methods. The proposed model significantly reduced the features vector space by an average of 70% compared with the state-of-the-art methods while significantly increasing overall detection performance.
Collapse
|
30
|
Ishaque S, Khan N, Krishnan S. Trends in Heart-Rate Variability Signal Analysis. Front Digit Health 2021; 3:639444. [PMID: 34713110 PMCID: PMC8522021 DOI: 10.3389/fdgth.2021.639444] [Citation(s) in RCA: 33] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2020] [Accepted: 02/02/2021] [Indexed: 11/22/2022] Open
Abstract
Heart rate variability (HRV) is the rate of variability between each heartbeat with respect to time. It is used to analyse the Autonomic Nervous System (ANS), a control system used to modulate the body's unconscious action such as cardiac function, respiration, digestion, blood pressure, urination, and dilation/constriction of the pupil. This review article presents a summary and analysis of various research works that analyzed HRV associated with morbidity, pain, drowsiness, stress and exercise through signal processing and machine learning methods. The points of emphasis with regards to HRV research as well as the gaps associated with processes which can be improved to enhance the quality of the research have been discussed meticulously. Restricting the physiological signals to Electrocardiogram (ECG), Electrodermal activity (EDA), photoplethysmography (PPG), and respiration (RESP) analysis resulted in 25 articles which examined the cause and effect of increased/reduced HRV. Reduced HRV was generally associated with increased morbidity and stress. High HRV normally indicated good health, and in some instances, it could signify clinical events of interest such as drowsiness. Effective analysis of HRV during ambulatory and motion situations such as exercise, video gaming, and driving could have a significant impact toward improving social well-being. Detection of HRV in motion is far from perfect, situations involving exercise or driving reported accuracy as high as 85% and as low as 59%. HRV detection in motion can be improved further by harnessing the advancements in machine learning techniques.
Collapse
Affiliation(s)
- Syem Ishaque
- Department of Electrical, Computer and Biomedical Engineering, Ryerson University, Toronto, ON, Canada
| | - Naimul Khan
- Department of Electrical, Computer and Biomedical Engineering, Ryerson University, Toronto, ON, Canada
| | - Sri Krishnan
- Department of Electrical, Computer and Biomedical Engineering, Ryerson University, Toronto, ON, Canada
| |
Collapse
|
31
|
EEG Mental Stress Assessment Using Hybrid Multi-Domain Feature Sets of Functional Connectivity Network and Time-Frequency Features. SENSORS 2021; 21:s21186300. [PMID: 34577505 PMCID: PMC8473213 DOI: 10.3390/s21186300] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/09/2021] [Revised: 09/07/2021] [Accepted: 09/16/2021] [Indexed: 12/28/2022]
Abstract
Exposure to mental stress for long period leads to serious accidents and health problems. To avoid negative consequences on health and safety, it is very important to detect mental stress at its early stages, i.e., when it is still limited to acute or episodic stress. In this study, we developed an experimental protocol to induce two different levels of stress by utilizing a mental arithmetic task with time pressure and negative feedback as the stressors. We assessed the levels of stress on 22 healthy subjects using frontal electroencephalogram (EEG) signals, salivary alpha-amylase level (AAL), and multiple machine learning (ML) classifiers. The EEG signals were analyzed using a fusion of functional connectivity networks estimated by the Phase Locking Value (PLV) and temporal and spectral domain features. A total of 210 different features were extracted from all domains. Only the optimum multi-domain features were used for classification. We then quantified stress levels using statistical analysis and seven ML classifiers. Our result showed that the AAL level was significantly increased (p < 0.01) under stress condition in all subjects. Likewise, the functional connectivity network demonstrated a significant decrease under stress, p < 0.05. Moreover, we achieved the highest stress classification accuracy of 93.2% using the Support Vector Machine (SVM) classifier. Other classifiers produced relatively similar results.
Collapse
|
32
|
Katmah R, Al-Shargie F, Tariq U, Babiloni F, Al-Mughairbi F, Al-Nashash H. A Review on Mental Stress Assessment Methods Using EEG Signals. SENSORS (BASEL, SWITZERLAND) 2021; 21:5043. [PMID: 34372280 PMCID: PMC8347831 DOI: 10.3390/s21155043] [Citation(s) in RCA: 35] [Impact Index Per Article: 11.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Revised: 07/13/2021] [Accepted: 07/19/2021] [Indexed: 01/19/2023]
Abstract
Mental stress is one of the serious factors that lead to many health problems. Scientists and physicians have developed various tools to assess the level of mental stress in its early stages. Several neuroimaging tools have been proposed in the literature to assess mental stress in the workplace. Electroencephalogram (EEG) signal is one important candidate because it contains rich information about mental states and condition. In this paper, we review the existing EEG signal analysis methods on the assessment of mental stress. The review highlights the critical differences between the research findings and argues that variations of the data analysis methods contribute to several contradictory results. The variations in results could be due to various factors including lack of standardized protocol, the brain region of interest, stressor type, experiment duration, proper EEG processing, feature extraction mechanism, and type of classifier. Therefore, the significant part related to mental stress recognition is choosing the most appropriate features. In particular, a complex and diverse range of EEG features, including time-varying, functional, and dynamic brain connections, requires integration of various methods to understand their associations with mental stress. Accordingly, the review suggests fusing the cortical activations with the connectivity network measures and deep learning approaches to improve the accuracy of mental stress level assessment.
Collapse
Affiliation(s)
- Rateb Katmah
- Biomedical Engineering Graduate Program, American University of Sharjah, Sharjah 26666, United Arab Emirates;
| | - Fares Al-Shargie
- Department of Electrical Engineering, American University of Sharjah, Sharjah 26666, United Arab Emirates; (U.T.); (H.A.-N.)
| | - Usman Tariq
- Department of Electrical Engineering, American University of Sharjah, Sharjah 26666, United Arab Emirates; (U.T.); (H.A.-N.)
| | - Fabio Babiloni
- Department of Molecular Medicine, University of Sapienza Rome, 00185 Rome, Italy;
- College Computer Science and Technology, University Hangzhou Dianzi, Hangzhou 310018, China
| | - Fadwa Al-Mughairbi
- College of Medicines and Health Sciences, United Arab Emirates University, Al-Ain 15551, United Arab Emirates;
| | - Hasan Al-Nashash
- Department of Electrical Engineering, American University of Sharjah, Sharjah 26666, United Arab Emirates; (U.T.); (H.A.-N.)
| |
Collapse
|
33
|
Trambaiolli LR, Tiwari A, Falk TH. Affective Neurofeedback Under Naturalistic Conditions: A Mini-Review of Current Achievements and Open Challenges. FRONTIERS IN NEUROERGONOMICS 2021; 2:678981. [PMID: 38235228 PMCID: PMC10790905 DOI: 10.3389/fnrgo.2021.678981] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Accepted: 04/28/2021] [Indexed: 01/19/2024]
Abstract
Affective neurofeedback training allows for the self-regulation of the putative circuits of emotion regulation. This approach has recently been studied as a possible additional treatment for psychiatric disorders, presenting positive effects in symptoms and behaviors. After neurofeedback training, a critical aspect is the transference of the learned self-regulation strategies to outside the laboratory and how to continue reinforcing these strategies in non-controlled environments. In this mini-review, we discuss the current achievements of affective neurofeedback under naturalistic setups. For this, we first provide a brief overview of the state-of-the-art for affective neurofeedback protocols. We then discuss virtual reality as a transitional step toward the final goal of "in-the-wild" protocols and current advances using mobile neurotechnology. Finally, we provide a discussion of open challenges for affective neurofeedback protocols in-the-wild, including topics such as convenience and reliability, environmental effects in attention and workload, among others.
Collapse
Affiliation(s)
- Lucas R. Trambaiolli
- Basic Neuroscience Division, McLean Hospital–Harvard Medical School, Belmont, MA, United States
| | - Abhishek Tiwari
- Institut National de la Recherche Scientifique, University of Quebec, Montreal, QC, Canada
| | - Tiago H. Falk
- Institut National de la Recherche Scientifique, University of Quebec, Montreal, QC, Canada
| |
Collapse
|
34
|
Detection of Negative Stress through Spectral Features of Electroencephalographic Recordings and a Convolutional Neural Network. SENSORS 2021; 21:s21093050. [PMID: 33925583 PMCID: PMC8123772 DOI: 10.3390/s21093050] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Revised: 04/23/2021] [Accepted: 04/25/2021] [Indexed: 12/20/2022]
Abstract
In recent years, electroencephalographic (EEG) signals have been intensively used in the area of emotion recognition, partcularly in distress identification due to its negative impact on physical and mental health. Traditionally, brain activity has been studied from a frequency perspective by computing the power spectral density of the EEG recordings and extracting features from different frequency sub-bands. However, these features are often individually extracted from single EEG channels, such that each brain region is separately evaluated, even when it has been corroborated that mental processes are based on the coordination of different brain areas working simultaneously. To take advantage of the brain’s behaviour as a synchronized network, in the present work, 2-D and 3-D spectral images constructed from common 32 channel EEG signals are evaluated for the first time to discern between emotional states of calm and distress using a well-known deep-learning algorithm, such as AlexNet. The obtained results revealed a significant improvement in the classification performance regarding previous works, reaching an accuracy about 84%. Moreover, no significant differences between the results provided by the diverse approaches considered to reconstruct 2-D and 3-D spectral maps from the original location of the EEG channels over the scalp were noticed, thus suggesting that these kinds of images preserve original spatial brain information.
Collapse
|
35
|
Human stress classification during public speaking using physiological signals. Comput Biol Med 2021; 133:104377. [PMID: 33866254 DOI: 10.1016/j.compbiomed.2021.104377] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2021] [Revised: 03/31/2021] [Accepted: 04/01/2021] [Indexed: 11/24/2022]
Abstract
Public speaking is a common type of social evaluative situation and a significant amount of the population feel uneasy with it. It is of utmost importance to detect public speaking stress so that appropriate action can be taken to minimize its impacts on human health. In this study, a multimodal human stress classification scheme in response to real-life public speaking activity is proposed. Electroencephalography (EEG), galvanic skin response (GSR), and photoplethysmography (PPG) signals of forty participants are acquired in rest-state and during public speaking activity to divide data into a stressed and non-stressed group. Frequency domain features from EEG and time-domain features from GSR and PPG signals are extracted. The selected set of features from all modalities are fused to classify the stress into two classes. Classification is performed via a leave-one-out cross-validation scheme by using five different classifiers. The highest accuracy of 96.25% is achieved using a support vector machine classifier with radial basis function. Statistical analysis is performed to examine the significance of EEG, GSR, and PPG signals between the two phases of the experiment. Statistical significance is found in certain EEG frequency bands as well as GSR and PPG data recorded before and after public speaking supporting the fact that brain activity, skin conductance, and blood volumetric flow are credible measures of human stress during public speaking activity.
Collapse
|
36
|
Emotional Well-Being in Urban Wilderness: Assessing States of Calmness and Alertness in Informal Green Spaces (IGSs) with Muse—Portable EEG Headband. SUSTAINABILITY 2021. [DOI: 10.3390/su13042212] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
In this experiment, we operated within the novel research area of Informal Green Spaces (often called green wastelands), exploring emotional well-being with the employment of portable electroencephalography (EEG) devices. The apparatus (commercial EEG Muse headband) provided an opportunity to analyze states of calmness and alertness in n = 20 participants as they visited selected Informal Green Spaces in Warsaw, Poland. The article aims to test the hypothesis that passive recreation in Informal Green Spaces (IGSs) has a positive impact on emotional well-being and that there is a connection between the intensity of states of calmness and alertness and 1. the type of green space (IGS/GS), 2. the type of scenery and 3. the type of IGS. The preliminary experiment showed that there might be no substantial distinction in the users’ levels of emotional states when considering existing typologies. On the other hand, data-driven analysis suggests that there might be a connection between the state of alertness and some characteristics of specific areas. After carrying out the multivariate analyses of variance in the repeated measurement scheme and finding significant differences between oscillations in different areas, we conclude that there might be three possible sources of lower alertness and increased calmness in some areas. These are 1. the presence of “desirable” human intervention such as paths and urban furniture, 2. a lack of “undesirable” users and signs of their presence and 3. the presence of other “desirable” users.
Collapse
|
37
|
Li W, Huan W, Hou B, Tian Y, Zhang Z, Song A. Can Emotion be Transferred? – A Review on Transfer Learning for EEG-Based Emotion Recognition. IEEE Trans Cogn Dev Syst 2021. [DOI: 10.1109/tcds.2021.3098842] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
38
|
Parent M, Albuquerque I, Tiwari A, Cassani R, Gagnon JF, Lafond D, Tremblay S, Falk TH. PASS: A Multimodal Database of Physical Activity and Stress for Mobile Passive Body/ Brain-Computer Interface Research. Front Neurosci 2020; 14:542934. [PMID: 33363449 PMCID: PMC7753022 DOI: 10.3389/fnins.2020.542934] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2020] [Accepted: 11/16/2020] [Indexed: 12/27/2022] Open
Abstract
With the burgeoning of wearable devices and passive body/brain-computer interfaces (B/BCIs), automated stress monitoring in everyday settings has gained significant attention recently, with applications ranging from serious games to clinical monitoring. With mobile users, however, challenges arise due to other overlapping (and potentially confounding) physiological responses (e.g., due to physical activity) that may mask the effects of stress, as well as movement artifacts that can be introduced in the measured signals. For example, the classical increase in heart rate can no longer be attributed solely to stress and could be caused by the activity itself. This makes the development of mobile passive B/BCIs challenging. In this paper, we introduce PASS, a multimodal database of Physical Activity and StresS collected from 48 participants. Participants performed tasks of varying stress levels at three different activity levels and provided quantitative ratings of their perceived stress and fatigue levels. To manipulate stress, two video games (i.e., a calm exploration game and a survival game) were used. Peripheral physical activity (electrocardiography, electrodermal activity, breathing, skin temperature) as well as cerebral activity (electroencephalography) were measured throughout the experiment. A complete description of the experimental protocol is provided and preliminary analyses are performed to investigate the physiological reactions to stress in the presence of physical activity. The PASS database, including raw data and subjective ratings has been made available to the research community at http://musaelab.ca/pass-database/. It is hoped that this database will help advance mobile passive B/BCIs for use in everyday settings.
Collapse
Affiliation(s)
- Mark Parent
- INRS-EMT, Université du Québec, Montréal, QC, Canada
| | | | | | | | | | - Daniel Lafond
- Thales Research and Technology Canada, Quebec City, QC, Canada
| | | | - Tiago H Falk
- INRS-EMT, Université du Québec, Montréal, QC, Canada.,PERFORM Center, Concordia University, Montréal, QC, Canada
| |
Collapse
|
39
|
Abstract
Over the last decade, the area of electroencephalography (EEG) witnessed a progressive move from high-end large measurement devices, relying on accurate construction and providing high sensitivity, to miniature hardware, more specifically wireless wearable EEG devices. While accurate, traditional EEG systems need a complex structure and long periods of application time, unwittingly causing discomfort and distress on the users. Given their size and price, aside from their lower sensitivity and narrower spectrum band(s), wearable EEG devices may be used regularly by individuals for continuous collection of user data from non-medical environments. This allows their usage for diverse, nontraditional, non-medical applications, including cognition, BCI, education, and gaming. Given the reduced need for standardization or accuracy, the area remains a rather incipient one, mostly driven by the emergence of new devices that represent the critical link of the innovation chain. In this context, the aim of this study is to provide a holistic assessment of the consumer-grade EEG devices for cognition, BCI, education, and gaming, based on the existing products, the success of their underlying technologies, as benchmarked by the undertaken studies, and their integration with current applications across the four areas. Beyond establishing a reference point, this review also provides the critical and necessary systematic guidance for non-medical EEG research and development efforts at the start of their investigation.
Collapse
|
40
|
Feature Selection Model based on EEG Signals for Assessing the Cognitive Workload in Drivers. SENSORS 2020; 20:s20205881. [PMID: 33080866 PMCID: PMC7589097 DOI: 10.3390/s20205881] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/21/2020] [Revised: 10/09/2020] [Accepted: 10/13/2020] [Indexed: 11/17/2022]
Abstract
In recent years, research has focused on generating mechanisms to assess the levels of subjects’ cognitive workload when performing various activities that demand high concentration levels, such as driving a vehicle. These mechanisms have implemented several tools for analyzing the cognitive workload, and electroencephalographic (EEG) signals have been most frequently used due to their high precision. However, one of the main challenges in implementing the EEG signals is finding appropriate information for identifying cognitive states. Here, we present a new feature selection model for pattern recognition using information from EEG signals based on machine learning techniques called GALoRIS. GALoRIS combines Genetic Algorithms and Logistic Regression to create a new fitness function that identifies and selects the critical EEG features that contribute to recognizing high and low cognitive workloads and structures a new dataset capable of optimizing the model’s predictive process. We found that GALoRIS identifies data related to high and low cognitive workloads of subjects while driving a vehicle using information extracted from multiple EEG signals, reducing the original dataset by more than 50% and maximizing the model’s predictive capacity, achieving a precision rate greater than 90%.
Collapse
|
41
|
Ishaque S, Rueda A, Nguyen B, Khan N, Krishnan S. Physiological Signal Analysis and Classification of Stress from Virtual Reality Video Game. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:867-870. [PMID: 33018122 DOI: 10.1109/embc44109.2020.9176110] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Stress can affect a person's performance and health positively and negatively. A lot of the relaxation methods have been suggested to reduce the amount of stress. This study used virtual reality (VR) video games to alleviate stress. Physiological signals captured from Electrocardiogram (ECG), galvanic skin response (GSR), and respiration (RESP) were used to determine if the subject was stressed or relaxed. Time and frequency domain features were then extracted to evaluate stress levels. Frequency domain methods such as low-frequency (LF), high-frequency (HF), LF-HF ratio (LF/HF) are considered the most effective for HRV analysis, Poincare plots are moré discerning visually and shares a 81% correlation with LF/HF ratio. GSR is associated with EDA activity, which only increases due to stress. Stress and relax were classified using Linear Discriminant Analysis (LDA), Decision Tree, Support Vector machine (SVM), Gradient Boost (GB), and Naive Bayes. GB performed the best with an accuracy of 85% after 5 fold cross validation with 100 iterations, which is admirable from a small dataset with 50 samples.
Collapse
|
42
|
Saeed SMU, Anwar SM, Khalid H, Majid M, Bagci U. EEG based Classification of Long-term Stress Using Psychological Labeling. SENSORS (BASEL, SWITZERLAND) 2020; 20:E1886. [PMID: 32235295 PMCID: PMC7180785 DOI: 10.3390/s20071886] [Citation(s) in RCA: 37] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/18/2020] [Revised: 03/25/2020] [Accepted: 03/25/2020] [Indexed: 01/21/2023]
Abstract
Stress research is a rapidly emerging area in the field of electroencephalography (EEG) signal processing. The use of EEG as an objective measure for cost effective and personalized stress management becomes important in situations like the nonavailability of mental health facilities. In this study, long-term stress was classified with machine learning algorithms using resting state EEG signal recordings. The labeling for the stress and control groups was performed using two currently accepted clinical practices: (i) the perceived stress scale score and (ii) expert evaluation. The frequency domain features were extracted from five-channel EEG recordings in addition to the frontal and temporal alpha and beta asymmetries. The alpha asymmetry was computed from four channels and used as a feature. Feature selection was also performed to identify statistically significant features for both stress and control groups (via t-test). We found that support vector machine was best suited to classify long-term human stress when used with alpha asymmetry as a feature. It was observed that the expert evaluation-based labeling method had improved the classification accuracy by up to 85.20%. Based on these results, it is concluded that alpha asymmetry may be used as a potential bio-marker for stress classification, when labels are assigned using expert evaluation.
Collapse
Affiliation(s)
- Sanay Muhammad Umar Saeed
- Department of Computer Engineering, University of Engineering and Technology, Taxila 47050, Pakistan; (S.M.U.S.); (M.M.)
| | - Syed Muhammad Anwar
- Department of Software Engineering, University of Engineering and Technology, Taxila 47050, Pakistan
- Department of Computer Science, University of Central Florida, Orlando, FL 32816, USA;
| | - Humaira Khalid
- Department of Psychology, Benazir Bhutto Hospital, Rawalpindi 46000, Pakistan;
| | - Muhammad Majid
- Department of Computer Engineering, University of Engineering and Technology, Taxila 47050, Pakistan; (S.M.U.S.); (M.M.)
| | - Ulas Bagci
- Department of Computer Science, University of Central Florida, Orlando, FL 32816, USA;
| |
Collapse
|
43
|
Sharma R, Chopra K. EEG signal analysis and detection of stress using classification techniques. JOURNAL OF INFORMATION & OPTIMIZATION SCIENCES 2020. [DOI: 10.1080/02522667.2020.1714187] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Affiliation(s)
- Ruchi Sharma
- Department of Electrical & Electronics Engineering, GD Goenka University, Gurugram 122103, Haryana, India,
| | - Khyati Chopra
- Department of Electrical & Electronics Engineering, GD Goenka University, Gurugram 122103, Haryana, India,
| |
Collapse
|