1
|
Li W, Cheng S, Dai J, Chang Y. Effects of Mental Workload Manipulation on Electroencephalography Spectrum Oscillation and Microstates in Multitasking Environments. Brain Behav 2025; 15:e70216. [PMID: 39778947 PMCID: PMC11710893 DOI: 10.1002/brb3.70216] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/20/2024] [Revised: 11/21/2024] [Accepted: 12/01/2024] [Indexed: 01/11/2025] Open
Abstract
INTRODUCTION Multitasking during flights leads to a high mental workload, which is detrimental for maintaining task performance. Electroencephalography (EEG) power spectral analysis based on frequency-band oscillations and microstate analysis based on global brain network activation can be used to evaluate mental workload. This study explored the effects of a high mental workload during simulated flight multitasking on EEG frequency-band power and microstate parameters. METHODS Thirty-six participants performed multitasking with low and high mental workloads after 4 consecutive days of training. Two levels of mental workload were set by varying the number of subtasks. EEG signals were acquired during the task. Power spectral and microstate analyses were performed on the EEG. The indices of four frequency bands (delta, theta, alpha, and beta) and four microstate classes (A-D) were calculated, changes in the frequency-band power and microstate parameters under different mental workloads were compared, and the relationships between the two types of EEG indices were analyzed. RESULTS The theta-, alpha-, and beta-band powers were higher under the high than under the low mental workload condition. Compared with the low mental workload condition, the high mental workload condition had a lower global explained variance and time parameters of microstate B but higher time parameters of microstate D. Less frequent transitions between microstates A and B and more frequent transitions between microstates C and D were observed during high mental workload conditions. The time parameters of microstate B were positively correlated with the delta-, theta-, and beta-band powers, whereas the duration of microstate C was negatively correlated with the beta-band power. CONCLUSION EEG frequency-band power and microstate parameters can be used to detect a high mental workload. Power spectral analyses based on frequency-band oscillations and microstate analyses based on global brain network activation were not completely isolated during multitasking.
Collapse
Affiliation(s)
- Wenbin Li
- Department of Aerospace Hygiene, Faculty of Aerospace MedicineAir Force Medical UniversityXi'anChina
| | - Shan Cheng
- Department of Aerospace Medical Equipment, Faculty of Aerospace MedicineAir Force Medical UniversityXi'anChina
| | - Jing Dai
- Department of Aerospace Ergonomics, Faculty of Aerospace MedicineAir Force Medical UniversityXi'anChina
| | - Yaoming Chang
- Department of Aerospace Hygiene, Faculty of Aerospace MedicineAir Force Medical UniversityXi'anChina
| |
Collapse
|
2
|
Feltman KA, Vogl JF, McAtee A, Kelley AM. Measuring aviator workload using EEG: an individualized approach to workload manipulation. FRONTIERS IN NEUROERGONOMICS 2024; 5:1397586. [PMID: 38919336 PMCID: PMC11197431 DOI: 10.3389/fnrgo.2024.1397586] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Accepted: 05/21/2024] [Indexed: 06/27/2024]
Abstract
Introduction Measuring an operator's physiological state and using that data to predict future performance decrements has been an ongoing goal in many areas of transportation. Regarding Army aviation, the realization of such an endeavor could lead to the development of an adaptive automation system which adapts to the needs of the operator. However, reaching this end state requires the use of experimental scenarios similar to real-life settings in order to induce the state of interest that are able to account for individual differences in experience, exposure, and perception to workload manipulations. In the present study, we used an individualized approach to manipulating workload in order to account for individual differences in response to workload manipulations, while still providing an operationally relevant flight experience. Methods Eight Army aviators participated in the study, where they completed two visits to the laboratory. The first visit served the purpose of identifying individual workload thresholds, with the second visit resulting in flights with individualized workload manipulations. EEG data was collected throughout both flights, along with subjective ratings of workload and flight performance. Results Both EEG data and workload ratings suggested a high workload. Subjective ratings were higher during the high workload flight compared to the low workload flight (p < 0.001). Regarding EEG, frontal alpha (p = 0.04) and theta (p = 0.01) values were lower and a ratio of beta/(alpha+theta) (p = 0.02) were higher in the baseline flight scenario compared to the high workload scenario. Furthermore, the data were compared to that collected in previous studies which used a group-based approach to manipulating workload. Discussion The individualized method demonstrated higher effect sizes in both EEG and subjective ratings, suggesting the use of this method may provide a more reliable way of producing high workload in aviators.
Collapse
Affiliation(s)
- Kathryn A. Feltman
- United States Army Aeromedical Research Laboratory, Fort Novosel, AL, United States
| | - Johnathan F. Vogl
- United States Army Aeromedical Research Laboratory, Fort Novosel, AL, United States
| | - Aaron McAtee
- United States Army Aeromedical Research Laboratory, Fort Novosel, AL, United States
- Goldbelt Inc., Herndon, VA, United States
| | - Amanda M. Kelley
- United States Army Aeromedical Research Laboratory, Fort Novosel, AL, United States
| |
Collapse
|
3
|
Liu C, Zhang C, Sun L, Liu K, Liu H, Zhu W, Jiang C. Detection of Pilot's Mental Workload Using a Wireless EEG Headset in Airfield Traffic Pattern Tasks. ENTROPY (BASEL, SWITZERLAND) 2023; 25:1035. [PMID: 37509982 PMCID: PMC10378707 DOI: 10.3390/e25071035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Revised: 06/25/2023] [Accepted: 07/05/2023] [Indexed: 07/30/2023]
Abstract
Elevated mental workload (MWL) experienced by pilots can result in increased reaction times or incorrect actions, potentially compromising flight safety. This study aims to develop a functional system to assist administrators in identifying and detecting pilots' real-time MWL and evaluate its effectiveness using designed airfield traffic pattern tasks within a realistic flight simulator. The perceived MWL in various situations was assessed and labeled using NASA Task Load Index (NASA-TLX) scores. Physiological features were then extracted using a fast Fourier transformation with 2-s sliding time windows. Feature selection was conducted by comparing the results of the Kruskal-Wallis (K-W) test and Sequential Forward Floating Selection (SFFS). The results proved that the optimal input was all PSD features. Moreover, the study analyzed the effects of electroencephalography (EEG) features from distinct brain regions and PSD changes across different MWL levels to further assess the proposed system's performance. A 10-fold cross-validation was performed on six classifiers, and the optimal accuracy of 87.57% was attained using a multi-class K-Nearest Neighbor (KNN) classifier for classifying different MWL levels. The findings indicate that the wireless headset-based system is reliable and feasible. Consequently, numerous wireless EEG device-based systems can be developed for application in diverse real-driving scenarios. Additionally, the current system contributes to future research on actual flight conditions.
Collapse
Affiliation(s)
- Chenglin Liu
- School of Transportation & Logistics, Southwest Jiaotong University, Chengdu 611756, China
| | - Chenyang Zhang
- School of Transportation & Logistics, Southwest Jiaotong University, Chengdu 611756, China
| | - Luohao Sun
- School of Information Science and Technology, Southwest Jiaotong University, Chengdu 611756, China
| | - Kun Liu
- School of Transportation & Logistics, Southwest Jiaotong University, Chengdu 611756, China
| | - Haiyue Liu
- School of Transportation & Logistics, Southwest Jiaotong University, Chengdu 611756, China
| | - Wenbing Zhu
- School of Transportation & Logistics, Southwest Jiaotong University, Chengdu 611756, China
| | - Chaozhe Jiang
- School of Transportation & Logistics, Southwest Jiaotong University, Chengdu 611756, China
| |
Collapse
|
4
|
Mastropietro A, Pirovano I, Marciano A, Porcelli S, Rizzo G. Reliability of Mental Workload Index Assessed by EEG with Different Electrode Configurations and Signal Pre-Processing Pipelines. SENSORS (BASEL, SWITZERLAND) 2023; 23:1367. [PMID: 36772409 PMCID: PMC9920504 DOI: 10.3390/s23031367] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Revised: 01/18/2023] [Accepted: 01/21/2023] [Indexed: 06/18/2023]
Abstract
BACKGROUND AND OBJECTIVE Mental workload (MWL) is a relevant construct involved in all cognitively demanding activities, and its assessment is an important goal in many research fields. This paper aims at evaluating the reproducibility and sensitivity of MWL assessment from EEG signals considering the effects of different electrode configurations and pre-processing pipelines (PPPs). METHODS Thirteen young healthy adults were enrolled and were asked to perform 45 min of Simon's task to elicit a cognitive demand. EEG data were collected using a 32-channel system with different electrode configurations (fronto-parietal; Fz and Pz; Cz) and analyzed using different PPPs, from the simplest bandpass filtering to the combination of filtering, Artifact Subspace Reconstruction (ASR) and Independent Component Analysis (ICA). The reproducibility of MWL indexes estimation and the sensitivity of their changes were assessed using Intraclass Correlation Coefficient and statistical analysis. RESULTS MWL assessed with different PPPs showed reliability ranging from good to very good in most of the electrode configurations (average consistency > 0.87 and average absolute agreement > 0.92). Larger fronto-parietal electrode configurations, albeit being more affected by the choice of PPPs, provide better sensitivity in the detection of MWL changes if compared to a single-electrode configuration (18 vs. 10 statistically significant differences detected, respectively). CONCLUSIONS The most complex PPPs have been proven to ensure good reliability (>0.90) and sensitivity in all experimental conditions. In conclusion, we propose to use at least a two-electrode configuration (Fz and Pz) and complex PPPs including at least the ICA algorithm (even better including ASR) to mitigate artifacts and obtain reliable and sensitive MWL assessment during cognitive tasks.
Collapse
Affiliation(s)
- Alfonso Mastropietro
- Institute of Biomedical Technologies, National Research Council, Via Fratelli Cervi 93, 20054 Segrate, Italy
| | - Ileana Pirovano
- Institute of Biomedical Technologies, National Research Council, Via Fratelli Cervi 93, 20054 Segrate, Italy
| | - Alessio Marciano
- Department of Molecular Medicine, University of Pavia, Via Forlanini 6, 27100 Pavia, Italy
| | - Simone Porcelli
- Department of Molecular Medicine, University of Pavia, Via Forlanini 6, 27100 Pavia, Italy
| | - Giovanna Rizzo
- Institute of Biomedical Technologies, National Research Council, Via Fratelli Cervi 93, 20054 Segrate, Italy
| |
Collapse
|
5
|
Recognising situation awareness associated with different workloads using EEG and eye-tracking features in air traffic control tasks. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.110179] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
6
|
Izadi Laybidi M, Rasoulzadeh Y, Dianat I, Samavati M, Asghari Jafarabadi M, Nazari MA. Cognitive performance and electroencephalographic variations in air traffic controllers under various mental workload and time of day. Physiol Behav 2022; 252:113842. [PMID: 35561808 DOI: 10.1016/j.physbeh.2022.113842] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2021] [Revised: 03/12/2022] [Accepted: 05/09/2022] [Indexed: 11/19/2022]
Abstract
The aim of this study was to investigate the effects of mental workload (MWL) and time of day on cognitive performance and electroencephalographic (EEG) parameters of air traffic controllers. EEG signals recorded while 20 professional air traffic controllers performed cognitive tasks [A-X Continuous Performance Test (AX-CPT) and 3-back working memory task] after they were exposed to two levels of task difficulty (high and low MWL) in the morning and afternoon. Significant decreases in cognitive performance were found when the levels of task difficulty increased in both tasks. The results confirmed the sensitivity of the theta and beta activities to levels of task difficulty in the 3-back task, while they were not affected in the AX-CPT. Theta and beta activities were influenced by time of day in the AX-CPT. The findings provide guidance for application of changes in EEG parameters when MWL level is manipulated during the day that could be implemented in future for the development of real-time monitoring systems to improve aviation safety.
Collapse
Affiliation(s)
- Marzieh Izadi Laybidi
- Department of Occupational Health and Ergonomics, Faculty of Health, Tabriz University of Medical Sciences, Tabriz, Iran; Student Research Committee, Faculty of Health, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Yahya Rasoulzadeh
- Department of Occupational Health and Ergonomics, Faculty of Health, Tabriz University of Medical Sciences, Tabriz, Iran; Road Traffic Injury Research Center, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Iman Dianat
- Department of Occupational Health and Ergonomics, Faculty of Health, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Mehdi Samavati
- Research Center for Biomedical Technologies & Robotics, Tehran University of Medical Sciences, Tehran, Iran
| | - Mohammad Asghari Jafarabadi
- Center for the Development of Interdisciplinary Research in Islamic Sciences and Health Sciences, Tabriz University of Medical Sciences, Tabriz, Iran; Department of Statistics and Epidemiology, School of Medicine, Zanjan University of Medical Sciences, Zanjan, Iran
| | - Mohammad Ali Nazari
- Department of Neuroscience, Faculty of Advanced Technologies in Medicine, Iran University of Medical Sciences, Tehran, Iran.
| |
Collapse
|
7
|
Pagnotta M, Jacobs DM, de Frutos PL, Rodríguez R, Ibáñez-Gijón J, Travieso D. Task difficulty and physiological measures of mental workload in air traffic control: a scoping review. ERGONOMICS 2022; 65:1095-1118. [PMID: 34904533 DOI: 10.1080/00140139.2021.2016998] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/25/2021] [Accepted: 12/05/2021] [Indexed: 06/14/2023]
Abstract
This study provides a systematic synthesis of empirical research on mental workload (MWL) in air traffic control (ATC). MWL is a key concept in research on innovative technologies, because the assessment of MWL is crucial to the evaluation of such technologies. Our specific focus was on physiological measures of MWL. The used search strategy identified 39 peer-reviewed publications that analysed ATC tasks, examined different levels of difficulty of the ATC task, and considered at least one physiological measure of MWL. Positive relations between measures of MWL and task difficulty were observed most frequently, indicating that the measures indeed allowed the assessment of MWL. The most commonly used physiological measures were brain measures (EEG and fNIR) and heart rate measures. The review revealed a need for more precise descriptions of crucial experimental parameters in order to permit a transition of the field towards more interactive and dynamic types of analysis. Practitioner summary: Research on innovative technology in air traffic control (ATC) depends on assessments of mental workload (MWL). We reviewed empirical research on MWL in ATC. Brain and heart measures often allow assessments of MWL. Better descriptions of experiments are needed to allow comparisons among studies and more dynamic and interactive analyses.
Collapse
Affiliation(s)
- Murillo Pagnotta
- Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain
| | - David M Jacobs
- Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain
| | | | - Ruben Rodríguez
- CRIDA A.I.E, ATM R&D + Innovation Reference Centre, Madrid, Spain
| | | | - David Travieso
- Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain
| |
Collapse
|
8
|
Zou Y, Zhao X, Chu Y, Xu W, Han J, Li W. A supervised independent component analysis algorithm for motion imagery-based brain computer interface. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103576] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
9
|
Wendiggensen P, Ghin F, Koyun AH, Stock AK, Beste C. Pretrial Theta Band Activity Affects Context-dependent Modulation of Response Inhibition. J Cogn Neurosci 2022; 34:605-617. [PMID: 35061021 DOI: 10.1162/jocn_a_01816] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/17/2024]
Abstract
The ability to inhibit a prepotent response is a crucial prerequisite of goal-directed behavior. So far, research on response inhibition has mainly examined these processes when there is little to no cognitive control during the decision to respond. We manipulated the "context" in which response inhibition has to be exerted (i.e., a controlled or an automated context) by combining a Simon task with a go/no-go task and focused on theta band activity. To investigate the role of "context" in response inhibition, we also examined how far theta band activity in the pretrial period modulates context-dependent variations of theta band activity during response inhibition. This was done in an EEG study applying beamforming methods. Here, we examined n = 43 individuals. We show that an automated context, as opposed to a controlled context, compromises response inhibition performance and increases the need for cognitive control. This was also related to context-dependent modulations of theta band activity in superior frontal and middle frontal regions. Of note, results showed that theta band activity in the pretrial period, associated with the right inferior frontal cortex, was substantially correlated with context-dependent modulations of theta band activity during response inhibition. The direction of the obtained correlation provides insights into the functional relevance of a pretrial theta band activity. The data suggest that pretrial theta band activity reflects some form of attentional sampling to inform possible upcoming processes signaling the need for cognitive control.
Collapse
Affiliation(s)
- Paul Wendiggensen
- Cognitive Neurophysiology, Department of Child and Adolescent Psychiatry, Faculty of Medicine, Technische Universität Dresden, Germany
| | - Filippo Ghin
- Cognitive Neurophysiology, Department of Child and Adolescent Psychiatry, Faculty of Medicine, Technische Universität Dresden, Germany
| | - Anna Helin Koyun
- Cognitive Neurophysiology, Department of Child and Adolescent Psychiatry, Faculty of Medicine, Technische Universität Dresden, Germany
| | - Ann-Kathrin Stock
- Cognitive Neurophysiology, Department of Child and Adolescent Psychiatry, Faculty of Medicine, Technische Universität Dresden, Germany
| | - Christian Beste
- Cognitive Neurophysiology, Department of Child and Adolescent Psychiatry, Faculty of Medicine, Technische Universität Dresden, Germany
| |
Collapse
|
10
|
Han Y, Ziebell P, Riccio A, Halder S. Two sides of the same coin: adaptation of BCIs to internal states with user-centered design and electrophysiological features. BRAIN-COMPUTER INTERFACES 2022. [DOI: 10.1080/2326263x.2022.2041294] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Affiliation(s)
- Yiyuan Han
- School of Computer Science and Electronic Engineering, University of Essex, Colchester, UK
| | - Philipp Ziebell
- Institute of Psychology, University of Würzburg, Würzburg, Germany
| | - Angela Riccio
- Neuroelectrical Imaging and Brain Computer Interface Laboratory,Fondazione Santa Lucia, Irccs, Rome, Italy
| | - Sebastian Halder
- School of Computer Science and Electronic Engineering, University of Essex, Colchester, UK
| |
Collapse
|
11
|
Rahman ML, Files BT, Oiknine AH, Pollard KA, Khooshabeh P, Song C, Passaro AD. Combining Neural and Behavioral Measures Enhances Adaptive Training. Front Hum Neurosci 2022; 16:787576. [PMID: 35237140 PMCID: PMC8882624 DOI: 10.3389/fnhum.2022.787576] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Accepted: 01/10/2022] [Indexed: 11/22/2022] Open
Abstract
Adaptive training adjusts a training task with the goal of improving learning outcomes. Adaptive training has been shown to improve human performance in attention, working memory capacity, and motor control tasks. Additionally, correlations have been observed between neural EEG spectral features (4–13 Hz) and the performance of some cognitive tasks. This relationship suggests some EEG features may be useful in adaptive training regimens. Here, we anticipated that adding a neural measure into a behavioral-based adaptive training system would improve human performance on a subsequent transfer task. We designed, developed, and conducted a between-subjects study of 44 participants comparing three training regimens: Single Item Fixed Difficulty (SIFD), Behaviorally Adaptive Training (BAT), and Combined Adaptive Training (CAT) using both behavioral and EEG measures. Results showed a statistically significant transfer task performance advantage of the CAT-based system relative to SIFD and BAT systems of 6 and 9 percentage points, respectively. Our research shows a promising pathway for designing closed-loop BCI systems based on both users' behavioral performance and neural signals for augmenting human performance.
Collapse
Affiliation(s)
- Md Lutfor Rahman
- Department of Computer Science and Information Systems, California State University San Marcos, San Marcos, CA, United States
- Human Research and Engineering Directorate, DEVCOM Army Research Laboratory, Los Angeles, CA, United States
- Department of Computer Science and Engineering, University of California, Riverside, Riverside, CA, United States
| | - Benjamin T. Files
- Human Research and Engineering Directorate, DEVCOM Army Research Laboratory, Los Angeles, CA, United States
- *Correspondence: Benjamin T. Files
| | | | - Kimberly A. Pollard
- Human Research and Engineering Directorate, DEVCOM Army Research Laboratory, Los Angeles, CA, United States
| | - Peter Khooshabeh
- Human Research and Engineering Directorate, DEVCOM Army Research Laboratory, Los Angeles, CA, United States
| | - Chengyu Song
- Department of Computer Science and Engineering, University of California, Riverside, Riverside, CA, United States
| | - Antony D. Passaro
- Human Research and Engineering Directorate, DEVCOM Army Research Laboratory, Los Angeles, CA, United States
| |
Collapse
|
12
|
Chikhi S, Matton N, Blanchet S. EEG
power spectral measures of cognitive workload: A meta‐analysis. Psychophysiology 2022; 59:e14009. [DOI: 10.1111/psyp.14009] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2021] [Revised: 12/13/2021] [Accepted: 01/10/2022] [Indexed: 12/22/2022]
Affiliation(s)
- Samy Chikhi
- Laboratoire Mémoire, Cerveau et Cognition (MC2Lab, URP 7536), Institute of Psychology University of Paris Boulogne‐Billancourt France
| | - Nadine Matton
- CLLE‐LTC University of Toulouse, CNRS (UMR5263) Toulouse France
- ENAC Research Lab École Nationale d’Aviation Civile Toulouse France
| | - Sophie Blanchet
- Laboratoire Mémoire, Cerveau et Cognition (MC2Lab, URP 7536), Institute of Psychology University of Paris Boulogne‐Billancourt France
| |
Collapse
|
13
|
Study of EEG characteristics while solving scientific problems with different mental effort. Sci Rep 2021; 11:23783. [PMID: 34893689 PMCID: PMC8664921 DOI: 10.1038/s41598-021-03321-9] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2021] [Accepted: 11/24/2021] [Indexed: 11/11/2022] Open
Abstract
Studying the mental effort in problem-solving is important to the understanding of how the brain allocates cognitive resources to process information. The electroencephalogram is a promising physiological approach to assessing the online mental effort. In this study, we investigate the EEG indicators of mental effort while solving scientific problems. By manipulating the complexity of the scientific problem, the level of mental effort also changes. With the increase of mental effort, theta synchronization in the frontal region and lower alpha desynchronization in the parietal and occipital regions significantly increase. Also, upper alpha desynchronization demonstrates a widespread enhancement across the whole brain. According to the functional topography of brain activity in the theta and alpha frequency, our results suggest that the mental effort while solving scientific problems is related to working memory, visuospatial processing, semantic processing and magnitude manipulation. This study suggests the reliability of EEG to evaluate the mental effort in an educational context and provides valuable insights into improving the problem-solving abilities of students in educational practice.
Collapse
|
14
|
The EEG spectral properties of meditation and mind wandering differ between experienced meditators and novices. Neuroimage 2021; 245:118669. [PMID: 34688899 DOI: 10.1016/j.neuroimage.2021.118669] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2021] [Revised: 10/15/2021] [Accepted: 10/18/2021] [Indexed: 01/26/2023] Open
Abstract
Previous literature suggests that individuals with meditation training become less distracted during meditation practice. In this study, we assess whether putative differences in the subjective experience of meditation between meditators and non-meditators are reflected in EEG spectral modulations. For this purpose, we recorded electroencephalography (EEG) during rest and two breath focus meditations (with and without experience sampling) in a group of 29 adult participants with more than 3 years of meditation experience and a control group of 29 participants without any meditation experience. Experience sampling in one of the meditation conditions allowed us to disentangle periods of breath focus from mind wandering (i.e. moments of distraction driven by task-irrelevant thoughts) during meditation practice. Overall, meditators reported a greater level of focus and reduced mind wandering during meditation practice than controls. In line with these reports, EEG spectral modulations associated with meditation and mind wandering also differed significantly between meditators and controls. While meditators (but not controls) showed a significant decrease in individual alpha frequency / amplitude and a steeper 1/f slope during meditation relative to rest, controls (but not meditators) showed a relative increase in individual alpha amplitude during mind wandering relative to breath focus periods. Together, our results show that the subjective experience of meditation and mind wandering differs between meditators and novices and that this is reflected in oscillatory and non-oscillatory properties of EEG.
Collapse
|
15
|
Zhao Y, Dai G, Borghini G, Zhang J, Li X, Zhang Z, Aricò P, Di Flumeri G, Babiloni F, Zeng H. Label-Based Alignment Multi-Source Domain Adaptation for Cross-Subject EEG Fatigue Mental State Evaluation. Front Hum Neurosci 2021; 15:706270. [PMID: 34658814 PMCID: PMC8519604 DOI: 10.3389/fnhum.2021.706270] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2021] [Accepted: 08/27/2021] [Indexed: 11/13/2022] Open
Abstract
Accurate detection of driving fatigue is helpful in significantly reducing the rate of road traffic accidents. Electroencephalogram (EEG) based methods are proven to be efficient to evaluate mental fatigue. Due to its high non-linearity, as well as significant individual differences, how to perform EEG fatigue mental state evaluation across different subjects still keeps challenging. In this study, we propose a Label-based Alignment Multi-Source Domain Adaptation (LA-MSDA) for cross-subject EEG fatigue mental state evaluation. Specifically, LA-MSDA considers the local feature distributions of relevant labels between different domains, which efficiently eliminates the negative impact of significant individual differences by aligning label-based feature distributions. In addition, the strategy of global optimization is introduced to address the classifier confusion decision boundary issues and improve the generalization ability of LA-MSDA. Experimental results show LA-MSDA can achieve remarkable results on EEG-based fatigue mental state evaluation across subjects, which is expected to have wide application prospects in practical brain-computer interaction (BCI), such as online monitoring of driver fatigue, or assisting in the development of on-board safety systems.
Collapse
Affiliation(s)
- Yue Zhao
- School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, China
| | - Guojun Dai
- School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, China
| | - Gianluca Borghini
- Industrial NeuroScience Lab, University of Rome "La Sapienza", Rome, Italy
| | - Jiaming Zhang
- School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, China
| | - Xiufeng Li
- School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, China
| | - Zhenyan Zhang
- School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, China
| | - Pietro Aricò
- Industrial NeuroScience Lab, University of Rome "La Sapienza", Rome, Italy
| | | | - Fabio Babiloni
- School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, China.,Industrial NeuroScience Lab, University of Rome "La Sapienza", Rome, Italy
| | - Hong Zeng
- School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, China.,Key Laboratory of Brain Machine Collaborative Intelligence of Zhejiang Province, Hangzhou, China
| |
Collapse
|
16
|
Bagheri M, Power SD. Investigating hierarchical and ensemble classification approaches to mitigate the negative effect of varying stress state on EEG-based detection of mental workload level - and vice versa. BRAIN-COMPUTER INTERFACES 2021. [DOI: 10.1080/2326263x.2021.1948756] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
Affiliation(s)
- Mahsa Bagheri
- Faculty of Engineering and Applied Science, Memorial University of Newfoundland, St. John’s, Canada
| | - Sarah D. Power
- Faculty of Engineering and Applied Science, Memorial University of Newfoundland, St. John’s, Canada
- Faculty of Medicine, Memorial University of Newfoundland, St. John’s, Canada
| |
Collapse
|
17
|
Wisniewski MG, Zakrzewski AC, Bell DR, Wheeler M. EEG power spectral dynamics associated with listening in adverse conditions. Psychophysiology 2021; 58:e13877. [PMID: 34161612 DOI: 10.1111/psyp.13877] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2020] [Revised: 05/15/2021] [Accepted: 05/17/2021] [Indexed: 01/08/2023]
Abstract
Adverse listening conditions increase the demand on cognitive resources needed for speech comprehension. In an exploratory study, we aimed to identify independent power spectral features in the EEG useful for studying the cognitive processes involved in this effortful listening. Listeners performed the coordinate response measure task with a single-talker masker at a 0-dB signal-to-noise ratio. Sounds were left unfiltered or degraded with low-pass filtering. Independent component analysis (ICA) was used to identify independent components (ICs) in the EEG data, the power spectral dynamics of which were then analyzed. Frontal midline theta, left frontal, right frontal, left mu, right mu, left temporal, parietal, left occipital, central occipital, and right occipital clusters of ICs were identified. All IC clusters showed some significant listening-related changes in their power spectrum. This included sustained theta enhancements, gamma enhancements, alpha enhancements, alpha suppression, beta enhancements, and mu rhythm suppression. Several of these effects were absent or negligible using traditional channel analyses. Comparison of filtered to unfiltered speech revealed a stronger alpha suppression in the parietal and central occipital clusters of ICs for the filtered speech condition. This not only replicates recent findings showing greater alpha suppression as listening difficulty increases but also suggests that such alpha-band effects can stem from multiple cortical sources. We lay out the advantages of the ICA approach over the restrictive analyses that have been used as of late in the study of listening effort. We also make suggestions for moving into hypothesis-driven studies regarding the power spectral features that were revealed.
Collapse
Affiliation(s)
- Matthew G Wisniewski
- Department of Psychological Sciences, Kansas State University, Manhattan, KS, USA
| | | | - Destiny R Bell
- Department of Psychological Sciences, Kansas State University, Manhattan, KS, USA
| | - Michelle Wheeler
- Department of Psychological Sciences, Kansas State University, Manhattan, KS, USA
| |
Collapse
|
18
|
Robles D, Kuziek JWP, Wlasitz NA, Bartlett NT, Hurd PL, Mathewson KE. EEG in motion: Using an oddball task to explore motor interference in active skateboarding. Eur J Neurosci 2021; 54:8196-8213. [PMID: 33644960 DOI: 10.1111/ejn.15163] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2020] [Revised: 01/18/2021] [Accepted: 02/17/2021] [Indexed: 11/28/2022]
Abstract
Recent advancements in portable computer devices have opened new avenues in the study of human cognition outside research laboratories. This flexibility in methodology has led to the publication of several electroencephalography studies recording brain responses in real-world scenarios such as cycling and walking outside. In the present study, we tested the classic auditory oddball task while participants moved around an indoor running track using an electric skateboard. This novel approach allows for the study of attention in motion while virtually removing body movement. Using the skateboard auditory oddball paradigm, we found reliable and expected standard-target differences in the P3 and MMN/N2b event-related potentials. We also recorded baseline electroencephalography activity and found that, compared to this baseline, alpha power is attenuated in frontal and parietal regions during skateboarding. In order to explore the influence of motor interference in cognitive resources during skateboarding, we compared participants' preferred riding stance (baseline level of riding difficulty) versus their non-preferred stance (increased level of riding difficulty). We found that an increase in riding difficulty did not modulate the P3 and tonic alpha amplitude during skateboard motion. These results suggest that increases in motor demands might not lead to reductions in cognitive resources as shown in previous literature.
Collapse
Affiliation(s)
- Daniel Robles
- Department of Psychology, Faculty of Science, University of Alberta, Edmonton, AB, Canada
| | - Jonathan W P Kuziek
- Department of Psychology, Faculty of Science, University of Alberta, Edmonton, AB, Canada
| | - Nicole A Wlasitz
- Department of Psychology, Faculty of Science, University of Alberta, Edmonton, AB, Canada
| | - Nathan T Bartlett
- Department of Psychology, Faculty of Science, University of Alberta, Edmonton, AB, Canada
| | - Pete L Hurd
- Department of Psychology, Faculty of Science, University of Alberta, Edmonton, AB, Canada
| | - Kyle E Mathewson
- Department of Psychology, Faculty of Science, University of Alberta, Edmonton, AB, Canada
| |
Collapse
|
19
|
EEG Correlates of Central Origin of Cancer-Related Fatigue. Neural Plast 2021; 2020:8812984. [PMID: 33488692 PMCID: PMC7787808 DOI: 10.1155/2020/8812984] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2020] [Revised: 10/26/2020] [Accepted: 11/05/2020] [Indexed: 11/17/2022] Open
Abstract
The neurophysiological mechanism of cancer-related fatigue (CRF) remains poorly understood. EEG was examined during a sustained submaximal contraction (SC) task to further understand our prior research findings of greater central contribution to early fatigue during SC in CRF. Advanced cancer patients and matched healthy controls performed an elbow flexor SC until task failure while undergoing neuromuscular testing and EEG recording. EEG power changes over left and right sensorimotor cortices were analyzed and correlated with brief fatigue inventory (BFI) score and evoked muscle force, a measure of central fatigue. Brain electrical activity changes during the SC differed in CRF from healthy subjects mainly in the theta (4-8 Hz) and beta (12-30 Hz) bands in the contralateral (to the fatigued limb) hemisphere; changes were correlated with the evoked force. Also, the gamma band (30-50 Hz) power decrease during the SC did not return to baseline after 2 min of rest in CRF, an effect correlated with BFI score. In conclusion, altered brain electrical activity during a fatigue task in patients is associated with central fatigue during SC or fatigue symptoms, suggesting its potential contribution to CRF during motor performance. This information should guide the development and use of rehabilitative interventions that target the central nervous system to maximize function recovery.
Collapse
|
20
|
Ismail LE, Karwowski W. Applications of EEG indices for the quantification of human cognitive performance: A systematic review and bibliometric analysis. PLoS One 2020; 15:e0242857. [PMID: 33275632 PMCID: PMC7717519 DOI: 10.1371/journal.pone.0242857] [Citation(s) in RCA: 35] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2020] [Accepted: 11/10/2020] [Indexed: 12/02/2022] Open
Abstract
BACKGROUND Neuroergonomics combines neuroscience with ergonomics to study human performance using recorded brain signals. Such neural signatures of performance can be measured using a variety of neuroimaging techniques, including functional magnetic resonance imaging (fMRI), functional near-infrared spectroscopy (fNIRS), and electroencephalography (EEG). EEG has an excellent temporal resolution, and EEG indices are highly sensitive to human brain activity fluctuations. OBJECTIVE The focus of this systematic review was to explore the applications of EEG indices for quantifying human performance in a variety of cognitive tasks at the macro and micro scales. To identify trends and the state of the field, we examined global patterns among selected articles, such as journal contributions, highly cited papers, affiliations, and high-frequency keywords. Moreover, we discussed the most frequently used EEG indices and synthesized current knowledge regarding the EEG signatures of associated human performance measurements. METHODS In this systematic review, we analyzed articles published in English (from peer-reviewed journals, proceedings, and conference papers), Ph.D. dissertations, textbooks, and reference books. All articles reviewed herein included exclusively EEG-based experimental studies in healthy participants. We searched Web-of-Science and Scopus databases using specific sets of keywords. RESULTS Out of 143 papers, a considerable number of cognitive studies focused on quantifying human performance with respect to mental fatigue, mental workload, mental effort, visual fatigue, emotion, and stress. An increasing trend for publication in this area was observed, with the highest number of publications in 2017. Most studies applied linear methods (e.g., EEG power spectral density and the amplitude of event-related potentials) to evaluate human cognitive performance. A few papers utilized nonlinear methods, such as fractal dimension, largest Lyapunov exponent, and signal entropy. More than 50% of the studies focused on evaluating an individual's mental states while operating a vehicle. Several different methods of artifact removal have also been noted. Based on the reviewed articles, research gaps, trends, and potential directions for future research were explored. CONCLUSION This systematic review synthesized current knowledge regarding the application of EEG indices for quantifying human performance in a wide variety of cognitive tasks. This knowledge is useful for understanding the global patterns of applications of EEG indices for the analysis and design of cognitive tasks.
Collapse
Affiliation(s)
- Lina Elsherif Ismail
- Department of Industrial Engineering and Management Systems, Computational Neuroergonomics Laboratory, University of Central Florida, Orlando, FL, United States of America
| | - Waldemar Karwowski
- Department of Industrial Engineering and Management Systems, Computational Neuroergonomics Laboratory, University of Central Florida, Orlando, FL, United States of America
| |
Collapse
|
21
|
Bagheri M, Power SD. EEG-based detection of mental workload level and stress: the effect of variation in each state on classification of the other. J Neural Eng 2020; 17:056015. [DOI: 10.1088/1741-2552/abbc27] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
|
22
|
Barua S, Ahmed MU, Begum S. Towards Intelligent Data Analytics: A Case Study in Driver Cognitive Load Classification. Brain Sci 2020; 10:E526. [PMID: 32781777 PMCID: PMC7465999 DOI: 10.3390/brainsci10080526] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2020] [Revised: 07/10/2020] [Accepted: 07/29/2020] [Indexed: 11/16/2022] Open
Abstract
One debatable issue in traffic safety research is that the cognitive load by secondary tasks reduces primary task performance, i.e., driving. In this paper, the study adopted a version of the n-back task as a cognitively loading secondary task on the primary task, i.e., driving; where drivers drove in three different simulated driving scenarios. This paper has taken a multimodal approach to perform 'intelligent multivariate data analytics' based on machine learning (ML). Here, the k-nearest neighbour (k-NN), support vector machine (SVM), and random forest (RF) are used for driver cognitive load classification. Moreover, physiological measures have proven to be sophisticated in cognitive load identification, yet it suffers from confounding factors and noise. Therefore, this work uses multi-component signals, i.e., physiological measures and vehicular features to overcome that problem. Both multiclass and binary classifications have been performed to distinguish normal driving from cognitive load tasks. To identify the optimal feature set, two feature selection algorithms, i.e., sequential forward floating selection (SFFS) and random forest have been applied where out of 323 features, a subset of 42 features has been selected as the best feature subset. For the classification, RF has shown better performance with F1-score of 0.75 and 0.80 than two other algorithms. Moreover, the result shows that using multicomponent features classifiers could classify better than using features from a single source.
Collapse
Affiliation(s)
- Shaibal Barua
- School of Innovation, Design and Engineering, Mälardalen University, Högskoleplan 1, 72220 Västerås, Sweden; (M.U.A.); (S.B.)
| | | | | |
Collapse
|
23
|
Radüntz T, Fürstenau N, Mühlhausen T, Meffert B. Indexing Mental Workload During Simulated Air Traffic Control Tasks by Means of Dual Frequency Head Maps. Front Physiol 2020; 11:300. [PMID: 32372970 PMCID: PMC7186426 DOI: 10.3389/fphys.2020.00300] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2019] [Accepted: 03/17/2020] [Indexed: 11/16/2022] Open
Abstract
In our digitized society, advanced information and communication technology and highly interactive work environments impose high demands on cognitive capacity. Optimal workload conditions are important for assuring employee's health and safety of other persons. This is particularly relevant in safety-critical occupations, such as air traffic control. For measuring mental workload using the EEG, we have developed the method of Dual Frequency Head Maps (DFHM). The method was tested and validated already under laboratory conditions. However, validation of the method regarding reliability and reproducibility of results under realistic settings and real world scenarios was still required. In our study, we examined 21 air traffic controllers during arrival management tasks. Mental workload variations were achieved by simulation scenarios with different number of aircraft and the occurrence of a priority-flight request as an exceptional event. The workload was assessed using the EEG-based DFHM-workload index and instantaneous self-assessment questionnaire. The DFHM-workload index gave stable results with highly significant correlations between scenarios with similar traffic-load conditions (r between 0.671 and 0.809, p ≤ 0.001). For subjects reporting that they experienced workload variation between the different scenarios, the DFHM-workload index yielded significant differences between traffic-load levels and priority-flight request conditions. For subjects who did not report to experience workload variations between the scenarios, the DFHM-workload index did not yield any significant differences for any of the factors. We currently conclude that the DFHM-workload index reveals potential for applications outside the laboratory and yields stable results without retraining of the classifiers neither regarding new subjects nor new tasks.
Collapse
Affiliation(s)
- Thea Radüntz
- Mental Health and Cognitive Capacity, Work and Health, Federal Institute for Occupational Safety and Health, Berlin, Germany
| | - Norbert Fürstenau
- Institute of Flight Guidance, German Aerospace Center, Braunschweig, Germany
| | - Thorsten Mühlhausen
- Institute of Flight Guidance, German Aerospace Center, Braunschweig, Germany
| | - Beate Meffert
- Signal Processing and Pattern Recognition, Department of Computer Science, Humboldt-Universität zu Berlin, Berlin, Germany
| |
Collapse
|
24
|
Fernandez Rojas R, Debie E, Fidock J, Barlow M, Kasmarik K, Anavatti S, Garratt M, Abbass H. Electroencephalographic Workload Indicators During Teleoperation of an Unmanned Aerial Vehicle Shepherding a Swarm of Unmanned Ground Vehicles in Contested Environments. Front Neurosci 2020; 14:40. [PMID: 32116498 PMCID: PMC7034033 DOI: 10.3389/fnins.2020.00040] [Citation(s) in RCA: 23] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2019] [Accepted: 01/13/2020] [Indexed: 11/15/2022] Open
Abstract
Background: Although many electroencephalographic (EEG) indicators have been proposed in the literature, it is unclear which of the power bands and various indices are best as indicators of mental workload. Spectral powers (Theta, Alpha, and Beta) and ratios (Beta/(Alpha + Theta), Theta/Alpha, Theta/Beta) were identified in the literature as prominent indicators of cognitive workload. Objective: The aim of the present study is to identify a set of EEG indicators that can be used for the objective assessment of cognitive workload in a multitasking setting and as a foundational step toward a human-autonomy augmented cognition system. Methods: The participants' perceived workload was modulated during a teleoperation task involving an unmanned aerial vehicle (UAV) shepherding a swarm of unmanned ground vehicles (UGVs). Three sources of data were recorded from sixteen participants (n = 16): heart rate (HR), EEG, and subjective indicators of the perceived workload using the Air Traffic Workload Input Technique (ATWIT). Results: The HR data predicted the scores from ATWIT. Nineteen common EEG features offered a discriminatory power of the four workload setups with high classification accuracy (82.23%), exhibiting a higher sensitivity than ATWIT and HR. Conclusion: The identified set of features represents EEG indicators for the objective assessment of cognitive workload across subjects. These common indicators could be used for augmented intelligence in human-autonomy teaming scenarios, and form the basis for our work on designing a closed-loop augmented cognition system for human-swarm teaming.
Collapse
Affiliation(s)
- Raul Fernandez Rojas
- School of Engineering & IT, University of New South Wales, Canberra, NSW, Australia
| | - Essam Debie
- School of Engineering & IT, University of New South Wales, Canberra, NSW, Australia
| | - Justin Fidock
- Defence Science and Technology Organisation, Adelaide, SA, Australia
| | - Michael Barlow
- School of Engineering & IT, University of New South Wales, Canberra, NSW, Australia
| | - Kathryn Kasmarik
- School of Engineering & IT, University of New South Wales, Canberra, NSW, Australia
| | - Sreenatha Anavatti
- School of Engineering & IT, University of New South Wales, Canberra, NSW, Australia
| | - Matthew Garratt
- School of Engineering & IT, University of New South Wales, Canberra, NSW, Australia
| | - Hussein Abbass
- School of Engineering & IT, University of New South Wales, Canberra, NSW, Australia
| |
Collapse
|
25
|
Jafari MJ, Zaeri F, Jafari AH, Payandeh Najafabadi AT, Hassanzadeh-Rangi N. Human-based dynamics of mental workload in complicated systems. EXCLI JOURNAL 2019; 18:501-512. [PMID: 31423130 PMCID: PMC6694705 DOI: 10.17179/excli2019-1372] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/24/2019] [Accepted: 07/08/2019] [Indexed: 11/30/2022]
Abstract
As a dynamic system in which different factors affect human performance via dynamic interactions, mental workload needs a dynamic measure to monitor its factors and evidence in a complicated system, an approach that is lacking in the literature. The present study introduces a system dynamics-based model for designing feedback mechanisms related to the mental workload through literature review and content analysis of the previous studies. A human-based archetype of mental workload was detected from the data collection process. The archetype is presented at various stages, including dynamic theory, behavior over time, leverage points and model verification. The real validation of the dynamic model was confirmed in an urban train simulator. The dynamic model can be used to analyze the long-term behavior of the mental workload. Decision-makers can benefit from the developed archetypes in evaluating the dynamic impact of their decisions on accident prevention in the complicated systems.
Collapse
Affiliation(s)
- Mohammad-Javad Jafari
- Department of Occupational Health and Safety Engineering, School of Public Health and Safety, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Farid Zaeri
- Proteomics Research Center and Department of Biostatistics, Faculty of Paramedical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Amir H Jafari
- Medical Physics & Biomedical Engineering Department, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | - Amir T Payandeh Najafabadi
- Department of Actuarial Science, Faculty of Mathematical Sciences, Shahid Beheshti University, G.C. Evin, 1983963113
| | - Narmin Hassanzadeh-Rangi
- Department of Occupational Health and Safety Engineering, School of Public Health and Safety, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| |
Collapse
|
26
|
Bernhardt KA, Poltavski D, Petros T, Ferraro FR, Jorgenson T, Carlson C, Drechsel P, Iseminger C. The effects of dynamic workload and experience on commercially available EEG cognitive state metrics in a high-fidelity air traffic control environment. APPLIED ERGONOMICS 2019; 77:83-91. [PMID: 30832781 DOI: 10.1016/j.apergo.2019.01.008] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/07/2018] [Revised: 11/07/2018] [Accepted: 01/18/2019] [Indexed: 06/09/2023]
Abstract
The current study evaluated the validity of commercially available electroencephalography (EEG) cognitive state metrics of workload and engagement in differentially experienced air traffic control (ATC) students. EEG and pupil diameter recordings were collected from 47 ATC students (27 more experienced and 20 less experienced) during a high-fidelity, variable workload approach-control scenario. Scenario workload was manipulated by increasing the number of aircraft released and the presence of a divided attention task. Results showed that scenario performance significantly degraded with increased aircraft and the presence of the divided attention task. No scenario performance differences were found between experience groups. The EEG engagement metric significantly differed between experience groups, with less experienced controllers exhibiting higher engagement than more experienced controllers. The EEG workload metric and pupil diameter were sensitive to workload manipulations but did not differentiate experience groups. Commercially available EEG cognitive state metrics may be a viable tool for enhancing ATC training.
Collapse
Affiliation(s)
- Kyle A Bernhardt
- Department of Psychology University of North Dakota, 501 North Columbia Rd, Stop 8380, Grand Forks, ND, 58202, USA.
| | - Dmitri Poltavski
- Department of Psychology University of North Dakota, 501 North Columbia Rd, Stop 8380, Grand Forks, ND, 58202, USA.
| | - Thomas Petros
- Department of Psychology University of North Dakota, 501 North Columbia Rd, Stop 8380, Grand Forks, ND, 58202, USA.
| | - F Richard Ferraro
- Department of Psychology University of North Dakota, 501 North Columbia Rd, Stop 8380, Grand Forks, ND, 58202, USA.
| | - Terra Jorgenson
- Department of Aviation University of North Dakota, 4251 University Ave, Grand Forks, ND, 58202, USA.
| | - Craig Carlson
- Department of Aviation University of North Dakota, 4251 University Ave, Grand Forks, ND, 58202, USA.
| | - Paul Drechsel
- Department of Aviation University of North Dakota, 4251 University Ave, Grand Forks, ND, 58202, USA.
| | - Colt Iseminger
- Department of Aviation University of North Dakota, 4251 University Ave, Grand Forks, ND, 58202, USA.
| |
Collapse
|
27
|
Lohani M, Payne BR, Strayer DL. A Review of Psychophysiological Measures to Assess Cognitive States in Real-World Driving. Front Hum Neurosci 2019; 13:57. [PMID: 30941023 PMCID: PMC6434408 DOI: 10.3389/fnhum.2019.00057] [Citation(s) in RCA: 95] [Impact Index Per Article: 15.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2018] [Accepted: 02/01/2019] [Indexed: 11/13/2022] Open
Abstract
As driving functions become increasingly automated, motorists run the risk of becoming cognitively removed from the driving process. Psychophysiological measures may provide added value not captured through behavioral or self-report measures alone. This paper provides a selective review of the psychophysiological measures that can be utilized to assess cognitive states in real-world driving environments. First, the importance of psychophysiological measures within the context of traffic safety is discussed. Next, the most commonly used physiology-based indices of cognitive states are considered as potential candidates relevant for driving research. These include: electroencephalography and event-related potentials, optical imaging, heart rate and heart rate variability, blood pressure, skin conductance, electromyography, thermal imaging, and pupillometry. For each of these measures, an overview is provided, followed by a discussion of the methods for measuring it in a driving context. Drawing from recent empirical driving and psychophysiology research, the relative strengths and limitations of each measure are discussed to highlight each measures' unique value. Challenges and recommendations for valid and reliable quantification from lab to (less predictable) real-world driving settings are considered. Finally, we discuss measures that may be better candidates for a near real-time assessment of motorists' cognitive states that can be utilized in applied settings outside the lab. This review synthesizes the literature on in-vehicle psychophysiological measures to advance the development of effective human-machine driving interfaces and driver support systems.
Collapse
Affiliation(s)
- Monika Lohani
- Department of Educational Psychology, University of Utah, Salt Lake City, UT, United States
| | - Brennan R. Payne
- Department of Psychology, University of Utah, Salt Lake City, UT, United States
| | - David L. Strayer
- Department of Psychology, University of Utah, Salt Lake City, UT, United States
| |
Collapse
|
28
|
Xu Y, Xiao D, Zhang H, He L, Gu Y, Peng X, Gao X, Liu Z, Zhang J. A prospective study on peptide mapping of human fatigue saliva markers based on magnetic beads. Exp Ther Med 2019; 17:2995-3002. [PMID: 30936969 PMCID: PMC6434231 DOI: 10.3892/etm.2019.7293] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2018] [Accepted: 01/24/2019] [Indexed: 11/05/2022] Open
Abstract
In order to explore convenient and stable fatigue markers, we studied various high-molecular-weight peptide fragments under fatigue state and non-fatigue state in the saliva using time of flight mass spectrometry. The saliva samples were collected from 10 healthy volunteers that were in the condition of fatigue and non-fatigue, respectively. Moreover, the time of flight mass spectrometry was conducted using two kinds of sample treatment methods, the magnetic beads enrichment (MB) and direct detection of stock solution. This was followed by modeling via the mass spectra of MB and supernatant (stock solution) directly collected after centrifugation. Both MB and direct sampling produced good spectrograms between 1,000 and 15,000 Da, while some peaks were lost in the enrichment. The spectrograms in the early and late period were different in each individual. Due to the limited sample size, 20 early and 20 late spectrograms were used for modeling analysis. Three different peptides were identified in the stock solution samples that can be detected in both fatigue and non-fatigue groups. The cross validity of MB model was 92.06%, while that of the stock solution model was 95.49%. The results showed that there were different peaks within the molecular weight of 2,000-15,000 Da, which provided a scientific basis for further realization of the convenient fatigue detection method based on the biosensor technique, with important theoretical and practical significance.
Collapse
Affiliation(s)
- Yanli Xu
- Hebei University of Engineering, Affiliated Hospital, College of Medicine, Handan, Hebei 056002, P.R. China
| | - Di Xiao
- State Key Laboratory of Infectious Disease Prevention and Control, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, National Institute for Communicable Disease Control and Prevention, Chinese Center for Disease Control and Prevention, Beijing 102206, P.R. China
| | - Huifang Zhang
- State Key Laboratory of Infectious Disease Prevention and Control, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, National Institute for Communicable Disease Control and Prevention, Chinese Center for Disease Control and Prevention, Beijing 102206, P.R. China
| | - Lihua He
- State Key Laboratory of Infectious Disease Prevention and Control, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, National Institute for Communicable Disease Control and Prevention, Chinese Center for Disease Control and Prevention, Beijing 102206, P.R. China
| | - Yixin Gu
- State Key Laboratory of Infectious Disease Prevention and Control, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, National Institute for Communicable Disease Control and Prevention, Chinese Center for Disease Control and Prevention, Beijing 102206, P.R. China
| | - Xianhui Peng
- State Key Laboratory of Infectious Disease Prevention and Control, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, National Institute for Communicable Disease Control and Prevention, Chinese Center for Disease Control and Prevention, Beijing 102206, P.R. China
| | - Xiaohuan Gao
- Beijing Huawei Tongke Medical Research Center, Beijing 100069, P.R. China
| | - Zhijun Liu
- Hebei University of Engineering, Affiliated Hospital, College of Medicine, Handan, Hebei 056002, P.R. China
| | - Jianzhong Zhang
- State Key Laboratory of Infectious Disease Prevention and Control, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, National Institute for Communicable Disease Control and Prevention, Chinese Center for Disease Control and Prevention, Beijing 102206, P.R. China
| |
Collapse
|
29
|
Aricò P, Borghini G, Di Flumeri G, Sciaraffa N, Babiloni F. Passive BCI beyond the lab: current trends and future directions. Physiol Meas 2018; 39:08TR02. [DOI: 10.1088/1361-6579/aad57e] [Citation(s) in RCA: 115] [Impact Index Per Article: 16.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
|
30
|
Dimitrakopoulos GN, Kakkos I, Dai Z, Wang H, Sgarbas K, Thakor N, Bezerianos A, Sun Y. Functional Connectivity Analysis of Mental Fatigue Reveals Different Network Topological Alterations Between Driving and Vigilance Tasks. IEEE Trans Neural Syst Rehabil Eng 2018; 26:740-749. [DOI: 10.1109/tnsre.2018.2791936] [Citation(s) in RCA: 76] [Impact Index Per Article: 10.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|