1
|
Jhen RN, Wang PC, Chang YM, Kao JL, Wu ECH, Shiao CC. The Clinical Significance and Application of Heart Rate Variability in Dialysis Patients: A Narrative Review. Biomedicines 2024; 12:1547. [PMID: 39062120 PMCID: PMC11275182 DOI: 10.3390/biomedicines12071547] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2024] [Revised: 06/24/2024] [Accepted: 07/10/2024] [Indexed: 07/28/2024] Open
Abstract
Autonomic nervous system (ANS) dysfunction is prevalent in end-stage kidney disease (ESKD) patients, carrying significant risks for morbidity and mortality. Heart rate variability (HRV) is a simple and non-invasive method to evaluate ANS functions and predict prognoses in specific patient populations. Since there is a lack of a clear understanding of the clinical significance of HRV in predicting prognoses in ESKD patients, an updated review on this topic is urgently warranted. The clinical significance of HRV in dialysis patients includes its associations with metabolic syndrome, nutritional status, intradialytic hypotension, vascular access failure, major adverse cardiovascular events, and mortality. These findings underscore the essential role of the autonomic reserve, which might denote the elevation of ANS activity as a response to external stimulus. Patients with a higher level of sympathetic activity at the resting stage, but who are unable to adequately elevate their sympathetic activity under stress might be susceptible to a worse outcome in critical circumstances. Further applications of HRV include HRV biofeedback, risk classification, and real-time HRV monitoring. Overall, HRV is an optimal tool for predicting prognoses in dialysis patients. Further study is encouraged in order to gain a clearer understanding of the clinical significance and application of HRV, and thereby enhance the care of ESKD patients.
Collapse
Affiliation(s)
- Rong-Na Jhen
- Division of Nephrology, Department of Internal Medicine, Camillian Saint Mary’s Hospital Luodong, No. 160, Zhongzheng S. Rd., Luodong Township, Yilan County 265, Taiwan; (R.-N.J.); (Y.-M.C.); (J.-L.K.)
| | - Ping-Chen Wang
- Department of Medical Research and Education, Camillian Saint Mary’s Hospital Luodong, No. 160, Zhongzheng S. Rd., Luodong Township, Yilan County 265, Taiwan;
| | - Yu-Ming Chang
- Division of Nephrology, Department of Internal Medicine, Camillian Saint Mary’s Hospital Luodong, No. 160, Zhongzheng S. Rd., Luodong Township, Yilan County 265, Taiwan; (R.-N.J.); (Y.-M.C.); (J.-L.K.)
| | - Jsun-Liang Kao
- Division of Nephrology, Department of Internal Medicine, Camillian Saint Mary’s Hospital Luodong, No. 160, Zhongzheng S. Rd., Luodong Township, Yilan County 265, Taiwan; (R.-N.J.); (Y.-M.C.); (J.-L.K.)
| | - Eric Chien-Hwa Wu
- Division of Nephrology, Department of Internal Medicine, Camillian Saint Mary’s Hospital Jiaoxi, No. 129, Sec. 4, Jiaoxi Rd., Jiaoxi Township, Yilan County 262, Taiwan;
| | - Chih-Chung Shiao
- Division of Nephrology, Department of Internal Medicine, Camillian Saint Mary’s Hospital Luodong, No. 160, Zhongzheng S. Rd., Luodong Township, Yilan County 265, Taiwan; (R.-N.J.); (Y.-M.C.); (J.-L.K.)
| |
Collapse
|
2
|
Wiltshire TJ, van Eijndhoven K, Halgas E, Gevers JMP. Prospects for Augmenting Team Interactions with Real-Time Coordination-Based Measures in Human-Autonomy Teams. Top Cogn Sci 2024; 16:391-429. [PMID: 35261211 DOI: 10.1111/tops.12606] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2021] [Revised: 02/02/2022] [Accepted: 02/04/2022] [Indexed: 11/26/2022]
Abstract
Complex work in teams requires coordination across team members and their technology as well as the ability to change and adapt over time to achieve effective performance. To support such complex interactions, recent efforts have worked toward the design of adaptive human-autonomy teaming systems that can provide feedback in or near real time to achieve the desired individual or team results. However, while significant advancements have been made to better model and understand the dynamics of team interaction and its relationship with task performance, appropriate measures of team coordination and computational methods to detect changes in coordination have not yet been widely investigated. Having the capacity to measure coordination in real time is quite promising as it provides the opportunity to provide adaptive feedback that may influence and regulate teams' coordination patterns and, ultimately, drive effective team performance. A critical requirement to reach this potential is having the theoretical and empirical foundation from which to do so. Therefore, the first goal of the paper is to review approaches to coordination dynamics, identify current research gaps, and draw insights from other areas, such as social interaction, relationship science, and psychotherapy. The second goal is to collate extant work on feedback and advance ideas for adaptive feedback systems that have potential to influence coordination in a way that can enhance the effectiveness of team interactions. In addressing these two goals, this work lays the foundation as well as plans for the future of human-autonomy teams that augment team interactions using coordination-based measures.
Collapse
Affiliation(s)
- Travis J Wiltshire
- Department of Cognitive Science and Artificial Intelligence, Tilburg University
| | | | - Elwira Halgas
- Department of Industrial Engineering and Innovation Sciences, Eindhoven University of Technology
| | - Josette M P Gevers
- Department of Industrial Engineering and Innovation Sciences, Eindhoven University of Technology
| |
Collapse
|
3
|
Aygun A, Nguyen T, Haga Z, Aeron S, Scheutz M. Investigating Methods for Cognitive Workload Estimation for Assistive Robots. SENSORS (BASEL, SWITZERLAND) 2022; 22:6834. [PMID: 36146189 PMCID: PMC9505485 DOI: 10.3390/s22186834] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Revised: 08/29/2022] [Accepted: 09/05/2022] [Indexed: 06/16/2023]
Abstract
Robots interacting with humans in assistive contexts have to be sensitive to human cognitive states to be able to provide help when it is needed and not overburden the human when the human is busy. Yet, it is currently still unclear which sensing modality might allow robots to derive the best evidence of human workload. In this work, we analyzed and modeled data from a multi-modal simulated driving study specifically designed to evaluate different levels of cognitive workload induced by various secondary tasks such as dialogue interactions and braking events in addition to the primary driving task. Specifically, we performed statistical analyses of various physiological signals including eye gaze, electroencephalography, and arterial blood pressure from the healthy volunteers and utilized several machine learning methodologies including k-nearest neighbor, naive Bayes, random forest, support-vector machines, and neural network-based models to infer human cognitive workload levels. Our analyses provide evidence for eye gaze being the best physiological indicator of human cognitive workload, even when multiple signals are combined. Specifically, the highest accuracy (in %) of binary workload classification based on eye gaze signals is 80.45 ∓ 3.15 achieved by using support-vector machines, while the highest accuracy combining eye gaze and electroencephalography is only 77.08 ∓ 3.22 achieved by a neural network-based model. Our findings are important for future efforts of real-time workload estimation in the multimodal human-robot interactive systems given that eye gaze is easy to collect and process and less susceptible to noise artifacts compared to other physiological signal modalities.
Collapse
Affiliation(s)
- Ayca Aygun
- Department of Computer Science, Tufts University, Medford, MA 02155, USA
| | - Thuan Nguyen
- Department of Computer Science, Tufts University, Medford, MA 02155, USA
| | - Zachary Haga
- Department of Computer Science, Tufts University, Medford, MA 02155, USA
| | - Shuchin Aeron
- Department of Electrical and Computer Engineering, Tufts University, Medford, MA 02155, USA
| | - Matthias Scheutz
- Department of Computer Science, Tufts University, Medford, MA 02155, USA
| |
Collapse
|
4
|
Zangi N, Srour-Zreik R, Ridel D, Chasidim H, Borowsky A. Driver distraction and its effects on partially automated driving performance: A driving simulator study among young-experienced drivers. ACCIDENT; ANALYSIS AND PREVENTION 2022; 166:106565. [PMID: 35032704 DOI: 10.1016/j.aap.2022.106565] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/12/2021] [Revised: 12/29/2021] [Accepted: 01/03/2022] [Indexed: 06/14/2023]
Abstract
Drivers of partially automated vehicles (PAVs) are relieved from parts of the driving tasks allocated to the automated driver. Ironically, these drivers are obligated to continuously monitor the driving task at all times and keep their attention on the roadway. This reduction in the driving task's demands and cognitive workload may encourage drivers to engage with non-driving related tasks (NDRT), which may impair drivers' awareness of the road environment and, as a result, compromise safety. This study examined how engagement with a visual-manual NDRT affects the driving performance of PAV drivers. Thirty-seven participants were randomly assigned to one of two experimental conditions in a driving simulator. Each consisted of two simulated drives. The first experimental condition included one drive under manual driving conditions and another under partially automated driving conditions (i.e., L2). Both drives had no NDRT involved. The second experimental condition included one drive under L2 without an NDRT and one drive under L2, including engagement with an NDRT. Participants' eye movements and heart rate were recorded throughout the experiment. Across various measures, the findings showed that under L2 driving conditions, engagement with an NDRT impairs driving performance in two primary aspects: (1) drivers were less aware of road hazards, and (2) their mental workload was higher when they engaged with an NDRT. In addition, the findings reveal that for drivers engaged with an NDRT, the attentional time-sharing strategy between the NDRT and the roadway monitoring task affected the probability of identifying a hazard. This study shows the adverse effects of engagement with an NDRT under L2 driving conditions on driving performance. Future studies should examine different interventions to mitigate these effects, assuring that drivers are constantly aware of the roadway environment.
Collapse
Affiliation(s)
- Noa Zangi
- Ben-Gurion University of the Negev, Israel
| | | | - Dana Ridel
- Ben-Gurion University of the Negev, Israel
| | | | | |
Collapse
|
5
|
Ortiz-Rangel E, Guerrero-Ramírez GV, García-Beltrán CD, Guerrero-Lara M, Adam-Medina M, Astorga-Zaragoza CM, Reyes-Reyes J, Posada-Gómez R. Dynamic modeling and simulation of the human cardiovascular system with PDA. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103151] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
6
|
Nodoushan RJ, Madadizadeh F, Anoosheh VS, Boghri F, Chenani KT. Mental workload and occupational burnout among the faculty members and administrative staff of Yazd Public Health School. JOURNAL OF EDUCATION AND HEALTH PROMOTION 2021; 10:293. [PMID: 34667793 PMCID: PMC8459838 DOI: 10.4103/jehp.jehp_1076_20] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/23/2020] [Accepted: 01/07/2021] [Indexed: 06/13/2023]
Abstract
BACKGROUND Administrative staff may be exposed to a great deal of the mental workload (MWL) due to the long working hours and the responsibility of responding to large numbers of clients. Occupational burnout (OB) is one of the issues that can be affected by MWL. The aim of the present study was to investigate the relationship between mental MWL and OB, as well as the internal interactions between OB dimensions. MATERIALS AND METHODS This cross-sectional and descriptive (correlation) study was conducted among faculty members and administrative staff of public health school of Yazd province. Samples were collected through the simple random sampling. NASA task load index and Maslach questionnaire were used for the assessment of MWL and OB, respectively. Frequency and percentage were used for the descriptive analysis. Spearman, Mann-Whitney U, and Kruskal-Wallis H tests were used for inferential statistics. RESULTS Ultimately, 29 individuals from faculty members and 82 individuals from administrative staff participated in this study. Most of the participants (73.9%) had experienced many MWL instances in performing their jobs duties. No significant relationship between MWL with OB and MWL with any of the demographic characteristics was found, as well (P > 0.05). In case of OB, a significant relationship was discovered between depersonalization with gender and personal accomplishment with work section (P < 0.05). CONCLUSIONS MWL cannot be considered as a contributing factor of OB of the administrative staff because no significant relationship has been noted between them. Reducing working hours, selection of suitable staff, and allowing a few minutes to rest on a daily basis represent the suggested solutions for reducing the MWL of staff.
Collapse
Affiliation(s)
- Reza Jafari Nodoushan
- Department of Occupational Health Engineering, School of Public Health, Shahid Sadoughi University of Medical Sciences, Yazd, Iran
| | - Farzan Madadizadeh
- Department of Biostatistics and Epidemiology, Research Center of Prevention and Epidemiology of Non-Communicable Disease, School of Public Health, Shahid Sadoughi University of Medical Sciences, Yazd, Iran
| | - Vida Sadat Anoosheh
- PhD Student of Ergonomics, Department of Occupational Health and Ergonomics, School of Health, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Fahima Boghri
- Occupational Health Research Center, School of Public Health, Shahid Sadoughi University of Medical Sciences, Yazd, Iran
| | - Khalil Taherzadeh Chenani
- Occupational Health Research Center, School of Public Health, Shahid Sadoughi University of Medical Sciences, Yazd, Iran
| |
Collapse
|
7
|
Likens AD, Wiltshire TJ. Windowed multiscale synchrony: modeling time-varying and scale-localized interpersonal coordination dynamics. Soc Cogn Affect Neurosci 2021; 16:232-245. [PMID: 32991716 PMCID: PMC7812625 DOI: 10.1093/scan/nsaa130] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2020] [Revised: 06/30/2020] [Accepted: 09/18/2020] [Indexed: 12/18/2022] Open
Abstract
Social interactions are pervasive in human life with varying forms of interpersonal coordination emerging and spanning different modalities (e.g. behaviors, speech/language, and neurophysiology). However, during social interactions, as in any dynamical system, patterns of coordination form and dissipate at different scales. Historically, researchers have used aggregate measures to capture coordination over time. While those measures (e.g. mean relative phase, cross-correlation, coherence) have provided a wealth of information about coordination in social settings, some evidence suggests that multiscale coordination may change over the time course of a typical empirical observation. To address this gap, we demonstrate an underutilized method, windowed multiscale synchrony, that moves beyond quantifying aggregate measures of coordination by focusing on how the relative strength of coordination changes over time and the scales that comprise social interaction. This method involves using a wavelet transform to decompose time series into component frequencies (i.e. scales), preserving temporal information and then quantifying phase synchronization at each of these scales. We apply this method to both simulated and empirical interpersonal physiological and neuromechanical data. We anticipate that demonstrating this method will stimulate new insights on the mechanisms and functions of synchrony in interpersonal contexts using neurophysiological and behavioral measures.
Collapse
Affiliation(s)
- Aaron D Likens
- Department of Biomechanics, University of Nebraska at Omaha, 6001 Dodge Street Omaha, NE 68182
| | - Travis J Wiltshire
- Department of Cognitive Science & Artificial Intelligence, Tilburg University, (Room D104) Warandelaan 2, 5037 AB, Tilburg, The Netherlands
| |
Collapse
|
8
|
Statistical process control charts for better analysis of sequential data in psychology: The case of illusion of control experiments. Behav Res Methods 2021; 54:475-492. [PMID: 34244984 DOI: 10.3758/s13428-021-01619-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/10/2021] [Indexed: 11/08/2022]
Abstract
Illusion of control (IOC) is a bias in the judgment of personal success with implications to learning theories and health policies; some important questions in the investigation of IOC may be related to traditional measures in the field, namely self-assessment using Likert scales about the sense of control. Statistical process control (SPC) and Shewhart charts are methods developed to monitor and control industrial processes, never applied in psychological studies before. The present two studies investigated the use of the technique of Shewhart charts in the analysis of IOC. The purpose was to explore the use of SPC and Shewhart charts in the analysis of data sequences from psychological experiments; the objective was to analyze the results of reaction time (RT) data sequences plotted in SPC charts, in comparison with self-assessment judgments from an IOC task. Participants were 63 undergraduate students (Study 1) and 103 mine workers (Study 2) instructed to try to control a traffic light on a computer by pressing or not the keyboard. Higher probabilities of the successful outcome generated judgments of illusion and shifts (due to cognitive activity) in the charts of RT; lower probabilities resulted in null illusion and RT presented a random and stable profile. Patterns for different groups emerged in Shewhart charts. SPC can contribute to the analysis of the behavior of sequences of data in psychological studies, so that the charts indicate changes and patterns not detected by traditional ANOVA and other linear models.
Collapse
|
9
|
Melnicuk V, Thompson S, Jennings P, Birrell S. Effect of cognitive load on drivers' State and task performance during automated driving: Introducing a novel method for determining stabilisation time following take-over of control. ACCIDENT; ANALYSIS AND PREVENTION 2021; 151:105967. [PMID: 33444868 DOI: 10.1016/j.aap.2020.105967] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/07/2019] [Revised: 12/22/2020] [Accepted: 12/22/2020] [Indexed: 06/12/2023]
Abstract
This research paper explores the impact of cognitive load on drivers' physiological state and driving performance during an automated driving to manual control transition scenario, using a driving simulator. Whilst driving in the automated mode, cognitive load was manipulated using the "N-Back" task, which participants engaged with via a visual display. Results suggest that non-optimal levels of workload during the automated driving conditions impair driving performance, especially lateral control of the vehicle, and the magnitude of this impairment varied with increasing cognitive load. In addition to these findings, the present paper introduces a novel method for determining stabilisation times of both driver state and driving performance indicators following a transition of vehicle control. Using this method we demonstrate that mean and standard deviation of lane position impairments were found to take longer to stabilise following transition to manual driving following a higher level of cognitive load during the automated driving period, taking up to 22 s for driving performance to normalise after take-over. In addition, heart rate parameters take between 20 and 30 s to stabilise following a planned take-over request. Finally, this paper demonstrates how the magnitude of cognitive load can be estimated in context of automated driving using physiological measures, captured by consumer electronic devices. We discuss the impact our findings have on the design of SAE Level 3 systems. Relevant suggestions are provided to the research community and automakers working on future implementation of vehicles capable of conditional automation.
Collapse
Affiliation(s)
- Vadim Melnicuk
- Lotus Cars, Potash Lane, Hethel, Norwich, NR14 8EZ, United Kingdom
| | - Simon Thompson
- Jaguar Land Rover, Banbury Road, Gaydon, CV35 0RR, United Kingdom
| | - Paul Jennings
- WMG, University of Warwick, 6 Lord Bhattacharyya Way, Coventry, CV4 7AL, United Kingdom
| | - Stewart Birrell
- National Transport Design Centre, Coventry University, Swift Road, Coventry, CV1 2TT, United Kingdom.
| |
Collapse
|
10
|
Bläsing D, Bornewasser M. Influence of Increasing Task Complexity and Use of Informational Assistance Systems on Mental Workload. Brain Sci 2021; 11:102. [PMID: 33466605 PMCID: PMC7828683 DOI: 10.3390/brainsci11010102] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2020] [Revised: 01/06/2021] [Accepted: 01/12/2021] [Indexed: 11/16/2022] Open
Abstract
(1) Background: Cognitive aspects and complexity in modern manual mixed model assembly are increasing. To reduce mental workload (MWL), informational assistance systems are introduced. The influence of complexity and used assistance system on MWL should be investigated to further improve the implementation of such assistance systems. (2) Methods: Using a simulated close to real-life assembly task a 2 × 3 design was chosen, with two levels of assembly complexity (within subjects) and three different assistance systems (paper, Augmented Reality (AR)-glasses, tablet-between subjects). MWL was measured using either physiological response (electrocardiogram (ECG) and eye-tracking) or performance indicators. (3) Results: An influence of task complexity on MWL can be shown. Additionally, usability based differences between the used assistance systems become more evident with reference to the results of area of interest analysis. (4) Conclusions: Using a multi-modal measurement approach, it is possible to detect complexity-based differences in MWL. Additional research on validity and alignment is needed to further use these for (neuro-) ergonomic considerations and recommendations.
Collapse
Affiliation(s)
- Dominic Bläsing
- Institute of Psychology, University Greifswald, Franz-Mehring-Str. 47, 17489 Greifswald, Germany;
- Institute for Community Medicine, Prevention Research and Social Medicine, University Medicine Greifswald, Walther-Rathenau-Str. 48, 17489 Greifswald, Germany
| | - Manfred Bornewasser
- Institute of Psychology, University Greifswald, Franz-Mehring-Str. 47, 17489 Greifswald, Germany;
| |
Collapse
|
11
|
Hu J, He L, Wang R. Safety evaluation of freeway interchange merging areas based on driver workload theory. Sci Prog 2020; 103:36850420940878. [PMID: 32660349 PMCID: PMC10451929 DOI: 10.1177/0036850420940878] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Prior safety evaluations of interchange merging areas have mostly focused on traffic conflicts and operating speeds, without considering how these factors can influence the driver workload. Researches regarding the level of driver workload have largely concentrated on urban roads, tunnel sections, and basic freeway segments, without considering the impact of merging traffic flows on safety. Therefore, this study has investigated how merging vehicles can impact through-driver workload and safety. Three independent field experiments were conducted on freeways, involving 18 drivers and 17 interchanges. The results showed that the vehicles merging onto freeway impact driver workload and driving performance, generating potential risk that cannot be ignored. Merging into the mainline traffic flow increases the through-driver workload to a higher level or even exceeds the safety threshold, despite there being better geometrical conditions of interchanges than those of basic freeway segments. When the volume of merging vehicles exceeds 564 pcu/h or the traffic saturation is above 0.485, driver workload rises above the safety thresholds and the driving risk is elevated, which potentially would lead to crashes. This study offers insights for more effective segment division of operating speed prediction, and dynamic risk management with regard to interchange safety.
Collapse
Affiliation(s)
- Jiangbi Hu
- College of Architecture and Civil Engineering, Beijing University of Technology, Beijing, China
| | - Lucheng He
- College of Architecture and Civil Engineering, Beijing University of Technology, Beijing, China
| | - Ronghua Wang
- College of Architecture and Civil Engineering, Beijing University of Technology, Beijing, China
| |
Collapse
|
12
|
Jaiswal D, Chowdhury A, Banerjee T, Chatterjee D. Effect of Mental Workload on Breathing Pattern and Heart Rate for a Working Memory Task: A Pilot Study. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2019:2202-2206. [PMID: 31946338 DOI: 10.1109/embc.2019.8856458] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Mental workload or cognitive load is the total amount of mental resources required while doing a task. Apart from qualitative measures, various physiological signals are being used for assessment of mental workload. However, very limited research has been done on assessment of cognitive load from respiratory signals. In the present study, we have tried to analyze the cognitive load mainly based on respiratory features. n-back memory test has been modified to impart low and high cognitive load. The peripheral blood volume signal (PPG) collected while executing the task is used to reconstruct the breathing pattern signal. A number of morphological as well as statistical features are calculated from this reconstructed signal. Finally a classifier is used for classifying the low and high cognitive load. Results show that a classification accuracy of 76.8% is obtained while using respiratory features only. A maximum accuracy of 81.80% is obtained if we combine time domain PPG features with respiratory features. The features finally selected can also be used to study the habituation effect.
Collapse
|
13
|
|
14
|
Tao D, Tan H, Wang H, Zhang X, Qu X, Zhang T. A Systematic Review of Physiological Measures of Mental Workload. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2019; 16:E2716. [PMID: 31366058 PMCID: PMC6696017 DOI: 10.3390/ijerph16152716] [Citation(s) in RCA: 66] [Impact Index Per Article: 13.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/31/2019] [Revised: 07/21/2019] [Accepted: 07/26/2019] [Indexed: 01/04/2023]
Abstract
Mental workload (MWL) can affect human performance and is considered critical in the design and evaluation of complex human-machine systems. While numerous physiological measures are used to assess MWL, there appears no consensus on their validity as effective agents of MWL. This study was conducted to provide a comprehensive understanding of the use of physiological measures of MWL and to synthesize empirical evidence on the validity of the measures to discriminate changes in MWL. A systematical literature search was conducted with four electronic databases for empirical studies measuring MWL with physiological measures. Ninety-one studies were included for analysis. We identified 78 physiological measures, which were distributed in cardiovascular, eye movement, electroencephalogram (EEG), respiration, electromyogram (EMG) and skin categories. Cardiovascular, eye movement and EEG measures were the most widely used across varied research domains, with 76%, 66%, and 71% of times reported a significant association with MWL, respectively. While most physiological measures were found to be able to discriminate changes in MWL, they were not universally valid in all task scenarios. The use of physiological measures and their validity for MWL assessment also varied across different research domains. Our study offers insights into the understanding and selection of appropriate physiological measures for MWL assessment in varied human-machine systems.
Collapse
Affiliation(s)
- Da Tao
- State Key Laboratory of Nuclear Power Safety Monitoring Technology and Equipment, China Nuclear Power Engineering Co., Ltd., Shenzhen 518172, China
- Institute of Human Factors and Ergonomics, College of Mechatronics and Control Engineering, Shenzhen University, Shenzhen 518060, China
| | - Haibo Tan
- State Key Laboratory of Nuclear Power Safety Monitoring Technology and Equipment, China Nuclear Power Engineering Co., Ltd., Shenzhen 518172, China
| | - Hailiang Wang
- Institute of Human Factors and Ergonomics, College of Mechatronics and Control Engineering, Shenzhen University, Shenzhen 518060, China
- Key Laboratory of Optoelectronic Devices and Systems of Ministry of Education and Guangdong Province, Shenzhen University, Shenzhen 518060, China
| | - Xu Zhang
- Institute of Human Factors and Ergonomics, College of Mechatronics and Control Engineering, Shenzhen University, Shenzhen 518060, China
| | - Xingda Qu
- State Key Laboratory of Nuclear Power Safety Monitoring Technology and Equipment, China Nuclear Power Engineering Co., Ltd., Shenzhen 518172, China
- Institute of Human Factors and Ergonomics, College of Mechatronics and Control Engineering, Shenzhen University, Shenzhen 518060, China
| | - Tingru Zhang
- State Key Laboratory of Nuclear Power Safety Monitoring Technology and Equipment, China Nuclear Power Engineering Co., Ltd., Shenzhen 518172, China.
- Institute of Human Factors and Ergonomics, College of Mechatronics and Control Engineering, Shenzhen University, Shenzhen 518060, China.
| |
Collapse
|
15
|
Yin Z, Zhao M, Zhang W, Wang Y, Wang Y, Zhang J. Physiological-signal-based mental workload estimation via transfer dynamical autoencoders in a deep learning framework. Neurocomputing 2019. [DOI: 10.1016/j.neucom.2019.02.061] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
16
|
Simões RAG, Benvenuti MFL, Rodrigues ADS, Coutinho SP, Muñoz MÁ, Bizarro L. Persistence of repeated self-reported illusion of control as a product of action and outcome association in productive and preventive scenarios. PSYCHOLOGICAL RESEARCH 2019; 84:1184-1197. [PMID: 30719543 DOI: 10.1007/s00426-019-01147-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2018] [Accepted: 01/22/2019] [Indexed: 11/28/2022]
Abstract
Individuals interpret themselves as causal agents when executing an action to achieve an outcome, even when action and outcome are independent. How can illusion of control be managed? Once established, does it decay? This study aimed to analyze the effects of valence, probability of the outcome [p(O)] and probability of the actions performed by the participant [p(A)], on the magnitude of judgments of control and corresponding associative measures (including Rescorla-Wagner's, Probabilistic Contrast, and Cheng's Power Probabilistic Contrast models). A traffic light was presented on a computer screen to 81 participants who tried to control the green or red lights by pressing the spacebar, after instructions describing a productive or a preventive scenario. There were 4 blocks of 50 trials under all of 4 different p(O)s in random order (0.10, 0.30, 0.70, and 0.90). Judgments were assessed in a bidimensional scale. The 2 × 4 × 4 mixed experimental design was analyzed through General Linear Models, including factor group (between-subject valence), and block and p(O) (within subjects). There was a small effect of group and a large and direct effect of p(O) on judgments. Illusion was reported by 66% of the sample and was positive in the productive group. The oscillation of p(O) produced stronger illusions; decreasing p(O)s produced nil or negative illusions. Only Rescorla-Wagner's could model causality properly. The reasons why p(A) and the other models could not generate significant results are discussed. The results help to comprehend the importance of keeping moderate illusions in productive and preventive scenarios.
Collapse
Affiliation(s)
- Reinaldo Augusto Gomes Simões
- Universidade Federal do Rio Grande do Sul, Instituto de Psicologia, Rua Ramiro Barcelos, 2600, Porto Alegre, RS, 90035-003, Brazil. .,Mind, Brain and Behavior Research Center-CIMCYC, Universidad de Granada, Campus de la Cartuja s/n, 18071, Granada, Spain.
| | - Marcelo Frota Lobato Benvenuti
- Universidade de São Paulo, Instituto de Psicologia, Av. Prof. Mello Moraes, 1721, São Paulo, SP, 05508-030, Brazil.,Instituto Nacional de Ciência e Tecnologia sobre Comportamento, Cognição e Ensino, Rodovia Washington Luís, km 235, São Carlos, SP, 13565-905, Brazil
| | - Aline de Souza Rodrigues
- Universidade Federal do Rio Grande do Sul, Instituto de Psicologia, Rua Ramiro Barcelos, 2600, Porto Alegre, RS, 90035-003, Brazil
| | - Stela Pereira Coutinho
- Universidade Federal do Rio Grande do Sul, Instituto de Psicologia, Rua Ramiro Barcelos, 2600, Porto Alegre, RS, 90035-003, Brazil
| | - Miguel Ángel Muñoz
- Mind, Brain and Behavior Research Center-CIMCYC, Universidad de Granada, Campus de la Cartuja s/n, 18071, Granada, Spain
| | - Lisiane Bizarro
- Universidade Federal do Rio Grande do Sul, Instituto de Psicologia, Rua Ramiro Barcelos, 2600, Porto Alegre, RS, 90035-003, Brazil
| |
Collapse
|
17
|
Spangler DP, Gamble KR, McGinley JJ, Thayer JF, Brooks JR. Intra-Individual Variability in Vagal Control Is Associated With Response Inhibition Under Stress. Front Hum Neurosci 2018; 12:475. [PMID: 30542274 PMCID: PMC6277930 DOI: 10.3389/fnhum.2018.00475] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2018] [Accepted: 11/12/2018] [Indexed: 11/13/2022] Open
Abstract
Dynamic intra-individual variability (IIV) in cardiac vagal control across multiple situations is believed to contribute to adaptive cognition under stress; however, a dearth of research has empirically tested this notion. To this end, we examined 25 U.S. Army Soldiers (all male, mean age = 30.73, standard deviation (SD) = 7.71) whose high-frequency heart rate variability (HF-HRV) was measured during a resting baseline and during three conditions of a shooting task (training, low stress, high stress). Response inhibition was measured as the correct rejection (CR) of friendly targets during the low and high stress conditions. We tested the association between the SD of HF-HRV across all four task conditions (IIV in vagal control) and changes in response inhibition between low and high stress. Greater differences in vagal control between conditions (larger IIV) were associated with higher tonic vagal control during rest, and stronger stress-related decreases in response inhibition. These results suggest that flexibility in vagal control is supported by tonic vagal control, but this flexibility also uniquely relates to adaptive cognition under stress. Findings are consistent with neurobehavioral and dynamical systems theories of vagal function.
Collapse
Affiliation(s)
- Derek P Spangler
- Human Research & Engineering Directorate, U.S. Army Research Laboratory, Aberdeen, MD, United States
| | - Katherine R Gamble
- Human Research & Engineering Directorate, U.S. Army Research Laboratory, Aberdeen, MD, United States
| | - Jared J McGinley
- Department of Psychology, Towson University, Towson, MD, United States
| | - Julian F Thayer
- Department of Psychology, The Ohio State University, Columbus, OH, United States
| | - Justin R Brooks
- Human Research & Engineering Directorate, U.S. Army Research Laboratory, Aberdeen, MD, United States
| |
Collapse
|
18
|
Development of a combined time-frequency technique for accurate extraction of pNN50 metric from noisy heart rate measurements. INTERNATIONAL JOURNAL OF INTELLIGENT ROBOTICS AND APPLICATIONS 2018. [DOI: 10.1007/s41315-018-0052-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
|
19
|
Detecting correlation changes in multivariate time series: A comparison of four non-parametric change point detection methods. Behav Res Methods 2018; 49:988-1005. [PMID: 27383753 DOI: 10.3758/s13428-016-0754-9] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Change point detection in multivariate time series is a complex task since next to the mean, the correlation structure of the monitored variables may also alter when change occurs. DeCon was recently developed to detect such changes in mean and\or correlation by combining a moving windows approach and robust PCA. However, in the literature, several other methods have been proposed that employ other non-parametric tools: E-divisive, Multirank, and KCP. Since these methods use different statistical approaches, two issues need to be tackled. First, applied researchers may find it hard to appraise the differences between the methods. Second, a direct comparison of the relative performance of all these methods for capturing change points signaling correlation changes is still lacking. Therefore, we present the basic principles behind DeCon, E-divisive, Multirank, and KCP and the corresponding algorithms, to make them more accessible to readers. We further compared their performance through extensive simulations using the settings of Bulteel et al. (Biological Psychology, 98 (1), 29-42, 2014) implying changes in mean and in correlation structure and those of Matteson and James (Journal of the American Statistical Association, 109 (505), 334-345, 2014) implying different numbers of (noise) variables. KCP emerged as the best method in almost all settings. However, in case of more than two noise variables, only DeCon performed adequately in detecting correlation changes.
Collapse
|
20
|
Zhang P, Wang X, Chen J, You W. Feature Weight Driven Interactive Mutual Information Modeling for Heterogeneous Bio-Signal Fusion to Estimate Mental Workload. SENSORS 2017; 17:s17102315. [PMID: 29023364 PMCID: PMC5677372 DOI: 10.3390/s17102315] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/01/2017] [Revised: 10/02/2017] [Accepted: 10/03/2017] [Indexed: 12/11/2022]
Abstract
Many people suffer from high mental workload which may threaten human health and cause serious accidents. Mental workload estimation is especially important for particular people such as pilots, soldiers, crew and surgeons to guarantee the safety and security. Different physiological signals have been used to estimate mental workload based on the n-back task which is capable of inducing different mental workload levels. This paper explores a feature weight driven signal fusion method and proposes interactive mutual information modeling (IMIM) to increase the mental workload classification accuracy. We used EEG and ECG signals to validate the effectiveness of the proposed method for heterogeneous bio-signal fusion. The experiment of mental workload estimation consisted of signal recording, artifact removal, feature extraction, feature weight calculation, and classification. Ten subjects were invited to take part in easy, medium and hard tasks for the collection of EEG and ECG signals in different mental workload levels. Therefore, heterogeneous physiological signals of different mental workload states were available for classification. Experiments reveal that ECG can be utilized as a supplement of EEG to optimize the fusion model and improve mental workload estimation. Classification results show that the proposed bio-signal fusion method IMIM can increase the classification accuracy in both feature level and classifier level fusion. This study indicates that multi-modal signal fusion is promising to identify the mental workload levels and the fusion strategy has potential application of mental workload estimation in cognitive activities during daily life.
Collapse
Affiliation(s)
- Pengbo Zhang
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing 100084, China.
| | - Xue Wang
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing 100084, China.
| | - Junfeng Chen
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing 100084, China.
| | - Wei You
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing 100084, China.
| |
Collapse
|
21
|
Cross-subject recognition of operator functional states via EEG and switching deep belief networks with adaptive weights. Neurocomputing 2017. [DOI: 10.1016/j.neucom.2017.05.002] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
22
|
Ruscio D, Bos AJ, Ciceri MR. Distraction or cognitive overload? Using modulations of the autonomic nervous system to discriminate the possible negative effects of advanced assistance system. ACCIDENT; ANALYSIS AND PREVENTION 2017; 103:105-111. [PMID: 28399463 DOI: 10.1016/j.aap.2017.03.023] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/28/2016] [Revised: 03/26/2017] [Accepted: 03/28/2017] [Indexed: 06/07/2023]
Abstract
The interaction with Advanced Driver Assistance Systems has several positive implications for road safety, but also some potential downsides such as mental workload and automation complacency. Malleable attentional resources allocation theory describes two possible processes that can generate workload in interaction with advanced assisting devices. The purpose of the present study is to determine if specific analysis of the different modalities of autonomic control of nervous system can be used to discriminate different potential workload processes generated during assisted-driving tasks and automation complacency situations. Thirty-five drivers were tested in a virtual scenario while using head-up advanced warning assistance system. Repeated MANOVA were used to examine changes in autonomic activity across a combination of different user interactions generated by the advanced assistance system: (1) expected take-over request without anticipatory warning; (2) expected take-over request with two-second anticipatory warning; (3) unexpected take-over request with misleading warning; (4) unexpected take-over request without warning. Results shows that analysis of autonomic modulations can discriminate two different resources allocation processes, related to different behavioral performances. The user's interaction that required divided attention under expected situations produced performance enhancement and reciprocally-coupled parasympathetic inhibition with sympathetic activity. At the same time, supervising interactions that generated automation complacency were described specifically by uncoupled sympathetic activation. Safety implications for automated assistance systems developments are considered.
Collapse
Affiliation(s)
- D Ruscio
- Politecnico di Milano, Italy; Università Cattolica del Sacro Cuore, Milano, Italy.
| | - A J Bos
- Central Michigan University, Mt. Pleasant, MI, USA
| | - M R Ciceri
- Università Cattolica del Sacro Cuore, Milano, Italy
| |
Collapse
|
23
|
|
24
|
Robust correlation technology for online monitoring of changes in the state of the heart by means of laptops and smartphones. Biomed Signal Process Control 2017. [DOI: 10.1016/j.bspc.2016.06.015] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
25
|
Liu J, Gardi A, Ramasamy S, Lim Y, Sabatini R. Cognitive pilot-aircraft interface for single-pilot operations. Knowl Based Syst 2016. [DOI: 10.1016/j.knosys.2016.08.031] [Citation(s) in RCA: 46] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
26
|
Regulatory focus moderates the relationship between task control and physiological and psychological markers of stress: A work simulation study. Int J Psychophysiol 2014; 94:390-8. [DOI: 10.1016/j.ijpsycho.2014.10.009] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2013] [Revised: 10/14/2014] [Accepted: 10/15/2014] [Indexed: 01/17/2023]
|
27
|
Zhang J, Yang S. An incremental-PID-controlled particle swarm optimization algorithm for EEG-data-based estimation of operator functional state. Biomed Signal Process Control 2014. [DOI: 10.1016/j.bspc.2014.08.005] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
28
|
Ke Y, Qi H, He F, Liu S, Zhao X, Zhou P, Zhang L, Ming D. An EEG-based mental workload estimator trained on working memory task can work well under simulated multi-attribute task. Front Hum Neurosci 2014; 8:703. [PMID: 25249967 PMCID: PMC4157541 DOI: 10.3389/fnhum.2014.00703] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2014] [Accepted: 08/21/2014] [Indexed: 11/13/2022] Open
Abstract
Mental workload (MW)-based adaptive system has been found to be an effective approach to enhance the performance of human-machine interaction and to avoid human error caused by overload. However, MW estimated from the spontaneously generated electroencephalogram (EEG) was found to be task-specific. In existing studies, EEG-based MW classifier can work well under the task used to train the classifier (within-task) but crash completely when used to classify MW of a task that is similar to but not included in the training data (cross-task). The possible causes have been considered to be the task-specific EEG patterns, the mismatched workload across tasks and the temporal effects. In this study, cross-task performance-based feature selection (FS) and regression model were tried to cope with these challenges, in order to make EEG-based MW estimator trained on working memory tasks work well under a complex simulated multi-attribute task (MAT). The results show that the performance of regression model trained on working memory task and tested on multi-attribute task with the feature subset picked-out were significantly improved (correlation coefficient (COR): 0.740 ± 0.147 and 0.598 ± 0.161 for FS data and validation data respectively) when compared to the performance in the same condition with all features (chance level). It can be inferred that there do exist some MW-related EEG features can be picked out and there are something in common between MW of a relatively simple task and a complex task. This study provides a promising approach to measure MW across tasks.
Collapse
Affiliation(s)
- Yufeng Ke
- Laboratory of Neural Engineering and Rehabilitation, Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University Tianjin, China
| | - Hongzhi Qi
- Laboratory of Neural Engineering and Rehabilitation, Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University Tianjin, China
| | - Feng He
- Laboratory of Neural Engineering and Rehabilitation, Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University Tianjin, China
| | - Shuang Liu
- Laboratory of Neural Engineering and Rehabilitation, Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University Tianjin, China
| | - Xin Zhao
- Laboratory of Neural Engineering and Rehabilitation, Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University Tianjin, China
| | - Peng Zhou
- Laboratory of Neural Engineering and Rehabilitation, Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University Tianjin, China
| | - Lixin Zhang
- Laboratory of Neural Engineering and Rehabilitation, Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University Tianjin, China
| | - Dong Ming
- Laboratory of Neural Engineering and Rehabilitation, Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University Tianjin, China
| |
Collapse
|
29
|
Bousefsaf F, Maaoui C, Pruski A. Remote detection of mental workload changes using cardiac parameters assessed with a low-cost webcam. Comput Biol Med 2014; 53:154-63. [PMID: 25150821 DOI: 10.1016/j.compbiomed.2014.07.014] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2014] [Revised: 07/04/2014] [Accepted: 07/20/2014] [Indexed: 10/24/2022]
Abstract
We introduce a new framework for detecting mental workload changes using video frames obtained from a low-cost webcam. Image processing in addition to a continuous wavelet transform filtering method were developed and applied to remove major artifacts and trends on raw webcam photoplethysmographic signals. The measurements are performed on human faces. To induce stress, we have employed a computerized and interactive Stroop color word test on a set composed by twelve participants. The electrodermal activity of the participants was recorded and compared to the mental workload curve assessed by merging two parameters derived from the pulse rate variability and photoplethysmographic amplitude fluctuations, which reflect peripheral vasoconstriction changes. The results exhibit strong correlation between the two measurement techniques. This study offers further support for the applicability of mental workload detection by remote and low-cost means, providing an alternative to conventional contact techniques.
Collapse
Affiliation(s)
- Frédéric Bousefsaf
- Laboratoire de Conception, Optimisation et Modélisation des Systèmes (LCOMS), Université de Lorraine, Bâtiment ISEA (Institut Supérieur d׳Electronique et d׳Automatique), 7 rue Marconi, 57070 METZ Technopôle, France.
| | - Choubeila Maaoui
- Laboratoire de Conception, Optimisation et Modélisation des Systèmes (LCOMS), Université de Lorraine, Bâtiment ISEA (Institut Supérieur d׳Electronique et d׳Automatique), 7 rue Marconi, 57070 METZ Technopôle, France
| | - Alain Pruski
- Laboratoire de Conception, Optimisation et Modélisation des Systèmes (LCOMS), Université de Lorraine, Bâtiment ISEA (Institut Supérieur d׳Electronique et d׳Automatique), 7 rue Marconi, 57070 METZ Technopôle, France
| |
Collapse
|
30
|
Yin Z, Zhang J. Identification of temporal variations in mental workload using locally-linear-embedding-based EEG feature reduction and support-vector-machine-based clustering and classification techniques. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2014; 115:119-134. [PMID: 24821400 DOI: 10.1016/j.cmpb.2014.04.011] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/23/2013] [Revised: 04/17/2014] [Accepted: 04/18/2014] [Indexed: 06/03/2023]
Abstract
Identifying the abnormal changes of mental workload (MWL) over time is quite crucial for preventing the accidents due to cognitive overload and inattention of human operators in safety-critical human-machine systems. It is known that various neuroimaging technologies can be used to identify the MWL variations. In order to classify MWL into a few discrete levels using representative MWL indicators and small-sized training samples, a novel EEG-based approach by combining locally linear embedding (LLE), support vector clustering (SVC) and support vector data description (SVDD) techniques is proposed and evaluated by using the experimentally measured data. The MWL indicators from different cortical regions are first elicited by using the LLE technique. Then, the SVC approach is used to find the clusters of these MWL indicators and thereby to detect MWL variations. It is shown that the clusters can be interpreted as the binary class MWL. Furthermore, a trained binary SVDD classifier is shown to be capable of detecting slight variations of those indicators. By combining the two schemes, a SVC-SVDD framework is proposed, where the clear-cut (smaller) cluster is detected by SVC first and then a subsequent SVDD model is utilized to divide the overlapped (larger) cluster into two classes. Finally, three-class MWL levels (low, normal and high) can be identified automatically. The experimental data analysis results are compared with those of several existing methods. It has been demonstrated that the proposed framework can lead to acceptable computational accuracy and has the advantages of both unsupervised and supervised training strategies.
Collapse
Affiliation(s)
- Zhong Yin
- Department of Automation, East China University of Science and Technology, Shanghai 200237, PR China
| | - Jianhua Zhang
- Department of Automation, East China University of Science and Technology, Shanghai 200237, PR China.
| |
Collapse
|
31
|
Bousefsaf F, Maaoui C, Pruski A. Continuous wavelet filtering on webcam photoplethysmographic signals to remotely assess the instantaneous heart rate. Biomed Signal Process Control 2013. [DOI: 10.1016/j.bspc.2013.05.010] [Citation(s) in RCA: 38] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
32
|
Yin Z, Zhang J. Operator functional state classification using least-square support vector machine based recursive feature elimination technique. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2013; 113:101-115. [PMID: 24138846 DOI: 10.1016/j.cmpb.2013.09.007] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/02/2013] [Revised: 08/01/2013] [Accepted: 09/11/2013] [Indexed: 06/02/2023]
Abstract
This paper proposed two psychophysiological-data-driven classification frameworks for operator functional states (OFS) assessment in safety-critical human-machine systems with stable generalization ability. The recursive feature elimination (RFE) and least square support vector machine (LSSVM) are combined and used for binary and multiclass feature selection. Besides typical binary LSSVM classifiers for two-class OFS assessment, two multiclass classifiers based on multiclass LSSVM-RFE and decision directed acyclic graph (DDAG) scheme are developed, one used for recognizing the high mental workload and fatigued state while the other for differentiating overloaded and base-line states from the normal states. Feature selection results have revealed that different dimensions of OFS can be characterized by specific set of psychophysiological features. Performance comparison studies show that reasonable high and stable classification accuracy of both classification frameworks can be achieved if the RFE procedure is properly implemented and utilized.
Collapse
Affiliation(s)
- Zhong Yin
- Department of Automation, East China University of Science and Technology, Shanghai 200237, P. R. China
| | | |
Collapse
|
33
|
Widyanti A, de Waard D, Johnson A, Mulder B. National culture moderates the influence of mental effort on subjective and cardiovascular measures. ERGONOMICS 2012; 56:182-194. [PMID: 23234266 DOI: 10.1080/00140139.2012.748219] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
UNLABELLED Subjective measures of mental effort have been shown to be relatively insensitive in Indonesian participants. An open question is whether this insensitivity reflects how mental effort is experienced or how it is reported. We compared the performance, subjective workload ratings, heart rate and heart-rate variability (HRV) of 31 Dutch and 30 Indonesian participants under single- and dual-task conditions. Indonesians performed faster but less accurately and used a narrower range of subjective workload ratings than did the Dutch. Dutch participants showed a decrease in HRV both in the mid-frequency (MF) and high-frequency bands and an increase in heart rate during task performance compared with the resting period. Indonesians showed this pattern in the MF band only. The decrease of HRV in the MF band in both groups suggests that the relative insensitivity of subjective mental effort scales among Indonesians has to do with how workload is reported rather than with how it is experienced. PRACTITIONER SUMMARY The sensitivity of the subjective measures of mental workload has been shown to depend on culture. Here, we show that heart-rate variability reacts similarly to workload in Eastern as in Western participants. This suggests that culture influences more how invested mental effort is reported than how it is experienced psychophysiologically.
Collapse
Affiliation(s)
- Ari Widyanti
- Department of Psychology, University of Groningen, Grote Kruisstraat 2/1, 9712 TS, Groningen, The Netherlands.
| | | | | | | |
Collapse
|