1
|
Wiediartini, Ciptomulyono U, Dewi RS. Evaluation of physiological responses to mental workload in n-back and arithmetic tasks. ERGONOMICS 2024; 67:1121-1133. [PMID: 37970874 DOI: 10.1080/00140139.2023.2284677] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/26/2023] [Accepted: 11/13/2023] [Indexed: 11/19/2023]
Abstract
Working memory tasks, such as n-back and arithmetic tasks, are frequently used in studying mental workload. The present study investigated and compared the sensitivity of several physiological measures at three levels of difficulty of n-back and arithmetic tasks. The results showed significant differences in fixation duration and pupil diameter among three task difficulty levels for both n-back and arithmetic tasks. Pupil diameters increase with increasing mental workload, whereas fixation duration decreases. Blink duration and heart rate (HR) were significantly increased as task difficulty increased in the n-back task, while root mean square of successive differences (RMSSD) and standard deviation of R-R intervals (SDNN) were significantly decreased in the arithmetic task. On the other hand, blink rate and Galvanic Skin Response (GSR) were not sensitive enough to assess the differences in task difficulty for both tasks. All significant physiological measures yielded significant differences between low and high task difficulty except for SDNN.Practitioner summary: This study aimed to assess the sensitivity levels of several physiological measures of mental workload in n-back and arithmetic tasks. It showed that pupil diameter was the most sensitive in both tasks. This study also found that most physiological indices are sensitive to an extreme change in task difficulty levels.
Collapse
Affiliation(s)
- Wiediartini
- Department of Industrial and Systems Engineering, Institut Teknologi Sepuluh Nopember, Surabaya, Indonesia
- Safety and Health Engineering Study Program, Politeknik Perkapalan Negeri Surabaya, Surabaya, Indonesia
| | - Udisubakti Ciptomulyono
- Department of Industrial and Systems Engineering, Institut Teknologi Sepuluh Nopember, Surabaya, Indonesia
| | - Ratna Sari Dewi
- Department of Industrial and Systems Engineering, Institut Teknologi Sepuluh Nopember, Surabaya, Indonesia
| |
Collapse
|
2
|
Pan T, Wang H, Si H, Li Y, Li G, Zhu Y. Research on identification of flight cadets' cognitive load based on multi-source physiological data and CGAN-DBN model. ERGONOMICS 2024:1-19. [PMID: 39016192 DOI: 10.1080/00140139.2024.2380340] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/14/2024] [Accepted: 07/10/2024] [Indexed: 07/18/2024]
Abstract
Modern aircraft cockpit system is highly information-intensive. Pilots often need to receive a large amount of information and make correct judgments and decisions in a short time. However, cognitive load can affect their ability to perceive, judge and make decisions accurately. Furthermore, the excessive cognitive load will induce incorrect operations and even lead to flight accidents. Accordingly, the research on cognitive load is crucial to reduce errors and even accidents caused by human factors. By using physiological acquisition systems such as eye movement, ECG, and respiration, multi-source physiological signals of flight cadets performing different flight tasks during the flight simulation experiment are obtained. Based on the characteristic indexes extracted from multi-source physiological data, the CGAN-DBN model is established by combining the conditional generative adversarial networks (CGAN) model with the deep belief network (DBN) model to identify the flight cadets' cognitive load. The research results show that the flight cadets' cognitive load identification based on the CGAN-DBN model established has high accuracy. And it can effectively identify the cognitive load of flight cadets. The research paper has important practical significance to reduce the flight accidents caused by the high cognitive load of pilots.
Collapse
Affiliation(s)
- Ting Pan
- College of Civil Aviation, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Haibo Wang
- College of General Aviation and Flight, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Haiqing Si
- College of General Aviation and Flight, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Yixuan Li
- College of Civil Aviation, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Gen Li
- College of Civil Aviation, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Yijin Zhu
- College of General Aviation and Flight, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| |
Collapse
|
3
|
Tang H, Lee BG, Towey D, Pike M. The Impact of Various Cockpit Display Interfaces on Novice Pilots' Mental Workload and Situational Awareness: A Comparative Study. SENSORS (BASEL, SWITZERLAND) 2024; 24:2835. [PMID: 38732940 PMCID: PMC11086349 DOI: 10.3390/s24092835] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/26/2024] [Revised: 04/21/2024] [Accepted: 04/26/2024] [Indexed: 05/13/2024]
Abstract
Future airspace is expected to become more congested with additional in-service cargo and commercial flights. Pilots will face additional burdens in such an environment, given the increasing number of factors that they must simultaneously consider while completing their work activities. Therefore, care and attention must be paid to the mental workload (MWL) experienced by operating pilots. If left unaddressed, a state of mental overload could affect the pilot's ability to complete his or her work activities in a safe and correct manner. This study examines the impact of two different cockpit display interfaces (CDIs), the Steam Gauge panel and the G1000 Glass panel, on novice pilots' MWL and situational awareness (SA) in a flight simulator-based setting. A combination of objective (EEG and HRV) and subjective (NASA-TLX) assessments is used to assess novice pilots' cognitive states during this study. Our results indicate that the gauge design of the CDI affects novice pilots' SA and MWL, with the G1000 Glass panel being more effective in reducing the MWL and improving SA compared with the Steam Gauge panel. The results of this study have implications for the design of future flight deck interfaces and the training of future pilots.
Collapse
Affiliation(s)
- Huimin Tang
- School of Computer Science, University of Nottingham Ningbo China, 199 Taikang East Road, Ningbo 315100, China; (H.T.); (B.G.L.); (D.T.)
| | - Boon Giin Lee
- School of Computer Science, University of Nottingham Ningbo China, 199 Taikang East Road, Ningbo 315100, China; (H.T.); (B.G.L.); (D.T.)
- Nottingham Ningbo China Beacons of Excellence Research and Innovation Institute, Ningbo 315101, China
| | - Dave Towey
- School of Computer Science, University of Nottingham Ningbo China, 199 Taikang East Road, Ningbo 315100, China; (H.T.); (B.G.L.); (D.T.)
| | - Matthew Pike
- School of Computer Science, University of Nottingham Ningbo China, 199 Taikang East Road, Ningbo 315100, China; (H.T.); (B.G.L.); (D.T.)
| |
Collapse
|
4
|
Honma M, Masaoka Y, Iizuka N, Wada S, Kamimura S, Yoshikawa A, Moriya R, Kamijo S, Izumizaki M. Reading on a smartphone affects sigh generation, brain activity, and comprehension. Sci Rep 2022; 12:1589. [PMID: 35102254 PMCID: PMC8803971 DOI: 10.1038/s41598-022-05605-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Accepted: 01/13/2022] [Indexed: 01/04/2023] Open
Abstract
Electronic devices have become an indispensable part of our daily lives, while their negative aspects have been reported. One disadvantage is that reading comprehension is reduced when reading from an electronic device; the cause of this deficit in performance is unclear. In this study, we investigated the cause for comprehension decline when reading on a smartphone by simultaneously measuring respiration and brain activity during reading in 34 healthy individuals. We found that, compared to reading on a paper medium, reading on a smartphone elicits fewer sighs, promotes brain overactivity in the prefrontal cortex, and results in reduced comprehension. Furthermore, reading on a smartphone affected sigh frequency but not normal breathing, suggesting that normal breathing and sigh generation are mediated by pathways differentially influenced by the visual environment. A path analysis suggests that the interactive relationship between sigh inhibition and overactivity in the prefrontal cortex causes comprehension decline. These findings provide new insight into the respiration-mediated mechanisms of cognitive function.
Collapse
Affiliation(s)
- Motoyasu Honma
- Department of Physiology, Showa University School of Medicine, 1-5-8 Hatanodai, Shinagawa-ku, Tokyo, 142-8555, Japan.
| | - Yuri Masaoka
- Department of Physiology, Showa University School of Medicine, 1-5-8 Hatanodai, Shinagawa-ku, Tokyo, 142-8555, Japan
| | - Natsuko Iizuka
- Department of Physiology, Showa University School of Medicine, 1-5-8 Hatanodai, Shinagawa-ku, Tokyo, 142-8555, Japan
| | - Sayaka Wada
- Department of Physiology, Showa University School of Medicine, 1-5-8 Hatanodai, Shinagawa-ku, Tokyo, 142-8555, Japan
| | - Sawa Kamimura
- Department of Physiology, Showa University School of Medicine, 1-5-8 Hatanodai, Shinagawa-ku, Tokyo, 142-8555, Japan
| | - Akira Yoshikawa
- Department of Physiology, Showa University School of Medicine, 1-5-8 Hatanodai, Shinagawa-ku, Tokyo, 142-8555, Japan
| | - Rika Moriya
- Department of Physiology, Showa University School of Medicine, 1-5-8 Hatanodai, Shinagawa-ku, Tokyo, 142-8555, Japan
| | - Shotaro Kamijo
- Department of Physiology, Showa University School of Medicine, 1-5-8 Hatanodai, Shinagawa-ku, Tokyo, 142-8555, Japan
| | - Masahiko Izumizaki
- Department of Physiology, Showa University School of Medicine, 1-5-8 Hatanodai, Shinagawa-ku, Tokyo, 142-8555, Japan
| |
Collapse
|
5
|
Ayres P, Lee JY, Paas F, van Merriënboer JJG. The Validity of Physiological Measures to Identify Differences in Intrinsic Cognitive Load. Front Psychol 2021; 12:702538. [PMID: 34566780 PMCID: PMC8461231 DOI: 10.3389/fpsyg.2021.702538] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2021] [Accepted: 08/13/2021] [Indexed: 11/13/2022] Open
Abstract
A sample of 33 experiments was extracted from the Web-of-Science database over a 5-year period (2016-2020) that used physiological measures to measure intrinsic cognitive load. Only studies that required participants to solve tasks of varying complexities using a within-subjects design were included. The sample identified a number of different physiological measures obtained by recording signals from four main body categories (heart and lungs, eyes, skin, and brain), as well as subjective measures. The overall validity of the measures was assessed by examining construct validity and sensitivity. It was found that the vast majority of physiological measures had some level of validity, but varied considerably in sensitivity to detect subtle changes in intrinsic cognitive load. Validity was also influenced by the type of task. Eye-measures were found to be the most sensitive followed by the heart and lungs, skin, and brain. However, subjective measures had the highest levels of validity. It is concluded that a combination of physiological and subjective measures is most effective in detecting changes in intrinsic cognitive load.
Collapse
Affiliation(s)
- Paul Ayres
- School of Education, University of New South Wales, Sydney, NSW, Australia
| | - Joy Yeonjoo Lee
- School of Health Professions Education, Maastricht University, Maastricht, Netherlands
| | - Fred Paas
- Department of Psychology, Education and Child Studies, Erasmus University, Rotterdam, Netherlands
- School of Education/Early Start, University of Wollongong, Wollongong, NSW, Australia
| | | |
Collapse
|
6
|
BioPyC, an Open-Source Python Toolbox for Offline Electroencephalographic and Physiological Signals Classification. SENSORS 2021; 21:s21175740. [PMID: 34502629 PMCID: PMC8433891 DOI: 10.3390/s21175740] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Revised: 08/09/2021] [Accepted: 08/20/2021] [Indexed: 11/17/2022]
Abstract
Research on brain–computer interfaces (BCIs) has become more democratic in recent decades, and experiments using electroencephalography (EEG)-based BCIs has dramatically increased. The variety of protocol designs and the growing interest in physiological computing require parallel improvements in processing and classification of both EEG signals and bio signals, such as electrodermal activity (EDA), heart rate (HR) or breathing. If some EEG-based analysis tools are already available for online BCIs with a number of online BCI platforms (e.g., BCI2000 or OpenViBE), it remains crucial to perform offline analyses in order to design, select, tune, validate and test algorithms before using them online. Moreover, studying and comparing those algorithms usually requires expertise in programming, signal processing and machine learning, whereas numerous BCI researchers come from other backgrounds with limited or no training in such skills. Finally, existing BCI toolboxes are focused on EEG and other brain signals but usually do not include processing tools for other bio signals. Therefore, in this paper, we describe BioPyC, a free, open-source and easy-to-use Python platform for offline EEG and biosignal processing and classification. Based on an intuitive and well-guided graphical interface, four main modules allow the user to follow the standard steps of the BCI process without any programming skills: (1) reading different neurophysiological signal data formats, (2) filtering and representing EEG and bio signals, (3) classifying them, and (4) visualizing and performing statistical tests on the results. We illustrate BioPyC use on four studies, namely classifying mental tasks, the cognitive workload, emotions and attention states from EEG signals.
Collapse
|