1
|
Jin H, Zhu L, Li M, Duffy VG. Recognition and evaluation of mental workload in different stages of perceptual and cognitive information processing using a multimodal approach. ERGONOMICS 2024; 67:377-397. [PMID: 37289000 DOI: 10.1080/00140139.2023.2223785] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/18/2022] [Accepted: 06/06/2023] [Indexed: 06/09/2023]
Abstract
This study explores the effects of different perceptual and cognitive information processing stages on mental workload by assessing multimodal indicators of mental workload such as the NASA-TLX, task performance, ERPs and eye movements. Repeated measures ANOVA of the data showed that among ERP indicators, P1, N1 and N2 amplitudes were sensitive to perceptual load (P-load), P3 amplitude was sensitive to P-load only in the prefrontal region during high cognitive load (C-load) states, and P3 amplitude in the occipital and parietal regions was sensitive to C-load. Among the eye movement indicators, blink frequency was sensitive to P-load in all C-load states, but to C-load in only low P-load states; pupil diameter and blink duration were sensitive to both P-load and C-load. Based on the above indicators, the k-nearest neighbours (KNN) algorithm was used to propose a classification method for the four different mental workload states with an accuracy of 97.89%.Practitioner summary: Based on the results of this study, it is possible to implement the monitoring of mental workload states and optimise brain task allocation in operations involving high mental workload, such as human-computer interaction.
Collapse
Affiliation(s)
- Haizhe Jin
- Department of Industrial Engineering, School of Business Administration, Northeastern University, Shenyang, China
| | - Lin Zhu
- Department of Industrial Engineering, School of Business Administration, Northeastern University, Shenyang, China
| | - Mingming Li
- Department of Industrial Engineering, College of Management Science and Engineering, Anhui University of Technology, Ma'anshan, China
| | - Vincent G Duffy
- School of Industrial Engineering, Purdue University, West Lafayette, IN, USA
| |
Collapse
|
2
|
Peters A, Brockhoff L, Bruchmann M, Dellert T, Moeck R, Schlossmacher I, Straube T. Visual perceptual load and processing of somatosensory stimuli in primary and secondary somatosensory cortices. Sci Rep 2023; 13:7005. [PMID: 37117254 PMCID: PMC10147921 DOI: 10.1038/s41598-023-34225-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Accepted: 04/26/2023] [Indexed: 04/30/2023] Open
Abstract
Load theory assumes that neural activation to distractors in early sensory cortices is modulated by the perceptual load of a main task, regardless of whether task and distractor share the same sensory modality or not. While several studies have investigated the question of load effects on distractor processing in early sensory areas, there is no functional magnetic resonance imaging (fMRI) study regarding load effects on somatosensory stimuli. Here, we used fMRI to investigate effects of visual perceptual load on neural responses to somatosensory stimuli applied to the wrist in a study with 44 participants. Perceptual load was manipulated by an established sustained visual detection task, which avoided simultaneous target and distractor presentations. Load was operationalized by detection difficulty of subtle or clear color changes of one of 12 rotating dots. While all somatosensory stimuli led to activation in somatosensory areas SI and SII, we found no statistically significant difference in brain activation to these stimuli under high compared to low sustained visual load. Moreover, exploratory Bayesian analyses supported the absence of differences. Thus, our findings suggest a resistance of somatosensory processing to at least some forms of visual perceptual load, possibly due to behavioural relevance of discrete somatosensory stimuli and separable attentional resources for the somatosensory and visual modality.
Collapse
Affiliation(s)
- Antje Peters
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany.
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, 48149, Münster, Germany.
| | - Laura Brockhoff
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany
| | - Maximilian Bruchmann
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, 48149, Münster, Germany
| | - Torge Dellert
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, 48149, Münster, Germany
| | - Robert Moeck
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany
| | - Insa Schlossmacher
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, 48149, Münster, Germany
| | - Thomas Straube
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, 48149, Münster, Germany
| |
Collapse
|
3
|
Brockhoff L, Elias EA, Bruchmann M, Schindler S, Moeck R, Straube T. The effects of visual perceptual load on detection performance and event-related potentials to auditory stimuli. Neuroimage 2023; 273:120080. [PMID: 37011716 DOI: 10.1016/j.neuroimage.2023.120080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Revised: 03/25/2023] [Accepted: 03/31/2023] [Indexed: 04/03/2023] Open
Abstract
Load Theory states that perceptual load prevents, or at least reduces, the processing of task-unrelated stimuli. This study systematically examined the detection and neural processing of auditory stimuli unrelated to a visual foreground task. The visual task was designed to create continuous perceptual load, alternated between low and high load, and contained performance feedback to motivate participants to focus on the visual task instead of the auditory stimuli presented in the background. The auditory stimuli varied in intensity, and participants signaled their subjective perception of these stimuli without receiving feedback. Depending on stimulus intensity, we observed load effects on detection performance and P3 amplitudes of the event-related potential (ERP). N1 amplitudes were unaffected by perceptual load, as tested by Bayesian statistics. Findings suggest that visual perceptual load affects the processing of auditory stimuli in a late time window, which is associated with a lower probability of reported awareness of these stimuli.
Collapse
|
4
|
Brockhoff L, Schindler S, Bruchmann M, Straube T. Effects of perceptual and working memory load on brain responses to task-irrelevant stimuli: Review and implications for future research. Neurosci Biobehav Rev 2022; 135:104580. [DOI: 10.1016/j.neubiorev.2022.104580] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2021] [Revised: 01/25/2022] [Accepted: 02/12/2022] [Indexed: 11/27/2022]
|
5
|
Deviant consonance and dissonance capture attention differently only when task demand is high: An ERP study with three-stimulus oddball paradigm. Int J Psychophysiol 2021; 166:1-8. [PMID: 33932475 DOI: 10.1016/j.ijpsycho.2021.04.008] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2020] [Revised: 03/22/2021] [Accepted: 04/25/2021] [Indexed: 11/22/2022]
Abstract
The current study investigated whether consonance (imperfect consonance: major third) and dissonance (minor second) would capture attention differently when they occurred as chords (combinations of two tones) that were deviant from their context. In addition, we also examined how task demand would modulate these chords' attentional capture. For this investigation, we used an auditory three-stimulus oddball paradigm in which these chords were presented as deviant stimuli (5% each) among frequent standard (80%) and infrequent target (10%) pure tones. The task difficulty was manipulated by changing pitch intervals between standard and target tones. The results showed that these chords elicited dual-peak P3a, and that consonance enhanced the late phase of P3a compared to dissonance, only when the task demand was high. These findings revealed that deviant consonance and dissonance captured attention differently; in particular, consonance captured attention more strongly than dissonance, and this effect was induced by high task demand. This attentional capture difference between the chord categories was induced through enhanced focus of attention on the pitch dimension of oddball stimuli. In addition, the deviant chords might have been processed by a mechanism similar to that which processes novel stimuli, and these chords' differences might have affected not the novelty detection process, but a process which orients attentional resources to deviant chords, which were recognized as novel stimuli.
Collapse
|
6
|
Matusz PJ, Merkley R, Faure M, Scerif G. Expert attention: Attentional allocation depends on the differential development of multisensory number representations. Cognition 2019; 186:171-177. [DOI: 10.1016/j.cognition.2019.01.013] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2018] [Revised: 01/14/2019] [Accepted: 01/23/2019] [Indexed: 01/01/2023]
|
7
|
Rosburg T, Schmidt A. Potential Mechanisms for the Ketamine-Induced Reduction of P3b Amplitudes. Front Behav Neurosci 2018; 12:308. [PMID: 30618662 PMCID: PMC6297878 DOI: 10.3389/fnbeh.2018.00308] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2018] [Accepted: 11/27/2018] [Indexed: 12/12/2022] Open
Abstract
In specific dosages, the N-methyl-D-aspartate receptor (NMDA) antagonist ketamine can be used to model transient psychotic symptoms in healthy individuals that resemble those of schizophrenia. Ketamine administration also temporarily impairs cognitive functions, which can be studied by event-related potentials (ERPs). ERPs also allow dissecting what stages of information processing are affected by ketamine and what stages remain functional. For tasks requiring the differentiation of targets and non-targets, it has repeatedly been shown that ketamine administration in healthy individuals leads to decreased amplitudes of the ERP component P3b in response to target stimuli. However, it could be argued that this ketamine-induced P3b reduction is the consequence of an increased difficulty to differentiate targets from non-targets, primarily mediated by ketamine's psychotomimetic rather than pharmacological effects. The current review of ERP studies seeks to clarify the issue whether P3b effects of ketamine may indeed be explained as the consequence of an experienced increase in task difficulty or whether alternative mechanisms are perhaps more plausible. The review first summarizes the effects of task difficulty on ERP components related to intentional stimulus categorization (P3b), involuntary attention switches to distractors (P3a), as well as sensory processing (P1, N1). Secondly, the ERP effects of task difficulty are contrasted with those observed in ketamine studies in healthy individuals. Findings show that P3b amplitudes are consistently diminished by an increased task difficulty, as well as after ketamine administration. In contrast and as most important difference, increased task difficulty leads to increased P3a amplitudes to distractors presented in same modality as targets, whereas ketamine leads to reduced P3a amplitudes for such distractors. This dissociation indicates that the decreased P3b amplitudes after ketamine cannot be explained by a drug-induced increase in task difficulty. The conjoint reductions of P3a and P3b amplitudes instead suggest that working memory operations, in particular working memory updating are impaired after ketamine, which is in line with previous behavioral findings.
Collapse
Affiliation(s)
- Timm Rosburg
- Forensic Department, University Psychiatric Clinics Basel, Basel, Switzerland
| | - André Schmidt
- Department of Psychiatry, University Psychiatric Clinics Basel, Basel, Switzerland
| |
Collapse
|
8
|
Temporal attention is involved in the enhancement of attentional capture with task difficulty. Neuroreport 2017; 28:755-759. [DOI: 10.1097/wnr.0000000000000837] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|