1
|
Jin H, Zhu L, Li M, Duffy VG. Recognition and evaluation of mental workload in different stages of perceptual and cognitive information processing using a multimodal approach. ERGONOMICS 2024; 67:377-397. [PMID: 37289000 DOI: 10.1080/00140139.2023.2223785] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/18/2022] [Accepted: 06/06/2023] [Indexed: 06/09/2023]
Abstract
This study explores the effects of different perceptual and cognitive information processing stages on mental workload by assessing multimodal indicators of mental workload such as the NASA-TLX, task performance, ERPs and eye movements. Repeated measures ANOVA of the data showed that among ERP indicators, P1, N1 and N2 amplitudes were sensitive to perceptual load (P-load), P3 amplitude was sensitive to P-load only in the prefrontal region during high cognitive load (C-load) states, and P3 amplitude in the occipital and parietal regions was sensitive to C-load. Among the eye movement indicators, blink frequency was sensitive to P-load in all C-load states, but to C-load in only low P-load states; pupil diameter and blink duration were sensitive to both P-load and C-load. Based on the above indicators, the k-nearest neighbours (KNN) algorithm was used to propose a classification method for the four different mental workload states with an accuracy of 97.89%.Practitioner summary: Based on the results of this study, it is possible to implement the monitoring of mental workload states and optimise brain task allocation in operations involving high mental workload, such as human-computer interaction.
Collapse
Affiliation(s)
- Haizhe Jin
- Department of Industrial Engineering, School of Business Administration, Northeastern University, Shenyang, China
| | - Lin Zhu
- Department of Industrial Engineering, School of Business Administration, Northeastern University, Shenyang, China
| | - Mingming Li
- Department of Industrial Engineering, College of Management Science and Engineering, Anhui University of Technology, Ma'anshan, China
| | - Vincent G Duffy
- School of Industrial Engineering, Purdue University, West Lafayette, IN, USA
| |
Collapse
|
2
|
Abstract
Recent studies using the additional singleton paradigm have shown that regularities in distractor locations can cause biases in the spatial priority map, such that attentional capture by salient singletons is reduced for locations that are likely to contain distractors. It has been suggested that this type of suppression is proactive (i.e., occurring before display onset). The current study replicated the original findings using an online version of the task. To further assess the suppression of high-probability locations, we employed a congruence manipulation similar to the traditional flanker effect, where distractors could be either congruent or incongruent with the response to the target. Experiment 1 shows that through statistical learning distractor suppression reduces the interference from incongruent distractors, as participants made less errors in high-probability versus low-probability conditions. In Experiment 2, participants were forced to search for a specific target feature (the so-called feature-search mode), which is assumed to allow participants to ignore distractors in a top-down manner. Yet even when this "top-down" search mode was employed, there was still a congruence effect when the distractor singleton was presented at the low-probability but not at the high-probability location. The absence, but not reversal, of a congruence effect at the high-probability location also further indicates that this distractor suppression mechanism is proactive. The results indicate that regardless of the search mode used, there is suppression of the high-probability location indicating that this location competes less for attention within the spatial priority map than all other locations.
Collapse
Affiliation(s)
- Yavor Ivanov
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Van der Boechorststraat 7, 1081 BT, Amsterdam, The Netherlands.
- Institute of Brain and Behavior Amsterdam (iBBA), Amsterdam, The Netherlands.
| | - Jan Theeuwes
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Van der Boechorststraat 7, 1081 BT, Amsterdam, The Netherlands
- Institute of Brain and Behavior Amsterdam (iBBA), Amsterdam, The Netherlands
| |
Collapse
|
3
|
Vilhelmsen K, Agyei SB, van der Weel FRR, van der Meer ALH. A high-density EEG study of differentiation between two speeds and directions of simulated optic flow in adults and infants. Psychophysiology 2018; 56:e13281. [PMID: 30175487 DOI: 10.1111/psyp.13281] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2017] [Revised: 06/07/2018] [Accepted: 07/18/2018] [Indexed: 12/24/2022]
Abstract
A high-density EEG study was carried out to investigate cortical activity in response to forward and backward visual motion at two different driving speeds, simulated through optic flow. Participants were prelocomotor infants at the age of 4-5 months and infants with at least 3 weeks of crawling experience at the age of 8-11 months, and adults. Adults displayed shorter N2 latencies in response to forward as opposed to backward visual motion and differentiated significantly between low and high speeds, with shorter latencies for low speeds. Only infants at 8-11 months displayed similar latency differences between motion directions, and exclusively in response to low speed. The developmental differences in latency between infant groups are interpreted in terms of a combination of increased experience with self-produced locomotion and neurobiological development. Analyses of temporal spectral evolution (TSE, time-dependent amplitude changes) were also performed to investigate nonphase-locked changes at lower frequencies in underlying neuronal networks. TSE showed event-related desynchronization activity in response to visual motion for infants compared to adults. The poorer responses in infants are probably related to immaturity of the dorsal visual stream specialized in the processing of visual motion and could explain the observed problems in infants with differentiating high speeds of up to 50 km/h.
Collapse
Affiliation(s)
- Kenneth Vilhelmsen
- Developmental Neuroscience Laboratory, Department of Psychology, Norwegian University of Science and Technology (NTNU), Trondheim, Norway
| | - Seth B Agyei
- Developmental Neuroscience Laboratory, Department of Psychology, Norwegian University of Science and Technology (NTNU), Trondheim, Norway
| | - F R Ruud van der Weel
- Developmental Neuroscience Laboratory, Department of Psychology, Norwegian University of Science and Technology (NTNU), Trondheim, Norway
| | - Audrey L H van der Meer
- Developmental Neuroscience Laboratory, Department of Psychology, Norwegian University of Science and Technology (NTNU), Trondheim, Norway
| |
Collapse
|
4
|
The cognitive loci of the display and task-relevant set size effects on distractor interference: Evidence from a dual-task paradigm. Atten Percept Psychophys 2017; 80:337-351. [PMID: 29124674 DOI: 10.3758/s13414-017-1442-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The congruency effect of a task-irrelevant distractor has been found to be modulated by task-relevant set size and display set size. The present study used a psychological refractory period (PRP) paradigm to examine the cognitive loci of the display set size effect (dilution effect) and the task-relevant set size effect (perceptual load effect) on distractor interference. A tone discrimination task (Task 1), in which a response was made to the pitch of the target tone, was followed by a letter discrimination task (Task 2) in which different types of visual target display were used. In Experiment 1, in which display set size was manipulated to examine the nature of the display set size effect on distractor interference in Task 2, the modulation of the congruency effect by display set size was observed at both short and long stimulus-onset asynchronies (SOAs), indicating that the display set size effect occurred after the target was selected for processing in the focused attention stage. In Experiment 2, in which task-relevant set size was manipulated to examine the nature of the task-relevant set size effect on distractor interference in Task 2, the effects of task-relevant set size increased with SOA, suggesting that the target selection efficiency in the preattentive stage was impaired with increasing task-relevant set size. These results suggest that display set size and task-relevant set size modulate distractor processing in different ways.
Collapse
|
5
|
Murphy G, Greene CM. The Elephant in the Road: Auditory Perceptual Load Affects Driver Perception and Awareness. APPLIED COGNITIVE PSYCHOLOGY 2017. [DOI: 10.1002/acp.3311] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
6
|
Torralbo A, Kelley TA, Rees G, Lavie N. Attention induced neural response trade-off in retinotopic cortex under load. Sci Rep 2016; 6:33041. [PMID: 27625311 PMCID: PMC5021995 DOI: 10.1038/srep33041] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2016] [Accepted: 08/12/2016] [Indexed: 11/30/2022] Open
Abstract
The effects of perceptual load on visual cortex response to distractors are well established and various phenomena of ‘inattentional blindness’ associated with elimination of visual cortex response to unattended distractors, have been documented in tasks of high load. Here we tested an account for these effects in terms of a load-induced trade-off between target and distractor processing in retinotopic visual cortex. Participants were scanned using fMRI while performing a visual-search task and ignoring distractor checkerboards in the periphery. Retinotopic responses to target and distractors were assessed as a function of search load (comparing search set-sizes two, three and five). We found that increased load not only increased activity in frontoparietal network, but also had opposite effects on retinotopic responses to target and distractors. Target-related signals in areas V2–V3 linearly increased, while distractor response linearly decreased, with increased load. Critically, the slopes were equivalent for both load functions, thus demonstrating resource trade-off. Load effects were also found in displays with the same item number in the distractor hemisphere across different set sizes, thus ruling out local intrahemispheric interactions as the cause. Our findings provide new evidence for load theory proposals of attention resource sharing between target and distractor leading to inattentional blindness.
Collapse
Affiliation(s)
- Ana Torralbo
- Institute of Cognitive Neuroscience, University College London, London, UK
| | - Todd A Kelley
- Institute of Cognitive Neuroscience, University College London, London, UK
| | - Geraint Rees
- Institute of Cognitive Neuroscience, University College London, London, UK.,Wellcome Trust Centre for Neuroimaging, University College London, London, WC1N 3BG, UK
| | - Nilli Lavie
- Institute of Cognitive Neuroscience, University College London, London, UK
| |
Collapse
|
7
|
Identifying visual targets amongst interfering distractors: Sorting out the roles of perceptual load, dilution, and attentional zoom. Atten Percept Psychophys 2016; 78:1822-38. [DOI: 10.3758/s13414-016-1149-9] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
8
|
|
9
|
Wang L, Yu H, Hu J, Theeuwes J, Gong X, Xiang Y, Jiang C, Zhou X. Reward breaks through center-surround inhibition via anterior insula. Hum Brain Mapp 2015; 36:5233-51. [PMID: 26416017 DOI: 10.1002/hbm.23004] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2015] [Revised: 09/14/2015] [Accepted: 09/17/2015] [Indexed: 01/17/2023] Open
Abstract
Focusing attention on a target creates a center-surround inhibition such that distractors located close to the target do not capture attention. Recent research showed that a distractor can break through this surround inhibition when associated with reward. However, the brain basis for this reward-based attention is unclear. In this fMRI study, we presented a distractor associated with high or low reward at different distances from the target. Behaviorally the low-reward distractor did not capture attention and thus did not cause interference, whereas the high-reward distractor captured attention only when located near the target. Neural activity in extrastriate cortex mirrored the behavioral pattern. A comparison between the high-reward and the low-reward distractors presented near the target (i.e., reward-based attention) and a comparison between the high-reward distractors located near and far from the target (i.e., spatial attention) revealed a common frontoparietal network, including inferior frontal gyrus and inferior parietal sulcus as well as the visual cortex. Reward-based attention specifically activated the anterior insula (AI). Dynamic causal modelling showed that reward modulated the connectivity from AI to the frontoparietal network but not the connectivity from the frontoparietal network to the visual cortex. Across participants, the reward-based attentional effect could be predicted both by the activity in AI and by the changes of spontaneous functional connectivity between AI and ventral striatum before and after reward association. These results suggest that AI encodes reward-based salience and projects it to the stimulus-driven attentional network, which enables the reward-associated distractor to break through the surround inhibition in the visual cortex.
Collapse
Affiliation(s)
- Lihui Wang
- Center for Brain and Cognitive Sciences and Department of Psychology, Peking University, Beijing, China
| | - Hongbo Yu
- Center for Brain and Cognitive Sciences and Department of Psychology, Peking University, Beijing, China
| | - Jie Hu
- Center for Brain and Cognitive Sciences and Department of Psychology, Peking University, Beijing, China
| | - Jan Theeuwes
- Department of Experimental and Applied Psychology, Vrije Universiteit, Amsterdam, 1081 BT, The Netherlands
| | - Xiaoliang Gong
- Key Laboratory of Embedded System and Service Computing (Ministry of Education), Tongji University, Shanghai, 201804, China
| | - Yang Xiang
- Key Laboratory of Embedded System and Service Computing (Ministry of Education), Tongji University, Shanghai, 201804, China
| | - Changjun Jiang
- Key Laboratory of Embedded System and Service Computing (Ministry of Education), Tongji University, Shanghai, 201804, China
| | - Xiaolin Zhou
- Center for Brain and Cognitive Sciences and Department of Psychology, Peking University, Beijing, China.,Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, 100871, China.,Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing, 100871, China.,PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing, 100871, China
| |
Collapse
|
10
|
Knepp MM, Krafka ER, Boulton AN, Myers MP. Group administration influences design but not written word fluency testing. Laterality 2014; 19:615-37. [PMID: 24611866 DOI: 10.1080/1357650x.2014.892507] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
Quicker assessments of right and left frontal lobe function, such as the examination of performance on design and language fluency tasks, respectively, lend themselves to a group administration setting. However, the influence of social facilitation factors on a dissociation model in these group settings is not well understood. One hundred college students (71 women) completed design and written word fluency tasks while sitting beside a faster or slower working confederate. Questionnaires related to trait worry, emotion regulation, state depression, anxiety and stress were completed following these tasks. Students in the fast condition produced significantly more unique designs, but there was no condition difference on written word fluency. This finding indicated that performance on a design task, which requires relative right frontal activation, may decrease if the subject is paired with a slow working confederate. High trait worriers demonstrated reduced performance on the design task (as indicated by higher design error ratios) but preserved performance on the word task. This supported a single dissociation in that performance on these tasks indicates compromised right hemisphere function and preserved left hemisphere function, respectively, in high trait worriers.
Collapse
Affiliation(s)
- Michael M Knepp
- a Department of Psychology and Neuroscience , University of Mount Union , Alliance , OH , USA
| | | | | | | |
Collapse
|
11
|
Kuratomi K, Yoshizaki K. [Effect of conflict frequency associated with presentation hemifield on global/local processing]. SHINRIGAKU KENKYU : THE JAPANESE JOURNAL OF PSYCHOLOGY 2013; 84:536-542. [PMID: 24505981 DOI: 10.4992/jjpsy.84.536] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
We used a global/local processing task with hierarchically structured visual stimuli to investigate whether each hemisphere independently modulates visual selectivity depending on conflict frequency. In both of the present experiments, a hierarchical pattern consisting of large (global) letter made up of small (local) letters was briefly presented to unilateral visual-field (LVF/RVF) and the congruency between the local and global levels was manipulated. An important manipulation was that the congruency ratio in a given block differed between the two visual-fields (80% and 20%). We required right-handed participants to identify the global (Experiment 1) and local level (Experiment 2) of the hierarchical stimulus. The results showed that when the stimuli were projected to the nondominant hemisphere for the task demand (left hemisphere in the global task and right hemisphere in the local task) the size of the interference (local interference in Experiment 1 and global interference in Experiment 2) was larger in the 80% congruent condition than in the 20% congruent condition, whereas it was invariant when the stimuli were projected to the dominant hemisphere. These results demonstrate that each hemisphere independently works cognitive control.
Collapse
Affiliation(s)
- Kei Kuratomi
- Department of Psychology, Aichi Shukutoku University, 9, Katahira 2-chome, Nagakute 480-1179, Japan.
| | - Kazuhito Yoshizaki
- Department of Psychology, Aichi Shukutoku University, 9, Katahira 2-chome, Nagakute 480-1179, Japan
| |
Collapse
|