1
|
Peters A, Bruchmann M, Dellert T, Moeck R, Schlossmacher I, Straube T. Stimulus awareness is associated with secondary somatosensory cortex activation in an inattentional numbness paradigm. Sci Rep 2023; 13:22575. [PMID: 38114726 PMCID: PMC10730535 DOI: 10.1038/s41598-023-49857-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Accepted: 12/12/2023] [Indexed: 12/21/2023] Open
Abstract
While inattentional blindness and deafness studies have revealed neural correlates of consciousness (NCC) without the confound of task relevance in the visual and auditory modality, comparable studies for the somatosensory modality are lacking. Here, we investigated NCC using functional magnetic resonance imaging (fMRI) in an inattentional numbness paradigm. Participants (N = 44) received weak electrical stimulation on the left hand while solving a demanding visual task. Half of the participants were informed that task-irrelevant weak tactile stimuli above the detection threshold would be applied during the experiment, while the other half expected stimuli below the detection threshold. Unexpected awareness assessments after the experiment revealed that altogether 10 participants did not consciously perceive the somatosensory stimuli during the visual task. Awareness was not significantly modulated by prior information. The fMRI data show that awareness of stimuli led to increased activation in the contralateral secondary somatosensory cortex. We found no significant effects of stimulus awareness in the primary somatosensory cortex or frontoparietal areas. Thus, our results support the hypothesis that somatosensory stimulus awareness is mainly based on activation in higher areas of the somatosensory cortex and does not require strong activation in extended anterior or posterior networks, which is usually seen when perceived stimuli are task-relevant.
Collapse
Affiliation(s)
- Antje Peters
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany.
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, 48149, Münster, Germany.
| | - Maximilian Bruchmann
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, 48149, Münster, Germany
| | - Torge Dellert
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, 48149, Münster, Germany
| | - Robert Moeck
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany
| | - Insa Schlossmacher
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, 48149, Münster, Germany
| | - Thomas Straube
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, 48149, Münster, Germany
| |
Collapse
|
2
|
Harris AM, Eayrs JO, Lavie N. Establishing gaze markers of perceptual load during multi-target visual search. Cogn Res Princ Implic 2023; 8:56. [PMID: 37648839 PMCID: PMC10468466 DOI: 10.1186/s41235-023-00498-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Accepted: 06/22/2023] [Indexed: 09/01/2023] Open
Abstract
Highly-automated technologies are increasingly incorporated into existing systems, for instance in advanced car models. Although highly automated modes permit non-driving activities (e.g. internet browsing), drivers are expected to reassume control upon a 'take over' signal from the automation. To assess a person's readiness for takeover, non-invasive eye tracking can indicate their attentive state based on properties of their gaze. Perceptual load is a well-established determinant of attention and perception, however, the effects of perceptual load on a person's ability to respond to a takeover signal and the related gaze indicators are not yet known. Here we examined how load-induced attentional state affects detection of a takeover-signal proxy, as well as the gaze properties that change with attentional state, in an ongoing task with no overt behaviour beyond eye movements (responding by lingering the gaze). Participants performed a multi-target visual search of either low perceptual load (shape targets) or high perceptual load (targets were two separate conjunctions of colour and shape), while also detecting occasional auditory tones (the proxy takeover signal). Across two experiments, we found that high perceptual load was associated with poorer search performance, slower detection of cross-modal stimuli, and longer fixation durations, while saccade amplitude did not consistently change with load. Using machine learning, we were able to predict the load condition from fixation duration alone. These results suggest monitoring fixation duration may be useful in the design of systems to track users' attentional states and predict impaired user responses to stimuli outside of the focus of attention.
Collapse
Affiliation(s)
- Anthony M Harris
- Institute of Cognitive Neuroscience, University College London, London, UK.
- Queensland Brain Institute, The University of Queensland, Brisbane, Australia.
| | - Joshua O Eayrs
- Institute of Cognitive Neuroscience, University College London, London, UK
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
| | - Nilli Lavie
- Institute of Cognitive Neuroscience, University College London, London, UK
| |
Collapse
|
3
|
Peters A, Brockhoff L, Bruchmann M, Dellert T, Moeck R, Schlossmacher I, Straube T. Visual perceptual load and processing of somatosensory stimuli in primary and secondary somatosensory cortices. Sci Rep 2023; 13:7005. [PMID: 37117254 PMCID: PMC10147921 DOI: 10.1038/s41598-023-34225-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Accepted: 04/26/2023] [Indexed: 04/30/2023] Open
Abstract
Load theory assumes that neural activation to distractors in early sensory cortices is modulated by the perceptual load of a main task, regardless of whether task and distractor share the same sensory modality or not. While several studies have investigated the question of load effects on distractor processing in early sensory areas, there is no functional magnetic resonance imaging (fMRI) study regarding load effects on somatosensory stimuli. Here, we used fMRI to investigate effects of visual perceptual load on neural responses to somatosensory stimuli applied to the wrist in a study with 44 participants. Perceptual load was manipulated by an established sustained visual detection task, which avoided simultaneous target and distractor presentations. Load was operationalized by detection difficulty of subtle or clear color changes of one of 12 rotating dots. While all somatosensory stimuli led to activation in somatosensory areas SI and SII, we found no statistically significant difference in brain activation to these stimuli under high compared to low sustained visual load. Moreover, exploratory Bayesian analyses supported the absence of differences. Thus, our findings suggest a resistance of somatosensory processing to at least some forms of visual perceptual load, possibly due to behavioural relevance of discrete somatosensory stimuli and separable attentional resources for the somatosensory and visual modality.
Collapse
Affiliation(s)
- Antje Peters
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany.
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, 48149, Münster, Germany.
| | - Laura Brockhoff
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany
| | - Maximilian Bruchmann
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, 48149, Münster, Germany
| | - Torge Dellert
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, 48149, Münster, Germany
| | - Robert Moeck
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany
| | - Insa Schlossmacher
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, 48149, Münster, Germany
| | - Thomas Straube
- Institute of Medical Psychology and Systems Neuroscience, University Hospital Münster, Von-Esmarch-Straße 52, 48149, Münster, Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, 48149, Münster, Germany
| |
Collapse
|
4
|
Virtual reality-based distraction on pain, performance, and anxiety during and after moderate-vigorous intensity cycling. Physiol Behav 2022; 250:113779. [PMID: 35283175 DOI: 10.1016/j.physbeh.2022.113779] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2021] [Revised: 03/08/2022] [Accepted: 03/09/2022] [Indexed: 11/23/2022]
Abstract
PURPOSE To determine whether increased visual perceptual load (PL) within an immersive virtual environment may help explain previously shown pain-relieving effects of virtual reality (VR) during high intensity cycling. METHODS Using a within-subjects design, participants cycled at a perceptually "hard" intensity for 10 min on three separate occasions. The first session did not use VR (i.e., no perceptual load - NPL). Subsequent sessions employed VR during cycling with either a low or high perceptual load (LPL or HPL). Quadriceps pain intensity (PI) was reported by participants throughout cycling. RESULTS Data were analyzed for 43 healthy participants (20 females, mean age 21 [SD 1.4]). For PI, ANOVA showed there were significant main effects of condition (F = 13.458, df =1.579, 66.334, p<0.001) and time (F = 113.045, df =1.618, 227.683, p<0.001). At every time point, t-tests revealed mean PI was significantly lower in the NPL than in the LPL condition (t(42)=4.737, p<0.001, d = 0.472) and HPL condition (t(42)=3.380, p = 0.002, d = 0.391). Dependent t-tests showed that more work (kilojoules) was performed during the LPL condition than the NPL (t(42)=2.992, p = 0.005) and HPL (t(42)=5.810, p<0.001) conditions. CONCLUSIONS Compared to a traditional 10-minute bout of cycle ergometry (NPL), individuals who cycled in the LPL condition chose to exercise at a higher intensity despite greater PI. Those who cycled in the HPL condition did not change their exercise intensity, but did report higher PI, possibly, because of the greater mental effort/energy requirement.
Collapse
|
5
|
Assessing Perceptual Load and Cognitive Load by Fixation-Related Information of Eye Movements. SENSORS 2022; 22:s22031187. [PMID: 35161930 PMCID: PMC8839381 DOI: 10.3390/s22031187] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/23/2021] [Revised: 01/22/2022] [Accepted: 02/01/2022] [Indexed: 01/27/2023]
Abstract
Assessing mental workload is imperative for avoiding unintended negative consequences in critical situations such as driving and piloting. To evaluate mental workload, measures of eye movements have been adopted, but unequivocal results remain elusive, especially those related to fixation-related parameters. We aimed to resolve the discrepancy of previous results by differentiating two kinds of mental workload (perceptual load and cognitive load) and manipulated them independently using a modified video game. We found opposite effects of the two kinds of mental workload on fixation-related parameters: shorter fixation durations and more fixations when participants played an episode with high (vs. low) perceptual load, and longer fixation durations and fewer fixations when they played an episode with high (vs. low) cognitive load. Such opposite effects were in line with the load theory and demonstrated that fixation-related parameters can be used to index mental workload at different (perceptual and cognitive) stages of mental processing.
Collapse
|
6
|
Dehais F, Lafont A, Roy R, Fairclough S. A Neuroergonomics Approach to Mental Workload, Engagement and Human Performance. Front Neurosci 2020; 14:268. [PMID: 32317914 PMCID: PMC7154497 DOI: 10.3389/fnins.2020.00268] [Citation(s) in RCA: 56] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2019] [Accepted: 03/10/2020] [Indexed: 12/26/2022] Open
Abstract
The assessment and prediction of cognitive performance is a key issue for any discipline concerned with human operators in the context of safety-critical behavior. Most of the research has focused on the measurement of mental workload but this construct remains difficult to operationalize despite decades of research on the topic. Recent advances in Neuroergonomics have expanded our understanding of neurocognitive processes across different operational domains. We provide a framework to disentangle those neural mechanisms that underpin the relationship between task demand, arousal, mental workload and human performance. This approach advocates targeting those specific mental states that precede a reduction of performance efficacy. A number of undesirable neurocognitive states (mind wandering, effort withdrawal, perseveration, inattentional phenomena) are identified and mapped within a two-dimensional conceptual space encompassing task engagement and arousal. We argue that monitoring the prefrontal cortex and its deactivation can index a generic shift from a nominal operational state to an impaired one where performance is likely to degrade. Neurophysiological, physiological and behavioral markers that specifically account for these states are identified. We then propose a typology of neuroadaptive countermeasures to mitigate these undesirable mental states.
Collapse
Affiliation(s)
- Frédéric Dehais
- ISAE-SUPAERO, Université de Toulouse, Toulouse, France
- School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA, United States
| | - Alex Lafont
- ISAE-SUPAERO, Université de Toulouse, Toulouse, France
| | - Raphaëlle Roy
- ISAE-SUPAERO, Université de Toulouse, Toulouse, France
| | - Stephen Fairclough
- School of Psychology, Liverpool John Moores University, Liverpool, United Kingdom
| |
Collapse
|
7
|
Morgan P, Macken B, Toet A, Bompas A, Bray M, Rushton S, Jones D. Distraction for the eye and ear. THEORETICAL ISSUES IN ERGONOMICS SCIENCE 2020. [DOI: 10.1080/1463922x.2020.1712493] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Affiliation(s)
- Philip Morgan
- HuFEx, School of Psychology, Cardiff University, Cardiff, UK
| | - Bill Macken
- HuFEx, School of Psychology, Cardiff University, Cardiff, UK
| | - Alexander Toet
- The Netherlands Organization for Applied Scientific Research
| | - Aline Bompas
- HuFEx, School of Psychology, Cardiff University, Cardiff, UK
| | - Mark Bray
- BAE Systems-Applied Intelligence Laboratories, London, UK
| | - Simon Rushton
- HuFEx, School of Psychology, Cardiff University, Cardiff, UK
| | - Dylan Jones
- HuFEx, School of Psychology, Cardiff University, Cardiff, UK
| |
Collapse
|
8
|
Dehais F, Hodgetts HM, Causse M, Behrend J, Durantin G, Tremblay S. Momentary lapse of control: A cognitive continuum approach to understanding and mitigating perseveration in human error. Neurosci Biobehav Rev 2019; 100:252-262. [DOI: 10.1016/j.neubiorev.2019.03.006] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2018] [Revised: 03/08/2019] [Accepted: 03/11/2019] [Indexed: 11/28/2022]
|
9
|
Miller CB, Robertson DJ, Johnson KA, Lovato N, Bartlett DJ, Grunstein RR, Gordon CJ. Tired and lack focus? Insomnia increases distractibility. J Health Psychol 2019; 26:795-804. [DOI: 10.1177/1359105319842927] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
Chronic insomnia is associated with subjective daytime cognitive dysfunction, but objective corroborative data are often lacking. In this study, we use Perceptual Load Theory to objectively assess distractibility in participants with insomnia ( N = 23) compared with age- and sex-matched controls ( N = 23). Following overnight supervised sleep observation, all participants completed a selective attention task which varied in the level of perceptual load and distractor congruency. The insomnia group was found to be more distracted than controls, whereas their selective attention mechanism appeared to be intact, with reduced distractor processing under high load for both groups. Insomnia symptom severity was positively correlated with participant distractibility. These findings suggest that there are insomnia-related daytime cognitive impairments that are likely to arise from compromised cognitive control rather than an ineffective selective attention mechanism. This task may be clinically useful in assessing daytime impairments, and potentially treatment response, in those with insomnia.
Collapse
Affiliation(s)
- Christopher B Miller
- CIRUS, Centre for Sleep and Chronobiology, Woolcock Institute of Medical Research, Sydney, NSW, Australia
| | - David J Robertson
- School of Psychological Sciences and Health, University of Strathclyde, Glasgow, UK
| | - Keith A Johnson
- CIRUS, Centre for Sleep and Chronobiology, Woolcock Institute of Medical Research, Sydney, NSW, Australia
- Faculty of Medicine and Health, Central Clinical School, The University of Sydney, Sydney, NSW, Australia
| | - Nicole Lovato
- Adelaide Institute for Sleep Health, A Flinders Centre of Research Excellence, Flinders University of South Australia
- CRC for Alertness, Safety and Productivity, Melbourne, VIC, Australia
| | - Delwyn J Bartlett
- CIRUS, Centre for Sleep and Chronobiology, Woolcock Institute of Medical Research, Sydney, NSW, Australia
- Faculty of Medicine and Health, Central Clinical School, The University of Sydney, Sydney, NSW, Australia
- CRC for Alertness, Safety and Productivity, Melbourne, VIC, Australia
| | - Ronald R Grunstein
- CIRUS, Centre for Sleep and Chronobiology, Woolcock Institute of Medical Research, Sydney, NSW, Australia
- Faculty of Medicine and Health, Central Clinical School, The University of Sydney, Sydney, NSW, Australia
- CRC for Alertness, Safety and Productivity, Melbourne, VIC, Australia
- Department of Respiratory and Sleep Medicine, Royal Prince Alfred Hospital, Sydney, NSW, Australia
| | - Christopher J Gordon
- CIRUS, Centre for Sleep and Chronobiology, Woolcock Institute of Medical Research, Sydney, NSW, Australia
- CRC for Alertness, Safety and Productivity, Melbourne, VIC, Australia
- Faculty of Medicine and Health, Susan Wakil School of Nursing and Midwifery, University of Sydney, NSW, Australia
| |
Collapse
|
10
|
Callan DE, Gateau T, Durantin G, Gonthier N, Dehais F. Disruption in neural phase synchrony is related to identification of inattentional deafness in real-world setting. Hum Brain Mapp 2018; 39:2596-2608. [PMID: 29484760 DOI: 10.1002/hbm.24026] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2017] [Revised: 02/19/2018] [Accepted: 02/20/2018] [Indexed: 11/10/2022] Open
Abstract
Individuals often have reduced ability to hear alarms in real world situations (e.g., anesthesia monitoring, flying airplanes) when attention is focused on another task, sometimes with devastating consequences. This phenomenon is called inattentional deafness and usually occurs under critical high workload conditions. It is difficult to simulate the critical nature of these tasks in the laboratory. In this study, dry electroencephalography is used to investigate inattentional deafness in real flight while piloting an airplane. The pilots participating in the experiment responded to audio alarms while experiencing critical high workload situations. It was found that missed relative to detected alarms were marked by reduced stimulus evoked phase synchrony in theta and alpha frequencies (6-14 Hz) from 120 to 230 ms poststimulus onset. Correlation of alarm detection performance with intertrial coherence measures of neural phase synchrony showed different frequency and time ranges for detected and missed alarms. These results are consistent with selective attentional processes actively disrupting oscillatory coherence in sensory networks not involved with the primary task (piloting in this case) under critical high load conditions. This hypothesis is corroborated by analyses of flight parameters showing greater maneuvering associated with difficult phases of flight occurring during missed alarms. Our results suggest modulation of neural oscillation is a general mechanism of attention utilizing enhancement of phase synchrony to sharpen alarm perception during successful divided attention, and disruption of phase synchrony in brain networks when attentional demands of the primary task are great, such as in the case of inattentional deafness.
Collapse
Affiliation(s)
- Daniel E Callan
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology (NICT), Osaka University, Osaka, Japan.,Institut Supérieur de l'Aéronautique et de l'Espace (ISAE), Université Fédérale Toulouse Midi-Pyrénées, Toulouse, France
| | - Thibault Gateau
- Institut Supérieur de l'Aéronautique et de l'Espace (ISAE), Université Fédérale Toulouse Midi-Pyrénées, Toulouse, France
| | - Gautier Durantin
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, Australia
| | - Nicolas Gonthier
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology (NICT), Osaka University, Osaka, Japan.,Institut Supérieur de l'Aéronautique et de l'Espace (ISAE), Université Fédérale Toulouse Midi-Pyrénées, Toulouse, France
| | - Frédéric Dehais
- Institut Supérieur de l'Aéronautique et de l'Espace (ISAE), Université Fédérale Toulouse Midi-Pyrénées, Toulouse, France
| |
Collapse
|
11
|
Murphy S, Spence C, Dalton P. Auditory perceptual load: A review. Hear Res 2017; 352:40-48. [DOI: 10.1016/j.heares.2017.02.005] [Citation(s) in RCA: 46] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/23/2016] [Revised: 12/21/2016] [Accepted: 02/05/2017] [Indexed: 11/26/2022]
|
12
|
Murphy G, Greene CM. Visual feature vs. conjunction searches as a robust manipulation of perceptual load. JOURNAL OF COGNITIVE PSYCHOLOGY 2016. [DOI: 10.1080/20445911.2016.1256888] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Affiliation(s)
- Gillian Murphy
- School of Applied Psychology, University College Cork, Cork, Ireland
| | - Ciara M. Greene
- School of Psychology, University College Dublin, Dublin, Ireland
| |
Collapse
|