1
|
Zhu R, Ma X, You X. The effect of working memory load on inattentional deafness during aeronautical decision-making. APPLIED ERGONOMICS 2023; 113:104099. [PMID: 37480663 DOI: 10.1016/j.apergo.2023.104099] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/28/2023] [Revised: 07/16/2023] [Accepted: 07/17/2023] [Indexed: 07/24/2023]
Abstract
Operating an aircraft requires pilots to handle a significant amount of multi-modal information, which creates a high working memory load. Detecting auditory alarms in this high-load scenario is crucial for aviation safety. According to cognitive control load theory, an increase in working memory load may enhance distractor interference, resulting in improved detection sensitivity for task-irrelevant stimuli. Therefore, understanding the effect of working memory load on auditory alarm detection is of particular interest in aviation safety research. The studies were designed to investigate the effect of storage load and executive function load of working memory on auditory alarm detection during aeronautical decision-making through three experiments. In Experiment 1 and 2, participants performed an aeronautical decision-making task while also detecting an auditory alarm during the retention interval of a working memory task (visual-spatial, visual-verbal and auditory-verbal). In Experiment 3, participants were required to detect an auditory alarm while performing the 2-back and 3-back aeronautical decision-making tasks. Experiment 1 found that the auditory alarm sensitivity was higher in conditions of low visual-spatial working memory storage load compare to high load conditions. Experiment 2 found that a high storage load of visual-verbal working memory reduced auditory alarm sensitivity but auditory-verbal working memory load did not. Experiment 3 found that, unlike storage load, auditory alarm sensitivity was stronger under high executive function load relative to low executive function load. These findings show that working memory storage load and executive function load have different effects on auditory alarm sensitivity. The relationship between executive function and auditory alarm sensitivity supports cognitive control load theory, while the impact of the storage function on auditory alarm sensitivity does not adhere to this theory.
Collapse
Affiliation(s)
- Rongjuan Zhu
- School of Management, Xi'an University of Science and Technology, Xi'an, 710054, China
| | - Xiaoliang Ma
- Geovis Spatial Technology Co.,Ltd, Xi'an, 710100, China
| | - Xuqun You
- Key Laboratory for Behavior and Cognitive Neuroscience of Shaanxi Province, School of Psychology, Shaanxi Normal University, Xi'an, 710062, China.
| |
Collapse
|
2
|
Mark JA, Ayaz H, Callan DE. Simultaneous fMRI and tDCS for Enhancing Training of Flight Tasks. Brain Sci 2023; 13:1024. [PMID: 37508957 PMCID: PMC10377527 DOI: 10.3390/brainsci13071024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Revised: 06/23/2023] [Accepted: 06/29/2023] [Indexed: 07/30/2023] Open
Abstract
There is a gap in our understanding of how best to apply transcranial direct-current stimulation (tDCS) to enhance learning in complex, realistic, and multifocus tasks such as aviation. Our goal is to assess the effects of tDCS and feedback training on task performance, brain activity, and connectivity using functional magnetic resonance imaging (fMRI). Experienced glider pilots were recruited to perform a one-day, three-run flight-simulator task involving varying difficulty conditions and a secondary auditory task, mimicking real flight requirements. The stimulation group (versus sham) received 1.5 mA high-definition HD-tDCS to the right dorsolateral prefrontal cortex (DLPFC) for 30 min during the training. Whole-brain fMRI was collected before, during, and after stimulation. Active stimulation improved piloting performance both during and post-training, particularly in novice pilots. The fMRI revealed a number of tDCS-induced effects on brain activation, including an increase in the left cerebellum and bilateral basal ganglia for the most difficult conditions, an increase in DLPFC activation and connectivity to the cerebellum during stimulation, and an inhibition in the secondary task-related auditory cortex and Broca's area. Here, we show that stimulation increases activity and connectivity in flight-related brain areas, particularly in novices, and increases the brain's ability to focus on flying and ignore distractors. These findings can guide applied neurostimulation in real pilot training to enhance skill acquisition and can be applied widely in other complex perceptual-motor real-world tasks.
Collapse
Affiliation(s)
- Jesse A Mark
- School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA 19104, USA
| | - Hasan Ayaz
- School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA 19104, USA
- Department of Psychological and Brain Sciences, College of Arts and Sciences, Drexel University, Philadelphia, PA 19104, USA
- Drexel Solutions Institute, Drexel University, Philadelphia, PA 19104, USA
- A.J. Drexel Autism Institute, Drexel University, Philadelphia, PA 19104, USA
- Department of Family and Community Health, University of Pennsylvania, Philadelphia, PA 19104, USA
- Center for Injury Research and Prevention, Children's Hospital of Philadelphia, Philadelphia, PA 19104, USA
| | - Daniel E Callan
- Brain Information Communication Research Laboratory, Advanced Telecommunications Research Institute International, Kyoto 619-0288, Japan
| |
Collapse
|
3
|
Callan DE, Fukada T, Dehais F, Ishii S. The role of brain-localized gamma and alpha oscillations in inattentional deafness: implications for understanding human attention. Front Hum Neurosci 2023; 17:1168108. [PMID: 37305364 PMCID: PMC10248426 DOI: 10.3389/fnhum.2023.1168108] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Accepted: 04/27/2023] [Indexed: 06/13/2023] Open
Abstract
Introduction The processes involved in how the attention system selectively focuses on perceptual and motor aspects related to a specific task, while suppressing features of other tasks and/or objects in the environment, are of considerable interest for cognitive neuroscience. The goal of this experiment was to investigate neural processes involved in selective attention and performance under multi-task situations. Several studies have suggested that attention-related gamma-band activity facilitates processing in task-specific modalities, while alpha-band activity inhibits processing in non-task-related modalities. However, investigations into the phenomenon of inattentional deafness/blindness (inability to observe stimuli in non-dominant task when primary task is demanding) have yet to observe gamma-band activity. Methods This EEG experiment utilizes an engaging whole-body perceptual motor task while carrying out a secondary auditory detection task to investigate neural correlates of inattentional deafness in natural immersive high workload conditions. Differences between hits and misses on the auditory detection task in the gamma (30-50 Hz) and alpha frequency (8-12 Hz) range were carried out at the cortical source level using LORETA. Results Participant auditory task performance correlated with an increase in gamma-band activity for hits over misses pre- and post-stimulus in left auditory processing regions. Alpha-band activity was greater for misses relative to hits in right auditory processing regions pre- and post-stimulus onset. These results are consistent with the facilitatory/inhibitory role of gamma/alpha-band activity for neural processing. Additional gamma- and alpha-band activity was found in frontal and parietal brain regions which are thought to reflect various attentional monitoring, selection, and switching processes. Discussion The results of this study help to elucidate the role of gamma and alpha frequency bands in frontal and modality-specific regions involved with selective attention in multi-task immersive situations.
Collapse
Affiliation(s)
- Daniel E. Callan
- Brain Information Communication Research Laboratory, Advanced Telecommunications Research Institute International, Kyoto, Japan
- Institut Supérieur de l'Aéronautique et de l'Espace, University of Toulouse, Toulouse, France
| | - Takashi Fukada
- Brain Information Communication Research Laboratory, Advanced Telecommunications Research Institute International, Kyoto, Japan
- Graduate School of Informatics, Kyoto University, Kyoto, Japan
| | - Frédéric Dehais
- Institut Supérieur de l'Aéronautique et de l'Espace, University of Toulouse, Toulouse, France
| | - Shin Ishii
- Brain Information Communication Research Laboratory, Advanced Telecommunications Research Institute International, Kyoto, Japan
- Graduate School of Informatics, Kyoto University, Kyoto, Japan
| |
Collapse
|
4
|
Silagyi DV, Liu D. Prediction of severity of aviation landing accidents using support vector machine models. ACCIDENT; ANALYSIS AND PREVENTION 2023; 187:107043. [PMID: 37086512 DOI: 10.1016/j.aap.2023.107043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/27/2022] [Revised: 12/29/2022] [Accepted: 03/23/2023] [Indexed: 05/03/2023]
Abstract
The purpose of this study was to apply support vector machine (SVM) models to predict the severity of aircraft damage and the severity of personal injury during an aircraft approach and landing accident and to evaluate and rank the importance of 14 accident factors across 39 sub-categorical factors. Three new factors were introduced using the theory of inattentional blindness: The presence of visual area surface penetrations for a runway, the Federal Aviation Administration's (FAA) visual area surface penetration policy timeframe, and the type of runway approach lighting. The study comprised 1,297 aircraft approach and landing accidents at airports within the United States with at least one instrument approach procedure. Support vector machine models were developed in using the linear, polynomial, radial basis function (RBF), and sigmoid kernels for the severity of aircraft damage and additional SVM models were developed for the severity of personal injury. The SVM models using the RBF kernel produced the best machine learning models with a 96% accuracy for predicting the severity of aircraft damage (0.94 precision, 0.95 recall, and 0.95 F1-score) and a 98% accuracy for predicting the severity of personal injury (0.99 precision, 0.98 recall, and 0.99 F1-score). The top predictors across both models were the pilot's total flight hours, time of the accident, pilot's age, crosswind component, landing runway number, single-engine land certificate, and any obstacle penetration. This study demonstrates the benefit of SVM modeling using the RBF kernel for accident prediction and for datasets with categorical factors.
Collapse
Affiliation(s)
- Dezsö V Silagyi
- Embry-Riddle Aeronautical University, Daytona Beach, FL, USA.
| | - Dahai Liu
- Embry-Riddle Aeronautical University, Daytona Beach, FL, USA.
| |
Collapse
|
5
|
Massé E, Bartheye O, Fabre L. Classification of Electrophysiological Signatures With Explainable Artificial Intelligence: The Case of Alarm Detection in Flight Simulator. Front Neuroinform 2022; 16:904301. [PMID: 35784188 PMCID: PMC9243447 DOI: 10.3389/fninf.2022.904301] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2022] [Accepted: 04/22/2022] [Indexed: 11/30/2022] Open
Abstract
Relevant sounds such as alarms are sometimes involuntarily ignored, a phenomenon called inattentional deafness. This phenomenon occurs under specific conditions including high workload (i.e., multitasking) and/or cognitive fatigue. In the context of aviation, such an error can have drastic consequences on flight safety. This study uses an oddball paradigm in which participants had to detect rare sounds in an ecological context of simulated flight. Cognitive fatigue and cognitive load were manipulated to trigger inattentional deafness, and brain activity was recorded via electroencephalography (EEG). Our results showed that alarm omission and alarm detection can be classified based on time-frequency analysis of brain activity. We reached a maximum accuracy of 76.4% when the algorithm was trained on all participants and a maximum of 90.5%, on one participant, when the algorithm was trained individually. This method can benefit from explainable artificial intelligence to develop efficient and understandable passive brain-computer interfaces, improve flight safety by detecting such attentional failures in real time, and give appropriate feedback to pilots, according to our ambitious goal, providing them with reliable and rich human/machine interactions.
Collapse
Affiliation(s)
| | | | - Ludovic Fabre
- Centre de Recherche de l’Ecole de l’Air, Salon-de-Provence, France
| |
Collapse
|
6
|
Degraded States of Engagement in Air Traffic Control. SAFETY 2022. [DOI: 10.3390/safety8010019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/04/2022] Open
Abstract
Safety studies have identified attention as a recurring cause of incidents and accidents in air traffic control. However, little is known of the precise attentional states that lead to degraded ATC performance. Therefore, we surveyed 150 French en route air traffic controllers on the causes of and impacts on perceived cooperation, safety, and performance of seven degraded attentional states from the literature: task-related and task-unrelated mind wandering, mental overload, inattentional deafness and blindness, attentional entropy, and perseveration. Our findings indicated that task-related and task-unrelated mind wandering were the most prevalent but had the least impact on perceived safety. Conversely, inattentional blindness and attentional entropy were less reported but were considered a significant safety concern, while inattentional deafness affected cooperation. Most states were experienced in workload levels consistent with the literature. However, no other factor such as shift work was identified as a cause of these states. Overall, these findings suggest that “attention” is not a specific enough subject for ATC, as attentional issues can occur in various conditions and have different impacts. As far as safety is concerned, inattentional blindness should be the prime target for further research. Neuroergonomics in particular could help develop dynamic countermeasures to mitigate its impact.
Collapse
|
7
|
Zhu R, Wang Z, Ma X, You X. High expectancy influences the role of cognitive load in inattentional deafness during landing decision-making. APPLIED ERGONOMICS 2022; 99:103629. [PMID: 34717070 DOI: 10.1016/j.apergo.2021.103629] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/09/2021] [Revised: 10/19/2021] [Accepted: 10/23/2021] [Indexed: 06/13/2023]
Abstract
Neglecting a critical auditory alarm is a major obstacle to maintaining a safe environment, especially in aviation. Earlier studies have indicated that tasks with a higher perceptual or cognitive load in the visual modality influence the processing of auditory stimuli. It is unclear, however, whether other factors, such as memory failure, active neglect, or expectancy influence the effect of cognitive load on auditory alarm detection sensitivity during aeronautical decision-making. In this study, we investigated this issue in three laboratory experiments using the technique of signal detection analysis, in which participants were asked to make a landing decision based on indicators of the instrument landing system while also trying to detect an audible alarm. We found that the sensitivity of auditory alarm detection was reduced under conditions of high cognitive load and that this effect persisted even when the auditory detection response occurred first (before the landing decision response) and when the probability of an auditory alarm was 40%. However, the sensitivity of auditory detection was not influenced by cognitive load under high expectancy conditions (60% probability of alarm presentation). Furthermore, the value of the response bias was reduced under high cognitive load conditions when the probability of an auditory alarm was low (20%). With an increase in the level of expectancy (40% and 60% probability of alarm presentation), it was found that cognitive load did not influence the response bias. These findings indicate that visual cognitive load affects the sensitivity to an auditory alarm only at a low expectancy level (20% and 40% probability of alarm presentation). The effect of cognitive load on the sensitivity to an auditory alarm was not due to memory failure or active neglect and the response bias was more sensitive to the expectancy factor.
Collapse
Affiliation(s)
- Rongjuan Zhu
- Key Laboratory for Behavior and Cognitive Neuroscience of Shaanxi Province, School of Psychology, Shaanxi Normal University, Xi'an, 710062, China
| | - Ziyu Wang
- Key Laboratory for Behavior and Cognitive Neuroscience of Shaanxi Province, School of Psychology, Shaanxi Normal University, Xi'an, 710062, China
| | - Xiaoliang Ma
- Geovis Spatial Technology Co.,Ltd, Xi'an, 710100, China
| | - Xuqun You
- Key Laboratory for Behavior and Cognitive Neuroscience of Shaanxi Province, School of Psychology, Shaanxi Normal University, Xi'an, 710062, China.
| |
Collapse
|
8
|
Somon B, Giebeler Y, Darmet L, Dehais F. Benchmarking cEEGrid and Solid Gel-Based Electrodes to Classify Inattentional Deafness in a Flight Simulator. FRONTIERS IN NEUROERGONOMICS 2022; 2:802486. [PMID: 38235232 PMCID: PMC10790867 DOI: 10.3389/fnrgo.2021.802486] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/26/2021] [Accepted: 12/06/2021] [Indexed: 01/19/2024]
Abstract
Transfer from experiments in the laboratory to real-life tasks is challenging due notably to the inability to reproduce the complexity of multitasking dynamic everyday life situations in a standardized lab condition and to the bulkiness and invasiveness of recording systems preventing participants from moving freely and disturbing the environment. In this study, we used a motion flight simulator to induce inattentional deafness to auditory alarms, a cognitive difficulty arising in complex environments. In addition, we assessed the possibility of two low-density EEG systems a solid gel-based electrode Enobio (Neuroelectrics, Barcelona, Spain) and a gel-based cEEGrid (TMSi, Oldenzaal, Netherlands) to record and classify brain activity associated with inattentional deafness (misses vs. hits to odd sounds) with a small pool of expert participants. In addition to inducing inattentional deafness (missing auditory alarms) at much higher rates than with usual lab tasks (34.7% compared to the usual 5%), we observed typical inattentional deafness-related activity in the time domain but also in the frequency and time-frequency domains with both systems. Finally, a classifier based on Riemannian Geometry principles allowed us to obtain more than 70% of single-trial classification accuracy for both mobile EEG, and up to 71.5% for the cEEGrid (TMSi, Oldenzaal, Netherlands). These results open promising avenues toward detecting cognitive failures in real-life situations, such as real flight.
Collapse
Affiliation(s)
- Bertille Somon
- Artificial and Natural Intelligence Toulouse Institute, Université de Toulouse, Toulouse, France
- Department for Aerospace Vehicles Design and Control, ISAE-SUPAERO, Université de Toulouse, Toulouse, France
| | - Yasmina Giebeler
- Department for Aerospace Vehicles Design and Control, ISAE-SUPAERO, Université de Toulouse, Toulouse, France
- Department of Psychology and Ergonomics, Technische Universität Berlin, Berlin, Germany
| | - Ludovic Darmet
- Department for Aerospace Vehicles Design and Control, ISAE-SUPAERO, Université de Toulouse, Toulouse, France
| | - Frédéric Dehais
- Artificial and Natural Intelligence Toulouse Institute, Université de Toulouse, Toulouse, France
- Department for Aerospace Vehicles Design and Control, ISAE-SUPAERO, Université de Toulouse, Toulouse, France
- School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA, United States
| |
Collapse
|
9
|
Dehais F, Lafont A, Roy R, Fairclough S. A Neuroergonomics Approach to Mental Workload, Engagement and Human Performance. Front Neurosci 2020; 14:268. [PMID: 32317914 PMCID: PMC7154497 DOI: 10.3389/fnins.2020.00268] [Citation(s) in RCA: 56] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2019] [Accepted: 03/10/2020] [Indexed: 12/26/2022] Open
Abstract
The assessment and prediction of cognitive performance is a key issue for any discipline concerned with human operators in the context of safety-critical behavior. Most of the research has focused on the measurement of mental workload but this construct remains difficult to operationalize despite decades of research on the topic. Recent advances in Neuroergonomics have expanded our understanding of neurocognitive processes across different operational domains. We provide a framework to disentangle those neural mechanisms that underpin the relationship between task demand, arousal, mental workload and human performance. This approach advocates targeting those specific mental states that precede a reduction of performance efficacy. A number of undesirable neurocognitive states (mind wandering, effort withdrawal, perseveration, inattentional phenomena) are identified and mapped within a two-dimensional conceptual space encompassing task engagement and arousal. We argue that monitoring the prefrontal cortex and its deactivation can index a generic shift from a nominal operational state to an impaired one where performance is likely to degrade. Neurophysiological, physiological and behavioral markers that specifically account for these states are identified. We then propose a typology of neuroadaptive countermeasures to mitigate these undesirable mental states.
Collapse
Affiliation(s)
- Frédéric Dehais
- ISAE-SUPAERO, Université de Toulouse, Toulouse, France
- School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA, United States
| | - Alex Lafont
- ISAE-SUPAERO, Université de Toulouse, Toulouse, France
| | - Raphaëlle Roy
- ISAE-SUPAERO, Université de Toulouse, Toulouse, France
| | - Stephen Fairclough
- School of Psychology, Liverpool John Moores University, Liverpool, United Kingdom
| |
Collapse
|
10
|
Gougelet RJ, Terzibas C, Callan DE. Cerebellum, Basal Ganglia, and Cortex Mediate Performance of an Aerial Pursuit Task. Front Hum Neurosci 2020; 14:29. [PMID: 32116611 PMCID: PMC7033450 DOI: 10.3389/fnhum.2020.00029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2019] [Accepted: 01/21/2020] [Indexed: 12/03/2022] Open
Abstract
The affordance competition hypothesis is an ethologically inspired theory from cognitive neuroscience that provides an integrative neural account of continuous, real-time behavior, and will likely become increasingly relevant to the growing field of neuroergonomics. In the spirit of neuroergonomics in aviation, we designed a three-dimensional, first-person, continuous, and real-time fMRI task during which human subjects maneuvered a simulated airplane in pursuit of a target airplane along constantly changing headings. We introduce a pseudo-event-related, parametric fMRI analysis approach to begin testing the affordance competition hypothesis in neuroergonomic contexts, and attempt to identify regions of the brain that exhibit a linear metabolic relationship with the continuous variables of task performance and distance-from-target. In line with the affordance competition hypothesis, our results implicate the cooperation of the cerebellum, basal ganglia, and cortex in such a task, with greater involvement of the basal ganglia during good performance, and greater involvement of cortex and cerebellum during poor performance and when distance-from-target closes. We briefly review the somatic marker and dysmetria of thought hypotheses, in addition to the affordance competition hypothesis, to speculate on the intricacies of the cooperation of these brain regions in a task such as ours. In doing so, we demonstrate how the affordance competition hypothesis and other cognitive neuroscience theories are ready for testing in continuous, real-time tasks such as ours, and in other neuroergonomic settings more generally.
Collapse
Affiliation(s)
- Robert J Gougelet
- Department of Cognitive Science, University of California, San Diego, La Jolla, CA, United States.,Swartz Center for Computational Neuroscience, University of California, San Diego, La Jolla, CA, United States
| | - Cengiz Terzibas
- Multisensory Cognition and Computation Laboratory, Universal Communication Research Institute, National Institute of Information and Communications Technology, Kyoto, Japan
| | - Daniel E Callan
- Swartz Center for Computational Neuroscience, University of California, San Diego, La Jolla, CA, United States.,Center for Information and Neural Networks, National Institute of Information and Communications Technology, Osaka University, Osaka, Japan
| |
Collapse
|
11
|
Chen X, Xu K, Yang Y, Wang Q, Jiang H, Guo X, Chen X, Yang J, Luo C. Altered Default Mode Network Dynamics in Civil Aviation Pilots. Front Neurosci 2020; 13:1406. [PMID: 31992967 PMCID: PMC6971098 DOI: 10.3389/fnins.2019.01406] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2019] [Accepted: 12/12/2019] [Indexed: 12/27/2022] Open
Abstract
Background Airlines occupy an increasingly important place in the economy of many countries. Because air disasters may cause substantial losses, comprehensive surveys of the psychophysiological mechanism of flying are needed; however, relatively few studies have focused on pilots. The default mode network (DMN) is an important intrinsic connectivity network involved in a range of functions related to flying. This study aimed to examine functional properties of the DMN in pilots. Method Resting-state functional magnetic resonance imaging data from 26 pilots and 24 controls were collected. Independent component analysis, a data-driven approach, was combined with functional connectivity analysis to investigate functional properties of the DMN in pilots. Results The pilot group exhibited increased functional integration in the precuneus/posterior cingulate cortex (PCC) and left middle occipital gyrus. Subsequent functional connectivity analysis identified enhanced functional connection between the precuneus/PCC and medial superior frontal gyrus. Conclusion The pilot group exhibited increased functional connections within the DMN. These findings highlight the importance of the DMN in the neurophysiological mechanism of flying.
Collapse
Affiliation(s)
- Xi Chen
- Institute of Aviation Human Factors and Ergonomics, Department of Aviation Psychology, Institute of Flight Technology, Civil Aviation Flight University of China, Guanghan, China
| | - Kaijun Xu
- Institute of Aviation Human Factors and Ergonomics, Department of Aviation Psychology, Institute of Flight Technology, Civil Aviation Flight University of China, Guanghan, China
| | - Yong Yang
- Institute of Aviation Human Factors and Ergonomics, Department of Aviation Psychology, Institute of Flight Technology, Civil Aviation Flight University of China, Guanghan, China
| | - Quanchuan Wang
- Institute of Aviation Human Factors and Ergonomics, Department of Aviation Psychology, Institute of Flight Technology, Civil Aviation Flight University of China, Guanghan, China
| | - Hao Jiang
- Institute of Aviation Human Factors and Ergonomics, Department of Aviation Psychology, Institute of Flight Technology, Civil Aviation Flight University of China, Guanghan, China
| | - Xiangmei Guo
- Institute of Aviation Human Factors and Ergonomics, Department of Aviation Psychology, Institute of Flight Technology, Civil Aviation Flight University of China, Guanghan, China
| | - Xipeng Chen
- Institute of Aviation Human Factors and Ergonomics, Department of Aviation Psychology, Institute of Flight Technology, Civil Aviation Flight University of China, Guanghan, China
| | - Jiazhong Yang
- Institute of Aviation Human Factors and Ergonomics, Department of Aviation Psychology, Institute of Flight Technology, Civil Aviation Flight University of China, Guanghan, China
| | - Cheng Luo
- Key Laboratory for NeuroInformation of Ministry of Education, School of Life Sciences and Technology, University of Electronic Science and Technology of China, Chengdu, China
| |
Collapse
|
12
|
Hutchinson BT. Toward a theory of consciousness: A review of the neural correlates of inattentional blindness. Neurosci Biobehav Rev 2019; 104:87-99. [DOI: 10.1016/j.neubiorev.2019.06.003] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2018] [Revised: 03/31/2019] [Accepted: 06/03/2019] [Indexed: 10/26/2022]
|
13
|
Dehais F, Duprès A, Blum S, Drougard N, Scannella S, Roy RN, Lotte F. Monitoring Pilot's Mental Workload Using ERPs and Spectral Power with a Six-Dry-Electrode EEG System in Real Flight Conditions. SENSORS (BASEL, SWITZERLAND) 2019; 19:E1324. [PMID: 30884825 PMCID: PMC6471557 DOI: 10.3390/s19061324] [Citation(s) in RCA: 50] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/12/2019] [Revised: 02/24/2019] [Accepted: 03/12/2019] [Indexed: 11/29/2022]
Abstract
Recent technological progress has allowed the development of low-cost and highly portable brain sensors such as pre-amplified dry-electrodes to measure cognitive activity out of the laboratory. This technology opens promising perspectives to monitor the "brain at work" in complex real-life situations such as while operating aircraft. However, there is a need to benchmark these sensors in real operational conditions. We therefore designed a scenario in which twenty-two pilots equipped with a six-dry-electrode EEG system had to perform one low load and one high load traffic pattern along with a passive auditory oddball. In the low load condition, the participants were monitoring the flight handled by a flight instructor, whereas they were flying the aircraft in the high load condition. At the group level, statistical analyses disclosed higher P300 amplitude for the auditory target (Pz, P4 and Oz electrodes) along with higher alpha band power (Pz electrode), and higher theta band power (Oz electrode) in the low load condition as compared to the high load one. Single trial classification accuracy using both event-related potentials and event-related frequency features at the same time did not exceed chance level to discriminate the two load conditions. However, when considering only the frequency features computed over the continuous signal, classification accuracy reached around 70% on average. This study demonstrates the potential of dry-EEG to monitor cognition in a highly ecological and noisy environment, but also reveals that hardware improvement is still needed before it can be used for everyday flight operations.
Collapse
Affiliation(s)
- Frédéric Dehais
- ISAE-SUPAERO, Université de Toulouse, 31055 Toulouse, France.
| | - Alban Duprès
- ISAE-SUPAERO, Université de Toulouse, 31055 Toulouse, France.
| | - Sarah Blum
- Department of Psychology, University of Oldenburg, 26122 Oldenburg, Germany.
| | | | | | - Raphaëlle N Roy
- ISAE-SUPAERO, Université de Toulouse, 31055 Toulouse, France.
| | - Fabien Lotte
- Inria Bordeaux Sud Ouest, LaBRI, University of Bordeaux, Potioc Team, 33400 Talence, France.
| |
Collapse
|
14
|
Inattentional deafness to auditory alarms: Inter-individual differences, electrophysiological signature and single trial classification. Behav Brain Res 2018; 360:51-59. [PMID: 30508609 DOI: 10.1016/j.bbr.2018.11.045] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2018] [Revised: 11/22/2018] [Accepted: 11/29/2018] [Indexed: 02/03/2023]
Abstract
Inattentional deafness can have deleterious consequences in complex real-life situations (e.g. healthcare, aviation) leading to miss critical auditory signals. Such failure of auditory attention is thought to rely on top-down biasing mechanisms at the central executive level. A complementary approach to account for this phenomenon is to consider the existence of visual dominance over hearing that could be implemented via direct visual-to-auditory pathways. To investigate this phenomenon, thirteen aircraft pilots, equipped with a 32-channel EEG system, faced a low and high workload scenarii along with an auditory oddball task in a motion flight simulator. Prior to the flying task, the pilots were screened to assess their working memory span and visual dominance susceptibility. The behavioral results disclosed that the volunteers missed 57.7% of the auditory alarms in the difficult condition. Among all evaluated capabilities, only the visual dominance index was predictive of the miss rate in the difficult scenario. These findings provide behavioral evidences that other early cross-modal competitive process than top down modulation process could account for inattentional deafness. The electrophysiological analyses showed that the miss over the hit alarms led to a significant amplitude reduction of early perceptual (N100) and late attentional (P3a and P3b) event-related potentials components. Eventually, we implemented an EEG-based processing pipeline to perform single-trial classification of inattentional deafness. The results indicate that this processing chain could be used in an ecological setting as it led to 72.2% mean accuracy to discriminate missed from hit auditory alarms.
Collapse
|
15
|
Callan DE, Gateau T, Durantin G, Gonthier N, Dehais F. Disruption in neural phase synchrony is related to identification of inattentional deafness in real-world setting. Hum Brain Mapp 2018; 39:2596-2608. [PMID: 29484760 DOI: 10.1002/hbm.24026] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2017] [Revised: 02/19/2018] [Accepted: 02/20/2018] [Indexed: 11/10/2022] Open
Abstract
Individuals often have reduced ability to hear alarms in real world situations (e.g., anesthesia monitoring, flying airplanes) when attention is focused on another task, sometimes with devastating consequences. This phenomenon is called inattentional deafness and usually occurs under critical high workload conditions. It is difficult to simulate the critical nature of these tasks in the laboratory. In this study, dry electroencephalography is used to investigate inattentional deafness in real flight while piloting an airplane. The pilots participating in the experiment responded to audio alarms while experiencing critical high workload situations. It was found that missed relative to detected alarms were marked by reduced stimulus evoked phase synchrony in theta and alpha frequencies (6-14 Hz) from 120 to 230 ms poststimulus onset. Correlation of alarm detection performance with intertrial coherence measures of neural phase synchrony showed different frequency and time ranges for detected and missed alarms. These results are consistent with selective attentional processes actively disrupting oscillatory coherence in sensory networks not involved with the primary task (piloting in this case) under critical high load conditions. This hypothesis is corroborated by analyses of flight parameters showing greater maneuvering associated with difficult phases of flight occurring during missed alarms. Our results suggest modulation of neural oscillation is a general mechanism of attention utilizing enhancement of phase synchrony to sharpen alarm perception during successful divided attention, and disruption of phase synchrony in brain networks when attentional demands of the primary task are great, such as in the case of inattentional deafness.
Collapse
Affiliation(s)
- Daniel E Callan
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology (NICT), Osaka University, Osaka, Japan.,Institut Supérieur de l'Aéronautique et de l'Espace (ISAE), Université Fédérale Toulouse Midi-Pyrénées, Toulouse, France
| | - Thibault Gateau
- Institut Supérieur de l'Aéronautique et de l'Espace (ISAE), Université Fédérale Toulouse Midi-Pyrénées, Toulouse, France
| | - Gautier Durantin
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, Australia
| | - Nicolas Gonthier
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology (NICT), Osaka University, Osaka, Japan.,Institut Supérieur de l'Aéronautique et de l'Espace (ISAE), Université Fédérale Toulouse Midi-Pyrénées, Toulouse, France
| | - Frédéric Dehais
- Institut Supérieur de l'Aéronautique et de l'Espace (ISAE), Université Fédérale Toulouse Midi-Pyrénées, Toulouse, France
| |
Collapse
|