Aviation and neurophysiology: A systematic review

Exploring perceptions of pilot licensing and training standards: a survey of Canadian student and licensed pilots

This study investigates the perspectives of Canadian student and licenced pilots on general aviation pilot training and licencing practices. Employing a mixed-methods approach, this research critiques the reliance on flight hours as the sole competence metric and examines the alignment of existing practices with modern aviation's complexities. Findings reveal a divergence in opinions between novice and experienced pilots on flight hours' importance, with a consensus towards a competency-based evaluation model. The study identifies critical shortcomings in existing training practices, such as the challenge of integrating technology, fostering advanced skills, and efficiently utilising instructional resources. It suggests recommendations for regulatory enhancements, aiming to ensure training practices evolve in line with the changing requirements of aviation safety and technology. The conclusion calls for urgent reform, underlining the imperative for training adaptations that can prepare pilots to proficiently manage the complexities of contemporary airspace, thus safeguarding their proficiency and safety.

Enhancing Aviation Safety through AI-Driven Mental Health Management for Pilots and Air Traffic Controllers

This article provides an overview of the mental health challenges faced by pilots and air traffic controllers (ATCs), whose stressful professional lives may negatively impact global flight safety and security. The adverse effects of mental health disorders on their flight performance pose a particular safety risk, especially in sudden unexpected startle situations. Therefore, the early detection, prediction and prevention of mental health deterioration in pilots and ATCs, particularly among those at high risk, are crucial to minimize potential air crash incidents caused by human factors. Recent research in artificial intelligence (AI) demonstrates the potential of machine and deep learning, edge and cloud computing, virtual reality and wearable multimodal physiological sensors for monitoring and predicting mental health disorders. Longitudinal monitoring and analysis of pilots' and ATCs physiological, cognitive and behavioral states could help predict individuals at risk of undisclosed or emerging mental health disorders. Utilizing AI tools and methodologies to identify and select these individuals for preventive mental health training and interventions could be a promising and effective approach to preventing potential air crash accidents attributed to human factors and related mental health problems. Based on these insights, the article advocates for the design of a multidisciplinary mental healthcare ecosystem in modern aviation using AI tools and technologies, to foster more efficient and effective mental health management, thereby enhancing flight safety and security standards. This proposed ecosystem requires the collaboration of multidisciplinary experts, including psychologists, neuroscientists, physiologists, psychiatrists, etc. to address these challenges in modern aviation.

The role of visual conditions and aircraft type on different aspects of pilot workload

OBJECTIVE

The objective of our work was to assess the impact of flight conditions by aircraft type on the workload estimated using NASA-Task Load Index (NASA-TLX).

BACKGROUND

Learning about subjective workload is important for assessing the impact of a pilot's work environment on their performance in the cockpit. This is an important element of flight safety and includes the prevention of aviation accidents.

METHODS

The study included 146 military pilots that fly the following aircrafts: flying fast-jet (21), fixed-wing (24), and rotary-wing (101). The NASA-TLX questionnaire was used to assess workload and pilots were asked to determine the level of workload resulting from flying under the following conditions: daytime flight (VFR), night-vision flight performed under Night Visual Flight Rules (NVFR), and night-vision flight using night-vision goggles (NVGs).

RESULTS

The highest level of workload was consistently attributed to flights performed under NVG conditions. NVFR conditions were rated as the most burdensome, while VFR conditions were rated as the least burdensome. Fast-jet pilots rated their mental performance and effort workload as significantly higher than pilots of other aircrafts.

CONCLUSION

Pilots' perceived workload is influenced by both flight conditions and the type of aircraft they fly. Workload knowledge is important for flight safety and should be taken into account during training and flight-task planning.

APPLICATION

The results of our study can be useful both in flight training and in work on the effectiveness of the human-machine interface. Awareness of one's own limitations due to the work environment can help improve flight safety.

Measuring aviator workload using EEG: an individualized approach to workload manipulation

Introduction

Measuring an operator's physiological state and using that data to predict future performance decrements has been an ongoing goal in many areas of transportation. Regarding Army aviation, the realization of such an endeavor could lead to the development of an adaptive automation system which adapts to the needs of the operator. However, reaching this end state requires the use of experimental scenarios similar to real-life settings in order to induce the state of interest that are able to account for individual differences in experience, exposure, and perception to workload manipulations. In the present study, we used an individualized approach to manipulating workload in order to account for individual differences in response to workload manipulations, while still providing an operationally relevant flight experience.

Methods

Eight Army aviators participated in the study, where they completed two visits to the laboratory. The first visit served the purpose of identifying individual workload thresholds, with the second visit resulting in flights with individualized workload manipulations. EEG data was collected throughout both flights, along with subjective ratings of workload and flight performance.

Results

Both EEG data and workload ratings suggested a high workload. Subjective ratings were higher during the high workload flight compared to the low workload flight (p < 0.001). Regarding EEG, frontal alpha (p = 0.04) and theta (p = 0.01) values were lower and a ratio of beta/(alpha+theta) (p = 0.02) were higher in the baseline flight scenario compared to the high workload scenario. Furthermore, the data were compared to that collected in previous studies which used a group-based approach to manipulating workload.

Discussion

The individualized method demonstrated higher effect sizes in both EEG and subjective ratings, suggesting the use of this method may provide a more reliable way of producing high workload in aviators.

Detecting and Predicting Pilot Mental Workload Using Heart Rate Variability: A Systematic Review

Measuring pilot mental workload (MWL) is crucial for enhancing aviation safety. However, MWL is a multi-dimensional construct that could be affected by multiple factors. Particularly, in the context of a more automated cockpit setting, the traditional methods of assessing pilot MWL may face challenges. Heart rate variability (HRV) has emerged as a potential tool for detecting pilot MWL during real-flight operations. This review aims to investigate the relationship between HRV and pilot MWL and to assess the performance of machine-learning-based MWL detection systems using HRV parameters. A total of 29 relevant papers were extracted from three databases for review based on rigorous eligibility criteria. We observed significant variability across the reviewed studies, including study designs and measurement methods, as well as machine-learning techniques. Inconsistent results were observed regarding the differences in HRV measures between pilots under varying levels of MWL. Furthermore, for studies that developed HRV-based MWL detection systems, we examined the diverse model settings and discovered that several advanced techniques could be used to address specific challenges. This review serves as a practical guide for researchers and practitioners who are interested in employing HRV indicators for evaluating MWL and wish to incorporate cutting-edge techniques into their MWL measurement approaches.

Mental workload assessment by monitoring brain, heart, and eye with six biomedical modalities during six cognitive tasks

Introduction

The efficiency and safety of complex high precision human-machine systems such as in aerospace and robotic surgery are closely related to the cognitive readiness, ability to manage workload, and situational awareness of their operators. Accurate assessment of mental workload could help in preventing operator error and allow for pertinent intervention by predicting performance declines that can arise from either work overload or under stimulation. Neuroergonomic approaches based on measures of human body and brain activity collectively can provide sensitive and reliable assessment of human mental workload in complex training and work environments.

Methods

In this study, we developed a new six-cognitive-domain task protocol, coupling it with six biomedical monitoring modalities to concurrently capture performance and cognitive workload correlates across a longitudinal multi-day investigation. Utilizing two distinct modalities for each aspect of cardiac activity (ECG and PPG), ocular activity (EOG and eye-tracking), and brain activity (EEG and fNIRS), 23 participants engaged in four sessions over 4 weeks, performing tasks associated with working memory, vigilance, risk assessment, shifting attention, situation awareness, and inhibitory control.

Results

The results revealed varying levels of sensitivity to workload within each modality. While certain measures exhibited consistency across tasks, neuroimaging modalities, in particular, unveiled meaningful differences between task conditions and cognitive domains.

Discussion

This is the first comprehensive comparison of these six brain-body measures across multiple days and cognitive domains. The findings underscore the potential of wearable brain and body sensing methods for evaluating mental workload. Such comprehensive neuroergonomic assessment can inform development of next generation neuroadaptive interfaces and training approaches for more efficient human-machine interaction and operator skill acquisition.

Simultaneous fMRI and tDCS for Enhancing Training of Flight Tasks

There is a gap in our understanding of how best to apply transcranial direct-current stimulation (tDCS) to enhance learning in complex, realistic, and multifocus tasks such as aviation. Our goal is to assess the effects of tDCS and feedback training on task performance, brain activity, and connectivity using functional magnetic resonance imaging (fMRI). Experienced glider pilots were recruited to perform a one-day, three-run flight-simulator task involving varying difficulty conditions and a secondary auditory task, mimicking real flight requirements. The stimulation group (versus sham) received 1.5 mA high-definition HD-tDCS to the right dorsolateral prefrontal cortex (DLPFC) for 30 min during the training. Whole-brain fMRI was collected before, during, and after stimulation. Active stimulation improved piloting performance both during and post-training, particularly in novice pilots. The fMRI revealed a number of tDCS-induced effects on brain activation, including an increase in the left cerebellum and bilateral basal ganglia for the most difficult conditions, an increase in DLPFC activation and connectivity to the cerebellum during stimulation, and an inhibition in the secondary task-related auditory cortex and Broca's area. Here, we show that stimulation increases activity and connectivity in flight-related brain areas, particularly in novices, and increases the brain's ability to focus on flying and ignore distractors. These findings can guide applied neurostimulation in real pilot training to enhance skill acquisition and can be applied widely in other complex perceptual-motor real-world tasks.

The effect of flight phase on electrodermal activity and gaze behavior: A simulator study

Current advances in airplane cockpit design and layout are often driven by a need to improve the pilot's awareness of the aircraft's state. This involves an improvement in the flow of information from aircraft to pilot. However, providing the aircraft with information on the pilot's state remains an open challenge. This work takes a first step towards determining the pilot's state based on biosensor data. We conducted a simulator study to record participants' electrodermal activity and gaze behavior, indicating pilot state changes during three distinct flight phases in an instrument failure scenario. The results show a significant difference in these psychophysiological measures between a phase of regular flight, the incident phase, and a phase with an additional troubleshooting task after the failure. The differences in the observed measures suggest great potential for a pilot-aware cockpit that can provide assistance based on the sensed pilot state.

A neuroergonomic approach to assessing motor performance in stroke patients using fNIRS and behavioral data

Stroke is characterized by high morbidity and disability, and proposing effective methods for assessing and designing rehabilitation products is an attractive topic in current research. In this study, a hand function rehabilitation aid was developed for stroke patients. Ten stroke patients and 20 healthy older people as a control group were recruited to perform a 600 s task after a 600 s resting by gripping a stick while clicking on a flashing light in an electronic insert in sequence according to a pattern. The functional near-infrared spectroscopy (fNIRS) and behavioral data were collected during their rehabilitation training. Brain function was analyzed using three indicators, namely brain area activation, functional connectivity and effective connectivity, while behavioral performance was analyzed using ten indicators, such as velocity and acceleration, and correlations were made between both. Followed by proposing a quantitative assessment method based on the fusion of multiple data sources. The results showed that the developed rehabilitation tool could effectively stimulate the patient's brain and help recover their cognitive and behavioral capacities. The scientific validity of the proposed assessment approach was further confirmed by contrasting the data results of the stroke group with those of the healthy elderly group. This study has integrated brain function and behavioral data, providing a practical quantitative evaluation method of product ergonomics and data-driven product design concepts for stroke patients.

Assessing the development of mental fatigue during simulated flights with concurrent EEG-fNIRS measurement

Mental fatigue (MF) can impair pilots' performance and reactions to unforeseen events and is therefore an important concept within aviation. The physiological measurement of MF, especially with EEG and, in recent years, fNIRS, has gained much attention. However, a systematic investigation and comparison of the measurements is seldomly done. We induced MF via time on task during a 90-min simulated flight task and collected concurrent EEG-fNIRS, performance and self-report data from 31 participants. While their subjective MF increased linearly, the participants were able to keep their performance stable over the course of the experiment. EEG data showed an early increase and levelling in parietal alpha power and a slower, but steady increase in frontal theta power. No consistent trend could be observed in the fNIRS data. Thus, more research on fNIRS is needed to understand its possibilities and limits for MF assessment, and a combination with EEG is advisable to compare and validate results. Until then, EEG remains the better choice for continuous MF assessment in cockpit applications because of its high sensitivity to a transition from alert to fatigued, even before performance is impaired.

Stress-Adaptive Training: An Adaptive Psychomotor Training According to Stress Measured by Grip Force

Current training methods show advances in simulation technologies; however, most of them fail to account for changes in the physical or mental state of the trainee. An innovative training method, adaptive to the trainee's stress levels as measured by grip force, is described and inspected. It is compared with two standard training methods that ignore the trainee's state, either leaving the task's level of difficulty constant or increasing it over time. Fifty-two participants, divided into three test groups, performed a psychomotor training task. The performance level of the stress-adaptive group was higher than for both control groups, with a main effect of t = -2.12 (p = 0.039), while the training time was shorter than both control groups, with a main effect of t = 3.27 (p = 0.002). These results indicate that stress-adaptive training has the potential to improve training outcomes. Moreover, these results imply that grip force measurement has practical applications. Future studies may aid in the development of this training method and its outcomes.