Executive Functions and Pilot Characteristics Predict Flight Simulator Performance in General Aviation Pilots

A Window Into the Tired Brain: Neurophysiological Dynamics of Visuospatial Working Memory Under Fatigue

OBJECTIVE

We examine the spatiotemporal dynamics of neural activity and its correlates in heart rate and its variability (HR/HRV) during a fatiguing visuospatial working memory task.

BACKGROUND

The neural and physiological drivers of fatigue are complex, coupled, and poorly understood. Investigations that combine the fidelity of neural indices and the field-readiness of physiological measures can facilitate measurements of fatigue states in operational settings.

METHOD

Sixteen healthy adults, balanced by sex, completed a 60-minute fatiguing visuospatial working memory task. Changes in task performance, subjective measures of effort and fatigue, cerebral hemodynamics, and HR/HRV were analyzed. Peak brain activation, functional and effective connections within relevant brain networks were contrasted against spectral and temporal features of HR/HRV.

RESULTS

Task performance elicited increased neural activation in regions responsible for maintaining working memory capacity. With the onset of time-on-task effects, resource utilization was seen to increase beyond task-relevant networks. Over time, functional connections in the prefrontal cortex were seen to weaken, with changes in the causal relationships between key regions known to drive working memory. HR/HRV indices were seen to closely follow activity in the prefrontal cortex.

CONCLUSION

This investigation provided a window into the neurophysiological underpinnings of working memory under the time-on-task effect. HR/HRV was largely shown to mirror changes in cortical networks responsible for working memory, therefore supporting the possibility of unobtrusive state recognition under ecologically valid conditions.

APPLICATIONS

Findings here can inform the development of a fieldable index for cognitive fatigue.

Executive Functions and Theory of Mind in Teachers and Non-Teachers

Human teaching is a key behavior for the socialization of cultural knowledge. Previous studies suggest that human teaching behavior would support the development of executive and ToM skills, which in turn would refine the teaching behavior. Given this connection, it raises the question of whether subjects with professional training in teaching also have more efficient executive and ToM systems. To shed light on this issue, in the present study we compared the performance of professional teachers (N = 20, age range = 35-61 years) with a matched control group of non-teachers (N = 20, age range: 29-64 years) on tasks measuring working memory (Sternberg Task), cognitive flexibility (Wisconsin Card Sorting Test), executive control (Attention Network Test), along with online ToM skills (Frith-Happé Animations Task), emotion recognition (Reading the Mind in the Eyes Test) and first-order and second-order ToM (Yoni Task). We found that teachers were significantly more accurate on tasks involving cognitive flexibility (p = .014) and working memory (p = .040), and more efficient on tasks requiring executive control of attention (p = .046), compared to non-teachers. In ToM tasks, differences in accuracy between teachers and non-teachers were not found. But, teachers were slower to respond than non-teachers (about 2 s difference) on tasks involving emotion recognition (p = .0007) and the use of second-order affective ToM (p = .006). Collectively, our findings raise an interesting link between professional teaching and the development of cognitive skills critical for decision-making in challenging social contexts such as the classroom. Future research could explore ways to foster teachers' strengths in cognitive flexibility, working memory, and executive control of attention to enhance teaching strategies and student learning outcomes. Additionally, exploring factors behind slower response times in affective ToM tasks can guide teacher-training programs focused on interpersonal skills and improve teacher-student interactions.

Mild Depressive Symptoms in Airline Pilots Associated With Impaired Executive Functions

INTRODUCTION

While significant efforts have been made to understand the influence of depression-related impairments on executive functioning within the general population, the specific impact on airline pilots remains largely unexplored. Considering the crucial role that cognitive abilities play in the realm of aircraft piloting, it is imperative to probe into the potential repercussions of depressive symptoms on executive functions (EFs) among this professional cohort.

OBJECTIVES

 This study aims to explore the associations between depressive symptoms and EFs in a convenience sample of airline pilots.

METHODS

 Male airline pilots (n = 100) underwent the Beck Depression Inventory II (BDI-II) to gauge both the presence and intensity of depressive symptoms. The Stroop Color and Word Test (SCWT), the Digit Span Task (DST), and the Wisconsin Card Sorting Test (WCST) were used to assess EFs.

RESULTS

 Of the entire sample of pilots, 88% (n = 88) demonstrated minimal depressive symptoms with a BDI-II score ranging from 0 to 13. The remaining 12% (n = 12) exhibited mild depression, with scores between 14 and 19. Pilots suffering from mild depression demonstrated prolonged color and word times and a higher time interference (TI) score on the SCWT. Moreover, these individuals exhibited lower scores on the DST across both the forward digit span (FDS) and backward digit span (BDS) subtests. Finally, the presence of mild depression correlated with an increased number of total errors, encompassing both perseverative and non-perseverative errors, in the WCST. After adjusting for potential confounding variables, we found an independent association between BDI-II scores and total errors in the WCST.

CONCLUSION

Our research points to substantial differences in EFs between airline pilots demonstrating mild depression and those exhibiting minimal depressive symptoms. This information can catalyze heightened consciousness about the psychological welfare of pilots.

The effect of backpack weight on the performance of basic short-term/working memory tasks while walking along a pre-determined route

This study investigated possible backpack weight effects on the performance of three basic short-term/working memory (STM/WM) tasks conducted concurrently with the physical task of route walking. The STM/WM tasks were the Corsi block-tapping, digit span, and 3-back tasks, and, were employed to examine the visuo-spatial sketchpad, phonological loop and central executive components of the WM system. Four backpack weight levels (0%, 15%, 25% and 40% of body mass) were considered. Thirty participants conducted the three experimental tasks requiring physical-cognitive multitasking. Data analyses revealed that: (1) increased backpack weight resulted in decreases in the performance of the Corsi block-tapping and the 3-back task, but (2) backpack weight did not significantly affect the digit span task performance. The study results suggest that reducing backpack weight could benefit the performance of various cognitive tasks during route walking. The study findings may be useful for the ergonomics design of body-worn equipment and human-system interfaces.Practitioner summary: This study examined the backpack weight effects on the performance of three basic short-term/working memory tasks conducted concurrently with the physical task of route walking. The study revealed that reducing backpack weight could benefit various cognitive tasks during physical-cognitive multitasking, especially cognitive tasks that require visuospatial processing and executive control.

Building a transdisciplinary expert consensus on the cognitive drivers of performance under pressure: An international multi-panel Delphi study

Introduction

The ability to perform optimally under pressure is critical across many occupations, including the military, first responders, and competitive sport. Despite recognition that such performance depends on a range of cognitive factors, how common these factors are across performance domains remains unclear. The current study sought to integrate existing knowledge in the performance field in the form of a transdisciplinary expert consensus on the cognitive mechanisms that underlie performance under pressure.

Methods

International experts were recruited from four performance domains [(i) Defense; (ii) Competitive Sport; (iii) Civilian High-stakes; and (iv) Performance Neuroscience]. Experts rated constructs from the Research Domain Criteria (RDoC) framework (and several expert-suggested constructs) across successive rounds, until all constructs reached consensus for inclusion or were eliminated. Finally, included constructs were ranked for their relative importance.

Results

Sixty-eight experts completed the first Delphi round, with 94% of experts retained by the end of the Delphi process. The following 10 constructs reached consensus across all four panels (in order of overall ranking): (1) Attention; (2) Cognitive Control-Performance Monitoring; (3) Arousal and Regulatory Systems-Arousal; (4) Cognitive Control-Goal Selection, Updating, Representation, and Maintenance; (5) Cognitive Control-Response Selection and Inhibition/Suppression; (6) Working memory-Flexible Updating; (7) Working memory-Active Maintenance; (8) Perception and Understanding of Self-Self-knowledge; (9) Working memory-Interference Control, and (10) Expert-suggested-Shifting.

Discussion

Our results identify a set of transdisciplinary neuroscience-informed constructs, validated through expert consensus. This expert consensus is critical to standardizing cognitive assessment and informing mechanism-targeted interventions in the broader field of human performance optimization.

The risk-taking behavioural intentions of pilots in adverse weather conditions: an application of the theory of planned behaviour

This paper examined pilots' risk-taking behavioural intentions based on the theory of planned behaviour, as well as the impact of experience on behavioural intentions in adverse weather conditions. Two hundred and seventy-three airline pilots and flying cadets were divided into two groups and asked to complete a questionnaire based on two decision-making scenarios. This questionnaire measured pilots' intentions to take risks, along with the attitude towards the behaviour, subjective norms, perceived behavioural control (PBC), risk perception, and self-identity. The results showed that attitude, subjective norm, PBC, and risk perception explained 52% of the variance in behavioural intentions. Additionally, pilots' risk-taking decisions can be influenced by experience. Inexperienced pilots had a relatively stronger intention to take risks and a more favourable attitude towards risky behaviour. Moreover, pilots were more likely to rely on their own direct experience in the decision-making process. Practitioner summary: This study examined the pilots' risk-taking intentions under adverse weather conditions using a questionnaire based on the TPB theory. Results demonstrated that the TPB model can be applied to the risk-taking scenario and that experience can influence pilots' decisions. These findings have implications for improving flight safety and lowering accident rates.

Anodal tDCS augments and preserves working memory beyond time-on-task deficits

Transcranial direct current stimulation (tDCS) of the left dorsolateral prefrontal cortex (DLPFC) has been shown to promote working memory (WM), however, its efficacy against time-on-task-related performance decline and associated cognitive fatigue remains uncertain. This study examined the impact of anodal tDCS of the left DLPFC on performance during a fatiguing visuospatial WM test. We adopted a repeated measures design, where 32 healthy adults (16 female), underwent anodal, control and sham tDCS on separate days. They completed an hour long two-back test, with stimulation intensity, onset, and duration set at 1 mA, at the 20th minute for 10 minutes respectively. Task performance, subjective responses, and heart rate variability (HRV) were captured during the experiment. Anodal tDCS substantially improved WM relative to sham tDCS and control in both sexes. These benefits lasted beyond the stimulation interval, and were unique across performance measures. However, no perceptual changes in subjective effort or fatigue levels were noted between conditions, although participants reported greater discomfort during stimulation. While mood and sleepiness changed with time-on-task, reflecting fatigue, these were largely similar across conditions. HRV increased under anodal tDCS and control, and plateaued under sham tDCS. We found that short duration anodal tDCS at 1 mA was an effective countermeasure to time-on-task deficits during a visuospatial two-back task, with enhancement and preservation of WM capacity. However, these improvements were not available at a perceptual level. Therefore, wider investigations are necessary to determine “how” such solutions will be operationalized in the field, especially within human-centered systems.

Influences of age, mental workload, and flight experience on cognitive performance and prefrontal activity in private pilots: a fNIRS study

The effects of aging on cognitive performance must be better understood, especially to protect older individuals who are engaged in risky activities (e.g. aviation). Current literature on executive functions suggests that brain compensatory mechanisms may counter cognitive deterioration due to aging, at least up to certain task load levels. The present study assesses this hypothesis in private pilots engaged in two executive tasks from the standardized CANTAB battery, namely Spatial Working Memory (SWM) and  One Touch Stockings of Cambridge (OTS). Sixty-one pilots from three age groups (young, middle-aged, older) performed these two tasks from low to very high difficulty levels, beyond those reported in previous aging studies. A fNIRS headband measured changes in oxyhemoglobin (HbO2) in the prefrontal cortex. Results confirmed an overall effect of the difficulty level in the three age groups, with a decline in task performance and an increase in prefrontal HbO2 signal. Performance of older relative to younger pilots was impaired in both tasks, with the greatest impairment observed for the highest-load Spatial Working Memory task. Consistent with this behavioral deficit in older pilots, a plateau of prefrontal activity was observed at this highest-load level, suggesting that a ceiling in neural resources was reached. When behavioral performance was either equivalent between age groups or only slightly impaired in the older group, there were not any age-related differences in prefrontal activity. Finally, older pilots with extensive flying experience tend to show better preserved spatial working memory performance when compared to mildly-experienced of the same age group. The present findings are discussed in the frames of HAROLD and CRUNCH theoretical models of cognitive and neural aging, evoking the possibility that piloting expertise may contribute to preserve executive functions throughout adulthood.

Effects of backpack weight on the performance of basic short-term/working memory tasks during flat-surface standing

This study empirically investigated the effects of backpack weight on the performance of three basic short-term/working memory (STM/WM) tasks during flat-surface standing. Four levels of backpack weight were considered: 0, 15, 25 and 40% of the body weight. The three STM/WM tasks were the Corsi block, digit span and 3-back tasks, corresponding to the visuo-spatial sketchpad, phonological loop and central executive of WM, respectively. Thirty participants conducted the STM/WM tasks while standing with loaded backpack. Major study findings were that (1) increased backpack weight adversely affected the scores of all three STM/WM tasks; and, (2) the adverse effect of backpack weight was less pronounced for the phonological loop STM task than the other STM/WM tasks. The study findings may help understand and predict the impacts of body-worn equipment weight on the worker's mental task performance for various work activities requiring simultaneous performance of mental and physical tasks. Practitioner summary: The current study empirically examined the effects of backpack weight on the performance of three basic STM/WM tasks. The study findings entail that reduces the weight of body-worn equipment can positively impact the worker's mental task performance in addition to reducing the worker's bodily stresses. Abbreviations: ACC: anterior cingulate cortex; AP: anterior-posterior; BW: body weight; CoP: centre of pressure; C-S: central executive working memory task and standing; DLPFC: dorsolateral prefrontal cortex; HIP: human information processing; ML: medio-lateral; PMC: premotor cortex; P-S: phonological loop short-term memory task and standing; SMA: supplementary motor area; STM: short-term memory; VLPFC: ventrolateral prefrontal cortex; V-S: visuo-spatial short-term memory task and standing; WM: working memory.

In silico vs. Over the Clouds: On-the-Fly Mental State Estimation of Aircraft Pilots, Using a Functional Near Infrared Spectroscopy Based Passive-BCI

There is growing interest for implementing tools to monitor cognitive performance in naturalistic work and everyday life settings. The emerging field of research, known as neuroergonomics, promotes the use of wearable and portable brain monitoring sensors such as functional near infrared spectroscopy (fNIRS) to investigate cortical activity in a variety of human tasks out of the laboratory. The objective of this study was to implement an on-line passive fNIRS-based brain computer interface to discriminate two levels of working memory load during highly ecological aircraft piloting tasks. Twenty eight recruited pilots were equally split into two groups (flight simulator vs. real aircraft). In both cases, identical approaches and experimental stimuli were used (serial memorization task, consisting in repeating series of pre-recorded air traffic control instructions, easy vs. hard). The results show pilots in the real flight condition committed more errors and had higher anterior prefrontal cortex activation than pilots in the simulator, when completing cognitively demanding tasks. Nevertheless, evaluation of single trial working memory load classification showed high accuracy (>76%) across both experimental conditions. The contributions here are two-fold. First, we demonstrate the feasibility of passively monitoring cognitive load in a realistic and complex situation (live piloting of an aircraft). In addition, the differences in performance and brain activity between the two experimental conditions underscore the need for ecologically-valid investigations.

Debiasing visual pilots' weather-related decision making

Pilots who decide to continue a flight into deteriorating weather conditions, rather than turn back or divert, are a significant cause of fatal crashes in general aviation. Earlier research has suggested that cognitive biases such as the anchoring effect and confirmation bias are implicated in many decisions to continue into worsening weather. In this study, we explored whether a simple debiasing technique, 'considering the alternative', reduced the effect of these two potentially fatal biases. Despite the study being adequately powered, our attempts to reduce the effects of biases were both unsuccessful. Negative findings such as these are particularly useful in aviation, as they can provide information on what does not work in this high stakes industry, even though such strategies may work elsewhere.

Mental workload and neural efficiency quantified in the prefrontal cortex using fNIRS

An improved understanding of how the brain allocates mental resources as a function of task difficulty is critical for enhancing human performance. Functional near infrared spectroscopy (fNIRS) is a field-deployable optical brain monitoring technology that provides a direct measure of cerebral blood flow in response to cognitive activity. We found that fNIRS was sensitive to variations in task difficulty in both real-life (flight simulator) and laboratory settings (tests measuring executive functions), showing increased concentration of oxygenated hemoglobin (HbO2) and decreased concentration of deoxygenated hemoglobin (HHb) in the prefrontal cortex as the tasks became more complex. Intensity of prefrontal activation (HbO2 concentration) was not clearly correlated to task performance. Rather, activation intensity shed insight on the level of mental effort, i.e., how hard an individual was working to accomplish a task. When combined with performance, fNIRS provided an estimate of the participants' neural efficiency, and this efficiency was consistent across levels of difficulty of the same task. Overall, our data support the suitability of fNIRS to assess the mental effort related to human operations and represents a promising tool for the measurement of neural efficiency in other contexts such as training programs or the clinical setting.

Neural and psychophysiological correlates of human performance under stress and high mental workload

In our anxiogenic and stressful world, the maintenance of an optimal cognitive performance is a constant challenge. It is particularly true in complex working environments (e.g. flight deck, air traffic control tower), where individuals have sometimes to cope with a high mental workload and stressful situations. Several models (i.e. processing efficiency theory, cognitive-energetical framework) have attempted to provide a conceptual basis on how human performance is modulated by high workload and stress/anxiety. These models predict that stress can reduce human cognitive efficiency, even in the absence of a visible impact on the task performance. Performance may be protected under stress thanks to compensatory effort, but only at the expense of a cognitive cost. Yet, the psychophysiological cost of this regulation remains unclear. We designed two experiments involving pupil diameter, cardiovascular and prefrontal oxygenation measurements. Participants performed the Toulouse N-back Task that intensively engaged both working memory and mental calculation processes under the threat (or not) of unpredictable aversive sounds. The results revealed that higher task difficulty (higher n level) degraded the performance and induced an increased tonic pupil diameter, heart rate and activity in the lateral prefrontal cortex, and a decreased phasic pupil response and heart rate variability. Importantly, the condition of stress did not impact the performance, but at the expense of a psychophysiological cost as demonstrated by lower phasic pupil response, and greater heart rate and prefrontal activity. Prefrontal cortex seems to be a central region for mitigating the influence of stress because it subserves crucial functions (e.g. inhibition, working memory) that can promote the engagement of coping strategies. Overall, findings confirmed the psychophysiological cost of both mental effort and stress. Stress likely triggered increased motivation and the recruitment of additional cognitive resources that minimize its aversive effects on task performance (effectiveness), but these compensatory efforts consumed resources that caused a loss of cognitive efficiency (ratio between performance effectiveness and mental effort).

High Working Memory Load Impairs Language Processing during a Simulated Piloting Task: An ERP and Pupillometry Study

Given the important amount of visual and auditory linguistic information that pilots have to process, operating an aircraft generates a high working-memory load (WML). In this context, the ability to focus attention on relevant information and to remain responsive to concurrent stimuli might be altered. Consequently, understanding the effects of WML on the processing of both linguistic targets and distractors is of particular interest in the study of pilot performance. In the present work, participants performed a simplified piloting task in which they had to follow one of three colored aircraft, according to specific written instructions (i.e., the written word for the color corresponding to the color of one of the aircraft) and to ignore either congruent or incongruent concurrent auditory distractors (i.e., a spoken name of color). The WML was manipulated with an n-back sub-task. Participants were instructed to apply the current written instruction in the low WML condition, and the 2-back written instruction in the high WML condition. Electrophysiological results revealed a major effect of WML at behavioral (i.e., decline of piloting performance), electrophysiological, and autonomic levels (i.e., greater pupil diameter). Increased WML consumed resources that could not be allocated to the processing of the linguistic stimuli, as indexed by lower P300/P600 amplitudes. Also, significantly, lower P600 responses were measured in incongruent vs. congruent trials in the low WML condition, showing a higher difficulty reorienting attention toward the written instruction, but this effect was canceled in the high WML condition. This suppression of interference in the high load condition is in line with the engagement/distraction trade-off model. We propose that P300/P600 components could be reliable indicators of WML and that they allow an estimation of its impact on the processing of linguistic stimuli.

Transcranial Direct Current Stimulation Modulates Neuronal Activity and Learning in Pilot Training

Skill acquisition requires distributed learning both within (online) and across (offline) days to consolidate experiences into newly learned abilities. In particular, piloting an aircraft requires skills developed from extensive training and practice. Here, we tested the hypothesis that transcranial direct current stimulation (tDCS) can modulate neuronal function to improve skill learning and performance during flight simulator training of aircraft landing procedures. Thirty-two right-handed participants consented to participate in four consecutive daily sessions of flight simulation training and received sham or anodal high-definition-tDCS to the right dorsolateral prefrontal cortex (DLPFC) or left motor cortex (M1) in a randomized, double-blind experiment. Continuous electroencephalography (EEG) and functional near infrared spectroscopy (fNIRS) were collected during flight simulation, n-back working memory, and resting-state assessments. tDCS of the right DLPFC increased midline-frontal theta-band activity in flight and n-back working memory training, confirming tDCS-related modulation of brain processes involved in executive function. This modulation corresponded to a significantly different online and offline learning rates for working memory accuracy and decreased inter-subject behavioral variability in flight and n-back tasks in the DLPFC stimulation group. Additionally, tDCS of left M1 increased parietal alpha power during flight tasks and tDCS to the right DLPFC increased midline frontal theta-band power during n-back and flight tasks. These results demonstrate a modulation of group variance in skill acquisition through an increasing in learned skill consistency in cognitive and real-world tasks with tDCS. Further, tDCS performance improvements corresponded to changes in electrophysiological and blood-oxygenation activity of the DLPFC and motor cortices, providing a stronger link between modulated neuronal function and behavior.

Processing Functional Near Infrared Spectroscopy Signal with a Kalman Filter to Assess Working Memory during Simulated Flight

Working memory (WM) is a key executive function for operating aircraft, especially when pilots have to recall series of air traffic control instructions. There is a need to implement tools to monitor WM as its limitation may jeopardize flight safety. An innovative way to address this issue is to adopt a Neuroergonomics approach that merges knowledge and methods from Human Factors, System Engineering, and Neuroscience. A challenge of great importance for Neuroergonomics is to implement efficient brain imaging techniques to measure the brain at work and to design Brain Computer Interfaces (BCI). We used functional near infrared spectroscopy as it has been already successfully tested to measure WM capacity in complex environment with air traffic controllers (ATC), pilots, or unmanned vehicle operators. However, the extraction of relevant features from the raw signal in ecological environment is still a critical issue due to the complexity of implementing real-time signal processing techniques without a priori knowledge. We proposed to implement the Kalman filtering approach, a signal processing technique that is efficient when the dynamics of the signal can be modeled. We based our approach on the Boynton model of hemodynamic response. We conducted a first experiment with nine participants involving a basic WM task to estimate the noise covariances of the Kalman filter. We then conducted a more ecological experiment in our flight simulator with 18 pilots who interacted with ATC instructions (two levels of difficulty). The data was processed with the same Kalman filter settings implemented in the first experiment. This filter was benchmarked with a classical pass-band IIR filter and a Moving Average Convergence Divergence (MACD) filter. Statistical analysis revealed that the Kalman filter was the most efficient to separate the two levels of load, by increasing the observed effect size in prefrontal areas involved in WM. In addition, the use of a Kalman filter increased the performance of the classification of WM levels based on brain signal. The results suggest that Kalman filter is a suitable approach for real-time improvement of near infrared spectroscopy signal in ecological situations and the development of BCI.

Real-time state estimation in a flight simulator using fNIRS

Working memory is a key executive function for flying an aircraft. This function is particularly critical when pilots have to recall series of air traffic control instructions. However, working memory limitations may jeopardize flight safety. Since the functional near-infrared spectroscopy (fNIRS) method seems promising for assessing working memory load, our objective is to implement an on-line fNIRS-based inference system that integrates two complementary estimators. The first estimator is a real-time state estimation MACD-based algorithm dedicated to identifying the pilot's instantaneous mental state (not-on-task vs. on-task). It does not require a calibration process to perform its estimation. The second estimator is an on-line SVM-based classifier that is able to discriminate task difficulty (low working memory load vs. high working memory load). These two estimators were tested with 19 pilots who were placed in a realistic flight simulator and were asked to recall air traffic control instructions. We found that the estimated pilot's mental state matched significantly better than chance with the pilot's real state (62% global accuracy, 58% specificity, and 72% sensitivity). The second estimator, dedicated to assessing single trial working memory loads, led to 80% classification accuracy, 72% specificity, and 89% sensitivity. These two estimators establish reusable blocks for further fNIRS-based passive brain computer interface development.