Weatherwise: evaluation of a cue-based training approach for the recognition of deteriorating weather conditions during flight

The roles of phishing knowledge, cue utilization, and decision styles in phishing email detection

This study investigated the roles of phishing knowledge, cue utilization, and decision styles in contributing to phishing email detection. Participants (N = 145) completed an online email sorting task, and measures of phishing knowledge, email decision styles, cue utilization, and email security awareness. Cue utilization was the only factor that uniquely predicted the capacity to discriminate phishing from genuine emails. Phishing knowledge was associated with greater phishing detection and a bias towards classifying all emails as phishing. A preference for intuitive decision making predicted lower detection of phishing emails, driven by a greater tendency to classify emails as genuine. These findings support the proposition that cue utilization is a distinct cognitive process that enables expert performance. The outcomes indicate that, in addition to increasing phishing knowledge and developing safe behavioral patterns, anti-phishing training needs to provide opportunities for trainees to develop meaningful cue associations.

Effects of distance flown on pilot decision making in continued flight into deteriorating weather conditions

INTRODUCTION

Continuing flight into adverse weather remains a significant problem in general aviation (GA) safety. A variety of experiential, cognitive, and motivational factors have been suggested as explanations. Previous research has shown that adverse weather accidents occur further into planned flights than other types of accident, suggesting that previous investment of time and effort might be a contributing factor. The aim of this study was to experimentally determine the effect of prior commitment on general aviation pilots' decision-making and risk-taking in simulated VFR flights.

METHOD

Thirty-six licensed pilots 'flew' two simulated flights designed to simulate an encounter with deteriorating coastal weather and a developing extensive cloud base underneath the aircraft as it crossed a mountain range. After making a decision to continue or discontinue the flight, pilots completed a range of risk perception, risk taking, and situational awareness measures.

RESULTS

Visual flight rules were violated in 42% of the flights. Prior commitment, in terms of distance already flown, led to an increased tendency to continue the flight into adverse weather in the coastal 'scud running' scenario. Continuing pilots perceived the risks differently and showed greater risk tolerance than others. These 'bolder' pilots also tended to be more active and better qualified than the others.

CONCLUSIONS

There are undoubtedly multiple factors underlying any individual decision to continue or discontinue a flight. The willingness to tolerate a higher level of risk seems to be one such factor. This willingness can increase with time invested in the flight and also seems to be related to individual flight qualifications and experience.

PRACTICAL APPLICATIONS

All pilots might benefit from carefully structured simulator sessions designed to safely teach practical risk management strategies with clear and immediate feedback.

Cue utilisation is partially related to performance on an urban operations course but not experience

INTRODUCTION

Decision making in use of force relies on accurate cue identification to inform appropriate response. This research was designed to test the relationship between cue utilisation and performance prior to, and following participation in an urban operations course (UOC).

METHODS

A total of 37 participants were assessed on cue utilisation measures, course outcome and between group changes following course participation.

RESULTS

A significant main effect was evident for Cue utilisation and administration, (p = 0.005), but not training group, (p = 0.54), nor between groups and point of administration, (p = 0.410). No main effect was evident between groups and training outcome, (p = 0.11). However, there was a main effect for point of administration, (p = 0.02) and training outcome and point of administration (p = 0.02).

CONCLUSION

Although cue utilisation is an essential component of perception-action tasks, cues may be more specific to the relevant training environment with limited transfer to the operational context.

Use of flight tracking data to inform safety deficiencies for general aviation cross-country operations in challenging flying environments

BACKGROUND

Air carriers, but not general aviation, have long employed in-flight data to identify risks/implement corrective measures for improved safety. Herein, using in-flight data, aircraft (in non-instrument-rated private pilots (PPLs) ownership) operations in two potentially hazardous environments (mountains, degraded visibility) were researched for safety practice deficiencies. Four questions were posed, the first two related to mountainous terrain operations: were aircraft (a) flown with hazardous ridge-level winds, (b) within gliding distance of level terrain? Regarding degraded visibility, did aviators (c) depart with low cloud ceilings (≤3,000 ft.), (d) fly at night away from urban lighting?

METHODS

The study cohort comprised: (a) single engine aircraft in sole PPL proprietorship (b) registered in Automatic Dependent Surveillance-Broadcast (ADS-B-Out) equipage-required locations prone to low cloud ceilings in three mountainous states. ADS-B-Out data for cross-country flights (>200 nm) were collected.

RESULTS

250 flights (50 airplanes) were tracked (spring/summer 2021). For aircraft transiting areas subject to mountain winds influences, 65% completed one/multiple flights with potentially hazardous ridge-level winds. Two thirds of airplanes traversing mountainous topography would have, for at least one flight, been unable to glide to level terrain with a powerplant failure. Encouragingly, flight departures for 82% of the aircraft were with >3,000 ft. cloud ceilings. Likewise, flights for >86% of the study cohort were undertaken during daylight. Employing a risk scale, operations for 68% of the study cohort did not exceed low-risk (i.e., ≤1 unsafe practice) and high-risk flight(s) (three concurrent unsafe practices) were rare (4% of airplanes). In log-linear analysis, no interactions were evident between the four unsafe practices (p = 0.602).

DISCUSSION

Hazardous winds and inadequate engine failure planning were identified as safety deficiencies for general aviation mountain operations.

PRACTICAL APPLICATION

This study advocates for the expanded use of ADS-B-Out in-flight data to inform safety deficiencies/implement corrective measures toward improving general aviation safety.

The Role of Cue-Based Strategies in Skilled Diagnosis Among Pathologists

OBJECTIVE

This research was designed to test whether behavioral indicators of pathology-related cue utilization were associated with performance on a diagnostic task.

BACKGROUND

Across many domains, including pathology, successful diagnosis depends on pattern recognition that is supported by associations in memory in the form of cues. Previous studies have focused on the specific information or knowledge on which medical image expertise relies. The target in this study is the more general ability to identify and interpret relevant information.

METHOD

Data were collected from 54 histopathologists in both conference and online settings. The participants completed a pathology edition of the Expert Intensive Skills Evaluation 2.0 (EXPERTise 2.0) to establish behavioral indicators of context-related cue utilization. They also completed a separate diagnostic task designed to examine related diagnostic skills.

RESULTS

Behavioral indicators of higher or lower cue utilization were based on the participants' performance across five tasks. Accounting for the number of cases reported per year, higher cue utilization was associated with greater accuracy on the diagnostic task. A post hoc analysis suggested that higher cue utilization may be associated with a greater capacity to recognize low prevalence cases.

CONCLUSION

This study provides support for the role of cue utilization in the development and maintenance of skilled diagnosis amongst pathologists.

APPLICATION

Pathologist training needs to be structured to ensure that learners have the opportunity to form cue-based strategies and associations in memory, especially for less commonly seen diseases.

Explaining emergency physicians' capacity to recover from interruptions

OBJECTIVE

To assess whether the capacity to utilize cues amongst emergency physicians is associated with differences in the capacity to recover performance following an interruption.

BACKGROUND

Interruptions are implicated in errors in emergency medicine due to the cognitive load that they impose on working memory, resulting in a loss of performance on the primary task. The utilization of cues is associated with a reduction in cognitive load during the performance of a task, thereby enabling the allocation of residual resources that mitigates the loss of performance following interruptions.

METHOD

Thirty-nine emergency physicians, recruited at a medical conference, completed an assessment of cue utilization (EXPERTise 2.0) and an online simulation (Septris) that involved the management of patients presenting with sepsis. During the simulation, physicians were interrupted and asked to check a medication order. Task performance was assessed using scores on Septris, with points awarded for the accurate management of patients.

RESULTS

Emergency physicians with higher cue utilization recorded significantly higher scores on the simulation task following the interruption, compared to physicians with lower cue utilization (p = .028).

CONCLUSION

The results confirm a relationship between cue utilization and the recovery of performance following an interruption. This is likely due to the advantages afforded by associated reductions in cognitive load.

APPLICATION

Assessments of cue utilization may assist in the development of interventions to support clinicians in interruptive environments.

Cue utilisation reduces the impact of response bias in histopathology

Histopathologists make diagnostic decisions that are thought to be based on pattern recognition, likely informed by cue-based associations formed in memory, a process known as cue utilisation. Typically, the cases presented to the histopathologist have already been classified as 'abnormal' by clinical examination and/or other diagnostic tests. This results in a high disease prevalence, the potential for 'abnormality priming', and a response bias leading to false positives on normal cases. This study investigated whether higher cue utilisation is associated with a reduction in positive response bias in the diagnostic decisions of histopathologists. Data were collected from eighty-two histopathologists who completed a series of demographic and experience-related questions and the histopathology edition of the Expert Intensive Skills Evaluation 2.0 (EXPERTise 2.0) to establish behavioural indicators of context-related cue utilisation. They also completed a separate, diagnostic task comprising breast histopathology images where the frequency of abnormality was manipulated to create a high disease prevalence context for diagnostic decisions relating to normal tissue. Participants were assigned to higher or lower cue utilisation groups based on their performance on EXPERTise 2.0. When the effects of experience were controlled, higher cue utilisation was specifically associated with a greater accuracy classifying normal images, recording a lower positive response bias. This study suggests that cue utilisation may play a protective role against response biases in histopathology settings.

Differentiating Experience From Cue Utilization in Radiological Assessments

OBJECTIVE

This research was designed to examine the contribution of self-reported experience and cue utilization to diagnostic accuracy in the context of radiology.

BACKGROUND

Within radiology, it is unclear how task-related experience contributes to the acquisition of associations between features with events in memory, or cues, and how they contribute to diagnostic performance.

METHOD

Data were collected from 18 trainees and 41 radiologists. The participants completed a radiology edition of the established cue utilization assessment tool EXPERTise 2.0, which provides a measure of cue utilization based on performance on a number of domain-specific tasks. The participants also completed a separate image interpretation task as an independent measure of diagnostic performance.

RESULTS

Consistent with previous research, a k-means cluster analysis using the data from EXPERTise 2.0 delineated two groups, the pattern of centroids of which reflected higher and lower cue utilization. Controlling for years of experience, participants with higher cue utilization were more accurate on the image interpretation task compared to participants who demonstrated relatively lower cue utilization (p = .01).

CONCLUSION

This study provides support for the role of cue utilization in assessments of radiology images among qualified radiologists. Importantly, it also demonstrates that cue utilization and self-reported years of experience as a radiologist make independent contributions to performance on the radiological diagnostic task.

APPLICATION

Task-related experience, including training, needs to be structured to ensure that learners have the opportunity to acquire feature-event relationships and internalize these associations in the form of cues in memory.

A comparison of general aviation accidents involving airline pilots and instrument-rated private pilots

INTRODUCTION

The extremely low accident rate for U.S air carriers relative to that of general aviation (∼1 and ∼60/million flight hours respectively) partly reflects advanced airman certification, more demanding recurrency training and stringent operational regulations. However, whether such skillset/training/regulations translate into improved safety for airline pilots operating in the general aviation environment is unknown and the aim of this study.

METHODS

Accidents (1998-2017) involving airline pilots and instrument-rated private pilots (PPL-IFR) operating non-revenue light aircraft were identified from the NTSB accident database. An online survey informed general aviation flight exposure for both pilot cohorts. Statistics used proportion testing and Mann-Whitney U tests.

RESULTS

In degraded visibility, 0 and 40% (χ²p = 0.043) of fatal accidents involving airline and PPL-IFR airmen were due to in-flight loss-of-control, respectively. For landing accidents, airline pilots were under-represented for mishaps related to airspeed mismanagement (p = 0.036) relative to PPL-IFR but showed a dis-proportionate count (2X) of ground loss-of-directional control accidents (p = 0.009) the latter likely reflecting a preference for tail-wheel aircraft. The proportion of FAA rule violation-related mishaps by airline pilots was >2X (7 vs. 3%) that for PPL-IFR airmen. Moreover, airline pilots showed a disproportionate (χ²p = 0.021) count of flights below legal minimum altitudes. Not performing an official preflight weather briefing or intentionally operating in instrument conditions without an IFR flight plan represented 43% of airline pilot accidents involving FAA rule infractions.

CONCLUSIONS

These findings inform safety deficiencies for: (a) airline pilots, landing/ground operations in tail-wheel aircraft and lack of 14CFR 91 familiarization regulations regarding minimum operating altitudes and (b) PPL-IFR airmen in-flight loss-of-control and poor landing speed management. Practical Applications: For PPL-IFR airmen, training/recurrency should focus on unusual attitude recovery and managing approach speeds. Airline pilots should seek additional instructional time regarding landing tail-wheel aircraft and become familiar with 14CFR 91 rules covering minimum altitudes.

The Role of Cue Utilization and Cognitive Load in the Recognition of Phishing Emails

Phishing emails represent a major threat to online information security. While the prevailing research is focused on users' susceptibility, few studies have considered the decision-making strategies that account for skilled detection. One relevant facet of decision-making is cue utilization, where users retrieve feature-event associations stored in long-term memory. High degrees of cue utilization help reduce the demands placed on working memory (i.e., cognitive load), and invariably improve decision performance (i.e., the information-reduction hypothesis in expert performance). The current study explored the effect of cue utilization and cognitive load when detecting phishing emails. A total of 50 undergraduate students completed: (1) a rail control task; (2) a phishing detection task; and (3) a survey of the cues used in detection. A cue utilization assessment battery (EXPERTise 2.0) then classified participants with either higher or lower cue utilization. As expected, higher cue utilization was associated with a greater likelihood of detecting phishing emails. However, variation in cognitive load had no effect on phishing detection, nor was there an interaction between cue utilization and cognitive load. Further, the findings revealed no significant difference in the types of cues used across cue utilization groups or performance levels. These findings have implications for our understanding of cognitive mechanisms that underpin the detection of phishing emails and the role of factors beyond the information-reduction hypothesis.

Cue utilisation predicts control room operators' performance in a sustained visual search task

This research was designed to determine whether qualified practitioners' cue utilisation is predictive of their performance during a sustained visual search task in an operational context. Australian Distribution Network Service Provider (DNSP) operators were recruited for two experiments, and were classified with either higher or lower cue utilisation based on an assessment of cue utilisation within the context of power distribution. Operators' performance was assessed using a domain-related sustained visual search task. In both experiments, power distribution operators with higher cue utilisation demonstrated shorter mean response latencies during the sustained visual search task, compared to operators with lower cue utilisation. Further, no differences in accuracy based on cue utilisation were observed during the sustained visual search task. The results are consistent with the proposition that power operators with higher cue utilisation have a greater capacity to sustain visual search during domain-related tasks, compared to operators with lower cue utilisation. Practitioner summary: Power distribution system operators' cue utilisation was used to predict performance during a domain-related sustained visual search task. Power distribution operators with higher cue utilisation demonstrated shorter mean response latencies during the sustained visual search task, but no differences in accuracy, compared to operators with lower cue utilisation. Abbreviations: DNSP: distribution network service provider; EXPERTise 2.0: EXPERT intensive skills evaluation; FAT: feature association task; FDT: feature discrimination task; FIT: feature identification task; fNIRS: functional near infrared spectroscopy; FPT: feature prioritisation task; FRT: feature recognition task; SCADA: supervisory control and data acquisition.

Higher social cue utilisation improves communication, reduces perceived workload, and improves performance amongst ad hoc dyads in simulated rail control

The objective was to examine whether ad hoc dyads with different collective social cue utilisation would record differences in performance and perceptions of workload during a simulated rail control task that incorporated distinct levels of demand. The frequency of two types of communicative statements was also examined as mediating factors: closing the loop and informative responding. A quasi-experimental design was employed using 40 dyadic teams. The results indicated that ad hoc teams whose members comprised higher social cue utilisation recorded relatively faster response times and perceived lower levels of workload, and engaged in a greater frequency of communicative statements that involved 'closing the loop' and 'informative responses'. Social cue utilisation also exerted an indirect effect on perceived workload through informative responding. The outcomes have theoretical implications for models of ad hoc team performance, and practical implications for the selection and training of teams that operate on an ad hoc basis. Practitioner summary: This study indicates that, in the context of simulation tasks requiring teamwork, higher social cue utilisation amongst ad hoc team members is associated with communication, workload perception, and overall performance.

Nurses' cognitive and perceptual bias in the identification of clinical deterioration cues

BACKGROUND

Perception and processing of clinical cues have rarely been investigated in the nursing literature despite their relevance to the early identification and management of clinical deterioration.

AIM

This study used a hypovolemic shock scenario from the Feedback Incorporating Review and Simulation Techniques to Act on Clinical Trends (FIRST2ACT) virtual simulation program, equipped with an eye tracker, to investigate cue processing during the management of patient deterioration.

RESULT

The study revealed that attention deviation distorted interpretation of subsequent cues, causing 63% of participants to exhibit a cognitive bias (heightened sensitivity to specific but noncritical cues) and 65% to exhibit at least one episode of nonfixation on clinically relevant cues. Attention deviation and distorted interpretations of clinical cues will have an impact on patient safety.

CONCLUSION

The findings are likely to have important implications for understanding error and associated training implications.

Occupant injury and fatality in general aviation aircraft for which dynamic crash testing is certification-mandated

Towards further improving general aviation aircraft crashworthiness, multi-axis dynamic tests have been required for aircraft certification (14CFR23.562) since 1985. The objective of this study was to determine if occupants in aircraft certified to these higher crashworthiness standards show a mitigated fraction of fatal accidents and/or injury severity. The NTSB aviation database was queried for accidents occurring between 2002 and 2012 involving aircraft certified to, or immune from, dynamic crash testing and manufactured after 1999. Only operations conducted under 14CFR Part 91 were considered. Statistical analysis employed proportion tests and logistic regression. Off-airport landings are associated with high decelerative forces; however for off-airport landings, the fraction of fatal accidents for aircraft subject to, or exempt from, dynamic crash testing was similar (0.53 and 0.60, respectively). Unexpectedly, for on-airport landings a higher fraction of fatalities was evident for aircraft whose certification mandated dynamic crash testing. Improved crashworthiness standards would be expected to translate into a reduced severity of accident injuries. For all accidents, as well as for those deemed survivable, the fraction of minor and serious injuries was reduced for occupants in aircraft certified to the higher crashworthiness standards. Surprisingly, the fraction of occupants fatally injured was not decreased for aircraft subject to dynamic crash tests. To shed light on this unexpected finding flight history, airman demographics and post-impact fires for aircraft for which dynamic crash testing is mandatory or exempt was examined. For the former cohort the median distance of the accident flight was nearly 44% higher. Aircraft subject to dynamic crash testing were also involved in a greater fraction (0.25 versus 0.12, respectively) of post-impact fires. Our data suggest that while the more stringent crashworthiness standards have mitigated minor and serious injuries, surprisingly the fraction of occupants fatally injured is unaltered. The unchanged fraction of fatal injuries may reflect partly (a) fatigue associated with longer flight distances and (b) a greater proportion of post-impact fires.

Measuring Diagnostic Skills through the Utilization of Cues

The aim of this paper is to outline a theoretical and empirical case for the role of cue utilization in the cognitive process of diagnosis. Drawing on theories of skill acquisition, the case is made that the utilization of cues represents a critical precursor to the progression toward expertise but that the acquisition and utilization of cues is dependent upon a repertoire of cases and exemplars that have been acquired during the progression from novice to competence. Cases and exemplars form the basis of a mental model from which cues, in the form or feature-event or feature-object relationships, can be identified and retained in memory. The implications of a more sophisticated understanding of the role of cue utilization in skill acquisition will provide the foundation for more effective and more efficient industrial training systems in the future.

Expert and competent non-expert visual cues during simulated diagnosis in intensive care

The aim of this study was to examine the information acquisition strategies of expert and competent non-expert intensive care physicians during two simulated diagnostic scenarios involving respiratory distress in an infant. Specifically, the information acquisition performance of six experts and 12 competent non-experts was examined using an eye-tracker during the initial 90 s of the assessment of the patient. The results indicated that, in comparison to competent non-experts, experts recorded longer mean fixations, irrespective of the scenario. When the dwell times were examined against specific areas of interest, the results revealed that competent non-experts recorded greater overall dwell times on the nurse, where experts recorded relatively greater dwell times on the head and face of the manikin. In the context of the scenarios, experts recorded differential dwell times, spending relatively more time on the head and face during the seizure scenario than during the coughing scenario. The differences evident between experts and competent non-experts were interpreted as evidence of the relative availability of task-specific cues or heuristics in memory that might direct the process of information acquisition amongst expert physicians. The implications are discussed for the training and assessment of diagnostic skills.

Trait-based cue Utilization and initial skill acquisition: implications for models of the progression to expertise

The primary aim of this study was to examine the role of cue utilization in the initial acquisition of psycho-motor skills. Two experiments were undertaken, the first of which examined the relationship between cue utilization typologies and levels of accuracy following four simulated, power-off landing trials in a light aircraft simulator. The results indicated that higher levels of cue utilization were associated with a greater level of landing accuracy following training exposure. In the second study, participants' levels of cue utilization were assessed prior to two 15 min periods during which they practiced take-offs and landings using a simulated unmanned aerial vehicle (UAV). Consistent with Study 1, the outcomes of Study 2 revealed a statistically significant relationship among levels of cue utilization and the number of trials to criterion on the take-off task, and the proportion of successful trials during both take-off and landing. In combination, the results suggest that the capacity for the acquisition and the subsequent utilization of cues is an important predictor of skill acquisition, particularly during the initial stages of the process. The implications for theory and applied practice are discussed.

The application of reduced-processing decision support systems to facilitate the acquisition of decision-making skills

OBJECTIVE

The study was designed to examine whether the availability of reduced-processing decision support system interfaces could improve the decision making of inexperienced personnel in the context of

BACKGROUND

Although research into reduced-processing decision support systems has demonstrated benefits in minimizing cognitive load, these benefits have not typically translated into direct improvements in decision accuracy because of the tendency for inexperienced personnel to focus on less-critical information. The authors investigated whether reduced-processing interfaces that direct users' attention toward the most critical cues for decision making can produce improvements in decision-making performance.

METHOD

Novice participants made incident command-related decisions in experimental conditions that differed according to the amount of information that was available within the interface, the level of control that they could exert over the presentation of information, and whether they had received decision training.

RESULTS

The results revealed that despite receiving training, participants improved in decision accuracy only when they were provided with an interface that restricted information access to the most critical cues.

CONCLUSION

It was concluded that an interface that restricts information access to only the most critical cues in the scenario can facilitate improvements in decision performance.

APPLICATION

Decision support system interfaces that encourage the processing of the most critical cues have the potential to improve the accuracy and timeliness of decisions made by inexperienced personnel.

The capability of static and dynamic features to distinguish competent from genuinely expert practitioners in pediatric diagnosis

OBJECTIVE

The authors describe the development of a new, more objective method of distinguishing experienced competent nonexpert from expert practitioners within pediatric intensive care.

BACKGROUND

Expert performance involves the acquisition and use of refined feature-event associations (cues) in the operational environment. Competent non-experts, although experienced, possess rudimentary cue associations in memory. Thus, they cannot respond as efficiently or as reliably as their expert counterparts, particularly when key diagnostic information is unavailable, such as that provided by dynamic cues.

METHOD

This study involved the application of four distinct tasks in which the use of relevant cues could be expected to increase both the accuracy and the efficiency of diagnostic performance. These tasks included both static and dynamic stimuli that were varied systematically. A total of 50 experienced pediatric intensive staff took part in the study.

RESULTS

The sample clustered into two levels across the tasks: Participants who performed at a consistently high level throughout the four tasks were labeled experts, and participants who performed at a lower level throughout the tasks were labeled competent nonexperts. The groups differed in their responses to the diagnostic scenarios presented in two of the tasks and their ability to maintain performance in the absence of dynamic features.

CONCLUSION

Experienced pediatricians can be decomposed into two groups on the basis of their capacity to acquire and use cues; these groups differ in their diagnostic accuracy and in their ability to maintain performance in the absence of dynamic features.

APPLICATION

The tasks may be used to identify practitioners who are failing to acquire expertise at a rate consistent with their experience, position, or training. This information may be used to guide targeted training efforts.

Situational and personal characteristics associated with adverse weather encounters by pilots

Weather conditions are significant hazards impacting the safe and efficient operation of aircraft. In this study, a large number of pilots were surveyed regarding weather events, and the circumstances associated with those events. Pilots completed a web-based questionnaire containing demographic questions, a risk perception scale, a hazardous events scale, and a pilot judgment scale. The pilots who reported a flight in which they penetrated weather without authorization or were concerned about the weather also completed 53 questions regarding their weather encounter. Usable data were obtained for 364 participants: 144 who reported flying into weather, 114 who experienced a flight on which weather was a concern, and 106 who reported no flights on which weather was entered or was a major concern. Significant differences were evident between the three groups on the measures of pilot judgment, personal minimums, and hazardous events where pilots flying into weather recorded the poorest scores (least conservative minimums, most hazardous events, and poorest judgment). Significant differences were also noted between the two weather groups for a number of circumstances surrounding the events. Compared to the in-weather group, pilots in the near-weather group had acquired greater instrument hours, were older, and were more likely to have an instrument rating. Their aircraft were more likely to have an autopilot. More pilots in the in-weather group (28%) reported that they would be much more careful in the future regarding weather, compared to 17% of the near-weather group. The study provides data not previously obtained on both the situational and personal characteristics that are related to involvement in different degrees of weather-related encounters. These data should promote a better understanding of these individuals and the situations in which they are involved, and should inform future research and intervention efforts.

Cue Generation amongst Firefighters: Competent vs. Expert Differences

Empirical investigations of cognitive skill acquisition have generally focused on differences between novice and expert operators. The result is a neglect of the intermediate stage of skill acquisition in which operators progress through competence towards expert performance. This study investigated the qualitative and quantitative differences in the cognitive cues generated by competent and expert firefighters. Participants first read a written, firefighting-related decision scenario before listing the cues that they considered relevant in formulating a decision. The results revealed that experts generated significantly more cues than competent operators. Further, the types of cues generated by competent and expert operators differed, with experts reporting significantly more safety-related cues than competent operators. These outcomes suggest that differences exist between the cues that are employed by expert and competent operators during decision-making, and that these differences reflect a qualitative change in information processing that occurs during the transition from competence to expertise.

The role of expertise research and human factors in capturing, explaining, and producing superior performance

OBJECTIVES

The goal of this article is to identify some of the major trends and findings in expertise research and their connections to human factors.

BACKGROUND

Progress in the study of superior human performance has come from improved methods of measuring expertise and the development of better tools for revealing the mechanisms that support expert performance, such as protocol analysis and eye tracking.

METHODS

We review some of the challenges of capturing superior human performance in the laboratory and the means by which the expert performance approach may overcome such challenges. We then discuss applications of the expert performance approach to a handful of domains that have long been of interest to human factors researchers.

RESULTS

Experts depend heavily on domain-specific knowledge for superior performance, and such knowledge enables the expert to anticipate and prepare for future actions more efficiently. Training programs designed to focus learners' attention on task-related knowledge and skills critical to expert performance have shown promise in facilitating skill acquisition among nonexperts and in reducing errors by experts on representative tasks.

CONCLUSIONS

Although significant challenges remain, there is encouraging progress in domains such as sports, aviation, and medicine in understanding some of the mechanisms underlying human expertise and in structuring training and tools to improve skilled performance.

APPLICATIONS

Knowledge engineering techniques can capture expert knowledge and preserve it for organizations and for the development of expert systems. Understanding the mechanisms that underlie expert performance may provide insights into the structuring of better training programs for improvingskill and in designing systems to support professional expertise.

Improving pilots' risk assessment skills in low-flying operations: the role of feedback and experience

Risk assessment is one of the most important skills that pilots are expected to acquire to ensure the safe and successful management of flight. The traditional approach to the development of these skills requires pilots to directly engage with potentially hazardous events. Using low-flying as a context, the present study sought to test whether engagement with hazards in a simulated environment, together with feedback concerning performance, would improve pilots' risk assessment during a subsequent simulated test flight. The results indicated that engagement with the hazards, rather than the provision of feedback per se, was associated with behavior that reduced the risk to the aircraft, while maintaining operational performance. It was concluded that exposure to hazards within a simulated environment could provide the basis for the development of risk assessment skills amongst less experienced pilots.

Heuristic-based information acquisition and decision making among pilots

OBJECTIVE

This research was designed to examine the impact of heuristic-based approaches to the acquisition of task-related information on the selection of an optimal alternative during simulated in-flight decision making.

BACKGROUND

The work integrated features of naturalistic and normative decision making and strategies of information acquisition within a computer-based, decision support framework.

METHOD

The study comprised two phases, the first of which involved familiarizing pilots with three different heuristic-based strategies of information acquisition: frequency, elimination by aspects, and majority of confirming decisions. The second stage enabled participants to choose one of the three strategies of information acquisition to resolve a fourth (choice) scenario.

RESULTS

The results indicated that task-oriented experience, rather than the information acquisition strategies, predicted the selection of the optimal alternative. It was also evident that of the three strategies available, the elimination by aspects information acquisition strategy was preferred by most participants.

CONCLUSION

It was concluded that task-oriented experience, rather than the process of information acquisition, predicted task accuracy during the decision-making task. It was also concluded that pilots have a preference for one particular approach to information acquisition.

APPLICATION

Applications of outcomes of this research include the development of decision support systems that adapt to the information-processing capabilities and preferences of users.

Remembrance of cases past: who remembers what, when confronting critical flight events?

Recent "naturalistic" theories of decision making emphasize the role of stored prior experiences or cases as a guide to current action. However, there is little empirical evidence on the role that case-based remindings play in real-life decision making. The present study utilized a Web-based survey to collect data about the role of prior cases in pilot decision making about critical flight events. Results showed that more than half of the 1081 pilots who responded could provide details about utilizing a previous case in responding to a critical flight event. These events were most likely to involve weather or equipment failure. The cases were found to be useful in situational assessment rather than option evaluation. The use of cases increased with age and experience. Data obtained from a concurrent conventional survey showed broadly similar results. The implications of these results are that case-based remindings play an important role in expert pilot decision making and that a training system that incorporates case-based learning would be a potentially useful means of improving pilot decision making. Actual or potential applications of this research include the development of case-based training systems to enhance flight training.