Operator selection for human-automation teaming: The role of manual task skill in predicting automation failure intervention

Humans working in modern work systems are increasingly required to supervise task automation. We examined whether manual aircraft conflict detection skill predicted participants' ability to respond to conflict detection automation failures in simulated air traffic control. In a conflict discrimination task (to assess manual skill), participants determined whether pairs of aircraft were in conflict or not by judging their relative-arrival time at common intersection points. Then in a simulated air traffic control task, participants supervised automation which either partially or fully detected and resolved conflicts on their behalf. Automation supervision required participants to detect when automation may have failed and effectively intervene. When automation failed, participants who had better manual conflict detection skill were faster and more accurate to intervene. However, a substantial proportion of variance in failure intervention was not explained by manual conflict detection skill, potentially reflecting that future research should consider other cognitive skills underlying automation supervision.

Return-to-Manual Performance can be Predicted Before Automation Fails

OBJECTIVE

This study aimed to examine operator state variables (workload, fatigue, and trust in automation) that may predict return-to-manual (RTM) performance when automation fails in simulated air traffic control.

BACKGROUND

Prior research has largely focused on triggering adaptive automation based on reactive indicators of performance degradation or operator strain. A more direct and effective approach may be to proactively engage/disengage automation based on predicted operator RTM performance (conflict detection accuracy and response time), which requires analyses of within-person effects.

METHOD

Participants accepted and handed-off aircraft from their sector and were assisted by imperfect conflict detection/resolution automation. To avoid aircraft conflicts, participants were required to intervene when automation failed to detect a conflict. Participants periodically rated their workload, fatigue and trust in automation.

RESULTS

For participants with the same or higher average trust than the sample average, an increase in their trust (relative to their own average) slowed their subsequent RTM response time. For participants with lower average fatigue than the sample average, an increase in their fatigue (relative to own average) improved their subsequent RTM response time. There was no effect of workload on RTM performance.

CONCLUSIONS

RTM performance degraded as trust in automation increased relative to participants' own average, but only for individuals with average or high levels of trust.

APPLICATIONS

Study outcomes indicate a potential for future adaptive automation systems to detect vulnerable operator states in order to predict subsequent RTM performance decrements.

Prospective memory decision control: A computational model of context effects on prospective memory

Prospective memory (PM) tasks require remembering to perform a deferred action and can be associated with predictable contexts. We present a theory and computational model, prospective memory decision control (PMDC), of the cognitive processes by which context supports PM. Under control conditions, participants completed lexical decisions. Under PM conditions, participants had the additional PM task of responding to letter strings containing certain syllables. Stimuli were presented in one of two colors, with color potentially changing after each set of four trials. A pretrial colored fixation was presented before each set. Under control and PM standard conditions, fixation color was meaningless. Under PM context conditions, fixation color indicated whether a PM target could occur within the next set. We replicated prior findings of higher PM accuracy for context compared to standard conditions, and the expected variation in PM costs (slowed lexical decisions) as a function of context relevance. PMDC, which formalizes PM as a process of evidence accumulation among ongoing and PM task responses, accounted for the impact of context on PM costs and accuracy via proactive and reactive cognitive control. Increased ongoing task thresholds and decreased PM thresholds in relevant contexts indicated proactive control. With context provision, PM accumulation rates on PM trials increased, as did inhibition of accumulation to competing responses, indicating reactive control. Although an observed capacity-sharing effect explained some portion of PM costs, we found no evidence that participants redirected more capacity from the ongoing to the PM task when contextually cued to relevant contexts. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Automated decision aids: When are they advisors and when do they take control of human decision making?

We applied a computational model to examine the extent to which participants used an automated decision aid as an advisor, as compared to a more autonomous trigger of responding, at varying levels of decision aid reliability. In an air traffic control conflict detection task, we found higher accuracy when the decision aid was correct, and more errors when the decision aid was incorrect, as compared to a manual condition (no decision aid). Responses that were correct despite incorrect automated advice were slower than matched manual responses. Decision aids set at lower reliability (75%) had smaller effects on choices and response times, and were subjectively trusted less, than decision aids set at higher reliability (95%). We fitted an evidence accumulation model to choices and response times to measure how information processing was affected by decision aid inputs. Participants primarily treated low-reliability decision aids as an advisor rather than directly accumulating evidence based on its advice. Participants directly accumulated evidence based upon the advice of high-reliability decision aids, consistent with granting decision aids more autonomous influence over decisions. Individual differences in the level of direct accumulation correlated with subjective trust, suggesting a cognitive mechanism by which trust impacts human decisions. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Listening to Misinformation while Driving: Cognitive Load and the Effectiveness of (Repeated) Corrections

Corrected misinformation can continue to influence inferential reasoning. It has been suggested that such continued influence is partially driven by misinformation familiarity, and that corrections should therefore avoid repeating misinformation to avoid inadvertent strengthening of misconceptions. However, evidence for such familiarity-backfire effects is scarce. We tested whether familiarity backfire may occur if corrections are processed under cognitive load. Although misinformation repetition may boost familiarity, load may impede integration of the correction, reducing its effectiveness and therefore allowing a backfire effect to emerge. Participants listened to corrections that repeated misinformation while in a driving simulator. Misinformation familiarity was manipulated through the number of corrections. Load was manipulated through a math task administered selectively during correction encoding. Multiple corrections were more effective than a single correction; cognitive load reduced correction effectiveness, with a single correction entirely ineffective under load. This provides further evidence against familiarity-backfire effects and has implications for real-world debunking.

Transparent Automated Advice to Mitigate the Impact of Variation in Automation Reliability

OBJECTIVE

To examine the extent to which increased automation transparency can mitigate the potential negative effects of low and high automation reliability on disuse and misuse of automated advice, and perceived trust in automation.

BACKGROUND

Automated decision aids that vary in the reliability of their advice are increasingly used in workplaces. Low-reliability automation can increase disuse of automated advice, while high-reliability automation can increase misuse. These effects could be reduced if the rationale underlying automated advice is made more transparent.

METHODS

Participants selected the optimal UV to complete missions. The Recommender (automated decision aid) assisted participants by providing advice; however, it was not always reliable. Participants determined whether the Recommender provided accurate information and whether to accept or reject advice. The level of automation transparency (medium, high) and reliability (low: 65%, high: 90%) were manipulated between-subjects.

RESULTS

With high- compared to low-reliability automation, participants made more accurate (correctly accepted advice and identified whether information was accurate/inaccurate) and faster decisions, and reported increased trust in automation. Increased transparency led to more accurate and faster decisions, lower subjective workload, and higher usability ratings. It also eliminated the increased automation disuse associated with low-reliability automation. However, transparency did not mitigate the misuse associated with high-reliability automation.

CONCLUSION

Transparency protected against low-reliability automation disuse, but not against the increased misuse potentially associated with the reduced monitoring and verification of high-reliability automation.

APPLICATION

These outcomes can inform the design of transparent automation to improve human-automation teaming under conditions of varied automation reliability.

Reducing the Costs of Automation Failure by Providing Voluntary Automation Checking Tools

OBJECTIVE

We investigated the extent to which a voluntary-use range and bearing line (RBL) tool improves return-to-manual performance when supervising high-degree conflict detection automation in simulated air traffic control.

BACKGROUND

High-degree automation typically benefits routine performance and reduces workload, but can degrade return-to-manual performance if automation fails. We reasoned that providing a voluntary checking tool (RBL) would support automation failure detection, but also that automation induced complacency could extend to nonoptimal use of such tools.

METHOD

Participants were assigned to one of three conditions, where conflict detection was either performed: manually, with RBLs available to use (Manual + RBL), automatically with RBLs (Auto + RBL), or automatically without RBLs (Auto). Voluntary-use RBLs allowed participants to reliably check aircraft conflict status. Automation failed once.

RESULTS

RBLs improved automation failure detection - with participants intervening faster and making fewer false alarms when provided RBLs compared to not (Auto + RBL vs Auto). However, a cost of high-degree automation remained, with participants slower to intervene to the automation failure than to an identical manual conflict event (Auto + RBL vs Manual + RBL). There was no difference in RBL engagement time between Auto + RBL and Manual + RBL conditions, suggesting participants noticed the conflict event at the same time.

CONCLUSIONS

The cost of automation may have arisen from participants' reconciling which information to trust: the automation (which indicated no conflict and had been perfectly reliable prior to failing) or the RBL (which indicated a conflict).

APPLICATIONS

Providing a mechanism for checking the validity of high-degree automation may facilitate human supervision of automation.

Do concurrent task demands impact the benefit of automation transparency?

Automated decision aids typically improve decision-making, but incorrect advice risks automation misuse or disuse. We examined the novel question of whether increased automation transparency improves the accuracy of automation use under conditions with/without concurrent (non-automated assisted) task demands. Participants completed an uninhabited vehicle (UV) management task whereby they assigned the best UV to complete missions. Automation advised the best UV but was not always correct. Concurrent non-automated task demands decreased the accuracy of automation use, and increased decision time and perceived workload. With no concurrent task demands, increased transparency which provided more information on how the automation made decisions, improved the accuracy of automation use. With concurrent task demands, increased transparency led to higher trust ratings, faster decisions, and a bias towards agreeing with automation. These outcomes indicate increased reliance on highly transparent automation under conditions with concurrent task demands and have potential implications for human-automation teaming design.

Turning Back the Rising Sea: Theory performativity in the shift from climate science to popular authority

Action on climate change continues to be hampered by vested interests seeding doubt about science and the need to reduce carbon emissions. Using a qualitative case study of local climate adaptation to sea level rise, we show how climate change science is translated into a self-referential theory focused on property prices. Our analysis develops two mechanisms – enablement and theorization – to explain the relationship between theory performativity and power within a process of translation. This contributes to (1) the performativity debate by showing how the constitution of power relations shapes theory performativity; (2) theories of power, by tracing the ways in which certain actors are able to enrol others and impact the authority of particular theories, and (3) processes of translation by developing mechanisms for following the ways in which power and theory performativity interact. We conclude by arguing that a performative understanding of how power shapes beliefs is central to combating the failure to address climate change.

"I don't think anybody really knows": Constructing reflexive ignorance in climate change adaptation

Responding to the existential threat of climate change is often seen as requiring greater reflexivity. Imbued with notions of resilience and reflection, reflexivity is assumed to contribute to pro-environmental change. However, as the need to manage climate impacts becomes more immediate, political struggles over climate adaptation have become increasingly apparent. These impacts occur most often within local communities, in the context of competing economic interests and differing interpretations of climate science. Thus while it is increasingly difficult to deny climate change, conflicting priorities can lead to ignorance. In these circumstances, how communities build and share knowledge, and negotiate responses is central. Based on a study of a vulnerable region in Australia, we identify three processes through which the local community mobilized to disrupt local climate change adaptation. These included emphasizing uncertainty about the science of climate change, encouraging fear about property prices, and repositioning property owners as victims of climate adaptation policy. We argue that this response to climate adaptation constitutes the production of reflexive ignorance, which reinforces skepticism around scientific authority and defends particular economic interests.

Illness Experiences, Collective Decisions, and the Therapeutic Encounter in Indian Oncology

Social science scholarship on cancer has been almost exclusively focused on Organization for Economic Cooperation and Development (OECD) countries, despite a significant epidemiological transition taking place in many non-OECD contexts, with cancer emerging as a prominent, and strongly feared, illness experience. With cancer gaining an increasingly high profile in India, there is an urgent need to explore how experiences of cancer may be socially and culturally embedded, and in turn, how localized practices may shape the therapeutic encounter. Here, drawing on interviews with 40 people living with cancer in Hyderabad, India, we focus on some specific components of their therapeutic journeys, including diagnostic and prognostic disclosure, collective versus individual decision making, the dynamics of medical authority, and the reception of cancer within their social milieu. These participants' accounts provide insight into a range of cultural sensibilities around illness and care, and reinforce the importance of understanding the cultural inflections of communication, decisions, and illness experiences.

The Impact of Uncertain Contact Location on Situation Awareness and Performance in Simulated Submarine Track Management

OBJECTIVE

The aim of these studies was to examine the extent to which uncertainty in contact location in submarine track management affected operator situation awareness (SA), workload, and performance and whether operator SA predicted unique variance in performance.

BACKGROUND

We extend prior research by manipulating uncertainty in contact location and by including a sample of expert track managers in a submarine combat system.

METHOD

In Experiment 1, university students completed a track management task. In Experiment 2, expert submariners were embedded in a real submarine combat system. Uncertainty was manipulated and SA was measured using the situation present assessment method.

RESULTS

Increased uncertainty led to higher student workload and moderately impaired SA and performance, and SA predicted incremental variance in performance. Uncertainty had no effect on expert SA or the accuracy of the tactical picture compiled. On average, experts took 20 s to accept SA queries (compared with 2.18 s for students). The time taken for experts to accept SA queries, but not their subsequent response to SA queries, was positively associated with their tactical picture accuracy.

CONCLUSION

Uncertainty can negatively impact SA, workload, and performance. Some key findings from the laboratory were replicated using experts, but the fact that experts took on average 20 s to accept SA queries presents a challenge for using SPAM in submarine control rooms.

APPLICATION

Contact location is uncertain due to the use of passive sonar and hostile deception. It is essential to measure track manager SA in order to inform work design and training.

Randomized controlled trial of asthma risk with paracetamol use in infancy--a feasibility study

BACKGROUND

There is non-experimental evidence that paracetamol (acetaminophen) use may increase the risk of developing asthma. However, numerous methodological issues need to be resolved before undertaking a randomized controlled trial to investigate this hypothesis.

OBJECTIVE

To establish the feasibility of a randomized controlled trial of liberal paracetamol as usually given by parents/guardians vs. a comparator (restricted paracetamol in accordance with WHO guidelines, ibuprofen or placebo), and childhood asthma risk.

METHODS

Questionnaires were completed by parents/guardians of infants admitted to Wellington Hospital with bronchiolitis to assess views about comparator treatments. Subsequently, infants of parents/guardians who provided informed consent were randomized to restricted or liberal paracetamol use for 3 months with paracetamol use recorded.

RESULTS

Of 120 eligible participants, 72 (60%) parents/guardians completed the questionnaire. Ibuprofen, restricted paracetamol and placebo were acceptable to 42 (58%), 29 (40%) and 9 (12%) parents/guardians, respectively. 36 (30%) infants were randomized to restricted or liberal paracetamol. Paracetamol use was greater for the liberal vs. restricted group for reported [Hodges-Lehmann estimator of difference 0.94 mg/kg/day (95% CI 0.2-3.52), P = 0.02] and measured use [Hodges-Lehmann estimator of difference 2.11 mg/kg/day (95% CI 0.9-4.18), P = 0.004]. The median reported and measured use of paracetamol was 2.0-fold and 3.5-fold greater in the liberal vs. restricted group.

CONCLUSIONS AND CLINICAL RELEVANCE

Although separation in paracetamol dosing is likely to be achieved with a liberal vs. restricted paracetamol regime, ibuprofen is the preferred comparator treatment in the proposed RCT of paracetamol use and risk of asthma in childhood.

Situation awareness measures for simulated submarine track management

OBJECTIVE

The aim of this study was to examine whether the Situation Present Assessment Method (SPAM) and the Situation Awareness Global Assessment Technique (SAGAT) predict incremental variance in performance on a simulated submarine track management task and to measure the potential disruptive effect of these situation awareness (SA) measures.

BACKGROUND

Submarine track managers use various displays to localize and track contacts detected by own-ship sensors. The measurement of SA is crucial for designing effective submarine display interfaces and training programs.

METHOD

Participants monitored a tactical display and sonar bearing-history display to track the cumulative behaviors of contacts in relationship to own-ship position and landmarks. SPAM (or SAGAT) and the Air Traffic Workload Input Technique (ATWIT) were administered during each scenario, and the NASA Task Load Index (NASA-TLX) and Situation Awareness Rating Technique were administered postscenario.

RESULTS

SPAM and SAGAT predicted variance in performance after controlling for subjective measures of SA and workload, and SA for past information was a stronger predictor than SA for current/future information. The NASA-TLX predicted performance on some tasks. Only SAGAT predicted variance in performance on all three tasks but marginally increased subjective workload.

CONCLUSION

SPAM, SAGAT, and the NASA-TLX can predict unique variance in submarine track management performance. SAGAT marginally increased subjective workload, but this increase did not lead to any performance decrement.

APPLICATION

Defense researchers have identified SPAM as an alternative to SAGAT because it would not require field exercises involving submarines to be paused. SPAM was not disruptive, but it is potentially problematic that SPAM did not predict variance in all three performance tasks.

1974 meeting in san antonio

San Antonio will be the site of the 1974 MLA Annual Meeting, and the program will emphasize expanding the role of health science libraries. Tours, as well as activities available in San Antonio, are described. The Convention Center itself, and the convention hotel, the Hilton Palacio del Rio, are mentioned, and other accommodations are listed. Social events are discussed, and the city's many interesting restaurants are noted.