Judgment and Decision Making by Individuals and Teams: Issues, Models, and Applications

The human factor and ergonomics in Patient Safety

The human condition is linked to error in any activity that is performed, and the healthcare world is no exception. The origin of human error does not lie within the perversity of human nature, instead, it has its origins in latent failures in the healthcare environment and is a consequence of the processes and procedures applied. The science of the Human Factor deals with the application of knowledge to people (capabilities, characteristics and limitations), with the design and the management of the equipment they use and with the environments in which they work and the activities they carry out. Part of the Human Factor are the non-technical skills. These skills greatly influence people's behavior and, therefore, their performance and the quality of healthcare in a very complex socio-technical system.

Human Performance Consequences of Automated Decision Aids: The Impact of Time Pressure

OBJECTIVE

The study addresses the impact of time pressure on human interactions with automated decision support systems (DSSs) and related performance consequences.

BACKGROUND

When humans interact with DSSs, this often results in worse performance than could be expected from the automation alone. Previous research has suggested that time pressure might make a difference by leading humans to rely more on a DSS.

METHOD

In two laboratory experiments, participants performed a luggage screening task either manually, supported by a highly reliable DSS, or by a low reliable DSS. Time provided for inspecting the X-rays was 4.5 s versus 9 s varied within-subjects as the time pressure manipulation. Participants in the automation conditions were either shown the automation's advice prior (Experiment 1) or following (Experiment 2) their own inspection, before they made their final decision.

RESULTS

In Experiment 1, time pressure compromised performance independent of whether the task was performed manually or with automation support. In Experiment 2, the negative impact of time pressure was only found in the manual but not in the two automation conditions. However, neither experiment revealed any positive impact of time pressure on overall performance, and the joint performance of human and automation was mostly worse than the performance of the automation alone.

CONCLUSION

Time pressure compromises the quality of decision-making. Providing a DSS can reduce this effect, but only if the automation's advice follows the assessment of the human.

APPLICATION

The study provides suggestions for the effective implementation of DSSs in addition to supporting concerns that highly reliable DSSs are not used optimally by human operators.

Evaluating an integrated primary care approach to improve well-being among frail community-living older people: A theory-guided study protocol

Background

A major challenge in primary healthcare is the substantial increase in the proportion of frail community-dwelling older persons with long-term conditions and multiple complex needs. Consequently, a fundamental transformation of current models of primary care by means of implementing proactive integrated care is necessary. Therefore, an understanding of the effects of integrated primary care approaches and underlying mechanisms is essential. This article presents the design of a theory-based evaluation of an integrated primary care approach to improve well-being among frail community-living older adults, which is called “Finding and Follow-up of Frail older persons” (FFF).

First, we present a theoretical model to facilitate a sound theory-guided evaluation of integrated primary care approaches for frail community-dwelling older people. The model incorporates interrelated elements of integrated primary care approaches (e.g. proactive case finding and self-management support). Efforts to improve primary care should integrate these promising components to assure productive patient-professional interactions and to improve well-being. Moreover, cognitive and behavioral components of healthcare professionals and patients are assumed to be important. Second, we present the design of the study to evaluate the FFF approach which consists of the following key components: (1) proactive case finding, (2) case management, (3) medication review, (4) self-management support, and (5) working in multidisciplinary care teams.

Methods

The longitudinal evaluation study has a matched quasi-experimental design with one pretest and one posttest (12 month follow-up) and is conducted in the Netherlands between 2014 and 2017. Both quantitative and qualitative methods are used to evaluate effectiveness, processes, and cost-effectiveness. In total, 250 frail older persons (75 years and older) of 11 GP (general practitioner) practices that implemented the FFF approach are compared with 250 frail older patients of 4 GP practices providing care as usual. In addition, data are collected from healthcare professionals. Outcome measures are based on our theoretical model.

Discussion

The proposed evaluation study will reveal insight into the (cost)effectiveness and underlying mechanisms of the proactive integrated primary care approach FFF. A major strength of the study is the comprehensive evaluation based on a theoretical framework. The quasi-experimental design presents some challenges.

Debiasing visual pilots' weather-related decision making

Pilots who decide to continue a flight into deteriorating weather conditions, rather than turn back or divert, are a significant cause of fatal crashes in general aviation. Earlier research has suggested that cognitive biases such as the anchoring effect and confirmation bias are implicated in many decisions to continue into worsening weather. In this study, we explored whether a simple debiasing technique, 'considering the alternative', reduced the effect of these two potentially fatal biases. Despite the study being adequately powered, our attempts to reduce the effects of biases were both unsuccessful. Negative findings such as these are particularly useful in aviation, as they can provide information on what does not work in this high stakes industry, even though such strategies may work elsewhere.

Complacency and Automation Bias in the Use of Imperfect Automation

OBJECTIVE

We examine the effects of two different kinds of decision-aiding automation errors on human-automation interaction (HAI), occurring at the first failure following repeated exposure to correctly functioning automation. The two errors are incorrect advice, triggering the automation bias, and missing advice, reflecting complacency.

BACKGROUND

Contrasts between analogous automation errors in alerting systems, rather than decision aiding, have revealed that alerting false alarms are more problematic to HAI than alerting misses are. Prior research in decision aiding, although contrasting the two aiding errors (incorrect vs. missing), has confounded error expectancy.

METHOD

Participants performed an environmental process control simulation with and without decision aiding. For those with the aid, automation dependence was created through several trials of perfect aiding performance, and an unexpected automation error was then imposed in which automation was either gone (one group) or wrong (a second group). A control group received no automation support.

RESULTS

The correct aid supported faster and more accurate diagnosis and lower workload. The aid failure degraded all three variables, but "automation wrong" had a much greater effect on accuracy, reflecting the automation bias, than did "automation gone," reflecting the impact of complacency. Some complacency was manifested for automation gone, by a longer latency and more modest reduction in accuracy.

CONCLUSIONS

Automation wrong, creating the automation bias, appears to be a more problematic form of automation error than automation gone, reflecting complacency.

IMPLICATIONS

Decision-aiding automation should indicate its lower degree of confidence in uncertain environments to avoid the automation bias.

Is Global Warming a Challenge to Human Factors/Ergonomics?

Global warming has not been a major focus of human factors/ergonomics (HF/E), but interest in the problem and in the question of what HF/E professionals might have to contribute to its solution or to the mitigation of undesirable effects appears to be growing. Here I note three ways in which HF/E science is well positioned to contribute: promotion of a systems-approach perspective, development of effective tools for dealing with the problem, and performance of focused behavioral research.

Situational awareness, relational coordination and integrated care delivery to hospitalized elderly in the Netherlands: a comparison between hospitals

BACKGROUND

It is known that interprofessional collaboration is crucial for integrated care delivery, yet we are still unclear about the underlying mechanisms explaining effectiveness of integrated care delivery to older patients. In addition, we lack research comparing integrated care delivery between hospitals. Therefore, this study aims to (i) provide insight into the underlying components 'relational coordination' and 'situational awareness' of integrated care delivery and the role of team and organizational context in integrated care delivery; and (ii) compare situational awareness, relational coordination, and integrated care delivery of different hospitals in the Netherlands.

METHODS

This cross-sectional study took place in 2012 among professionals from three different hospitals involved in the delivery of care to older patients. A total of 215 professionals filled in the questionnaire (42% response rate).Descriptive statistics and paired-sample t-tests were used to investigate the level of situational awareness, relational coordination, and integrated care delivery in the three different hospitals. Correlation and multilevel analyses were used to investigate the relationship between background characteristics, team context, organizational context, situational awareness, relational coordination and integrated care delivery.

RESULTS

No differences in background characteristics, team context, organizational context, situational awareness, relational coordination and integrated care delivery were found among the three hospitals. Correlational analysis revealed that situational awareness (r = 0.30; p < 0.01), relational coordination (r = 0.17; p < 0.05), team climate (r = 0.29; p < 0.01), formal internal communication (r = 0.46; p < 0.01), and informal internal communication (r = 0.36; p < 0.01) were positively associated with integrated care delivery. Stepwise multilevel analyses showed that formal internal communication (p < 0.001) and situational awareness (p < 0.01) were associated with integrated care delivery. Team climate was not significantly associated with integrated care delivery when situational awareness and relational coordination were included in the equation. Thus situational awareness acted as mediator between team climate and integrated care delivery among professionals delivering care to older hospitalized patients.

CONCLUSIONS

The results of this study show the importance of formal internal communication and situational awareness for quality of care delivery to hospitalized older patients.

Understanding clinical risk decision making regarding development of depression during interferon-alpha treatment for hepatitis-C: a qualitative interview study

BACKGROUND

Hepatitis C virus (HCV) affects 170 million worldwide. Currently, around 30% of patients receiving interferon-alpha (IFN-α) treatment for HCV experience clinically significant depression. Effective and timely detection of depression is crucial to ensuring appropriate treatment and support. However, little is known about how clinical nurse specialists identify patients at risk of developing interferon-alpha-induced depression, and monitor those receiving antiviral treatment for the occurrence of depression.

OBJECTIVE

This study aimed to gain an in-depth understanding of staff experience of, and attitudes towards, the identification and monitoring of interferon-alpha-induced-depression and the decision-making process concerning the use of liaison psychiatry and other clinical services.

DESIGN

A qualitative interview study was conducted among clinical staff involved in the care of patients with hepatitis C, using the perspective of naturalistic decision making.

SETTINGS

Outpatient liver clinics in three large teaching hospitals in South London, the United Kingdom.

PARTICIPANTS

All clinical nurse specialists from the three outpatient liver clinics were included. All were involved directly in the care of patients receiving interferon-alpha treatment and had at least one year experience (mean 6.4 years, range 1-11 years) in this field.

METHODS

Semi-structured face-to-face interviews were conducted between 2010 and 2011. Data collection and analysis were carried out iteratively to ensure the reliability of the analysis using the constant comparison method.

RESULTS

Staff used verbal and non-verbal cues when assessing risks of patients developing depression before and during IFN-α treatment. Major sources of uncertainty were patient engagement and familiarity, referrals to psychiatrists, language barriers, and distinguishing between psychological and physical symptoms. Good rapport with patients and good communication among multidisciplinary professional groups were key strategies identified to reduce uncertainty.

CONCLUSION

Current methods of identifying vulnerable patients rely on the availability of clinical experts and good communication within a multidisciplinary team. Detection and management of depression in this population is complex, however, various strategies are employed by nurses to overcome difficulties when making decisions regarding patient welfare. Current clinical practices should be taken into account when developing new tools and methods.

Dopamine beta hydroxylase genotype identifies individuals less susceptible to bias in computer-assisted decision making

Computerized aiding systems can assist human decision makers in complex tasks but can impair performance when they provide incorrect advice that humans erroneously follow, a phenomenon known as "automation bias." The extent to which people exhibit automation bias varies significantly and may reflect inter-individual variation in the capacity of working memory and the efficiency of executive function, both of which are highly heritable and under dopaminergic and noradrenergic control in prefrontal cortex. The dopamine beta hydroxylase (DBH) gene is thought to regulate the differential availability of dopamine and norepinephrine in prefrontal cortex. We therefore examined decision-making performance under imperfect computer aiding in 100 participants performing a simulated command and control task. Based on two single nucleotide polymorphism (SNPs) of the DBH gene, -1041 C/T (rs1611115) and 444 G/A (rs1108580), participants were divided into groups of low and high DBH enzyme activity, where low enzyme activity is associated with greater dopamine relative to norepinephrine levels in cortex. Compared to those in the high DBH enzyme activity group, individuals in the low DBH enzyme activity group were more accurate and speedier in their decisions when incorrect advice was given and verified automation recommendations more frequently. These results indicate that a gene that regulates relative prefrontal cortex dopamine availability, DBH, can identify those individuals who are less susceptible to bias in using computerized decision-aiding systems.