"First, know thyself": cognition and error in medicine

Deliberate practice of diagnostic clinical reasoning reveals low performance and improvement of diagnostic justification in pre-clerkship students

PURPOSE

Diagnostic errors are a large burden on patient safety and improving clinical reasoning (CR) education could contribute to reducing these errors. To this end, calls have been made to implement CR training as early as the first year of medical school. However, much is still unknown about pre-clerkship students' reasoning processes. The current study aimed to observe how pre-clerkship students use clinical information during the diagnostic process.

METHODS

In a prospective observational study, pre-clerkship medical students completed 10-11 self-directed online simulated CR diagnostic cases. CR skills assessed included: creation of the differential diagnosis (Ddx), diagnostic justification (DxJ), ordering investigations, and identifying the most probable diagnosis. Student performances were compared to expert-created scorecards and students received detailed individualized formative feedback for every case.

RESULTS

121 of 133 (91%) first- and second-year medical students consented to the research project. Students scored much lower for DxJ compared to scores obtained for creation of the Ddx, ordering tests, and identifying the correct diagnosis, (30-48% lower, p < 0.001). Specifically, students underutilized physical exam data (p < 0.001) and underutilized data that decreased the probability of incorrect diagnoses (p < 0.001). We observed that DxJ scores increased 40% after 10-11 practice cases (p < 0.001).

CONCLUSIONS

We implemented deliberate practice with formative feedback for CR starting in the first year of medical school. Students underperformed in DxJ, particularly with analyzing the physical exam data and pertinent negative data. We observed significant improvement in DxJ performance with increased practice.

Impact of diagnostic checklists on the interpretation of normal and abnormal electrocardiograms

OBJECTIVES

Checklists that aim to support clinicians' diagnostic reasoning processes are often recommended to prevent diagnostic errors. Evidence on checklist effectiveness is mixed and seems to depend on checklist type, case difficulty, and participants' expertise. Existing studies primarily use abnormal cases, leaving it unclear how the diagnosis of normal cases is affected by checklist use. We investigated how content-specific and debiasing checklists impacted performance for normal and abnormal cases in electrocardiogram (ECG) diagnosis.

METHODS

In this randomized experiment, 42 first year general practice residents interpreted normal, simple abnormal, and complex abnormal ECGs without a checklist. One week later, they were randomly assigned to diagnose the ECGs again with either a debiasing or content-specific checklist. We measured residents' diagnostic accuracy, confidence, patient management, and time taken to diagnose. Additionally, confidence-accuracy calibration was assessed.

RESULTS

Accuracy, confidence, and patient management were not significantly affected by checklist use. Time to diagnose decreased with a checklist (M=147s (77)) compared to without a checklist (M=189s (80), Z=-3.10, p=0.002). Additionally, residents' calibration improved when using a checklist (phase 1: R2=0.14, phase 2: R2=0.40).

CONCLUSIONS

In both normal and abnormal cases, checklist use improved confidence-accuracy calibration, though accuracy and confidence were not significantly affected. Time to diagnose was reduced. Future research should evaluate this effect in more experienced GPs. Checklists appear promising for reducing overconfidence without negatively impacting normal or simple ECGs. Reducing overconfidence has the potential to improve diagnostic performance in the long term.

Behavioral Economics: A Primer and Applications to the UN Sustainable Development Goal of Good Health and Well-Being

Behavioral economics (BE) is a relatively new field within economics that incorporates insights from psychology that can be harnessed to improve economic decision making with the potential to enhance good health and well-being of individuals and societies, the third of the United Nations Sustainable Development Goals. While some of the psychological principles of economic decision making were described as far back as the 1700s by Adam Smith, BE emerged as a discipline in the 1970s with the groundbreaking work of psychologists Daniel Kahneman and Amos Tversky. We describe the basic concepts of BE, heuristics (decision-making shortcuts) and their associated biases, and the BE strategies framing, incentives, and economic nudging to overcome these biases. We survey the literature to identify how BE techniques have been employed to improve individual choice (focusing on childhood obesity), health policy, and patient and healthcare provider decision making. Additionally, we discuss how these BE-based efforts to improve health-related decision making can lead to sustaining good health and well-being and identify additional health-related areas that may benefit from including principles of BE in decision making.

The relationship between time to diagnose and diagnostic accuracy among internal medicine residents: a randomized experiment

BACKGROUND

Diagnostic errors have been attributed to cognitive biases (reasoning shortcuts), which are thought to result from fast reasoning. Suggested solutions include slowing down the reasoning process. However, slower reasoning is not necessarily more accurate than faster reasoning. In this study, we studied the relationship between time to diagnose and diagnostic accuracy.

METHODS

We conducted a multi-center within-subjects experiment where we prospectively induced availability bias (using Mamede et al.'s methodology) in 117 internal medicine residents. Subsequently, residents diagnosed cases that resembled those bias cases but had another correct diagnosis. We determined whether residents were correct, incorrect due to bias (i.e. they provided the diagnosis induced by availability bias) or due to other causes (i.e. they provided another incorrect diagnosis) and compared time to diagnose.

RESULTS

We did not successfully induce bias: no significant effect of availability bias was found. Therefore, we compared correct diagnoses to all incorrect diagnoses. Residents reached correct diagnoses faster than incorrect diagnoses (115 s vs. 129 s, p < .001). Exploratory analyses of cases where bias was induced showed a trend of time to diagnose for bias diagnoses to be more similar to correct diagnoses (115 s vs 115 s, p = .971) than to other errors (115 s vs 136 s, p = .082).

CONCLUSIONS

We showed that correct diagnoses were made faster than incorrect diagnoses, even within subjects. Errors due to availability bias may be different: exploratory analyses suggest a trend that biased cases were diagnosed faster than incorrect diagnoses. The hypothesis that fast reasoning leads to diagnostic errors should be revisited, but more research into the characteristics of cognitive biases is important because they may be different from other causes of diagnostic errors.

Black swans, cognition, and the power of learning from failure

Failure carries undeniable stigma and is difficult to confront for individuals, teams, and organizations. Disciplines such as commercial and military aviation, medicine, and business have long histories of grappling with it, beginning with the recognition that failure is inevitable in every human endeavor. Although conservation may arguably be more complex, conservation professionals can draw on the research and experience of these other disciplines to institutionalize activities and attitudes that foster learning from failure, whether they are minor setbacks or major disasters. Understanding the role of individual cognitive biases, team psychological safety, and organizational willingness to support critical self-examination all contribute to creating a cultural shift in conservation to one that is open to the learning opportunity that failure provides. This new approach to managing failure is a necessary next step in the evolution of conservation effectiveness.

Cardiac Arrest and Gastrointestinal Bleeding: A Case of Medical Heuristics

Insufficient clinical data from patients is a major cause of errors in medical diagnostics. In an attempt to make a diagnosis, initial clinical information provided to the physician may be overly relied on as the only information required in making diagnosis leading to anchoring. Failure to rely on differential diagnoses in spite of new signs and symptoms or rethinking of initial hypothesis may lead to fixation on a certain diagnosis, which may lead to significant morbidity and mortality. In the event that there is an anchoring heuristic, like in our patient, it is important to consider differential diagnoses; however, it is not wrong to rely on some form of anchor. We report a case of a 62-year-old male with a history of multiple medical conditions and a history of acetaminophen overdose who presented to the hospital with large amounts of coffee ground emesis. He was subsequently transferred to the liver transplant center on discovery that he was in fulminant hepatic failure and died two days later in spite of aggressive medical treatment.