Interventions targeted at reducing diagnostic error: systematic review

The Impact of a Cohort Structure on Grantee Experiences Developing Clinical Quality Measures for Diagnostic Excellence

BACKGROUND

Diagnostic errors are harmful and pervasive. The Gordon and Betty Moore Foundation funded the Diagnostic Excellence Initiative (Initiative) to support the development of clinical quality measures needed to inform quality improvement efforts in medical diagnosis. The Initiative leverages a unique cohort structure that combines technical assistance and cohort activities to foster innovation in groups of grantees. This manuscript shares grantee perspectives on their participation in these unique cohorts.

METHODS

The authors conducted interviews with 16 Initiative grantees to understand how technical assistance and cohort activities affected their measure development process. Interviews were recorded, transcribed, and coded using deductive codes.

RESULTS

Grantees reported technical assistance and cohort activities provided as part of the Initiative effectively supported them in developing clinical quality measures. Technical assistance, including one-on-one technical support and work plans, helped meet project milestones and address implementation challenges. Grantees valued cohort activities, including office hours and in-person meetings, because they gave grantees the opportunity to connect with other measure developers and gain new perspectives on their work. Further, grantees reported learning about the measure development process and indicated participation in an Initiative cohort had positive effects on their careers.

CONCLUSION

Grantees believed the combination of technical assistance and cohort activities provided by the Initiative supported their ability to develop diagnostic quality measures. This suggests collaborative learning activities like those provided to grantees could effectively support other complex problems in health care.

Online public response to emergency department diagnostic error report: A qualitative study

BACKGROUND

The 2022 study on diagnostic error in the emergency department (ED) published by the Agency for Healthcare Research and Quality (AHRQ) reported that one in every 18 ED patients is misdiagnosed. The report was methodologically critiqued by emergency physicians and researchers. However, little is known about public perception of error in the ED. We sought to characterize public response to AHRQ's publication.

METHODS

A search was conducted for online news articles published December 2022 reporting the AHRQ study and containing "public comment" sections. Verbatim comments and relevant characteristics were collected. Three coders completed content analysis and resolved any differences. Descriptive statistics and themes are reported.

RESULTS

Fifteen online articles were reviewed; three had public comment sections (New York Times, DailyMail, and Boston Globe). There were 553 unique user comments; 293 were original comments (53%) and 260 were replies to comments (47%). The 260 replies were in response to 113 original comments, with the remaining original comments having 0 replies (n = 180). Of the 202 commenters who identified a personal role in a health care encounter, 70 (35%) identified as patients and 68 (34%) identified as physicians. Comments centered on seven major themes: (1) negative personal experiences, (2) reframing study conclusions, (3) sense of decline in training standards, (4) internal stressors impeding ED diagnostic accuracy, (5) external stressors impeding ED diagnostic accuracy, (6) suggested solutions, and (7) role of the ED in diagnosis.

CONCLUSIONS

The news coverage of AHRQ's report provided individuals a platform to share their perspectives. Many comments reflected a nuanced understanding of the role of emergency care and the stressors of the ED environment. Despite questions about the report's accuracy, there were many individuals who shared personal negative experiences suggesting that the public may feel directly impacted by error in the ED.

From stable teamwork to dynamic teaming in the ambulatory care diagnostic process

Dynamic teaming is required whenever people must coordinate with one another in a fluid context, particularly when the fundamental structures of a team, such as membership, priorities, tasks, modes of communication, and location are in near-constant flux. This is certainly the case in the contemporary ambulatory care diagnostic process, where circumstances and conditions require a shifting cast of individuals to coordinate dynamically to ensure patient safety. This article offers an updated perspective on dynamic teaming commonly required during the ambulatory diagnostic process. Drawing upon team science, it clarifies the characteristics of dynamic diagnostic teams, identifies common risk points in the teaming process and the practical implications of these risks, considers the role of providers and patients in averting adverse outcomes, and provides a case example of the challenges of dynamic teaming during the diagnostic process. Based on this, future research needs are offered as well as clinical practice recommendations related to team characteristics and breakdowns, team member knowledge/cognitions, teaming dynamics, and the patient as a team member.

Implementation of a bundle to improve diagnosis in hospitalized patients: lessons learned

OBJECTIVES

The inpatient setting is a challenging clinical environment where systems and situational factors predispose clinicians to making diagnostic errors. Environmental complexities limit trialing of interventions to improve diagnostic error in active inpatient clinical settings. Informed by prior work, we piloted a multi-component intervention designed to reduce diagnostic error to understand its feasibility and uptake.

METHODS

From September 2018 to June 2019, we conducted a prospective, pre-test/post-test pilot study of hospital medicine physicians during admitting shifts at a tertiary-care, academic medical center. Optional intervention components included use of dedicated workspaces, privacy barriers, noise cancelling headphones, application-based breathing exercises, a differential diagnosis expander application, and a checklist to enable a diagnostic pause. Participants rated their confidence in patient diagnoses and completed a survey on intervention component use. Data on provider resource utilization and patient diagnoses were collected, and qualitative interviews were held with a subset of participants in order to better understand experience with the intervention.

RESULTS

Data from 37 physicians and 160 patients were included. No intervention component was utilized by more than 50 % of providers, and no differences were noted in diagnostic confidence or number of diagnoses documented pre-vs. post-intervention. Lab utilization increased, but there were no other differences in resource utilization during the intervention. Qualitative feedback highlighted workflow integration challenges, among others, for poor intervention uptake.

CONCLUSIONS

Our pilot study demonstrated poor feasibility and uptake of an intervention designed to reduce diagnostic error. This study highlights the unique challenges of implementing solutions within busy clinical environments.

Interventions to improve timely cancer diagnosis: an integrative review

Cancer will affect more than one in three U.S. residents in their lifetime, and although the diagnosis will be made efficiently in most of these cases, roughly one in five patients will experience a delayed or missed diagnosis. In this integrative review, we focus on missed opportunities in the diagnosis of breast, lung, and colorectal cancer in the ambulatory care environment. From a review of 493 publications, we summarize the current evidence regarding the contributing factors to missed or delayed cancer diagnosis in ambulatory care, as well as evidence to support possible strategies for intervention. Cancer diagnoses are made after follow-up of a positive screening test or an incidental finding, or most commonly, by following up and clarifying non-specific initial presentations to primary care. Breakdowns and delays are unacceptably common in each of these pathways, representing failures to follow-up on abnormal test results, incidental findings, non-specific symptoms, or consults. Interventions aimed at 'closing the loop' represent an opportunity to improve the timeliness of cancer diagnosis and reduce the harm from diagnostic errors. Improving patient engagement, using 'safety netting,' and taking advantage of the functionality offered through health information technology are all viable options to address these problems.

Diagnostic error in mental health: a review

Diagnostic errors are associated with patient harm and suboptimal outcomes. Despite national scientific efforts to advance definition, measurement and interventions for diagnostic error, diagnosis in mental health is not well represented in this ongoing work. We aimed to summarise the current state of research on diagnostic errors in mental health and identify opportunities to align future research with the emerging science of diagnostic safety. We review conceptual considerations for defining and measuring diagnostic error, the application of these concepts to mental health settings, and the methods and subject matter focus of recent studies of diagnostic error in mental health. We found that diagnostic error is well understood to be a problem in mental healthcare. Although few studies used clear definitions or frameworks for understanding diagnostic error in mental health, several studies of missed, wrong, delayed and disparate diagnosis of common mental disorders have identified various avenues for future research and development. Nevertheless, a lack of clear consensus on how to conceptualise, define and measure errors in diagnosis will pose a barrier to advancement. Further research should focus on identifying preventable missed opportunities in the diagnosis of mental disorders, which may uncover generalisable opportunities for improvement.

Cost-consequence analysis of computer vision-based skin prick tests: implications for cost containment in Switzerland

BACKGROUND

Skin prick tests (SPTs), or intraepidermal tests, are often the first diagnostic approach for people with a suspected allergy. Together with the clinical history, SPTs allow doctors to draw conclusions on allergies based on the sensitization pattern. The purpose of this study is to investigate the potential cost consequences that would accrue to a Swiss University hospital after the adoption of computer vision-based SPTs.

METHODS

We conducted a cost-consequence analysis from a hospital's perspective to evaluate the potential cost consequences of using a computer vision-based system to read SPT results. The patient population consisted of individuals who were referred to the allergology department of one of the five university hospitals in Switzerland, Inselspital, whose allergology department averages 100 SPTs a week. We developed an early cost-consequence model comparing two SPT techniques; computer vision-based SPTs conducted with the aid of Nexkin DSPT and standard fully manual SPTs. Probabilistic sensitivity analysis and additional univariate sensitivity analyses were used to account for uncertainty.

RESULTS

The difference in average cost between the two alternatives from a hospital's perspective was estimated to be CHF 7 per SPT, in favour of the computer vison-based SPTs. Monte Carlo probabilistic simulation also indicated that SPTs conducted using the computer vision-based system were cost saving compared to standard fully manual SPTs. Sensitivity analyses additionally demonstrated the robustness of the base case result subject to plausible changes in all the input parameters, with parameters representing the costs associated with both SPT techniques having the largest influence on the incremental cost. However, higher sensitization prevalence rates seemed to favour the more accurate standard fully manual SPTs.

CONCLUSION

Against the backdrop of rising healthcare costs especially in Switzerland, using computer-aided or (semi) automated diagnostic systems could play an important role in healthcare cost containment efforts. However, results should be taken with caution because of the uncertainty associated with the early nature of our analysis and the specific Swiss context adopted in this study.

Role of knowledge and reasoning processes as predictors of resident physicians' susceptibility to anchoring bias in diagnostic reasoning: a randomised controlled experiment

BACKGROUND

Diagnostic errors have been attributed to reasoning flaws caused by cognitive biases. While experiments have shown bias to cause errors, physicians of similar expertise differed in susceptibility to bias. Resisting bias is often said to depend on engaging analytical reasoning, disregarding the influence of knowledge. We examined the role of knowledge and reasoning mode, indicated by diagnosis time and confidence, as predictors of susceptibility to anchoring bias. Anchoring bias occurs when physicians stick to an incorrect diagnosis triggered by early salient distracting features (SDF) despite subsequent conflicting information.

METHODS

Sixty-eight internal medicine residents from two Dutch university hospitals participated in a two-phase experiment. Phase 1: assessment of knowledge of discriminating features (ie, clinical findings that discriminate between lookalike diseases) for six diseases. Phase 2 (1 week later): diagnosis of six cases of these diseases. Each case had two versions differing exclusively in the presence/absence of SDF. Each participant diagnosed three cases with SDF (SDF+) and three without (SDF-). Participants were randomly allocated to case versions. Based on phase 1 assessment, participants were split into higher knowledge or lower knowledge groups.

MAIN OUTCOME MEASUREMENTS

frequency of diagnoses associated with SDF; time to diagnose; and confidence in diagnosis.

RESULTS

While both knowledge groups performed similarly on SDF- cases, higher knowledge physicians succumbed to anchoring bias less frequently than their lower knowledge counterparts on SDF+ cases (p=0.02). Overall, physicians spent more time (p<0.001) and had lower confidence (p=0.02) on SDF+ than SDF- cases (p<0.001). However, when diagnosing SDF+ cases, the groups did not differ in time (p=0.88) nor in confidence (p=0.96).

CONCLUSIONS

Physicians apparently adopted a more analytical reasoning approach when presented with distracting features, indicated by increased time and lower confidence, trying to combat bias. Yet, extended deliberation alone did not explain the observed performance differences between knowledge groups. Success in mitigating anchoring bias was primarily predicted by knowledge of discriminating features of diagnoses.

Frontline Providers' and Patients' Perspectives on Improving Diagnostic Safety in the Emergency Department: A Qualitative Study

BACKGROUND

Few studies have described the insights of frontline health care providers and patients on how the diagnostic process can be improved in the emergency department (ED), a setting at high risk for diagnostic errors. The authors aimed to identify the perspectives of providers and patients on the diagnostic process and identify potential interventions to improve diagnostic safety.

METHODS

Semistructured interviews were conducted with 10 ED physicians, 15 ED nurses, and 9 patients/caregivers at two separate health systems. Interview questions were guided by the ED-Adapted National Academies of Sciences, Engineering, and Medicine Diagnostic Process Framework and explored participant perspectives on the ED diagnostic process, identified vulnerabilities, and solicited interventions to improve diagnostic safety. The authors performed qualitative thematic analysis on transcribed interviews.

RESULTS

The research team categorized vulnerabilities in the diagnostic process and intervention opportunities based on the ED-Adapted Framework into five domains: (1) team dynamics and communication (for example, suboptimal communication between referring physicians and the ED team); (2) information gathering related to patient presentation (for example, obtaining the history from the patients or their caregivers; (3) ED organization, system, and processes (for example, staff schedules and handoffs); (4) patient education and self-management (for example, patient education at discharge from the ED); and (5) electronic health record and patient portal use (for example, automatic release of test results into the patient portal). The authors identified 33 potential interventions, of which 17 were provider focused and 16 were patient focused.

CONCLUSION

Frontline providers and patients identified several vulnerabilities and potential interventions to improve ED diagnostic safety. Refining, implementing, and evaluating the efficacy of these interventions are required.

Association Between Medicare's Sepsis Reporting Policy (SEP-1) and the Documentation of a Sepsis Diagnosis in the Clinical Record

STUDY DESIGN

Interrupted time series analysis of a retrospective, electronic health record cohort.

OBJECTIVE

To determine the association between the implementation of Medicare's sepsis reporting measure (SEP-1) and sepsis diagnosis rates as assessed in clinical documentation.

BACKGROUND

The role of health policy in the effort to improve sepsis diagnosis remains unclear.

PATIENTS AND METHODS

Adult patients hospitalized with suspected infection and organ dysfunction within 6 hours of presentation to the emergency department, admitted to one of 11 hospitals in a multi-hospital health system from January 2013 to December 2017. Clinician-diagnosed sepsis, as reflected by the inclusion of the terms "sepsis" or "septic" in the text of clinical notes in the first two calendar days following presentation.

RESULTS

Among 44,074 adult patients with sepsis admitted to 11 hospitals over 5 years, the proportion with sepsis documentation was 32.2% just before the implementation of SEP-1 in the third quarter of 2015 and increased to 37.3% by the fourth quarter of 2017. Of the 9 post-SEP-1 quarters, 8 had odds ratios for a sepsis diagnosis >1 (overall range: 0.98-1.26; P value for a joint test of statistical significance = 0.005). The effects were clinically modest, with a maximum effect of an absolute increase of 4.2% (95% CI: 0.9-7.8) at the end of the study period. The effect was greater in patients who did not require vasopressors compared with patients who required vasopressors ( P value for test of interaction = 0.02).

CONCLUSIONS

SEP-1 implementation was associated with modest increases in sepsis diagnosis rates, primarily among patients who did not require vasoactive medications.

Delayed diagnosis of serious paediatric conditions in 13 regional emergency departments

OBJECTIVE

To evaluate rates, risk factors and outcomes of delayed diagnosis of seven serious paediatric conditions.

METHODS

This was a retrospective, cross-sectional study of children under 21 years old visiting 13 community and tertiary emergency departments (EDs) with appendicitis, bacterial meningitis, intussusception, mastoiditis, ovarian torsion, sepsis or testicular torsion. Delayed diagnosis was defined as having a previous ED encounter within 1 week in which the condition was present per case review. Patients with delayed diagnosis were each matched to four control patients without delay by condition, facility and age. Conditional logistic regression models evaluated risk factors of delay. Complications were compared between by delayed diagnosis status.

RESULTS

Among 14 972 children, delayed diagnosis occurred in 1.1% (range 0.3% for sepsis to 2.6% for ovarian torsion). Hispanic (matched OR 2.71, 95% CI 1.69 to 4.35) and non-Hispanic black (OR 2.40, 95% CI 1.21 to 4.79) race/ethnicity were associated with delayed diagnosis, whereas Asian and other race/ethnicity were not. Public (OR 2.21, 95% CI 1.42 to 3.44) and other (OR 2.43, 95% CI 1.50 to 3.93) insurance were also associated with delay. Non-English language was associated with delay (OR 1.65, 95% CI 1.02 to 2.69). Abnormal vital signs were associated with a lower likelihood of delay (OR 0.15, 95% CI 0.09 to 0.25). In an adjusted model, Hispanic race/ethnicity, other insurance, abnormal vital signs and complex chronic conditions (CCCs) were associated with delay. The odds of a complication were 2.5-fold (95% CI 1.6 to 3.8) higher among patients with a delay.

CONCLUSION

Delayed diagnosis was uncommon across 13 regional EDs but was more likely among children with Hispanic ethnicity, CCCs or normal vital signs. Delays were associated with a higher risk of complications.

Emergency Department Volume and Delayed Diagnosis of Serious Pediatric Conditions

Importance

Diagnostic delays are common in the emergency department (ED) and may predispose to worse outcomes.

Objective

To evaluate the association of annual pediatric volume in the ED with delayed diagnosis.

Design, Setting, and Participants

This retrospective cohort study included all children younger than 18 years treated at 954 EDs in 8 states with a first-time diagnosis of any of 23 acute, serious conditions: bacterial meningitis, compartment syndrome, complicated pneumonia, craniospinal abscess, deep neck infection, ectopic pregnancy, encephalitis, intussusception, Kawasaki disease, mastoiditis, myocarditis, necrotizing fasciitis, nontraumatic intracranial hemorrhage, orbital cellulitis, osteomyelitis, ovarian torsion, pulmonary embolism, pyloric stenosis, septic arthritis, sinus venous thrombosis, slipped capital femoral epiphysis, stroke, or testicular torsion. Patients were identified using the Healthcare Cost and Utilization Project State ED and Inpatient Databases. Data were collected from January 2015 to December 2019, and data were analyzed from July to December 2023.

Exposure

Annual volume of children at the first ED visited.

Main Outcomes and Measures

Possible delayed diagnosis, defined as a patient with an ED discharge within 7 days prior to diagnosis. A secondary outcome was condition-specific complications. Rates of possible delayed diagnosis and complications were determined. The association of volume with delayed diagnosis across conditions was evaluated using conditional logistic regression matching on condition, age, and medical complexity. Condition-specific volume-delay associations were tested using hierarchical logistic models with log volume as the exposure, adjusting for age, sex, payer, medical complexity, and hospital urbanicity. The association of delayed diagnosis with complications by condition was then examined using logistic regressions.

Results

Of 58 998 included children, 37 211 (63.1%) were male, and the mean (SD) age was 7.1 (5.8) years. A total of 6709 (11.4%) had a complex chronic condition. Delayed diagnosis occurred in 9296 (15.8%; 95% CI, 15.5-16.1). Each 2-fold increase in annual pediatric volume was associated with a 26.7% (95% CI, 22.5-30.7) decrease in possible delayed diagnosis. For 21 of 23 conditions (all except ectopic pregnancy and sinus venous thrombosis), there were decreased rates of possible delayed diagnosis with increasing ED volume. Condition-specific complications were 11.2% (95% CI, 3.1-20.0) more likely among patients with a possible delayed diagnosis compared with those without.

Conclusions and Relevance

EDs with fewer pediatric encounters had more possible delayed diagnoses across 23 serious conditions. Tools to support timely diagnosis in low-volume EDs are needed.

Mortality and risk factors associated with misdiagnosis of acute aortic syndrome in Ontario, Canada: a population-based study

INTRODUCTION

Acute aortic syndrome (AAS) is a life-threatening aortic emergency. It describes three diagnoses: acute aortic dissection, acute intramural haematoma and penetrating atherosclerotic ulcer. Unfortunately, there are no accurate estimates of the miss rate for AAS, risk factors for missed diagnosis or its effect on outcomes.

METHODS

A population-based retrospective cohort study of anonymously linked data for residents of Ontario, Canada, was carried out. Incident cases of AAS were identified between 2003 and 2018 using a validated algorithm based on ICD codes and death. Before multivariate modelling, all categorical variables were analysed for an association with missed AAS diagnosis using χ2 tests. These preliminary analyses were unadjusted for clustering or any covariates. Finally, we performed multilevel logistic regression analysis using a generalised linear mixed model approach to model the probability of a missed case occurring.

RESULTS

There were 1299 cases of AAS (age mean (SD) 68.03±14.70, woman 500 (38.5%), rural areas (n=111, 8.55%)) over the study period. Missed cases accounted for 163 (12.5%) of the cohort. Mortality (non-missed AAS 59.7% vs missed AAS 54.6%) and surgical intervention (non-missed AAS 31% vs missed AAS 30.7%) were similar in missed and non-missed cases. However, lower acuity (Canadian triage acuity scale >2 (OR 2.45 95% CI 1.71 to 3.52) (the scale is from 1 to 5, with 1 indicating high acuity) had a higher odds of being a missed case and non-ambulatory presentation (OR 0.47 95% CI 0.33 to 0.67) and presenting to a teaching (OR 0.60 95% CI 0.40 to 0.90)) or cardiac centre (OR 0.41 95% CI 0.27 to 0.62) were associated with a lower odds of being a missed case.

CONCLUSIONS

The high rate of misdiagnosis has remained stable for over a decade. Non-teaching and non-cardiac hospitals had a higher incidence of missed cases. Mortality and rates of surgery were not associated with a missed diagnosis of AAS. Educational interventions should be prioritised in non-teaching hospitals and non-cardiac centres.

The PRIDx framework to engage payers in reducing diagnostic errors in healthcare

OBJECTIVES

No framework currently exists to guide how payers and providers can collaboratively develop and implement incentives to improve diagnostic safety. We conducted a literature review and interviews with subject matter experts to develop a multi-component 'Payer Relationships for Improving Diagnoses (PRIDx)' framework, that could be used to engage payers in diagnostic safety efforts.

CONTENT

The PRIDx framework, 1) conceptualizes diagnostic safety links to care provision, 2) illustrates ways to promote payer and provider engagement in the design and adoption of accountability mechanisms, and 3) explicates the use of data analytics. Certain approaches suggested by PRIDx were refined by subject matter expert interviewee perspectives.

SUMMARY

The PRIDx framework can catalyze public and private payers to take specific actions to improve diagnostic safety.

OUTLOOK

Implementation of the PRIDx framework requires new types of partnerships, including external support from public and private payer organizations, and requires creation of strong provider incentives without undermining providers' sense of professionalism and autonomy. PRIDx could help facilitate collaborative payer-provider approaches to improve diagnostic safety and generate research concepts, policy ideas, and potential innovations for engaging payers in diagnostic safety improvement activities.

OUTCOMES OF MISSED DIAGNOSIS OF PEDIATRIC APPENDICITIS, NEW-ONSET DIABETIC KETOACIDOSIS, AND SEPSIS IN FIVE PEDIATRIC HOSPITALS

BACKGROUND

Missed diagnosis can predispose to worse condition-specific outcomes.

OBJECTIVE

To determine 90-day complication rates and hospital utilization after a missed diagnosis of pediatric appendicitis, new-onset diabetic ketoacidosis (DKA), and sepsis.

METHODS

We evaluated patients under 21 years of age visiting five pediatric emergency departments (EDs) with a study condition. Case patients had a preceding ED visit within 7 days of diagnosis and underwent case review to confirm a missed diagnosis. Control patients had no preceding ED visit. We compared complication rates and utilization between case and control patients after adjusting for age, sex, and insurance.

RESULTS

We analyzed 29,398 children with appendicitis, 5366 with DKA, and 3622 with sepsis, of whom 429, 33, and 46, respectively, had a missed diagnosis. Patients with missed diagnosis of appendicitis or DKA had more hospital days and readmissions; there were no significant differences for those with sepsis. Those with missed appendicitis were more likely to have abdominal abscess drainage (adjusted odds ratio [aOR] 3.0, 95% confidence interval [CI] 2.4-3.6) or perforated appendicitis (aOR 3.1, 95% CI 2.5-3.8). Those with missed DKA were more likely to have cerebral edema (aOR 4.6, 95% CI 1.5-11.3), mechanical ventilation (aOR 13.4, 95% CI 3.8-37.1), or death (aOR 28.4, 95% CI 1.4-207.5). Those with missed sepsis were less likely to have mechanical ventilation (aOR 0.5, 95% CI 0.2-0.9). Other illness complications were not significantly different by missed diagnosis.

CONCLUSIONS

Children with delayed diagnosis of appendicitis or new-onset DKA had a higher risk of 90-day complications and hospital utilization than those with a timely diagnosis.

Developing, pilot testing, and refining requirements for 3 EHR-integrated interventions to improve diagnostic safety in acute care: a user-centered approach

Objective

To describe a user-centered approach to develop, pilot test, and refine requirements for 3 electronic health record (EHR)-integrated interventions that target key diagnostic process failures in hospitalized patients.

Materials and Methods

Three interventions were prioritized for development: a Diagnostic Safety Column (DSC) within an EHR-integrated dashboard to identify at-risk patients; a Diagnostic Time-Out (DTO) for clinicians to reassess the working diagnosis; and a Patient Diagnosis Questionnaire (PDQ) to gather patient concerns about the diagnostic process. Initial requirements were refined from analysis of test cases with elevated risk predicted by DSC logic compared to risk perceived by a clinician working group; DTO testing sessions with clinicians; PDQ responses from patients; and focus groups with clinicians and patient advisors using storyboarding to model the integrated interventions. Mixed methods analysis of participant responses was used to identify final requirements and potential implementation barriers.

Results

Final requirements from analysis of 10 test cases predicted by the DSC, 18 clinician DTO participants, and 39 PDQ responses included the following: DSC configurable parameters (variables, weights) to adjust baseline risk estimates in real-time based on new clinical data collected during hospitalization; more concise DTO wording and flexibility for clinicians to conduct the DTO with or without the patient present; and integration of PDQ responses into the DSC to ensure closed-looped communication with clinicians. Analysis of focus groups confirmed that tight integration of the interventions with the EHR would be necessary to prompt clinicians to reconsider the working diagnosis in cases with elevated diagnostic error (DE) risk or uncertainty. Potential implementation barriers included alert fatigue and distrust of the risk algorithm (DSC); time constraints, redundancies, and concerns about disclosing uncertainty to patients (DTO); and patient disagreement with the care team's diagnosis (PDQ).

Discussion

A user-centered approach led to evolution of requirements for 3 interventions targeting key diagnostic process failures in hospitalized patients at risk for DE.

Conclusions

We identify challenges and offer lessons from our user-centered design process.

Effect on diagnostic accuracy of cognitive reasoning tools for the workplace setting: systematic review and meta-analysis

BACKGROUND

Preventable diagnostic errors are a large burden on healthcare. Cognitive reasoning tools, that is, tools that aim to improve clinical reasoning, are commonly suggested interventions. However, quantitative estimates of tool effectiveness have been aggregated over both workplace-oriented and educational-oriented tools, leaving the impact of workplace-oriented cognitive reasoning tools alone unclear. This systematic review and meta-analysis aims to estimate the effect of cognitive reasoning tools on improving diagnostic performance among medical professionals and students, and to identify factors associated with larger improvements.

METHODS

Controlled experimental studies that assessed whether cognitive reasoning tools improved the diagnostic accuracy of individual medical students or professionals in a workplace setting were included. Embase.com, Medline ALL via Ovid, Web of Science Core Collection, Cochrane Central Register of Controlled Trials and Google Scholar were searched from inception to 15 October 2021, supplemented with handsearching. Meta-analysis was performed using a random-effects model.

RESULTS

The literature search resulted in 4546 articles of which 29 studies with data from 2732 participants were included for meta-analysis. The pooled estimate showed considerable heterogeneity (I2=70%). This was reduced to I2=38% by removing three studies that offered training with the tool before the intervention effect was measured. After removing these studies, the pooled estimate indicated that cognitive reasoning tools led to a small improvement in diagnostic accuracy (Hedges' g=0.20, 95% CI 0.10 to 0.29, p<0.001). There were no significant subgroup differences.

CONCLUSION

Cognitive reasoning tools resulted in small but clinically important improvements in diagnostic accuracy in medical students and professionals, although no factors could be distinguished that resulted in larger improvements. Cognitive reasoning tools could be routinely implemented to improve diagnosis in practice, but going forward, more large-scale studies and evaluations of these tools in practice are needed to determine how these tools can be effectively implemented.

PROSPERO REGISTRATION NUMBER

CRD42020186994.

Medical malpractice and gastrointestinal endoscopy

PURPOSE OF REVIEW

Medical liability is a perennial issue that most physicians will face at some point in their careers. Gastroenterologists routinely perform endoscopic procedures to aid in the diagnosis and treatment of their patients. Advances in endoscopic techniques and technology have accelerated movement of the field into a more surgical realm. These developments warrant consideration of pitfalls that may expose gastroenterologists to liability. This review will explore trends in malpractice facing gastroenterologists and offer strategies to deliver high quality and safe patient care.

RECENT FINDINGS

Despite being a procedure-oriented subspeciality, only a minority of malpractice claims against gastroenterologists are related to procedures. Diagnostic error is among the most prevalent reason for lawsuits. The consequences of malpractice are costly due litigation and indemnity as well as the increase in defensive medical practice. Improving diagnostic quality, optimizing informed consent, and enhancing patient-physician communication are important elements of risk mitigation.

SUMMARY

Understanding the important role that diagnosis plays in medical liability allows physicians to better evaluate risk and apply deliberate decision-making in order to practice confidently.