Simulation-based mastery learning compared to standard education for discussing diagnostic uncertainty with patients in the emergency department: a randomized controlled trial

A Literature Study of Medical Simulations for Non-Technical Skills Training in Emergency Medicine: Twenty Years of Progress, an Integrated Research Framework, and Future Research Avenues

Medical simulations have led to extensive developments in emergency medicine. Apart from the growing number of applications and research efforts in patient safety, few studies have focused on modalities, research methods, and professions via a synthesis of simulation studies with a focus on non-technical skills training. Intersections between medical simulation, non-technical skills training, and emergency medicine merit a synthesis of progress over the first two decades of the 21st century. Drawing on research from the Web of Science Core Collection's Science Citation Index Expanded and Social Science Citation Index editions, results showed that medical simulations were found to be effective, practical, and highly motivating. More importantly, simulation-based education should be a teaching approach, and many simulations are utilised to substitute high-risk, rare, and complex circumstances in technical or situational simulations. (1) Publications were grouped by specific categories of non-technical skills, teamwork, communication, diagnosis, resuscitation, airway management, anaesthesia, simulation, and medical education. (2) Although mixed-method and quantitative approaches were prominent during the time period, further exploration of qualitative data would greatly contribute to the interpretation of experience. (3) High-fidelity dummy was the most suitable instrument, but the tendency of simulators without explicitly stating the vendor selection calls for a standardised training process. The literature study concludes with a ring model as the integrated framework of presently known best practices and a broad range of underexplored research areas to be investigated in detail.

Communicating Diagnostic Uncertainty at Emergency Department Discharge: A Simulation-Based Mastery Learning Randomized Trial

PURPOSE

There are no standardized approaches for communicating with patients discharged from the emergency department with diagnostic uncertainty. This trial tested efficacy of the Uncertainty Communication Education Module, a simulation-based mastery learning curriculum designed to establish competency in communicating diagnostic uncertainty.

METHOD

Resident physicians at 2 sites participated in a 2-arm waitlist randomized controlled trial from September 2019 to June 2020. After baseline (T1) assessment of all participants via a standardized patient encounter using the Uncertainty Communication Checklist (UCC), immediate access physicians received training in the Uncertainty Communication Education Module, which included immediate feedback, online educational modules, a smartphone-based application, and telehealth deliberate practice with standardized patients. All physicians were retested 16-19 weeks later (T2) via in-person standardized patient encounters; delayed access physicians then received the intervention. A final test of all physicians occurred 11-15 weeks after T2 (T3). The primary outcome measured the percentage of physicians in the immediate versus delayed access groups meeting or exceeding the UCC minimum passing standard at T2.

RESULTS

Overall, 109 physicians were randomized, with mean age 29 years (range 25-46). The majority were male (n = 69, 63%), non-Hispanic/Latino (n = 99, 91%), and White (n = 78, 72%). At T2, when only immediate access participants had received the curriculum, immediate access physicians demonstrated increased mastery (n = 29, 52.7%) compared with delayed access physicians (n = 2, 3.7%, P < .001; estimated adjusted odds ratio of mastery for the immediate access participants, 31.1 [95% CI, 6.8-143.1]). There were no significant differences when adjusting for training site or stage of training.

CONCLUSIONS

The Uncertainty Communication Education Module significantly increased mastery in communicating diagnostic uncertainty at the first postintervention test among emergency physicians in standardized patient encounters. Further work should assess the impact of clinical implementation of these communication skills.

Teaching the science of uncertainty

As we increasingly acknowledge the ubiquitous nature of uncertainty in clinical practice (Meyer AN, Giardina TD, Khawaja L, Singh H. Patient and clinician experiences of uncertainty in the diagnostic process: current understanding and future directions. Patient Educ Counsel 2021;104:2606-15; Han PK, Klein WM, Arora NK. Varieties of uncertainty in health care: a conceptual taxonomy. Med Decis Making 2011;31:828-38) and strive to better define this entity (Lee C, Hall K, Anakin M, Pinnock R. Towards a new understanding of uncertainty in medical education. J Eval Clin Pract 2020; Bhise V, Rajan SS, Sittig DF, Morgan RO, Chaudhary P, Singh H. Defining and measuring diagnostic uncertainty in medicine: a systematic review. J Gen Intern Med 2018;33:103-15), as educators we should also design, implement, and evaluate curricula addressing clinical uncertainty. Although frequently encountered, uncertainty is often implicitly referred to rather than explicitly discussed (Gärtner J, Berberat PO, Kadmon M, Harendza S. Implicit expression of uncertainty - suggestion of an empirically derived framework. BMC Med Educ 2020;20:83). Increasing explicit discussion of - and comfort with -uncertainty has the potential to improve diagnostic reasoning and accuracy and improve patient care (Dunlop M, Schwartzstein RM. Reducing diagnostic error in the intensive care unit. Engaging. Uncertainty when teaching clinical reasoning. Scholar;1:364-71). Discussion of both diagnostic and prognostic uncertainty with patients is central to shared decision-making in many contexts as well, (Simpkin AL, Armstrong KA. Communicating uncertainty: a narrative review and framework for future research. J Gen Intern Med 2019;34:2586-91) from the outpatient setting to the inpatient setting, and from undergraduate medical education (UME) trainees to graduate medical education (GME) trainees. In this article, we will explore the current status of how the science of uncertainty is taught from the UME curriculum to the GME curriculum, and describe strategies how uncertainty can be explicitly discussed for all levels of trainees.

"Unfortunately, I don't have an answer for you": How resident physicians communicate diagnostic uncertainty to patients during emergency department discharge

OBJECTIVE

To describe how emergency medicine resident physicians discuss diagnostic uncertainty during a simulated ED discharge discussion.

METHODS

A secondary content analysis of simulated clinical encounter audiotapes completed by emergency medicine residents across two sites.

RESULTS

When discussing lack of diagnosis, residents explained the evaluation revealed no cause for symptoms, noted concerning diagnoses that were excluded, and acknowledged both symptoms and patients' feelings. Residents used explicit and implicit language to discuss diagnostic uncertainty with similar frequency. Almost half of the residents discussed the ED role as focused on emergent illness to give patients context for their uncertain diagnoses. However, 28% of residents in this study did not discuss diagnostic uncertainty in any form. All residents provided reassurance.

CONCLUSION

Residents use a range of approaches to discuss diagnostic uncertainty with patients at the time of a simulated ED discharge, with some residents omitting discussion of uncertainty entirely.

PRACTICE IMPLICATIONS

These findings represent the current state of communication, which needs improvement. These findings do not immediately transfer to clinical practice recommendations, but rather support a need for both further study and development of formal communication training on this topic.

There's an app for that: Teaching residents to communicate diagnostic uncertainty through a mobile gaming application

BACKGROUND

Clear communication is integral to good clinical care; however, communication training is cost and time intensive. Mobile applications (apps) may provide a useful adjunct to traditional simulation skills training.

OBJECTIVE

To evaluate (1) use of an app for teaching communication skills about diagnostic uncertainty, (2) feedback on app use, and (3) the association between use and skill mastery.

PATIENT INVOLVEMENT

The app under study is designed to improve doctor-patient communication.

METHODS

The study was a planned sub-analysis of a randomized controlled waitlist trial with emergency medicine resident physicians randomized to receive immediate or delayed access to an educational curriculum focused on diagnostic uncertainty. The curriculum included a web-based interactive module and the app. Metrics describing participants' use of the app, feedback on use, and association of use and achieving mastery in communicating diagnostic uncertainty are reported. Differences between groups utilizing the app were analyzed using Chi-squared test; logistic regression assessed the association between app use and achieving mastery of the communication skill.

RESULTS

Among 109 participants completing the trial, only 34 (31.2%) used the app. Most participants engaged with the app on one occasion for a median of 50 min (IQR 31, 87). Senior residents were more likely to use the app than junior residents (41.3% vs 23.8%, p=0.05). Overall reviews were positive; 76% reported the app helped them learn. There was no significant association between app use and achieving mastery of the communication skill in the trial [OR 2.1, 95% CI (0.91-4.84)].

DISCUSSION

Despite positive reviews of app use, overall use was low and there was no association with achieving mastery.

PRACTICAL VALUE

Offering an app as an auxiliary training opportunity may be beneficial to some residents, but shouldn't be planned for use as a primary didactic modality unless there is evidence for effectiveness and use is mandated.

AVAILABILITY OF DATA AND MATERIALS

The datasets generated and/or analyzed during the current study are not publicly available since some data may be identifiable but are available from the corresponding author on reasonable request.

Emergency Medicine Clinician Experiences Addressing Uncertainty in First-Trimester Bleeding

The purpose of this work is to understand Emergency Department (ED) clinicians’ experiences in communicating uncertainty about first-trimester bleeding (FTB) and their need for training on this topic. This cross-sectional study surveyed a national sample of attending physicians and advanced practice providers (APPs). The survey included quantitative and qualitative questions about communicating with patients presenting with FTB. These questions assessed clinicians’ frequency encountering challenges, comfort, training, prior experience, and interest in training on the topic. Of 402 respondents, 54% reported that they encountered challenges at least sometimes when discussing FTB with patients where the pregnancy outcome is uncertain. While the majority (84%) were at least somewhat prepared for these conversations from their training, which commonly addressed the diagnostic approach to this scenario, 39% strongly or moderately agreed that they could benefit from training on the topic. Because the majority of ED clinicians identified at least sometimes encountering challenges communicating with pregnant patients about FTB, our study indicates a need exists for more training in this skill.

Patient and clinician experiences of uncertainty in the diagnostic process: Current understanding and future directions

OBJECTIVE

Uncertainty occurs throughout the diagnostic process and must be managed to facilitate accurate and timely diagnoses and treatments. Better characterization of uncertainty can inform strategies to manage it more effectively in clinical practice. We provide a comprehensive overview of current literature on diagnosis-related uncertainty describing (1) where patients and clinicians experience uncertainty within the diagnostic process, (2) how uncertainty affects the diagnostic process, (3) roots of uncertainty related to probability/risk, ambiguity, or complexity, and (4) strategies to manage uncertainty.

DISCUSSION

Each diagnostic process step involves uncertainty, including patient engagement with the healthcare system; information gathering, interpretation, and integration; formulating working diagnoses; and communicating diagnoses to patients. General management strategies include acknowledging uncertainty, obtaining more contextual information from patients (e.g., gathering occupations and family histories), creating diagnostic safety nets (e.g., informing patients what red flags to look for), engaging in worst case/best case scenario planning, and communicating diagnostic uncertainty to patients, families, and colleagues. Potential strategies tailored to various aspects of diagnostic uncertainty are also outlined.

CONCLUSION

Scientific knowledge on diagnostic uncertainty, while previously elusive, is now becoming more clearly defined. Next steps include research to evaluate relationships between management and communication of diagnostic uncertainty and improved patient outcomes.