Debriefing for the Transfer of Learning: The Importance of Context

The 2024 French guidelines for scenario design in simulation-based education: manikin-based immersive simulation, simulated participant-based immersive simulation and procedural simulation

BACKGROUND

Simulation-based education in healthcare encompasses a wide array of modalities aimed at providing realistic clinical experiences supported by meticulously designed scenarios. The French-speaking Society for Simulation in Healthcare (SoFraSimS) has developed guidelines to assist educators in the design of scenarios for manikin- or simulated participant- based immersive simulation and procedural simulation, the three mainly used modalities.

METHODS

After establishing a French-speaking group of experts within the SoFraSimS network, we performed an extensive literature review with theory-informed practices and personal experiences. We used this approach identify the essential criteria for practice-based scenario design within the three simulation modalities.

RESULTS

We present three comprehensive templates for creating innovative scenarios and simulation sessions, each tailored to the specific characteristics of a simulation modality. The SoFraSimS templates include five sections distributed between the three modalities. The first section contextualizes the scenario by describing the practicalities of the setting, the instructors and learners, and its connection to the educational program. The second section outlines the learning objectives. The third lists all the elements necessary during the preparation phase, describing the educational method used for procedural simulation (such as demonstration, discovery, mastery learning, and deliberate practice). The fourth section addresses the simulation phase, detailing the behaviors the instructor aims to analyze, the embedded triggers, and the anticipated impact on simulation proceedings (natural feedback). This ensures maximum control over the learning experience. Finally, the fifth section compiles elements for post-simulation modifications to enhance future iterations.

CONCLUSION

We trust that these guidelines will prove valuable to educators seeking to implement simulation-based education and contribute to the standardization of scenarios for healthcare students and professionals. This standardization aims to facilitate communication, comparison of practices and collaboration across different learning and healthcare institutions.

Patient safety, what does clinical simulation and teaching innovation contribute?

Clinical simulation in Intensive Care Medicine is a crucial tool to strengthen patient safety. It focuses on the complexity of the Intensive Care Unit, where challenging clinical situations require rapid decision making and the use of invasive techniques that can increase the risk of errors and compromise safety. Clinical simulation, by mimicking clinical contexts, is presented as essential for developing technical and non-technical skills and enhancing teamwork in a safe environment, without harm to the patient. in situ simulation is a valuable approach to practice in realistic environments and to address latent security threats. Other simulation methods as virtual reality and tele-simulation are gaining more and more acceptance. Herein, we provide current data on the clinical utility of clinical simulation related to improved safety in the practice of techniques and procedures, as well as improvements of teamwork performance and outcomes. Finally, we propose the needs for future research.

Teaching Before, During, and After a Surgical Resuscitation

Teaching during a surgical resuscitation can be difficult due to the infrequency of these events. Furthermore, when these events do occur, the trainee can experience cognitive overload and an overwhelming amount of stress, thereby impairing the learning process. The emergent nature of these scenarios can make it difficult for the surgical educator to adequately teach. Repeated exposure through simulation, role play, and "war games" are great adjuncts to teaching and preparation before crisis. However, surgical educators can further enhance the knowledge of their trainees during these scenarios by using tactics such as talking out loud, targeted teaching, and debriefing.

A comparison of rapid cycle deliberate practice and traditional reflective debriefing on interprofessional team performance

BACKGROUND

In simulation-based education, debriefing is necessary to promote knowledge acquisition and skill application. Rapid Cycle Deliberate Practice (RCDP) and Traditional Reflective Debriefing (TRD) are based in learning theories of deliberate practice and reflective learning, respectively. In this study, we compared the effectiveness of TRD versus RCDP on acquisition of conceptual knowledge and teamwork skills among interdisciplinary learners in the pediatric emergency department.

METHODS

One hundred sixty-four learners including emergency department attending physicians, fellows, nurses, medical technicians, paramedics, and respiratory therapists, participated in 28 in-situ simulation workshops over 2 months. Groups were quasi-randomized to receive RCDP or TRD debriefing. Learners completed a multiple-choice test to assess teamwork knowledge. The TEAM Assessment Tool assessed team performance before and after debriefing. Primary outcomes were teamwork knowledge and team performance.

RESULTS

Average pre-intervention baseline knowledge assessment scores were high in both groups (TRD mean 90.5 (SD 12.7), RCDP mean 88.7 (SD 15.5). Post-test scores showed small improvements in both groups (TRD mean 93.2 (SD 12.2), RCDP mean 89.9 (SD 13.8), as indicated by effect sizes (ES = 0.21 and 0.09, for TRD and RCDP, respectively). Assessment of team performance demonstrated a significant improvement in mean scores from pre-assessment to post-assessment for all TEAM Assessment skills in both TRD and RCDP arms, based on p-values (all p < 0.01) and effect sizes (all ES > 0.8). While pre-post improvements in TEAM scores were generally higher in the RCDP group based on effect sizes, analysis did not indicate either debriefing approach as meaningfully improved over the other.

CONCLUSIONS

Our study did not demonstrate that either TRD versus RCDP was meaningfully better in teamwork knowledge acquisition or improving skill application and performance. As such, we propose Reflective Deliberate Practice as a framework for future study to allow learners to reflect on learning and practice in action.

Nursing students learning transfer from classroom to clinical practice: An integrative review

AIM

The aim of this integrative review was to examine the theoretical, qualitative, quantitative and mixed-methods literature focused on how nursing students transfer learning from theory courses into clinical practice.

BACKGROUND

As nursing curriculum aligns with the growing body of nursing knowledge, nursing students continue to develop their knowledge base and skill sets to prepare for future nursing practice. The bulk of this preparation involves developing connections between classroom/lab knowledge and further demonstrating those connections in clinical practice. However, the extant state of evidence on undergraduate nursing students' learning transfer has not yet been synthesized.

DESIGN

This integrative review was conducted using the Whittemore and Knafl framework.

REVIEW METHODS

Eight databases were searched in June 2022: MEDLINE, APA PsycInfo, EMBASE, Web of Science, CINAHL, ERIC, Academic Search Complete and Education Research Complete. Literature was included if it focused on undergraduate nursing students who have participated in at least one clinical practicum and reported on learning transfer in clinical settings. Only English-language, peer-reviewed literature was included. Two researchers independently assessed the eligibility of articles at the title-and-abstract level and at the full-text level, followed by an assessment of methodological quality. The Joanna Briggs Institute's critical appraisal checklists were used to assess theoretical papers and literature reviews and the mixed-methods appraisal tool (MMAT) was used to appraise all studies. Reference lists of included articles were searched for additional relevant literature. Reporting followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement guidelines.

RESULTS

Twenty-eight articles met our inclusion criteria and were included in this review, including 20 qualitative studies, one quantitative study, three mixed-methods studies, three theoretical articles and one integrative review. The results of this review highlighted that numerous facilitators and barriers influence nursing students' ability to transfer learning within clinical learning environments. Facilitators included having knowledgeable and supportive educators and nursing staff, using strategies to promote connections, fostering reflection and aligning theory and practice. Barriers included unclear connections between course content, incongruencies between classroom and practice, lack of nurse role models, lack of real-world applicability and unsupportive nurse educators.

CONCLUSIONS

The information generated from this integrative review provides evidence about barriers that can be mitigated and facilitators that can be leveraged to facilitate undergraduate nursing students' learning transfer into clinical practice. The findings also highlighted gaps in evidence surrounding the need to understand how nursing students transfer learning from classroom settings to clinical practice settings.

Academic half days, noon conferences and classroom-based education in postgraduate medical education: a scoping review

BACKGROUND

Classroom-based education (CBE) is ubiquitous in postgraduate medical education (PGME), but to date no studies have synthesized the literature on the topic. We conducted a scoping review focusing on academic half days and noon conferences.

METHODS

We searched 4 databases (MEDLINE [OVID], Embase [OVID], ERIC [EBSCO] and Web of Science) from inception to December 2021, performed reference and citation harvesting, and applied predetermined inclusion and exclusion criteria to our screening. We used 2 frameworks for the analysis: "experiences, trajectories and reifications" and "description, justification and clarification."

RESULTS

We included 90 studies, of which 55 focused on resident experiences, 29 on trajectories and 6 on reification. We classified 44 studies as "description," 38 as "justification" and 8 as "clarification." In the description studies, 12 compared academic half days with noon conferences, 23 described specific teaching topics, and 9 focused on resources needed for CBE. Justification studies examined the effects of CBE on outcomes, such as examination scores (17) and use of teaching strategies in team-based learning, principles of adult learning and e-learning (15). Of the 8 clarification studies, topics included the role of CBE in PGME, stakeholder perspectives and transfer of knowledge between classroom and workplace.

INTERPRETATION

Much of the existing literature is either a description of various aspects of CBE or justification of particular teaching strategies. Few studies exist on how and why CBE works; future studies should aim to clarify how CBE facilitates resident learning within the sociocultural framework of PGME.

Assessment of the Building Situation Tool Adoption Among Firefighters

Technology is a standard tool that first responders use in their assessment and planning during disasters. Despite the considerable number of hardware and software solutions adopted, first responders still often rely on paper plans when examining indoor disasters. The purpose of this research is to investigate the technical competencies of firefighters and test the building situation tool (BUST) to replace the paper plans. A mixed method approach was used to assess the technology self-efficacy and gather insight into perceived usefulness, ease of use, and the user experience from the firefighters (N=20). The findings show a sufficient level of competency, and that first time users prefer guided instructions, clarity in the user interface, controls, and options to customize the user interface. The findings have practical implications for the future development of BUST and its adoption to the workflow of firefighters.

Effects of Debriefing on Motivation and Reflective Thinking of Nursing Students during In-School Practicum Using a Flipped Learning Model

Debriefing and flipped learning have been determined to be useful strategies for nursing education. Recently, it has been reported that applying debriefing and flipped learning together was helpful for educational outcomes. The objective of this study was to compare learning motivation and reflective thinking before and after debriefing during nursing practicums that applied flipped learning. We implemented a quasi-experimental procedure in the form of a pretest-posttest non-equivalent control group design (1 September to 22 October 2021). The participants comprised 63 nursing students in South Korea (33 in the experimental group and 30 in the control group). Each group took part in a nursing practice class, wherein the experimental group engaged in debriefing using flipped learning, while the control group engaged only in flipped learning. We then examined academic motivation and reflective thinking in both the groups, and found that reflective thinking was significantly higher in the experimental group (53.67 ± 5.71) versus the control group (50.80 ± 4.69) (t = 2.165, p = 0.034). However, there were no differences in learning motivation between the two groups (t = 1.864, p = 0.067). In sum, this study confirmed the benefits of this new teaching approach, in which debriefing and flipped learning were integrated and incorporated into a nursing practice class. Given our promising results, this approach can be applied in various cases to strengthen the clinical practice skills of nursing students.

The Use of Simulation-Based Education With New Graduate Nurses in Emergency Department and Acute Care Settings: A Scoping Review

Background The literature questions if newly graduated nurses are truly ready to practice at the bedside. Simulation has been shown to bridge the gap between theory and practice. The purpose of this study was to investigate what is known about the use of simulation education with novice graduate nurses in critical care settings in the hospital. Method A scoping review was conducted using the PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Articles published in English between 2015 and September 2021 that focused on simulation education with novice graduate nurses in a critical care setting were included. Results The review yielded six articles. Conclusion The literature is scant on the use of simulation in critical care areas with novice graduate nurses. Additional inquiry is needed related to the role of learners, cost, timing, setting, and educational practices. More studies with stronger research designs and valid and reliable measurement instruments are also needed. Finally, there is a need to better understand the effects of simulation on novice nurse graduates' knowledge and skills as well as patient outcomes. [J Contin Educ Nurs. 2022;53(7):301-306.].

Developing Situation Awareness in Simulation Prebriefing

BACKGROUND

Prebriefing before simulation is a recommended practice that increases learner satisfaction and improves performance. Promoting situation awareness through prebriefing facilitates optimal learning outcomes.

METHOD

Endsley's Model of Situation Awareness is applied to the cognitive work of nursing practice that occurs during the prebriefing phase of simulation. Perceiving, comprehending, and projecting about elements of a situation lead to clinical judgement, reasoning, decision making, and ultimately nursing actions.

RESULTS

Developing situation awareness in prebriefing is a supported process that connects learners' prior knowledge and experience with the needed knowledge, skills, and abilities in the simulation environment. These mental models become the foundation for understanding the relevance of perceived information, comprehending its meaning, and directing nursing actions.

CONCLUSION

The simulation facilitator influences the development of situation awareness by focusing perception on key elements and scenario objectives, fostering psychological safety, and enhancing familiarity with the simulation environment during prebriefing. [J Nurs Educ. 2022;61(5):250-256.].

The community of inquiry framework for virtual team-to-team debriefings during interprofessional trauma simulations

Purpose

Psychological safety is key to effective debriefing and learning. The COVID-19 pandemic necessitated rapid adaption of simulation events to virtual/hybrid platforms. We sought to determine the effect of utilizing the Community of Inquiry framework (CoI) for debriefing virtually connecting interprofessional learner teams on the psychological safety experienced during trauma simulations.

Methods

General surgery (GSR), emergency medicine (EMR) residents, trauma nurses/nurse practitioners and medical students participated in multiple simulation events designed to improve teamwork and leadership skills. Pre-course materials were provided before the event for learners to prepare. Briefings delineating expectations emphasized importance of and strategies employed to achieve psychological safety. Four unique clinical scenarios were run for each simulation event, with a debrief after each scenario. Virtual team-to-team debriefings were structured using the Community of Inquiry (CoI) conceptual framework. All learners completed pre-/post-assessments utilizing Inter-professional Collaborative Competencies Attainment Survey (ICCAS).

Results

Twenty-five learners participated (13 GSR, 5 EMR, 3 medical students, 2 trauma APRNs and 2 trauma RNs). Learner assessment found 88% (22) "agreed"/"strongly agreed" that virtual team-to-team debriefing had social, cognitive and educator presence per the CoI domains. However, one GSR and two nurse learners "strongly disagreed" with these statements. Most learners felt the debriefing was effective and safe. All participants "strongly agreed"/"agreed" the simulation achieved ICCAS competencies.

Conclusions

Debriefings utilizing a virtual platform are challenging with multiple barriers to ensuring psychological safety and efficacy. By structuring debriefings using the CoI framework we demonstrate they can be effective for most learners. However, educators should recognize the implications of social identity theory, particularly the effects of hierarchy, on comfort level of learners. Developing strategies to optimize virtual simulation learning environments is essential as this valuable pedagogy persists during and beyond the COVID-19 pandemic.

Decontextualisation for framing effect reduction

BACKGROUND

The aim of this study is to demonstrate the presence of a framing effect that influences residents' decision-making and to assess decontextualisation as an intervention strategy to reduce the influence of framing on their decision.

METHODS

This is a randomised controlled trial in which researchers sent an evaluation questionnaire to all residents of … University including clinical vignettes, with questions formulated in two different ways on the same subject and a decontextualisation test involving logical reasoning problems. The researchers then sent to all participants different clinical vignettes evaluating the same dimensions as those addressed in the previous part.

RESULTS

The response rate was 86 (28.2%), of which they included 52 (60.4%) in the analysis. The framing effect was present in 37 (71.1%) of responses and then decreased to 35 (67.3%) after the decontextualisation test, especially at the level of the type of framing involving risky decision-making (p = 0.03).

DISCUSSION

Decontextualisation is an effective strategy for reducing bias related to the framing effect among residents, particularly the type of framing involving risky decision-making. In medical teaching, decontextualisation exercises may help improve critical thinking and reduce the framing effect.

Transfer of training from an internal medicine boot camp to the workplace: enhancing and hindering factors

BACKGROUND

The transfer of training to the workplace is the aim of training interventions. Three primary factors influence transfer: trainee characteristics, training design and work environment influences. Within medical education, the work environment factors influencing transfer of training remain underexplored. Burke and Hutchins' review of training transfer outlined five work environment influences: opportunity to perform, supervisor/peer support, strategic link, transfer climate and accountability. This study aimed to explore the ways in which work environment factors influence the transfer of training for medical trainees.

METHODS

Internal Medicine Training in Scotland includes a three-day boot camp involving simulation-based mastery learning of procedural skills, immersive simulation scenarios and communication workshops. Following ethical approval, trainees were invited to take part in interviews at least three months after following their boot camp. Interviews were semi-structured, anonymised, transcribed verbatim and analysed using template analysis. Member checking interviews were performed to verify findings.

RESULTS

A total of 26 trainees took part in interviews between January 2020 and January 2021. Trainees reported a lack of opportunities to perform procedures in the workplace and challenges relating to the transfer climate, including a lack of appropriate equipment and resistance to change in the workplace. Trainees described a strong sense of personal responsibility to transfer and they felt empowered to change practice in response to the challenges faced.

CONCLUSIONS

This study highlights barriers to transfer of training within the clinical workplace including procedural opportunities, a transfer climate with challenging equipment availability and, at times, an unsupportive workplace culture. Trainees are driven by their own sense of personal responsibility; medical educators and healthcare leaders must harness this enthusiasm and take heed of the barriers to assist in the development of strategies to overcome them.

Impact of palliative care simulation on nursing students' learning outcomes and reported use in hospital placement

Aim

Nursing students report emotional distress and feelings of inadequacy to the complexity of palliative care. This study aimed to examine nursing students’ attainment of learning outcomes in palliative care through simulation and hospital placement.

Design

A longitudinal, intervention study.

Methods

Fifty‐five second‐year bachelor nursing students participated. Three waves of assessments were performed: (1) pretest; (2) postsimulation test and (3) postplacement test after the completion of the placement. Non‐parametric Wilcoxon's signed‐rank test for paired samples was used to test for differences between assessments of knowledge, skills and competence before and after simulation, and between postsimulation and post hospital placement.

Results

The results showed positive differences between pre‐ and postsimulation, indicating that learning outcomes were attained through simulation. However, negative differences between the postplacement test and postsimulation test scores indicated that the participants had practiced learning outcome from the simulation to a small degree during placement.

Simulation Interventions for the Classroom to Support the Acquisition of Interprofessional Competencies

Interprofessional collaboration (IPC) supports the delivery of quality and safe healthcare. The acquisition of interprofessional competencies both pre-licensure and post-licensure are key to implementing this approach in the healthcare workplace. This report documents the development and implementation of a simulation intervention to support interprofessional education (IPE) in the undergraduate classroom for pre-licensure learners. The learning activity framework includes an exposure phase (e.g., didactic classroom instruction) and an immersion phase (e.g., simulation intervention and debriefing). Details on the debriefing process are included as it is key to achieving the learning objectives. The three learning activity pilot tests (n=150) revealed that learners recognized that interprofessional competencies were an important asset to support IPC. The pilot tests identified the need for further development in order for students to make a connection with the mastery phase (i.e., clinical placement). The next steps will include the development and incorporation of formative tools to assess learners' progress, as well as a plan to evaluate the learning activity that will connect all three phases (exposure, immersion, and mastery) of the learning framework.

Identifying Entrustable Professional Activities for Shared Decision Making in Postgraduate Medical Education: A National Delphi Study

PURPOSE

Although shared decision making (SDM) is considered the preferred approach in medical decision making, it is currently not routinely used in clinical practice. To bridge the transfer gap between SDM training and application, the authors aimed to reach consensus on entrustable professional activities (EPAs) for SDM and associated behavioral indicators as a framework to support self-directed learning during postgraduate medical education.

METHOD

Using existing literature on SDM frameworks and competencies; input from an interview study with 17 Dutch experts in SDM, doctor-patient communication, and medical education; and a national SDM expert meeting as a starting point, in 2017, the authors conducted a modified online Delphi study with a multidisciplinary Dutch panel of 32 experts in SDM and medical education.

RESULTS

After 3 Delphi rounds, consensus was reached on 4 EPAs-(1) the resident discusses the desirability of SDM with the patient, (2) the resident discusses the options for management with the patient, (3) the resident explores the patient's preferences and deliberations, and (4) the resident takes a well-argued decision together with the patient. Consensus was also reached on 18 associated behavioral indicators. Of the 32 experts, 30 (94%) agreed on this list of SDM EPAs and behavioral indicators.

CONCLUSIONS

The authors succeeded in developing EPAs and associated behavioral indicators for SDM for postgraduate medical education to improve the quality of SDM training and the application of SDM in clinical practice. These EPAs are characterized as process EPAs for SDM in contrast with content EPAs related to diverse medical complaints. A next step is the implementation of the SDM EPAs in existing competency-based workplace curricula.

Teaching the use of framing and decontextualization to address context-based bias in psychiatry

The framing effect in medical decision making is a type of cognitive bias that can lead a medical trainee at undergraduate and graduate level to reach a diagnosis or take action based on emotional states induced by the frame in which the information has been approached. This literature review on the framing effect in medical decision making will be done in the context of a case presentation in which the framing of scientific information may lead to conflicting decisions in psychiatry. As a matter of fact, debiasing techniques which help medical students/residents become aware of the fact that they might be easily influenced by the frame used in scientific data, have started to be implemented in medical teaching programs. It is important to incorporate exercises that improve debiasing skills in the curriculum at all levels of medical education. An example of such exercises is decontextualization which consists of improving problem-solving in a non-medical context in order to consolidate the use of the same schema of critical thinking in a medical context afterwards.

The impact of a three-phase video-assisted debriefing on nursing students' debriefing experiences, perceived stress and facilitators' practices: A mixed methods study

BACKGROUND

As an integral part of simulation, debriefing helps learners to construct knowledge through reflecting, internalizing, and relating. Video-assisted debriefing (VAD) adds audio-visual captures and reviews to support traditional verbal debriefing (VD), but evidence evaluating its educational effects has been mixed, with limited attention focusing on its structure development.

AIMS

This study aimed to 1) investigate the effects of a three-phase VAD in enhancing nursing students' debriefing experiences and perceived stress compared to VD and 2) to explore its impact on facilitators' debriefing practices.

METHODS

A mixed-methods design was adopted. The quantitative phase involved a prospective controlled trial on 145 nursing students from a university in Singapore who were randomized into the intervention cluster (n = 72) and the control cluster (n = 73). The debriefing experience scale (DES), the stress visual analogue scale (Stress VAS), and the debriefing assessment for simulation in healthcare (DASH© student version) were used as outcome measures. For the qualitative component, a purposive sample of eight facilitators evaluated their own debriefing practices using the DASH© instructor version and each completed an open-ended question survey. Qualitative data were analyzed using content analysis.

RESULTS

Students from the intervention cluster significantly improved their debriefing experiences (p = 0.01), experienced comparable stress, and had better impressions of VAD facilitators' practices (p < 0.001) compared to those in the control cluster. Repeated VAD significantly reduced students' stress (p < 0.001). Students viewed the VAD facilitators as more effective than the VD facilitators. Three categories were derived from the qualitative comments: the act of debriefing, the crux of VAD, and debriefing for success.

CONCLUSION

The three-phase VAD significantly improved nursing students' debriefing experiences without adding extra stress. It also helped to improve facilitators' practices. Future research will benefit from exploring how experts facilitate the three-phase VAD "on the ground" and its effect on learning transfer and cost-effectiveness.

[Introduction to debriefing for internists: how to transform real or simulated clinical situations into learning moments]

Debriefing is a phase of synthesis and reflection that immediately follows a real-life or simulated situation. It is an essential educational step that forces the learners to reflect upon the thought processes that underlie their actions. Debriefing encourages a personal and collective reflection in order to remodel erroneous mental schemas and rectify actions done in context. Debriefing cannot be improvised; it requires a sound structure and regular practice in order to be truly effective. The debriefer must be considerate, choose appropriate learning objectives and dedicate ample time to the learners. Debriefing is focused on learning acquired in context-in other words, on the actions that were performed within a real-life or simulated clinical practice situation-and immediately follows the situation. After an initial phase of emotional release, the debriefer will help learners analyse their actions to identify their underlying rationale (contextualization), extract the overarching principles related to the lived situation in order to modify the rationale if needed (decontextualization) and assist the transfer of learning to real life (in the case of simulation) and to similar situations (recontextualization). A final summary of learning achieved during the training session concludes the debriefing. Debriefing is useful in any learning situation, including in internal medicine. Even if simulation is still underused in internal medicine, post-event debriefing can be implanted in our clinical services. Indeed, training our students and shaping them into healthcare professionals rest in no small part on hospital rotations where the intern is confronted with real-patient situations that are suitable to learning. Some in-hospital clinical encounters can be actively transformed into learning opportunities thanks to post-event debriefing, but can also passively morph into bad daily practice if no supporting action is implemented. Debriefing can thus provide an opportunity to develop non-technical skills in critical situations, or doctor-patient communication skills, within a team or between colleagues. These competencies are the hallmark of well-trained interns and are indispensable for the proper functioning of a care team. We will not develop the emotional and psychological management of debriefing in this article. We hope we will helpfully introduce as many of our colleagues as possible to the art of debriefing in most circumstances.

The "Timeline Debriefing Tool": a tool for structuring the debriefing description phase

Several recent literature reviews have been published with the aim to determine how to optimise a debriefing. A main element found in these reviews was the importance of structuring the debriefing. Within the steps usually outlined in the debriefing, the description phase allows participants to describe their recollections and establish a shared mental model of what happened during the simulation. The description phase is used in many debriefing models but how to realise this description remains unclear. We provide an original tool to ensure a highly structured description phase: the “Timeline Debriefing Tool”.

The Timeline Debriefing Tool, or TDT, is constructed on visual support such as a whiteboard or a flipchart. It allows for a clear description phase, makes the process more dynamic, promotes exchanges between participants and establishes a clear and shared vision of the simulation in visual support which can be used by the instructor in the analysis phase. Moreover, the timeline allows participants to discover their performance gaps by themselves, thus beginning deeper cognitive processing in the participants’ mind and promoting reflection in the analysis phase.

A new tool for assessing short debriefings after immersive simulation: validity of the SHORT scale

BACKGROUND

Simulation is being increasingly used worldwide in healthcare education. However, it is costly both in terms of finances and human resources. As a consequence, several institutions have designed programs offering several short immersive simulation sessions, each followed by short debriefings. Although debriefing is recommended, no tool exists to assess appropriateness of short debriefings after such simulation sessions. We have developed the Simulation in Healthcare retrOaction Rating Tool (SHORT) to assess short debriefings, and provide some validity evidence for its use.

METHODS

We designed this scale based on our experience and previously published instruments, and tested it by assessing short debriefings of simulation sessions offered to emergency medicine residents at Laval University (Canada) from 2015 to 2016. Analysis of its reliability and validity was done using Standards for educational and psychological testing. Generalizability theory was used for testing internal structure evidence for validity.

RESULTS

Two raters independently assessed 22 filmed short debriefings. Mean debriefing length was 10:35 (min 7:21; max 14:32). Calculated generalizability (reliability) coefficients are φ = 0.80 and φ-λ3 = 0.82. The generalizability coefficient for a single rater assessing three debriefings is φ = 0.84.

CONCLUSIONS

The G study shows a high generalizability coefficient (φ ≥ 0.80), which demonstrates a high reliability. The response process evidence for validity provides evidence that no errors were associated with using the instrument. Further studies should be done to demonstrate validity of the English version of the instrument and to validate its use by novice raters trained in the use of the SHORT.