Filming for auditing of real-life emergency teams: a systematic review

Video analysis of real-life shoulder dystocia to assess technical and non-technical performance

INTRODUCTION

Managing obstetric shoulder dystocia requires swift action using correct maneuvers. However, knowledge of obstetric teams' performance during management of real-life shoulder dystocia is limited, and the impact of non-technical skills has not been adequately evaluated. We aimed to analyze videos of teams managing real-life shoulder dystocia to identify clinical challenges associated with correct management and particular non-technical skills correlated with high technical performance.

MATERIAL AND METHODS

We included 17 videos depicting teams managing shoulder dystocia in two Danish delivery wards, where deliveries were initially handled by midwives, and consultants were available for complications. Delivery rooms contained two or three cameras activated by Bluetooth upon obstetrician entry. Videos were captured 5 min before and after activation. Two obstetricians assessed the videos; technical performances were scored as low (0-59), average (60-84), or high (85-100). Two other assessors evaluated non-technical skills using the Global Assessment of Team Performance checklist, scoring 6 (poor) to 30 (excellent). We used a spline regression model to explore associations between these two score sets. Inter-rater agreement was assessed using interclass correlation coefficients.

RESULTS

Interclass correlation coefficients were 0.71 (95% confidence interval 0.23-0.89) and 0.82 (95% confidence interval 0.52-0.94) for clinical and non-technical performances, respectively. Two teams had low technical performance scores; four teams achieved high scores. Teams adhered well to guidelines, demonstrating limited head traction, McRoberts maneuver, and internal rotation maneuvers. Several clinical skills posed challenges, notably recognizing shoulder impaction, applying suprapubic pressure, and discouraging women from pushing. Two non-technical skills were associated with high technical performance: effective patient communication, with teams calming the mother and guiding her collaboration during internal rotational maneuvers, and situation awareness, where teams promptly mobilized all essential personnel (senior midwife, consultant, pediatric team). Team communication, stress management, and task management skills were not associated with high technical performance.

CONCLUSIONS

Videos capturing teams managing real-life shoulder dystocia are an effective tool to reveal challenges with certain technical and non-technical skills. Teams with high technical performance are associated with effective patient communication and situational awareness. Future training should include technical skills and non-technical skills, patient communication, and situation awareness.

Quality improvement initiative: implementing and redefining video review of real-time neonatal procedures using action research

Video review (VR) of procedures in the medical environment can be used to drive quality improvement. However, first it has to be implemented in a safe and effective way. Our primary objective was to (re)define a guideline for implementing interprofessional VR in a neonatal intensive care unit (NICU). Our secondary objective was to determine the rate of acceptance by providers attending VR. For 9 months, VR sessions were evaluated with a study group, consisting of different stakeholders. A questionnaire was embedded at the end of each session to obtain feedback from providers on the session and on the safe learning environment. In consensus meetings, success factors and preconditions were identified and divided into different factors that influenced the rate of adoption of VR. The number of providers who recorded procedures and attended VR sessions was determined. A total of 18 VR sessions could be organised, with an equal distribution of medical and nursing staff. After the 9-month period, 101/125 (81%) of all providers working on the NICU attended at least 1 session and 80/125 (64%) of all providers recorded their performance of a procedure at least 1 time. In total, 179/297 (61%) providers completed the questionnaire. Almost all providers (99%) reported to have a positive opinion about the review sessions. Preconditions and success factors related to implementation were identified and addressed, including improving the pathway for obtaining consent, preparation of VR, defining the role of the chair during the session and building a safe learning environment. Different strategies were developed to ensure findings from sessions were used for quality improvement. VR was successfully implemented on our NICU and we redefined our guideline with various preconditions and success factors. The adjusted guideline can be helpful for implementation of VR in emergency care settings.

Team performance during vacuum-assisted vaginal delivery: video review of obstetric multidisciplinary teams

Introduction

Vacuum extraction is generally considered an operator-dependent task, with most attention directed toward the obstetrician's technical abilities (1-3). Little is known about the effect of the team and non-technical skills on clinical outcomes in vacuum-assisted delivery. This study aimed to investigate whether the non-technical skills of obstetricians were correlated with their level of clinical performance via the analysis of video recordings of teams conducting actual vacuum extractions.

Methods

We installed between two or three video cameras in each delivery room at Aarhus University Hospital and Horsens Regional Hospital and obtained 60 videos of teams managing vacuum extraction. Appropriate consent was obtained. Two raters carefully reviewed the videos and assessed the teams' non-technical skills using the Assessment of Obstetric Team Performance (AOTP) checklist, rating all items on a Likert scale score from 1 to 5 (1 = poor; 3 = average; and 5 = excellent). This resulted in a total score ranging from 18 to 90. Two different raters independently assessed the teams' clinical performance (adherence to clinical guidelines) using the TeamOBS-Vacuum-Assisted Delivery (VAD) checklist, rating each item (0 = not done, 1 = done incorrectly; and 2 = done correctly). This resulted in a total score with the following ranges (low clinical performance: 0-59; average: 60-84; and high: 85-100). Interrater agreement was analyzed using intraclass correlation (ICC), and the risk of high or low clinical performance was analyzed on a logit scale to meet the assumption of normality.

Results

Teams that received excellent non-technical scores had an 81% probability of achieving high clinical performance, whereas this probability was only 12% among teams with average non-technical scores (p < 0.001). Teams with a high clinical performance often had excellent behavior in the non-technical items of "team interaction," "anticipation," "avoidance fixation," and "focused communication." Teams with a low or average clinical performance often neglected to consider analgesia, had delayed abandonment of the attempted vaginal delivery and insufficient use of appropriate fetal monitoring. Interrater reliability was high for both rater-teams, with an ICC for the non-technical skills of 0.83 (95% confidence interval [CI]: 0.71-0.88) and 0.84 for the clinical performance (95% CI: 0.74-0.90).

Conclusion

Although assisted vaginal delivery by vacuum extraction is generally considered to be an operator-dependent task, our findings suggest that teamwork and effective team interaction play crucial roles in achieving high clinical performance. Teamwork helped the consultant anticipate the next step, avoid fixation, ensure adequate analgesia, and maintain thorough fetal monitoring during delivery.

Impact of video recordings review with structured debriefings on trauma team performance: a prospective observational cohort study

PURPOSE

To determine the impact of structured debriefings (SD) with audio/video review of trauma patients' resuscitation events on trauma team (TT) technical and non-technical skills.

METHODS

Single-center prospective observational cohort study. The study included all emergency department patients aged 18 years or older who received resuscitation from the TT. Virtual meeting was held with the TT using SD to review one trauma patient resuscitation video. Technical skills improvement was based on adherence to the ATLS protocol and non-technical skills based on T-NOTECHS scale.

RESULTS

There was statistically significant improvement in adherence to the ATLS protocol: 73% [55-82%] vs 91% [82-100%] (p < 0.001); and improvement in T-NOTECHS scale: 12 [10-14] vs 16 [14-19] points (p < 0.001).

CONCLUSION

In this study, we found that structured debriefings with review of patients' resuscitation video recordings can have a significant positive impact on trauma team performance in the emergency department in both technical and non-technical skills.

Record, reflect and refine: using video review as an initiative to improve neonatal care

BACKGROUND

The goal of every medical team is to provide optimal care for their patients. We aimed to use video review (VR) sessions to identify and address areas for improvement in neonatal care.

METHODS

For nine months, neonatal procedures (stabilization at birth, intubations and sterile line insertions) were video recorded and reviewed with the neonatal care providers. Action research was used to identify and address areas for improvement which were categorized as (1) protocol/equipment adjustments, (2) input for research, (3) aspects of variety, or (4) development of educational material or training programs.

RESULTS

Eighteen VR sessions were organized with a mean(SD) of 17(5) staff members participating. In total, 120 areas for improvement were identified and addressed, of which 84/120 (70%) were categorized as aspects of variety, 20/120 (17%) as development of educational material or training programs, 10/120 (8%) as protocol/equipment adjustments, and 6/120 (5%) as input for research. The areas for improvement were grouped in themes per category, including sterility, technique, equipment, communication, teamwork, parents' perspective and ventilation.

CONCLUSION

Our study showed that regularly organized VR empowered healthcare providers to identify and address a large variety of areas for improvement, contributing to continuous learning and improvement processes.

IMPACT

Video review empowered healthcare providers to identify areas for improvement in neonatal care Video review gave providers the opportunity to address identified areas for improvement, either by enhancing the application of external evidence (i.e. guidelines), learning from individual clinical expertise or strengthening resilience and teamwork Embedding regularly organized video review sessions allowed for continuous monitoring of care by providers, which can be beneficial for creating ongoing learning and improvement processes The structured pathways, supporting implementation of changes that were proposed based on the video review sessions, could help other centers make use of the potential video review has to offer.

Developing the TeamOBS-vacuum-assisted delivery checklist to assess clinical performance in a vacuum-assisted delivery: a Delphi study with initial validation

Introduction

In Northern Europe, vacuum-assisted delivery (VAD) accounts for 6-15% of all deliveries; VAD is considered safe when conducted by adequately trained personnel. However, failed vacuum extraction can be harmful to both the mother and child. Therefore, the clinical performance in VAD must be assessed to guide learning, determine a performance benchmark, and evaluate the quality to achieve an overall high performance. We were unable to identify a pre-existing tool for evaluating the clinical performance in real-life vacuum-assisted births.

Objective

We aimed to develop and validate a checklist for assessing the clinical performance in VAD.

Methods

We conducted a Delphi process, described as an interactive process where experts answer questions until answers converge toward a "joint opinion" (consensus). We invited international experts as Delphi panelists and reached a consensus after four Delphi rounds, described as follows: (1) the panelists were asked to add, remove, or suggest corrections to the preliminary list of items essential for evaluating clinical performance in VAD; (2) the panelists applied weights of clinical importance on a Likert scale of 1-5 for each item; (3) each panelist revised their original scores after reviewing a summary of the other panelists' scores and arguments; and (4) the TeamOBS-VAD was tested using videos of real-life VADs, and the Delphi panel made final adjustments and approved the checklist.

Results

Twelve Delphi panelists from the UK (n = 3), Norway (n = 2), Sweden (n = 3), Denmark (n = 3), and Iceland (n = 1) were included. After four Delphi rounds, the Delphi panel reached a consensus on the checklist items and scores. The TeamOBS-VAD checklist was tested using 60 videos of real-life vacuum extractions. The inter-rater agreement had an intraclass correlation coefficient (ICC) of 0.73; 95% confidence interval (95% CI) of [0.58, 0.83], and that for the average of two raters was ICC 0.84 95% CI [0.73, 0.91]. The TeamOBS-VAD score was not associated with difficulties in delivery, such as the number of contractions during vacuum extraction delivery, cephalic level, rotation, and position. Failed vacuum extraction occurred in 6% of the video deliveries, but none were associated with the teams with low clinical performance scores.

Conclusion

The TeamOBS-VAD checklist provides a valid and reliable evaluation of the clinical performance of vaginal-assisted vacuum extraction.

Evaluation of video review tools for assessing non-technical skills in emergency department resuscitation teams: a systematic review

BACKGROUND AND IMPORTANCE

Use of video review in medicine is established in contexts such as surgery. Although not widely used in the emergency department (ED), some centres use it to evaluate non-technical skills (NTS) to support teaching and quality improvement.

OBJECTIVE

There is no consensus on assessment of NTS using video review in the ED and the purpose of this review was to identify tools used in this context.

DESIGN, SETTING AND PARTICIPANTS

Studies were identified using Embase, Medline, CINAHL and Google Scholar. Inclusion criterion for the review was NTS of resuscitation teams working within the ED were assessed using video review. A systematic search method was used, and results were synthesised after search criteria was checked by two independent reviewers. Authors settled on the same 9 studies eligible for inclusion.

OUTCOME MEASURES AND ANALYSIS

Reliability and validity of tools identified for use in this context. Due to the heterogeneity of studies, no meta-analysis occurred.

MAIN RESULTS

There are 9 studies included in the review. The review was registered with PROSPERO (Ref No: CRD42022306129). Four unique tools were identified - 6 studies used T-NOTECHS, 1 used TTCA-24, 1 used CALM and 1 used the Communication tool. T-NOTECHS is validated in the literature for use in this context.

CONCLUSION

T-NOTECHS is the tool of choice for assessing ED teams in this context.

Healthcare providers' perceptions and expectations of video-assisted debriefing of real-life obstetrical emergencies: a qualitative study from Denmark

OBJECTIVES

Video-assisted debriefing (VAD) of real-life obstetrical emergencies provides an opportunity to improve quality of care, but is rarely used in clinical practice. A barrier for implementation is the expected mental reservations among healthcare providers. The aim of this study was to explore healthcare providers' perceptions and expectations of VAD of real-life events.

SETTING

Participants were recruited from two Labour and Delivery Units in Denmark. In both units, VAD of real-life obstetrical emergencies had never been conducted.

PARTICIPANTS

22 healthcare providers (10 physicians, 9 midwives and 3 nursing assistants). During the study period (August-October 2021), semi-structured, individual interviews were conducted. Interviews were analysed using thematic analysis.

PRIMARY AND SECONDARY OUTCOME MEASURES

A qualitative description of healthcare providers' perceptions and expectations of VAD of real-life events.

RESULTS

Three major themes were identified: (1) Video-assisted debriefing (VAD) as an opportunity for learning: All participants expected VAD to provide an opportunity for learning and improving patient care. All participants expected the video to provide a 'bigger picture', by showing 'what was actually done' instead of 'what we believed was done'. (2) Video-assisted debriefing (VAD) as a cause for concern: The primary concern for all participants was the risk of being exposed as less competent. Participants were concerned that being confronted with every minor detail of their clinical practice would enhance their self-criticalness. (3) Preconditions for video-assisted debriefing (VAD): Participants emphasised the importance of organisational support from management. In addition, creating a safe environment for VAD, for example, by using only expert debriefers was considered an essential precondition for successful implementation.

CONCLUSIONS

The risk of being exposed as less competent was a barrier towards VAD of real-life events. However, the majority found the educational benefits to outweigh the risk of being exposed.

Video recording emergency care and video-reflection to improve patient care; a narrative review and case-study of a neonatal intensive care unit

As the complexity of emergency care increases, current research methods to improve care are often unable to capture all aspects of everyday clinical practice. Video recordings can visualize clinical care in an objective way. They can be used as a tool to assess care and to reflect on care with the caregivers themselves. Although the use of video recordings to reflect on medical interventions (video-reflection) has increased over the years, it is still not used on a regular basis. However, video-reflection proved to be of educational value and can improve teams' management and performance. It has a positive effect on guideline adherence, documentation, clinical care and teamwork. Recordings can also be used for video-reflexivity. Here, caregivers review recordings together to reflect on their everyday practice from new perspectives with regard to context and conduct in general. Although video-reflection in emergency care has proven to be valuable, certain preconditions have to be met and obstacles need to be overcome. These include gaining trust of the caregivers, having a proper consent-procedure, maintaining confidentiality and adequate use of technical equipment. To implement the lessons learned from video-reflection in a sustainable way and to continuously improve care, it should be integrated in regular simulation training or education. This narrative review will describe the development of video recording in emergency care and how video-reflection can improve patient care and safety in new ways. On our own department, the NICU at the LUMC, video-reflection has already been implemented and we want to further expand this. We will describe the use of video-reflection in our own unit. Based on the results of this narrative review we will propose options for future research to increase the value of video-reflection.

Teamwork and Adherence to Guideline on Newborn Resuscitation-Video Review of Neonatal Interdisciplinary Teams

BACKGROUND

Little is known about the importance of non-technical skills for the adherence to guidelines, when teams of midwives, obstetricians, anesthesiologists, and pediatricians resuscitate and support the transition of newborns. Non-technical skills are competences underpinning successful teamwork in healthcare. These are usually referred to as leadership, situational awareness, communication, teamwork, decision making, and coping with stress and fatigue.

OBJECTIVE

By review of videos of teams managing newborns with difficult transition, we aimed to investigate whether the level of the teams' non-technical skills was associated with the degree of adherence to guidelines for newborn resuscitation and transitional support at birth.

METHODS

Four expert raters independently assessed 43 real-life videos of teams managing newborns with transitional difficulties, two assessed the non-technical score and two assessed the clinical performance. Exposure was the non-technical score, obtained by the Global Assessment Of Team Performance checklist (GAOTP). GAOTP was rated on a Likert Scale 1-5 (1 = poor, 3 = average and 5 = excellent). The outcome was the clinical performance score of the team assessed according to adherence of the European Resuscitation Counsel (ERC) guideline for neonatal resuscitation and transitional support. The ERC guideline was adapted into the checklist TeamOBS-Newborn to facilitate a structured and simple performance assessment (low score 0-60, average 60-84, high 85-100). Interrater agreement was analyzed by intraclass correlation (ICC), Bland-Altman analysis, and Cohen's kappa weighted. The risk of high and low clinical performance was analyzed on the logit scale to meet the assumptions of normality and constant standard deviation.

RESULTS

Teams with an excellent non-technical score had a relative risk 5.5 [95% confidence interval (CI) 2.4-22.5] of high clinical performance score compared to teams with average non-technical score. In addition, we found a dose response like association. The specific non-technical skills associated with the highest degree of adherence to guidelines were leadership and teamwork, coping with stress and fatigue, and communication with parents. Inter-rater agreement was high; raters assessing non-technical skills had an interclass coefficient (ICC) 0.88 (95% CI 0.79-0.94); the neonatologists assessing clinical performance had an ICC of 0.81 (95% CI 0.66-0.89).

CONCLUSION

Teams with an excellent non-technical score had five times the chance of high clinical performance compared to teams with average non-technical skills. High performance teams were characterized by good leadership and teamwork, coping with stress, and fatigue and communication with parents.

The effects of obstetric emergency team training on patient outcome: A systematic review and meta-analysis

INTRODUCTION

Little is known about the optimal simulation-based team training in obstetric emergencies. We aimed to review how simulation-based team training affects patient outcomes in obstetric emergencies.

MATERIAL AND METHODS

Search Strategy: MEDLINE, Embase, Cochrane Library, and Cochrane Central Register of Controlled Trials were searched up to and including May 15, 2021.

SELECTION CRITERIA

randomized controlled trials (RCTs) and cohort studies on obstetric teams in high-resource settings comparing the effect of simulation-based obstetric emergency team training with no training on the risk of Apgar scores less than 7 at 5 min, neonatal hypoxic ischemic encephalopathy, severe postpartum hemorrhage, blood transfusion of four or more units, and delay of emergency cesarean section by more than 30 min.

DATA COLLECTION AND ANALYSIS

The included studies were assessed using PRISMA, EPCO, and GRADE.

RESULTS

We found 21 studies, four RCTs and 17 cohort studies, evaluating patient outcomes after obstetric team training compared with no training. Annual obstetric emergency team training may reduce brachial plexus injury (six cohort studies: odds ratio [OR] 0.47, 95% CI 0.33-0.68; one RCT: OR 1.30, 95 CI% 0.39-4.33, low certainty evidence) and suggest a positive effect; but it was not significant on Apgar score below 7 at 5 min (three cohort studies: OR 0.77, 95% CI 0.51-1.19; two RCT: OR 0.87, 95% CI 0.72-1.05, moderate certainty evidence). The effect was unclear for hypoxic ischemic encephalopathy, umbilical prolapse, decision to birth interval in emergency cesarean section, and for severe postpartum hemorrhage. Studies with in situ multi-professional simulation-based training demonstrated the best effect.

CONCLUSIONS

Emerging evidence suggests an effect of obstetric team training on obstetric outcomes, but conflicting results call for controlled trials targeted to identify the optimal methodology for effective team training.

Leveraging Telemedicine for Quality Improvement Video Review of Critical ICU Events: A Novel Multidisciplinary Form of Education

The objectives of this study were to codify the events triggering bedside recording and to report the types of performance issues identified that were then used to inform dedicated ICU quality improvement efforts.

Design

This is a retrospective descriptive analysis of a video review program conducted at a single institution from July 2016 to November 2019.

Setting

Surgical and Trauma ICU at a single urban academic quaternary care center.

Patients

All patients admitted to the surgical and trauma ICU between July 2016 and November 2019 were eligible for the study as all ICU beds in our health system institutions are equipped with closed circuit video/audio monitoring. Through an institutional review board approved program, any event triggering the immediate bedside presence of a provider in the ICU is routinely recorded at the discretion of the care team or tele-intensivist.

Interventions

A database of these events was created over a 3-year period, and cases were reviewed for content, quality improvement, and educational opportunities. Select recordings were analyzed and shared at multidisciplinary/multiprofessional video review sessions.

Measurements and Main Results

There were 286 critical events video recorded and reviewed in the ICUs between July 2016 and November 2019. The most commonly recorded events included: cardiopulmonary arrests (n = 75), intubations (n = 71), and acute clinical decompensation triggered by nonreassuring vital signs (n = 57) or arrhythmias (n = 13). Of these recordings, 59 were shared at video review conferences, where quality of care was assessed and thematic opportunities for improvement were characterized. Recurrent quality improvement themes that were identified included adherence to protocols, the importance of teamwork and closed-loop communication, clearly designated team leadership, and the use of universal precautions.

Conclusions

Video review in the ICU is feasible and presents valuable opportunities for quality improvement and educational discussions.