Is video observation as effective as live observation in improving teamwork in the operating room?

Video-based observation in impact evaluation

This paper reviews the literature on the use of video-based observation (VBO) with particular attention to monitoring and evaluation (M&E) on development projects. While the use of video both as a research tool and as a strategy for supporting professional development is well-documented across several disciplines, the extent to which VBO has been utilized in M&E contexts is less clearly defined. In order to provide theoretically-grounded recommendations for the development and implementation of one organisation's innovative VBO impact evaluation scheme, this review examines recent evidence of VBO in M&E contexts and draws on VBO literature more generally to identify its advantages and challenges together with advice for enhancing its effectiveness. Based on this analysis, the paper highlights a number of practical issues that should be considered when VBO is being developed for M&E in development contexts, particularly where videos are being made by participants themselves. The value of VBO in responding to COVID-19 and reducing carbon emissions is also noted.

Structured Feedback Enhances Compliance with Operating Room Debriefs

BACKGROUND

Surgical debriefs help reduce preventable errors in the operating room (OR) leading to patient injury. However, compliance with debriefs remains poor. The objective of this study was to evaluate the role of structured feedback to surgeons in improving compliance with and quality of surgical debriefs.

MATERIALS AND METHODS

Surgical cases at an 875-bed urban teaching hospital from January-June 2019 were audited via audio/video recording to evaluate debrief performance. Debriefs were evaluated for clinical completeness and teamwork quality via two structured forms. Surgeons received an evaluation of their debrief performance at two time points during the study period (February and April). Univariate and mixed-effects regression analyses were used to assess changes in debrief compliance and quality over time.

RESULTS

A total of 878 surgical cases performed by 61 surgeons were reviewed: 198 (22.6%) cases during Period 1 (P1), 371 (42.3%) P2, and 309 (35.1%) P3. The rate at which a debrief occurred was 62.1% in P1, 73.0% in P2, and 82.2% in P3 (P < 0.001). Debriefs were 1.96 (95% CI 1.31-2.95, P = 0.001) times more likely to be completed during P2 and 3.21 (95% CI 2.07-5.04, P < 0.001) times more likely during P3 compared to P1. The percent of debriefs initiated by the lead surgeon increased from 59.8% in P1, to 80.0% in P2, to 81.5% in P3 (P < 0.001).

CONCLUSIONS

Providing structured feedback to surgeons on their debrief performance was associated with improvements in compliance and completeness with debriefing protocols, OR teamwork and communication, and leadership and accountability from the lead surgeons.

Interventions to improve team effectiveness within health care: a systematic review of the past decade

BACKGROUND

A high variety of team interventions aims to improve team performance outcomes. In 2008, we conducted a systematic review to provide an overview of the scientific studies focused on these interventions. However, over the past decade, the literature on team interventions has rapidly evolved. An updated overview is therefore required, and it will focus on all possible team interventions without restrictions to a type of intervention, setting, or research design.

OBJECTIVES

To review the literature from the past decade on interventions with the goal of improving team effectiveness within healthcare organizations and identify the "evidence base" levels of the research.

METHODS

Seven major databases were systematically searched for relevant articles published between 2008 and July 2018. Of the original search yield of 6025 studies, 297 studies met the inclusion criteria according to three independent authors and were subsequently included for analysis. The Grading of Recommendations, Assessment, Development, and Evaluation Scale was used to assess the level of empirical evidence.

RESULTS

Three types of interventions were distinguished: (1) Training, which is sub-divided into training that is based on predefined principles (i.e. CRM: crew resource management and TeamSTEPPS: Team Strategies and Tools to Enhance Performance and Patient Safety), on a specific method (i.e. simulation), or on general team training. (2) Tools covers tools that structure (i.e. SBAR: Situation, Background, Assessment, and Recommendation, (de)briefing checklists, and rounds), facilitate (through communication technology), or trigger (through monitoring and feedback) teamwork. (3) Organizational (re)design is about (re)designing structures to stimulate team processes and team functioning. (4) A programme is a combination of the previous types. The majority of studies evaluated a training focused on the (acute) hospital care setting. Most of the evaluated interventions focused on improving non-technical skills and provided evidence of improvements.

CONCLUSION

Over the last decade, the number of studies on team interventions has increased exponentially. At the same time, research tends to focus on certain interventions, settings, and/or outcomes. Principle-based training (i.e. CRM and TeamSTEPPS) and simulation-based training seem to provide the greatest opportunities for reaching the improvement goals in team functioning.