Observational teamwork assessment for surgery: content validation and tool refinement. J Am Coll Surg. 2011;212:234-243.e1-e5. [PMID: 21276535 DOI: 10.1016/j.jamcollsurg.2010.11.001]

Intraoperative Communication Among Men and Women Surgeons With Nursing and Anesthesia Providers

INTRODUCTION

Gender bias has been reported by women surgeons, but its impact on communication in the operating room (OR) is unclear. OR communication is critical to understand, as it directly impacts patient outcomes. The current study evaluates potential gender bias in the type and quality of communication between surgeons and OR nursing and anesthesia providers.

METHODS

We developed a novel intraoperative communication assessment tool, Operating Room Communication Quality assessment tool (OComm), which was adapted from previously validated teamwork assessment tools. Independent coders recorded the instances of conversation and categorized them into clinical or casual communication. After the operation, the participants were assigned a score from the OComm tool. Participants were then given the same OComm measure to assess their self-perceived communication quality and collect demographic information.

RESULTS

For both genders, surgeons' median self-perceived OComm scores was 3.47/4, but surgeons observed OComm score was 2.91/4. Anesthesia providers noted the highest median self-perceived OComm score of 3.65/4 but the lowest observed OComm median score of 2.29/4. From both surgeon to nurse and surgeon to anesthesia provider, there was no association between the gender and frequency of casual conversation (P = 1 > 0.025).

CONCLUSIONS

There was no gender difference in the degree to which women and men surgeons engaged in casual conversation with nursing and anesthesia providers. Surgeons, both men and women, were also more likely to rate their quality of communication lower than the nurses and anesthesia providers, while independent coders were more likely to rate surgeons' quality of communication higher than that of nurses and anesthesia providers.

Social and Cognitive Skills (SCOPE)-a generic model for multi-professional work and education in healthcare

In this article, we present a generic model for social and cognitive skills that can be used in work and (simulation-based) education in healthcare. We combined existing non-technical skills tools into a tool that we call SCOPE. SCOPE is a model that comprises the three social categories of "teamwork", "leading", and "task management" as well as the two cognitive categories of "situation awareness" and "decision making". Each category comprises between three and six elements. We formulated guiding questions for each category in an attempt to emphasize its core meaning. We developed a dynamic graphical representation of the categories that emphasize the constant changes in the relative importance of the categories over the course of a clinical or educational situation. Anecdotal evidence supports the value of the model for aligning language around social and cognitive skills across specialties and professions.

Development and Validation of the Interprofessional Collaboration Practice Competency Scale (IPCPCS) for Clinical Nurses

Interprofessional collaborative practice is a core competency and is the key to strengthening health practice systems in order to deliver safe and high-quality nursing practice. However, there is no Interprofessional Collaboration Practice Competency Scale (IPCPCS) for clinical nurses in Taiwan. Therefore, the purposes of this study were to develop an IPCPCS and to verify its reliability and validity. This was a psychometric study with a cross-sectional survey using convenience sampling to recruit nurses from the seven hospitals of a medical foundation. A self-designed structured IPCPCS was rolled out via a Google survey. The data were analyzed using descriptive statistics, principal-axis factoring (PAF) with Promax rotation, Pearson correlation, reliability analysis, and one-way ANOVA. PAF analysis found that three factors could explain 77.76% of cumulative variance. These were collaborative leadership and interprofessional conflict resolution, interprofessional communication and team functioning, and role clarification and client-centered care. The internal consistency of the three factors (Cronbach's α) was between 0.970 to 0.978, and the Pearson correlation coefficients were between 0.814 to 0.883. Significant differences were presented in the IPCPCS score by age, education level, total years of work experience, position on the nursing clinical ladder, and participation in interprofessional education. In conclusion, the three factors used in the IPCPCS have good reliability and construct validity. This scale can be used as an evaluation tool of in-service interprofessional education courses for clinical nurses.

Speech Communication Interference in the Operating Room

INTRODUCTION

Operating room communication is frequently disrupted, raising safety concerns. We used a Speech Interference Instrument to measure the frequency, impact, and causes of speech communication interference (SCI) events.

METHODS

In this prospective study, we observed 40 surgeries, primarily general surgery, to measure the frequency of SCI, defined as "group discourse disrupted according to the participants, the goals, or the physical and situational context of the exchange." We performed supplemental observations, focused on conducting postsurgery interviews with SCI event participants to identify contextual factors. We thematically analyzed notes and interviews.

RESULTS

The observed 103 SCI events in 40 surgeries (mean 2.58) mostly involved the attending (50.5%), circulating nurse (44.6%), resident (44.6%), or scrub tech (42.7%). The majority (82.1%) of SCI events occurred during another patient-related task. 17.5% occurred at a critical moment. 27.2% of SCI events were not acknowledged or repeated and the message was lost. Including the supplemental observations, 97.0% of SCI events caused a delay (mean 5 s). Inter-rater reliability, calculated by Gwet's AC1 was 0.87-0.98. Postsurgery interviews confirmed miscommunication and distractions. Attention was most commonly diverted by loud noises (e.g., suction), conversations, or multitasking (e.g., using the electronic health record). Successful strategies included repetition or deferment of the request until competing tasks were complete.

CONCLUSIONS

Communication interference may have patient safety implications that arise from conflicts with other case-related tasks, machine noises, and other conversations. Reorganization of workflow, tasks, and communication behaviors could reduce miscommunication and improve surgical safety and efficiency.

Video-based Coaching: Current Status and Role in Surgical Practice, Part II- Practical Implementation and Risk Mitigation from the Society for Surgery of the Alimentary Tract, Health Care Quality and Outcomes Committee

INTRODUCTION

Video-based surgical coaching is gaining traction within the surgical community. It has an increasing adoption rate and growing recognition of its utility, especially an advanced continuous professional growth tool, for continued educational purposes. This method offers instructional flexibility in real-time remote settings and asynchronous feedback scenarios. In our first paper, we delineated fundamental principles for video-based coaching, emphasizing the customization of feedback to suit individual surgeon's needs.

METHOD

In this second part of the series, we review into practical applications of video-based coaching, focusing on quality improvements in a team-based setting, such as the trauma bay. Additionally, we address the potential risks associated with surgical video recording, storage, and distribution, particularly regarding medicolegal aspects. We propose a comprehensive framework to facilitate the implementation of video coaching within individual healthcare institutions.

RESULTS

Our paper examines the legal and ethical framework and explores the potential benefits and challenges, offering insights into the real-world implications of this educational approach.

CONCLUSION

This paper contributes to the discourse on integrating video-based coaching into continuous professional development. It aims to facilitate informed decision-making in healthcare institutions, considering the adoption of this innovative educational quality tool.

Effect of Mixed Reality on Delivery of Emergency Medical Care in a Simulated Environment: A Pilot Randomized Crossover Trial

Importance

Mixed-reality (MR) technology has the potential to enhance care delivery, but there remains a paucity of evidence for its efficacy and feasibility.

Objective

To assess the efficacy and feasibility of MR technology to enhance emergency care delivery in a simulated environment.

Design, Setting, and Participants

This pilot randomized crossover trial was conducted from September to November 2021 at a single center in a high-fidelity simulated environment with participants block randomized to standard care (SC) or MR-supported care (MR-SC) groups. Participants were 22 resident-grade physicians working in acute medical and surgical specialties prospectively recruited from a single UK Academic Health Sciences Centre. Data were analyzed from September to December 2022.

Intervention

Participants resuscitated a simulated patient who was acutely unwell, including undertaking invasive procedures. Participants completed 2 scenarios and were randomly assigned to SC or MR-SC for the first scenario prior to crossover. The HoloLens 2 MR device provided interactive holographic content and bidirectional audiovisual communication with senior physicians in the MR-SC group.

Main Outcomes and Measures

The primary outcome was error rate assessed via the Imperial College Error Capture (ICECAP) multidimensional error-capture tool. Secondary outcomes included teamwork (Observational Teamwork Assessment for Surgery [OTAS]; range, 0-6 and Teamwork Skills Assessment for Ward Care [T-SAW-C]; range, 1-5), scenario completion, stress and cognitive load (NASA Task Load Index [NASA-TLX; range 0-100]), and MR device user acceptability.

Results

A total of 22 physicians (15 males [68.2%]; median [range] age, 28 [25-34] years) were recruited. MR technology significantly reduced the mean (SD) number of errors per scenario compared with SC (5.16 [3.34] vs 8.30 [3.09] errors; P = .003), with substantial reductions in procedural (0.79 [0.75] vs 1.52 [1.20] errors; P = .02), technical (1.95 [1.40] vs 3.65 [2.03] errors; P = .01), and safety (0.37 [0.96] vs 0.96 [0.85] errors; P = .04) domains. MR resulted in significantly greater scenario completion rates vs SC (22 scenarios [100%] vs 14 scenarios [63.6%]; P = .003). It also led to significant improvements in the overall quality of teamwork and interactions vs SC as measured by mean (SD) OTAS (25.41 [6.30] vs 16.33 [5.49]; P < .001) and T-SAW-C (27.35 [6.89] vs 18.37 [6.09]; P < .001) scores. As reported via mean (range) NASA-TLX score, there were significant reductions for MR-SC vs SC in participant temporal demands (38 [20-50] vs 46 [30-70]; P = .03) and significant improvements in self-reported task performance (50 [30-60] vs 39 [10-70]; P = .01). Overall, 19 participants (86.4%) reported that they were more confident in making clinical decisions and undertaking clinical procedures with MR support.

Conclusions and Relevance

This study found that the use of MR technology reduced error, improved teamwork, and enhanced practitioner confidence when used to support the delivery of simulated emergency medical care.

Trial Registration

ClinicalTrials.gov Identifier: NCT05870137.

The need for non-technical skills education in orthopedic surgery

BACKGROUND

The issue of surgical safety has increased significantly over the last few decades. Several studies have established that it is linked to non-technical performance, rather than clinical competencies. Non-technical skills can be blended with technical training in the surgical profession to improve surgeons' abilities and enhance patient care and procedural skills. The main goal of this study was to determine orthopedic surgeons' requirements of non-technical skills, and to identify the most pressing issues.

METHODS

We conducted a self-administered online questionnaire survey in this cross-sectional study. The questionnaire was piloted, validated, pretested, and clearly stated the study's purpose. After the pilot, minor wording and questions were clarified before starting the data collection. Orthopedic surgeons from the Middle East and Northern Africa were invited. The questionnaire was based on a five-point Likert scale, the data were analyzed categorically, and variables were summarized as descriptive statistics.

RESULTS

Of the 1713 orthopedic surgeons invited, 60% completed the survey (1033 out of 1713). The majority demonstrated a high likelihood of participating in such activities in the future (80.5%). More than half (53%) of them preferred non-technical skills courses to be part of major orthopedic conferences, rather than independent courses. Most (65%) chose them to be face-to-face. Although 97.2% agreed on the importance of these courses, only 27% had attended similar courses in the last three years. Patient safety, infection prevention and control, and communication skills were ranked at the top as topics to be addressed. Moreover, participants indicated they would most likely attend courses on infection prevention and control, patient safety and teamwork, and team management.

CONCLUSION

The results highlight the need for non-technical skills training in the region and the general preferences regarding modality and setting. These findings support the high demand from orthopedic surgeons' perspective to develop an educational program on non-technical skills.

Computer-assisted simulated workplace-based assessment in surgery: application of the universal framework of intraoperative performance within a mixed-reality simulation

Objectives

Workplace-based assessment (WBA) is a key requirement of competency-based medical education in postgraduate surgical education. Although simulated workplace-based assessment (SWBA) has been proposed to complement WBA, it is insufficiently adopted in surgical education. In particular, approaches to criterion-referenced and automated assessment of intraoperative surgical competency in contextualized SWBA settings are missing.Main objectives were (1) application of the universal framework of intraoperative performance and exemplary adaptation to spine surgery (vertebroplasty); (2) development of computer-assisted assessment based on criterion-referenced metrics; and (3) implementation in contextualized, team-based operating room (OR) simulation, and evaluation of validity.

Design

Multistage development and assessment study: (1) expert-based definition of performance indicators based on framework's performance domains; (2) development of respective assessment metrics based on preoperative planning and intraoperative performance data; (3) implementation in mixed-reality OR simulation and assessment of surgeons operating in a confederate team. Statistical analyses included internal consistency and interdomain associations, correlations with experience, and technical and non-technical performances.

Setting

Surgical simulation center. Full surgical team set-up within mixed-reality OR simulation.

Participants

Eleven surgeons were recruited from two teaching hospitals. Eligibility criteria included surgical specialists in orthopedic, trauma, or neurosurgery with prior VP or kyphoplasty experience.

Main outcome measures

Computer-assisted assessment of surgeons' intraoperative performance.

Results

Performance scores were associated with surgeons' experience, observational assessment (Objective Structured Assessment of Technical Skill) scores and overall pass/fail ratings. Results provide strong evidence for validity of our computer-assisted SWBA approach. Diverse indicators of surgeons' technical and non-technical performances could be quantified and captured.

Conclusions

This study is the first to investigate computer-assisted assessment based on a competency framework in authentic, contextualized team-based OR simulation. Our approach discriminates surgical competency across the domains of intraoperative performance. It advances previous automated assessment based on the use of current surgical simulators in decontextualized settings. Our findings inform future use of computer-assisted multidomain competency assessments of surgeons using SWBA approaches.

Next in Surgical Data Science: Autonomous Non-Technical Skill Assessment in Minimally Invasive Surgery Training

Background: It is well understood that surgical skills largely define patient outcomes both in Minimally Invasive Surgery (MIS) and Robot-Assisted MIS (RAMIS). Non-technical surgical skills, including stress and distraction resilience, decision-making and situation awareness also contribute significantly. Autonomous, technologically supported objective skill assessment can be efficient tools to improve patient outcomes without the need to involve expert surgeon reviewers. However, autonomous non-technical skill assessments are unstandardized and open for more research. Recently, Surgical Data Science (SDS) has become able to improve the quality of interventional healthcare with big data and data processing techniques (capture, organization, analysis and modeling of data). SDS techniques can also help to achieve autonomous non-technical surgical skill assessments. Methods: An MIS training experiment is introduced to autonomously assess non-technical skills and to analyse the workload based on sensory data (video image and force) and a self-rating questionnaire (SURG-TLX). A sensorized surgical skill training phantom and adjacent training workflow were designed to simulate a complicated Laparoscopic Cholecystectomy task; the dissection of the cholecyst’s peritonial layer and the safe clip application on the cystic artery in an uncomfortable environment. A total of 20 training sessions were recorded from 7 subjects (3 non-medicals, 2 residents, 1 expert surgeon and 1 expert MIS surgeon). Workload and learning curves were studied via SURG-TLX. For autonomous non-technical skill assessment, video image data with tracked instruments based on Channel and Spatial Reliability Tracker (CSRT) and force data were utilized. An autonomous time series classification was achieved by a Fully Convolutional Neural Network (FCN), where the class labels were provided by SURG-TLX. Results: With unpaired t-tests, significant differences were found between the two groups (medical professionals and control) in certain workload components (mental demands, physical demands, and situational stress, p<0.0001, 95% confidence interval, p<0.05 for task complexity). With paired t-tests, the learning curves of the trials were also studied; the task complexity resulted in a significant difference between the first and the second trials. Autonomous non-technical skill classification was based on the FCN by applying the tool trajectories and force data as input. This resulted in a high accuracy (85%) on temporal demands classification based on the z component of the used forces and 75% accuracy for classifying mental demands/situational stress with the x component of the used forces validated with Leave One Out Cross-Validation. Conclusions: Non-technical skills and workload components can be classified autonomously based on measured training data. SDS can be effective via automated non-technical skill assessment.

Preparing and Presenting Validation Studies: A Guide for the Perplexed

SUMMARY STATEMENT

Simulated environments are frequently used for learner assessment, and a wide array of assessment instruments have been created to assist with this process. It is important, therefore, that clear, compelling evidence for the validity of these assessments be established. Contemporary theory recognizes instrument validity as a unified construct that links a construct to be assessed with a population, an environment of assessment, and a decision to be made using the scores. In this article, we present a primer on 2 current frameworks (Messick and Kane), define the elements of each, present a rubric that can be used by potential authors to structure their work, and offer examples of published studies showing how each framework has been successfully used to make a validity argument. We offer this with the goal of improving the quality of validity-related publications, thereby advancing the quality of assessment in healthcare simulation.

Development of the "Teamwork in Endoscopy Assessment Module for Endoscopic Non-Technical Skills" (TEAM-ENTS) behavioral marker system

BACKGROUND

Non-technical skills (NTS) are integral to team performance and subsequent quality and safety of care. Behavioral marker systems (BMSs) are now increasingly used in healthcare to support the training and assessment of team NTS. Within gastrointestinal endoscopy, this is an area of novel research. The aims of this study were to define the core relevant NTS for endoscopy teams and develop a preliminary framework for a team-based BMS known as TEAM-ENTS (Teamwork in Endoscopy Assessment Module for Endoscopic Non-Technical Skills).

METHODS

This study was conducted in two phases. In phase 1, a literature review of team-based BMSs was performed to inform an interview study of core endoscopy team members. Cognitive task analysis was used to break down the NTS relevant to endoscopy teams. Framework analysis generated the structure for the preliminary TEAM-ENTS framework. In phase 2, a modified Delphi process was undertaken to refine the items of the framework.

RESULTS

Seven consultant endoscopists and six nurses were interviewed. The final coding framework consisted of 88 codes grouped into five overarching categories. In total, 58 participants were recruited to the Delphi panel. In the first round, nine elements and 37 behavioral descriptors did not meet consensus. Following item adjustment, merging and deletion, all remaining items met consensus thresholds after the second round. The refined TEAM-ENTS BMS consists of five categories, 16 elements, and 47 behavioral descriptors.

CONCLUSIONS

The refined TEAM-ENTS behavioral marker system was developed to reflect the core NTS relevant to endoscopy teams. Future studies will aim to fully validate this tool.

Instruments to evaluate non-technical skills during high fidelity simulation: A systematic review

Introduction

High Fidelity Simulations (HFS) are increasingly used to develop Non-Technical Skills (NTS) in healthcare providers, medical and nursing students. Instruments to measure NTS are needed to evaluate the healthcare providers' (HCPs) performance during HFS. The aim of this systematic review is to describe the domains, items, characteristics and psychometric properties of instruments devised to evaluate the NTS of HCPs during HFS.

Methods

A systematic review of the literature was performed according to the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA). Studies were retrieved from PubMed, Cinahl, Web of Science, Cochrane Library, ProQuest and PubPsych. Studies evaluating the measurement properties of instruments used to assess NTS during HFS training were included. Pairs of independent reviewers determined the eligibility, extracted and evaluated the data. Risk of bias and appraisal of the methodological quality of the studies was assessed using the Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) checklist, and the quality of the evidence with the Grading of Recommendations, Assessment, Development and Evaluation (GRADE).

Results

A total of 3,953 articles were screened. A total of 110 reports were assessed for eligibility and 26 studies were included. Studies were conducted in Europe/United Kingdom (n = 13; 50%), North America/Australia (n = 12; 46%) and Thailand (n = 1; 4%). The NTS instruments reported in this review included from 1 to 14 domains (median of 4, Q1 = 3.75, Q3 = 5) and from 3 to 63 items (median of 15, Q1 = 10, Q3 = 19.75). Out of 19 NTS assessment instruments for HFS, the Team Emergency Assessment Measure (TEAM) can be recommended for use to assess NTS. All the other instruments require further research to assess their quality in order to be recommended for use during HFS training. Eight NTS instruments had a positive overall rating of their content validity with at least a moderate quality of evidence.

Conclusion

Among a large variety of published instruments, TEAM can be recommended for use to assess NTS during HFS. Evidence is still limited on essential aspects of validity and reliability of all the other NTS instruments included in this review. Further research is warranted to establish their performance in order to be reliably used for HFS.

A real-time analysis of intraoperative interruptions in relation to use of simple preventive measures including a sign on the door and a checklist-based team brief

This study aimed to evaluate intraoperative interruptions by frequency, type, interference and source, and preventive measures. The interruptions in the operating theatre were evaluated for 52 surgical procedures based on real-time recordings and divided into routine operative procedures (ROP, n = 26, without intervention) and intervened operative procedures (IOP, n = 26, observed after team brief and placement of a warning sign for unnecessary door openings) groups. Intervened operative procedures vs. routine operative procedures was associated with a significantly lower number of interruptions (p = 0.014). Implementation of preventive measures was associated with a significantly lower number of entrances and exits (p = 0.001) and equipment issues (p = 0.003), interruptions that affected the circulating nurse or anaesthesia technician/associate (p = 0.003) and those caused by team members other than assisting surgeon and scrub nurse (p-value ranged from 0.015 to 0.009). Our findings revealed significantly reduced interruptions after a simple preventive measure including team brief and the placement of a warning sign for unnecessary door openings.

Integrative Review of Non-Technical Skills Frameworks to Apply for Air Medical Transfer of Pregnant Women

OBJECTIVE

To identify the most suitable non-technical skills framework to adapt and apply to the air medical transfer of pregnant women.

DATA SOURCES

Embase, PsycINFO, PubMed, MEDLINE, Web of Science, CINAHL, Science Direct, and Google Scholar.

STUDY SELECTION

We retrieved potentially relevant articles using a predefined combination of keywords extended with truncation and Boolean operators. Database and manual reference searches yielded 569 peer-reviewed articles. We included articles if they presented empirical data and described non-technical or cognitive competency skills frameworks for health care professionals. We discussed any ambiguities regarding inclusion, and they were resolved by consensus. We retained 71 full-text articles for final review.

DATA EXTRACTION

We coded extracted data under four criteria: non-technical skill categories, context of use, psychometric properties, and rating system. We generated descriptive summary tables of the characteristics of existing non-technical skills frameworks based on publication year, method of development, clinical setting, clinical specialty, routine/crisis-based performance, and team/individual performance.

DATA SYNTHESIS

We identified 42 non-technical skills frameworks from a variety of health care settings. We critically examined context of use and how use in various clinical settings may align with air transfers of pregnant women. Our findings illustrate the importance of team-based and routine performance rather than crisis-focused skills. Maintaining situational awareness throughout all stages of the transfer and communicating effectively with team members, the pregnant woman, and her partner are skills that are particularly important to ensure good outcomes.

CONCLUSION

We selected the Global Assessment of Obstetric Team Performance as the most suitable non-technical skills framework to adapt to the clinical setting of air medical transfer of pregnant women. We considered the clinical specialty, specific non-technical skills required in the setting, the framework's properties, and the requirement to focus on routine team performance.

Closed loop communication in the trauma bay: identifying opportunities for team performance improvement through a video review analysis

Objectives

Communication among trauma team members in the trauma bay is vulnerable to errors, which may impact patient outcomes. We used the previously validated trauma-non-technical skills (T-NOTECHS) tool to identify communication gaps during patient management in the trauma bay and to inform development strategies to improve team performance.

Methods

Two reviewers independently assessed non-technical skills of team members through video footage at Sunnybrook Health Sciences Centre. Team performance was measured using T-NOTECHS across five domains using a five-point Likert scale (lower score indicating worse performance): (1) leadership; (2) cooperation and resource management; (3) communication and interaction; (4) assessment and decision making; (5) situation awareness/coping with stress. Secondary outcomes assessed the number of callouts, closed loop communications and parallel conversations.

Results

The study included 55 trauma activations. Injury severity score (ISS) was used as a measure of trauma severity. A case with an ISS score ≥ 16 was considered severe. ISS was ≥ 16 in 37% of cases. Communication and interaction scored significantly lower compared to all other domains (p < 0.0001). There were significantly more callouts and completed closed loop communications in more severe cases compared to less severe cases (p = 0.017 for both). Incomplete closed loop communications and parallel conversations were identified, irrespective of case severity.

Conclusion

A lower communication score was identified using T-NOTECHS, attributed to incomplete closed loop communications and parallel conversations. Through video review of trauma team activations, opportunities for improvement in communication can be identified by the T-NOTECHS tool, as well as specifically identifying callouts and closed loop communication. This process may be useful for trauma programs as part of a quality improvement program on communication skills and team performance.

Supplementary Information

The online version contains supplementary material available at 10.1007/s43678-022-00295-z.

A Strategic Core Role Perspective on Team Coordination: Benefits of Centralized Leadership for Managing Task Complexity in the Operating Room

OBJECTIVE

We examine whether surgical teams can handle changes in task requirements better when their formal leader and strategic core role holder-that is, the main surgeon-is central to team coordination.

BACKGROUND

Evidence regarding the benefits of shared leadership for managing complex tasks is divided. We tested whether a strategic core role holder's centrality in team coordination helps teams to handle different types of task complexity.

METHOD

We observed coordination as specific leadership behavior in 30 surgical teams during real-life operations. To assess the strategic core role holder's coordination centrality, we conducted social network analyses. Task complexity (i.e., surgical difficulty and unexpected events) and surgical goal attainment were rated in a questionnaire.

RESULTS

In the critical operation phase, surgical difficulty impaired goal attainment when the strategic core role holder's coordination centrality was low, while this effect was nonsignificant when his/her coordination centrality was high. Unexpected events had a negative effect on surgical goal attainment. However, coordination centrality of the strategic core role holder could not help manage unexpected events.

CONCLUSION

The results indicate that shared leadership is not beneficial when teams face surgical difficulty during the critical operation phase. In this situation, team coordination should rather be centralized around the strategic core role holder. Contrarily, when unexpected events occur, centralizing team coordination around a single leader does not seem to be beneficial for goal attainment.

APPLICATION

Leaders and team members should be aware of the importance of distributing leadership differently when it comes to managing different types of task complexity.

Validity of scoring systems for the assessment of technical and non-technical skills in ophthalmic surgery-a systematic review

Evaluation and recommendation of the scoring systems for technical skills (TS) and non-technical skills (NTS) assessments in ophthalmic surgery. A literature search was performed between December 2019 and May 2020. Studies describing the development or validation of TS or NTS scoring systems in ophthalmic surgery were included. Only scoring systems for completion by hand were included. The primary outcome was the validity and reliability status for each scoring system. The secondary outcome was recommendation based on modified Oxford Centre for Evidence-Based Medicine guidelines. Nineteen and five scoring systems were identified for TS and NTS respectively. TS scoring systems exist for cataract surgery (including the steps of phacoemulsification and paediatric cataract surgery) ptosis, strabismus, lateral tarsal strip, vitrectomy, and intraocular surgery in general. NTS scoring systems apply to cataract surgery or ophthalmic surgery in general. No single scoring system satisfied all validity and reliability measures. The recommended TS scoring systems are 'International Council of Ophthalmology's Ophthalmology Surgical Competency Assessment Rubrics' (ICO-OSCAR) for phacoemulsification, strabismus and paediatric cataract surgery, and 'Objective Structured Assessment of Cataract Surgical Skill' (OSACSS). Non-Technical Skills for Surgeons (NOTSS), Observational Teamwork Assessment for Surgery (OTAS) and Anaesthetists Non-Technical Skills (ANTS) are recommended for NTS. There is a paucity of NTS scoring systems. Further research is required to validate all scoring systems to consistent standards. Limitations of the assessment tools included infrequent quantification of face and content validity, and inconsistency in terminology and statistical methods between studies.

Defining the need for faculty development in assessment

BACKGROUND

High-quality workplace-based assessments are essential for competency-based surgical education. We explored education leaders' perceptions regarding faculty competence in assessment.

METHODS

Surgical education leaders were surveyed regarding which areas faculty needed improvement, and knowledge of assessment tools. Respondents were queried on specific skills regarding (a)importance in resident/medical student education (b)competence of faculty in assessment and feedback.

RESULTS

Surveys (n = 636) were emailed, 103 responded most faculty needed improvement in: verbal (86%) and written (83%) feedback, assessing operative skill (49%) and preparation for procedures (50%). Cholecystectomy, trauma laparotomy, inguinal herniorrhaphy were "very-extremely important" in resident education (99%), but 21-24% thought faculty "moderately to not-at-all" competent in assessment. This gap was larger for non-technical skills. Regarding assessment tools, 56% used OSATS, 49% Zwisch; most were unfamiliar with all non-technical tools.

SUMMARY

These data demonstrate a significant perceived gap in competence of faculty in assessment and feedback, and unfamiliarity with assessment tools. This can inform faculty development to support competency-based surgical education.

RAS-NOTECHS: validity and reliability of a tool for measuring non-technical skills in robotic-assisted surgery settings

Background

Non-technical skills (NTS) are essential for safe surgical practice as they impact workflow and patient outcomes. Observational tools to measure operating room (OR) teams’ NTS have been introduced. However, there are none that account for the specific teamwork challenges introduced by robotic-assisted surgery (RAS). We set out to develop and content-validate a tool to assess multidisciplinary NTS in RAS.

Methodology

Stepwise, multi-method procedure. Observations in different surgical departments and a scoping literature review were first used to compile a set of RAS-specific teamwork behaviours. This list was refined and expert validated using a Delphi consensus approach consisting of qualitative interviews and a quantitative survey. Then, RAS-specific behaviours were merged with a well-established assessment tool on OR teamwork (NOTECHS II). Finally, the new tool—RAS-NOTECHS—was applied in standardized observations of real-world procedures to test its reliability (inter-rater agreement via intra-class correlations).

Results

Our scoping review revealed 5242 articles, of which 21 were included based on pre-established inclusion criteria. We elicited 16 RAS-specific behaviours from the literature base. These were synthesized with further 18 behavioural markers (obtained from 12 OR-observations) into a list of 26 behavioural markers. This list was reviewed by seven RAS experts and condensed to 15 expert-validated RAS-specific behavioural markers which were then merged into NOTECHS II. For five observations of urologic RAS procedures (duration: 13 h and 41 min), inter-rater agreement for identification of behavioural markers was strong. Agreement of RAS-NOTECHS scores indicated moderate to strong agreement.

Conclusions

RAS-NOTECHS is the first observational tool for multidisciplinary NTS in RAS. In preliminary application, it has been shown to be reliable. Since RAS is rapidly increasing and challenges for effective and safe teamwork remain at the forefront of quality and safety of surgical care, RAS-NOTECHS may contribute to training and improvement efforts in technology-facilitated surgeries.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00464-021-08474-2.

Non-Technical Skill Assessment and Mental Load Evaluation in Robot-Assisted Minimally Invasive Surgery

BACKGROUND: Sensor technologies and data collection practices are changing and improving quality metrics across various domains. Surgical skill assessment in Robot-Assisted Minimally Invasive Surgery (RAMIS) is essential for training and quality assurance. The mental workload on the surgeon (such as time criticality, task complexity, distractions) and non-technical surgical skills (including situational awareness, decision making, stress resilience, communication, leadership) may directly influence the clinical outcome of the surgery. METHODS: A literature search in PubMed, Scopus and PsycNet databases was conducted for relevant scientific publications. The standard PRISMA method was followed to filter the search results, including non-technical skill assessment and mental/cognitive load and workload estimation in RAMIS. Publications related to traditional manual Minimally Invasive Surgery were excluded, and also the usability studies on the surgical tools were not assessed. RESULTS: 50 relevant publications were identified for non-technical skill assessment and mental load and workload estimation in the domain of RAMIS. The identified assessment techniques ranged from self-rating questionnaires and expert ratings to autonomous techniques, citing their most important benefits and disadvantages. CONCLUSIONS: Despite the systematic research, only a limited number of articles was found, indicating that non-technical skill and mental load assessment in RAMIS is not a well-studied area. Workload assessment and soft skill measurement do not constitute part of the regular clinical training and practice yet. Meanwhile, the importance of the research domain is clear based on the publicly available surgical error statistics. Questionnaires and expert-rating techniques are widely employed in traditional surgical skill assessment; nevertheless, recent technological development in sensors and Internet of Things-type devices show that skill assessment approaches in RAMIS can be much more profound employing automated solutions. Measurements and especially big data type analysis may introduce more objectivity and transparency to this critical domain as well. SIGNIFICANCE: Non-technical skill assessment and mental load evaluation in Robot-Assisted Minimally Invasive Surgery is not a well-studied area yet; while the importance of this domain from the clinical outcome's point of view is clearly indicated by the available surgical error statistics.

Using the Observational Teamwork Assessment in Surgery Instrument to Measure RN Teamwork During Cardiac Surgery: Lessons Learned

BACKGROUND

Surgical teams aspire to be safe and avoid preventable deaths. A lack of teamwork has been associated with safety failures, including adverse events and errors.

PURPOSE

The purpose of the pilot study was to: (1) modify the Observational Teamwork Assessment in Surgery (OTAS) and the original data collection method to measure registered nurse (RN) teamwork during the intraoperative phase of 5 open heart surgical procedures and (2) recommend strategies to further test the reliability and validity of the modified OTAS.

METHODS

This was a pilot study of the OTAS using direct observation.

RESULTS

Although characterized as psychometrically rigorous in prior systematic reviews, using the OTAS to measure RN teamwork in the intraoperative phase of cardiac surgery revealed deficits in its content validity and reliability. The OTAS and its original data collection method were modified.

CONCLUSION

Recommendations for further use of the modified OTAS to increase its reliability and validity are given.

[Teamwork and stress in routine interventions: an observational study of multiprofessional OR teams]

Hintergrund

Effektive interprofessionelle Teamarbeit im Operationssaal (OP) und intraoperativer Stress sind von großer Bedeutung für Patientensicherheit und Versorgungsqualität. Dennoch gibt es nur wenige systematische Studien zum Zusammenhang von Teamarbeit im OP und Arbeitsstress.

Ziele der Arbeit

Untersuchung des Zusammenhangs von Teamarbeit und empfundenem Stress bei Routineeingriffen – für das OP-Team als Gesamtheit sowie für die einzelnen Professionen Chirurgie, Anästhesie und Pflege.

Material und Methoden

Durchgeführt wurde eine Mehrmethodenstudie bestehend aus Expertenbeobachtungen mittels eines standardisierten Beobachtungsinstruments (OTAS-D) und systematischer Selbstberichte des gesamten OP-Teams. Erfasst wurden 64 elektive Routineeingriffe unterschiedlicher chirurgischer Fachbereiche. Die statistischen Zusammenhangsanalysen unter Kontrolle prozeduraler Einflussfaktoren wurden mit „Mixed-effects“-Regressionsmodellen berechnet.

Ergebnisse

Die Güte der intraoperativen Teamarbeit lag auf mittlerem Niveau. Der situative Stress während des Eingriffs wurde durch die Befragten eher auf niedrigerem Niveau berichtet, mit signifikanten Unterschieden zwischen den Professionen Chirurgie, Pflege und Anästhesie. Mitglieder des chirurgischen Teams berichteten im Durchschnitt die höchsten Stressniveaus. Ein genereller Zusammenhang zwischen Teamarbeit und Stresserleben konnte nicht beobachtet werden, allerdings für die einzelnen Professionen: Für das chirurgische Team ergaben sich signifikante, positive Zusammenhänge, sowie für die Teamarbeitsdimensionen Zusammenarbeit und Führung. Signifikante negative Zusammenhänge ergaben sich für das Pflegeteam hinsichtlich der Qualität der interdisziplinären Teamarbeit insgesamt sowie für die Teamarbeitsdimension Team-Monitoring.

Diskussion

Die Effekte interprofessioneller Zusammenarbeit im OP auf subjektives Stressempfinden bei Routineeingriffen hängen von Professionszugehörigkeit, Aufgabe und Tätigkeit ab. Weitere Forschungsarbeit ist notwendig, inwiefern gute Teamarbeit bei Routineeingriffen innerhalb und über die Professionen hinweg intraoperativen Stress beeinflusst.

Zusatzmaterial online

Die Online-Version dieses Beitrags (10.1007/s00113-021-00977-w) enthält eine vollständige Liste mit Kurzbeschreibungen der beobachteten Eingriffe. Beitrag und Zusatzmaterial stehen Ihnen auf www.springermedizin.de/link/10.1007/s00113-021-00977-w zur Verfügung.

Comprehensive Literature Search to Identify Assessment Tools for Operating Room Nontechnical Skills to Determine Common Critical Components

BACKGROUND

Effective use of nontechnical skills (NTS) contributes to the provision of safe, quality care in the fast-paced, dynamic setting of the operating room (OR). Inter-professional education of NTS to OR team members can improve performance. Such training requires the accurate measurement of NTS in order to identify gaps in their utilization by OR teams. Although several instruments for measuring OR NTS exist in the literature, each tool tends to define specific NTS differently.

AIM

We aimed to determine commonalities in defined measurements among existing OR NTS tools.

METHODS

We undertook a comprehensive literature review of assessment tools for OR NTS to determine the critical components common to these instruments. A PubMed search of the literature from May 2009 to May 2019 combined various combinations of keywords and Medical Subject Headings (MeSH) related to the following subjects: teamwork, teams, assessment, debriefing, surgery, operating room, nontechnical, communication. From this start, articles were selected describing specific instruments. Three reviewers then identified the common components measured among these assessment tools. Reviewers collated kin constructs within each instrument using frequency counts of similarly termed and conceptualized components.

RESULTS

The initial PubMed search produced 119 articles of which 24 articles satisfied the inclusion criteria. Within these articles, 10 assessment tools evaluated OR NTS. Kin constructs were grouped into six NTS categories in the following decreasing frequency order: communication, situation awareness, teamwork, leadership, decision making, and task management/decision making (equal).

CONCLUSION

NTS OR assessment tools in the literature have a variety of kin constructs related to the specific measured components within the instruments. Such kin constructs contain thematic cohesion across six primary NTS groupings with some variation in scale and scope. Future plans include using this information to develop an easy-to-use assessment tool to assist with debriefing in the clinical environment.

Evaluation of the Impact of Intraoperative Distractions on Teamwork, Stress, and Workload

BACKGROUND

Within the operating rooms (ORs), distractions occur on a regular basis, which affect the surgical workflow and results in the interruption of urgent tasks. This study aimed to observe the occurrence of intraoperative distractions in Tunisian ORs and evaluate associations among distractions, teamwork, workload, and stress.

METHODS

This observational cross-sectional study was conducted in four different ORs (orthopedic, urology, emergency, and digestive surgery) of Sahloul University Hospital for a period of 3 mo in 2018. Distractions and teamwork were recorded and rated in real time during the intraoperative phase of each case using validated observation sheets. Besides, at the end of each operation, stress and workload of team members were measured.

RESULTS

Altogether, 50 cases were observed and 160 participants were included. Distractions happened in 100% of the included operations. Overall, we recorded 933 distractions that occurred once every 3 min, with a mean frequency of M = 18.66 (standard deviation [SD] = 8.24) per case. It is particularly noticeable that procedural distractions occurred significantly higher during teaching cases compared with nonteaching cases (M = 3.85, M = 0.60, respectively, P < 0.001). The mean global teamwork score was M = 3.85 (SD = 0.67), the mean workload score was M = 58.60 (SD = 24.27), and the mean stress score was M = 15.29 (SD = 4.00). Furthermore, a higher stress level among surgeons was associated with distractions related to equipment failures and people entering or exiting the OR (r = 0.206, P < 0.01 and r = 0.137, P < 0.01, respectively). Similarly, nurses reported a higher workload in the presence of distractions related to the work environment in the OR (r = 0.313, P < 0.05).

CONCLUSIONS

This study highlighted a serious problem, which often team members seem to ignore or underestimate. Taking our findings into consideration, we recommend the implementation of the Surgical Checklist and preoperative briefings to reduce the number of surgical distractions. Also, a continuous teamwork training should be adopted to ensure that OR staff can avoid or handle distractions when they happen.

Non-technical skills in robotic surgery and impact on near-miss events: a multi-center study

BACKGROUND

Robotic surgery requires a set of non-technical skills (NTS), because of the complex environment. We aim to study relationship between NTS and near-miss events in robotic surgery.

METHODS

This is an observational study in five French centers. Three robotic procedures were observed and filmed by one of expert trainers in NTS. They established and scored a non-technical skills in robotic surgery (NTSRS) score, that included eight items, each scored from 1 to 5, to assess the whole surgical teams. The surgical teams also self-assessed their work. The number of near-miss events was recorded and classified as minor, or major but no harm incidents, independently by two surgeons. Correlations were Spearman coefficients.

RESULTS

Of the 26 procedures included, 15 were prostatectomy (58%), 9 nephrectomy (35%), and 2 pyeloplasty (7.7%). Half of procedures (n = 13) were performed by surgeons with extensive RS experience (more than 150 procedures). Per procedure, there was a median (quartiles) of 9 (7; 11) near-miss events. There was 1 (0; 2) major near-miss events, with no harm. The median NTSRS score was 18 (14; 21), out of 40. The number of near-miss events was strongly correlated with the NTSRS score (r = - 0.92, p < 0.001) but was not correlated with the surgeon's experience. The surgeons for fifteen (58%) procedures, and the bed-side surgeons for 11 (42%) procedures, felt that there was no need for an improvement in the quality of their NTS. None of the surgeons gave a negative self-evaluation for any procedure; in three procedures (12%), the bed-side surgeons self-assessed negatively, on ergonomics.

CONCLUSION

Occurrence of near-miss events was reduced in teams managing NTS. Specific NTS surgical team training is essential for robotic surgery as it may have a significant impact on risk management.

Using Fully-Immersive Simulation Training with Structured Debrief to Improve Nontechnical Skills in Emergency Endovascular Surgery

OBJECTIVE

Assess whether fully-immersive simulation training with structured debriefing of a standardized emergency thoracic endovascular aortic repair (TEVAR) scenario improves team-work performance of the lead surgeon. Secondary aims: assess whether technical skills (TS) and radiation safety behaviors (RSB) improved concurrently.

DESIGN

Pre-post study.

SETTING

UK-based training days.

PARTICIPANTS

General and vascular surgical trainees (n = 16).

INTERVENTION(S)

Fully-immersive simulation training with structured debriefing of a standardized emergency TEVAR scenario. Following standardized emergency TEVAR technical training, trainees led 2 standardized fully-immersive endovascular surgery simulations, with scripted support from a passive surgical team. A non-TS (NTS) structured debrief was delivered following simulations. NTS were assessed using the validated observational teamwork assessment for surgery tool post hoc using video recordings of simulations. TS were assessed through time taken to complete each step of the procedure, as defined during technical training. RSB were assessed through checking for presence of pre-defined actions and the length of time fluoroscopy was used during each simulation.

RESULTS

Total observational teamwork assessment for surgery scores improved following structured debrief (p = 0.005, median 52.55/90 vs 73.0/90), alongside all constituent domains - communication (p < 0.001, median 11.7/20 vs 16.6/20), coordination (p < 0.001, median 8.6/15 vs 13.4/15), cooperation (p < 0.001, median 13.15/20 vs 16.35/20), leadership (p < 0.001, median 8.70/15 vs 11.30/15) and monitoring (p < 0.001, median 9.85/20 vs 14.85/20). TS improved; time to complete 12 of 13 procedural steps improved (p < 0.027). Fluoroscopy time (seconds) decreased (p = 0.339, 543.6 vs 495.5), frequency lead surgeons checked the team were wearing leads increased (p = 0.125, 3 vs 7) and asked the team to step back before screening increased (p = 0.003, frequency team asked to step back/total angiography runs before = 2/36 vs after = 14/44).

CONCLUSIONS

fully-immersive endovascular simulation with structured debrief is a robust tool to improve NTS and TS. Incorporation into surgical training may reduce operating theatres errors, increase efficiency, and improve RSB. However effective translation into the clinical workplace must be demonstrated to see these benefits.

Development and impact of an endoscopic non-technical skills (ENTS) behavioural marker system

Background

Non-technical skills (NTS) are crucial to effective team working in endoscopy. Training in NTS has been shown to improve team performance and patient outcomes. As such, NTS training and assessment are now considered essential components of the endoscopy quality assurance process. Across the literature, other specialties have achieved this through development of behavioural marker systems (BMS). BMS provide a framework for assessing, training and measuring the NTS relevant to healthcare individuals and team. This article describes the development and impact of a novel BMS for endoscopy: the endoscopic non-technical skills (ENTS) system.

Methods

The initial NTS taxonomy for endoscopy was created through a combination of literature review, staff focus groups and semi-structured interviews, incorporating the critical decision method. Framework analysis was conducted with three individual coders and generated a skills list which formed the preliminary taxonomy. Video observation of Bowel Cancer Screening endoscopists was used to identify exemplar behaviours which were mapped to relevant skills in the NTS taxonomy. Behavioural descriptors, derived from video data, were added to form the basis of the ENTS system.

Results

A taxonomy of 33 skills in 14 separate categories were identified through framework analysis. Following video analysis and behaviour mapping, 4 overarching categories and 13 behavioural elements were identified which formed the ENTS framework. The endoscopy (directly observed procedural skills) 4-point rating scale was added to create the final ENTS system. Since its development in 2010, the ENTS system has been validated in the assessment of endoscopy for trainees nationally. ENTS informs a number of training initiatives, including a national strategy to improve NTS for all endoscopists.

Conclusions

The ENTS system is a clinically relevant tool, validated for use in trainee assessment. The use of ENTS will be important to the future of training and quality assurance in endoscopy.

A Ward-Round Non-Technical Skills for Surgery (WANTSS) Taxonomy

BACKGROUND

Around half of surgical adverse events occur outside the operating room. However the majority of nontechnical skills (NTS) training programs have been developed for the intraoperative environment. Ward rounds are a crucial part of extraoperative care and to date no specific NTS training manual has been developed targeting emergency general surgical ward rounds.

AIM

To develop a NTS taxonomy for emergency general surgical ward rounds that can be used to improve surgical team members' NTS and improve outcomes.

METHODS

A literature review of existing NTS taxonomies was conducted, followed by semistructured interviews and observational data collection, to determine good and poor surgical ward-round behaviors. These behaviors were reviewed by a panel of subject matter experts and categorized into a taxonomy, using the Non-Technical Skills for Surgeons taxonomy framework as a guide.

RESULTS

The Ward-round Non-Technical Skills for Surgery taxonomy includes examples of good and poor ward-round-specific behaviors, grouped into elements and categories. The taxonomy can be used as both a training and teaching manual for the surgical team.

CONCLUSION

Ward rounds are a crucial part of extraoperative surgical care. The Ward-round Non-Technical Skills for Surgery taxonomy provides surgical teams with a manual to help them improve their ward-round NTS.

Non-technical Skills Simulation Training

Purpose of Review

“Non-technical skills” are critical to patient safety and form an important part of a surgeon’s competency. Inter-disciplinary team training is now considered essential to train these valuable skills. This review discusses the importance of non-technical skills, and the role these skills have in simulation training within Otolaryngology.

Recent Findings

Otolaryngologists are uniquely positioned to encounter airway emergencies. Consequently, team-based training in crisis scenarios is especially important. Simulation can occur in situ or in the simulated setting, with “boot-camps” becoming a popular training intervention. Whilst team training within otolaryngology has been shown to be highly effective, formal assessment of these skills is not currently routine, with no assessment tool specifically tailored to ENT.

Summary

Simulation-based training is an effective and feasible method of teaching non-technical skills in Otolaryngology. With the shift towards competency-based medical education, formal assessment of these skills is important to perform.

Measuring the teamwork performance of operating room teams: a systematic review of assessment tools and their measurement properties

Teamwork is fundamental to surgical patient safety but is inconsistently measured. While many tools have been developed for elective intraoperative situations, it is unclear which is the most robust. This systematic review aimed to identify tools to measure the teamwork of operating room teams. Studies were included if they examined the measurement properties of these tools. PsycINFO, Embase (via OVID), CINAHL, ERIC, Medline and Medline in Process (via OVID) were searched through to May 3, 2019, as were reference lists of included studies and previously published relevant reviews. Retrieved articles were screened and data extracted in duplicate by two independent reviewers. Quality was assessed using the COSMIN checklist. Of the 2121 references identified, 14 studies of six assessment tools were included. Tools were validated across various specialties, mostly in clinical rather than simulated settings. The Observational Teamwork Assessment for Surgery (OTAS) and Operating Theater Team Non-Technical Skills Assessment Tool (NOTECHS) were the most frequently investigated tools. Though acceptable for assessing teamwork, both NOTECHS and OTAS rely on the questionable assumption that the teamwork of a team is equivalent to the sum of individual performances. Future studies may investigate other assessment tools that assess the whole team as the unit of analysis along with the potential of these tools to provide healthcare providers with meaningful feedback in clinical practice.

Technical and Nontechnical Skills in Surgery: A Simulated Operating Room Environment Study

STUDY DESIGN

Observational simulation study.

OBJECTIVE

The goal of this study was to investigate the relationship between technical and nontechnical skills (NTS) in a simulated surgical procedure.

SUMMARY OF BACKGROUND DATA

Although surgeons' technical and NTS during surgery are crucial determinants for clinical outcomes, little literature is available in spine surgery. Moreover, evidence regarding how surgeons' technical and NTS are related is limited.

METHODS

A mixed-reality and full-scale simulated operating room environment was employed for the surgical team. Eleven surgeons performed the vertebroplasty procedure (VP). Technical skills (TS) were assessed using Objective Structured Assessment of Technical Skill scores and senior expert-evaluated VP outcome assessment. NTS were assessed with the Observational Teamwork Assessment for Surgery. Kendall-Tau-b tests were performed for correlations. We further controlled the influence of surgeons' experience (based on professional tenure and number of previous VPs performed).

RESULT

Surgeons' NTS correlated significantly with their technical performance (τ = 0.63; P = 0.006) and surgical outcome scores (τ = 0.60; P = 0.007). This association was attenuated when controlling for surgeons' experience.

CONCLUSION

Our results suggest that spine surgeons with higher levels of TS also apply better communication, leadership, and coordination behaviors during the procedure. Yet, the role of surgeons' experience needs further investigation for improving surgeons' intraoperative performance during spine surgery.

LEVEL OF EVIDENCE

3.

Interruptions in Surgery: A Comprehensive Review

BACKGROUND

Recent literature showed that analysis of interruptions can contribute to evaluating the care process in the operating room, and thus, understanding potential errors that may occur during surgical procedures. The aim of this comprehensive review was to summarize current knowledge on the description and impact of interruptions in surgery.

MATERIAL AND METHODS

A literature search was conducted according to a set of criteria in the databases MEDLINE, BASE, Cochrane's Library, and PsycINFO.

RESULTS

41 articles were included. Two main methodological approaches were found, observational in the OR, or controlled in an experimental simulated environment. Interruptions in the OR were manifold, and several classifications were used. The severity of interruptions differed according to the category of the interruptions. Interruptions were influenced by team familiarity and the expertise of the surgical team; high team familiarity and a high level of expertise decreased the frequency of interruptions. However, our literature search lacked controlled studies carried out in the OR. Interruptions seemed to increase the workload and stress of the surgical team and impair nontechnical skills, but no clear evidence of this was advanced.

CONCLUSIONS

Interruptions are probably risk factors for errors in the operating room. However, there is as yet no clear evidence of the association of interruption frequency with errors in the operating room. There is a need to define and target interruptions, which should be reduced by putting safeguards in place, thereby allowing those which could be beneficial and neglecting those with no potential consequences.

Objective Measures of Communication Behavior Predict Clinical Performance

OBJECTIVE

Effective teamwork and communication are critical to patient outcomes, and subjective assessment tools have been studied in predicting team performances. However, inherent biases remain while using subjective assessment tools. This study hypothesizes that objective communication features can assess and predict clinical performance.

DESIGN

Forty 3rd-year medical students participated in the Acute Care Trauma Simulation as the role of doctor, teaming up with a nurse confederate and a simulated patient. Participants conducted postoperative patient management, patient care diagnoses, and treatment. Audio from all team members were recorded, speech variables (e.g., speech duration, number of conversations, etc.) were extracted, and statistical analyses were performed to associate communication with clinical performance.

SETTING

This study was performed at the simulation center located at Fairbanks Hall, Indiana University School of Medicine.

PARTICIPANTS

Data from forty 3rd-year medical students were collected and analyzed.

RESULTS

Majority (67%) of the communications were initiated by student. Speech ratio, intensity, and frequency of communications differed when students communicate with nurse than with patient (e.g., student communication to patient had higher intensity than nurse). Increasing frequency of check-backs between student and nurse (p < 0.05) and speech duration from student to patient (p = 0.001) positively associated with student's clinical performance score.

CONCLUSION

Objective communication features can predict medical trainee's clinical performance and provide an objective approach for simulation-based trauma care training.

The Alternative Surgical Curriculum

Surgical training has focused on the development of technical competency. Interpersonal and cognitive skills are essential to working as an interdisciplinary team, which translates into safety for the patient and well-being for the surgeon and colleagues. This article offers an "alternative" surgical curriculum topic list to augment the technical skill sets traditionally taught to trainees.

Psychological aptitude for surgery: The importance of non-technical skills

INTRODUCTION

Psychological aptitude for surgery includes all the non-technical abilities that are necessary for the surgeons. However, differently from the other careers, these skills are not considered in the selection process and their role is definitively underestimated in the field of surgery. We perform a literature review of non-technical skills for surgery to identify their role and to understand how to train and evaluate these abilities among the surgeons.

RESULTS

Different methods have been presented for the evaluation and training of non-technical skills for surgeons; based on the model of aviation and anesthesia a wide range of simulated scenarios have been proposed to practice these aptitudes and abilities. Different behavioral markers systems have been developed for correct identification and definition of these skills, these can be used in the real surgical room and even learned and trained in the simulated operating theatre.

CONCLUSION

This article shows the importance of non-practical abilities in the surgical performance and in defining the aptitude for surgery. Learning these skills and introducing them in surgical education can be useful to improve the surgical performance.

Use of a Portable Functional Near-Infrared Spectroscopy (fNIRS) System to Examine Team Experience During Crisis Event Management in Clinical Simulations

Objective: The aim of this study was to investigate the utilization of a portable functional near-infrared spectroscopy (fNIRS) system, the fNIRS Pioneer^TM, to examine team experience in high-fidelity simulation-based crisis event management (CEM) training for anesthesiologists in operating rooms.

Background: Effective evaluation of team performance and experience in CEM simulations is essential for healthcare training and research. Neurophysiological measures with wearable devices can provide useful indicators of team experience to compliment traditional self-report, observer ratings, and behavioral performance measures. fNIRS measured brain blood oxygenation levels and neural synchrony can be used as indicators of workload and team engagement, which is vital for optimal team performance.

Methods: Thirty-three anesthesiologists, who were attending CEM training in two-person teams, participated in this study. The participants varied in their expertise level and the simulation scenarios varied in difficulty level. The oxygenated and de-oxygenated hemoglobin (HbO and HbR) levels in the participants’ prefrontal cortex were derived from data recorded by a portable one-channel fNIRS system worn by all participants throughout CEM training. Team neural synchrony was measured by HbO/HbR wavelet transformation coherence (WTC). Observer-rated workload and self-reported workload and mood were also collected.

Results: At the individual level, the pattern of HbR level corresponded to changes of workload for the individuals in different roles during different phases of a scenario; but this was not the case for HbO level. Thus, HbR level may be a better indicator for individual workload in the studied setting. However, HbR level was insensitive to differences in scenario difficulty and did not correlate with observer-rated or self-reported workload. At the team level, high levels of HbO and HbR WTC were observed during active teamwork. Furthermore, HbO WTC was sensitive to levels of scenario difficulty.

Conclusion: This study showed that it was feasible to use a portable fNIRS system to study workload and team engagement in high-fidelity clinical simulations. However, more work is needed to establish the sensitivity, reliability, and validity of fNIRS measures as indicators of team experience.

Systematic review of team performance in minimally invasive abdominal surgery

Background

Adverse events in the operating theatre related to non‐technical skills and teamwork are still an issue. The influence of minimally invasive techniques on team performance and subsequent impact on patient safety remains unclear. The aim of this review was to assess the methodology used to objectify and rate team performance in minimally invasive abdominal surgery.

Methods

A systematic literature search was conducted according to the PRISMA guidelines. Studies on assessment of surgical team performance or non‐technical skills of the surgical team in the setting of minimally invasive abdominal surgery were included. Study aim, methodology, results and conclusion were extracted for qualitative synthesis.

Results

Sixteen studies involving 677 surgical procedures were included. All studies consisted of observational case series that used heterogeneous methodologies to assess team performance and were of low methodological quality. The most commonly used team performance objectification tools were ‘construct’‐ and ‘incident’‐based tools. Evidence of validity for the assessed outcome was spread widely across objectification tools, ranging from low to high. Diverse and poorly defined outcomes were reported.

Conclusion

Team demands for minimally invasive approaches to abdominal procedures remain unclear. The current literature consists of studies with heterogeneous methodology and poorly defined outcomes.

Developing a Care Coordination Model Using a Hybrid DEMATEL and PLS-SEM Approach

The aim of this article is to develop and assess a model for care coordination (CC). A novel hybrid approach of Decision-Making Trial and Evaluation Laboratory (DEMATEL) and partial least square structural equation modelling (PLS-SEM) has been used to assess the CC model. The study has been conducted in four phases: (a) literature review, (b) Delphi session, (c) development of CC model through DEMATEL and (d) validation of the model through PLS-SEM. The study involves perspectives of service providers as well as service receivers, for which data were collected from hospitals across India. The literature review and Delphi session helped in finalising the seven measures of CC. Identified measures of CC are: IT-enabled coordination, inter-professional teamwork and consistency, patient centredness, communication and information transfer, physical infrastructural facilities and requirements, delivery of quality care, and facilitating transitions and accountability. Patient-centredness was found to be the most important construct of CC. Delivery of quality care is the most influenced construct and is affected by all the other constructs. Based on the results, practitioners may develop an overarching strategy to deliver seamless care and better health outcomes. This understanding may help in designing processes which in turn would deliver health as a social good.

Team talk and team decision processes: a qualitative discourse analytical approach to 10 real-life medical emergency team encounters

OBJECTIVES

Explore the function of three specific modes of talk (discourse types) in decision-making processes.

DESIGN

Ten real-life admissions of patients with critical illness were audio/video recorded and transcribed. Activity-type analysis (a qualitative discourse analytical method) was applied.

SETTING

Interdisciplinary emergency teams admitting patients with critical illness in a Norwegian university hospital emergency department (ED).

PARTICIPANTS

All emergency teams consisted of at least two internal medicine physicians, two ED nurses, one anaesthetist and one nurse anaesthetist. The number of healthcare professionals involved in each emergency team varied between 11 and 20, and some individuals were involved with more than one team.

RESULTS

The three discourse types played significant roles in team decision-making processes when negotiating meaning. Online commentaries (ONC) and metacommentaries (MC) created progression while offline commentaries (OFC) temporarily placed decisions on hold. Both ONC and MC triggered action and distributed tasks, resources and responsibility in the team. OFC sought mutual understanding and created a broader base for decisions.

CONCLUSION

A discourse analytical perspective on team talk in medical emergencies illuminates both the dynamics and complexity of teamwork. Here, we draw attention to the way specific modes of talk function in negotiating mutual understanding and distributing tasks and responsibilities in non-algorithm-driven activities. The analysis uncovers a need for an enhanced focus on how language can trigger safe team practice and integrate this knowledge in teamwork training to improve communication skills in ad hoc emergency teams.