Non-technical skills training in the operating theatre: A meta-analysis of patient outcomes

The role of the community pharmacy work system in the enactment of pharmacists' non-technical skills

Non-technical skills are recognised as important in various work domains, but have been the subject of debate regarding their role in ergonomics/human factors, given their focus on human behaviour itself rather than the interaction between people and systems. This study aimed to examine the relationship between non-technical skills and the work system in which they are enacted. The study setting was community pharmacies in England. Qualitative data were obtained from observation of seven pharmacists and semi-structured interviews with 16 pharmacists, and subjected to thematic analysis. Elements of their work system were found to be related to their non-technical skills; either by creating a need for the skill in the first place, or by facilitating or inhibiting its enactment. The findings highlight the importance of considering the work system that contextualises individuals' and teams' behaviour, in addition to the behaviour itself, when investigating non-technical skills.

Deep Learning Analysis of Surgical Video Recordings to Assess Nontechnical Skills

Importance

Assessing nontechnical skills in operating rooms (ORs) is crucial for enhancing surgical performance and patient safety. However, automated and real-time evaluation of these skills remains challenging.

Objective

To explore the feasibility of using motion features extracted from surgical video recordings to automatically assess nontechnical skills during cardiac surgical procedures.

Design, Setting, and Participants

This cross-sectional study used video recordings of cardiac surgical procedures at a tertiary academic US hospital collected from January 2021 through May 2022. The OpenPose library was used to analyze videos to extract body pose estimations of team members and compute various team motion features. The Non-Technical Skills for Surgeons (NOTSS) assessment tool was employed for rating the OR team's nontechnical skills by 3 expert raters.

Main Outcomes and Measures

NOTSS overall score, with motion features extracted from surgical videos as measures.

Results

A total of 30 complete cardiac surgery procedures were included: 26 (86.6%) were on-pump coronary artery bypass graft procedures and 4 (13.4%) were aortic valve replacement or repair procedures. All patients were male, and the mean (SD) age was 72 (6.3) years. All surgical teams were composed of 4 key roles (attending surgeon, attending anesthesiologist, primary perfusionist, and scrub nurse) with additional supporting roles. NOTSS scores correlated significantly with trajectory (r = 0.51, P = .005), acceleration (r = 0.48, P = .008), and entropy (r = -0.52, P = .004) of team displacement. Multiple linear regression, adjusted for patient factors, showed average team trajectory (adjusted R2 = 0.335; coefficient, 10.51 [95% CI, 8.81-12.21]; P = .004) and team displacement entropy (adjusted R2 = 0.304; coefficient, -12.64 [95% CI, -20.54 to -4.74]; P = .003) were associated with NOTSS scores.

Conclusions and Relevance

This study suggests a significant link between OR team movements and nontechnical skills ratings by NOTSS during cardiac surgical procedures, suggesting automated surgical video analysis could enhance nontechnical skills assessment. Further investigation across different hospitals and specialties is necessary to validate these findings.

Patient and Operational Factors Do Not Substantively Affect the Annual Departmental Quality of Anesthesiologists' Clinical Supervision and Nurse Anesthetists' Work Habits

INTRODUCTION

Although safety climate, teamwork, and other non-technical skills in operating rooms probably influence clinical outcomes, direct associations have not been shown, at least partially due to sample size considerations. We report data from a retrospective cohort of anesthesia evaluations that can simplify the design of prospective observational studies in this area. Associations between non-technical skills in anesthesia, specifically anesthesiologists' quality of clinical supervision and nurse anesthetists' work habits, and patient and operational factors were examined.

METHODS

Eight fiscal years of evaluations and surgical cases from one hospital were included. Clinical supervision by anesthesiologists was evaluated daily using a nine-item scale. Work habits of nurse anesthetists were evaluated daily using a six-item scale. The dependent variables for both groups of staff were binary, whether all items were given the maximum score or not. Associations were tested with patient and operational variables for the entire day.

RESULTS

There were 40,718 evaluations of faculty anesthesiologists by trainees, 53,772 evaluations of nurse anesthetists by anesthesiologists, and 296,449 cases that raters and ratees started together. Cohen's d values were small (≤0.10) for all independent variables, suggesting a lack of any clinically meaningful association between patient and operational factors and evaluations given the maximum scores. For supervision quality, the day's count of orthopedic cases was a significant predictor of scores (P = 0.0011). However, the resulting absolute marginal change in the percentage of supervision scores equal to the maximum was only 0.8% (99% confidence interval: 0.2% to 1.4%), i.e., too small to be of clinical or managerial importance. Neurosurgical cases may have been a significant predictor of work habits (P = 0.0054). However, the resulting marginal change in the percentage of work habits scores equal to the maximum, an increase of 0.8% (99% confidence interval: 0.1% to 1.6%), which was again too small to be important.

CONCLUSIONS

When evaluating the effect of assigning anesthesiologists and nurse anesthetists with different clinical performance quality on clinical outcomes, supervision quality and work habits scores may be included as independent variables without concern that their effects are confounded by association with the patient or case characteristics. Clinical supervision and work habits are measures of non-technical skills. Hence, these findings suggest that non-technical performance can be judged by observing the typical small sample size of cases. Then, associations can be tested with administrative data for a far greater number of patients because there is unlikely to be a confounding association between patient and case characteristics and the clinicians' non-technical performance.

Beyond the self: a novel framework to enhance non-technical team skills for anesthesiologists

Human factors and non-technical skills (NTS) have been identified as essential contributors to both the propagation and prevention of medical errors in the operating room. Despite extensive study and interventions to nurture and enhance NTS in anesthesiologists, gaps to effective team practice and patient safety remain. Furthermore, the link between added NTS training and clinically significant improved outcomes has not yet been demonstrated. We performed a narrative review to summarize the literature on existing systems and initiatives used to measure and nurture NTS in the clinical operating room setting. Controlled interventions performed to nurture NTS (N.=13) were identified and compared. We comment on the body of current evidence and highlight the achievements and limitations of interventions published thus far. We then propose a novel education and training framework to further develop and enhance non-technical skills in both individual anesthesiologists and operating room teams. We use the cardiac anesthesiology environment as a starting point to illustrate its use, with clinical examples. NTS is a key component of enhancing patient safety. Effective framing of its concepts is central to apply individual characteristics and skills in team environments in the OR and achieve tangible, beneficial patient outcomes.

Crisis Scenarios for Simulation-Based Nontechnical Skills Training for Cardiac Surgery Teams: A National Survey Among Cardiac Anesthesiologists, Cardiac Surgeons, Clinical Perfusionists, and Cardiac Operating Room Nurses

BACKGROUND

Nontechnical skills in cardiac surgery are vital in ensuring patient safety in the operating room (OR). To train these skills in a simulation-based scenario, a collection of commonly accepted crisis scenarios is needed to serve as a framework for a simulation-based training program.

OBJECTIVE

The objective of this study was to identify and reach consensus on a collection of relevant crisis scenarios in cardiac surgery suitable for simulation-based team training focusing on nontechnical skills.

METHODS

Using the Delphi method, a national assessment was performed among cardiac surgeons, cardiac anesthesiologists, clinical perfusionists, and cardiac OR nurses in the Netherlands. In the first Delphi round, potential crisis scenarios for simulation-based team training in cardiac surgery were identified. In the second round, the identified scenarios were rated using a 5-point Likert scale. Finally, based on consensus (two-thirds majority), scenarios were prioritized and explored for feasibility.

RESULTS

One hundred fourteen experts participated in the study (26 cardiac anesthesiologists, 24 cardiac surgeons, 25 clinical perfusionists, and 39 OR nurses), representing all 16 cardiac surgical centers in the Netherlands. In the first round, 237 scenarios were identified. After eliminating duplicates and grouping similar scenarios, 44 scenarios were scored in round 2, which finally resulted in 13 relevant crisis scenarios with an expert consensus higher than 67%.

CONCLUSIONS

Thirteen crisis scenarios relevant to simulation-based team training were identified by an expert panel consisting of all members of the cardiac surgical team. Further research is needed to evaluate the educational value of the respective scenarios.

Guidelines on human factors in critical situations 2023

OBJECTIVE

To provide guidelines to define the place of human factors in the management of critical situations in anaesthesia and critical care.

DESIGN

A committee of nineteen experts from the SFAR and GFHS learned societies was set up. A policy of declaration of links of interest was applied and respected throughout the guideline-producing process. Likewise, the committee did not benefit from any funding from a company marketing a health product (drug or medical device). The committee followed the GRADE® method (Grading of Recommendations Assessment, Development and Evaluation) to assess the quality of the evidence on which the recommendations were based.

METHODS

We aimed to formulate recommendations according to the GRADE® methodology for four different fields: 1/ communication, 2/ organisation, 3/ working environment and 4/ training. Each question was formulated according to the PICO format (Patients, Intervention, Comparison, Outcome). The literature review and recommendations were formulated according to the GRADE® methodology.

RESULTS

The experts' synthesis work and application of the GRADE® method resulted in 21 recommendations. Since the GRADE® method could not be applied in its entirety to all the questions, the guidelines used the SFAR "Recommendations for Professional Practice" A means of secured communication (RPP) format and the recommendations were formulated as expert opinions.

CONCLUSION

Based on strong agreement between experts, we were able to produce 21 recommendations to guide human factors in critical situations.

Assessing non-technical skills in undergraduate nursing students: a validation study

OBJECTIVES

Non-technical skills (NTS) are fundamental to the nursing profession to ensure safe, quality care. Purpose: The aim of this study was to develop a new instrument to assess NTS among nursing students: the Non-Technical Skills Student Evaluation (NTS-SE) tool.

METHODS

A cross-sectional study was conducted to test the psychometric properties of the tool. A number of 1,087 nursing students were enrolled from five Bachelor Schools of Nursing.

RESULTS

Exploratory and confirmatory factor analysis suggested the suitability of a two-factor model. The final version of the NTS-SE consisted of 23 items distributed in two domains: cognitive skills and interpersonal skills. For each domain, Cronbach's alpha coefficients were above 0.94. There were significant differences in scores between second- and third-year students (p<0.001) and among the different nursing schools (p<0.001).

CONCLUSIONS

The NTS-SE can be useful when assessing the effect of educational strategies and/or clinical traineeship experiences on the acquisition of NTS.

Objective Measures of Surgeon Non-Technical Skills in Surgery: A Scoping Review

OBJECTIVE

The purpose of this study was to identify, synthesize, and discuss objective behavioral or physiological metrics of surgeons' nontechnical skills (NTS) in the literature.

BACKGROUND

NTS, or interpersonal or cognitive skills, have been identified to contribute to safe and efficient surgical performance; however, current assessments are subjective, checklist-based tools. Intraoperative skill evaluation, such as technical skills, has been previously utilized as an objective measure to address such limitations.

METHODS

Five databases in engineering, behavioral science, and medicine were searched following PRISMA reporting guidelines. Eligibility criteria included studies with NTS objective measurements, surgeons, and took place within simulated or live operations.

RESULTS

Twenty-three articles were included in this review. Objective metrics included communication metrics and measures from physiological responses such as changes in brain activation and motion of the eye. Frequencies of content-coded communication in surgery were utilized in 16 studies and were associated with not only the communication construct but also cognitive constructs of situation awareness and decision making. This indicates the underlying importance of communication in evaluating the NTS constructs. To synthesize the scoped literature, a framework based on the one-way communication model was used to map the objective measures to NTS constructs.

CONCLUSION

Objective NTS measurement of surgeons is still preliminary, and future work on leveraging objective metrics in parallel with current assessment tools is needed.

APPLICATION

Findings from this work identify objective NTS metrics for measurement applications in a surgical environment.

Effects of structured intraoperative briefings on patient outcomes: multicentre before-and-after study

BACKGROUND

Operations require collaboration between surgeons, anaesthetia professionals, and nurses. The aim of this study was to determine whether intraoperative briefings influence patient outcomes.

METHODS

In a before-and-after controlled trial (9 months baseline; 9 months intervention), intraoperative briefings were introduced in four general surgery centres between 2015 and 2018. During the operation, the responsible surgeon (most senior surgeon present) briefed the surgical team using the StOP? protocol about: progress of the operation (Status), next steps (Objectives), possible problems (Problems), and encouraged asking questions (?). Differences between baseline and intervention were analysed regarding surgical-site infections (primary outcome), mortality, unplanned reoperations, and duration of hospital stay (secondary outcomes), using inverse probability of treatment (IPT) weighting based on propensity scores.

RESULTS

In total, 8256 patients underwent surgery in the study. Endpoint data were available for 7745 patients (93.8 per cent). IPT-weighted and adjusted intention-to-treat analyses showed no differences in surgical-site infections between baseline and intervention (9.8 versus 9.6 per cent respectively; adjusted difference (AD) -0.15 (95 per cent c.i. -1.45 to 1.14) per cent; odds ratio (OR) 0.92, 95 per cent c.i. 0.83 to 1.15; P = 0.797), but there were reductions in mortality (1.6 versus 1.1 per cent; AD -0.54 (-1.04 to -0.03) per cent; OR 0.60, 0.39 to 0.92; P = 0.018), unplanned reoperations (6.4 versus 4.8 per cent; AD -1.66 (-2.69 to -0.62) per cent; OR 0.72, 0.59 to 0.89; P = 0.002), and fewer prolonged hospital stays (21.6 versus 19.8 per cent; AD -1.82 (-3.48 to -0.15) per cent; OR 0.87, 0.77 to 0.98; P = 0.024).

CONCLUSION

Short intraoperative briefings improve patient outcomes and should be performed routinely.

Intraoperative and postoperative complications in colorectal procedures: the role of continuous updating in medicine

Accepting surgical complications, especially those related to the learning curve, as unavoidable events in colorectal procedures, is like accepting to fly onboard an aircraft with a 10 to 20% chance of not arriving at final destination. Under this condition, it is very likely that the aviation industry and the concurrent reshaping of the world and of our lives would have not been possible in the absence of high reliability and reproducibility of safe flights. It's hard to imagine surgery without any intraoperative and/or postoperative complications. Nevertheless, there is a plenty of room for improvement by simply adopting what has been explicitly and scientifically demonstrated; training outside of the OR, usage of modern information technologies and application of evidence-based perioperative care protocols. Additionally, the possibility to objectively measure and monitor the technical and even non-technical skills and competencies of individual surgeons and even of OR teams through the application of structured and validated assessment tools can finally put an end to the self-referential, purely hierarchical, and indeed extremely unreliable process of being authorized or not to perform operations on patients. Last but not least, a wide range of new technologies spanning from augmented imaging modalities, virtual reality for intraoperative guidance, improved robotic manipulators, artificial intelligence to assist in preoperative patient specific risk assessment, and intraoperative decision-making has the potential to tackle several hidden roots of surgical complications.

Value of Nontechnical Skills in Minimally Invasive Surgery

Nontechnical skills are of increasing importance in surgery and surgical training. The main studies on its impact on the safety and effectiveness of surgical interventions were mainly published in the first decade of the 2000s. Due to the significant technical complexity and great diversity of instruments for nontechnical skills evaluation, the interest in training and in measuring the impact on surgical safety has relatively decreased. However, the advent of minimally invasive surgery and its peculiar technical characteristics of sophisticated technique and constant innovation through the adoption of new materials and drugs has rekindled interest in this expertise area. In the present review, we have revisited the main instruments available to measure nontechnical skill of surgical teams and analyzed the role of the main competencies on which they are based, such as situational awareness, leadership and communication skills, and the consistency of the intraoperative decision-making process. We conclude that despite the great consensus that exists among all members of the health team on the importance of nontechnical skills for the surgical team in minimally invasive surgery, the reproducible evidence on the subject is scarce and laborious to obtain. To the extent that protecting and expanding nontechnical skills is fundamental to the path toward the high reliability of health institutions, it is possible to anticipate here the role of these institutions as promoters of continuity and new research models in this area of knowledge, especially in minimally invasive surgery, an access route to which more and more patients undergoing surgical treatment in these same institutions are submitted.

Innovations in Urologic Surgical Training

PURPOSE OF REVIEW

This review aims to summarize innovations in urologic surgical training in the past 5 years.

RECENT FINDINGS

Many assessment tools have been developed to objectively evaluate surgical skills and provide structured feedback to urologic trainees. A variety of simulation modalities (i.e., virtual/augmented reality, dry-lab, animal, and cadaver) have been utilized to facilitate the acquisition of surgical skills outside the high-stakes operating room environment. Three-dimensional printing has been used to create high-fidelity, immersive dry-lab models at a reasonable cost. Non-technical skills such as teamwork and decision-making have gained more attention. Structured surgical video review has been shown to improve surgical skills not only for trainees but also for qualified surgeons. Research and development in urologic surgical training has been active in the past 5 years. Despite these advances, there is still an unfulfilled need for a standardized surgical training program covering both technical and non-technical skills.

[Personality traits in anesthesiology : Results from a questionnaire-based requirements analysis]

BACKGROUND

Criteria for the identification of suitable applicants for undergraduate and postgraduate medical education are greatly and ubiquitously discussed. Apart from the acquisition of theoretical knowledge and practical skills, certain personality traits are necessary for practicing the medical profession; however, little is known on the personality traits required for medical subspecialties. This study had two objectives: 1) identification and evaluation of personality traits which are essential for performing anesthesiology and 2) establishment of a job specification for anesthesiology.

METHODS

We performed a survey among German anesthesiologists using an online questionnaire. This questionnaire collected demographic data, such as age, gender, level of postgraduate education and 28 personality traits from 5 categories: cognition, psychomotor, physical, sensory and social interactive properties. The participants were asked to rate the personality traits on a 5-point Likert scale. Statistical analysis was performed using an ANOVA.

RESULTS

A total of 714 questionnaires were analyzed. Social interactive skills and cognitive personality traits were considered as most important for a clinical career in anesthesiology. The three personality traits rated highest were a high decision-making ability, stress tolerance and speed of perception. Furthermore, a high apprehension, affability and patient-oriented behavior are needed.

CONCLUSION

A job specification describing important personality traits can be useful to advise both undergraduates and postgraduates on their medical career and for medical team simulation tasks. For the clinical practice in anesthesiology, for example, high social interactive and cognitive personality traits are required.

Non-technical skills curriculum incorporating simulation-based training improves performance in colonoscopy among novice endoscopists: Randomized controlled trial

BACKGROUND AND AIMS

Non-technical skills (NTS), involving cognitive, social and interpersonal skills that complement technical skills, are important for the completion of safe and efficient procedures. We investigated the impact of a simulation-based curriculum with dedicated NTS training on novice endoscopists' performance of clinical colonoscopies.

METHODS

A single-blinded randomized controlled trial was conducted at a single center. Novice endoscopists were randomized to a control curriculum or a NTS curriculum. The control curriculum involved a didactic session, virtual reality (VR) simulator colonoscopy training, and integrated scenario practice using a VR simulator, a standardized patient, and endoscopy nurse. Feedback and training were provided by experienced endoscopists. The NTS curriculum group received similar training that included a small-group session on NTS, feedback targeting NTS, and access to a self-reflective NTS checklist. The primary outcome was performance during two clinical colonoscopies, assessed using the Joint Advisory Group Direct Observation of Procedural Skills (JAG DOPS) tool.

RESULTS

Thirty-nine participants completed the study. The NTS group (n = 21) had superior clinical performance during their first (P < 0.001) and second clinical colonoscopies (P < .0.001), compared to the control group (n = 18). The NTS group performed significantly better on the VR simulator (P < 0.05) and in the integrated scenario (P < 0.05).

CONCLUSION

Our findings demonstrate that dedicated NTS training led to improved performance of clinical colonoscopies among novices.

Surgeons' participation in the development of collaboration and management competencies in undergraduate medical education

The teaching of professional roles in medical education is an interdisciplinary concern. However, surgeons require specific standards of professionalism for certain context-based situations. In addition to communication, studies require collaboration, leadership, error-/conflict-management, patient-safety and decision-making as essential competencies for surgeons. Standards for corresponding competencies are defined in special chapters of the German National Competency-based Learning Objectives for Undergraduate Medical Education (NKLM; chapter 8, 10). The current study asks whether these chapters are adequately taught in surgical curricula. Eight German faculties contributed to analysing mapping data considering surgical courses of undergraduate programs. All faculties used the MERlin mapping platform and agreed on procedures for data collection and processing. Sub-competency and objective coverage, as well as the achievement of the competency level were mapped. Overall counts of explicit citations were used for analysis. Collaboration within the medical team is a strongly represented topic. In contrast, interprofessional cooperation, particularly in healthcare sector issues is less represented. Patient safety and dealing with errors and complications is most emphasized for the Manager/Leader, while time management, career planning and leadership are not addressed. Overall, the involvement of surgery in teaching the competencies of the Collaborator and Manager/Leader is currently low. However, there are indications of a curricular development towards explicit teaching of these roles in surgery. Moreover, implicitly taught roles are numerous, which indicates a beginning awareness of professional roles.

Current Status of Simulation Training in Urology: A Non-Systematic Review

Simulation has emerged as an effective solution to increasing modern constraints in surgical training. It is recognized that a larger proportion of surgical complications occur during the surgeon's initial learning curve. The simulation takes the learning curve out of the operating theatre and facilitates training in a safe and pressure-free environment whilst focusing on patient safety. The cost of simulation is not insignificant and requires commitment in funding, human resources and logistics. It is therefore important for trainers to have evidence when selecting various simulators or devices. Our non-systematic review aims to provide a comprehensive up-to-date picture on urology simulators and the evidence for their validity. It also discusses emerging technologies and future directions. Urologists should embed evidence-based simulation in training programs to shorten learning curves while maintaining patient safety and work should be directed toward a validated and agreed curriculum.

The rise of human factors: optimising performance of individuals and teams to improve patients' outcomes

The improvement of surgical outcomes has been achieved working under the assumption that they are mainly the result of technical skills. This model, although correct, is not exhaustive and has left out many variables that affect outcomes, of which a number can be grouped under the label of non-technical skills, which is a subset of human factors. Non-technical skills are developed to facilitate a shared mental model between team members, teams and their operational environment. They include situation awareness, decision-making, communication, teamwork, leadership and performance-shaping factors. The importance of these non-technical skills has been highlighted during the investigations of severe accidents in many high-risk industries and healthcare. There is an almost untapped opportunity to improve outcomes focusing on non-technical skills because until recently there has been an under-investment of time and resources in this area compared with technical skills. This theoretical paper supports the adoption of a broader model of human performance as a function of technical and non-technical skills and the cultural and organisational context where these are at play. We also aim to highlight a pathway to increase the investment in non-technical skills following the most updated evidence.