Development of a team performance scale to assess undergraduate health professionals

Effective debriefings in the clinical setting: a pilot study to test the impact of an evidence based debriefing app on anesthesia care providers' performance

Background

Debriefing enhances team learning, performance, and patient safety. Despite its benefits, it's underused. To address this, we developed an evidence-based debriefing app.

Methods

This pilot study, conducted at a Swiss hospital, evaluated team performance during two anesthesia inductions using the Team Performance Scale (TPS). Following the first induction, teams engaged with the Zurich Debriefing App, with debriefing sessions meticulously recorded for subsequent evaluation. To mitigate bias, raters underwent comprehensive TPS training. The debriefings were analyzed through the DE-CODE framework. We utilized paired t-tests to examine performance improvements and linear regressions to assess the impact of reflective statements on performance, moderated by psychological safety.

Results

Team performance significantly improved from the first to the second induction (t (9) = -2.512, p = 0.033). Senior physicians' (n = 8) reflective statements predicted post-assessment TPS scores (R 2 = 0.732, p = 0.061), while consultants (n = 7) and nurse anesthetists (n = 10) did not. Interaction analysis revealed no moderation effects, but a main effect indicated the significance of senior physicians' reflective statements.

Conclusion

This pilot study confirms the efficacy of the evidence-based debriefing app in enhancing anesthesia team performance. Senior physicians' reflective statements positively influenced performance; however, no moderation effects were observed. The study highlights the potential of debriefing apps to streamline and enhance team debriefing processes, with significant implications for improving clinical practice and patient safety. Further research is needed to validate these findings on a larger scale and optimize the integration of debriefing into routine clinical practice.

A Scoping Review of Interprofessional Simulation-Based Team Training Programs

SUMMARY STATEMENT

Interprofessional simulation-based team training (ISBTT) is promoted as a strategy to improve collaboration in healthcare, and the literature documents benefits on teamwork and patient safety. Teamwork training in healthcare is traditionally grounded in crisis resource management (CRM), but it is less clear whether ISBTT programs explicitly take the interprofessional context into account, with complex team dynamics related to hierarchy and power. This scoping review examined key aspects of published ISBTT programs including (1) underlying theoretical frameworks, (2) design features that support interprofessional learning, and (3) reported behavioral outcomes. Of 4854 titles identified, 58 articles met inclusion criteria. Most programs were based on CRM and related frameworks and measured CRM outcomes. Only 12 articles framed ISBTT as interprofessional education and none measured all interprofessional competencies. The ISBTT programs may be augmented by integrating theoretical concepts related to power and intergroup relations in their design to empower participants to navigate complex interprofessional dynamics.

Interprofessional simulation of acute care for nursing and medical students: interprofessional competencies and transfer to the workplace

BACKGROUND

Teamwork and communication are essential tools for doctors, nurses and other team members in the management of critically ill patients. Early interprofessional education during study, using acute care simulation, may improve teamwork and communication between interprofessional team members on the long run.

METHODS

A comparative sequential quantitative-qualitative study was used to understand interprofessional learning outcomes in nursing and medical students after simulation of acute care. Students were assigned to a uni- or interprofessional training. Questionnaires were used to measure short and long term differences in interprofessional collaboration and communication between the intervention and control group for nursing and medical students respectively. Semi-structured focus groups were conducted to gain a better understanding of IPE in acute simulation.

RESULTS

One hundred and ninety-one students participated in this study (131 medical, 60 nursing students). No differences were found between the intervention and control group in overall ICCAS scores for both medical and nursing students (p = 0.181 and p = 0.441). There were no differences in ICS scores between the intervention and control group. Focus groups revealed growing competence in interprofessional communication and collaboration for both medical and nursing students.

CONCLUSIONS

Interprofessional simulation training did show measurable growth of interprofessional competencies, but so did uniprofessional training. Both medical and nursing students reported increased awareness of perspective and expertise of own and other profession. Furthermore, they reported growing competence in interprofessional communication and collaboration in transfer to their workplace.

Evaluation of Communication and Safety Behaviors During Hospital-Wide Code Response Simulation

INTRODUCTION

To understand the baseline quality of team communication behaviors at our organization, we implemented institution-wide simulation training and measured the performance of safety behaviors of ad hoc teams in emergent situations.

METHODS

Clinicians participated in 2 interprofessional video-recorded simulation scenarios, each followed by debriefing. Using a standardized evaluation instrument, 2 reviewers independently evaluated the presence or absence of desired team safety behaviors, including escalating care, sharing a mental model, establishing leadership, thinking out loud, and identifying roles and responsibilities. We also scored the quality of sharing the mental model, closed-loop communication, and overall team performance on a 7-point scale. Discordant reviews were resolved with scoring by an additional reviewer.

RESULTS

A total of 1404 clinicians participated in 398 simulation scenarios, resulting in 257 usable videos. Overall, teams exhibited desired behaviors at the following frequencies: escalating care, 85%; sharing mental models, 66%; verbally establishing leadership, 6%; thinking out loud, 87%; and identifying roles and responsibilities, 27%. Across all reviews, the quality of the graded behaviors (of 7 points) was 2.8 for shared mental models, 3.3 for closed-loop communication, and 3.2 for overall team performance.

CONCLUSIONS

In a simulation setting with ad hoc teams, there was variable performance on completing safety behaviors and only a fair quality of graded communication behaviors. These results establish a baseline assessment of communication and teamwork behaviors and will guide future quality improvement interventions.

Feasibility of an Interprofessional, Simulation-Based Curriculum to Improve Teamwork Skills, Clinical Skills, and Knowledge of Undergraduate Medical and Nursing Students in Uganda: A Cohort Study

INTRODUCTION

Many deaths in Sub-Saharan Africa are preventable with provision of skilled healthcare. Unfortunately, skills decay after training. We determined the feasibility of implementing an interprofessional (IP) simulation-based educational curriculum in Uganda and evaluated the possible impact of this curriculum on teamwork, clinical skills (CSs), and knowledge among undergraduate medical and nursing students.

METHODS

We conducted a prospective cohort study over 10 months. Students were divided into 4 cohorts based on clinical rotations and exposed to rotation-specific simulation scenarios at baseline, 1 month, and 10 months. We measured clinical teamwork scores (CTSs) at baseline and 10 months; CSs at baseline and 10 months, and knowledge scores (KSs) at baseline, 1 month, and 10 months. We used paired t tests to compare mean CTSs and KSs, as well as Wilcoxon rank sum test to compare group CS scores.

RESULTS

One hundred five students (21 teams) participated in standardized simulation scenarios. We successfully implemented the IP, simulation-based curriculum. Teamwork skills improved from baseline to 10 months when participants were exposed to: (a) similar scenario to baseline {baseline mean CTS = 55.9% [standard deviation (SD) = 14.4]; 10-month mean CTS = 88.6%; SD = 8.5, P = 0.001}, and (b) a different scenario to baseline [baseline mean CTS = 55.9% (SD = 14.4); 10-month CTS = 77.8% (SD = 20.1), P = 0.01]. All scenario-specific CS scores showed no improvement at 10 months compared with baseline. Knowledge was retained in all scenarios at 10 months.

CONCLUSIONS

An IP, simulation-based undergraduate curriculum is feasible to implement in a low-resource setting and may contribute to gains in knowledge and teamwork skills.

Adaptation and validation of a Spanish version of the KidSIM Team Performance Scale

BACKGROUND

Interprofessional education offers students from different disciplines the opportunity to share learning experiences.

PURPOSE

To develop and validate a Spanish version of the KidSIM Team Performance Scale, thus providing a tool for assessing the team performance of undergraduate health professionals in our cultural context.

METHOD

Descriptive observational study consisting of two phases: a) translation and adaptation of the original instrument, b) validation of the Spanish version.

RESULTS

The Spanish version comprises 11 items and is linguistically and conceptually equivalent to the original scale. Factor analysis yielded a model comprising three factors: roles and leadership capacity, communication, and use of resources. Internal consistency was good (Cronbach's alpha = 0.85), while inter-observer agreement was moderate (Cohen's kappa = 0.58). The RMSEA fit index was acceptable (0.0801 [0.0618-0.115]).

CONCLUSION

The Spanish version of the KidSIM Team Performance Scale is a valid and reliable tool for assessing simulated teamwork among undergraduate health professionals.

Behavioral Crisis Management: A Quality Improvement Pilot for Improving Teamwork in a Primary Care Pediatric Setting

INTRODUCTION

Children with behavioral escalations in the primary care office may pose safety risks to themselves and others. Interprofessional teams utilizing crisis resource management (CRM) skills more successfully manage behavioral crises. The purpose of this quality improvement (QI) pilot project was to improve team performance during a behavioral crisis in pediatric primary care, as well as evaluate learner satisfaction with the curriculum.

METHOD

We implemented an evidence-based curriculum using simulation and didactic techniques in primary care offices within a pediatric network. Using a one group pre-post design, we evaluated roles, communication, and patient-centered care with the KidSIM Team Performance Scale. Utilizing a post intervention survey, learner feedback was elicited regarding learning environment, facilitators and barriers to learning, skill of facilitator, and usability and applicability of content.

FINDINGS

101 interprofessional participants attended one of eight educational sessions. KidSIM Team Performance Scale results demonstrated statistically significant improved total team performance in a simulated behavioral crisis (Z = -2.52, p = 0.012). Post simulation evaluation demonstrated positive feedback about the program, content and facilitators.

DISCUSSION

This pilot QI project demonstrated that a curriculum using behavioral simulation scenarios and CRM principles can improve teamwork in an interprofessional primary care office. Additionally, participants overwhelmingly indicated satisfaction with the curriculum.

APPLICATION TO PRACTICE

Ensuring staff have the appropriate skills to manage behavioral health crises facilitates safer and more effective patient care, enhances patient-centered care and solidifies a positive staff approach in the pediatric ambulatory setting.

Teamwork Among Medicine House Staff During Work Rounds: Development of a Direct Observation Tool

OBJECTIVE

Teamwork is integral to effective health care but difficult to evaluate. Few tools have been tested outside of classroom or medical simulation settings. Accordingly, we aimed to develop and pilot test an easy-to-use direct observation instrument for measuring teamwork among medical house staff.

METHODS

We performed direct observations of 18 inpatient medicine house staff teams at a teaching hospital using an instrument constructed from existing teamwork tools, expert panel review, and pilot testing. We examined differences across teams using the Kruskal-Wallis statistic. We examined interrater reliability with the κ statistic, domain scales using Cronbach α, and construct validity using correlation and multivariable regression analyses of quality and utilization metrics. Observers rated team performance before and after providing feedback to 12 of the 18 team leaders and assessed changes in team performance using paired two-tailed t tests.

RESULTS

We found variation in team performance in the situation monitoring, mutual support, and communication domains. The instrument evidenced good interrater reliability among concurrent, independent observers (κ = 0.7, P < 0.001). It had satisfactory face validity based on expert panel review and the assessments of resident team leaders. Construct validity was supported by a positive correlation between team performance and the Hospital Consumer Assessment of Healthcare Providers and Systems physician communication score (r = 0.6, P = 0.03). Providing resident physicians with information about their teams' performance was associated with improved mean performance in follow-up observations (3.6-3.8/4.0, P = 0.001).

CONCLUSIONS

Direct observation of teamwork behaviors by medicine house staff on ward rounds is feasible and feedback may improve performance.

Assessing Medical Students' Nontechnical Skills Using Immersive Simulation: What Are the Essential Components?

INTRODUCTION

Nontechnical skills (NTS) have been acknowledged to be important for medical students and can be linked to improved clinical performance. However, existing tools to evaluate these within a simulated setting address only a limited number of NTS. The Medical Students' Nontechnical Skills (Medi-StuNTS) behavioral marker system (BMS) outlines 5 categories of NTS for medical students. This study aimed to seek evidence for completeness and content validity to refine the BMS and to ascertain which NTS are essential for medical students.

METHODS

We asked 128 workshop participants if they felt there were any missing or irrelevant items in Medi-StuNTS system. A subject matter expert panel (n = 10) rated how essential they considered each item in the BMS. An Item-Content Validity Index was calculated for each skill element and the Scale-Content Validity Index was calculated as a measure of content validity of the full system.

RESULTS

Of the workshop participants, 78.9% felt that there were no missing items and 93% felt that there were no irrelevant items. Potentially missing items highlighted were as follows: "working in a hierarchy," "leadership," "awareness of the emotional state of other team members," and "nonverbal communication." Fourteen of 16 skill elements achieved the recommended level for content validity (Item-Content Validity Index ≥ 0.78), and the Scale-Content Validity Index was higher than the acceptable level (≥0.8).

CONCLUSIONS

Evidence for completeness and content validity of Medi-StuNTS has been demonstrated. There is a far wider range of NTS that seem to be essential for medical students than those assessed by tools developed before Medi-StuNTS. Medi-StuNTS provides comprehensive cover of the essential NTS required by medical students, with specific reference to the skill categories "self-awareness" and "escalating care," which do not feature in other tools for assessing NTS in this group.

Effectiveness of a training intervention to improve communication between/awareness of team roles: A randomized clinical trial

BACKGROUND

Interprofessional teamwork training of nursing undergraduates is essential to improving healthcare. The absence of clear role definitions and poor interprofessional communications have been listed as the main reasons behind abandonment of the profession by recently graduated nurses.

PURPOSE

The aim of this parallel randomized clinical trial was to evaluate the impact of Situation-Background-Assessment-Recommendation (SBAR) role-play training on interprofessional teamwork skills (role-related and communication-related) and non-technical skills (patient assessment, patient intervention, patient safety, and critical thinking).

METHOD

The intervention group were taught teamwork skills, role and task assignment skills, and use of the SBAR worksheet in a 1-hour role-play training session, while the control group received conventional lecture-based training. Teamwork and non-technical skills were then assessed in high-fidelity simulation scenarios using the KidSIM Team Performance Scale (teamwork skills) and the Clinical Simulation Evaluation Tool (non-technical skills). Cohen's d (d) was used to examine effect size differences.

RESULTS

Compared to the control group, the intervention group improved in 4 teamwork items - 'verbalize out loud' (p < 0.001, d = 0.99), 'paraphrase' (p < 0.001, d = 0.77), 'cross-monitoring' (p < 0.001, d = 0.72), and 'role clarity' (p = 0.002, d = 0.66) - and in a single non-technical skill (patient intervention: p = 0.004, d = 0.66), while also reporting greater confidence in performing patient assessments (p = 0.02, d = 0.56).

CONCLUSIONS

Role-play and SBAR training for undergraduate nurses improved patient intervention, enhanced information sharing in an interprofessional team, and raised awareness of their own and other team members' roles.

Applying safety lessons from aviation to pre-licensure health professions education: A narrative critical review

BACKGROUND

Significant numbers of patients continue to be harmed annually by healthcare systems in the United States (US) and around the world. Through a lens of safety, the fields of aviation and healthcare share many similarities in the non-technical skills required by team members, including situational awareness, communication, problem-solving, and leadership. Despite these links and evidence of effective interventions in the clinical setting, there is a lack of a guidance on how to incorporate non-technical skills training into pre-licensure health professions curricula.

METHODS

Following guidance for a narrative critical review, a comprehensive literature search was conducted looking for studies incorporating non-technical skills training including crew resource management (CRM) and human factors and ergonomics (HFE) into pre-licensure health professions curricula.

RESULTS

Eleven example articles were organized into three broad themes: (1) changing the teaching paradigm around errors, (2) targeted curricular interventions, and (3) interprofessional team training. Several useful tools for evaluating training effectiveness were highlighted, but consistent measures of efficacy for CRM/HFE training are lacking. Interprofessional team training may have the most tangible and broadly applicable link to pre-licensure curricula.

IMPLICATIONS

Additional research is needed to identify best practices for consistent incorporation of non-technical skills into pre-licensure curricula. A cultural shift to focus on error management (vs. solely error avoidance) is also needed early in training with development of a common language to discuss patient safety issues and opportunities for improvement across various healthcare settings.

Evaluation of teamwork assessment tools for interprofessional simulation: a systematic literature review

There is growing evidence supporting the use of simulation-based education to improve teamwork in the clinical environment, which results in improved patient outcomes. Interprofessional simulation improves awareness of professional roles and responsibilities, promotes teamwork and provides training in non-technical skills. Tools have been developed to assess the quality of teamwork during simulation, but the use of these tools should be supported by validity evidence in appropriate contexts. This study aims to assess the validity of teamwork tools used in simulation-based interprofessional training for healthcare workers and students, and to compare the design and reporting of these studies. Medline, EMBASE, ERIC, and CINAHL were searched using terms synonymous with simulation, crew resource management, training, assessment, interprofessional, and teamwork, from 2007-2017. Interprofessional healthcare simulation studies involving objectively rated teamwork training were included. The initial search provided 356 records for review, of which 24 were ultimately included. Three tools demonstrated good validity evidence underpinning their use. However, three studies did not explore tool psychometrics at all, and the quality of reporting amongst these studies on design and participant demographics was variable. Further research to generate reporting guidelines and validate existing tools for new populations would be beneficial.

Resuscitation Education Science: Educational Strategies to Improve Outcomes From Cardiac Arrest: A Scientific Statement From the American Heart Association

The formula for survival in resuscitation describes educational efficiency and local implementation as key determinants in survival after cardiac arrest. Current educational offerings in the form of standardized online and face-to-face courses are falling short, with providers demonstrating a decay of skills over time. This translates to suboptimal clinical care and poor survival outcomes from cardiac arrest. In many institutions, guidelines taught in courses are not thoughtfully implemented in the clinical environment. A current synthesis of the evidence supporting best educational and knowledge translation strategies in resuscitation is lacking. In this American Heart Association scientific statement, we provide a review of the literature describing key elements of educational efficiency and local implementation, including mastery learning and deliberate practice, spaced practice, contextual learning, feedback and debriefing, assessment, innovative educational strategies, faculty development, and knowledge translation and implementation. For each topic, we provide suggestions for improving provider performance that may ultimately optimize patient outcomes from cardiac arrest.

Observer-based tools for non-technical skills assessment in simulated and real clinical environments in healthcare: a systematic review

Background

Over the past three decades multiple tools have been developed for the assessment of non-technical skills (NTS) in healthcare. This study was designed primarily to analyse how they have been designed and tested but also to consider guidance on how to select them.

Objectives

To analyse the context of use, method of development, evidence of validity (including reliability) and usability of tools for the observer-based assessment of NTS in healthcare.

Design

Systematic review.

Data sources

Search of electronic resources, including PubMed, Embase, CINAHL, ERIC, PsycNet, Scopus, Google Scholar and Web of Science. Additional records identified through searching grey literature (OpenGrey, ProQuest, AHRQ, King’s Fund, Health Foundation).

Study selection

Studies of observer-based tools for NTS assessment in healthcare professionals (or undergraduates) were included if they: were available in English; published between January 1990 and March 2018; assessed two or more NTS; were designed for simulated or real clinical settings and had provided evidence of validity plus or minus usability. 11,101 articles were identified. After limits were applied, 576 were retrieved for evaluation and 118 articles included in this review.

Results

One hundred and eighteen studies describing 76 tools for assessment of NTS in healthcare met the eligibility criteria. There was substantial variation in the method of design of the tools and the extent of validity, and usability testing. There was considerable overlap in the skills assessed, and the contexts of use of the tools.

Conclusion

This study suggests a need for rationalisation and standardisation of the way we assess NTS in healthcare and greater consistency in how tools are developed and deployed.

Development of a Simulation-Based Interprofessional Teamwork Assessment Tool

BACKGROUND

The Accreditation Council for Graduate Medical Education (ACGME) Milestone projects required each specialty to identify essential skills and develop means of assessment with supporting validity evidence for trainees. Several specialties rate trainees on a milestone subcompetency related to working in interprofessional teams. A tool to assess trainee competence in any role on an interprofessional team in a variety of scenarios would be valuable and suitable for simulation-based assessment.

OBJECTIVE

We developed a tool for simulation settings that assesses interprofessional teamwork in trainees.

METHODS

In 2015, existing tools that assess teamwork or interprofessionalism using direct observation were systematically reviewed for appropriateness, generalizability, adaptability, ease of use, and resources required. Items from these tools were included in a Delphi method with multidisciplinary pediatrics experts using an iterative process from June 2016 to January 2017 to develop an assessment tool.

RESULTS

Thirty-one unique tools were identified. A 2-stage review narrowed this list to 5 tools, and 81 items were extracted. Twenty-two pediatrics experts participated in 4 rounds of Delphi surveys, with response rates ranging from 82% to 100%. Sixteen items reached consensus for inclusion in the final tool. A global 4-point rating scale from novice to proficient was developed.

CONCLUSIONS

A novel tool to assess interprofessional teamwork for individual trainees in a simulated setting was developed using a systematic review and Delphi methodology. This is the first step to establish the validity evidence necessary to use this tool for competency-based assessment.

eAssessment: development of an electronic version of the Objective Structured Assessment of Debriefing tool to streamline evaluation of video recorded debriefings

Objective

The Objective Structured Assessment of Debriefing (OSAD) is an evidence-based, 8-item tool that uses a behaviorally anchored rating scale in paper-based form to evaluate the quality of debriefing in medical education. The objective of this project was twofold: 1) to create an easy-to-use electronic format of the OSAD (eOSAD) in order to streamline data entry; and 2) to pilot its use on videoed debriefings.

Materials and Methods

The eOSAD was developed in collaboration with the LSU Health New Orleans Epidemiology Data Center using SurveyGizmo (Widgix Software, LLC, Boulder, CO, USA) software. The eOSAD was then piloted by 2 trained evaluators who rated 37 videos of faculty teams conducting pre-briefing and debriefing after a high-fidelity trauma simulation. Inter-rater reliability was assessed, and evaluators' qualitative feedback was obtained.

Results

Inter-rater reliability was good [prebrief, intraclass correlation coefficient, ICC = 0.955 (95% CI, 0.912-0.977), P < .001; debrief, ICC = 0.853 (95% CI, 0.713-0.924), P < .001]. Qualitative feedback from evaluators found that the eOSAD was easy to complete, simple to read and add comments, and reliably stored data that were readily retrievable, enabling the smooth dissemination of information collected.

Discussion

The eOSAD features a secure login, sharable internet access link for distant evaluators, and the immediate exporting of data into a secure database for future analysis. It provided convenience for end-users, produced reliable assessments among independent evaluators, and eliminated multiple sources of possible data corruption.

Conclusion

The eOSAD tool format advances the post debriefing evaluation of videoed inter-professional team training in high-fidelity simulation.

Measuring Medical Housestaff Teamwork Performance Using Multiple Direct Observation Instruments: Comparing Apples and Apples

PURPOSE

To examine the composition and concordance of existing instruments used to assess medical teams' performance.

METHOD

A trained observer joined 20 internal medicine housestaff teams for morning work rounds at Tufts Medical Center, a 415-bed Boston teaching hospital, from October through December 2015. The observer rated each team's performance using nine teamwork observation instruments that examined domains including team structure, leadership, situation monitoring, mutual support, and communication. Observations recorded on paper forms were stored electronically. Scores were normalized from 1 (low) to 5 (high) to account for different rating scales. Overall mean scores were calculated and graphed; weighted scores adjusted for the number of items in each teamwork domain. Teamwork scores were analyzed using t tests, pairwise correlations, and the Kruskal-Wallis statistic, and team performance was compared across instruments by domain.

RESULTS

The nine tools incorporated five major domains, with 5 to 35 items per instrument, for a total of 161 items per observation session. In weighted and unweighted analyses, the overall teamwork performance score for a given team on a given day varied by instrument. While all of the tools identified the same low outlier, high performers on some instruments were low performers on others. Inconsistent scores for a given team across instruments persisted in domain-level analyses.

CONCLUSIONS

There was substantial variation in the rating of individual teams assessed concurrently by a single observer using multiple instruments. Because existing teamwork observation tools do not yield concordant assessments, researchers should create better tools for measuring teamwork performance.

Team Training of Inter-Professional Students (TTIPS) for improving teamwork

Objective

In surgery, dysfunctional teamwork is perpetuated by a 'silo' mentality modelled by students. Interprofessional education using high-fidelity simulation-based training (SBT) may counteract such modelling. We sought to determine whether SBT of interprofessional student teams (1) changes long-term teamwork attitudes and (2) is an effective form of team training.

Design

A quasiexperimental, pre/postintervention comparison design was employed at an academic health sciences institution. High-fidelity simulation-based training of 42 interprofessional teams of third year surgery clerkship medical students and senior undergraduate nursing students was undertaken using a two-scenario format with immediate after action debriefing. Pre/postintervention TeamSTEPPS Teamwork Attitudes questionnaires (5 subscales, 30 items, Likert type) were given to the medical student and undergraduate nursing student classes. Pre/postsession Readiness for Inter-Professional Learning (RIPL; 19 items, Likert type) surveys and postscenario participant-rated and observer-rated Teamwork Assessment Scales (3 subscales, 11 items, Likert type) were given during each training session. Mean TeamSTEPPS Teamwork Attitudes Questionnaire, RIPL and Teamwork Assessment Scales scores were calculated; matched pre/postscore differences and trained versus non-trained TeamSTEPPS Teamwork Attitudes Questionnaire scores were compared using paired t-test or analysis of variance.

Results

Both student groups had 10 significantly improved RIPL items as well as TeamSTEPPS Teamwork Attitudes Questionnaire (TTAQ) mutual support subscales. Medical students had a significantly improved TTAQ team structure subscale. Over a simulation-based training session, each observer-rated Teamwork Assessment Scales subscale and two self-rated Teamwork Assessment Scales subscales significantly improved. Trained students had significantly higher TTAQ team structure subscales than non-trained students.

Conclusions

Interprofessional education using high-fidelity simulation-based training of students is effective at teaching teamwork, changing interprofessional attitudes and improving long-term teamwork attitudes.

Medical school predictors of later perceived mastery of clinical work among Norwegian doctors: a cohort study with 10-year and 20-year follow-up

OBJECTIVE

Doctors' self-perceived mastery of clinical work might have an impact on their career and patient care, in addition to their own health and well-being. The aim of this study is to identify predictors at medical school of perceived mastery later in doctors' careers.

DESIGN

A cohort of medical students (n=631) was surveyed in the final year of medical school in 1993/1994 (T1), and 10 (T2) and 20 (T3) years later.

SETTING

Nationwide healthcare institutions.

PARTICIPANTS

Medical students from all universities in Norway.

MAIN OUTCOME MEASURES

Perceived mastery of clinical work was measured at T2 and T3. The studied predictors measured at T1 included personality traits, medical school stress, perceived medical recording skills, identification with the role of doctor, hazardous drinking and drinking to cope, in addition to age and gender. Effects were studied using multiple linear regression models.

RESULTS

Response rates: T1, 522/631 (83%); T2, 390/522 (75%); and T3, 303/522 (58%). Mean scores at T2 and T3 were 22.3 (SD=4.2) and 24.5 (3.0) (t=8.2, p<0.001), with no gender difference. Adjusted associations at T2 were: role identification (β=0.16; p=0.006; 95% CI 0.05 to 0.28), perceived medical recording skills (β=0.13; p=0.02; 95% CI 0.02 to 0.24) and drinking to cope (β=-2.45; p=0.001; 95% CI -3.88 to -1.03). Adjusted association at T3 was perceived medical recording skills (β=0.11; p=0.015; 95% CI 0.02 to 0.21).

CONCLUSIONS

Perceived medical recording skills and role identification were associated with higher perceived mastery. Medical schools should provide experiences, teaching and assessment to enhance students' physician role identification and confidence in their own skills. Drinking to cope was associated with lower perceived mastery, which indicates the importance of acquiring healthier coping strategies in medical school.

A Systematic Review of Assessment Tools Measuring Interprofessional Education Outcomes Relevant to Pharmacy Education

Objective. To identify and describe the available quantitative tools that assess interprofessional education (IPE) relevant to pharmacy education. Methods. A systematic approach was used to identify quantitative IPE assessment tools relevant to pharmacy education. The search strategy included the National Center for Interprofessional Practice and Education Resource Exchange (Nexus) website, a systematic search of the literature, and a manual search of journals deemed likely to include relevant tools. Results. The search identified a total of 44 tools from the Nexus website, 158 abstracts from the systematic literature search, and 570 abstracts from the manual search. A total of 36 assessment tools met the criteria to be included in the summary, and their application to IPE relevant to pharmacy education was discussed. Conclusion. Each of the tools has advantages and disadvantages. No single comprehensive tool exists to fulfill assessment needs. However, numerous tools are available that can be mapped to IPE-related accreditation standards for pharmacy education.

Interprofessional Team Training at the Prelicensure Level: A Review of the Literature

PURPOSE

The authors undertook a descriptive analysis review to gain a better understanding of the various approaches to and outcomes of team training initiatives in prelicensure curricula since 2000.

METHOD

In July and August 2014, the authors searched the MEDLINE, PsycINFO, Embase, Business Source Premier, and CINAHL databases to identify evaluative studies of team training programs' effects on the team knowledge, communication, and skills of prelicensure students published from 2000 to August 2014. The authors identified 2,568 articles, with 17 studies meeting the selection criteria for full text review.

RESULTS

The most common study designs were single-group, pre/posttest studies (n = 7), followed by randomized controlled or comparison trials (n = 6). The Situation, Background, Assessment, Recommendation communication tool (n = 5); crisis resource management principles (n = 6); and high-fidelity simulation (n = 4) were the most common curriculum bases used. Over half of the studies (n = 9) performed training with students from more than one health professions program. All but three used team performance assessments, with most (n = 8) using observed behavior checklists created for that specific study. The majority of studies (n = 16) found improvements in team knowledge, communication, and skills.

CONCLUSIONS

Team training appears effective in improving team knowledge, communication, and skills in prelicensure learners. Continued exploration of the best method of team training is necessary to determine the most effective way to move forward in prelicensure interprofessional team education.

Development of a self-assessment teamwork tool for use by medical and nursing students

BACKGROUND

Teamwork training is an essential component of health professional student education. A valid and reliable teamwork self-assessment tool could assist students to identify desirable teamwork behaviours with the potential to promote learning about effective teamwork. The aim of this study was to develop and evaluate a self-assessment teamwork tool for health professional students for use in the context of emergency response to a mass casualty.

METHODS

The authors modified a previously published teamwork instrument designed for experienced critical care teams for use with medical and nursing students involved in mass casualty simulations. The 17-item questionnaire was administered to students immediately following the simulations. These scores were used to explore the psychometric properties of the tool, using Exploratory and Confirmatory Factor Analysis.

RESULTS

202 (128 medical and 74 nursing) students completed the self-assessment teamwork tool for students. Exploratory factor analysis revealed 2 factors (5 items - Teamwork coordination and communication; 4 items - Information sharing and support) and these were justified with confirmatory factor analysis. Internal consistency was 0.823 for Teamwork coordination and communication, and 0.812 for Information sharing and support.

CONCLUSIONS

These data provide evidence to support the validity and reliability of the self-assessment teamwork tool for students This self-assessment tool could be of value to health professional students following team training activities to help them identify the attributes of effective teamwork.

Addressing the Interprofessional Collaboration Competencies of the Association of American Medical Colleges: A Systematic Review of Assessment Instruments in Undergraduate Medical Education

PURPOSE

To summarize characteristics and validity evidence of tools that assess teamwork in undergraduate medical education (UME), and provide recommendations for addressing the interprofessional collaboration competencies of the Association of American Medical Colleges (AAMC).

METHOD

The authors conducted a systematic review, searching MEDLINE, MEDLINE In-process, CINAHL, and PsycINFO from January 1, 1979, through April 1, 2014; they searched reference lists and national meeting abstracts. They included original research reports that described a quantitative tool used to assess teamwork in UME. They abstracted characteristics and validity evidence for the tools, plus study quality, according to established frameworks. Two authors independently abstracted 25% of articles and calculated agreement. Authors then applied predefined criteria to identify tools best suited to address the AAMC's teamwork competencies.

RESULTS

Of 13,549 citations, 70 articles describing 64 teamwork assessment tools were included. Of these 64 tools, 27 (42%) assessed teamwork in classroom, 31 (48%) in simulation, and only 7 (11%) in actual clinical settings. The majority (47; 73%) of tools assessed medical students' teamwork in interprofessional teams. On the basis of content concordance, strength of validity evidence, generalizability of scores, and level of outcomes, four published tools were recommended to assess the AAMC's teamwork competencies: the Collaborative Healthcare Interdisciplinary Relationship Planning Scale, Readiness for Interprofessional Learning Scale, Communication and Teamwork Skills assessment, and Teamwork Mini-Clinical Evaluation Exercise.

CONCLUSIONS

Substantial validity evidence supports the use of several UME teamwork assessments. Four tools have been appropriately designed and sufficiently studied to constitute appropriate assessments of the AAMC's teamwork competencies.

Simulation in the medical undergraduate curriculum to promote interprofessional collaboration for acute care: a systematic review

This literature review summarises interprofessional, simulation-based interventions in the context of preparing undergraduate and prelicensure healthcare students for the management of acutely unstable patients. There was a particular focus on the impact of such interventions on medical students. The review sought to identify the range of described interprofessional education (IPE) learning outcomes, types of learners, methods used to evaluate intervention effectiveness and study conclusions. We systematically compiled this information and generated review findings through narrative summary. A total of 18 articles fulfilled the review criteria. The diversity of IPE interventions described suggests a developing field where the opportunities provided by simulation are still being explored. With significant heterogeneity among the studies, comparison between them was unfeasible, but each study provided a unique narrative on the complex interplay between intervention, curriculum, learning activities, learners and facilitators. Together, the narratives provided in these studies reflect positively on undergraduate simulation-based interventions to promote interprofessional collaboration in acute care settings, and provide the basis for recommendations for future IPE design and delivery, and areas requiring further research.

Are we at risk of groupthink in our approach to teamwork interventions in health care?

CONTEXT

The incidence of medical error, adverse clinical events and poor quality health care is unacceptably high and there are data to suggest that poor coordination of care, or teamwork, contributes to adverse outcomes. So, can we assume that increased collaboration in multidisciplinary teams improves performance and health care outcomes for patients?

METHODS

In this essay, the authors discuss some reasons why we should not presume that collective decision making leads to better decisions and collaborative care results in better health care outcomes.

RESULTS

Despite an exponential increase in interventions designed to improve teamwork and interprofessional education (IPE), we are still lacking good quality data on whether these interventions improve important outcomes. There are reasons why some of the components of 'effective teamwork', such as shared mental models, team orientation and mutual trust, could impair delivery of health care. For example, prior studies have found that brainstorming results in fewer ideas rather than more, and hinders rather than helps productivity. There are several possible explanations for this effect, including 'social loafing' and cognitive overload. Similarly, attributes that improve cohesion within groups, such as team orientation and mutual trust, may increase the risk of 'groupthink' and group conformity bias, which may lead to poorer decisions.

CONCLUSIONS

In reality, teamwork and IPE are not inherently good, bad or neutral; instead, as with any intervention, their effect is modified by the persons involved, the situation and the interaction between persons and situation. Thus, rather than assume better outcomes with teamwork and IPE interventions, as clinicians and educators we must demonstrate that our interventions improve the delivery of health care.