Professionalism and communication in the intensive care unit: reliability and validity of a simulated family conference

The Impact of a Pediatric Continuity Care Intensivist Program on Patient and Parent Outcomes: An Unblinded Randomized Controlled Trial

Objectives  We studied the impact of a standardized continuity care intensivists (CCIs) program on patient and family outcomes for long-stay patients in the pediatric intensive care unit (PICU), also assessing the intervention's acceptability and feasibility. Methods  A patient-level, unblinded randomized-controlled trial in a PICU at a large children's hospital. Participants included: (1) patients with ≥ 7 days PICU admission and likely to stay another 7 days; (2) their parents; (3) PICU attendings participating as continuity attendings; and (4) PICU attendings providing usual care (UC). We examined a bundled intervention: (1) standardized continuity attending role, (2) communication training course for CCI, and (3) standardized timing of contact between CCI and patient/family. Results  Primary outcome was patient PICU length of stay. Secondary outcomes included patient, parental, and clinician outcomes. We enrolled 115 parent-patient dyads (231 subjects), 58 patients were randomized into treatment arm and 56 into the UC arm. Thirteen attendings volunteered to serve as CCI, 10 as UC. No association was found between the intervention and patient PICU length of stay ( p  = 0.5), other clinical factors, or parental outcomes. The intervention met a threshold for feasibility of enrollment, retention, and implementation while the majority of providers agreed the intervention was acceptable with more efficient decision making. Thirty percent CCIs felt the role took too much time, and 20% felt time was not worth the benefits. Conclusion  CCI intervention did not impact patient or family outcomes. PICU attendings believed that the implementation of the CCI program was feasible and acceptable with potential benefits for efficiency of decision making.

Communication Training in Adult and Pediatric Critical Care Medicine. A Systematic Review

Background: Interpersonal and communication skills are essential for physicians practicing in critical care settings. Accordingly, demonstration of these skills has been a core competency of the Accreditation Council for Graduate Medical Education since 2014. However, current practices regarding communication skills training in adult and pediatric critical care fellowships are not well described. Objective: To describe the current state of communication curricula and training methods in adult and pediatric critical care training programs as demonstrated by the published literature. Methods: We performed a systematic review of the published literature using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses checklist. Three authors reviewed a comprehensive set of databases and independently selected articles on the basis of a predefined set of inclusion and exclusion criteria. Data were independently extracted from the selected articles. Results: The 23 publications meeting inclusion criteria fell into the following study classifications: intervention (n = 15), cross-sectional survey (n = 5), and instrument validation (n = 3). Most interventional studies assessed short-term and self-reported outcomes (e.g., learner attitudes and perspectives) only. Fifteen of 22 publications represented pediatric subspecialty programs. Conclusion: Opportunities exist to evaluate the influence of communication training programs on important outcomes, including measured learner behavior and patient and family outcomes, and the durability of skill retention.

One Team's Experience with Integrating Flexible Visitation in the Medical Intensive Care Unit

Integration of flexible visitation into a large health system requires concentrated effort. Evaluating impact on patient, family, and staff outcomes is important to facilitate changes and ensure visiting policy success. The medical intensive care unit staff participated in a collaborative quality improvement effort to encourage flexible visitation. The integration of flexible visitation spanned an 18-month period, timed to accompany a transition to a new setting with rooms designed to support visitor presence. This article details these efforts, outcomes, and important gaps for future work evaluating integration of flexible visitation in critical care.

Palliative Care and Communication Training in Neurosurgery Residency: Results of a Trainee Survey

OBJECTIVE

Neurosurgeons care for critically ill patients near the end of life, yet little is known about how well their training prepares them for this role. We surveyed a random sample of neurosurgery residents to describe the quantity and quality of teaching activities related to serious illness communication and palliative care, and resident attitudes and perceived preparedness to care for seriously ill patients.

METHODS

A previously validated survey instrument was adapted to reflect required communication and palliative care competencies in the 2015 the Accreditation Council for Graduate Medical Education (ACGME) Milestones for Neurological Surgery. The survey was reviewed for content validity by independent faculty neurosurgeons, piloted with graduating neurosurgical residents, and distributed online in August 2016 to neurosurgery residents in the United States using the American Association of Neurological Surgeons (AANS)/Congress of Neurological Surgeons (CNS) Joint Section on Neurotrauma and Critical Care email listserv. Multiple choice and Likert scale responses were analyzed using descriptive statistics.

RESULTS

Sixty-two responses were recorded between August 2016 and October 2016. Most respondents reported no explicit teaching on: explaining risks and benefits of intubation and ventilation (69%), formulating prognoses in neurocritical care (60%), or leading family meetings (69%). Compared to performing craniotomies, respondents had less frequent practice leading discussions about withdrawing life-sustaining treatment (61% vs. 90%, p < 0.01, "weekly or more frequently"), and were less often observed (18% vs. 87%, p < 0.01) and given feedback on their performance (11% vs. 58%, p < 0.01). Nearly all respondents (95%) felt "prepared to discuss withdrawing life-sustaining treatments," however half (48%) reported they "would benefit from more communication training during residency." Most (87%) reported moral distress, agreeing that they "participated in operations and worried whether surgery aligned with patient goals."

CONCLUSIONS

Residents in our sample reported limited formal training, and relatively less observation and feedback, on required ACGME competencies in palliative care and communication. Most reported preparedness in this domain, but many were receptive to more training. Better quality and more consistent palliative care education in neurosurgery residency could improve competency and help ensure that neurosurgical care aligns with patient goals.

Pediatric continuity care intensivist: A randomized controlled trial

INTRODUCTION

Long-stay critically ill patients in the Pediatric Intensive Care Unit (PICU) may be at risk for inconsistencies in treatment plan, delay in plan progression, and patient/family dissatisfaction with communication. This article describes the development and evaluation of an intervention designed to improve continuity and communication delivered by continuity PICU attendings.

METHODS AND ANALYSIS

A randomized controlled trial of an intervention in one PICU that was randomized at the patient level. Eligible patients and their parents included those admitted to the PICU for longer than one week and were anticipated to remain for an additional 7 days. The intervention, a Continuity Care Intensivist (CCI), included early assignment of a continuity attending (separate from a regularly scheduled service attending), standardization of the continuity role to ensure consistent team and family contact and facilitate timely decision making, and enhancement of CCI communication skills. The outcomes evaluated were 1) patient PICU length of stay, ventilator-dependent days, and hospital acquired infections, 2) parental mood and satisfaction with PICU communication, and 3) intensivist perception of acceptability of intervention. Intention to treat analysis will be completed using multivariable linear regression to determine the impact of the intervention on outcomes. Lessons have been learned about the appropriate enrollment criteria for patients to allow for impact of continuity attending, frequent prognostic uncertainty in determining which patients will become longer stay in the PICU, and the difficulty of achieving timely initial contact of continuity attending with patients given the CCI's other commitments.

Tell Me Straight: Teaching Residents to Disclose Adverse Events in Surgery

OBJECTIVE

The purpose of this effort was to create an educational experience that provided learners a realistic disclosure experience and improved resident confidence discussing an adverse outcome with a patient and family.

DESIGN

Residents practiced disclosing a surgical complication to a patient/family with simulated patients (SPs). We paired professional SPs with former patient SPs to present a realistic case. Junior residents were given extra training time before their disclosure of a laparoscopic cholecystectomy conversion to an open procedure; senior residents disclosed a bile duct injury. Residents rated pre and post-module confidence levels, and skills performance using the Disclosure of a Complication Checklist.

SETTING

900-bed tertiary care hospital with surgical residency program and simulation center.

PARTICIPANTS

General surgery residents (PGY 1-5).

RESULTS

Eighteen residents participated in the disclosure module. Analysis of the medians and interquartile ranges of pre and post-module confidence scores showed significant improvement for each individual item and mean score of learners. Residents assessed their completion rates of individual Checklist tasks positively. For example, 94% self-endorsed completion of "explanation of facts," 89% self-endorsed "took responsibility," and 78% self-endorsed "apologized sincerely." Self-rated competence scores from the Checklist were low: 7% indicated they would be "extremely comfortable" entrusting their loved one's care to themselves, 11% rated their ability to explain the facts as "outstanding," and 12% felt they were "outstanding" in their "ability to disclose a complication in a professional manner."

CONCLUSION

Residents received important skills practice in our disclosure training; disclosure confidence increased after participation. Residents scored high on completion of disclosure tasks and low on comfort and proficiency of those tasks. The Checklist provided a useful set of tasks to review and complete in the exercise. Separating residents by PGY level enabled senior residents to experience a more complex scenario and junior residents extra time to practice.

Training Surgeons and Anesthesiologists to Facilitate End-of-Life Conversations With Patients and Families: A Systematic Review of Existing Educational Models

OBJECTIVE

Despite caring for patients near the end-of-life (EOL), surgeons and anesthesiologists report low confidence in their ability to facilitate EOL conversations. This discrepancy exists despite competency requirements and professional medical society recommendations. The objective of this systematic review is to identify articles describing EOL communication training available to surgeons and anesthesiologists, and to assess their methodological rigor to inform future curricular design and evaluation.

METHODS

This PRISMA-concordant systematic review identified English-language articles from PubMed, EMBASE, and manual review. Eligible articles included viewpoint pieces, and observational, qualitative, or case studies that featured an educational intervention for surgeons or anesthesiologists on EOL communication skills. Data on the study objective, setting, design, participants, intervention, and results were extracted and analyzed. The Newcastle-Ottawa Scale was used to assess methodological quality.

RESULTS

Database and manual search returned 2710 articles. A total of 2268 studies were screened by title and abstract, 46 reviewed in full-text, and 16 included in the final analysis. Fifteen studies were conducted exclusively in academic hospitals. Two studies included attending surgeons as participants; all others featured residents, fellows, or a mix thereof. Fifteen studies used simulated role-playing to teach and assess EOL communication skills. Measured outcomes included knowledge, attitudes, confidence, self-rated or observer-rated communication skills, and curriculum feedback; significance of results varied widely. Most studies lacked adequate methodological quality and appropriate control groups to be confident about the significance and applicability of their results.

CONCLUSIONS

There are few quality studies evaluating EOL communication training for surgeons and anesthesiologists. These programs frequently use role-playing to teach and assess EOL communication skills. More studies are needed to evaluate the effect of these interventions on patient outcomes. However, evaluating the effectiveness of these initiatives poses methodological challenges.

Improving surgical residents' communication in disclosing complications: A qualitative analysis of simulated physician and patient surrogate conversations

BACKGROUND

In this study, we explore surgical resident communication with simulated patient surrogates (SPs), in an Objective Structured Clinical Examination (OSCE).

METHODS

We use discourse analysis (DA), a qualitative approach to analyzing language, to evaluate our residents' interactions with simulated patient surrogates. After identifying problematic communication patterns, we apply communication theory to discuss our findings and provide suggestions for improvement.

RESULTS

Residents consistently use bluntness, defined as delivering the news abruptly and without adequate preface, and evasiveness, defined as avoiding giving the news, to deliver difficult information. In addition, some residents use neutral language when empathetic language is warranted; and some try to direct the response of SPs, who then become defensive. Residents use evasiveness most frequently, followed by bluntness. These delivery methods often result in poor communication.

CONCLUSIONS

We recommend further research in barriers to effective resident communication with patients, as well as future research on the positive effects of good communication on patient perception. Learning these skills will help residents to convey support and empathy to patients, thereby enhancing care.

Developing and testing a comprehensive tool to assess family meetings: Empirical distinctions between high- and low-quality meetings

BACKGROUND

The heterogeneity with regard to findings on family meetings (or conferences) suggests a need to better understand factors that influence family meetings. While earlier studies have explored frequency or timing of family meetings, little is known about how factors (such as what is said during meetings, how it is said, and by whom) influence family meeting quality.

OBJECTIVES

(1) To develop an evaluation tool to assess family meetings (Phase 1); (2) to identify factors that influence meeting quality by evaluating 34 family meetings (Phase 2).

MATERIALS AND METHODS

For Phase 1, methods included developing a framework, cognitive testing, and finalizing the evaluation tool. The tool consisted of Facilitator Characteristics (i.e., gender, experience, and specialty of the person leading the meeting), and 22 items across 6 Meeting Elements (i.e., Introductions, Information Exchanges, Decisions, Closings, Communication Styles, and Emotional Support) and sub-elements. For Phase 2, methods included training evaluators, assessing family meetings, and analyzing data. We used Spearman's rank-order correlations to calculate meeting quality. Qualitative techniques were used to analyze free-text.

RESULTS

No Facilitator Characteristic had a significant correlation with meeting quality. Sub-elements related to communication style and emotional support most strongly correlated with high-quality family meetings, as well as whether "next steps" were outlined (89.66%) and whether "family understanding" was elicited (86.21%). We also found a significant and strong positive association between overall proportion scores and evaluators' ratings (r_s=0.731, p<0.001).

CONCLUSIONS

We filled a gap by developing an evaluation tool to assess family meetings, and we identified how what is said during meetings impacts quality.

Tough Conversations: Development of a Curriculum for Medical Students to Lead Family Meetings

Background:

Few educational interventions have been developed to teach Family Meeting (FM) communication skills at the undergraduate level. We developed an innovative curriculum to address this gap.

Methods:

Fourth year medical students during 2011-2013 (n = 674) completed training for conducting a FM. To assess the effectiveness of this training, students completed a FM Objective Structured Clinical Exam (OSCE) that included 15 domains rated on a 1-5 point Likert scale. Tasks included discussing prognosis, establishing goals of care and demonstrating conflict resolution skills. Students received one-to-one feedback from standardized family members and faculty observers. Group debriefings with faculty were held after the OSCE.

Results:

Analysis of faculty feedback narratives revealed four themes in which students required improvement: 1) Discussing prognosis, 2) Explaining palliative care/hospice, 3) Avoiding medical jargon, and 4) Discussing cultural/religious preferences. Evaluation total mean score was 28.2 (Min 15, Max 63; SD 7.57), and identified student’s need to; 1) Ask more about the degree of knowledge family members want, 2) Ask religious beliefs, and 3) Assess family members’ level of education ( p < 0.001). Qualitative analysis of group debriefings suggested that student perception of the OSCE experience was positive overall. Students found the case to be realistic and immediate feedback to be helpful.

Conclusions:

Conducting a FM is an advanced skill. This study shows that it is possible to train fourth year students to lead FMs and identify their strengths, needs using a FM OSCE.

Teaching professionalism in graduate medical education: What is the role of simulation?

BACKGROUND

We systematically reviewed the literature concerning simulation-based teaching and assessment of the Accreditation Council for Graduate Medical Education professionalism competencies to elucidate best practices and facilitate further research.

METHODS

A systematic review of English literature for "professionalism" and "simulation(s)" yielded 697 abstracts. Two independent raters chose abstracts that (1) focused on graduate medical education, (2) described the simulation method, and (3) used simulation to train or assess professionalism. Fifty abstracts met the criteria, and seven were excluded for lack of relevant information. The raters, 6 professionals with medical education, simulation, and clinical experience, discussed 5 of these articles as a group; they calibrated coding and applied further refinements, resulting in a final, iteratively developed evaluation form. The raters then divided into 2 teams to read and assess the remaining articles. Overall, 15 articles were eliminated, and 28 articles underwent final analysis.

RESULTS

Papers addressed a heterogeneous range of professionalism content via multiple methods. Common specialties represented were surgery (46.4%), pediatrics (17.9%), and emergency medicine (14.3%). Sixteen articles (57%) referenced a professionalism framework; 14 (50%) incorporated an assessment tool; and 17 (60.7%) reported debriefing participants, though in limited detail. Twenty-three (82.1%) articles evaluated programs, mostly using subjective trainee reports.

CONCLUSION

Despite early innovation, reporting of simulation-based professionalism training and assessment is nonstandardized in methods and terminology and lacks the details required for replication. We offer minimum standards for reporting of future professionalism-focused simulation training and assessment as well as a basic framework for better mapping proper simulation methods to the targeted domain of professionalism.

Interprofessional orientation for health professionals utilising simulated learning: Findings from a pilot study

We describe a novel, interprofessional educational intervention pilot used to orient new health profession employees through the simulation laboratory. Health profession employees were recruited to engage in a simulation training session that focused on communication, collaboration, and healthcare roles and responsibilities. Learners (N = 11) were divided into two groups with representation from various health disciplines. Each group participated in a simulated patient scenario while the other group actively observed in another classroom. At the end of both sessions, the group reconvened for a debriefing session. Participants were given a survey before and after the training session, to evaluate the content, experience, and value to their practice. The pre- and post-evaluation survey analysis showed improvement in all objectives with a mean (SD) pre-evaluation score of 4.10 (0.40-1.01) and mean (SD) post-evaluation score of 4.73 (0.30-0.81). Results were favourable, and plans to expand this project are under way.

Validity and reliability assessment of detailed scoring checklists for use during perioperative emergency simulation training

INTRODUCTION

Few valid and reliable grading checklists have been published for the evaluation of performance during simulated high-stakes perioperative event management. As such, the purposes of this study were to construct valid scoring checklists for a variety of perioperative emergencies and to determine the reliability of scores produced by these checklists during continuous video review.

METHODS

A group of anesthesiologists, intensivists, and educators created a set of simulation grading checklists for the assessment of the following scenarios: severe anaphylaxis, cerebrovascular accident, hyperkalemic arrest, malignant hyperthermia, and acute coronary syndrome. Checklist items were coded as critical or noncritical. Nonexpert raters evaluated 10 simulation videos in a random order, with each video being graded 4 times. A group of faculty experts also graded the videos to create a reference standard to which nonexpert ratings were compared. P < 0.05 was considered significant.

RESULTS

Team leaders in the simulation videos were scored by the expert panel as having performed 56.5% of all items on the checklist (range, 43.8%-84.0%), and 67.2% of the critical items (range, 30.0%-100%). Nonexpert raters agreed with the expert assessment 89.6% of the time (95% confidence interval, 87.2%-91.6%). No learning curve development was found with repetitive video assessment or checklist use. The κ values comparing nonexpert rater assessments to the reference standard averaged 0.76 (95% confidence interval, 0.71-0.81).

CONCLUSIONS

The findings indicate that the grading checklists described are valid, are reliable, and could be used in perioperative crisis management assessment.

Using simulation and standardized patients to teach vital skills to pain medicine fellows

INTRODUCTION

Simulation is an evolving aspect of medical education. The role of simulation in training programs is variable, however, in technical specialties such as surgery and anesthesiology its role is quickly becoming a standard part of training programs. Pain fellowship programs must teach clinical diagnostic skills, pharmacology and pathophysiology, in addition to interventional skills to fellows with varying residency backgrounds.

METHODS

The implementation of a hybrid simulation course into the pain fellowship curriculum allows for active learning as fellows experience challenging patient scenarios, stressful periprocedural events, and cases gone awry that require emergency algorithm recall and action.

CONCLUSION

This report describes the incorporation of simulation and crucial conversations into a pain fellowship curriculum.

A Curriculum to Improve Residents' End-of-Life Communication and Pain Management Skills During Pediatrics Intensive Care Rotation: Pilot Study

BACKGROUND

Research suggests pediatrics practitioners lack confidence and skills in the end-of-life (EOL) care.

OBJECTIVE

This pilot study explored the impact of a curriculum designed to prepare future pediatricians to manage pain and provide comfort for children and infants with life-threatening conditions and to be more confident and competent in their EOL discussions with families.

METHODS

Participants included 8 postgraduate year (PGY)-2 residents in the study group and 9 PGY-3 residents in a control group. The EOL curriculum included 4, 1-hour sessions consisting of didactic lectures, videos, and small-group, interactive discussions. Topics included discussing EOL with families, withdrawal of care, and pain assessment and management. Curriculum evaluation used an objective structured clinical examination (OSCE), self-assessment confidence and competency questionnaire, and a follow-up survey 18 months after the intervention.

RESULTS

The OSCE showed no statistically significant differences between PGY-2 versus PGY-3 residents in discussing EOL issues with family (mean  =  48.3 [PGY-2] versus 41.0 [PGY-3]), managing withdrawal of care (mean  =  20.9 [PGY-2] versus 18.91 [PGY-3]), and managing adolescent pain (mean  =  30.97 [PGY-2] versus 29.27 [PGY-3]). The self-assessment confidence and competency scores improved significantly after the intervention for both PGY-2 residents (0.62 versus 0.86, P < .01) and PGY-3 residents (0.61 versus 0.85, P < .01).

CONCLUSIONS

An EOL curriculum for PGY-2 pediatrics residents delivered during the intensive care unit rotation is feasible and may be effective. Residents reported the curriculum was useful in their practice.

International overview of high-level simulation education initiatives in relation to critical care

The use of simulation in health care education has become very topical across all professions and specialties in order to improve patient safety and quality of care. In the last decade, the adoption of more realistic simulation-based teaching methodologies, which serves as a bridge between the acquisition and application of clinical skills, knowledge, and attributes, has been accompanied by the development of a multitude of international and national simulation societies. These serve as important exchange fora for educators, clinicians, researchers, and engineers who desire to learn and share their experience and knowledge around simulation-based education. Several countries have derived their own strategy in order to promote the use of such training methodology. Current key national strategies will be presented in this paper alongside a discussion of their expected impact. Various approaches have been adopted and each has their own place and the potential to be adopted by other nations depending on their political, economic or even geographic context. Within the critical care arena, simulation has generated considerable interest and there is a growing evidence base for its use as a learning and teaching strategy within this environment. A number of critical care-related associations and societies are now recognizing simulation as an appropriate pedagogical approach and acknowledging its potential to improve patient care and clinical outcomes. Its implementation should be carefully considered to ensure that developments are based on current best educational practice to maximize the efficiency of these educational interventions.

Are pediatric critical care medicine fellowships teaching and evaluating communication and professionalism?

OBJECTIVES

To describe the teaching and evaluation modalities used by pediatric critical care medicine training programs in the areas of professionalism and communication.

DESIGN

Cross-sectional national survey.

SETTING

Pediatric critical care medicine fellowship programs.

SUBJECTS

Pediatric critical care medicine program directors.

INTERVENTIONS

None.

MEASUREMENTS AND MAIN RESULTS

Survey response rate was 67% of program directors in the United States, representing educators for 73% of current pediatric critical care medicine fellows. Respondents had a median of 4 years experience, with a median of seven fellows and 12 teaching faculty in their program. Faculty role modeling or direct observation with feedback were the most common modalities used to teach communication. However, six of the eight (75%) required elements of communication evaluated were not specifically taught by all programs. Faculty role modeling was the most commonly used technique to teach professionalism in 44% of the content areas evaluated, and didactics was the technique used in 44% of other professionalism content areas. Thirteen of the 16 required elements of professionalism (81%) were not taught by all programs. Evaluations by members of the healthcare team were used for assessment for both competencies. The use of a specific teaching technique was not related to program size, program director experience, or training in medical education.

CONCLUSIONS

A wide range of techniques are currently used within pediatric critical care medicine to teach communication and professionalism, but there are a number of required elements that are not specifically taught by fellowship programs. These areas of deficiency represent opportunities for future investigation and improved education in the important competencies of communication and professionalism.

Residents' perspectives of the value of a simulation curriculum in a general surgery residency program: a multimethod study of stakeholder feedback

BACKGROUND

Simulation has altered surgical curricula throughout residency programs. The purpose of this multimethod study was to explore residents' perceptions of simulation within surgical residency as relevant stakeholder feedback and program evaluation of the surgery simulation curriculum.

METHODS

Focus groups were held with a sample of surgery residents (n = 25) at a university-affiliated program. Residents participated in focus groups based on level of training and completed questionnaires regarding simulation curricula. Groups were facilitated by nonsurgeon faculty. Residents were asked: "What is the role of simulation in surgical education?" An interdisciplinary team recorded narrative data and performed content analyses. Quantitative data from questionnaires were summarized using descriptive statistics and frequencies.

RESULTS

Major themes from the qualitative data included: concerns regarding simulation in surgical education (28%), exposure to situations and technical skills in a low-stress learning environment (24%), pressure by external agencies (19%), an educational tool (17%), and quality assurance for patient care (12%). Laparoscopy and cadaver lab were the most prevalent simulation training during residency, in addition to trauma simulations, central lines/chest tubes/IV access, and stapling lab. In response to the statement: "ACGME should require a simulation curriculum in surgery residency," 52.1% responded favorably and 47.8% responded nonfavorably.

CONCLUSION

Residents acknowledge the value of simulation in patient safety, quality, and exposure to procedures before clinical experience, but remain divided on efficacy and requirement of simulation within curricula. The greater challenge to residency programs may be strategic implementation of simulation curricula within the right training context.

Validation of a detailed scoring checklist for use during advanced cardiac life support certification

INTRODUCTION

Defining valid, reliable, defensible, and generalizable standards for the evaluation of learner performance is a key issue in assessing both baseline competence and mastery in medical education. However, before setting these standards of performance, the reliability of the scores yielding from a grading tool must be assessed. Accordingly, the purpose of this study was to assess the reliability of scores generated from a set of grading checklists used by nonexpert raters during simulations of American Heart Association (AHA) Megacodes.

METHODS

The reliability of scores generated from a detailed set of checklists, when used by 4 nonexpert raters, was tested by grading team leader performance in 8 Megacode scenarios. Videos of the scenarios were reviewed and rated by trained faculty facilitators and a group of nonexpert raters. The videos were reviewed "continuously" and "with pauses." The grading made by 2 content experts served as the reference standard, and 4 nonexpert raters were used to test the reliability of the checklists.

RESULTS

Our results demonstrate that nonexpert raters are able to produce reliable grades when using the checklists under consideration, demonstrating excellent intrarater reliability and agreement with a reference standard. The results also demonstrate that nonexpert raters can be trained in the proper use of the checklist in a short amount of time, with no discernible learning curve thereafter. Finally, our results show that a single trained rater can achieve reliable scores of team leader performance during AHA Megacodes when using our checklist in a continuous mode because measures of agreement in total scoring were very strong [Lin's (Biometrics 1989;45:255-268) concordance correlation coefficient, 0.96; intraclass correlation coefficient, 0.97].

CONCLUSIONS

We have shown that our checklists can yield reliable scores, are appropriate for use by nonexpert raters, and are able to be used during continuous assessment of team leader performance during the review of a simulated Megacode. This checklist may be more appropriate for use by advanced cardiac life support instructors during Megacode assessments than the current tools provided by the AHA.

Using standardized family members to teach communication skills and ethical principles to critical care trainees

OBJECTIVE

We sought to determine the effectiveness of standardized family members for improving communication skills and ethical and legal knowledge of senior intensive care unit trainees.

DESIGN

Multimodal evaluation of mixed-methods educational intervention.

SETTING

Postgraduate critical care medicine academic program.

SUBJECTS

Postgraduate subspecialty critical care medicine trainees.

INTERVENTION

Communication workshop featuring a short didactic session and four simulated family meetings using trained professionals as standardized family members.

MEASUREMENTS

Ethical and legal knowledge and comfort with communication (before and after the workshop) and communication skill (during the workshop).

MAIN RESULTS

Fifty-one postgraduate critical care medicine subspecialty trainees participated in the workshop over a 5-yr period. Ethical and legal knowledge and comfort scores improved significantly among trainees who participated in the workshop. Ninety percent of trainees felt that the workshop had met or exceeded their expectations and would recommend it to other trainees. Ninety-eight percent of trainees felt that the workshop had met the highest priority learning objectives they identified. Communication scores showed a trend towards improvement over the course of the workshop, although the improvements were not significant. Participants reflecting on the workshop >1 yr later overwhelmingly felt that it had prepared them for real communication challenges in training and practice.

CONCLUSIONS

This workshop was effective for improving ethical and legal knowledge and comfort with communication among critical care medicine trainees. Participants overwhelmingly felt that it had met their learning needs and that it was an effective teaching tool that had prepared them for real communication challenges in training and practice. It could be used in a variety of contexts to address an often-neglected area of education.

Family conference in the intensive care unit: a systematic review

For the past several decades, there has been an emphasis placed on family members of critically ill patients. Patients and families should not be excluded from learning about uncertainty, risks, and treatment choices. The purpose of this article was to review research studies related to family conferences and/or meetings that focus on both adult and pediatric patients in the intensive care unit.

Interprofessional learning and virtual communities: an opportunity for the future

As various agencies increasingly advocate interprofessional care (IPC), it is paramount that the educational implications of this approach are considered. Interprofessional learning (IPL) is necessary for IPC and this paper argues that an emerging educational model, narrative-based virtual communities (VCs), meets this goal. We therefore argue for the fusion of narrative pedagogy with the VC approach to further the IPL agenda. Using stories to teach is not new. Technological innovations now make the possibility of using narrative, a way to enable students to experience greater reality in complex situations. Recently, two multimedia VCs have been developed. Here, we review the use of "The Neighborhood" and "Stilwell", as IPL tools. Early evaluation of these communities has been very positive and they offer a unique and innovative approach to IPL in ways that immerse learners from many professions into the context of the lives of individuals requiring health and social care, and the people who provide that service. Thus, it is possible to more fully realize and teach about collaboration and partnerships among professionals and patients.

Interprofessional simulated learning: short-term associations between simulation and interprofessional collaboration

BACKGROUND

Health professions education programs use simulation for teaching and maintaining clinical procedural skills. Simulated learning activities are also becoming useful methods of instruction for interprofessional education. The simulation environment for interprofessional training allows participants to explore collaborative ways of improving communicative aspects of clinical care. Simulation has shown communication improvement within and between health care professions, but the impacts of teamwork simulation on perceptions of others' interprofessional practices and one's own attitudes toward teamwork are largely unknown.

METHODS

A single-arm intervention study tested the association between simulated team practice and measures of interprofessional collaboration, nurse-physician relationships, and attitudes toward health care teams. Participants were 154 post-licensure nurses, allied health professionals, and physicians. Self- and proxy-report survey measurements were taken before simulation training and two and six weeks after.

RESULTS

Multilevel modeling revealed little change over the study period. Variation in interprofessional collaboration and attitudes was largely attributable to between-person characteristics. A constructed categorical variable indexing 'leadership capacity' found that participants with highest and lowest values were more likely to endorse shared team leadership over physician centrality.

CONCLUSION

Results from this study indicate that focusing interprofessional simulation education on shared leadership may provide the most leverage to improve interprofessional care.

Development and evaluation of a program to strengthen first year residents' proficiency in leading end-of-life discussions

PURPOSE

Multiple interventions have been developed to teach and improve internal medicine residents' end-of-life communication skills, but have not been easily adaptable to other institutions. The purpose of this study was to develop and evaluate a program to enhance physicians' end-of-life communication with families of dying patients using a format that could be incorporated into an existing curriculum for first-year internal medicine residents.

METHODS

An end-of-life educational program was developed and evaluated in the context of educating first-year residents at an urban academic medical center during the 2008-2009 academic year. The program consisted of three sessions including an interactive workshop flanked by pre- and post-workshop evaluations in simulated encounter and clinical vignette formats. Simulated encounters were recorded on video and residents' performances were rated by two independent observers using a 23 point checklist.

RESULTS

Complete data were available for 24 (73%) of 33 residents who participated in the program. The residents' checklist scores increased significantly from a mean of 48.1 at baseline to 73.9 at follow-up. The increase in the scores on the clinical vignettes was also statistically significant, but of lesser magnitude.

CONCLUSIONS

A short, focused intervention can have significant impact on residents' communication skills in the setting of an end-of-life objective structured clinical examination (OSCE).

Medical simulation in respiratory and critical care medicine

Simulation-based medical education has gained tremendous popularity over the past two decades. Driven by the patient safety movement, changes in the educational opportunities available to trainees and the rapidly evolving capabilities of computer technology, simulation-based medical education is now being used across the continuum of medical education. This review provides the reader with a perspective on simulation specific to respiratory and critical care medicine, including an overview of historical and modern simulation modalities and the current evidence supporting their use.

A multi-institutional study of the Family Conference Objective Structured Clinical Exam: a reliable assessment of professional communication

BACKGROUND

To test the value of a simulated Family Conference Objective Structured Clinical Exam (OSCE) for resident assessment purposes, we examined the generalizability and construct validity of its scores in a multi-institutional study.

METHODS

Thirty-four first-year (PG1) and 27 third-year (PG3) surgery residents (n = 61) from 6 training programs were tested. The OSCE consisted of 2 cases (End-of-Life [EOL] and Disclosure of Complications [DOC]). At each program, 2 clinicians and 2 standardized family members rated residents using case-specific tools. Performance was measured as the percentage of possible score obtained. We examined the generalizability of scores for each case separately. To assess construct validity, we compared PG1 with PG3 performance using repeated measures multivariate analysis of variance (MANOVA).

RESULTS

The relative G-coefficient for EOL was .890. For DOC, the relative G-coefficient was .716. There were no significant performance differences between PG1 and PG3 residents.

CONCLUSIONS

This OSCE provides reliable assessments suitable for formative evaluation of residents' interpersonal communication skills and professionalism.

Instruction and assessment of professionalism for surgery residents

Surgical professionalism is one of the core competencies for surgery residents. It focuses on professional responsibilities to patients and society. This report summarizes current literature on surgical professionalism to help surgical residency program directors organize appropriate instruction and assessment methods for their residents. The instructional design should be based on 14 key concepts of surgical professionalism outlined by the American College of Surgeons. The professionalism curriculum should be a mixture between faculty-identified concepts and resident input of context that those concepts apply. Surgical faculty should start the instruction with a lecture, which later leads to problem solving of cases related to surgical professionalism. Surgical faculty should integrate professionalism instruction in everyday practice in all clinical settings, using both structured and apprenticeship approaches. A comprehensive assessment of professionalism requires both a maximal and a typical performance assessment. The test of maximal performance in an Objective Structured Clinical Examination (OSCE) format is suggested for the assessment of professionalism in situations that do not occur often. The test of typical performance can be achieved with ratings from faculty, peers, nurses, and patients to evaluate professionalism competence in regular clinical services.