The effectiveness of the Geritalk communication skills course: a real-time assessment of skill acquisition and deliberate practice

Development of a Simulation-Based Mastery Learning Curriculum for Late Goals of Care Discussions

INTRODUCTION

Fellows in critical care medicine (CCM) routinely help patients and families navigate complex decisions near the end of life. These "late goals of care" (LGOC) discussions require rigorous skills training and impact patient care. Innovation is needed to ensure that fellow training in leading these discussions is centered on reproducible competency-based standards. The aims of this study were to (1) describe the development of a simulation-based mastery learning (SBML) curriculum for LGOC discussions and (2) set a defensible minimum passing standard (MPS) to ensure uniform skill acquisition among learners.

INNOVATION

We developed an SBML curriculum for CCM fellows structured around REMAP, a mnemonic outlining foundational components of effective communication around serious illness. A multidisciplinary expert panel iteratively created an LGOC discussion assessment tool. Pilot testing was completed to refine the checklist, set the MPS, and assess skill acquisition.

OUTCOMES

The LGOC discussion assessment tool included an 18-item checklist and 6 scaled items. The tool produced reliable data (k ≥ 0.7 and ICC of ≥ 0.7). Using the Mastery Angoff method, the panel set the MPS at 87%. Ten CCM fellows participated in the pilot study. Performance on the checklist significantly improved from a median score of 52% (IQR 44%-72%) at pretest to 96% (IQR 82%-97%) at post-test (P = 0.005). The number of learners who met the MPS similarly improved from 10% during pre-testing to 70% during post-testing (P = 0.02).

COMMENT

We describe the development of a LGOC SBML curriculum for CCM fellows which includes a robust communication skills assessment and the delineation of a defensible MPS.

NeoTalk: Communication Skills Training for Neonatal Clinicians

BACKGROUND

Despite proven benefit, pediatric subspecialists often have not been offered formal serious illness communication skills training. We sought to: 1) develop and evaluate the impact of a communication skills course, based on the VitalTalk framework, on Neonatal Intensive Care Unit (NICU) clinicians; 2) evaluate provider comfort with key serious illness communication skills and frequency of use of those skills, before and after "NeoTalk" and; 3) explore differences and similarities between adult and pediatric serious illness communication skills courses.

METHODS

We developed a NICU specific communication skills course and surveyed course participants to evaluate comfort with key communication skills before and after course participation, and frequency of use of key skills before and 2 months after our course. Wilcoxon signed rank tests and Kruskal-Wallis tests were performed to compare participant responses across time points.

RESULTS

34 providers completed NeoTalk training. Complete pre- and post-course data was available for 29 participants. Participants reported increased comfort with skills including 'sharing difficult news' (P = .018), and 'responding to emotion' (P = .002). Participants did not report increased frequency in using target skills 2 months after training.

CONCLUSIONS

A multi-disciplinary cohort of NICU providers endorsed increased confidence in key communication skills but not increased skill application 2-months post-course completion. While a single course can successfully teach skills, additional exposure may be necessary to build new communication habits. Our experience developing NeoTalk helped elucidate some of the ways in which conversations about seriously ill infants may be different from conversations about seriously ill adults.

Enduring Positive Impact of a Virtual Communication Skills Workshop of VitalTalk Pedagogy in a Non-U.S. Setting

CONTEXT

While in-person workshops on serious illness communication skills using VitalTalk pedagogy have been shown to have a long-lasting impact, whether changing the format into virtual would maintain its enduring impact is unknown. Objectives. To examine long-term impacts of a virtual VitalTalk communication workshop.

METHODS

Physicians in Japan who participated in our virtual VitalTalk workshop were asked to complete a self-assessment survey at 3 time points: before, immediately after, and 2 months after the workshop. We examined self-reported preparedness in 11 communication skills on a 5-point Likert scale at 3 time points, as well as self-reported frequency of practice on 5 communication skills at the pre- and 2-month time points.

RESULTS

Between January 2021 and June 2022, 117 physicians from 73 institutions across Japan completed our workshop. Seventy-four participants returned the survey at all the 3 time points. Their skill preparedness significantly improved upon the completion of the workshop in all 11 skills (P < .001 for all items). The improvement remained at the same level at 2 months in 7 skills. In 4 of the 11 skills, there was further improvement at the 2-month point. The frequency of self-directed skill practice also increased significantly in the 2-month survey for all 5 skills.

CONCLUSION

A virtual workshop of VitalTalk pedagogy improved self-reported preparedness of communication skills, and the impact was long-lasting in a non-U.S. setting as it likely induced self-practice of skills. Our findings encourage the use of a virtual format in any geographical location considering its enduring impact and easy accessibility.

Serious illness communication skills training for emergency physicians and advanced practice providers: a multi-method assessment of the reach and effectiveness of the intervention

BACKGROUND

EM Talk is a communication skills training program designed to improve emergency providers' serious illness conversational skills. Using the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework, this study aims to assess the reach of EM Talk and its effectiveness.

METHODS

EM Talk consisted of one 4-h training session during which professional actors used role-plays and active learning to train providers to deliver serious/bad news, express empathy, explore patients' goals, and formulate care plans. After the training, emergency providers filled out an optional post-intervention survey, which included course reflections. Using a multi-method analytical approach, we analyzed the reach of the intervention quantitatively and the effectiveness of the intervention qualitatively using conceptual content analysis of open-ended responses.

RESULTS

A total of 879 out of 1,029 (85%) EM providers across 33 emergency departments completed the EM Talk training, with the training rate ranging from 63 to 100%. From the 326 reflections, we identified meaning units across the thematic domains of improved knowledge, attitude, and practice. The main subthemes across the three domains were the acquisition of Serious Illness (SI) communication skills, improved attitude toward engaging qualifying patients in SI conversations, and commitment to using these learned skills in clinical practice.

CONCLUSION

Our study showed the extensive reach and the effectiveness of the EM Talk training in improving SI conversation. EM Talk, therefore, can potentially improve emergency providers' knowledge, attitude, and practice of SI communication skills.

TRIAL REGISTRATION

Clinicaltrials.gov: NCT03424109; Registered on January 30, 2018.

Education modalities for serious illness communication training: A scoping review on the impact on clinician behavior and patient outcomes

BACKGROUND

Several clinician training interventions have been developed in the past decade to address serious illness communication. While numerous studies report on clinician attitudes and confidence, little is reported on individual education modalities and their impact on actual behavior change and patient outcomes.

AIM

To examine what is known about the education modalities used in serious illness communication training and their impact on clinician behaviors and patient outcomes.

DESIGN

A scoping review using the Joanna Briggs Methods Manual for Scoping Reviews was conducted to examine studies measuring clinician behaviors or patient outcomes.

DATA SOURCES

Ovid MEDLINE and EMBASE databases were searched for English-language studies published between January 2011 and March 2023.

RESULTS

The search identified 1317 articles: 76 met inclusion criteria describing 64 unique interventions. Common education modalities used were: single workshop (n = 29), multiple workshops (n = 11), single workshop with coaching (n = 7), and multiple workshops with coaching (n = 5); though they were inconsistently structured. Studies reporting improved clinician skills tended to be in simulation settings with neither clinical practice nor patient outcomes explored. While some studies reported behavior changes or improved patient outcomes, they did not necessarily confirm improvements in clinician skills. As multiple modalities were commonly used and often embedded within quality improvement initiatives, the impact of individual modalities could not be determined.

CONCLUSION

This scoping review of serious illness communication interventions found heterogeneity among education modalities used and limited evidence supporting their effectiveness in impacting patient-centered outcomes and long-term clinician skill acquisition. Well-defined educational modalities and consistent measures of behavior change and standard patient-centered outcomes are needed.

PedsTalk: A Pilot Communication Skills Education Course for Pediatric Residents

OBJECTIVE

Communication skills are critical to pediatric practice, but few pediatric residency programs provide formal communication skills education. Pediatric residents often lack confidence in these skills. We hypothesized that a simulation-based communication skills course would improve resident confidence in the skills required for serious illness conversations with patients/families.

METHODS

In collaboration with multidiscipline VitalTalk-trained faculty, we developed PedsTalk, a communication skills course for pediatric residents based on the VitalTalk framework. In PedsTalk, faculty/peers offered real-time coaching during simulation sessions with actors. Resident participants self-rated confidence in 9 communication skills using a 5-point Likert scale before, immediately after, and 4 months after course participation, with course nonparticipants serving as controls. Responses were analyzed by using Friedman tests and Wilcoxon rank tests. Thematic analysis was conducted to identify themes among free-text responses.

RESULTS

Twenty-seven pediatric residents participated in PedsTalk, 11 of whom completed survey assessments at all timepoints. Eleven course nonparticipants served as controls. Over time, participants' confidence in the following communication skills was retained or significantly improved: "difficult conversations" (P < .001), "recognizing emotion" (P < .01), "using silence" (P < .008), "headline statements" (P < .001), eliciting "VALUES" (P < .001), and asking "permission to continue" (P < .001). Over time, controls had significant improvements in confidence in 2 skills: headline statements (P < .014) and eliciting "VALUES" (P < .031).

CONCLUSIONS

PedsTalk is a novel approach to communication skills education in pediatric residency. Participation improved residents' confidence in 6 communication skills, including overall confidence in having difficult conversations. Although confidence in some skills may naturally develop through clinical experiences, PedsTalk further enhances communication skills education among trainees.

Virtual Geritalk: Does Intensive Virtual Communication Skills Training Improve Use of Serious Illness Communication Skills?

Background: The COVID-19 pandemic presented a unique opportunity to adapt in-person communication skills training to a virtual format. Objective: Examine use of serious illness communication skills by learners after participating in an intensive virtual communication skills training. Design: Prospective cohort study. Setting/Subjects: Icahn School of Medicine at Mount Sinai, Clinical Fellows. Measurements: Family Meeting Communication Assessment Tool (FAMCAT) assessed fundamental and advanced communication skills. Results: As compared to a historical benchmark obtained after a prior in-person course, the virtual course showed equivalent or better use of communication skills across fundamental skills and advanced skills. Conclusions: Our findings suggest that a virtual communication skills training is associated with the use of serious illness communication skills in the clinical setting by learners.

Serious Illness Communication Skills Training for Emergency Physicians and Advanced Practice Providers: A Multi-Method Assessment of the Reach and Effectiveness of the Intervention

Background

EM Talk is a communication skills training program designed to improve emergency providers' serious illness conversational skills. Using the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework, this study aims to assess the reach of EM Talk and its effectiveness.

Methods

EM Talk is one of the components of Primary Palliative Care for Emergency Medicine (EM) intervention. It consisted of one 4-hour training session during which professional actors used role-plays and active learning to train providers to deliver serious/bad news, express empathy, explore patients' goals, and formulate care plans. After the training, emergency providers filled out an optional post-intervention survey, which included course reflections. Using a multi-method analytical approach, we analyzed the reach of the intervention quantitatively and the effectiveness of the intervention qualitatively using conceptual content analysis of open-ended responses.

Results

A total of 879 out of 1,029 (85%) EM providers across 33 emergency departments completed the EM Talk training, with the training rate ranging from 63-100%. From the 326 reflections, we identified meaning units across the thematic domains of improved knowledge, attitude, and practice. The main subthemes across the three domains were the acquisition of discussion tips and tricks, improved attitude toward engaging qualifying patients in serious illness (SI) conversations, and commitment to using these learned skills in clinical practice.

Conclusion

Effectively engaging qualifying patients in serious illness conversations requires appropriate communication skills. EM Talk has the potential to improve emergency providers' knowledge, attitude, and practice of SI communication skills.

Trial registration

NCT03424109.

Can teaching serious illness communication skills foster multidimensional empathy? A mixed-methods study

BACKGROUND

To investigate the impact of a serious illness communication skills training course on medical students' attitudes regarding clinical empathy, self-efficacy in empathic communication, and learning on different dimensions of empathy.

METHODS

A mixed-methods design was used. A blended learning Serious Illness Communication Skills Training (SI-CST) course was delivered to sixth-year medical students. Students (n=185) completed questionnaires with the 20-item Jefferson Scale of Empathy (JSE) and self-rated preparedness level for five empathic communication tasks at baseline (T1), six weeks (T2), and three-to-six months post-training (T3). Written reflections on key lessons learned were analyzed using inductive thematic analysis.

RESULTS

Total JSE scores significantly improved from T1 to T2 (111.4 vs 113.9, P=.01) and from T1 to T3 (111.4 vs 113.9, P=.01). There was an increase in Standing in Patient's Shoes subscale of the JSE with an effect size of 0.56 whereas the Perspective-Taking and Compassionate Care subscales showed no significant changes. Self-rated preparedness for all five empathic communication tasks significantly improved from T1 to T2 (P ≤ .001) and from T1 to T3 (P ≤ .001) with large effect sizes (1.09-1.41). Four key themes emerged from the qualitative analysis. They were appreciating the important role of empathy in clinical care (moral empathy), learning skills in detecting and understanding patient emotions (cognitive empathy), learning skills in responding to emotion with empathy (behavioral empathy), and appreciating that communication skills can be improved with continual practice and self-reflection.

CONCLUSIONS

Our results revealed that SI-CST improved medical students' empathic attitudes and self-efficacy in empathic communication. Qualitative results found learning on the cognitive, behavioral and moral dimensions of empathy.

Effect of Experiential Communication Skills Education on Graduate Medical Education Trainees' Communication Behaviors: A Systematic Review

PURPOSE

A better understanding of how communication skills education impacts trainees' communication skills is important for continual improvement in graduate medical education (GME). Guided by the Kirkpatrick Model, this review focused on studies that measured communication skills in either simulated or clinical settings. The aim of this systematic review was to examine the effect of experiential communication skills education on GME trainees' communication behaviors.

METHOD

Five databases were searched for studies published between 2001 and 2021 using terms representing the concepts of medical trainees, communication, training, and skills and/or behaviors. Included studies had an intervention design, focused only on GME trainees as learners, used experiential methods, and had an outcome measure of communication skills behavior that was assessed by a simulated or standardized patient (SP), patient, family member, or outside observer. Studies were examined for differences in outcomes based on study design; simulated versus clinical evaluation setting; outside observer versus SP, patient, or family member evaluator; and length of training.

RESULTS

Seventy-seven studies were ultimately included. Overall, 54 (70%) studies reported some positive findings (i.e., change in behavior). There were 44 (57%) single-group pre-post studies, 13 (17%) nonrandomized control studies, and 20 (26%) randomized control studies. Positive findings were frequent in single-group designs (80%) and were likely in nonrandomized (62%) and randomized (55%) control trials. Positive findings were likely in studies evaluating communication behavior in simulated (67%) and clinical (78%) settings as well as in studies with outside observer (63%) and SP, patient, and family member (64%) evaluators.

CONCLUSIONS

This review demonstrates strong support that experiential communication skills education can impact GME trainees' communication behaviors. Marked heterogeneity in communication trainings and evaluation measures, even among subgroups, did not allow for meta-analysis or comparative efficacy evaluation of different studies. Future studies would benefit from homogeneity in curricular and evaluation measures.

AD-LAST! An interdisciplinary clinical workshop to improve cultural and spiritual awareness in advance care planning skills

OBJECTIVES

Clinicians report training deficits in advance care planning (ACP), including limits to their understanding of cultural/spiritual influences on patient decision-making and skills in interdisciplinary teamwork. This study describes Advance Directives-Live Action Simulation Training (AD-LAST), an interdisciplinary experiential and didactic training program for discussing ACP and end-of-life (EOL) care. AD-LAST highlights cultural/spiritual variations in medical decision-making.

METHODS

Prospective educational cohort study with pre-post intervention survey. AD-LAST incorporated standard curricular tools for didactic and experiential training in ACP/EOL communication. Study conducted in an urban community teaching hospital in Queens, NY, one of the most diverse counties in the USA. Participants included physicians, house staff, nurses, therapists, and other disciplines. AD-LAST format was a one-day workshop. The morning focused on didactic teaching using widely available curricular tools. The afternoon involved experiential practice with standardized patient-actors. Pre-post intervention questionnaires assessed ACP operational knowledge and self-efficacy (i.e., self-confidence in skills) in ACP and EOL communication. Repeated measure ANOVAs evaluated changes from pretest to posttest in knowledge and self-efficacy.

RESULTS

A total of 163 clinical staff participated in 21 AD-LAST training sessions between August 2015 and January 2019. Participants displayed a significant increase from pretest to posttest in total knowledge (p < 0.001), ACP procedural knowledge (p < 0.001), ACP communication/relationships knowledge (p < 0.001), and self-efficacy (p < 0.001). Knowledge and self-efficacy were not correlated and represented independent outcomes. Postprogram evaluations showed greater than 96% of participants were highly satisfied with AD-LAST, especially the opportunity to practice skills in real-time and receive feedback from members of other professional groups.

SIGNIFICANCE OF RESULTS

AD-LAST, a multifaceted training program deployed in an interdisciplinary setting, is effective for increasing ACP knowledge and self-efficacy, including the capacity to address cultural/spiritual concerns. The use of standard tools facilitates dissemination. The use of case simulations reinforces learning.

Training to Promote Empathic Communication in Graduate Medical Education: A Shared Learning Intervention in Internal Medicine and General Surgery

Background:

Objective:

Design:

Setting/Subjects:

Measurements:

Results:

Conclusions:

Teaching and assessing communication skills in the postgraduate medical setting: a systematic scoping review

BACKGROUND

Poor communication skills can potentially compromise patient care. However, as communication skills training (CST) programs are not seen as a priority to many clinical departments, there is a discernible absence of a standardised, recommended framework for these programs to be built upon. This systematic scoping review (SSR) aims to gather prevailing data on existing CSTs to identify key factors in teaching and assessing communication skills in the postgraduate medical setting.

METHODS

Independent searches across seven bibliographic databases (PubMed, PsycINFO, EMBASE, ERIC, CINAHL, Scopus and Google Scholar) were carried out. Krishna's Systematic Evidence-Based Approach (SEBA) was used to guide concurrent thematic and content analysis of the data. The themes and categories identified were compared and combined where possible in keeping with this approach and then compared with the tabulated summaries of the included articles.

RESULTS

Twenty-five thousand eight hundred ninety-four abstracts were identified, and 151 articles were included and analysed. The Split Approach revealed similar categories and themes: curriculum design, teaching methods, curriculum content, assessment methods, integration into curriculum, and facilitators and barriers to CST. Amidst a wide variety of curricula designs, efforts to develop the requisite knowledge, skills and attitudes set out by the ACGME current teaching and assessment methods in CST maybe categorised into didactic and interactive methods and assessed along Kirkpatrick's Four Levels of Learning Evaluation.

CONCLUSIONS

A major flaw in existing CSTs is a lack of curriculum structure, focus and standardisation. Based upon the findings and current design principles identified in this SSR in SEBA, we forward a stepwise approach to designing CST programs. These involve 1) defining goals and learning objectives, 2) identifying target population and ideal characteristics, 3) determining curriculum structure, 4) ensuring adequate resources and mitigating barriers, 5) determining curriculum content, and 6) assessing learners and adopting quality improvement processes.

Virtual Geritalk: Improving Serious Illness Communication of Clinicians Who Care for Older Adults

CONTEXT

High quality communication is essential to older adults' medical decision-making, quality of life, and adjustment to serious illness. Studies have demonstrated that Geritalk, a two day (16 hours total) in-person communication skills training improves self-assessed preparedness, skill acquisition, and sustained practice of communication skills. Due to the COVID-19 pandemic, Geritalk was adapted to a virtual format (four days, 10 hours total).

OBJECTIVES

Our study evaluated the change in participants' self-assessed preparedness for serious illness communication before and after the virtual course and satisfaction with the course, and compared these findings to responses from a prior in-person Geritalk course.

METHODS

Geriatrics and Palliative Medicine fellows at three urban academic medical centers completed surveys, which employed five-point Likert scales, before and after the virtual course to assess satisfaction with the course and preparedness for serious illness communication.

RESULTS

Of the 20 virtual Geritalk participants, 17 (85%) completed the pre-course assessment, and 14 (70%) completed the post-course assessment. Overall, satisfaction with the course was high (mean 4.9 on a 5-point scale). Compared to in-person Geritalk participants, virtual course participants reported comparable and significant (P < 0.01) improvements in mean self-reported preparedness across all surveyed communication skills.

CONCLUSION

We show that a virtual communication skills training is feasible and effective. Our findings suggest that the innovative virtual Geritalk course has the potential to increase access to communication skills training, improve serious illness communication skills, and in improve the quality of care received by older adults with serious illness.

Physicians' Perceptions and Suggestions for the Adaptation of a US-Based Serious Illness Communication Training in a Non-US Culture: A Qualitative Study

CONTEXT

US-based serious illness communication training pedagogy has not been well studied outside of the United States.

OBJECTIVES

To explore the perception of a US-based, serious illness communication training pedagogy in a non-US culture and to identify aspects requiring cultural adaptations.

METHODS

In September 2019, we conducted a qualitative study using convenient sampling at two urban, academic medical centers in Tokyo, Japan. Semistructured interviews were conducted to Japanese physicians who participated in the four-hour VitalTalk training in Japanese. We explored six majored themes: 1) global impression of the training; 2) main goals from participation; 3) appropriateness of didactics; 4) role play experiences; 5) take away points from the training; and 6) changes in their own communication practice after the training. Interviews were transcribed, coded, and analyzed using phenomenological approach.

RESULTS

All 24 participants found the VitalTalk pedagogy novel and beneficial, stressing the importance of demonstrating empathy, reflecting on own skills, and recognizing the importance of feedback that emphasizes the use of specific words. Participants also pointed out that Japanese patients generally do not express their strong emotions explicitly.

CONCLUSION

Our study found empirical evidence that the VitalTalk pedagogy is perceived to be novel and beneficial in a non-US cultural setting. Cultural adaptations in expression and response to emotion may be required to maximize its efficacy in Japan. To meet the needs of clinical practice in Japan, further studies are needed to empirically test the suggested refinements for the VitalTalk pedagogy.

Expanding the Palliative Care Workforce during the COVID-19 Pandemic: An Evaluation of Core Palliative Care Skills in Health Social Workers

Background: Meeting the needs of seriously ill SARS-CoV-2 (COVID-19) patients requires novel models of deploying health social workers (SWs) to expand the palliative care workforce. To inform such expansion, understanding the current state of health SWs' core palliative care skills is necessary. Methods: Following minimal training, health SWs in one New York City hospital were surveyed about their frequency, competence, and confidence in using core palliative care skills. Results: Of the 170 health SWs surveyed, 46 (27%) responded, of whom 21 (46%) and 24 (52%) had palliative care training before and during the COVID-19 surge, respectively. Health SWs reported a "moderate improvement" in the use of three skills: "identify a medical decision maker," "assess prognostic understanding," and "coordinate care." There was "minimal decrease" to "no improvement" to "minimal improvement" in competence and confidence of skill use. Conclusion: Our findings suggest that educational initiatives can improve health SWs' use of core palliative care skills.

Launching the Next Steps to Improve Hospice and Palliative Medicine Fellow Performance Assessment: A Look Back to the Initial Toolkit of Assessment Methods

Education leaders in hospice and palliative medicine (HPM) have long acknowledged the challenge of fellow performance assessment and the need for HPM-specific fellow assessment tools. In 2010, and in alignment with the Accreditation Council for Graduate Medical Education's (ACGME's) directive toward competency-based medical education, the national HPM Competencies Workgroup curated a set of assessment tools, the HPM Toolkit of Assessment Methods. The Toolkit has been a resource for HPM fellowship directors in evolving practical, multifaceted fellow assessment strategies. Now, as American Academy of Hospice and Palliative Medicine plans for a national workgroup in 2020 to define current HPM fellow assessment methods and to propose strategies to strengthen and standardize future assessment, the Toolkit provides a strong base from which to launch. However, the field learned important lessons from the 2010 Workgroup about the consensus process, gaps in areas of assessment, opportunities to address gaps with new or adapted tools, and limitations in implementing the Toolkit over time in terms of tracking, accessibility, and dissemination. This article describes the development of the Toolkit, including recommended tools and methods for assessment within each ACGME competency domain, and links the lessons learned to recommendations for the 2020 workgroup to consider in creating the next HPM assessment strategy and toolkit. Effective implementation will be crucial in supporting fellows to reach independent practice, which will further strengthen the field and workforce to provide the highest quality patient and family-centered care in serious illness. This will require an inspired, committed effort from the HPM community, which we enthusiastically anticipate.

Impact of a Novel Goals-of-Care Communication Skills Coaching Intervention for Practicing Oncologists

Background: Oncologists routinely have opportunities for goals-of-care (GoC) discussions with patients. GoC discussions increase the likelihood that patients receive care consistent with their values. However, oncologists often feel ill-equipped to discuss end-of-life care. Objective: To assess the impact of a communication training and coaching intervention (INT) for oncologists during GoC discussions. Design: We randomized oncologists to usual care (UC) or a communication skills training INT, which consisted of an interactive training session and four joint visits with communication coaches. Setting/Subjects: Solid tumor oncologists seeing advanced cancer patients at four hospitals in New York and Connecticut. Measurements: Three blinded coders evaluated recorded encounters before and after INT using a validated tool to assess skill attainment. Results: Oncologists (n = 22) were 32% female and averaged 46 years of age. In baseline visits, INT oncologists (n = 11) and UC oncologists (n = 11) had no difference in the number of mean skills employed out of 8 GoC skills (INT 3.5, UC 2.4; p = 0.18). Post-INT, INT oncologists were significantly more likely to elicit patient values (55% vs. 0%; p = 0.01). There was no significant difference in overall mean skills employed (INT 3.4, UC 2.2; p = 0.14). Assessing for understanding, offering "I wish" statements, and providing prognosis were the least utilized skills among all oncologists. Conclusion: Our real-time communication skills coaching INT resulted in a significant increase in oncologists' ability to elicit patient values during GoC discussions, suggesting that skill acquisition can occur in the face of less intensive training. Future studies can highlight gaps leading to the lack of differences in utilization of other skills.

A Social Worker-Led Primary Palliative Care Model for Hospitalized Patients Admitted to the Hospital Medicine Service

Objective: To increase earlier access to palliative care, and in turn increase documented goals of care and appropriate hospice referrals for seriously ill patients admitted to hospital medicine.

Background: Due to the growing number of patients with serious illness and the specialty palliative care workforce shortage, innovative primary palliative care models are essential to meet this population's needs.

Methods: Patients with serious illness admitted to hospital medicine at a quaternary urban academic medical center in New York City and received an embedded palliative care social worker consultation in 2017. We used univariate analyses of sociodemographic, clinical, and utilization data to describe the sample.

Results: Overall, 232 patients received a primary palliative care consultation (mean age of 69 years, 44.8% female, 34% white, median Karnofsky Performance Status of 40%), and 159 (69%) had capacity to participate in a goals-of -are conversation. Referrals were from palliative care solid tumor oncology trigger program (113 [49%]), specialty palliative care consultation team (42[18%]), and hospital medicine (34[14.6%]). Before the consultation, 10(4.3%) had documented goals of care and 207 (89%) did after the consultation. The percentage of those referred to hospice was 24.1%. Of those transferred to specialty palliative care consultation service, nearly half required symptom management.

Discussion: Patients who received a primary palliative care consultation were seen earlier in their illness trajectory, based on their higher functional impairment, and the majority had capacity to participate in goals-of-care discussions, compared with those who were seen by specialty palliative care. The consultation increased goals-of-care documentation and the hospice referral rate was comparable with that of the specialty palliative consultation team.

Family Meeting Training Curriculum: A Multimedia Approach With Real-Time Experiential Learning for Residents

INTRODUCTION

Effective communication skills are widely recognized as an important aspect of medical practice. Several tools and curricula for communications training in medicine have been proposed, with increasing attention to the need for an evidence-based curriculum for communication with families of patients in the intensive care unit (ICU).

METHODS

We developed a curriculum for internal medicine residents rotating through the medical ICU that consisted of a didactic session introducing basic and advanced communication skills, computer-based scenarios exposing participants to commonly encountered dilemmas in simulated family meetings, and experiential learning through the opportunity to identify potential communication challenges prior to facilitating actual family meetings, followed by structured peer debriefing. Seventeen residents participated in the study.

RESULTS

We administered the Communication Skills Attitude Scale to participants before and after participation in the curriculum, as well as a global self-efficacy survey, with some items based on the Common Ground rating instrument, at the end of the academic year. There were no significant changes in either positive or negative attitudes toward learning communication skills. Resident self-perceived efficacy in several content domains improved but did not reach statistical significance.

DISCUSSION

Our curriculum provided interactive preparatory training and an authentic experience for learners to develop skills in family meeting facilitation. Learners responded favorably to the curriculum. Use of the Family Meeting Behavioral Skills (FMBS) tool helped residents and educators identify and focus on specific skills related to the family meeting. Next steps include gathering and analyzing data from the FMBS tool.

Development and Validation of the ACP-CAT for Assessing the Quality of Advance Care Planning Communication

CONTEXT

High-quality advance care planning (ACP) discussions are important to ensure patient receipt of goal-concordant care; however, there is no existing tool for assessing ACP communication quality.

OBJECTIVES

The objective of this study was to develop and validate a novel instrument that can be used to assess ACP communication skills of clinicians and trainees.

METHODS

We developed a 20-item ACP Communication Assessment Tool (ACP-CAT) plus two summative items. Randomized rater pairs assessed residents' performances in video-recorded standardized patient encounters before and after an ACP training program using the ACP-CAT. We tested the tool for its 1) discriminating ability, 2) interrater reliability, 3) concurrent validity, 4) feasibility, and 5) raters' satisfaction.

RESULTS

Fifty-eight pre/post-training video recordings from 29 first-year internal medicine residents at Mount Sinai Hospital were evaluated. ACP-CAT reliably discriminated performance before and after training (median score 6 vs. 11, P < 0.001). For both pre/post-training encounters, interrater reliability was high for ACP-CAT total scores (intraclass correlation coefficient or ICC = 0.83 and 0.82) and the summative items Overall impression of ACP communication skills (ICC = 0.73 and 0.80) and Overall ability to respond to emotion (ICC = 0.83 and 0.82). Concurrent validity was shown by the strong correlation between ACP-CAT total score and both summative items. Raters spent an average of 4.8 minutes to complete the ACP-CAT, found it feasible, and were satisfied with its use.

CONCLUSION

ACP-CAT provides a validated measure of ACP communication quality for assessing video-recorded encounters and can be further studied for its applicability with clinicians in different clinical contexts.

Communication Skills Training for General Surgery Residents

BACKGROUND

Although good communication skills are essential for surgeons, there is no formal communication training during general surgery residency.

OBJECTIVES

To implement a communication skills training program based on evidence-based teaching methods in general surgery residency.

DESIGN

We developed a 2-hour communication skills training program for general surgery residents, consisting of a small group skill practice session using role play with simulated patients along with real-time feedback from facilitators and observing peer residents. A board-certified palliative care physician and a board-certified surgeon facilitated each session. Outcome measures were self-assessment of preparedness with the session immediately before and after the session and 2 months after the session, resident satisfaction, and self-report frequency of skill practice. Results were compared between junior residents (postgraduate year 1-3) and senior residents (postgraduate year 4-5).

SETTING

Columbia University Medical Center in New York City, a tertiary care, urban academic center with a 5-year General Surgery Residency program.

PARTICIPANTS

Thirty-one out of 39 (79.4%) general surgery residents (20 junior and 11 senior) were trained over a 9-month period. All participants completed the immediate pre- and post-session surveys, and twenty residents (64.5%) completed the 2-month postsession follow-up survey.

RESULTS

Overall, self-assessment of preparedness for specific communication challenges improved significantly for 7 of 11 tasks. At baseline, senior residents felt significantly more prepared than junior residents in all 11 tasks. Junior residents' self-assessment of preparedness improved significantly in 10 of 11 tasks. Overall satisfaction with the session was very high (mean 4.74 on a 5-point scale). Residents reported high frequency of self-directed skill practice in the 2-month follow-up survey.

CONCLUSIONS

This 2-hour communication skills practice session for general surgery residents was feasible, and it improved resident self-assessment of preparedness in communication and augmented self-directed skill practice.

Primary Palliative Care Education Programs: Review and Characterization

Background:

Primary palliative care (PPC) education programs have arisen in response to the recognition that all clinicians need to have a basic set of knowledge and skills to provide excellent care to all patients. PPC education programs appear to vary widely, making it difficult for potential learners to find the right program to fit their needs. We have cataloged and categorized a snapshot of PPC education programs across the United States to serve as a resource for those seeking training, and for educators interested in starting or optimizing such programs.

Methods:

Medical and commercial search engines (MSEs and CSEs, respectively) were used to generate a list of PPC education programs in the United States. Programs were contacted to supplement information available online, and then categorized based on intended learner, certification/degree conferred upon completion, and other characteristics.

Results:

There was little overlap between the PPC education programs found through MSEs and CSEs. Programs found via CSEs varied with respect to intended learners, pedagogy, content, and cost. Among the minority of programs that confer a certification/degree upon completion, there is no consensus as to what these signify.

Conclusions:

The wide variety of PPC education programs is both a challenge to and strength of the field. We hope that this report will serve as a call to develop a standard PPC education taxonomy to help define essential components of all PPC programs, while also leaving sufficient room for programs to serve the unique needs of their local learners and patient populations.

NephroTalk: Evaluation of a Palliative Care Communication Curriculum for Nephrology Fellows

CONTEXT

Nephrologists care for a medically complex population that faces difficult decisions around treatment options and end-of-life care. Yet communication training within nephrology fellowship is rare. Prior work suggests that communication training in nephrology can improve perceived preparedness to engage in difficult conversations; however, it is unclear if this training results in improved clinical skills.

OBJECTIVES

The primary aim was to evaluate the efficacy of a three-day curriculum for nephrology fellows (NephroTalk) to improve communication skill acquisition for delivering serious news. We also measured self-reported preparedness for three additional communication tasks taught, including goals of care and transitions at end of life.

METHODS

Thirty-three first- and second-year fellows from seven academic nephrology programs participated in NephroTalk from 2015 to 2016. Pretraining and post-training encounters to deliver bad news with standardized patients were audiorecorded and evaluated using a modified communication checklist. Fellow experience and self-reported improvement in communication tasks were measured using a five-point Likert scale.

RESULTS

Skill use increased after training for seven of the nine skills measured (P < 0.01). The average number of skills gained after training was 3.6 ± 1.8 skills. With increased communication proficiency, post-training encounters were significantly shorter than pretraining encounters (P = 0.03). Fellows reported improved preparedness to engage in all communication tasks taught in NephroTalk curriculum.

CONCLUSION

Our findings support NephroTalk as an effective communication skills curriculum for nephrology trainees. Fellows increased their communication skills significantly in delivering bad news leading to more efficient encounters.

Expanding Goals of Care Conversations Across a Health System: The Mapping the Future Program

CONTEXT

Clinician failure to discuss goals of care (GOC) with seriously ill patients remains prevalent. Small-scale educational interventions have demonstrated improvement in physician communication skills, but it is unknown if these results translate into practice changes.

OBJECTIVES

To implement a large-scale educational intervention that would facilitate increased GOC discussions in at-risk patients, increase clinician confidence in having GOC discussions, and prove to be sustainable.

METHODS

The Mapping the Future courses were four-to-eight-hour trainings, with brief lectures and demonstrations followed by practice with simulated patient cases. Participants completed precourse and postcourse surveys, including demographic information, self-confidence in a variety of communication tasks, willingness to initiate GOC discussions, barriers to GOC discussions, and self-perceived skill at having GOC conversations. We compared the rate of documentation of GOC discussions with at-risk inpatients in three hospitals for physicians who had taken the course and those who had not.

RESULTS

Over a two-year period, we trained 512 clinicians in 42 sessions. After the course, participants felt that they had improved in all the skills that we taught and agreed that they would be more likely to initiate GOC conversations. Trained physicians were more likely than their nontrained colleagues to document a GOC discussion with at-risk patients (30.8% vs. 27.2%; P = 0.0001).

CONCLUSION

A large-scale educational intervention involving simulated patient cases increased GOC documentation across a health system. Other programs might consider collaboration with quality improvement specialists to measure the impact of education and situate it within other system changes to support increased GOC discussions.

Exploring the Role and Application of the Deliberate Practice Concept in Radiation Therapy

The concept of deliberate practice (DP) has been extensively applied to the development of skill and expert performance in many domains of professional practice. Although it has been widely reviewed in other health professions, there is a lack of evidence on its application in radiation therapy practice. This article aims to explore the concept of DP and how it can be applied to radiation therapy practice. The authors define DP, why it is essential, and how it can be implemented in radiation therapy. Evidence from the DP literature in the health professions was used to clarify the guiding principles for successful DP implementation within both the clinical and educational contexts. While the authors encourage radiation therapy practitioners to engage in DP approaches, every profession utilizing DP will develop strategies unique to the individual discipline. Hence, rather than imitating other professions, it is essential that radiation therapists engage evidence-based approaches that will generate empirical evidence to model radiation therapy-specific DP approaches.

Practicing Communication Skills For Responding to Emotionally Charged Questions

Objective:

To assess the impact of a 1-hour communication skills workshop highlighting the “ask more and summarize technique” (AMST) to teach residents an effective way to respond to emotionally charged questions.

Methods:

From December 2015 to January 2017, residents on an inpatient oncology or palliative medicine rotation attended a mandatory 1-hour workshop on AMST involving a short introduction to the technique followed by skills practice. A survey (S1) was administered to the residents during the first session to assess their self-reported attitudes and practices. A follow-up survey (S2) was e-mailed at the end of the rotation to assess the usefulness of AMST.

Results:

Twenty-one participants completed S1, and 12 participants completed S2. A total of 62% (13/21) reported the workshop was “very useful.” There was a reported increased frequency of “summarizing back” between surveys ( P = .01). Addressing fear and anxiety (75%, 9/12) and responding to patients who were angry/upset (67%, 8/12) were the situations where AMST was found to be the most useful. Fifty-four percent of respondents (7/12) felt they could have used AMST more.

Conclusion:

A 1-hour communication skills workshop targeting residents on an inpatient oncology or palliative rotation increased the use of summary statements in challenging situations.

Practice Implications:

A short skills practice workshop can be incorporated into a busy clinical curriculum to achieve changes in trainee behaviors and attitudes.

Validation of the Family Meeting Behavioral Skills Checklist. An Instrument to Assess Fellows' Communication Skills

RATIONALE

Fellows in pulmonary and critical care medicine are required to show competency in facilitating family meetings for critically ill patients. There are many assessment measures available for evaluating physician-patient communication (e.g., the SEGUE Framework [Set the stage, Elicit information, Give information, Understand the patient's perspective, End the encounter]) and some designed for family meetings. However, no validated measure exists that is specifically designed to assess communication skills during family meetings with surrogate decision makers in intensive care settings.

OBJECTIVES

We developed the Family Meeting Behavioral Skills Checklist (FMBSC) to measure advanced communication skills of fellows in family meetings of critically ill patients based on a literature review and consensus of an interdisciplinary group of communications experts. We evaluated the psychometric properties of the FMBSC.

METHODS

We digitally recorded 16 pulmonary/critical care fellows performing a simulated family meeting for a critically ill patient at the end of 1 year of fellowship training. Two clinical health psychologists evaluated each recording independently using the FMBSC Rating Scale and the SEGUE Framework. Judges recorded the number of skills performed using the checklist and employed a summary rating scale to judge the level of performance for each of nine subsets of skills. Each instrument was scored and converted to percentage scores. The FMBSC and SEGUE Framework items were summed and converted to percentage scores for each category and as a total for each instrument. The rating scale items on the FMBSC were also summed and converted to a percentage score. Four primary analyses were conducted to evaluate interjudge reliability, internal consistency, and concurrent validity.

MEASUREMENTS AND MAIN RESULTS

Interrater reliability was higher for the FMBSC (intraclass correlation [ICC2,2] = 0.57) than for the SEGUE instrument (ICC2,2 = 0.32) or the FMBSC Rating Scale (ICC2,2 = 0.23). The FMBSC demonstrated evidence of concurrent validity through high positive correlations with both the FMBSC Rating Scale and the SEGUE instrument (r = +0.83, P ≤ 0.01; r = +0.65, P ≤ 0.01 respectively). All but one of the nine subscales on the FMBSC showed adequate internal consistency (reliabilities ranged from 0.18 to 0.68). Interjudge reliability was higher for the FMBSC (ICC2,2 = 0.57) than for the SEGUE instrument (ICC2,2 = 0.32) or the FMBSC Rating Scale (ICC2,2 = 0.23).

CONCLUSIONS

The FMBSC demonstrated internal consistency and structural validity in assessing advanced communication skills of fellows in facilitating family meetings of critically ill patients in the ICU. Interjudge reliability was better for the FMBS Checklist than it was for the other measures.

Physician communication coaching effects on patient experience

Background

Excellent communication is a necessary component of high-quality health care. We aimed to determine whether a training module could improve patients’ perceptions of physician communication behaviors, as measured by change over time in domains of patient experience scores related to physician communication.

Study design

We designed a comprehensive physician-training module focused on improving specific “etiquette-based” physician communication skills through standardized simulations and physician coaching with structured feedback. We employed a quasi-experimental pre-post design, with an intervention group consisting of internal medicine hospitalists and residents and a control group consisting of surgeons. The outcome was percent “always” scores for questions related to patients’ perceptions of physician communication using the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) survey and a Non-HCAHPS Physician-Specific Patient Experience Survey (NHPPES) administered to patients cared for by hospitalists.

Results

A total of 128 physicians participated in the simulation. Responses from 5020 patients were analyzed using HCAHPS survey data and 1990 patients using NHPPES survey data. The intercept shift, or the degree of change from pre-intervention percent “always” responses, for the HCAHPS questions of doctors “treating patients with courtesy” “explaining things in a way patients could understand,” and “overall teamwork” showed no significant differences between surgical control and hospitalist intervention patients. Adjusted NHPPES percent excellent survey results increased significantly post-intervention for the questions of specified individual doctors “keeping patient informed” (adjusted intercept shift 9.9% P = 0.019), “overall teamwork” (adjusted intercept shift 11%, P = 0.037), and “using words the patient could understand” (adjusted intercept shift 14.8%, p = 0.001).

Conclusion

A simulation based physician communication coaching method focused on specific “etiquette-based” communication behaviors through a deliberate practice framework was not associated with significantly improved HCAHPS physician communication patient experience scores. Further research could reveal ways that this model affects patients’ perceptions of physician communication relating to specific physicians or behaviors.

"I Just Felt Like I Was Stuck in the Middle": Physician Assistants' Experiences Communicating With Terminally Ill Patients and Their Families in the Acute Care Setting

CONTEXT

Terminally ill hospitalized patients and their families consistently rank effective communication and shared decision-making among their top priorities. Advance practice providers such as physician assistants (PAs) are increasingly providing care in the hospital setting and are often called to communicate with patients and families. A first step to improving PA communication is to better understand PAs' current experiences in their daily practices.

OBJECTIVES

This study aimed to explore roles PAs serve in communicating with terminally ill patients/families; PAs' attitudes and opinions about communication roles; and perceived barriers and facilitators of communication with patients/families in the hospital setting.

METHODS

Five focus groups were conducted with PAs practicing on adult medical services at three acute care hospitals of an academic medical center in Bronx, New York. An open-ended question guide was used. An inductive thematic analysis strategy was used to examine the data from transcribed audiotapes of focus group sessions to identify emergent concepts and themes.

RESULTS

The overarching theme that emerged was being stuck in the middle. PAs experienced ambiguity around their roles and responsibilities in communications between the medical team as well as patients and families; gaps in knowledge and skills; and organizational or structural deficits in the patient care systems that placed them in uncomfortable situations.

CONCLUSION

Interventions aimed at improving PA communication with terminally ill patients and their families should target institutional structures, systems, and culture around roles and responsibilities in addition to skill and knowledge gaps to be most effective.

Electronic Goals of Care Alerts: An Innovative Strategy to Promote Primary Palliative Care

CONTEXT

Given the shortage of palliative care specialists, strategies are needed to promote primary palliative care by nonpalliative care providers. Electronic reminders are frequently used in medicine to standardize practice, but their effectiveness in encouraging goals of care discussions is not well understood.

OBJECTIVES

To determine whether brief education and electronic alerts increase the frequency of goals of care discussions.

METHODS

All general medicine services at a large academic medical center were included. Each medicine team received brief education on rounds about goals of care communication tool. When a newly admitted patient met predefined criteria, an electronic alert that included the tool was sent to the patient's resident and attending physicians within 48 hours.

RESULTS

Of 352 admissions screened over a four-week period, 18% met one or more criteria. The combination of alerts and education increased documentation of goals of care in the medical record from 20.5% (15/73) to 44.6% (25/56) of patients (risk ratio 2.17, 95% CI 1.23-3.72). There were no significant changes in code status, noncode status limitations in care, or palliative care consultation.

CONCLUSION

The combination of brief education and electronic goals of care alerts significantly increased documented goals of care discussions. This intervention is simple and feasible in many settings, but larger studies are needed to determine impact on patient outcomes.

Social worker assessment of bad news delivery by emergency medicine residents: a novel direct-observation milestone assessment

The skill of delivering bad news is difficult to teach and evaluate. Residents may practice in simulated settings; however, this may not translate to confidence or competence during real experiences. We investigated the acceptability and feasibility of social workers as evaluators of residents' delivery of bad news during patient encounters, and assessed the attitudes of both groups regarding this process. From August 2013 to June 2014, emergency medicine residents completed self-assessments after delivering bad news. Social workers completed evaluations after observing these conversations. The Assessment tools were designed by modifying the global Breaking Bad News Assessment Scale. Residents and social workers completed post-study surveys. 37 evaluations were received, 20 completed by social workers and 17 resident self-evaluations. Social workers reported discussing plans with residents prior to conversations 90 % of the time (18/20, 95 % CI 64.5, 97.8). Social workers who had previously observed the resident delivering bad news reported that the resident was more skilled on subsequent encounters 90 % of the time (95 % CI 42.2, 99). Both social workers and residents felt that prior training or experience was important. First-year residents valued advice from social workers less than advice from attending physicians, whereas more experienced residents perceived advice from social workers to be equivalent with that of attending physicians (40 versus 2.9 %, p = 0.002). Social worker assessment of residents' abilities to deliver bad news is feasible and acceptable to both groups. This formalized self-assessment and evaluation process highlights the importance of social workers' involvement in delivery of bad news, and the teaching of this skill. This method may also be used as direct-observation for resident milestone assessment.

Improving Management of Behavioral and Psychological Symptoms of Dementia in Acute Care: Evidence and Lessons Learned From Across the Care Spectrum

As the prevalence of Alzheimer disease and related dementias increases, dementia-related behavioral symptoms present growing threats to care quality and safety of older adults across care settings. Behavioral and psychological symptoms of dementia (BPSD) such as agitation, aggression, and resistance to care occur in nearly all individuals over the course of their illness. In inpatient care settings, if not appropriately treated, BPSD can result in care complications, increased length of stay, dissatisfaction with care, and caregiver stress and injury. Although evidence-based, nonpharmacological approaches to treating BPSD exist, their implementation into acute care has been thwarted by limited nursing staff expertise in behavioral health, and a lack of consistent approaches to integrate behavioral health expertise into medically focused inpatient care settings. This article describes the core components of one evidence-based approach to integrating behavioral health expertise into dementia care. This approach, called STAR-VA, was implemented in Veterans' Health Administration community living centers (nursing homes). It has demonstrated effectiveness in reducing the severity and frequency of BPSD, while improving staff knowledge and skills in caring for people with dementia. The potential for adapting this approach in acute care settings is discussed, along with key lessons learned regarding opportunities for nursing leadership to ensure consistent implementation and sustainability.

Team-based Palliative and End-of-life Care for Heart Failure

Clinical practice guidelines endorse the use of palliative care in patients with symptomatic heart failure. Palliative care is conceptualized as supportive care afforded to most patients with chronic, life-limiting illness. However, the optimal content and delivery of palliative care interventions remains unknown and its integration into existing heart failure disease management continues to be a challenge. Therefore, this article comments on the current state of multidisciplinary care for such patients, explores evidence supporting a team-based approach to palliative and end-of-life care for patients with heart failure, and identifies high-priority areas for research.