Relationships Between Reflection and Behavior Change in CME

Reflecting on insight and insights into reflection: a systematic review of insight and reflection in post graduate medical education

BACKGROUND

Clinicians recognize insight as important for safe independent medical practice. Clinical education literature focuses on self-reflection. The aim of this review is to describe how clinical educators conceptualize reflection and ask is it analogous to how clinicians conceptualize insight?

METHODS

Using PRISMA guidelines, a systematic review of the literature around insight and reflection in postgraduate medical education was undertaken. A thematic analysis of the concepts of insight and reflection was performed.

RESULTS

A total of 75 reports were included in the analysis. The literature focussed predominantly on reflection with little discussion of insight. Three main themes were generated: episodic reflection; cyclic reflection; reflection as a state. Reflection as a state seemed to be the professional quality most often aspired to but was less well defined in terms of educational interventions. When more than one model was described, it was often with a reflective state being the ideal that episodic or cyclic reflection may approximate. It is not clear that it is possible to progress up the hierarchy.

CONCLUSION

We present a novel description of a hierarchy from discrete episodes of reflection, to cyclic processes that involve reflection, through to a state in which the practitioner is reflective. There is no unified understanding of how an individual ascends this hierarchy, or a cohesive description of what insight is for an independent medical practitioner. This review highlights the need for research into how practicing clinicians conceptualize and characterize insight in their training and practice.

Learner engagement and teaching effectiveness in livestreamed versus in-person CME

INTRODUCTION

Engaging learners in continuing medical education (CME) is challenging. Recently, CME courses have transitioned to livestreamed CME, with learners viewing live, in-person courses online. The authors aimed to (1) compare learner engagement and teaching effectiveness in livestreamed with in-person CME and (2) determine how livestream engagement and teaching effectiveness is associated with (A) interactivity metrics, (B) presentation characteristics and (C) medical knowledge.

METHODS

A 3-year, non-randomised study of in-person and livestream CME was performed. The course was in-person for 2018 but transitioned to livestream for 2020 and 2021. Learners completed the Learner Engagement Inventory and Teaching Effectiveness Instrument after each presentation. Both instruments were supported by content, internal structure and relations to other variables' validity evidence. Interactivity metrics included learner use of audience response, questions asked by learners and presentation views. Presentation characteristics included presentations using audience response, using pre/post-test format, time of day and words per slide. Medical knowledge was assessed by audience response. A repeated measures analysis of variance (anova) was used for comparisons and a mixed model approach for correlations.

RESULTS

A total of 159 learners (response rate 27%) completed questionnaires. Engagement did not significantly differ between in-person or livestream CME. (4.56 versus 4.53, p = 0.64, maximum 5 = highly engaged). However, teacher effectiveness scores were higher for in-person compared with livestream (4.77 versus 4.71 p = 0.01, maximum 5 = highly effective). For livestreamed courses, learner engagement was associated with presentation characteristics, including presentation using of audience response (yes = 4.57, no = 4.45, p < .0001), use of a pre/post-test (yes = 4.62, no = 4.54, p < .0001) and time of presentation (morning = 4.58, afternoon = 4.53, p = .0002). Significant associations were not seen for interactivity metrics or medical knowledge.

DISCUSSION

Livestreaming may be as engaging as in-person CME. Although teaching effectiveness in livestreaming was lower, this difference was small. CME course planners should consider offering livestream CME while exploring strategies to enhance teaching effectiveness in livestreamed settings.

Do learners implement what they learn? Commitment-to-change following an interprofessional palliative care course

BACKGROUND

Palliative care educators should incorporate strategies that enhance application into practice by learners. Commitment-to-change is an approach to reinforce learning and encourage application into practice; immediately post-course learners commit to making changes in their practices as a result of participating in the course ("statements") and then several weeks or months later are prompted to reflect on their commitments ("reflections").

AIM

Explore if and how learners implemented into practice what they learned in a palliative care course, using commitment-to-change reflections.

DESIGN

Secondary analysis of post-course commitment statements and 4-months post-course commitment reflections submitted online by learners who participated in Pallium Canada's interprofessional, 2-day, Learning Essential Approaches to Palliative Care (LEAP) Core courses.

SETTING/PARTICIPANTS

Primary care providers from across Canada and different profession who attended LEAP Core courses from 1 April 2015 to 31 March 2017.

RESULTS

About 1063 of 4636 learners (22.9%) who participated in the 244 courses delivered during the study period submitted a total of 4250 reflections 4 months post-course. Of these commitments, 3081 (72.5%) were implemented. The most common implemented commitments related to initiating palliative care early across diseases, pain and symptom management, use of clinical instruments, advance care planning, and interprofessional collaboration. Impact extended to patients, services, and colleagues. Barriers to implementation into practice included lack of time, and system-level factors such as lack of support by managers and untrained colleagues.

CONCLUSIONS

Examples of benefits to patients, families, services, colleagues, and themselves were described as a result of participating in the courses.

Training Interprofessional Staff in Whole Health Clinical Care at the Veterans Health Administration

Introduction

The Veterans Health Administration (VHA) initiated a system-wide redesign in 2011 toward a patient-centered approach called the Whole Health System (WHS) of care. Education of VHA clinical staff in WHS-informed care, Whole Health Clinical Care (WHCC), is one critical element of this redesign effort. At a minimum, WHCC education should address core competencies for clinicians and be considered satisfactory for learners. This is the first study to evaluate learner satisfaction and perceived achievement of course objectives in WHCC that incorporated active learning strategies.

Method

A large VA Healthcare System developed an in-person workshop focused on WHCC that used multiple active learning activities. These activities included case presentations, role playing, experiential learning, and group discussion.

Results

Sixty-two interprofessional staff attended the workshop in November 2019. Forty (64.50%) participants completed post-workshop surveys within 30 days. Data suggest participants were highly satisfied with the workshop and that they successfully met stated learning objectives.

Conclusions

We call on VHA and private-sector hospitals to train clinical staff in WHCC that incorporates use of active learning strategies.

Commitment to Change Statements and Actual Practice Change After a Continuing Medical Education Intervention

INTRODUCTION

Continuing medical education (CME) interventions often evaluate participant commitment to change (CTC) clinical practice. Evidence linking CTC to actual practice change is limited.

METHODS

In an intervention that combined live CME with changes to the electronic health record to promote judicious antibiotic use for children with urinary tract infections (UTIs), we evaluated CTC and subsequent prescribing behavior in Kaiser Permanente Colorado, an integrated health care system. CTC was assessed immediately after the session using closed-ended questions about session learning objectives and open-ended questions to elicit specific practice changes. Perceived barriers to implementing recommended changes were also assessed.

RESULTS

Among 179 participants, 80 (45%) completed postsession evaluations and treated one or more child with a UTI in the subsequent 17 months (856 UTIs in total). In closed-ended responses about session learning objectives, 45 clinicians (56%) committed to changing practice for antibiotic choice and duration, whereas 37 (46%) committed to implementing new practice guidelines. When asked open-ended questions to identify specific practice changes, 32 (40%) committed to antibiotic choice change and 29 (36%) committed to treatment duration change. Participants who made specific CTC statements had greater improvement in antibiotic choice (relative rate ratio 1.56, 95% CI 1.16-2.09) and duration (relative rate ratio 1.59, 95% CI 1.05-2.41) than participants who did not make specific commitments. Few perceived barriers affected subsequent prescribing.

DISCUSSION

Commitments to changing specific clinical behaviors were associated with sustained changes in prescribing for children with UTIs. Linking self-evaluations with clinical data in integrated health care systems is an important tool for CME evaluators.

Effect of Pause Procedures on Participant Reflection and Commitment-to-Change in Continuing Medical Education

Problem: Conferences are the most common form of continuing medical education (CME), but their effect on clinician practice is inconsistent. Reflection is a critical step in the process of practice change among clinicians and may lead to improved outcomes following conference-based CME. However, reflection requires time to process newly-learned material. Adequate time for reflection may be noticeably absent during many conference presentations. Intervention: The pause procedure is a 90-second 'pause' during a 30-minute presentation so learners can review and discuss content. The goal of the pause procedure is to stimulate learners' active engagement with newly learned material which will, in turn, promote learner reflection. Context: Fifty-six presentations at two hospital medicine CME conferences were assigned to the pause procedure or control. Study outcomes provided by conference participants were validated reflection scores and commitment-to-change (CTC) statements for each presentation. A post-hoc survey of the intervention group was conducted to assess presenters' experiences with the pause procedure. Impact: A total of 527 conference participants completed presentation evaluations (response rate 72.7%). Presentations incorporating the pause procedure failed to lead higher participant reflection scores (percentage 'top box' score; intervention: 39.2% vs. control: 41.7%, p = 0.40) or participant CTC rates (median [IQR]; intervention: 4.64 [3.04, 10.57] vs. control: 8.16 [5.28, 17.12], p = 0.13) than control presentations. However, the majority of presenters (16 out of 17 survey respondents) had never before used the intervention and little active engagement among learners was noted during the pause procedure. Lessons Learned: Adding the pause procedure to CME presentations did not lead to greater reflection or CTC among clinician learners. However, presenters had limited experience with the intervention, which may have reduced their fidelity to the educational principles of the pause procedure. Faculty development may be necessary when planning a new educational intervention that is to be implemented by conference presenters.

Continuous learning in multiple sclerosis care: a qualitative study of the expanded learning model for systems

OBJECTIVES

This study characterized how an online continuing education activity affected knowledge, attitudes, and practices of healthcare professionals who care for patients with multiple sclerosis (MS) and whether those changes reflected theorized translational mechanisms proposed in The Expanded Learning Model for Systems (TELMS).

METHODS

This preliminary study used semi-structured interviews (thematic analysis) to assess whether and how translational mechanisms underpinning the TELMS theory might be revealed in learners' attitudes and practice behavior. Eighteen participants (primarily neurologists and nurses) were interviewed by telephone or online. Thematic analysis identified relevant themes according to sensitizing concepts derived from TELMS and the recognition of emergent themes.

RESULTS

Textual interpretation of interview data revealed that MS providers act in various scenarios that validate the principles of TELMS model of learning engagement. Further, elements of translational mechanisms proposed by TELMS were consistently observed in the narrative reflections. Emergent themes included the importance of practices such as goal setting, coordination of care, systems-level MS care, and economic considerations. Practitioners particularly drew on ideas from TELMS when facing challenges in diverse cultural and sociocultural settings.

CONCLUSIONS

We identified mechanisms of change reflected in the TELMS model that is useful for the design and evaluation of future educational activities. These include attitudes and beliefs about the application of evidence-aligned MS care, as well as the commitment to multidisciplinary strategies, enhanced coordination of care, and promotion of systems-based changes. Future studies are needed to further validate the TELMS model.

Reflective and feedback performances on Thai medical students' patient history-taking skills

BACKGROUND

Reflective practice (RP) plays a crucial role in encouraging learners to think critically and consciously about their performances. Providing constructive feedback can further enhance RP. But non-Western learners might face different learning barriers compared to learners in the West, where RP originated.

METHODS

In this retrospective study, we assessed RP and feedback performances on Thai medical students' patient history-taking skills. We applied RP and peer feedback, along with feedback from the instructors, during the history-taking sessions of the ten-week introduction course for fourth-year medical students. Twelve history-taking sessions were used for the analysis. Two instructors assessed students' reflective performance and categorised them into one of the six stages of Gibbs' reflective cycle; their feedback performances were analysed using Pendleton's model. We investigated the correlations between students' overall grade point average (GPAX) and patient history-taking scores on the Objective Structured Clinical Examination (OSCE). Students' opinions of the RP teaching method were also collected.

RESULTS

All (n = 48) students participated in our study. The students' mean age was 21.2 ± 0.5 years. The majority of the students were female (64.6%). The data indicated that 33 and 4% of the participants were categorised into the evaluation stage and action plan stage of Gibbs' reflective cycle, respectively. In addition, 22 and 15% of the participants were able to state what their peers did well and suggest how peers could improve their skills, respectively. All students passed the minimum passing level of four history-taking OSCE stations. Participants agreed that RP was a useful tool (mean 9.0, SD 0.1), which enhanced their thought processes (mean 8.4, SD 0.2) and future performances (mean 8.2, SD 0.2). However, there was no correlation between the students' highest Gibbs' reflection levels and their history-taking OSCE scores.

CONCLUSIONS

RP, together with feedback, proved to be a useful technique to help fourth-year Thai medical students improve their reflection skills, enhance their medical knowledge, and improve patient history-taking skills. Further study with longer monitoring is required to further explore negative and positive influential factors affecting students' achievement of better reflection performances.

Creating Effective and Efficient Pediatric-Specific CME Content: More than Just Checking a Box

States dictate the type of continuing medical education (CME) required for licensing; however, CME providers are not mandated to create content relevant to all specialties. This often forces pediatricians to engage in educational activities that are irrelevant to their practice. This is contrary to what constitutes effective CME. The goal was to develop pediatric content using adult learning theory that aligns with effective CME principles while simultaneously satisfying state licensure requirements. A targeted needs assessment of pediatric providers revealed that pediatric-specific CME activities satisfying the state's requirement for pain management and end-of-life issues were lacking. Webinars adhering to adult learning principles were created in consultation with content experts. Five hundred ninety-seven learners across 30 states successfully completed the webinars and received CME credit. To satisfy ongoing state licensing requirements, 44% of learners had completed similar activities in the past, but 72% of those learners participated in activities focused on adult medicine due to the lack of available pediatric modules. Until states and regulators allow for more flexibility in satisfying licensing requirements, it will be incumbent on those who create CME to develop educational activities that satisfy state requirements while aligning with the principles of effective CME. With strategic planning, this is possible and will hopefully empower physicians to engage in CME without resorting to "checking a box."