Building and executing a research agenda toward conducting implementation science in medical education

Development and Implementation of a Family Presence Facilitator Curriculum for Interprofessional Use in Pediatric Medical Resuscitations

Introduction

Family presence during pediatric medical resuscitation has myriad benefits. However, there is significant heterogeneity in provider acceptance and implementation of the family support role. We designed this curriculum to teach all members of the health care team best practices in the Family Presence Facilitator (FPF) role during pediatric medical resuscitations.

Methods

We applied Kern's six-step approach to develop an FPF curriculum comprising didactic and interactive elements, along with training for simulated participants. We implemented the curriculum through (a) live sessions (30-minute didactic or 90-minute workshop) for learners; (b) a 20-minute asynchronous version of the didactic curriculum for self-directed learning; and (c) a 1-hour, monthly, in situ simulation curriculum in a pediatric emergency department setting. Curriculum evaluation surveys queried self-reported engagement, satisfaction, relevance, confidence, commitment, knowledge, skills, and attitudes in a retrospective pre/post format.

Results

We collected data from 153 learners, including attendings, fellows, residents, advanced practice providers, medical students, and child life specialists, between October 2022 and September 2023. Only 22% of participants had received similar prior training. One hundred percent of learners found the curriculum enjoyable and engaging; learners also agreed the curriculum improved their knowledge and skills in providing empathetic and respectful communication (99%); nonspeculative, clear information (100%); and nonverbal support (99%). Of respondents, 100% believed the curriculum would improve the patient care experience.

Discussion

Facilitating family presence during pediatric medical resuscitations is a crucial skill. Our curriculum improves self-reported confidence, knowledge, and skills among interprofessional learners. Next steps include expanding this curriculum beyond the pediatric setting.

A Scoping Review of the Literature on Entrustable Professional Activities in Surgery Residency Programs

OBJECTIVE

Entrustable professional activities (EPAs) are a crucial component of contemporary postgraduate medical education with many surgery residency programs having implemented EPAs as a competency assessment framework to assess and provide feedback on the performance of their residents. Despite broad implementation of EPAs, there is a paucity of evidence regarding the impact of EPAs on the learners and learning environments. A first step in improving understanding of the use and impact of EPAs is by mapping the rising number of EPA-related publications from the field of surgery. The primary objective of this scoping review is to examine the nature, extent, and range of articles on the development, implementation, and assessment of EPAs. The second objective is to identify the experiences and factors that influence EPA implementation and use in practice in surgical specialties.

DESIGN

Scoping review. Four electronic databases (Medline, Embase, Education Source, and ERIC) were searched on January 20, 2022, and then again on July 19, 2023. A quasi-statistical content analysis was employed to quantify and draw meaning from the information related to the development, implementation, assessment, validity, reliability, and experiences with EPAs in the workplace.

PARTICIPANTS

A total of 42 empirical and nonempirical articles were included.

RESULTS

Four thematic categories describe the topic areas in included articles related to: 1) the development and refinement of EPAs, including the multiple steps taken to develop and refine unique EPAs for surgery residency programs; 2) the methods for implementing EPAs; 3) outcomes of EPA use in practice; 4) barriers, facilitators, and areas for improvement for the implementation and use of EPAs in surgical education.

CONCLUSIONS

This scoping review highlights the key trends and gaps from the rapidly increasing number of publications on EPAs in surgery residency, from development to their use in the workplace. Existing EPA studies lack a theoretical and/or conceptual basis; future development and implementation studies should adopt implementation science frameworks to better structure and operationalize EPAs within surgery residency programs.

Exploring Factors for Implementation of EPAs in Pediatric Subspecialty Fellowships: A Qualitative Study of Program Directors

OBJECTIVE

To understand fellowship program directors' (FPDs) perspectives on facilitators and barriers to using entrustable professional activities (EPAs) in pediatric subspecialty training.

METHODS

We performed a qualitative study of FPDs, balancing subspecialty, program size, geographic region and current uses of EPAs. A study coordinator conducted 1-on-1 interviews using a semistructured approach to explore EPA use or nonuse and factors supporting or preventing their use. Investigators independently coded transcribed interviews using an inductive approach and the constant comparative method. Group discussion informed code structure development and refinement. Iterative data collection and analysis continued until theoretical sufficiency was achieved, yielding a thematic analysis.

RESULTS

Twenty-eight FPDs representing 11 pediatric subspecialties were interviewed, of whom 16 (57%) reported current EPA use. Five major themes emerged: (1) facilitators including the intuitive nature and simple wording of EPAs; (2) barriers such as workload burden and lack of a regulatory requirement; (2) variable knowledge and training surrounding EPAs, leading to differing levels of understanding; (3) limited current use of EPAs, even among self-reported users; and (4) complementary nature of EPAs and milestones. FPDs acknowledged the differing strengths of both EPAs and milestones but sought additional knowledge about the value added by EPAs for assessing trainees, including the impact on outcomes.

CONCLUSIONS

Identified themes can inform effective and meaningful EPA implementation strategies: Supporting and educating FPDs, ongoing assessment of the value of EPAs in training, and practical integration with current workflow. Generating additional data and engaging stakeholders is critical for successful implementation for the pediatric subspecialties.

A Scoping Review of Health Care Faculty Mentorship Programs in Academia: Implications for Program Design, Implementation, and Outcome Evaluation

INTRODUCTION

Formal mentoring programs have direct benefits for academic health care institutions, but it is unclear whether program designs use recommended components and whether outcomes are being captured and evaluated appropriately. The goal of this scoping review is to address these questions.

METHODS

We completed a literature review using a comprehensive search in SCOPUS and PubMed (1998-2019), a direct solicitation for unpublished programs, and hand-searched key references, while targeting mentor programs in the United States, Puerto Rico, and Canada. After three rounds of screening, team members independently reviewed and extracted assigned articles for 40 design data items into a comprehensive database.

RESULTS

Fifty-eight distinct mentoring programs were represented in the data set. The team members clarified specific mentor roles to assist the analysis. The analysis identified mentoring program characteristics that were properly implemented, including identifying program goals, specifying the target learners, and performing a needs assessment. The analysis also identified areas for improvement, including consistent use of models/frameworks for program design, implementation of mentor preparation, consistent reporting of objective outcomes and career satisfaction outcomes, engagement of program evaluation methods, increasing frequency of reports as programs as they mature, addressing the needs of specific faculty groups (eg, women and minority faculty), and providing analyses of program cost-effectiveness in relation to resource allocation (return on investment).

CONCLUSION

The review found that several mentor program design, implementation, outcome, and evaluation components are poorly aligned with recommendations, and content for URM and women faculty members is underrepresented. The review should provide academic leadership information to improve these discrepancies.

Researching the Impact of Service provider Education (RISE) Project - a multiphase mixed methods protocol to evaluate implementation acceptability and feasibility

BACKGROUND

Health and social service providers receive limited education on recognizing and responding to family violence. With adequate education, providers could be prepared to identify individuals subjected to family violence and help reduce the risk of associated impairment. Informed by the Active Implementation Frameworks, our research will determine the scope of strategies needed for the uptake and sustainability of educational interventions focused on family violence for providers. It will also determine the acceptability, feasibility, and proof-of-concept for a new educational intervention, called VEGA (Violence, Evidence, Guidance, Action), for developing and improving primary care provider knowledge and skills in family violence.

METHODS

This paper details the protocol for the Researching the Impact of Service provider Education (RISE) Project. The RISE Project follows a sequential multiphase mixed method research design; qualitative and quantitative data are being collected and integrated over three conceptually and methodologically linked research phases. Activities primarily occur in Ontario, Alberta, and Quebec. Phase 1 uses a sequential exploratory mixed method research design to characterize the scope and salience of learning and implementation needs and preferences for family violence education. Phase 2 will use an embedded mixed method research design to determine whether VEGA technology supports providers to achieve their family violence learning goals with effectiveness, efficiency, and satisfaction. Phase 3 will use a concurrent mixed method research design to determine acceptability, feasibility, and proof-of-concept for evaluating whether VEGA improves primary care providers' knowledge and skills in family violence. This final phase will provide information on implementation strategies for family violence education in the "real world." It will also generate data on provider recruitment, retention, and data completeness, as well as exploratory estimates of the effect for provider outcome measures proposed for a randomized controlled trial.

DISCUSSION

The RISE Project comprehensively integrates an implementation approach to improve family violence education for the health and social service professions. It will provide important information about factors that could influence the uptake and effectiveness of a health profession's educational intervention into the real world, as well as provide foundational evidence concerning the tenability of using a randomized controlled trial to evaluate the impact of VEGA in primary care settings.

Managing expansions in medical students' clinical placements caused by curricular transformation: perspectives from four medical schools

Many challenges could occur that result in the need to handle an increase in the number of medical student clinical placements, such as curricular transformations or viral pandemics, such as COVID 19. Here, we describe four different institutions' approaches to addressing the impact of curricular transformation on clerkships using an implementation science lens. Specifically, we explore four different approaches to managing the 'bulge' as classes overlap in clerkships Curriculum leaders at four medical schools report on managing the bulge of core clinical placements resulting from reducing the duration of the foundational sciences curriculum and calendar shifts for the respective clerkship curriculum. These changes, which occurred between 2014 and 2018, led to more students being enrolled in core clinical rotations at the same time than occurred previously. Schools provided respective metrics used to evaluate the effectiveness of their bulge management technique. These data typically included number of students affected in each phase of their curricular transformation, performance on standardized examinations, and student and faculty feedback. Not all data were available from all schools, as some schools are still working through their 'bulge' or are affected by COVID-19. There is much to be learned about managing curricular transformations. Working on such endeavors in a learning collaborative such as the AMA Accelerating Change in Medical Education Initiative provided support and insights about how to survive, thrive and identifying lessons learned during curricular transformation.

Child maltreatment online education for healthcare and social service providers: Implications for the COVID-19 context and beyond

Evidence indicates that healthcare and social service providers (HSSPs) receive inadequate education related to recognizing and responding to child maltreatment. This is despite the fact HSSPs are identified as an important factor in the primary, secondary, and tertiary prevention of this childhood exposure. The need for online education for HSSPs' is highlighted during the COVID-19 pandemic restrictions and will continue to be relevant afterward. The objective of this commentary is to provide an overview of: (a) educational interventions for HSSPs' related to recognizing and responding to child maltreatment; (b) the development of VEGA (Violence, Evidence, Guidance, Action), which is an online platform of educational resources to support HSSPs to recognize and respond to child maltreatment; and (c) the RISE (Researching the Impact of Service provider Education) project, which is an ongoing multi-province evaluation of VEGA in Canada. It is important to consider ongoing ways that HSSPs can receive education related to recognizing and responding to child maltreatment. The virtual implementation of VEGA and the RISE Project provide a necessary opportunity to continue to increase the capacity of Canada's HSSPs to adequately and safely recognize and respond to child maltreatment, while simultaneously advancing education scholarship for the field of child maltreatment and which will have relevance for the COVID-19 context and beyond.

What influences allied health clinician participation in research in the public hospital setting: a qualitative theory-informed approach

OBJECTIVES

Using theoretical frameworks from implementation science, we aimed to systematically explore the barriers and enablers to research active allied health professionals (AHP) participating and leading research in the hospital setting.

DESIGN

A qualitative interview study informed by behaviour change theory.

SETTING

Single Australian tertiary hospital and health service.

PARTICIPANTS

We recruited a convenience sample of 21 AHPs working within a hospital who were seeking to actively participate in/or lead research within their workplace.

DATA COLLECTION

Semistructured interviews explored perceived barriers and enablers to research participation, informed by the 14 domains of the theoretical domains framework (TDF). Transcribed interviews were deductively coded and mapped to the TDF. A deeper level of inductive coding was used to identify emergent themes that influenced behaviour change, according to the three key constructs of: capability, opportunity and motivation (COM-B).

RESULTS

Barriers and enablers to research participation were identified within nine predominant domains of the TDF. Most enablers to engaging in research related to the motivation or opportunity constructs of the COM-B. These enablers included positive beliefs about the consequences of research participation, enabling social influences, peer support and motivation for skill development and to inform practice. Predominant barriers related to environmental context and resources (eg, reduced funding or time), emotional responses of being overwhelmed and perceptions of reduced capability.

CONCLUSION

This study identified key barriers and enablers to behaviour change related to AHPs participating and/or leading research. Motivation and opportunities to participate in research may be enabled by maximising social influence opportunities, reiterating beliefs about positive consequences of research and considering AHP's emotional responses. Implementation science frameworks may provide a more systematic and holistic understanding of factors which influence research participation including enhancing knowledge, motivation and opportunity.

Bridging the Chasm: Challenges, Opportunities, and Resources for Integrating a Dissemination and Implementation Science Curriculum into Medical Education

BACKGROUND

Physicians are charged with implementing evidence-based medicine, yet few are trained in the science of Dissemination and Implementation (D&I). In view of the potential of evidence-based training in D&I to help close the gap between research and practice, the goal of this review is to examine the importance of D&I training in medical education, describe challenges to implementing such training, and provide strategies and resources for building D&I capacity.

METHODS

We conducted (1) a systematic review to identify US-based D&I training efforts and (2) a critical review of additional literature to inform our evaluation of the challenges and opportunities of integrating D&I training in medical education.

RESULTS

Out of 269 unique articles reviewed, 11 described US-based D&I training. Although vibrant and diverse training opportunities exist, their capacity is limited, and they are not designed to meet physicians' needs. Synthesis of relevant literature using a critical review approach identified challenges inherent to changing medical education, as well as challenges related to D&I science. Finally, selected strategies and resources are available for facilitating incorporation of D&I training into medical education and overcoming existing challenges.

CONCLUSIONS

Integrating D&I training in the medical education curriculum, and particularly in residency and fellowship training, holds promise for bridging the chasm between scientific discoveries and improved patient care and outcomes. However, unique challenges should be addressed, including the need for greater evidence.

Building Sustainable Professional Development Programs: Applying Strategies From Implementation Science to Translate Evidence Into Practice

INTRODUCTION

Multisite and national professional development (PD) programs for educators are challenging to establish. Use of implementation science (IS) frameworks designed to convert evidence-based intervention methods into effective health care practice may help PD developers translate proven educational methods and models into successful, well-run programs. Implementation of the national Educational Scholars Program (ESP) is used to illustrate the value of the IS model.

METHODS

Four adaptable elements of IS are described: (1) replication of an evidence-based model, (2) systematic stages of implementation, (3) management of implementation using three implementation drivers, and (4) demonstration of program success through measures of fidelity to proven models and sustainability.

RESULTS

Implementation of the ESP was grounded on five established principles and methods for successful PD. The process was conducted in four IS stages over 10 years: Exploration, Installation, Initial Implementation, and Full Implementation. To ensure effective and efficient processes, attention to IS implementation drivers helped to manage organizational relationships, build competence in faculty and scholars, and address leadership challenges. We describe the ESP's fidelity to evidence-based structures and methods, and offer three examples of sustainability efforts that enabled achievement of targeted program outcomes, including academic productivity, strong networking, and career advancement of scholars.

DISCUSSION

Application of IS frameworks to program implementation may help other PD programs to translate evidence-based methods into interventions with enhanced impact. A PD program can follow systematic developmental stages and be operationalized by practical implementation drivers, thereby creating successful and sustainable interventions that promote the academic vitality of health professions educators.