A systematic review of faculty development initiatives designed to enhance teaching effectiveness: A 10-year update: BEME Guide No. 40

Development of a questionnaire to measure teachers' student-centred perspectives based on the Onion Model

BACKGROUND

Teachers with a teacher-centred perspective have difficulties applying student-centred approaches in Problem Based Learning (PBL) because they are inclined to show teacher-centred behaviours. The six aspects explained in Korthagen's Onion Model (environment, behaviour, competencies, beliefs, identity, and mission) are assumed to contribute to teachers' perspectives, showing that both the environment and personal characteristics influence behaviours. For teachers to function properly in PBL, those six aspects should reflect a student-centred perspective. Previous instruments to measure teaching perspectives focused on only a few of these relevant aspects. Therefore, we developed the Student-Centred Perspective of Teachers (SCPT) questionnaire with subscales for each aspect in the Onion Model. This study aimed to provide evidence for its internal and external validity.

METHODS

The SCPT was distributed in a survey to 795 teachers from 20 medical schools. For the internal validation, Confirmatory Factor Analysis was performed to analyse theoretical fit model validation, convergent validation, and discriminant validation. For the external validation, teachers' perspective scores were compared among three groups of amount of PBL training using Analysis of Variance (ANOVA) and post-hoc Least Significant Difference (LSD) tests. The p-value for all tests was set at .05.

RESULTS

A total of 543 out of 795 teachers (68.3%) participated. Confirmatory Factor Analysis showed the evidence of the SCPT's internal validation with acceptable fit for the six subscales measured by 19 items and the following Composite Reliability scores: environment (.72), behaviour (.74), competencies (.63), beliefs (.55), identity (.76), and mission (.60). All items' factors loadings reached a good standard (.5 or greater). Only the environment subscale had the Average Variance Extracted (AVE) score higher than .5 and the Maximum Shared Variance score lower than the AVE score. ANOVA and Post-hoc LSD tests showed that teachers who participated in more PBL training showed significantly higher student-centred perspectives, providing evidence for external validity.

CONCLUSION

The SCPT is a reliable and valid instrument to measure teaching perspectives. Identifying aspects that do not represent the adoption of a student-centred perspective may provide valuable input for faculty development in the context of PBL.

Learning Theory-Driven Tips for Designing Effective Learning Solutions for the Continuous Education of Community Pharmacists to Enhance Patient-Centered Care—A Qualitative Study

The constant development of medical and pharmaceutical sciences and the changing roles of pharmacists highlight the importance of lifelong learning in their profession. Given the identified knowledge gaps in the literature in terms of pharmacists’ preferences for lifelong learning, the study aimed to evaluate the opinions and attitudes of community pharmacists towards lifelong learning, including their previous experiences and educational needs, in order to propose evidence-based tips for designing such solutions and interventions intended for them both in face-to-face and online forms. For this purpose, ten semi-structured in-depth interviews were conducted with Polish community pharmacists on the topic using a thematic guide. Subsequently, they were subjected to literal transcription and interpretative phenomenological analysis by two independent researchers using phenomenology as the qualitative approach. The identified themes covered the topic’s relevance for pharmacists’ work, practice-oriented form and content, previous learners’ experiences as a foundation for further learning, commercial initiatives’ risks, motivation sources, and barriers for participation in lifelong learning solutions so far. Based on the insights provided by the respondents, as well as scientifically proven learning theories and educational principles, ten tips were formulated for designing recipient-friendly learning solutions and interventions within the framework of postgraduate lifelong learning of pharmacists.

Collaborative faculty development transforms evaluation at a school of osteopathic medicine: an exploratory grounded theory study

Background: Faculty development (FD) initiatives for medical educators must keep pace with educators’ expanding roles and responsibilities in the 21st century to effectively support and guide professional growth. Successful initiatives will be comprehensive and systematic, rather than episodic. Our research explores the impact of a collaborative, individualized, and focused FD program. The purpose of this pilot study is: (1) to describe the innovative design and implementation of the incipient FD program at University of the Incarnate Word School of Osteopathic Medicine (UIWSOM), San Antonio, Texas; and (2) to present insights from a preliminary process evaluation of the program’s initial launch to inform and facilitate broadscale implementation.      Methods: We used a longitudinal, holistic approach to redesign the UIWSOM FD program to provide evidence-informed and experiential learning for faculty. We performed a process evaluation of the initial iteration of the FD program using an inductive qualitative research approach. We applied principles of constructivist grounded theory to analyze faculty’s responses collected during semi-structured interviews. Results: Three themes emerged from our analysis: communication, advocacy, and reciprocal learning.  We found that effective communication, advocacy for faculty success, and reciprocal value between faculty and program developers undergirded the core concept of authentic engagement.  Faculty’s perceptions of the quality of engagement of those implementing the program overshadowed the quality of the logistics.  Conclusions: Our pilot study identified authentic engagement as critical to faculty’s positive experience of this new FD initiative.  Practical implications for other health professions schools with similar FD initiatives include consideration of the relational aspects.  Future studies should expand the process evaluation to determine key factors driving perceived program success for other skill domains and amongst clinical faculty, and include a long-range outcome evaluation of the fully implemented program.

When theory joins practice: A design-based research approach for leader identity development

INTRODUCTION

Inclusive educational leaders promote teacher team functioning. To support leader inclusiveness, we designed and implemented a faculty development programme focusing on leader identity formation. We investigated (1) how participants' leader identity developed throughout the programme and (2) how the design principles contributed to this process, according to participants.

METHODS

A design-based research approach was followed. Participants were 7 course coordinators, leading an interdisciplinary teacher team. To study leader identity development, participants repeatedly filled out a validated questionnaire. To investigate how design principles contributed, observational field notes, facilitator debriefings, a programme evaluation questionnaire and a semi-structured focus group were used. Thematic analysis was applied for qualitative data.

RESULTS

Participants gained broader views on leadership, moving from individual dominance towards engaging team members. Most participants initially experienced a deconstruction of their former leader identity and became motivated to improve leadership qualities. Competence-building, reflecting and receiving feedback on workplace experiences, and practicing in a safe environment were perceived to be key for identity development.

CONCLUSIONS

We developed and evaluated a leader identity programme which can convert teachers' classic leadership views towards views incorporating social interactions and relationships. We demonstrated how social interactions provide opportunities to learn from pe.ers in the work environment.

The "Seminartage Weiterbildung Allgemeinmedizin" (SemiWAM®) - development, implementation and evaluation of a five-year, competence-based postgraduate programme in Bavaria

INTRODUCTION

Starting in 2013, a five-year, competence-based postgraduate programme, the "Seminartage Weiterbildung Allgemeinmedizin" (SemiWAM^®) for continuing education in general practice, was developed and offered in Bavaria. This evaluation reports on the experiences of SemiWAM^® after a first cycle.

MATERIAL AND METHODS

Process reflection based on the cycle of Kern: In addition to qualitative findings, results of the evaluation forms (mean values with standard deviation) are presented. The evaluation form contained questions on organisational issues, content of presentation, didactic preparation of the supervisor, transfer to real life practice as well as demographic variables. All questions were voted on a six-point Likert scale from "1=very satisfied" to "6=very dissatisfied".

RESULTS

The reflection showed three crucial entry points: Choosing "reason for encounter" as a content precondition to ensure target audience needs, the close didactic supervision of supervisor, and the continuous growth of supervisor team with newly qualified GP. The evaluation results for the overall assessment (MW 1.11-1.60), the didactic concept (MW 1.30-1.87), as well as the transfer into daily life practice (MW 1.48-2.35) reflect the high quality of the SemiWAM^®.

DISCUSSION

The SemiWAM^® curriculum presented can be easily transferred to comparable structures in Germany that accompany specialty training, such as the competence centres for residency training in general practice. The process evaluation based on the core cycle also provides important support for the agile implementation of these or similar programmes.

Just-in-Time Continuing Education: Perceived and Unperceived, Pull and Push Taxonomy

ABSTRACT

We live in a world where "just-in-time" (JiT) methodologies are increasingly used. Continuing professional development (CPD), including faculty development, has the opportunity to leverage online technologies in a JiT format to further support learner engagement and program sustainability. In this article, the authors propose a model that can serve as a taxonomy for defining and implementing JiT continuing education (JiTCE). The anatomy of JiTCE describes four mechanisms to address CPD needs and delivery procedures: perceived and unperceived, as well as pull and push (PUPP) taxonomy. JiTCE PUPP taxonomy defines four components for designing and developing a program with JiT: on-demand learning, subscription-based learning, performance feedback-driven learning, and data-driven learning. These methods, as backbones, use various online technologies, which offer fundamental support for JiTCE. Delivery systems and technologies are provided as specific examples for JiTCE throughout the article. JiTCE introduces a novel taxonomy to meet continuing education needs and provides an organized approach to design and deploy programming in a sustainable way. Online technologies are evolving everyday and are an indispensable part of both clinical practice and medical education. Pull-push and perceived-unperceived axes can help guide new opportunities for instructional designers and curriculum developers to leverage best practices to align with CPD offerings, which include cutting-edge technologies.

Cultivating cultural awareness among medical educators by integrating cultural anthropology in faculty development: an action research study

BACKGROUND

In faculty development, understanding each participant's cultural context is important. However, there is scarce evidence on how to improve cultural understanding in faculty development. Cultural anthropology is a discipline that focuses on developing cultural self-awareness by understanding different cultures. Professionals from this field can be crucial to the goal of cultivating cultural awareness among medical educators. The aims of this study are to 1) develop and modify cultural anthropology sessions in faculty development and 2) evaluate the effectiveness of these sessions, including their long-term impacts.

METHODS

The cultural anthropology sessions were organized as part of a longitudinal faculty development program-Foundation Course for Medical Education-at Kyoto University in Japan. The study included 47 medical educators participating in faculty development and three lecturers: two cultural anthropologists and a medical educator. We developed the cultural anthropology sessions and implemented them in the longitudinal faculty development program. In these sessions, cultural anthropologists used inquiry-guided reflection. An action research methodology was employed and repeated in four cycles from 2015 to 2018. Qualitative and quantitative data were collected during the action research cycles. The qualitative data were thematically analyzed.

RESULTS

The cultural anthropologists' inquiries fostered learning during the sessions, and three themes-cultural relativism, attention to context, and reframing-were synthesized. As a long-term impact of the sessions, the learners reported becoming more aware of the cultural contexts in their daily educational and clinical activities.

CONCLUSIONS

The cultural anthropology sessions in the faculty development program were shown to have enhanced the participants' awareness of cultural contexts. The concept and format of these sessions may be used more widely in faculty development programs.

Design and comparison of a hybrid to a traditional in-person point-of-care ultrasound course

Background

Traditional introductory point-of-care ultrasound (POCUS) courses are resource intensive, typically requiring 2–3 days at a remote site, consisting of lectures and hands-on components. Social distancing requirements resulting from the COVID-19 pandemic led us to create a novel hybrid course curriculum consisting of virtual and in-person components.

Methods

Faculty, chief residents, fellows and advanced practice providers (APPs) in the Department of Medicine were invited to participate in the hybrid curriculum. The course structure included 4 modules of recorded lectures, quizzes, online image interpretation sessions, online case discussions, and hands-on sessions at the bedside of course participant’s patients. The components of the course were delivered over approximately 8 months. Those participants who completed a minimum of 3 modules over the year were invited for final assessments. Results from the hybrid curriculum cohort were compared to the year-end data from a prior traditional in-person cohort.

Results

Participant knowledge scores were not different between traditional (n = 19) and hybrid (n = 24) groups (81% and 84%, respectively, P = 0.9). There was no change in POCUS skills as measured by the hands-on test from both groups at end-of-course (76% and 76%, respectively, P = 0.93). Confidence ratings were similar across groups from 2.73 traditional to 3.0 hybrid (out of possible 4, P = 0.46). Participants rated the course highly, with an average overall rating of 4.6 out 5.

Conclusions

A hybrid virtual and in-person POCUS course was highly rated and as successful as a traditional course in improving learner knowledge, hands-on skill and confidence at 8 months after course initiation. These results support expanding virtual elements of POCUS educational curricula.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13089-022-00261-x.

Enablers and Barriers of Blended Learning in Faculty Development

Introduction

Online learning provides a ubiquitous and self-paced learning experience, while face-to-face learning encourages commitment in a prescheduled formal instruction. Blended learning (BL) combines these two mediums and provides flexible learning opportunities. While faculty development programs have utilized these two mediums separately, BL has not been fully implemented locally until recently. Identifying elements that enable or hinder faculty within a newly implemented BL program can enhance the learning experience and support professional development. The current study aims to identify how junior and senior faculty members of medical departments at a Turkish university perceive enablers and barriers in a new BL faculty development program.

Methods

This research is a multiple case study with qualitative inquiry using in-depth interviews and thematic analysis. Using a BL approach, the research team designed faculty development activities based on the Four-Component Instructional Design model. Participants accessed the activities on a Moodle learning management system. Faculty experiences in blended faculty development were examined. The study group consisted of 26 participants, with 14 junior faculty in case 1 and 12 senior faculty in case 2 from different medical departments at a Turkish university. Data were collected and analyzed using qualitative methods.

Results

This study identified enablers and barriers within a BL faculty development program. While participants identified three barriers, they identified eight enabling elements in a BL program. A lack of time was the most critical barrier to participation in the program. Setting goals for personal development and obtaining skills in teaching were essential enablers within the BL program.

Conclusion

The use of an online platform to support face-to-face faculty development programs is beneficial in several ways for faculty. Faculty developers can utilize BL to foster engagement and motivate faculty for increased participation, especially if they seek to mitigate known barriers to a successful BL program. Online communication and activities are suggested to develop communities of practice in the workplace. Strategies to eliminate workload and provide guidance on time management are required for both junior and senior faculty.

'It's going to change the way we train': Qualitative evaluation of a transformative faculty development workshop

INTRODUCTION

Relatively little is known about faculty development (FD) activities that help participants achieve sustainable behavioral change. This qualitative study evaluated the medium- to long-term impact of a FD workshop informed by transformative learning (TL) theory. It aimed to discover which aspects of FD prompted healthcare professionals (HPs) to adopt effective teaching and learning practices.

METHODS

Seventeen participants were interviewed between January and July 2020, 7 to 30 months after the workshop. Purposeful sampling strategies were used to collect data and analysis was performed using reflexive thematic analysis.

RESULTS

Four themes were identified: perspectival shift in educational practice, re-affirmation of current practices, becoming an educator, and valuing FD that accommodates HPs' multiple communities of practice (CoPs). Workshop activities foregrounding critical discourse and reflection helped participants gain new knowledge and deeper understanding of education. TL was likely when participants already identified as an educator in addition to their HP identity. Additionally, a workplace CoP determined the type and level of support affecting HPs' development as educators.

DISCUSSION

Aspects of FD that prompted HPs to adopt effective teaching and learning practices included initiatives that catalyzed critical discourse and reflection. Readiness for TL is promoted when HPs have a strong educator identity because of workplace educator CoPs. Future research could explore effecting sustainable post-workshop behavioral change in HPs through the strengthening of workplace educator CoPs. To do this, institutions could send co-located HPs from different disciplines to the same FD program.

Behind teaching-learning strategies in physiology: perceptions of students and teachers of Brazilian medical courses

The teaching-learning process must constantly overcome the barriers imposed by rapid scientific and technological advances, as well as changes in the profiles of students and access to information. This study intended to analyze the perceptions of students and professors of medical courses of the teaching-learning strategies used in physiology at different Brazilian universities as well as the factors that influence or hinder the learning of this discipline. Questionnaires were analyzed from 174 students and 16 professors of physiology from medical courses of 20 higher education institutions (public and private) in a southern Brazilian state. The teaching strategies most used by physiology teachers coincided with the classroom activities that students consider to have the greatest contribution to their learning (expository classes/lectures, tests and questionnaires, problem-based learning/clinical case studies, and demonstrative/practical classes). It was also evidenced that teachers' didactic is considered as a very influencing factor for the students during their learning process, whereas the teachers pointed out daily pedagogical practice as the most relevant factor in the development of their skills within the classroom. In addition, some factors hindering the teaching-learning process of physiology were identified by the respondents, such as large amounts of information, little time for study outside the classroom, previous knowledge, and intrinsic difficulty of the discipline. Finally, students tended to study alone and generally used teachers' slides and their own notes as study materials. The continuous assessment of the perceptions, needs, and difficulties of students and teachers plays an essential role in improving the teaching-learning process.

Twelve tips for mindful teaching and learning in medical education

Mindfulness practice has been shown to have many positive benefits for patients, clinicians, and trainees. Mindfulness fosters compassion, connection, and enhanced clinical reasoning and can reduce burnout among clinicians. A primary focus of mindfulness is present-moment awareness and may be achieved through openness, curiosity, perspective-taking, and letting go of judgment. We propose that the core principles of mindfulness can be harnessed by educators to enhance their teaching skills specifically around creating a supportive and safe learning environment, using questions effectively, providing feedback, and serving as role models. Mindful teaching promotes mindful learning, which focuses on context, openness to new possibilities, reflection, and critical thinking, as opposed to rote repetition and memorization. This article describes core mindfulness principles and strategies that can be used to become a more mindful teacher.

Orientation of medical trainees to a new clinical environment (the ready-steady-go model): a constructivist grounded theory study

BACKGROUND

High-quality orientation of trainees entering a new clinical workplace is essential to support education and patient safety. However, few consultants receive extensive formal training to support new trainees and must create their own ways of integrating newcomers into their clinical team and work environment. We aim to conceptualise the strategies consultants use in the early stages of working with new trainees that will be useful for future faculty development in this area.

METHODS

We used constructivist grounded theory (CGT) methodology by interviewing fifteen consultants in three medical specialties, to explore how trainees are integrated into a new clinical environment. We used CGT principles and procedures (iteration, constant comparison, and theoretical sampling) to analyse and construct a conceptual interpretation of the empirical data.

RESULTS

Consultants' central concern when introduced to a new cohort of trainees was that they had the required knowledge and skills (ready), were adapted and integrated into the new workplace and clinical team (steady), and safely participating in practice (go). Consultants used two broad strategies: formal orientation and informal orientation. Both these approaches had the common goal of intensifying interaction between consultants and trainees to get trainees to a position where they were ready, adapted, integrated, and participating safely and efficiently in practice. Several disruptors were identified by participants that delayed and sometimes completely inhibited the orientation process.

CONCLUSIONS

The model of orientation constructed through this research could be a valuable tool to support faculty development initiatives, the reflective learning practice of clinical supervisors, and curriculum design. The disruptors were identified as valid priorities for improving trainee orientation in postgraduate medical education. Future research should involve a longitudinal approach to explore trainee engagement with orientation upon entering a new clinical workplace.

Creation of the Association of Pediatric Program Directors Faculty Development for Educators "Nuts and Bolts" Teaching Aids

Faculty development (FD) continues to be a great need and challenge for faculty engaged in graduate medical education (GME) and such educator development should ultimately benefit learners in GME programs. As a Task Force within the Association of Pediatric Program Directors (APPD) FD Learning Community, our Educator subcommittee utilized multiple needs assessments to develop a novel educator development program called the APPD FD for Educators Nuts and Bolts (Nuts & Bolts) consisting of 1 to 2 page FD teaching aids. This paper outlines the development of these teaching aids and can be used as a reference for developing future Nuts & Bolts teaching aids. The development was based on 1) a defining framework (Glassick's criteria), 2) a clear model for evaluation of the program (Logic model), and 3) development of an assessment tool to demonstrate effectiveness of the teaching aids in FD at the local level. These 3 components help establish the scholarly nature of the FD Nuts & Bolts program. Multiple lessons learned from development of this program are presented to inform others engaged in educator program development. Detailed proposals for use of FD Nuts & Bolts for faculty improvement and plans for generating additional teaching aids are presented.

Evaluation in health professions education-Is measuring outcomes enough?

INTRODUCTION

In an effort to increase the rigour of evaluation in health professions education (HPE), a range of evaluation approaches are used. These largely focus on outcome evaluation as opposed to programme evaluation. We aim to review and critique the use of outcome evaluation models, using the Kirkpatrick Model as an example given its wide acceptance and use, and advocate for the use of programme evaluation models that help us understand how and why outcomes are occurring.

METHODS

We systematically searched OVID medline, Scopus, CINAHL and Pubmed, and hand searched six leading HPE journals to provide an overview of the use of the Kirkpatrick Model as well as a range of programme evaluation models in HPE. In addition to this, we synthesised the existing critiques of the Kirkpatrick Model as an example of outcome evaluation, to highlight the limitations of such models.

RESULTS

The use of the Kirkpatrick Model in HPE is widespread and increasing; however, studies focus on categorising outcomes, rather than explaining how and why they occur. The main criticisms of the model are as follows: it is outcomes focused and fails to consider factors that can impact training outcomes; it assumes positive casual linkages between the levels; there is an assumption that the higher-level outcomes are more important; and unintended impacts are not considered. The use of the Kirkpatrick Model by the MERSQI, BEME and WHO contribute to the myth that the Kirkpatrick Model is the gold standard for programme evaluation.

DISCUSSION

Moving forward, evaluations of HPE interventions must shift from focusing largely on measuring outcomes of interventions with little consideration for how and why these outcomes are occurring to programme evaluation that investigates what contributes to these outcomes. Other models that facilitate the evaluation of the complex processes that occur in HPE should be used instead of Kirkpatrick's.

Trigger videos: a novel application of a tool for surgical faculty development

BACKGROUND

Trigger videos have occasionally been used in medical education; however, their application to surgical faculty development is novel. We assessed participants' attitudes towards workshops on intraoperative teaching (IOT) that were anchored by trigger videos, and studied whether they could generate discussion-for-learning among surgeons in this workshop setting.

METHODS

Surgeons from multiple specialties attended one of six faculty development workshops where IOT trigger videos were shown and discussed during break-out sessions. Participants completed questionnaires to (1) evaluate videos via survey and feedback, and (2) identify adoptable and discardable IOT techniques. Teaching techniques were collated to identify planned IOT changes and survey data and feedback were analyzed.

RESULTS

A total of 135 surgeons identified 292 adoptable and 202 discardable IOT techniques based on trigger videos and discussions, and 94% of participants reported that the trigger videos were useful and encouraged them to discuss and consider new IOT techniques in their own practice.

CONCLUSIONS

Participants reported that the trigger videos were useful and motivating. Surgeons critically reflected on IOT during the sessions, identifying numerous adoptable and discardable techniques relevant to their own teaching styles. Trigger videos can be a valuable tool for surgical faculty development and can be tailored to other medical specialties.

Training medical educators to teach: bridging the gap between perception and reality

Teaching is a core expectation of physicians in academic hospitals and academic medical centers, but best practices for training physicians to teach have not been established. There is significant variability in how physicians are trained to teach medical students and residents across the world, and between Israeli hospitals. In an article published earlier this year in the Israel Journal of Health Policy Research, Nothman and colleagues describe a survey of 245 Israeli physicians in departments of internal medicine, pediatrics, and obstetrics and gynecology, at four different faculties of medicine across Israel. The majority of Israeli physicians responding to this survey reported receiving minimal training to teach, with only 35% receiving any training focused on medical education skills, most (55%) receiving training of only 1–2 days duration. In addition, the physicians surveyed perceived their training as inadequate and not aligned with their self-perceived educational needs. Furthermore, the respondents felt strongly that “compensation and appreciation” for medical education was less than for those involved in research. Despite the general lack of training in teaching skills and the perception that teaching physicians are less valued than researchers, survey respondents rated themselves as highly confident in most domains of medical education. In this context, this commentary reviews the disconnect between the general perception that all physicians can and should engage in teaching in the clinical setting with the well-described observation that competence in medical education requires dedicated and longitudinal training. Leveraging best practices in curriculum design by aligning educational interventions for teaching physicians with their self-perceived needs is discussed, and models for dedicated faculty development strategies for teaching medical education skills to physicians are reviewed. Finally, the importance of and potential strategies for assessing teaching physicians’ effectiveness in Israel and elsewhere are considered as a means to address these physicians’ perception that they are not as valued as researchers. Understanding teaching physicians’ perspectives on and motivations for training medical students and residents is critical for supporting the frontline teaching faculty who educate future healthcare providers at the bedside in medical schools, hospitals, and academic medical centers in Israel and beyond.

Students' initial perspectives on online learning experience in China during the COVID-19 outbreak: expanding online education for future doctors on a national scale

BACKGROUND

During the early stage of COVID-19 outbreak in China, most medical undergraduate programs have to eventually embrace the maneuver of transferring to nearly 100% online-learning as a new routine for different curricula. And there is a lack of empirical evidence of effective medical education curriculum that has been completely implemented in an online format. This study summarizes medical students' perspectives regarding online-learning experience during the COVID-19 outbreak and presents reflection on medical education.

METHODS

From February 21st to March 14th, 2020, the authors conducted survey of a nationally representative sample of undergraduate medical students from 90 medical schools in China. Participant demographics and responses were tabulated, and independent sample t-tests as well as multiple logistic regression models were used to assess the associations of demographic characteristics, prior online learning experience, and orientation with students' perspectives on the online learning experience.

RESULTS

Among 118,030 medical students participated in the survey (response rate 52.4%), 99,559 provided valid data for the analysis. The sample is fairly nationally representative. 65.7% (65,389/99,559) supported great orientation and 62.1% (61,818/99,559) reported that they were satisfied with the ongoing online-learning experience. The most common problem students would encounter was the network congestion (76,277/99,559; 76.6%). Demographics, learning phases, and academic performance were associated with online-learning engagement and perceptions. Formal orientation and prior PU (perceived usefulness of online learning) were significantly positively associated with the satisfaction and evaluation of the online learning experience (p <  0.001).

CONCLUSIONS

Data from this national survey indicates a relatively positive role of online learning as a formal teaching/learning approach in medical education. Considerations should be made regarding such application in aspects of students' different learning phases. We suggest that further policy interventions should be taken from technological, organizational, environmental, as well as individual aspects, to help improve the outcome of online learning for future doctors.

Measuring the Impact of the National Train-the-Trainer Interprofessional Team Development Program (T3-ITDP) on the Implementation of Interprofessional Education and Interprofessional Collaborative Practice

Background

In order to prepare current and future educators and clinicians to lead interprofessional education (IPE) and interprofessional collaborative practice (IPCP), faculty and staff need training in collaborative approaches to developing, implementing, assessing, and sustaining high quality IPE across the interprofessional learning continuum. The Train-the-Trainer Interprofessional Team Development Program (T3-ITDP) is a 3.5-day program designed to develop expert IPE teams through interactive workshops, coaching, and the development and implementation of an IPE or IPCP (IPECP) project for their home institutions.

Purpose

The purpose of this research was to assess the impact of the T3-ITDP on the development and implementation of IPECP projects by participating teams.

Methods

The T3-ITDP impact survey was created and administered to collect data on the scope and impact of participant teams' projects, including learner and project outcomes, training methods, dissemination plans, assessment strategies, and teams' intentions to continue working together beyond the initial project. With human subject's approval, we invited 55 T3-ITDP participant teams to complete the impact survey. These teams were at least one year post-completion of the in-person portion of the program and thus had time to initiate their IPECP projects.

Results

Forty-one (74.5%) teams responded to the survey. Of those teams, 31 (76%) used T3-ITDP content and/or approaches to develop their IPECP projects that targeted learners across the interprofessional learning continuum. Sustainability of IPECP projects was supported through several mechanisms, including institutional support or incorporating IPECP activities into existing courses. Almost half of the teams worked together on new projects, and 74% of teams planned to repeat a newly developed activity.

Discussion & Conclusions

Results of the T3-ITDP impact survey demonstrated that team-based, project-focused professional development catalyzed the development, implementation, and sustainment of new IPECP projects at academic and community institutions throughout the U.S.

A Qualitative Preceptor Development Needs Assessment to Inform Program Design and Effectiveness

Objective. To assess preceptor teaching challenges and development programming design preferences through a qualitative needs assessment of Doctor of Pharmacy student and resident preceptors.Methods. In 2018, 148 experiential education stakeholders across North Carolina (eg, preceptors, residency program directors, experiential faculty administrators, and practice site administrators) were invited to participate in a 60-minute semi-structured interview as part of a broad preceptor development needs assessment. Interview questions focused on: precepting challenges, positive and negative features of development programs, and preferences for program design. Interview transcripts were coded using thematic analysis.Results. Forty-two participants completed interviews, including preceptors from various rotation types, residency program directors, experiential faculty administrators, and institution administrators. Participants identified numerous teaching challenges related to learners, preceptors, and institutional level factors. Participants often noted there was inadequate time, resources, and support to effectively teach. Desirable preceptor development program features included practical strategies, collaboration with preceptors, delivery by education and practice experts, and topics specific to precepting experience. Participants identified live, on-demand, and webinar formats as acceptable if collaboration and engagement were included. Participants also desired unique training opportunities such as online platforms, coaching programs, and simulated learning environments.Conclusion. Preceptors for pharmacy students and residents face numerous challenges and require sufficient time, support, and resources to develop their skills. Participants requested training that included on-demand, frequent sessions delivered through various modalities, collaboration opportunities, a choice in topics and delivery formats, and sessions from educational and practice experts.

Nursing students' learning from involvement in research projects: an integrative literature review

OBJECTIVE

To identify the learning outcomes and skills obtained of undergraduate nursing students involved in research projects.

METHODS

This was an integrative literature review, based on a research protocol in the CINAHL Complete databases; Cochrane Central Register of Controlled Trials; Cochrane Database of Systematic Reviews; Cochrane Methodology Register; MedicLatina; MEDLINE, Scopus and JBI, including primary and secondary studies, published between 2015 and 2020.

RESULTS

A total of five heterogeneous articles were included, which were categorized using Kirkpatrick's (adapted) model. Seventeen learning outcomes acquired through participation in research projects were identified, from the learning of new knowledge and skills to the development of new attitudes and behaviors.

FINAL CONSIDERATIONS

The involvement of nursing students in research projects is important to their professional development. Future investment in research on this topic can help cement the potential of this type of student involvement.

Online Faculty Development: An African Lusophone Ophthalmic Society Experience During the COVID-19 Pandemic

PURPOSE

Faculty development for procedural specialists aims at developing both their medical education and surgical competence. This has been challenging during the COVID-19 pandemic, especially in under-resourced settings and African Lusophone ophthalmology community has been no exception. The Mozambican College of Ophthalmology (MOC) and the Continuing Professional Development Committee of the International Council of Ophthalmology (ICO) established a collaboration to enhance simulation-based clinical teaching competence in cataract surgery.

METHODS

Ten Mozambican ophthalmologists experienced in teaching cataract surgery participated in a group mentoring assisted 6 month/11 flipped-learning online experience on curriculum design, which included practice-based and social learning strategies, continuous bidirectional feedback, individual and group reflection opportunities, and the demonstration of declarative and procedural competencies. Program evaluation consisted of pre and post-test knowledge assessment; individual homework, informed by curated reading and a recorded lesson; feedback surveys for each module and one month after the program's conclusion, and a longitudinal project on creating a simulation-based education session on one step of cataract surgery.

RESULTS

Participants a) highlighted the opportunity to advance their scholarly teaching skills as facilitators; b) showed an increase in knowledge post-test, expressed commitment to improve their learning experiences´ design, include interactive educational methods, and provide constructive feedback; and c) formed a sustained community of practice of ophthalmologists educators (CoP).

CONCLUSION

This online faculty development program, assisted by group mentoring, held during the COVID-19 pandemic, facilitated the development of a CoP and was effective in enhancing teaching competence in curriculum design to apply in simulation-based learning environments.

Entrustable Professional Activities for Small-Group Facilitation: A Validation Study Using Modified Delphi Technique

:

Entrustable professional activities (EPAs) provide a novel approach to support teachers' structured professionalization and to assess improvement in teaching competence thereafter. Despite their novelty, it is important to assess EPAs as a construct to ensure that they accurately reflect the work of the targeted profession.

BACKGROUND:

The co-creation of an EPA framework for training and entrustment of small-group facilitators has been discussed in the literature. Although a rigorous design process was used to develop the framework, its content validity has not been established yet.Approach: A modified Delphi technique was used. Three survey rounds were conducted from December 2019 to April 2020. Expert health professions educationalists were recruited using purposive sampling and snowball techniques. In Round 1, a rubric consisting of seven items was used to assess the quality of nine pre-designed EPAs. In Round 2, competencies required to perform the agreed-upon EPAs were selected from 12 competencies provided. In Round 3, consensus was sought on sub-activities recommended for agreed-upon EPAs. Quantitative data were analyzed using multiple statistical analyses, including item-wise and rubric-wise content validity indices, asymmetric confidence interval, mean, standard deviation, and response frequencies. Qualitative data were thematically analyzed using content analysis.

FINDINGS:

Three of the nine proposed EPAs achieved statistical consensus for retention. These EPAs were: (1) preparing an activity, (2) facilitating a small-group session, and (3) reflecting upon self and the session. Nine of the 12 pre-determined competencies achieved consensus and were then mapped against each agreed-upon EPA based on their relevance. Finally, results indicated consensus on five, six, and four sub-activities for EPA 1, EPA 2, and EPA 3, respectively.

CONCLUSIONS:

The final framework delineates three EPAs for small-group facilitation and their associated sub-activities. The full description of each EPA provided in this article includes the title, context, task specification, required competencies, and entrustment resources. Program developers, administrative bodies, and teaching staff may find this EPA framework useful to structure faculty development, to entrust teachers, and to support personal development.

The impact of a faculty development program, the Leadership in Academic Medicine Program (LAMP), on self-efficacy, academic promotion and institutional retention

BACKGROUND

Academic medical centers invest considerably in faculty development efforts to support the career success and promotion of their faculty, and to minimize faculty attrition. This study evaluated the impact of a faculty development program called the Leadership in Academic Medicine Program (LAMP) on participants' (1) self-ratings of efficacy, (2) promotion in academic rank, and (3) institutional retention.

METHOD

Participants from the 2013-2020 LAMP cohorts were surveyed pre and post program to assess their level of agreement with statements that spanned domains of self-awareness, self-efficacy, satisfaction with work and work environment. Pre and post responses were compared using McNemar's tests. Changes in scores across gender were compared using Wilcoxon Rank Sum/Mann-Whitney tests. LAMP participants were matched to nonparticipant controls by gender, rank, department, and time of hire to compare promotions in academic rank and departures from the organization. Kaplan Meier curves and Cox proportional hazards models were used to examine differences.

RESULTS

There were significant improvements in almost all self-ratings on program surveys (p < 0.05). Greatest improvements were seen in "understand the promotions process" (36% vs. 94%), "comfortable negotiating" (35% vs. 74%), and "time management" (55% vs. 92%). There were no statistically significant differences in improvements by gender, however women faculty rated themselves lower on all pre-program items compared to men. There was significant difference found in time-to-next promotion (p = 0.003) between LAMP participants and controls. Kaplan-Meier analysis demonstrated that LAMP faculty achieved next promotion more often and faster than controls. Cox-proportional-hazards analyses found that LAMP faculty were 61% more likely to be promoted than controls (hazard ratio [HR] 1.61, 95% confidence interval [CI] 1.16-2.23, p-value = 0.004). There was significant difference found in time-to-departure (p < 0.0001) with LAMP faculty retained more often and for longer periods. LAMP faculty were 77% less likely to leave compared to controls (HR 0.23, 95% CI 0.16-0.34, p < 0.0001).

CONCLUSIONS

LAMP is an effective faculty development program as measured subjectively by participant self-ratings and objectively through comparative improvements in academic promotions and institutional retention.

What works for whom in compassion training programs offered to practicing healthcare providers: a realist review

BACKGROUND

Patients and families want their healthcare to be delivered by healthcare providers that are both competent and compassionate. While compassion training has begun to emerge in healthcare education, there may be factors that facilitate or inhibit the uptake and implementation of training into practice. This review identified the attributes that explain the successes and/or failures of compassion training programs offered to practicing healthcare providers.

METHODS

Realist review methodology for knowledge synthesis was used to consider the contexts, mechanisms (resources and reasoning), and outcomes of compassion training for practicing healthcare providers to determine what works, for whom, and in what contexts.

RESULTS

Two thousand nine hundred ninety-one articles underwent title and abstract screening, 53 articles underwent full text review, and data that contributed to the development of a program theory were extracted from 45 articles. Contexts included the clinical setting, healthcare provider characteristics, current state of the healthcare system, and personal factors relevant to individual healthcare providers. Mechanisms included workplace-based programs and participatory interventions that impacted teaching, learning, and the healthcare organization. Contexts were associated with certain mechanisms to effect change in learners' attitudes, knowledge, skills and behaviors and the clinical process.

CONCLUSIONS

In conclusion this realist review determined that compassion training may engender compassionate healthcare practice if it becomes a key component of the infrastructure and vision of healthcare organizations, engages institutional participation, improves leadership at all levels, adopts a multimodal approach, and uses valid measures to assess outcomes.

Clinical Teacher Training for health professionals: From blended to online and (maybe) back again?

BACKGROUND

The Clinical Teacher Training (CTT) programme was originally developed as an interprofessional, blended learning programme, to support health professionals working across health services within Australia, although it has also been delivered internationally. With the disruption of COVID-19, we rapidly moved to 'online only' delivery. We sought to modify the programme, ensuring that the constructivist paradigms important for our learner experience through the original blended format were maintained in the online platform.

APPROACH

Consisting of 10 modules on a range of topics, the new CTT online only programme was facilitated online across 6 weeks with asynchronous and synchronous assessable activities, and provision of peer and facilitator feedback. The learning outcomes for each module were similar to the 'blended learning' format. The new programme was delivered three times throughout 2020 and completed by a total of 208 health professionals from across 10 metropolitan and rural health districts.

EVALUATION

The focus of our evaluation was on the programme's final 2020 iteration, for which we had ethics approval. Participants (n = 59) were from diverse health professions, across five metropolitan and rural health districts. We prioritised the learner experience in constructing our evaluation strategy. Quantitative and qualitative data were collected by post-course questionnaire and analysed using descriptive statistics and thematic analysis. Twenty participants (34%) responded to the post-course questionnaire. Participants valued the structure, topics, clear outcomes, timeframe, online resources, small group activities, feedback and the flexibility and accessibility afforded by online only delivery. However, participants identified a need for additional 'real-time' engagement in activities. Faculty were surprised by the time required to adequately facilitate online learning, and similarly, valued the real-time interactions.

IMPLICATIONS

The online only CTT programme provided an excellent, scalable framework to ensure continued provision of a relevant and accessible training resource for clinicians working in metropolitan and regional/rural health services. Learner-reported achievement of programme learning outcomes was not negatively impacted by online only delivery. Balancing these resource advantages with learner preferences and our desire to build active teaching networks, we will continue to host the majority of the programme online, while offering short face-to-face sessions within local contexts.

Implementation and lessons learned from 2 online interprofessional faculty development programs for improving educational practice in the health professions in Chile and the United Kingdom from 2018 to 2021

This study presents the design, implementation, and lessons learned from 2 fit-for-purpose online interprofessional faculty development programs for educational practice improvement in the health professions in Chile and the United Kingdom from 2018 to 2021. Both programs were designed to enhance teaching and learning practices in an interprofessional environment based on 4 pillars: professional diversity, egalitarianism, blended/online learning, and active learning strategies. A multidisciplinary mix of educators participated, showing similar results. The 3 main lessons learned were that the following factors facilitated an interprofessional environment: a professions-inclusive teaching style, a flexible learning climate, and interprofessional peer work. These lessons may be transferable to other programs seeking to enhance and support interprofessionality. Faculty development initiatives preparing educators for interprofessional practice should be an integral component of health professions education, as delivering these courses within professional silos is no longer justifiable. As the relevance of interprofessional education grows, an effective way of promoting interprofessonal education is to train the trainers in formal interprofessional settings.

Models on Teaching Effectiveness in Current Scientific Literature

Knowing what defines ‘effective teaching’ contributes significantly to the appropriateness and validity of the instruction provided to pre-service teachers during their initial training. This may help them to perform as expert teachers before finishing their university training. This study aims to reflect upon the most significant models and theoretical contributions of each of the five most common methods for investigating teaching effectiveness in the current scientific literature. To that end, the main scientific sources within this field of study have been obtained on the Internet through the Web of Science (WoS), Scopus and ERIC. The sources were selected for their relevance to the topic, which was determined by assessing the citations generated by the academic works and the impact of the journals in which they were published. The results show that the key and most central factor salient in teaching quality is related to the teachers themselves and their training. Thus, any educational model that seeks educational excellence must focus foremost on ensuring care and respect for teaching professionals, beyond economic investment, resource availability, or any other factors.

Viewing faculty development through an organizational lens: Sharing lessons learned

INTRODUCTION

Faculty Development (FD) plays a key role in supporting education, especially during times of change. The effectiveness of FD often depends upon organizational factors, indicating a need for a deeper appreciation of the role of institutional context. How do organizational factors constrain or enhance the capacity of faculty developers to fulfil their mandates?

METHODS

Using survey research methodology, data from a survey of FD leaders at Canadian medical schools were analyzed using Bolman and Deal's four frames: Symbolic, Political, Structural, and Human Resource (HR).

RESULTS

In the Symbolic frame, FD leaders reported lack of identity as a FD unit, which was seen as a constraining factor. Within the Political frame, developing visibility was seen as an enhancing factor, though it did not always ensure being valued. In the Structural frame, expanding scope of practice was seen as an enhancing factor, though it could also be a constraining factor if not accompanied by increased resources. In the HR frame, a sense of instability due to changing leadership and uncertainty about human resources was seen as a constraining factor.

CONCLUSION

While broadening the mandate of FD can generally be considered as positive, it is imperative that it is appropriately resourced and accompanied by recognition of FD as a valued contributor to the educational mission.

Threshold concepts in group-based mentoring and implications for faculty development: A qualitative analysis

INTRODUCTION

The literature on faculty development programs for mentors is scarce. This study examines mentors' experiences and challenges, with the aim of identifying threshold concepts in mentoring. It also discusses the implications for the faculty development of mentors.

METHODS

Semi-structured interviews solicited personal narratives and reflections on mentors' lived experiences. Data analysis was guided by the threshold concepts framework allowing for the identification of significant and transformative shifts in perspectives.

RESULTS

We interviewed 22 mentors from two Norwegian and one Canadian medical school with group-based mentoring programs. The mentoring experience involved four significant threshold concepts: focusing on students' needs; the importance of creating a trusting learning space; seeing oneself through the eyes of students; and aligning mentor and physician identities.

CONCLUSION

Taking on a mentor role can provoke personal and professional dilemmas while also sparking growth. The trajectories of developing as a mentor and as a professional physician may be seen to mutually validate, mirror and reinforce each other. Faculty development programs designed specifically for mentors should aim to stimulate reflection on previous learning experiences and strive for a successful alignment of the distinct pedagogical and clinical content knowledge required to fulfill various professional roles.

Informal faculty development in health professions education: Identifying opportunities in everyday practice

INTRODUCTION

Faculty development (FD) supports health professions educators to develop knowledge, skills, and expertise. Whilst formal FD is a focus in the health professions education (HPE) literature, little is known about how FD occurs informally. We sought to identify opportunities and constraints for informal FD amongst health professions educators in the academic (university) setting and understand how they engage with these opportunities.

METHODS

This exploratory study was conducted in one Australian university. Interviews and focus groups were conducted with undergraduate and postgraduate teachers and assessors (teachers) (n = 10); teaching team and program leaders (mid-level leaders) (n = 8); and senior (university-level) leaders (n = 2). We analysed data thematically and applied situated cognition theory.

RESULTS

We identified three everyday educational practices that provide opportunities for informal FD in the academic setting: (1) applying evidence to; (2) evaluating; and (3) sharing, educational practice. Engaging with these opportunities was shaped by individuals' motivation and proactivity to engage in professional learning (effectivities) and organisational culture and structures (constraints).

CONCLUSION

Applying evidence to, evaluating, and sharing educational practice provide valuable contexts for ongoing learning in the academic setting. Assisting educators and organisations to recognise and leverage these 'in situ' FD opportunities is vital in fostering a continuous learning culture.

Implementing Systematic Faculty Development to Support an EPA-Based Program of Assessment: Strategies, Outcomes, and Lessons Learned

Problem: Development of a novel, competency-based program of assessment requires creation of a plan to measure the processes that enable successful implementation. The principles of implementation science outline the importance of considering key drivers that support and sustain transformative change within an educational program. The introduction of Entrustable Professional Activities (EPAs) as a framework for assessment has underscored the need to create a structured plan to prepare assessors to engage in a new paradigm of assessment. Although approaches to rater training for workplace-based assessments have been described, specific strategies to prepare assessors to apply standards related to the level of supervision a student needs have not been documented. Intervention: We describe our systematic approach to prepare assessors, faculty and postgraduate trainees, to complete EPA assessments for medical students during the clerkship phase of our curriculum. This institution-wide program is designed to build assessors' skills in direct observation of learners during authentic patient encounters. Assessors apply new knowledge and practice skills in using established performance expectations to determine the level of supervision a learner needs to perform clinical tasks. Assessors also learn to provide feedback and narrative comments to coach students and promote their ongoing clinical development. Data visualizations for assessors facilitate reinforcement of the tenets learned during training. Collaborative learning and peer feedback during faculty development sessions promote the formation of a community of practice among assessors. Context: Faculty development for assessors was implemented in advance of implementation of the EPA program. Assessors in the program include residents/fellows who work closely with students, faculty with discipline-specific expertise and a group of experienced clinicians who were selected to serve as experts in competency-based EPA assessments, the Master Assessors. Training focused on creating a shared understanding about the application of criteria used to evaluate student performance. EPA assessments based on the AAMC's Core Entrustable Professional Activities for Entering Residency, were completed in nine core clerkships. EPA assessments included a supervision rating based on a modified scale for use in undergraduate medical education. Impact: Data from EPA assessments completed during the first year of the program were analyzed to evaluate the effectiveness of the faculty development activities implemented to prepare assessors to consistently apply standards for assessment. A systematic approach to training and attention to critical drivers that enabled institution-wide implementation, led to consistency in the supervision rating for students' first EPA assessment completed by any type of assessor, ratings by assessors done within a specific clinical context, and ratings assigned by a group of specific assessors across clinical settings. Lessons learned: A systematic approach to faculty development with a willingness to be flexible and reach potential participants using existing infrastructure, can facilitate assessors' engagement in a new culture of assessment. Interaction among participants during training sessions not only promotes learning but also contributes to community building. A leadership group responsible to oversee faculty development can ensure that the needs of stakeholders are addressed and that a change in assessment culture is sustained.

Using the Five Core Components of Competency-Based Medical Education to Support Implementation of CBVE

In recent years, veterinary education has begun the transition to competency-based models, recognizing that, like medical education, our goals include improved patient and client outcomes and the importance of learner-centered methods in education. Given that implementation of competency-based veterinary education (CBVE) is still in its relative infancy across many veterinary programs, we stand to gain from a unified approach to its implementation. As a guideline, the five core components of competency-based medical education (CBME) should serve to ensure and maintain fidelity of the original design of outcomes-based education during implementation of CBVE. Identified the essential and indispensable elements of CBME which include 1) clearly articulated outcome competencies required for practice, 2) sequenced progression of competencies and their developmental markers, 3) tailored learning experiences that facilitate the acquisition of competencies, 4) competency-focused instruction that promotes the acquisition of competencies, and 5) programmatic assessment. This review advocates the adoption of the principles contained in the five core components of CBME, outlines the approach to implementation of CBVE based upon the five core components, and addresses the key differences between veterinary and medical education which may serve as challenges to ensuring fidelity of CBVE during implementation.

How to Launch and Continually Enhance an Effective Medical Campus Faculty Development Program: Steps for Implementation and Lessons Learned

Purpose

Drawing on the decade of experience of Boston University Medical Campus' Faculty Development Office, this paper reports strategies used to launch and continually improve faculty development programming within an academic health sciences campus.

Patients and Methods

The authors explain the steps that Boston University Medical Campus took to institute their set of faculty development programs, including an overview of resources on how to periodically conduct needs assessments, engage key institutional stakeholders, design and evaluate an array of programming to meet the needs of a diverse faculty, and institute real-time program modifications.

Results

In a step-by-step guide, and by highlighting vital lessons learned, the authors describe a process by which biomedical educators can create and sustain a robust faculty development office within their own institutions.

Conclusion

This paper identifies steps to launch and improve faculty development program. Faculty development programs should be expanded to support faculty in academic medical centers.

Transfer of knowledge, skills and confidence from a faculty development programme for health professions educators into practice

BACKGROUND

Faculty development programmes should incorporate the transfer of knowledge, skills, and confidence from the training to educational practice. However, there is a risk that transfer may fail due to inadequate integration of knowledge, skills, and confidence. The study evaluated transfer levels, guided by learned principles from a faculty development programme.

METHOD

The submitted self-reports on a pedagogical intervention of 92 out of 190 health professions educators who participated in a mandatory teaching and learning training programme, were analysed by a mixed-method approach guided by a structured conceptual framework.

RESULTS

Overall 93.4% reported the successful transfer of learning. Participants incorporated sustainable changed practice (level A, 57.6%), showed reflection on the impact of changed practice (level B, 21.7%), and performed effect analysis (level C, 14.1%). The rest planned application of learning (level D, 4.4%) and identified gaps in current practice or developed an idea for educational intervention but did not implement (level E, 2.2%).

CONCLUSION

The majority of participants transferred their learning. Faculty development programmes must ensure successful transfer of knowledge, skills, and confidence from the training to educational practice to ensure sustainable development of teaching and learning practices.

The effectiveness of faculty development activities for interprofessional education : A systematic review protocol

Despite increasing international demand for interprofessional education (IPE) in health care, there remains limited understanding of the kind of faculty development (FD) activities needed. This paper reports on a protocol for a systematic review to answer the question: What are the available FD activities for IPE facilitators, and which are more effective? The review aims to identify principles and methods to develop competent facilitators in IPE and to identify the implications and effects of FD for IPE concerning individuals, organizations, education, and health practice. Literature was identified through systematic searches in the electronic databases: MEDLINE (Ovid), Embase (Ovid), Eric (EBSCO), CINAHL (EBSCO), Scopus, and Web of Science. There will be no restrictions on language or publication period. Screening of potential studies will be completed independently by at least two reviewers. The research quality of studies will be assessed for methodological rigor using established instruments based on the Critical Appraisal Skills Programme. Search results will be summarized using the PRISMA flow diagram. The proposed review seeks to provide clarity on the evidence base of FD for IPE facilitators, to strengthen future design and delivery of FD activities, and to enable ongoing success of this educational model.

[Education for resuscitation]

Diese Leitlinien des European Resuscitation Council basieren auf dem internationalen wissenschaftlichen Konsens 2020 zur kardiopulmonalen Reanimation mit Behandlungsempfehlungen (International Liaison Committee on Resuscitation 2020 International Consensus on Cardiopulmonary Resuscitation Science with Treatment Recommendations [ILCOR] 2020 CoSTR). Dieser Abschnitt bietet Bürgern und Angehörigen der Gesundheitsberufe Anleitungen zum Lehren und Lernen der Kenntnisse, der Fertigkeiten und der Einstellungen zur Reanimation mit dem Ziel, das Überleben von Patienten nach Kreislaufstillstand zu verbessern.

Experiential learning, collaboration and reflection: key ingredients in longitudinal faculty development

BACKGROUND

Longitudinal faculty development (LFD) may allow for increased uptake of teaching skills, especially in a forum where teachers can reflect individually and collectively on the new skills. However, the exact processes by which such interventions are effective need further exploration.

METHODS

This qualitative study examined an LFD initiative teaching a novel feedback approach attended by five family practice physicians. The initiative began with two 1.5-hour workshops: Goal-Oriented Feedback (as the teaching skill to be developed) and Narrative Reflection (as the tool to support personal reflection on the skill being learned). Over the subsequent six-months, the five participants iteratively applied the feedback approach in their teaching and engaged in narrative reflection at four 1-hour group sessions. Transcripts from the group discussions and exit interviews were analyzed using thematic analysis.

RESULTS

Iteratively trialing, individually reflecting on, and collectively exploring efforts to implement the new feedback approach resulted in the development of a learning community among the group. This sense of community created a safe space for reflection, while motivating ongoing efforts to learn the skill. Individual pre-reflection prepared individuals for group co-reflection; however, written narratives were not essential.

CONCLUSION

LFD initiatives should include an emphasis on ensuring opportunities for iterative attempts of teaching skills, guided self-reflection, and collaborative group reflection and learning to ensure sustainable change to teaching practices.

Shared Tobacco Cessation Curriculum Website for Health Professionals: Longitudinal Analysis of User and Utilization Data Over a Period of 15 Years

BACKGROUND

Because tobacco use is a major cause of morbidity and mortality worldwide, it is essential to prepare health care providers to assist patients with quitting smoking. Created in 1999, the "Rx for Change" tobacco cessation curriculum was designed to fill an educational gap in cessation training of health professional students. In 2004, a website was launched to host teaching materials and tools to support the efforts of educators and clinicians.

OBJECTIVE

The objective of this study was to characterize users and utilization of a website hosting shared teaching materials over a period of 15 years.

METHODS

Data from the Rx for Change website have been collected prospectively since its inception. In this study, end-user data were analyzed to determine user characteristics, how they heard about the website, intended use of the materials, and numbers of logins and file downloads over time.

RESULTS

Total number of website registrants was 15,576, representing all 50 states in the United States and 94 countries. The most represented discipline was pharmacy (6393/15,505, 41.2%), and nearly half of users were students or residents. The most common source of referral to the website was a faculty member or colleague (33.4%, 2591/7758), and the purpose of enhancing personal knowledge and skills was the most commonly cited intended use of the curricular materials. A total of 259,835 file downloads occurred during the 15-year period, and the most commonly downloaded file type was ancillary handouts.

CONCLUSIONS

The Rx for Change website demonstrated sustained use, providing immediate access to tobacco cessation teaching and practice tools for educators and clinicians over the first 15 years of its existence. The website has a broad interprofessional reach, and the consistent utilization over time and large number of downloads provide evidence for the feasibility and utility of a public-access website hosting teaching materials. The shared curriculum approach averts the need for educators to create their own materials for teaching tobacco cessation to students in the health professions.

Effects of a Debriefing Workshop for Simulation Educators in Nursing

Simulation educators play an essential role in debriefing to induce learning outcomes following a simulation activity. Training programs are needed to ensure and maintain the simulation educator's debriefing competency. This study aimed to identify the effects of a 4-hour debriefing workshop on knowledge, debriefing competency, and satisfaction. A one-group pretest-posttest design was used. The debriefing workshop consisted of a lecture, a practicum for debriefing competency rating (peer evaluation, learner evaluation), a presentation, and a group discussion. A convenience sample of 22 simulation educators completed a self-administered questionnaire. The pretest-posttest difference in knowledge and debriefing competency was analyzed using a paired t test. The results indicated that simulation educators had a higher posttest than pretest knowledge score. Training also significantly improved the overall elements of the perceived simulation educator debriefing competency. The simulation educators were generally satisfied with the debriefing workshop. The debriefing workshop positively affected the simulation educators' knowledge, debriefing competency, and satisfaction. Further study is needed to identify the translational effects of a faculty development program regarding debriefing on learner outcomes.

Quality of pediatric clinical practice guidelines

BACKGROUND

There is a lack of a comprehensive evaluation for pediatric clinical practice guidelines (CPGs) published in recent years. Here, we assessed the quality of pediatric CPGs, considering factors that might affect their quality. The aim of the study is to promote a more coherent development and application of CPGs.

METHODS

Pediatric CPGs published in PubMed, MedLive, Guidelines International Network, National Institute for Health and Care Excellence, and World Health Organization between 2017 and 2019 were searched and collected. Paired researchers conducted screening, data extraction, and quality assessment using the Appraisal of Guidelines for Research and Evaluation II (AGREE II). Linear regression analysis determined the factors affecting CPGs' quality.

RESULTS

The study included a total of 216 CPGs, which achieved a mean score of 4.26 out of 7 points (60.86%) in the AGREE II assessment. Only 6.48% of the CPGs reached the "recommend" level. The remaining 69.91% should have been modified before recommendation, while the other 23.61% did not reach the recommended level at all. The overall quality of recent pediatric CPGs was higher than previously, and the proportion of CPGs with low-quality decreased over time. However, there were still too few CPGs that reached a high-quality level. The "applicability" and "rigor of development" domains had generally low scores. CPGs formulated by developing countries or regions, those that are not under an organizations or groups responsibility, and those that used non-evidence-based methods were found to be associated with poorer quality in different domains as independent or combinational factors.

CONCLUSIONS

The quality of pediatric CPGs still needs to be improved. Specifically, a quality control before applying new CPGs should be essential to ensure their quality and applicability.

A Qualitative Exploration of the Intern Experience in Assessing Medical Student Performance

BACKGROUND

Interns play a key role in medical student education, often observing behaviors that others do not. Their role in assessment, however, is less clear. Despite accreditation standards pertaining to residents' assessment skills, they receive little guidance or formal training in it. In order to better prepare residents for their role in medical student assessment, we need to understand their current experience.

OBJECTIVE

We aimed to describe the first-year resident experience assessing students' performance and providing input to faculty for student clinical performance assessments and grades in the inpatient setting.

METHODS

Pediatric interns at Children's National Hospital (CN) from February 2018 to February 2019 were invited to participate in semistructured interviews about their experience assessing students. Constant comparative methodology was used to develop themes. Ten interviews were conducted, at which point thematic saturation was reached.

RESULTS

We identified 4 major themes: 1) Interns feel as though they assess students in meaningful, unique ways. 2) Interns encounter multiple barriers and facilitators to assessing students. 3) Interns voice varying levels of comfort and motivation assessing different areas of student work. 4) Interns see their role in assessment limited to formative rather than summative assessment.

CONCLUSIONS

These findings depict the intern experience with assessment of medical students at a large pediatric residency program and can help inform ways to develop and utilize the assessment skills of interns.

Environmental influences and individual characteristics that affect learner-centered teaching practices

Research-based teaching practices can improve student learning outcomes in a variety of complex educational environments. The implementation of learner-centered teaching practices in STEM can both benefit from or be constrained by different factors related to individual instructors and the teaching environment. Additionally, we know little of how the instructional climate varies across institutions and how this climate affects teaching practices. Our study sought to examine the relative importance of environmental influences and individual characteristics on learner-centered teaching practices across institutions. We also assessed differences in our study population and departmental climate for 35 US higher education institutions across the country. We found that self-efficacy in teaching and professional development exert a strong influence on faculty teaching practices in biology. While departmental climate did not emerge as a significant predictor of teaching practices, there was consistently low support for teaching, and institution size was negatively correlated with leadership and evaluation of effective teaching. We also found that intensive professional development programs, such as the Faculty Institutes for Reforming Science Teaching IV program, may prepare instructors to teach learner-centered courses in different collegial teaching climates. Our results suggest that through cultivating self-efficacy and participating in iterative professional development, instructors can implement effective teaching practices in a variety of institutional environments.

Education Morbidity and Mortality: Reviving Intraoperative Teaching and Learning

BACKGROUND

Using the platform of morbidity and mortality conference, we developed and executed a combined faculty-resident intervention called "Education M&M" to discuss challenges faced by both parties in the operating room (OR), identify realistic solutions, and implement action plans. This study aimed to investigate the impact of this intervention on resident OR training.

MATERIALS AND METHODS

Two resident case presentations were followed by audience discussion and recommendations regarding actionable solutions aimed at improving resident OR training from an expert faculty panel. Postintervention surveys were completed by participants immediately and 2 mo later to assess perceived short and long-term impact on OR teaching and/or learning and the execution of two recommended solutions. Descriptive statistical analysis was applied.

RESULTS

Immediate post-intervention surveys (n = 44) indicated that 81.8% of participants enjoyed the M&M "a lot"; 90.1% said they would use some or a lot of the ideas presented. Awareness of OR teaching/learning challenges before and after the M&M improved from 3.0 to 3.7 (P = 0.00001) for faculty and 3.0 to 3.9 for trainees (P = 0.00004). Understanding of OR teaching and/or learning approaches improved from 3.1 to 3.7 for faculty (P = 0.00004) and 2.7 to 3.9 for trainees (P = 0.00001). In 2-mo post-intervention surveys, most residents had experienced two recommended solutions (71% and 88%) in the OR, but self-reported changes to faculty behavior did not reach statistical significance.

CONCLUSIONS

A department-wide education M&M could be an effective approach to enhance mutual communication between faculty members and residents around OR teaching/learning by identifying program-specific challenges and potential actionable solutions.

An Evaluation of Faculty Development Programs for Clinician-Educators: A Scoping Review

PURPOSE

Faculty development (FD) has become increasingly important for clinician-educators. An array of FD programs has been developed, but the impact of these programs on clinician-educators and their learners and workplace is less known. The authors conducted a scoping review to explore the status of program evaluation in FD for clinician-educators to inform future planning and research.

METHOD

Five databases were searched for articles published from January 1998 to August 2018 using Arksey and O'Malley's framework and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews. Studies that described evaluation methods and outcomes of FD programs for clinician-educators were included. Data were collected and organized according to program domain (teaching, research/scholarship, leadership, or a combination of skills). A modified version of the Kirkpatrick model was used to compare results among studies.

RESULTS

From a total of 2,091 articles, 1,095 were eligible for full review, and 31 met the inclusion criteria. Seven programs targeted only teaching skills, 3 research/scholarship skills, 7 leadership skills, and 14 a combination of skills. Eighteen programs required the completion of a project; fewer offered fellowships, master's degrees, or certificates. Participant surveys were the most common evaluation method across all domains. Often used metrics included participant satisfaction and self-reported knowledge, skills, behavior changes, scholarly output, and leadership positions. Less common evaluation methods included learner and peer evaluations, interviews, and focus groups. Change at the institutional level was evaluated in 11 programs.

CONCLUSIONS

Program evaluation remains an underdeveloped area in FD for clinician-educators. Developers expend significant effort on program design and implementation but approach evaluation less purposefully. Rigorous metrics that align with program goals and are used longitudinally are needed to accurately assess the impact of FD programs on participants and their learners, workplace, and institutions at large.