The impact of a faculty development program: evaluation based on the self-assessment of medical educators from preclinical and clinical disciplines

A Qualitative Exploration of the Intern Experience in Assessing Medical Student Performance

BACKGROUND

Interns play a key role in medical student education, often observing behaviors that others do not. Their role in assessment, however, is less clear. Despite accreditation standards pertaining to residents' assessment skills, they receive little guidance or formal training in it. In order to better prepare residents for their role in medical student assessment, we need to understand their current experience.

OBJECTIVE

We aimed to describe the first-year resident experience assessing students' performance and providing input to faculty for student clinical performance assessments and grades in the inpatient setting.

METHODS

Pediatric interns at Children's National Hospital (CN) from February 2018 to February 2019 were invited to participate in semistructured interviews about their experience assessing students. Constant comparative methodology was used to develop themes. Ten interviews were conducted, at which point thematic saturation was reached.

RESULTS

We identified 4 major themes: 1) Interns feel as though they assess students in meaningful, unique ways. 2) Interns encounter multiple barriers and facilitators to assessing students. 3) Interns voice varying levels of comfort and motivation assessing different areas of student work. 4) Interns see their role in assessment limited to formative rather than summative assessment.

CONCLUSIONS

These findings depict the intern experience with assessment of medical students at a large pediatric residency program and can help inform ways to develop and utilize the assessment skills of interns.

Identification of capacity development indicators for faculty development programs: A nominal group technique study

BACKGROUND

Although there have been many research studies of the effectiveness of faculty development in health profession education, the contribution of these programs to organizational development through capacity development has not been studied. Further understanding of capacity development requires appropriate indicators and no previous indicators for faculty development of health profession educators were identified. The aim of the study was to identify indicators of capacity development in the context of faculty development programs at Tehran University of medical sciences (TUMS).

METHODS

A nominal group technique session was conducted with key informants from faculty development program providers to generate and prioritize a list of capacity development indicators.

RESULTS

A list of 26 indicators was generated and five categories were identified: Development and innovation in teaching and learning process, Development and innovation in communication and collaboration at different levels, Development and sustaining faculty development programs, Development of educational leadership and management, Development in scholarship.

CONCLUSIONS

Capacity development for faculty development interventions of health profession educators is a process of engagement within a wider system, including individual and collective action, and involves the socialization of the teachers into suitable roles through professional identity development and participation within the wider system.

Contribution of faculty developmental programmes to professional identity development of medical educators in Malaysia: A phenomenological study

OBJECTIVE

Professional identity development (PID) of academicians is triggered by numerous elements, including faculty development programmes (FDP). The study aims at exploring how FDPs contribute to PID among junior medical educationists.

METHODS

A qualitative phenomenological study was carried out in six Malaysian public medical schools from 15th March to 15th April 2019. A total of 10 junior medical educationists participated in the study. A purposive sampling technique was utilised to select eligible participants. A series of semi-structured interviews was conducted to collect the data using a pre-determined interview protocol. The collected data were then analysed using open, axial, and selective coding methods assisted by ATLAS.ti software.

RESULTS

Three themes (i.e. personal growth, professional growth, and self-reflective practice) and nine sub-themes (i.e. self-awareness, intention, internal satisfaction, career pathway, maintaining professional skills, acquiring new knowledge, identifying strengths and weaknesses, and areas for improvement) emerged from the data analysis.

CONCLUSION

The study showed that PID could be developed through personal growth, professional growth, and self-reflective practice. Policymakers should focus on these characteristics during training sessions designed for the professional development of their medical faculty staff.

The International Literature on Teaching Faculty Development in English-Language Journals: A Scoping Review and Recommendations for Core Topics

BACKGROUND

With increasing physician mobility, there is interest in how medical schools and postgraduate medical education institutions across the world develop and maintain the competence of medical teachers. Published reviews of faculty development (FD) have predominantly included studies from the United States and Canada.

OBJECTIVE

We synthesized the international FD literature (beyond the US and Canada), focusing on FD type, intended audience, study format, effectiveness, differences among countries, and potential unique features.

METHODS

We identified English-language publications that addressed FD for medical faculty for teaching and related activities, excluding US and Canadian publications.

RESULTS

A search of 4 databases identified 149 publications, including 83 intervention studies. There was significant growth in international FD publications for the most recent decade, and a sizable number of studies were from developing economies and/or resulted from international collaborations. Focal areas echo those in earlier published reviews, suggesting the international FD literature addresses similar faculty needs and organizational concerns.

CONCLUSIONS

The growth in publications in recent years and a higher proportion of reporting on participant reactions, coupled with less frequent reporting of results, transfer to practice, and impact on learners and the organization, suggest this is an evolving field. To enhance international FD, educators and researchers should focus on addressing common needs expressed by faculty, including curriculum design and evaluation, small group teaching, assessing professionalism and providing feedback. Future research should focus on approaches for developing comprehensive institutional FD programs that include communities of learning and practice and evaluating their impact.

The impact and effectiveness of faculty development program in fostering the faculty's knowledge, skills, and professional competence: A systematic review and meta-analysis

BACKGROUND

Faculty vitality is the main ingredient to enhance professional education and competence. Enriching the faculty vitality in key domains of teaching, assessing, research, professionalism, and administration is perceived to improve educational environment significantly and enhances the academic performance of learners. Faculty development program (FDP) has been considered as a stand-alone educational pedagogy in fostering knowledge and professional skills of faculty. However, few studies have provided objective reports about the impact of such programs in a healthcare system.

METHODS

This research was conducted by selecting data sources of PubMed-Medline, Wiley online library, Cochrane library, Taylor & Francis Online, CINAHL, Springer link, Proquest, ISI Web of knowledge, ScienceDirect, EJS, EBSCO, Blackwell, Emerald and ABI Inform. This search followed a step-wise approach defined by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). A total of 37 studies that explored the impact of FDPs on medical and allied health faculty's professional development were selected.

RESULTS

This meta-analysis reported a mean effect size of 0.73 that reflects a significant and positive impact of FDPs in enhancing faculty's knowledge and professional competence (z-statistics of 4.46 significant at p-value < 0.05) using the random effects model and forest plot.

CONCLUSION

This article reiterates the incorporation of FDPs in all healthcare institutions for improving the academic performance of faculty with resultant enrichment of learners' knowledge and skills.

Improving global health: measuring the success of capacity building outreach programs: a view from the International Society of Nephrology

Capacity building is key to the advance of health care in the developing world, but capacity building can take several forms, and it is not yet clear which forms and funding models are most effective. The International Society of Nephrology (ISN) has developed and sustained a portfolio of global outreach programs that make a unique contribution at low cost to the appropriate training and continuing support of nephrologists throughout the developing world. We describe the programs and present encouraging findings of their outcomes. Finally, we reflect on how the ISN interventions and evaluations measure up against recommended approaches in the literature and consider lessons for ISN and other organizations involved in planning, evaluating, and benchmarking similar programs.

A systematic review of faculty development initiatives designed to enhance teaching effectiveness: A 10-year update: BEME Guide No. 40

BACKGROUND

This review, which focused on faculty development initiatives designed to improve teaching effectiveness, synthesized findings related to intervention types, study characteristics, individual and organizational outcomes, key features, and community building.

METHODS

This review included 111 studies (between 2002 and 2012) that met the review criteria.

FINDINGS

Overall satisfaction with faculty development programs was high. Participants reported increased confidence, enthusiasm, and awareness of effective educational practices. Gains in knowledge and skills, and self-reported changes in teaching behaviors, were frequently noted. Observed behavior changes included enhanced teaching practices, new educational initiatives, new leadership positions, and increased academic output. Organizational changes were infrequently explored. Key features included evidence-informed educational design, relevant content, experiential learning, feedback and reflection, educational projects, intentional community building, longitudinal program design, and institutional support.

CONCLUSION

This review holds implications for practice and research. Moving forward, we should build on current success, broaden the focus beyond individual teaching effectiveness, develop programs that extend over time, promote workplace learning, foster community development, and secure institutional support. We should also embed studies in a theoretical framework, conduct more qualitative and mixed methods studies, assess behavioral and organizational change, evaluate transfer to practice, analyse key features, and explore the role of faculty development within the larger organizational context.

Identification of technical item flaws leads to improvement of the quality of single best Multiple Choice Questions

Objective: The purpose of the study was to identify technical item flaws in the multiple choice questions submitted for the final exams for the years 2009, 2010 and 2011.

Methods: This descriptive analytical study was carried out in Islamic International Medical College (IIMC). The Data was collected from the MCQ’s submitted by the faculty for the final exams for the year 2009, 2010 and 2011. The data was compiled and evaluated by a three member assessment committee. The data was analyzed for frequency and percentages the categorical data was analyzed by chi-square test.

Results: Overall percentage of flawed item was 67% for the year 2009 of which 21% were for testwiseness and 40% were for irrelevant difficulty. In year 2010 the total item flaws were 36% and 11% testwiseness and 22% were for irrelevant difficulty. The year 2011 data showed decreased overall flaws of 21%. The flaws of testwisness were 7%, irrelevant difficulty were 11%.

Conclusion: Technical item flaws are frequently encountered during MCQ construction, and the identification of flaws leads to improved quality of the single best MCQ’s.

Attitudes of affiliate faculty members toward medical student summative evaluation for clinical clerkships: a qualitative analysis

BACKGROUND

Summative evaluation of medical students is a critical component of the educational process. Despite extensive literature on evaluation, few studies have centered on affiliate faculty members' attitudes toward summative evaluation of students, though it has been suggested that these attitudes influence their effectiveness as evaluators.

PURPOSE

The objective is to examine affiliate faculty members' attitudes toward clinical clerkship evaluation using primarily qualitative research methods.

METHODS

The study used a nonexperimental research design and employed mixed methods. Data were collected through interviews, focus groups, and a questionnaire from 11 affiliate faculty members.

RESULTS

Themes emerging from the data fell into three broad categories: (a) factors that influence grading, (b) consequences of negative evaluations, and (c) disconnections in the grading process. The quantitative portion of the study revealed important discrepancies supporting the use of qualitative methods.

CONCLUSIONS

The study highlights faculty members' struggles with the evaluative process and emphasizes the need for improvements in evaluation tools and faculty development.