Perceptions of Leaders and Clinician Educators on the Impact of International Accreditation

Impact of a Regional Pediatric Hematology/Oncology Fellowship Program in Guatemala

PURPOSE

This study aimed to describe and assess the regional experience of a pediatric hematology/oncology fellowship program based in Guatemala.

METHODS

The Unidad Nacional de Oncología Pediátrica (UNOP) in Guatemala City, Guatemala, is the only hospital in Central America dedicated exclusively to childhood and adolescent cancer. To address the regional need for specialists, a fellowship program in pediatric hematology/oncology was launched in 2003. The UNOP fellowship program comprises 3 years of training. Although the program is based at UNOP, it also includes rotations locally and internationally to enhance clinical exposure. The curriculum is based on international standards to cover clinical expertise, research, professionalism, communication, and health advocacy. Trainees are selected according to country or facility-level need for pediatric hematologists/oncologists, with a plan for them to be hired immediately after completing their training.

RESULTS

Forty physicians from 10 countries in Latin America have completed training. In addition, there are currently 13 fellows from five countries in training. Of the graduates, 39 (98%) are now practicing in pediatric hematology/oncology in Latin America. Moreover, many of them have leadership positions within their institutions and participate in research, advocacy, and policy making. Graduates from the UNOP program contribute to institutions by providing care for an increasing number of patients with pediatric cancer. The UNOP program is the first pediatric hematology/oncology fellowship program in the world to be accredited by Accreditation Council for Graduate Medical Education-International, an international body accrediting clinical training programs.

CONCLUSION

The UNOP program has trained specialists to increase the available care for children with cancer in Latin America. This regional approach to specialist training can maximize resources and serve as a model for other programs and regions.

Components of effective letters of recommendation: A cross-sectional survey of academic faculty

INTRODUCTION

Conventional merit-based criteria, including standardized test scores and grade point averages, have become less available to residency programs to help distinguish applicants, making other components of the application, including letters of recommendation (LORs), important surrogate markers for performance. Despite their impact on applications, there is limited published data on LORs in the international setting.

METHODS

A cross-sectional survey of academic faculty was conducted between 9 January 2023 and 12 March 2023 at two large academic medical centers in the United Arab Emirates. Descriptive statistics were used to tabulate variable frequencies.

RESULTS

Of the 98 respondents, the majority were male (n = 67; 68.4%), Western-trained (n = 66; 67.3%), mid-career physicians (n = 46; 46.9%). Most respondents (n = 77; 78.6%) believed that the purpose of an LOR was to help an applicant match into their desired program. Letters rarely included important skills, such as leadership (n = 37; 37.8%), applicant involvement in research (n = 43; 43.9%), education (n = 38; 38.8%), or patient advocacy (n = 30; 30.6%). Most faculty (n = 81; 82.7%) were not familiar with standardized letters of recommendation. Only 7.3% (n = 7) of respondents previously received training in writing LORs, but 87.7% (n = 86) expressed an interest in this professional development opportunity.

CONCLUSION

There is variability in perceptions and practices related to LOR writing in our international setting, with several areas for improvement. Given the increasing importance of LORs to a candidate's application, faculty development is necessary.

Consistency and quality in written accreditation protocols for pediatrician training programs: a mixed-methods analysis of a global sample, and directions for improvement

BACKGROUND

The World Federation for Medical Education (WFME) defines accreditation as 'certification of the suitability of medical education programs, and of…competence…in the delivery of medical education.' Accreditation bodies function at national, regional and global levels. In 2015, WFME published quality standards for accreditation of postgraduate medical education (PGME). We compared accreditation of pediatric PGME programs to these standards to understand variability in accreditation and areas for improvement.

METHODS

We examined 19 accreditation protocols representing all country income levels and world regions. For each, two raters assessed 36 WFME-defined accreditation sub-areas as present, partially present, or absent. When rating "partially present" or "absent", raters noted the rationale for the rating. Using an inductive approach, authors qualitatively analyzed notes, generating themes in reasons for divergence from the benchmark.

RESULTS

A median of 56% (IQR 43-77%) of WFME sub-areas were present in individual protocols; 22% (IQR 15-39%) were partially present; and 8.3% (IQR 5.5-21%) were absent. Inter-rater agreement was 74% (SD 11%). Sub-areas least addressed included number of trainees, educational expertise, and performance of qualified doctors. Qualitative themes of divergence included (1) variation in protocols related to heterogeneity in program structure; (2) limited engagement with stakeholders, especially regarding educational outcomes and community/health system needs; (3) a trainee-centered approach, including equity considerations, was not universal; and (4) less emphasis on quality of education, particularly faculty development in teaching.

CONCLUSIONS

Heterogeneity in accreditation can be appropriate, considering cultural or regulatory context. However, we identified broadly applicable areas for improvement: ensuring equitable access to training, taking a trainee-centered approach, emphasizing quality of teaching, and ensuring diverse stakeholder feedback.

Medical Resident Awareness of Predatory Journal Practices in an International Medical Education System

INTRODUCTION

Learning research methodology is increasingly becoming an essential part of graduate medical education worldwide, with many regulatory and accreditation bodies requiring residents to participate in scholarship. Research methodology workshops have become a standard part of medical curricula; however, there is limited data on how much training on journal selection and the publication process trainees receive. The alarming growth of predatory journals has made it increasingly difficult for researchers, especially trainees and early career physicians, to distinguish these publications from reputable journals. The purpose of this study is to assess the knowledge of reputable and predatory publishing practices amongst medical trainees in an international medical education setting in the United Arab Emirates.

METHODS

A survey on credible journal practices based on the 'Think. Check. Submit' initiative was sent to all graduate medical education trainees at two large academic medical centers in Abu Dhabi, United Arab Emirates. Descriptive statistics were used to tabulate variable frequencies.

RESULTS

Over half of the 160 respondents reported receiving prior research methodology training and 42.5% had at least one publication. The majority of the trainees selected impact factor and the quality of the peer-review process as characteristics of reputable journals. Ambiguous editorial board and rapid publication process were recognized as characteristics of predatory journals by >65% of trainees, however, 95% of all trainees were unaware of Beall's list or other resources to help select a journal for publication. 15.2% of trainees who received unsolicited emails from publishers submitted their manuscripts to the unfamiliar journals, citing peer recommendation and pressure to publish from their training programs as reasons.

CONCLUSION

Trainees in the United Arab Emirates were mostly unaware of reputable publication practices and are vulnerable to publishing in predatory journals. Policy and educational reform are necessary to maintain the credibility and integrity of the scientific process.

"I Find It Quite a Privilege to Be Involved in Their Lives": A Multinational Qualitative Study of Program Directors' Perspectives on Their Relationships with Residents

PHENOMENON

Program director (PD)-resident relationships are important in shaping resident experiences and educational outcomes. Yet, there is limited literature on the development or meaning of these relationships, particularly from the PD perspective. Through qualitative interviews, we explore how PDs navigate their role to develop and maintain relationships with their trainees, and elucidate how these relationships impact the PDs personally and professionally.

APPROACH

Qualitative study using individual semi-structured interviews of former and current PDs (n = 33) from multiple specialties and hospitals in accredited residency programs in Qatar, Singapore, and the United Arab Emirates. We used attachment theory and narrative analysis to investigate how PDs perceive and describe relationship building with their residents amidst tensions of familiarizing themselves with their new role.

FINDINGS

PD-resident relationships are complex and multidimensional, shifting over time, changing patterns and evolving to respond to different contexts. PDs initially negotiate their own roles, while navigating their relationships with residents and other stakeholders to create their professional identities. PDs develop professional alliances, defining for the resident the profession and its expectations. As residents negotiate the various challenges of their training, the role of the PD emerges into one of providing emotional support and advocacy. The support and attachment are often enduring and extend beyond the period of residency training.

INSIGHTS

Our study examines the experiences of program directors as they negotiate complex educator-learner relationships. The PDs described roles that extended beyond their job description. Although all interviewees reported that the PD position was challenging, they focused on the rewarding aspects of the job and how their relationships helped sustain them through the difficulties. Through their reflections, the PDs described the personal satisfaction and benefits of their interactions with the residents, and how the engagement contributed to personal and professional success.

Internal medicine residents' perceptions and experiences in palliative care: a qualitative study in the United Arab Emirates

Background

Palliative medicine is a newly developing field in the United Arab Emirates (UAE). The purpose of this study was to gain a deeper understanding of the experiences of internal medicine residents providing end-of-life care to patients and their families, and how those experiences shape their learning needs.

Method

Nine focus groups were conducted with internal medicine residents and recent graduates from two large academic health centers in the UAE between 2019 and 2020. Through an iterative process, data were collected and examined using constant comparison to identify themes and explore their relationships.

Results

Fifty-two residents and graduates participated. Residents frequently care for terminally ill patients and their families, but lack confidence in their skills and request more structured education and training. Cultural and system related factors also impact palliative care education and patient care. Five main themes and associated subthemes were identified: (1) clinical management of palliative patients, (2) patient and family communication skills, (3) religion, (4) barriers to end-of-life education, and (5) emotional impact of managing dying patients.

Conclusion

Our findings can help guide program development and curricular changes for internal medicine residents in the region. Structured education in end-of-life care, with a focus on fostering culturally sensitive communication skills and spirituality, can improve resident education and patient care. Clear and transparent policies at the institution level are necessary. Programs are also needed to assist residents in developing effective coping strategies and emotionally navigating experiences with patient death.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12904-022-00908-5.

International Residency Program Directors on Implementing Educational Transformation: A Qualitative Study of Their Experiences and Strategies for Overcoming Challenges

BACKGROUND

Residency program directors (PDs) need to navigate diverse roles and responsibilities as clinical teachers, administrators, and drivers of educational improvement. Little is known about the experience of PDs leading transformation of international residency programs.

OBJECTIVE

We explored the lived experiences of international residency PDs and developed an understanding of how PDs manage educational program transformation.

METHODS

Using a phenomenological approach, semi-structured interviews were conducted with current and former PDs involved in the transformation to competency-based medical education in the first international settings to be accredited by the Accreditation Council for Graduate Medical Education-International (ACGME-I). Thirty-three interviews with PDs from Qatar, Singapore, and the United Arab Emirates were conducted from September 2018 to July 2019, audio-recorded, and transcribed. Data were independently coded by 2 researchers. A thematic analysis was conducted and patterns that reflected coping and managing educational reform were identified.

RESULTS

PDs described distinctive patterns of navigating the educational transformation. Five themes emerged: PDs (1) embraced continuous learning and self-development; (2) managed change in the context of their local settings; (3) anticipated problems and built support networks to effectively problem-solve; (4) maintained relationships with stakeholders for meaningful and constructive interactions; and (5) focused on intrinsic qualities that helped them navigate challenges.

CONCLUSIONS

International PDs were presented with significant challenges in implementing educational transformation but coped successfully through distinctive patterns and methods.

Program Director Retention and Attrition Rates in International Graduate Medical Education

BACKGROUND

Program directors (PDs) are integral to the education of the next generation of physicians. Yet, administrative burdens, substantial patient care responsibilities, and lack of protected time for teaching may contribute to work-life imbalance and physician burnout, leading to high rates of attrition. Data on international residency program leadership turnover are lacking.

OBJECTIVE

This study aimed to quantify PD turnover in Accreditation Council for Graduate Medical Education-International (ACGME-I) accredited programs in Singapore, United Arab Emirates (UAE), and Qatar, and to compare to US PD attrition rates.

METHODS

Data on PD turnover in international programs was extracted from the ACGME-I Accreditation Data System for academic years 2010-2011 through 2018-2019 for Singapore and 2013-2014 through 2018-2019 for UAE and Qatar. Rates of PD turnover were calculated by country and by ACGME-I medical-, surgical-, and hospital-based specialty groupings and compared using χ² test. Annual US PD turnover data was extracted from the ACGME's Data Resource Book.

RESULTS

Seventy programs met inclusion criteria. International PD attrition was high, with 56 programs (80%) changing PDs since program inception, and 16 programs (29%) having 2 or more PD turnovers. There was no significant difference between PD turnover rates in hospital (83%), medical (79%), or surgical (78%) specialties. International PD attrition rates varied from 7% to 20% annually and were comparable to PD turnover in US programs (range 12%-15%).

CONCLUSIONS

High PD turnover rates in newly accredited international residency programs were noted, although annual attrition rates were comparable to US residency programs.

Accreditation Improves Quality of Oncology Education in Low- and Middle-Income Countries: Perspectives of African Oncologists

The purpose of this study is to understand the perspectives of African Oncologists on the role of accreditation and on global standards. We developed a survey that addressed African oncologists' opinions on the role of accreditation. The survey also included 187 standards from World Federation of Medical Education Postgraduate medical education (PGME) standards, American Council of Graduate Medical Education (ACGME)-I standards for hematology/oncology, and the Royal College of Physician and Surgeons of Canada Medical Oncology standards. A 3-point scale was employed for each standard: 1 = not important, 2 = important but not essential, 3 = essential. The survey was sent to 79 physicians, 38 responded. Eighty-seven percent agreed that accreditation ensures quality. Forty-five percent agreed it will not increase migration of qualified doctors. Twenty-two individuals who completed the entire survey were analyzed for the standards. Five standards received the highest ratings of 3 (essential) from all respondents. One standard received a rating of < 2.0. The majority of standards had ratings between 2.6 and 2.94 indicating African oncologists found most standards to be useful. Ratings < 2.6 were mostly related to resource constraints. Most African Oncologists believed that accreditation ensures quality of education, and most standards were considered important. This data is useful for developing and adapting accreditation standards in resource-constrained settings.

A 360-degree assessment of teaching effectiveness using a structured-videorecorded observed teaching exercise for faculty development

BACKGROUND

Filming teaching sessions were reported in the medical literature in the 1980s and 1990s but appear to have been an underreported and/or underutilized teaching tool since that time. National faculty development programs, such as the Harvard Macy Institute (HMI) Program for Educators in Health Professions and the Stanford Faculty Development Center for Medical Teachers program, have attempted to bridge this gap in formal instruction in teaching skills through microteaching sessions involving videos for self- and peer-assessment and feedback.

OBJECTIVE

Current video-feedback faculty development initiatives are time intensive and impractical to implement broadly at an institutional level. Further, results of peer feedback have not been frequently reported in the literature at the institutional level. Our research aims to propose a convenient and effective process for incorporating video analysis into faculty devleopment programs.

DESIGN

Our work describes a novel technique using video-recorded, simulated teaching exercises to compile multi-dimensional feedback as an aid in faculty development programs that promote teaching-skill development. This research evaluated the effectiveness of a focused teaching practicum designed for faculty in multiple specialty departments with large numbers of older patients into a geriatrics-based faculty development program. Effectiveness of the practicum is evaluated using quantitative scoring and qualitative analysis of self-reflection as well as peer and trainee input.

RESULTS

VOTE sessions demonstrate an important exportable product which enable faculty to receive a detailed 360-degree assessment of their teaching.

CONCLUSION

This intervention can be easily replicated and revised, as needed, to fit into the educational curriculum at other academic medical centers.

Characterization and Perceptions of Surgical Clinician Educators: An International Survey

OBJECTIVE

Surgeons worldwide face unique time and practice pressures differentiating them from other types of physicians, specifically as clinician educators (CEs). The purpose of this study is to identify and describe academic surgical clinician educators (SCEs) in international graduate medical education systems, characterize their perceptions of roles, preparedness, and factors affecting job satisfaction and retention, as compared to nonsurgical international CEs.

DESIGN, SETTING, AND PARTICIPANTS

A cross-sectional survey of CEs was conducted June 2013-June 2014 at academic medical centers in Singapore, Qatar, and the United Arab Emirates that adopted competency-based graduate medical education and received accreditation by the Accreditation Council for Graduate Medical Education-International.

RESULTS

Two hundred seventy-six (76.3%) of 359 eligible physicians responded; 64 (23.2%) were SCEs. SCEs were predominantly male (80%), less than 50 years of age (83%), with 64% having been in their current position less than 5 years. Overall, SCEs were significantly less confident, as compared to nonsurgical CEs, in aspects of educational programs, including curriculum development, assessment, and mentorship. SCEs spent significantly more time engaged in patient care activities, as compared to nonsurgeon colleagues. There were no significant differences between SCEs and nonsurgical CEs in terms of work-life balance and satisfaction with responsibilities, position, or potential promotion, with most SCEs intending to stay in academic medicine.

CONCLUSIONS

Academic SCEs working in the international programs reported overall job satisfaction with a desire to remain in academic medicine. However, SCEs have several faculty development needs. International surgical training programs can develop and expand offerings in teaching and education to improve skills and maintain SCE satisfaction and retention, necessary to successfully train the next generation of surgeons.

Burnout and depression among medical residents in the United Arab Emirates: A Multicenter study

Introduction:

Persistent imbalance between work demands and resources seems to be a crucial contributor to the development of burnout among medical professionals. Yet, it seems that Middle East is lacking studies analyzing psychological well-being's of medical residents. Hence, we aimed to conduct a nationwide study to understand and address burnout and depression in medical residents in the UAE.

Methods:

A multicenter, cross-sectional study was designed to evaluate professional burnout and depression among medical residents to address the gap.

Results:

Our results indicate that 75.5% (216/286) of UAE medical residents had moderate-to-high emotional exhaustion (EE), 84% (249/298) had high depersonalization (DP), and 74% (216/291) had a low sense of personal accomplishment. In aggregate, 70% (212/302) of medical residents were considered to be experiencing at least one symptom of burnout based on a high EE score or a high DP score. Depression ranging from 6% to 22%, depending on the specialty was also noted. Noticeably, 83% (40/48) of medical residents who had high scores for depression also reported burnout.

Conclusions:

This study shows that burnout and depression are high among medical residents in UAE. There is a crucial need to address burnout through effective interventions at both the individual and institutional levels. Professional counseling services for residents will certainly be a step forward to manage resident burnout provided the social stigma associated with counseling can be eliminated with awareness. The work hour regulations suggested by the Accreditation Council for Graduate Medical Education partly provides a solution to improve patient safety and care quality. There is an urge to reconfigure the approach to medical training for the well-being of the next generation of physicians in the Arab world.

The link between quality and accreditation of residency programs: the surveyors' perceptions

Accreditation of medical residency programs has become globally important. Currently it is moving from the goal of attaining minimal standards to a model of continuous improvement. In some countries, the accreditation system engages peers (physicians) to survey residency programs. The surveyors are sometimes volunteers, usually engaged in multiple clinical and education activities. Few studies have investigated the benefits of residency program evaluation and accreditation from the perspective of the surveyors. As peers they both conduct and receive accreditation surveys, which puts them in a privileged position in that it provides the surveyor with an opportunity to share experiences and knowledge and apply what is learned in their own context. The objective of this study is to obtain the perceptions of these surveyors about the impact of an accreditation system on residency programs. Surveyors participated in semi-structured interviews. A thematic analysis was performed on the interview data, and resulting topics were grouped into five themes: Burden (of documentation and of time needed); Efficiency and efficacy of the accreditation process; Training and experience of surveyors; Being a peer; Professional skills and recognition of surveyors. These categories were organized into two major themes: 'Structure and Process' and 'Human Resources'. The study participants proposed ways to improve efficiency including diminish the burden of documentation to the physicians involved in the process and to increase efforts on training programs and payment for surveyors and program directors. Based on the results we propose a conceptual framework to improve accreditation systems.

ABBREVIATIONS

PD: Program director.