Impact of accreditation on Caribbean medical schools' processes

What are the perceptions of faculty and academic leaders regarding the impact of accreditation on the continuous quality improvement process of undergraduate medical education programs at Caribbean medical schools?

BACKGROUND

Accreditation and regulation are meant for quality assurance in higher education. However, there is no guarantee that accreditation ensures quality improvement. The accreditation for Caribbean medical schools varies from island to island, and it could be mandatory or voluntary, depending on local government requirements. Caribbean medical schools recently attained accreditation status to meet the Educational Commission for Foreign Medical Graduates (ECFMG) requirements by 2024. Literature suggests that accreditation impacts ECFMG certification rates and medical schools' educational processes. However, no such study has examined accreditation's impact on continuous quality improvement (CQI) in medical schools. This study aims to gather the perceptions and experiences of faculty members and academic leaders regarding the impact of accreditation on CQI across Caribbean medical schools.

METHODS

This qualitative phenomenological study inquiries about the perceptions and experiences of faculty and academic leaders regarding accreditation's impact on CQI. Purposive and snowball sampling techniques were used. Participants were interviewed using a semi-structured interview method. Fifteen participants were interviewed across ten Caribbean medical schools representing accredited medical schools, accreditation denied medical schools, and schools that never applied for accreditation. Interviews were audio recorded, and thematic data analysis was conducted.

RESULTS

Thematic analysis yielded six themes, including accreditation and CQI, CQI irrespective of accreditation, faculty engagement and faculty empowerment in the CQI process, collecting and sharing data, ECFMG 2024 requirements, and organizational structure of CQI.

CONCLUSIONS

There is ongoing quality improvement at Caribbean medical schools, as perceived by faculty members and academic leaders. However, most of the change process is happening because of accreditation, and the quality improvement is due to external push such as accreditation rather than internal motivation. It is recommended that Caribbean medical schools promote internal quality improvement irrespective of accreditation and embrace the culture of CQI.

Did the students' satisfaction rates at Avalon University School of Medicine correlate with the occurrence of accreditation site visits?

INTRODUCTION

Accreditation of medical education programs can be observed from different perspectives. Regulatory/accreditation agencies consider it vital to assure a certain level of quality. Other stakeholders may perceive the accreditation process as a negative experience, draining resources, and efforts. Although accreditation may improve the program's governance and administration, its direct or indirect impact on students must be further investigated. This study explores the relationship between the occurrence of accreditation site visits and student satisfaction rates at Avalon University School of Medicine.

METHODS

A comparison study was conducted with retrospective satisfaction data from two accreditation cycles at AUSOM. We used the Caribbean Accreditation Authority for Education in Medicine and Other Health Professions (CAAM-HP) student surveys for data collection, and data from 2017, 2019, and 2022 were used. The response rate was 70% (n = 71), 72% (n = 47), and 60% (n = 56) for basic science students and 80% (n = 111), 82% (n = 115), and 70% (n = 76) for clinical students in 2017, 2019, and 2022, respectively. The survey for basic sciences students included 37 questions/items, and the survey for clinical students included 39 questions/items. The responses for the questionnaire were on the five-point Likert scale. The retrospective data were evaluated using the unpaired Wilcoxon-rank sum test.

RESULTS

The ratings for the basic science students' survey increased from 2017 to 2019 (first accreditation cycle) only for 11 items/questions and they were increased from 2019 to 2022 for all items/questions. The ratings for clinical science students' surveys increased from 2017 to 2019 (the first accreditation cycle) for all items/questions with a statistically significant p-value. They increased for 28 questions/items from 2019 to 2022, and two items (availability and adequacy of career counseling) showed statistically significant p-values.

CONCLUSIONS

The pre-accreditation preparation and the self-evaluation process while correcting the program's deficiencies are essential triggers for the quality improvement process associated with accreditation.

The impact of accreditation on continuous quality improvement process in undergraduate medical education programs: A scoping review

Background

Accreditation in medical education has existed for more than 100 years, yet the impact of accreditation remains inconclusive. Some studies have shown the effects of accreditation on student outcomes and educational processes at medical schools. However, evidence showing the impact of accreditation on continuous quality improvement of undergraduate medical education programs is still in its infancy. This scoping review explores the impact of accreditation on continuous quality improvement (CQI).

Methods

This scoping review followed the methodology of the Preferred Reporting Items of Systematic Reviews and the Meta-Analysis extension for scoping reviews (PRISMA-ScR) checklist outlined by Arksey and O'Malley (2005). Databases, including PubMed, Medline, ERIC, CINHAL, and Google Scholar, were searched to find articles from 2000 to 2022 related to the accreditation of undergraduate medical education programs and continuous quality improvement.

Results

A total of 35 full-text articles were reviewed, and ten articles met our inclusion criteria. The review of the full-text articles yielded four themes: Accreditation and its standards in general, Accreditation and its impact on student outcomes, Accreditation and its impact on medical school's educational processes, Accreditation and CQI. However, the literature evidence suggesting the impact of accreditation on CQI is minimal. The quality assurance approach is based on meeting the standards of accreditation. The quality improvement approach is based on striving for excellence. Literature suggests a requirement to move from student outcomes to CQI measures. CQI requires everyone in the organization to take responsibility and accountability, considering quality as the result of every single step or process and leaders supporting improvements in data collection and data analysis for quality improvement.

Conclusions

The literature on accreditation and CQI are limited in number. More research studies are required to enhance undergraduate medical education accreditation practices' value to medical students, educators, academic leaders, programs, and the public. It was recommended that medical schools embrace the culture and vision perpetuated by the CQI process.

Cross-Border Accreditation in the Caribbean: A Potential Threat to the Integrity of the Accreditation Process?

According to the World Directory of Medical Schools, the Caribbean region hosts around 100 medical schools, leading to variations in education programs and student performance. Accreditation is crucial for maintaining educational standards. The proliferation of accrediting agencies recognized by the World Federation of Medical Education (WFME) has led to cross-border accreditation practices and market-driven competition. Concerns about the integrity of accreditation processes in the Caribbean region have raised questions about educational quality and global implications. Establishing a framework and scrutiny of the WFME regarding cross-border accreditation is essential to preserve educational standards and prevent global implications. ECFMG's intervention is urgently needed to investigate and restore the integrity of medical school accreditation in the Caribbean, setting a precedent for global accreditation standards.

First-round accreditation and pass rates on licensing examination at different medical schools in China: Closing the performance gap

BACKGROUND

Although the accreditation approach is widely used to ensure the quality of medical education in many countries, there is scant empirical evidence on whether and how it improves actual medical school performance. We focused on conditions in China, which introduced an accreditation system during the 2010s. Specifically, we examined the relationship between first-round accreditation and actual performance based on the results of medical licensing examinations. Referring to organisation theory, we hypothesised that the impacts of accreditation would depend on existing performance gaps.

METHOD

In 2022, we analysed panel data from 105 Chinese medical schools during accreditation (2012 to 2021) and pass rates on medical licensing examinations (2011 to 2019), as matched into 834 school-year records in a window of years before and after accreditation. We employed fixed-effects regression models with a comparison group to exclude factors that may have confounded the impacts of accreditation time. We also demonstrated the heterogeneous effects of accreditation by tier and performance gap of medical schools.

RESULTS

The conservative estimates showed a substantial cumulative improvement (over 15 percentage points) in pass rates during the years before accreditation, with no clear trend indicating performance drops in the years after accreditation. Lower-tiered medical schools gained greater benefits from accreditation. Medical schools with a larger prior performance gap achieved a greater percentage point increase in pass rates with the passage of time in pre-accreditation years.

CONCLUSIONS

This is the first empirical study to investigate whether accreditation has bridged performance gaps among medical schools. The results support the value of accreditation in China, a country that recently established the system, and might work as a substitute for missing information on early accreditation history in countries with long-established accreditation systems. We encourage more studies in countries that have recently introduced accreditation systems.

Quality assurance in health professions education: Role of accreditation and licensure

OBJECTIVE

The aim of this paper is to provide an overview of the major quality assurance strategies, accreditation and licensure, in health professions education. It explores the nature of these regulatory processes using Brazil and the United States as examples because these large systems are at different ends of the developmental continuum. For each, it describes the tensions that arise, offers a critical synthesis of the evidence and maps out future directions.

RESULTS

Given wide variability among operating medical schools in curricular design, length of study, resources and facilities for clinical training and supervision, the nature of regulatory bodies varies considerably. Nonetheless, they share tensions related purpose and process including quality assurance versus quality improvement, outcomes versus process and continuous versus episodic evaluations and assessments. Clear evidence of effectiveness, especially for accreditation, is scarce and difficult to obtain, particularly as it relates to health outcomes.

CONCLUSIONS

Regulatory processes need to be built around clear definitions of the goals for each stage of professional development, the current movement towards competency-based education and the variable durations of medical education. These changes must motivate revisions in the content and process of programmes for accreditation and licensure, complimentary efforts towards quality of care, and stimulate a significant research effort.