Relationships Between the ACGME Resident and Faculty Surveys and Program Pass Rates on the ABIM Internal Medicine Certification Examination

Resident factors associated with American board of internal medicine certification exam failure

INTRODUCTION

Performance on the certifying examinations such as the American Board of Internal Medicine Certification Exam (ABIM-CE) is of great interest to residents and their residency programs. Identification of factors associated with certification exam result may allow residency programs to recognize and intervene for residents at risk of failing. Despite this, residency programs have few evidence-based predictors of certification exam outcome. The change to pass-or-fail score reporting of the USA Medical Licensing Exam (USMLE) Step 1 removes one such predictor.

MATERIALS AND METHODS

We performed a retrospective study of residents from a medium-sized internal medicine residency program who graduated from 1998 through 2017. We used univariate tests of associations between ABIM-CE result and various demographic and scholastic factors.

RESULTS

Of 166 graduates, 14 (8.4%) failed the ABIM-CE on the first attempt. Failing the first attempt of the ABIM-CE was associated with older median age on entering residency (29 vs 27 years; P = 0.01); lower percentile rank on the Internal Medicine In-Training Examination (IM-ITE) in each of the first, second, and third years of training (P < 0.001 for all); and lower scores on the USMLE Steps 1, 2 Clinical Knowledge, and 3 (P < 0.05 for all). No association was seen between a variety of other scholastic or demographic factors and first-attempt ABIM-CE result.

DISCUSSION

Although USMLE step 1 has changed to a pass-or-fail reporting structure, there are still other characteristics that allow residency programs to identify residents at risk of ABIM-CE first time failure and who may benefit from intervention.

-A cross-sectional study of clinical learning environments across four undergraduate programs using the undergraduate clinical education environment measure

BACKGROUND

The clinical learning environment (CLE) influences students' achievement of learning outcomes and the development of their professional behaviors. However, CLEs are not always optimal for learning because of clinical productivity expectations and a lack of support from supervisors. The purpose of this study was to describe and compare students' perceptions of their CLEs across four undergraduate programs.

METHODS

This study is cross-sectional. In total, 735 students who were registered in the medical, nursing, physiotherapy, and speech-language pathology (SLP) programs were invited to participate. Data were collected using an online survey, which included demographics and the Undergraduate Clinical Education Environment Measure (UCEEM). The UCEEM consists of 26 items congregated into two overarching dimensions-experiential learning and social participation-with four subscales: opportunities to learn in and through work and quality of supervision, preparedness for student entry, workplace interaction patterns and student inclusion, and equal treatment.

RESULTS

In total 280 students (median age 28; range: 20-52; 72% females) returned the questionnaire. The mean total UCEEM score was 98.3 (SD 18.4; range: 91-130), with physiotherapy students giving the highest scores and medical students the lowest. The mean scores for the dimensions experiential learning and social participation for all the students were 62.8 (SD 13.6; range 59-85) and 35.5 (SD 6.2; range 13-45), respectively. Medical students rated the lowest for all subscales. The items receiving the highest ratings concerned equal treatment, whereas those receiving the lowest ratings concerned supervisors' familiarity with the learning objectives. There were few statistically significant differences between the semesters within each program.

CONCLUSIONS

The students generally hold positive perceptions toward their CLEs. However, the students from the medical and nursing programs rated their learning environment lower than did the students from the physiotherapy and SLP programs. Importantly, in several aspects, the medical students provided significantly lower ratings for their CLE compared with the students from the other programs. The medical students' low ratings for their supervisors' familiarity with the learning objectives underscore the need to ensure that the prerequisites for optimal supervision are met.

The Role of Integrative Educational Intervention Package (Monthly ITE, Mentoring, Mocked OSCE) in Improving Successfulness for Anesthesiology Residents in the National Board Exam

BACKGROUND

National Board of Anesthesiology (NBA) pass rate is an important and critical step in clinical residency programs.

OBJECTIVES

This study was designed to assess the relationship between an integrative educational intervention (IEI) and the relative annual pass rate (RAPR). RAPR is defined as ratio of NBA pass rate of Shahid Beheshti University of Medical Sciences (SBMU) to the NBA pass rate of all the anesthesiology residency programs across Iran.

METHODS

In a descriptive-analytic retrospective study from 2012 to 2019, RAPR was calculated. IEI was implanted in the latter 4years period of this time interval includes: (1) individualized mentorship for residents by faculty members; (2) monthly in-training examination (ITE) in written; and (3) periodical mocked OSCE exam. Spearman's correlation coefficient was used to assess correlation between integrative educational intervention and RAPR results. P value less than 0.05 was considered statistically significant.

RESULTS

There was a statistically significant relationship between "integrative educational intervention program" and the RAPR results: Spearman's correlation coefficient = 0.655 (P value = 0.039).

CONCLUSIONS

The IEI package of Anesthesiology Department, SBMU showed a significant relationship with improvements in successfulness for anesthesiology residents in the National Board Exam (RAPR trend). More prolonged studies could prevail further aspects of these interventions.

Exploring the relationship between examination pass rates and eligibility pathways among pharmacist candidates for initial board certification

OBJECTIVES

To compare examination pass rates among different eligibility cohorts for initial board certification in 6 recognized pharmacy practice specialties.

DESIGN

Retrospective observational cohort study.

SETTING AND PARTICIPANTS

Practicing U.S. pharmacists who were approved candidates for initial board certification examinations in the following Board of Pharmacy Specialties (BPS)-recognized specialties: ambulatory care pharmacy, critical care pharmacy, oncology pharmacy, pediatric pharmacy, pharmacotherapy, and psychiatric pharmacy.

OUTCOME MEASURES

The number and percentage of BPS-approved candidates that pass initial board certification examinations differentiated by specialty and eligibility pathway (i.e., completion of postgraduate residency training or demonstration of postlicensure specialized practice experience).

RESULTS

Initial board certification examination outcome (i.e., pass or fail) was assessed for a total of 15,171 candidates from Fall 2015 to Fall 2018. Pass rates for that period based on eligibility pathway (e.g., completion of a PGY-2 specialty residency, completion of a PGY-1 residency plus 1-2 years of postlicensure specialized practice experience, or 3-4 years of postlicensure specialized practice experience) were, respectively as follows: ambulatory care pharmacy (n = 2081): 94%, 84%, and 55% (P < 0.0001); critical care pharmacy (n = 2111): 99%, 94%, and 79% (P < 0.0001); oncology pharmacy (n = 1195) 93%, 75%, and 50% (P < 0.0001); pediatric pharmacy (n = 1119): 87%, 73%, and 57%; (P < 0.0001); pharmacotherapy (n = 8368): 88%, 59% (P < 0.0001); and psychiatric pharmacy (n = 477): 93%, 72%, 49% (P < 0.0001).

CONCLUSION

From 2015 to 2018, the percentage of BPS-approved candidates that passed initial board certification examinations in ambulatory care pharmacy, critical care pharmacy, oncology pharmacy, pediatric pharmacy, pharmacotherapy, and psychiatric pharmacy was significantly higher for cohorts deemed to be board eligible based on completion of postgraduate residency training.

The education avenue of the clinical learning environment: A pragmatic approach

Aim: This perspective is part of a series of articles that are outcomes of a consensus conference, that seek to offer a comprehensive examination of the clinical learning environment (CLE), using different academic disciplines and areas of focus termed "avenues." The education dimensions of the CLE are discussed in detail in this perspective, along with critical linkages to the other avenues. Methods: Using iterative presentations, discussion and small group work, in October 2018, the consensus conference participants explored the education, psychological, sociocultural, diversity and inclusion, digital and architectural aspects of the CLE. Results: The education avenue of the CLE includes elements of teaching and learning such as the curriculum, clinical experiences, the assessment system, educational program governance, trainee selection, faculty development, and program evaluation and improvement. Within the educational domain, we focus on organizational and personal/social aspects of the CLE, including (1) curriculum design and deployment, including placement of trainees in clinical settings, organizational culture, practices and policies, and accreditation and regulatory requirements from the organizational domain (2) the education system, including assessment, program evaluation and organization and governance; and (3) elements from the personal and social domains, including peer-to-peer, trainee-faculty, and trainee-patient relationships that influence how and what postgraduate trainees learn, trainee selection, informal and hidden curricula, and trainees' perceptions of their learning environment. Conclusions: We provide suggestions for further research and recommendations for addressing challenges and facilitating improvement in the educational aspects of the CLE, along with actionable practice points.

The clinical learning environment

Learning in a clinical context is foundational in the training of health professionals; there is simply no alternative. The subject of the clinical learning environment (CLE) is at the forefront of discussions. In this introduction to a themed issue on the CLE, we present an expanded conceptual model that approaches the CLE through six different lenses, termed "avenues:" architectural, digital, diversity and inclusion, education, psychological, and sociocultural, with each avenue represented by a paper. The aim is to facilitate dialog around the contributions of different academic disciplines to research on the CLE. Collectively the papers highlight the overlap between the various "avenues" in how they influence each other, and how they collectively have shaped the work to understand and improve the CLE. The expectation is that the various avenues can add to existing knowledge and create new ideas for interventions to improve the clinical learning environment across nations for learners and teachers with the ultimate aim of improving patient care. Research and efforts to improve the CLE are critical to learning, professional socialization and well-being for trainees as they learn and participate in patient care, and to the quality of care they will deliver over decades of practice after graduation.