Competency-based medical education in ophthalmology residency training: a review

Comparison of 3D heads-up display system with conventional surgical microscopy for minimally invasive glaucoma surgery on an artificial eye model

OBJECTIVE

To survey ophthalmic surgeons' opinions comparing a novel three-dimensional (3D) heads-up display system with a conventional surgical microscopy for minimally invasive glaucoma surgery (MIGS) on an artificial eye model.

MATERIALS AND METHODS

Twenty-one ophthalmologists at the 2021 Canadian Ophthalmological Society Annual Meeting in Halifax, Nova Scotia, underwent a 90-minute skills-transfer course on MIGS. Using an artificial eye model (SimulEYE iTrack Model; InsEYE LLC, Westlake Village, Calif.), participants engaged in hands-on practice of MIGS via both a 3D heads-up display system (3D HUDS) (Zeiss Artevo 800; Carl Zeiss Meditec, Jena, Germany) and a conventional surgical microscope. Following completion, participants and instructors answered a 16-question survey comparing the 2 systems (3D HUDS vs conventional surgical microscope). Survey responses were recorded on a 9-point double-headed Likert scale ranging from strongly favour 3D HUDS (1) to strongly favour conventional surgical microscopy (9). Mann-Whitney U nonparametric analysis was used to compare instructor versus participants and experts versus nonexperts.

RESULTS

Survey ratings favoured the 3D HUDS over the conventional surgical microscopy, with respondent ratings for all survey questions ranging from a response of 1 (strongly favour 3D HUDS) to 5 (equal). Mann-Whitney U statistical analysis revealed no significant difference between instructor versus participant as well as between expert versus nonexpert. Most ratings for the 3D HUDS were received for ergonomic setup of the surgical modality, depth of field (or) field of view, and usefulness in training residents for MIGS. Equal ratings for the 3D HUDS and conventional surgical microscope were received for system malfunctions and lag during surgery.

CONCLUSIONS

The 3D HUDS was favoured over conventional microscopy for the performance of simulated MIGS by ophthalmologists with varying levels of experience. The survey results suggest that the 3D HUDS in an artificial eye model is useful for teaching minimally invasive glaucoma surgery, particularly with the advent of competency-based ophthalmology education programs.

Effectiveness of the Eyesi Surgical Simulator for ophthalmology trainees: systematic review and meta-analysis

OBJECTIVE

The Eyesi Surgical Simulator (VRmagic, Mannheim, Germany) is the most commonly used ophthalmic virtual reality surgical simulator. While studies have demonstrated improved trainee skill acquisition with simulation-based training tools, a systematic review and meta-analysis evaluating Eyesi specifically has yet to be conducted. The aim of this study was to meta-analyze studies comparing Eyesi with other methods of technical skill teaching for trainees.

METHODS

MEDLINE, Embase, and CENTRAL databases were searched. Articles included compared Eyesi Surgical Simulator use with alternative methods of technical skill training for medical students or residents. A pairwise meta-analysis using inverse variance random effects was performed. Standardized mean differences (SMDs) were used as the primary outcome measure to account for differences in surgical skill evaluation tools.

RESULTS

From 207 citations, 8 studies with 108 learners using Eyesi and 123 learners not using Eyesi were included. Improvements in technical skill scores were significantly greater with the use of Eyesi (3 studies; SMD = 2.02; 95% CI, 1.47-2.57; p < 0.001; I2 = 0%). There was a significant reduction in the number of learners experiencing post-training technical errors in the Eyesi group (5 studies: odds ratio = 0.43; 95% CI, 0.20-0.90; p = 0.03; I2 = 30%). There were no significant differences in post-training time to task completion between groups (3 studies; SMD = 1.96; 95% CI, -1.96-5.88; p = 0.33; I2 = 97%).

CONCLUSIONS

The Eyesi Surgical Simulator may improve technical skill acquisition (grade: low certainty of evidence) and decrease technical errors (grade: very low certainty of evidence) during cataract surgery among trainees. Further prospective studies evaluating Eyesi modules with standardized scoring systems is warranted.

Unveiling the paradoxes of implementing post graduate competency based medical education programs

PURPOSE

Competency-based medical education (CBME) has gained prominence as an innovative model for post-graduate medical education, yet its implementation poses significant challenges, especially with regard to its sustainability. Drawing on paradox theory, we suggest that revealing the paradoxes underlying these challenges may contribute to our understanding of post graduate competency-based medical education (PGCBME) implementation processes and serve as a first-step in enhancing better implementation. Thus, the purpose of the current study is to identify the paradoxes associated with PGCBME implementation.

METHOD

A qualitative study was conducted, as part of a larger action research, using in-depth semi-structured interviews with fellows and educators in eight Neonatal wards.

RESULTS

Analysis revealed that the PGCBME program examined in this study involves three different levels of standardization, each serving as one side of paradoxical tensions; (1) a paradox between the need for standardized assessment tools and for free-flow flexible assessment tools, (2) a paradox between the need for a standardized implementation process across all wards and the need for unique implementation protocols in each ward; and 3) a paradox between the need for a standardized meaning of competency proficiency and the need for flexible and personal competency achievement indicators.

CONCLUSIONS

Implementing PGCBME programs involves many challenges, some of which are paradoxical, i.e. two contradictory challenges in which solving one challenge exacerbates another. Revealing these paradoxes is important in navigating them successfully.

Lessons learned spanning 17 years of experience with three consecutive nationwide competency based medical education training plans

Introduction

Curricula for postgraduate medical education have transformed since the introduction of competency based medical education (CBME). Postgraduate training plans offer broader training with different competencies and an outcome-based approach, in addition to the medical technical aspects of training. However, CBME also has its challenges. Over the past years, critical views have been shared on the potential drawbacks of CBME, such as assessment burden and conflicts with practicality in the workplace. Recent studies identified a need for a better understanding of how the evolving concept of CBME has been translated to curriculum design and implemented in the practice of postgraduate training. The aim of this study was to describe the development of CBME translations to curriculum design, based on three consecutive postgraduate training programs spanning 17 years.

Method

We performed a document analysis of three consecutive Dutch gynecology and obstetrics training plans that were implemented in 2005, 2013, and 2021. We used template analysis to identify changes over time.

Results

Over time, CBME-based curriculum design changed in several domains. Assessment changed from a model with a focus on summative decision to one with an emphasis on formative, low-stakes assessments aimed at supporting learning. The training plans evolved in parallel to evolving educational insights, e.g., by placing increasing emphasis on personal development. The curricula focused on a competency-based concept by introducing training modules and personalized authorization based on feedback rather than on a set duration of internships. There was increasing freedom in personalized training trajectories in the training plans, together with increasing trust towards the resident.

Conclusion

The way CBME was translated into training plans has evolved in the course of 17 years of experience with CMBE-based education. The main areas of change were the structure of the training plans, which became increasingly open, the degree to which learning outcomes were mandatory or not, and the way these outcomes were assessed.

Using a rapid-cycle approach to evaluate implementation of competency-based medical education in ophthalmology

OBJECTIVE

As competency-based medical education is being implemented across Canada, there is an increasing need to evaluate the progress to date, including identification of strengths and weaknesses, to inform program development. Ophthalmology is preparing for a national launch in coming years. The purpose of this study was to describe key stakeholders' lived experiences in the competency-based medical education foundation-of-discipline stage in one ophthalmology department.

DESIGN

Using a case-study approach, a qualitative rapid-cycle evaluation was conducted during the 2018-2019 academic year.

PARTICIPANTS

Residents, faculty, academic advisors, competence committee members, the program director, the program administrator, and the educational consultant were invited to participate in the program evaluation.

METHODS

The rapid-cycle evaluation consisted of 2 evaluation cycles, with the first round of interviews and focus groups occurring in October 2018 and the second round in March 2019. Recommendations were implemented in November 2019 and June 2019. All data were analyzed thematically using NVivo.

RESULTS

Three main themes emerged across all data sets: developing a shared understanding (e.g., role expectations and changes to assessment), refining assessment processes and tools (e.g., the need for streamlining and clarification), and feedback (e.g., perceived benefits and value of narrative comments).

CONCLUSIONS

Exploring lived experiences in this study resulted in positive and immediate improvements to the residency program. The recommendations and approach will be useful to other Canadian departments and institutions as they prepare for Competence by Design.

Cataract surgical training in Europe: European Board of Ophthalmology survey

PURPOSE

To survey recently graduated European ophthalmologists concerning cataract surgery (CS) training opportunities.

SETTING

Countries affiliated to the European Board of Ophthalmology (EBO).

DESIGN

Cross-sectional study of anonymous survey results.

METHODS

A 23-question online survey was emailed to candidates who sat the EBO Diploma Examination as residents between 2018 and 2022.

RESULTS

821 ophthalmologists from 30 countries completed the survey. The mean residency duration was 4.73 (SD 0.9) years. The mean reported number of entire CS procedures performed was 80.7 (SD 100.6) at the end of residency, but more than 25% of respondents (n = 210) had received no live CS training during their residency. The self-confidence (scale, 1 to 10) to perform a simple case or challenging case, manage posterior capsular rupture, and realize a corneal stitch were rated 4.1, 3.2, 4.2, 2.4, respectively. We observed extensive variation in clinical exposure to CS and self-reported confidence to perform CS between European trainees. Females reported a mean of 18% fewer entire procedures than their male colleagues and were also less confident in their surgical skills (P < .05). Trainees in residency programs longer than 5 years performed fewer procedures and were less confident than trainees in residences of shorter duration (P < .001). The importance of fellowships to complete surgical education was rated 7.7 out of 10.

CONCLUSIONS

CS training across European countries lacks harmony. Female ophthalmology trainees continue, as in other specialties, to experience apparent gender bias. European level recommendations seem necessary to raise and harmonize competency-based CS training programs and promote post-residency fellowship training programs.

Standard ophthalmology residency training in China: an evaluation of resident satisfaction on training program in Guangdong Province

BACKGROUND

National standardized training for resident doctors (STRD) in mainland China has been formally established since 2014 as a kind of postgraduate education. The purpose of this survey was to assess the satisfaction of the training residents in Guangdong Province on the ophthalmology STRD program after a duration of 5 years.

METHOD

A 48-item survey was sent to all postgraduate ophthalmology residents from bases in Guangdong Province to inquire about their attitude towards the program. The survey contained questions about demographic and work-related information, job satisfaction, psychological resilience, and job performance. All responses were verified, and invalid questionnaires were excluded. Statistical analyses were performed using SPSS software version 22.0 (SPSS, Inc., Chicago, IL). Multiple logistic regression analysis was used to evaluate the factors (demographic information, working environment, clinical exposure, supervision and hands-on training opportunities, and involvement in academic activities) impacting the overall satisfaction. P < 0.05 was considered statistically significant.

RESULTS

A total of 471/635 (74.17%) valid questionnaires were returned from all the STRD bases of Guangdong Province, which included 38 hospitals. 60.3% of the respondents reported overall satisfaction with their training. The satisfaction with operative teaching (60.7%) was slightly lower than the other settings of teaching experience (above 65%). Meanwhile, the satisfaction on different secessions of operative experience was all below 70%, of which in the areas of cornea and orbit were 55.42% and 57.53%, respectively. Some potential factors were found to affect general satisfaction, including the training grade, marriage, working time, income level, the doctor-patient relationship, family members working as doctors, the time proportion spent on writing medical documents during clinical work, and the frequency of attending academic meetings. Improvement was observed in both performing and reporting clinical examinations in the last year of training in comparison to the first year. Finally, 82.8% of the residents acknowledged this training was helpful for future clinical work. The first five career preferences for residents were cataract (67.1%), refractive surgery (42.3%), vitreo-retina (36.5%), optometry (28.7%), and oculoplastic (27.2%).

CONCLUSION

Ophthalmology residents in Guangdong Province expressed comparable satisfaction with the STRD program. To further improve satisfaction, factors such as resident subsidy, harmonious marriage, the patient-doctor relationship, and chances of attending academic conferences should be emphasized.

Face and Content Validity of an Artificial Eye Model for Secondary Intraocular Lens Fixation via Yamane Technique

Purpose

To assess the face and content validity of an artificial eye model for secondary intraocular lens (IOL) fixation via the Yamane technique.

Methods

Ophthalmologists and residents participated in a 90-minute simulation session on secondary IOL fixation via the Yamane technique. Hands-on practice of this technique was performed on an artificial eye, the Bioniko Okulo BR8. After, all ophthalmologists answered an 18-question survey assessing the face and content validity of the model. Survey responses were recorded on a 5-point double-headed Likert scale, ranging from strongly agree (1)-to-strongly disagree (5) (Figure 1).

Results

Twenty-three surveys were completed. Respondents rated the survey with a median response of 1 (strongly agree)-to-3 (neutral). Highest ratings for the model were received for "usefulness for training residents", and "easier to set up and clean-up compared to a cadaver". Lowest ratings were received for realism of the model compared to cadaveric eyes. Statistical analysis revealed no significant difference among identified groups. Ratings for face and content validity were viewed favorably, both with an overall median response of 2.00 (agree).

Conclusion

The Bioniko Okulo BR8 shows promise as a valid tool for practicing secondary IOL fixation via the Yamane technique. Considering recent guidelines in competency-based ophthalmology education programs, this model may be a valuable tool over traditional techniques for teaching and improving surgical skill amongst trainees.

Bias in Surgical Residency Evaluations: A Scoping Review

OBJECTIVE

Given widespread disparities in the surgical workforce and the advent of competency-based training models that rely on objective evaluations of resident performance, this review aims to describe the landscape of bias in the evaluation methods of residents in surgical training programs in the United States.

DESIGN

A scoping review was conducted within PubMed, Embase, Web of Science, and ERIC in May 2022, without a date restriction. Studies were screened and reviewed in duplicate by 3 reviewers. Data were described descriptively.

SETTING/PARTICIPANTS

English-language studies conducted in the United States that assessed bias in the evaluation of surgical residents were included.

RESULTS

The search yielded 1641 studies, of which 53 met inclusion criteria. Of the included studies, 26 (49.1%) were retrospective cohort studies, 25 (47.2%) were cross-sectional studies, and 2 (3.8%) were prospective cohort studies. The majority included general surgery residents (n = 30, 56.6%) and nonstandardized examination modalities (n = 38, 71.7%), such as video-based skills evaluations (n = 5, 13.2%). The most common performance metric evaluated was operative skill (n = 22, 41.5%). Overall, the majority of studies demonstrated bias (n = 38, 73.6%) and most investigated gender bias (n = 46, 86.8%). Most studies reported disadvantages for female trainees regarding standardized examinations (80.0%), self-evaluations (73.7%), and program-level evaluations (71.4%). Four studies (7.6%) assessed racial bias, of which all reported disadvantages for trainees underrepresented in surgery.

CONCLUSIONS

Evaluation methods for surgery residents may be prone to bias, particularly with regard to female trainees. Research is warranted regarding other implicit and explicit biases, such as racial bias, as well as for nongeneral surgery subspecialties.

Curriculum satisfaction of graduates of medical residency in ophthalmology

BACKGROUND

The number of ophthalmologists trained in Brazil has increased, but their satisfaction with the medical residency curriculum is unclear. The purpose of this study is to evaluate the satisfaction and self-confidence of graduates of a reference ophthalmology residency program in Brazil and to analyze whether there is a difference in these parameters among those who graduated in different decades.

METHODS

This is a cross-sectional web-based study conducted in 2022 with 379 ophthalmologists who graduated from the Faculty of Medical Sciences of the State University of Campinas (UNICAMP), Brazil. We aim to obtain data on satisfaction and self-confidence in clinical and surgical practices.

RESULTS

In total, 158 questionnaires were completed (41.68% response rate); 104 respondents completed their medical residency between 2010 and 2022, 34 between 2000 and 2009, and only 20 before 2000. Most respondents were satisfied or very satisfied with their programs (98.7%). Respondents reported insufficient exposure to low vision rehabilitation (62.7%), toric intraocular implants (60.8%), refractive surgery (55.7%), and orbital trauma surgery (84.8%), particularly among graduates before 2010. They also reported insufficient training in certain non-clinical areas, such as office management (61.4%), health insurance management (88.6%), and personnel and administration skills (74.1%). We found that respondents who graduated a long time ago had higher confidence in clinical and surgical practices.

CONCLUSIONS

Brazilian ophthalmology residents and UNICAMP graduates expressed high levels of satisfaction with their residency training programs. Those who completed the program a long time ago appear to have more confidence in clinical and surgical practices. There were clinical and non-clinical areas with insufficient training identified for improvement.

Comparative analysis of European residency programs: benchmarking and harmonizing ophthalmology training in Europe

BACKGROUND/OBJECTIVES

This study aims to benchmark the training programs of European ophthalmology residents.

SUBJECTS/METHODS

An online survey, aimed at European ophthalmology residents in training and those within two years of completion, was sent through the national representatives of the European Society of Ophthalmology, Young Ophthalmologists section (SOE-YO). The study involved 214 subjects representing 36 of the 44 European countries offering ophthalmology training programs.

RESULTS

Among the surveyed, 74.8% of participants had an official national curriculum; 55.8% had a national specialty examination to accredit their training as ophthalmologists. 45.8% were satisfied or very satisfied with the clinical skills acquired, while 42.1% were completely dissatisfied with the surgical skills achieved. Considering the 4th year residents (mean duration of the residency), many of them did not perform phacoemulsification surgery (34%), pterygium excision (46.9%), or repair of eyelid laceration (31.3%).

CONCLUSIONS

There is great heterogeneity in the competencies achieved by residents in training according to their country of origin, especially in terms of surgical competences.

Ophthalmology Residency in the United States: The Case for a National Curriculum

To identify strategies for effective curriculum development and implementation in United States (US) ophthalmology residency training programs. A literature review was conducted for all English-language PubMed/Medline articles relating to ophthalmology residency education or curriculum/curricula. Despite ACGME-defined program requirements outlining curricular goals for US ophthalmology residency training programs, there is no comprehensive, national curriculum with detailed plans for instruction of necessary topics within the 36-month residency training period. Several articles identify a need for detailed curricula on various topics, propose ideas on how residency programs could create curricula, and explore ways of assessing resident competence. There is a paucity of literature evaluating how ophthalmology residents best learn various ophthalmology topics. We need to develop an intentional, comprehensive, and timely national curriculum for ophthalmology residency programs in the US, with detailed plans on how to meet curricular objectives and consideration of the most effective teaching strategies for different ophthalmology concepts.

Review of Challenges to the Implementation of Competence by Design in Post-Graduate Medical Education: What Can Diagnostic Radiology Learn from the Experience of Other Specialty Disciplines?

Competence by Design (CBD) is a medical education initiative instituted by the Royal College of Physicians and Surgeons of Canada to improve the training of resident physicians in specialty disciplines. CBD integrates Competency Based Medical Education with traditional specialty discipline post-graduate medical education (PGME) training through the application of an organizational framework of competencies. Various specialty disciplines in Canada have transitioned to CBD since 2017 in a staggered approach. Diagnostic radiology PGME programs in Canada are expected to transition to CBD in 2022 for the incoming resident physician cohort. This article reviews potential challenges to the implementation of CBD in diagnostic radiology PGME programs and proposes evidence-informed targeted strategies and solutions to address these challenges. It is important for diagnostic radiology PGME programs to understand the challenges pertaining to the implementation of CBD so that they may be able to successfully implement this or similar medical education initiatives in their programs. Moreover, as radiology subspecialty PGME programs, such as nuclear medicine, interventional radiology, neuroradiology, and pediatric radiology, likewise transition to CBD and diagnostic radiology PGME programs internationally increasingly implement other Competency Based Medical Education models, the implications of the challenges pertaining to the implementation of CBD will further become of increasing importance.

Implementing competency-based medical education in post-graduate ophthalmology training: Understanding key concepts and methodologies and overcoming challenges

The National Medical Council (NMC) has mandated that all post-graduate training shall be competency-based, following the principles of Competency. Based Medical Education (CBME). This aims to serve the dual purpose of standardizing ophthalmology post-graduate training and to overcome the shortcomings of the traditional curriculum by employing innovative and interactive teaching-learning and assessment techniques to produce competent ophthalmologists well equipped with clinical, surgical, and professional skills relevant to current times. CBME marks a paradigm shift from traditional curriculum methodologies and involves the introduction of several new concepts. This article aims to highlight the key principles of CBME and the various teaching-learning and assessment technique methodologies which can be employed for post-graduate training. It also highlights the various challenges that are likely to be faced in its implementation and measures to overcome them.

Developing a best practice framework for clinical competency education in the traditional East-Asian medicine curriculum

BACKGROUND

While clinical competency is crucial for traditional East-Asian medical education, available studies on the educational system for fostering clinical performance are scarce. This study aimed to review the educational system, curriculum, facilities, and management of current traditional East-Asian medicine in a well-established university of Korea and develop a Best Practice Framework (BPF) of clinical competency education.

METHODS

The clinical competency education system in Pusan National University School of Korean Medicine was systematically described through 5 steps of governance of the educational system, competency of the graduates, educational resources, assessment strategies and tools, and gaps in the curriculum. We also reviewed the experiences in education and the points to be improved.

RESULTS

The Office of Traditional Korean Medicine Education governs the development, implementation, and evaluation of the educational curriculum for cultivating students' clinical competency. Medical students have undertaken 39 modules of clinical biomedicine and 21 of traditional medicine during the clinical clerkship courses in an affiliated hospital, Clinical Skill Practice Center, clinical research center, practice lab for medical herb, and other locations. After training, 15 modules of simulated clinical training using standardized patients, students' clinical competency are evaluated by a Clinical Performance Test using a Clinical Performance Examination (CPX) and an Objective Structured Clinical Examination (OSCE) for biomedical and traditional medical skills.

CONCLUSIONS

A clinical competency framework is required for a qualified physician of traditional East-Asian medicine. This study reviewed the current well-organized educational system of Korean traditional medicine in detail, which can be used for the BPF of competency-based clinical education. We expect the current study to be a representative reference for establishing an educational system of traditional medicine such as acupuncture and medical herbs in other countries.

An update on the novel approaches towards skills assessment of ophthalmology residents in the Indian scenario

An essential part of the teaching-learning paradigm is assessment. It is one of the ways to achieve feedback for the various methods that have been used to impart a particular skill. This is true of ophthalmology training, where various clinical and surgical skills are learned as part of the residency program. In preparation for residents to become proficient ophthalmologists, both formative and summative assessments are of paramount importance. At present, assessment is primarily summative in the form of a university examination, including theory and practical examinations that are conducted at the end of the three years of residency. A formative assessment can make course corrections early on, allowing for an improved understanding of the subject and the acquisition of clinical and surgical skills. Formative assessments also allow us to customize the teaching methodology considering individual residents’ learning capabilities. In addition, formative assessments have the advantage of alleviating the stress of a “final” examination, which could sometimes result in a less-than-optimum performance by the residents. The COVID-19 pandemic has forced us to adopt new teaching methods, which has led to the adoption of changes in assessment. In this regard, we discuss the different assessment tools available, their pros and cons, and how best these tools can be made applicable in the setting of an ophthalmology residency program.