Ophthalmic simulated surgical competency assessment rubric (Sim-OSSCAR) for trabeculectomy

Skills assessment after a grape-based microsurgical course for ophthalmology residents: randomised controlled trial

AIMS

To introduce and assess a course using grapes as training models for ophthalmology residents to acquire basic microsurgical skills.

METHODS

Ophthalmology residents who were novices at microsurgery were included. Participants were randomised into a 1:1 ratio to a 4-hour training programme based on fruit models (group A) or virtual reality (VR) modulator and silicone suture pads (group B), respectively. Before and after training, questionnaires were designed to measure their self-confidence with ophthalmic operations and with their coming role as surgical assistants. After training, each participant provided their interest in further studying microsurgery and was assessed for their general competence of ophthalmic microsurgery on porcine eyes.

RESULTS

Eighty-three participants were included, with 42 ones in group A and 41 ones in group B. After training, participants in group A performed better in the uniformities of the suture span (p<0.05), suture thickness (p<0.05) and tissue protection (p<0.05) during the corneal suturing assessment. The overall scores of corneal suturing and circular capsulorhexis in the porcine eye in group A were comparable to those in group B (p=0.26 and 0.87, respectively). Group A showed a more positive attitude to withstand the training for more than 4 hours (p<0.001), as well as a higher willingness to receive more times of the training in the future (p<0.001).

CONCLUSIONS

Training models based on grapes are equal to VR simulators and silicon suture pads to provide solid training tasks for ophthalmology residents to master basic microsurgical skills, and might have advantages in lower economic cost, and easy availability.

TRIAL REGISTRATION NUMBER

ChiCTR2000040439.

The Impact of Simulation-Based Trabeculectomy Training on Resident Core Surgical Skill Competency

PRCIS

Simulation-based surgical education shows a positive, immediate, and sustained impact on core surgical skill competency in trabeculectomy among resident ophthalmologists in training.

PURPOSE

To measure the impact of trabeculectomy, surgical simulation training on core surgical skill competency in resident ophthalmologists.

MATERIALS AND METHODS

This is a post hoc analysis of the GLAucoma Simulated Surgery trial, which is a multicenter, multinational randomized controlled trial. Resident ophthalmologists from 6 training centers in sub-Saharan Africa (in Kenya, Uganda, Tanzania, Zimbabwe, and South Africa) were recruited according to the inclusion criteria of having performed zero surgical trabeculectomies and assisted in <5. Participants were randomly assigned to intervention and control arms using allocation concealment. The intervention was a 1-week intensive trabeculectomy surgical simulation course. Outcome measures were mean surgical competency scores in 8 key trabeculectomy surgical skills (scleral incision, scleral flap, releasable suturing, conjunctival suturing, sclerostomy, tissue handling, fluidity, and speed), using a validated scoring tool.

RESULTS

Forty-nine residents were included in the intention-to-treat analysis. Baseline characteristics were balanced between arms. Median baseline surgical competency scores were 2.88/16 [interquartile range (IQR): 1.75-4.17] and 3.25/16 (IQR: 1.83-4.75) in the intervention and control arms, respectively. At primary intervention, median scores increased to 11.67/16 (IQR: 9.58-12.63) and this effect was maintained at 3 months and 1 year ( P =0.0001). Maximum competency scores at primary intervention were achieved in the core trabeculectomy skills of releasable suturing (n=17, 74%), scleral flap formation (n=16, 70%), and scleral incision (n=15, 65%) compared with scores at baseline.

CONCLUSIONS

This study demonstrates the positive impact of intensive simulation-based surgical education on core trabeculectomy skill development. The rapid and sustained effect of resident skill acquisition pose strong arguments for its formal integration into ophthalmic surgical education.

Theoretical Frameworks in Medical Education: Using a Systematic Review of Ophthalmology Education Research to Create a Theory of Change Model

BACKGROUND

Theoretical frameworks provide a lens to examine questions and interpret results; however, they are underutilized in medical education.

OBJECTIVE

To systematically evaluate the use of theoretical frameworks in ophthalmic medical education and present a theory of change model to guide educational initiatives.

METHODS

Six electronic databases were searched for peer-reviewed, English-language studies published between 2016 and 2021 on ophthalmic educational initiatives employing a theoretical framework. Quality of studies was assessed using the Grading of Recommendations, Assessment, Development, and Evaluations (GRADE) approach; risk of bias was evaluated using the Medical Education Research Study Quality Instrument (MERSQI) and the Accreditation Council for Graduate Medical Education (ACGME) guidelines for evaluation of assessment methods. Abstracted components of the included studies were used to develop a theory of change model.

RESULTS

The literature search yielded 1661 studies: 666 were duplicates, 834 studies were excluded after abstract review, and 132 after full-text review; 29 studies (19.2%) employing a theoretical framework were included. The theories used most frequently were the Dreyfus model of skill acquisition and Messick's contemporary validity framework. GRADE ratings were predominantly "low," the average MERSQI score was 10.04, and the ACGME recommendation for all assessment development studies was the lowest recommendation. The theory of change model outlined how educators can select, apply, and evaluate theory-based interventions.

CONCLUSIONS

Few ophthalmic medical education studies employed a theoretical framework; their overall rigor was low as assessed by GRADE, MERSQI, and ACGME guidelines. A theory of change model can guide integration of theoretical frameworks into educational initiatives.

Angle Examination Gonioscopy and Minimally Invasive Glaucoma Surgical Training on Human Eyes in Wet Lab

PURPOSE

To understand the feasibility, utility and efficacy of a low-cost model for performing anterior chamber angle gonioscopy and micro-surgery on human corneo-scleral tissues in wet lab on resident skill enhancement.

METHODS

Post-keratoplasty residual corneo-scleral rims and/or the expired donor corneo-scleral buttons were included for the purpose of this study. Initially, inverted rims were used to demonstrate the basic angle anatomy on a slit lamp bio-microscope. Central hazy cornea was then replaced with an artificial cornea and an artificial anterior chamber to simulate indirect gonioscopy, direct gonioscopy, goniotomy and other angle-based surgeries. Direct gonioscopy and goniotomy exercises (as a means to simulate intra-operative gonioscopy and other angle-based surgeries respectively) were evaluated quantitatively, and the rest qualitatively.

RESULTS

A total of 65 residents were included in the exercise. The mean age was 26.69±1.74 years. Amongst these, 55 ophthalmology residents performed the basic examination, that is, slit lamp mounted angle anatomy examination (n=55) and artificial chamber mounted indirect gonioscopic examination through artificial cornea (n=55). In the second exercise, 10 glaucoma fellows performed the direct gonioscopic and the goniotomy exercises on artificial chamber. The fellows demonstrated a statistically significant improvement in interpretation and surgical skill enhancement concurrent with reduction in time taken with increasing number of attempts (P<0.05). In the third simulation exercise, micro-stent placement within the Schlemm's canal, sub-conjunctival space, and the supra-choroidal space was re-produced successfully on multiple occasions.

CONCLUSIONS

The residual human corneo-scleral rims proved to be an important resource for teaching both the basic examination skills as well as those required for transitioning to advanced intraoperative gonioscopy and goniotomy skills. These low cost, easy to adapt models can be incorporated within the curriculum for improved glaucoma training of both the residents and the glaucoma fellows.

Experiences and Perceptions of Ophthalmic Simulation-Based Surgical Education in Sub-Saharan Africa

BACKGROUND

Simulation-based surgical education (SBSE) can positively impact trainee surgical competence. However, a detailed qualitative study of the role of simulation in ophthalmic surgical education has not previously been conducted.

OBJECTIVE

To explore the experiences of trainee ophthalmologists and ophthalmic surgeon educators' use of simulation, and the perceived challenges in surgical training.

METHODS

A multi-center, multi-country qualitative study was conducted between October 2017 and August 2020. Trainee ophthalmologists from six training centers in sub-Saharan Africa (SSA) (in Kenya, Uganda, Tanzania, Zimbabwe and South Africa) participated in semi-structured interviews, before and after an intense simulation training course in intraocular surgery. Semi-structured interviews were also conducted with experienced ophthalmic surgeon educators. Interviews were anonymized, recorded, transcribed and coded. An inductive, bottom-up, constant comparative method was used for thematic analysis.

RESULTS

Twenty-seven trainee ophthalmologists and 12 ophthalmic surgeon educators were included in the study and interviewed. The benefits and challenges of conventional surgical teaching, attributes of surgical educators, value of simulation in training and barriers to implementing ophthalmic surgical simulation were identified as major themes. Almost all trainees and trainers reported patient safety, a calm environment, the possibility of repetitive practice, and facilitation of reflective learning as beneficial aspects of ophthalmic SBSE. Perceived barriers in surgical training included a lack of surgical cases, poor supervision and limited simulation facilities.

CONCLUSIONS

Simulation is perceived as an important and valuable model for education amongst trainees and ophthalmic surgeon educators in SSA. Advocating for the expansion and integration of educationally robust simulation surgical skills centers may improve the delivery of ophthalmic surgical education throughout SSA.

Simulation-based surgical education for glaucoma versus conventional training alone: the GLAucoma Simulated Surgery (GLASS) trial. A multicentre, multicountry, randomised controlled, investigator-masked educational intervention efficacy trial in Kenya, South Africa, Tanzania, Uganda and Zimbabwe

Background/Aim

Glaucoma accounts for 8% of global blindness and surgery remains an important treatment. We aimed to determine the impact of adding simulation-based surgical education for glaucoma.

Methods

We designed a randomised controlled, parallel-group trial. Those assessing outcomes were masked to group assignment. Fifty-one trainee ophthalmologists from six university training institutions in sub-Saharan Africa were enrolled by inclusion criteria of having performed no surgical trabeculectomies and were randomised. Those randomised to the control group received no placebo intervention, but received the training intervention after the initial 12-month follow-up period. The intervention was an intense simulation-based surgical training course over 1 week. The primary outcome measure was overall simulation surgical competency at 3 months.

Results

Twenty-five were assigned to the intervention group and 26 to the control group, with 2 dropouts from the intervention group. Forty-nine were included in the final intention-to-treat analysis. Surgical competence at baseline was comparable between the arms. This increased to 30.4 (76.1%) and 9.8 (24.4%) for the intervention and the control group, respectively, 3 months after the training intervention for the intervention group, a difference of 20.6 points (95% CI 18.3 to 22.9, p<0.001). At 1 year, the mean surgical competency score of the intervention arm participants was 28.6 (71.5%), compared with 11.6 (29.0%) for the control (difference 17.0, 95% CI 14.8 to 19.4, p<0.001).

Conclusion

These results support the pursuit of financial, advocacy and research investments to establish simulation surgery training units and courses including instruction, feedback, deliberate practice and reflection with outcome measurement to enable trainee glaucoma surgeons to engage in intense simulation training for glaucoma surgery.

Trial registration number

PACTR201803002159198.

Face and content validity of an artificial eye model for Ab-Interno Goniotomy

PURPOSE

To determine the face and content validity of an artificial eye model for ab-interno goniotomy (SimulEYE KDB model, InsEYEt, Westlake Village, CA) by surveying ophthalmologists with varying experience using a Kahook Dual Blade (KDB; New World Medical, Rancho Cucamonga, CA, USA) following a 90-min wet-lab course using the model.

PARTICIPANTS

Overall 13 ophthalmologists participated following a surgical simulation session on goniotomy using the goniotomy blade at the 2019 Canadian Ophthalmological Society annual meeting.

METHODS

A 17-question survey to assess the face and content validity of the model was given immediately following the surgical simulation session on goniotomy using the goniotomy blade. Responses to each survey question were recorded on a 5-point Likert scale ranging from (1) strongly agree to (5) strongly disagree.

RESULTS

Respondents rated statements regarding the model with a median response of 1 (Strongly Agree) to 3 (Neither agree or disagree). Mann-Whitney U nonparametric analysis revealed no significant difference in responses between instructor vs. non-instructor or between prior experience vs. no prior experience for any of the survey statements. The model received highest survey ratings for utility in training residents, acquisition of surgical skills, accessibility, and higher likelihood of success with the procedure than theory and observation alone. Lowest ratings were for realism of the model compared to a human cadaveric eye.

CONCLUSION

Our results suggest the SimulEYE KDB model is a reasonably cost-effective solution for simulating angle-based surgeries. Additionally, our project shows that experienced ophthalmologists found the artificial eye models useful and helpful for angle-based surgery training.