Construct Validity and Experience of Using a Low-cost Arthroscopic Knee Surgery Simulator

Construct Validity and Experience of Using a Low-cost Arthroscopic Shoulder Surgery Simulator

Objective  To validate the low-cost model for arthroscopy training and analyze the acceptance and usefulness of the developed simulator in medical teaching and training. Method  Ten medical students, ten third-year orthopedic residents, and ten shoulder surgeons performed predetermined tasks on a shoulder simulator twice. The parameters used were time to complete the tasks, number of looks at the hands, GOALS score (Global Operative Assessment of Laparoscopic Skills) and comparison between groups and within groups. An adapted Likert scale was applied addressing the individuals' impressions about the simulator and its applicability. Results  In the intergroup comparison, the shoulder surgeons had better scores and times than the other groups. When the tasks were repeated, the group of surgeons had a 59% improvement in time (p < 0.05), as did the group of medical students. In the GOALS score, shoulder surgeons had consistently better scores than the other groups. And when we evaluated the evolution from the first to the second test, the group of surgeons and the group of academics had a statistically significant improvement (p < 0.05). In terms of lookdowns, there was a decrease in all groups. There was consensus that the simulator is useful in training. Conclusion  The simulator developed allowed the differentiation between individuals with different levels of training in arthroscopic surgery. It was accepted by 100% of the participants as a useful tool in arthroscopic shoulder surgical training.

Simulation training to retool practicing orthopedic surgeons is rare

Purpose

Modern surgical practice is continuously changing as technology develops. New techniques are often implemented after a surgeon has made the transition to independent clinical practice. There is therefore a need to 'retool' technical skills. Additionally, practicing surgeons must maintain and develop skills such as leadership, communication, critical thinking, teaching, and mentoring. Our aim was to perform a scoping review to assess the current status of simulation education for practicing Orthopedic Surgeons (OS).

Methods

A 10 year search of PubMed, ERIC, and Web of Science was performed with a medical librarian. Controlled vocabulary Medical Subject Headings terms and natural language were developed with subject matter experts describing simulation, training and OS. Two trained reviewers evaluated all abstracts for inclusion. Exclusion criteria were articles that did not assess simulation education involving practicing OS. Data were extracted from the included full text articles by two reviewers: details of study design, type of participants, type of simulation and role of OS in the educational event.

Results

Initial search identified 1824 articles of which 443 were duplicates, and 1381 articles were further screened. Of these, 1155 were excluded, 226 full text articles were assessed for eligibility and 80 included in analysis. Most were published in the last 6 years and from the United States. The majority (99%) described technical skill simulations (arthroscopy 56%, screw placement 23%, ligament reconstruction 19%). OS were rarely the only learners with 91% studies also having residents participate. OS were the targeted learner in 6% studies. OS provided content validity for 15 (19%) and construct validity in 59 (74%) studies.

Conclusions

Simulation training to educate practicing OS is rare. OS are often used to validate work rather than being the center of an educational endeavor. A refocusing is needed to provide adequate training for practicing surgeons to retool skills as new techniques become available.

Validation of an endoscopic flavectomy training model

OBJECTIVE

to validate a lumbar spine endoscopic flavectomy simulator using the construct method and to assess the acceptability of the simulator in medical education.

METHODS

thirty medical students and ten video-assisted surgery experienced orthopedists performed an endoscopic flavectomy procedure in the simulator. Time, look-downs, lost instruments, respect for the stipulated edge of the ligamentum flavum, regularity of the incision, GOALS checklist (Global Operative Assessment of Laparoscopic Skills), and responses to the Likert Scale adapted for this study were analyzed.

RESULTS

all variables differed between groups. Procedure time was shorter in the physician group (p < 0.001). Look-downs and instrument losses were seven times greater among students than physicians. Half of the students respected the designated incision limits, compared to 80% of the physicians. In the student group, about 30% of the incisions were regular, compared to 100% in the physician group (p < 0.001). The physicians performed better in all GOALS checklist domains. All the physicians and more than 96% of the students considered the activity enjoyable, and approximately 90% believed that the model was realistic and could contribute to medical education.

CONCLUSIONS

the simulator could differentiate the groups' experience level, indicating construct validity, and both groups reported high acceptability.