A blinded, multirater and multi-institutional study evaluating the Objective Structured Assessment of Technical Skills (OSATS) tool in dermatology education

Assessment of laparoscopic intracorporeal intestinal anastomosis training using simulation-based 3D printed models: exploring surgical performance and learning curves

BACKGROUND AND AIMS

Intestinal anastomosis is a clinical procedure widely used to reconstruct the digestive tract, but authentic laparoscopic intracorporeal intestinal anastomosis (LIIA) models are lacking. However, three-dimensional (3D) printing can enable authentic and reusable models. In this paper, a novel cost-effective 3D-printing training model of LIIA is designed and the authenticity and validity of the model are tested.

METHODS

A fused deposition modeling 3D printing and an assembled lab model were built to test LIIA. Fifteen surgeons were required to perform LIIA, and their operation score and time were recorded and analyzed. Five experts were invited to assess the face and content validity of the models. A study was also performed to further evaluate and validate the learning curve of surgeons.

RESULTS

The difference in modified anastomosis objective structured assessment of technical skills (MAOSATS) scores between the expert, intermediate, and novice groups were significant (64.1±1.8: 48.5±1.7: 29.5±3.1, P <0.001). In addition, the operation time of the procedure was statistically different for all three groups (21.5±1.9: 30.6±2.8:70.7±4.0, P<0.001 ). The five experts rated the face and content validity of the model very highly, with the median being four out of five. Surgeons who underwent repeated training programs showed improved surgical performance. After eight training sessions, the novices' performance was similar to that of the average level of untrained intermediates, while the operation scores of the intermediates were close to that of the average level of experts.

CONCLUSIONS

In this study, it is found that the LIIA model exhibits excellent face, content, and construct validity. Repeated simulation training of the LIIA training program improved the surgeon's operative performance, so the model is considered one of the most effective methods for LIIA training and assessment of surgical quality in the future and for reducing healthcare costs.

Development and evaluation of a portable and soft 3D-printed cast for laparoscopic choledochojejunostomy model in surgical training

BACKGROUND

Laparoscopic choledochojejunostomy (LCJ) is an essential basic skill for biliary surgeons. Therefore, we established a convenient and effective LCJ 3D printing model to evaluate whether the model could simulate the actual operation situation and determine its effectiveness and validity in surgical training.

METHODS

A 3D printing dry laboratory model was established to simulate LCJ. The face and content validity of the model were evaluated by six experienced biliary surgeons based on 5-point Likert scale questionnaires. A total of 15 surgeons with different levels of experience performed LCJ on the model and evaluated the structural validity of the model using the objective structured assessment of technical skills (OSATS). Simultaneously, the operation time of each surgery was also recorded. A study was also performed to further evaluate the learning curve of residents.

RESULTS

The operating space score of the model was 4.83 ± 0.41 points. The impression score of bile duct and intestinal canal was 4.33 ± 0.52 and 4.17 ± 0.41 points, respectively. The tactile sensation score of bile duct suture and intestinal canal suture was 4.00 ± 0.63 and 3.83 ± 0.41points, respectively. The OSATS score for model operation in the attending group was 29.20 ± 0.45 points, which was significantly higher than that in the fellow group (26.80 ± 1.10, P = 0.007) and the resident group (19.80 ± 1.30, P < 0.001). In addition, there was a statistical difference in operation time among surgeons of different experience levels (P < 0.05). Residents could significantly improve the surgical score and shorten the time of LCJ through repeated training.

CONCLUSIONS

The 3D printing LCJ model can simulate the real operation scenes and distinguish surgeons with different levels of experience. The model is expected to be one of the training methods for biliary tract surgery in the future.

Effectivity of Distance Learning in the Training of Basic Surgical Skills—A Randomized Controlled Trial

Background: Distance learning is an interactive way of education when teachers and students are physically separated. Our purpose was to examine its effectivity in training of basic surgical techniques and to provide an alternative sustainable methodology for the training of medical professionals. Methods: Sixty students were involved in our single blinded randomized controlled study. Six homogenized groups were created then randomized into three groups of distance learning and three groups of in-person teaching. The groups completed the same curriculum using our own “SkillBox”. All students took the same pre- and post-course test evaluated blindly. The students filled out an online feedback form after the course. A financial analysis was also made. Results: There was no significant difference in the post-course exam results (distance 28.200 vs. in-person 25.200). We managed to achieve significantly better improvements in the distance learning of suturing (distance 19.967 vs. in-person 15.900, p = 0.043). According to 93% of the study group students, the quality of teaching did not decrease compared to the traditional classes. Conclusion: The results of the students improved similarly in distance learning and in-person education. The online form of teaching was received positively among the students; they found it an effective and good alternative.