Educational system based on the TAPP checklist improves the performance of novices: a multicenter randomized trial

Development of a systematic telesimulation curriculum for laparoscopic inguinal hernia repair

Purpose

Telesimulation, whereby learners telecommunicate and use simulator resources to receive education at an off-site location, has been used to educate surgical trainees about how to perform basic surgical procedures. However, it has not yet been used for advanced surgical procedures. We aimed to develop a telesimulation curriculum to teach a common laparoscopic procedure called transabdominal preperitoneal (TAPP) repair and to explore the feasibility of its use.

Methods

Learning objectives were created to develop a telesimulation curriculum that included didactic telelecture and telesimulation training. Pre-tests and post-tests to assess the didactic materials were developed and assessed among surgeons with various experiences. We assessed the feasibility of the telelecture and telesimulation separately. Pre-tests, post-tests, and questionnaires were used to assess the telelectures. We created a TAPP repair telesimulation system and checked for problems during training. Trainees were assessed to determine their skill improvement using previously published assessment tools and questionnaires.

Results

A didactic telelecture was developed based on the learning objectives using an expert consensus and pilot-tested among five participants. After the lecture, their test scores improved and they expressed positive opinions about the usefulness of telelectures. The TAPP repair telesimulation training was pilot-tested among three trainees. No technical problems occurred during training. All trainees improved their skills after the telesimulation training and agreed that the training was useful for learning the TAPP repair procedure.

Conclusions

We systematically developed a telesimulation curriculum for the TAPP repair procedure and demonstrated its feasibility among learners.

Identifying the Essential Portions of the Skill Acquisition Process Using Item Response Theory

OBJECTIVE

Item response theory (IRT) was originally developed to make performance assessments more accurate. However, IRT analysis of the intraoperative performance of surgical trainees could help identify the elements that the trainees find difficult during the skill acquisition process. The aim of this study was to identify the essential portions of the skill acquisition process of a surgical procedure using the IRT.

DESIGN

The 24-item assessment checklist was used to evaluate a recorded intra-operative performance of a laparoscopic inguinal hernia repair. The scores were analyzed using IRT to calculate the difficulty and discrimination level of each item.

SETTING

Fifteen institutes.

PARTICIPANTS

Thirty surgical trainees.

RESULTS

A total of 123 assessments were analyzed. The item analysis showed the procedure specific item "traction of peritoneum (difficulty: -0.45; discrimination: 19.37)" and generic items "instrument handling (difficulty: -0.59; discrimination: 3.82)" and "flow of procedure (difficulty: 0.09; discrimination: 3.27)" to be key elements in the skill acquisition process of the procedure.

CONCLUSIONS

Key elements in the skill acquisition process of the procedure were quantitatively identified by applying the IRT analysis. This could lead to the use of IRT in designing and developing a more effective training curriculum.