Development and initial validation of a video-based peroral endoscopic myotomy assessment tool

BACKGROUND AND AIMS

Video analysis has emerged as a potential strategy for performance assessment and improvement. We aimed to develop a video-based skill assessment tool for peroral endoscopic myotomy (POEM).

METHODS

POEM was deconstructed into basic procedural components through video analysis by an expert panel. A modified Delphi approach and 2 validation exercises were conducted to refine the POEM assessment tool (POEMAT). Twelve assessors used the final POEMAT version to grade 10 videos. Fully crossed generalizability (G) studies investigated the contributions of assessors, endoscopists' performance, and technical elements to reliability. G coefficients below .5 were considered unreliable, between .5 and .7 as modestly reliable, and above .7 as indicative of satisfactory reliability.

RESULTS

After task deconstruction, discussions, and the modified Delphi process, the final POEMAT comprised 9 technical elements. G analysis showed low variance for endoscopist performance (.8%-24.9%) and high interrater variability (range, 63.2%-90.1%). The G score was moderately reliable (≥.60) for "submucosal tunneling" and "myotomy" and satisfactorily reliable (≥.70) for "active hemostasis" and "mucosal closure."

CONCLUSIONS

We developed and established initial content and response process validity evidence for the POEMAT. Future steps include appraisal of the tool using a wider range of POEM videos to establish and improve the discriminative validity of this tool.

Endoscopic submucosal dissection for superficial esophageal cancer

Endoscopic submucosal dissection (ESD) has evolved into a viable treatment modality for superficial esophageal cancer. ESD offers a distinct advantage given the ability to perform en bloc resection enabling accurate histopathologic assessment. Data from published literature has established ESD as the preferred option in the treatment of superficial squamous cell carcinoma with complete resection rates of 78-100%, and a low rate recurrence of 0-2.6%. En bloc resection for esophageal SCC is curative for tumors with M1 (intrapethelial) or M2 (invasion into the lamina propria) involvement with no lymphovascular invasion. Tumors that contain lymphovascular invasion or submucosal invasion greater than 200 μm should be treated as advanced carcinomas due to the increased risk of lymph node metastasis. In contrast, the role of ESD in Barrett's esophagus is more limited due to the high rate of efficacy of EMR. A randomized control trial comparing EMR and ESD strategies found a higher R0 resection rate for ESD, but no significant difference in complete remission from neoplasia at 3 month follow up. Endoscopic ultrasound (EUS) has a limited role in the evaluation of superficial esophageal cancer. Alternatively, detailed endoscopic assessment along with magnification endoscopy or narrow band imaging, may provide greater utility than EUS. The most common adverse events of ESD in the esophagus include perforation and stricture. Perforation can often be managed by defect closure along with non-operative conservative management. Steroid administration with either topical or local injection can be effective management in stricture prevention. Continued refinement of ESD technique and innovation will overcome some of the current limitations of ESD and enable curative resection of superficial esophageal cancer as an alternative to invasive surgery.