1
|
Ketel MHM, Klarenbeek BR, Eddahchouri Y, Cheong E, Cuesta MA, van Daele E, Ferri LE, Gisbertz SS, Gutschow CA, Hubka M, Hölscher AH, Law S, Luyer MDP, Merritt RE, Morse CR, Mueller CL, Nieuwenhuijzen GAP, Nilsson M, Pattyn P, Shen Y, van den Wildenberg FJH, Abma IL, Rosman C, van Workum F. A Video-Based Procedure-Specific Competency Assessment Tool for Minimally Invasive Esophagectomy. JAMA Surg 2024; 159:297-305. [PMID: 38150247 PMCID: PMC10753443 DOI: 10.1001/jamasurg.2023.6522] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2023] [Accepted: 09/11/2023] [Indexed: 12/28/2023]
Abstract
Importance Minimally invasive esophagectomy (MIE) is a complex procedure with substantial learning curves. In other complex minimally invasive procedures, suboptimal surgical performance has convincingly been associated with less favorable patient outcomes as assessed by peer review of the surgical procedure. Objective To develop and validate a procedure-specific competency assessment tool (CAT) for MIE. Design, Setting, and Participants In this international quality improvement study, a procedure-specific MIE-CAT was developed and validated. The MIE-CAT contains 8 procedural phases, and 4 quality components per phase are scored with a Likert scale ranging from 1 to 4. For evaluation of the MIE-CAT, intraoperative MIE videos performed by a single surgical team in the Esophageal Center East Netherlands were peer reviewed by 18 independent international MIE experts (with more than 120 MIEs performed). Each video was assessed by 2 or 3 blinded experts to evaluate feasibility, content validity, reliability, and construct validity. MIE-CAT version 2 was composed with refined content aimed at improving interrater reliability. A total of 32 full-length MIE videos from patients who underwent MIE between 2011 and 2020 were analyzed. Data were analyzed from January 2021 to January 2023. Exposure Performance assessment of transthoracic MIE with an intrathoracic anastomosis. Main Outcomes and Measures Feasibility, content validity, interrater and intrarater reliability, and construct validity, including correlations with both experience of the surgical team and clinical parameters, of the developed MIE-CAT. Results Experts found the MIE-CAT easy to understand and easy to use to grade surgical performance. The MIE-CAT demonstrated good intrarater reliability (range of intraclass correlation coefficients [ICCs], 0.807 [95% CI, 0.656 to 0.892] for quality component score to 0.898 [95% CI, 0.846 to 0.932] for phase score). Interrater reliability was moderate (range of ICCs, 0.536 [95% CI, -0.220 to 0.994] for total MIE-CAT score to 0.705 [95% CI, 0.473 to 0.846] for quality component score), and most discrepancies originated in the lymphadenectomy phases. Hypothesis testing for construct validity showed more than 75% of hypotheses correct: MIE-CAT performance scores correlated with experience of the surgical team (r = 0.288 to 0.622), blood loss (r = -0.034 to -0.545), operative time (r = -0.309 to -0.611), intraoperative complications (r = -0.052 to -0.319), and severe postoperative complications (r = -0.207 to -0.395). MIE-CAT version 2 increased usability. Interrater reliability improved but remained moderate (range of ICCs, 0.666 to 0.743), and most discrepancies between raters remained in the lymphadenectomy phases. Conclusions and Relevance The MIE-CAT was developed and its feasibility, content validity, reliability, and construct validity were demonstrated. By providing insight into surgical performance of MIE, the MIE-CAT might be used for clinical, training, and research purposes.
Collapse
Affiliation(s)
- Mirte H. M. Ketel
- Department of Surgery, Radboud University Medical Center, Nijmegen, the Netherlands
| | | | - Yassin Eddahchouri
- Department of Surgery, Radboud University Medical Center, Nijmegen, the Netherlands
| | - Edward Cheong
- The PanAsia Surgery Group, Mount Elizabeth Hospital, Singapore
| | - Miguel A. Cuesta
- Department of Surgery, Amsterdam University Medical Centers, Location VUmc, Amsterdam, the Netherlands
| | - Elke van Daele
- Department of Gastrointestinal Surgery, Ghent University Hospital, Ghent, Belgium
| | - Lorenzo E. Ferri
- Department of Surgery, McGill University Health Centre, Montreal General Hospital, Montreal, Quebec, Canada
| | - Suzanne S. Gisbertz
- Amsterdam UMC location University of Amsterdam, Surgery, Amsterdam, the Netherlands
- Cancer Center Amsterdam, Cancer Treatment and Quality of Life, Amsterdam, the Netherlands
| | - Christian A. Gutschow
- Department of Surgery and Transplantation, University Hospital Zurich, Zurich, Switzerland
| | - Michal Hubka
- Department of Thoracic Surgery, Virginia Mason Medical Center, Seattle, Washington
| | - Arnulf H. Hölscher
- Department for General, Visceral and Trauma Surgery, Elisabeth-Krankenhaus-Essen GmbH, Essen, Germany
| | - Simon Law
- Department of Surgery, Queen Mary Hospital, School of Clinical Medicine, The University of Hong Kong, Hong Kong
| | - Misha D. P. Luyer
- Department of Surgery, Catharina Hospital, Eindhoven, the Netherlands
| | - Robert E. Merritt
- Department of Surgery, Ohio State University Wexner Medical Center, Columbus
| | | | - Carmen L. Mueller
- Department of Surgery, McGill University Health Centre, Montreal General Hospital, Montreal, Quebec, Canada
| | | | - Magnus Nilsson
- Department of Clinical Science, Intervention and Technology, Karolinska Institutet, Stockholm, Sweden
- Department of Upper Abdominal Diseases, Karolinska University Hospital, Stockholm, Sweden
| | - Piet Pattyn
- Department of Gastrointestinal Surgery, Ghent University Hospital, Ghent, Belgium
| | - Yaxing Shen
- Department of Thoracic Surgery, Zhongshan Hospital, Fudan University, Shanghai, China
| | | | - Inger L. Abma
- IQ Healthcare, Radboud University Medical Center, Nijmegen, the Netherlands
| | - Camiel Rosman
- Department of Surgery, Radboud University Medical Center, Nijmegen, the Netherlands
| | - Frans van Workum
- Department of Surgery, Radboud University Medical Center, Nijmegen, the Netherlands
- Department of Surgery, Canisius-Wilhelmina Hospital, Nijmegen, the Netherlands
| |
Collapse
|
2
|
Grüter AAJ, Toorenvliet BR, Belgers EHJ, Belt EJT, van Duijvendijk P, Hoff C, Hompes R, Smits AB, van de Ven AWH, van Westreenen HL, Bonjer HJ, Tanis PJ, Tuynman JB. Nationwide standardization of minimally invasive right hemicolectomy for colon cancer and development and validation of a video-based competency assessment tool (the Right study). Br J Surg 2024; 111:znad404. [PMID: 38103184 PMCID: PMC10763527 DOI: 10.1093/bjs/znad404] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2023] [Accepted: 11/16/2023] [Indexed: 12/17/2023]
Abstract
BACKGROUND Substantial variation exists when performing a minimally invasive right hemicolectomy (MIRH) due to disparities in training, expertise and differences in implementation of innovations. This study aimed to achieve national consensus on an optimal and standardized MIRH technique for colon cancer and to develop and validate a video-based competency assessment tool (CAT) for MIRH. METHOD Statements covering all elements of MIRH were formulated. Subsequently, the Delphi technique was used to reach consensus on a standardized MIRH among 76 colorectal surgeons from 43 different centres. A CAT was developed based on the Delphi results. Nine surgeons assessed the same 12 unedited full-length videos using the CAT, allowing evaluation of the intraclass correlation coefficient (ICC). RESULTS After three Delphi rounds, consensus (≥80% agreement) was achieved on 23 of the 24 statements. Consensus statements included the use of low intra-abdominal pressure, detailed anatomical outline how to perform complete mesocolic excision with central vascular ligation, the creation of an intracorporeal anastomosis, and specimen extraction through a Pfannenstiel incision using a wound protector. The CAT included seven consecutive steps to measure competency of the MIRH and showed high consistency among surgeons with an overall ICC of 0.923. CONCLUSION Nationwide consensus on a standardized and optimized technique of MIRH was reached. The CAT developed showed excellent interrater reliability. These achievements are crucial steps to an ongoing nationwide quality improvement project (the Right study).
Collapse
Affiliation(s)
- Alexander A J Grüter
- Department of Surgery, Amsterdam UMC location Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
- Treatment and Quality of Life, Cancer Center Amsterdam, Amsterdam, The Netherlands
| | | | - Eric H J Belgers
- Department of Surgery, Zuyderland Medisch Centrum, Heerlen, The Netherlands
| | - Eric J T Belt
- Department of Surgery, Albert Schweitzer Ziekenhuis, Dordrecht, The Netherlands
| | | | - Christiaan Hoff
- Department of Surgery, Medisch Centrum Leeuwarden, Leeuwarden, The Netherlands
| | - Roel Hompes
- Department of Surgery, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands
| | - Anke B Smits
- Department of Surgery, St.Antonius Ziekenhuis, Nieuwegein, The Netherlands
| | | | | | - Hendrik J Bonjer
- Department of Surgery, Amsterdam UMC location Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Pieter J Tanis
- Department of Surgery, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands
- Department of Surgical Oncology and Gastrointestinal Surgery, Erasmus MC, Rotterdam, The Netherlands
| | - Jurriaan B Tuynman
- Department of Surgery, Amsterdam UMC location Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
3
|
Grüter AAJ, Coblijn UK, Toorenvliet BR, Tanis PJ, Tuynman JB. National implementation of an optimal standardised technique for right-sided colon cancer: protocol of an interventional sequential cohort study (Right study). Tech Coloproctol 2023; 27:1083-1090. [PMID: 37097330 PMCID: PMC10562307 DOI: 10.1007/s10151-023-02801-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Accepted: 04/03/2023] [Indexed: 04/26/2023]
Abstract
PURPOSE Minimally invasive right hemicolectomy (MIRH) is the cornerstone of treatment for patients with right-sided colon cancer. This operation has evolved during recent decades, with many innovations and improvements but this has also resulted in high variability of uptake with subsequent substantial variableness. The aim of this ongoing study is to identify current surgical variations, determine the most optimal and standardised MIRH and nationally train and implement that technique to improve short-term clinical and long-term oncological outcomes. METHODS The Right study is a national multicentre prospective interventional sequential cohort study. Firstly, current local practice was evaluated. Subsequently, a standardised surgical technique for right-sided colon cancer was determined using the Delphi consensus method, and this procedure was trained during hands-on courses. The standardised MIRH will be implemented with proctoring (implementation cohort), after which the performance will be monitored (consolidation cohort). Patients who will receive a minimally invasive (extended) right hemicolectomy for cT1-3N0-2M0 colon cancer will be included. The primary outcome is patient safety reflected in the 90-day overall complication rate according to the Clavien-Dindo classification. Secondary outcomes will include intraoperative complications, 90-day mortality rate, number of resected tumour-positive lymph nodes, completeness of mesocolic excision, surgical quality score, locoregional and distant recurrence and 5-year overall survival. A total number of 1095 patients (365 per cohort) will be included. DISCUSSION The Right study is designed to safely implement the best surgical practice concerning patients with right-sided colon cancer aiming to standardise and improve the surgical quality of MIRH at a national level. TRIAL REGISTRATION ClinicalTrials.gov: NCT04889456, May 2021.
Collapse
Affiliation(s)
- Alexander A J Grüter
- Department of Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, Amsterdam, The Netherlands.
- Cancer Center Amsterdam, Treatment and Quality of Life, Amsterdam, The Netherlands.
| | - Usha K Coblijn
- Department of Surgery, Antoni van Leeuwenhoek, Plesmanlaan 121, Amsterdam, The Netherlands
| | | | - Pieter J Tanis
- Department of Surgery, UMC Location University of Amsterdam, Meibergdreef 9, Amsterdam, The Netherlands
- Department of Surgery, Erasmus MC, Dr. Molewaterplein 40, Rotterdam, The Netherlands
| | - Jurriaan B Tuynman
- Department of Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, Amsterdam, The Netherlands
| |
Collapse
|
4
|
Ketel MHM, Klarenbeek BR, Eddahchouri Y, Cuesta MA, van Daele E, Gutschow CA, Hölscher AH, Hubka M, Luyer MDP, Merritt RE, Nieuwenhuijzen GAP, Shen Y, Abma IL, Rosman C, van Workum F. Crowd-sourced and expert video assessment in minimally invasive esophagectomy. Surg Endosc 2023; 37:7819-7828. [PMID: 37605010 PMCID: PMC10520122 DOI: 10.1007/s00464-023-10297-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Accepted: 07/02/2023] [Indexed: 08/23/2023]
Abstract
BACKGROUND Video-based assessment by experts may structurally measure surgical performance using procedure-specific competency assessment tools (CATs). A CAT for minimally invasive esophagectomy (MIE-CAT) was developed and validated previously. However, surgeon's time is scarce and video assessment is time-consuming and labor intensive. This study investigated non-procedure-specific assessment of MIE video clips by MIE experts and crowdsourcing, collective surgical performance evaluation by anonymous and untrained laypeople, to assist procedure-specific expert review. METHODS Two surgical performance scoring frameworks were used to assess eight MIE videos. First, global performance was assessed with the non-procedure-specific Global Operative Assessment of Laparoscopic Skills (GOALS) of 64 procedural phase-based video clips < 10 min. Each clip was assessed by two MIE experts and > 30 crowd workers. Second, the same experts assessed procedure-specific performance with the MIE-CAT of the corresponding full-length video. Reliability and convergent validity of GOALS for MIE were investigated using hypothesis testing with correlations (experience, blood loss, operative time, and MIE-CAT). RESULTS Less than 75% of hypothesized correlations between GOALS scores and experience of the surgical team (r < 0.3), blood loss (r = - 0.82 to 0.02), operative time (r = - 0.42 to 0.07), and the MIE-CAT scores (r = - 0.04 to 0.76) were met for both crowd workers and experts. Interestingly, experts' GOALS and MIE-CAT scores correlated strongly (r = 0.40 to 0.79), while crowd workers' GOALS and experts' MIE-CAT scores correlations were weak (r = - 0.04 to 0.49). Expert and crowd worker GOALS scores correlated poorly (ICC ≤ 0.42). CONCLUSION GOALS assessments by crowd workers lacked convergent validity and showed poor reliability. It is likely that MIE is technically too difficult to assess for laypeople. Convergent validity of GOALS assessments by experts could also not be established. GOALS might not be comprehensive enough to assess detailed MIE performance. However, expert's GOALS and MIE-CAT scores strongly correlated indicating video clip (instead of full-length video) assessments could be useful to shorten assessment time.
Collapse
Affiliation(s)
- Mirte H M Ketel
- Department of Surgery, Radboud University Medical Center, Nijmegen, The Netherlands.
| | | | - Yassin Eddahchouri
- Department of Surgery, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Miguel A Cuesta
- Department of Surgery, Amsterdam University Medical Centers, Location VUmc, Amsterdam, The Netherlands
| | - Elke van Daele
- Department of Digestive Surgery, Ghent University Hospital, Ghent, Belgium
| | - Christian A Gutschow
- Department of Surgery and Transplantation, University Hospital Zurich, Zurich, Switzerland
| | - Arnulf H Hölscher
- Department for General, Visceral and Trauma Surgery, Elisabeth-Krankenhaus-Essen GmbH, Essen, Germany
| | - Michal Hubka
- Department of Thoracic Surgery, Virginia Mason Medical Center, Seattle, SE, USA
| | - Misha D P Luyer
- Department of Surgery, Catharina Hospital, Eindhoven, The Netherlands
| | - Robert E Merritt
- Department of Surgery, Ohio State University - Wexner Medical Center, Columbus, OH, USA
| | | | - Yaxing Shen
- Department of Thoracic Surgery, Zhongshan Hospital, Fudan University, Shanghai, China
| | - Inger L Abma
- IQ Healthcare, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Camiel Rosman
- Department of Surgery, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Frans van Workum
- Department of Surgery, Radboud University Medical Center, Nijmegen, The Netherlands
- Department of Surgery, Canisius-Wilhelmina Hospital, Nijmegen, The Netherlands
| |
Collapse
|
5
|
Grüter AAJ, Van Lieshout AS, van Oostendorp SE, Henckens SPG, Ket JCF, Gisbertz SS, Toorenvliet BR, Tanis PJ, Bonjer HJ, Tuynman JB. Video-based tools for surgical quality assessment of technical skills in laparoscopic procedures: a systematic review. Surg Endosc 2023; 37:4279-4297. [PMID: 37099157 PMCID: PMC10234871 DOI: 10.1007/s00464-023-10076-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Accepted: 04/08/2023] [Indexed: 04/27/2023]
Abstract
BACKGROUND Quality of surgery has substantial impact on both short- and long-term clinical outcomes. This stresses the need for objective surgical quality assessment (SQA) for education, clinical practice and research purposes. The aim of this systematic review was to provide a comprehensive overview of all video-based objective SQA tools in laparoscopic procedures and their validity to objectively assess surgical performance. METHODS PubMed, Embase.com and Web of Science were systematically searched by two reviewers to identify all studies focusing on video-based SQA tools of technical skills in laparoscopic surgery performed in a clinical setting. Evidence on validity was evaluated using a modified validation scoring system. RESULTS Fifty-five studies with a total of 41 video-based SQA tools were identified. These tools were used in 9 different fields of laparoscopic surgery and were divided into 4 categories: the global assessment scale (GAS), the error-based assessment scale (EBAS), the procedure-specific assessment tool (PSAT) and artificial intelligence (AI). The number of studies focusing on these four categories were 21, 6, 31 and 3, respectively. Twelve studies validated the SQA tool with clinical outcomes. In 11 of those studies, a positive association between surgical quality and clinical outcomes was found. CONCLUSION This systematic review included a total of 41 unique video-based SQA tools to assess surgical technical skills in various domains of laparoscopic surgery. This study suggests that validated SQA tools enable objective assessment of surgical performance with relevance for clinical outcomes, which can be used for training, research and quality improvement programs.
Collapse
Affiliation(s)
- Alexander A J Grüter
- Department of Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, Amsterdam, The Netherlands.
- Cancer Center Amsterdam, Treatment and Quality of Life, Amsterdam, The Netherlands.
| | - Annabel S Van Lieshout
- Department of Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, Amsterdam, The Netherlands
- Cancer Center Amsterdam, Treatment and Quality of Life, Amsterdam, The Netherlands
| | - Stefan E van Oostendorp
- Department of Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, Amsterdam, The Netherlands
- Department of Surgery, Rode Kruis Ziekenhuis, Vondellaan 13, Beverwijk, The Netherlands
| | - Sofie P G Henckens
- Cancer Center Amsterdam, Treatment and Quality of Life, Amsterdam, The Netherlands
- Department of Surgery, Amsterdam UMC Location University of Amsterdam, Meibergdreef 9, Amsterdam, The Netherlands
| | - Johannes C F Ket
- Medical Library, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Suzanne S Gisbertz
- Department of Surgery, Amsterdam UMC Location University of Amsterdam, Meibergdreef 9, Amsterdam, The Netherlands
| | | | - Pieter J Tanis
- Department of Surgery, Amsterdam UMC Location University of Amsterdam, Meibergdreef 9, Amsterdam, The Netherlands
- Department of Surgical Oncology and Gastrointestinal Surgery, Erasmus MC, Doctor Molewaterplein 40, Rotterdam, The Netherlands
| | - Hendrik J Bonjer
- Department of Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, Amsterdam, The Netherlands
| | - Jurriaan B Tuynman
- Department of Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, Amsterdam, The Netherlands
| |
Collapse
|
6
|
Peng X, Ge Y, Zhang J, Wei Z, Zhang H. Transanal total mesorectal excision port-assisted perineal hernia repair: A case report. Front Oncol 2022; 12:1036145. [PMID: 36330488 PMCID: PMC9624435 DOI: 10.3389/fonc.2022.1036145] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2022] [Accepted: 09/30/2022] [Indexed: 11/13/2022] Open
Abstract
Perineal hernia after abdominoperineal resection (APR) is a troublesome problem, and severe cases require surgical treatment. However, perineal hernia repair is challenging, especially when combined with intestinal adhesions. The difficulty of the operation lies in performing adhesiolysis and mesh placement under poor visibility. While there are traditional, laparoscopic and even robotic methods of performing this procedure, no easy and minimally-invasive approach has been reported. Here, we report the case of a patient with perineal hernia, who underwent transanal total mesorectal excision (TaTME) port-assisted laparoscopic perineal hernia repair. The operation was successful, the postoperative recovery was uneventful, the patient’s symptoms improved significantly, and no recurrence was found during the 4-month follow-up. The availability and safety of TaTME port-assisted perineal hernia repair provide a promising approach for hernia repair. Compared with traditional perineal or laparoscopic abdominal approaches, this procedure is less invasive and results in a better field of vision.
Collapse
|
7
|
Antoun A, Al Rashid F, Alhassan N, Gomez-Garibello C, Fiore JF, Feldman LS, Lee L, Mueller CL. Development of a formative feedback tool for transanal total mesorectal excision. Surg Endosc 2022; 36:6705-6711. [PMID: 34982229 DOI: 10.1007/s00464-021-08943-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2021] [Accepted: 12/06/2021] [Indexed: 11/25/2022]
Abstract
INTRODUCTION Transanal total mesorectal excision (TaTME) is a novel procedure in the treatment of rectal cancer. Current training models for TaTME suggest a period of proctored cases, but no structured feedback tool exists to guide operators during the learning phase. The objective of this study therefore was to develop a formative feedback tool for the critical steps of the transanal portion of TaTME. METHODS A two-round Delphi study by TaTME experts was conducted to determine the items to be included in the formative feedback tool. Participants rated each step from a prepared list using a Likert scale from 1 (Not relevant) to 5 (Very relevant) with the option to suggest additional steps. Responses to the first round were presented in the second round, where participants rated the revised list of steps. Consensus was defined as > 80% of participants rating the step as 4 or 5 (out of 5). Items were combined when appropriate to avoid redundancy. Rating anchors describing performance (on a 5-point scale) were then developed for each step. The final tool was recirculated and participants rated the finished product on its feasibility and usefulness. RESULTS Twenty-six TaTME experts were contacted for participation. Fifteen experts (58%) participated in the first round of the study, and eleven (42%) participated in the second round. The majority (14, 93%) had completed fellowship training in colorectal surgery. The first round of the Delphi study contained 34 items, and 32 items met inclusion criteria after the second round. Redundant items were combined into 15 items that comprised the final tool. Out of eight respondents to the feasibility survey, all believed the feedback tool enhances the feedback of learners and would use it for training purposes if available. CONCLUSION This work describes the development of a novel consensus-based formative feedback tool specific to TaTME.
Collapse
Affiliation(s)
- Alen Antoun
- Department of Surgery, McGill University Health Centre and the Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, 1650 Cedar Ave, L8-505, Montreal, QC, H3G 1A4, Canada
| | - Faisal Al Rashid
- Department of Surgery, McGill University Health Centre and the Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, 1650 Cedar Ave, L8-505, Montreal, QC, H3G 1A4, Canada
| | - Noura Alhassan
- Department of Surgery, McGill University Health Centre and the Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, 1650 Cedar Ave, L8-505, Montreal, QC, H3G 1A4, Canada
- Department of Surgery, King Saud University, Riyadh, Saudi Arabia
| | | | - Julio F Fiore
- Department of Surgery, McGill University Health Centre and the Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, 1650 Cedar Ave, L8-505, Montreal, QC, H3G 1A4, Canada
| | - Liane S Feldman
- Department of Surgery, McGill University Health Centre and the Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, 1650 Cedar Ave, L8-505, Montreal, QC, H3G 1A4, Canada
| | - Lawrence Lee
- Department of Surgery, McGill University Health Centre and the Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, 1650 Cedar Ave, L8-505, Montreal, QC, H3G 1A4, Canada
| | - Carmen L Mueller
- Department of Surgery, McGill University Health Centre and the Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, 1650 Cedar Ave, L8-505, Montreal, QC, H3G 1A4, Canada.
| |
Collapse
|
8
|
Naghawi H, Chau J, Madani A, Kaneva P, Monson J, Mueller C, Lee L. Development and evaluation of a virtual knowledge assessment tool for transanal total mesorectal excision. Tech Coloproctol 2022; 26:551-560. [PMID: 35503143 DOI: 10.1007/s10151-022-02621-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Accepted: 04/10/2022] [Indexed: 11/28/2022]
Abstract
BACKGROUND Transanal total mesorectal excision (TATME) is difficult to learn and can result in serious complications. Current paradigms for assessing performance and competency may be insufficient. This study aims to develop and provide preliminary validity evidence for a TATME virtual assessment tool (TATME-VAT) to assess the cognitive skills necessary to safely complete TATME dissection. METHODS Participants from North America, Europe, Japan and China completed the test via an interactive online platform between 11/2019 and 05/2020. They were grouped into expert, experienced and novice surgeons depending on the number of independently performed TATMEs. TATME-VAT is a 24-item web-based assessment evaluating advanced cognitive skills, designed according to a blueprint from consensus guidelines. Eight items were multiple choice questions. Sixteen items required making annotations on still frames of TATME videos (VCT) and were scored using a validated algorithm derived from experts' responses. Annotation (range 0-100), multiple choice (range 0-100), and overall scores (sum of annotation and multiple-choice scores, normalized to μ = 50 and σ = 10) were reported. RESULTS There were significant differences between the expert, experienced, and novice groups for the annotation (p < 0.001), multiple-choice (p < 0.001), and overall scores (p < 0.001). The annotation (p = 0.439) and overall (p = 0.152) scores were similar between the experienced and novice groups. Annotation scores were higher in participants with 51 or more vs. 30-50 vs. less than 30 cases. Scores were also lower in users with a self-reported recent complication vs. those without. CONCLUSIONS This study describes the development of an interactive video-based virtual assessment tool for TATME dissection and provides initial validity evidence for its use.
Collapse
Affiliation(s)
- Hamzeh Naghawi
- The Steinberg-Bernstein Centre for Minimally Invasive Surgery, McGill University Health Center, Montreal, QC, Canada
| | - Johnny Chau
- The Steinberg-Bernstein Centre for Minimally Invasive Surgery, McGill University Health Center, Montreal, QC, Canada
| | - Amin Madani
- The University Health Network - Toronto General Hospital, Toronto, ON, Canada
| | - Pepa Kaneva
- The Steinberg-Bernstein Centre for Minimally Invasive Surgery, McGill University Health Center, Montreal, QC, Canada
| | - John Monson
- AdventHealth Medical Group, Orlando, FL, USA
| | - Carmen Mueller
- The Steinberg-Bernstein Centre for Minimally Invasive Surgery, McGill University Health Center, Montreal, QC, Canada
| | - Lawrence Lee
- The Steinberg-Bernstein Centre for Minimally Invasive Surgery, McGill University Health Center, Montreal, QC, Canada. .,Colon and Rectal Surgery, Department of Surgery, McGill University Health Centre, 1001 Decarie Boulevard, DS1-3310, Montreal, QC, H4A 3J1, Canada.
| |
Collapse
|
9
|
Andersen SAW, Nayahangan LJ, Park YS, Konge L. Use of Generalizability Theory for Exploring Reliability of and Sources of Variance in Assessment of Technical Skills: A Systematic Review and Meta-Analysis. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2021; 96:1609-1619. [PMID: 33951677 DOI: 10.1097/acm.0000000000004150] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
PURPOSE Competency-based education relies on the validity and reliability of assessment scores. Generalizability (G) theory is well suited to explore the reliability of assessment tools in medical education but has only been applied to a limited extent. This study aimed to systematically review the literature using G-theory to explore the reliability of structured assessment of medical and surgical technical skills and to assess the relative contributions of different factors to variance. METHOD In June 2020, 11 databases, including PubMed, were searched from inception through May 31, 2020. Eligible studies included the use of G-theory to explore reliability in the context of assessment of medical and surgical technical skills. Descriptive information on study, assessment context, assessment protocol, participants being assessed, and G-analyses was extracted. Data were used to map G-theory and explore variance components analyses. A meta-analysis was conducted to synthesize the extracted data on the sources of variance and reliability. RESULTS Forty-four studies were included; of these, 39 had sufficient data for meta-analysis. The total pool included 35,284 unique assessments of 31,496 unique performances of 4,154 participants. Person variance had a pooled effect of 44.2% (95% confidence interval [CI], 36.8%-51.5%). Only assessment tool type (Objective Structured Assessment of Technical Skills-type vs task-based checklist-type) had a significant effect on person variance. The pooled reliability (G-coefficient) was 0.65 (95% CI, .59-.70). Most studies included decision studies (39, 88.6%) and generally seemed to have higher ratios of performances to assessors to achieve a sufficiently reliable assessment. CONCLUSIONS G-theory is increasingly being used to examine reliability of technical skills assessment in medical education, but more rigor in reporting is warranted. Contextual factors can potentially affect variance components and thereby reliability estimates and should be considered, especially in high-stakes assessment. Reliability analysis should be a best practice when developing assessment of technical skills.
Collapse
Affiliation(s)
- Steven Arild Wuyts Andersen
- S.A.W. Andersen is postdoctoral researcher, Copenhagen Academy for Medical Education and Simulation (CAMES), Center for Human Resources and Education, Capital Region of Denmark, and Department of Otolaryngology, The Ohio State University, Columbus, Ohio, and resident in otorhinolaryngology, Department of Otorhinolaryngology-Head & Neck Surgery, Rigshospitalet, Copenhagen, Denmark; ORCID: https://orcid.org/0000-0002-3491-9790
| | - Leizl Joy Nayahangan
- L.J. Nayahangan is researcher, CAMES, Center for Human Resources and Education, Capital Region of Denmark, Copenhagen, Denmark; ORCID: https://orcid.org/0000-0002-6179-1622
| | - Yoon Soo Park
- Y.S. Park is director of health professions education research, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts; ORCID: https://orcid.org/0000-0001-8583-4335
| | - Lars Konge
- L. Konge is professor of medical education, University of Copenhagen, and head of research, CAMES, Center for Human Resources and Education, Capital Region of Denmark, Copenhagen, Denmark; ORCID: https://orcid.org/0000-0002-1258-5822
| |
Collapse
|
10
|
Van Oostendorp SE, Belgers HJ(E, Hol JC, Doornebosch PG, Belt EJT, Oosterling SJ, Kusters M, Bonjer HJ(J, Sietses C, Tuynman JB. The learning curve of transanal total mesorectal excision for rectal cancer is associated with local recurrence: results from a multicentre external audit. Colorectal Dis 2021; 23:2020-2029. [PMID: 33969621 PMCID: PMC8453958 DOI: 10.1111/codi.15722] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/29/2020] [Revised: 03/19/2021] [Accepted: 05/02/2021] [Indexed: 12/14/2022]
Abstract
AIM Transanal total mesorectal excision (TaTME) has been suggested as a potential solution for the resection of challenging mid and low rectal cancer. This relatively complex procedure has been implemented in many centres over the last years, despite the absence of long-term safety data. Recently, concern has arisen because of an increase in local recurrence in the implementation phase. The aim of this study was to assess the correlation between accumulated experience and local recurrences. METHOD An independent clinical researcher performed an external audit of consecutive series of all TaTME procedures in six centres in the Netherlands. Kaplan-Meier estimated local recurrence rates were calculated and multivariate Cox proportional hazards regression analysis performed to assess risk factors for local recurrence. Primary outcome was the local recurrence rate in the initial implementation (cases 1-10), continued adoption (cases 11-40) and prolonged experience (case 41 onward). RESULTS Six hundred and twenty-four consecutive patients underwent TaTME for rectal cancer with a median follow-up of 27 months (range 1-82 months). The estimated 2- and 3-year local recurrence rates were 4.6% and 6.6%, respectively. Cox proportional hazards regression revealed procedural experience to be an independent factor in multivariate analysis next to advanced stage (ycMRF+, pT3-4, pN+) and pelvic sepsis. Corrected analysis projected the 3-year local recurrence rates to be 9.7%, 3.3% and 3.5% for the implementation, continued adoption and prolonged experience cohorts, respectively. CONCLUSION This multicentre study shows a high local recurrence rate (12.5%) after implementation of TaTME which lowers to an acceptable rate (3.4%) when experience increases. Therefore, intensified proctoring and further precautions must be implemented to reduce the unacceptably high risk of local recurrence at units starting this technique.
Collapse
Affiliation(s)
- Stefan E. Van Oostendorp
- Department of SurgeryAmsterdam UMCVrije Universiteit AmsterdamCancer Centre AmsterdamAmsterdamThe Netherlands
| | | | - Jeroen C. Hol
- Department of SurgeryAmsterdam UMCVrije Universiteit AmsterdamCancer Centre AmsterdamAmsterdamThe Netherlands
- Department of SurgeryGelderse Vallei HospitalEdeThe Netherlands
| | | | - Eric J. Th. Belt
- Department of SurgeryAlbert Schweitzer HospitalDordrechtThe Netherlands
| | | | - Miranda Kusters
- Department of SurgeryAmsterdam UMCVrije Universiteit AmsterdamCancer Centre AmsterdamAmsterdamThe Netherlands
| | - H. J. (Jaap) Bonjer
- Department of SurgeryAmsterdam UMCVrije Universiteit AmsterdamCancer Centre AmsterdamAmsterdamThe Netherlands
| | - Colin Sietses
- Department of SurgeryGelderse Vallei HospitalEdeThe Netherlands
| | - Jurriaan B. Tuynman
- Department of SurgeryAmsterdam UMCVrije Universiteit AmsterdamCancer Centre AmsterdamAmsterdamThe Netherlands
| |
Collapse
|
11
|
Persiani R, Lorenzon L, Marincola G, Santocchi P, Tedesco S, Biondi A. Systematic review of transanal total mesorectal excision literature according to the ideal framework: The evolution never ends. Surgery 2021; 170:1054-1060. [PMID: 34020793 DOI: 10.1016/j.surg.2021.04.006] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2020] [Revised: 03/15/2021] [Accepted: 04/05/2021] [Indexed: 12/22/2022]
Abstract
BACKGROUND Designing studies to assess critically novel procedures can be challenging; thus, the process to achieve robust evidence is frequently problematic. The aim of this systematic review was to evaluate if literature on transanal total mesorectal excision is evolving according to the Idea, Development, Exploration, Assessment, and Long-term results framework. METHODS Literature on transanal total mesorectal excision was searched according to the preferred reporting items for systematic reviews and meta-analyses statement, and these variables were recorded: bibliometric data, design, corresponding author's nationality, number of patients enrolled, and Idea, Development, Exploration, Assessment, and Long-term results stages (stage 0, stage 1, stage 2, stage 3, and stage 4). RESULTS Out of 447 articles retrieved, 247 were selected (76.5% single center and 23.5% multicenter collaborations), including 35 reviews, 15 meta-analyses, 24 other publications, and 173 articles classified according to Idea, Development, Exploration, Assessment, and Long-term results stages (19 stage 0, 27 stage 1, 111 stage 2, 7 stage 3, and 9 stage 4). Overall, impact factor produced was 634.10. Reviewing corresponding authors' nationalities, 32 countries were identified, and the most reported were the United States, China, and the United Kingdom; nearly all were from the Northern Hemisphere. Publication of stage 3 and 4 articles started in 2014, whereas stage 0 and 1 articles were stably published over time. The number of patients increased in correspondence with the Idea, Development, Exploration, Assessment, and Long-term results stages (case series with >51 patients, respectively, 100.0% stage 3, 77.8% stage 4, and 33.3% stage 2, P = .005). CONCLUSION The number of stage 3 and 4 articles is still low; however, the technical innovation of transanal total mesorectal excision is a non-stopping process with preclinical studies stably published over time.
Collapse
Affiliation(s)
- Roberto Persiani
- General Surgery Unit, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy. https://twitter.com/PersianiRoberto
| | - Laura Lorenzon
- General Surgery Unit, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy.
| | - Giuseppe Marincola
- General Surgery Unit, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy. https://twitter.com/GiuseppeMarinc3
| | - Pietro Santocchi
- General Surgery Unit, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy. https://twitter.com/PSantocchi
| | - Silvia Tedesco
- General Surgery Unit, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy. https://twitter.com/SilviaTedesco16
| | - Alberto Biondi
- General Surgery Unit, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy. https://twitter.com/AlbertoBiondi78
| |
Collapse
|
12
|
Lefevre JH. TaTME: We continuously do the splits. Colorectal Dis 2021; 23:775. [PMID: 33871160 DOI: 10.1111/codi.15655] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/08/2023]
|
13
|
Moloney K, Janda M, Frumovitz M, Leitao M, Abu-Rustum NR, Rossi E, Nicklin JL, Plante M, Lecuru FR, Buda A, Mariani A, Leung Y, Ferguson SE, Pareja R, Kimmig R, Tong PSY, McNally O, Chetty N, Liu K, Jaaback K, Lau J, Ng SYJ, Falconer H, Persson J, Land R, Martinelli F, Garrett A, Altman A, Pendlebury A, Cibula D, Altamirano R, Brennan D, Ind TE, De Kroon C, Tse KY, Hanna G, Obermair A. Development of a surgical competency assessment tool for sentinel lymph node dissection by minimally invasive surgery for endometrial cancer. Int J Gynecol Cancer 2021; 31:647-655. [PMID: 33664126 DOI: 10.1136/ijgc-2020-002315] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2020] [Revised: 02/02/2021] [Accepted: 02/04/2021] [Indexed: 02/02/2023] Open
Abstract
INTRODUCTION Sentinel lymph node dissection is widely used in the staging of endometrial cancer. Variation in surgical techniques potentially impacts diagnostic accuracy and oncologic outcomes, and poses barriers to the comparison of outcomes across institutions or clinical trial sites. Standardization of surgical technique and surgical quality assessment tools are critical to the conduct of clinical trials. By identifying mandatory and prohibited steps of sentinel lymph node (SLN) dissection in endometrial cancer, the purpose of this study was to develop and validate a competency assessment tool for use in surgical quality assurance. METHODS A Delphi methodology was applied, included 35 expert gynecological oncology surgeons from 16 countries. Interviews identified key steps and tasks which were rated mandatory, optional, or prohibited using questionnaires. Using the surgical steps for which consensus was achieved, a competency assessment tool was developed and subjected to assessments of validity and reliability. RESULTS Seventy percent consensus agreement standardized the specific mandatory, optional, and prohibited steps of SLN dissection for endometrial cancer and informed the development of a competency assessment tool. Consensus agreement identified 21 mandatory and three prohibited steps to complete a SLN dissection. The competency assessment tool was used to rate surgical quality in three preselected videos, demonstrating clear separation in the rating of the skill level displayed with mean skills summary scores differing significantly between the three videos (F score=89.4; P<0.001). Internal consistency of the items was high (Cronbach α=0.88). CONCLUSION Specific mandatory and prohibited steps of SLN dissection in endometrial cancer have been identified and validated based on consensus among a large number of international experts. A competency assessment tool is now available and can be used for surgeon selection in clinical trials and for ongoing, prospective quality assurance in routine clinical care.
Collapse
Affiliation(s)
- Kristen Moloney
- Gynaecologic Oncology, Royal Brisbane and Women's Hospital, Herston, Queensland, Australia
| | - Monika Janda
- Centre for Health Services Research, The University of Queensland Faculty of Medicine, Brisbane, Queensland, Australia
| | - Michael Frumovitz
- Gynecologic Oncology and Reproductive Medicine, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| | - Mario Leitao
- Gynecology Service Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| | - Nadeem R Abu-Rustum
- Gynecology Service Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| | - Emma Rossi
- Obstetrics and Gynecology, The University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | - James L Nicklin
- Gynaecological Oncology, Royal Brisbane and Women's Hospital, Herston, Queensland, Australia.,Faculty of Medicine, The University of Queensland, St Lucia, Queensland, Australia
| | - Marie Plante
- Gynecology Oncology Service, Centre Hospitalier Universitaire de Québec-Université Laval, Quebec, Quebec, Canada
| | - Fabrice R Lecuru
- Surgical Oncology, Institute Curie, Paris, France.,Surgical Oncology Department for Breast and Gynecology, Universite de Paris, Paris, Île-de-France, France
| | - Alessandro Buda
- Department of Obstetrics and Gynecology, Università degli Studi Milano-Bicocca, San Gerardo Hospital, Monza, Italy.,Division of Gynecologic Oncology Italy, Ospedale Michele e Pietro Ferrero, Verduno (CN), Italy
| | - Andrea Mariani
- Gynecologic Surgery, Department of Obstetrics and Gynecology, Mayo Clinic Rochester, Rochester, Minnesota, USA
| | - Yee Leung
- Obstetrics and Gynaecology, The University of Western Australia Faculty of Health and Medical Sciences, Perth, Western Australia, Australia
| | - Sarah Elizabeth Ferguson
- Gynecologic Oncology, University Health Network, Toronto, Ontario, Canada.,Obstetrics and Gynaecology, University of Toronto, Toronto, Ontario, Canada
| | - Rene Pareja
- Gynecologic Oncology, Instituto Nacional de Cancerologia, Bogota, Colombia.,Gynecologic Oncology, Clínica De Oncología Astorga, Medellín, Colombia
| | - Rainer Kimmig
- Gynecology and Obstetrics, University of Essen, Essen, Germany
| | | | - Orla McNally
- Obstetrics and Gynaecology, Royal Women's Hospital, Parkville, Victoria, Australia.,Victorian Comprehensive Cancer Centre, University of Melbourne, Parkville, Victoria, Australia
| | - Naven Chetty
- Gynaecologic Oncology, Mater Health Services Brisbane, South Brisbane, Queensland, Australia
| | - Kaijiang Liu
- Gynecology and Obstetrics, Shanghai Jiao Tong University School of Medicine Affiliated Renji Hospital, Shanghai, China
| | - Ken Jaaback
- Gynaecologic Oncology, John Hunter Hospital, New Lambton Heights, New South Wales, Australia
| | - Julio Lau
- Gynecology Oncology, Hospital General San Juan de Dios, Guatemala, Guatemala.,Gynecology Oncology, University of San Carlos de Guatemala Faculty of Medical Sciences, Guatemala, Guatemala
| | | | - Henrik Falconer
- Women's and Children's Health, Karolinska Institute, Stockholm, Sweden.,Women's and Children's Health, Karolinska University Hospital, Stockholm, Sweden
| | - Jan Persson
- Obstetrics and Gynaecology, Skanes Universitetssjukhus Lund, Lund, Skåne, Sweden.,Clinical Sciences, Obstetrics and Gynaecology, Lund University Faculty of Medicine, Lund, Sweden
| | - Russell Land
- Gynaecologic Oncology, Royal Brisbane and Women's Hospital, Herston, Queensland, Australia.,Faculty of Medicine, The University of Queensland, St Lucia, Queensland, Australia
| | - Fabio Martinelli
- Gynaecologic Oncology, Fondazione IRCCS Istituto Nazionale dei Tumori, Milan, Italy
| | - Andrea Garrett
- Gynaecologic Oncology, Royal Brisbane and Women's Hospital, Herston, Queensland, Australia
| | - Alon Altman
- Gynecologic Oncology, University of Manitoba, Winnipeg, Manitoba, Canada.,Gynecologic Oncology, CancerCare Manitoba, Winnipeg, Manitoba, Canada
| | - Adam Pendlebury
- Gynaecological Oncology, Mercy Hospital for Women, Heidelberg, Victoria, Australia
| | - David Cibula
- Gynecology and Obstetrics, Charles University First Faculty of Medicine, Praha, Praha, Czech Republic.,Gynecology and Obstetrics, General University Hospital in Prague, Praha, Czech Republic
| | - Roberto Altamirano
- Gynecology Oncology, Universidad de Chile, Santiago de Chile, Chile.,Gynecology Oncology, Hospital Clinico San Borja Arriaran, Santiago, Chile
| | - Donal Brennan
- Gynaecology Oncology, Mater Misericordiae University Hospital, Dublin, Ireland.,School of Medicine, University College Dublin, Dublin, Ireland
| | - Thomas Edward Ind
- Gynaecological Oncology, Royal Marsden NHS Foundation Trust, London, UK.,Gynaecology, St George's University of London, London, UK
| | - Cornelis De Kroon
- Gynecology, Leiden University Medical Center, Leiden, Zuid-Holland, The Netherlands
| | - Ka Yu Tse
- Obstetrics and Gynaecology, University of Hong Kong Li Ka Shing Faculty of Medicine, Hong Kong, Hong Kong
| | - George Hanna
- Surgery and Cancer, Imperial College London, London, UK
| | - Andreas Obermair
- Center for Clinical Research, Faculty of Medicine, University of Queensland, Herston, Queensland, Australia .,Queensland Centre for Gynaecologic Cancer Research, Royal Brisbane and Women's Hospital, Herston, Queensland, Australia
| |
Collapse
|
14
|
Global versus task-specific postoperative feedback in surgical procedure learning. Surgery 2021; 170:81-87. [PMID: 33589246 DOI: 10.1016/j.surg.2020.12.038] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Revised: 12/23/2020] [Accepted: 12/26/2020] [Indexed: 12/26/2022]
Abstract
BACKGROUND Task-specific checklists and global rating scales are both recommended assessment tools to provide constructive feedback on surgical performance. This study evaluated the most effective feedback tool by comparing the effects of the Observational Clinical Human Reliability Analysis (OCHRA) and the Objective Structured Assessment of Technical Skills (OSATS) on surgical performance in relation to the visual-spatial ability of the learners. METHODS In a randomized controlled trial, medical students were allocated to either the OCHRA (n = 25) or OSATS (n = 25) feedback group. Visual-spatial ability was measured by a Mental Rotation Test. Participants performed an open inguinal hernia repair procedure on a simulation model twice. Feedback was provided after the first procedure. Improvement in performance was evaluated blindly using a global rating scale (performance score) and hand-motion analysis (time and path length). RESULTS Mean improvement in performance score was not significantly different between the OCHRA and OSATS feedback groups (P = .100). However, mean improvement in time (371.0 ± 223.4 vs 274.6 ± 341.6; P = .027) and path length (53.5 ± 42.4 vs 34.7 ± 39.0; P = .046) was significantly greater in the OCHRA feedback group. When stratified by mental rotation test scores, the greater improvement in time (P = .032) and path length (P = .053) was observed only among individuals with low visual-spatial abilities. CONCLUSION A task-specific (OCHRA) feedback is more effective in improving surgical skills in terms of time and path length in novices compared to a global rating scale (OSATS). The effects of a task-specific feedback are present mostly in individuals with lower visual-spatial abilities.
Collapse
|
15
|
Markar S, Santoni G, Maret-Ouda J, Lagergren J. Hospital volume of esophageal cancer surgery in relation to outcomes from primary anti-reflux surgery. Dis Esophagus 2021; 34:5874719. [PMID: 32696953 DOI: 10.1093/dote/doaa075] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/24/2020] [Revised: 06/01/2020] [Accepted: 06/28/2020] [Indexed: 12/11/2022]
Abstract
No previous study has sought to identify the effect of hospital volume of esophagectomy on anti-reflux surgery outcomes. The hypothesis under investigation was hospitals performing esophagectomies, particularly those of higher annual volume, have better outcomes from primary anti-reflux surgery. This population-based cohort study included adult individuals (≥18 years) in Sweden receiving primary anti-reflux surgery for a recorded gastro-esophageal reflux disease in 1997-2010, with follow-up until 2013 The 'exposure' was hospital volume of esophagectomy, with hospitals conducting esophagectomies divided into 0, >0-1, >1-3 and ≥ 4 based on annual volume, and hospitals not conducting esophagectomies were the reference category. The outcomes were 30-day re-intervention and surgical re-intervention during the entire follow-up after anti-reflux surgery. Multivariable Cox regression provided hazard ratios (HRs) with 95% confidence intervals (CIs), adjusted for age, sex, comorbidity, type of anti-reflux surgery, and year of anti-reflux surgery. Among 10,959 participants having undergone primary anti-reflux surgery, the 30-day re-intervention rate was 1.1%, and the rate of surgical re-intervention during the entire follow-up was 6.8%. Compared with hospitals not performing esophagectomy, hospitals in the highest volume group of esophagectomy showed no decreased risks of 30-day re-intervention (HR = 1.46, 95% CI 0.89-2.39) or surgical re-intervention (HR = 1.21, 95%CI 0.91-1.60) during follow-up. Similarly, the intermediate hospital volume categories of esophageal cancer surgery had no decreased risk of surgical re-interventions after anti-reflux surgery. This study provides no evidence for centralization of primary anti-reflux surgery to centers for esophageal cancer surgery.
Collapse
Affiliation(s)
- Sheraz Markar
- Upper Gastrointestinal Surgery, Department of Molecular Medicine and Surgery, Karolinska Institutet, Karolinska University Hospital, Stockholm, Sweden and.,Department Surgery & Cancer, Imperial College London, London, UK
| | - Giola Santoni
- Upper Gastrointestinal Surgery, Department of Molecular Medicine and Surgery, Karolinska Institutet, Karolinska University Hospital, Stockholm, Sweden and
| | - John Maret-Ouda
- Upper Gastrointestinal Surgery, Department of Molecular Medicine and Surgery, Karolinska Institutet, Karolinska University Hospital, Stockholm, Sweden and
| | - Jesper Lagergren
- Upper Gastrointestinal Surgery, Department of Molecular Medicine and Surgery, Karolinska Institutet, Karolinska University Hospital, Stockholm, Sweden and.,School of Cancer and Pharmaceutical Sciences, King's College London, London, UK
| |
Collapse
|
16
|
Ye J, Tian Y, Li F, van Oostendorp S, Chai Y, Tuynman J, Tong W. Comparison of transanal total mesorectal excision (TaTME) versus laparoscopic TME for rectal cancer: A case matched study. Eur J Surg Oncol 2020; 47:1019-1025. [PMID: 33309105 DOI: 10.1016/j.ejso.2020.11.131] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2020] [Revised: 10/28/2020] [Accepted: 11/20/2020] [Indexed: 12/20/2022] Open
Abstract
BACKGROUND Transanal total mesorectal excision (TaTME) has been developed to improve the quality of laparoscopic TME for patients with rectal cancer. Recently, international concern on TaTME was raised by a national cohort study showing an increased rate of local recurrences. This study aimed to compare clinicopathological and mid-term oncological outcomes of TaTME versus laparoscopic TME (LaTME) for mid and low rectal cancer of a high volume center. METHODS From August 2014 to October 2019, patients with mid or low rectal cancer who received TaTME procedure were identified. The cases were matched with patients treated with LaTME. Data were retrospectively collected including operative details, postoperative morbidity, pathologic results, and oncologic outcomes. Primary endpoint was the local recurrence (LR) rate. RESULTS Propensity score matching yielded 70 patients in each of the groups. There were no statistically significant differences between the 2 groups in terms of postoperative complications, conversion rate to open surgery and circumferential resection margin. Local recurrence occurred in 2 patients (2.9%) in the transanal group, whereas 1 patient developed a local recurrence in the laparoscopic group (1.4%)(p = 0.559). Kaplan-Meier survival analysis showed a 2 year Local recurrence rate 1.5% VS 1.6%(p = 0.934), DFS 88.0% VS 87.7%, OS 94.0% vs 100% for transanal and laparoscopic group, respectively. CONCLUSIONS In a high volume center the transanal total mesorectal procedure is feasible, and appears to be safe alternative to laparoscopic surgery. Oncological outcomes were acceptable and no increased multi or unifocal local recurrence rate was found.
Collapse
Affiliation(s)
- Jingwang Ye
- Department of General Surgery, Daping Hospital, Army Medical University, 400042, Chongqing, China
| | - Yue Tian
- Department of General Surgery, Daping Hospital, Army Medical University, 400042, Chongqing, China
| | - Fan Li
- Department of General Surgery, Daping Hospital, Army Medical University, 400042, Chongqing, China
| | - Stefan van Oostendorp
- Department of Surgery, Amsterdam UMC, Vrije Universiteit Amsterdam, Cancer Center Amsterdam, Amsterdam, the Netherlands
| | - Yiming Chai
- School of Liberal Arts Education, Ningxia Vocational Technical College of Industry and Commerce, Ningxia, China
| | - Jurriaan Tuynman
- Department of Surgery, Amsterdam UMC, Vrije Universiteit Amsterdam, Cancer Center Amsterdam, Amsterdam, the Netherlands
| | - Weidong Tong
- Department of General Surgery, Daping Hospital, Army Medical University, 400042, Chongqing, China.
| |
Collapse
|
17
|
Nazari T, Dankbaar MEW, Sanders DL, Anderegg MCJ, Wiggers T, Simons MP. Learning inguinal hernia repair? A survey of current practice and of preferred methods of surgical residents. Hernia 2020; 24:995-1002. [PMID: 32889641 PMCID: PMC7520418 DOI: 10.1007/s10029-020-02270-y] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2020] [Accepted: 07/16/2020] [Indexed: 12/28/2022]
Abstract
Purpose During surgical residency, many learning methods are available to learn an inguinal hernia repair (IHR). This study aimed to investigate which learning methods are most commonly used and which are perceived as most important by surgical residents for open and endoscopic IHR. Methods European general surgery residents were invited to participate in a 9-item web-based survey that inquired which of the learning methods were used (checking one or more of 13 options) and what their perceived importance was on a 5-point Likert scale (1 = completely not important to 5 = very important). Results In total, 323 residents participated. The five most commonly used learning methods for open and endoscopic IHR were apprenticeship style learning in the operation room (OR) (98% and 96%, respectively), textbooks (67% and 49%, respectively), lectures (50% and 44%, respectively), video-demonstrations (53% and 66%, respectively) and journal articles (54% and 54%, respectively). The three most important learning methods for the open and endoscopic IHR were participation in the OR [5.00 (5.00–5.00) and 5.00 (5.00–5.00), respectively], video-demonstrations [4.00 (4.00–5.00) and 4.00 (4.00–5.00), respectively], and hands-on hernia courses [4.00 (4.00–5.00) and 4.00 (4.00–5.00), respectively]. Conclusion This study demonstrated a discrepancy between learning methods that are currently used by surgical residents to learn the open and endoscopic IHR and preferred learning methods. There is a need for more emphasis on practising before entering the OR. This would support surgical residents’ training by first observing, then practising and finally performing the surgery in the OR. Electronic supplementary material The online version of this article (10.1007/s10029-020-02270-y) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- T Nazari
- Department of Surgery, Erasmus University Medical Center, Rotterdam, The Netherlands.
| | - M E W Dankbaar
- The Institute of Medical Education Research Rotterdam (iMERR), Rotterdam, The Netherlands
- Department of Education, Erasmus University Medical Center, Rotterdam, The Netherlands
| | - D L Sanders
- North Devon District Hospital, Barnstaple, UK
| | - M C J Anderegg
- Department of Surgery, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - T Wiggers
- Incision Academy, Amsterdam, The Netherlands
| | - M P Simons
- Department of Surgery, OLVG, Amsterdam, The Netherlands
| |
Collapse
|
18
|
Accuracy and usefulness in assessing proficiency of the observational clinical human reliability assessment checklist of the open inguinal hernia repair procedure: A cross-sectional study. Int J Surg 2020; 82:156-161. [PMID: 32882402 DOI: 10.1016/j.ijsu.2020.08.032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2020] [Revised: 08/13/2020] [Accepted: 08/20/2020] [Indexed: 11/20/2022]
Abstract
BACKGROUND The Observational Clinical Human Reliability Assessment (OCHRA) can be used to score errors during surgical procedures. To construct an OCHRA-checklist, steps, substeps, and hazards of a surgical procedure need to be defined. A step-by-step framework was developed to segment surgical procedures into steps, substeps, and hazards. The first aim of this study was to investigate if the step-by-step framework could be used to construct an accurate Lichtenstein open inguinal hernia repair (LOIHR) stepwise description. The second aim was to investigate if the OCHRA-checklist based on this stepwise description was accurate and useful for surgical training and assessment. MATERIALS AND METHODS Ten expert surgeons rated statements regarding the accuracy of the LOIHR stepwise description, the accuracy, and the usefulness of the LOIHR OCHRA-checklist (eight, seven, and six statements, respectively) using a 5-point Likert scale. One-sample Wilcoxon signed-rank test was used to compare the outcomes to the neutral value of 3. RESULTS The accuracy of the stepwise description and the accuracy and usefulness of the OCHRA-checklist were rated statistically significantly higher than the neutral value of 3 (median 4.75 [5.00-4.00] with p = .009, median 5.00 [5.00-4.00] with p = .012, median 4.00 [5.00-4.00] with p = .047, respectively). The experts rated the OCHRA-checklist to be useful for the training (5.00 [5.00-4.00], p = .009), and assessment (4.50 [5.00-4.00], p = .010) of surgical residents. CONCLUSION This preliminary study showed that the stepwise LOIHR description constructed using the step-by-step framework was found to be accurate. The LOIHR OCHRA-checklist developed using the stepwise description was also accurate, and particularly useful for the training and assessment of proficiency of surgical residents.
Collapse
|
19
|
Antoun A, Chau J, Alsharqawi N, Kaneva P, Feldman LS, Mueller CL, Lee L. P338: summarizing measures of proficiency in transanal total mesorectal excision—a systematic review. Surg Endosc 2020; 35:4817-4824. [DOI: 10.1007/s00464-020-07935-4] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2020] [Accepted: 08/25/2020] [Indexed: 01/01/2023]
|
20
|
Melstrom KA, Kaiser AM. Role of minimally invasive surgery for rectal cancer. World J Gastroenterol 2020; 26:4394-4414. [PMID: 32874053 PMCID: PMC7438189 DOI: 10.3748/wjg.v26.i30.4394] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/30/2020] [Revised: 05/20/2020] [Accepted: 07/30/2020] [Indexed: 02/06/2023] Open
Abstract
Rectal cancer is one of the most common malignancies worldwide. Surgical resection for rectal cancer usually requires a proctectomy with respective lymphadenectomy (total mesorectal excision). This has traditionally been performed transabdominally through an open incision. Over the last thirty years, minimally invasive surgery platforms have rapidly evolved with the goal to accomplish the same quality rectal resection through a less invasive approach. There are currently three resective modalities that complement the traditional open operation: (1) Laparoscopic surgery; (2) Robotic surgery; and (3) Transanal total mesorectal excision. In addition, there are several platforms to carry out transluminal local excisions (without lymphadenectomy). Evidence on the various modalities is of mixed to moderate quality. It is unreasonable to expect a randomized comparison of all options in a single trial. This review aims at reviewing in detail the various techniques in regard to intra-/perioperative benchmarks, recovery and complications, oncological and functional outcomes.
Collapse
Affiliation(s)
- Kurt A Melstrom
- Division of Colorectal Surgery, Department of Surgery, City of Hope National Medical Center, Duarte, CA 91010-3000, United States
| | - Andreas M Kaiser
- Division of Colorectal Surgery, Department of Surgery, City of Hope National Medical Center, Duarte, CA 91010-3000, United States
| |
Collapse
|
21
|
Fearnhead NS, Acheson AG, Brown SR, Hancock L, Harikrishnan A, Kelly SB, Maxwell‐Armstrong CA, Sagar PM, Siddiqi S, Walsh CJ, Wheeler JMD, Abercrombie JF. The ACPGBI recommends pause for reflection on transanal total mesorectal excision. Colorectal Dis 2020; 22:745-748. [PMID: 32705791 PMCID: PMC7497088 DOI: 10.1111/codi.15143] [Citation(s) in RCA: 34] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/24/2020] [Accepted: 03/05/2020] [Indexed: 12/26/2022]
Affiliation(s)
- N. S. Fearnhead
- Cambridge University Hospitals NHS Foundation TrustCambridgeUK
| | - A. G. Acheson
- Nottingham University Hospitals NHS TrustNottinghamUK
| | - S. R. Brown
- Sheffield Teaching Hospitals NHS Foundation TrustSheffieldUK
| | - L. Hancock
- Wythenshawe HospitalManchester University NHS Foundation TrustManchesterUK
| | - A. Harikrishnan
- Sheffield Teaching Hospitals NHS Foundation TrustSheffieldUK
| | - S. B. Kelly
- Northumbria Healthcare NHS Foundation TrustNewcastle upon TyneUK
| | | | - P. M. Sagar
- Leeds Teaching Hospitals NHS TrustLeedsWest YorkshireUK
| | - S. Siddiqi
- Broomfield HospitalMid Essex Hospital NHS TrustChelmsfordEssexUK
| | - C. J. Walsh
- Arrowe Park HospitalWirral University Teaching Hospital NHS Foundation TrustWirralMerseysideUK
| | | | | | | |
Collapse
|
22
|
van Oostendorp SE, Belgers HJ, Bootsma BT, Hol JC, Belt EJTH, Bleeker W, Den Boer FC, Demirkiran A, Dunker MS, Fabry HFJ, Graaf EJR, Knol JJ, Oosterling SJ, Slooter GD, Sonneveld DJA, Talsma AK, Van Westreenen HL, Kusters M, Hompes R, Bonjer HJ, Sietses C, Tuynman JB. Locoregional recurrences after transanal total mesorectal excision of rectal cancer during implementation. Br J Surg 2020; 107:1211-1220. [PMID: 32246472 PMCID: PMC7496604 DOI: 10.1002/bjs.11525] [Citation(s) in RCA: 75] [Impact Index Per Article: 18.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2019] [Revised: 12/19/2019] [Accepted: 01/13/2020] [Indexed: 12/21/2022]
Abstract
Background Transanal total mesorectal excision (TaTME) has been proposed as an approach in patients with mid and low rectal cancer. The TaTME procedure has been introduced in the Netherlands in a structured training pathway, including proctoring. This study evaluated the local recurrence rate during the implementation phase of TaTME. Methods Oncological outcomes of the first ten TaTME procedures in each of 12 participating centres were collected as part of an external audit of procedure implementation. Data collected from a cohort of patients treated over a prolonged period in four centres were also collected to analyse learning curve effects. The primary outcome was the presence of locoregional recurrence. Results The implementation cohort of 120 patients had a median follow up of 21·9 months. Short‐term outcomes included a positive circumferential resection margin rate of 5·0 per cent and anastomotic leakage rate of 17 per cent. The overall local recurrence rate in the implementation cohort was 10·0 per cent (12 of 120), with a mean(s.d.) interval to recurrence of 15·2(7·0) months. Multifocal local recurrence was present in eight of 12 patients. In the prolonged cohort (266 patients), the overall recurrence rate was 5·6 per cent (4·0 per cent after excluding the first 10 procedures at each centre). Conclusion TaTME was associated with a multifocal local recurrence rate that may be related to suboptimal execution rather than the technique itself. Prolonged proctoring, optimization of the technique to avoid spillage, and quality control is recommended.
Collapse
Affiliation(s)
- S E van Oostendorp
- Department of Surgery, Amsterdam UMC, Location VUmc, Amsterdam, the Netherlands
| | - H J Belgers
- Zuyderland Medical Centre, Sittard-Geleen and Heerlen, Dordrecht, the Netherlands
| | - B T Bootsma
- Department of Surgery, Amsterdam UMC, Location VUmc, Amsterdam, the Netherlands
| | - J C Hol
- Department of Surgery, Amsterdam UMC, Location VUmc, Amsterdam, the Netherlands.,Gelderse Vallei Hospital, Ede, the Netherlands
| | - E J T H Belt
- Albert Schweitzer Hospital, Dordrecht, the Netherlands
| | - W Bleeker
- Wilhelmina Hospital, Assen, the Netherlands
| | | | | | - M S Dunker
- Noord West Hospital, Alkmaar, the Netherlands
| | - H F J Fabry
- Bravis Hospital, Roosendaal, the Netherlands
| | - E J R Graaf
- IJsselland Hospital, Cappelle aan den Ijssel, the Netherlands
| | - J J Knol
- Department of Abdominal Surgery, Jessa Hospital, Hasselt, Belgium
| | | | - G D Slooter
- Maxima Medical Centre, Veldhoven, the Netherlands
| | | | - A K Talsma
- Deventer Hospital, Deventer, the Netherlands
| | | | - M Kusters
- Department of Surgery, Amsterdam UMC, Location VUmc, Amsterdam, the Netherlands
| | - R Hompes
- Department of Surgery, Amsterdam UMC, Location AMC, Cancer Centre Amsterdam, Amsterdam, the Netherlands
| | - H J Bonjer
- Department of Surgery, Amsterdam UMC, Location VUmc, Amsterdam, the Netherlands
| | - C Sietses
- Gelderse Vallei Hospital, Ede, the Netherlands
| | - J B Tuynman
- Department of Surgery, Amsterdam UMC, Location VUmc, Amsterdam, the Netherlands
| |
Collapse
|