1
|
Brocke TK, Fox C, Clanahan JM, Klos CL, Chapman WC, Wise PE, Awad MM, Ohman KA. Extrapolative Validity Evidence of the Anastomosis Objective Structured Assessment of Technical Skill (A-OSATS) for Robotic Ileocolic Anastomosis. JOURNAL OF SURGICAL EDUCATION 2024; 81:1577-1584. [PMID: 39255546 DOI: 10.1016/j.jsurg.2024.07.021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/29/2024] [Revised: 07/24/2024] [Accepted: 07/28/2024] [Indexed: 09/12/2024]
Abstract
OBJECTIVE To collect validity evidence for the use of the Anastomosis Objective Structured Assessment of Technical Skills (A-OSATS) instrument, which has been developed to evaluate performance of a minimally invasive side-to-side bowel anastomosis with hand-sewn common enterotomy. DESIGN Residents performed a robotic ileocolic anastomosis simulation on an ex vivo porcine model. Faculty scored each resident with the A-OSATS and performed a provocative leak test on the completed anastomoses. Residents were reassessed on the sewing sub-score 1 month later. Data were compared with parametric and nonparametric analysis. SETTING Single academic general surgery residency PARTICIPANTS: PGY-4 and -5 general surgery residents (n = 17) RESULTS: PGY-5s performed better than PGY-4s in repeat A-OSATS sewing sub-score (mean 55/55 ± 0 vs 43 ± 4.9, p < 0.001) and time to complete (minutes, mean 14.5 ± 4.9 vs 21.2 ± 3.9, p = 0.01). There was a strong correlation between A-OSATS score and time (r = -0.67, p = 0.005). For the initial assessment, there was no significant difference in mean A-OSATS score between anastomoses that leaked and those that did not leak (137.3 ± 14.5 vs 150.1 ± 11.2, p = 0.098), but on repeat assessment, intact anastomoses had a higher mean A-OSATS sewing sub-score than those that leaked (52.2 ± 4.7 vs 39 ± 3.5, p = 0.007). There was no significant difference between initial A-OSATS score and repeat score (p = 0.14). CONCLUSIONS We provide extrapolative validity evidence for the A-OSATS instrument by comparing A-OSATS score to time to sew, provocative leak test, and discrimination between PGY-4s and PGY-5s. Generalizability validity evidence is provided by test-retest reliability. Further refinement is needed for the A-OSATS tool to be used for high-stakes entrustment decisions in resident-performed robotic ileocolic anastomoses.
Collapse
Affiliation(s)
- Tiffany K Brocke
- Department of Surgery, Washington University School of Medicine, St. Louis, Missouri.
| | - Cory Fox
- Department of Surgery, Washington University School of Medicine, St. Louis, Missouri
| | - Julie M Clanahan
- Department of Surgery, Washington University School of Medicine, St. Louis, Missouri
| | - Coen L Klos
- John Cochran VA Medical Center, St. Louis, Missouri
| | - William C Chapman
- Department of Surgery, Washington University School of Medicine, St. Louis, Missouri
| | - Paul E Wise
- Department of Surgery, Washington University School of Medicine, St. Louis, Missouri
| | - Michael M Awad
- Department of Surgery, Washington University School of Medicine, St. Louis, Missouri
| | - Kerri A Ohman
- Department of Surgery, Washington University School of Medicine, St. Louis, Missouri; John Cochran VA Medical Center, St. Louis, Missouri
| |
Collapse
|
2
|
Lund S, Navarro S, D'Angelo JD, Park YS, Rivera M. Expanded Access to Video-Based Laparoscopic Skills Assessments: Ease, Reliability, and Accuracy. JOURNAL OF SURGICAL EDUCATION 2024; 81:850-857. [PMID: 38664172 DOI: 10.1016/j.jsurg.2024.03.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Revised: 01/29/2024] [Accepted: 03/13/2024] [Indexed: 05/13/2024]
Abstract
OBJECTIVE Video-based performance assessments provide essential feedback to surgical residents, but in-person and remote video-based assessment by trained proctors incurs significant cost. We aimed to determine the reliability, accuracy, and difficulty of untrained attending staff surgeon raters completing video-based assessments of a basic laparoscopic skill. Secondarily, we aimed to compare reliability and accuracy between 2 different types of assessment tools. DESIGN An anonymous survey was distributed electronically to surgical attendings via a national organizational listserv. Survey items included demographics, rating of video-based assessment experience (1 = have never completed video-based assessments, 5 = often complete video-based assessments), and rating of favorability toward video-based and in-person assessments (0 = not favorable, 100 = favorable). Participants watched 2 laparoscopic peg transfer performances, then rated each performance using an Objective Structured Assessment of Technical Skill (OSATS) form and the McGill Inanimate System for Training and Evaluation of Laparoscopic Skills (MISTELS). Participants then rated assessment completion ease (1 = Very Easy, 5 = Very Difficult). SETTING National survey of practicing surgeons. PARTICIPANTS Sixty-one surgery attendings with experience in laparoscopic surgery from 10 institutions participated as untrained raters. Six experienced laparoscopic skills proctors participated as expert raters. RESULTS Inter-rater reliability was substantial for both OSATS (k = 0.75) and MISTELS (k = 0.85). MISTELS accuracy was significantly higher than that of OSATS (κ: MISTELS = 0.18, 95%CI = [0.06,0.29]; OSATS = 0.02, 95%CI = [-0.01,0.04]). While participants were inexperienced with completing video-based assessments (median = 1/5), they perceived video-based assessments favorably (mean = 73.4) and felt assessment completion was "Easy" on average. CONCLUSIONS We demonstrate that faculty raters untrained in simulation-based assessments can successfully complete video-based assessments of basic laparoscopic skills with substantial inter-rater reliability without marked difficulty. These findings suggest an opportunity to increase access to feedback for trainees using video-based assessment of fundamental skills in laparoscopic surgery.
Collapse
Affiliation(s)
- Sarah Lund
- Mayo Clinic Department of Surgery, 200 1st Street SW, Rochester, Minnesota 55905.
| | - Sergio Navarro
- Mayo Clinic Department of Surgery, 200 1st Street SW, Rochester, Minnesota 55905
| | - Jonathan D D'Angelo
- Mayo Clinic Division of Colon and Rectal Surgery, 200 1st Street SW, Rochester, Minnesota 55905
| | - Yoon Soo Park
- Department of Medical Education, University of Illinois at Chicago College of Medicine, 808 S Wood Street, Chicago Illinois 60612
| | - Mariela Rivera
- Mayo Clinic Division of Trauma, Critical Care, and General Surgery, 200 1st Street SW, Rochester, Minnesota 55905
| |
Collapse
|
3
|
Fadel MG, Walshaw J, Pecchini F, Elhadi M, Yiasemidou M, Boal M, Carrano FM, Massey LH, Antoniou SA, Nickel F, Perretta S, Fuchs HF, Hanna GB, Francis NK, Kontovounisios C. European Robotic Surgery Consensus (ERSC): Protocol for the development of a consensus in robotic training for gastrointestinal surgery trainees. PLoS One 2024; 19:e0302648. [PMID: 38820412 PMCID: PMC11142498 DOI: 10.1371/journal.pone.0302648] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2024] [Accepted: 04/06/2024] [Indexed: 06/02/2024] Open
Abstract
BACKGROUND The rapid adoption of robotic surgical systems across Europe has led to a critical gap in training and credentialing for gastrointestinal (GI) surgeons. Currently, there is no existing standardised curriculum to guide robotic training, assessment and certification for GI trainees. This manuscript describes the protocol to achieve a pan-European consensus on the essential components of a comprehensive training programme for GI robotic surgery through a five-stage process. METHODS AND ANALYSIS In Stage 1, a Steering Committee, consisting of international experts, trainees and educationalists, has been established to lead and coordinate the consensus development process. In Stage 2, a systematic review of existing multi-specialty robotic training curricula will be performed to inform the formulation of key position statements. In Stage 3, a comprehensive survey will be disseminated across Europe to capture the current state of robotic training and identify potential challenges and opportunities for improvement. In Stage 4, an international panel of GI surgeons, trainees, and robotic theatre staff will participate in a three-round Delphi process, seeking ≥ 70% agreement on crucial aspects of the training curriculum. Industry and patient representatives will be involved as external advisors throughout this process. In Stage 5, the robotic training curriculum for GI trainees will be finalised in a dedicated consensus meeting, culminating in the production of an Explanation and Elaboration (E&E) document. REGISTRATION DETAILS The study protocol has been registered on the Open Science Framework (https://osf.io/br87d/).
Collapse
Affiliation(s)
- Michael G. Fadel
- Department of Surgery and Cancer, Imperial College London, London, United Kingdom
| | - Josephine Walshaw
- Leeds Institute of Medical Research, St James’s University Hospital, University of Leeds, Leeds, United Kingdom
| | - Francesca Pecchini
- Division of General Surgery, Emergency and New Technologies, Baggiovara General Hospital, Modena, Italy
| | | | - Marina Yiasemidou
- The Royal London Hospital, Barts Health NHS Trust, London, United Kingdom
| | - Matthew Boal
- The Griffin Institute, Northwick Park and St Mark’s Hospital, London, United Kingdom
| | - Francesco Maria Carrano
- Department of Medical and Surgical Sciences and Translational Medicine, Faculty of Medicine and Psychology, St Andrea Hospital, Sapienza University, Rome, Italy
| | - Lisa H. Massey
- Department of Colorectal Surgery, Nottingham University Hospitals NHS Trust, Nottingham, United Kingdom
| | | | - Felix Nickel
- Department of General, Visceral and Thoracic Surgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Silvana Perretta
- IRCAD, Research Institute Against Digestive Cancer, Strasbourg, France
- NHC University Hospital, Strasbourg, France
| | - Hans F. Fuchs
- Department of General, Visceral, Cancer and Transplantation Surgery, University Hospital Cologne, Cologne, Germany
| | - George B. Hanna
- Department of Surgery and Cancer, Imperial College London, London, United Kingdom
| | - Nader K. Francis
- The Griffin Institute, Northwick Park and St Mark’s Hospital, London, United Kingdom
| | - Christos Kontovounisios
- Department of Surgery and Cancer, Imperial College London, London, United Kingdom
- Department of Colorectal Surgery, Chelsea and Westminster Hospital NHS Foundation Trust, London, United Kingdom
- Department of Colorectal Surgery, Royal Marsden NHS Foundation Trust, London, United Kingdom
- 2nd Department of Surgery, Evangelismos Hospital, Athens, Greece
| | | |
Collapse
|
4
|
Tou S, Au S, Clancy C, Clarke S, Collins D, Dixon F, Dreher E, Fleming C, Gallagher AG, Gomez-Ruiz M, Kleijnen J, Maeda Y, Rollins K, Matzel KE. European Society of Coloproctology guideline on training in robotic colorectal surgery (2024). Colorectal Dis 2024; 26:776-801. [PMID: 38429251 DOI: 10.1111/codi.16904] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/13/2024] [Accepted: 01/14/2024] [Indexed: 03/03/2024]
Affiliation(s)
- Samson Tou
- Department of Colorectal Surgery, University Hospitals of Derby and Burton NHS Foundation Trust, Derby, UK
- School of Medicine, University of Nottingham, Derby, UK
| | | | - Cillian Clancy
- Department of Colorectal Surgery, Tallaght University Hospital, Dublin, Ireland
| | - Steven Clarke
- University Hospitals of Derby and Burton NHS Foundation Trust, Derby, UK
| | - Danielle Collins
- Department of Colorectal Surgery, Western General Hospital, NHS Lothian, Edinburgh, Scotland
| | - Frances Dixon
- Department of Colorectal Surgery, Milton Keynes University Hospital NHS Foundation Trust, Milton Keynes, UK
| | - Elizabeth Dreher
- Department of Urology, University Hospitals of Derby and Burton NHS Foundation Trust, Derby, UK
| | - Christina Fleming
- Department of Colorectal Surgery, University Hospital Limerick, Limerick, Ireland
| | | | - Marcos Gomez-Ruiz
- Colorectal Surgery Unit, General Surgery Department, Marqués de Valdecilla University Hospital, Santander, Spain
- Valdecilla Biomedical Research Institute (IDIVAL), Santander, Spain
| | - Jos Kleijnen
- Kleijnen Systematic Reviews Ltd, York, UK
- School for Public Health and Primary Care (CAPHRI), Maastricht University, Maastricht, the Netherlands
| | - Yasuko Maeda
- Department of Surgery, Queen Elizabeth University Hospital, Glasgow, UK
| | - Katie Rollins
- Gastrointestinal Surgery, Nottingham Digestive Diseases Centre, National Institute for Health Research (NIHR) Nottingham Biomedical Research Centre, Nottingham, UK
| | - Klaus E Matzel
- Section of Coloproctology, Department of Surgery, University of Erlangen-Nürnberg, FAU, Erlangen, Germany
| |
Collapse
|
5
|
Boal MWE, Anastasiou D, Tesfai F, Ghamrawi W, Mazomenos E, Curtis N, Collins JW, Sridhar A, Kelly J, Stoyanov D, Francis NK. Evaluation of objective tools and artificial intelligence in robotic surgery technical skills assessment: a systematic review. Br J Surg 2024; 111:znad331. [PMID: 37951600 PMCID: PMC10771126 DOI: 10.1093/bjs/znad331] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Revised: 09/18/2023] [Accepted: 09/19/2023] [Indexed: 11/14/2023]
Abstract
BACKGROUND There is a need to standardize training in robotic surgery, including objective assessment for accreditation. This systematic review aimed to identify objective tools for technical skills assessment, providing evaluation statuses to guide research and inform implementation into training curricula. METHODS A systematic literature search was conducted in accordance with the PRISMA guidelines. Ovid Embase/Medline, PubMed and Web of Science were searched. Inclusion criterion: robotic surgery technical skills tools. Exclusion criteria: non-technical, laparoscopy or open skills only. Manual tools and automated performance metrics (APMs) were analysed using Messick's concept of validity and the Oxford Centre of Evidence-Based Medicine (OCEBM) Levels of Evidence and Recommendation (LoR). A bespoke tool analysed artificial intelligence (AI) studies. The Modified Downs-Black checklist was used to assess risk of bias. RESULTS Two hundred and forty-seven studies were analysed, identifying: 8 global rating scales, 26 procedure-/task-specific tools, 3 main error-based methods, 10 simulators, 28 studies analysing APMs and 53 AI studies. Global Evaluative Assessment of Robotic Skills and the da Vinci Skills Simulator were the most evaluated tools at LoR 1 (OCEBM). Three procedure-specific tools, 3 error-based methods and 1 non-simulator APMs reached LoR 2. AI models estimated outcomes (skill or clinical), demonstrating superior accuracy rates in the laboratory with 60 per cent of methods reporting accuracies over 90 per cent, compared to real surgery ranging from 67 to 100 per cent. CONCLUSIONS Manual and automated assessment tools for robotic surgery are not well validated and require further evaluation before use in accreditation processes.PROSPERO: registration ID CRD42022304901.
Collapse
Affiliation(s)
- Matthew W E Boal
- The Griffin Institute, Northwick Park & St Marks’ Hospital, London, UK
- Wellcome/ESPRC Centre for Interventional Surgical Sciences (WEISS), University College London (UCL), London, UK
- Division of Surgery and Interventional Science, Research Department of Targeted Intervention, UCL, London, UK
| | - Dimitrios Anastasiou
- Wellcome/ESPRC Centre for Interventional Surgical Sciences (WEISS), University College London (UCL), London, UK
- Medical Physics and Biomedical Engineering, UCL, London, UK
| | - Freweini Tesfai
- The Griffin Institute, Northwick Park & St Marks’ Hospital, London, UK
- Wellcome/ESPRC Centre for Interventional Surgical Sciences (WEISS), University College London (UCL), London, UK
| | - Walaa Ghamrawi
- The Griffin Institute, Northwick Park & St Marks’ Hospital, London, UK
| | - Evangelos Mazomenos
- Wellcome/ESPRC Centre for Interventional Surgical Sciences (WEISS), University College London (UCL), London, UK
- Medical Physics and Biomedical Engineering, UCL, London, UK
| | - Nathan Curtis
- Department of General Surgey, Dorset County Hospital NHS Foundation Trust, Dorchester, UK
| | - Justin W Collins
- Division of Surgery and Interventional Science, Research Department of Targeted Intervention, UCL, London, UK
- University College London Hospitals NHS Foundation Trust, London, UK
| | - Ashwin Sridhar
- Division of Surgery and Interventional Science, Research Department of Targeted Intervention, UCL, London, UK
- University College London Hospitals NHS Foundation Trust, London, UK
| | - John Kelly
- Division of Surgery and Interventional Science, Research Department of Targeted Intervention, UCL, London, UK
- University College London Hospitals NHS Foundation Trust, London, UK
| | - Danail Stoyanov
- Wellcome/ESPRC Centre for Interventional Surgical Sciences (WEISS), University College London (UCL), London, UK
- Computer Science, UCL, London, UK
| | - Nader K Francis
- The Griffin Institute, Northwick Park & St Marks’ Hospital, London, UK
- Division of Surgery and Interventional Science, Research Department of Targeted Intervention, UCL, London, UK
- Yeovil District Hospital, Somerset Foundation NHS Trust, Yeovil, Somerset, UK
| |
Collapse
|
6
|
Rudiman R, Mirbagheri A, Candrawinata VS. Assessment of robotic telesurgery system among surgeons: a single-center study. J Robot Surg 2023; 17:2757-2761. [PMID: 37710051 PMCID: PMC10678790 DOI: 10.1007/s11701-023-01709-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 09/01/2023] [Indexed: 09/16/2023]
Abstract
The field of robotic-assisted surgery is expanding rapidly; therefore, future robotic surgeons will need to be trained in an organized manner. Here, we aimed to examine surgeon performance on the Sinaflex Robotic Telesurgery System for correlation with training hours spent in training program. This is a prospective study of a single-center experience at the Hasan Sadikin Hospital, Bandung City of West Java, Indonesia. We included 43 surgeons from 11 departments, all invited to train using the Sinaflex Robotic Telesurgery system at the Hasan Sadikin Hospital. All study cohorts have never performed a robotic surgery procedure beforehand and have had at least five years of field experience. The surgeons were free to choose their training duration and simulation. After finishing the training session, they were asked to perform several tasks with increasing difficulty levels. There were nine training tasks in total with increasing levels of difficulty. A total of 43 surgeons from 11 different department were included in this prospective study. Our study was separated into 3 different batches and most surgeons failed to pass the examination (n = 12, 8, and 9, for batches 1, 2, and 3, respectively). The "failed" surgeon, additionally, tended to be older than the "passed" cohort (49.3 ± 7.4 vs 42.1 ± 7.3 years old, p = 0.005). In terms of duration of hours spent training on the robot, there was little difference training hours between the cohort that passed and the cohort that failed cohort (10.0 [8.4-10.1] vs 10.0 [8.0-10.0], respectively) with a p value of 0.265. We found no correlation between the total hours spent in the training program and surgeon performance on the Sinaflex robotic telesurgery system. Structured robot surgical training courses must be incorporated into the training programs.
Collapse
Affiliation(s)
- Reno Rudiman
- Division of Digestive Surgery, Department of Surgery, Faculty of Medicine, Hasan Sadikin Hospital, Universitas Padjadjaran, West Java, Bandung, Indonesia.
| | - Alireza Mirbagheri
- Department of Medical Physics and Biomedical Engineering, School of Medicine and also Research Center for Biomedical Technologies and Robotics (RCBTR), Advanced Medical Technologies and Equipment Institute (AMTEI), both at Tehran University of Medical Sciences, Tehran, Iran
| | | |
Collapse
|
7
|
Xia J, Wu J, Chen H, Mao J, Xu X, Zhang J, Yang J, Wang Z. Assessment of laparoscopic intracorporeal intestinal anastomosis training using simulation-based 3D printed models: exploring surgical performance and learning curves. Int J Surg 2023; 109:2953-2961. [PMID: 37498142 PMCID: PMC10583936 DOI: 10.1097/js9.0000000000000582] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2023] [Accepted: 06/25/2023] [Indexed: 07/28/2023]
Abstract
BACKGROUND AND AIMS Intestinal anastomosis is a clinical procedure widely used to reconstruct the digestive tract, but authentic laparoscopic intracorporeal intestinal anastomosis (LIIA) models are lacking. However, three-dimensional (3D) printing can enable authentic and reusable models. In this paper, a novel cost-effective 3D-printing training model of LIIA is designed and the authenticity and validity of the model are tested. METHODS A fused deposition modeling 3D printing and an assembled lab model were built to test LIIA. Fifteen surgeons were required to perform LIIA, and their operation score and time were recorded and analyzed. Five experts were invited to assess the face and content validity of the models. A study was also performed to further evaluate and validate the learning curve of surgeons. RESULTS The difference in modified anastomosis objective structured assessment of technical skills (MAOSATS) scores between the expert, intermediate, and novice groups were significant (64.1±1.8: 48.5±1.7: 29.5±3.1, P <0.001). In addition, the operation time of the procedure was statistically different for all three groups (21.5±1.9: 30.6±2.8:70.7±4.0, P<0.001 ). The five experts rated the face and content validity of the model very highly, with the median being four out of five. Surgeons who underwent repeated training programs showed improved surgical performance. After eight training sessions, the novices' performance was similar to that of the average level of untrained intermediates, while the operation scores of the intermediates were close to that of the average level of experts. CONCLUSIONS In this study, it is found that the LIIA model exhibits excellent face, content, and construct validity. Repeated simulation training of the LIIA training program improved the surgeon's operative performance, so the model is considered one of the most effective methods for LIIA training and assessment of surgical quality in the future and for reducing healthcare costs.
Collapse
Affiliation(s)
- Jianfu Xia
- Department of General Surgery, The Dingli Clinical College of Wenzhou Medical University, Wenzhou Central Hospital, Wenzhou
- Department of Clinical Medicine, Suzhou Medical College of Soochow University, Suzhou
- Department of Hernia Surgery, Zhejiang Provincial People’s Hospital, Affiliated People’s Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China
| | - Junjie Wu
- School of Public Health, Hangzhou Medical College, Hangzhou, Zhejiang, China
| | - Hao Chen
- The Second Clinical Medical College, Zhejiang Chinese Medical University
| | - Jinlei Mao
- The Second Clinical Medical College, Zhejiang Chinese Medical University
| | - Xiaodong Xu
- College of Materials Science and Engineering, Zhejiang University of Technology
| | - Jing Zhang
- College of Materials Science and Engineering, Zhejiang University of Technology
| | - Jin Yang
- Department of General Surgery, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou, People’s Republic of China
| | - Zhifei Wang
- Department of Hernia Surgery, Zhejiang Provincial People’s Hospital, Affiliated People’s Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China
| |
Collapse
|
8
|
Haney CM, Kowalewski KF, Schmidt MW, Lang F, Bintintan V, Fan C, Wehrtmann F, Studier-Fischer A, Felinska EA, Müller-Stich BP, Nickel F. Robotic-assisted versus laparoscopic bowel anastomoses: randomized crossover in vivo experimental study. Surg Endosc 2023; 37:5894-5901. [PMID: 37072638 PMCID: PMC10338398 DOI: 10.1007/s00464-023-10044-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2023] [Accepted: 03/25/2023] [Indexed: 04/20/2023]
Abstract
BACKGROUND Initial learning curves are potentially shorter in robotic-assisted surgery (RAS) than in conventional laparoscopic surgery (LS). There is little evidence to support this claim. Furthermore, there is limited evidence how skills from LS transfer to RAS. METHODS A randomized controlled, assessor blinded crossover study to compare how RAS naïve surgeons (n = 40) performed linear-stapled side-to-side bowel anastomoses in an in vivo porcine model with LS and RAS. Technique was rated using the validated anastomosis objective structured assessment of skills (A-OSATS) score and the conventional OSATS score. Skill transfer from LS to RAS was measured by comparing the RAS performance of LS novices and LS experienced surgeons. Mental and physical workload was measured with the NASA-task load index (NASA-Tlx) and the Borg-scale. OUTCOMES In the overall cohort, there were no differences between RAS and LS for surgical performance (A-OSATS, time, OSATS). Surgeons that were naïve in both LS and RAS had significantly higher A-OSATS scores in RAS (Mean (Standard deviation (SD)): LS: 48.0 ± 12.1; RAS: 52.0 ± 7.5); p = 0.044) mainly deriving from better bowel positioning (LS: 8.7 ± 1.4; RAS: 9.3 ± 1.0; p = 0.045) and closure of enterotomy (LS: 12.8 ± 5.5; RAS: 15.6 ± 4.7; p = 0.010). There was no statistically significant difference in how LS novices and LS experienced surgeons performed in RAS [Mean (SD): novices: 48.9 ± 9.0; experienced surgeons: 55.9 ± 11.0; p = 0.540]. Mental and physical demand was significantly higher after LS. CONCLUSION The initial performance was improved for RAS versus LS for linear stapled bowel anastomosis, whereas workload was higher for LS. There was limited transfer of skills from LS to RAS.
Collapse
Affiliation(s)
- Caelán Max Haney
- Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
- Department of Urology, University Hospital Leipzig, Liebigstraße 20, 04103, Leipzig, Germany
| | - Karl-Friedrich Kowalewski
- Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
- Department of Urology, University Medical Center Mannheim, University of Heidelberg, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany
| | - Mona Wanda Schmidt
- Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
| | - Franziska Lang
- Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
| | - Vasile Bintintan
- Department of Surgery, University Hospital Cluj Napoca, Cluj-Napoca, Romania
| | - Carolyn Fan
- Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
| | - Fabian Wehrtmann
- Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
| | - Alexander Studier-Fischer
- Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
| | - Eleni Amelia Felinska
- Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
| | - Beat Peter Müller-Stich
- Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
- Department of Surgery, Clarunis University Center for Gastrointestinal and Liver Disease, University Hospital and St. Clara Hospital Basel, Basel, Switzerland
| | - Felix Nickel
- Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany.
- Department of General, Visceral, and Thoracic Surgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
| |
Collapse
|
9
|
Karadza E, Haney CM, Limen EF, Müller PC, Kowalewski KF, Sandini M, Wennberg E, Schmidt MW, Felinska EA, Lang F, Salg G, Kenngott HG, Rangelova E, Mieog S, Vissers F, Korrel M, Zwart M, Sauvanet A, Loos M, Mehrabi A, de Santibanes M, Shrikhande SV, Abu Hilal M, Besselink MG, Müller-Stich BP, Hackert T, Nickel F. Development of biotissue training models for anastomotic suturing in pancreatic surgery. HPB (Oxford) 2023:S1365-182X(23)00041-2. [PMID: 36828741 DOI: 10.1016/j.hpb.2023.02.002] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/29/2022] [Revised: 12/11/2022] [Accepted: 02/06/2023] [Indexed: 02/26/2023]
Abstract
BACKGROUND Anastomotic suturing is the Achilles heel of pancreatic surgery. Especially in laparoscopic and robotically assisted surgery, the pancreatic anastomosis should first be trained outside the operating room. Realistic training models are therefore needed. METHODS Models of the pancreas, small bowel, stomach, bile duct, and a realistic training torso were developed for training of anastomoses in pancreatic surgery. Pancreas models with soft and hard textures, small and large ducts were incrementally developed and evaluated. Experienced pancreatic surgeons (n = 44) evaluated haptic realism, rigidity, fragility of tissues, and realism of suturing and knot tying. RESULTS In the iterative development process the pancreas models showed high haptic realism and highest realism in suturing (4.6 ± 0.7 and 4.9 ± 0.5 on 1-5 Likert scale, soft pancreas). The small bowel model showed highest haptic realism (4.8 ± 0.4) and optimal wall thickness (0.1 ± 0.4 on -2 to +2 Likert scale) and suturing behavior (0.1 ± 0.4). The bile duct models showed optimal wall thickness (0.3 ± 0.8 and 0.4 ± 0.8 on -2 to +2 Likert scale) and optimal tissue fragility (0 ± 0.9 and 0.3 ± 0.7). CONCLUSION The biotissue training models showed high haptic realism and realistic suturing behavior. They are suitable for realistic training of anastomoses in pancreatic surgery which may improve patient outcomes.
Collapse
Affiliation(s)
- Emir Karadza
- Department of General, Visceral and Transplantation Surgery at Heidelberg University Hospital, Heidelberg, Germany
| | - Caelan M Haney
- Department of General, Visceral and Transplantation Surgery at Heidelberg University Hospital, Heidelberg, Germany
| | - Eldridge F Limen
- Department of General, Visceral and Transplantation Surgery at Heidelberg University Hospital, Heidelberg, Germany
| | - Philip C Müller
- Department of Surgery and Transplantation, Swiss HPB and Transplantation Center, University Hospital Zürich, Zürich, Switzerland
| | - Karl-Friedrich Kowalewski
- Department of Urology and Urooncological Surgery, University Medical Center Mannheim, Mannheim, Germany
| | - Marta Sandini
- Department of General, Visceral and Transplantation Surgery at Heidelberg University Hospital, Heidelberg, Germany
| | - Erica Wennberg
- Department of General, Visceral and Transplantation Surgery at Heidelberg University Hospital, Heidelberg, Germany
| | - Mona W Schmidt
- Department of Gynecology and Obstetrics, University Medical Center Mainz, Mainz, Germany
| | - Eleni A Felinska
- Department of General, Visceral and Transplantation Surgery at Heidelberg University Hospital, Heidelberg, Germany
| | - Franziska Lang
- Department of General, Visceral and Transplantation Surgery at Heidelberg University Hospital, Heidelberg, Germany
| | - Gabriel Salg
- Department of General, Visceral and Transplantation Surgery at Heidelberg University Hospital, Heidelberg, Germany
| | - Hannes G Kenngott
- Department of General, Visceral and Transplantation Surgery at Heidelberg University Hospital, Heidelberg, Germany
| | - Elena Rangelova
- Section for Upper Abdominal Surgery at Department of Surgery, Sahlgrenska University Hospital, Gothenburg, Sweden
| | - Sven Mieog
- Department of Surgery, Leiden University Medical Center, Leiden, the Netherlands
| | - Frederique Vissers
- Department of Surgery, Amsterdam UMC, University of Amsterdam, Cancer Center Amsterdam, the Netherlands
| | - Maarten Korrel
- Department of Surgery, Amsterdam UMC, University of Amsterdam, Cancer Center Amsterdam, the Netherlands
| | - Maurice Zwart
- Department of Surgery, Amsterdam UMC, University of Amsterdam, Cancer Center Amsterdam, the Netherlands
| | - Alain Sauvanet
- Department of HPB Surgery, Hôpital Beaujon, Clichy-Paris, France
| | - Martin Loos
- Department of General, Visceral and Transplantation Surgery at Heidelberg University Hospital, Heidelberg, Germany
| | - Arianeb Mehrabi
- Department of General, Visceral and Transplantation Surgery at Heidelberg University Hospital, Heidelberg, Germany
| | - Martin de Santibanes
- Department of Surgery, Hospital Italiano de Buenos Aires, Buenos Aires, Argentina
| | | | - Mohammad Abu Hilal
- Department of Surgery, Instituto Fondazione Poliambulanza, Brescia, Italy
| | - Marc G Besselink
- Department of Surgery, Amsterdam UMC, University of Amsterdam, Cancer Center Amsterdam, the Netherlands
| | - Beat P Müller-Stich
- Department of General, Visceral and Transplantation Surgery at Heidelberg University Hospital, Heidelberg, Germany
| | - Thilo Hackert
- Department of General, Visceral and Transplantation Surgery at Heidelberg University Hospital, Heidelberg, Germany
| | - Felix Nickel
- Department of General, Visceral and Transplantation Surgery at Heidelberg University Hospital, Heidelberg, Germany.
| |
Collapse
|
10
|
Younes MM, Larkins K, To G, Burke G, Heriot A, Warrier S, Mohan H. What are clinically relevant performance metrics in robotic surgery? A systematic review of the literature. J Robot Surg 2022; 17:335-350. [PMID: 36190655 PMCID: PMC10076398 DOI: 10.1007/s11701-022-01457-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Accepted: 09/17/2022] [Indexed: 10/10/2022]
Abstract
A crucial element of any surgical training program is the ability to provide procedure-specific, objective, and reliable measures of performance. During robotic surgery, objective clinically relevant performance metrics (CRPMs) can provide tailored contextual feedback and correlate with clinical outcomes. This review aims to define CRPMs, assess their validity in robotic surgical training and compare CRPMs to existing measures of robotic performance. A systematic search of Medline and Embase databases was conducted in May 2022 following the PRISMA guidelines. The search terms included Clinically Relevant Performance Metrics (CRPMs) OR Clinically Relevant Outcome Measures (CROMs) AND robotic surgery. The study settings, speciality, operative context, study design, metric details, and validation status were extracted and analysed. The initial search yielded 116 citations, of which 6 were included. Citation searching identified 3 additional studies, resulting in 9 studies included in this review. Metrics were defined as CRPMs, CROMs, proficiency-based performance metrics and reference-procedure metrics which were developed using a modified Delphi methodology. All metrics underwent both contents and construct validation. Two studies found a strong correlation with GEARS but none correlated their metrics with patient outcome data. CRPMs are a validated and objective approach for assessing trainee proficiency. Evaluating CRPMs with other robotic-assessment tools will facilitate a multimodal metric evaluation approach to robotic surgery training. Further studies should assess the correlation with clinical outcomes. This review highlights there is significant scope for the development and validation of CRPMs to establish proficiency-based progression curricula that can be translated from a simulation setting into clinical practice.
Collapse
Affiliation(s)
- Melissa M Younes
- The University of Melbourne, 305 Grattan Street, Parkville, VIC, Australia
| | - Kirsten Larkins
- The University of Melbourne, 305 Grattan Street, Parkville, VIC, Australia. .,Peter MacCallum Cancer Centre, Melbourne, VIC, Australia.
| | - Gloria To
- The University of Melbourne, 305 Grattan Street, Parkville, VIC, Australia
| | - Grace Burke
- International Medical Robotics Academy, North Melbourne, VIC, Australia
| | - Alexander Heriot
- The University of Melbourne, 305 Grattan Street, Parkville, VIC, Australia.,Peter MacCallum Cancer Centre, Melbourne, VIC, Australia.,International Medical Robotics Academy, North Melbourne, VIC, Australia
| | - Satish Warrier
- The University of Melbourne, 305 Grattan Street, Parkville, VIC, Australia.,Peter MacCallum Cancer Centre, Melbourne, VIC, Australia.,International Medical Robotics Academy, North Melbourne, VIC, Australia.,Monash University, Clayton, VIC, Australia
| | - Helen Mohan
- The University of Melbourne, 305 Grattan Street, Parkville, VIC, Australia.,Peter MacCallum Cancer Centre, Melbourne, VIC, Australia.,Austin Health, Heidelberg, VIC, Australia
| |
Collapse
|
11
|
Effectivity of Distance Learning in the Training of Basic Surgical Skills—A Randomized Controlled Trial. SUSTAINABILITY 2022. [DOI: 10.3390/su14084727] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
Background: Distance learning is an interactive way of education when teachers and students are physically separated. Our purpose was to examine its effectivity in training of basic surgical techniques and to provide an alternative sustainable methodology for the training of medical professionals. Methods: Sixty students were involved in our single blinded randomized controlled study. Six homogenized groups were created then randomized into three groups of distance learning and three groups of in-person teaching. The groups completed the same curriculum using our own “SkillBox”. All students took the same pre- and post-course test evaluated blindly. The students filled out an online feedback form after the course. A financial analysis was also made. Results: There was no significant difference in the post-course exam results (distance 28.200 vs. in-person 25.200). We managed to achieve significantly better improvements in the distance learning of suturing (distance 19.967 vs. in-person 15.900, p = 0.043). According to 93% of the study group students, the quality of teaching did not decrease compared to the traditional classes. Conclusion: The results of the students improved similarly in distance learning and in-person education. The online form of teaching was received positively among the students; they found it an effective and good alternative.
Collapse
|