1
|
Hashimoto DA, Sambasastry SK, Singh V, Kurada S, Altieri M, Yoshida T, Madani A, Jogan M. A foundation for evaluating the surgical artificial intelligence literature. EUROPEAN JOURNAL OF SURGICAL ONCOLOGY 2024:108014. [PMID: 38360498 DOI: 10.1016/j.ejso.2024.108014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2023] [Revised: 01/06/2024] [Accepted: 02/09/2024] [Indexed: 02/17/2024]
Abstract
With increasing growth in applications of artificial intelligence (AI) in surgery, it has become essential for surgeons to gain a foundation of knowledge to critically appraise the scientific literature, commercial claims regarding products, and regulatory and legal frameworks that govern the development and use of AI. This guide offers surgeons a framework with which to evaluate manuscripts that incorporate the use of AI. It provides a glossary of common terms, an overview of prerequisite knowledge to maximize understanding of methodology, and recommendations on how to carefully consider each element of a manuscript to assess the quality of the data on which an algorithm was trained, the appropriateness of the methodological approach, the potential for reproducibility of the experiment, and the applicability to surgical practice, including considerations on generalizability and scalability.
Collapse
Affiliation(s)
- Daniel A Hashimoto
- Penn Computer Assisted Surgery and Outcomes Laboratory, Department of Surgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA; School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA, USA; Global Surgical AI Collaborative, Toronto, ON, USA.
| | - Sai Koushik Sambasastry
- Penn Computer Assisted Surgery and Outcomes Laboratory, Department of Surgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA; School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA, USA
| | - Vivek Singh
- Penn Computer Assisted Surgery and Outcomes Laboratory, Department of Surgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Sruthi Kurada
- Penn Computer Assisted Surgery and Outcomes Laboratory, Department of Surgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA; School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA, USA
| | - Maria Altieri
- Penn Computer Assisted Surgery and Outcomes Laboratory, Department of Surgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA; Global Surgical AI Collaborative, Toronto, ON, USA
| | - Takuto Yoshida
- Surgical AI Research Academy, Department of Surgery, University Health Network, Toronto, ON, USA
| | - Amin Madani
- Global Surgical AI Collaborative, Toronto, ON, USA; Surgical AI Research Academy, Department of Surgery, University Health Network, Toronto, ON, USA
| | - Matjaz Jogan
- Penn Computer Assisted Surgery and Outcomes Laboratory, Department of Surgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| |
Collapse
|
2
|
Grover K, Mowoh DP, Chatha HN, Mallidi A, Sarvepalli S, Peery C, Galvani C, Havaleshko D, Taggar A, Khaitan L, Abbas M. A cognitive task analysis of expert surgeons performing the robotic roux-en-y gastric bypass. Surg Endosc 2023; 37:9523-9532. [PMID: 37702879 DOI: 10.1007/s00464-023-10354-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Accepted: 07/30/2023] [Indexed: 09/14/2023]
Abstract
BACKGROUND The safe and effective performance of a robotic roux-en-y gastric bypass (RRNY) requires the application of a complex body of knowledge and skills. This qualitative study aims to: (1) define the tasks, subtasks, decision points, and pitfalls in a RRNY; (2) create a framework upon which training and objective evaluation of a RRNY can be based. METHODS Hierarchical and cognitive task analyses for a RRNY were performed using semi-structured interviews of expert bariatric surgeons to describe the thoughts and behaviors that exemplify optimal performance. Verbal data was recorded, transcribed verbatim, supplemented with literary and video resources, coded, and thematically analyzed. RESULTS A conceptual framework was synthesized based on three book chapters, three articles, eight online videos, nine field observations, and interviews of four subject matter experts (SME). At the time of the interview, SME had practiced a median of 12.5 years and had completed a median of 424 RRNY cases. They estimated the number of RRNY to achieve competence and expertise were 25 cases and 237.5 cases, respectively. After four rounds of inductive analysis, 83 subtasks, 75 potential errors, 60 technical tips, and 15 decision points were identified and categorized into eight major procedural steps (pre-procedure preparation, abdominal entry & port placement, gastric pouch creation, omega loop creation, gastrojejunal anastomosis, jejunojejunal anastomosis, closure of mesenteric defects, leak test & port closure). Nine cognitive behaviors were elucidated (respect for patient-specific factors, tactical modification, adherence to core surgical principles, task completion, judicious technique & instrument selection, visuospatial awareness, team-based communication, anticipation & forward planning, finessed tissue handling). CONCLUSION This study defines the key elements that formed the basis of a conceptual framework used by expert bariatric surgeons to perform the RRNY safely and effectively. This framework has the potential to serve as foundational tool for training novices.
Collapse
Affiliation(s)
- Karan Grover
- Department of Surgery, University Hospitals Cleveland Medical Center, 11100 Euclid Ave, Lakeside 7, Cleveland, OH, 44106-5047, USA.
| | - Daniel Praise Mowoh
- Department of Surgery, University Hospitals Cleveland Medical Center, 11100 Euclid Ave, Lakeside 7, Cleveland, OH, 44106-5047, USA
| | | | - Ajitha Mallidi
- Department of Surgery, University Hospitals Cleveland Medical Center, 11100 Euclid Ave, Lakeside 7, Cleveland, OH, 44106-5047, USA
| | - Shravan Sarvepalli
- Department of Surgery, University Hospitals Cleveland Medical Center, 11100 Euclid Ave, Lakeside 7, Cleveland, OH, 44106-5047, USA
| | | | - Carlos Galvani
- Department of Surgery, Tulane University School of Medicine, New Orleans, LA, USA
| | | | - Amit Taggar
- Florida Surgical Weight Loss Centers, Tampa, FL, USA
| | - Leena Khaitan
- Department of Surgery, University Hospitals Cleveland Medical Center, 11100 Euclid Ave, Lakeside 7, Cleveland, OH, 44106-5047, USA
| | - Mujjahid Abbas
- Department of Surgery, University Hospitals Cleveland Medical Center, 11100 Euclid Ave, Lakeside 7, Cleveland, OH, 44106-5047, USA
| |
Collapse
|
3
|
Grover K, Korenblit N, Babu A, Podolsky D, Carbonell A, Orenstein S, Pauli EM, Novitsky Y, Madani A, Sullivan M, Nieman D. Understanding How Experts Do It: A Conceptual Framework for the Open Transversus Abdominis Release Procedure. Ann Surg 2023; 277:498-505. [PMID: 36538631 DOI: 10.1097/sla.0000000000005756] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
BACKGROUND The safe and effective performance of a posterior component separation via a transversus abdominis release (TAR) requires intraoperative judgement and decision-making skills that are difficult to define, standardize, and teach. We herein present the first qualitative study which builds a framework upon which training and objective evaluation of a TAR can be based. METHODS Hierarchical and cognitive task analyses for a TAR procedure were performed using semistructured interviews of hernia experts to describe the thoughts and behaviors that exemplify optimal performance. Verbal data was recorded, transcribed, coded, and thematically analyzed. RESULTS A conceptual framework was synthesized based on literary sources (4 book chapters, 4 peer-reviewed articles, 3 online videos), 2 field observations, and interviews of 4 hernia experts [median 66 minutes (44-78)]. Subject matter experts practiced a median of 6.5 years (1.5-16) and have completed a median of 300 (60-500) TARs. After 5 rounds of inductive analysis, 80 subtasks, 86 potential errors, 36 cognitive behaviors, and 17 decision points were identified and categorized into 10 procedural steps (midline laparotomy, adhesiolysis, retrorectus dissection, etc.) and 9 fundamental principles: patient physiology and disease burden; tactical modification; tissue reconstruction and wound healing; task completion; choice of technique and instruments; safe planes and danger zones; exposure, ergonomics, environmental limitations; anticipation and forward planning; and tissue trauma and handling. CONCLUSION This is the first study to define the key tasks, decisions, and cognitive behaviors that are essential to a successful TAR procedure.
Collapse
Affiliation(s)
- Karan Grover
- Division of General Surgery, Rutgers Biomedical and Health Sciences-Robert Wood Johnson Medical School, New Brunswick, NJ
| | - Nechama Korenblit
- Division of General Surgery, Rutgers Biomedical and Health Sciences-Robert Wood Johnson Medical School, New Brunswick, NJ
| | - Archana Babu
- Division of General Surgery, Jefferson Medical Center, Philadelphia, PA
| | - Dina Podolsky
- Division of General Surgery, Columbia University Medical Center, New York, NY
| | - Alfredo Carbonell
- Department of Surgery, University of South Carolina School of Medicine-Greenville/Prisma Health, Greenville, SC
| | - Sean Orenstein
- Division of Gastrointestinal and General Surgery, Oregon Health and Science University School of Medicine, Portland, OR
| | - Eric M Pauli
- Department of Surgery, Penn State Hershey Medical Center, Hershey, PA
| | - Yuri Novitsky
- Division of General Surgery, Columbia University Medical Center, New York, NY
| | - Amin Madani
- Division of General Surgery, University Health Network - Toronto General Hospital, Toronto, Canada
| | - Maura Sullivan
- Surgical Skills Simulation and Education Center, Keck School of Medicine, Los Angeles, CA
| | - Dylan Nieman
- Division of General Surgery, Rutgers Biomedical and Health Sciences-Robert Wood Johnson Medical School, New Brunswick, NJ
| |
Collapse
|
4
|
Khalid MU, Laplante S, Madani A. Machines with vision for intraoperative guidance during gastrointestinal cancer surgery. Front Med (Lausanne) 2022; 9:1025382. [PMID: 36250078 PMCID: PMC9561352 DOI: 10.3389/fmed.2022.1025382] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2022] [Accepted: 09/15/2022] [Indexed: 11/13/2022] Open
Affiliation(s)
| | - Simon Laplante
- Department of Surgery, University of Toronto, Toronto, ON, Canada
- Surgical Artificial Intelligence Research Academy, University Health Network, Toronto, ON, Canada
| | - Amin Madani
- Department of Surgery, University of Toronto, Toronto, ON, Canada
- Surgical Artificial Intelligence Research Academy, University Health Network, Toronto, ON, Canada
| |
Collapse
|
5
|
Lee JA. Kui and Wai Fong Lectureship: Optimizing Surgical Education Through Metacognition and Technology. J Surg Res 2022; 277:A12-A17. [PMID: 35589411 DOI: 10.1016/j.jss.2022.05.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Revised: 12/31/2021] [Accepted: 01/01/2022] [Indexed: 11/29/2022]
Affiliation(s)
- James A Lee
- Columbia University Medical Center, New York, New York.
| |
Collapse
|
6
|
Lee JA. Optimizing Surgical Education Through Metacognition and Technology. J Surg Res 2022; 274:242-247. [PMID: 35196637 DOI: 10.1016/j.jss.2022.01.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Revised: 12/31/2021] [Accepted: 01/01/2022] [Indexed: 11/18/2022]
Affiliation(s)
- James A Lee
- Columbia University Medical Center, New York, New York.
| |
Collapse
|
7
|
Ward TM, Mascagni P, Madani A, Padoy N, Perretta S, Hashimoto DA. Surgical data science and artificial intelligence for surgical education. J Surg Oncol 2021; 124:221-230. [PMID: 34245578 DOI: 10.1002/jso.26496] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Revised: 03/29/2021] [Accepted: 04/02/2021] [Indexed: 11/11/2022]
Abstract
Surgical data science (SDS) aims to improve the quality of interventional healthcare and its value through the capture, organization, analysis, and modeling of procedural data. As data capture has increased and artificial intelligence (AI) has advanced, SDS can help to unlock augmented and automated coaching, feedback, assessment, and decision support in surgery. We review major concepts in SDS and AI as applied to surgical education and surgical oncology.
Collapse
Affiliation(s)
- Thomas M Ward
- Department of Surgery, Surgical AI & Innovation Laboratory, Massachusetts General Hospital, Boston, Massachusetts
| | - Pietro Mascagni
- ICube, University of Strasbourg, CNRS, France.,Fondazione Policlinico A. Gemelli IRCCS, Rome, Italy.,IHU Strasbourg, Strasbourg, France
| | - Amin Madani
- Department of Surgery, University Health Network, Toronto, Canada
| | - Nicolas Padoy
- ICube, University of Strasbourg, CNRS, France.,IHU Strasbourg, Strasbourg, France
| | | | - Daniel A Hashimoto
- Department of Surgery, Surgical AI & Innovation Laboratory, Massachusetts General Hospital, Boston, Massachusetts
| |
Collapse
|
8
|
Fazendin J, Chen H, Lindeman B. Influence of fellowship educational experience on practice patterns for adrenalectomy: A survey of recent AAES fellowship graduates. Am J Surg 2020; 221:626-630. [PMID: 32819675 DOI: 10.1016/j.amjsurg.2020.07.027] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2020] [Revised: 07/16/2020] [Accepted: 07/27/2020] [Indexed: 12/19/2022]
Abstract
BACKGROUND Current practice patterns for adrenalectomy among endocrine surgeons is a limited area of study. Here we survey relatively junior endocrine surgeons regarding educational experiences in adrenalectomy and correlate these with current practice. METHODS An electronic survey was sent to recent AAES-accredited fellowships graduates (2014-2019), querying adrenalectomy volume and approaches during fellowship and current practice patterns. RESULTS Most graduates (63.2%) performed >20 adrenalectomies in fellowship. Exposure was greatest to open (94.1%) and laparoscopic transabdominal (92.6%) adrenalectomy, followed by retroperitoneoscopic (86.7%). The majority (73.5%) of respondents stated their current practice patterns are the same as their exposure during training. Preoperative diagnosis, side of lesion, and patient comorbidities were all ranked as significant predictors affecting choice of approach (p < 0.001). CONCLUSION The large majority of AAES fellowship graduates receive high-volume adrenalectomy experience in several approaches. The technique to which a trainee was exposed to most frequently was the greatest predictor for preferential approach in current practice.
Collapse
Affiliation(s)
- Jessica Fazendin
- The University of Alabama at Birmingham, Department of Surgery, USA.
| | - Herbert Chen
- The University of Alabama at Birmingham, Department of Surgery, USA
| | | |
Collapse
|