1
|
King A, Fowler G, Macefield RC, Quek FF, Walker H, Thomas C, Markar S, Blazeby JM, Blencowe NS. A systematic scoping review protocol to summarise and appraise the use of artificial intelligence in the analysis of digital videos of invasive general surgical procedures. Int J Surg Protoc 2023; 27:118-121. [PMID: 38046901 PMCID: PMC10688534 DOI: 10.1097/sp9.0000000000000012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Accepted: 09/28/2023] [Indexed: 12/05/2023] Open
Abstract
Background Intraoperative video recordings are a valuable addition to operative written documentation. However, the review of these videos often requires surgical expertise and takes considerable time. While a large amount of work has been undertaken to understand the role of artificial intelligence (AI) in healthcare more generally, the application of these techniques to automate the analysis of surgical videos is currently unclear. In this systematic scoping review, we sought to give a contemporary overview of the use of AI research in the analysis of digital videos of invasive general surgical procedures. We will describe and summarise the study characteristics, purpose of the applications and stage of development, to ascertain how these techniques might be applied in future research and to identify gaps in current knowledge (e.g. uncertainties about the study methods). Methods Systematic searches will be conducted in OVID Medline and Embase, using terms related to 'artificial intelligence', 'surgery' and 'video' to identify all potentially relevant studies published since 1st January 2012. All primary studies where AI has been applied to the analysis of videos (recorded by conventional digital cameras or laparoscopic or robotic-assisted technology) of general surgical procedures will be included. Data extraction will include study characteristics, governance, details of video datasets and AI models, measures of accuracy, validation and any reported limitations. Ethics and dissemination No ethical approval is required as primary data will not be collected. The results will be disseminated at relevant conferences, on social media and published in a peer-reviewed journal.
Collapse
Affiliation(s)
- Anni King
- National Institute for Health Research Bristol Biomedical Research Centre (Surgical Innovation Theme), Centre for Surgical Research, Bristol Medical School: Population Health Sciences, University of Bristol
| | - George Fowler
- National Institute for Health Research Bristol Biomedical Research Centre (Surgical Innovation Theme), Centre for Surgical Research, Bristol Medical School: Population Health Sciences, University of Bristol
- Department of Surgery, North Bristol NHS Trust, Bristol
| | - Rhiannon C. Macefield
- National Institute for Health Research Bristol Biomedical Research Centre (Surgical Innovation Theme), Centre for Surgical Research, Bristol Medical School: Population Health Sciences, University of Bristol
| | - Fang-Fang Quek
- National Institute for Health Research Bristol Biomedical Research Centre (Surgical Innovation Theme), Centre for Surgical Research, Bristol Medical School: Population Health Sciences, University of Bristol
| | - Hamish Walker
- National Institute for Health Research Bristol Biomedical Research Centre (Surgical Innovation Theme), Centre for Surgical Research, Bristol Medical School: Population Health Sciences, University of Bristol
| | - Charlie Thomas
- National Institute for Health Research Bristol Biomedical Research Centre (Surgical Innovation Theme), Centre for Surgical Research, Bristol Medical School: Population Health Sciences, University of Bristol
| | - Sheraz Markar
- Nuffield Department of Surgery, Oxford University Hospitals NHS Foundation Trust, Oxford, Oxfordshire, UK
| | - Jane M. Blazeby
- National Institute for Health Research Bristol Biomedical Research Centre (Surgical Innovation Theme), Centre for Surgical Research, Bristol Medical School: Population Health Sciences, University of Bristol
| | - Natalie S. Blencowe
- National Institute for Health Research Bristol Biomedical Research Centre (Surgical Innovation Theme), Centre for Surgical Research, Bristol Medical School: Population Health Sciences, University of Bristol
| |
Collapse
|
2
|
Levin M, McKechnie T, Kruse CC, Aldrich K, Grantcharov TP, Langerman A. Surgical data recording in the operating room: a systematic review of modalities and metrics. Br J Surg 2021; 108:613-621. [PMID: 34157080 DOI: 10.1093/bjs/znab016] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2020] [Revised: 10/09/2020] [Accepted: 12/28/2020] [Indexed: 12/17/2022]
Abstract
INTRODUCTION Operating room recording, via video, audio and sensor-based recordings, is increasingly common. Yet, surgical data science is a new field without clear guidelines. The purpose of this study is to examine existing published studies of surgical recording modalities to determine which are available for use in the operating room, as a first step towards developing unified standards for this field. METHODS Medline, EMBASE, CENTRAL and PubMed databases were systematically searched for articles describing modalities of data collection in the operating room. Search terms included 'video-audio media', 'bio-sensing techniques', 'sound', 'movement', 'operating rooms' and others. Title, abstract and full-text screening were completed to identify relevant articles. Descriptive statistical analysis was performed for included studies. RESULTS From 3756 citations, 91 studies met inclusion criteria. These studies described 10 unique data-collection modalities for 17 different purposes in the operating room. Data modalities included video, audio, kinematic and eye-tracking among others. Data-collection purposes described included surgical trainee assessment, surgical error, surgical team communication and operating room efficiency. CONCLUSION Effective data collection and utilization in the operating room are imperative for the provision of superior surgical care. The future operating room landscape undoubtedly includes multiple modalities of data collection for a plethora of purposes. This review acts as a foundation for employing operating room data in a way that leads to meaningful benefit for patient care.
Collapse
Affiliation(s)
- M Levin
- Department of Otolaryngology, Head and Neck Surgery, University of Toronto, Toronto, Ontario, Canada
| | - T McKechnie
- Division of General Surgery, Department of Surgery, McMaster University, Hamilton, Ontario, Canada
| | - C C Kruse
- Michael G. DeGroote School of Medicine, McMaster University, Hamilton, Ontario, Canada
| | - K Aldrich
- Center for Medical Interoperability, Nashville, Tennessee, USA
| | - T P Grantcharov
- International Center for Surgical Safety, Li Ka Shing Knowledge Institute, St. Michael's Hospital, Ontario, Canada
| | - A Langerman
- Center for Medical Interoperability, Nashville, Tennessee, USA.,International Center for Surgical Safety, Li Ka Shing Knowledge Institute, St. Michael's Hospital, Ontario, Canada.,Department of Otolaryngology - Head and Neck Surgery, Department of Radiology and Radiological Sciences, Surgical Analytics Lab, Center for Biomedical Ethics and Society, Vanderbilt University Medical Center, Nashville, Tennessee, USA
| |
Collapse
|
3
|
Garbey M, Joerger G, Furr S. Gastroenterology Procedures Generate Aerosols: An Air Quality Turnover Solution to Mitigate COVID-19's Propagation Risk. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2020; 17:E8780. [PMID: 33256004 PMCID: PMC7731398 DOI: 10.3390/ijerph17238780] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/28/2020] [Revised: 11/13/2020] [Accepted: 11/22/2020] [Indexed: 12/13/2022]
Abstract
The growing fear of virus transmission during the 2019 coronavirus disease (COVID-19) pandemic has called for many scientists to look into the various vehicles of infection, including the potential to travel through aerosols. Few have looked into the issue that gastrointestinal (GI) procedures may produce an abundance of aerosols. The current process of risk management for clinics is to follow a clinic-specific HVAC formula, which is typically calculated once a year and assumes perfect mixing of the air within the space, to determine how many minutes each procedural room refreshes 99% of its air between procedures when doors are closed. This formula is not designed to fit the complex dynamic of small airborne particle transport and deposition that can potentially carry the virus in clinical conditions. It results in reduced procedure throughput as well as an excess of idle time in clinics that process a large number of short procedures such as outpatient GI centers. We present and tested a new cyber-physical system that continuously monitors airborne particle counts in procedural rooms and also at the same time automatically monitors the procedural rooms' state and flexible endoscope status without interfering with the clinic's workflow. We use our data gathered from over 1500 GI cases in one clinical suite to understand the correlation between air quality and standard procedure types as well as identify the risks involved with any HVAC system in a clinical suite environment. Thanks to this system, we demonstrate that standard GI procedures generate large quantities of aerosols, which can potentially promote viral airborne transmission among patients and healthcare staff. We provide a solution for the clinic to improve procedure turnover times and throughput, as well as to mitigate the risk of airborne transmission of the virus.
Collapse
Affiliation(s)
- Marc Garbey
- ORintelligence, Houston, TX 77021, USA; (G.J.); (S.F.)
- LaSIE, UMR CNRS 7356, Université de La Rochelle, 17000 La Rochelle, France
| | | | - Shannon Furr
- ORintelligence, Houston, TX 77021, USA; (G.J.); (S.F.)
| |
Collapse
|
4
|
Garbey M, Joerger G, Furr S. A Systems Approach to Assess Transport and Diffusion of Hazardous Airborne Particles in a Large Surgical Suite: Potential Impacts on Viral Airborne Transmission. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2020; 17:E5404. [PMID: 32727142 PMCID: PMC7432518 DOI: 10.3390/ijerph17155404] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/24/2020] [Revised: 07/13/2020] [Accepted: 07/14/2020] [Indexed: 01/21/2023]
Abstract
Airborne transmission of viruses, such as the coronavirus 2 (SARS-CoV-2), in hospital systems are under debate: it has been shown that transmission of SARS-CoV-2 virus goes beyond droplet dynamics that is limited to 1 to 2 m, but it is unclear if the airborne viral load is significant enough to ensure transmission of the disease. Surgical smoke can act as a carrier for tissue particles, viruses, and bacteria. To quantify airborne transmission from a physical point of view, we consider surgical smoke produced by thermal destruction of tissue during the use of electrosurgical instruments as a marker of airborne particle diffusion-transportation. Surgical smoke plumes are also known to be dangerous for human health, especially to surgical staff who receive long-term exposure over the years. There are limited quantified metrics reported on long-term effects of surgical smoke on staff's health. The purpose of this paper is to provide a mathematical framework and experimental protocol to assess the transport and diffusion of hazardous airborne particles in every large operating room suite. Measurements from a network of air quality sensors gathered during a clinical study provide validation for the main part of the model. Overall, the model estimates staff exposure to airborne contamination from surgical smoke and biological material. To address the clinical implication over a long period of time, the systems approach is built upon previous work on multi-scale modeling of surgical flow in a large operating room suite and takes into account human behavior factors.
Collapse
Affiliation(s)
- Marc Garbey
- ORintelligence, Houston, TX 77021, USA; (G.J.); (S.F.)
- LaSIE, UMR CNRS 7356, University of la Rochelle, 17000 La Rochelle, France
| | - Guillaume Joerger
- ORintelligence, Houston, TX 77021, USA; (G.J.); (S.F.)
- GEPROVAS, 67000 Strasbourg, France
| | - Shannon Furr
- ORintelligence, Houston, TX 77021, USA; (G.J.); (S.F.)
| |
Collapse
|
5
|
Rambourg J, Gaspard-Boulinc H, Conversy S, Garbey M. A Continuum of Interfaces to Engage Surgical Staff in Efficient Collaboration. J Med Syst 2019; 43:184. [PMID: 31093782 DOI: 10.1007/s10916-019-1318-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2018] [Accepted: 05/01/2019] [Indexed: 10/26/2022]
Abstract
Large hospital surgical suites must combine high quality of care with an efficient management of operations. However, the diversity of procedures, staff, and patients present important challenges for staff collaboration. The complexity of flows between tasks and places, such as interconnections between pre-operation, post-operation and intensive care units, led previous research to address these issues separately using checklists, scheduling, or specialized human-computer interfaces. Approaches to treat the surgical suite as a whole entity have not been explored yet. Here, we build upon a cyber-physical system comprising an electronic whiteboard and different sensors tracking the status of operating rooms to design a continuum of mobile and fixed, shared computer interfaces. The interfaces disseminate the information through different locations and devices and allow for its manipulation in order to foster appropriate collaboration on unforeseen events and decisions. We present our design rationale process, involving the different surgical suite users and stakeholders and report on the architecture of the system.
Collapse
Affiliation(s)
- Juliette Rambourg
- Houston Methodist Hospital, Houston, TX, USA. .,ENAC - French University of Civil Aviation, Toulouse, France.
| | | | | | - Marc Garbey
- Houston Methodist Hospital, Houston, TX, USA
| |
Collapse
|
6
|
Maintaining operative efficiency while allowing sufficient time for residents to learn. Am J Surg 2018; 218:211-217. [PMID: 30522695 DOI: 10.1016/j.amjsurg.2018.11.035] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2018] [Revised: 11/11/2018] [Accepted: 11/26/2018] [Indexed: 11/23/2022]
Abstract
BACKGROUND Surgical residents desire independent operating experience but recognize that attendings have a responsibility to keep cases as short as possible. METHODS We analyzed video and interviews of attending surgeons related to more than 400 moments in which the resident was the primary operator. We examined these moments for themes related to timing and pace. RESULTS Our surgeons encouraged the residents to speed up when patient safety could be jeopardized by the case moving too slowly. In contrast, they encouraged the residents to slow down when performing a crucial step or granting independence. Attending surgeons encouraged speed through economical language, by substituting physical actions for words, and through the use of Intelligent Cooperation. Conversely, they encouraged slowing down via just-in-time mini-lectures and by questioning the trainee. CONCLUSIONS We present recommendations for safe teaching in the operating room while simultaneously maintaining overall surgical flow. Teaching residents to operate quickly can save time and is likely based on an automaticity in teaching. Slowing a resident down is vital for trainee skill development and patient safety.
Collapse
|
7
|
Joerger G, Rambourg J, Gaspard-Boulinc H, Conversy S, Bass BL, Dunkin BJ, Garbey M. A Cyber-Physical System to Improve the Management of a Large Suite of Operating Rooms. ACM TRANSACTIONS ON CYBER-PHYSICAL SYSTEMS 2018. [DOI: 10.1145/3140234] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Abstract
Cyber-physical systems have been deployed with considerable success in many industries. However, the implementation of cyber-physical systems in hospitals has been limited. By nature, in clinical operations, patient safety and consideration for health outcomes are of the utmost importance, thus possibly slowing the implementation of innovative solutions with limited history. Revenues from operating room (OR) time and surgery account for about 50% of the income of major hospitals (Erdogan et al. 2011; Cuschieri 2006), but the efficiency of OR utilization is often reported to be relatively low. Therefore, improving OR management with a cyber-physical system should be a priority. In this article, we will report on our experience implementing a cyber-physical system at Houston Methodist Hospital and discuss some of the difficulties and potential drivers for success. Our pilot study was done in the context of the management of a large suite of ORs. It uses the agile codevelopment of a cyber-physical system through an intense collaboration of clinicians and computational scientists. While technology remains the foundation of a cyber-physical system, this experience reinforced that the human factor is an important driving force behind the design that promotes user acceptance.
Collapse
Affiliation(s)
- Guillaume Joerger
- Center for Computational Surgery, Houston Methodist Hospital - Houston, USA
| | - Juliette Rambourg
- ENAC French University of Civil Aviation - Toulouse, France, & Center for Computational Surgery Houston Methodist Hospital - Houston, TX, USA
| | | | | | - Barbara L. Bass
- Department of Surgery, Houston Methodist Hospital - Houston USA
| | - Brian J. Dunkin
- Department of Surgery, Houston Methodist Hospital - Houston USA
| | - Marc Garbey
- Center for Computational Surgery, Houston Methodist Hospital - Houston, USA
| |
Collapse
|