1
|
Pruitt K, Johnson B, Gahan J, Ma L, Fei B. A High-Speed Hyperspectral Laparoscopic Imaging System. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2023; 12466:1246608. [PMID: 38524190 PMCID: PMC10961180 DOI: 10.1117/12.2653922] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/26/2024]
Abstract
Minimally invasive surgery (MIS) has expanded broadly in the field of abdominal and pelvic surgery. Laparoscopic and robotic surgery has improved surgeon ergonomics, instrument precision, operative time, and postoperative recovery across various abdominal procedures. The goal of this study is to establish the feasibility of implementing high-speed hyperspectral imaging into a standard laparoscopic setup and exploring its benefit to common intracorporeal procedures. A hyperspectral laparoscopic imaging system was constructed using a customized hyperspectral camera alongside a standard rigid laparoscope and was validated for both spectral and spatial accuracy. Demosaicing methods were investigated for improved full-resolution visualization. Hyperspectral cameras with different spectral ranges were considered and compared with one another alongside two different light sources to determine the most effective configuration. Finally, different porcine tissues were imaged ex-vivo to test the capabilities of the system and spectral footprints of the various tissues were extracted. The tissue was also imaged in a phantom to simulate the system's use in MIS. The results demonstrated a hyperspectral laparoscopic imaging system that could provide quantitative, diagnostic information while not disrupting normal workflow nor adding excessive weight to the laparoscopic setup. The high-speed hyperspectral laparoscopic imaging system can have immediate applications in image-guided surgery.
Collapse
Affiliation(s)
- Kelden Pruitt
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
- Center for Imaging and Surgical Innovation, University of Texas at Dallas, Richardson, TX
| | - Brett Johnson
- University of Texas Southwestern Medical Center, Department of Urology, Dallas, TX
| | - Jeffrey Gahan
- University of Texas Southwestern Medical Center, Department of Urology, Dallas, TX
| | - Ling Ma
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
- Center for Imaging and Surgical Innovation, University of Texas at Dallas, Richardson, TX
| | - Baowei Fei
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
- Center for Imaging and Surgical Innovation, University of Texas at Dallas, Richardson, TX
- University of Texas Southwestern Medical Center, Department of Radiology, Dallas, TX
| |
Collapse
|
2
|
Roberts S, Desai A, Checcucci E, Puliatti S, Taratkin M, Kowalewski KF, Gomez Rivas J, Rivero I, Veneziano D, Autorino R, Porpiglia F, Gill IS, Cacciamani GE. "Augmented reality" applications in urology: a systematic review. Minerva Urol Nephrol 2022; 74:528-537. [PMID: 35383432 DOI: 10.23736/s2724-6051.22.04726-7] [Citation(s) in RCA: 21] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
INTRODUCTION Augmented reality (AR) applied to surgical procedures refers to the superimposition of preoperative or intra-operative images onto the operative field. Augmented reality has been increasingly used in myriad surgical specialties including Urology. The following study reviews advances in the use of AR for improvements in urologic outcomes. EVIDENCE ACQUISITION We identified all descriptive, validity, prospective randomized/nonrandomized trials and retrospective comparative/noncomparative studies about the use of AR in Urology up until March 2021. The MEDLINE, Scopus, and Web of Science databases were used for literature search. We conducted the study selection according to the PRISMA (Preferred Reporting Items for Systematic Reviews and meta-analysis statement) guidelines. We limited included studies to only those using AR, excluding all that used virtual reality technology. EVIDENCE SYNTHESIS A total of 60 studies were identified and included in the present analysis. Overall, 19 studies were descriptive/validity/phantom studies for specific AR methodologies, 4 studies were case reports, and 37 studies included clinical prospective/retrospective comparative studies. CONCLUSIONS Advances in AR have led to increasing registration accuracy as well as increased ability to identify anatomic landmarks and improve outcomes during Urologic procedures such as RARP and robot-assisted partial nephrectomy.
Collapse
Affiliation(s)
- Sidney Roberts
- Keck School of Medicine, Catherine and Joseph Aresty Department of Urology, USC Institute of Urology, Los Angeles, CA, USA
| | - Aditya Desai
- Keck School of Medicine, Catherine and Joseph Aresty Department of Urology, USC Institute of Urology, Los Angeles, CA, USA
| | - Enrico Checcucci
- School of Medicine, Division of Urology, Department of Oncology, San Luigi Hospital, University of Turin, Orbassano, Turin, Italy.,European Association of Urology (EAU) Young Academic Office (YAU) Uro-Technology Working Group, Arnhem, the Netherlands
| | - Stefano Puliatti
- European Association of Urology (EAU) Young Academic Office (YAU) Uro-Technology Working Group, Arnhem, the Netherlands.,Department of Urology, University of Modena and Reggio Emilia, Modena, Italy.,Department of Urology, OLV, Aalst, Belgium.,ORSI Academy, Melle, Belgium
| | - Mark Taratkin
- European Association of Urology (EAU) Young Academic Office (YAU) Uro-Technology Working Group, Arnhem, the Netherlands.,Institute for Urology and Reproductive Health, Sechenov University, Moscow, Russia
| | - Karl-Friedrich Kowalewski
- European Association of Urology (EAU) Young Academic Office (YAU) Uro-Technology Working Group, Arnhem, the Netherlands.,Virgen Macarena University Hospital, Seville, Spain.,Department of Urology and Urosurgery, University Hospital of Mannheim, Mannheim, Germany
| | - Juan Gomez Rivas
- European Association of Urology (EAU) Young Academic Office (YAU) Uro-Technology Working Group, Arnhem, the Netherlands.,Department of Urology, Clinico San Carlos University Hospital, Madrid, Spain
| | - Ines Rivero
- European Association of Urology (EAU) Young Academic Office (YAU) Uro-Technology Working Group, Arnhem, the Netherlands.,Department of Urology and Nephrology, Virgen del Rocío University Hospital, Seville, Spain
| | - Domenico Veneziano
- European Association of Urology (EAU) Young Academic Office (YAU) Uro-Technology Working Group, Arnhem, the Netherlands.,Department of Urology, Riuniti Hospital, Reggio Calabria, Reggio Calabria, Italy
| | | | - Francesco Porpiglia
- European Association of Urology (EAU) Young Academic Office (YAU) Uro-Technology Working Group, Arnhem, the Netherlands
| | - Inderbir S Gill
- Keck School of Medicine, Catherine and Joseph Aresty Department of Urology, USC Institute of Urology, Los Angeles, CA, USA.,Artificial Intelligence (AI) Center at USC Urology, USC Institute of Urology, Los Angeles, CA, USA
| | - Giovanni E Cacciamani
- Keck School of Medicine, Catherine and Joseph Aresty Department of Urology, USC Institute of Urology, Los Angeles, CA, USA - .,European Association of Urology (EAU) Young Academic Office (YAU) Uro-Technology Working Group, Arnhem, the Netherlands.,Artificial Intelligence (AI) Center at USC Urology, USC Institute of Urology, Los Angeles, CA, USA.,Keck School of Medicine, Department of Radiology, University of Southern California, Los Angeles, CA, USA
| |
Collapse
|
3
|
Reis G, Yilmaz M, Rambach J, Pagani A, Suarez-Ibarrola R, Miernik A, Lesur P, Minaskan N. Mixed reality applications in urology: Requirements and future potential. Ann Med Surg (Lond) 2021; 66:102394. [PMID: 34040777 PMCID: PMC8141462 DOI: 10.1016/j.amsu.2021.102394] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2021] [Revised: 04/28/2021] [Accepted: 05/09/2021] [Indexed: 12/20/2022] Open
Abstract
Background Mixed reality (MR), the computer-supported augmentation of a real environment with virtual elements, becomes ever more relevant in the medical domain, especially in urology, ranging from education and training over surgeries. We aimed to review existing MR technologies and their applications in urology. Methods A non-systematic review of current literature was performed using the PubMed-Medline database using the medical subject headings (MeSH) term “mixed reality”, combined with one of the following terms: “virtual reality”, “augmented reality”, ‘’urology’’ and “augmented virtuality”. The relevant studies were utilized. Results MR applications such as MR guided systems, immersive VR headsets, AR models, MR-simulated ureteroscopy and smart glasses have enormous potential in education, training and surgical interventions of urology. Medical students, urology residents and inexperienced urologists can gain experience thanks to MR technologies. MR applications are also used in patient education before interventions. Conclusions For surgical support, the achievable accuracy is often not sufficient. The main challenges are the non-rigid nature of the genitourinary organs, intraoperative data acquisition, online and multimodal registration and calibration of devices. However, the progress made in recent years is tremendous in all respects and the gap is constantly shrinking. MR, including AV and AR, is an intriguing technology with tremendous potential in urology field. ∙The main challenges lie in intraoperative data acquisition, online and multimodal registration and calibration of devices and data, appropriate display hardware, as well as cooperative devices and tools in the operation theatres. ∙Medical experts should feel encouraged to experience MR solutions and to communicate their specific needs and effects they aim at.
Collapse
Affiliation(s)
- Gerd Reis
- German Research Center for Artificial Intelligence, Department Augmented Vision, Kaiserslautern, Germany
| | - Mehmet Yilmaz
- Department of Urology, Faculty of Medicine, University of Freiburg - Medical Centre, Freiburg, Germany
- Corresponding author. Department of Urology, Faculty of Medicine, Medical Centre– University of Freiburg Hugstetter Str. 55, 79106, Freiburg, Germany.
| | - Jason Rambach
- German Research Center for Artificial Intelligence, Department Augmented Vision, Kaiserslautern, Germany
| | - Alain Pagani
- German Research Center for Artificial Intelligence, Department Augmented Vision, Kaiserslautern, Germany
| | - Rodrigo Suarez-Ibarrola
- Department of Urology, Faculty of Medicine, University of Freiburg - Medical Centre, Freiburg, Germany
| | - Arkadiusz Miernik
- Department of Urology, Faculty of Medicine, University of Freiburg - Medical Centre, Freiburg, Germany
| | - Paul Lesur
- German Research Center for Artificial Intelligence, Department Augmented Vision, Kaiserslautern, Germany
| | - Nareg Minaskan
- German Research Center for Artificial Intelligence, Department Augmented Vision, Kaiserslautern, Germany
| |
Collapse
|
4
|
Beloborodov V, Vorobev V, Golub I, Frolov A, Kelchevskaya E, Tsoktoev D, Maksikova T. A multidisciplinary approach to urinary system iatrogenic injuries. Cent European J Urol 2020; 73:534-543. [PMID: 33552581 PMCID: PMC7848821 DOI: 10.5173/ceju.2020.0153] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2020] [Revised: 11/02/2020] [Accepted: 11/24/2020] [Indexed: 11/22/2022] Open
Abstract
INTRODUCTION Urinary system iatrogenic injuries appear because of urological, obstetric-gynecological, and surgical manipulations in the retroperitoneal space, pelvis, or perineum. The purpose of this research was to analyze and obtain knowledge about the issue of iatrogenic injuries, to apply injury prevention algorithms, and to assess multidisciplinary perspectives in modern surgery. MATERIAL AND METHODS The research was interdisciplinary and consisted of several modules: a prospective, single-centre study of urinary system iatrogenic injuries (476 patients) along with four interregional and international procedural types of research. RESULTS The analysis results indicate an extremely high significance of urinary system injuries evoking numerous negative consequences that are hard to eliminate. A comparative assessment of interdisciplinary interaction demonstrates the more effective interpretation of examination results, more comprehensive and credible clinical diagnosis, more qualitative evaluation of a patient's condition, more effective choice of initial treatment policy, and more satisfactory treatment in patients' opinion. The research allowed for the identification of a typical procedural mistake in the urethral catheter setting causing a high risk of urethra injuries followed by urethra strictures or consecutive infections of the urinary tract. CONCLUSIONS More complicated treatment procedures cause a higher probability of urinary system iatrogenic injuries. The absence of unified algorithms and typical procedural mistakes cause such incidents. A partial solution to this issue could be found in a more profound interdisciplinary interaction in all treatment phases as well as in identifying and eliminating procedural mistakes.
Collapse
Affiliation(s)
- Vladimir Beloborodov
- Department of General Surgery and Anesthesiology, Irkutsk State Medical University, Irkutsk, Russian Federation
| | - Vladimir Vorobev
- Department of General Surgery and Anesthesiology, Irkutsk State Medical University, Irkutsk, Russian Federation
| | - Igor Golub
- Department of General Surgery and Anesthesiology, Irkutsk State Medical University, Irkutsk, Russian Federation
| | - Aleksandr Frolov
- Department of General Surgery and Anesthesiology, Irkutsk State Medical University, Irkutsk, Russian Federation
| | - Elena Kelchevskaya
- Department of General Surgery and Anesthesiology, Irkutsk State Medical University, Irkutsk, Russian Federation
| | - Darizhab Tsoktoev
- Department of General Surgery and Anesthesiology, Irkutsk State Medical University, Irkutsk, Russian Federation
| | - Tatyana Maksikova
- Department of Propedeutics of Internal Diseases, Irkutsk State Medical University, Irkutsk, Russian Federation
| |
Collapse
|
5
|
Bertolo R, Hung A, Porpiglia F, Bove P, Schleicher M, Dasgupta P. Systematic review of augmented reality in urological interventions: the evidences of an impact on surgical outcomes are yet to come. World J Urol 2019; 38:2167-2176. [PMID: 30826888 DOI: 10.1007/s00345-019-02711-z] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2018] [Accepted: 02/26/2019] [Indexed: 01/12/2023] Open
Abstract
PURPOSE To perform a systematic literature review on the clinical impact of augmented reality (AR) for urological interventions. METHODS As of June 21, 2018, systematic literature review was performed via Medline, Embase and Cochrane databases in accordance with the PRISMA guidelines and registered at PROSPERO (CRD42018102194). Only full text articles in English were included, without time restrictions. Articles were considered if they reported on the use of AR during urological intervention and the impact on the surgical outcomes. The risk of bias and the quality of each study included were independently assessed using the standard Cochrane Collaboration risk of bias tool and the Risk Of Bias In Non-randomised Studies-of Interventions Tool (ROBINS-I). RESULTS 131 articles were identified. 102 remained after duplicate removal and were critically reviewed for evidence synthesis. 20 studies reporting on the outcomes of the use of AR during urological interventions in a clinical setting were considered. Given the mostly non-comparative design of the studies identified, the evidence synthesis was performed in a descriptive and narrative manner. Only one comparative study was found, with the remaining 19 items being single-arm observational studies. Based on the existing evidence, we are unable to state that AR improves the outcomes of urological interventions. The major limitation of AR-assisted surgery is inaccuracy in registration, translating into a poor navigation precision. CONCLUSIONS To date, there is limited evidence showing superior therapeutic benefits of AR-guided surgery when compared with the conventional surgical approach to the respective disease.
Collapse
Affiliation(s)
- Riccardo Bertolo
- Glickman Urological and Kidney Institute, Cleveland Clinic, 2050 E 96th St, Q Building, Cleveland, OH, 44195, USA. .,Urology Department, "San Carlo di Nancy" Hospital, Rome, Italy.
| | - Andrew Hung
- Center for Robotic Simulation and Education, Catherine and Joseph Aresty Department of Urology, USC Institute of Urology, University of Southern California, Los Angeles, CA, USA
| | - Francesco Porpiglia
- Division of Urology, Department of Oncology, University of Turin, San Luigi Hospital, Orbassano, Turin, Italy
| | - Pierluigi Bove
- Urology Department, "San Carlo di Nancy" Hospital, Rome, Italy
| | - Mary Schleicher
- Floyd D. Loop Alumni Library, Cleveland Clinic, Cleveland, OH, USA
| | | |
Collapse
|