3
|
Samant S, Bakhos JJ, Wu W, Zhao S, Kassab GS, Khan B, Panagopoulos A, Makadia J, Oguz UM, Banga A, Fayaz M, Glass W, Chiastra C, Burzotta F, LaDisa JF, Iaizzo P, Murasato Y, Dubini G, Migliavacca F, Mickley T, Bicek A, Fontana J, West NEJ, Mortier P, Boyers PJ, Gold JP, Anderson DR, Tcheng JE, Windle JR, Samady H, Jaffer FA, Desai NR, Lansky A, Mena-Hurtado C, Abbott D, Brilakis ES, Lassen JF, Louvard Y, Stankovic G, Serruys PW, Velazquez E, Elias P, Bhatt DL, Dangas G, Chatzizisis YS. Artificial Intelligence, Computational Simulations, and Extended Reality in Cardiovascular Interventions. JACC Cardiovasc Interv 2023; 16:2479-2497. [PMID: 37879802 DOI: 10.1016/j.jcin.2023.07.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Revised: 07/11/2023] [Accepted: 07/13/2023] [Indexed: 10/27/2023]
Abstract
Artificial intelligence, computational simulations, and extended reality, among other 21st century computational technologies, are changing the health care system. To collectively highlight the most recent advances and benefits of artificial intelligence, computational simulations, and extended reality in cardiovascular therapies, we coined the abbreviation AISER. The review particularly focuses on the following applications of AISER: 1) preprocedural planning and clinical decision making; 2) virtual clinical trials, and cardiovascular device research, development, and regulatory approval; and 3) education and training of interventional health care professionals and medical technology innovators. We also discuss the obstacles and constraints associated with the application of AISER technologies, as well as the proposed solutions. Interventional health care professionals, computer scientists, biomedical engineers, experts in bioinformatics and visualization, the device industry, ethics committees, and regulatory agencies are expected to streamline the use of AISER technologies in cardiovascular interventions and medicine in general.
Collapse
Affiliation(s)
- Saurabhi Samant
- Center for Digital Cardiovascular Innovations, Division of Cardiovascular Medicine, University of Miami Miller School of Medicine, Miami, Florida, USA; Cardiovascular Biology and Biomechanics Laboratory (CBBL), Cardiovascular Division, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Jules Joel Bakhos
- Center for Digital Cardiovascular Innovations, Division of Cardiovascular Medicine, University of Miami Miller School of Medicine, Miami, Florida, USA; Cardiovascular Biology and Biomechanics Laboratory (CBBL), Cardiovascular Division, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Wei Wu
- Center for Digital Cardiovascular Innovations, Division of Cardiovascular Medicine, University of Miami Miller School of Medicine, Miami, Florida, USA; Cardiovascular Biology and Biomechanics Laboratory (CBBL), Cardiovascular Division, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Shijia Zhao
- Center for Digital Cardiovascular Innovations, Division of Cardiovascular Medicine, University of Miami Miller School of Medicine, Miami, Florida, USA; Cardiovascular Biology and Biomechanics Laboratory (CBBL), Cardiovascular Division, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Ghassan S Kassab
- California Medical Innovations Institute, San Diego, California, USA
| | - Behram Khan
- Center for Digital Cardiovascular Innovations, Division of Cardiovascular Medicine, University of Miami Miller School of Medicine, Miami, Florida, USA; Cardiovascular Biology and Biomechanics Laboratory (CBBL), Cardiovascular Division, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Anastasios Panagopoulos
- Center for Digital Cardiovascular Innovations, Division of Cardiovascular Medicine, University of Miami Miller School of Medicine, Miami, Florida, USA; Cardiovascular Biology and Biomechanics Laboratory (CBBL), Cardiovascular Division, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Janaki Makadia
- Center for Digital Cardiovascular Innovations, Division of Cardiovascular Medicine, University of Miami Miller School of Medicine, Miami, Florida, USA; Cardiovascular Biology and Biomechanics Laboratory (CBBL), Cardiovascular Division, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Usama M Oguz
- Center for Digital Cardiovascular Innovations, Division of Cardiovascular Medicine, University of Miami Miller School of Medicine, Miami, Florida, USA; Cardiovascular Biology and Biomechanics Laboratory (CBBL), Cardiovascular Division, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Akshat Banga
- Center for Digital Cardiovascular Innovations, Division of Cardiovascular Medicine, University of Miami Miller School of Medicine, Miami, Florida, USA; Cardiovascular Biology and Biomechanics Laboratory (CBBL), Cardiovascular Division, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Muhammad Fayaz
- Center for Digital Cardiovascular Innovations, Division of Cardiovascular Medicine, University of Miami Miller School of Medicine, Miami, Florida, USA; Cardiovascular Biology and Biomechanics Laboratory (CBBL), Cardiovascular Division, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - William Glass
- Interprofessional Experiential Center for Enduring Learning, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Claudio Chiastra
- PoliTo(BIO)Med Lab, Department of Mechanical and Aerospace Engineering, Politecnico di Torino, Turin, Italy
| | - Francesco Burzotta
- Department of Cardiovascular Sciences, Università Cattolica Del Sacro Cuore, Rome, Italy
| | - John F LaDisa
- Departments of Biomedical Engineering and Pediatrics - Division of Cardiology, Herma Heart Institute, Children's Wisconsin and the Medical College of Wisconsin, and the MARquette Visualization Lab, Marquette University, Milwaukee, Wisconsin, USA
| | - Paul Iaizzo
- Visible Heart Laboratories, Department of Surgery, University of Minnesota, Minnesota, USA
| | - Yoshinobu Murasato
- Department of Cardiology, National Hospital Organization Kyushu Medical Center, Fukuoka, Japan
| | - Gabriele Dubini
- Department of Chemistry, Materials and Chemical Engineering 'Giulio Natta', Politecnico di Milano, Milan, Italy
| | - Francesco Migliavacca
- Department of Chemistry, Materials and Chemical Engineering 'Giulio Natta', Politecnico di Milano, Milan, Italy
| | | | - Andrew Bicek
- Boston Scientific Inc, Marlborough, Massachusetts, USA
| | | | | | | | - Pamela J Boyers
- Interprofessional Experiential Center for Enduring Learning, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Jeffrey P Gold
- Interprofessional Experiential Center for Enduring Learning, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Daniel R Anderson
- Cardiovascular Biology and Biomechanics Laboratory (CBBL), Cardiovascular Division, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - James E Tcheng
- Cardiovascular Division, Duke Clinical Research Institute, Duke University Medical Center, Durham, North Carolina, USA
| | - John R Windle
- Cardiovascular Biology and Biomechanics Laboratory (CBBL), Cardiovascular Division, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Habib Samady
- Georgia Heart Institute, Gainesville, Georgia, USA
| | - Farouc A Jaffer
- Cardiology Division, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Nihar R Desai
- Section of Cardiovascular Medicine, Yale School of Medicine, New Haven, Connecticut, USA
| | - Alexandra Lansky
- Section of Cardiovascular Medicine, Yale School of Medicine, New Haven, Connecticut, USA
| | - Carlos Mena-Hurtado
- Section of Cardiovascular Medicine, Yale School of Medicine, New Haven, Connecticut, USA
| | - Dawn Abbott
- Cardiovascular Institute, Warren Alpert Medical School at Brown University, Providence, Rhode Island, USA
| | - Emmanouil S Brilakis
- Center for Advanced Coronary Interventions, Minneapolis Heart Institute, Minneapolis, Minnesota, USA
| | - Jens Flensted Lassen
- Department of Cardiology B, Odense University Hospital, Odense, Syddanmark, Denmark
| | - Yves Louvard
- Institut Cardiovasculaire Paris Sud, Massy, France
| | - Goran Stankovic
- Department of Cardiology, Clinical Center of Serbia, Belgrade, Serbia
| | - Patrick W Serruys
- Department of Cardiology, National University of Ireland, Galway, Galway, Ireland
| | - Eric Velazquez
- Section of Cardiovascular Medicine, Yale School of Medicine, New Haven, Connecticut, USA
| | - Pierre Elias
- Seymour, Paul, and Gloria Milstein Division of Cardiology, Columbia University Irving Medical Center, NewYork-Presbyterian Hospital, New York, New York, USA
| | - Deepak L Bhatt
- Mount Sinai Heart, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - George Dangas
- Mount Sinai Heart, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Yiannis S Chatzizisis
- Center for Digital Cardiovascular Innovations, Division of Cardiovascular Medicine, University of Miami Miller School of Medicine, Miami, Florida, USA; Cardiovascular Biology and Biomechanics Laboratory (CBBL), Cardiovascular Division, University of Nebraska Medical Center, Omaha, Nebraska, USA.
| |
Collapse
|
4
|
Hatzl J, Böckler D, Meisenbacher K, Barb A, Hartmann N, Henning D, Uhl C. Mixed Reality in der Gefäßchirurgie – ein Scoping Review. Zentralbl Chir 2022; 147:439-446. [DOI: 10.1055/a-1939-7686] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Zusammenfassung
Hintergrund „Mixed Reality“ (MR) erlaubt die Projektion von virtuellen Objekten in das Sichtfeld des Anwenders durch ein Head-mounted Display (HMD). Im gefäßchirurgischen
Behandlungsspektrum könnten MR-Anwendungen in Zukunft einen Nutzen darstellen. Im folgenden Scoping Review soll eine Orientierung über die aktuelle Anwendung der genannten Technologien im
Bereich der Gefäßchirurgie gegeben und Forschungsziele für die Zukunft definiert werden. Material und Methoden Es erfolgte eine systematische Literaturrecherche in PubMed (MEDLINE)
mit den Suchbegriffen „aorta“, „intervention“, „endovsacular intervention“, „vascular surgery“, „aneurysm“, „endovascular“, „vascular access“ jeweils in Kombination mit „mixed reality“ oder
„augmented reality“. Die Suche erfolgte nach PRISMA-Leitlinie (Preferred Reporting Items for Systematic reviews and Meta-Analyses) für Scoping Reviews. Ergebnisse Aus 547
Literaturstellen konnten 8 relevante Studien identifiziert werden. Die Suchergebnisse konnten in 2 Anwendungskategorien eingeteilt werden: (1) MR mit dem Ziel des Informationsmanagements und
zur Verbesserung der periprozeduralen Ergonomie gefäßchirurgischer Eingriffe (n = 3) sowie (2) MR mit dem Ziel der intraoperativen Navigation bei gefäßchirurgischen Eingriffen (n = 5). Die
Registrierung des physischen Patienten mit dem virtuellen Objekt und das Tracking von Instrumenten in der MR-Umgebung zur intraoperativen Navigation ist dabei im Fokus des wissenschaftlichen
Interesses und konnte technisch erfolgreich am Phantom- und Tiermodell gezeigt werden. Die bisher vorgestellten Methoden sind jedoch mit hohem infrastrukturellem Aufwand und relevanten
Limitationen verbunden. Schlussfolgerung Der Einsatz von MR im Bereich der Gefäßchirurgie ist grundsätzlich vielversprechend. Für die Zukunft sollten alternative, pragmatische
Registrierungsmethoden mit entsprechender Quantifizierung des Positionierungsfehlers angestrebt werden. Die entwickelten Soft- und Hardwarelösungen sollten auf das Anforderungsprofil der
Gefäßchirurgie angepasst werden. Das elektromagnetische Instrumenten-Tracking erscheint als sinnvolle, komplementäre Technologie zur Umsetzung der MR-assistierten Navigation.
Collapse
Affiliation(s)
- Johannes Hatzl
- Klinik für Gefäßchirurgie und Endovaskuläre Chirurgie, UniversitätsKlinikum Heidelberg, Heidelberg, Deutschland
| | - Dittmar Böckler
- Klinik für Gefäßchirurgie und Endovaskuläre Chirurgie, UniversitätsKlinikum Heidelberg, Heidelberg, Deutschland
| | - Katrin Meisenbacher
- Klinik für Gefäßchirurgie und Endovaskuläre Chirurgie, UniversitätsKlinikum Heidelberg, Heidelberg, Deutschland
| | - Alexandru Barb
- Klinik für Gefäßchirurgie und Endovaskuläre Chirurgie, UniversitätsKlinikum Heidelberg, Heidelberg, Deutschland
| | - Niklas Hartmann
- Klinik für Gefäßchirurgie und Endovaskuläre Chirurgie, UniversitätsKlinikum Heidelberg, Heidelberg, Deutschland
| | - Daniel Henning
- Klinik für Gefäßchirurgie und Endovaskuläre Chirurgie, UniversitätsKlinikum Heidelberg, Heidelberg, Deutschland
| | - Christian Uhl
- Klinik für Gefäßchirurgie und Endovaskuläre Chirurgie, UniversitätsKlinikum Heidelberg, Heidelberg, Deutschland
| |
Collapse
|
5
|
Eves J, Sudarsanam A, Shalhoub J, Amiras D. Augmented Reality in Vascular and Endovascular Surgery: Scoping Review. JMIR Serious Games 2022; 10:e34501. [PMID: 36149736 PMCID: PMC9547335 DOI: 10.2196/34501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2021] [Revised: 04/22/2022] [Accepted: 06/23/2022] [Indexed: 11/22/2022] Open
Abstract
Background Technological advances have transformed vascular intervention in recent decades. In particular, improvements in imaging and data processing have allowed for the development of increasingly complex endovascular and hybrid interventions. Augmented reality (AR) is a subject of growing interest in surgery, with the potential to improve clinicians’ understanding of 3D anatomy and aid in the processing of real-time information. This study hopes to elucidate the potential impact of AR technology in the rapidly evolving fields of vascular and endovascular surgery. Objective The aim of this review is to summarize the fundamental concepts of AR technologies and conduct a scoping review of the impact of AR and mixed reality in vascular and endovascular surgery. Methods A systematic search of MEDLINE, Scopus, and Embase was performed in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. All studies written in English from inception until January 8, 2021, were included in the search. Combinations of the following keywords were used in the systematic search string: (“augmented reality” OR “hololens” OR “image overlay” OR “daqri” OR “magic leap” OR “immersive reality” OR “extended reality” OR “mixed reality” OR “head mounted display”) AND (“vascular surgery” OR “endovascular”). Studies were selected through a blinded process between 2 investigators (JE and AS) and assessed using data quality tools. Results AR technologies have had a number of applications in vascular and endovascular surgery. Most studies (22/32, 69%) used 3D imaging of computed tomography angiogram–derived images of vascular anatomy to augment clinicians’ anatomical understanding during procedures. A wide range of AR technologies were used, with heads up fusion imaging and AR head-mounted displays being the most commonly applied clinically. AR applications included guiding open, robotic, and endovascular surgery while minimizing dissection, improving procedural times, and reducing radiation and contrast exposure. Conclusions AR has shown promising developments in the field of vascular and endovascular surgery, with potential benefits to surgeons and patients alike. These include reductions in patient risk and operating times as well as in contrast and radiation exposure for radiological interventions. Further technological advances are required to overcome current limitations, including processing capacity and vascular deformation by instrumentation.
Collapse
Affiliation(s)
- Joshua Eves
- Imperial Vascular Unit, Imperial College Healthcare NHS Trust, London, United Kingdom
| | - Abhilash Sudarsanam
- Imperial Vascular Unit, Imperial College Healthcare NHS Trust, London, United Kingdom
| | - Joseph Shalhoub
- Imperial Vascular Unit, Imperial College Healthcare NHS Trust, London, United Kingdom.,Department of Surgery & Cancer, Imperial College London, London, United Kingdom
| | - Dimitri Amiras
- Department of Surgery & Cancer, Imperial College London, London, United Kingdom.,Department of Radiology, Imperial College Healthcare NHS Trust, London, United Kingdom
| |
Collapse
|
6
|
Condino S, Piazza R, Carbone M, Bath J, Troisi N, Ferrari M, Berchiolli R. Bioengineering, augmented reality, and robotic surgery in vascular surgery: A literature review. Front Surg 2022; 9:966118. [PMID: 36061062 PMCID: PMC9437582 DOI: 10.3389/fsurg.2022.966118] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2022] [Accepted: 08/04/2022] [Indexed: 12/20/2022] Open
Abstract
Biomedical engineering integrates a variety of applied sciences with life sciences to improve human health and reduce the invasiveness of surgical procedures. Technological advances, achieved through biomedical engineering, have contributed to significant improvements in the field of vascular and endovascular surgery. This paper aims to review the most cutting-edge technologies of the last decade involving the use of augmented reality devices and robotic systems in vascular surgery, highlighting benefits and limitations. Accordingly, two distinct literature surveys were conducted through the PubMed database: the first review provides a comprehensive assessment of augmented reality technologies, including the different techniques available for the visualization of virtual content (11 papers revised); the second review collects studies with bioengineering content that highlight the research trend in robotic vascular surgery, excluding works focused only on the clinical use of commercially available robotic systems (15 papers revised). Technological flow is constant and further advances in imaging techniques and hardware components will inevitably bring new tools for a clinical translation of innovative therapeutic strategies in vascular surgery.
Collapse
Affiliation(s)
- Sara Condino
- Department of Information Engineering, University of Pisa, Pisa, Italy
- EndoCAS Center, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| | - Roberta Piazza
- EndoCAS Center, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| | - Marina Carbone
- Department of Information Engineering, University of Pisa, Pisa, Italy
- EndoCAS Center, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
- Correspondence: Marina Carbone
| | - Jonathan Bath
- Division of Vascular Surgery, University of Missouri, Columbia, MO, United States
| | - Nicola Troisi
- Vascular Surgery Unit, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| | - Mauro Ferrari
- Vascular Surgery Unit, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| | - Raffaella Berchiolli
- Vascular Surgery Unit, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| |
Collapse
|