1
|
Arensmeyer J, Bedetti B, Schnorr P, Buermann J, Zalepugas D, Schmidt J, Feodorovici P. A System for Mixed-Reality Holographic Overlays of Real-Time Rendered 3D-Reconstructed Imaging Using a Video Pass-through Head-Mounted Display-A Pathway to Future Navigation in Chest Wall Surgery. J Clin Med 2024; 13:2080. [PMID: 38610849 PMCID: PMC11012529 DOI: 10.3390/jcm13072080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2024] [Revised: 03/26/2024] [Accepted: 03/27/2024] [Indexed: 04/14/2024] Open
Abstract
Background: Three-dimensional reconstructions of state-of-the-art high-resolution imaging are progressively being used more for preprocedural assessment in thoracic surgery. It is a promising tool that aims to improve patient-specific treatment planning, for example, for minimally invasive or robotic-assisted lung resections. Increasingly available mixed-reality hardware based on video pass-through technology enables the projection of image data as a hologram onto the patient. We describe the novel method of real-time 3D surgical planning in a mixed-reality setting by presenting three representative cases utilizing volume rendering. Materials: A mixed-reality system was set up using a high-performance workstation running a video pass-through-based head-mounted display. Image data from computer tomography were imported and volume-rendered in real-time to be customized through live editing. The image-based hologram was projected onto the patient, highlighting the regions of interest. Results: Three oncological cases were selected to explore the potentials of the mixed-reality system. Two of them presented large tumor masses in the thoracic cavity, while a third case presented an unclear lesion of the chest wall. We aligned real-time rendered 3D holographic image data onto the patient allowing us to investigate the relationship between anatomical structures and their respective body position. Conclusions: The exploration of holographic overlay has proven to be promising in improving preprocedural surgical planning, particularly for complex oncological tasks in the thoracic surgical field. Further studies on outcome-related surgical planning and navigation should therefore be conducted. Ongoing technological progress of extended reality hardware and intelligent software features will most likely enhance applicability and the range of use in surgical fields within the near future.
Collapse
Affiliation(s)
- Jan Arensmeyer
- Division of Thoracic Surgery, Department of General, Thoracic and Vascular Surgery, University Hospital Bonn, 53127 Bonn, Germany (P.F.)
- Bonn Surgical Technology Center (BOSTER), University Hospital Bonn, 53227 Bonn, Germany
| | - Benedetta Bedetti
- Division of Thoracic Surgery, Department of General, Thoracic and Vascular Surgery, University Hospital Bonn, 53127 Bonn, Germany (P.F.)
- Department of Thoracic Surgery, Helios Hospital Bonn/Rhein-Sieg, 53123 Bonn, Germany
| | - Philipp Schnorr
- Division of Thoracic Surgery, Department of General, Thoracic and Vascular Surgery, University Hospital Bonn, 53127 Bonn, Germany (P.F.)
- Department of Thoracic Surgery, Helios Hospital Bonn/Rhein-Sieg, 53123 Bonn, Germany
| | - Jens Buermann
- Division of Thoracic Surgery, Department of General, Thoracic and Vascular Surgery, University Hospital Bonn, 53127 Bonn, Germany (P.F.)
- Department of Thoracic Surgery, Helios Hospital Bonn/Rhein-Sieg, 53123 Bonn, Germany
| | - Donatas Zalepugas
- Division of Thoracic Surgery, Department of General, Thoracic and Vascular Surgery, University Hospital Bonn, 53127 Bonn, Germany (P.F.)
- Department of Thoracic Surgery, Helios Hospital Bonn/Rhein-Sieg, 53123 Bonn, Germany
| | - Joachim Schmidt
- Division of Thoracic Surgery, Department of General, Thoracic and Vascular Surgery, University Hospital Bonn, 53127 Bonn, Germany (P.F.)
- Bonn Surgical Technology Center (BOSTER), University Hospital Bonn, 53227 Bonn, Germany
- Department of Thoracic Surgery, Helios Hospital Bonn/Rhein-Sieg, 53123 Bonn, Germany
| | - Philipp Feodorovici
- Division of Thoracic Surgery, Department of General, Thoracic and Vascular Surgery, University Hospital Bonn, 53127 Bonn, Germany (P.F.)
- Bonn Surgical Technology Center (BOSTER), University Hospital Bonn, 53227 Bonn, Germany
| |
Collapse
|
2
|
Nanchahal S, Arjomandi Rad A, Naruka V, Chacko J, Liu G, Afoke J, Miller G, Malawana J, Punjabi P. Mitral valve surgery assisted by virtual and augmented reality: Cardiac surgery at the front of innovation. Perfusion 2024; 39:244-255. [PMID: 36314484 DOI: 10.1177/02676591221137480] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2023]
Abstract
BACKGROUND Given the variety in mitral valve (MV) pathology and associated surgical techniques, extended reality (XR) holds great potential to assist MV surgeons. This review aims to systematically evaluate the currently available evidence investigating the use of XR and associated technologies in MV surgery. METHODS A systematic database search was conducted of original articles and case reports that explored the use of XR and MV surgery in EMBASE, MEDLINE, Cochrane database and Google Scholar, from inception to February 2022. RESULTS Our search yielded 171 articles, of which 15 studies were included in this review, featuring 328 patients. Two main areas of application were identified: (i) pre-operative planning and (ii) predicting post-operative outcomes. The articles reporting outcomes relating to pre-operative planning were further categorised as exploring themes relevant to (i) mitral annular assessment; (ii) training; (iii) evaluation of surgical technique; (iv) surgical approach or plan and (v) selecting ring size or type. Preoperatively, XR has been shown to evaluate mitral annular pathology more accurately than echocardiography, informing the surgeon about the optimal surgical technique, approach and plan for a particular patient's MV pathology. Furthermore, XR could simulate and aid ring size/type selection for MV annuloplasty, creating a personalized surgical plan. Additionally, XR could estimate the postoperative MV biomechanical and physiological characteristics, predicting and pre-empting post-operative complications. CONCLUSION XR demonstrated promising applications for assisting MV surgery, enhancing outcomes and patient-centred care, nevertheless, there remain the need for randomized studies to ascertain its feasibility, safety, and validity in clinical practice.
Collapse
Affiliation(s)
- Sukanya Nanchahal
- Department of Medicine, Faculty of Medicine, Imperial College London, London, UK
| | - Arian Arjomandi Rad
- Department of Medicine, Faculty of Medicine, Imperial College London, London, UK
| | - Vinci Naruka
- Department of Cardiothoracic Surgery, Imperial College Healthcare NHS Trust, Hammersmith Hospital, London, UK
| | - Jacob Chacko
- Department of Cardiothoracic Surgery, Imperial College Healthcare NHS Trust, Hammersmith Hospital, London, UK
| | - Guiqing Liu
- Department of Cardiothoracic Surgery, Imperial College Healthcare NHS Trust, Hammersmith Hospital, London, UK
| | - Jonathan Afoke
- Department of Cardiothoracic Surgery, Imperial College Healthcare NHS Trust, Hammersmith Hospital, London, UK
| | - George Miller
- Research Unit, The Healthcare Leadership Academy, London, UK
| | - Johann Malawana
- Research Unit, The Healthcare Leadership Academy, London, UK
| | - Prakash Punjabi
- Department of Cardiothoracic Surgery, Imperial College Healthcare NHS Trust, Hammersmith Hospital, London, UK
- National Heart and Lung Institute, Imperial College London, London, UK
| |
Collapse
|
3
|
Karsenty C, Hadeed K, Pyra P, Guitarte A, Djeddai C, Vincent R, Dulac Y, Silagdze I, Gobin J, Combes N, Ratsimandresy M, Berthomieu L, Calvaruso D, Acar P. Advancing paediatric cardiac imaging: a comprehensive analysis of the feasibility and accuracy of a novel 3D paediatric transoesophageal probe. Front Cardiovasc Med 2023; 10:1294109. [PMID: 38116539 PMCID: PMC10728472 DOI: 10.3389/fcvm.2023.1294109] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2023] [Accepted: 11/13/2023] [Indexed: 12/21/2023] Open
Abstract
Aims Pediatric transoesophageal echocardiography (TOE) probes have remained two-dimensional (2D) limiting their use compared to adults. While critical in pediatrics for interventions and post-surgery assessments, technological advancements introduced a three-dimensional (3D) pediatric TOE probe. This study assessed the new 3D pediatric TOE probe (GE 9VT-D) for feasibility, handling, and imaging quality. Methods and results At Children's Hospital of Toulouse, 2-month prospective study enrolled children undergoing TOE with the new probe. All imaging modalities were rated by 2 operators using a 5-point Likert-type scale from 1 (very poor) to 5 (very good) quality. Forty-five children, median age 3.7 (range: 2 months-14.7 years) median weight 7.8 kg (range: 4.3-48 kg) underwent 60 TOEs: 25% pre-surgery, 45% post-surgery, 28% during percutaneous procedures, and 2% in intensive care. Probe handling was "very easy" in all cases without adverse events. The median score of 2D, 2D colour, pulsed Doppler and 3D were noted 5 out of 5 and continuous Doppler and 3D colour 4 out of 5. The 3D image quality remained consistent irrespective of the patient weighing above or below 7.8 kg (p = 0.72). Postoperative TOEs identified two cases needing further interventions, emphasizing its value in evaluating surgical outcomes and also for guiding percutaneous interventions. Conclusion Our comprehensive evaluation demonstrates that the new 3D pediatric TOE probe is feasible and provides high-quality imaging in pediatric patients. The successful integration of this novel probe into clinical practice has the potential to enhance diagnostic accuracy and procedural planning, ultimately optimizing patient outcomes in pediatric cardiac care.
Collapse
Affiliation(s)
- Clément Karsenty
- Department of Paediatric Cardiology, University Hospital, Toulouse, France
- Institut Des Maladies Métaboliques Et Cardiovasculaires [Institute of Metabolic and Cardiovascular Diseases], University of Toulouse, Toulouse, France
| | - Khaled Hadeed
- Department of Paediatric Cardiology, University Hospital, Toulouse, France
| | - Pierrick Pyra
- Department of Paediatric Cardiology, University Hospital, Toulouse, France
| | - Aitor Guitarte
- Department of Paediatric Cardiology, University Hospital, Toulouse, France
| | - Camelia Djeddai
- Department of Paediatric Cardiology, University Hospital, Toulouse, France
| | - Remi Vincent
- Department of Paediatric Cardiology, University Hospital, Toulouse, France
| | - Yves Dulac
- Department of Paediatric Cardiology, University Hospital, Toulouse, France
| | - Ia Silagdze
- Department of Paediatric Cardiology, University Hospital, Toulouse, France
| | - Julie Gobin
- Department of Anesthesiology and Paediatric Cardiology, University Hospital, Toulouse, France
| | - Nicolas Combes
- Department of Cardiology, Clinique Pasteur [Pasteur Clinic], Toulouse, France
| | | | - Lionel Berthomieu
- Department of Intensive Care Unit and Paediatric Cardiology, University Hospital, Toulouse, France
| | - Davide Calvaruso
- Department of Paediatric Cardiology, University Hospital, Toulouse, France
| | - Philippe Acar
- Department of Paediatric Cardiology, University Hospital, Toulouse, France
| |
Collapse
|
4
|
Jone PN, Gearhart A, Lei H, Xing F, Nahar J, Lopez-Jimenez F, Diller GP, Marelli A, Wilson L, Saidi A, Cho D, Chang AC. Artificial Intelligence in Congenital Heart Disease: Current State and Prospects. JACC. ADVANCES 2022; 1:100153. [PMID: 38939457 PMCID: PMC11198540 DOI: 10.1016/j.jacadv.2022.100153] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/13/2022] [Revised: 10/04/2022] [Accepted: 10/07/2022] [Indexed: 06/29/2024]
Abstract
The current era of big data offers a wealth of new opportunities for clinicians to leverage artificial intelligence to optimize care for pediatric and adult patients with a congenital heart disease. At present, there is a significant underutilization of artificial intelligence in the clinical setting for the diagnosis, prognosis, and management of congenital heart disease patients. This document is a call to action and will describe the current state of artificial intelligence in congenital heart disease, review challenges, discuss opportunities, and focus on the top priorities of artificial intelligence-based deployment in congenital heart disease.
Collapse
Affiliation(s)
- Pei-Ni Jone
- Section of Pediatric Cardiology, Department of Pediatrics, Lurie Children’s Hospital of Chicago, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Addison Gearhart
- Department of Cardiology, Boston Children's Hospital and Harvard Medical School, Boston, Massachusetts, USA
| | - Howard Lei
- Division of Pediatric Cardiology, Children’s Hospital of Orange County, Orange, California, USA
| | - Fuyong Xing
- Department of Biostatistics and Informatics, University of Colorado Anschutz Medical Campus, Aurora, Colorado, USA
| | - Jai Nahar
- Department of Cardiology, Children's National Hospital, Washington, DC, USA
| | | | - Gerhard-Paul Diller
- Department of Cardiology III-Adult Congenital and Valvular Heart Disease, University Hospital Muenster, Muenster, Germany
- Adult Congenital Heart Centre and National Centre for Pulmonary Hypertension, Royal Brompton and Harefield National Health Service Foundation Trust, Imperial College London, London, UK
- National Register for Congenital Heart Defects, Berlin, Germany
| | - Ariane Marelli
- McGill Adult Unit for Congenital Heart Disease Excellence, Department of Medicine, McGill University, Montréal, Québec, Canada
| | - Laura Wilson
- Department of Pediatrics, University of Florida-Congenital Heart Center, Gainesville, Florida, USA
| | - Arwa Saidi
- Department of Pediatrics, University of Florida-Congenital Heart Center, Gainesville, Florida, USA
| | - David Cho
- Department of Cardiology, University of California at Los Angeles, Los Angeles, California, USA
| | - Anthony C. Chang
- Division of Pediatric Cardiology, Children’s Hospital of Orange County, Orange, California, USA
| |
Collapse
|
5
|
Baker KE, Robbins AC, Wasson RG, McCandless MG, Lirette ST, Kimball RJ, Washington CW, Luzardo GD, Stringer SP, Zachariah MA. Side-firing intraoperative ultrasound applied to resection of pituitary macroadenomas and giant adenomas: A single-center retrospective case-control study. Front Oncol 2022; 12:1043697. [DOI: 10.3389/fonc.2022.1043697] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Accepted: 11/08/2022] [Indexed: 12/05/2022] Open
Abstract
IntroductionMultiple intraoperative navigation and imaging modalities are currently available as an adjunct to endoscopic transsphenoidal resection of pituitary adenomas, including intraoperative CT and MRI, fluorescence guidance, and neuronavigation. However, these imaging techniques have several limitations, including intraoperative tissue shift, lack of availability in some centers, and the increased cost and time associated with their use. The side-firing intraoperative ultrasound (IOUS) probe is a relatively new technology in endoscopic endonasal surgery that may help overcome these obstacles.MethodsA retrospective analysis was performed on patients admitted for resection of pituitary adenomas by a single surgeon at the University of Mississippi Medical Center. The control (non-ultrasound) group consisted of twelve (n=12) patients who received surgery without IOUS guidance, and the IOUS group was composed of fifteen (n=15) patients who underwent IOUS-guided surgery. Outcome measures used to assess the side-firing IOUS were the extent of tumor resection, postoperative complications, length of hospital stay (LOS) in days, operative time, and self-reported surgeon confidence in estimating the extent of resection intraoperatively.ResultsPreoperative data analysis showed no significant differences in patient demographics or presenting symptoms between the two groups. Postoperative data revealed no significant difference in the rate of gross total resection between the groups (p = 0.716). Compared to the non-US group, surgeon confidence was significantly higher (p < 0.001), and operative time was significantly lower for the US group in univariate analysis (p = 0.011). Multivariate analysis accounting for tumor size, surgeon confidence, and operative time confirmed these findings. Interestingly, we noted a trend for a lower incidence of postoperative diabetes insipidus in the US group, although this did not quite reach our threshold for statistical significance.ConclusionIncorporating IOUS as an aid for endonasal resection of pituitary adenomas provides real-time image guidance that increases surgeon confidence in intraoperative assessment of the extent of resection and decreases operative time without posing additional risk to the patient. Additionally, we identified a trend for reduced diabetes insipidus with IOUS.
Collapse
|
6
|
Spanaki A, Kabir S, Stephenson N, van Poppel MPM, Benetti V, Simpson J. 3D Approaches in Complex CHD: Where Are We? Funny Printing and Beautiful Images, or a Useful Tool? J Cardiovasc Dev Dis 2022; 9:269. [PMID: 36005432 PMCID: PMC9410138 DOI: 10.3390/jcdd9080269] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Revised: 08/02/2022] [Accepted: 08/05/2022] [Indexed: 11/16/2022] Open
Abstract
Echocardiography, CT and MRI have a crucial role in the management of congenital heart disease (CHD) patients. All of these modalities can be presented in a 2D or a 3D rendered format. The aim of this paper is to review the key advantages and potential limitations, as well as the future challenges of a 3D approach in each imaging modality. The focus of this review is on anatomic rather than functional assessment. Conventional 2D echocardiography presents limitations when imaging complex lesions, whereas 3D imaging depicts the anatomy in all dimensions. CT and MRI can visualise extracardiac vasculature and guide complex biventricular repair. Three-dimensional printed models can be used in depicting complex intracardiac relationships and defining the surgical strategy in specific lesions. Extended reality imaging retained dynamic cardiac motion holds great potential for planning surgical and catheter procedures. Overall, the use of 3D imaging has resulted in a better understanding of anatomy, with a direct impact on the surgical and catheter approach, particularly in more complex cases.
Collapse
Affiliation(s)
- Adriani Spanaki
- Department of Congenital Heart Disease, Evelina London Children’s Hospital, Guy’s and St Thomas NHS Foundation Trust, London SE1 7EH, UK
| | - Saleha Kabir
- Department of Congenital Heart Disease, Evelina London Children’s Hospital, Guy’s and St Thomas NHS Foundation Trust, London SE1 7EH, UK
| | - Natasha Stephenson
- School of Biomedical Engineering & Imaging Sciences, King’s College London, King’s Health Partners, St Thomas’ Hospital, London SE1 7EH, UK
| | - Milou P. M. van Poppel
- School of Biomedical Engineering & Imaging Sciences, King’s College London, King’s Health Partners, St Thomas’ Hospital, London SE1 7EH, UK
| | - Valentina Benetti
- Department of Congenital Heart Disease, Evelina London Children’s Hospital, Guy’s and St Thomas NHS Foundation Trust, London SE1 7EH, UK
| | - John Simpson
- Department of Congenital Heart Disease, Evelina London Children’s Hospital, Guy’s and St Thomas NHS Foundation Trust, London SE1 7EH, UK
- School of Biomedical Engineering & Imaging Sciences, King’s College London, King’s Health Partners, St Thomas’ Hospital, London SE1 7EH, UK
| |
Collapse
|
7
|
Van den Eynde J, Kutty S, Danford DA, Manlhiot C. Artificial intelligence in pediatric cardiology: taking baby steps in the big world of data. Curr Opin Cardiol 2022; 37:130-136. [PMID: 34857721 DOI: 10.1097/hco.0000000000000927] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
PURPOSE OF REVIEW Artificial intelligence (AI) has changed virtually every aspect of modern life, and medicine is no exception. Pediatric cardiology is both a perceptual and a cognitive subspecialty that involves complex decision-making, so AI is a particularly attractive tool for this medical discipline. This review summarizes the foundational work and incremental progress made as AI applications have emerged in pediatric cardiology since 2020. RECENT FINDINGS AI-based algorithms can be useful for pediatric cardiology in many areas, including: (1) clinical examination and diagnosis, (2) image processing, (3) planning and management of cardiac interventions, (4) prognosis and risk stratification, (5) omics and precision medicine, and (6) fetal cardiology. Most AI initiatives showcased in medical journals seem to work well in silico, but progress toward implementation in actual clinical practice has been more limited. Several barriers to implementation are identified, some encountered throughout medicine generally, and others specific to pediatric cardiology. SUMMARY Despite barriers to acceptance in clinical practice, AI is already establishing a durable role in pediatric cardiology. Its potential remains great, but to fully realize its benefits, substantial investment to develop and refine AI for pediatric cardiology applications will be necessary to overcome the challenges of implementation.
Collapse
Affiliation(s)
- Jef Van den Eynde
- The Blalock-Taussig-Thomas Pediatric and Congenital Heart Center, Department of Pediatrics, Johns Hopkins School of Medicine, Johns Hopkins University, Baltimore, Maryland, USA
- Department of Cardiovascular Sciences, KU Leuven & Congenital and Structural Cardiology, UZ Leuven, Leuven, Belgium
| | - Shelby Kutty
- The Blalock-Taussig-Thomas Pediatric and Congenital Heart Center, Department of Pediatrics, Johns Hopkins School of Medicine, Johns Hopkins University, Baltimore, Maryland, USA
| | - David A Danford
- The Blalock-Taussig-Thomas Pediatric and Congenital Heart Center, Department of Pediatrics, Johns Hopkins School of Medicine, Johns Hopkins University, Baltimore, Maryland, USA
| | - Cedric Manlhiot
- The Blalock-Taussig-Thomas Pediatric and Congenital Heart Center, Department of Pediatrics, Johns Hopkins School of Medicine, Johns Hopkins University, Baltimore, Maryland, USA
| |
Collapse
|
8
|
Krasemann T, Branstetter J. Virtual Reality Treatment Planning for Congenital Heart Disease. JACC Case Rep 2021; 3:1584-1585. [PMID: 34729505 PMCID: PMC8543154 DOI: 10.1016/j.jaccas.2021.08.023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Affiliation(s)
- Thomas Krasemann
- Department of Pediatric Cardiology, Sophia Children’s Hospital, Erasmus Medical Center Rotterdam, Rotterdam, the Netherlands
| | - Joshua Branstetter
- Department of Pharmacy, Children’s Healthcare of Atlanta, Atlanta, Georgia, USA
| |
Collapse
|
9
|
Deng S, Wheeler G, Toussaint N, Munroe L, Bhattacharya S, Sajith G, Lin E, Singh E, Chu KYK, Kabir S, Pushparajah K, Simpson JM, Schnabel JA, Gomez A. A Virtual Reality System for Improved Image-Based Planning of Complex Cardiac Procedures. J Imaging 2021; 7:151. [PMID: 34460787 PMCID: PMC8404926 DOI: 10.3390/jimaging7080151] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Revised: 08/13/2021] [Accepted: 08/17/2021] [Indexed: 12/03/2022] Open
Abstract
The intricate nature of congenital heart disease requires understanding of the complex, patient-specific three-dimensional dynamic anatomy of the heart, from imaging data such as three-dimensional echocardiography for successful outcomes from surgical and interventional procedures. Conventional clinical systems use flat screens, and therefore, display remains two-dimensional, which undermines the full understanding of the three-dimensional dynamic data. Additionally, the control of three-dimensional visualisation with two-dimensional tools is often difficult, so used only by imaging specialists. In this paper, we describe a virtual reality system for immersive surgery planning using dynamic three-dimensional echocardiography, which enables fast prototyping for visualisation such as volume rendering, multiplanar reformatting, flow visualisation and advanced interaction such as three-dimensional cropping, windowing, measurement, haptic feedback, automatic image orientation and multiuser interactions. The available features were evaluated by imaging and nonimaging clinicians, showing that the virtual reality system can help improve the understanding and communication of three-dimensional echocardiography imaging and potentially benefit congenital heart disease treatment.
Collapse
Affiliation(s)
- Shujie Deng
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London SE1 7EU, UK; (S.D.); (G.W.); (N.T.); (L.M.); (S.B.); (G.S.); (E.L.); (E.S.); (K.Y.K.C.); (K.P.); (J.M.S.); (J.A.S.)
| | - Gavin Wheeler
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London SE1 7EU, UK; (S.D.); (G.W.); (N.T.); (L.M.); (S.B.); (G.S.); (E.L.); (E.S.); (K.Y.K.C.); (K.P.); (J.M.S.); (J.A.S.)
| | - Nicolas Toussaint
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London SE1 7EU, UK; (S.D.); (G.W.); (N.T.); (L.M.); (S.B.); (G.S.); (E.L.); (E.S.); (K.Y.K.C.); (K.P.); (J.M.S.); (J.A.S.)
| | - Lindsay Munroe
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London SE1 7EU, UK; (S.D.); (G.W.); (N.T.); (L.M.); (S.B.); (G.S.); (E.L.); (E.S.); (K.Y.K.C.); (K.P.); (J.M.S.); (J.A.S.)
| | - Suryava Bhattacharya
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London SE1 7EU, UK; (S.D.); (G.W.); (N.T.); (L.M.); (S.B.); (G.S.); (E.L.); (E.S.); (K.Y.K.C.); (K.P.); (J.M.S.); (J.A.S.)
| | - Gina Sajith
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London SE1 7EU, UK; (S.D.); (G.W.); (N.T.); (L.M.); (S.B.); (G.S.); (E.L.); (E.S.); (K.Y.K.C.); (K.P.); (J.M.S.); (J.A.S.)
| | - Ei Lin
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London SE1 7EU, UK; (S.D.); (G.W.); (N.T.); (L.M.); (S.B.); (G.S.); (E.L.); (E.S.); (K.Y.K.C.); (K.P.); (J.M.S.); (J.A.S.)
| | - Eeshar Singh
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London SE1 7EU, UK; (S.D.); (G.W.); (N.T.); (L.M.); (S.B.); (G.S.); (E.L.); (E.S.); (K.Y.K.C.); (K.P.); (J.M.S.); (J.A.S.)
| | - Ka Yee Kelly Chu
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London SE1 7EU, UK; (S.D.); (G.W.); (N.T.); (L.M.); (S.B.); (G.S.); (E.L.); (E.S.); (K.Y.K.C.); (K.P.); (J.M.S.); (J.A.S.)
| | - Saleha Kabir
- Department of Congenital Heart Disease, Evelina London Children’s Hospital, Guy’s and St Thomas’ National Health Service Foundation Trust, London SE1 7EH, UK;
| | - Kuberan Pushparajah
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London SE1 7EU, UK; (S.D.); (G.W.); (N.T.); (L.M.); (S.B.); (G.S.); (E.L.); (E.S.); (K.Y.K.C.); (K.P.); (J.M.S.); (J.A.S.)
- Department of Congenital Heart Disease, Evelina London Children’s Hospital, Guy’s and St Thomas’ National Health Service Foundation Trust, London SE1 7EH, UK;
| | - John M. Simpson
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London SE1 7EU, UK; (S.D.); (G.W.); (N.T.); (L.M.); (S.B.); (G.S.); (E.L.); (E.S.); (K.Y.K.C.); (K.P.); (J.M.S.); (J.A.S.)
- Department of Congenital Heart Disease, Evelina London Children’s Hospital, Guy’s and St Thomas’ National Health Service Foundation Trust, London SE1 7EH, UK;
| | - Julia A. Schnabel
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London SE1 7EU, UK; (S.D.); (G.W.); (N.T.); (L.M.); (S.B.); (G.S.); (E.L.); (E.S.); (K.Y.K.C.); (K.P.); (J.M.S.); (J.A.S.)
- Department of Informatics, Technische Universität München, 85748 Garching, Germany
- Helmholtz Zentrum München—German Research Center for Environmental Health, 85764 Neuherberg, Germany
| | - Alberto Gomez
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London SE1 7EU, UK; (S.D.); (G.W.); (N.T.); (L.M.); (S.B.); (G.S.); (E.L.); (E.S.); (K.Y.K.C.); (K.P.); (J.M.S.); (J.A.S.)
| |
Collapse
|
10
|
Pushparajah K. Non-invasive Imaging in the Evaluation of Cardiac Shunts for Interventional Closure. Front Cardiovasc Med 2021; 8:651726. [PMID: 34222361 PMCID: PMC8253251 DOI: 10.3389/fcvm.2021.651726] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2021] [Accepted: 04/08/2021] [Indexed: 11/13/2022] Open
Abstract
Multimodality imaging provides important information to guide patient selection and pre-procedural decision making for shunt lesions in CHD. While echocardiography, CT, and CMR are well-established, 3D printing and now virtual reality imaging are beginning to show promise.
Collapse
Affiliation(s)
- Kuberan Pushparajah
- School of Biomedical Engineering and Imaging Sciences, King's College London, St Thomas' Hospital, London, United Kingdom.,Department of Paediatric Cardiology, Evelina London Children's Hospital, London, United Kingdom
| |
Collapse
|
11
|
Lau I, Gupta A, Sun Z. Clinical Value of Virtual Reality versus 3D Printing in Congenital Heart Disease. Biomolecules 2021; 11:884. [PMID: 34198642 PMCID: PMC8232263 DOI: 10.3390/biom11060884] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2021] [Revised: 06/10/2021] [Accepted: 06/12/2021] [Indexed: 11/22/2022] Open
Abstract
Both three-dimensional (3D) printing and virtual reality (VR) are reported as being superior to the current visualization techniques in conveying more comprehensive visualization of congenital heart disease (CHD). However, little is known in terms of their clinical value in diagnostic assessment, medical education, and preoperative planning of CHD. This cross-sectional study aims to address these by involving 35 medical practitioners to subjectively evaluate VR visualization of four selected CHD cases in comparison with the corresponding 3D printed heart models (3DPHM). Six questionnaires were excluded due to incomplete sections, hence a total of 29 records were included for the analysis. The results showed both VR and 3D printed heart models were comparable in terms of the degree of realism. VR was perceived as more useful in medical education and preoperative planning compared to 3D printed heart models, although there was no significant difference in the ratings (p = 0.54 and 0.35, respectively). Twenty-one participants (72%) indicated both the VR and 3DPHM provided additional benefits compared to the conventional medical imaging visualizations. This study concludes the similar clinical value of both VR and 3DPHM in CHD, although further research is needed to involve more cardiac specialists for their views on the usefulness of these tools.
Collapse
Affiliation(s)
- Ivan Lau
- Discipline of Medical Radiation Science, Curtin Medical School, Curtin University, Perth, WA 6102, Australia;
| | - Ashu Gupta
- Department of Medical Imaging, Fiona Stanley Hospital, Perth, WA 6150, Australia;
| | - Zhonghua Sun
- Discipline of Medical Radiation Science, Curtin Medical School, Curtin University, Perth, WA 6102, Australia;
- Curtin Health Innovation Research Institute (CHIRI), Faculty of Health Sciences, Curtin University, Perth, WA 6102, Australia
| |
Collapse
|
12
|
Commentary: Virtual reality 3-dimensional imaging of atrioventricular valves: A tool for surgeons or a toy for engineers? JTCVS Tech 2021; 7:278-279. [PMID: 34318269 PMCID: PMC8312100 DOI: 10.1016/j.xjtc.2021.03.021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2021] [Revised: 03/08/2021] [Accepted: 03/22/2021] [Indexed: 11/23/2022] Open
|