1
|
Ivantsits M, Tautz L, Huellebrand M, Walczak L, Akansel S, Khasyanova I, Kempfert J, Sündermann S, Falk V, Hennemuth A. MV-GNN: Generation of continuous geometric representations of mitral valve motion from 3D+t echocardiography. Comput Biol Med 2024; 182:109154. [PMID: 39321581 DOI: 10.1016/j.compbiomed.2024.109154] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2024] [Revised: 08/17/2024] [Accepted: 09/11/2024] [Indexed: 09/27/2024]
Abstract
We present a geometric deep-learning method for reconstructing a temporally continuous mitral valve surface mesh from 3D transesophageal echocardiography sequences. Our approach features a supervised end-to-end deep learning architecture that combines a convolutional neural network-based voxel encoder and decoder with a graph neural network-based multi-resolution mesh decoder, all trained on sparse landmark annotations. Key elements of our methodology include a tube-shaped prototype mesh with labeled vertices, a specialized loss function to preserve the known inlet and outlet, and a rigid alignment system for anatomical landmarks. A custom term in the loss function prevents self-intersecting geometries within the valve mesh, promoting point correspondence and facilitating a continuous representation of valve anatomy over time. An ablation study evaluates the impact of different loss term configurations on model performance, highlighting the effectiveness of each individual loss term. Our Mitral Valve Graph Neural Network (MV-GNN) outperforms existing deep-learning methods on most distance metrics for the annulus and leaflets. The continuous valve motion representations generated by our approach (3D+t) exhibit distance measures comparable to our 3D solution, demonstrating its potential for analyzing mitral valve dynamics and enhancing personalized simulations for hemodynamic assessment and therapy planning.
Collapse
Affiliation(s)
- Matthias Ivantsits
- Institute for Imaging Science and Computational Modelling in Cardiovascular Medicine, Charité - Universitätsmedizin Berlin, 13353 Berlin, Germany; Deutsches Herzzentrum der Charité, 13353 Berlin, Germany.
| | - Lennart Tautz
- Fraunhofer MEVIS, Max-von-Laue-Str. 2, 28359 Bremen, Germany
| | - Markus Huellebrand
- Institute for Imaging Science and Computational Modelling in Cardiovascular Medicine, Charité - Universitätsmedizin Berlin, 13353 Berlin, Germany; Deutsches Herzzentrum der Charité, 13353 Berlin, Germany; Fraunhofer MEVIS, Max-von-Laue-Str. 2, 28359 Bremen, Germany
| | - Lars Walczak
- Institute for Imaging Science and Computational Modelling in Cardiovascular Medicine, Charité - Universitätsmedizin Berlin, 13353 Berlin, Germany; Deutsches Herzzentrum der Charité, 13353 Berlin, Germany; Fraunhofer MEVIS, Max-von-Laue-Str. 2, 28359 Bremen, Germany
| | - Serdar Akansel
- Deutsches Herzzentrum der Charité, 13353 Berlin, Germany
| | | | - Jörg Kempfert
- Deutsches Herzzentrum der Charité, 13353 Berlin, Germany; DZHK (German Centre for Cardiovascular Research), Berlin, Germany
| | - Simon Sündermann
- Deutsches Herzzentrum der Charité, 13353 Berlin, Germany; DZHK (German Centre for Cardiovascular Research), Berlin, Germany
| | - Volkmar Falk
- Deutsches Herzzentrum der Charité, 13353 Berlin, Germany; DZHK (German Centre for Cardiovascular Research), Berlin, Germany
| | - Anja Hennemuth
- Institute for Imaging Science and Computational Modelling in Cardiovascular Medicine, Charité - Universitätsmedizin Berlin, 13353 Berlin, Germany; Deutsches Herzzentrum der Charité, 13353 Berlin, Germany; Fraunhofer MEVIS, Max-von-Laue-Str. 2, 28359 Bremen, Germany; DZHK (German Centre for Cardiovascular Research), Berlin, Germany
| |
Collapse
|
2
|
Bharucha AH, Moore J, Carnahan P, MacCarthy P, Monaghan MJ, Baghai M, Deshpande R, Byrne J, Dworakowski R, Eskandari M. Three-dimensional printing in modelling mitral valve interventions. Echo Res Pract 2023; 10:12. [PMID: 37528494 PMCID: PMC10394816 DOI: 10.1186/s44156-023-00024-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2023] [Accepted: 06/23/2023] [Indexed: 08/03/2023] Open
Abstract
Mitral interventions remain technically challenging owing to the anatomical complexity and heterogeneity of mitral pathologies. As such, multi-disciplinary pre-procedural planning assisted by advanced cardiac imaging is pivotal to successful outcomes. Modern imaging techniques offer accurate 3D renderings of cardiac anatomy; however, users are required to derive a spatial understanding of complex mitral pathologies from a 2D projection thus generating an 'imaging gap' which limits procedural planning. Physical mitral modelling using 3D printing has the potential to bridge this gap and is increasingly being employed in conjunction with other transformative technologies to assess feasibility of intervention, direct prosthesis choice and avoid complications. Such platforms have also shown value in training and patient education. Despite important limitations, the pace of innovation and synergistic integration with other technologies is likely to ensure that 3D printing assumes a central role in the journey towards delivering personalised care for patients undergoing mitral valve interventions.
Collapse
Affiliation(s)
- Apurva H Bharucha
- The Cardiac Care Group, King's College Hospital, London, SE5 9RS, UK
| | - John Moore
- Robarts Research Institute, Western University, London, ON, Canada
| | - Patrick Carnahan
- Robarts Research Institute, Western University, London, ON, Canada
| | - Philip MacCarthy
- The Cardiac Care Group, King's College Hospital, London, SE5 9RS, UK
| | - Mark J Monaghan
- The Cardiac Care Group, King's College Hospital, London, SE5 9RS, UK
| | - Max Baghai
- The Cardiac Care Group, King's College Hospital, London, SE5 9RS, UK
| | - Ranjit Deshpande
- The Cardiac Care Group, King's College Hospital, London, SE5 9RS, UK
| | - Jonathan Byrne
- The Cardiac Care Group, King's College Hospital, London, SE5 9RS, UK
| | - Rafal Dworakowski
- The Cardiac Care Group, King's College Hospital, London, SE5 9RS, UK
| | - Mehdi Eskandari
- The Cardiac Care Group, King's College Hospital, London, SE5 9RS, UK.
| |
Collapse
|
3
|
Van Praet KM, Kempfert J, Jacobs S, Stamm C, Akansel S, Kofler M, Sündermann SH, Nazari Shafti TZ, Jakobs K, Holzendorf S, Unbehaun A, Falk V. Mitral valve surgery: current status and future prospects of the minimally invasive approach. Expert Rev Med Devices 2021; 18:245-260. [PMID: 33624569 DOI: 10.1080/17434440.2021.1894925] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
Introduction: During the past five years the approach to procedural planning, operative techniques and perfusion strategies for minimally invasive mitral valve surgery (MIMVS) has evolved. With the goal to provide a maximum of patient safety the procedure has been modified according to individual patient characteristics and is largely based on preoperative imaging.Areas covered: In this review article we describe the important factors in image based therapy planning and simulation, different access strategies, the operative key-steps, a rationale use of devices, and highlight a few future developments in the field of MIMVS. Published studies were identified through pearl growing, citation chasing, a search of PubMed using the systematic review methods filter, and the authors' topic knowledge.Expert opinion: With the help of expert teams including surgeons specialized in mitral repair, anesthesiologists and perfusionists a broad spectrum of mitral valve pathologies and related pathologies can be treated with excellent functional outcomes. Avoiding procedure related complications is the key for success for any MIMVS program.
Collapse
Affiliation(s)
- Karel M Van Praet
- Department of Cardiothoracic and Vascular Surgery, German Heart Center Berlin, Berlin, Germany.,German Center for Cardiovascular Research (DZHK), Partner Site Berlin, Berlin, Germany
| | - Jörg Kempfert
- Department of Cardiothoracic and Vascular Surgery, German Heart Center Berlin, Berlin, Germany.,German Center for Cardiovascular Research (DZHK), Partner Site Berlin, Berlin, Germany
| | - Stephan Jacobs
- Department of Cardiothoracic and Vascular Surgery, German Heart Center Berlin, Berlin, Germany
| | - Christof Stamm
- Department of Cardiothoracic and Vascular Surgery, German Heart Center Berlin, Berlin, Germany
| | - Serdar Akansel
- Department of Cardiothoracic and Vascular Surgery, German Heart Center Berlin, Berlin, Germany
| | - Markus Kofler
- Department of Cardiothoracic and Vascular Surgery, German Heart Center Berlin, Berlin, Germany
| | - Simon H Sündermann
- Department of Cardiothoracic and Vascular Surgery, German Heart Center Berlin, Berlin, Germany.,German Center for Cardiovascular Research (DZHK), Partner Site Berlin, Berlin, Germany.,Department of Cardiothoracic Surgery, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Timo Z Nazari Shafti
- Department of Cardiothoracic and Vascular Surgery, German Heart Center Berlin, Berlin, Germany.,German Center for Cardiovascular Research (DZHK), Partner Site Berlin, Berlin, Germany.,Berlin Institute of Health (BIH), Berlin, Germany
| | - Katharina Jakobs
- Institute for Anesthesiology, German Heart Center Berlin, Berlin, Germany
| | - Stefan Holzendorf
- Department of Perfusion, German Heart Center Berlin, Berlin, Germany
| | - Axel Unbehaun
- Department of Cardiothoracic and Vascular Surgery, German Heart Center Berlin, Berlin, Germany.,German Center for Cardiovascular Research (DZHK), Partner Site Berlin, Berlin, Germany
| | - Volkmar Falk
- Department of Cardiothoracic and Vascular Surgery, German Heart Center Berlin, Berlin, Germany.,German Center for Cardiovascular Research (DZHK), Partner Site Berlin, Berlin, Germany.,Department of Cardiothoracic Surgery, Charité - Universitätsmedizin Berlin, Berlin, Germany.,Berlin Institute of Health (BIH), Berlin, Germany.,Department of Health Sciences, ETH Zürich, Translational Cardiovascular Technologies, Switzerland
| |
Collapse
|
4
|
Aly AH, Aly AH, Lai EK, Yushkevich N, Stoffers RH, Gorman JH, Cheung AT, Gorman JH, Gorman RC, Yushkevich PA, Pouch AM. In Vivo Image-Based 4D Modeling of Competent and Regurgitant Mitral Valve Dynamics. EXPERIMENTAL MECHANICS 2021; 61:159-169. [PMID: 33776070 PMCID: PMC7988343 DOI: 10.1007/s11340-020-00656-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/31/2020] [Accepted: 08/05/2020] [Indexed: 06/12/2023]
Abstract
BACKGROUND In vivo characterization of mitral valve dynamics relies on image analysis algorithms that accurately reconstruct valve morphology and motion from clinical images. The goal of such algorithms is to provide patient-specific descriptions of both competent and regurgitant mitral valves, which can be used as input to biomechanical analyses and provide insights into the pathophysiology of diseases like ischemic mitral regurgitation (IMR). OBJECTIVE The goal is to generate accurate image-based representations of valve dynamics that visually and quantitatively capture normal and pathological valve function. METHODS We present a novel framework for 4D segmentation and geometric modeling of the mitral valve in real-time 3D echocardiography (rt-3DE), an imaging modality used for pre-operative surgical planning of mitral interventions. The framework integrates groupwise multi-atlas label fusion and template-based medial modeling with Kalman filtering to generate quantitatively descriptive and temporally consistent models of valve dynamics. RESULTS The algorithm is evaluated on rt-3DE data series from 28 patients: 14 with normal mitral valve morphology and 14 with severe IMR. In these 28 data series that total 613 individual 3DE images, each 3D mitral valve segmentation is validated against manual tracing, and temporal consistency between segmentations is demonstrated. CONCLUSIONS Automated 4D image analysis allows for reliable non-invasive modeling of the mitral valve over the cardiac cycle for comparison of annular and leaflet dynamics in pathological and normal mitral valves. Future studies can apply this algorithm to cardiovascular mechanics applications, including patient-specific strain estimation, fluid dynamics simulation, inverse finite element analysis, and risk stratification for surgical treatment.
Collapse
Affiliation(s)
- A H Aly
- Department of Radiology, University of Pennsylvania, Philadelphia, PA, USA
- Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, USA
| | - A H Aly
- Department of Radiology, University of Pennsylvania, Philadelphia, PA, USA
| | - E K Lai
- Gorman Cardiovascular Research Group, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, PA, USA
| | - N Yushkevich
- Department of Radiology, University of Pennsylvania, Philadelphia, PA, USA
| | | | - J H Gorman
- Gorman Cardiovascular Research Group, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, PA, USA
| | - A T Cheung
- Department of Anesthesiology, Perioperative and Pain Medicine, Stanford University Medical Center, Stanford, CA, USA
| | - J H Gorman
- Gorman Cardiovascular Research Group, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, PA, USA
| | - R C Gorman
- Gorman Cardiovascular Research Group, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, PA, USA
| | - P A Yushkevich
- Department of Radiology, University of Pennsylvania, Philadelphia, PA, USA
| | - A M Pouch
- Department of Radiology, University of Pennsylvania, Philadelphia, PA, USA
| |
Collapse
|
5
|
Ginty OK, Moore JT, Eskandari M, Carnahan P, Lasso A, Jolley MA, Monaghan M, Peters TM. Dynamic, patient-specific mitral valve modelling for planning transcatheter repairs. Int J Comput Assist Radiol Surg 2019; 14:1227-1235. [PMID: 31115756 DOI: 10.1007/s11548-019-01998-y] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2019] [Accepted: 05/14/2019] [Indexed: 01/14/2023]
Abstract
PURPOSE Transcatheter, beating heart repair techniques for mitral valve regurgitation is a very active area of development. However, it is difficult to both simulate and predict the clinical outcomes of mitral repairs, owing to the complexity of mitral valve geometry and the influence of hemodynamics. We aim to produce a workflow for manufacturing dynamic patient-specific models to simulate the mitral valve for transcatheter repair applications. METHODS In this paper, we present technology and associated workflow, for using transesophageal echocardiography to generate dynamic physical replicas of patient valves. We validate our workflow using six patient datasets representing patients with unique or particularly challenging pathologies as selected by a cardiologist. The dynamic component of the models and their resultant potential as procedure planning tools is due to a dynamic pulse duplicator that permits the evaluation of the valve models experiencing realistic hemodynamics. RESULTS Early results indicate the workflow has excellent anatomical accuracy and the ability to replicate regurgitation pathologies, as shown by colour Doppler ultrasound and anatomical measurements comparing patients and models. Analysis of all measurements successfully resulted in t critical two-tail > t stat and p values > 0.05, thus demonstrating no statistical difference between the patients and models, owing to high fidelity morphological replication. CONCLUSIONS Due to the combination of a dynamic environment and patient-specific modelling, this workflow demonstrates a promising technology for simulating the complete morphology of mitral valves undergoing transcatheter repairs.
Collapse
Affiliation(s)
- Olivia K Ginty
- Robarts Research Institute, Western University, London, N6A5B7, Canada.
| | - John T Moore
- Robarts Research Institute, Western University, London, N6A5B7, Canada
| | | | - Patrick Carnahan
- Robarts Research Institute, Western University, London, N6A5B7, Canada
| | - Andras Lasso
- Laboratory for Percutaneous Surgery, Queen's University, Kingston, K7L3N6, Canada
| | - Matthew A Jolley
- Department of Anesthesiology and Critical Care Medicine/Division of Pediatric Cardiology, Children's Hospital of Philadelphia, University of Pennsylvania Perelman School of Medicine, Philadelphia, 19104, USA
| | - Mark Monaghan
- King's College Hospital, Denmark Hill, London, SE59RS, UK
| | - Terry M Peters
- Robarts Research Institute, Western University, London, N6A5B7, Canada.,Department of Medical Biophysics, Medical Imaging, School of Biomedical Engineering, Western University, London, N6A3K7, Canada
| |
Collapse
|