1
|
Kadry K, Gupta S, Nezami FR, Edelman ER. Probing the limits and capabilities of diffusion models for the anatomic editing of digital twins. NPJ Digit Med 2024; 7:354. [PMID: 39632966 PMCID: PMC11618336 DOI: 10.1038/s41746-024-01332-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2024] [Accepted: 11/09/2024] [Indexed: 12/07/2024] Open
Abstract
Numerical simulations of cardiovascular device deployment within digital twins of patient-specific anatomy can expedite and de-risk the device design process. Nonetheless, the exclusive use of patient-specific data constrains the anatomic variability that can be explored. We study how Latent Diffusion Models (LDMs) can edit digital twins to create digital siblings. Siblings can serve as the basis for comparative simulations, which can reveal how subtle anatomic variations impact device deployment, and augment virtual cohorts for improved device assessment. Using a case example centered on cardiac anatomy, we study various methods to generate digital siblings. We specifically introduce anatomic variation at different spatial scales or within localized regions, demonstrating the existence of bias toward common anatomic features. We furthermore leverage this bias for virtual cohort augmentation through selective editing, addressing issues related to dataset imbalance and diversity. Our framework delineates the capabilities of diffusion models in synthesizing anatomic variation for numerical simulation studies.
Collapse
Affiliation(s)
- Karim Kadry
- Massachusetts Institute of Technology (MIT), Cambridge, MA, 02139, USA.
| | - Shreya Gupta
- Massachusetts Institute of Technology (MIT), Cambridge, MA, 02139, USA
| | | | - Elazer R Edelman
- Massachusetts Institute of Technology (MIT), Cambridge, MA, 02139, USA
| |
Collapse
|
2
|
Sel K, Osman D, Zare F, Masoumi Shahrbabak S, Brattain L, Hahn J, Inan OT, Mukkamala R, Palmer J, Paydarfar D, Pettigrew RI, Quyyumi AA, Telfer B, Jafari R. Building Digital Twins for Cardiovascular Health: From Principles to Clinical Impact. J Am Heart Assoc 2024; 13:e031981. [PMID: 39087582 PMCID: PMC11681439 DOI: 10.1161/jaha.123.031981] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 08/02/2024]
Abstract
The past several decades have seen rapid advances in diagnosis and treatment of cardiovascular diseases and stroke, enabled by technological breakthroughs in imaging, genomics, and physiological monitoring, coupled with therapeutic interventions. We now face the challenge of how to (1) rapidly process large, complex multimodal and multiscale medical measurements; (2) map all available data streams to the trajectories of disease states over the patient's lifetime; and (3) apply this information for optimal clinical interventions and outcomes. Here we review new advances that may address these challenges using digital twin technology to fulfill the promise of personalized cardiovascular medical practice. Rooted in engineering mechanics and manufacturing, the digital twin is a virtual representation engineered to model and simulate its physical counterpart. Recent breakthroughs in scientific computation, artificial intelligence, and sensor technology have enabled rapid bidirectional interactions between the virtual-physical counterparts with measurements of the physical twin that inform and improve its virtual twin, which in turn provide updated virtual projections of disease trajectories and anticipated clinical outcomes. Verification, validation, and uncertainty quantification builds confidence and trust by clinicians and patients in the digital twin and establishes boundaries for the use of simulations in cardiovascular medicine. Mechanistic physiological models form the fundamental building blocks of the personalized digital twin that continuously forecast optimal management of cardiovascular health using individualized data streams. We present exemplars from the existing body of literature pertaining to mechanistic model development for cardiovascular dynamics and summarize existing technical challenges and opportunities pertaining to the foundation of a digital twin.
Collapse
Affiliation(s)
- Kaan Sel
- Laboratory for Information & Decision Systems (LIDS)Massachusetts Institute of TechnologyCambridgeMAUSA
| | - Deen Osman
- Department of Electrical and Computer EngineeringTexas A&M UniversityCollege StationTXUSA
| | - Fatemeh Zare
- Department of Electrical and Computer EngineeringTexas A&M UniversityCollege StationTXUSA
| | | | - Laura Brattain
- Lincoln LaboratoryMassachusetts Institute of TechnologyLexingtonMAUSA
| | - Jin‐Oh Hahn
- Department of Mechanical EngineeringUniversity of MarylandCollege ParkMDUSA
| | - Omer T. Inan
- School of Electrical and Computer EngineeringGeorgia Institute of TechnologyAtlantaGAUSA
| | - Ramakrishna Mukkamala
- Department of Bioengineering and Anesthesiology and Perioperative MedicineUniversity of PittsburghPittsburghPAUSA
| | - Jeffrey Palmer
- Lincoln LaboratoryMassachusetts Institute of TechnologyLexingtonMAUSA
| | - David Paydarfar
- Department of NeurologyThe University of Texas at Austin Dell Medical SchoolAustinTXUSA
| | | | - Arshed A. Quyyumi
- Emory Clinical Cardiovascular Research Institute, Division of Cardiology, Department of MedicineEmory University School of MedicineAtlantaGAUSA
| | - Brian Telfer
- Lincoln LaboratoryMassachusetts Institute of TechnologyLexingtonMAUSA
| | - Roozbeh Jafari
- Laboratory for Information & Decision Systems (LIDS)Massachusetts Institute of TechnologyCambridgeMAUSA
- Department of Electrical and Computer EngineeringTexas A&M UniversityCollege StationTXUSA
- Lincoln LaboratoryMassachusetts Institute of TechnologyLexingtonMAUSA
- School of Engineering MedicineTexas A&M UniversityHoustonTXUSA
| |
Collapse
|
3
|
Villegas-Martinez M, de Villedon de Naide V, Muthurangu V, Bustin A. The beating heart: artificial intelligence for cardiovascular application in the clinic. MAGMA (NEW YORK, N.Y.) 2024; 37:369-382. [PMID: 38907767 DOI: 10.1007/s10334-024-01180-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/26/2023] [Revised: 04/25/2024] [Accepted: 06/13/2024] [Indexed: 06/24/2024]
Abstract
Artificial intelligence (AI) integration in cardiac magnetic resonance imaging presents new and exciting avenues for advancing patient care, automating post-processing tasks, and enhancing diagnostic precision and outcomes. The use of AI significantly streamlines the examination workflow through the reduction of acquisition and postprocessing durations, coupled with the automation of scan planning and acquisition parameters selection. This has led to a notable improvement in examination workflow efficiency, a reduction in operator variability, and an enhancement in overall image quality. Importantly, AI unlocks new possibilities to achieve spatial resolutions that were previously unattainable in patients. Furthermore, the potential for low-dose and contrast-agent-free imaging represents a stride toward safer and more patient-friendly diagnostic procedures. Beyond these benefits, AI facilitates precise risk stratification and prognosis evaluation by adeptly analysing extensive datasets. This comprehensive review article explores recent applications of AI in the realm of cardiac magnetic resonance imaging, offering insights into its transformative potential in the field.
Collapse
Affiliation(s)
- Manuel Villegas-Martinez
- IHU LIRYC, Electrophysiology and Heart Modeling Institute, Hôpital Xavier Arnozan, Université de Bordeaux-INSERM U1045, Avenue du Haut Lévêque, 33604, Pessac, France
- Department of Cardiovascular Imaging, Hôpital Cardiologique du Haut-Lévêque, CHU de Bordeaux, Avenue de Magellan, 33604, Pessac, France
| | - Victor de Villedon de Naide
- IHU LIRYC, Electrophysiology and Heart Modeling Institute, Hôpital Xavier Arnozan, Université de Bordeaux-INSERM U1045, Avenue du Haut Lévêque, 33604, Pessac, France
- Department of Cardiovascular Imaging, Hôpital Cardiologique du Haut-Lévêque, CHU de Bordeaux, Avenue de Magellan, 33604, Pessac, France
| | - Vivek Muthurangu
- Center for Cardiovascular Imaging, UCL Institute of Cardiovascular Science, University College London, London, WC1N 1EH, UK
| | - Aurélien Bustin
- IHU LIRYC, Electrophysiology and Heart Modeling Institute, Hôpital Xavier Arnozan, Université de Bordeaux-INSERM U1045, Avenue du Haut Lévêque, 33604, Pessac, France.
- Department of Cardiovascular Imaging, Hôpital Cardiologique du Haut-Lévêque, CHU de Bordeaux, Avenue de Magellan, 33604, Pessac, France.
- Department of Diagnostic and Interventional Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland.
| |
Collapse
|
4
|
Zhang L, Wu X, Zhang J, Liu Z, Fan Y, Zheng L, Liu P, Song H, Lyu G. SEG-LUS: A novel ultrasound segmentation method for liver and its accessory structures based on muti-head self-attention. Comput Med Imaging Graph 2024; 113:102338. [PMID: 38290353 DOI: 10.1016/j.compmedimag.2024.102338] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Revised: 12/13/2023] [Accepted: 01/14/2024] [Indexed: 02/01/2024]
Abstract
Although liver ultrasound (US) is quick and convenient, it presents challenges due to patient variations. Previous research has predominantly focused on computer-aided diagnosis (CAD), particularly for disease analysis. However, characterizing liver US images is complex due to structural diversity and a limited number of samples. Normal liver US images are crucial, especially for standard section diagnosis. This study explicitly addresses Liver US standard sections (LUSS) and involves detailed labeling of eight anatomical structures. We propose SEG-LUS, a US image segmentation model for the liver and its accessory structures. In SEG-LUS, we have adopted the shifted windows feature encoder combined with the cross-attention mechanism to adapt to capturing image information at different scales and resolutions and address context mismatch and sample imbalance in the segmentation task. By introducing the UUF module, we achieve the perfect fusion of shallow and deep information, making the information retained by the network in the feature extraction process more comprehensive. We have improved the Focal Loss to tackle the imbalance of pixel-level distribution. The results show that the SEG-LUS model exhibits significant performance improvement, with mPA, mDice, mIOU, and mASD reaching 85.05%, 82.60%, 74.92%, and 0.31, respectively. Compared with seven state-of-the-art semantic segmentation methods, the mPA improves by 5.32%. SEG-LUS is positioned to serve as a crucial reference for research in computer-aided modeling using liver US images, thereby advancing the field of US medicine research.
Collapse
Affiliation(s)
- Lei Zhang
- College of Physics and Electronic Engineering, Northwest Normal University, Lanzhou 730070, China
| | - Xiuming Wu
- Department of Ultrasound, Quanzhou First Hospital Affiliated to Fujian Medical University, Quanzhou 362000, China
| | - Jiansong Zhang
- College of Medicine, Huaqiao University, Quanzhou 362021, China
| | - Zhonghua Liu
- Department of Ultrasound, Quanzhou First Hospital Affiliated to Fujian Medical University, Quanzhou 362000, China
| | - Yuling Fan
- College of Engineering, Huaqiao University, Quanzhou 362021, China
| | - Lan Zheng
- College of Engineering, Huaqiao University, Quanzhou 362021, China
| | - Peizhong Liu
- College of Medicine, Huaqiao University, Quanzhou 362021, China; College of Engineering, Huaqiao University, Quanzhou 362021, China; Collaborative Innovation Center for Maternal and Infant Health Service Application Technology, Quanzhou Medical College, Quanzhou 362011, China.
| | - Haisheng Song
- College of Physics and Electronic Engineering, Northwest Normal University, Lanzhou 730070, China.
| | - Guorong Lyu
- Collaborative Innovation Center for Maternal and Infant Health Service Application Technology, Quanzhou Medical College, Quanzhou 362011, China; Department of Ultrasound, The Second Hospital of Quanzhou Affiliated to Fujian Medical University, Quanzhou, China.
| |
Collapse
|
5
|
Bunik VI. Editorial: Experts' opinion in medicine 2022. Front Med (Lausanne) 2023; 10:1296196. [PMID: 37886362 PMCID: PMC10598464 DOI: 10.3389/fmed.2023.1296196] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Accepted: 09/29/2023] [Indexed: 10/28/2023] Open
Affiliation(s)
- Victoria I. Bunik
- Belosersky Institute of Physicochemical Biology, Lomonosov Moscow State University, Moscow, Russia
- Faculty of Bioengineering and Bioinformatics, Lomonosov Moscow State University, Moscow, Russia
- Department of Biochemistry, I.M. Sechenov First Moscow State Medical University, Moscow, Russia
| |
Collapse
|