1
|
Miller RJH, Killekar A, Shanbhag A, Bednarski B, Michalowska AM, Ruddy TD, Einstein AJ, Newby DE, Lemley M, Pieszko K, Van Kriekinge SD, Kavanagh PB, Liang JX, Huang C, Dey D, Berman DS, Slomka PJ. Predicting mortality from AI cardiac volumes mass and coronary calcium on chest computed tomography. Nat Commun 2024; 15:2747. [PMID: 38553462 PMCID: PMC10980695 DOI: 10.1038/s41467-024-46977-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2023] [Accepted: 03/12/2024] [Indexed: 04/02/2024] Open
Abstract
Chest computed tomography is one of the most common diagnostic tests, with 15 million scans performed annually in the United States. Coronary calcium can be visualized on these scans, but other measures of cardiac risk such as atrial and ventricular volumes have classically required administration of contrast. Here we show that a fully automated pipeline, incorporating two artificial intelligence models, automatically quantifies coronary calcium, left atrial volume, left ventricular mass, and other cardiac chamber volumes in 29,687 patients from three cohorts. The model processes chamber volumes and coronary artery calcium with an end-to-end time of ~18 s, while failing to segment only 0.1% of cases. Coronary calcium, left atrial volume, and left ventricular mass index are independently associated with all-cause and cardiovascular mortality and significantly improve risk classification compared to identification of abnormalities by a radiologist. This automated approach can be integrated into clinical workflows to improve identification of abnormalities and risk stratification, allowing physicians to improve clinical decision-making.
Collapse
Affiliation(s)
- Robert J H Miller
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
- Department of Cardiac Sciences, University of Calgary, Calgary, AB, Canada
| | - Aditya Killekar
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Aakash Shanbhag
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Bryan Bednarski
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Anna M Michalowska
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Terrence D Ruddy
- Division of Cardiology, University of Ottawa Heart Institute, Ottawa, Ontario, Canada
| | - Andrew J Einstein
- Division of Cardiology, Department of Medicine, Columbia University Irving Medical Center and New York-Presbyterian Hospital, New York, New York, NY, USA
- Department of Radiology, Columbia University Irving Medical Center and New York-Presbyterian Hospital, New York, New York, NY, USA
| | - David E Newby
- British Heart Foundation Centre for Cardiovascular Science, University of Edinburgh, Edinburgh, UK
| | - Mark Lemley
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Konrad Pieszko
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
- Department of Interventional Cardiology and Cardiac Surgery, University of Zielona Gora, Gora, Poland
| | - Serge D Van Kriekinge
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Paul B Kavanagh
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Joanna X Liang
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Cathleen Huang
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Damini Dey
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Daniel S Berman
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Piotr J Slomka
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA.
| |
Collapse
|
2
|
Miller RJH, Shanbhag A, Killekar A, Lemley M, Bednarski B, Van Kriekinge SD, Kavanagh PB, Feher A, Miller EJ, Einstein AJ, Ruddy TD, Liang JX, Builoff V, Berman DS, Dey D, Slomka PJ. AI-derived epicardial fat measurements improve cardiovascular risk prediction from myocardial perfusion imaging. NPJ Digit Med 2024; 7:24. [PMID: 38310123 PMCID: PMC10838293 DOI: 10.1038/s41746-024-01020-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2023] [Accepted: 01/18/2024] [Indexed: 02/05/2024] Open
Abstract
Epicardial adipose tissue (EAT) volume and attenuation are associated with cardiovascular risk, but manual annotation is time-consuming. We evaluated whether automated deep learning-based EAT measurements from ungated computed tomography (CT) are associated with death or myocardial infarction (MI). We included 8781 patients from 4 sites without known coronary artery disease who underwent hybrid myocardial perfusion imaging. Of those, 500 patients from one site were used for model training and validation, with the remaining patients held out for testing (n = 3511 internal testing, n = 4770 external testing). We modified an existing deep learning model to first identify the cardiac silhouette, then automatically segment EAT based on attenuation thresholds. Deep learning EAT measurements were obtained in <2 s compared to 15 min for expert annotations. There was excellent agreement between EAT attenuation (Spearman correlation 0.90 internal, 0.82 external) and volume (Spearman correlation 0.90 internal, 0.91 external) by deep learning and expert segmentation in all 3 sites (Spearman correlation 0.90-0.98). During median follow-up of 2.7 years (IQR 1.6-4.9), 565 patients experienced death or MI. Elevated EAT volume and attenuation were independently associated with an increased risk of death or MI after adjustment for relevant confounders. Deep learning can automatically measure EAT volume and attenuation from low-dose, ungated CT with excellent correlation with expert annotations, but in a fraction of the time. EAT measurements offer additional prognostic insights within the context of hybrid perfusion imaging.
Collapse
Affiliation(s)
- Robert J H Miller
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
- Department of Cardiac Sciences, University of Calgary, Calgary, AB, Canada
| | - Aakash Shanbhag
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
- Signal and Image Processing Institute, Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, USA
| | - Aditya Killekar
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Mark Lemley
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Bryan Bednarski
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Serge D Van Kriekinge
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Paul B Kavanagh
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Attila Feher
- Section of Cardiovascular Medicine, Department of Internal Medicine, Yale University School of Medicine, New Haven, CT, USA
| | - Edward J Miller
- Section of Cardiovascular Medicine, Department of Internal Medicine, Yale University School of Medicine, New Haven, CT, USA
| | - Andrew J Einstein
- Division of Cardiology, Department of Medicine, and Department of Radiology, Columbia University Irving Medical Center and New York-Presbyterian Hospital, New York, NY, USA
| | - Terrence D Ruddy
- Division of Cardiology, University of Ottawa Heart Institute, Ottawa, ON, Canada
| | - Joanna X Liang
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Valerie Builoff
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Daniel S Berman
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Damini Dey
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Piotr J Slomka
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging and Biomedical Sciences Cedars-Sinai Medical Center, Los Angeles, CA, USA.
| |
Collapse
|
3
|
Miller RJH, Pieszko K, Shanbhag A, Feher A, Lemley M, Killekar A, Kavanagh PB, Van Kriekinge SD, Liang JX, Huang C, Miller EJ, Bateman T, Berman DS, Dey D, Slomka PJ. Deep Learning Coronary Artery Calcium Scores from SPECT/CT Attenuation Maps Improve Prediction of Major Adverse Cardiac Events. J Nucl Med 2023; 64:652-658. [PMID: 36207138 PMCID: PMC10071789 DOI: 10.2967/jnumed.122.264423] [Citation(s) in RCA: 17] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2022] [Revised: 10/04/2022] [Accepted: 10/04/2022] [Indexed: 11/16/2022] Open
Abstract
Low-dose ungated CT attenuation correction (CTAC) scans are commonly obtained with SPECT/CT myocardial perfusion imaging. Despite the characteristically low image quality of CTAC, deep learning (DL) can potentially quantify coronary artery calcium (CAC) from these scans in an automatic manner. We evaluated CAC quantification derived with a DL model, including correlation with expert annotations and associations with major adverse cardiovascular events (MACE). Methods: We trained a convolutional long short-term memory DL model to automatically quantify CAC on CTAC scans using 6,608 studies (2 centers) and evaluated the model in an external cohort of patients without known coronary artery disease (n = 2,271) obtained in a separate center. We assessed agreement between DL and expert annotated CAC scores. We also assessed associations between MACE (death, revascularization, myocardial infarction, or unstable angina) and CAC categories (0, 1-100, 101-400, or >400) for scores manually derived by experienced readers and scores obtained fully automatically by DL using multivariable Cox models (adjusted for age, sex, past medical history, perfusion, and ejection fraction) and net reclassification index. Results: In the external testing population, DL CAC was 0 in 908 patients (40.0%), 1-100 in 596 (26.2%), 100-400 in 354 (15.6%), and >400 in 413 (18.2%). Agreement in CAC category by DL CAC and expert annotation was excellent (linear weighted κ, 0.80), but DL CAC was obtained automatically in less than 2 s compared with about 2.5 min for expert CAC. DL CAC category was an independent risk factor for MACE with hazard ratios in comparison to a CAC of zero: CAC of 1-100 (2.20; 95% CI, 1.54-3.14; P < 0.001), CAC of 101-400 (4.58; 95% CI, 3.23-6.48; P < 0.001), and CAC of more than 400 (5.92; 95% CI, 4.27-8.22; P < 0.001). Overall, the net reclassification index was 0.494 for DL CAC, which was similar to expert annotated CAC (0.503). Conclusion: DL CAC from SPECT/CT attenuation maps agrees well with expert CAC annotations and provides a similar risk stratification but can be obtained automatically. DL CAC scores improved classification of a significant proportion of patients as compared with SPECT myocardial perfusion alone.
Collapse
Affiliation(s)
- Robert J H Miller
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California
- Department of Cardiac Sciences, University of Calgary, Calgary, Alberta, Canada
| | - Konrad Pieszko
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California
- Department of Interventional Cardiology and Cardiac Surgery, University of Zielona Góra, Zielona Góra, Poland
| | - Aakash Shanbhag
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California
| | - Attila Feher
- Section of Cardiovascular Medicine, Department of Internal Medicine, Yale University School of Medicine, New Haven, Connecticut; and
| | - Mark Lemley
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California
| | - Aditya Killekar
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California
| | - Paul B Kavanagh
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California
| | - Serge D Van Kriekinge
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California
| | - Joanna X Liang
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California
| | - Cathleen Huang
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California
| | - Edward J Miller
- Section of Cardiovascular Medicine, Department of Internal Medicine, Yale University School of Medicine, New Haven, Connecticut; and
| | - Timothy Bateman
- Cardiovascular Imaging Technologies LLC, Kansas City, Missouri
| | - Daniel S Berman
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California
| | - Damini Dey
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California
| | - Piotr J Slomka
- Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California;
| |
Collapse
|