Growing a Random Forest with Fuzzy Spatial Features for Fully Automatic Artery-Specific Coronary Calcium Scoring

Active multitask learning with uncertainty-weighted loss for coronary calcium scoring

PURPOSE

The coronary artery calcification (CAC) score is an independent marker for the risk of cardiovascular events. Automatic methods for quantifying CAC could reduce workload and assist radiologists in clinical decision-making. However, large annotated datasets are needed for training to achieve very good model performance, which is an expensive process and requires expert knowledge. The number of training data required can be reduced in an active learning scenario, which requires only the most informative samples to be labeled. Multitask learning techniques can improve model performance by joint learning of multiple related tasks and extraction of shared informative features.

METHODS

We propose an uncertainty-weighted multitask learning model for coronary calcium scoring in electrocardiogram-gated (ECG-gated), noncontrast-enhanced cardiac calcium scoring CT. The model was trained to solve the two tasks of coronary artery region segmentation (weak labels) and coronary artery calcification segmentation (strong labels) simultaneously in an active learning scenario to improve model performance and reduce the number of samples needed for training. We compared our model with a single-task U-Net and a sequential-task model as well as other state-of-the-art methods. The model was evaluated on 1275 individual patients in three different datasets (DISCHARGE, CADMAN, orCaScore), and the relationship between model performance and various influencing factors (image noise, metal artifacts, motion artifacts, image quality) was analyzed.

RESULTS

Joint learning of multiclass coronary artery region segmentation and binary coronary calcium segmentation improved calcium scoring performance. Since shared information can be learned from both tasks for complementary purposes, the model reached optimal performance with only 12% of the training data and one-third of the labeling time in an active learning scenario. We identified image noise as one of the most important factors influencing model performance along with anatomical abnormalities and metal artifacts.

CONCLUSIONS

Our multitask learning approach with uncertainty-weighted loss improves calcium scoring performance by joint learning of shared features and reduces labeling costs when trained in an active learning scenario.

AI-Supported Comprehensive Detection and Quantification of Biomarkers of Subclinical Widespread Diseases at Chest CT for Preventive Medicine

Automated image analysis plays an increasing role in radiology in detecting and quantifying image features outside of the perception of human eyes. Common AI-based approaches address a single medical problem, although patients often present with multiple interacting, frequently subclinical medical conditions. A holistic imaging diagnostics tool based on artificial intelligence (AI) has the potential of providing an overview of multi-system comorbidities within a single workflow. An interdisciplinary, multicentric team of medical experts and computer scientists designed a pipeline, comprising AI-based tools for the automated detection, quantification and characterization of the most common pulmonary, metabolic, cardiovascular and musculoskeletal comorbidities in chest computed tomography (CT). To provide a comprehensive evaluation of each patient, a multidimensional workflow was established with algorithms operating synchronously on a decentralized Joined Imaging Platform (JIP). The results of each patient are transferred to a dedicated database and summarized as a structured report with reference to available reference values and annotated sample images of detected pathologies. Hence, this tool allows for the comprehensive, large-scale analysis of imaging-biomarkers of comorbidities in chest CT, first in science and then in clinical routine. Moreover, this tool accommodates the quantitative analysis and classification of each pathology, providing integral diagnostic and prognostic value, and subsequently leading to improved preventive patient care and further possibilities for future studies.

Machine learning for coronary artery calcification detection and labeling using only native computer tomography

In recent decades, the World Health Organization has found an increase in the death rate due to cardiovascular disease. Calcifications of the coronary arteries are the main sign of any cardiovascular event. Each individual's calcium score helps estimate the severity of the disease. However, the score for each artery is more significant. This study aims to research the segmentation, the labeling, and then the complete and partial quantification of calcium using only native coronary computed tomography with the help of machine-learning algorithms. Our semi-automatic system limited the region of interest by applying a defined preprocessing step. We then implemented two random forest classifiers; the first separated true coronary artery calcification (CAC) from the noise, and the second labeled CAC into the right coronary artery, left coronary artery, left anterior descending artery, and left circumflex artery using specific features. Agatston score and volume score of each CAC, each artery, and all of the arteries were calculated. This method gave promising results, comparable to those found in the literature, with the accuracy of 99.98% and 100% for CAC detection and labeling respectively.

Automatic coronary artery calcium scoring from unenhanced-ECG-gated CT using deep learning

PURPOSE

The purpose of this study was to develop and evaluate an algorithm that can automatically estimate the amount of coronary artery calcium (CAC) from unenhanced electrocardiography (ECG)-gated computed tomography (CT) cardiac volume acquisitions by using convolutional neural networks (CNN).

MATERIALS AND METHODS

The method used a set of five CNN with three-dimensional (3D) U-Net architecture trained on a database of 783 CT examinations to detect and segment coronary artery calcifications in a 3D volume. The Agatston score, the conventional CAC scoring, was then computed slice by slice from the resulting segmentation mask and compared to the ground truth manually estimated by radiologists. The quality of the estimation was assessed with the concordance index (C-index) on CAC risk category on a separate testing set of 98 independent CT examinations.

RESULTS

The final model yielded a C-index of 0.951 on the testing set. The remaining errors of the method were mainly observed on small-size and/or low-density calcifications, or calcifications located near the mitral valve or ring.

CONCLUSION

The deep learning-based method proposed here to compute automatically the CAC score from unenhanced-ECG-gated cardiac CT is fast, robust and yields accuracy similar to those of other artificial intelligence methods, which could improve workflow efficiency, eliminating the time spent on manually selecting coronary calcifications to compute the Agatston score.

Evaluation of an AI-based, automatic coronary artery calcium scoring software

Objectives

To evaluate an artificial intelligence (AI)–based, automatic coronary artery calcium (CAC) scoring software, using a semi-automatic software as a reference.

Methods

This observational study included 315 consecutive, non-contrast-enhanced calcium scoring computed tomography (CSCT) scans. A semi-automatic and an automatic software obtained the Agatston score (AS), the volume score (VS), the mass score (MS), and the number of calcified coronary lesions. Semi-automatic and automatic analysis time were registered, including a manual double-check of the automatic results. Statistical analyses were Spearman’s rank correlation coefficient (⍴), intra-class correlation (ICC), Bland Altman plots, weighted kappa analysis (κ), and Wilcoxon signed-rank test.

Results

The correlation and agreement for the AS, VS, and MS were ⍴ = 0.935, 0.932, 0.934 (p < 0.001), and ICC = 0.996, 0.996, 0.991, respectively (p < 0.001). The correlation and agreement for the number of calcified lesions were ⍴ = 0.903 and ICC = 0.977 (p < 0.001), respectively. The Bland Altman mean difference and 1.96 SD upper and lower limits of agreements for the AS, VS, and MS were − 8.2 (− 115.1 to 98.2), − 7.4 (− 93.9 to 79.1), and − 3.8 (− 33.6 to 25.9), respectively. Agreement in risk category assignment was 89.5% and κ = 0.919 (p < 0.001). The median time for the semi-automatic and automatic method was 59 s (IQR 35–100) and 36 s (IQR 29–49), respectively (p < 0.001).

Conclusions

There was an excellent correlation and agreement between the automatic software and the semi-automatic software for three CAC scores and the number of calcified lesions. Risk category classification was accurate but showing an overestimation bias tendency. Also, the automatic method was less time-demanding.

Key Points

• Coronary artery calcium (CAC) scoring is an excellent candidate for artificial intelligence (AI) development in a clinical setting.

• An AI-based, automatic software obtained CAC scores with excellent correlation and agreement compared with a conventional method but was less time-consuming.