Supervised machine learning for coronary artery lumen segmentation in intravascular ultrasound images

Deep Learning Paradigm and Its Bias for Coronary Artery Wall Segmentation in Intravascular Ultrasound Scans: A Closer Look

BACKGROUND AND MOTIVATION

Coronary artery disease (CAD) has the highest mortality rate; therefore, its diagnosis is vital. Intravascular ultrasound (IVUS) is a high-resolution imaging solution that can image coronary arteries, but the diagnosis software via wall segmentation and quantification has been evolving. In this study, a deep learning (DL) paradigm was explored along with its bias.

METHODS

Using a PRISMA model, 145 best UNet-based and non-UNet-based methods for wall segmentation were selected and analyzed for their characteristics and scientific and clinical validation. This study computed the coronary wall thickness by estimating the inner and outer borders of the coronary artery IVUS cross-sectional scans. Further, the review explored the bias in the DL system for the first time when it comes to wall segmentation in IVUS scans. Three bias methods, namely (i) ranking, (ii) radial, and (iii) regional area, were applied and compared using a Venn diagram. Finally, the study presented explainable AI (XAI) paradigms in the DL framework.

FINDINGS AND CONCLUSIONS

UNet provides a powerful paradigm for the segmentation of coronary walls in IVUS scans due to its ability to extract automated features at different scales in encoders, reconstruct the segmented image using decoders, and embed the variants in skip connections. Most of the research was hampered by a lack of motivation for XAI and pruned AI (PAI) models. None of the UNet models met the criteria for bias-free design. For clinical assessment and settings, it is necessary to move from a paper-to-practice approach.

Recent Advances in Machine Learning Applied to Ultrasound Imaging

Machine learning (ML) methods are pervading an increasing number of fields of application because of their capacity to effectively solve a wide variety of challenging problems. The employment of ML techniques in ultrasound imaging applications started several years ago but the scientific interest in this issue has increased exponentially in the last few years. The present work reviews the most recent (2019 onwards) implementations of machine learning techniques for two of the most popular ultrasound imaging fields, medical diagnostics and non-destructive evaluation. The former, which covers the major part of the review, was analyzed by classifying studies according to the human organ investigated and the methodology (e.g., detection, segmentation, and/or classification) adopted, while for the latter, some solutions to the detection/classification of material defects or particular patterns are reported. Finally, the main merits of machine learning that emerged from the study analysis are summarized and discussed.

Fully automated lumen and vessel contour segmentation in intravascular ultrasound datasets

Segmentation of lumen and vessel contours in intravascular ultrasound (IVUS) pullbacks is an arduous and time-consuming task, which demands adequately trained human resources. In the present study, we propose a machine learning approach to automatically extract lumen and vessel boundaries from IVUS datasets. The proposed approach relies on the concatenation of a deep neural network to deliver a preliminary segmentation, followed by a Gaussian process (GP) regressor to construct the final lumen and vessel contours. A multi-frame convolutional neural network (MFCNN) exploits adjacency information present in longitudinally neighboring IVUS frames, while the GP regression method filters high-dimensional noise, delivering a consistent representation of the contours. Overall, 160 IVUS pullbacks (63 patients) from the IBIS-4 study (Integrated Biomarkers and Imaging Study-4, Trial NCT00962416), were used in the present work. The MFCNN algorithm was trained with 100 IVUS pullbacks (8427 manually segmented frames), was validated with 30 IVUS pullbacks (2583 manually segmented frames) and was blindly tested with 30 IVUS pullbacks (2425 manually segmented frames). Image and contour metrics were used to characterize model performance by comparing ground truth (GT) and machine learning (ML) contours. Median values (interquartile range, IQR) of the Jaccard index for lumen and vessel were 0.913, [0.882,0.935] and 0.940, [0.917,0.957], respectively. Median values (IQR) of the Hausdorff distance for lumen and vessel were 0.196mm, [0.146,0.275]mm and 0.163mm, [0.122,0.234]mm, respectively. Also, the mean value of lumen area predictions, and limits of agreement were -0.19mm², [1.1,-1.5]mm², while the mean value and limits of agreement of plaque burden were 0.0022, [0.082,-0.078]. The results obtained with the model developed in this work allow us to conclude that the proposed machine learning approach delivers accurate segmentations in terms of image metrics, contour metrics and clinically relevant variables, enabling its use in clinical routine by mitigating the costs involved in the manual management of IVUS datasets.

Automated lumen segmentation using multi-frame convolutional neural networks in intravascular ultrasound datasets

Aims

Assessment of minimum lumen areas in intravascular ultrasound (IVUS) pullbacks is time-consuming and demands adequately trained personnel. In this work, we introduce a novel and fully automated pipeline to segment the lumen boundary in IVUS datasets.

Methods and results

First, an automated gating is applied to select end-diastolic frames and bypass saw-tooth artefacts. Second, within a machine learning (ML) environment, we automatically segment the lumen boundary using a multi-frame (MF) convolutional neural network (MFCNN). Finally, we use the theory of Gaussian processes (GPs) to regress the final lumen boundary. The dataset consisted of 85 IVUS pullbacks (52 patients). The dataset was partitioned at the pullback-level using 73 pullbacks for training (20 586 frames), 6 pullbacks for validation (1692 frames), and 6 for testing (1692 frames). The degree of overlapping, between the ground truth and ML contours, median (interquartile range, IQR) systematically increased from 0.896 (0.874-0.933) for MF1 to 0.925 (0.911-0.948) for MF11. The median (IQR) of the distance error was also reduced from 3.83 (2.94-4.98)% for MF1 to 3.02 (2.25-3.95)% for MF11-GP. The corresponding median (IQR) in the lumen area error remained between 5.49 (2.50-10.50)% for MF1 and 5.12 (2.15-9.00)% for MF11-GP. The dispersion in the relative distance and area errors consistently decreased as we increased the number of frames, and also when the GP regressor was coupled to the MFCNN output.

Conclusion

These results demonstrate that the proposed ML approach is suitable to effectively segment the lumen boundary in IVUS scans, reducing the burden of costly and time-consuming manual delineation.