Modelling of image-catheter motion for 3-D IVUS

POST-IVUS: A perceptual organisation-aware selective transformer framework for intravascular ultrasound segmentation

Intravascular ultrasound (IVUS) is recommended in guiding coronary intervention. The segmentation of coronary lumen and external elastic membrane (EEM) borders in IVUS images is a key step, but the manual process is time-consuming and error-prone, and suffers from inter-observer variability. In this paper, we propose a novel perceptual organisation-aware selective transformer framework that can achieve accurate and robust segmentation of the vessel walls in IVUS images. In this framework, temporal context-based feature encoders extract efficient motion features of vessels. Then, a perceptual organisation-aware selective transformer module is proposed to extract accurate boundary information, supervised by a dedicated boundary loss. The obtained EEM and lumen segmentation results will be fused in a temporal constraining and fusion module, to determine the most likely correct boundaries with robustness to morphology. Our proposed methods are extensively evaluated in non-selected IVUS sequences, including normal, bifurcated, and calcified vessels with shadow artifacts. The results show that the proposed methods outperform the state-of-the-art, with a Jaccard measure of 0.92 for lumen and 0.94 for EEM on the IVUS 2011 open challenge dataset. This work has been integrated into a software QCU-CMS2 to automatically segment IVUS images in a user-friendly environment.

A Deep Learning Method for Motion Artifact Correction in Intravascular Photoacoustic Image Sequence

In vivo application of intravascular photoacoustic (IVPA) imaging for coronary arteries is hampered by motion artifacts associated with the cardiac cycle. Gating is a common strategy to mitigate motion artifacts. However, a large amount of diagnostically valuable information might be lost due to one frame per cycle. In this work, we present a deep learning-based method for directly correcting motion artifacts in non-gated IVPA pullback sequences. The raw signal frames are classified into dynamic and static frames by clustering. Then, a neural network named Motion Artifact Correction (MAC)-Net is designed to correct motion in dynamic frames. Given the lack of the ground truth information on the underlying dynamics of coronary arteries, we trained and tested the network using a computer-generated dataset. Based on the results, it has been observed that the trained network can directly correct motion in successive frames while preserving the original structures without discarding any frames. The improvement in the visual effect of the longitudinal view has been demonstrated based on quantitative evaluation of the inter-frame dissimilarity. The comparison results validated the motion-suppression ability of our method comparable to gating and image registration-based non-learning methods, while maintaining the integrity of the pullbacks without image preprocessing. Experimental results from in vivo intravascular ultrasound and optical coherence tomography pullbacks validated the feasibility of our method in the in vivo intracoronary imaging scenario.

High contrast power Doppler imaging in side-viewing intravascular ultrasound imaging via angular compounding

The ability to assess likelihood of plaque rupture can determine the course of treatment in coronary artery disease. One indicator of plaque vulnerability is the development of blood vessels within the plaque, or intraplaque neovascularization. In order to visualize these vessels with increased sensitivity in the cardiac catheterization lab, a new approach for imaging blood flow in small vessels using side-viewing intravascular ultrasound (IVUS) is proposed. This approach based on compounding adjacent angular acquisitions was evaluated in tissue mimicking phantoms and ex vivo vessels. In phantom studies, the Doppler CNR increased from 3.3 ± 1.0 to 13 ± 2.6 (conventional clutter filtering) and from 1.9 ± 0.15 to 7.5 ± 1.1 (SVD filtering) as a result of applying angular compounding. When imaging flow at a rate of 5.6 mm/s in 200 µm tubes adjacent to the lumen of ex vivo porcine arteries, the Doppler CNR increased from 5.3 ± 0.95 to 7.2 ± 1.3 (conventional filtering) and from 23 ± 3.3 to 32 ± 6.7 (SVD filtering). Applying these strategies could allow increased sensitivity to slow flow in side-viewing intravascular ultrasound imaging.

The role of noninvasive and invasive diagnostic imaging techniques for detection of extra-cranial venous system anomalies and developmental variants

The extra-cranial venous system is complex and not well studied in comparison to the peripheral venous system. A newly proposed vascular condition, named chronic cerebrospinal venous insufficiency (CCSVI), described initially in patients with multiple sclerosis (MS) has triggered intense interest in better understanding of the role of extra-cranial venous anomalies and developmental variants. So far, there is no established diagnostic imaging modality, non-invasive or invasive, that can serve as the "gold standard" for detection of these venous anomalies. However, consensus guidelines and standardized imaging protocols are emerging. Most likely, a multimodal imaging approach will ultimately be the most comprehensive means for screening, diagnostic and monitoring purposes. Further research is needed to determine the spectrum of extra-cranial venous pathology and to compare the imaging findings with pathological examinations. The ability to define and reliably detect noninvasively these anomalies is an essential step toward establishing their incidence and prevalence. The role for these anomalies in causing significant hemodynamic consequences for the intra-cranial venous drainage in MS patients and other neurologic disorders, and in aging, remains unproven.

Motion artifacts associated with in vivo endoscopic OCT images of the esophagus

3-D optical coherence tomography (OCT) has been extensively investigated as a potential screening and/or surveillance tool for Barrett's esophagus (BE). Understanding and correcting motion artifact may improve image interpretation. In this work, the motion trace was analyzed to show the physiological origin (respiration and heart beat) of the artifacts. Results showed that increasing balloon pressure did not sufficiently suppress the physiological motion artifact. An automated registration algorithm was designed to correct such artifacts. The performance of the algorithm was evaluated in images of normal porcine esophagus and demonstrated in images of BE in human patients.

Classification of blood regions in IVUS images using three dimensional brushlet expansions

The presence of non-coherent blood speckle patterns makes the assessment of lumen size in intravascular ultrasound (IVUS) images a challenging problem, especially for images acquired with recent high frequency transducers. In this paper, we present a robust three-dimensional (3D) feature extraction algorithm based on the expansion of IVUS cross-sectional images and pullback directions onto an orthonormal complex brushlet basis. Several features are selected from the projections of low-frequency 3D brushlet coefficients. These representations are used as inputs to a neural network that is trained to classify blood maps on IVUS images. We evaluated the algorithm performance using repeated randomized experiments on sub-samples to validate the quantification of the blood maps when compared to expert manual tracings of 258 frames collected from three patients. Our results demonstrate that the proposed features extracted in the brushlet domain capture well the non-coherent structures of blood speckle, enabling identification of blood pools and enhancement of the lumen area.