Current research and future prospects of IVOCT imaging-based detection of the vascular lumen and vulnerable plaque

Atherosclerosis plaque tissue classification using self-attention-based conditional variational auto-encoder generative adversarial network using OCT plaque image

Adults with coronary artery disease often have atherosclerosis, this is defined as the accumulation of plaque in the tissues of the arterial wall. Cardiologists utilize optical coherence tomography (OCT), a light-based imaging method, to examine the layers of intracoronary tissue along pathological formations, such as plaque accumulation. Intracoronary cross-sectional images produced by state-of-the-art catheter-based imaging scheme have 10-15 µm high resolution. Nevertheless, interpretation of the obtained images depends on the operator, which takes a lot of time and is exceedingly error-prone from one observer to another. OCT image post-processing that automatically and accurately tags coronary plaques can help the technique become more widely used and lower the diagnostic error rate. To overcome these problems, Atherosclerosis plaque tissue classification using Self-Attention-Based Conditional Variational Auto-Encoder Generative Adversarial Network (APC-OCTPI-SACVAGAN) is proposed which classifies the Atherosclerosis plaque images as Fibro calcific plaque, Fibro atheroma, Thrombus, Fibrous plaque and Micro-vessel. The proposed APC-OCTPI-SACVAGAN technique is executed in MATLAB. The efficiency of proposed APC-OCTPI-SACVAGAN method attains 16.19 %, 17.93 %, 19.81 % and 1.57 % higher accuracy; 16.92 %, 11.54 %, 5.29 % and 1.946 % higher Area under curve; and 28.06 %, 25.32 %, 32.19 % and 39.185 % lower computational time comparing to the existing methods respectively.

Trajectory-Aware Adaptive Imaging Clue Analysis for Guidewire Artifact Removal in Intravascular Optical Coherence Tomography

Guidewire Artifact Removal (GAR) involves restoring missing imaging signals in areas of IntraVascular Optical Coherence Tomography (IVOCT) videos affected by guidewire artifacts. GAR helps overcome imaging defects and minimizes the impact of missing signals on the diagnosis of CardioVascular Diseases (CVDs). To restore the actual vascular and lesion information within the artifact area, we propose a reliable Trajectory-aware Adaptive imaging Clue analysis Network (TAC-Net) that includes two innovative designs: (i) Adaptive clue aggregation, which considers both texture-focused original (ORI) videos and structure-focused relative total variation (RTV) videos, and suppresses texture-structure imbalance with an active weight-adaptation mechanism; (ii) Trajectory-aware Transformer, which uses a novel attention calculation to perceive the attention distribution of artifact trajectories and avoid the interference of irregular and non-uniform artifacts. We provide a detailed formulation for the procedure and evaluation of the GAR task and conduct comprehensive quantitative and qualitative experiments. The experimental results demonstrate that TAC-Net reliably restores the texture and structure of guidewire artifact areas as expected by experienced physicians (e.g., SSIM: 97.23%). We also discuss the value and potential of the GAR task for clinical applications and computer-aided diagnosis of CVDs.

Detection of thin-cap fibroatheroma in IVOCT images based on weakly supervised learning and domain knowledge

Automatic detection of thin-cap fibroatheroma (TCFA) on intravascular optical coherence tomography images is essential for the prevention of acute coronary syndrome. However, existing methods need to mark the exact location of TCFAs on each frame as supervision, which is extremely time-consuming and expensive. Hence, a new weakly supervised framework is proposed to detect TCFAs using only image-level tags as supervision. The framework comprises cut, feature extraction, relation, and detection modules. First, based on prior knowledge, a cut module was designed to generate a small number of specific region proposals. Then, to learn global information, a relation module was designed to learn the spatial adjacency and order relationships at the feature level, and an attention-based strategy was introduced in the detection module to effectively aggregate the classification results of region proposals as the image-level predicted score. The results demonstrate that the proposed method surpassed the state-of-the-art weakly supervised detection methods.

Deep self-supervised transformation learning for leukocyte classification

The scarcity of training annotation is one of the major challenges for the application of deep learning technology in medical image analysis. Recently, self-supervised learning provides a powerful solution to alleviate this challenge by extracting useful features from a large number of unlabeled training data. In this article, we propose a simple and effective self-supervised learning method for leukocyte classification by identifying the different transformations of leukocyte images, without requiring a large batch of negative sampling or specialized architectures. Specifically, a convolutional neural network backbone takes different transformations of leukocyte image as input for feature extraction. Then, a pretext task of self-supervised transformation recognition on the extracted feature is conducted by a classifier, which helps the backbone learn useful representations that generalize well across different leukocyte types and datasets. In the experiment, we systematically study the effect of different transformation compositions on useful leukocyte feature extraction. Compared with five typical baselines of self-supervised image classification, experimental results demonstrate that our method performs better in different evaluation protocols including linear evaluation, domain transfer, and finetuning, which proves the effectiveness of the proposed method.

Vascular elasticity measurement of the great saphenous vein based on optical coherence elastography

Vascular elasticity is important in physiological and clinical problems. The mechanical properties of the great saphenous vein (GSV) deserve attention. This research aims to measure the radial elasticity of ex vivo GSV using the optical coherence elasticity (OCE). The finite element model of the phantom is established, the displacement field is calculated, the radial mechanical characteristics of the simulation body are obtained. Furthermore, we performed OCE on seven isolated GSVs. The strain field is obtained by combining the relationship between strain and displacement to obtain the radial elastic modulus of GSVs. In the phantom experiment, the strain of the experimental region of interest is mainly between 0.1 and 0.4, while the simulation result is between 0.06 and 0.40. The radial elastic modulus of GSVs ranged from 3.83 kPa to 7.74 kPa. This study verifies the feasibility of the OCE method for measuring the radial elastic modulus of blood vessels.

Self-supervised speckle noise reduction of optical coherence tomography without clean data

Optical coherence tomography (OCT) is widely used in clinical diagnosis due to its non-invasive, real-time, and high-resolution characteristics. However, the inherent speckle noise seriously degrades the image quality, which might damage the fine structures in OCT, thus affecting the diagnosis results. In recent years, supervised deep learning-based denoising methods have shown excellent denoising ability. To train a deep denoiser, a large number of paired noisy-clean images are required, which is difficult to achieve in clinical practice, since acquiring a speckle-free OCT image requires dozens of repeated scans and image registration. In this research, we propose a self-supervised strategy that helps build a despeckling model by training it to map neighboring pixels in a single noisy OCT image. Adjacent pixel patches are randomly selected from the original OCT image to generate two similar undersampled images, which are respectively used as the input and target images for training a deep neural network. To ensure both the despeckling and the structure-preserving effects, a multi-scale pixel patch sampler and corresponding loss functions are adopted in our practice. Through quantitative evaluation and qualitative visual comparison, we found that the proposed method performs better than state-of-the-art methods regarding despeckling effects and structure preservation. Besides, the proposed method is much easier to train and deploy without the need for clean OCT images, which has great significance in clinical practice.

Progress in Probe-Based Sensing Techniques for In Vivo Diagnosis

Advancements in robotic surgery help to improve the endoluminal diagnosis and treatment with minimally invasive or non-invasive intervention in a precise and safe manner. Miniaturized probe-based sensors can be used to obtain information about endoluminal anatomy, and they can be integrated with medical robots to augment the convenience of robotic operations. The tremendous benefit of having this physiological information during the intervention has led to the development of a variety of in vivo sensing technologies over the past decades. In this paper, we review the probe-based sensing techniques for the in vivo physical and biochemical sensing in China in recent years, especially on in vivo force sensing, temperature sensing, optical coherence tomography/photoacoustic/ultrasound imaging, chemical sensing, and biomarker sensing.