Extraction of Cardiac and Respiratory Motion Information from Cardiac X-Ray Fluoroscopy Images Using Hierarchical Manifold Learning

Deep motion tracking from multiview angiographic image sequences for synchronization of cardiac phases

In the diagnosis and interventional treatment of coronary artery disease, the 3D[Formula: see text]time reconstruction of the coronary artery on the basis of x-ray angiographic image sequences can provide dynamic structural information. The synchronization of cardiac phases in the sequences is essential for minimizing the influence of cardiorespiratory motion and realizing precise 3D[Formula: see text]time reconstruction. Key points are initially extracted from the first image of a sequence. Matching grid points between consecutive images in the sequence are extracted by a multi-layer matching strategy. Then deep motion tracking (DMT) of key points is achieved by local deformation based on the neighboring grid points of key points. The local deformation is optimized by the Random sample consensus (RANSAC) algorithm. Then, a simple harmonic motion (SHM) model is utilized to distinguish cardiac motion from other motion sources (e.g. respiratory, patient movement, etc). Next, the signal which is composed of cardiac motions is filtered by a band-pass filter to reconstruct the cardiac phases. Finally, the synchronization of cardiac phases from different imaging angles is realized by a piece-wise linear transformation. The proposed method was evaluated using clinical x-ray angiographic image sequences from 13 patients. [Formula: see text] matching points can be accurately computed by the DMT method. The mean peak temporal distance (MPTD) between the reconstructed cardiac phases and the electrocardiograph signal is [Formula: see text] s. The correlation between the cardiac phases of the same patient is over [Formula: see text]. Compared with three other state-of-the-art methods, the proposed method accurately reconstructs and synchronizes the cardiac phases from different sequences of the same patient. The proposed DMT method is robust and highly effective in synchronizing cardiac phases of angiographic image sequences captured from different imaging angles.

Unsupervised Learning for Robust Respiratory Signal Estimation From X-Ray Fluoroscopy

Respiratory signals are required for image gating and motion compensation in minimally invasive interventions. In X-ray fluoroscopy, extraction of a respiratory signal can be challenging due to characteristics of interventional imaging, in particular injection of contrast agent and automatic exposure control. We present a novel method for respiratory signal extraction based on dimensionality reduction that can tolerate these events. Images are divided into patches of multiple sizes. Low-dimensional embeddings are generated for each patch using illumination-invariant kernel PCA. Patches with respiratory information are selected automatically by agglomerative clustering. The signals from this respiratory cluster are combined robustly to a single respiratory signal. In the experiments, we evaluate our method on a variety of scenarios. If the diaphragm is visible, we track its superior-inferior motion as ground truth. Our method has a correlation coefficient of more than 91% with the ground truth irrespective of whether or not contrast agent injection or automatic exposure control occur. Additionally, we show that very similar signals are estimated from biplane sequences and from sequences without visible diaphragm. Since all these cases are handled automatically, the method is robust enough to be considered for use in a clinical setting.

Image-based view-angle independent cardiorespiratory motion gating and coronary sinus catheter tracking for x-ray-guided cardiac electrophysiology procedures

Determination of the cardiorespiratory phase of the heart has numerous applications during cardiac imaging. In this article we propose a novel view-angle independent near-real time cardiorespiratory motion gating and coronary sinus (CS) catheter tracking technique for x-ray fluoroscopy images that are used to guide cardiac electrophysiology procedures. The method is based on learning CS catheter motion using principal component analysis and then applying the derived motion model to unseen images taken at arbitrary projections, using the epipolar constraint. This method is also able to track the CS catheter throughout the x-ray images in any arbitrary subsequent view. We also demonstrate the clinical application of our model on rotational angiography sequences. We validated our technique in normal and very low dose phantom and clinical datasets. For the normal dose clinical images we established average systole, end-expiration and end-inspiration gating success rates of 100%, 85.7%, and 92.3%, respectively. For very low dose applications, the technique was able to track the CS catheter with median errors not exceeding 1 mm for all tracked electrodes. Average gating success rates of 80.3%, 71.4%, and 69.2% were established for the application of the technique on clinical datasets, even with a dose reduction of more than 10 times. In rotational sequences at normal dose, CS tracking median errors were within 1.2 mm for all electrodes, and the gating success rate was 100%, for view angles from RAO 90° to LAO 90°. This view-angle independent technique can extract clinically useful cardiorespiratory motion information using x-ray doses significantly lower than those currently used in clinical practice.