A framework for combining a motion atlas with non-motion information to learn clinically useful biomarkers: Application to cardiac resynchronisation therapy response prediction

Optimizing outcomes from cardiac resynchronization therapy: what do recent data and insights say?

INTRODUCTION

Cardiac Resynchronization Therapy (CRT) is an effective treatment for heart failure (HF) in approximately two-thirds of recipients, with a third remaining CRT 'non-responders.' There is an increasing body of evidence exploring the reasons behind non-response, as well as ways to preempt or counteract it.

AREAS COVERED

This review will examine the most recent evidence regarding optimizing outcomes from CRT, as well as explore whether traditional CRT indeed remains the best first-line therapy for electrical resynchronization in HF. We will start by discussing methods of preempting non-response, such as refining patient selection and procedural technique, before reviewing how responses can be optimized post-implantation. For the purpose of this review, evidence was gathered from electronic literature searches (via PubMed and GoogleScholar), with a particular focus on primary evidence published in the last 5 years.

EXPERT OPINION

Ever-expanding research in the field of device therapy has armed physicians with more tools than ever to treat dyssynchronous HF. Newer developments, such as artificial intelligence (AI) guided device programming and conduction system pacing (CSP) are particularly exciting, and we will discuss how they could eventually lead to truly personalized care by maximizing outcomes from CRT.

Artificial intelligence models in prediction of response to cardiac resynchronization therapy: a systematic review

The aim of the presented review is to summarize the literature data on the accuracy and clinical applicability of artificial intelligence (AI) models as a valuable alternative to the current guidelines in predicting cardiac resynchronization therapy (CRT) response and phenotyping of patients eligible for CRT implantation. This systematic review was performed according to the PRISMA guidelines. After a search of Scopus, PubMed, Cochrane Library, and Embase databases, 675 records were identified. Twenty supervised (prediction of CRT response) and 9 unsupervised (clustering and phenotyping) AI models were analyzed qualitatively (22 studies, 14,258 patients). Fifty-five percent of AI models were based on retrospective studies. Unsupervised AI models were able to identify clusters of patients with significantly different rates of primary outcome events (death, heart failure event). In comparison to the guideline-based CRT response prediction accuracy of 70%, supervised AI models trained on cohorts with > 100 patients achieved up to 85% accuracy and an AUC of 0.86 in their prediction of response to CRT for echocardiographic and clinical outcomes, respectively. AI models seem to be an accurate and clinically applicable tool in phenotyping of patients eligible for CRT implantation and predicting potential responders. In the future, AI may help to increase CRT response rates to over 80% and improve clinical decision-making and prognosis of the patients, including reduction of mortality rates. However, these findings must be validated in randomized controlled trials.

Correcting bias in cardiac geometries derived from multimodal images using spatiotemporal mapping

Cardiovascular imaging studies provide a multitude of structural and functional data to better understand disease mechanisms. While pooling data across studies enables more powerful and broader applications, performing quantitative comparisons across datasets with varying acquisition or analysis methods is problematic due to inherent measurement biases specific to each protocol. We show how dynamic time warping and partial least squares regression can be applied to effectively map between left ventricular geometries derived from different imaging modalities and analysis protocols to account for such differences. To demonstrate this method, paired real-time 3D echocardiography (3DE) and cardiac magnetic resonance (CMR) sequences from 138 subjects were used to construct a mapping function between the two modalities to correct for biases in left ventricular clinical cardiac indices, as well as regional shape. Leave-one-out cross-validation revealed a significant reduction in mean bias, narrower limits of agreement, and higher intraclass correlation coefficients for all functional indices between CMR and 3DE geometries after spatiotemporal mapping. Meanwhile, average root mean squared errors between surface coordinates of 3DE and CMR geometries across the cardiac cycle decreased from 7 ± 1 to 4 ± 1 mm for the total study population. Our generalised method for mapping between time-varying cardiac geometries obtained using different acquisition and analysis protocols enables the pooling of data between modalities and the potential for smaller studies to leverage large population databases for quantitative comparisons.

An Artificial Intelligence Approach to Guiding the Management of Heart Failure Patients Using Predictive Models: A Systematic Review

Heart failure (HF) is one of the leading causes of mortality and hospitalization worldwide. The accurate prediction of mortality and readmission risk provides crucial information for guiding decision making. Unfortunately, traditional predictive models reached modest accuracy in HF populations. We therefore aimed to present predictive models based on machine learning (ML) techniques in HF patients that were externally validated. We searched four databases and the reference lists of the included papers to identify studies in which HF patient data were used to create a predictive model. Literature screening was conducted in Academic Search Ultimate, ERIC, Health Source Nursing/Academic Edition and MEDLINE. The protocol of the current systematic review was registered in the PROSPERO database with the registration number CRD42022344855. We considered all types of outcomes: mortality, rehospitalization, response to treatment and medication adherence. The area under the receiver operating characteristic curve (AUC) was used as the comparator parameter. The literature search yielded 1649 studies, of which 9 were included in the final analysis. The AUCs for the machine learning models ranged from 0.6494 to 0.913 in independent datasets, whereas the AUCs for statistical predictive scores ranged from 0.622 to 0.806. Our study showed an increasing number of ML predictive models concerning HF populations, although external validation remains infrequent. However, our findings revealed that ML approaches can outperform conventional risk scores and may play important role in HF management.

A multimodal deep learning model for cardiac resynchronisation therapy response prediction

We present a novel multimodal deep learning framework for cardiac resynchronisation therapy (CRT) response prediction from 2D echocardiography and cardiac magnetic resonance (CMR) data. The proposed method first uses the 'nnU-Net' segmentation model to extract segmentations of the heart over the full cardiac cycle from the two modalities. Next, a multimodal deep learning classifier is used for CRT response prediction, which combines the latent spaces of the segmentation models of the two modalities. At test time, this framework can be used with 2D echocardiography data only, whilst taking advantage of the implicit relationship between CMR and echocardiography features learnt from the model. We evaluate our pipeline on a cohort of 50 CRT patients for whom paired echocardiography/CMR data were available, and results show that the proposed multimodal classifier results in a statistically significant improvement in accuracy compared to the baseline approach that uses only 2D echocardiography data. The combination of multimodal data enables CRT response to be predicted with 77.38% accuracy (83.33% sensitivity and 71.43% specificity), which is comparable with the current state-of-the-art in machine learning-based CRT response prediction. Our work represents the first multimodal deep learning approach for CRT response prediction.

The Applications of Artificial Intelligence in Cardiovascular Magnetic Resonance-A Comprehensive Review

Cardiovascular disease remains an integral field on which new research in both the biomedical and technological fields is based, as it remains the leading cause of mortality and morbidity worldwide. However, despite the progress of cardiac imaging techniques, the heart remains a challenging organ to study. Artificial intelligence (AI) has emerged as one of the major innovations in the field of diagnostic imaging, with a dramatic impact on cardiovascular magnetic resonance imaging (CMR). AI will be increasingly present in the medical world, with strong potential for greater diagnostic efficiency and accuracy. Regarding the use of AI in image acquisition and reconstruction, the main role was to reduce the time of image acquisition and analysis, one of the biggest challenges concerning magnetic resonance; moreover, it has been seen to play a role in the automatic correction of artifacts. The use of these techniques in image segmentation has allowed automatic and accurate quantification of the volumes and masses of the left and right ventricles, with occasional need for manual correction. Furthermore, AI can be a useful tool to directly help the clinician in the diagnosis and derivation of prognostic information of cardiovascular diseases. This review addresses the applications and future prospects of AI in CMR imaging, from image acquisition and reconstruction to image segmentation, tissue characterization, diagnostic evaluation, and prognostication.

Characterization of motion patterns by a spatio-temporal saliency descriptor in cardiac cine MRI

BACKGROUND AND OBJECTIVE

Abnormalities of the heart motion reveal the presence of a disease. However, a quantitative interpretation of the motion is still a challenge due to the complex dynamics of the heart. This work proposes a quantitative characterization of regional cardiac motion patterns in cine magnetic resonance imaging (MRI) by a novel spatio-temporal saliency descriptor.

METHOD

The strategy starts by dividing the cardiac sequence into a progression of scales which are in due turn mapped to a feature space of regional orientation changes, mimicking the multi-resolution decomposition of oriented primitive changes of visual systems. These changes are estimated as the difference between a particular time and the rest of the sequence. This decomposition is then temporarily and regionally integrated for a particular orientation and then for the set of different orientations. A final spatio-temporal 4D saliency map is obtained as the summation of the previously integrated information for the available scales. The saliency dispersion of this map was computed in standard cardiac locations as a measure of the regional motion pattern and was applied to discriminate control and hypertrophic cardiomyopathy (HCM) subjects during the diastolic phase.

RESULTS

Salient motion patterns were estimated from an experimental set, which consisted of 3D sequences acquired by MRI from 108 subjects (33 control, 35 HCM, 20 dilated cardiomyopathy (DCM), and 20 myocardial infarction (MINF) from heterogeneous datasets). HCM and control subjects were classified by an SVM that learned the salient motion patterns estimated from the presented strategy, by achieving a 94% AUC. In addition, statistical differences (test t-student, p<0.05) were found among groups of disease in the septal and anterior ventricular segments at both the ED and ES, with salient motion characteristics aligned with existing knowledge on the diseases.

CONCLUSIONS

Regional wall motion abnormality in the apical, anterior, basal, and inferior segments was associated with the saliency dispersion in HCM, DCM, and MINF compared to healthy controls during the systolic and diastolic phases. This saliency analysis may be used to detect subtle changes in heart function.

The Role of AI in Characterizing the DCM Phenotype

Dilated Cardiomyopathy is conventionally defined by left ventricular dilatation and dysfunction in the absence of coronary disease. Emerging evidence suggests many patients remain vulnerable to major adverse outcomes despite clear therapeutic success of modern evidence-based heart failure therapy. In this era of personalized medical care, the conventional assessment of left ventricular ejection fraction falls short in fully predicting evolution and risk of outcomes in this heterogenous group of heart muscle disease, as such, a more refined means of phenotyping this disease appears essential. Cardiac MRI (CMR) is well-placed in this respect, not only for its diagnostic utility, but the wealth of information captured in global and regional function assessment with the addition of unique tissue characterization across different disease states and patient cohorts. Advanced tools are needed to leverage these sensitive metrics and integrate with clinical, genetic and biochemical information for personalized, and more clinically useful characterization of the dilated cardiomyopathy phenotype. Recent advances in artificial intelligence offers the unique opportunity to impact clinical decision making through enhanced precision image-analysis tasks, multi-source extraction of relevant features and seamless integration to enhance understanding, improve diagnosis, and subsequently clinical outcomes. Focusing particularly on deep learning, a subfield of artificial intelligence, that has garnered significant interest in the imaging community, this paper reviews the main developments that could offer more robust disease characterization and risk stratification in the Dilated Cardiomyopathy phenotype. Given its promising utility in the non-invasive assessment of cardiac diseases, we firstly highlight the key applications in CMR, set to enable comprehensive quantitative measures of function beyond the standard of care assessment. Concurrently, we revisit the added value of tissue characterization techniques for risk stratification, showcasing the deep learning platforms that overcome limitations in current clinical workflows and discuss how they could be utilized to better differentiate at-risk subgroups of this phenotype. The final section of this paper is dedicated to the allied clinical applications to imaging, that incorporate artificial intelligence and have harnessed the comprehensive abundance of data from genetics and relevant clinical variables to facilitate better classification and enable enhanced risk prediction for relevant outcomes.

A probabilistic deep motion model for unsupervised cardiac shape anomaly assessment

Automatic shape anomaly detection in large-scale imaging data can be useful for screening suboptimal segmentations and pathologies altering the cardiac morphology without intensive manual labour. We propose a deep probabilistic model for local anomaly detection in sequences of heart shapes, modelled as point sets, in a cardiac cycle. A deep recurrent encoder-decoder network captures the spatio-temporal dependencies to predict the next shape in the cycle and thus derive the outlier points that are attributed to excessive deviations from the network prediction. A predictive mixture distribution models the inlier and outlier classes via Gaussian and uniform distributions, respectively. A Gibbs sampling Expectation-Maximisation (EM) algorithm computes soft anomaly scores of the points via the posterior probabilities of each class in the E-step and estimates the parameters of the network and the predictive distribution in the M-step. We demonstrate the versatility of the method using two shape datasets derived from: (i) one million biventricular CMR images from 20,000 participants in the UK Biobank (UKB), and (ii) routine diagnostic imaging from Multi-Centre, Multi-Vendor, and Multi-Disease Cardiac Image (M&Ms). Experiments show that the detected shape anomalies in the UKB dataset are mostly associated with poor segmentation quality, and the predicted shape sequences show significant improvement over the input sequences. Furthermore, evaluations on U-Net based shapes from the M&Ms dataset reveals that the anomalies are attributable to the underlying pathologies that affect the ventricles. The proposed model can therefore be used as an effective mechanism to sift shape anomalies in large-scale cardiac imaging pipelines for further analysis.

The evolving role of artificial intelligence in cardiac image analysis

Research in artificial intelligence (AI) have progressed over the last decade. The field of cardiac imaging has seen significant developments using newly developed deep learning methods for automated image analysis and AI tools for disease detection and prognostication. This review article is aimed at those without special background in AI. We review AI concepts and we survey the growing contemporary applications of AI for image analysis in echocardiography, nuclear cardiology, cardiac computed tomography, cardiac magnetic resonance, and invasive angiography.

Non-invasive simulated electrical and measured mechanical indices predict response to cardiac resynchronization therapy

BACKGROUND

Cardiac Resynchronization Therapy (CRT) in dyssynchronous heart failure patients is ineffective in 20-30% of cases. Sub-optimal left ventricular (LV) pacing location can lead to non-response, thus there is interest in LV lead location optimization. Invasive acute haemodynamic response (AHR) measurements have been used to optimize the LV pacing location during CRT implantation. In this manuscript, we aim to predict the optimal lead location (AHR>10%) with non-invasive computed tomography (CT) based measures of cardiac anatomical and mechanical properties, and simulated electrical activation times.

METHODS

Non-invasive measurements from CT images and ECG were acquired from 34 patients indicated for CRT upgrade. The LV lead was implanted and AHR was measured at different pacing sites. Computer models of the ventricles were used to simulate the electrical activation of the heart, track the mechanical motion throughout the cardiac cycle and measure the wall thickness of the LV on a patient specific basis.

RESULTS

We tested the ability of electrical, mechanical and anatomical indices to predict the optimal LV location. Electrical (RV-LV delay) and mechanical (time to peak contraction) indices were correlated with an improved AHR, while wall thickness was not predictive. A logistic regression model combining RV-LV delay and time to peak contraction was able to predict positive response with 70 ± 11% accuracy and AUROC curve of 0.73.

CONCLUSION

Non-invasive electrical and mechanical indices can predict optimal epicardial lead location. Prospective analysis of these indices could allow clinicians to test the AHR at fewer pacing sites and reduce time, costs and risks to patients.

A deep-learning semantic segmentation approach to fully automated MRI-based left-ventricular deformation analysis in cardiotoxicity

Left-ventricular (LV) strain measurements with the Displacement Encoding with Stimulated Echoes (DENSE) MRI sequence provide accurate estimates of cardiotoxicity damage related to breast cancer chemotherapy. This study investigated an automated LV chamber quantification tool via segmentation with a supervised deep convolutional neural network (DCNN) before strain analysis with DENSE images. Segmentation for chamber quantification analysis was conducted with a custom DeepLabV3+ DCNN with ResNet-50 backbone on 42 female breast cancer datasets (22 training-sets, eight validation-sets and 12 independent test-sets). Parameters such as LV end-diastolic diameter (LVEDD) and ejection fraction (LVEF) were quantified, and myocardial strains analyzed with the Radial Point Interpolation Method (RPIM). Myocardial classification was validated against ground-truth with sensitivity-specificity analysis, the metrics of Dice, average perpendicular distance (APD) and Hausdorff-distance. Following segmentation, validation was conducted with the Cronbach's Alpha (C-Alpha) intraclass correlation coefficient between LV chamber quantification results with DENSE and Steady State Free Precession (SSFP) acquisitions and a vendor tool-based method to segment the DENSE data, and similarly for myocardial strain analysis in the chambers. The results of myocardial classification from segmentation of the DENSE data were accuracy = 97%, Dice = 0.89 and APD = 2.4 mm in the test-set. The C-Alpha correlations from comparing chamber quantification results between the segmented DENSE and SSFP data and vendor tool-based method were 0.97 for LVEF (56 ± 7% vs 55 ± 7% vs 55 ± 6%, p = 0.6) and 0.77 for LVEDD (4.6 ± 0.4 cm vs 4.5 ± 0.3 cm vs 4.5 ± 0.3 cm, p = 0.8). The validation metrics against ground-truth and equivalent parameters obtained from the SSFP segmentation and vendor tool-based comparisons show that the DCNN approach is applicable for automated LV chamber quantification and subsequent strain analysis in cardiotoxicity.

Cardiac MRI-Update 2020

PURPOSE

To review emerging techniques in cardiac magnetic resonance imaging (CMR) and their clinical applications with a special emphasis on new technologies, recent trials, and updated guidelines.

TECHNOLOGICAL INNOVATIONS

The utility of CMR has expanded with the development of new MR sequences, postprocessing techniques, and artificial intelligence-based technologies, which have substantially increased the spectrum, quality, and reliability of information that can be obtained by CMR.

ESTABLISHED AND EMERGING INDICATIONS

The CMR modality has become an irreplaceable tool for diagnosis, treatment guidance and follow-up of patients with ischemic heart disease, myocarditis, and cardiomyopathies. Its role has been further strengthened by recent trials and guidelines. Quantitative mapping techniques are increasingly used for tissue characterization and detection of diffuse myocardial changes including myocardial storage diseases.

PRACTICAL RECOMMENDATIONS

With state-of-the-art CMR sequences, postprocessing techniques and understanding of their interpretation, CMR makes invaluable contributions to provide state-of-the-art diagnostics and care for cardiac patients in a multidisciplinary team.

Interpretable Deep Models for Cardiac Resynchronisation Therapy Response Prediction

Advances in deep learning (DL) have resulted in impressive accuracy in some medical image classification tasks, but often deep models lack interpretability. The ability of these models to explain their decisions is important for fostering clinical trust and facilitating clinical translation. Furthermore, for many problems in medicine there is a wealth of existing clinical knowledge to draw upon, which may be useful in generating explanations, but it is not obvious how this knowledge can be encoded into DL models - most models are learnt either from scratch or using transfer learning from a different domain. In this paper we address both of these issues. We propose a novel DL framework for image-based classification based on a variational autoencoder (VAE). The framework allows prediction of the output of interest from the latent space of the autoencoder, as well as visualisation (in the image domain) of the effects of crossing the decision boundary, thus enhancing the interpretability of the classifier. Our key contribution is that the VAE disentangles the latent space based on 'explanations' drawn from existing clinical knowledge. The framework can predict outputs as well as explanations for these outputs, and also raises the possibility of discovering new biomarkers that are separate (or disentangled) from the existing knowledge. We demonstrate our framework on the problem of predicting response of patients with cardiomyopathy to cardiac resynchronization therapy (CRT) from cine cardiac magnetic resonance images. The sensitivity and specificity of the proposed model on the task of CRT response prediction are 88.43% and 84.39% respectively, and we showcase the potential of our model in enhancing understanding of the factors contributing to CRT response.

Artificial Intelligence and Texture Analysis in Cardiac Imaging

PURPOSE OF REVIEW

The aim of this structured review is to summarize the current research applications and opportunities arising from artificial intelligence (AI) and texture analysis with regard to cardiac imaging.

RECENT FINDINGS

Current research findings suggest tremendous potential for AI in cardiac imaging, especially with regard to objective image analyses, overcoming the limitations of an observer-dependent subjective image interpretation. Researchers have used this technique across multiple imaging modalities, for instance to detect myocardial scars in cardiac MR imaging, to predict contrast enhancement in non-contrast studies, and to improve image acquisition and reconstruction. AI in medical imaging has the potential to provide novel, much-needed applications for improving patient care pertaining to the cardiovascular system. While several shortcomings are still present in the current methodology, AI may serve as a resourceful assistant to radiologists and clinicians alike.

Artificial Intelligence in Cardiac Imaging With Statistical Atlases of Cardiac Anatomy

In many cardiovascular pathologies, the shape and motion of the heart provide important clues to understanding the mechanisms of the disease and how it progresses over time. With the advent of large-scale cardiac data, statistical modeling of cardiac anatomy has become a powerful tool to provide automated, precise quantification of the status of patient-specific heart geometry with respect to reference populations. Powered by supervised or unsupervised machine learning algorithms, statistical cardiac shape analysis can be used to automatically identify and quantify the severity of heart diseases, to provide morphometric indices that are optimally associated with clinical factors, and to evaluate the likelihood of adverse outcomes. Recently, statistical cardiac atlases have been integrated with deep neural networks to enable anatomical consistency of cardiac segmentation, registration, and automated quality control. These combinations have already shown significant improvements in performance and avoid gross anatomical errors that could make the results unusable. This current trend is expected to grow in the near future. Here, we aim to provide a mini review highlighting recent advances in statistical atlasing of cardiac function in the context of artificial intelligence in cardiac imaging.

Machine Learning Approaches for Myocardial Motion and Deformation Analysis

Information about myocardial motion and deformation is key to differentiate normal and abnormal conditions. With the advent of approaches relying on data rather than pre-conceived models, machine learning could either improve the robustness of motion quantification or reveal patterns of motion and deformation (rather than single parameters) that differentiate pathologies. We review machine learning strategies for extracting motion-related descriptors and analyzing such features among populations, keeping in mind constraints specific to the cardiac application.

Analysis of nonstandardized stress echocardiography sequences using multiview dimensionality reduction

Alternative stress echocardiography protocols such as handgrip exercise are potentially more favorable towards large-scale screening scenarios than those currently adopted in clinical practice. However, these are still underexplored because the maximal exercise levels are not easily quantified and regulated, requiring the analysis of the complete data sequences (thousands of images), which represents a challenging task for the clinician. We propose a framework for the analysis of these complex datasets, and illustrate it on a handgrip exercise dataset including complete acquisitions of 10 healthy controls and 5 ANT1 mutation patients (1377 cardiac cycles). The framework is based on an unsupervised formulation of multiple kernel learning, which is used to integrate information coming from myocardial velocity traces and heart rate to obtain a lower-dimensional representation of the data. Such simplified representation is then explored to discriminate groups of response and understand the underlying pathophysiological mechanisms. The analysis pipeline involves the reconstruction of population-specific signatures using multiscale kernel regression, and the clustering of subjects based on the trajectories defined by their projected sequences. The results confirm that the proposed framework is able to detect distinctive clusters of response and to provide insight regarding the underlying pathophysiology.

Machine learning in cardiovascular magnetic resonance: basic concepts and applications

Machine learning (ML) is making a dramatic impact on cardiovascular magnetic resonance (CMR) in many ways. This review seeks to highlight the major areas in CMR where ML, and deep learning in particular, can assist clinicians and engineers in improving imaging efficiency, quality, image analysis and interpretation, as well as patient evaluation. We discuss recent developments in the field of ML relevant to CMR in the areas of image acquisition & reconstruction, image analysis, diagnostic evaluation and derivation of prognostic information. To date, the main impact of ML in CMR has been to significantly reduce the time required for image segmentation and analysis. Accurate and reproducible fully automated quantification of left and right ventricular mass and volume is now available in commercial products. Active research areas include reduction of image acquisition and reconstruction time, improving spatial and temporal resolution, and analysis of perfusion and myocardial mapping. Although large cohort studies are providing valuable data sets for ML training, care must be taken in extending applications to specific patient groups. Since ML algorithms can fail in unpredictable ways, it is important to mitigate this by open source publication of computational processes and datasets. Furthermore, controlled trials are needed to evaluate methods across multiple centers and patient groups.

Semi-Supervised Convolutional Neural Network for Law Advice Online

With the rapid developments of Internet technology, a mass of law cases is constantly occurring and needs to be dealt with in time. Automatic classification of law text is the most basic and critical process in the online law advice platform. Deep neural network-based natural language processing (DNN-NLP) is one of the most promising approaches to implement text classification. Meanwhile, as the convolutional neural network-based (CNN-based) methods developed, CNN-based text classification has already achieved impressive results. However, previous work applied amounts of manually-annotated data, which increased the labor cost and reduced the adaptability of the approach. Hence, we present a new semi-supervised model to solve the problem of data annotation. Our method learns the embedding of small text regions from unlabeled data and then integrates the learned embedding into the supervised training. More specifically, the learned embedding regions with the two-view-embedding model are used as an additional input to the CNN’s convolution layer. In addition, to implement the multi-task learning task, we propose the multi-label classification algorithm to assign multiple labels to an instance. The proposed method is evaluated experimentally subject to a law case description dataset and English standard dataset RCV1 . On Chinese data, the simulation results demonstrate that, compared with the existing methods such as linear SVM, our scheme respectively improves by 7.76%, 7.86%, 9.19%, and 2.96% the precision, recall, F-1, and Hamming loss. Analogously, the results suggest that compared to CNN, our scheme respectively improves by 4.46%, 5.76%, 5.14% and 0.87% in terms of precision, recall, F-1, and Hamming loss. It is worth mentioning that the robustness of this method makes it suitable and effective for automatic classification of law text. Furthermore, the design concept proposed is promising, which can be utilized in other real-world applications such as news classification and public opinion monitoring.

Machine learning-based phenogrouping in heart failure to identify responders to cardiac resynchronization therapy

AIMS

We tested the hypothesis that a machine learning (ML) algorithm utilizing both complex echocardiographic data and clinical parameters could be used to phenogroup a heart failure (HF) cohort and identify patients with beneficial response to cardiac resynchronization therapy (CRT).

METHODS AND RESULTS

We studied 1106 HF patients from the Multicenter Automatic Defibrillator Implantation Trial with Cardiac Resynchronization Therapy (MADIT-CRT) (left ventricular ejection fraction ≤ 30%, QRS ≥ 130 ms, New York Heart Association class ≤ II) randomized to CRT with a defibrillator (CRT-D, n = 677) or an implantable cardioverter defibrillator (ICD, n = 429). An unsupervised ML algorithm (Multiple Kernel Learning and K-means clustering) was used to categorize subjects by similarities in clinical parameters, and left ventricular volume and deformation traces at baseline into mutually exclusive groups. The treatment effect of CRT-D on the primary outcome (all-cause death or HF event) and on volume response was compared among these groups. Our analysis identified four phenogroups, significantly different in the majority of baseline clinical characteristics, biomarker values, measures of left and right ventricular structure and function and the primary outcome occurrence. Two phenogroups included a higher proportion of known clinical characteristics predictive of CRT response, and were associated with a substantially better treatment effect of CRT-D on the primary outcome [hazard ratio (HR) 0.35; 95% confidence interval (CI) 0.19-0.64; P = 0.0005 and HR 0.36; 95% CI 0.19-0.68; P = 0.001] than observed in the other groups (interaction P = 0.02).

CONCLUSIONS

Our results serve as a proof-of-concept that, by integrating clinical parameters and full heart cycle imaging data, unsupervised ML can provide a clinically meaningful classification of a phenotypically heterogeneous HF cohort and might aid in optimizing the rate of responders to specific therapies.

Regional Multi-View Learning for Cardiac Motion Analysis: Application to Identification of Dilated Cardiomyopathy Patients

OBJECTIVE

The aim of this paper is to describe an automated diagnostic pipeline that uses as input only ultrasound (US) data, but is at the same time informed by a training database of multimodal magnetic resonance (MR) and US image data.

METHODS

We create a multimodal cardiac motion atlas from three-dimensional (3-D) MR and 3-D US data followed by multi-view machine learning algorithms to combine and extract the most meaningful cardiac descriptors for classification of dilated cardiomyopathy (DCM) patients using US data only. More specifically, we propose two algorithms based on multi-view linear discriminant analysis and multi-view Laplacian support vector machines (MvLapSVMs). Furthermore, a novel regional multi-view approach is proposed to exploit the regional relationships between the two modalities.

RESULTS

We evaluate our pipeline on the classification task of discriminating between normals and DCM patients. Results show that the use of multi-view classifiers together with a cardiac motion atlas results in a statistically significant improvement in accuracy compared to classification without the multimodal atlas. MvLapSVM was able to achieve the highest accuracy for both the global approach (92.71%) and the regional approach (94.32%).

CONCLUSION

Our work represents an important contribution to the understanding of cardiac motion, which is an important aid in the quantification of the contractility and function of the left ventricular myocardium.

SIGNIFICANCE

The intended workflow of the developed pipeline is to make use of the prior knowledge from the multimodal atlas to enable robust extraction of indicators from 3-D US images for detecting DCM patients.

Myocardial strain computed at multiple spatial scales from tagged magnetic resonance imaging: Estimating cardiac biomarkers for CRT patients

Abnormal cardiac motion can indicate different forms of disease, which can manifest at different spatial scales in the myocardium. Many studies have sought to characterise particular motion abnormalities associated with specific diseases, and to utilise motion information to improve diagnoses. However, the importance of spatial scale in the analysis of cardiac deformation has not been extensively investigated. We build on recent work on the analysis of myocardial strains at different spatial scales using a cardiac motion atlas to find the optimal scales for estimating different cardiac biomarkers. We apply a multi-scale strain analysis to a 43 patient cohort of cardiac resynchronisation therapy (CRT) patients using tagged magnetic resonance imaging data for (1) predicting response to CRT, (2) identifying septal flash, (3) estimating QRS duration, and (4) identifying the presence of ischaemia. A repeated, stratified cross-validation is used to demonstrate the importance of spatial scale in our analysis, revealing different optimal spatial scales for the estimation of different biomarkers.

A multimodal spatiotemporal cardiac motion atlas from MR and ultrasound data

Cardiac motion atlases provide a space of reference in which the motions of a cohort of subjects can be directly compared. Motion atlases can be used to learn descriptors that are linked to different pathologies and which can subsequently be used for diagnosis. To date, all such atlases have been formed and applied using data from the same modality. In this work we propose a framework to build a multimodal cardiac motion atlas from 3D magnetic resonance (MR) and 3D ultrasound (US) data. Such an atlas will benefit from the complementary motion features derived from the two modalities, and furthermore, it could be applied in clinics to detect cardiovascular disease using US data alone. The processing pipeline for the formation of the multimodal motion atlas initially involves spatial and temporal normalisation of subjects' cardiac geometry and motion. This step was accomplished following a similar pipeline to that proposed for single modality atlas formation. The main novelty of this paper lies in the use of a multi-view algorithm to simultaneously reduce the dimensionality of both the MR and US derived motion data in order to find a common space between both modalities to model their variability. Three different dimensionality reduction algorithms were investigated: principal component analysis, canonical correlation analysis and partial least squares regression (PLS). A leave-one-out cross validation on a multimodal data set of 50 volunteers was employed to quantify the accuracy of the three algorithms. Results show that PLS resulted in the lowest errors, with a reconstruction error of less than 2.3 mm for MR-derived motion data, and less than 2.5  mm for US-derived motion data. In addition, 1000 subjects from the UK Biobank database were used to build a large scale monomodal data set for a systematic validation of the proposed algorithms. Our results demonstrate the feasibility of using US data alone to analyse cardiac function based on a multimodal motion atlas.