Super-resolution and denoising of 4D-Flow MRI using physics-Informed deep neural nets

Unsupervised Denoising and Super-Resolution of Vascular Flow Data by Physics-Informed Machine Learning

We present an unsupervised deep learning method to perform flow denoising and super-resolution without high-resolution labels. We demonstrate the ability of a single model to reconstruct three-dimensional stenosis and aneurysm flows, with varying geometries, orientations, and boundary conditions. Ground truth data was generated using computational fluid dynamics, and then corrupted with multiplicative Gaussian noise. Auto-encoders were used to compress the representations of the flow domain geometry and the (possibly noisy and low-resolution) flow field. These representations were used to condition a physics-informed neural network. A physics-based loss was implemented to train the model to recover lost information from the noisy input by transforming the flow to a solution of the Navier-Stokes equations. Our experiments achieved mean squared errors in the true flow reconstruction of O(1.0 × 10-4), and root mean squared residuals of O(1.0 × 10-2) for the momentum and continuity equations. Our method yielded correlation coefficients of 0.971 for the hidden pressure field and 0.82 for the derived wall shear stress field. By performing point-wise predictions of the flow, the model was able to robustly denoise and super-resolve the field to 20× the input resolution.

Physics-informed neural networks for parameter estimation in blood flow models

BACKGROUND

Physics-informed neural networks (PINNs) have emerged as a powerful tool for solving inverse problems, especially in cases where no complete information about the system is known and scatter measurements are available. This is especially useful in hemodynamics since the boundary information is often difficult to model, and high-quality blood flow measurements are generally hard to obtain.

METHODS

In this work, we use the PINNs methodology for estimating reduced-order model parameters and the full velocity field from scatter 2D noisy measurements in the aorta. Two different flow regimes, stationary and transient were studied.

RESULTS

We show robust and relatively accurate parameter estimations when using the method with simulated data, while the velocity reconstruction accuracy shows dependence on the measurement quality and the flow pattern complexity. Comparison with a Kalman filter approach shows similar results when the number of parameters to be estimated is low to medium. For a higher number of parameters, only PINNs were capable of achieving good results.

CONCLUSION

The method opens a door to deep-learning-driven methods in the simulations of complex coupled physical systems.

Super-resolution Left Ventricular Flow and Pressure Mapping by Navier-Stokes-Informed Neural Networks

Intraventricular vector flow mapping (VFM) is a growingly adopted echocardiographic modality that derives time-resolved two-dimensional flow maps in the left ventricle (LV) from color-Doppler sequences. Current VFM models rely on kinematic constraints arising from planar flow incompressibility. However, these models are not informed by crucial information about flow physics; most notably the pressure and shear forces within the fluid and the resulting accelerations. This limitation has rendered VFM unable to combine information from different time frames in an acquisition sequence or derive fluctuating pressure maps. In this study, we leveraged recent advances in artificial intelligence (AI) to develop AI-VFM, a vector flow mapping modality that uses physics-informed neural networks (PINNs) encoding mass conservation and momentum balance inside the LV, and no-slip boundary conditions at the LV endocardium. AI-VFM recovers the flow and pressure fields in the LV from standard echocardiographic scans. It performs phase unwrapping and recovers flow data in areas without input color-Doppler data. AI-VFM also recovers complete flow maps at time points without color-Doppler input data, producing super-resolution flow maps. We show that informing the PINNs with momentum balance is essential to achieving temporal super-resolution and significantly increases the accuracy of AI-VFM compared to informing the PINNs only with mass conservation. AI-VFM is solely informed by each patient's flow physics; it does not utilize explicit smoothness constraints or incorporate data from other patients or flow models. AI-VFM takes 15 minutes to run in off-the-shelf graphics processing units and its underlying PINN framework could be extended to map other flow-associated metrics like blood residence time or the concentration of coagulation species.

Implicit neural representations for unsupervised super-resolution and denoising of 4D flow MRI

BACKGROUND AND OBJECTIVE

4D flow magnetic resonance imaging provides time-resolved blood flow velocity measurements, but suffers from limitations in spatio-temporal resolution and noise. In this study, we investigated the use of sinusoidal representation networks (SIRENs) to improve denoising and super-resolution of velocity fields measured by 4D flow MRI in the thoracic aorta.

METHODS

Efficient training of SIRENs in 4D was achieved by sampling voxel coordinates and enforcing the no-slip condition at the vessel wall. A set of synthetic measurements were generated from computational fluid dynamics simulations, reproducing different noise levels. The influence of SIREN architecture was systematically investigated, and the performance of our method was compared to existing approaches for 4D flow denoising and super-resolution.

RESULTS

Compared to existing techniques, a SIREN with 300 neurons per layer and 20 layers achieved lower errors (up to 50% lower vector normalized root mean square error, 42% lower magnitude normalized root mean square error, and 15% lower direction error) in velocity and wall shear stress fields. Applied to real 4D flow velocity measurements in a patient-specific aortic aneurysm, our method produced denoised and super-resolved velocity fields while maintaining accurate macroscopic flow measurements.

CONCLUSIONS

This study demonstrates the feasibility of using SIRENs for complex blood flow velocity representation from clinical 4D flow, with quick execution and straightforward implementation.

Accelerated simulation methodologies for computational vascular flow modelling

Vascular flow modelling can improve our understanding of vascular pathologies and aid in developing safe and effective medical devices. Vascular flow models typically involve solving the nonlinear Navier-Stokes equations in complex anatomies and using physiological boundary conditions, often presenting a multi-physics and multi-scale computational problem to be solved. This leads to highly complex and expensive models that require excessive computational time. This review explores accelerated simulation methodologies, specifically focusing on computational vascular flow modelling. We review reduced order modelling (ROM) techniques like zero-/one-dimensional and modal decomposition-based ROMs and machine learning (ML) methods including ML-augmented ROMs, ML-based ROMs and physics-informed ML models. We discuss the applicability of each method to vascular flow acceleration and the effectiveness of the method in addressing domain-specific challenges. When available, we provide statistics on accuracy and speed-up factors for various applications related to vascular flow simulation acceleration. Our findings indicate that each type of model has strengths and limitations depending on the context. To accelerate real-world vascular flow problems, we propose future research on developing multi-scale acceleration methods capable of handling the significant geometric variability inherent to such problems.

Fluid dynamic analysis in predicting the recanalization of intracranial aneurysms after coil embolization - A study of spatiotemporal characteristics

Purpose

Hemodynamics play a key role in the management of cerebral aneurysm recanalization after coil embolization; however, the most reliable hemodynamic parameter remains unknown. Previous studies have explored the use of both spatiotemporally averaged and maximal definitions for hemodynamic parameters, based on computational fluid dynamics (CFD) analysis, to build predictive models for aneurysmal recanalization. In this study, we aimed to assess the influence of different spatiotemporal characteristics of hemodynamic parameters on predictive performance.

Methods

Hemodynamics were simulated using CFD for 66 cerebral aneurysms from 65 patients. We evaluated 14 types of spatiotemporal definitions for two hemodynamic parameters in the pre-coiling model and five in virtual post-coiling model (VM) created by cutting the aneurysm from the pre-coiling model. A total of 91 spatiotemporal hemodynamic features were derived and utilized to develop univariate predictor (UP) and multivariate logistic regression (LR) models. The model's performance was assessed using two metrics: the area under the receiver operating characteristic curve (AUROC) and the area under the precision-recall curve (AUPRC).

Results

Different spatiotemporal hemodynamic features exhibited a wide range of AUROC values ranging from 0.224 to 0.747, with 22 feature pairs showing a significant difference in AUROC value (P-value <0.05), despite being derived from the same hemodynamic parameter. PDave,q1 was identified as the strongest UP with AUROC/AUPRC values of 0.747/0.385, yielding sensitivity and specificity value of 0.889 and 0.614 at the optimal cut-off value, respectively. The LR model further improved the prediction performance, having AUROC/AUPRC values of 0.890/0.903. At the optimal cut-off value, the LR model achieved a specificity of 0.877, sensitivity of 0.719, outperforming the UP model.

Conclusion

Our research indicated that the characteristics of hemodynamic parameters in terms of space and time had a significant impact on the development of predictive model. Our findings suggest that LR model based on spatiotemporal hemodynamic features could be clinically useful in predicting recanalization after coil embolization in patients, without the need for invasive procedures.

Developing and deploying deep learning models in brain magnetic resonance imaging: A review

Magnetic resonance imaging (MRI) of the brain has benefited from deep learning (DL) to alleviate the burden on radiologists and MR technologists, and improve throughput. The easy accessibility of DL tools has resulted in a rapid increase of DL models and subsequent peer-reviewed publications. However, the rate of deployment in clinical settings is low. Therefore, this review attempts to bring together the ideas from data collection to deployment in the clinic, building on the guidelines and principles that accreditation agencies have espoused. We introduce the need for and the role of DL to deliver accessible MRI. This is followed by a brief review of DL examples in the context of neuropathologies. Based on these studies and others, we collate the prerequisites to develop and deploy DL models for brain MRI. We then delve into the guiding principles to develop good machine learning practices in the context of neuroimaging, with a focus on explainability. A checklist based on the United States Food and Drug Administration's good machine learning practices is provided as a summary of these guidelines. Finally, we review the current challenges and future opportunities in DL for brain MRI.

4D Flow cardiovascular magnetic resonance consensus statement: 2023 update

Hemodynamic assessment is an integral part of the diagnosis and management of cardiovascular disease. Four-dimensional cardiovascular magnetic resonance flow imaging (4D Flow CMR) allows comprehensive and accurate assessment of flow in a single acquisition. This consensus paper is an update from the 2015 '4D Flow CMR Consensus Statement'. We elaborate on 4D Flow CMR sequence options and imaging considerations. The document aims to assist centers starting out with 4D Flow CMR of the heart and great vessels with advice on acquisition parameters, post-processing workflows and integration into clinical practice. Furthermore, we define minimum quality assurance and validation standards for clinical centers. We also address the challenges faced in quality assurance and validation in the research setting. We also include a checklist for recommended publication standards, specifically for 4D Flow CMR. Finally, we discuss the current limitations and the future of 4D Flow CMR. This updated consensus paper will further facilitate widespread adoption of 4D Flow CMR in the clinical workflow across the globe and aid consistently high-quality publication standards.

Cerebrovascular super-resolution 4D Flow MRI - Sequential combination of resolution enhancement by deep learning and physics-informed image processing to non-invasively quantify intracranial velocity, flow, and relative pressure

The development of cerebrovascular disease is tightly coupled to regional changes in intracranial flow and relative pressure. Image-based assessment using phase contrast magnetic resonance imaging has particular promise for non-invasive full-field mapping of cerebrovascular hemodynamics. However, estimations are complicated by the narrow and tortuous intracranial vasculature, with accurate image-based quantification directly dependent on sufficient spatial resolution. Further, extended scan times are required for high-resolution acquisitions, and most clinical acquisitions are performed at comparably low resolution (>1 mm) where biases have been observed with regard to the quantification of both flow and relative pressure. The aim of our study was to develop an approach for quantitative intracranial super-resolution 4D Flow MRI, with effective resolution enhancement achieved by a dedicated deep residual network, and with accurate quantification of functional relative pressures achieved by subsequent physics-informed image processing. To achieve this, our two-step approach was trained and validated in a patient-specific in-silico cohort, showing good accuracy in estimating velocity (relative error: 15.0 ± 0.1%, mean absolute error (MAE): 0.07 ± 0.06 m/s, and cosine similarity: 0.99 ± 0.06 at peak velocity) and flow (relative error: 6.6 ± 4.7%, root mean square error (RMSE): 0.56 mL/s at peak flow), and with the coupled physics-informed image analysis allowing for maintained recovery of functional relative pressure throughout the circle of Willis (relative error: 11.0 ± 7.3%, RMSE: 0.3 ± 0.2 mmHg). Furthermore, the quantitative super-resolution approach is applied to an in-vivo volunteer cohort, effectively generating intracranial flow images at <0.5 mm resolution and showing reduced low-resolution bias in relative pressure estimation. Our work thus presents a promising two-step approach to non-invasively quantify cerebrovascular hemodynamics, being applicable to dedicated clinical cohorts in the future.

A wavelet neural operator based elastography for localization and quantification of tumors

BACKGROUND AND OBJECTIVES

The application of intelligent imaging techniques and deep learning in the field of computer-aided diagnosis and medical imaging have improved and accelerated the early diagnosis of many diseases. Elastography is an imaging modality where an inverse problem is solved to extract the elastic properties of tissues and subsequently mapped to anatomical images for diagnostic purposes. In the present work, we propose a wavelet neural operator-based approach for correctly learning the non-linear mapping of elastic properties directly from measured displacement field data.

METHODS

The proposed framework learns the underlying operator behind the elastic mapping and thus can map any displacement data from a family to the elastic properties. The displacement fields are first uplifted to a high-dimensional space using a fully connected neural network. On the lifted data, certain iterations are performed using wavelet neural blocks. In each wavelet neural block, the lifted data are decomposed into low, and high-frequency components using wavelet decomposition. To learn the most relevant patterns and structural information from the input, the neural network kernels are directly convoluted with the outputs of the wavelet decomposition. Thereafter the elasticity field is reconstructed from the outputs from convolution. The mapping between the displacement and the elasticity using wavelets is unique and remains stable during training.

RESULTS

The proposed framework is tested on several artificially fabricated numerical examples, including a benign-cum-malignant tumor prediction problem. The trained model was also tested on real Ultrasound-based elastography data to demonstrate the applicability of the proposed scheme in clinical usage. The proposed framework reproduces the highly accurate elasticity field directly from the displacement inputs.

CONCLUSIONS

The proposed framework circumvents different data pre-processing and intermediate steps utilized in traditional methods, hence providing an accurate elasticity map. The computationally efficient framework requires fewer epochs for training, which bodes well for its clinical usability for real-time predictions. The weights and biases from pre-trained models can also be employed for transfer learning, which reduces the effective training time with random initialization.

Deep Learning for Image Enhancement and Correction in Magnetic Resonance Imaging-State-of-the-Art and Challenges

Magnetic resonance imaging (MRI) provides excellent soft-tissue contrast for clinical diagnoses and research which underpin many recent breakthroughs in medicine and biology. The post-processing of reconstructed MR images is often automated for incorporation into MRI scanners by the manufacturers and increasingly plays a critical role in the final image quality for clinical reporting and interpretation. For image enhancement and correction, the post-processing steps include noise reduction, image artefact correction, and image resolution improvements. With the recent success of deep learning in many research fields, there is great potential to apply deep learning for MR image enhancement, and recent publications have demonstrated promising results. Motivated by the rapidly growing literature in this area, in this review paper, we provide a comprehensive overview of deep learning-based methods for post-processing MR images to enhance image quality and correct image artefacts. We aim to provide researchers in MRI or other research fields, including computer vision and image processing, a literature survey of deep learning approaches for MR image enhancement. We discuss the current limitations of the application of artificial intelligence in MRI and highlight possible directions for future developments. In the era of deep learning, we highlight the importance of a critical appraisal of the explanatory information provided and the generalizability of deep learning algorithms in medical imaging.

Accelerated 4D-flow MRI with 3-point encoding enabled by machine learning

PURPOSE

To investigate the acceleration of 4D-flow MRI using a convolutional neural network (CNN) that produces three directional velocities from three flow encodings, without requiring a fourth reference scan measuring background phase.

METHODS

A fully 3D CNN using a U-net architecture was trained in a block-wise fashion to take complex images from three flow encodings and to produce three real-valued images for each velocity component. Using neurovascular 4D-flow scans (n = 144), the CNN was trained to predict velocities computed from four flow encodings by standard reconstruction including correction for residual background phase offsets. Methods to optimize loss functions were investigated, including magnitude, complex difference, and uniform velocity weightings. Subsequently, 3-point encoding was evaluated using cross validation of pixelwise correlation, flow measurements in major arteries, and in experiments with data at differing acceleration rates than the training data.

RESULTS

The CNN-produced 3-point velocities showed excellent agreements with the 4-point velocities, both qualitatively in velocity images, in flow rate measures, and quantitatively in regression analysis (slope = 0.96, R²  = 0.992). Optimizing the training to focus on vessel velocities rather than the global velocity error and improved the correlation of velocity within vessels themselves. The lowest error was observed when the loss function used uniform velocity weighting, in which the magnitude-weighted inverse of the velocity frequency uniformly distributed weighting across all velocity ranges. When applied to highly accelerated data, the 3-point network maintained a high correlation with ground truth data and demonstrated a denoising effect.

CONCLUSION

The 4D-flow MRI can be accelerated using machine learning requiring only three flow encodings to produce three-directional velocity maps with small errors.

Recent developments in modeling, imaging, and monitoring of cardiovascular diseases using machine learning

Cardiovascular diseases are the leading cause of mortality, morbidity, and hospitalization around the world. Recent technological advances have facilitated analyzing, visualizing, and monitoring cardiovascular diseases using emerging computational fluid dynamics, blood flow imaging, and wearable sensing technologies. Yet, computational cost, limited spatiotemporal resolution, and obstacles for thorough data analysis have hindered the utility of such techniques to curb cardiovascular diseases. We herein discuss how leveraging machine learning techniques, and in particular deep learning methods, could overcome these limitations and offer promise for translation. We discuss the remarkable capacity of recently developed machine learning techniques to accelerate flow modeling, enhance the resolution while reduce the noise and scanning time of current blood flow imaging techniques, and accurate detection of cardiovascular diseases using a plethora of data collected by wearable sensors.

4-dimensional local radial basis function interpolation of large, uniformly spaced datasets

BACKGROUND AND OBJECTIVE

Large, uniformly spaced, complex and time varying datasets derived from high resolution medical image velocimetry can provide a wealth of information regarding small-scale transient physiological flow phenomena and pulsation of anatomical boundaries. However, there remains a need for interpolation techniques to effectively reconstruct a fully 4-dimensional functional relationship from this data. This paper presents a preliminary evaluation of a 4-dimensional local radial basis function (RBF) algorithm as a means of addressing this problem for laminar flows.

METHODS

A 4D interpolation algorithm is proposed based on a Local Hermitian Interpolation (LHI) using a combination of multi-quadric RBF with a partition of unity scheme. The domain is divided into uniform sub-systems with size restricted to immediately neighbouring points. The validity of the algorithm is first established on a known 4D analytical dataset and a CFD based laminar flow phantom. Application is then demonstrated through characterisation of a large 4D laminar flow dataset obtained from magnetic resonance imaging (MRI) measurements of cerebrospinal fluid velocities in the brain.

RESULTS

Performance of the algorithm is compared to that of a quad-linear interpolation, demonstrating favourable improvement in accuracy. The technique is shown to be robust, computationally efficient and capable of refined interpolation in Euclidean space and time. Application to MR velocimetry data is shown to produce promising results for the 4D reconstruction of the transient flow field and movement of the fluid boundaries at spatial and temporal locations intermediate to the original data.

CONCLUSION

This study has demonstrated feasibility of an accurate, stable and efficient 4-dimensional local RBF interpolation method for large, transient laminar flow velocimetry datasets. The proposed approach does not suffer from ill-conditioning or high computational cost due to domain decomposition into local stencils where the RBF is only ever applied to a limited number of points. This work offers a potential tool to assist medical diagnoses and drug delivery through better understanding of physiological flow fields such as cerebrospinal fluid. Further work will evaluate the technique on a wider range of flow fields and against CFD simulation.

Advances in machine learning applications for cardiovascular 4D flow MRI

Four-dimensional flow magnetic resonance imaging (MRI) has evolved as a non-invasive imaging technique to visualize and quantify blood flow in the heart and vessels. Hemodynamic parameters derived from 4D flow MRI, such as net flow and peak velocities, but also kinetic energy, turbulent kinetic energy, viscous energy loss, and wall shear stress have shown to be of diagnostic relevance for cardiovascular diseases. 4D flow MRI, however, has several limitations. Its long acquisition times and its limited spatio-temporal resolutions lead to inaccuracies in velocity measurements in small and low-flow vessels and near the vessel wall. Additionally, 4D flow MRI requires long post-processing times, since inaccuracies due to the measurement process need to be corrected for and parameter quantification requires 2D and 3D contour drawing. Several machine learning (ML) techniques have been proposed to overcome these limitations. Existing scan acceleration methods have been extended using ML for image reconstruction and ML based super-resolution methods have been used to assimilate high-resolution computational fluid dynamic simulations and 4D flow MRI, which leads to more realistic velocity results. ML efforts have also focused on the automation of other post-processing steps, by learning phase corrections and anti-aliasing. To automate contour drawing and 3D segmentation, networks such as the U-Net have been widely applied. This review summarizes the latest ML advances in 4D flow MRI with a focus on technical aspects and applications. It is divided into the current status of fast and accurate 4D flow MRI data generation, ML based post-processing tools for phase correction and vessel delineation and the statistical evaluation of blood flow.

Investigating molecular transport in the human brain from MRI with physics-informed neural networks

In recent years, a plethora of methods combining neural networks and partial differential equations have been developed. A widely known example are physics-informed neural networks, which solve problems involving partial differential equations by training a neural network. We apply physics-informed neural networks and the finite element method to estimate the diffusion coefficient governing the long term spread of molecules in the human brain from magnetic resonance images. Synthetic testcases are created to demonstrate that the standard formulation of the physics-informed neural network faces challenges with noisy measurements in our application. Our numerical results demonstrate that the residual of the partial differential equation after training needs to be small for accurate parameter recovery. To achieve this, we tune the weights and the norms used in the loss function and use residual based adaptive refinement of training points. We find that the diffusion coefficient estimated from magnetic resonance images with physics-informed neural networks becomes consistent with results from a finite element based approach when the residuum after training becomes small. The observations presented here are an important first step towards solving inverse problems on cohorts of patients in a semi-automated fashion with physics-informed neural networks.

Physics-Informed Neural Networks for Brain Hemodynamic Predictions Using Medical Imaging

Determining brain hemodynamics plays a critical role in the diagnosis and treatment of various cerebrovascular diseases. In this work, we put forth a physics-informed deep learning framework that augments sparse clinical measurements with one-dimensional (1D) reduced-order model (ROM) simulations to generate physically consistent brain hemodynamic parameters with high spatiotemporal resolution. Transcranial Doppler (TCD) ultrasound is one of the most common techniques in the current clinical workflow that enables noninvasive and instantaneous evaluation of blood flow velocity within the cerebral arteries. However, it is spatially limited to only a handful of locations across the cerebrovasculature due to the constrained accessibility through the skull's acoustic windows. Our deep learning framework uses in vivo real-time TCD velocity measurements at several locations in the brain combined with baseline vessel cross-sectional areas acquired from 3D angiography images and provides high-resolution maps of velocity, area, and pressure in the entire brain vasculature. We validate the predictions of our model against in vivo velocity measurements obtained via four-dimensional (4D) flow magnetic resonance imaging (MRI) scans. We then showcase the clinical significance of this technique in diagnosing cerebral vasospasm (CVS) by successfully predicting the changes in vasospastic local vessel diameters based on corresponding sparse velocity measurements. We show this capability by generating synthetic blood flow data after cerebral vasospasm at various levels of stenosis. Here, we demonstrate that the physics-based deep learning approach can estimate and quantify the subject-specific cerebral hemodynamic variables with high accuracy despite lacking knowledge of inlet and outlet boundary conditions, which is a significant limitation for the accuracy of the conventional purely physics-based computational models.

SRflow: Deep learning based super-resolution of 4D-flow MRI data

Exploiting 4D-flow magnetic resonance imaging (MRI) data to quantify hemodynamics requires an adequate spatio-temporal vector field resolution at a low noise level. To address this challenge, we provide a learned solution to super-resolve in vivo 4D-flow MRI data at a post-processing level. We propose a deep convolutional neural network (CNN) that learns the inter-scale relationship of the velocity vector map and leverages an efficient residual learning scheme to make it computationally feasible. A novel, direction-sensitive, and robust loss function is crucial to learning vector-field data. We present a detailed comparative study between the proposed super-resolution and the conventional cubic B-spline based vector-field super-resolution. Our method improves the peak-velocity to noise ratio of the flow field by 10 and 30% for in vivo cardiovascular and cerebrovascular data, respectively, for 4 × super-resolution over the state-of-the-art cubic B-spline. Significantly, our method offers 10x faster inference over the cubic B-spline. The proposed approach for super-resolution of 4D-flow data would potentially improve the subsequent calculation of hemodynamic quantities.

Inverse problems in blood flow modeling: A review

Mathematical and computational modeling of the cardiovascular system is increasingly providing non-invasive alternatives to traditional invasive clinical procedures. Moreover, it has the potential for generating additional diagnostic markers. In blood flow computations, the personalization of spatially distributed (i.e., 3D) models is a key step which relies on the formulation and numerical solution of inverse problems using clinical data, typically medical images for measuring both anatomy and function of the vasculature. In the last years, the development and application of inverse methods has rapidly expanded most likely due to the increased availability of data in clinical centers and the growing interest of modelers and clinicians in collaborating. Therefore, this work aims to provide a wide and comparative overview of literature within the last decade. We review the current state of the art of inverse problems in blood flows, focusing on studies considering fully dimensional fluid and fluid-solid models. The relevant physical models and hemodynamic measurement techniques are introduced, followed by a survey of mathematical data assimilation approaches used to solve different kinds of inverse problems, namely state and parameter estimation. An exhaustive discussion of the literature of the last decade is presented, structured by types of problems, models and available data.

Enhanced 4D Flow MRI-Based CFD with Adaptive Mesh Refinement for Flow Dynamics Assessment in Coarctation of the Aorta

4D Flow MRI is a diagnostic tool that can visualize and quantify patient-specific hemodynamics and help interventionalists optimize treatment strategies for repairing coarctation of the aorta (COA). Despite recent developments in 4D Flow MRI, shortcomings include phase-offset errors, limited spatiotemporal resolution, aliasing, inaccuracies due to slow aneurysmal flows, and distortion of images due to metallic artifact from vascular stents. To address these limitations, we developed a framework utilizing Computational Fluid Dynamics (CFD) with Adaptive Mesh Refinement (AMR) that enhances 4D Flow MRI visualization/quantification. We applied this framework to five pediatric patients with COA, providing in-vivo and in-silico datasets, pre- and post-intervention. These two data sets were compared and showed that CFD flow rates were within 9.6% of 4D Flow MRI, which is within a clinically acceptable range. CFD simulated slow aneurysmal flow, which MRI failed to capture due to high relative velocity encoding (Venc). CFD successfully predicted in-stent blood flow, which was not visible in the in-vivo data due to susceptibility artifact. AMR improved spatial resolution by factors of 101 to 103 and temporal resolution four-fold. This computational framework has strong potential to optimize visualization/quantification of aneurysmal and in-stent flows, improve spatiotemporal resolution, and assess hemodynamic efficiency post-COA treatment.

Machine Learning for Cardiovascular Biomechanics Modeling: Challenges and Beyond

Recent progress in machine learning (ML), together with advanced computational power, have provided new research opportunities in cardiovascular modeling. While classifying patient outcomes and medical image segmentation with ML have already shown significant promising results, ML for the prediction of biomechanics such as blood flow or tissue dynamics is in its infancy. This perspective article discusses some of the challenges in using ML for replacing well-established physics-based models in cardiovascular biomechanics. Specifically, we discuss the large landscape of input features in 3D patient-specific modeling as well as the high-dimensional output space of field variables that vary in space and time. We argue that the end purpose of such ML models needs to be clearly defined and the tradeoff between the loss in accuracy and the gained speedup carefully interpreted in the context of translational modeling. We also discuss several exciting venues where ML could be strategically used to augment traditional physics-based modeling in cardiovascular biomechanics. In these applications, ML is not replacing physics-based modeling, but providing opportunities to solve ill-defined problems, improve measurement data quality, enable a solution to computationally expensive problems, and interpret complex spatiotemporal data by extracting hidden patterns. In summary, we suggest a strategic integration of ML in cardiovascular biomechanics modeling where the ML model is not the end goal but rather a tool to facilitate enhanced modeling.

A multi-modality approach for enhancing 4D flow magnetic resonance imaging via sparse representation

This work evaluates and applies a multi-modality approach to enhance blood flow measurements and haemodynamic analysis with phase-contrast magnetic resonance imaging (4D flow MRI) in cerebral aneurysms (CAs). Using a library of high-resolution velocity fields from patient-specific computational fluid dynamic simulations and in vitro particle tracking velocimetry measurements, the flow field of 4D flow MRI data is reconstructed as the sparse representation of the library. The method was evaluated with synthetic 4D flow MRI data in two CAs. The reconstruction enhanced the spatial resolution and velocity accuracy of the synthetic MRI data, leading to reliable pressure and wall shear stress (WSS) evaluation. The method was applied on in vivo 4D flow MRI data acquired in the same CAs. The reconstruction increased the velocity and WSS by 6-13% and 39-61%, respectively, suggesting that the accuracy of these quantities was improved since the raw MRI data underestimated the velocity and WSS by 10-20% and 40-50%, respectively. The computed pressure fields from the reconstructed data were consistent with the observed flow structures. The results suggest that using the sparse representation flow reconstruction with in vivo 4D flow MRI enhances blood flow measurement and haemodynamic analysis.

Progressive back-projection network for COVID-CT super-resolution

BACKGROUND AND OBJECTIVE

Recently, the COVID-19 epidemic has become more and more serious around the world, how to improve the image resolution of COVID-CT is a very important task. The network based on progressive upsampling for COVID-CT super-resolution increases the reconstruction error. This paper proposes a progressive back-projection network (PBPN) for COVID-CT super-resolution to solve this problem.

METHODS

In this paper, we propose a progressive back-projection network (PBPN) for COVID-CT super-resolution. PBPN is divided into two stages, and each stage consists of back-projection, deep feature extraction and upscaling. We design an up-projection and down-projection residual module to minimize the reconstruction error and construct a residual attention module to extract deep features. In each stage, firstly, PBPN performs back-projection to extract shallow features by two up-projection and down-projection residual modules; then, PBPN extracts deep features from the shallow features by two residual attention modules; finally, PBPN upsamples the deep features through sub-pixel convolution.

RESULTS

The proposed method achieves the improvements of about 0.14~0.47 dB/0.0012~0.0060 for × 2 scale factor, 0.02~0.08 dB/0.0024~0.0059 for × 3 scale factor, and 0.08~0.41 dB/ 0.0040~0.0147 for × 4 scale factor than state-of-the-art methods (Bicubic, SRCNN, FSRCNN, VDSR, LapSRN, DRCN and DSRN) in terms of PSNR/SSIM on benchmark datasets.

CONCLUSIONS

The proposed mehtod obtains better performance for COVID-CT super-resolution and reconstructs high-quality high-resolution COVID-CT images that contain more details and edges.

Integrating multi-fidelity blood flow data with reduced-order data assimilation

High-fidelity patient-specific modeling of cardiovascular flows and hemodynamics is challenging. Direct blood flow measurement inside the body with in-vivo measurement modalities such as 4D flow magnetic resonance imaging (4D flow MRI) suffer from low resolution and acquisition noise. In-vitro experimental modeling and patient-specific computational fluid dynamics (CFD) models are subject to uncertainty in patient-specific boundary conditions and model parameters. Furthermore, collecting blood flow data in the near-wall region (e.g., wall shear stress) with experimental measurement modalities poses additional challenges. In this study, a computationally efficient data assimilation method called reduced-order modeling Kalman filter (ROM-KF) was proposed, which combined a sequential Kalman filter with reduced-order modeling using a linear model provided by dynamic mode decomposition (DMD). The goal of ROM-KF was to overcome low resolution and noise in experimental and uncertainty in CFD modeling of cardiovascular flows. The accuracy of the method was assessed with 1D Womersley flow, 2D idealized aneurysm, and 3D patient-specific cerebral aneurysm models. Synthetic experimental data were used to enable direct quantification of errors using benchmark datasets. The accuracy of ROM-KF in reconstructing near-wall hemodynamics was assessed by applying the method to problems where near-wall blood flow data were missing in the experimental dataset. The ROM-KF method provided blood flow data that were more accurate than the computational and synthetic experimental datasets and improved near-wall hemodynamics quantification.

Blood Flow Quantification in Peripheral Arterial Disease: Emerging Diagnostic Techniques in Vascular Surgery

The assessment of local blood flow patterns in patients with peripheral arterial disease is clinically relevant, since these patterns are related to atherosclerotic disease progression and loss of patency in stents placed in peripheral arteries, through mechanisms such as recirculating flow and low wall shear stress (WSS). However, imaging of vascular flow in these patients is technically challenging due to the often complex flow patterns that occur near atherosclerotic lesions. While several flow quantification techniques have been developed that could improve the outcomes of vascular interventions, accurate 2D or 3D blood flow quantification is not yet used in clinical practice. This article provides an overview of several important topics that concern the quantification of blood flow in patients with peripheral arterial disease. The hemodynamic mechanisms involved in the development of atherosclerosis and the current clinical practice in the diagnosis of this disease are discussed, showing the unmet need for improved and validated flow quantification techniques in daily clinical practice. This discussion is followed by a showcase of state-of-the-art blood flow quantification techniques and how these could be used before, during and after treatment of stenotic lesions to improve clinical outcomes. These techniques include novel ultrasound-based methods, Phase-Contrast Magnetic Resonance Imaging (PC-MRI) and Computational Fluid Dynamics (CFD). The last section discusses future perspectives, with advanced (hybrid) imaging techniques and artificial intelligence, including the implementation of these techniques in clinical practice.

Blood Flow Quantification in Peripheral Arterial Disease: Emerging Diagnostic Techniques in Vascular Surgery

The assessment of local blood flow patterns in patients with peripheral arterial disease is clinically relevant, since these patterns are related to atherosclerotic disease progression and loss of patency in stents placed in peripheral arteries, through mechanisms such as recirculating flow and low wall shear stress (WSS). However, imaging of vascular flow in these patients is technically challenging due to the often complex flow patterns that occur near atherosclerotic lesions. While several flow quantification techniques have been developed that could improve the outcomes of vascular interventions, accurate 2D or 3D blood flow quantification is not yet used in clinical practice. This article provides an overview of several important topics that concern the quantification of blood flow in patients with peripheral arterial disease. The hemodynamic mechanisms involved in the development of atherosclerosis and the current clinical practice in the diagnosis of this disease are discussed, showing the unmet need for improved and validated flow quantification techniques in daily clinical practice. This discussion is followed by a showcase of state-of-the-art blood flow quantification techniques and how these could be used before, during and after treatment of stenotic lesions to improve clinical outcomes. These techniques include novel ultrasound-based methods, Phase-Contrast Magnetic Resonance Imaging (PC-MRI) and Computational Fluid Dynamics (CFD). The last section discusses future perspectives, with advanced (hybrid) imaging techniques and artificial intelligence, including the implementation of these techniques in clinical practice.

Data-driven cardiovascular flow modelling: examples and opportunities

High-fidelity blood flow modelling is crucial for enhancing our understanding of cardiovascular disease. Despite significant advances in computational and experimental characterization of blood flow, the knowledge that we can acquire from such investigations remains limited by the presence of uncertainty in parameters, low resolution, and measurement noise. Additionally, extracting useful information from these datasets is challenging. Data-driven modelling techniques have the potential to overcome these challenges and transform cardiovascular flow modelling. Here, we review several data-driven modelling techniques, highlight the common ideas and principles that emerge across numerous such techniques, and provide illustrative examples of how they could be used in the context of cardiovascular fluid mechanics. In particular, we discuss principal component analysis (PCA), robust PCA, compressed sensing, the Kalman filter for data assimilation, low-rank data recovery, and several additional methods for reduced-order modelling of cardiovascular flows, including the dynamic mode decomposition and the sparse identification of nonlinear dynamics. All techniques are presented in the context of cardiovascular flows with simple examples. These data-driven modelling techniques have the potential to transform computational and experimental cardiovascular research, and we discuss challenges and opportunities in applying these techniques in the field, looking ultimately towards data-driven patient-specific blood flow modelling.