Interactive virtual probing of 4D MRI blood-flow

A Review of Three-Dimensional Medical Image Visualization

Importance. Medical images are essential for modern medicine and an important research subject in visualization. However, medical experts are often not aware of the many advanced three-dimensional (3D) medical image visualization techniques that could increase their capabilities in data analysis and assist the decision-making process for specific medical problems. Our paper provides a review of 3D visualization techniques for medical images, intending to bridge the gap between medical experts and visualization researchers.Highlights. Fundamental visualization techniques are revisited for various medical imaging modalities, from computational tomography to diffusion tensor imaging, featuring techniques that enhance spatial perception, which is critical for medical practices. The state-of-the-art of medical visualization is reviewed based on a procedure-oriented classification of medical problems for studies of individuals and populations. This paper summarizes free software tools for different modalities of medical images designed for various purposes, including visualization, analysis, and segmentation, and it provides respective Internet links.Conclusions. Visualization techniques are a useful tool for medical experts to tackle specific medical problems in their daily work. Our review provides a quick reference to such techniques given the medical problem and modalities of associated medical images. We summarize fundamental techniques and readily available visualization tools to help medical experts to better understand and utilize medical imaging data. This paper could contribute to the joint effort of the medical and visualization communities to advance precision medicine.

Automatic measurement plane placement for 4D Flow MRI of the great vessels using deep learning

PURPOSE

Despite the great potential and flexibility of 4D flow MRI for hemodynamic analysis, a major limitation is the need for time-consuming and user-dependent post-processing. We propose a fast four-step algorithm for rapid, robust, and repeatable flow measurements in the great vessels based on automatic placement of measurement planes and vessel segmentation.

METHODS

Our algorithm works by (1) subsampling the 3D image into 3D patches, (2) predicting the probability of each patch containing individual vessels and location/orientation of the vessel within the patch via a convolutional neural network, (3) selecting the predicted planes with highest probabilities for each vessel, and (4) shifting the plane centers to the maximum velocity within each plane. The method was trained on 283 scans and evaluated on 40 unseen scans by comparing algorithm-derived processing times, plane locations, and flow measurements to those of two manual observers (graduate students) using t-tests, Pearson correlation, and Bland-Altman analysis.

RESULTS

The average processing time for the algorithm (18 s) was shorter than observer 1 (362 s; P < 0.001) and observer 2 (317 s; P < 0.001). The distance between planes placed by the algorithm and those placed by manual observers was slightly greater (O1 vs. algorithm: 9.0 mm, O2 vs. algorithm: 10.3 mm) than the distance between planes placed by the two manual observers (8.3 mm). The correlation between flow values for planes placed by the algorithm and those placed by manual observers was slightly lower (O1 vs. algorithm: R = 0.68, O2 vs. algorithm: R = 0.72) than the flow correlation between the two manual observers (R = 0.81).

CONCLUSION

Our method is a feasible and accurate approach for fast, reproducible, and automated flow measurement and visualization in 4D flow MRI of the great vessels, with similar variability compared to a manual annotator as the variability between two manual observers. This approach could be applied in other anatomical regions.

Uncertainty Footprint: Visualization of Nonuniform Behavior of Iterative Algorithms Applied to 4D Cell Tracking

Research on microscopy data from developing biological samples usually requires tracking individual cells over time. When cells are three-dimensionally and densely packed in a time-dependent scan of volumes, tracking results can become unreliable and uncertain. Not only are cell segmentation results often inaccurate to start with, but it also lacks a simple method to evaluate the tracking outcome. Previous cell tracking methods have been validated against benchmark data from real scans or artificial data, whose ground truth results are established by manual work or simulation. However, the wide variety of real-world data makes an exhaustive validation impossible. Established cell tracking tools often fail on new data, whose issues are also difficult to diagnose with only manual examinations. Therefore, data-independent tracking evaluation methods are desired for an explosion of microscopy data with increasing scale and resolution. In this paper, we propose the uncertainty footprint, an uncertainty quantification and visualization technique that examines nonuniformity at local convergence for an iterative evaluation process on a spatial domain supported by partially overlapping bases. We demonstrate that the patterns revealed by the uncertainty footprint indicate data processing quality in two algorithms from a typical cell tracking workflow - cell identification and association. A detailed analysis of the patterns further allows us to diagnose issues and design methods for improvements. A 4D cell tracking workflow equipped with the uncertainty footprint is capable of self diagnosis and correction for a higher accuracy than previous methods whose evaluation is limited by manual examinations.

Combined Visualization of Vessel Deformation and Hemodynamics in Cerebral Aneurysms

We present the first visualization tool that combines patient-specific hemodynamics with information about the vessel wall deformation and wall thickness in cerebral aneurysms. Such aneurysms bear the risk of rupture, whereas their treatment also carries considerable risks for the patient. For the patient-specific rupture risk evaluation and treatment analysis, both morphological and hemodynamic data have to be investigated. Medical researchers emphasize the importance of analyzing correlations between wall properties such as the wall deformation and thickness, and hemodynamic attributes like the Wall Shear Stress and near-wall flow. Our method uses a linked 2.5D and 3D depiction of the aneurysm together with blood flow information that enables the simultaneous exploration of wall characteristics and hemodynamic attributes during the cardiac cycle. We thus offer medical researchers an effective visual exploration tool for aneurysm treatment risk assessment. The 2.5D view serves as an overview that comprises a projection of the vessel surface to a 2D map, providing an occlusion-free surface visualization combined with a glyph-based depiction of the local wall thickness. The 3D view represents the focus upon which the data exploration takes place. To support the time-dependent parameter exploration and expert collaboration, a camera path is calculated automatically, where the user can place landmarks for further exploration of the properties. We developed a GPU-based implementation of our visualizations with a flexible interactive data exploration mechanism. We designed our techniques in collaboration with domain experts, and provide details about the evaluation.

Occlusion-free Blood Flow Animation with Wall Thickness Visualization

We present the first visualization tool that combines pathlines from blood flow and wall thickness information. Our method uses illustrative techniques to provide occlusion-free visualization of the flow. We thus offer medical researchers an effective visual analysis tool for aneurysm treatment risk assessment. Such aneurysms bear a high risk of rupture and significant treatment-related risks. Therefore, to get a fully informed decision it is essential to both investigate the vessel morphology and the hemodynamic data. Ongoing research emphasizes the importance of analyzing the wall thickness in risk assessment. Our combination of blood flow visualization and wall thickness representation is a significant improvement for the exploration and analysis of aneurysms. As all presented information is spatially intertwined, occlusion problems occur. We solve these occlusion problems by dynamic cutaway surfaces. We combine this approach with a glyph-based blood flow representation and a visual mapping of wall thickness onto the vessel surface. We developed a GPU-based implementation of our visualizations which facilitates wall thickness analysis through real-time rendering and flexible interactive data exploration mechanisms. We designed our techniques in collaboration with domain experts, and we provide details about the evaluation of the technique and tool.

Atlas-based analysis of 4D flow CMR: automated vessel segmentation and flow quantification

BACKGROUND

Flow volume quantification in the great thoracic vessels is used in the assessment of several cardiovascular diseases. Clinically, it is often based on semi-automatic segmentation of a vessel throughout the cardiac cycle in 2D cine phase-contrast Cardiovascular Magnetic Resonance (CMR) images. Three-dimensional (3D), time-resolved phase-contrast CMR with three-directional velocity encoding (4D flow CMR) permits assessment of net flow volumes and flow patterns retrospectively at any location in a time-resolved 3D volume. However, analysis of these datasets can be demanding. The aim of this study is to develop and evaluate a fully automatic method for segmentation and analysis of 4D flow CMR data of the great thoracic vessels.

METHODS

The proposed method utilizes atlas-based segmentation to segment the great thoracic vessels in systole, and registration between different time frames of the cardiac cycle in order to segment these vessels over time. Additionally, net flow volumes are calculated automatically at locations of interest. The method was applied on 4D flow CMR datasets obtained from 11 healthy volunteers and 10 patients with heart failure. Evaluation of the method was performed visually, and by comparison of net flow volumes in the ascending aorta obtained automatically (using the proposed method), and semi-automatically. Further evaluation was done by comparison of net flow volumes obtained automatically at different locations in the aorta, pulmonary artery, and caval veins.

RESULTS

Visual evaluation of the generated segmentations resulted in good outcomes for all the major vessels in all but one dataset. The comparison between automatically and semi-automatically obtained net flow volumes in the ascending aorta resulted in very high correlation (r (2)=0.926). Moreover, comparison of the net flow volumes obtained automatically in other vessel locations also produced high correlations where expected: pulmonary trunk vs. proximal ascending aorta (r (2)=0.955), pulmonary trunk vs. pulmonary branches (r (2)=0.808), and pulmonary trunk vs. caval veins (r (2)=0.906).

CONCLUSIONS

The proposed method allows for automatic analysis of 4D flow CMR data, including vessel segmentation, assessment of flow volumes at locations of interest, and 4D flow visualization. This constitutes an important step towards facilitating the clinical utility of 4D flow CMR.

Visualizing Cardiovascular Magnetic Resonance (CMR) imagery: challenges and opportunities

Cardiovascular Magnetic Resonance (CMR) imaging is an essential technique for measuring regional myocardial function. However, it is a time-consuming and cognitively demanding task to interpret, identify and compare various motion characteristics based on watching CMR imagery. In this work, we focus on the problems of visualising imagery resulting from 2D myocardial tagging in CMR. In particular we provide an overview of the current state of the art of relevant visualization techniques, and a discussion on why the problem is difficult from a perceptual perspective. Finally, we introduce a proof-of-concept multilayered visualization user interface for visualizing CMR data using multiple derived attributes encoded into multivariate glyphs. An initial evaluation of the system by clinicians suggested a great potential for this visualisation technology to become a clinical practice in the future.

Blood Flow Clustering and Applications in Virtual Stenting of Intracranial Aneurysms

Understanding the hemodynamics of blood flow in vascular pathologies such as intracranial aneurysms is essential for both their diagnosis and treatment. Computational fluid dynamics (CFD) simulations of blood flow based on patient-individual data are performed to better understand aneurysm initiation and progression and more recently, for predicting treatment success. In virtual stenting, a flow-diverting mesh tube (stent) is modeled inside the reconstructed vasculature and integrated in the simulation. We focus on steady-state simulation and the resulting complex multiparameter data. The blood flow pattern captured therein is assumed to be related to the success of stenting. It is often visualized by a dense and cluttered set of streamlines.We present a fully automatic approach for reducing visual clutter and exposing characteristic flow structures by clustering streamlines and computing cluster representatives. While individual clustering techniques have been applied before to streamlines in 3D flow fields, we contribute a general quantitative and a domain-specific qualitative evaluation of three state-of-the-art techniques. We show that clustering based on streamline geometry as well as on domain-specific streamline attributes contributes to comparing and evaluating different virtual stenting strategies. With our work, we aim at supporting CFD engineers and interventional neuroradiologists.

Automatic Detection and Visualization of Qualitative Hemodynamic Characteristics in Cerebral Aneurysms

Cerebral aneurysms are a pathological vessel dilatation that bear a high risk of rupture. For the understanding and evaluation of the risk of rupture, the analysis of hemodynamic information plays an important role. Besides quantitative hemodynamic information, also qualitative flow characteristics, e.g., the inflow jet and impingement zone are correlated with the risk of rupture. However, the assessment of these two characteristics is currently based on an interactive visual investigation of the flow field, obtained by computational fluid dynamics (CFD) or blood flow measurements. We present an automatic and robust detection as well as an expressive visualization of these characteristics. The detection can be used to support a comparison, e.g., of simulation results reflecting different treatment options. Our approach utilizes local streamline properties to formalize the inflow jet and impingement zone. We extract a characteristic seeding curve on the ostium, on which an inflow jet boundary contour is constructed. Based on this boundary contour we identify the impingement zone. Furthermore, we present several visualization techniques to depict both characteristics expressively. Thereby, we consider accuracy and robustness of the extracted characteristics, minimal visual clutter and occlusions. An evaluation with six domain experts confirms that our approach detects both hemodynamic characteristics reasonably.