Temporal Views of Flattened Mitral Valve Geometries

A Survey of Designs for Combined 2D+3D Visual Representations

We examine visual representations of data that make use of combinations of both 2D and 3D data mappings. Combining 2D and 3D representations is a common technique that allows viewers to understand multiple facets of the data with which they are interacting. While 3D representations focus on the spatial character of the data or the dedicated 3D data mapping, 2D representations often show abstract data properties and take advantage of the unique benefits of mapping to a plane. Many systems have used unique combinations of both types of data mappings effectively. Yet there are no systematic reviews of the methods in linking 2D and 3D representations. We systematically survey the relationships between 2D and 3D visual representations in major visualization publications-IEEE VIS, IEEE TVCG, and EuroVis-from 2012 to 2022. We closely examined 105 articles where 2D and 3D representations are connected visually, interactively, or through animation. These approaches are designed based on their visual environment, the relationships between their visual representations, and their possible layouts. Through our analysis, we introduce a design space as well as provide design guidelines for effectively linking 2D and 3D visual representations.

Visualization of Human Spine Biomechanics for Spinal Surgery

We propose a visualization application, designed for the exploration of human spine simulation data. Our goal is to support research in biomechanical spine simulation and advance efforts to implement simulation-backed analysis in surgical applications. Biomechanical simulation is a state-of-the-art technique for analyzing load distributions of spinal structures. Through the inclusion of patient-specific data, such simulations may facilitate personalized treatment and customized surgical interventions. Difficulties in spine modelling and simulation can be partly attributed to poor result representation, which may also be a hindrance when introducing such techniques into a clinical environment. Comparisons of measurements across multiple similar anatomical structures and the integration of temporal data make commonly available diagrams and charts insufficient for an intuitive and systematic display of results. Therefore, we facilitate methods such as multiple coordinated views, abstraction and focus and context to display simulation outcomes in a dedicated tool. By linking the result data with patient-specific anatomy, we make relevant parameters tangible for clinicians. Furthermore, we introduce new concepts to show the directions of impact force vectors, which were not accessible before. We integrated our toolset into a spine segmentation and simulation pipeline and evaluated our methods with both surgeons and biomechanical researchers. When comparing our methods against standard representations that are currently in use, we found increases in accuracy and speed in data exploration tasks. in a qualitative review, domain experts deemed the tool highly useful when dealing with simulation result data, which typically combines time-dependent patient movement and the resulting force distributions on spinal structures.

Mitral valve flattening and parameter mapping for patient-specific valve diagnosis

Purpose

Intensive planning and analysis from echocardiography are a crucial step before reconstructive surgeries are applied to malfunctioning mitral valves. Volume visualizations of echocardiographic data are often used in clinical routine. However, they lack a clear visualization of the crucial factors for decision making.

Methods

We build upon patient-specific mitral valve surface models segmented from echocardiography that represent the valve’s geometry, but suffer from self-occlusions due to complex 3D shape. We transfer these to 2D maps by unfolding their geometry, resulting in a novel 2D representation that maintains anatomical resemblance to the 3D geometry. It can be visualized together with color mappings and presented to physicians to diagnose the pathology in one gaze without the need for further scene interaction. Furthermore, it facilitates the computation of a Pathology Score, which can be used for diagnosis support.

Results

Quality and effectiveness of the proposed methods were evaluated through a user survey conducted with domain experts. We assessed pathology detection accuracy using 3D valve models in comparison with the novel visualizations. Classification accuracy increased by 5.3% across all tested valves and by 10.0% for prolapsed valves. Further, the participants’ understanding of the relation between 3D and 2D views was evaluated. The Pathology Score is found to have potential to support discriminating pathologic valves from normal valves.

Conclusions

In summary, our survey shows that pathology detection can be improved in comparison with simple 3D surface visualizations of the mitral valve. The correspondence between the 2D and 3D representations is comprehensible, and color-coded pathophysiological magnitudes further support the clinical assessment.