Enhancing Single-Frame Supervision for Better Temporal Action Localization

Temporal action localization aims to identify the boundaries and categories of actions in videos, such as scoring a goal in a football match. Single-frame supervision has emerged as a labor-efficient way to train action localizers as it requires only one annotated frame per action. However, it often suffers from poor performance due to the lack of precise boundary annotations. To address this issue, we propose a visual analysis method that aligns similar actions and then propagates a few user-provided annotations (e.g., boundaries, category labels) to similar actions via the generated alignments. Our method models the alignment between actions as a heaviest path problem and the annotation propagation as a quadratic optimization problem. As the automatically generated alignments may not accurately match the associated actions and could produce inaccurate localization results, we develop a storyline visualization to explain the localization results of actions and their alignments. This visualization facilitates users in correcting wrong localization results and misalignments. The corrections are then used to improve the localization results of other actions. The effectiveness of our method in improving localization performance is demonstrated through quantitative evaluation and a case study.

Visual Analysis of Displacement Processes in Porous Media using Spatio-Temporal Flow Graphs

We developed a new approach comprised of different visualizations for the comparative spatio-temporal analysis of displacement processes in porous media. We aim to analyze and compare ensemble datasets from experiments to gain insight into the influence of different parameters on fluid flow. To capture the displacement of a defending fluid by an invading fluid, we first condense an input image series to a single time map. From this map, we generate a spatio-temporal flow graph covering the whole process. This graph is further simplified to only reflect topological changes in the movement of the invading fluid. Our interactive tools allow the visual analysis of these processes by visualizing the graph structure and the context of the experimental setup, as well as by providing charts for multiple metrics. We apply our approach to analyze and compare ensemble datasets jointly with domain experts, where we vary either fluid properties or the solid structure of the porous medium. We finally report the generated insights from the domain experts and discuss our contribution's advantages, generality, and limitations.

Chances and barriers of building information modelling in wastewater management

The advancing digitalisation is one of the great challenges of our times. Related activities also concern the wastewater sector. In the field of building construction, one emerging approach is building information modelling (BIM). The presented work investigates to which extent BIM practices have already found their way to wastewater management, and what kind of benefits and constraints are incorporated. Information is collected by means of a literature review and international expert surveys. Results indicate that several BIM-related key elements are already well established in the sector, but not necessarily in the intended manner. Consequently, the digital transition in the wastewater sector is not about replacing existing procedures and techniques but to rethink and optimise them. This primarily concerns data and information management in combination with the application of digital tools. Furthermore, wastewater management requires more integrated approaches, involving interdisciplinary/collaborative concepts and life cycle perspectives. Appropriate change management is necessary to give support and guidance to employees during the transition process. Furthermore, also from the political side, a clear definition and communication of the pursued digital vision is important. This article aims at stimulating discussion and research to optimise wastewater management from the digital perspective.

S4: Self-Supervised Learning of Spatiotemporal Similarity

We introduce an ML-driven approach that enables interactive example-based queries for similar behavior in ensembles of spatiotemporal scientific data. This addresses an important use case in the visual exploration of simulation and experimental data, where data is often large, unlabeled and has no meaningful similarity measures available. We exploit the fact that nearby locations often exhibit similar behavior and train a Siamese Neural Network in a self-supervised fashion, learning an expressive latent space for spatiotemporal behavior. This space can be used to find similar behavior with just a few user-provided examples. We evaluate this approach on several ensemble datasets and compare with multiple existing methods, showing both qualitative and quantitative results.

A Hybrid In Situ Approach for Cost Efficient Image Database Generation

The visualization of results while the simulation is running is increasingly common in extreme scale computing environments. We present a novel approach for in situ generation of image databases to achieve cost savings on supercomputers. Our approach, a hybrid between traditional inline and in transit techniques, dynamically distributes visualization tasks between simulation nodes and visualization nodes, using probing as a basis to estimate rendering cost. Our hybrid design differs from previous works in that it creates opportunities to minimize idle time from four fundamental types of inefficiency: variability, limited scalability, overhead, and rightsizing. We demonstrate our results by comparing our method against both inline and in transit methods for a variety of configurations, including two simulation codes and a scaling study that goes above 19K cores. Our findings show that our approach is superior in many configurations. As in situ visualization becomes increasingly ubiquitous, we believe our technique could lead to significant amounts of reclaimed cycles on supercomputers.

Situated Visual Analysis and Live Monitoring for Manufacturing

Modern machines continuously log status reports over long periods of time, which are valuable data to optimize working routines. Data visualization is a commonly used tool to gain insights into these data, mostly in retrospective (e.g., to determine causal dependencies between the faults of different machines). We present an approach to bring such visual analyses to the shop floor to support reacting to faults in real time. This approach combines spatio-temporal analyses of time series using a handheld touch device with augmented reality for live monitoring. Important information augments machines directly in their real-world context, and detailed logs of current and historical events are displayed on the handheld device. In collaboration with an industry partner, we designed and tested our approach on a live production line to obtain feedback from operators. We compare our approach for monitoring and analysis with existing solutions that are currently deployed.

Real-Time Visual Analysis of High-Volume Social Media Posts

Breaking news and first-hand reports often trend on social media platforms before traditional news outlets cover them. The real-time analysis of posts on such platforms can reveal valuable and timely insights for journalists, politicians, business analysts, and first responders, but the high number and diversity of new posts pose a challenge. In this work, we present an interactive system that enables the visual analysis of streaming social media data on a large scale in real-time. We propose an efficient and explainable dynamic clustering algorithm that powers a continuously updated visualization of the current thematic landscape as well as detailed visual summaries of specific topics of interest. Our parallel clustering strategy provides an adaptive stream with a digestible but diverse selection of recent posts related to relevant topics. We also integrate familiar visual metaphors that are highly interlinked for enabling both explorative and more focused monitoring tasks. Analysts can gradually increase the resolution to dive deeper into particular topics. In contrast to previous work, our system also works with non-geolocated posts and avoids extensive preprocessing such as detecting events. We evaluated our dynamic clustering algorithm and discuss several use cases that show the utility of our system.

The coupled socio-ecohydrological evolution of river systems: Towards an integrative perspective of river systems in the 21st century

River systems have undergone a massive transformation since the Anthropocene. The natural properties of river systems have been drastically altered and reshaped, limiting the use of management frameworks, their scientific knowledge base and their ability to provide adequate solutions for current problems and those of the future, such as climate change, biodiversity crisis and increased demands for water resources. To address these challenges, a socioecologically driven research agenda for river systems that complements current approaches is needed and proposed. The implementation of the concepts of social metabolism and the colonisation of natural systems into existing concepts can provide a new basis to analyse the coevolutionary coupling of social systems with ecological and hydrological (i.e., 'socio-ecohydrological') systems within rivers. To operationalize this research agenda, we highlight four initial core topics defined as research clusters (RCs) to address specific system properties in an integrative manner. The colonisation of natural systems by social systems is seen as a significant driver of the transformation processes in river systems. These transformation processes are influenced by connectivity (RC 1), which primarily addresses biophysical aspects and governance (RC 2), which focuses on the changes in social systems. The metabolism (RC 3) and vulnerability (RC 4) of the social and natural systems are significant aspects of the coupling of social systems and ecohydrological systems with investments, energy, resources, services and associated risks and impacts. This socio-ecohydrological research agenda complements other recent approaches, such as 'socio-ecological', 'socio-hydrological' or 'socio-geomorphological' systems, by focusing on the coupling of social systems with natural systems in rivers and thus, by viewing the socioeconomic features of river systems as being just as important as their natural characteristics. The proposed research agenda builds on interdisciplinarity and transdisciplinarity and requires the implementation of such programmes into the education of a new generation of river system scientists, managers and engineers who are aware of the transformation processes and the coupling between systems.

PyramidTags: Context-, Time- and Word Order-Aware Tag Maps to Explore Large Document Collections

It is difficult to explore large text collections if no or little information is available on the contained documents. Hence, starting analytic tasks on such corpora is challenging for many stakeholders from various domains. As a remedy, recent visualization research suggests to use visual spatializations of representative text documents or tags to explore text collections. With PyramidTags, we introduce a novel approach for summarizing large text collections visually. In contrast to previous work, PyramidTags in particular aims at creating an improved representation that incorporates both temporal evolution and semantic relationship of visualized tags within the summarized document collection. As a result, it equips analysts with a visual starting point for interactive exploration to not only get an overview of the main terms and phrases of the corpus, but also to grasp important ideas and stories. Analysts can hover and select multiple tags to explore relationships and retrieve the most relevant documents. In this work, we apply PyramidTags to hundreds of thousands of web-crawled news reports. Our benchmarks suggest that PyramidTags creates time- and context-aware layouts, while preserving the inherent word order of important pairs.

2019 IEEE Scientific Visualization Contest Winner: Visual Analysis of Structure Formation in Cosmic Evolution

Simulations of cosmic evolution are a means to explain the formation of the universe as we see it today. The resulting data of such simulations comprise numerous physical quantities, which turns their analysis into a complex task. Here, we analyze such high-dimensional and time-varying particle data using various visualization techniques from the fields of particle visualization, flow visualization, volume visualization, and information visualization. Our approach employs specialized filters to extract and highlight the development of so-called active galactic nuclei and filament structures formed by the particles. Additionally, we calculate X-ray emission of the evolving structures in a preprocessing step to complement visual analysis. Our approach is integrated into a single visual analytics framework to allow for analysis of star formation at interactive frame rates. Finally, we lay out the methodological aspects of our work that led to success at the 2019 IEEE SciVis Contest.

Local Prediction Models for Spatiotemporal Volume Visualization

We present a machine learning-based approach for detecting and visualizing complex behavior in spatiotemporal volumes. For this, we train models to predict future data values at a given position based on the past values in its neighborhood, capturing common temporal behavior in the data. We then evaluate the model's prediction on the same data. High prediction error means that the local behavior was too complex, unique or uncertain to be accurately captured during training, indicating spatiotemporal regions with interesting behavior. By training several models of varying capacity, we are able to detect spatiotemporal regions of various complexities. We aggregate the obtained prediction errors into a time series or spatial volumes and visualize them together to highlight regions of unpredictable behavior and how they differ between the models. We demonstrate two further volumetric applications: adaptive timestep selection and analysis of ensemble dissimilarity. We apply our technique to datasets from multiple application domains and demonstrate that we are able to produce meaningful results while making minimal assumptions about the underlying data.

Visual analysis of droplet dynamics in large-scale multiphase spray simulations

Abstract

We present a data-driven visual analysis approach for the in-depth exploration of large numbers of droplets. Understanding droplet dynamics in sprays is of interest across many scientific fields for both simulation scientists and engineers. In this paper, we analyze large-scale direct numerical simulation datasets of the two-phase flow of non-Newtonian jets. Our interactive visual analysis approach comprises various dedicated exploration modalities that are supplemented by directly linking to ParaView. This hybrid setup supports a detailed investigation of droplets, both in the spatial domain and in terms of physical quantities . Considering a large variety of extracted physical quantities for each droplet enables investigating different aspects of interest in our data. To get an overview of different types of characteristic behaviors, we cluster massive numbers of droplets to analyze different types of occurring behaviors via domain-specific pre-aggregation, as well as different methods and parameters. Extraordinary temporal patterns are of high interest, especially to investigate edge cases and detect potential simulation issues. For this, we use a neural network-based approach to predict the development of these physical quantities and identify irregularly advected droplets.

Graphic Abstract

Foveated Encoding for Large High-Resolution Displays

Collaborative exploration of scientific data sets across large high-resolution displays requires both high visual detail as well as low-latency transfer of image data (oftentimes inducing the need to trade one for the other). In this work, we present a system that dynamically adapts the encoding quality in such systems in a way that reduces the required bandwidth without impacting the details perceived by one or more observers. Humans perceive sharp, colourful details, in the small foveal region around the centre of the field of view, while information in the periphery is perceived blurred and colourless. We account for this by tracking the gaze of observers, and respectively adapting the quality parameter of each macroblock used by the H.264 encoder, considering the so-called visual acuity fall-off. This allows to substantially reduce the required bandwidth with barely noticeable changes in visual quality, which is crucial for collaborative analysis across display walls at different locations. We demonstrate the reduced overall required bandwidth and the high quality inside the foveated regions using particle rendering and parallel coordinates.

Visual Neural Decomposition to Explain Multivariate Data Sets

Investigating relationships between variables in multi-dimensional data sets is a common task for data analysts and engineers. More specifically, it is often valuable to understand which ranges of which input variables lead to particular values of a given target variable. Unfortunately, with an increasing number of independent variables, this process may become cumbersome and time-consuming due to the many possible combinations that have to be explored. In this paper, we propose a novel approach to visualize correlations between input variables and a target output variable that scales to hundreds of variables. We developed a visual model based on neural networks that can be explored in a guided way to help analysts find and understand such correlations. First, we train a neural network to predict the target from the input variables. Then, we visualize the inner workings of the resulting model to help understand relations within the data set. We further introduce a new regularization term for the backpropagation algorithm that encourages the neural network to learn representations that are easier to interpret visually. We apply our method to artificial and real-world data sets to show its utility.

PlotThread: Creating Expressive Storyline Visualizations using Reinforcement Learning

Storyline visualizations are an effective means to present the evolution of plots and reveal the scenic interactions among characters. However, the design of storyline visualizations is a difficult task as users need to balance between aesthetic goals and narrative constraints. Despite that the optimization-based methods have been improved significantly in terms of producing aesthetic and legible layouts, the existing (semi-) automatic methods are still limited regarding 1) efficient exploration of the storyline design space and 2) flexible customization of storyline layouts. In this work, we propose a reinforcement learning framework to train an AI agent that assists users in exploring the design space efficiently and generating well-optimized storylines. Based on the framework, we introduce PlotThread, an authoring tool that integrates a set of flexible interactions to support easy customization of storyline visualizations. To seamlessly integrate the AI agent into the authoring process, we employ a mixed-initiative approach where both the agent and designers work on the same canvas to boost the collaborative design of storylines. We evaluate the reinforcement learning model through qualitative and quantitative experiments and demonstrate the usage of PlotThread using a collection of use cases.

Cyclic RGD and isoDGR Integrin Ligands Containing cis-2-amino-1-cyclopentanecarboxylic (cis-β-ACPC) Scaffolds

Integrin ligands containing the tripeptide sequences Arg-Gly-Asp (RGD) and iso-Asp-Gly- Arg (isoDGR) were actively investigated as inhibitors of tumor angiogenesis and directing unit in tumor-targeting drug conjugates. Reported herein is the synthesis, of two RGD and one isoDGR cyclic peptidomimetics containing (1S,2R) and (1R,2S) cis-2-amino-1-cyclopentanecarboxylic acid (cis-β-ACPC), using a mixed solid phase/solution phase synthetic protocol. The three ligands were examined in vitro in competitive binding assays to the purified α_vβ₃ and α₅β₁ receptors using biotinylated vitronectin (α_vβ₃) and fibronectin (α₅β₁) as natural displaced ligands. The IC50 values of the ligands ranged from nanomolar (the two RGD ligands) to micromolar (the isoDGR ligand) with a pronounced selectivity for α_vβ₃ over α₅β₁. In vitro cell adhesion assays were also performed using the human skin melanoma cell line WM115 (rich in integrin α_vβ₃). The two RGD ligands showed IC₅₀ values in the same micromolar range as the reference compound (cyclo[RGDfV]), while for the isoDGR derivative an IC₅₀ value could not be measured for the cell adhesion assay. A conformational analysis of the free RGD and isoDGR ligands by NMR (VT-NMR and NOESY experiments) and computational studies (MC/EM and MD), followed by docking simulations performed in the α_Vβ₃ integrin active site, provided a rationale for the behavior of these ligands toward the receptor.

Stereoselective Synthesis of Tropanes via a 6π-Electrocyclic Ring-Opening/ Huisgen [3+2]-Cycloaddition Cascade of Monocyclopropanated Heterocycles

The synthesis of tropanes via a microwave-assisted, stereoselective 6π-electrocyclic ring-opening/ Huisgen [3+2]-cycloaddition cascade of cyclopropanated pyrrole and furan derivatives with electron-deficient dipolarophiles is demonstrated. Starting from furans or pyrroles, 8-aza- and 8-oxabicyclo[3.2.1]octanes are accessible in two steps in dia- and enantioselective pure form, being versatile building blocks for the synthesis of pharmaceutically relevant targets, especially for new cocaine analogues bearing various substituents at the C-6/C-7 positions of the tropane ring system. Moreover, the 2-azabicyclo[2.2.2]octane core (isoquinuclidines), being prominently represented in many natural and pharmaceutical products, is accessible via this approach.

VeCHArt: Visually Enhanced Comparison of Historic Art Using an Automated Line-Based Synchronization Technique

The analysis of subtle deviations between different versions of historical prints has been a long-standing challenge in art history research. So far, this challenge has required extensive domain knowledge, fine-tuned expert perception, and time-consuming manual labor. In this paper we introduce an explorative visual approach to facilitate fast and accurate support for the task of comparing differences between prints such as engravings and woodcuts. To this end, we have developed a customized algorithm that detects similar stroke-patterns in prints and matches them in order to allow visual alignment and automated deviation highlighting. Our visual analytics system enables art history researchers to quickly detect, document, and categorize qualitative and quantitative discrepancies, and to analyze these discrepancies using comprehensive interactions. To evaluate our approach, we conducted a user study involving both experts on historical prints and laypeople. Using our new interactive technique, our subjects found about 20 percent more differences compared to regular image viewing software as well as "paper-based" comparison. Moreover, the laypeople found the same differences as the experts when they used our system, which was not the case for conventional methods. Informal feedback showed that both laypeople and experts strongly preferred employing our system to working with conventional methods.

On Evaluating Runtime Performance of Interactive Visualizations

As our field matures, evaluation of visualization techniques has extended from reporting runtime performance to studying user behavior. Consequently, many methodologies and best practices for user studies have evolved. While maintaining interactivity continues to be crucial for the exploration of large data sets, no similar methodological foundation for evaluating runtime performance has been developed. Our analysis of 50 recent visualization papers on new or improved techniques for rendering volumes or particles indicates that only a very limited set of parameters like different data sets, camera paths, viewport sizes, and GPUs are investigated, which make comparison with other techniques or generalization to other parameter ranges at least questionable. To derive a deeper understanding of qualitative runtime behavior and quantitative parameter dependencies, we developed a framework for the most exhaustive performance evaluation of volume and particle visualization techniques that we are aware of, including millions of measurements on ten different GPUs. This paper reports on our insights from statistical analysis of this data, discussing independent and linear parameter behavior and non-obvious effects. We give recommendations for best practices when evaluating runtime performance of scientific visualization applications, which can serve as a starting point for more elaborate models of performance quantification.

Visual Quality Guidance for Document Exploration with Focus+Context Techniques

Magic lens based focus+context techniques are powerful means for exploring document spatializations. Typically, they only offer additional summarized or abstracted views on focused documents. As a consequence, users might miss important information that is either not shown in aggregated form or that never happens to get focused. In this work, we present the design process and user study results for improving a magic lens based document exploration approach with exemplary visual quality cues to guide users in steering the exploration and support them in interpreting the summarization results. We contribute a thorough analysis of potential sources of information loss involved in these techniques, which include the visual spatialization of text documents, user-steered exploration, and the visual summarization. With lessons learned from previous research, we highlight the various ways those information losses could hamper the exploration. Furthermore, we formally define measures for the aforementioned different types of information losses and bias. Finally, we present the visual cues to depict these quality measures that are seamlessly integrated into the exploration approach. These visual cues guide users during the exploration and reduce the risk of misinterpretation and accelerate insight generation. We conclude with the results of a controlled user study and discuss the benefits and challenges of integrating quality guidance in exploration techniques.

Prioritization of stormwater management sites in urban areas

Multiple pressures as urbanization, densification and climate change lead to the need for adaptation of sewer systems within urban environments. To increase the adaptive capacity of stormwater management systems, there is a shift towards decentralized nature-based solutions (NBS). Especially in densely built areas the availability of land can be a limiting factor for the implementation of NBS. To consider the spatial framework conditions in planning we developed an integrated modelling framework for prioritizing sites for NBS implementation for stormwater management within built urban structures. The implementation potential of NBS from a settlement structure model and a street typology model are combined with the discharge reduction potential from a sewer model. In effectiveness matrices priorities for stormwater management sites for individual NBS are identified. This modelling framework offers a transparent and flexible approach to decision making for the implementation of NBS.

Prenatal cigarette smoke exposure slightly alters neurobehavioral development in neonatal rats: Implications for developmental origins of health and disease (DoHAD)

Numerous studies indicate that smoking during pregnancy exerts harmful effects on fetal brain development. The aim of this study was to determine the influence of maternal smoking during pregnancy on the early physical and neurobehavioral development of newborn rats. Wistar rats were subjected to whole-body smoke exposure for 2 × 40 min daily from the day of mating until day of delivery. For this treatment, a manual closed-chamber smoking system and 4 research cigarettes per occasion were used. After delivery the offspring were tested daily for somatic growth, maturation of facial characteristics and neurobehavioral development until three weeks of age. Motor coordination tests were performed at 3 and 4 weeks of age. We found that prenatal cigarette smoke exposure did not alter weight gain or motor coordination. Critical physical reflexes indicative of neurobehavioral development (eyelid reflex, ear unfolding) appeared significantly later in pups prenatally exposed to smoke as compared to the control group. Prenatal smoke exposure also resulted in a delayed appearance of reflexes indicating neural maturity, including hind limb grasping and forelimb placing reflexes. In conclusion, clinically relevant prenatal exposure to cigarette smoke results in slightly altered neurobehavioral development in rat pups. These findings suggest that chronic exposure of pregnant mothers to cigarette smoke (including passive smoking) results in persisting alterations in the developing brain, which may have long-lasting consequences supporting the concept of developmental origins of health and disease (DoHAD).

A methodical framework for analysing the cause of urban pluvial flooding in a hillside settlement

Pluvial flood risk is increasing in urban and rural areas due to changes in precipitation patterns and urbanization. Pluvial flooding is often associated with insufficient capacities of the sewer system or low surface drainage efficiency of urban areas. In hilly areas, hillside runoff additionally affects the risk of pluvial flooding. This article introduces a methodical approach and related evaluation criteria for a systematic analysis of potential causes of urban pluvial flooding. In the presented case study, the cause of pluvial flooding at two selected sites in a hillside settlement is investigated based on a coupled 1D/2D model of the whole hydrological catchment. The results show that even though bottlenecks in the sewer system are important, the effect of low surface drainage efficiency and hillside runoff greatly influence pluvial flooding. The knowledge of different causes of flooding can be further used for selecting and positioning appropriate adaption measures. The presented approach proved its practicability and can thus serve as a guidance and template for other applications to gain better understanding and knowledge of local specific pluvial flooding events.

Regio- and Stereoselective Synthesis of Functionalized Dihydropyridines, Pyridines, and 2H-Pyrans: Heck Coupling of Monocyclopropanated Heterocycles

A palladium-catalyzed coupling between aryl halides and monocyclopropanated pyrroles or furans has been developed, leading to valuable six-membered N- and O-heterocycles. As the key step, a selective cleavage of the non-activated endocyclic C-C bond of the 2-heterobicyclo-[3.1.0]hexane framework is achieved. The developed method offers access to highly functionalized piperidines, pyridines, and pyrans that are challenging to access by traditional methods.

Feature-Based Volumetric Terrain Generation and Decoration

Two-dimensional height fields are the most common data structure used for storing and rendering of terrain in offline rendering and especially real-time computer graphics. By its very nature, a height field cannot store terrain structures with multiple vertical layers such as overhanging cliffs, caves, or arches. This restriction does not apply to volumetric data structures. However, the workflow of manual modelling and editing of volumetric terrain usually is tedious and very time-consuming. Therefore, we propose to use three-dimensional curve-based primitives to efficiently model prominent, large-scale terrain features. We present a technique for volumetric generation of a complete terrain surface from the sparse input data by means of diffusion-based algorithms. By combining an efficient, feature-based toolset with a volumetric terrain representation, the modelling workflow is accelerated and simplified while retaining the full artistic freedom of volumetric terrains. Feature Curves also contain material information that can be complemented with local details by using per-face texture mapping. All stages of our method are GPU-accelerated using compute shaders to ensure interactive editing of terrain. Please note that this paper is an extended version of our previously published work [1] .

Exploration Strategies for Discovery of Interactivity in Visualizations

We investigate how people discover the functionality of an interactive visualization that was designed for the general public. While interactive visualizations are increasingly available for public use, we still know little about how the general public discovers what they can do with these visualizations and what interactions are available. Developing a better understanding of this discovery process can help inform the design of visualizations for the general public, which in turn can help make data more accessible. To unpack this problem, we conducted a lab study in which participants were free to use their own methods to discover the functionality of a connected set of interactive visualizations of public energy data. We collected eye movement data and interaction logs as well as video and audio recordings. By analyzing this combined data, we extract exploration strategies that the participants employed to discover the functionality in these interactive visualizations. These exploration strategies illuminate possible design directions for improving the discoverability of a visualization's functionality.

Nitrous oxide emissions of a mesh separated single stage deammonification reactor

It is widely accepted that partial nitrification by ANAMMOX has the potential to become one of the key processes in wastewater treatment. However, large greenhouse gas emissions have been panobserved in many cases. A novel mesh separated reactor, developed to allow continuous operation of deammonification at smaller scale without external biomass selection, was compared to a conventional single-chamber deammonification sequencing batch reactor (SBR), where both were equally-sized pilot-scale reactors. The mesh reactor consisted of an aerated and an anoxic zone separated by a mesh. The resulting differences in the structure of the microbial community were detected by next-generation sequencing. When both systems were operated in a sequencing batch mode, both systems had comparable nitrous oxide emission factors in the range of 4% to 5% of the influent nitrogen load. A significant decrease was observed after switching from sequencing batch mode to continuous operation.

Visualization of Bubble Formation in Porous Media

We present a visualization approach for the analysis of CO2 bubble-induced attenuation in porous rock formations. As a basis for this, we introduce customized techniques to extract CO2 bubbles and their surrounding porous structure from X-ray computed tomography data (XCT) measurements. To understand how the structure of porous media influences the occurrence and the shape of formed bubbles, we automatically classify and relate them in terms of morphology and geometric features, and further directly support searching for promising porous structures. To allow for the meaningful direct visual comparison of bubbles and their structures, we propose a customized registration technique considering the bubble shape as well as its points of contact with the porous media surface. With our quantitative extraction of geometric bubble features, we further support the analysis as well as the creation of a physical model. We demonstrate that our approach was successfully used to answer several research questions in the domain, and discuss its high practical relevance to identify critical seismic characteristics of fluid-saturated rock that govern its capability to store CO2.

Enabling Detailed, Biophysics-Based Skeletal Muscle Models on HPC Systems

Realistic simulations of detailed, biophysics-based, multi-scale models often require very high resolution and, thus, large-scale compute facilities. Existing simulation environments, especially for biomedical applications, are typically designed to allow for high flexibility and generality in model development. Flexibility and model development, however, are often a limiting factor for large-scale simulations. Therefore, new models are typically tested and run on small-scale compute facilities. By using a detailed biophysics-based, chemo-electromechanical skeletal muscle model and the international open-source software library OpenCMISS as an example, we present an approach to upgrade an existing muscle simulation framework from a moderately parallel version toward a massively parallel one that scales both in terms of problem size and in terms of the number of parallel processes. For this purpose, we investigate different modeling, algorithmic and implementational aspects. We present improvements addressing both numerical and parallel scalability. In addition, our approach includes a novel visualization environment which is based on the MegaMol framework and is capable of handling large amounts of simulated data. We present the results of a number of scaling studies at the Tier-1 supercomputer HazelHen at the High Performance Computing Center Stuttgart (HLRS). We improve the overall runtime by a factor of up to 2.6 and achieve good scalability on up to 768 cores.

Interactive Molecular Graphics for Augmented Reality Using HoloLens

Immersive technologies like stereo rendering, virtual reality, or augmented reality (AR) are often used in the field of molecular visualisation. Modern, comparably lightweight and affordable AR headsets like Microsoft’s HoloLens open up new possibilities for immersive analytics in molecular visualisation. A crucial factor for a comprehensive analysis of molecular data in AR is the rendering speed. HoloLens, however, has limited hardware capabilities due to requirements like battery life, fanless cooling and weight. Consequently, insights from best practises for powerful desktop hardware may not be transferable. Therefore, we evaluate the capabilities of the HoloLens hardware for modern, GPU-enabled, high-quality rendering methods for the space-filling model commonly used in molecular visualisation. We also assess the scalability for large molecular data sets. Based on the results, we discuss ideas and possibilities for immersive molecular analytics. Besides more obvious benefits like the stereoscopic rendering offered by the device, this specifically includes natural user interfaces that use physical navigation instead of the traditional virtual one. Furthermore, we consider different scenarios for such an immersive system, ranging from educational use to collaborative scenarios.

Visual Interactive Map Matching

Map matching is the process of assigning observed geographic positions of vehicles and their trajectories to the actual road links in a road network. In this paper, we present Visual Interactive Map Matching, a visual analytics approach to fine-tune the data preprocessing and matching process. It is based on ST-matching, a state-of-the-art and easy-to-understand map matching algorithm. Parameters of the preprocessing step and algorithm can be optimized with immediate visual feedback. Visualizations show current matching issues and performance metrics on a map and in diagrams. Manual and computer-supported editing of the road network model leads to a refined alignment of trajectories and roads. We demonstrate our approach with large-scale taxi trajectory data. We show that optimizing the matching on a subsample results in considerably improved matching quality, also when later scaled to the full dataset. An optimized matching ensures data faithfulness and prevents misinterpretation when the matched data might be investigated in follow-up analysis.

Visual Analysis of Inclusion Dynamics in Two-Phase Flow

In single-phase flow visualization, research focuses on the analysis of vector field properties. In two-phase flow, in contrast, analysis of the phase components is typically of major interest. So far, visualization research of two-phase flow concentrated on proper interface reconstruction and the analysis thereof. In this paper, we present a novel visualization technique that enables the investigation of complex two-phase flow phenomena with respect to the physics of breakup and coalescence of inclusions. On the one hand, we adapt dimensionless quantities for a localized analysis of phase instability and breakup, and provide detailed inspection of breakup dynamics with emphasis on oscillation and its interplay with rotational motion. On the other hand, we present a parametric tightly linked space-time visualization approach for an effective interactive representation of the overall dynamics. We demonstrate the utility of our approach using several two-phase CFD datasets.

Molecular Surface Maps

We present Molecular Surface Maps, a novel, view-independent, and concise representation for molecular surfaces. It transfers the well-known world map metaphor to molecular visualization. Our application maps the complex molecular surface to a simple 2D representation through a spherical intermediate, the Molecular Surface Globe. The Molecular Surface Map concisely shows arbitrary attributes of the original molecular surface, such as biochemical properties or geometrical features. This results in an intuitive overview, which allows researchers to assess all molecular surface attributes at a glance. Our representation can be used as a visual summarization of a molecule's interface with its environment. In particular, Molecular Surface Maps simplify the analysis and comparison of different data sets or points in time. Furthermore, the map representation can be used in a Space-time Cube to analyze time-dependent data from molecular simulations without the need for animation. We show the feasibility of Molecular Surface Maps for different typical analysis tasks of biomolecular data.

Progressive Direct Volume-to-Volume Transformation

We present a novel technique to generate transformations between arbitrary volumes, providing both expressive distances and smooth interpolates. In contrast to conventional morphing or warping approaches, our technique requires no user guidance, intermediate representations (like extracted features), or blending, and imposes no restrictions regarding shape or structure. Our technique operates directly on the volumetric data representation, and while linear programming approaches could solve the underlying problem optimally, their polynomial complexity makes them infeasible for high-resolution volumes. We therefore propose a progressive refinement approach designed for parallel execution that is able to quickly deliver approximate results that are iteratively improved toward the optimum. On this basis, we further present a new approach for the streaming selection of time steps in temporal data that allows for the reconstruction of the full sequence with a user-specified error bound. We finally demonstrate the utility of our technique for different applications, compare our approach against alternatives, and evaluate its characteristics with a variety of different data sets.

Lost in calibration: why people still do not calibrate their models, and why they still should - a case study from urban drainage modelling

From a scientific point of view, it is unquestioned that numerical models for technical systems need to be calibrated. However, in sufficiently calibrated models are still used in engineering practice. Case studies in the scientific literature that deal with urban water management are mostly large cities, while little attention is paid to the differing boundary conditions of smaller municipalities. Consequently, the aim of this paper is to discuss the calibration of a hydrodynamic model of a small municipality (15,000 inhabitants). To represent the spatial distribution of precipitation, three distributed rain gauges were used for model calibration. To show the uncertainties imminent to the calibration process, 17 scenarios, differing in assumptions for calibration, were distinguished. To compare the impact of the different calibration scenarios on actual design values, design rainfall events were applied. The comparison of the model results using the different typical design storm events from all the surrounding data points showed substantial differences for the assessment of the sewers regarding urban flooding, emphasizing the necessity of uncertainty analysis for hydrodynamic models. Furthermore, model calibration is of the utmost importance, because uncalibrated models tend to overestimate flooding volume and therefore result in larger diameters and retention volumes.

Can Twitter Save Lives? A Broad-Scale Study on Visual Social Media Analytics for Public Safety

The use of social media monitoring for public safety is on the brink of commercialization and practical adoption. To close the gap between research and application, this paper presents results of a two-phase study on visual analytics of social media for public safety. For the first phase, we conducted a large field study, in which 29 practitioners from disaster response and critical infrastructure management were asked to investigate crisis intelligence tasks based on Twitter data recorded during the 2013 German Flood. To this end, the ScatterBlogs visual analytics system, a platform that provides reference implementations of tools and techniques popular in research, was given to them as an integrated toolbox. We reviewed the domain experts' individual performances with the system as well as their comments about the usefulness of techniques. In the second phase, we built on this feedback about ScatterBlogs in order to sketch out a system and create additional tools specifically adapted to the collected requirements. The performance of the old lab prototype is finally compared against the re-design in a controlled user study.

Gaze Stripes: Image-Based Visualization of Eye Tracking Data

We present a new visualization approach for displaying eye tracking data from multiple participants. We aim to show the spatio-temporal data of the gaze points in the context of the underlying image or video stimulus without occlusion. Our technique, denoted as gaze stripes, does not require the explicit definition of areas of interest but directly uses the image data around the gaze points, similar to thumbnails for images. A gaze stripe consists of a sequence of such gaze point images, oriented along a horizontal timeline. By displaying multiple aligned gaze stripes, it is possible to analyze and compare the viewing behavior of the participants over time. Since the analysis is carried out directly on the image data, expensive post-processing or manual annotation are not required. Therefore, not only patterns and outliers in the participants' scanpaths can be detected, but the context of the stimulus is available as well. Furthermore, our approach is especially well suited for dynamic stimuli due to the non-aggregated temporal mapping. Complementary views, i.e., markers, notes, screenshots, histograms, and results from automatic clustering, can be added to the visualization to display analysis results. We illustrate the usefulness of our technique on static and dynamic stimuli. Furthermore, we discuss the limitations and scalability of our approach in comparison to established visualization techniques.

VA²: A Visual Analytics Approach for // Evaluating Visual Analytics Applications

Evaluation has become a fundamental part of visualization research and researchers have employed many approaches from the field of human-computer interaction like measures of task performance, thinking aloud protocols, and analysis of interaction logs. Recently, eye tracking has also become popular to analyze visual strategies of users in this context. This has added another modality and more data, which requires special visualization techniques to analyze this data. However, only few approaches exist that aim at an integrated analysis of multiple concurrent evaluation procedures. The variety, complexity, and sheer amount of such coupled multi-source data streams require a visual analytics approach. Our approach provides a highly interactive visualization environment to display and analyze thinking aloud, interaction, and eye movement data in close relation. Automatic pattern finding algorithms allow an efficient exploratory search and support the reasoning process to derive common eye-interaction-thinking patterns between participants. In addition, our tool equips researchers with mechanisms for searching and verifying expected usage patterns. We apply our approach to a user study involving a visual analytics application and we discuss insights gained from this joint analysis. We anticipate our approach to be applicable to other combinations of evaluation techniques and a broad class of visualization applications.

CiteRivers: Visual Analytics of Citation Patterns

The exploration and analysis of scientific literature collections is an important task for effective knowledge management. Past interest in such document sets has spurred the development of numerous visualization approaches for their interactive analysis. They either focus on the textual content of publications, or on document metadata including authors and citations. Previously presented approaches for citation analysis aim primarily at the visualization of the structure of citation networks and their exploration. We extend the state-of-the-art by presenting an approach for the interactive visual analysis of the contents of scientific documents, and combine it with a new and flexible technique to analyze their citations. This technique facilitates user-steered aggregation of citations which are linked to the content of the citing publications using a highly interactive visualization approach. Through enriching the approach with additional interactive views of other important aspects of the data, we support the exploration of the dataset over time and enable users to analyze citation patterns, spot trends, and track long-term developments. We demonstrate the strengths of our approach through a use case and discuss it based on expert user feedback.

Semantic Enrichment of Movement Behavior with Foursquare--A Visual Analytics Approach

In recent years, many approaches have been developed that efficiently and effectively visualize movement data, e.g., by providing suitable aggregation strategies to reduce visual clutter. Analysts can use them to identify distinct movement patterns, such as trajectories with similar direction, form, length, and speed. However, less effort has been spent on finding the semantics behind movements, i.e. why somebody or something is moving. This can be of great value for different applications, such as product usage and consumer analysis, to better understand urban dynamics, and to improve situational awareness. Unfortunately, semantic information often gets lost when data is recorded. Thus, we suggest to enrich trajectory data with POI information using social media services and show how semantic insights can be gained. Furthermore, we show how to handle semantic uncertainties in time and space, which result from noisy, unprecise, and missing data, by introducing a POI decision model in combination with highly interactive visualizations. Finally, we evaluate our approach with two case studies on a large electric scooter data set and test our model on data with known ground truth.