A framework for multi-scale modelling

Multiscale co-simulation design pattern for neuroscience applications

Integration of information across heterogeneous sources creates added scientific value. Interoperability of data, tools and models is, however, difficult to accomplish across spatial and temporal scales. Here we introduce the toolbox Parallel Co-Simulation, which enables the interoperation of simulators operating at different scales. We provide a software science co-design pattern and illustrate its functioning along a neuroscience example, in which individual regions of interest are simulated on the cellular level allowing us to study detailed mechanisms, while the remaining network is efficiently simulated on the population level. A workflow is illustrated for the use case of The Virtual Brain and NEST, in which the CA1 region of the cellular-level hippocampus of the mouse is embedded into a full brain network involving micro and macro electrode recordings. This new tool allows integrating knowledge across scales in the same simulation framework and validating them against multiscale experiments, thereby largely widening the explanatory power of computational models.

Synergistic Integration Between Machine Learning and Agent-Based Modeling: A Multidisciplinary Review

Agent-based modeling (ABM) involves developing models in which agents make adaptive decisions in a changing environment. Machine-learning (ML) based inference models can improve sequential decision-making by learning agents' behavioral patterns. With the aid of ML, this emerging area can extend traditional agent-based schemes that hardcode agents' behavioral rules into an adaptive model. Even though there are plenty of studies that apply ML in ABMs, the generalized applicable scenarios, frameworks, and procedures for implementations are not well addressed. In this article, we provide a comprehensive review of applying ML in ABM based on four major scenarios, i.e., microagent-level situational awareness learning, microagent-level behavior intervention, macro-ABM-level emulator, and sequential decision-making. For these four scenarios, the related algorithms, frameworks, procedures of implementations, and multidisciplinary applications are thoroughly investigated. We also discuss how ML can improve prediction in ABMs by trading off the variance and bias and how ML can improve the sequential decision-making of microagent and macrolevel policymakers via a mechanism of reinforced behavioral intervention. At the end of this article, future perspectives of applying ML in ABMs are discussed with respect to data acquisition and quality issues, the possible solution of solving the convergence problem of reinforcement learning, interpretable ML applications, and bounded rationality of ABM.

Towards validated multiscale simulations for fusion

Harnessing energy produced by thermonuclear fusion reactions has the potential to provide a clean and inexpensive source of energy to Earth. However, throughout the past seven decades, physicists learned that creating our very own fusion energy source is very difficult to achieve. We constructed a component-based, multiscale fusion workflow to model fusion plasma inside the core of a tokamak device. To ensure the simulation results agree with experimental values, the model needs to undergo the process of verification, validation and uncertainty quantification (VVUQ). This paper will go over the VVUQ work carried out in the multiscale fusion workflow (MFW), with the help of the EasyVVUQ software library developed by the VECMA project. In particular, similarity of distributions from simulation and experiment is explored as a validation metric. Such initial validation measures provide insights into the accuracy of the simulation results. This article is part of the theme issue 'Reliability and reproducibility in computational science: implementing verification, validation and uncertainty quantification in silico'.

VECMAtk: a scalable verification, validation and uncertainty quantification toolkit for scientific simulations

We present the VECMA toolkit (VECMAtk), a flexible software environment for single and multiscale simulations that introduces directly applicable and reusable procedures for verification, validation (V&V), sensitivity analysis (SA) and uncertainty quantication (UQ). It enables users to verify key aspects of their applications, systematically compare and validate the simulation outputs against observational or benchmark data, and run simulations conveniently on any platform from the desktop to current multi-petascale computers. In this sequel to our paper on VECMAtk which we presented last year [1] we focus on a range of functional and performance improvements that we have introduced, cover newly introduced components, and applications examples from seven different domains such as conflict modelling and environmental sciences. We also present several implemented patterns for UQ/SA and V&V, and guide the reader through one example concerning COVID-19 modelling in detail. This article is part of the theme issue 'Reliability and reproducibility in computational science: implementing verification, validation and uncertainty quantification in silico'.

Digital blood in massively parallel CPU/GPU systems for the study of platelet transport

We propose a highly versatile computational framework for the simulation of cellular blood flow focusing on extreme performance without compromising accuracy or complexity. The tool couples the lattice Boltzmann solver Palabos for the simulation of blood plasma, a novel finite-element method (FEM) solver for the resolution of deformable blood cells, and an immersed boundary method for the coupling of the two phases. The design of the tool supports hybrid CPU-GPU executions (fluid, fluid-solid interaction on CPUs, deformable bodies on GPUs), and is non-intrusive, as each of the three components can be replaced in a modular way. The FEM-based kernel for solid dynamics outperforms other FEM solvers and its performance is comparable to state-of-the-art mass-spring systems. We perform an exhaustive performance analysis on Piz Daint at the Swiss National Supercomputing Centre and provide case studies focused on platelet transport, implicitly validating the accuracy of our tool. The tests show that this versatile framework combines unprecedented accuracy with massive performance, rendering it suitable for upcoming exascale architectures.

Community effort endorsing multiscale modelling, multiscale data science and multiscale computing for systems medicine

Systems medicine holds many promises, but has so far provided only a limited number of proofs of principle. To address this road block, possible barriers and challenges of translating systems medicine into clinical practice need to be identified and addressed. The members of the European Cooperation in Science and Technology (COST) Action CA15120 Open Multiscale Systems Medicine (OpenMultiMed) wish to engage the scientific community of systems medicine and multiscale modelling, data science and computing, to provide their feedback in a structured manner. This will result in follow-up white papers and open access resources to accelerate the clinical translation of systems medicine.

Easing Multiscale Model Design and Coupling with MUSCLE 3

Multiscale modelling and simulation typically entails coupling multiple simulation codes into a single program. Doing this in an ad-hoc fashion tends to result in a tightly coupled, difficult-to-change computer program. This makes it difficult to experiment with different submodels, or to implement advanced techniques such as surrogate modelling. Furthermore, building the coupling itself is time-consuming. The MUltiScale Coupling Library and Environment version 3 (MUSCLE 3) aims to alleviate these problems. It allows the coupling to be specified in a simple configuration file, which specifies the components of the simulation and how they should be connected together. At runtime a simulation manager takes care of coordination of submodels, while data is exchanged over the network in a peer-to-peer fashion via the MUSCLE library. Submodels need to be linked to this library, but this is minimally invasive and restructuring simulation codes is usually not needed. Once operational, the model may be rewired or augmented by changing the configuration, without further changes to the submodels. MUSCLE 3 is developed openly on GitHub, and is available as Open Source software under the Apache 2.0 license.

Establishment of a Numerical Model to Design an Electro-Stimulating System for a Porcine Mandibular Critical Size Defect

Electrical stimulation is a promising therapeutic approach for the regeneration of large bone defects. Innovative electrically stimulating implants for critical size defects in the lower jaw are under development and need to be optimized in silico and tested in vivo prior to application. In this context, numerical modelling and simulation are useful tools in the design process. In this study, a numerical model of an electrically stimulated minipig mandible was established to find optimal stimulation parameters that allow for a maximum area of beneficially stimulated tissue. Finite-element simulations were performed to determine the stimulation impact of the proposed implant design and to optimize the electric field distribution resulting from sinusoidal low-frequency ( f = 20 Hz ) electric stimulation. Optimal stimulation parameters of the electrode length h el = 25 m m and the stimulation potential φ stim = 0.5 V were determined. These parameter sets shall be applied in future in vivo validation studies. Furthermore, our results suggest that changing tissue properties during the course of the healing process might make a feedback-controlled stimulation system necessary.

Multiscale modelling, simulation and computing: from the desktop to the exascale

This short contribution introduces a theme issue dedicated to 'Multiscale modelling, simulation and computing: from the desktop to the exascale'. It holds a collection of articles presenting cutting-edge research in generic multiscale modelling and multiscale computing, and applications thereof on high-performance computing systems. The special issue starts with a position paper to discuss the paradigm of multiscale computing in the face of the emerging exascale, followed by a review and critical assessment of existing multiscale computing environments. This theme issue provides a state-of-the-art account of generic multiscale computing, as well as exciting examples of applications of such concepts in domains ranging from astrophysics, via material science and fusion, to biomedical sciences. This article is part of the theme issue 'Multiscale modelling, simulation and computing: from the desktop to the exascale'.

Semi-intrusive multiscale metamodelling uncertainty quantification with application to a model of in-stent restenosis

We explore the efficiency of a semi-intrusive uncertainty quantification (UQ) method for multiscale models as proposed by us in an earlier publication. We applied the multiscale metamodelling UQ method to a two-dimensional multiscale model for the wound healing response in a coronary artery after stenting (in-stent restenosis). The results obtained by the semi-intrusive method show a good match to those obtained by a black-box quasi-Monte Carlo method. Moreover, we significantly reduce the computational cost of the UQ. We conclude that the semi-intrusive metamodelling method is reliable and efficient, and can be applied to such complex models as the in-stent restenosis ISR2D model. This article is part of the theme issue 'Multiscale modelling, simulation and computing: from the desktop to the exascale'.

Multiscale computing for science and engineering in the era of exascale performance

In this position paper, we discuss two relevant topics: (i) generic multiscale computing on emerging exascale high-performing computing environments, and (ii) the scaling of such applications towards the exascale. We will introduce the different phases when developing a multiscale model and simulating it on available computing infrastructure, and argue that we could rely on it both on the conceptual modelling level and also when actually executing the multiscale simulation, and maybe should further develop generic frameworks and software tools to facilitate multiscale computing. Next, we focus on simulating multiscale models on high-end computing resources in the face of emerging exascale performance levels. We will argue that although applications could scale to exascale performance relying on weak scaling and maybe even on strong scaling, there are also clear arguments that such scaling may no longer apply for many applications on these emerging exascale machines and that we need to resort to what we would call multi-scaling. This article is part of the theme issue 'Multiscale modelling, simulation and computing: from the desktop to the exascale'.

Application of the extreme scaling computing pattern on multiscale fusion plasma modelling

The extreme scaling pattern of the ComPat project is applied to a multi-scale workflow relevant to the magnetically confined fusion problem. This workflow combines transport, turbulence and equilibrium codes (together with additional auxiliaries such as initial conditions and numerical module), which aims at calculating the behaviour of a fusion plasma on long (transport) time scales based on information from much faster (turbulence) time scales. Initial findings of profile measurements are reported in this paper and indicate that, depending on the chosen performance metric for defining 'cost', such as time to completion, efficiency and total energy consumption of the mutliscale workflow, different choices on the number of cores would be made when determining the optimal execution configuration. A variant of the workflow which increases the inherent parallelism is presented, and shown to produce equivalent results at (typically) lower cost compared with the original workflow. This article is part of the theme issue 'Multiscale modelling, simulation and computing: from the desktop to the exascale'.

Cell studio: A platform for interactive, 3D graphical simulation of immunological processes

The field of computer modeling and simulation of biological systems is rapidly advancing, backed by significant progress in the fields of experimentation techniques, computer hardware, and programming software. The result of a simulation may be delivered in several ways, from numerical results, through graphs of the simulated run, to a visualization of the simulation. The vision of an in-silico experiment mimicking an in-vitro or in-vivo experiment as it is viewed under a microscope is appealing but technically demanding and computationally intensive. Here, we report “Cell Studio,” a generic, hybrid platform to simulate an immune microenvironment with biological and biophysical rules. We use game engines—generic programs for game creation which offer ready-made assets and tools—to create a visualized, interactive 3D simulation. We also utilize a scalable architecture that delegates the computational load to a server. The user may view the simulation, move the “camera” around, stop, fast-forward, and rewind it and inject soluble molecules into the extracellular medium at any point in time. During simulation, graphs are created in real time for a broad view of system-wide processes. The model is parametrized using a user-friendly Graphical User Interface (GUI). We show a simple validation simulation and compare its results with those from a “classical” simulation, validated against a “wet” experiment. We believe that interactive, real-time 3D visualization may aid in generating insights from the model and encourage intuition about the immunological scenario.

Developing a Policy Flight Simulator to Facilitate the Adoption of an Evidence-Based Intervention

While the use of evidence-based interventions (EBIs) has been advocated by the medical research community for quite some time, uptake of these interventions by healthcare providers has been slow. One possible explanation is that it is challenging for providers to estimate impacts of a specific EBI on their particular organization. To address that concern, we developed and evaluated a type of simulation called a policy flight simulator to determine if it could improve the adoption decision about a specific EBI, the transitional care model (TCM). The TCM uses an advanced practice nurse-led model of care to transition older adults with multiple chronic conditions from a hospitalization to home. An evaluation by a National Advisory Committee, made up of senior representatives from various stakeholders in the U.S. healthcare system, found the policy flight simulator to be a useful tool that has the potential to better inform adoption decisions. This paper describes the simulation development effort and documents lessons learned that may be useful to the healthcare modeling community and those interested in using simulation to support decisions based on EBIs.

A Comparison of Fully-Coupled 3D In-Stent Restenosis Simulations to In-vivo Data

We describe our fully-coupled 3D multiscale model of in-stent restenosis, with blood flow simulations coupled to smooth muscle cell proliferation, and report results of numerical simulations performed with this model. This novel model is based on several previously reported 2D models. We study the effects of various parameters on the process of restenosis and compare with in vivo porcine data where we observe good qualitative agreement. We study the effects of stent deployment depth (and related injury score), reendothelization speed, and simulate the effect of stent width. Also we demonstrate that we are now capable to simulate restenosis in real-sized (18 mm long, 2.8 mm wide) vessel geometries.

Towards the virtual artery: a multiscale model for vascular physiology at the physics-chemistry-biology interface

This discussion paper introduces the concept of the Virtual Artery as a multiscale model for arterial physiology and pathologies at the physics-chemistry-biology (PCB) interface. The cellular level is identified as the mesoscopic level, and we argue that by coupling cell-based models with other relevant models on the macro- and microscale, a versatile model of arterial health and disease can be composed. We review the necessary ingredients, both models of arteries at many different scales, as well as generic methods to compose multiscale models. Next, we discuss how this can be combined into the virtual artery. Finally, we argue that the concept of models at the PCB interface could or perhaps should become a powerful paradigm, not only as in our case for studying physiology, but also for many other systems that have such PCB interfaces.This article is part of the themed issue 'Multiscale modelling at the physics-chemistry-biology interface'.

Anatomy and Physiology of Multiscale Modeling and Simulation in Systems Medicine

Systems medicine is the application of systems biology concepts, methods, and tools to medical research and practice. It aims to integrate data and knowledge from different disciplines into biomedical models and simulations for the understanding, prevention, cure, and management of complex diseases. Complex diseases arise from the interactions among disease-influencing factors across multiple levels of biological organization from the environment to molecules. To tackle the enormous challenges posed by complex diseases, we need a modeling and simulation framework capable of capturing and integrating information originating from multiple spatiotemporal and organizational scales. Multiscale modeling and simulation in systems medicine is an emerging methodology and discipline that has already demonstrated its potential in becoming this framework. The aim of this chapter is to present some of the main concepts, requirements, and challenges of multiscale modeling and simulation in systems medicine.

Advancing a distributed multi-scale computing framework for large-scale high-throughput discovery in materials science

We describe the development of a large-scale high-throughput application for discovery in materials science. Our point of departure is a computational framework for distributed multi-scale computation. We augment the original framework with a specialized module whose role is to route evaluation requests needed by the high-throughput application to a collection of available computational resources. We evaluate the feasibility and performance of the resulting high-throughput computational framework by carrying out a high-throughput study of battery solvents. Our results indicate that distributed multi-scale computing, by virtue of its adaptive nature, is particularly well-suited for building high-throughput applications.

Multiscale modelling in immunology: a review

One of the greatest challenges in biomedicine is to get a unified view of observations made from the molecular up to the organism scale. Towards this goal, multiscale models have been highly instrumental in contexts such as the cardiovascular field, angiogenesis, neurosciences and tumour biology. More recently, such models are becoming an increasingly important resource to address immunological questions as well. Systematic mining of the literature in multiscale modelling led us to identify three main fields of immunological applications: host-virus interactions, inflammatory diseases and their treatment and development of multiscale simulation platforms for immunological research and for educational purposes. Here, we review the current developments in these directions, which illustrate that multiscale models can consistently integrate immunological data generated at several scales, and can be used to describe and optimize therapeutic treatments of complex immune diseases.

Multiscale modelling and simulation: a position paper

We argue that, despite the fact that the field of multiscale modelling and simulation has enjoyed significant success within the past decade, it still holds many open questions that are deemed important but so far have barely been explored. We believe that this is at least in part due to the fact that the field has been mainly developed within disciplinary silos. The principal topics that in our view would benefit from a targeted multidisciplinary research effort are related to reaching consensus as to what exactly one means by ‘multiscale modelling’, formulating a generic theory or calculus of multiscale modelling, applying such concepts to the urgent question of validation and verification of multiscale models, and the issue of numerical error propagation in multiscale models. Moreover, we believe that this would, in principle, also lay the foundation for more efficient, well-defined and usable multiscale computing environments. We believe that multidisciplinary research to fill in the gaps is timely, highly relevant, and with substantial potential impact on many scientific disciplines.

Performance of distributed multiscale simulations

Multiscale simulations model phenomena across natural scales using monolithic or component-based code, running on local or distributed resources. In this work, we investigate the performance of distributed multiscale computing of component-based models, guided by six multiscale applications with different characteristics and from several disciplines. Three modes of distributed multiscale computing are identified: supplementing local dependencies with large-scale resources, load distribution over multiple resources, and load balancing of small- and large-scale resources. We find that the first mode has the apparent benefit of increasing simulation speed, and the second mode can increase simulation speed if local resources are limited. Depending on resource reservation and model coupling topology, the third mode may result in a reduction of resource consumption.