Applying a Computational Model Credibility Framework to Physiological Closed-loop Controlled Medical Device Testing

Physiological Modeling of Hemodynamic Responses to Sodium Nitroprusside

BACKGROUND

Computational modeling of physiology has become a routine element in the development, evaluation, and safety testing of many types of medical devices. Members of the Food and Drug Administration have recently published a manuscript detailing the development, validation, and sensitivity testing of a computational model for blood volume, cardiac stroke volume, and blood pressure, noting that such a model might be useful in the development of closed-loop fluid administration systems. In the present study, we have expanded on this model to include the pharmacologic effect of sodium nitroprusside and calibrated the model against our previous experimental animal model data.

METHODS

Beginning with the model elements in the original publication, we added six new parameters to control the effect of sodium nitroprusside: two for the onset time and clearance rates, two for the stroke volume effect (which includes venodilation as a "hidden" element), and two for the direct effect on arterial blood pressure. Using this new model, we then calibrated the predictive performance against previously collected animal study data using nitroprusside infusions to simulate shock with the primary emphasis on MAP. Root-mean-squared error (RMSE) was calculated, and the performance was compared to the performance of the model in the original study.

RESULTS

RMSE of model-predicted MAP to actual MAP was lower than that reported in the original model, but higher for SV and CO. The individually fit models showed lower RMSE than using the population average values for parameters, suggesting the fitting process was effective in identifying improved parameters. Use of partially fit models after removal of the lowest variance population parameters showed a very minor decrement in improvement over the fully fit models.

CONCLUSION

The new model added the clinical effects of SNP and was successfully calibrated against experimental data with an RMSE of <10% for mean arterial pressure. Model-predicted MAP showed an error similar to that seen in the original base model when using fluid shifts, heart rate, and drug dose as model inputs.

Credibility Evidence for Computational Patient Models Used in the Development of Physiological Closed-Loop Controlled Devices for Critical Care Medicine

Physiological closed-loop controlled medical devices automatically adjust therapy delivered to a patient to adjust a measured physiological variable. In critical care scenarios, these types of devices could automate, for example, fluid resuscitation, drug delivery, mechanical ventilation, and/or anesthesia and sedation. Evidence from simulations using computational models of physiological systems can play a crucial role in the development of physiological closed-loop controlled devices; but the utility of this evidence will depend on the credibility of the computational model used. Computational models of physiological systems can be complex with numerous non-linearities, time-varying properties, and unknown parameters, which leads to challenges in model assessment. Given the wide range of potential uses of computational patient models in the design and evaluation of physiological closed-loop controlled systems, and the varying risks associated with the diverse uses, the specific model as well as the necessary evidence to make a model credible for a use case may vary. In this review, we examine the various uses of computational patient models in the design and evaluation of critical care physiological closed-loop controlled systems (e.g., hemodynamic stability, mechanical ventilation, anesthetic delivery) as well as the types of evidence (e.g., verification, validation, and uncertainty quantification activities) presented to support the model for that use. We then examine and discuss how a credibility assessment framework (American Society of Mechanical Engineers Verification and Validation Subcommittee, V&V 40 Verification and Validation in Computational Modeling of Medical Devices) for medical devices can be applied to computational patient models used to test physiological closed-loop controlled systems.