1
|
Tivay A, Bighamian R, Hahn JO, Scully CG. A GENERATIVE APPROACH TO TESTING THE PERFORMANCE OF PHYSIOLOGICAL CONTROL ALGORITHMS. ASME LETTERS IN DYNAMIC SYSTEMS AND CONTROL 2024; 4:031007. [PMID: 39262842 PMCID: PMC11385743 DOI: 10.1115/1.4065934] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/13/2024]
Abstract
Background Physiological closed-loop control algorithms play an important role in the development of autonomous medical care systems, a promising area of research that has the potential to deliver healthcare therapies meeting each patient's specific needs. Computational approaches can support the evaluation of physiological closed-loop control algorithms considering various sources of patient variability that they may be presented with. Method of Approach In this paper, we present a generative approach to testing the performance of physiological closed-loop control algorithms. This approach exploits a generative physiological model (which consists of stochastic and dynamic components that represent diverse physiological behaviors across a patient population) to generate a select group of virtual subjects. By testing a physiological closed-loop control algorithm against this select group, the approach estimates the distribution of relevant performance metrics in the represented population. We illustrate the promise of this approach by applying it to a practical case study on testing a closed-loop fluid resuscitation control algorithm designed for hemodynamic management. Results In this context, we show that the proposed approach can test the algorithm against virtual subjects equipped with a wide range of plausible physiological characteristics and behavior, and that the test results can be used to estimate the distribution of relevant performance metrics in the represented population. Conclusions In sum, the generative testing approach may offer a practical, efficient solution for conducting pre-clinical tests on physiological closed-loop control algorithms.
Collapse
Affiliation(s)
- Ali Tivay
- Mechanical Engineering, University of Maryland, College Park, MD 20742, USA
| | - Ramin Bighamian
- Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD 20903 USA
| | - Jin-Oh Hahn
- Mechanical Engineering, University of Maryland, College Park, MD 20742, USA
| | - Christopher G Scully
- Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD 20903 USA
| |
Collapse
|
2
|
Pathmanathan P, Aycock K, Badal A, Bighamian R, Bodner J, Craven BA, Niederer S. Credibility assessment of in silico clinical trials for medical devices. PLoS Comput Biol 2024; 20:e1012289. [PMID: 39116026 PMCID: PMC11309390 DOI: 10.1371/journal.pcbi.1012289] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Accepted: 07/01/2024] [Indexed: 08/10/2024] Open
Abstract
In silico clinical trials (ISCTs) are an emerging method in modeling and simulation where medical interventions are evaluated using computational models of patients. ISCTs have the potential to provide cost-effective, time-efficient, and ethically favorable alternatives for evaluating the safety and effectiveness of medical devices. However, ensuring the credibility of ISCT results is a significant challenge. This paper aims to identify unique considerations for assessing the credibility of ISCTs and proposes an ISCT credibility assessment workflow based on recently published model assessment frameworks. First, we review various ISCTs described in the literature, carefully selected to showcase the range of methodological options available. These studies cover a wide variety of devices, reasons for conducting ISCTs, patient model generation approaches including subject-specific versus 'synthetic' virtual patients, complexity levels of devices and patient models, incorporation of clinician or clinical outcome models, and methods for integrating ISCT results with real-world clinical trials. We next discuss how verification, validation, and uncertainty quantification apply to ISCTs, considering the range of ISCT approaches identified. Based on our analysis, we then present a hierarchical workflow for assessing ISCT credibility, using a general credibility assessment framework recently published by the FDA's Center for Devices and Radiological Health. Overall, this work aims to promote standardization in ISCTs and contribute to the wider adoption and acceptance of ISCTs as a reliable tool for evaluating medical devices.
Collapse
Affiliation(s)
- Pras Pathmanathan
- Center for Devices and Radiological Health, US Food and Drug Administration, Silver Spring, Maryland, United States of America
| | - Kenneth Aycock
- Center for Devices and Radiological Health, US Food and Drug Administration, Silver Spring, Maryland, United States of America
| | - Andreu Badal
- Center for Devices and Radiological Health, US Food and Drug Administration, Silver Spring, Maryland, United States of America
| | - Ramin Bighamian
- Center for Devices and Radiological Health, US Food and Drug Administration, Silver Spring, Maryland, United States of America
| | - Jeff Bodner
- Medtronic, PLC., Minneapolis, Minnesota, United States of America
| | - Brent A. Craven
- Center for Devices and Radiological Health, US Food and Drug Administration, Silver Spring, Maryland, United States of America
| | - Steven Niederer
- National Heart and Lung Institute, Imperial College, London, United Kingdom
- The Alan Turing Institute, London, United Kingdom
| |
Collapse
|
3
|
Dual Input Fuzzy Logic Controllers for Closed Loop Hemorrhagic Shock Resuscitation. Processes (Basel) 2022. [DOI: 10.3390/pr10112301] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022] Open
Abstract
Hemorrhage remains a leading cause of preventable death in emergency situations, including combat casualty care. This is partially due to the high cognitive burden that constantly adjusting fluid resuscitation rates can require, especially in austere or mass casualty situations. Closed-loop control systems have the potential to simplify hemorrhagic shock resuscitation if properly tuned for the application. We have previously compared 4 different controller types using a hardware-in-loop test platform that simulates hemorrhagic shock conditions, and we found that a dual input—(1) error from target and (2) rate of error change—fuzzy logic (DFL) controller performed best. Here, we highlight a range of DFL designs to showcase the tunability the controller can have for different hemorrhage scenarios. Five different controller setups were configured with different membership function logic to create more and less aggressive controller designs. Overall, the results for the different controller designs ranged from reaching the setup rapidly but often overshooting the target to more conservatively approaching the target, resulting in not reaching the target during high active hemorrhage rates. In conclusion, DFL controllers are well-suited for hemorrhagic shock resuscitation and can be tuned to meet the response rates set by clinical practice guidelines for this application.
Collapse
|
4
|
Hardware-in-Loop Comparison of Physiological Closed-Loop Controllers for the Autonomous Management of Hypotension. Bioengineering (Basel) 2022; 9:bioengineering9090420. [PMID: 36134966 PMCID: PMC9495383 DOI: 10.3390/bioengineering9090420] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Revised: 08/20/2022] [Accepted: 08/21/2022] [Indexed: 11/30/2022] Open
Abstract
Trauma and hemorrhage are leading causes of death and disability worldwide in both civilian and military contexts. The delivery of life-saving goal-directed fluid resuscitation can be difficult to provide in resource-constrained settings, such as in forward military positions or mass-casualty scenarios. Automated solutions for fluid resuscitation could bridge resource gaps in these austere settings. While multiple physiological closed-loop controllers for the management of hypotension have been proposed, to date there is no consensus on controller design. Here, we compare the performance of four controller types—decision table, single-input fuzzy logic, dual-input fuzzy logic, and proportional–integral–derivative using a previously developed hardware-in-loop test platform where a range of hemorrhage scenarios can be programmed. Controllers were compared using traditional controller performance metrics, but conclusions were difficult to draw due to inconsistencies across the metrics. Instead, we propose three aggregate metrics that reflect the target intensity, stability, and resource efficiency of a controller, with the goal of selecting controllers for further development. These aggregate metrics identify a dual-input, fuzzy-logic-based controller as the preferred combination of intensity, stability, and resource efficiency within this use case. Based on these results, the aggressively tuned dual-input fuzzy logic controller should be considered a priority for further development.
Collapse
|
5
|
Snider EJ, Berard D, Vega SJ, Hernandez Torres SI, Avital G, Boice EN. An Automated Hardware-in-Loop Testbed for Evaluating Hemorrhagic Shock Resuscitation Controllers. Bioengineering (Basel) 2022; 9:373. [PMID: 36004898 PMCID: PMC9405047 DOI: 10.3390/bioengineering9080373] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Revised: 08/03/2022] [Accepted: 08/03/2022] [Indexed: 12/04/2022] Open
Abstract
Hemorrhage remains a leading cause of death, with early goal-directed fluid resuscitation being a pillar of mortality prevention. While closed-loop resuscitation can potentially benefit this effort, development of these systems is resource-intensive, making it a challenge to compare infusion controllers and respective hardware within a range of physiologically relevant hemorrhage scenarios. Here, we present a hardware-in-loop automated testbed for resuscitation controllers (HATRC) that provides a simple yet robust methodology to evaluate controllers. HATRC is a flow-loop benchtop system comprised of multiple PhysioVessels which mimic pressure-volume responsiveness for different resuscitation infusates. Subject variability and infusate switching were integrated for more complex testing. Further, HATRC can modulate fluidic resistance to mimic arterial resistance changes after vasopressor administration. Finally, all outflow rates are computer-controlled, with rules to dictate hemorrhage, clotting, and urine rates. Using HATRC, we evaluated a decision-table controller at two sampling rates with different hemorrhage scenarios. HATRC allows quantification of twelve performance metrics for each controller configuration and scenario, producing heterogeneous results and highlighting the need for controller evaluation with multiple hemorrhage scenarios. In conclusion, HATRC can be used to evaluate closed-loop controllers through user-defined hemorrhage scenarios while rating their performance. Extensive controller troubleshooting using HATRC can accelerate product development and subsequent translation.
Collapse
Affiliation(s)
- Eric. J. Snider
- U.S. Army Institute of Surgical Research, JBSA Fort Sam Houston, San Antonio, TX 78234, USA
| | - David Berard
- U.S. Army Institute of Surgical Research, JBSA Fort Sam Houston, San Antonio, TX 78234, USA
| | - Saul J. Vega
- U.S. Army Institute of Surgical Research, JBSA Fort Sam Houston, San Antonio, TX 78234, USA
| | | | - Guy Avital
- U.S. Army Institute of Surgical Research, JBSA Fort Sam Houston, San Antonio, TX 78234, USA
- Trauma and Combat Medicine Branch, Surgeon General’s Headquarters, Israel Defense Forces, Ramat-Gan 52620, Israel
- Division of Anesthesia, Intensive Care and Pain Management, Tel-Aviv Sourasky Medical Center, Tel-Aviv 64239, Israel
| | - Emily N. Boice
- U.S. Army Institute of Surgical Research, JBSA Fort Sam Houston, San Antonio, TX 78234, USA
| |
Collapse
|
6
|
Closed-Loop Controlled Fluid Administration Systems: A Comprehensive Scoping Review. J Pers Med 2022; 12:jpm12071168. [PMID: 35887665 PMCID: PMC9315597 DOI: 10.3390/jpm12071168] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Revised: 07/14/2022] [Accepted: 07/15/2022] [Indexed: 02/07/2023] Open
Abstract
Physiological Closed-Loop Controlled systems continue to take a growing part in clinical practice, offering possibilities of providing more accurate, goal-directed care while reducing clinicians’ cognitive and task load. These systems also provide a standardized approach for the clinical management of the patient, leading to a reduction in care variability across multiple dimensions. For fluid management and administration, the advantages of closed-loop technology are clear, especially in conditions that require precise care to improve outcomes, such as peri-operative care, trauma, and acute burn care. Controller design varies from simplistic to complex designs, based on detailed physiological models and adaptive properties that account for inter-patient and intra-patient variability; their maturity level ranges from theoretical models tested in silico to commercially available, FDA-approved products. This comprehensive scoping review was conducted in order to assess the current technological landscape of this field, describe the systems currently available or under development, and suggest further advancements that may unfold in the coming years. Ten distinct systems were identified and discussed.
Collapse
|
7
|
Snider EJ, Berard D, Vega SJ, Avital G, Boice EN. Evaluation of a Proportional-Integral-Derivative Controller for Hemorrhage Resuscitation Using a Hardware-in-Loop Test Platform. J Pers Med 2022; 12:979. [PMID: 35743762 PMCID: PMC9224865 DOI: 10.3390/jpm12060979] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Revised: 06/13/2022] [Accepted: 06/14/2022] [Indexed: 12/04/2022] Open
Abstract
Hemorrhage is a leading cause of preventable death in trauma, which can often be avoided with proper fluid resuscitation. Fluid administration can be cognitive-demanding for medical personnel as the rates and volumes must be personalized to the trauma due to variations in injury severity and overall fluid responsiveness. Thus, automated fluid administration systems are ideal to simplify hemorrhagic shock resuscitation if properly designed for a wide range of hemorrhage scenarios. Here, we highlight the development of a proportional-integral-derivative (PID) controller using a hardware-in-loop test platform. The controller relies only on an input data stream of arterial pressure and a target pressure; the PID controller then outputs infusion rates to stabilize the subject. To evaluate PID controller performance with more than 10 controller metrics, the hardware-in-loop platform allowed for 11 different trauma-relevant hemorrhage scenarios for the controller to resuscitate against. Overall, the two controller configurations performed uniquely for the scenarios, with one reaching the target quicker but often overshooting, while the other rarely overshot the target but failed to reach the target during severe hemorrhage. In conclusion, PID controllers have the potential to simplify hemorrhage resuscitation if properly designed and evaluated, which can be accomplished with the test platform shown here.
Collapse
Affiliation(s)
- Eric J. Snider
- U.S. Army Institute of Surgical Research, JBSA Fort Sam Houston, San Antonio, TX 78234, USA; (D.B.); (S.J.V.); (G.A.); (E.N.B.)
| | - David Berard
- U.S. Army Institute of Surgical Research, JBSA Fort Sam Houston, San Antonio, TX 78234, USA; (D.B.); (S.J.V.); (G.A.); (E.N.B.)
| | - Saul J. Vega
- U.S. Army Institute of Surgical Research, JBSA Fort Sam Houston, San Antonio, TX 78234, USA; (D.B.); (S.J.V.); (G.A.); (E.N.B.)
| | - Guy Avital
- U.S. Army Institute of Surgical Research, JBSA Fort Sam Houston, San Antonio, TX 78234, USA; (D.B.); (S.J.V.); (G.A.); (E.N.B.)
- Trauma & Combat Medicine Branch, Surgeon General’s Headquarters, Israel Defense Forces, Ramat-Gan 5262000, Israel
- Division of Anesthesia, Intensive Care & Pain Management, Tel-Aviv Sourasky Medical Center, Tel-Aviv 6423906, Israel
| | - Emily N. Boice
- U.S. Army Institute of Surgical Research, JBSA Fort Sam Houston, San Antonio, TX 78234, USA; (D.B.); (S.J.V.); (G.A.); (E.N.B.)
| |
Collapse
|
8
|
Farahmand M, Mirinejad H, Scully CG. Model-based approach to investigate equipment-induced error in pressure-waveform derived hemodynamic measurements. Physiol Meas 2021; 42:10.1088/1361-6579/ac38be. [PMID: 34763325 PMCID: PMC8757537 DOI: 10.1088/1361-6579/ac38be] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2021] [Accepted: 11/11/2021] [Indexed: 12/30/2022]
Abstract
Objective.Advanced hemodynamic monitoring systems have provided less invasive methods for estimating pressure-derived measurements such as pressure-derived cardiac output (CO) measurements. These devices apply algorithms to arterial pressure waveforms recorded via pressure recording components that transmit the pressure signal to a pressure monitor. While standards have been developed for pressure monitoring equipment, it is unclear how the equipment-induced error can affect secondary measurements from pressure waveforms. We propose an approach for modelling different components of a pressure monitoring system and use this model-based approach to investigate the effect of different pressure recording configurations on pressure-derived hemodynamic measurements.Approach.The proposed model-based approach is a three step process. (1) Modelling the response of pressure recording components using bench tests; (2) verifying the identified models through nonparametric equivalence tests; and (3) assessing the effects of pressure recording components on pressure-derived measurements. To delineate the application of this approach, we performed a series of model-based analyses to quantify the combined effect of a wide range of tubing configurations with various damping ratios and natural frequencies and monitors with different bandwidths on pressure waveforms and CO measurements by six pulse contour algorithms.Results.Model-based results show the error in pressure-derived CO measurements because of tubing configurations with different natural frequencies and damping ratios. Tubing configurations with low natural frequencies (<23 Hz) altered characteristics of pressure waveforms in a way that affected the CO measurement, some by as much as 20%.Significance.Our method can serve as a tool to quantify the performance of pressure recording systems with different dynamic properties. This approach can be applied to investigate the effects of physiologic signal recording configurations on various pressure-derived hemodynamic measurements.
Collapse
Affiliation(s)
- Masoud Farahmand
- Division of Biomedical Physics, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, Food and Drug Administration, Silver Spring, MD 20993, United States of America
| | - Hossein Mirinejad
- College of Aeronautics and Engineering, Kent State University, Kent, OH 44242, United States of America
| | - Christopher G Scully
- Division of Biomedical Physics, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, Food and Drug Administration, Silver Spring, MD 20993, United States of America
| |
Collapse
|
9
|
Parvinian B, Bighamian R, Scully CG, Hahn JO, Pathmanathan P. Credibility Assessment of a Subject-Specific Mathematical Model of Blood Volume Kinetics for Prediction of Physiological Response to Hemorrhagic Shock and Fluid Resuscitation. Front Physiol 2021; 12:705222. [PMID: 34603074 PMCID: PMC8481867 DOI: 10.3389/fphys.2021.705222] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2021] [Accepted: 08/23/2021] [Indexed: 11/30/2022] Open
Abstract
Subject-specific mathematical models for prediction of physiological parameters such as blood volume, cardiac output, and blood pressure in response to hemorrhage have been developed. In silico studies using these models may provide an effective tool to generate pre-clinical safety evidence for medical devices and help reduce the size and scope of animal studies that are performed prior to initiation of human trials. To achieve such a goal, the credibility of the mathematical model must be established for the purpose of pre-clinical in silico testing. In this work, the credibility of a subject-specific mathematical model of blood volume kinetics intended to predict blood volume response to hemorrhage and fluid resuscitation during fluid therapy was evaluated. A workflow was used in which: (i) the foundational properties of the mathematical model such as structural identifiability were evaluated; (ii) practical identifiability was evaluated both pre- and post-calibration, with the pre-calibration results used to determine an optimal splitting of experimental data into calibration and validation datasets; (iii) uncertainty in model parameters and the experimental uncertainty were quantified for each subject; and (iv) the uncertainty was propagated through the blood volume kinetics model and its predictive capability was evaluated via validation tests. The mathematical model was found to be structurally identifiable. Pre-calibration identifiability analysis led to splitting the 180 min of time series data per subject into 50 and 130 min calibration and validation windows, respectively. The average root mean squared error of the mathematical model was 12.6% using the calibration window of (0 min, 50 min). Practical identifiability was established post-calibration after fixing one of the parameters to a nominal value. In the validation tests, 82 and 75% of the subject-specific mathematical models were able to correctly predict blood volume response when predictive capability was evaluated at 180 min and at the time when amount of infused fluid equals fluid loss.
Collapse
Affiliation(s)
- Bahram Parvinian
- Department of Mechanical Engineering, University of Maryland College Park, College Park, MD, United States
| | - Ramin Bighamian
- Office of Science and Engineering Laboratories, Food and Drug Administration, Silver Spring, MD, United States
| | - Christopher George Scully
- Office of Science and Engineering Laboratories, Food and Drug Administration, Silver Spring, MD, United States
| | - Jin-Oh Hahn
- Department of Mechanical Engineering, University of Maryland College Park, College Park, MD, United States
| | - Pras Pathmanathan
- Office of Science and Engineering Laboratories, Food and Drug Administration, Silver Spring, MD, United States
| |
Collapse
|
10
|
Gholami B, Haddad WM, Bailey JM, Muir WW. Closed-Loop Control for Fluid Resuscitation: Recent Advances and Future Challenges. Front Vet Sci 2021; 8:642440. [PMID: 33708814 PMCID: PMC7940185 DOI: 10.3389/fvets.2021.642440] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2020] [Accepted: 02/02/2021] [Indexed: 11/13/2022] Open
Abstract
Fluid therapy is extensively used to treat traumatized patients as well as patients during surgery. The fluid therapy process is complex due to interpatient variability in response to therapy as well as other complicating factors such as comorbidities and general anesthesia. These complexities can result in under- or over-resuscitation. Given the complexity of the fluid management process as well as the increased capabilities in hemodynamic monitoring, closed-loop fluid management can reduce the workload of the overworked clinician while ensuring specific constraints on hemodynamic endpoints are met with higher accuracy. The goal of this paper is to provide an overview of closed-loop control systems for fluid management and highlight several key steps in transitioning such a technology from bench to the bedside.
Collapse
Affiliation(s)
| | - Wassim M Haddad
- School of Aerospace Engineering, Georgia Institute of Technology, Atlanta, GA, United States
| | - James M Bailey
- Northeast Georgia Medical Center, Gainesville, GA, United States
| | - William W Muir
- College of Veterinary Medicine, Lincoln Memorial University, Harrogate, TN, United States
| |
Collapse
|
11
|
Abstract
Project-based learning (PBL) is proposed for the development of a Hardware-in-the-Loop (HIL) platform and the design of its digital controller for an undergraduate course on Digital Electronic Systems. The objective for students is the design of a digitally controlled HIL Boost converter, a digital pulse-width modulator (DPWM) and a current mode controller, implemented in field-programmable gate array (FPGA) devices. To this end, the different parts of the project are developed and evaluated, maximizing the use of FPGA resources in the design of the HIL and DPWM blocks, and applying design techniques that minimize the use of the digital resources used in the design of the controller. Students are equipped with a new individualized educational experience, allowing them to test their technical competence and knowledge in an environment close to the reality of the industry.
Collapse
|