1
|
Serafini MC, Rosales N, Garelli F. Auto adaptation of closed-loop insulin delivery system using continuous reward functions and incremental discretization. Comput Methods Biomech Biomed Engin 2024; 27:1375-1386. [PMID: 37545465 DOI: 10.1080/10255842.2023.2241945] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Revised: 07/07/2023] [Accepted: 07/20/2023] [Indexed: 08/08/2023]
Abstract
Several closed or hybrid loop controllers for Blood Glucose (BG) regulation, which are also known as Artificial Pancreas (AP) Systems or Automated Insulin Delivery systems (AIDs), are in development worldwide. Most AIDs are designed and evaluated for short-term performance, with a particular emphasis on the post-meal period. However, if controllers are not adapted properly to account for variations in physiology that affect Insulin Sensitivity (IS), the AIDs may perform inadequately. In this work, the performance of two Reinforcement Learning (RL) agents trained under both piecewise and continuous reward functions is evaluated in-silico for long-term adaptation of a Fully Automated Insulin Delivery (fAID) system. An automatic adaptive discretization scheme that expands the state space as needed is also implemented to avoid disproportionate state space exploration. The proposed agents are evaluated for long-term adaptation of the Automatic Regulation of Glucose (ARG) algorithm, considering variations in IS. Results show that both RL agents have improved performance compared to a rule-based decision-making approach and the baseline controller for the majority of the adult population. Moreover, the use of a continuous shaped reward function proves to enhance the performance of the agents further than a piecewise one.
Collapse
Affiliation(s)
- Maria Cecilia Serafini
- Grupo de Control Aplicado, Instituto LEICI (UNLP-CONICET), Facultad de Ingeniería, Universidad Nacional de La Plata, Argentina
| | - Nicolas Rosales
- Grupo de Control Aplicado, Instituto LEICI (UNLP-CONICET), Facultad de Ingeniería, Universidad Nacional de La Plata, Argentina
| | - Fabricio Garelli
- Grupo de Control Aplicado, Instituto LEICI (UNLP-CONICET), Facultad de Ingeniería, Universidad Nacional de La Plata, Argentina
| |
Collapse
|
2
|
Kovatchev B, Castillo A, Pryor E, Kollar LL, Barnett CL, DeBoer MD, Brown SA. Neural-Net Artificial Pancreas: A Randomized Crossover Trial of a First-in-Class Automated Insulin Delivery Algorithm. Diabetes Technol Ther 2024; 26:375-382. [PMID: 38277161 PMCID: PMC11305265 DOI: 10.1089/dia.2023.0469] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/27/2024]
Abstract
Background: Automated insulin delivery (AID) is now integral to the clinical practice of type 1 diabetes (T1D). The objective of this pilot-feasibility study was to introduce a new regulatory and clinical paradigm-a Neural-Net Artificial Pancreas (NAP)-an encoding of an AID algorithm into a neural network that approximates its action and assess NAP versus the original AID algorithm. Methods: The University of Virginia Model-Predictive Control (UMPC) algorithm was encoded into a neural network, creating its NAP approximation. Seventeen AID users with T1D were recruited and 15 participated in two consecutive 20-h hotel sessions, receiving in random order either NAP or UMPC. Their demographic characteristics were ages 22-68 years old, duration of diabetes 7-58 years, gender 10/5 female/male, White Non-Hispanic/Black 13/2, and baseline glycated hemoglobin 5.4%-8.1%. Results: The time-in-range (TIR) difference between NAP and UMPC, adjusted for entry glucose level, was 1 percentage point, with absolute TIR values of 86% (NAP) and 87% (UMPC). The two algorithms achieved similar times <70 mg/dL of 2.0% versus 1.8% and coefficients of variation of 29.3% (NAP) versus 29.1 (UMPC)%. Under identical inputs, the average absolute insulin-recommendation difference was 0.031 U/h. There were no serious adverse events on either controller. NAP had sixfold lower computational demands than UMPC. Conclusion: In a randomized crossover study, a neural-network encoding of a complex model-predictive control algorithm demonstrated similar performance, at a fraction of the computational demands. Regulatory and clinical doors are therefore open for contemporary machine-learning methods to enter the AID field. Clinical Trial Registration number: NCT05876273.
Collapse
Affiliation(s)
- Boris Kovatchev
- Address correspondence to: Boris Kovatchev, PhD, Center for Diabetes Technology, University of Virginia School of Medicine, 560 Ray C Hunt Drive, Charlottesville, VA 22903, USA
| | | | | | | | | | | | | |
Collapse
|
3
|
Parra D, Joedicke D, Velasco JM, Kronberger G, Hidalgo JI. Learning Difference Equations With Structured Grammatical Evolution for Postprandial Glycaemia Prediction. IEEE J Biomed Health Inform 2024; 28:3067-3078. [PMID: 38416612 DOI: 10.1109/jbhi.2024.3371108] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/01/2024]
Abstract
People with diabetes must carefully monitor their blood glucose levels, especially after eating. Blood glucose management requires a proper combination of food intake and insulin boluses. Glucose prediction is vital to avoid dangerous post-meal complications in treating individuals with diabetes. Although traditional methods, and also artificial neural networks, have shown high accuracy rates, sometimes they are not suitable for developing personalised treatments by physicians due to their lack of interpretability. This study proposes a novel glucose prediction method emphasising interpretability: Interpretable Sparse Identification by Grammatical Evolution. Combined with a previous clustering stage, our approach provides finite difference equations to predict postprandial glucose levels up to two hours after meals. We divide the dataset into four-hour segments and perform clustering based on blood glucose values for the two-hour window before the meal. Prediction models are trained for each cluster for the two-hour windows after meals, allowing predictions in 15-minute steps, yielding up to eight predictions at different time horizons. Prediction safety was evaluated based on Parkes Error Grid regions. Our technique produces safe predictions through explainable expressions, avoiding zones D (0.2% average) and E (0%) and reducing predictions on zone C (6.2%). In addition, our proposal has slightly better accuracy than other techniques, including sparse identification of non-linear dynamics and artificial neural networks. The results demonstrate that our proposal provides interpretable solutions without sacrificing prediction accuracy, offering a promising approach to glucose prediction in diabetes management that balances accuracy, interpretability, and computational efficiency.
Collapse
|
4
|
Faggionato E, Guazzo A, Pegolo E, Carli R, Bruschetta M, Favero SD. An Adaptive Model Predictive Controller to Address the Biovariability in Blood Clotting Response During Therapy With Warfarin. IEEE Trans Biomed Eng 2023; 70:2667-2678. [PMID: 37030797 DOI: 10.1109/tbme.2023.3261962] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/29/2023]
Abstract
OBJECTIVE Effective dosing of anticoagulants aims to prevent blood clot formation while avoiding hemorrhages. This complex task is challenged by several disturbing factors and drug-effect uncertainties, requesting frequent monitoring and adjustment. Biovariability in drug absorption and action further complicates titration and calls for individualized strategies. In this paper, we propose an adaptive closed-loop control algorithm to assist in warfarin therapy management. METHODS The controller was designed and tested in silico using an established pharmacometrics model of warfarin, which accounts for inter-subject variability. The control algorithm is an adaptive Model Predictive Control (a-MPC) that leverages a simplified patient model, whose parameters are updated with a Bayesian strategy. Performance was quantitatively evaluated in simulations performed on a population of virtual subjects against an algorithm reproducing medical guidelines (MG) and an MPC controller available in the literature (l-MPC). RESULTS The proposed a-MPC significantly (p 0.05) lowers rising time (2.8 vs. 4.4 and 11.2 days) and time out of range (3.3 vs. 7.2 and 12.9 days) with respect to both MG and l-MPC, respectively. Adaptivity grants a significantly (p 0.05) lower number of subjects reaching unsafe INR values compared to when this feature is not present (8.9% vs.15% of subjects presenting an overshoot outside the target range and 0.08% vs. 0.28% of subjects reaching dangerous INR values). CONCLUSION The a-MPC algorithm improve warfarin therapy compared to the benchmark therapies. SIGNIFICANCE This in-silico validation proves effectiveness of the a-MPC algorithm for anticoagulant administration, paving the way for clinical testing.
Collapse
|
5
|
Urbano F, Farella I, Brunetti G, Faienza MF. Pediatric Type 1 Diabetes: Mechanisms and Impact of Technologies on Comorbidities and Life Expectancy. Int J Mol Sci 2023; 24:11980. [PMID: 37569354 PMCID: PMC10418611 DOI: 10.3390/ijms241511980] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Revised: 07/20/2023] [Accepted: 07/24/2023] [Indexed: 08/13/2023] Open
Abstract
Type 1 diabetes (T1D) is one of the most common chronic diseases in childhood, with a progressively increasing incidence. T1D management requires lifelong insulin treatment and ongoing health care support. The main goal of treatment is to maintain blood glucose levels as close to the physiological range as possible, particularly to avoid blood glucose fluctuations, which have been linked to morbidity and mortality in patients with T1D. Indeed, the guidelines of the International Society for Pediatric and Adolescent Diabetes (ISPAD) recommend a glycated hemoglobin (HbA1c) level < 53 mmol/mol (<7.0%) for young people with T1D to avoid comorbidities. Moreover, diabetic disease strongly influences the quality of life of young patients who must undergo continuous monitoring of glycemic values and the administration of subcutaneous insulin. In recent decades, the development of automated insulin delivery (AID) systems improved the metabolic control and the quality of life of T1D patients. Continuous subcutaneous insulin infusion (CSII) combined with continuous glucose monitoring (CGM) devices connected to smartphones represent a good therapeutic option, especially in young children. In this literature review, we revised the mechanisms of the currently available technologies for T1D in pediatric age and explored their effect on short- and long-term diabetes-related comorbidities, quality of life, and life expectation.
Collapse
Affiliation(s)
- Flavia Urbano
- Giovanni XXIII Pediatric Hospital, 70126 Bari, Italy;
| | - Ilaria Farella
- Clinica Medica “A. Murri”, University of Bari “Aldo Moro”, 70124 Bari, Italy;
| | - Giacomina Brunetti
- Department of Biosciences, Biotechnologies, and Environment, University of Bari “Aldo Moro”, 70125 Bari, Italy
| | - Maria Felicia Faienza
- Department of Precision and Regenerative Medicine and Ionian Area, University of Bari “Aldo Moro”, 70124 Bari, Italy;
| |
Collapse
|
6
|
Thamotharan P, Srinivasan S, Kesavadev J, Krishnan G, Mohan V, Seshadhri S, Bekiroglu K, Toffanin C. Human Digital Twin for Personalized Elderly Type 2 Diabetes Management. J Clin Med 2023; 12:jcm12062094. [PMID: 36983097 PMCID: PMC10056736 DOI: 10.3390/jcm12062094] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Revised: 02/10/2023] [Accepted: 02/27/2023] [Indexed: 03/12/2023] Open
Abstract
Managing Elderly type 2 diabetes (E-T2D) is challenging due to geriatric conditions (e.g., co-morbidity, multiple drug intake, etc.), and personalization becomes paramount for precision medicine. This paper presents a human digital twin (HDT) framework to manage E-T2D that exploits various patient-specific data and builds a suite of models exploiting the data for prediction and management to personalize diabetes treatment in E-T2D patients. These models include mathematical and deep-learning ones that capture different patient aspects. Consequently, the HDT virtualizes the patient from different viewpoints using an HDT that mimics the patient and has interfaces to update the virtual models simultaneously from measurements. Using these models the HDT obtains deeper insights about the patient. Further, an adaptive patient model fusing this information and a learning-based model predictive control (LB-MPC) algorithm are proposed. The geriatric conditions are captured as model parameters and constraints while solving the LB-MPC to personalize the insulin infusion for E-T2D management. The HDT is deployed on and illustrated with 15 patients using clinical trials and simulations. Our results show that HDT helps improve the time-in-range from 3–75% to 86–97% and reduces insulin infusion by 14–29%.
Collapse
Affiliation(s)
| | - Seshadhri Srinivasan
- Kalasalingam Academy of Research and Education, Srivilliputhur 626126, Tamil Nadu, India
- TVS-Sensing Solutions Pvt Ltd., Madurai 625122, Tamil Nadu, India
- Correspondence:
| | | | - Gopika Krishnan
- Jothydev’s Diabetes Research Center, Trivandrum 695032, Kerala, India
| | - Viswanathan Mohan
- Madras Diabetes Research Foundation & Dr. Mohan’s Diabetes Specialities Centre, Chennai 600086, Tami Nadu, India
| | - Subathra Seshadhri
- Kalasalingam Academy of Research and Education, Srivilliputhur 626126, Tamil Nadu, India
| | | | - Chiara Toffanin
- Departrment of Electrical, Computer and Biomedical Engineering, University of Pavia, 27100 Pavia, Italy
| |
Collapse
|
7
|
Rodríguez-Sarmiento DL, León-Vargas F, García-Jaramillo M. Artificial pancreas systems: experiences from concept to commercialisation. Expert Rev Med Devices 2022; 19:877-894. [DOI: 10.1080/17434440.2022.2150546] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
8
|
Personalized hybrid artificial pancreas using unidirectional sliding-modes control algorithm. Biocybern Biomed Eng 2022. [DOI: 10.1016/j.bbe.2022.10.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
9
|
Alqahtani A. Application of Artificial Intelligence in Discovery and Development of Anticancer and Antidiabetic Therapeutic Agents. EVIDENCE-BASED COMPLEMENTARY AND ALTERNATIVE MEDICINE : ECAM 2022; 2022:6201067. [PMID: 35509623 PMCID: PMC9060979 DOI: 10.1155/2022/6201067] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Revised: 03/17/2022] [Accepted: 04/05/2022] [Indexed: 11/18/2022]
Abstract
Spectacular developments in molecular and cellular biology have led to important discoveries in cancer research. Despite cancer is one of the major causes of morbidity and mortality globally, diabetes is one of the most leading sources of group of disorders. Artificial intelligence (AI) has been considered the fourth industrial revolution machine. The most major hurdles in drug discovery and development are the time and expenditures required to sustain the drug research pipeline. Large amounts of data can be explored and generated by AI, which can then be converted into useful knowledge. Because of this, the world's largest drug companies have already begun to use AI in their drug development research. In the present era, AI has a huge amount of potential for the rapid discovery and development of new anticancer drugs. Clinical studies, electronic medical records, high-resolution medical imaging, and genomic assessments are just a few of the tools that could aid drug development. Large data sets are available to researchers in the pharmaceutical and medical fields, which can be analyzed by advanced AI systems. This review looked at how computational biology and AI technologies may be utilized in cancer precision drug development by combining knowledge of cancer medicines, drug resistance, and structural biology. This review also highlighted a realistic assessment of the potential for AI in understanding and managing diabetes.
Collapse
Affiliation(s)
- Amal Alqahtani
- College of Medicine, Imam Abdulrahman Bin Faisal University, Dammam, 31541, Saudi Arabia
- Department of Basic Sciences, Deanship of Preparatory Year and Supporting Studies, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 34212, Saudi Arabia
| |
Collapse
|