1
|
Ahmad S, Beneyto A, Zhu T, Contreras I, Georgiou P, Vehi J. An automatic deep reinforcement learning bolus calculator for automated insulin delivery systems. Sci Rep 2024; 14:15245. [PMID: 38956183 PMCID: PMC11219905 DOI: 10.1038/s41598-024-62912-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2023] [Accepted: 05/22/2024] [Indexed: 07/04/2024] Open
Abstract
In hybrid automatic insulin delivery (HAID) systems, meal disturbance is compensated by feedforward control, which requires the announcement of the meal by the patient with type 1 diabetes (DM1) to achieve the desired glycemic control performance. The calculation of insulin bolus in the HAID system is based on the amount of carbohydrates (CHO) in the meal and patient-specific parameters, i.e. carbohydrate-to-insulin ratio (CR) and insulin sensitivity-related correction factor (CF). The estimation of CHO in a meal is prone to errors and is burdensome for patients. This study proposes a fully automatic insulin delivery (FAID) system that eliminates patient intervention by compensating for unannounced meals. This study exploits the deep reinforcement learning (DRL) algorithm to calculate insulin bolus for unannounced meals without utilizing the information on CHO content. The DRL bolus calculator is integrated with a closed-loop controller and a meal detector (both previously developed by our group) to implement the FAID system. An adult cohort of 68 virtual patients based on the modified UVa/Padova simulator was used for in-silico trials. The percentage of the overall duration spent in the target range of 70-180 mg/dL was 71.2 % and 76.2 % , < 70 mg/dL was 0.9 % and 0.1 % , and > 180 mg/dL was 26.7 % and 21.1 % , respectively, for the FAID system and HAID system utilizing a standard bolus calculator (SBC) including CHO misestimation. The proposed algorithm can be exploited to realize FAID systems in the future.
Collapse
Affiliation(s)
- Sayyar Ahmad
- Modeling and Intelligent Control Engineering Laboratory, Institute of Informatics and Applications, University of Girona, 17003, Girona, Spain
| | - Aleix Beneyto
- Modeling and Intelligent Control Engineering Laboratory, Institute of Informatics and Applications, University of Girona, 17003, Girona, Spain
| | - Taiyu Zhu
- Centre for Bio-Inspired Technology, Department of Electrical and Electronic Engineering, Imperial College London, London, UK
| | - Ivan Contreras
- Modeling and Intelligent Control Engineering Laboratory, Institute of Informatics and Applications, University of Girona, 17003, Girona, Spain
| | - Pantelis Georgiou
- Centre for Bio-Inspired Technology, Department of Electrical and Electronic Engineering, Imperial College London, London, UK
| | - Josep Vehi
- Modeling and Intelligent Control Engineering Laboratory, Institute of Informatics and Applications, University of Girona, 17003, Girona, Spain.
- Centro de Investigación Biomédica en Red de Diabetes y Enfermedades Metabólicas Asociadas (CIBERDEM), 28001, Madrid, Spain.
| |
Collapse
|
2
|
Beolet T, Adenis A, Huneker E, Louis M. End-to-end offline reinforcement learning for glycemia control. Artif Intell Med 2024; 154:102920. [PMID: 38972092 DOI: 10.1016/j.artmed.2024.102920] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Revised: 06/18/2024] [Accepted: 06/20/2024] [Indexed: 07/09/2024]
Abstract
The development of closed-loop systems for glycemia control in type I diabetes relies heavily on simulated patients. Improving the performances and adaptability of these close-loops raises the risk of over-fitting the simulator. This may have dire consequences, especially in unusual cases which were not faithfully - if at all - captured by the simulator. To address this, we propose to use model-free offline RL agents, trained on real patient data, to perform the glycemia control. To further improve the performances, we propose an end-to-end personalization pipeline, which leverages offline-policy evaluation methods to remove altogether the need of a simulator, while still enabling an estimation of clinically relevant metrics for diabetes.
Collapse
Affiliation(s)
- Tristan Beolet
- Diabeloop, 17 rue Félix Esclangon, Grenoble, 38000, France.
| | - Alice Adenis
- Diabeloop, 17 rue Félix Esclangon, Grenoble, 38000, France
| | - Erik Huneker
- Diabeloop, 17 rue Félix Esclangon, Grenoble, 38000, France
| | - Maxime Louis
- Diabeloop, 17 rue Félix Esclangon, Grenoble, 38000, France
| |
Collapse
|
3
|
Eghbali-Zarch M, Masoud S. Application of machine learning in affordable and accessible insulin management for type 1 and 2 diabetes: A comprehensive review. Artif Intell Med 2024; 151:102868. [PMID: 38632030 DOI: 10.1016/j.artmed.2024.102868] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2023] [Revised: 03/03/2024] [Accepted: 04/03/2024] [Indexed: 04/19/2024]
Abstract
Proper insulin management is vital for maintaining stable blood sugar levels and preventing complications associated with diabetes. However, the soaring costs of insulin present significant challenges to ensuring affordable management. This paper conducts a comprehensive review of current literature on the application of machine learning (ML) in insulin management for diabetes patients, particularly focusing on enhancing affordability and accessibility within the United States. The review encompasses various facets of insulin management, including dosage calculation and response, prediction of blood glucose and insulin sensitivity, initial insulin estimation, resistance prediction, treatment adherence, complications, hypoglycemia prediction, and lifestyle modifications. Additionally, the study identifies key limitations in the utilization of ML within the insulin management literature and suggests future research directions aimed at furthering accessible and affordable insulin treatments. These proposed directions include exploring insurance coverage, optimizing insulin type selection, assessing the impact of biosimilar insulin and market competition, considering mental health factors, evaluating insulin delivery options, addressing cost-related issues affecting insulin usage and adherence, and selecting appropriate patient cost-sharing programs. By examining the potential of ML in addressing insulin management affordability and accessibility, this work aims to envision improved and cost-effective insulin management practices. It not only highlights existing research gaps but also offers insights into future directions, guiding the development of innovative solutions that have the potential to revolutionize insulin management and benefit patients reliant on this life-saving treatment.
Collapse
Affiliation(s)
- Maryam Eghbali-Zarch
- Department of Industrial and Systems Engineering, Wayne State University, Detroit, MI 48202, USA
| | - Sara Masoud
- Department of Industrial and Systems Engineering, Wayne State University, Detroit, MI 48202, USA.
| |
Collapse
|
4
|
Jafar A, Pasqua MR, Olson B, Haidar A. Advanced decision support system for individuals with diabetes on multiple daily injections therapy using reinforcement learning and nearest-neighbors: In-silico and clinical results. Artif Intell Med 2024; 148:102749. [PMID: 38325921 DOI: 10.1016/j.artmed.2023.102749] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Revised: 12/03/2023] [Accepted: 12/10/2023] [Indexed: 02/09/2024]
Abstract
Many individuals with diabetes on multiple daily insulin injections therapy use carbohydrate ratios (CRs) and correction factors (CFs) to determine mealtime and correction insulin boluses. The CRs and CFs vary over time due to physiological changes in individuals' response to insulin. Errors in insulin dosing can lead to life-threatening abnormal glucose levels, increasing the risk of retinopathy, neuropathy, and nephropathy. Here, we present a novel learning algorithm that uses Q-learning to track optimal CRs and uses nearest-neighbors based Q-learning to track optimal CFs. The learning algorithm was compared with the run-to-run algorithm A and the run-to-run algorithm B, both proposed in the literature, over an 8-week period using a validated simulator with a realistic scenario created with suboptimal CRs and CFs values, carbohydrate counting errors, and random meals sizes at random ingestion times. From Week 1 to Week 8, the learning algorithm increased the percentage of time spent in target glucose range (4.0 to 10.0 mmol/L) from 51 % to 64 % compared to 61 % and 58 % with the run-to-run algorithm A and the run-to-run algorithm B, respectively. The learning algorithm decreased the percentage of time spent below 4.0 mmol/L from 9 % to 1.9 % compared to 3.4 % and 2.3 % with the run-to-run algorithm A and the run-to-run algorithm B, respectively. The algorithm was also assessed by comparing its recommendations with (i) the endocrinologist's recommendations on two type 1 diabetes individuals over a 16-week period and (ii) real-world individuals' therapy settings changes of 23 individuals (19 type 2 and 4 type 1) over an 8-week period using the commercial Bigfoot Unity Diabetes Management System. The full agreements (i) were 89 % and 76 % for CRs and CFs for the type 1 diabetes individuals and (ii) was 62 % for mealtime doses for the individuals on the commercial Bigfoot system. Therefore, the proposed algorithm has the potential to improve glucose control in individuals with type 1 and type 2 diabetes.
Collapse
Affiliation(s)
- Adnan Jafar
- Department of Biomedical Engineering, McGill University, Montreal, Quebec, Canada
| | - Melissa-Rosina Pasqua
- Division of Endocrinology, Department of Medicine, McGill University, Montreal, Quebec, Canada; The Research Institute of McGill University Health Centre, Montreal, Quebec, Canada; Division of Experimental Medicine, Department of Medicine, McGill University, Montreal, Quebec, Canada
| | - Byron Olson
- Bigfoot Biomedical Inc., Milpitas, CA, United States
| | - Ahmad Haidar
- Department of Biomedical Engineering, McGill University, Montreal, Quebec, Canada; Division of Endocrinology, Department of Medicine, McGill University, Montreal, Quebec, Canada; The Research Institute of McGill University Health Centre, Montreal, Quebec, Canada; Division of Experimental Medicine, Department of Medicine, McGill University, Montreal, Quebec, Canada.
| |
Collapse
|
5
|
Zrubka Z, Kertész G, Gulácsi L, Czere J, Hölgyesi Á, Nezhad HM, Mosavi A, Kovács L, Butte AJ, Péntek M. The Reporting Quality of Machine Learning Studies on Pediatric Diabetes Mellitus: Systematic Review. J Med Internet Res 2024; 26:e47430. [PMID: 38241075 PMCID: PMC10837761 DOI: 10.2196/47430] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Revised: 04/29/2023] [Accepted: 11/17/2023] [Indexed: 01/23/2024] Open
Abstract
BACKGROUND Diabetes mellitus (DM) is a major health concern among children with the widespread adoption of advanced technologies. However, concerns are growing about the transparency, replicability, biasedness, and overall validity of artificial intelligence studies in medicine. OBJECTIVE We aimed to systematically review the reporting quality of machine learning (ML) studies of pediatric DM using the Minimum Information About Clinical Artificial Intelligence Modelling (MI-CLAIM) checklist, a general reporting guideline for medical artificial intelligence studies. METHODS We searched the PubMed and Web of Science databases from 2016 to 2020. Studies were included if the use of ML was reported in children with DM aged 2 to 18 years, including studies on complications, screening studies, and in silico samples. In studies following the ML workflow of training, validation, and testing of results, reporting quality was assessed via MI-CLAIM by consensus judgments of independent reviewer pairs. Positive answers to the 17 binary items regarding sufficient reporting were qualitatively summarized and counted as a proxy measure of reporting quality. The synthesis of results included testing the association of reporting quality with publication and data type, participants (human or in silico), research goals, level of code sharing, and the scientific field of publication (medical or engineering), as well as with expert judgments of clinical impact and reproducibility. RESULTS After screening 1043 records, 28 studies were included. The sample size of the training cohort ranged from 5 to 561. Six studies featured only in silico patients. The reporting quality was low, with great variation among the 21 studies assessed using MI-CLAIM. The number of items with sufficient reporting ranged from 4 to 12 (mean 7.43, SD 2.62). The items on research questions and data characterization were reported adequately most often, whereas items on patient characteristics and model examination were reported adequately least often. The representativeness of the training and test cohorts to real-world settings and the adequacy of model performance evaluation were the most difficult to judge. Reporting quality improved over time (r=0.50; P=.02); it was higher than average in prognostic biomarker and risk factor studies (P=.04) and lower in noninvasive hypoglycemia detection studies (P=.006), higher in studies published in medical versus engineering journals (P=.004), and higher in studies sharing any code of the ML pipeline versus not sharing (P=.003). The association between expert judgments and MI-CLAIM ratings was not significant. CONCLUSIONS The reporting quality of ML studies in the pediatric population with DM was generally low. Important details for clinicians, such as patient characteristics; comparison with the state-of-the-art solution; and model examination for valid, unbiased, and robust results, were often the weak points of reporting. To assess their clinical utility, the reporting standards of ML studies must evolve, and algorithms for this challenging population must become more transparent and replicable.
Collapse
Affiliation(s)
- Zsombor Zrubka
- HECON Health Economics Research Center, University Research and Innovation Center, Óbuda University, Budapest, Hungary
| | - Gábor Kertész
- John von Neumann Faculty of Informatics, Óbuda University, Budapest, Hungary
| | - László Gulácsi
- HECON Health Economics Research Center, University Research and Innovation Center, Óbuda University, Budapest, Hungary
| | - János Czere
- Doctoral School of Innovation Management, Óbuda University, Budapest, Hungary
| | - Áron Hölgyesi
- HECON Health Economics Research Center, University Research and Innovation Center, Óbuda University, Budapest, Hungary
- Doctoral School of Molecular Medicine, Semmelweis University, Budapest, Hungary
| | - Hossein Motahari Nezhad
- HECON Health Economics Research Center, University Research and Innovation Center, Óbuda University, Budapest, Hungary
- Doctoral School of Business and Management, Corvinus University of Budapest, Budapest, Hungary
| | - Amir Mosavi
- John von Neumann Faculty of Informatics, Óbuda University, Budapest, Hungary
| | - Levente Kovács
- Physiological Controls Research Center, University Research and Innovation Center, Óbuda University, Budapest, Hungary
| | - Atul J Butte
- Bakar Computational Health Sciences Institute, University of California, San Francisco, CA, United States
| | - Márta Péntek
- HECON Health Economics Research Center, University Research and Innovation Center, Óbuda University, Budapest, Hungary
| |
Collapse
|
6
|
Lu HY, Ding X, Hirst JE, Yang Y, Yang J, Mackillop L, Clifton DA. Digital Health and Machine Learning Technologies for Blood Glucose Monitoring and Management of Gestational Diabetes. IEEE Rev Biomed Eng 2024; 17:98-117. [PMID: 37022834 PMCID: PMC7615520 DOI: 10.1109/rbme.2023.3242261] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/10/2023]
Abstract
Innovations in digital health and machine learning are changing the path of clinical health and care. People from different geographical locations and cultural backgrounds can benefit from the mobility of wearable devices and smartphones to monitor their health ubiquitously. This paper focuses on reviewing the digital health and machine learning technologies used in gestational diabetes - a subtype of diabetes that occurs during pregnancy. This paper reviews sensor technologies used in blood glucose monitoring devices, digital health innovations and machine learning models for gestational diabetes monitoring and management, in clinical and commercial settings, and discusses future directions. Despite one in six mothers having gestational diabetes, digital health applications were underdeveloped, especially the techniques that can be deployed in clinical practice. There is an urgent need to (1) develop clinically interpretable machine learning methods for patients with gestational diabetes, assisting health professionals with treatment, monitoring, and risk stratification before, during and after their pregnancies; (2) adapt and develop clinically-proven devices for patient self-management of health and well-being at home settings ("virtual ward" and virtual consultation), thereby improving clinical outcomes by facilitating timely intervention; and (3) ensure innovations are affordable and sustainable for all women with different socioeconomic backgrounds and clinical resources.
Collapse
|
7
|
Augustin D, Lambert B, Robinson M, Wang K, Gavaghan D. Simulating clinical trials for model-informed precision dosing: using warfarin treatment as a use case. Front Pharmacol 2023; 14:1270443. [PMID: 37927586 PMCID: PMC10621790 DOI: 10.3389/fphar.2023.1270443] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Accepted: 10/05/2023] [Indexed: 11/07/2023] Open
Abstract
Treatment response variability across patients is a common phenomenon in clinical practice. For many drugs this inter-individual variability does not require much (if any) individualisation of dosing strategies. However, for some drugs, including chemotherapies and some monoclonal antibody treatments, individualisation of dosages are needed to avoid harmful adverse events. Model-informed precision dosing (MIPD) is an emerging approach to guide the individualisation of dosing regimens of otherwise difficult-to-administer drugs. Several MIPD approaches have been suggested to predict dosing strategies, including regression, reinforcement learning (RL) and pharmacokinetic and pharmacodynamic (PKPD) modelling. A unified framework to study the strengths and limitations of these approaches is missing. We develop a framework to simulate clinical MIPD trials, providing a cost and time efficient way to test different MIPD approaches. Central for our framework is a clinical trial model that emulates the complexities in clinical practice that challenge successful treatment individualisation. We demonstrate this framework using warfarin treatment as a use case and investigate three popular MIPD methods: 1. Neural network regression; 2. Deep RL; and 3. PKPD modelling. We find that the PKPD model individualises warfarin dosing regimens with the highest success rate and the highest efficiency: 75.1% of the individuals display INRs inside the therapeutic range at the end of the simulated trial; and the median time in the therapeutic range (TTR) is 74%. In comparison, the regression model and the deep RL model have success rates of 47.0% and 65.8%, and median TTRs of 45% and 68%. We also find that the MIPD models can attain different degrees of individualisation: the Regression model individualises dosing regimens up to variability explained by covariates; the Deep RL model and the PKPD model individualise dosing regimens accounting also for additional variation using monitoring data. However, the Deep RL model focusses on control of the treatment response, while the PKPD model uses the data also to further the individualisation of predictions.
Collapse
Affiliation(s)
- David Augustin
- Department of Computer Science, University of Oxford, Oxford, United Kingdom
| | - Ben Lambert
- College of Engineering, Mathematics and Physical Sciences, University of Exeter, Exeter, United Kingdom
| | - Martin Robinson
- Department of Computer Science, University of Oxford, Oxford, United Kingdom
| | - Ken Wang
- Research and Early Development, F. Hoffmann-La Roche AG, Basel, Switzerland
| | - David Gavaghan
- Department of Computer Science, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
8
|
Zhu T, Li K, Herrero P, Georgiou P. GluGAN: Generating Personalized Glucose Time Series Using Generative Adversarial Networks. IEEE J Biomed Health Inform 2023; 27:5122-5133. [PMID: 37134028 DOI: 10.1109/jbhi.2023.3271615] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
Time series data generated by continuous glucose monitoring sensors offer unparalleled opportunities for developing data-driven approaches, especially deep learning-based models, in diabetes management. Although these approaches have achieved state-of-the-art performance in various fields such as glucose prediction in type 1 diabetes (T1D), challenges remain in the acquisition of large-scale individual data for personalized modeling due to the elevated cost of clinical trials and data privacy regulations. In this work, we introduce GluGAN, a framework specifically designed for generating personalized glucose time series based on generative adversarial networks (GANs). Employing recurrent neural network (RNN) modules, the proposed framework uses a combination of unsupervised and supervised training to learn temporal dynamics in latent spaces. Aiming to assess the quality of synthetic data, we apply clinical metrics, distance scores, and discriminative and predictive scores computed by post-hoc RNNs in evaluation. Across three clinical datasets with 47 T1D subjects (including one publicly available and two proprietary datasets), GluGAN achieved better performance for all the considered metrics when compared with four baseline GAN models. The performance of data augmentation is evaluated by three machine learning-based glucose predictors. Using the training sets augmented by GluGAN significantly reduced the root mean square error for the predictors over 30 and 60-minute horizons. The results suggest that GluGAN is an effective method in generating high-quality synthetic glucose time series and has the potential to be used for evaluating the effectiveness of automated insulin delivery algorithms and as a digital twin to substitute for pre-clinical trials.
Collapse
|
9
|
Zhu T, Li K, Georgiou P. Offline Deep Reinforcement Learning and Off-Policy Evaluation for Personalized Basal Insulin Control in Type 1 Diabetes. IEEE J Biomed Health Inform 2023; 27:5087-5098. [PMID: 37607154 DOI: 10.1109/jbhi.2023.3303367] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/24/2023]
Abstract
Recent advancements in hybrid closed-loop systems, also known as the artificial pancreas (AP), have been shown to optimize glucose control and reduce the self-management burdens for people living with type 1 diabetes (T1D). AP systems can adjust the basal infusion rates of insulin pumps, facilitated by real-time communication with continuous glucose monitoring. Deep reinforcement learning (DRL) has introduced new paradigms of basal insulin control algorithms. However, all the existing DRL-based AP controllers require extensive random online interactions between the agent and environment. While this can be validated in T1D simulators, it becomes impractical in real-world clinical settings. To this end, we propose an offline DRL framework that can develop and validate models for basal insulin control entirely offline. It comprises a DRL model based on the twin delayed deep deterministic policy gradient and behavior cloning, as well as off-policy evaluation (OPE) using fitted Q evaluation. We evaluated the proposed framework on an in silico dataset generated by the UVA/Padova T1D simulator, and the OhioT1DM dataset, a real clinical dataset. The performance on the in silico dataset shows that the offline DRL algorithm significantly increased time in range while reducing time below range and time above range for both adult and adolescent groups. Then, we used the OPE to estimate model performance on the clinical dataset, where a notable increase in policy values was observed for each subject. The results demonstrate that the proposed framework is a viable and safe method for improving personalized basal insulin control in T1D.
Collapse
|
10
|
Del Giorno S, D’Antoni F, Piemonte V, Merone M. A New Glycemic closed-loop control based on Dyna-Q for Type-1-Diabetes. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
|
11
|
Zhu T, Li K, Herrero P, Georgiou P. Personalized Blood Glucose Prediction for Type 1 Diabetes Using Evidential Deep Learning and Meta-Learning. IEEE Trans Biomed Eng 2023; 70:193-204. [PMID: 35776825 DOI: 10.1109/tbme.2022.3187703] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
The availability of large amounts of data from continuous glucose monitoring (CGM), together with the latest advances in deep learning techniques, have opened the door to a new paradigm of algorithm design for personalized blood glucose (BG) prediction in type 1 diabetes (T1D) with superior performance. However, there are several challenges that prevent the widespread implementation of deep learning algorithms in actual clinical settings, including unclear prediction confidence and limited training data for new T1D subjects. To this end, we propose a novel deep learning framework, Fast-adaptive and Confident Neural Network (FCNN), to meet these clinical challenges. In particular, an attention-based recurrent neural network is used to learn representations from CGM input and forward a weighted sum of hidden states to an evidential output layer, aiming to compute personalized BG predictions with theoretically supported model confidence. The model-agnostic meta-learning is employed to enable fast adaptation for a new T1D subject with limited training data. The proposed framework has been validated on three clinical datasets. In particular, for a dataset including 12 subjects with T1D, FCNN achieved a root mean square error of 18.64±2.60 mg/dL and 31.07±3.62 mg/dL for 30 and 60-minute prediction horizons, respectively, which outperformed all the considered baseline methods with significant improvements. These results indicate that FCNN is a viable and effective approach for predicting BG levels in T1D. The well-trained models can be implemented in smartphone apps to improve glycemic control by enabling proactive actions through real-time glucose alerts.
Collapse
|
12
|
Armero W, Gray KJ, Fields KG, Cole NM, Bates DW, Kovacheva VP. A survey of pregnant patients' perspectives on the implementation of artificial intelligence in clinical care. J Am Med Inform Assoc 2022; 30:46-53. [PMID: 36250788 PMCID: PMC9748543 DOI: 10.1093/jamia/ocac200] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Revised: 07/17/2022] [Accepted: 10/04/2022] [Indexed: 12/15/2022] Open
Abstract
OBJECTIVE To evaluate and understand pregnant patients' perspectives on the implementation of artificial intelligence (AI) in clinical care with a focus on opportunities to improve healthcare technologies and healthcare delivery. MATERIALS AND METHODS We developed an anonymous survey and enrolled patients presenting to the labor and delivery unit at a tertiary care center September 2019-June 2020. We investigated the role and interplay of patient demographic factors, healthcare literacy, understanding of AI, comfort levels with various AI scenarios, and preferences for AI use in clinical care. RESULTS Of the 349 parturients, 57.6% were between the ages of 25-34 years, 90.1% reported college or graduate education and 69.2% believed the benefits of AI use in clinical care outweighed the risks. Cluster analysis revealed 2 distinct groups: patients more comfortable with clinical AI use (Pro-AI) and those who preferred physician presence (AI-Cautious). Pro-AI patients had a higher degree of education, were more knowledgeable about AI use in their daily lives and saw AI use as a significant advancement in medicine. AI-Cautious patients reported a lack of human qualities and low trust in the technology as detriments to AI use. DISCUSSION Patient trust and the preservation of the human physician-patient relationship are critical in moving forward with AI implementation in healthcare. Pregnant individuals are cautiously optimistic about AI use in their care. CONCLUSION Our findings provide insights into the status of AI use in perinatal care and provide a platform for driving patient-centered innovations.
Collapse
Affiliation(s)
- William Armero
- Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women’s Hospital, Harvard Medical School, Boston, Massachusetts, USA
- David Geffen School of Medicine at UCLA, Los Angeles, California, USA
| | - Kathryn J Gray
- Division of Maternal-Fetal Medicine, Brigham and Women’s Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Kara G Fields
- Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women’s Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Naida M Cole
- Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women’s Hospital, Harvard Medical School, Boston, Massachusetts, USA
- Department of Anesthesia and Critical Care, The University of Chicago, Chicago, Illinois, USA
| | - David W Bates
- Division of General Internal Medicine and Primary Care, Brigham and Women’s Hospital, Boston, Massachusetts, USA
- Department of Health Care Policy and Management, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, USA
| | - Vesela P Kovacheva
- Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women’s Hospital, Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
13
|
Ahmad S, Beneyto A, Contreras I, Vehi J. Bolus Insulin calculation without meal information. A reinforcement learning approach. Artif Intell Med 2022; 134:102436. [PMID: 36462903 DOI: 10.1016/j.artmed.2022.102436] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2022] [Revised: 10/24/2022] [Accepted: 10/28/2022] [Indexed: 11/09/2022]
Abstract
In continuous subcutaneous insulin infusion and multiple daily injections, insulin boluses are usually calculated based on patient-specific parameters, such as carbohydrates-to-insulin ratio (CR), insulin sensitivity-based correction factor (CF), and the estimation of the carbohydrates (CHO) to be ingested. This study aimed to calculate insulin boluses without CR, CF, and CHO content, thereby eliminating the errors caused by misestimating CHO and alleviating the management burden on the patient. A Q-learning-based reinforcement learning algorithm (RL) was developed to optimise bolus insulin doses for in-silico type 1 diabetic patients. A realistic virtual cohort of 68 patients with type 1 diabetes that was previously developed by our research group, was considered for the in-silico trials. The results were compared to those of the standard bolus calculator (SBC) with and without CHO misestimation using open-loop basal insulin therapy. The percentage of the overall duration spent in the target range of 70-180 mg/dL was 73.4% and 72.37%, <70 mg/dL was 1.96 and 0.70%, and >180 mg/dL was 23.40 and 24.63%, respectively, for RL and SBC without CHO misestimation. The results revealed that RL outperformed SBC in the presence of CHO misestimation, and despite not knowing the CHO content of meals, the performance of RL was similar to that of SBC in perfect conditions. This algorithm can be incorporated into artificial pancreas and automatic insulin delivery systems in the future.
Collapse
Affiliation(s)
- Sayyar Ahmad
- Department of Electrical, Electronic and Automatic Engineering, University of Girona, 17004 Girona, Spain
| | - Aleix Beneyto
- Department of Electrical, Electronic and Automatic Engineering, University of Girona, 17004 Girona, Spain
| | - Ivan Contreras
- Department of Electrical, Electronic and Automatic Engineering, University of Girona, 17004 Girona, Spain
| | - Josep Vehi
- Department of Electrical, Electronic and Automatic Engineering, University of Girona, 17004 Girona, Spain; Centro de Investigación Biomédica en Red de Diabetes y Enfermedades Metabólicas Asociadas (CIBERDEM), 28001 Madrid, Spain.
| |
Collapse
|
14
|
Zhu T, Uduku C, Li K, Herrero P, Oliver N, Georgiou P. Enhancing self-management in type 1 diabetes with wearables and deep learning. NPJ Digit Med 2022; 5:78. [PMID: 35760819 PMCID: PMC9237131 DOI: 10.1038/s41746-022-00626-5] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2021] [Accepted: 06/01/2022] [Indexed: 11/12/2022] Open
Abstract
People living with type 1 diabetes (T1D) require lifelong self-management to maintain glucose levels in a safe range. Failure to do so can lead to adverse glycemic events with short and long-term complications. Continuous glucose monitoring (CGM) is widely used in T1D self-management for real-time glucose measurements, while smartphone apps are adopted as basic electronic diaries, data visualization tools, and simple decision support tools for insulin dosing. Applying a mixed effects logistic regression analysis to the outcomes of a six-week longitudinal study in 12 T1D adults using CGM and a clinically validated wearable sensor wristband (NCT ID: NCT03643692), we identified several significant associations between physiological measurements and hypo- and hyperglycemic events measured an hour later. We proceeded to develop a new smartphone-based platform, ARISES (Adaptive, Real-time, and Intelligent System to Enhance Self-care), with an embedded deep learning algorithm utilizing multi-modal data from CGM, daily entries of meal and bolus insulin, and the sensor wristband to predict glucose levels and hypo- and hyperglycemia. For a 60-minute prediction horizon, the proposed algorithm achieved the average root mean square error (RMSE) of 35.28 ± 5.77 mg/dL with the Matthews correlation coefficients for detecting hypoglycemia and hyperglycemia of 0.56 ± 0.07 and 0.70 ± 0.05, respectively. The use of wristband data significantly reduced the RMSE by 2.25 mg/dL (p < 0.01). The well-trained model is implemented on the ARISES app to provide real-time decision support. These results indicate that the ARISES has great potential to mitigate the risk of severe complications and enhance self-management for people with T1D.
Collapse
Affiliation(s)
- Taiyu Zhu
- Centre for Bio-Inspired Technology, Department of Electrical and Electronic Engineering, Imperial College London, London, UK.
| | - Chukwuma Uduku
- Division of Diabetes, Endocrinology and Metabolism, Faculty of Medicine, Imperial College London, London, UK
| | - Kezhi Li
- Centre for Bio-Inspired Technology, Department of Electrical and Electronic Engineering, Imperial College London, London, UK. .,Institute of Health Informatics, University College London, London, UK.
| | - Pau Herrero
- Centre for Bio-Inspired Technology, Department of Electrical and Electronic Engineering, Imperial College London, London, UK
| | - Nick Oliver
- Division of Diabetes, Endocrinology and Metabolism, Faculty of Medicine, Imperial College London, London, UK
| | - Pantelis Georgiou
- Centre for Bio-Inspired Technology, Department of Electrical and Electronic Engineering, Imperial College London, London, UK
| |
Collapse
|
15
|
Li T, Wang Z, Lu W, Zhang Q, Li D. Electronic health records based reinforcement learning for treatment optimizing. INFORM SYST 2022. [DOI: 10.1016/j.is.2021.101878] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2023]
|
16
|
Zhu T, Li K, Herrero P, Georgiou P. Deep Learning for Diabetes: A Systematic Review. IEEE J Biomed Health Inform 2021; 25:2744-2757. [PMID: 33232247 DOI: 10.1109/jbhi.2020.3040225] [Citation(s) in RCA: 39] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Diabetes is a chronic metabolic disorder that affects an estimated 463 million people worldwide. Aiming to improve the treatment of people with diabetes, digital health has been widely adopted in recent years and generated a huge amount of data that could be used for further management of this chronic disease. Taking advantage of this, approaches that use artificial intelligence and specifically deep learning, an emerging type of machine learning, have been widely adopted with promising results. In this paper, we present a comprehensive review of the applications of deep learning within the field of diabetes. We conducted a systematic literature search and identified three main areas that use this approach: diagnosis of diabetes, glucose management, and diagnosis of diabetes-related complications. The search resulted in the selection of 40 original research articles, of which we have summarized the key information about the employed learning models, development process, main outcomes, and baseline methods for performance evaluation. Among the analyzed literature, it is to be noted that various deep learning techniques and frameworks have achieved state-of-the-art performance in many diabetes-related tasks by outperforming conventional machine learning approaches. Meanwhile, we identify some limitations in the current literature, such as a lack of data availability and model interpretability. The rapid developments in deep learning and the increase in available data offer the possibility to meet these challenges in the near future and allow the widespread deployment of this technology in clinical settings.
Collapse
|
17
|
Fakhroleslam M, Bozorgmehry Boozarjomehry R. A multi‐objective optimal insulin bolus advisor for type 1 diabetes based on personalized model and daily diet. ASIA-PAC J CHEM ENG 2021. [DOI: 10.1002/apj.2651] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Affiliation(s)
- Mohammad Fakhroleslam
- Process Engineering Department, Faculty of Chemical Engineering Tarbiat Modares University Tehran Iran
| | | |
Collapse
|
18
|
LSTMs and Deep Residual Networks for Carbohydrate and Bolus Recommendations in Type 1 Diabetes Management. SENSORS 2021; 21:s21093303. [PMID: 34068808 PMCID: PMC8126192 DOI: 10.3390/s21093303] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/06/2021] [Revised: 04/28/2021] [Accepted: 05/05/2021] [Indexed: 11/17/2022]
Abstract
To avoid serious diabetic complications, people with type 1 diabetes must keep their blood glucose levels (BGLs) as close to normal as possible. Insulin dosages and carbohydrate consumption are important considerations in managing BGLs. Since the 1960s, models have been developed to forecast blood glucose levels based on the history of BGLs, insulin dosages, carbohydrate intake, and other physiological and lifestyle factors. Such predictions can be used to alert people of impending unsafe BGLs or to control insulin flow in an artificial pancreas. In past work, we have introduced an LSTM-based approach to blood glucose level prediction aimed at “what-if” scenarios, in which people could enter foods they might eat or insulin amounts they might take and then see the effect on future BGLs. In this work, we invert the “what-if” scenario and introduce a similar architecture based on chaining two LSTMs that can be trained to make either insulin or carbohydrate recommendations aimed at reaching a desired BG level in the future. Leveraging a recent state-of-the-art model for time series forecasting, we then derive a novel architecture for the same recommendation task, in which the two LSTM chain is used as a repeating block inside a deep residual architecture. Experimental evaluations using real patient data from the OhioT1DM dataset show that the new integrated architecture compares favorably with the previous LSTM-based approach, substantially outperforming the baselines. The promising results suggest that this novel approach could potentially be of practical use to people with type 1 diabetes for self-management of BGLs.
Collapse
|
19
|
Jafar A, Fathi AE, Haidar A. Long-term use of the hybrid artificial pancreas by adjusting carbohydrate ratios and programmed basal rate: A reinforcement learning approach. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 200:105936. [PMID: 33515844 DOI: 10.1016/j.cmpb.2021.105936] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/28/2020] [Accepted: 01/06/2021] [Indexed: 06/12/2023]
Abstract
BACKGROUND AND OBJECTIVES The hybrid artificial pancreas regulates glucose levels in people with type 1 diabetes. It delivers (i) insulin boluses at meal times based on the meals' carbohydrate content and the carbohydrate ratios (CRs) and (ii) insulin basal, between meals and at night, continuously modulated around individual-specific programmed basal rate. The CRs and programmed basal rate significantly vary between individuals and within the same individual with type 1 diabetes, and using suboptimal values in the hybrid artificial pancreas may degrade glucose control. We propose a reinforcement learning algorithm to adaptively optimize CRs and programmed basal rate to improve the performance of the hybrid artificial pancreas. METHODS The proposed reinforcement learning algorithm was designed using the Q-learning approach. The algorithm learns the optimal actions (CRs and programmed basal rate) by applying them to the individual's state (previous day's glucose levels and insulin delivery) based on an exploration and exploitation trade-off. First, outcomes from our simulator were compared to those of a clinical study in 23 individuals with type 1 diabetes and have yielded similar results. Second, the learning algorithm was tested using the simulator with two scenarios. Scenario 1 has fixed meal sizes and ingestion times and scenario 2 has a more realistic eating behavior with random meal sizes, ingestion times, and carbohydrate counting errors. RESULTS After about five weeks, the reinforcement learning algorithm improved the percentage of time spent in target range from 67% to 86.7% in scenario 1 and 65.5% to 86% in scenario 2. The percentage of time spent below 4.0 mmol/L decreased from 9% to 0.9% in scenario 1 and 9.5% to 1.1% in scenario 2. CONCLUSIONS Results indicate that the proposed algorithm has the potential to improve glucose control in people with type 1 diabetes using the hybrid artificial pancreas. The proposed algorithm is a key in making the hybrid artificial pancreas adaptive for the long-term real life outpatient studies.
Collapse
Affiliation(s)
- Adnan Jafar
- Department of Biomedical Engineering, McGill University, Montreal, Canada.
| | - Anas El Fathi
- Department of Electrical and Computer Engineering, McGill University, Montreal, Canada.
| | - Ahmad Haidar
- Department of Biomedical Engineering, McGill University, Montreal, Canada.
| |
Collapse
|
20
|
Mujahid O, Contreras I, Vehi J. Machine Learning Techniques for Hypoglycemia Prediction: Trends and Challenges. SENSORS (BASEL, SWITZERLAND) 2021; 21:E546. [PMID: 33466659 PMCID: PMC7828835 DOI: 10.3390/s21020546] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/17/2020] [Revised: 01/08/2021] [Accepted: 01/12/2021] [Indexed: 12/11/2022]
Abstract
(1) Background: the use of machine learning techniques for the purpose of anticipating hypoglycemia has increased considerably in the past few years. Hypoglycemia is the drop in blood glucose below critical levels in diabetic patients. This may cause loss of cognitive ability, seizures, and in extreme cases, death. In almost half of all the severe cases, hypoglycemia arrives unannounced and is essentially asymptomatic. The inability of a diabetic patient to anticipate and intervene the occurrence of a hypoglycemic event often results in crisis. Hence, the prediction of hypoglycemia is a vital step in improving the life quality of a diabetic patient. The objective of this paper is to review work performed in the domain of hypoglycemia prediction by using machine learning and also to explore the latest trends and challenges that the researchers face in this area; (2) Methods: literature obtained from PubMed and Google Scholar was reviewed. Manuscripts from the last five years were searched for this purpose. A total of 903 papers were initially selected of which 57 papers were eventually shortlisted for detailed review; (3) Results: a thorough dissection of the shortlisted manuscripts provided an interesting split between the works based on two categories: hypoglycemia prediction and hypoglycemia detection. The entire review was carried out keeping this categorical distinction in perspective while providing a thorough overview of the machine learning approaches used to anticipate hypoglycemia, the type of training data, and the prediction horizon.
Collapse
Affiliation(s)
- Omer Mujahid
- Model Identification and Control Laboratory, Institut d’Informatica i Applicacions, Universitat de Girona, 17003 Girona, Spain; (O.M.); (I.C.)
| | - Ivan Contreras
- Model Identification and Control Laboratory, Institut d’Informatica i Applicacions, Universitat de Girona, 17003 Girona, Spain; (O.M.); (I.C.)
| | - Josep Vehi
- Model Identification and Control Laboratory, Institut d’Informatica i Applicacions, Universitat de Girona, 17003 Girona, Spain; (O.M.); (I.C.)
- Centro de Investigación Biomédica en Red de Diabetes y Enfermedades Metabólicas Asociadas (CIBERDEM), 17003 Girona, Spain
| |
Collapse
|