Patient Input for Design of a Decision Support Smartphone Application for Type 1 Diabetes

Enhancing the Capabilities of Continuous Glucose Monitoring With a Predictive App

BACKGROUND

Despite abundant evidence demonstrating the benefits of continuous glucose monitoring (CGM) in diabetes management, a significant proportion of people using this technology still struggle to achieve glycemic targets. To address this challenge, we propose the Accu-Chek® SmartGuide Predict app, an innovative CGM digital companion that incorporates a suite of advanced glucose predictive functionalities aiming to inform users earlier about acute glycemic situations.

METHODS

The app's functionalities, powered by three machine learning models, include a two-hour glucose forecast, a 30-minute low glucose detection, and a nighttime low glucose prediction for bedtime interventions. Evaluation of the models' performance included three data sets, comprising subjects with T1D on MDI (n = 21), subjects with type 2 diabetes (T2D) on MDI (n = 59), and subjects with T1D on insulin pump therapy (n = 226).

RESULTS

On an aggregated data set, the two-hour glucose prediction model, at a forecasting horizon of 30, 45, 60, and 120 minutes, achieved a percentage of data points in zones A and B of Consensus Error Grid of: 99.8%, 99.3%, 98.7%, and 96.3%, respectively. The 30-minute low glucose prediction model achieved an accuracy, sensitivity, specificity, mean lead time, and area under the receiver operating characteristic curve (ROC AUC) of: 98.9%, 95.2%, 98.9%, 16.2 minutes, and 0.958, respectively. The nighttime low glucose prediction model achieved an accuracy, sensitivity, specificity, and ROC AUC of: 86.5%, 55.3%, 91.6%, and 0.859, respectively.

CONCLUSIONS

The consistency of the performance of the three predictive models when evaluated on different cohorts of subjects with T1D and T2D on different insulin therapies, including real-world data, offers reassurance for real-world efficacy.

Modeling risk of hypoglycemia during and following physical activity in people with type 1 diabetes using explainable mixed-effects machine learning

BACKGROUND

Physical activity (PA) can cause increased hypoglycemia (glucose <70 mg/dL) risk in people with type 1 diabetes (T1D). We modeled the probability of hypoglycemia during and up to 24 h following PA and identified key factors associated with hypoglycemia risk.

METHODS

We leveraged a free-living dataset from Tidepool comprised of glucose measurements, insulin doses, and PA data from 50 individuals with T1D (6448 sessions) for training and validating machine learning models. We also used data from the T1Dexi pilot study that contains glucose management and PA data from 20 individuals with T1D (139 session) for assessing the accuracy of the best performing model on an independent test dataset. We used mixed-effects logistic regression (MELR) and mixed-effects random forest (MERF) to model hypoglycemia risk around PA. We identified risk factors associated with hypoglycemia using odds ratio and partial dependence analysis for the MELR and MERF models, respectively. Prediction accuracy was measured using the area under the receiver operating characteristic curve (AUROC).

RESULTS

The analysis identified risk factors significantly associated with hypoglycemia during and following PA in both MELR and MERF models including glucose and body exposure to insulin at the start of PA, low blood glucose index 24 h prior to PA, and PA intensity and timing. Both models showed overall hypoglycemia risk peaking 1 h after PA and again 5-10 h after PA, which is consistent with the hypoglycemia risk pattern observed in the training dataset. Time following PA impacted hypoglycemia risk differently across different PA types. Accuracy of hypoglycemia prediction using the fixed effects of the MERF model was highest when predicting hypoglycemia during the first hour following the start of PA (AUROCVALIDATION = 0.83 and AUROCTESTING = 0.86) and decreased when predicting hypoglycemia in the 24 h after PA (AUROCVALIDATION = 0.66 and AUROCTESTING = 0.68).

CONCLUSION

Hypoglycemia risk after the start of PA can be modeled using mixed-effects machine learning to identify key risk factors that may be used within decision support and insulin delivery systems. We published the population-level MERF model online for others to use.

Quantifying the impact of physical activity on future glucose trends using machine learning

Prevention of hypoglycemia (glucose <70 mg/dL) during aerobic exercise is a major challenge in type 1 diabetes. Providing predictions of glycemic changes during and following exercise can help people with type 1 diabetes avoid hypoglycemia. A unique dataset representing 320 days and 50,000 + time points of glycemic measurements was collected in adults with type 1 diabetes who participated in a 4-arm crossover study evaluating insulin-pump therapies, whereby each participant performed eight identically designed in-clinic exercise studies. We demonstrate that even under highly controlled conditions, there is considerable intra-participant and inter-participant variability in glucose outcomes during and following exercise. Participants with higher aerobic fitness exhibited significantly lower minimum glucose and steeper glucose declines during exercise. Adaptive, personalized machine learning (ML) algorithms were designed to predict exercise-related glucose changes. These algorithms achieved high accuracy in predicting the minimum glucose and hypoglycemia during and following exercise sessions, for all fitness levels.

Feature-Based Machine Learning Model for Real-Time Hypoglycemia Prediction

BACKGROUND

Hypoglycemia is a serious health concern in youth with type 1 diabetes (T1D). Real-time data from continuous glucose monitoring (CGM) can be used to predict hypoglycemic risk, allowing patients to take timely intervention measures.

METHODS

A machine learning model is developed for probabilistic prediction of hypoglycemia (<70 mg/dL) in 30- and 60-minute time horizons based on CGM datasets obtained from 112 patients over a range of 90 days consisting of over 1.6 million CGM values under normal living conditions. A comprehensive set of features relevant for hypoglycemia are developed and a parsimonious subset with most influence on predicting hypoglycemic risk is identified. Model performance is evaluated both with and without contextual information on insulin and carbohydrate intake.

RESULTS

The model predicted hypoglycemia with >91% sensitivity for 30- and 60-minute prediction horizons while maintaining specificity >90%. Inclusion of insulin and carbohydrate data yielded performance improvement for 60-minute but not for 30-minute predictions. Model performance was highest for nocturnal hypoglycemia (~95% sensitivity). Shortterm (less than one hour) and medium-term (one to four hours) features for good prediction performance are identified.

CONCLUSIONS

Innovative feature identification facilitated high performance for hypoglycemia risk prediction in pediatric youth with T1D. Timely alerts of impending hypoglycemia may enable proactive measures to avoid severe hypoglycemia and achieve optimal glycemic control. The model will be deployed on a patient-facing smartphone application in an upcoming pilot study.