Data-driven health management: reasoning about personally generated data in diabetes with information technologies

A simple modeling framework for prediction in the human glucose-insulin system

Forecasting blood glucose (BG) levels with routinely collected data is useful for glycemic management. BG dynamics are nonlinear, complex, and nonstationary, which can be represented by nonlinear models. However, the sparsity of routinely collected data creates parameter identifiability issues when high-fidelity complex models are used, thereby resulting in inaccurate forecasts. One can use models with reduced physiological fidelity for robust and accurate parameter estimation and forecasting with sparse data. For this purpose, we approximate the nonlinear dynamics of BG regulation by a linear stochastic differential equation: we develop a linear stochastic model, which can be specialized to different settings: type 2 diabetes mellitus (T2DM) and intensive care unit (ICU), with different choices of appropriate model functions. The model includes deterministic terms quantifying glucose removal from the bloodstream through the glycemic regulation system and representing the effect of nutrition and externally delivered insulin. The stochastic term encapsulates the BG oscillations. The model output is in the form of an expected value accompanied by a band around this value. The model parameters are estimated patient-specifically, leading to personalized models. The forecasts consist of values for BG mean and variation, quantifying possible high and low BG levels. Such predictions have potential use for glycemic management as part of control systems. We present experimental results on parameter estimation and forecasting in T2DM and ICU settings. We compare the model's predictive capability with two different nonlinear models built for T2DM and ICU contexts to have a sense of the level of prediction achieved by this model.

Automatic inference of hypoglycemia causes in type 1 diabetes: a feasibility study

Background

Hypoglycemia is the most common adverse consequence of treating diabetes, and is often due to suboptimal patient self-care. Behavioral interventions by health professionals and self-care education helps avoid recurrent hypoglycemic episodes by targeting problematic patient behaviors. This relies on time-consuming investigation of reasons behind the observed episodes, which involves manual interpretation of personal diabetes diaries and communication with patients. Therefore, there is a clear motivation to automate this process using a supervised machine learning paradigm. This manuscript presents a feasibility study of automatic identification of hypoglycemia causes.

Methods

Reasons for 1885 hypoglycemia events were labeled by 54 participants with type 1 diabetes over a 21 months period. A broad range of possible predictors were extracted describing a hypoglycemic episode and the subject's general self-care from participants' routinely collected data on the Glucollector, their diabetes management platform. Thereafter, the possible hypoglycemia reasons were categorized for two major analysis sections - statistical analysis of relationships between the data features of self-care and hypoglycemia reasons, and classification analysis investigating the design of an automated system to determine the reason for hypoglycemia.

Results

Physical activity contributed to 45% of hypoglycemia reasons on the real world collected data. The statistical analysis provided a number of interpretable predictors of different hypoglycemia reasons based on self-care behaviors. The classification analysis showed the performance of a reasoning system in practical settings with different objectives under F1-score, recall and precision metrics.

Conclusion

The data acquisition characterized the incidence distribution of the various hypoglycemia reasons. The analyses highlighted many interpretable predictors of the various hypoglycemia types. Also, the feasibility study presented a number of concerns valuable in the design of the decision support system for automatic hypoglycemia reason classification. Therefore, automating the identification of the causes of hypoglycemia may help objectively to target behavioral and therapeutic changes in patients' care.

From Reflection to Action: Combining Machine Learning with Expert Knowledge for Nutrition Goal Recommendations

Self-tracking can help personalize self-management interventions for chronic conditions like type 2 diabetes (T2D), but reflecting on personal data requires motivation and literacy. Machine learning (ML) methods can identify patterns, but a key challenge is making actionable suggestions based on personal health data. We introduce GlucoGoalie, which combines ML with an expert system to translate ML output into personalized nutrition goal suggestions for individuals with T2D. In a controlled experiment, participants with T2D found that goal suggestions were understandable and actionable. A 4-week in-the-wild deployment study showed that receiving goal suggestions augmented participants' self-discovery, choosing goals highlighted the multifaceted nature of personal preferences, and the experience of following goals demonstrated the importance of feedback and context. However, we identified tensions between abstract goals and concrete eating experiences and found static text too ambiguous for complex concepts. We discuss implications for ML-based interventions and the need for systems that offer more interactivity, feedback, and negotiation.

Automated vs. Human Health Coaching: Exploring Participant and Practitioner Experiences

Health coaching can be an effective intervention to support self-management of chronic conditions like diabetes, but there are not enough coaching practitioners to reach the growing population in need of support. Conversational technology, like chatbots, presents an opportunity to extend health coaching support to broader and more diverse populations. However, some have suggested that the human element is essential to health coaching and cannot be replicated with technology. In this research, we examine automated health coaching using a theory-grounded, wizard-of-oz chatbot, in comparison with text-based virtual coaching from human practitioners who start with the same protocol as the chatbot but have the freedom to embellish and adjust as needed. We found that even a scripted chatbot can create a coach-like experience for participants. While human coaches displayed advantages expressing empathy and using probing questions to tailor their support, they also encountered tremendous barriers and frustrations adapting to text-based virtual coaching. The chatbot coach had advantages in being persistent, as well as more consistently giving choices and options to foster client autonomy. We discuss implications for the design of virtual health coaching interventions.

Self-monitoring diabetes with multiple mobile health devices

OBJECTIVE

The purpose of this study was to examine the use of multiple mobile health technologies to generate and transmit data from diverse patients with type 2 diabetes mellitus (T2DM) in between clinic visits. We examined the data to identify patterns that describe characteristics of patients for clinical insights.

METHODS

We enrolled 60 adults with T2DM from a US healthcare system to participate in a 6-month longitudinal feasibility trial. Patient weight, physical activity, and blood glucose were self-monitored via devices provided at baseline. Patients also responded to biweekly medication adherence text message surveys. Data were aggregated in near real-time. Measures of feasibility assessing total engagement in device submissions and survey completion over the 6 months of observation were calculated.

RESULTS

It was feasible for participants from different socioeconomic, educational, and racial backgrounds to use and track relevant diabetes-related data from multiple mobile health devices for at least 6 months. Both the transmission and engagement of the data revealed notable patterns and varied by patient characteristics.

DISCUSSION

Using multiple mobile health tools allowed us to derive clinical insights from diverse patients with diabetes. The ubiquitous adoption of smartphones across racial, educational, and socioeconomic populations and the integration of data from mobile health devices into electronic health records present an opportunity to develop new models of care delivery for patients with T2DM that may promote equity as well.

Enabling personalized decision support with patient-generated data and attributable components

Decision-making related to health is complex. Machine learning (ML) and patient generated data can identify patterns and insights at the individual level, where human cognition falls short, but not all ML-generated information is of equal utility for making health-related decisions. We develop and apply attributable components analysis (ACA), a method inspired by optimal transport theory, to type 2 diabetes self-monitoring data to identify patterns of association between nutrition and blood glucose control. In comparison with linear regression, we found that ACA offers a number of characteristics that make it promising for use in decision support applications. For example, ACA was able to identify non-linear relationships, was more robust to outliers, and offered broader and more expressive uncertainty estimates. In addition, our results highlight a tradeoff between model accuracy and interpretability, and we discuss implications for ML-driven decision support systems.

Enabling Better Use of Person-Generated Health Data in Stroke Rehabilitation Systems: Systematic Development of Design Heuristics

BACKGROUND

An established and well-known method for usability assessment of various human-computer interaction technologies is called heuristic evaluation (HE). HE has been adopted for evaluations in a wide variety of specialized contexts and with objectives that go beyond usability. A set of heuristics to evaluate how health information technologies (HITs) incorporate features that enable effective patient use of person-generated health data (PGHD) is needed in an era where there is a growing demand and variety of PGHD-enabled technologies in health care and where a number of remote patient-monitoring technologies do not yet enable patient use of PGHD. Such a set of heuristics would improve the likelihood of positive effects from patients' use of PGHD and lower the risk of negative effects.

OBJECTIVE

This study aims to describe the development of a set of heuristics for the design and evaluation of how well remote patient therapeutic technologies enable patients to use PGHD (PGHD enablement). We used the case of Kinect-based stroke rehabilitation systems (K-SRS) in this study.

METHODS

The development of a set of heuristics to enable better use of PGHD was primarily guided by the R3C methodology. Closer inspection of the methodology reveals that neither its development nor its application to a case study were described in detail. Thus, where relevant, each step was grounded through best practice activities in the literature and by using Nielsen's heuristics as a basis for determining the new set of heuristics. As such, this study builds on the R3C methodology, and the implementation of a mixed process is intended to result in a robust and credible set of heuristics.

RESULTS

A total of 8 new heuristics for PGHD enablement in K-SRS were created. A systematic and detailed process was applied in each step of heuristic development, which bridged the gaps described earlier. It is hoped that this would aid future developers of specialized heuristics, who could apply the detailed process of heuristic development for other domains of technology, and additionally for the case of PGHD enablement for other health conditions. The R3C methodology was also augmented through the use of qualitative studies with target users and domain experts, and it is intended to result in a robust and credible set of heuristics, before validation and refinement.

CONCLUSIONS

This study is the first to develop a new set of specialized heuristics to evaluate how HITs incorporate features that enable effective patient use of PGHD, with K-SRS as a key case study. In addition, it is the first to describe how the identification of initial HIT features and concepts to enable PGHD could lead to the development of a specialized set of heuristics.

A new approach to integrating patient-generated data with expert knowledge for personalized goal setting: A pilot study

INTRODUCTION

Self-monitoring technologies produce patient-generated data that could be leveraged to personalize nutritional goal setting to improve population health; however, most computational approaches are limited when applied to individual-level personalization with sparse and irregular self-monitoring data. We applied informatics methods from expert suggestion systems to a challenging clinical problem: generating personalized nutrition goals from patient-generated diet and blood glucose data.

MATERIALS AND METHODS

We applied qualitative process coding and decision tree modeling to understand how registered dietitians translate patient-generated data into recommendations for dietary self-management of diabetes (i.e., knowledge model). We encoded this process in a set of functions that take diet and blood glucose data as an input and output diet recommendations (i.e., inference engine). Dietitians assessed face validity. Using four patient datasets, we compared our inference engine's output to clinical narratives and gold standards developed by expert clinicians.

RESULTS

To dietitians, the knowledge model represented how recommendations from patient data are made. Inference engine recommendations were 63 % consistent with the gold standard (range = 42 %-75 %) and 74 % consistent with narrative clinical observations (range = 63 %-83 %).

DISCUSSION

Qualitative modeling and automating how dietitians reason over patient data resulted in a knowledge model representing clinical knowledge. However, our knowledge model was less consistent with gold standard than narrative clinical recommendations, raising questions about how best to evaluate approaches that integrate patient-generated data with expert knowledge.

CONCLUSION

New informatics approaches that integrate data-driven methods with expert decision making for personalized goal setting, such as the knowledge base and inference engine presented here, demonstrate the potential to extend the reach of patient-generated data by synthesizing it with clinical knowledge. However, important questions remain about the strengths and weaknesses of computer algorithms developed to discern signal from patient-generated data compared to human experts.

Making sense of blood glucose data and self-management in individuals with type 2 diabetes mellitus: A qualitative study

AIMS AND OBJECTIVES

To describe individuals' with type 2 diabetes mellitus sense-making of blood glucose data and other influences impacting self-management behaviour.

BACKGROUND

Type 2 diabetes mellitus prevalence is increasing globally. Adherence to effective diabetes self-management regimens is an ongoing healthcare challenge. Examining individuals' sense-making processes can advance staff knowledge of and improve diabetes self-management behaviour.

DESIGN

A qualitative exploratory design examining how individuals make sense of blood glucose data and symptoms, and the influence on self-management decisions.

METHODS

Sixteen one-on-one interviews with adults diagnosed with type 2 diabetes mellitus using a semi-structured interview guide were conducted from March-May 2018. An inductive-deductive thematic analysis of data using the Sensemaking Framework for Chronic Disease Self-Management was used. The consolidated criteria for reporting qualitative research (COREQ) checklist were used in completing this paper.

RESULTS

Three main themes described participants' type 2 diabetes mellitus sense-making and influences on self-management decisions: classifying blood glucose data, building mental models and making self-management decisions. Participants classified glucose levels based on prior personal experiences. Participants learned about diabetes from classes, personal experience, health information technology and their social network. Seven participants expressed a need for periodic refreshing of diabetes knowledge.

CONCLUSION

Individuals use self-monitored glucose values and/or HbA1C values to evaluate glucose control. When using glucose values, they analyse the context in which the value was obtained through the lens of personal parameters and expectations. Understanding how individuals make sense of glycaemic data and influences on diabetes self-management behaviour with periodic reassessment of this understanding can guide the healthcare team in optimising collaborative individualised care plans.

RELEVANCE TO CLINICAL PRACTICE

Nurses must assess sense-making processes in self-management decisions. Periodic "refresher" diabetes education may be needed for individuals with type 2 diabetes mellitus.

A visual analytics approach for pattern-recognition in patient-generated data

Objective

To develop and test a visual analytics tool to help clinicians identify systematic and clinically meaningful patterns in patient-generated data (PGD) while decreasing perceived information overload.

Methods

Participatory design was used to develop Glucolyzer, an interactive tool featuring hierarchical clustering and a heatmap visualization to help registered dietitians (RDs) identify associative patterns between blood glucose levels and per-meal macronutrient composition for individuals with type 2 diabetes (T2DM). Ten RDs participated in a within-subjects experiment to compare Glucolyzer to a static logbook format. For each representation, participants had 25 minutes to examine 1 month of diabetes self-monitoring data captured by an individual with T2DM and identify clinically meaningful patterns. We compared the quality and accuracy of the observations generated using each representation.

Results

Participants generated 50% more observations when using Glucolyzer (98) than when using the logbook format (64) without any loss in accuracy (69% accuracy vs 62%, respectively, p = .17). Participants identified more observations that included ingredients other than carbohydrates using Glucolyzer (36% vs 16%, p = .027). Fewer RDs reported feelings of information overload using Glucolyzer compared to the logbook format. Study participants displayed variable acceptance of hierarchical clustering.

Conclusions

Visual analytics have the potential to mitigate provider concerns about the volume of self-monitoring data. Glucolyzer helped dietitians identify meaningful patterns in self-monitoring data without incurring perceived information overload. Future studies should assess whether similar tools can support clinicians in personalizing behavioral interventions that improve patient outcomes.

Designing for engagement with self-monitoring: A user-centered approach with low-income, Latino adults with Type 2 Diabetes

BACKGROUND AND SIGNIFICANCE

Data-driven interventions for health can help to personalize self-management of Type 2 Diabetes (T2D), but lack of sustained engagement with self-monitoring among disadvantaged populations may widen existing health disparities. Prior work developing approaches to increase motivation and engagement with self-monitoring holds promise, but little is known about applicability of these approaches to underserved populations.

OBJECTIVE

To explore how low-income, Latino adults with T2D respond to different design concepts for data-driven solutions in health that require self-monitoring, and what features resonate with them the most.

MATERIAL AND METHODS

We developed a set of mockups that incorporated different design features for promoting engagement with self-monitoring in T2D. We conducted focus groups to examine individuals' perceptions and attitudes towards mockups. Multiple interdisciplinary researchers analyzed data using directed content analysis.

RESULTS

We conducted 14 focus groups with 25 English- and Spanish-speaking adults with T2D. All participants reacted positively to external incentives. Social connectedness and healthcare expert feedback were also well liked because they enhanced current social practices and presented opportunities for learning. However, attitudes were more mixed towards goal setting, and very few participants responded positively to self-discovery and personalized decision support features. Instead, participants wished for personalized recommendations for meals and other health behaviors based on their personal health data.

CONCLUSION

This study suggests connections between individuals' degree of internal motivation and motivation for self-monitoring in health and their attitude towards designs of self-monitoring apps. We relate our findings to the self-determination continuum in self-determination theory (SDT) and propose it as a blueprint for aligning incentives for self-monitoring to different levels of motivation.

The parameter Houlihan: A solution to high-throughput identifiability indeterminacy for brutally ill-posed problems

One way to interject knowledge into clinically impactful forecasting is to use data assimilation, a nonlinear regression that projects data onto a mechanistic physiologic model, instead of a set of functions, such as neural networks. Such regressions have an advantage of being useful with particularly sparse, non-stationary clinical data. However, physiological models are often nonlinear and can have many parameters, leading to potential problems with parameter identifiability, or the ability to find a unique set of parameters that minimize forecasting error. The identifiability problems can be minimized or eliminated by reducing the number of parameters estimated, but reducing the number of estimated parameters also reduces the flexibility of the model and hence increases forecasting error. We propose a method, the parameter Houlihan, that combines traditional machine learning techniques with data assimilation, to select the right set of model parameters to minimize forecasting error while reducing identifiability problems. The method worked well: the data assimilation-based glucose forecasts and estimates for our cohort using the Houlihan-selected parameter sets generally also minimize forecasting errors compared to other parameter selection methods such as by-hand parameter selection. Nevertheless, the forecast with the lowest forecast error does not always accurately represent physiology, but further advancements of the algorithm provide a path for improving physiologic fidelity as well. Our hope is that this methodology represents a first step toward combining machine learning with data assimilation and provides a lower-threshold entry point for using data assimilation with clinical data by helping select the right parameters to estimate.

Academy of Nutrition and Dietetics: Revised 2017 Standards of Practice and Standards of Professional Performance for Registered Dietitian Nutritionists (Competent, Proficient, and Expert) in Diabetes Care

There are 30.3 million people with diabetes and 86 million with prediabetes in the United States, underscoring the growing need for comprehensive diabetes care and nutrition for the management of diabetes and diabetes-related conditions. Management of diabetes is also critical for the prevention of diabetes-related complications such as cardiovascular and renal disease. The Diabetes Care and Education Dietetic Practice Group along with the Academy of Nutrition and Dietetics Quality Management Committee have updated the Standards of Practice (SOP) and Standards of Professional Performance (SOPP) for Registered Dietitian Nutritionists (RDNs) in Diabetes Care. The SOP and SOPP for RDNs in Diabetes Care provide indicators that describe three levels of practice: competent, proficient, and expert. The SOP utilizes the Nutrition Care Process and clinical workflow elements for care and management of those with diabetes and prediabetes. The SOPP describes six domains that focus on professionalism: Quality in Practice, Competence and Accountability, Provision of Services, Application of Research, Communication and Application of Knowledge, and Utilization and Management of Resources. Specific indicators outlined in the SOP and SOPP depict how these standards apply to practice. The SOP and SOPP are complementary resources for RDNs caring for individuals with diabetes or specializing in diabetes care or practicing in other diabetes-related areas, including research. The SOP and SOPP are intended to be used for RDN self-evaluation for ensuring competent practice and for determining potential education and training needs for advancement to a higher practice level in a variety of settings.

Measuring the outcomes of using person-generated health data: a case study of developing a PROM item bank

INTRODUCTION

Patient-reported outcome measures (PROMs) allow patients to self-report the status of their health condition or experience independently. A key area for PROMs to contribute in building the evidence base is in understanding the effects of using person-generated health data (PGHD), and using PROMs to measure outcomes of using PGHD has been suggested in the literature. Key considerations inherent in the stroke rehabilitation context makes the measurement of PGHD outcomes in home-based poststroke rehabilitation, which uses body-tracking technologies, an important use case.

OBJECTIVE

This paper describes the development of a preliminary item bank of a PROM-PGHD for Kinect-based stroke rehabilitation systems (K-SRS), or PROM-PGHD for K-SRS.

METHODS

The authors designed a method to develop PROMs of using PGHD, or PROM-PGHD. The PROM-PGHD Development Method was designed by augmenting a key PROM development process, the Qualitative Item Review, and follows PROM development best practice. It has five steps, namely, literature review; binning and winnowing; initial item revision; eliciting patient input and final item Revision.

RESULTS

A preliminary item bank of the PROM-PGHD for K-SRS is presented. This is the result of implementing the first three steps of the PROM-PGHD Development Method within the domains of interest, that is, stroke and Kinect-based simulated rehabilitation.

CONCLUSIONS

This paper has set out a case study of our method, showing what needs to be done to ensure that the PROM-PGHD items are suited to the health condition and technology category. We described it as a case study because we argue that it is possible for the PROM-PGHD method to be used by others to measure effects of PGHD utilisation in other cases of health conditions and technology categories. Hence, it offers generalisability and has broader clinical relevance for evidence-based practice with PGHD. This paper is the first to offer a case study of developing a PROM-PGHD.

Mechanistic machine learning: how data assimilation leverages physiologic knowledge using Bayesian inference to forecast the future, infer the present, and phenotype

We introduce data assimilation as a computational method that uses machine learning to combine data with human knowledge in the form of mechanistic models in order to forecast future states, to impute missing data from the past by smoothing, and to infer measurable and unmeasurable quantities that represent clinically and scientifically important phenotypes. We demonstrate the advantages it affords in the context of type 2 diabetes by showing how data assimilation can be used to forecast future glucose values, to impute previously missing glucose values, and to infer type 2 diabetes phenotypes. At the heart of data assimilation is the mechanistic model, here an endocrine model. Such models can vary in complexity, contain testable hypotheses about important mechanics that govern the system (eg, nutrition's effect on glucose), and, as such, constrain the model space, allowing for accurate estimation using very little data.

High-fidelity phenotyping: richness and freedom from bias

Electronic health record phenotyping is the use of raw electronic health record data to assert characterizations about patients. Researchers have been doing it since the beginning of biomedical informatics, under different names. Phenotyping will benefit from an increasing focus on fidelity, both in the sense of increasing richness, such as measured levels, degree or severity, timing, probability, or conceptual relationships, and in the sense of reducing bias. Research agendas should shift from merely improving binary assignment to studying and improving richer representations. The field is actively researching new temporal directions and abstract representations, including deep learning. The field would benefit from research in nonlinear dynamics, in combining mechanistic models with empirical data, including data assimilation, and in topology. The health care process produces substantial bias, and studying that bias explicitly rather than treating it as merely another source of noise would facilitate addressing it.

Personal discovery in diabetes self-management: Discovering cause and effect using self-monitoring data

OBJECTIVE

To outline new design directions for informatics solutions that facilitate personal discovery with self-monitoring data. We investigate this question in the context of chronic disease self-management with the focus on type 2 diabetes.

MATERIALS AND METHODS

We conducted an observational qualitative study of discovery with personal data among adults attending a diabetes self-management education (DSME) program that utilized a discovery-based curriculum. The study included observations of class sessions, and interviews and focus groups with the educator and attendees of the program (n = 14).

RESULTS

The main discovery in diabetes self-management evolved around discovering patterns of association between characteristics of individuals' activities and changes in their blood glucose levels that the participants referred to as "cause and effect". This discovery empowered individuals to actively engage in self-management and provided a desired flexibility in selection of personalized self-management strategies. We show that discovery of cause and effect involves four essential phases: (1) feature selection, (2) hypothesis generation, (3) feature evaluation, and (4) goal specification. Further, we identify opportunities to support discovery at each stage with informatics and data visualization solutions by providing assistance with: (1) active manipulation of collected data (e.g., grouping, filtering and side-by-side inspection), (2) hypotheses formulation (e.g., using natural language statements or constructing visual queries), (3) inference evaluation (e.g., through aggregation and visual comparison, and statistical analysis of associations), and (4) translation of discoveries into actionable goals (e.g., tailored selection from computable knowledge sources of effective diabetes self-management behaviors).

DISCUSSION

The study suggests that discovery of cause and effect in diabetes can be a powerful approach to helping individuals to improve their self-management strategies, and that self-monitoring data can serve as a driving engine for personal discovery that may lead to sustainable behavior changes.

CONCLUSIONS

Enabling personal discovery is a promising new approach to enhancing chronic disease self-management with informatics interventions.

Personalized glucose forecasting for type 2 diabetes using data assimilation

Type 2 diabetes leads to premature death and reduced quality of life for 8% of Americans. Nutrition management is critical to maintaining glycemic control, yet it is difficult to achieve due to the high individual differences in glycemic response to nutrition. Anticipating glycemic impact of different meals can be challenging not only for individuals with diabetes, but also for expert diabetes educators. Personalized computational models that can accurately forecast an impact of a given meal on an individual's blood glucose levels can serve as the engine for a new generation of decision support tools for individuals with diabetes. However, to be useful in practice, these computational engines need to generate accurate forecasts based on limited datasets consistent with typical self-monitoring practices of individuals with type 2 diabetes. This paper uses three forecasting machines: (i) data assimilation, a technique borrowed from atmospheric physics and engineering that uses Bayesian modeling to infuse data with human knowledge represented in a mechanistic model, to generate real-time, personalized, adaptable glucose forecasts; (ii) model averaging of data assimilation output; and (iii) dynamical Gaussian process model regression. The proposed data assimilation machine, the primary focus of the paper, uses a modified dual unscented Kalman filter to estimate states and parameters, personalizing the mechanistic models. Model selection is used to make a personalized model selection for the individual and their measurement characteristics. The data assimilation forecasts are empirically evaluated against actual postprandial glucose measurements captured by individuals with type 2 diabetes, and against predictions generated by experienced diabetes educators after reviewing a set of historical nutritional records and glucose measurements for the same individual. The evaluation suggests that the data assimilation forecasts compare well with specific glucose measurements and match or exceed in accuracy expert forecasts. We conclude by examining ways to present predictions as forecast-derived range quantities and evaluate the comparative advantages of these ranges.

Integrating Patient-Generated Health Data Into Clinical Care Settings or Clinical Decision-Making: Lessons Learned From Project HealthDesign

Background

Patient-generated health data (PGHD) are health-related data created or recorded by patients to inform their self-care and understanding about their own health. PGHD is different from other patient-reported outcome data because the collection of data is patient-driven, not practice- or research-driven. Technical applications for assisting patients to collect PGHD supports self-management activities such as healthy eating and exercise and can be important for preventing and managing disease. Technological innovations (eg, activity trackers) are making it more common for people to collect PGHD, but little is known about how PGHD might be used in outpatient clinics.

Objective

The objective of our study was to examine the experiences of health care professionals who use PGHD in outpatient clinics.

Methods

We conducted an evaluation of Project HealthDesign Round 2 to synthesize findings from 5 studies funded to test tools designed to help patients collect PGHD and share these data with members of their health care team. We conducted semistructured interviews with 13 Project HealthDesign study team members and 12 health care professionals that participated in these studies. We used an immersion-crystallization approach to analyze data. Our findings provide important information related to health care professionals’ attitudes toward and experiences with using PGHD in a clinical setting.

Results

Health care professionals identified 3 main benefits of PGHD accessibility in clinical settings: (1) deeper insight into a patient’s condition; (2) more accurate patient information, particularly when of clinical relevance; and (3) insight into a patient’s health between clinic visits, enabling revision of care plans for improved health goal achievement, while avoiding unnecessary clinic visits. Study participants also identified 3 areas of consideration when implementing collection and use of PGHD data in clinics: (1) developing practice workflows and protocols related to PGHD collection and use; (2) data storage, accessibility at the point of care, and privacy concerns; and (3) ease of using PGHD data.

Conclusions

PGHD provides value to both patients and health care professionals. However, more research is needed to understand the benefit of using PGHD in clinical care and to identify the strategies and clinic workflow needs for optimizing these tools.