The Use of Computer Simulation Modeling to Estimate Complications in Patients with Type 2 Diabetes Mellitus: Comparative Validation of the Cornerstone Diabetes Simulation Model

The Determination of Diabetes Utilities, Costs, and Effects Model: A Cost-Utility Tool Using Patient-Level Microsimulation to Evaluate Sensor-Based Glucose Monitoring Systems in Type 1 and Type 2 Diabetes: Comparative Validation

OBJECTIVES

To assess the accuracy and validity of the Determination of Diabetes Utilities, Costs, and Effects (DEDUCE) model, a Microsoft-Excel-based tool for evaluating diabetes interventions for type 1 and type 2 diabetes.

METHODS

The DEDUCE model is a patient-level microsimulation, with complications predicted based on the Sheffield and Risk Equations for Complications Of type 2 diabetes models for type 1 and type 2 diabetes, respectively. For this tool to be useful, it must be validated to ensure that its complication predictions are accurate. Internal, external, and cross-validation was assessed by populating the DEDUCE model with the baseline characteristics and treatment effects reported in clinical trials used in the Fourth, Fifth, and Ninth Mount Hood Diabetes Challenges. Results from the DEDUCE model were evaluated against clinical results and previously validated models via mean absolute percentage error or percentage error.

RESULTS

The DEDUCE model performed favorably, predicting key outcomes, including cardiovascular disease in type 1 diabetes and all-cause mortality in type 2 diabetes. The model performed well against other models. In the Mount Hood 9 Challenge comparison, error was below the mean reported from comparator models for several outcomes, particularly for hazard ratios.

CONCLUSIONS

The DEDUCE model predicts diabetes-related complications from trials and studies well when compared with previously validated models. The model may serve as a useful tool for evaluating the cost-effectiveness of diabetes technologies.

A Systematic Review of Methodologies Used in Models of the Treatment of Diabetes Mellitus

BACKGROUND

Diabetes mellitus is a chronic and complex disease, increasing in prevalence and consequent health expenditure. Cost-effectiveness models with long time horizons are commonly used to perform economic evaluations of diabetes' treatments. As such, prediction accuracy and structural uncertainty are important features in cost-effectiveness models of chronic conditions.

OBJECTIVES

The aim of this systematic review is to identify and review published cost-effectiveness models of diabetes treatments developed between 2011 and 2022 regarding their methodological characteristics. Further, it also appraises the quality of the methods used, and discusses opportunities for further methodological research.

METHODS

A systematic literature review was conducted in MEDLINE and Embase to identify peer-reviewed papers reporting cost-effectiveness models of diabetes treatments, with time horizons of more than 5 years, published in English between 1 January 2011 and 31 of December 2022. Screening, full-text inclusion, data extraction, quality assessment and data synthesis using narrative synthesis were performed. The Philips checklist was used for quality assessment of the included studies. The study was registered in PROSPERO (CRD42021248999).

RESULTS

The literature search identified 30 studies presenting 29 unique cost-effectiveness models of type 1 and/or type 2 diabetes treatments. The review identified 26 type 2 diabetes mellitus (T2DM) models, 3 type 1 DM (T1DM) models and one model for both types of diabetes. Fifteen models were patient-level models, whereas 14 were at cohort level. Parameter uncertainty was assessed thoroughly in most of the models, whereas structural uncertainty was seldom addressed. All the models where validation was conducted performed well. The methodological quality of the models with respect to structure was high, whereas with respect to data modelling it was moderate.

CONCLUSIONS

Models developed in the past 12 years for health economic evaluations of diabetes treatments are of high-quality and make use of advanced methods. However, further developments are needed to improve the statistical modelling component of cost-effectiveness models and to provide better assessment of structural uncertainty.

Prediction of complications in health economic models of type 2 diabetes: a review of methods used

AIM

Diabetes health economic (HE) models play important roles in decision making. For most HE models of diabetes 2 diabetes (T2D), the core model concerns the prediction of complications. However, reviews of HE models pay little attention to the incorporation of prediction models. The objective of the current review is to investigate how prediction models have been incorporated into HE models of T2D and to identify challenges and possible solutions.

METHODS

PubMed, Web of Science, Embase, and Cochrane were searched from January 1, 1997, to November 15, 2022, to identify published HE models for T2D. All models that participated in The Mount Hood Diabetes Simulation Modeling Database or previous challenges were manually searched. Data extraction was performed by two independent authors. Characteristics of HE models, their underlying prediction models, and methods of incorporating prediction models were investigated.

RESULTS

The scoping review identified 34 HE models, including a continuous-time object-oriented model (n = 1), discrete-time state transition models (n = 18), and discrete-time discrete event simulation models (n = 15). Published prediction models were often applied to simulate complication risks, such as the UKPDS (n = 20), Framingham (n = 7), BRAVO (n = 2), NDR (n = 2), and RECODe (n = 2). Four methods were identified to combine interdependent prediction models for different complications, including random order evaluation (n = 12), simultaneous evaluation (n = 4), the 'sunflower method' (n = 3), and pre-defined order (n = 1). The remaining studies did not consider interdependency or reported unclearly.

CONCLUSIONS

The methodology of integrating prediction models in HE models requires further attention, especially regarding how prediction models are selected, adjusted, and ordered.

The challenges and pitfalls of incorporating evidence from cardiovascular outcomes trials in health economic modelling of type 2 diabetes

The clinical evidence base for evaluating modern type 2 diabetes interventions has expanded greatly in recent years, with numerous efficacious treatment options available (including dipeptidyl peptidase-4 inhibitors, glucagon-like peptide-1 receptor agonists and sodium-glucose cotransporter-2 inhibitors). The cardiovascular safety of these interventions has been assessed individually versus placebo in numerous cardiovascular outcomes trials (CVOTs), statistically powered to detect differences in a composite endpoint of major adverse cardiovascular events. There have been growing calls to incorporate these data in the long-term modelling of type 2 diabetes interventions because current diabetes models were developed prior to the conduct of the CVOTs and therefore rely on risk equations developed in the absence of these data. However, there are numerous challenges and pitfalls to avoid when using data from CVOTs. The primary concerns are around the heterogeneity of the trials, which have different study durations, inclusion criteria, rescue medication protocols and endpoint definitions; this results in significant uncertainty when comparing two or more interventions evaluated in separate CVOTs, as robust adjustment for these differences is difficult. Analyses using CVOT data inappropriately can dilute clear evidence from head-to-head clinical trials, and blur healthcare decision making. Calibration of existing models may represent an approach to incorporating CVOT data into diabetes modelling, but this can only offer a valid comparison of one intervention versus placebo based on a single CVOT. Ideally, model development should utilize patient-level data from CVOTs to prepare novel risk equations that can better model modern therapies for type 2 diabetes.

A review of simulation models for the long-term management of type 2 diabetes in low-and-middle income countries

INTRODUCTION

The burden of type 2 diabetes is steadily increasing in low-and-middle-income countries, thereby posing a major threat from both a treatment, and funding standpoint. Although simulation modelling is generally relied upon for evaluating long-term costs and consequences associated with diabetes interventions, no recent article has reviewed the characteristics and capabilities of available models used in low-and-middle-income countries. We review the use of computer simulation modelling for the management of type 2 diabetes in low-and-middle-income countries.

METHODS

A search for studies reporting computer simulation models of the natural history of individuals with type 2 diabetes and/or decision models to evaluate the impact of treatment strategies on these populations was conducted in PubMed. Data were extracted following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines and assessed using modelling checklists. Publications before the year 2000, from high-income countries, studies involving animals and analyses that did not use mathematical simulations were excluded. The full text of eligible articles was sourced and information about the intervention and population being modelled, type of modelling approach and the model structure was extracted.

RESULTS

Of the 79 articles suitable for full text review, 44 studies met the inclusion criteria. All were cost-effectiveness/utility studies with the majority being from the East Asia and Pacific region (n = 29). Of the included studies, 34 (77.3%) evaluated the cost-effectiveness of pharmacological interventions and approximately 75% of all included studies used HbA1c as one of the treatment effects of the intervention. 32 (73%) of the publications were microsimulation models, and 29 (66%) were state-transition models. Most of the studies utilised annual cycles (n = 29, 71%), and accounted for costs and outcomes over 20 years or more (n = 38, 86.4%).

CONCLUSIONS

While the use of simulation modelling in the management of type 2 diabetes has been steadily increasing in low-and-middle-income countries, there is an urgent need to invest in evaluating therapeutic and policy interventions related to type 2 diabetes in low-and-middle-income countries through simulation modelling, especially with local research data. Moreover, it is important to improve transparency and credibility in the reporting of input data underlying model-based economic analyses, and studies.

Decision models in type 2 diabetes mellitus: A systematic review

AIMS

To reduce the burden of type 2 diabetes (T2DM), the disease decision model plays a vital role in supporting decision-making. Currently, there is no comprehensive summary and assessment of the existing decision models for T2DM. The objective of this review is to provide an overview of the characteristics and capabilities of published decision models for T2DM. We also discuss which models are suitable for different study demands.

MATERIALS AND METHODS

Four databases (PubMed, Web of Science, Embase, and the Cochrane Library) were electronically searched for papers published from inception to August 2020. Search terms were: "Diabetes-Mellitus, Type 2", "cost-utility", "quality-of-life", and "decision model". Reference lists of the included studies were manually searched. Two reviewers independently screened the titles and abstracts following the inclusion and exclusion criteria. If there was insufficient information to include or exclude a study, then a full-text version was sought. The extracted information included basic information, study details, population characteristics, basic modeling methodologies, model structure, and data inputs for the included applications, model outcomes, model validation, and uncertainty.

RESULTS

Fourteen unique decision models for T2DM were identified. Markov chains and risk equations were utilized by four and three models, respectively. Three models utilized both. Except for the Archimedes model, all other models (n = 13) implemented an annual cycle length. The time horizon of most models was flexible. Fourteen models had differences in the division of health states. Ten models emphasized macrovascular and microvascular complications. Six models included adverse events. Majority of the models (n = 11) were patient-level simulation models. Eleven models simulated annual changes in risk factors (body mass index, glycemia, HbA1c, blood pressure (systolic and/or diastolic), and lipids (total cholesterol and/or high-density lipoprotein)). All models reported the main data sources used to develop health states of complications. Most models (n = 11) could deal with the uncertainty of models, which were described in varying levels of detail in the primary studies. Eleven studies reported that one or more validation checks were performed.

CONCLUSIONS

The existing decision models for T2DM are heterogeneous in terms of the level of detail in the classification of health states. Thus, more attention should be focused on balancing the desired level of complexity against the required level of transparency in the development of T2DM decision models.

Effect of Liver Kinase B1 on Osteogenic/Adipogenic Differentiation of Bone Marrow Mesenchymal Stem Cells in High Glucose Environment

Bone marrow mesenchymal stem cells (BMSCs) present reduced proliferation under high glucose condition. Liver kinase B1 (LKB1) can maintain the homeostasis of hematopoietic stem cells. However, whether LKB1 regulates BMSCs osteogenic/adipogenic differentiation under high glucose is unclear. Rat BMSCs were isolated and separated into control group, high glucose group, and LKB1 group (BMSCs were transfected with pc-DNA 3.1-LKB1 plasmid under high glucose condition) followed by analysis of LKB1 expression by Real time PCR and Western blot, osteocalcin, type I collagen, RUNX2 and OPN mRNA level by real-time PCR, FABP4 and PPARγ2 level by western blot. In high glucose group, LKB1 expression was significantly decreased, with reduced expression of osteocalcin, type I collagen, RUNX2 and OPN mRNA and elevated FABP4 and PPARγ2 level compared to control group (P < 0.05). Transfection of LKB1 plasmid reduced LKB1 expression, upregulated osteocalcin, type I collagen, RUNX2 and OPN mRNA and downregulated FABP4 and PPARγ2. Compared with the high glucose group, there was a statistical difference (P <0.05). High glucose can inhibit LKB1 expression and BMSCs osteogenic differentiation, and promote adipogenic differentiation. Upregulating LKB1 expression can promote BMSCs osteogenic differentiation.

Economic Simulation Modeling in Type 2 Diabetes

PURPOSE OF REVIEW

This paper provides an overview of type 2 diabetes economic simulation modeling and reviews current topics of discussion and major challenges in the field.

RECENT FINDINGS

Important challenges in the field include increasing the generalizability of models and improving transparency in model reporting. To identify and address these issues, modeling groups have organized through the Mount Hood Diabetes Challenge meetings and developed tools (i.e., checklist, impact inventory) to standardize modeling methods and reporting of results. Accordingly, many newer diabetes models have begun utilizing these tools, allowing for improved comparability between diabetes models. In the last two decades, type 2 diabetes simulation models have improved considerably, due to the collaborative work performed through the Mount Hood Diabetes Challenge meetings. To continue to improve diabetes models, future work must focus on clarifying diabetes progression in racial/ethnic minorities and incorporating equity considerations into health economic analysis.