Variation of Mean Absolute Relative Differences of Continuous Glucose Monitoring Systems Throughout the Day

Continuous Glucose Deviation Interval and Variability Analysis (CG-DIVA): A Novel Approach for the Statistical Accuracy Assessment of Continuous Glucose Monitoring Systems

BACKGROUND

The accuracy of continuous glucose monitoring (CGM) systems is crucial for the management of glucose levels in individuals with diabetes mellitus. However, the discussion of CGM accuracy is challenged by an abundance of parameters and assessment methods. The aim of this article is to introduce the Continuous Glucose Deviation Interval and Variability Analysis (CG-DIVA), a new approach for a comprehensive characterization of CGM point accuracy which is based on the U.S. Food and Drug Administration requirements for "integrated" CGM systems.

METHODS

The statistical concept of tolerance intervals and data from two approved CGM systems was used to illustrate the CG-DIVA.

RESULTS

The CG-DIVA characterizes the expected range of deviations of the CGM system from a comparison method in different glucose concentration ranges and the variability of accuracy within and between sensors. The results of the CG-DIVA are visualized in an intuitive and straightforward graphical presentation. Compared with conventional accuracy characterizations, the CG-DIVA infers the expected accuracy of a CGM system and highlights important differences between CGM systems. Furthermore, it provides information on the incidence of large errors which are of particular clinical relevance. A software implementation of the CG-DIVA is freely available (https://github.com/IfDTUlm/CGM_Performance_Assessment).

CONCLUSIONS

We argue that the CG-DIVA can simplify the discussion and comparison of CGM accuracy and could replace the high number of conventional approaches. Future adaptations of the approach could thus become a putative standard for the accuracy characterization of CGM systems and serve as the basis for the definition of future CGM performance requirements.

User Performance Evaluation and System Accuracy Assessment of Four Blood Glucose Monitoring Systems With Color Coding of Measurement Results

BACKGROUND

Blood glucose monitoring systems (BGMSs) are a cornerstone in diabetes management. They have to provide sufficiently accurate results in the hands of lay users, particularly in insulin-treated patients. The aim of this study was user performance evaluation and system accuracy assessment of four BGMSs with color coding of results.

METHODS

Study procedures were based on ISO 15197:2013. User performance evaluation included data from 100 participants, each of whom used every system with one reagent lot. Study personnel observed user techniques. For the system accuracy assessment, 100 capillary samples were obtained for measurement in duplicate with each of three reagent system lots per system, resulting in 600 results per system.

RESULTS

All assessed BGMSs exhibited a sufficient level of accuracy, with small differences between them. In the user performance evaluation, study personnel observed the smallest total number of user errors with Contour Next (Ascensia), followed by Accu-Chek Instant (Roche), Medisafe Fit Smile (Terumo), and OneTouch Ultra Plus Reflect (LifeScan). Approximately 90% of participants stated that a consistent color scheme, eg, for low blood glucose (BG) values, should be used across all BGMSs. There was no clear preference among the four tested BGMSs regarding the specific way of displaying color coding.

CONCLUSIONS

The four BGMSs assessed in this study showed only small differences in an overall sufficient level of accuracy. User handling errors, as observed by study personnel, differed between the systems.

Comparator Data Characteristics and Testing Procedures for the Clinical Performance Evaluation of Continuous Glucose Monitoring Systems

Comparing the performance of different continuous glucose monitoring (CGM) systems is challenging due to the lack of comprehensive guidelines for clinical study design. In particular, the absence of concise requirements for the distribution of comparator (reference) blood glucose (BG) concentrations and their rate of change (RoC) that are used to evaluate CGM performance, impairs comparability. For this article, several experts in the field of CGM performance testing have collaborated to propose characteristics of the distribution of comparator measurements that should be collected during CGM performance testing. Specifically, it is proposed that at least 7.5% of comparator BG concentrations are <70 mg/dL (3.9 mmol/L) and >300 mg/dL (16.7 mmol/L), respectively, and that at least 7.5% of BG-RoC combinations indicate fast BG changes with impending hypo- or hyperglycemia, respectively. These proposed characteristics of the comparator data can facilitate the harmonization of testing conditions across different studies and CGM systems and ensure that the most relevant scenarios representing real-life situations are established during performance testing. In addition, a study protocol and testing procedure for the manipulation of glucose levels are suggested that enable the collection of comparator data with these characteristics. This work is an important step toward establishing a future standard for the performance evaluation of CGM systems.

Clinical Performance Evaluation of Continuous Glucose Monitoring Systems: A Scoping Review and Recommendations for Reporting

The use of different approaches for design and results presentation of studies for the clinical performance evaluation of continuous glucose monitoring (CGM) systems has long been recognized as a major challenge in comparing their results. However, a comprehensive characterization of the variability in study designs is currently unavailable. This article presents a scoping review of clinical CGM performance evaluations published between 2002 and 2022. Specifically, this review quantifies the prevalence of numerous options associated with various aspects of study design, including subject population, comparator (reference) method selection, testing procedures, and statistical accuracy evaluation. We found that there is a large variability in nearly all of those aspects and, in particular, in the characteristics of the comparator measurements. Furthermore, these characteristics as well as other crucial aspects of study design are often not reported in sufficient detail to allow an informed interpretation of study results. We therefore provide recommendations for reporting the general study design, CGM system use, comparator measurement approach, testing procedures, and data analysis/statistical performance evaluation. Additionally, this review aims to serve as a foundation for the development of a standardized CGM performance evaluation procedure, thereby supporting the goals and objectives of the Working Group on CGM established by the Scientific Division of the International Federation of Clinical Chemistry and Laboratory Medicine.

Perceptions of Continuous Glucose Monitoring Systems in the T1D Exchange Diabetes Registry: Satisfaction, Concerns, and Areas for Future Improvement

Manufacturers continue to improve performance and usability of continuous glucose monitoring (CGM) systems. As CGM becomes a standard of care, especially for people on insulin therapy, it is important to routinely gauge how satisfied people with diabetes are with this technology. This article describes survey feedback from a large cohort of people with diabetes using older and current CGM systems and highlights areas of current satisfaction, concern, and future system improvement.

Post-Market Surveillance Assessment of the Clinical Accuracy of a Blood Glucose Monitoring System with an Improved Algorithm for Enhanced Product Performance

BACKGROUND

On-going manufacturer-led post-market surveillance (PMS), assessing the clinical accuracy of blood glucose monitoring (BGM) systems, is critical to substantiate the performance of such products for people with diabetes.

MATERIALS AND METHODS

Batches of Verio test-strip product were randomly and routinely selected over the period from launch of an improved-algorithm product to reporting date and sent to 3 clinic sites for clinician-led accuracy assessment. Accuracy is reported as per recently adopted FDA guidance for BGM systems, EN ISO 15197:2015 and MARD/MAD (Mean absolute relative difference/Mean absolute difference).

RESULTS

Thirty-three individual test-strip batches were evaluated corresponding to 506 unique donors. Accuracy performance - FDA: 98.9% of values within ±15% of comparator; ISO: 99.0% within ±15 mg/dL or ±15% at <100 mg/dL (<5.55 mmol/L) or ≥100 mg/dL (≥5.55 mmol/L) glucose, respectively. Overall MARD was 4.19% with a MARD range of 3.54%-5.73% across all test strip batches.

CONCLUSIONS

This post-market surveillance program demonstrates the new BGM system consistently meets measures of clinical accuracy specified by regulators. This program supports a growing demand by regulators for real-world evidence demonstrating consistent in-market product efficacy as opposed to the current largely passive approach that relies on assessment of reports filed by device users.

The Devil Is in the Details: Use, Limitations, and Implementation of Continuous Glucose Monitoring in the Inpatient Setting

Until recently, continuous glucose monitoring (CGM) systems were reserved for use in the outpatient setting or for investigational purposes in hospitalized patients. However, during the coronavirus disease 2019 pandemic, use of CGM in the inpatient setting has grown rapidly. This review outlines important details related to the accuracy, limitations, and implementation of, as well as necessary staff education for, inpatient CGM use and offers a glimpse into the future of CGM in the inpatient setting.

Benefits of a Switch from Intermittently Scanned Continuous Glucose Monitoring (isCGM) to Real-Time (rt) CGM in Diabetes Type 1 Suboptimal Controlled Patients in Real-Life: A One-Year Prospective Study §

The switch from intermittently scanned continuous glucose monitoring (isCGM) to real-time (rt) CGM could improve glycemic management in suboptimal controlled type 1 diabetes patients, but long-term study is lacking. We evaluated retrospectively the ambulatory glucose profile (AGP) in such patients after switching from Free Style Libre 1 (FSL1) to Dexcom G4 (DG4) biosensors over 1 year. Patients (n = 21, 43 ± 15 years, BMI 25 ± 5, HbA1c 8.1 ± 1.0%) had severe hypoglycemia and/or HbA1c ≥ 8%. AGP metrics (time-in-range (TIR) 70–180 mg/dL, time-below-range (TBR) <70 mg/dL or <54 mg/dL, glucose coefficient of variation (%CV), time-above-range (TAR) >180 mg/dL or >250 mg/dL, glucose management indicator (GMI), average glucose) were collected the last 3 months of FSL1 use (M0) and of DG4 for 3, 6 (M6) and 12 (M12) months of use. Values were means ± standard deviation or medians [Q1;Q3]. At M12 versus M0, the higher TIR (50 ± 17 vs. 45 ± 16, p = 0.036), and lower TBR < 70 mg/dL (2.5 [1.6;5.5] vs. 7.0 [4.5;12.5], p = 0.0007), TBR < 54 mg/dL (0.7 [0.4;0.8] vs. 2.3 [0.8;7.0], p = 0.007) and %CV (39 ± 5 vs. 45 ± 8, p = 0.0009), evidenced a long-term effectiveness of the switch. Compared to M6, TBR < 70 mg/dL decreased, %CV remained stable, while the improvement on hyperglycemia exposure decreased (higher GMI, TAR and average glucose). This switch was a relevant therapeutic option, though a loss of benefit on hyperglycemia stressed the need for optimized management of threshold alarms. Nevertheless, few patients attained the recommended values for AGP metrics, and the reasons why some patients are “responders” vs. “non-responders” warrant to be investigated.