1
|
Freckmann G, Eichenlaub M, Waldenmaier D, Pleus S, Wehrstedt S, Haug C, Witthauer L, Jendle J, Hinzmann R, Thomas A, Eriksson Boija E, Makris K, Diem P, Tran N, Klonoff DC, Nichols JH, Slingerland RJ. Clinical Performance Evaluation of Continuous Glucose Monitoring Systems: A Scoping Review and Recommendations for Reporting. J Diabetes Sci Technol 2023; 17:1506-1526. [PMID: 37599389 PMCID: PMC10658695 DOI: 10.1177/19322968231190941] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 08/22/2023]
Abstract
The use of different approaches for design and results presentation of studies for the clinical performance evaluation of continuous glucose monitoring (CGM) systems has long been recognized as a major challenge in comparing their results. However, a comprehensive characterization of the variability in study designs is currently unavailable. This article presents a scoping review of clinical CGM performance evaluations published between 2002 and 2022. Specifically, this review quantifies the prevalence of numerous options associated with various aspects of study design, including subject population, comparator (reference) method selection, testing procedures, and statistical accuracy evaluation. We found that there is a large variability in nearly all of those aspects and, in particular, in the characteristics of the comparator measurements. Furthermore, these characteristics as well as other crucial aspects of study design are often not reported in sufficient detail to allow an informed interpretation of study results. We therefore provide recommendations for reporting the general study design, CGM system use, comparator measurement approach, testing procedures, and data analysis/statistical performance evaluation. Additionally, this review aims to serve as a foundation for the development of a standardized CGM performance evaluation procedure, thereby supporting the goals and objectives of the Working Group on CGM established by the Scientific Division of the International Federation of Clinical Chemistry and Laboratory Medicine.
Collapse
Affiliation(s)
- Guido Freckmann
- IFCC Scientific Division - Working Group on Continuous Glucose Monitoring
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
| | - Manuel Eichenlaub
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
| | - Delia Waldenmaier
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
| | - Stefan Pleus
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
| | - Stephanie Wehrstedt
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
| | - Cornelia Haug
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
| | - Lilian Witthauer
- Diabetes Center Berne, Bern, Switzerland
- Department of Diabetes, Endocrinology, Nutritional Medicine and Metabolism, Inselspital Bern, Bern University Hospital and University of Bern, Bern, Switzerland
| | - Johan Jendle
- IFCC Scientific Division - Working Group on Continuous Glucose Monitoring
- School of Medical Sciences, Faculty of Medicine and Health, Örebro University, Örebro, Sweden
| | - Rolf Hinzmann
- IFCC Scientific Division - Working Group on Continuous Glucose Monitoring
- Roche Diabetes Care GmbH, Mannheim, Germany
| | - Andreas Thomas
- IFCC Scientific Division - Working Group on Continuous Glucose Monitoring
- Pirna, Germany
| | - Elisabet Eriksson Boija
- IFCC Scientific Division - Working Group on Continuous Glucose Monitoring
- Equalis AB, Uppsala, Sweden
| | - Konstantinos Makris
- IFCC Scientific Division - Working Group on Continuous Glucose Monitoring
- Clinical Biochemistry Department, KAT General Hospital, Athens, Greece
| | - Peter Diem
- IFCC Scientific Division - Working Group on Continuous Glucose Monitoring
- Endokrinologie Diabetologie Bern, Bern, Switzerland
| | - Nam Tran
- IFCC Scientific Division - Working Group on Continuous Glucose Monitoring
- Department of Pathology and Laboratory Medicine, University of California Davis Health, Sacramento, CA, USA
| | - David C. Klonoff
- IFCC Scientific Division - Working Group on Continuous Glucose Monitoring
- Diabetes Research Institute, Mills-Peninsula Medical Center, San Mateo, CA, USA
| | - James H. Nichols
- IFCC Scientific Division - Working Group on Continuous Glucose Monitoring
- Vanderbilt University Medical Center, Nashville, TN, USA
| | - Robbert J. Slingerland
- IFCC Scientific Division - Working Group on Continuous Glucose Monitoring
- Department of Clinical Chemistry, Isala Clinics, Zwolle, the Netherlands
| |
Collapse
|
2
|
Li Y, Cao B, Chen Q, Du M, Yan M, Chen Y, Wei H, Wu X, Cui Y, Liu F. Application of the FreeStyle®Libre Glucose Monitoring System in type 1 diabetes mellitus patients aged 1-4 years. Pediatr Diabetes 2022; 23:604-610. [PMID: 35644029 DOI: 10.1111/pedi.13368] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/01/2021] [Revised: 05/01/2022] [Accepted: 05/26/2022] [Indexed: 11/30/2022] Open
Abstract
BACKGROUND To investigate the analytical accuracy, safety performance, and user satisfaction (guardians of study participants) of the FreeStyle®Libre Glucose Monitoring System in the treatment of type 1 diabetes mellitus (T1DM), in children aged <4 years. METHODS Sixteen hospitalized children with new onset T1DM, aged 4 months to 4 years, were enrolled in this study. Patients wore the sensor for 14 days; sensor scans were performed immediately and at 5, 10, and 15 min after capillary blood glucose (BG) measurements to evaluate the effectiveness of the device and the lag effect. RESULTS The consensus error grid showed that 96.40% of values fell within zone A (no clinical impact) and 3.60% within zone B (little/no clinical impact). Overall, the mean absolute relative difference (MARD) was 9.34%, and was higher in the capillary BG <4.0 mmol/L group (15.18%) than in the 4-10 mmol/L (9.63%) and >10 mmol/L (7.17%) groups. The MARD increased gradually with scanning time extension, indicating a short lag effect. Regression analysis showed that a higher BG level was associated with a greater difference in FreeStyle®Libre System measurements. CONCLUSIONS The use of the FreeStyle®Libre System in children aged 1-4 years is accurate and safe, and may be accurate down to 4 months, independent of patient characteristics.
Collapse
Affiliation(s)
- Yangshiyu Li
- Department of Endocrinology, Genetics and Metabolism, Henan Children's Hospital, Zhengzhou Children's Hospital, Children's Hospital Affiliated to Zhengzhou University, Zhengzhou, China
| | - Bingyan Cao
- Department of Endocrinology, Genetic and Metabolism, Beijing Children's Hospital, Capital Medical University, National Center for Children's Health, Beijing, China
| | - Qiong Chen
- Department of Endocrinology, Genetics and Metabolism, Henan Children's Hospital, Zhengzhou Children's Hospital, Children's Hospital Affiliated to Zhengzhou University, Zhengzhou, China
| | - Mengmeng Du
- Department of Endocrinology, Genetics and Metabolism, Henan Children's Hospital, Zhengzhou Children's Hospital, Children's Hospital Affiliated to Zhengzhou University, Zhengzhou, China
| | - Mingming Yan
- Department of Statistics and Epidemiology, Henan Children's Hospital, Zhengzhou Children's Hospital, Children's Hospital Affiliated to Zhengzhou University, Zhengzhou, China
| | - Yongxing Chen
- Department of Endocrinology, Genetics and Metabolism, Henan Children's Hospital, Zhengzhou Children's Hospital, Children's Hospital Affiliated to Zhengzhou University, Zhengzhou, China
| | - Haiyan Wei
- Department of Endocrinology, Genetics and Metabolism, Henan Children's Hospital, Zhengzhou Children's Hospital, Children's Hospital Affiliated to Zhengzhou University, Zhengzhou, China
| | - Xue Wu
- Department of Endocrinology, Genetics and Metabolism, Henan Children's Hospital, Zhengzhou Children's Hospital, Children's Hospital Affiliated to Zhengzhou University, Zhengzhou, China
| | - Yan Cui
- Department of Endocrinology, Genetics and Metabolism, Henan Children's Hospital, Zhengzhou Children's Hospital, Children's Hospital Affiliated to Zhengzhou University, Zhengzhou, China
| | - Fang Liu
- Department of Endocrinology, Genetics and Metabolism, Henan Children's Hospital, Zhengzhou Children's Hospital, Children's Hospital Affiliated to Zhengzhou University, Zhengzhou, China
| |
Collapse
|
3
|
Edge J, Acerini C, Campbell F, Hamilton-Shield J, Moudiotis C, Rahman S, Randell T, Smith A, Trevelyan N. An alternative sensor-based method for glucose monitoring in children and young people with diabetes. Arch Dis Child 2017; 102:543-549. [PMID: 28137708 PMCID: PMC5466923 DOI: 10.1136/archdischild-2016-311530] [Citation(s) in RCA: 99] [Impact Index Per Article: 14.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/30/2016] [Revised: 12/19/2016] [Accepted: 12/22/2016] [Indexed: 01/12/2023]
Abstract
OBJECTIVE To determine accuracy, safety and acceptability of the FreeStyle Libre Flash Glucose Monitoring System in the paediatric population. DESIGN, SETTING AND PATIENTS Eighty-nine study participants, aged 4-17 years, with type 1 diabetes were enrolled across 9 diabetes centres in the UK. A factory calibrated sensor was inserted on the back of the upper arm and used for up to 14 days. Sensor glucose measurements were compared with capillary blood glucose (BG) measurements. Sensor results were masked to participants. RESULTS Clinical accuracy of sensor results versus BG results was demonstrated, with 83.8% of results in zone A and 99.4% of results in zones A and B of the consensus error grid. Overall mean absolute relative difference (MARD) was 13.9%. Sensor accuracy was unaffected by patient factors such as age, body weight, sex, method of insulin administration or time of use (day vs night). Participants were in the target glucose range (3.9-10.0 mmol/L) ∼50% of the time (mean 12.1 hours/day), with an average of 2.2 hours/day and 9.5 hours/day in hypoglycaemia and hyperglycaemia, respectively. Sensor application, wear/use of the device and comparison to self-monitoring of blood glucose were rated favourably by most participants/caregivers (84.3-100%). Five device related adverse events were reported across a range of participant ages. CONCLUSIONS Accuracy, safety and user acceptability of the FreeStyle Libre System were demonstrated for the paediatric population. Accuracy of the system was unaffected by subject characteristics, making it suitable for a broad range of children and young people with diabetes. TRIAL REGISTRATION NUMBER NCT02388815.
Collapse
Affiliation(s)
- Julie Edge
- Department of Paediatric Endocrinology and Diabetes, Oxford Children's Hospital, Oxford, UK
| | - Carlo Acerini
- The Weston Centre for Childhood & Adolescent Diabetes and Endocrinology, Addenbrooke's Hospital, Cambridge, UK
| | - Fiona Campbell
- Multi Speciality Out-Patients Department, Leeds Children's Hospital, Leeds Teaching Hospitals, Leeds, UK
| | - Julian Hamilton-Shield
- Department of Paediatric Diabetes and Endocrinology, Bristol Royal Hospital for Children, Bristol, UK
| | - Chris Moudiotis
- Department of Paediatric Diabetes and Endocrinology, Royal Devon and Exeter NHS Foundation Trust, Exeter, UK
| | - Shakeel Rahman
- Department of Paediatric Diabetes and Endocrinology, Harrogate District Hospital, Harrogate, UK
| | - Tabitha Randell
- Department of Paediatric Diabetes and Endocrinology, Nottingham University Hospitals NHS Trust, Nottingham, UK
| | - Anne Smith
- Department of Paediatric Diabetes and Endocrinology, Northampton General Hospital, Northampton, UK
| | - Nicola Trevelyan
- Southampton Children's Hospital, Southampton General Hospital, Southampton, UK
| |
Collapse
|
4
|
Mensh BD, Wisniewski NA, Neil BM, Burnett DR. Susceptibility of interstitial continuous glucose monitor performance to sleeping position. J Diabetes Sci Technol 2013; 7:863-70. [PMID: 23911167 PMCID: PMC3879750 DOI: 10.1177/193229681300700408] [Citation(s) in RCA: 49] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND Developing a round-the-clock artificial pancreas requires accurate and stable continuous glucose monitoring. The most widely used continuous glucose monitors (CGMs) are percutaneous, with the sensor residing in the interstitial space. Inaccuracies in percutaneous CGM readings during periods of lying on the devices (e.g., in various sleeping positions) have been anecdotally reported but not systematically studied. METHODS In order to assess the impact of sleep and sleep position on CGM performance, we conducted a study in human subjects in which we measured the variability of interstitial CGM data at night as a function of sleeping position. Commercially available sensors were placed for 4 days in the abdominal subcutaneous tissue in healthy, nondiabetic volunteers (four sensors per person, two per side). Nocturnal sleeping position was determined from video recordings and correlated to sensor data. RESULTS We observed that, although the median of the four sensor readings was typically 70-110 mg/dl during sleep, individual sensors intermittently exhibited aberrant glucose readings (>25 mg/dl away from median) and that these aberrant readings were strongly correlated with subjects lying on the sensors. We expected and observed that most of these aberrant sleep-position-related CGM readings were sudden decreases in reported glucose values, presumably due to local blood-flow decreases caused by tissue compression. Curiously, in rare cases, the aberrant CGM readings were elevated values. CONCLUSIONS These findings highlight limitations in our understanding of interstitial fluid physiology in the subcutaneous space and have significant implications for the utilization of sensors in the construction of an artificial pancreas.
Collapse
|
5
|
Italian contributions to the development of continuous glucose monitoring sensors for diabetes management. SENSORS 2012. [PMID: 23202020 PMCID: PMC3545591 DOI: 10.3390/s121013753] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/03/2022]
Abstract
Monitoring glucose concentration in the blood is essential in the therapy of diabetes, a pathology which affects about 350 million people around the World (three million in Italy), causes more than four million deaths per year and consumes a significant portion of the budget of national health systems (10% in Italy). In the last 15 years, several sensors with different degree of invasiveness have been proposed to monitor glycemia in a quasi-continuous way (up to 1 sample/min rate) for relatively long intervals (up to 7 consecutive days). These continuous glucose monitoring (CGM) sensors have opened new scenarios to assess, off-line, the effectiveness of individual patient therapeutic plans from the retrospective analysis of glucose time-series, but have also stimulated the development of innovative on-line applications, such as hypo/hyper-glycemia alert systems and artificial pancreas closed-loop control algorithms. In this review, we illustrate some significant Italian contributions, both from industry and academia, to the growth of the CGM sensors research area. In particular, technological, algorithmic and clinical developments performed in Italy will be discussed and put in relation with the advances obtained in the field in the wider international research community.
Collapse
|