1
|
Pleus S, Jendrike N, Baumstark A, Mende J, Wehrstedt S, Haug C, Freckmann G. Evaluation of System Accuracy, Precision, Hematocrit Influence, and User Performance of Two Blood Glucose Monitoring Systems Based on ISO 15197:2013/EN ISO 15197:2015. Diabetes Ther 2024; 15:447-459. [PMID: 38100029 PMCID: PMC10838869 DOI: 10.1007/s13300-023-01517-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Accepted: 11/29/2023] [Indexed: 02/06/2024] Open
Abstract
INTRODUCTION Sufficiently high analytical quality of blood glucose monitoring systems (BGMS) is a prerequisite for efficient diabetes therapy. In this study we assessed system accuracy, measurement repeatability, intermediate measurement precision, user performance, and the influence of hematocrit on two CE-marked blood glucose monitoring systems. For one BGMS, measurement accuracy using venous samples was additionally investigated. METHODS Study procedures were based on the International Organization of Standardization (ISO) 15197:2013/EN ISO 15197:2015 ("ISO 15197"). User performance included data from 100 subjects who used one test strip lot, whereas for all other analyses three different reagent system lots were used. For system accuracy assessment, 100 capillary samples were measured in duplicate with each of three reagent system lots per system, resulting in 600 results per system. RESULTS CareSens S Fit and CareSens H Beat both fulfilled the ISO 15197 accuracy criteria with 97.5-100% of each test strip lot's results falling within ± 15 mg/dL or ± 15% of the results of the comparison method and 100% of results in consensus error grid (CEG) zone A for all three lots. User performance evaluation revealed sufficient accuracy in the hands of lay users although some handling errors were documented by study staff. Assessment of measurement repeatability and intermediate measurement precision is given by standard deviation (SD) (glucose levels < 100 mg/dL) and by coefficient of variation (CV) (glucose concentrations ≥ 100 mg/dL). SD was ≤ 4.1 mg/dL and CV ≤ 4.2% for measurement repeatability and SD was ≤ 2.2 mg/dL and CV ≤ 2.6% for intermediate measurement precision. In case of hematocrit influence, both BGMS complied with all three tested lots with the defined criteria. CONCLUSION Both BGMS analyzed in this study fulfilled the required accuracy criteria of ISO 15197. They showed high precision, good performance in the hands of lay users, and the influence of hematocrit was acceptable in the labeled range.
Collapse
Affiliation(s)
- Stefan Pleus
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Lise-Meitner-Strasse 8/2, 89081, Ulm, Germany
| | - Nina Jendrike
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Lise-Meitner-Strasse 8/2, 89081, Ulm, Germany
| | - Annette Baumstark
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Lise-Meitner-Strasse 8/2, 89081, Ulm, Germany
| | - Jochen Mende
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Lise-Meitner-Strasse 8/2, 89081, Ulm, Germany
| | - Stephanie Wehrstedt
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Lise-Meitner-Strasse 8/2, 89081, Ulm, Germany.
| | - Cornelia Haug
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Lise-Meitner-Strasse 8/2, 89081, Ulm, Germany
| | - Guido Freckmann
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Lise-Meitner-Strasse 8/2, 89081, Ulm, Germany
| |
Collapse
|
2
|
Apiratmateekul N, Duanginta W, Phetree M, Kongros K, Treebuphachatsakul W. Effects of Simulated Adverse Environmental Conditions Related to Actual Conditions at Health Promoting Hospitals on the Performance of Blood Glucose Testing by Glucose Meters. J Diabetes Sci Technol 2023; 17:125-132. [PMID: 34515537 PMCID: PMC9846385 DOI: 10.1177/19322968211042343] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
BACKGROUND Annual peaks in temperature and humidity exceed manufacturers' specifications for blood glucose test strip storage in Thailand. Health Promoting Hospitals (HPH) do not always provide the same level of health services that hospitals do since they often only turn on air-conditioning units during working hours. METHODS The blood glucose testing performance of 4 glucose meters were investigated for short and long terms stress at 5 simulated conditions. Temperature and relative humidity (RH) at 5 HPHs in different regions of Thailand were monitored for 9 weeks during April to July 2019. The use of air conditioning in storage rooms for storing test strips was surveyed at 131 HPHs using questionnaires. RESULTS Median-paired differences of glucose measurements with stressed test strips in 5 simulated conditions significantly differed (P < 0.05) both in the short term (3 days) and in the long term (30 days) with 4 glucose meters when compared to unstressed test strips. The average temperature of all HPHs exceeded 30°C (86°F). The average RH was 84%. There was only one HPH that occasionally turned on its air conditioners. Most HPHs kept both opened and unopened vials of test strips in rooms without air conditioners. Further, 21.4-32.0% of HPHs kept test strips at room with air conditioners. CONCLUSIONS This study provides evidence for poor performance of blood glucose testing by glucose meters that are affected by adverse environmental conditions. The environmental for test strips storage at HPHs should be considered to prevent analytical errors of glucose measurement.
Collapse
Affiliation(s)
- Napaporn Apiratmateekul
- Department of Medical Technology,
Naresuan University, Muang, Phitsanulok, Thailand
- Reference Material and Medical
Laboratory Innovation Research Unit, Faculty of Allied Health Sciences, Naresuan
University, Muang, Phitsanulok, Thailand
| | - Wanutchaya Duanginta
- Reference Material and Medical
Laboratory Innovation Research Unit, Faculty of Allied Health Sciences, Naresuan
University, Muang, Phitsanulok, Thailand
| | - Methawadee Phetree
- Reference Material and Medical
Laboratory Innovation Research Unit, Faculty of Allied Health Sciences, Naresuan
University, Muang, Phitsanulok, Thailand
| | - Kunchit Kongros
- Department of Medical Technology,
Naresuan University, Muang, Phitsanulok, Thailand
- Reference Material and Medical
Laboratory Innovation Research Unit, Faculty of Allied Health Sciences, Naresuan
University, Muang, Phitsanulok, Thailand
| | - Wanvisa Treebuphachatsakul
- Department of Medical Technology,
Naresuan University, Muang, Phitsanulok, Thailand
- Reference Material and Medical
Laboratory Innovation Research Unit, Faculty of Allied Health Sciences, Naresuan
University, Muang, Phitsanulok, Thailand
- Medical Device Research Laboratory,
Division of Research and Innovation, Naresuan University, Muang, Phitsanulok,
Thailand
- Wanvisa Treebuphachatsakul, Naresuan
University, 99 Moo 9, Muang, Phitsanulok 65000, Thailand.
| |
Collapse
|
3
|
Adolfsson P, Taplin CE, Zaharieva DP, Pemberton J, Davis EA, Riddell MC, McGavock J, Moser O, Szadkowska A, Lopez P, Santiprabhob J, Frattolin E, Griffiths G, DiMeglio LA. ISPAD Clinical Practice Consensus Guidelines 2022: Exercise in children and adolescents with diabetes. Pediatr Diabetes 2022; 23:1341-1372. [PMID: 36537529 PMCID: PMC10107219 DOI: 10.1111/pedi.13452] [Citation(s) in RCA: 32] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 11/07/2022] [Indexed: 12/24/2022] Open
Affiliation(s)
- Peter Adolfsson
- Department of Pediatrics, Kungsbacka Hospital, Kungsbacka, Sweden.,Institute of Clinical Sciences, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
| | - Craig E Taplin
- Department of Endocrinology and Diabetes, Perth Children's Hospital, Nedlands, Western Australia, Australia.,Telethon Kids Institute, University of Western Australia, Perth, Western Australia, Australia.,Centre for Child Health Research, University of Western Australia, Perth, Western Australia, Australia
| | - Dessi P Zaharieva
- Division of Endocrinology, Department of Pediatrics, School of Medicine, Stanford University, Stanford, California, USA
| | - John Pemberton
- Department of Endocrinology and Diabetes, Birmingham Women's and Children's Hospital, Birmingham, UK
| | - Elizabeth A Davis
- Department of Endocrinology and Diabetes, Perth Children's Hospital, Nedlands, Western Australia, Australia.,Telethon Kids Institute, University of Western Australia, Perth, Western Australia, Australia.,Centre for Child Health Research, University of Western Australia, Perth, Western Australia, Australia
| | - Michael C Riddell
- Muscle Health Research Centre, York University, Toronto, Ontario, Canada
| | - Jonathan McGavock
- Faculty of Kinesiology and Recreation Management, University of Manitoba, Winnipeg, Manitoba, Canada.,Diabetes Research Envisioned and Accomplished in Manitoba (DREAM) Theme, Children's Hospital Research Institute of Manitoba, Winnipeg, Manitoba, Canada.,Department of Pediatrics and Child Health, University of Manitoba, Winnipeg, Manitoba, Canada.,Diabetes Action Canada SPOR Network, Toronto, Ontario, Canada
| | - Othmar Moser
- Division Exercise Physiology and Metabolism, Department of Sport Science, University of Bayreuth, Bayreuth, Germany.,Interdisciplinary Metabolic Medicine Trials Unit, Division of Endocrinology and Diabetology, Department of Internal Medicine, Medical University of Graz, Graz, Austria
| | - Agnieszka Szadkowska
- Department of Pediatrics, Diabetology, Endocrinology & Nephrology, Medical University of Lodz, Lodz, Poland
| | - Prudence Lopez
- Department of Paediatrics, John Hunter Children's Hospital, Newcastle, New South Wales, Australia.,University of Newcastle, Newcastle, New South Wales, Australia
| | - Jeerunda Santiprabhob
- Siriraj Diabetes Center, Faculty of Medicine Siriraj Hospital, Mahidol University, Bangkok, Thailand.,Division of Endocrinology and Metabolism, Department of Pediatrics, Faculty of Medicine Siriraj Hospital, Mahidol University, Bangkok, Thailand
| | | | | | - Linda A DiMeglio
- Department of Pediatrics, Division of Pediatric Endocrinology and Diabetology, Indiana University School of Medicine, Riley Hospital for Children, Indianapolis, Indiana, USA
| |
Collapse
|
4
|
Jendrike N, Baumstark A, Pleus S, Mende J, Haug C, Freckmann G. Assessment of System Accuracy, Intermediate Measurement Precision, and Measurement Repeatability of a Blood Glucose Monitoring System Based on ISO 15197. J Diabetes Sci Technol 2019; 13:235-241. [PMID: 30547683 PMCID: PMC6399804 DOI: 10.1177/1932296818821105] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/26/2023]
Abstract
BACKGROUND Analytical quality of blood glucose monitoring systems (BGMS) is an important aspect for many diabetes patients. Sufficiently high analytical quality is required for adequate diabetes therapy. METHODS In this study, system accuracy and measurement precision of a BGMS were assessed based on ISO 15197:2013. For system accuracy, this standard requires a specific glucose distribution and at least 95% of results obtained with the BGMS in capillary blood to fall within ±15 mg/dl or ±15% (at glucose concentrations <100 mg/dl or ≥100 mg/dl, respectively) of corresponding comparison method results, and at least 99% of results to be found within clinically acceptable consensus error grid (CEG) zones A and B. Based on ISO 15197:2013, intermediate measurement precision, using control solution, and measurement repeatability, using venous blood samples, were analyzed by calculation of standard deviations (SDs) and coefficients of variation (CV) at glucose concentrations <100 mg/dl or ≥100 mg/dl, respectively, although ISO 15197:2013 does not specify acceptance criteria. RESULTS The BGMS fulfilled system accuracy requirements with ≥99% of results within ±15 mg/dl or ±15% of the comparison method results, and 100% of results in CEG zones A and B. Intermediate measurement precision analysis showed SD ≤2.2 mg/dl and CV ≤2.3%. Analysis of measurement repeatability showed SD ≤2.1 mg/dl and CV ≤2.4%. CONCLUSION System accuracy requirements of ISO 15197:2013 were fulfilled by the BGMS. As ISO 15197:2013 does not specify precision requirements, precision analysis results were compared with those reported for other BGMS in the literature and found to be similar.
Collapse
Affiliation(s)
- Nina Jendrike
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
| | - Annette Baumstark
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
| | - Stefan Pleus
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
- Stefan Pleus, MSc, Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Lise-Meitner-Straße 8/2, D-89081 Ulm, Germany.
| | - Jochen Mende
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
| | - Cornelia Haug
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
| | - Guido Freckmann
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
| |
Collapse
|
5
|
Jendrike N, Baumstark A, Pleus S, Liebing C, Kamecke U, Haug C, Freckmann G. Accuracy of five systems for self-monitoring of blood glucose in the hands of adult lay-users and professionals applying ISO 15197:2013 accuracy criteria and potential insulin dosing errors. Curr Med Res Opin 2019; 35:301-311. [PMID: 29927663 DOI: 10.1080/03007995.2018.1491832] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
OBJECTIVE In this study, accuracy in the hands of intended users was evaluated for five self-monitoring of blood glucose (SMBG) systems based on ISO 15197:2013, and possibly related insulin dosing errors were calculated. In addition, accuracy was assessed in the hands of study personnel. METHODS For each system (Accu-Chek 1 Aviva Connect [A], Contour 2 Next One [B], FreeStyle Freedom Lite 3 [C], GlucoMen 4 areo [D] and OneTouch Verio 5 [E]) one test strip lot was evaluated as required by ISO 15197:2013, clause 8. Number and percentage of SMBG measurements within ±15 mg/dl and ±15% of the comparison measurements at glucose concentrations <100 mg/dl and ≥100 mg/dl, respectively, were calculated. In addition, data is presented in surveillance error grids, and insulin dosing errors were modeled. The study was registered at ClinicalTrials.gov (NCT03033849). RESULTS Four systems (A, B, C, D) fulfilled the tested reagent system lot ISO 15197:2013 accuracy criteria with the tested reagent system lot with at least 95% (lay-users) and 99.5% (study personnel) of results within the defined limits. Measurements with all five systems were within the clinically acceptable zones of the consensus error grid and the surveillance error grid. Median modeled insulin dosing errors were between -0.8 and +0.6 units for measurements performed by lay-users and between -0.7 and +0.8 units for study personnel. Frequent lay-user errors were not checking the test strips' expiry date, applying blood incorrectly and handling the device incorrectly. CONCLUSION In this study, the systems showed slight differences in the number of results within ISO 15197:2013 accuracy limits. Inaccurate SMBG measurements can result in insulin dosing errors and adversely affect glycemic control.
Collapse
Affiliation(s)
- Nina Jendrike
- a Institut für Diabetes-Technologie Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm , Ulm , Germany
| | - Annette Baumstark
- a Institut für Diabetes-Technologie Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm , Ulm , Germany
| | - Stefan Pleus
- a Institut für Diabetes-Technologie Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm , Ulm , Germany
| | - Christina Liebing
- a Institut für Diabetes-Technologie Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm , Ulm , Germany
| | - Ulrike Kamecke
- a Institut für Diabetes-Technologie Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm , Ulm , Germany
| | - Cornelia Haug
- a Institut für Diabetes-Technologie Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm , Ulm , Germany
| | - Guido Freckmann
- a Institut für Diabetes-Technologie Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm , Ulm , Germany
| |
Collapse
|
6
|
Pleus S, Jendrike N, Baumstark A, Mende J, Haug C, Freckmann G. Evaluation of Analytical Performance of Three Blood Glucose Monitoring Systems: System Accuracy, Measurement Repeatability, and Intermediate Measurement Precision. J Diabetes Sci Technol 2019; 13:111-117. [PMID: 30286620 PMCID: PMC6313280 DOI: 10.1177/1932296818804837] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
INTRODUCTION Blood glucose monitoring systems (BGMS) should provide sufficient analytical quality to allow adequate therapy for diabetes patients. Besides system accuracy, measurement precision is an important aspect of a BGMS' analytical quality. METHODS Based on ISO 15197:2013/EN ISO 15197:2015, system accuracy, measurement repeatability, and intermediate measurement precision were assessed. ISO 15197:2013 system accuracy criteria require that ⩾95% of individual BGMS' test strip lot results shall fall within ±15 mg/dl or ±15% of corresponding comparison method results (at glucose concentrations <100 mg/dl and ⩾100 mg/dl, respectively), and that ⩾99% of results fall within consensus error grid (CEG) zones A and B. Measurement repeatability was assessed using venous blood samples, whereas intermediate measurement precision was assessed using control solution samples. Standard deviation (SD) and coefficient of variation (CV) were calculated for glucose concentrations <100 mg/dl and ⩾100 mg/dl, respectively. Precision acceptance criteria are not specified by ISO 15197:2013. RESULTS All three BGMS fulfilled system accuracy criteria with 96% to 98% of individual test strip lot's results falling within the acceptable accuracy limits. All measurement results fell within CEG zones A and B. For measurement repeatability, SD was ⩽3.3 mg/dl, and CV was ⩽3.9% for the investigated BGMS. Assessment of intermediate measurement precision showed SD ⩽1.3 mg/dl and CV ⩽3.0%. CONCLUSION All three BGMS fulfilled system accuracy criteria of ISO 15197:2013. In absence of acceptance criteria, precision results were found to be consistent with the manufacturer's labeling of the investigated devices.
Collapse
Affiliation(s)
- Stefan Pleus
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
- Stefan Pleus, MSc, Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Lise-Meitner-Strasse 8/2, D-89081 Ulm, Germany.
| | - Nina Jendrike
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
| | - Annette Baumstark
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
| | - Jochen Mende
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
| | - Cornelia Haug
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
| | - Guido Freckmann
- Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
| |
Collapse
|
7
|
Leal Yepes F, Nydam D, Heuwieser W, Mann S. Technical note: Evaluation of the diagnostic accuracy of 2 point-of-care β-hydroxybutyrate devices in stored bovine plasma at room temperature and at 37°C. J Dairy Sci 2018; 101:6455-6461. [DOI: 10.3168/jds.2017-13960] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2017] [Accepted: 03/15/2018] [Indexed: 11/19/2022]
|
8
|
Erbach M, Freckmann G, Hinzmann R, Kulzer B, Ziegler R, Heinemann L, Schnell O. Interferences and Limitations in Blood Glucose Self-Testing: An Overview of the Current Knowledge. J Diabetes Sci Technol 2016; 10:1161-8. [PMID: 27044519 PMCID: PMC5032951 DOI: 10.1177/1932296816641433] [Citation(s) in RCA: 61] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
Abstract
In general, patients with diabetes performing self-monitoring of blood glucose (SMBG) can strongly rely on the accuracy of measurement results. However, various factors such as application errors, extreme environmental conditions, extreme hematocrit values, or medication interferences may potentially falsify blood glucose readings. Incorrect blood glucose readings may lead to treatment errors, for example, incorrect insulin dosing. Therefore, the diabetes team as well as the patients should be well informed about limitations in blood glucose testing. The aim of this publication is to review the current knowledge on limitations and interferences in blood glucose testing with the perspective of their clinical relevance.
Collapse
Affiliation(s)
| | - Guido Freckmann
- Institut für Diabetes-Technologie Forschungs- und Entwicklungsgesellschaft mbH, Ulm, Germany
| | | | - Bernhard Kulzer
- Research Institute of the Diabetes Academy Mergentheim (FIDAM), Bad Mergentheim, Germany
| | - Ralph Ziegler
- Diabetes Clinic for Children and Adolescents, Muenster, Germany
| | | | - Oliver Schnell
- Forschergruppe Diabetes e.V., Munich-Neuherberg, Germany
| |
Collapse
|