1
|
Rollborn N, Kultima K, Larsson A. Patient result monitoring of HbA 1c shows small seasonal variations and steady decrease over more than 10 years. Clin Chem Lab Med 2024; 0:cclm-2024-0205. [PMID: 38860992 DOI: 10.1515/cclm-2024-0205] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Accepted: 05/14/2024] [Indexed: 06/12/2024]
Abstract
OBJECTIVES Internal and external quality assurance materials often use highly processed matrixes. This can render the materials non-commutable. Monitoring laboratory methods with patient medians helps in identifying and correcting systematic errors that may affect diagnostic accuracy. The aim of the present study was to use HbA1c patient results for monitoring of method performance over time. METHODS Test HbA1c results from 2010 to 2022 was analyzed (n=722,553) regarding changes over time and seasonal variation. The HbA1c testing was initially performed on a Cobas 501 instrument using immunological detection but in May 2017 the method was replaced by capillary electrophoresis on Capillarys 3 Tera. RESULTS There was a steady decrease in HbA1c values. From 2011 to 2021 the decrease was for 0.10 percentile 6.6 %, lower quartile 7.9 %, median 10.2 %, mean values 9 %, upper quartile 11.2 %, and 0.90 percentile 9.3 %. No clear shift in HbA1c levels was observed due to the shift in methods. The median HbA1c values per month was approximately 44 mmol/mol (6.2 %, DCCT/NGSP). The only month with a median HbA1c that differed by more than 1 mmol/mol was July with a median value of 42 mmol/mol (6.0 %). CONCLUSIONS The patient data showed a similar decrease as in the National Diabetes Register which indicates that the method is stable over time without any sudden changes and that the seasonal variation is low. The continuous decrease in HbA1c values over time is most likely to a shift towards earlier detection of patient with diabetes and improved treatment.
Collapse
Affiliation(s)
- Niclas Rollborn
- Department of Medical Sciences, 8097 Clinical Chemistry, Uppsala University , Uppsala, Sweden
| | - Kim Kultima
- Department of Medical Sciences, 8097 Clinical Chemistry, Uppsala University , Uppsala, Sweden
| | - Anders Larsson
- Department of Medical Sciences, 8097 Clinical Chemistry, Uppsala University , Uppsala, Sweden
| |
Collapse
|
2
|
Li Y, Chen X, Zhao Y. The effect of ratios upon improving patient-based real-time quality control (PBRTQC) performance. Clin Chem Lab Med 2024; 62:646-656. [PMID: 37862239 DOI: 10.1515/cclm-2023-0865] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Accepted: 10/05/2023] [Indexed: 10/22/2023]
Abstract
OBJECTIVES Large biological variation hinders application of patient-based real-time quality control (PBRTQC). The effect of analyte ratios on the ability of PBRTQC to improve error detection was investigated. METHODS Four single analyte-ratio pairs (alanine aminotransferase [ALT] vs. ALT to aspartate aminotransferase ratio [RALT]; creatinine [Cr] vs. Cr to cystatin C ratio [RCr]; lactate dehydrogenase [LDH] vs. LDH to hydroxybutyrate dehydrogenase ratio [RLDH]; total bilirubin [TB] vs. TB to direct bilirubin ratio [RTB]) were chosen for comparison. Various procedures, including four conventional algorithms (moving average [MA], moving median [MM], exponentially weighted moving average [EWMA] and moving standard deviation [MSD]) were assessed. A new algorithm that monitors the number of defect reports per analytical run (NDR) was also evaluated. RESULTS When a single analyte and calculated ratio used the same PBRTQC parameters, fewer samples were needed to detect systematic errors (SE) by taking ratios (p<0.05). Application of ratios in MA, MM and EWMA significantly enhanced their ability to detect SE. The influence of ratio on random error (RE) detection depended upon the analytes and PBRTQC parameters, as consistent advantage was not demonstrated. The NDR method performed well when appropriate parameters were used, but was only effective for unilateral SE. Rearrangement of sample order led to a significant deterioration of conventional algorithms' performance, while NDR remained almost unaffected. CONCLUSIONS For analytes with large variation and poor PBRTQC performance, using ratios as PBRTQC indexes may significantly improve performance and achieve better anti-interference ability, providing a new class of monitoring indicators for PBRTQC.
Collapse
Affiliation(s)
- Yuanyuan Li
- Department of Laboratory Medicine, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, P.R. China
- Key Laboratory of Clinical In Vitro Diagnostic Techniques of Zhejiang Province, Hangzhou, P.R. China
- Institute of Laboratory Medicine, Zhejiang University, Hangzhou, P.R. China
| | - Xiaoling Chen
- Department of Laboratory Medicine, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, P.R. China
- Key Laboratory of Clinical In Vitro Diagnostic Techniques of Zhejiang Province, Hangzhou, P.R. China
- Institute of Laboratory Medicine, Zhejiang University, Hangzhou, P.R. China
| | - Ying Zhao
- Department of Laboratory Medicine, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, P.R. China
- Key Laboratory of Clinical In Vitro Diagnostic Techniques of Zhejiang Province, Hangzhou, P.R. China
- Institute of Laboratory Medicine, Zhejiang University, Hangzhou, P.R. China
| |
Collapse
|
3
|
Hatanaka N, Yamamoto Y, Shiozaki Y, Kuramura E, Nagai N, Kondo A, Kamioka M. Development and Evaluation of "The Delta Plus-Minus Even Distribution Check": A Novel Patient-Based Real-Time Quality Control Method for Laboratory Tests. J Appl Lab Med 2024; 9:316-328. [PMID: 38170846 DOI: 10.1093/jalm/jfad116] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2023] [Accepted: 10/24/2023] [Indexed: 01/05/2024]
Abstract
BACKGROUND Laboratory testing of large sample numbers necessitates high-volume rapid processing, and these test results require immediate validation and a high level of quality assurance. Therefore, real-time quality control including delta checking is an important issue. Delta checking is a process of identifying errors in individual patient results by reviewing differences from previous results of the same patient (Δ value). Under stable analytical conditions, Δ values are equally positively and negatively distributed. METHODS The previous 20 Δ values from 3 tests (cholesterol, albumin, and urea nitrogen) were analyzed by calculating the R-value: "the positive Δ value ratio minus 0.5." This method of monitoring optimized R-values is referred to as the even-check method (ECM) and was compared with quality control (QC) testing in terms of error detection. RESULTS Bias was observed on 4 of the 120 days for the 3 analytes measured. When QC detected errors, the ECM captured the same systematic errors and more rapidly. In contrast, the ECM did not generate an alarm for the one random error that occurred in QC. While QC did not detect any errors, the percentage of R-values exceeding the acceptable range was under 2%, the number of days generating alarms was between 16 and 21 days, with short alarm periods, and a median number of samples per alarm period between 7 and 9 samples. CONCLUSIONS The ECM is a practical real-time QC method, controlled by setting R-value conditions, that quickly detects bias values.
Collapse
Affiliation(s)
- Noriko Hatanaka
- Department of Clinical Laboratory Science, Faculty of Health Care, Tenri University, Tenri-city, Nara, Japan
| | - Yoshikazu Yamamoto
- Department of Clinical Laboratory Science, Faculty of Health Care, Tenri University, Tenri-city, Nara, Japan
| | - Yuya Shiozaki
- Department of Laboratory Medicine, Tenri Hospital, Tenri-city, Nara, Japan
| | - Eiji Kuramura
- Department of Laboratory Medicine, Tenri Hospital, Tenri-city, Nara, Japan
| | - Naoharu Nagai
- Department of Laboratory Medicine, Tenri Hospital, Tenri-city, Nara, Japan
| | - Akira Kondo
- Department of Clinical Laboratory Science, Faculty of Health Care, Tenri University, Tenri-city, Nara, Japan
| | - Mikio Kamioka
- Department of Laboratory Medicine, Tenri Hospital, Tenri-city, Nara, Japan
| |
Collapse
|
4
|
Zhang Y, Wang HL, Xie YH, He DH, Zhou CQ, Kong LR. Practical application of the patient data-based quality control method: the potassium example. Biochem Med (Zagreb) 2024; 34:010901. [PMID: 38361737 PMCID: PMC10864027 DOI: 10.11613/bm.2024.010901] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Accepted: 12/11/2023] [Indexed: 02/17/2024] Open
Abstract
Introduction Internal quality control (IQC) is a core pillar of laboratory quality control strategies. Internal quality control commercial materials lack the same characteristics as patient samples and IQC contributes to the costs of laboratory testing. Patient data-based quality control (PDB-QC) may be a valuable supplement to IQC; the smaller the biological variation, the stronger the ability to detect errors. Using the potassium concentration in serum as an example study compared error detection effectiveness between PDB-QC and IQC. Materials and methods Serum potassium concentrations were measured by using an indirect ion-selective electrode method. For the training database, 23,772 patient-generated data and 366 IQC data from April 2022 to September 2022 were used; 15,351 patient-generated data and 246 IQC data from October 2022 to January 2023 were used as the testing database. For both PDB-QC and IQC, average values and standard deviations were calculated, and z-score charts were plotted for comparison purposes. Results Five systematic and three random errors were detected using IQC. Nine systematic errors but no random errors were detected in PDB-QC. The PDB-QC showed systematic error warnings earlier than the IQC. Conclusions The daily average value of patient-generated data was superior to IQC in terms of the efficiency and timeliness of detecting systematic errors but inferior to IQC in detecting random errors.
Collapse
Affiliation(s)
- Yan Zhang
- Department of Clinical Laboratory, Traditional Chinese Medicine Hospital of Pidu District, Chengdu, China
- Department of Clinical Laboratory, The Third Affiliated Hospital of Chengdu University of Chinese Medicine, Chengdu, China
| | - Hua-Li Wang
- Department of Clinical Laboratory, Traditional Chinese Medicine Hospital of Pidu District, Chengdu, China
- Department of Clinical Laboratory, The Third Affiliated Hospital of Chengdu University of Chinese Medicine, Chengdu, China
| | - Ye-Hong Xie
- Department of Clinical Laboratory, Traditional Chinese Medicine Hospital of Pidu District, Chengdu, China
- Department of Clinical Laboratory, The Third Affiliated Hospital of Chengdu University of Chinese Medicine, Chengdu, China
| | - Da-Hai He
- Department of Clinical Laboratory, Traditional Chinese Medicine Hospital of Pidu District, Chengdu, China
- Department of Clinical Laboratory, The Third Affiliated Hospital of Chengdu University of Chinese Medicine, Chengdu, China
| | - Chao-Qiong Zhou
- Department of Clinical Laboratory, Traditional Chinese Medicine Hospital of Pidu District, Chengdu, China
- Department of Clinical Laboratory, The Third Affiliated Hospital of Chengdu University of Chinese Medicine, Chengdu, China
| | - Li-Rui Kong
- Department of Clinical Laboratory, Traditional Chinese Medicine Hospital of Pidu District, Chengdu, China
- Department of Clinical Laboratory, The Third Affiliated Hospital of Chengdu University of Chinese Medicine, Chengdu, China
| |
Collapse
|
5
|
Ziobrowska-Bech A, Hansen AB, Christensen PA. Analyte stability in whole blood using experimental and datamining approaches. Scandinavian Journal of Clinical and Laboratory Investigation 2022; 82:115-122. [PMID: 35112638 DOI: 10.1080/00365513.2022.2031280] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
The analytical stability of laboratory tests relies mostly on internal and external quality control procedures. Summarized patient data has in several studies been shown to be a good supplement for monitoring analytical stability. In our present investigation, we evaluate a datamining method for retrospective evaluation and assessment of analyte stability in whole blood. Results from the laboratory information system were used as the basis for the datamining approach. Blood tests were requested by the general practitioners and drawing of the blood sample was either at the general practitioner's or at the hospital outpatient clinics. We were able to split data into groups based on sample collection place and time to analysis. The datamining approach was compared to experiments where samples were incubated at a single temperature as well as an experiment where the temperatures were changed during incubation. To demonstrate the method, we selected three laboratory tests considered representative: potassium, phosphate, and lactate dehydrogenase. The datamining approach showed results similar to the reference experiment. Furthermore, our results show that the analytes phosphate and potassium were not stable after short storage at a lower temperature.
Collapse
Affiliation(s)
| | - Annebirthe Bo Hansen
- Department of Clinical Biochemistry, Aalborg University Hospital, Aalborg, Denmark
| | - Peter Astrup Christensen
- Department of Clinical Biochemistry, Aalborg University Hospital, Aalborg, Denmark.,Department of Clinical Medicine, Aalborg University, Aalborg, Denmark
| |
Collapse
|
6
|
Li Y, Yu Q, Zhang X, Chen X. Comparison and optimization of various moving patient-based real-time quality control procedures for serum sodium. J Clin Lab Anal 2021; 35:e23985. [PMID: 34520584 PMCID: PMC8529142 DOI: 10.1002/jcla.23985] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Revised: 08/04/2021] [Accepted: 08/20/2021] [Indexed: 11/25/2022] Open
Abstract
Background Patient‐based real‐time quality control (PBRTQC) is a valuable tool for monitoring the performance of testing processes. We aimed to compare and optimize various PBRTQC procedures for serum sodium. Methods In a computer simulation, artificial errors were added to 680,000 real patients’ results. The characteristics of error detection of various algorithms—moving average, moving median, moving SD and moving proportion of normal results including different control limits (CLs)—were assessed on their ability to detect critical errors early. Results The moving average and moving median were sensitive to system error, and the moving SD tended to detect random error. P3SD (moving proportion of normal results, CLs based on mean and SD of proportion of normal results) demonstrated excellent performance for both system error and random error. The increase of block sizes (N) leads to the delay of error detection and the decrease of false rejection, except for QC procedures with minimum and maximum as CLs. CLs calculation with “0.1% false alarm rate” had more effective performance than that set false alarm to zero (minimum and maximum as CLs). The impact of truncation on QC performance depended on truncation limits, algorithms and the types of error. The significant improvement in QC performance due to truncation was only found in moving SD. Conclusion “P3SD,N = 50, without truncation” and “moving SD, N = 25, set 0.1% false alarm as CLs and set 1% outliers exclusion as truncation limits” were recommended as the optimized procedures for serum sodium to monitor system error and random error, respectively.
Collapse
Affiliation(s)
- Yuanyuan Li
- Department of Laboratory Medicine, the First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou, China.,Key Laboratory of Clinical In Vitro Diagnostic Techniques of Zhejiang Province, Hangzhou, China.,Institute of Laboratory Medicine, Zhejiang University, Hangzhou, China
| | - Qian Yu
- Department of Laboratory Medicine, the First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou, China.,Key Laboratory of Clinical In Vitro Diagnostic Techniques of Zhejiang Province, Hangzhou, China.,Institute of Laboratory Medicine, Zhejiang University, Hangzhou, China
| | - Xiaoyan Zhang
- Department of Laboratory Medicine, the First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou, China.,Key Laboratory of Clinical In Vitro Diagnostic Techniques of Zhejiang Province, Hangzhou, China.,Institute of Laboratory Medicine, Zhejiang University, Hangzhou, China
| | - Xiaoling Chen
- Department of Laboratory Medicine, the First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou, China.,Key Laboratory of Clinical In Vitro Diagnostic Techniques of Zhejiang Province, Hangzhou, China.,Institute of Laboratory Medicine, Zhejiang University, Hangzhou, China
| |
Collapse
|
7
|
van Rossum HH. Moving average quality control: principles, practical application and future perspectives. Clin Chem Lab Med 2020; 57:773-782. [PMID: 30307894 DOI: 10.1515/cclm-2018-0795] [Citation(s) in RCA: 38] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2018] [Accepted: 09/10/2018] [Indexed: 11/15/2022]
Abstract
Moving average quality control (MA QC) was described decades ago as an analytical quality control instrument. Although a potentially valuable tool, it is struggling to meet expectations due to its complexity and need for evidence-based guidance. For this review, relevant literature and the world wide web were examined in order to (i) explain the basic concepts and current understanding of MA QC, (ii) discuss moving average (MA) optimization methods, (iii) gain insight into practical aspects related to applying MA in daily practice and (iv) describe future prospects to enable more widespread acceptance and application of MA QC. Each of the MA QC optimization methods currently available has their own advantages and disadvantages. Recently developed simulation methods provide realistic error detecting properties for MA QC and are available for laboratories. Operational MA management issues have been identified that allow developers of MA software to upgrade their packages to support optimal MA QC application and guide laboratories on MA management issues, such as MA alarm workup. The new insights into MA QC characteristics and operational issues, together with supporting online tools, may promote more widespread acceptance and application of MA QC.
Collapse
Affiliation(s)
- Huub H van Rossum
- Department of Laboratory Medicine, The Netherlands Cancer Institute, Plesmanlaan 121, Amsterdam 1066CX, The Netherlands; and Huvaros, The Netherlands, Phone: +31-20-5122756, Fax: +31-20-5122799
| |
Collapse
|
8
|
Hansen SI, Petersen PH, Lund F, Fraser CG. Plasma creatinine medians from patients partitioned by gender and age used as a tool for assessment of analytical stability at different concentrations. Clin Chem Lab Med 2019; 58:69-76. [PMID: 31377731 DOI: 10.1515/cclm-2019-0334] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2019] [Accepted: 07/12/2019] [Indexed: 11/15/2022]
Abstract
Background Monthly medians of patient results are useful in assessment of analytical quality in medical laboratories. Separate medians by gender makes it possible to generate two independent estimates of contemporaneous errors. However, for plasma creatinine, reference intervals (RIs) are different by gender and also higher over 70 years of age. Methods Daily, weekly and monthly patient medians were calculated from the raw data of plasma creatinine concentrations for males between 18 and 70 years, males >70 years, females between 18 and 70 years and females >70 years. Results The medians of the four groups were all closely associated, with similar patterns. The mean of percentage bias from each group defined the best estimate of bias. The maximum half-range (%) of the bias evaluations provided an estimate of the uncertainty comparable to the analytical performance specifications: thus, bias estimates could be classified as optimum, desirable or minimum quality. Conclusions Medians by gender and age are useful in assessment of analytical stability for plasma creatinine concentration ranging from 60 to 90 μmol/L. The daily medians are valuable in rapid detection of large systematic errors, the weekly medians in detecting minor systematic errors and monthly medians in assessment of long-term analytical stability.
Collapse
Affiliation(s)
- Steen Ingemann Hansen
- Department of Clinical Biochemistry, Nordsjællands Hospital, University of Copenhagen, Dyrehavevej 29, 3400 Hillerød, Denmark, Phone: +004548294156, Fax: +004548294184
| | - Per Hyltoft Petersen
- Department of Clinical Biochemistry, Nordsjællands Hospital, University of Copenhagen, Hillerød, Denmark.,Norwegian Quality Improvement of Laboratory Examinations (NOKLUS), Haraldsplass Deaconess Hospital, Bergen, Norway
| | - Flemming Lund
- Department of Clinical Biochemistry, Nordsjællands Hospital, University of Copenhagen, Hillerød, Denmark
| | - Callum G Fraser
- Centre for Research into Cancer Prevention and Screening, University of Dundee, Dundee, Scotland
| |
Collapse
|
9
|
Chen X, Wang J, Zhang W, Xie E, Zhang B, Xu HG. Failure of internal quality control in detecting significant reagent lot shift in serum creatinine measurement. J Clin Lab Anal 2019; 33:e22991. [PMID: 31373724 PMCID: PMC6868421 DOI: 10.1002/jcla.22991] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2019] [Revised: 06/26/2019] [Accepted: 07/11/2019] [Indexed: 11/30/2022] Open
Abstract
Background Internal quality control (IQC) in clinical laboratories is carried out to monitor analytical stability. Usually, the satisfactory results of the IQC ensure the acceptability of the examination results. Here, we reported that patients' creatinine results are unreliable, although the internal quality control is satisfactory. Methods Creatinine levels were analyzed from two quality control materials and twenty patients' specimens using two different lots of reagents. Lot‐to‐lot comparison was performed. The daily median values of serum creatinine levels of patients were calculated from the test results recorded in our laboratory information system. Results Although IQC was consistent, serum creatinine concentrations were higher using lot B (median: 153 μmol/L; interquartile range: 122‐522 μmol/L) than using lot A (median: 133 μmol/L; interquartile range: 76‐508 μmol/L) for 20 patients (P = .001). The Deming linear regression showed a best fit of y = 0.9394 × x + 45.66. R2 = .8919, and mean percentage difference between two lots was 34%. The new lot was considered unacceptable. Likewise, the median serum creatinine level from the 360 patients using lot B was 102 μmol/L, which was significantly higher than the daily medians of patients using lot A (median: 66 μmol/L; range: 61‐70 μmol/L) in the previous month. Conclusion The variations in creatinine concentrations proved to be due to different lots of reagents. However, IQC materials tested using both lots of reagent exhibited minimal variation. Therefore, IQC alone is insufficient for assessing laboratory analytical results. This finding prompts us to be vigilant in potential pitfall of interpreting test results based on satisfactory IQC alone.
Collapse
Affiliation(s)
- Xiaoting Chen
- Department of Laboratory Medicine, The First Affiliated Hospital of Nanjing Medical University, Nanjing, Jiangsu, China
| | - Jia Wang
- Department of Laboratory Medicine, The First Affiliated Hospital of Nanjing Medical University, Nanjing, Jiangsu, China
| | - Wei Zhang
- Department of Laboratory Medicine, The First Affiliated Hospital of Nanjing Medical University, Nanjing, Jiangsu, China
| | - Erfu Xie
- Department of Laboratory Medicine, The First Affiliated Hospital of Nanjing Medical University, Nanjing, Jiangsu, China
| | - Bingfeng Zhang
- Department of Laboratory Medicine, The First Affiliated Hospital of Nanjing Medical University, Nanjing, Jiangsu, China
| | - Hua-Guo Xu
- Department of Laboratory Medicine, The First Affiliated Hospital of Nanjing Medical University, Nanjing, Jiangsu, China
| |
Collapse
|
10
|
Aris-Brosou S, Kim J, Li L, Liu H. Predicting the Reasons of Customer Complaints: A First Step Toward Anticipating Quality Issues of In Vitro Diagnostics Assays with Machine Learning. JMIR Med Inform 2018; 6:e34. [PMID: 29764796 PMCID: PMC5974458 DOI: 10.2196/medinform.9960] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2018] [Revised: 03/27/2018] [Accepted: 03/27/2018] [Indexed: 11/29/2022] Open
Abstract
Background Vendors in the health care industry produce diagnostic systems that, through a secured connection, allow them to monitor performance almost in real time. However, challenges exist in analyzing and interpreting large volumes of noisy quality control (QC) data. As a result, some QC shifts may not be detected early enough by the vendor, but lead a customer to complain. Objective The aim of this study was to hypothesize that a more proactive response could be designed by utilizing the collected QC data more efficiently. Our aim is therefore to help prevent customer complaints by predicting them based on the QC data collected by in vitro diagnostic systems. Methods QC data from five select in vitro diagnostic assays were combined with the corresponding database of customer complaints over a period of 90 days. A subset of these data over the last 45 days was also analyzed to assess how the length of the training period affects predictions. We defined a set of features used to train two classifiers, one based on decision trees and the other based on adaptive boosting, and assessed model performance by cross-validation. Results The cross-validations showed classification error rates close to zero for some assays with adaptive boosting when predicting the potential cause of customer complaints. Performance was improved by shortening the training period when the volume of complaints increased. Denoising filters that reduced the number of categories to predict further improved performance, as their application simplified the prediction problem. Conclusions This novel approach to predicting customer complaints based on QC data may allow the diagnostic industry, the expected end user of our approach, to proactively identify potential product quality issues and fix these before receiving customer complaints. This represents a new step in the direction of using big data toward product quality improvement.
Collapse
Affiliation(s)
| | - James Kim
- Ortho Clinical Diagnostics, Raritan, NJ, United States
| | - Li Li
- Ortho Clinical Diagnostics, Raritan, NJ, United States
| | - Hui Liu
- Ortho Clinical Diagnostics, Raritan, NJ, United States
| |
Collapse
|
11
|
Hansen SI, Petersen PH, Lund F, Fraser CG, Sölétormos G. Gender-partitioned patient medians of serum albumin requested by general practitioners for the assessment of analytical stability. Clin Chem Lab Med 2018; 56:843-850. [PMID: 29252189 DOI: 10.1515/cclm-2017-0771] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2017] [Accepted: 11/06/2017] [Indexed: 11/15/2022]
Abstract
BACKGROUND Recently, the use of separate gender-partitioned patient medians of serum sodium has revealed potential for monitoring analytical stability within the optimum analytical performance specifications for laboratory medicine. The serum albumin concentration depends on whether a patient is sitting or recumbent during phlebotomy. We therefore investigated only examinations requested by general practitioners (GPs) to provide data from sitting patients. METHODS Weekly and monthly patient medians of serum albumin requested by GP for both male and female patients were calculated from the raw data obtained from three analysers in the hospital laboratory on examination of samples from those >18 years. The half-range of medians were applied as an estimate of the maximum bias. Further, the ratios between the two medians were calculated (females/males). RESULTS The medians for male and female patients were closely related despite considerable variation due to the current analytical variation. This relationship was confirmed by the calculated half-range for the monthly ratio between the genders of 0.44%, which surpasses the optimum analytical performance specification for bias of serum albumin (0.72%). The weekly ratio had a half-range of 1.83%, which surpasses the minimum analytical performance specifications of 2.15%. CONCLUSIONS Monthly gender-partitioned patient medians of serum albumin are useful for monitoring of long-term analytical stability, where the gender medians are two independent estimates of changes in (delta) bias: only results requested by GP are of value in this application to ensure that all patients are sitting during phlebotomy.
Collapse
Affiliation(s)
- Steen Ingemann Hansen
- Department of Clinical Biochemistry, Nordsjællands Hospital, University of Copenhagen, Dyrehavevej 29, 3400 Hillerød, Denmark, Phone: +004548294156, Fax: +004548294184
| | - Per Hyltoft Petersen
- Department of Clinical Biochemistry, Nordsjællands Hospital, University of Copenhagen, Hillerød, Denmark.,Norwegian Quality Improvement of Laboratory Examinations (NOKLUS), Haraldsplass Deaconess Hospital, Bergen, Norway
| | - Flemming Lund
- Department of Clinical Biochemistry, Nordsjællands Hospital, University of Copenhagen, Hillerød, Denmark
| | - Callum G Fraser
- Centre for Research into Cancer Prevention and Screening, University of Dundee, Dundee, Scotland
| | - György Sölétormos
- Department of Research, Nordsjællands Hospital University of Copenhagen, Hillerød, Denmark
| |
Collapse
|
12
|
Hansen SI, Petersen PH, Lund F, Fraser CG, Sölétormos G. Separate patient serum sodium medians from males and females provide independent information on analytical bias. Clin Chem Lab Med 2017; 55:1865-1872. [PMID: 28448271 DOI: 10.1515/cclm-2016-1010] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2016] [Accepted: 03/27/2017] [Indexed: 11/15/2022]
Abstract
BACKGROUND During monitoring of monthly medians of results from patients undertaken to assess analytical stability in routine laboratory performance, the medians for serum sodium for male and female patients were found to be significantly related. METHODS Daily, weekly and monthly patient medians of serum sodium for both male and female patients were calculated from results obtained on samples from the population >18 years on three analysers in the hospital laboratory. The half-range of medians was applied as an estimate of the maximum bias. Further, the ratios between the two medians were calculated. RESULTS The medians of both genders demonstrated dispersions over time, but they were closely connected in like patterns, which were confirmed by the half-range of the ratios of medians for males and females that varied from 0.36% for daily, 0.14% for weekly and 0.036% for monthly ratios over all instruments. CONCLUSIONS The tight relationship between the gender medians for serum sodium is only possible when raw laboratory data are used for calculation. The two patient medians can be used to confirm both and are useful as independent estimates of analytical bias during constant calibration periods. In contrast to the gender combined median, the estimate of analytical bias can be confirmed further by calculation of the ratios of medians for males and females.
Collapse
|
13
|
Bietenbeck A, Thaler MA, Luppa PB, Klawonn F. Stronger Together: Aggregated Z-values of Traditional Quality Control Measurements and Patient Medians Improve Detection of Biases. Clin Chem 2017; 63:1377-1387. [DOI: 10.1373/clinchem.2016.269845] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2016] [Accepted: 04/11/2017] [Indexed: 01/09/2023]
Abstract
Abstract
BACKGROUND
In clinical chemistry, quality control (QC) often relies on measurements of control samples, but limitations, such as a lack of commutability, compromise the ability of such measurements to detect out-of-control situations. Medians of patient results have also been used for QC purposes, but it may be difficult to distinguish changes observed in the patient population from analytical errors. This study aims to combine traditional control measurements and patient medians for facilitating detection of biases.
METHODS
The software package “rSimLab” was developed to simulate measurements of 5 analytes. Internal QC measurements and patient medians were assessed for detecting impermissible biases. Various control rules combined these parameters. A Westgard-like algorithm was evaluated and new rules that aggregate Z-values of QC parameters were proposed.
RESULTS
Mathematical approximations estimated the required sample size for calculating meaningful patient medians. The appropriate number was highly dependent on the ratio of the spread of sample values to their center. Instead of applying a threshold to each QC parameter separately like the Westgard algorithm, the proposed aggregation of Z-values averaged these parameters. This behavior was found beneficial, as a bias could affect QC parameters unequally, resulting in differences between their Z-transformed values. In our simulations, control rules tended to outperform the simple QC parameters they combined. The inclusion of patient medians substantially improved bias detection for some analytes.
CONCLUSIONS
Patient result medians can supplement traditional QC, and aggregations of Z-values are novel and beneficial tools for QC strategies to detect biases.
Collapse
Affiliation(s)
- Andreas Bietenbeck
- Institut für Klinische Chemie und Pathobiochemie, Klinikum rechts der Isar der Technischen Universität München, München, Germany
| | - Markus A Thaler
- Institut für Klinische Chemie und Pathobiochemie, Klinikum rechts der Isar der Technischen Universität München, München, Germany
| | - Peter B Luppa
- Institut für Klinische Chemie und Pathobiochemie, Klinikum rechts der Isar der Technischen Universität München, München, Germany
| | - Frank Klawonn
- Department of Biostatistics, Helmholtz Centre for Infection Research, Braunschweig, Germany
- Department of Computer Science, Ostfalia University of Applied Sciences, Wolfenbüttel, Germany
| |
Collapse
|