1
|
Yadav D, Rathore M, Banerjee M, Tomo S, Sharma P. Beyond the basics: Sigma scores in laboratory medicine with variable total allowable errors (TEa). Clin Chim Acta 2024; 565:119971. [PMID: 39326693 DOI: 10.1016/j.cca.2024.119971] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2024] [Revised: 08/21/2024] [Accepted: 09/13/2024] [Indexed: 09/28/2024]
Abstract
BACKGROUND To diagnose diseases, track the effectiveness of treatments and make well-informed clinical decisions, doctors rely on results from laboratories. Accurate and precise results minimize the necessity for additional testing, saving time and money while enhancing patient satisfaction.. Internal quality control and an external quality assurance scheme(EQAS) are metrics used to evaluate a clinical laboratory's performance. One of the numerous quality indicators that can be used to gauge the amount of errors is sigma metrics. To calculate the sigma scores bias%, CV%, and Total Error Allowable (TEa) are needed. Total Error allowable(TEa) is a crucial benchmark that establishes allowed limits on the degree of deviation from the target value for a certain analyte. Nevertheless, a proper consensus for establishing a TEa goal has not been reached and the impact of this limiting factor in standard laboratory practice and sigma calculation has not been sufficiently established. Choosing the right Total Error allowable(TEa) goal is one of the greatest challenges when employing sigma metrics as depending on the source, several measurands of TEa values may exhibit alteration. MATERIAL AND METHODS Our study aims to determine the sigma scores of 20 routine chemistry parameters using six different TEa sources: Clinical Laboratory Improvement Amendment (CLIA 88'), CLIA(Clinical Laboratory Improvement Amendment) 24, BDV (Biological Variation Desirable), RCPA(Royal College of Pathologists of Australasia), RiliBak(Guideline of the German Medical Association for Quality Assurance of Laboratory Medical Examinations), and EMC/Spain(Measurement and Control Scheme) over a 12-month period using the bias percent from the External Quality Assessment Scheme (EQAS) and coefficient of variation (CV) from the Internal Quality Control (IQC). Detection system was automated, multi-channel, selective analyzer, the Beckman Coulter AU680 which works on the principle of spectrophotometry. To compute the Sigma metrics, formula used was Sigma = (TEa - Bias%) / CV%. By comparing the sigma values from the different TEa sources, TEa variance on the evaluation of the sigma metric was ascertained after which an internal quality control plan and QGI(Quality Goal Index) for underperforming parameters were devised. RESULTS The study discovered that the sigma values of common chemical parameters varied significantly based on the TEa sources used. Maximum parameters in the above three-sigma zone were TBil, HDL, CK, ALP, amylase and uric acid in CLIA'88 while RCPA and Biological variation were determined to be the most severe, with the highest performing parameters falling below three sigma zones. Rilibaek was the most liberal, with only sodium in the lower three sigma zones along with CLIA'88. The findings indicate that there is the substantial influence of various Total Error Allowable (TEa) sources on the sigma metric evaluation. A quality control plan was devised depending on different sigma scores of the analytes using biorad unity 2.0 software(westgard sigma multirules). The origins of errors that resulted in low sigma ratings liked enhanced cleaning of electrodes, electrode replacement, ageing of reagents, instrument maintainence were pinpointed and addressed. CONCLUSION The study highlights the necessity of harmonizing and standardizing sigma metrics, stressing the significance of choosing suitable total error allowable goals (TEa). The creation of worldwide standards and recommendations for total error allowable (TEa) can lead to its harmonization. Establishing a consensus on the acceptable levels of error for various laboratory tests would necessitate the cooperation of specialists from many nations and organizations in order to set such guidelines and standards.
Collapse
Affiliation(s)
- Dharmveer Yadav
- Department of Biochemistry, All India Institute of Medical Sciences All India Institute of Medical Sciences, Jodhpur, India.
| | - Mohini Rathore
- Department of Biochemistry, All India Institute of Medical Sciences All India Institute of Medical Sciences, Jodhpur, India.
| | - Mithu Banerjee
- Department of Biochemistry, All India Institute of Medical Sciences All India Institute of Medical Sciences, Jodhpur, India.
| | - Sojit Tomo
- Department of Biochemistry, All India Institute of Medical Sciences All India Institute of Medical Sciences, Jodhpur, India.
| | - Praveen Sharma
- Department of Biochemistry, All India Institute of Medical Sciences All India Institute of Medical Sciences, Jodhpur, India.
| |
Collapse
|
2
|
Zhang J, Chen X, Wu J, Feng P, Wang W, Zhong K, Yuan S, Du Y, Zhang C, He F. An assessment of analytical performance using the six sigma scale in second-trimester maternal prenatal screening practices in China. Pract Lab Med 2024; 41:e00422. [PMID: 39155970 PMCID: PMC11327568 DOI: 10.1016/j.plabm.2024.e00422] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2024] [Revised: 06/11/2024] [Accepted: 07/21/2024] [Indexed: 08/20/2024] Open
Abstract
Objectives We aimed to evaluate the analytical performance of second-trimester maternal serum screening in China, and to compare if there are differences in sigma levels across different methods and months. Methods A retrospective study was conducted to assess the analytical quality levels of laboratories by calculating the Sigma metrics with prenatal screening biomarkers: AFP, Total β-hCG, free β-hCG, uE3. Data from 591 laboratories were selected. Sigma metrics were computed using the formula: Sigma metrics(σ) = (%TEa - |%Bias|)/%CV. The Friedman test and Mann-Whitney test were used to compare differences across various methods and different months. The Hodges-Lehmann was used for determining 95 % confidence intervals of pseudo-medians. Results Only uE3 showed significant monthly variations in sigma calculations. However, around 8 % of laboratories across all four analytes demonstrated sigma levels both above 6 and below 3 in different months. Laboratories utilizing time-resolved fluorescence methods significantly outperformed those using chemiluminescence in sigma level. For AFP, the pseudo-median difference between these methods lies within a 95 % confidence interval of (-3.22, -1.93), while for uE3, it is at (-2.30, -1.40). Notably, the median sigma levels for all analytes reached the 4-sigma threshold, with free β-hCG even attaining the 6-sigma level. Conclusion With current standards, China's second-trimester maternal serum screening is of relatively high analytical quality, and variations in sigma levels exist across different months and methods.
Collapse
Affiliation(s)
- Jinming Zhang
- National Center for Clinical Laboratories, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing Hospital/ National Center of Gerontology, Beijing, PR China
- Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, PR China
| | - Xingtong Chen
- National Center for Clinical Laboratories, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing Hospital/ National Center of Gerontology, Beijing, PR China
- Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, PR China
| | - Jiaming Wu
- National Center for Clinical Laboratories, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing Hospital/ National Center of Gerontology, Beijing, PR China
- Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, PR China
| | - Penghui Feng
- Department of Obstetrics and Gynecology, National Clinical Research Center for Obstetric & Gynecologic Diseases, Peking Union Medical College Hospital, Beijing, PR China
| | - Wei Wang
- National Center for Clinical Laboratories, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing Hospital/ National Center of Gerontology, Beijing, PR China
| | - Kun Zhong
- National Center for Clinical Laboratories, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing Hospital/ National Center of Gerontology, Beijing, PR China
| | - Shuai Yuan
- National Center for Clinical Laboratories, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing Hospital/ National Center of Gerontology, Beijing, PR China
| | - Yuxuan Du
- National Center for Clinical Laboratories, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing Hospital/ National Center of Gerontology, Beijing, PR China
| | - Chuanbao Zhang
- National Center for Clinical Laboratories, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing Hospital/ National Center of Gerontology, Beijing, PR China
- Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, PR China
| | - Falin He
- National Center for Clinical Laboratories, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing Hospital/ National Center of Gerontology, Beijing, PR China
- Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, PR China
| |
Collapse
|
3
|
Panda CR, Kumari S, Mangaraj M, Nayak S. The Evaluation of the Quality Performance of Biochemical Analytes in Clinical Biochemistry Laboratory Using Six Sigma Matrices. Cureus 2023; 15:e51386. [PMID: 38292960 PMCID: PMC10826247 DOI: 10.7759/cureus.51386] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/31/2023] [Indexed: 02/01/2024] Open
Abstract
Introduction This study was conducted to assess the analytical performance of biochemical tests using Six Sigma methodology and to assess the underlying causes of unsatisfied performance of analytes with a sigma value of less than 4 using quality goal index (QGI) and root cause analysis (RCA). Methodology Daily data for internal quality control (IQC) for both level 1 (L1) and level 2 (L2) and monthly data for external quality assessment for a period of six months were recorded. The coefficient of variation (CV), bias, and total allowable error (TEa) were calculated to analyze the sigma (σ) values for 19 biochemical analytes. Quality goal index (QGI) analysis was done to analyze impressions and inaccuracies in analyte performance having a sigma value of less than 4. Root cause analysis (RCA) was done to evaluate the possible causes that can improve quality performance. Results Creatinine and high-density lipoprotein (HDL) had sigma metrics of ≤2.0, and chloride, aspartate aminotransferase (AST), and alkaline phosphatase (ALP) had sigma values between 2 and 3. Glucose, total protein (TP), phosphate (Phos), and potassium had sigma values between 4 and 5 in level 1 QC. Sigma grading for level 2 quality control (QC) also gave similar results. For analytes with σ < 4, QGI analysis exposed inaccuracy or imprecision issues and identified errors such as the reconstitution of IQC, storage temperature, and air bubbles while processing the QC, being common causes of poor performance. Conclusion Six Sigma approach is helpful for quality assurance and identifying areas for improvement. Assessing Six Sigma metrics should be a routine practice to decide the frequency of QC run and to detect errors in analysis.
Collapse
Affiliation(s)
- Chhabi R Panda
- Biochemistry, All India Institute of Medical Sciences, Bhubaneswar, IND
| | - Suchitra Kumari
- Biochemistry, All India Institute of Medical Sciences, Bhubaneswar, IND
| | | | - Saurav Nayak
- Biochemistry, All India Institute of Medical Sciences, Bhubaneswar, IND
| |
Collapse
|
4
|
Li M, Li X, Lu X, Zhong M, Wang L, Song M, Xue F. Sigma metric used to evaluate the performance of haematology analysers: choosing an internal reference analyser for the laboratory. Hematology 2023; 28:2277498. [PMID: 37916652 DOI: 10.1080/16078454.2023.2277498] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2023] [Accepted: 10/25/2023] [Indexed: 11/03/2023] Open
Abstract
INTRODUCTION The sigma metric offers a quantitative framework for evaluating process performance in clinical laboratories. This study aimed to evaluate the analytical performance of automated analysers in haematology laboratories, using the sigma metric to choose the best analyser as an internal reference analyser. MATERIALS AND METHODS internal quality control (IQC) data were collected for 6 months from SNCS, and the sigma value was calculated for 9 haematology analysers in the laboratory. RESULTS For the normal control level, a satisfactory mean sigma value ≥3 was observed for all of the studied parameters of all automated analysers. For the low control level, platelet (PLT) count by Instrument (Inst.) G performed poorly, with a mean sigma value <3. Inst. H, with all parameters' sigma values >4, performed best and was chosen as the internal reference analyser. CONCLUSION The sigma metric can be used as a guide to choose the QC strategy and plan QC frequency. It can facilitate the comparison of the same assay performed by multiple systems.
Collapse
Affiliation(s)
- Min Li
- Department of Clinical Laboratory, Weifang People's Hospital, Weifang, People's Republic of China
| | - Xiaojuan Li
- Department of Clinical Laboratory, Weifang People's Hospital, Weifang, People's Republic of China
| | - Xiaohong Lu
- Department of Clinical Laboratory, Weifang People's Hospital, Weifang, People's Republic of China
| | - Mingqin Zhong
- Department of Clinical Laboratory, Weifang People's Hospital, Weifang, People's Republic of China
| | - Lin Wang
- Department of Clinical Laboratory, Weifang People's Hospital, Weifang, People's Republic of China
| | - Mingze Song
- Department of Clinical Laboratory, Weifang People's Hospital, Weifang, People's Republic of China
| | - Feng Xue
- Department of Clinical Laboratory, Weifang People's Hospital, Weifang, People's Republic of China
| |
Collapse
|
5
|
Gadde R, HM V. Analysis of biochemical analytes using six sigma metrics with two analyzers at an Indian lab setting. Bioinformation 2023; 19:1043-1050. [PMID: 38046510 PMCID: PMC10692979 DOI: 10.6026/973206300191043] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Revised: 11/30/2023] [Accepted: 11/30/2023] [Indexed: 12/05/2023] Open
Abstract
A zero defects goal was implemented in the clinical laboratory settings using a six-sigma model. Daily Internal Quality Control (IQC) and external quality control data from April-September 2023 was extracted to calculate the sigma metrics of 21 biochemical analytes based on Total Error Allowable (TEa), % bias and co-efficient of variation percent (CV%). A retrospective comparative study was conducted in the department of Clinical Biochemistry at Kanva Diagnostic Services Pvt. Ltd, Bengaluru, India. The analytical performance of the 21 biochemical analytes was tested on Cobas 6000 and C311 analyzers. Quality Goal Index (QGI) and root cause analysis was calculated to infer the reason for the deviation of six sigma. Method decision charts were plotted to show the comparison of the problem analytes on both the analyzers. On Cobas 6000 at level 1 IQC, out of 21 analytes, 10 analytes showed σ>6 and 10 analytes showed σ 3-6 and on C311, 15 analytes which showed σ>6 and 6 analytes that showed σ 3-6. On Cobas 6000 at level 2 IQC, out of 21 analytes, 12 analytes showed σ>6 and 8 analytes showed σ 3-6 and on C311 17 analytes showed σ>6 and 4 analytes showed σ 3-6. Creatinine failed to meet minimal sigma performance at both levels of IQC on Cobas 6000.
Collapse
Affiliation(s)
- Ranjeeta Gadde
- Kanva Diagnostic Services Private Ltd, #744, 11th Block, 2nd Stage, Marilingappa Extension, Nagarbhavi, Bengaluru - 560072, Karnataka, India
| | - Venkatappa HM
- Kanva Diagnostic Services Private Ltd, #744, 11th Block, 2nd Stage, Marilingappa Extension, Nagarbhavi, Bengaluru - 560072, Karnataka, India
| |
Collapse
|
6
|
Ercan Ş. Comparison of Sigma metrics computed by three bias estimation approaches for 33 chemistry and 26 immunoassay analytes. ADVANCES IN LABORATORY MEDICINE 2023; 4:236-245. [PMID: 38162416 PMCID: PMC10756147 DOI: 10.1515/almed-2022-0095] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/06/2022] [Accepted: 06/05/2023] [Indexed: 01/03/2024]
Abstract
Objectives Sigma metric can be calculated using a simple equation. However, there are multiple sources for the elements in the equation that may produce different Sigma values. This study aimed to investigate the importance of different bias estimation approaches for Sigma metric calculation. Methods Sigma metrics were computed for 33 chemistry and 26 immunoassay analytes on the Roche Cobas 6000 analyzer. Bias was estimated by three approaches: (1) averaging the monthly bias values obtained from the external quality assurance (EQA) studies; (2) calculating the bias values from the regression equation derived from the EQA data; and (3) averaging the monthly bias values from the internal quality control (IQC) events. Sigma metrics were separately calculated for the two levels of the IQC samples using three bias estimation approaches. The resulting Sigma values were classified into five categories considering Westgard Sigma Rules as ≥6, <6 and ≥5, <5 and ≥4, <4 and ≥3, and <3. Results When classifying Sigma metrics estimated by three bias estimation approaches for each assay, 16 chemistry assays at the IQC level 1 and 2 were observed to fall into different Sigma categories under at least one bias estimation approach. Similarly, for 12 immunoassays at the IQC level 1 and 2, Sigma category was different depending on bias estimation approach. Conclusions Sigma metrics may differ depending on bias estimation approaches. This should be considered when using Six Sigma for assessing analytical performance or scheduling the IQC events.
Collapse
Affiliation(s)
- Şerif Ercan
- Department of Medical Biochemistry, Lüleburgaz State Hospital, Lüleburgaz Devlet Hastanesi İstiklal Mah, Kırklareli, Türkiye
| |
Collapse
|
7
|
Ercan Ş. Comparación de la métrica Sigma calculada con tres métodos de estimación del sesgo en 33 magnitudes químicas y 26 de inmunoensayo. ADVANCES IN LABORATORY MEDICINE 2023; 4:246-257. [PMID: 38162415 PMCID: PMC10756148 DOI: 10.1515/almed-2023-0095] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/06/2022] [Accepted: 06/05/2023] [Indexed: 01/03/2024]
Abstract
Objetivos Aunque la métrica Sigma se puede calcular mediante una sencilla ecuación, la diversidad de fuentes de las que se extraen los elementos de la ecuación pueden arrojar diferentes valores Sigma. El objetivo de este estudio era investigar la importancia de las distintas estrategias de estimación del sesgo para el cálculo de la métrica Sigma. Métodos Se calculó la métrica Sigma de 33 magnitudes químicas y 26 magnitudes de inmunoensayo en un analizador Roche Cobas 6,000. El sesgo se calculó mediante tres métodos: a) calculando la media del sesgo mensual obtenida en los estudios de control de calidad externo (EQA, por sus siglas en inglés); 2) calculando los valores de sesgo mediante una ecuación de regresión a partir de datos obtenidos del EQA; y 3) calculando la media de los valores de sesgo mensual de los eventos de control de calidad internos (IQC, por sus siglas en inglés). Se realizó una métrica Sigma para cada uno de los dos niveles de muestras de IQC empleando tres métodos para calcular el sesgo. Los valores Sigma obtenidos se clasificaron en cinco categorías, en función de las reglas Sigma de Westgard, siendo ≥6, <6 y ≥5, <5 y ≥4, <4 y ≥3, y <3. Resultados Al clasificar la métrica Sigma, calculada aplicando tres métodos de estimación del sesgo para cada magnitud, se observó que 16 magnitudes químicas en los niveles 1 y 2 de IQC fueron clasificadas en categorías Sigma diferentes por al menos uno de los métodos de estimación de la desviación. Del mismo modo, dependiendo del método de estimación del sesgo empleado, se clasificaba en diferentes categorías a 12 magnitudes de inmunoensayo con niveles 1 y 2 de IQC. Conclusiones La métrica Sigma puede variar dependiendo del método empleado para calcular el sesgo, lo cual debe ser tenido en cuenta a la hora de evaluar el rendimiento analítico o programar eventos de IQC aplicando el método Seis Sigma.
Collapse
Affiliation(s)
- Şerif Ercan
- Departamento de Bioquímica Médica, Lüleburgaz State Hospital, Kırklareli, Türkiye
| |
Collapse
|
8
|
Saporito A, Tassone C, Di Iorio A, Barbieri Saraceno M, Bressan A, Pini R, Mongelli F, La Regina D. Six Sigma can significantly reduce costs of poor quality of the surgical instruments sterilization process and improve surgeon and operating room personnel satisfaction. Sci Rep 2023; 13:14116. [PMID: 37644121 PMCID: PMC10465484 DOI: 10.1038/s41598-023-41393-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 08/25/2023] [Indexed: 08/31/2023] Open
Abstract
Operating room (OR) management is a complex multidimensional activity combining clinical and managerial aspects. This longitudinal observational study aimed to assess the impact of Six-Sigma methodology to optimize surgical instrument sterilization processes. The project was conducted at the operating theatre of our tertiary regional hospital during the period from July 2021 to December 2022. The project was based on the surgical instrument supply chain analysis. We applied the Six Sigma lean methodology by conducting workshops and practical exercises and by improving the surgical instrument process chain, as well as checking stakeholders' satisfaction. The primary outcome was the analysis of Sigma improvement. Through this supply chain passed 314,552 instruments in 2022 and 22 OR processes were regularly assessed. The initial Sigma value was 4.79 ± 1.02σ, and the final one was 5.04 ± 0.85σ (SMD 0.60, 95%CI 0.16-1.04, p = 0.010). The observed improvement was estimated in approximately $19,729 of cost savings. Regarding personnel satisfaction, 150 questionnaires were answered, and the overall score improved from 6.6 ± 2.2 pts to 7.0 ± 1.9 pts (p = 0.013). In our experience the application of the Lean Six Sigma methodology to the process of handling the surgical instruments from/to the OR was cost-effective, significantly decreased the costs of poor quality and increased internal stakeholder satisfaction.
Collapse
Affiliation(s)
- Andrea Saporito
- Department of Anesthesia, Ospedale Regionale di Bellinzona e Valli, EOC, Bellinzona, Switzerland
- Faculty of Medicine, Università della Svizzera Italiana, Lugano, Switzerland
| | - Claudio Tassone
- Operating Theatre, Ospedale Regionale di Bellinzona e Valli, EOC, Bellinzona, Switzerland
| | - Antonio Di Iorio
- Operating Theatre, Ospedale Regionale di Bellinzona e Valli, EOC, Bellinzona, Switzerland
| | | | - Alessandro Bressan
- Hospital Direction, Ospedale Regionale di Bellinzona e Valli, EOC, Bellinzona, Switzerland
| | - Ramon Pini
- Department of Surgery, Ospedale Regionale di Bellinzona e Valli, EOC, Via Gallino 12, 6500, Bellinzona, Switzerland
| | - Francesco Mongelli
- Faculty of Medicine, Università della Svizzera Italiana, Lugano, Switzerland.
- Department of Surgery, Ospedale Regionale di Bellinzona e Valli, EOC, Via Gallino 12, 6500, Bellinzona, Switzerland.
| | - Davide La Regina
- Faculty of Medicine, Università della Svizzera Italiana, Lugano, Switzerland
- Department of Surgery, Ospedale Regionale di Bellinzona e Valli, EOC, Via Gallino 12, 6500, Bellinzona, Switzerland
| |
Collapse
|
9
|
Application of a six sigma model to evaluate the analytical performance of cerebrospinal fluid biochemical analytes and the design of quality control strategies for these assays: A single-centre study. Clin Biochem 2023; 114:73-78. [PMID: 36796711 DOI: 10.1016/j.clinbiochem.2023.02.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Revised: 02/05/2023] [Accepted: 02/11/2023] [Indexed: 02/16/2023]
Abstract
BACKGROUND In this study, we applied a six sigma model to examine cerebrospinal fluid (CSF) biochemical analytes for the first time. Our goal was to evaluate the analytical performance of various CSF biochemical analytes, design an optimized internal quality control (IQC) strategy, and formulate scientific and reasonable improvement plans. METHODS The sigma values of CSF total protein (CSF-TP), albumin (CSF-ALB), chloride (CSF-Cl), and glucose (CSF-GLU) were calculated using the following formula: sigma = [TEa(%)-|bias(%)|]/CV(%). The analytical performance of each analyte was shown using a normalized sigma method decision chart. Individualized IQC schemes and improvement protocols for CSF biochemical analytes were formulated using the Westgard sigma rule flow chart with batch size and quality goal index (QGI). RESULTS The distribution of sigma values for CSF biochemical analytes ranged from 5.0 to 9.9, and the sigma values varied for different concentrations of the same analyte. The analytical performance of the CSF assays at the two QC levels is displayed visually in normalized sigma method decision charts. Individualized IQC strategies for CSF biochemical analytes were as follows: for CSF-ALB, CSF-TP and CSF-Cl, use 13s with N = 2 and R = 1000; for CSF-GLU, use 13s/22s/R4s with N = 2 and R = 450. In addition, priority improvement measures for analytes with sigma values less than 6 (CSF-GLU) were formulated based on the QGI, and their analytical performance was improved after the corresponding improvement measures were taken. CONCLUSIONS The six sigma model has significant advantages in practical applications involving CSF biochemical analytes and is highly useful for quality assurance and quality improvement.
Collapse
|
10
|
Sulthana P.K. S, U. R, Yassir S, Prasad V. G, Ansar M. A comparative evaluation of six sigma metrics and quality goal index ratio 3 months prior to first lockdown due to COVID-19 pandemic and 3 months during lockdown in a NABL accredited central laboratory. Biomedicine (Taipei) 2022. [DOI: 10.51248/.v42i5.2038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
Introduction and Aim: Sigma represents Standard Deviation (SD) which indicates the degree of variation in a process, where the higher sigma value implies that less likely the laboratory reports false test results. Using a newer parameter called Quality Goal Index (QGI) we can find the reason behind the lower sigma value. Our study aimed to compare the six-sigma metric and QGI ratio 3 months prior to first lockdown due to COVID-19 pandemic and 3 months during the first lockdown.
Methodology: A retrospective study was used to compare the six-sigma metric and QGI ratio 3 months prior to first lockdown due to COVID-19 pandemic and 3 months during the first lockdown for the selected ten analytes from 1st of January 2020 to 30th of June 2020 from the clinical biochemistry section of Yenepoya Medical College Hospital, Deralakatte, Mangalore.
Results: The sigma metrics from January to March (level 1) indicated that urea, TSH, beta-HCG fell short of meeting Six Sigma quality performance and from April to June, glucose, creatinine, urea and ALT had metrics less than 3 at both the Internal Quality Control levels. QGI ratio indicated that from January to March, the problem was imprecision for urea, TSH and beta-HCG (QGI < 0.8). From April to June, urea and creatinine showed imprecision, glucose and ALT showed inaccuracy, urea and ALT showed both imprecision and inaccuracy.
Conclusion: This study highlights the necessity for stringent Internal Quality Control and External Quality Assurance monitoring even during the lockdown period of the pandemic. By implementing six sigma and finding QGI ratio, quality of laboratory services can be improved immensely.
Collapse
|
11
|
Chawla R, Subberwal M, Singhal A. Use of Uncertainty of Measurement for Traceability of Test Results and Setting up of own Quality Goal for Methods having Lower Stability- A Tertiary Care Hospital study. Indian J Clin Biochem 2022; 37:458-465. [PMID: 36262788 PMCID: PMC9573843 DOI: 10.1007/s12291-021-01016-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2020] [Accepted: 11/17/2021] [Indexed: 11/29/2022]
Abstract
Uncertainty of measurement (UM) provides a quantitative estimate for traceability of test results. The Nordtest guide was applied for calculating UM of 26 analytes. For this, internal and external quality control data from July 2019 to April 2020 was used. UM of test results were compared to %TEa values of CLIA '2019, RiliBÄK, and Ricos. It was observed that UM for all analytes were below %TEa values of RiliBÄK. UM value of Albumin, Calcium and Sodium could not meet CLIA '2019 and Ricos guidelines. For results of Albumin, Calcium and Sodium to be traceable, more frequent quality control protocols resulted in decrease in bias. Quality goals were set for these three parameters. This helped in reduction of quality control cycles and optimum utilization of resources.
Collapse
Affiliation(s)
- Ranjna Chawla
- Department of Biochemistry, Govind Ballabh Pant Institute of Post Graduate Medical Education and Research (GIPMER), Room no. 411, Academic Block, GIPMER, JLN Marg, New Delhi, 110002 India
| | - Manju Subberwal
- Department of Biochemistry, Govind Ballabh Pant Institute of Post Graduate Medical Education and Research (GIPMER), Room no. 414, Academic Block, GIPMER, JLN Marg, New Delhi, 110002 India
| | - Ankush Singhal
- Department of Biochemistry, Govind Ballabh Pant Institute of Post Graduate Medical Education and Research (GIPMER), Room no. 421, Academic Block, GIPMER, JLN Marg, New Delhi, 110002 India
| |
Collapse
|
12
|
Kang F, Li W, Lou Y, Shan Z. Application of biological variation and sigma metrics to evaluate the performance of HbA 1c in external quality assessment. Scandinavian Journal of Clinical and Laboratory Investigation 2022; 82:398-403. [PMID: 35872643 DOI: 10.1080/00365513.2022.2100822] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/16/2022]
Affiliation(s)
- Fengfeng Kang
- Center for Laboratory Medicine, Zhejiang Center for Clinical Laboratory, Zhejiang Provincial People’s Hospital (Affiliated People’s Hospital, Hangzhou Medical College), Hangzhou, P.R. China
| | - Weixing Li
- Center for Laboratory Medicine, Zhejiang Center for Clinical Laboratory, Zhejiang Provincial People’s Hospital (Affiliated People’s Hospital, Hangzhou Medical College), Hangzhou, P.R. China
| | - Yongyong Lou
- Zhejiang University School of Medicine First Affiliated Hospital Beilun Branch, Beilun District People's Hospital, Ningbo, P.R. China
| | - Zhiming Shan
- Center for Laboratory Medicine, Zhejiang Center for Clinical Laboratory, Zhejiang Provincial People’s Hospital (Affiliated People’s Hospital, Hangzhou Medical College), Hangzhou, P.R. China
| |
Collapse
|
13
|
van Heerden M, George JA, Khoza S. The application of sigma metrics in the laboratory to assess quality control processes in South Africa. Afr J Lab Med 2022; 11:1344. [PMID: 35811754 PMCID: PMC9257767 DOI: 10.4102/ajlm.v11i1.1344] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2020] [Accepted: 03/30/2022] [Indexed: 11/29/2022] Open
Abstract
Background Laboratories use quality control processes to monitor and evaluate analytical performance in terms of precision and bias. Sigma metrics provide an objective assessment of laboratory quality using the total allowable error as an additional parameter. Objective This study aimed to determine the sigma metrics of analytes when using different total allowable error guidelines. Methods A retrospective analysis was performed on 19 general chemistry analytes at Charlotte Maxeke Johannesburg Academic Hospital in South Africa between January 2017 and December 2017. Sigma metrics were calculated on two identical analysers, using internal quality control data and total allowable error guidelines from the Ricos biological variation database and three alternative sources (the Royal College of Pathologists of Australasia, the Clinical Laboratory Improvements Amendment, and the European Federation of Clinical Chemistry and Laboratory Medicine). Results The sigma performance was similar on both analysers but varied based on the guideline used, with the Clinical Laboratory Improvements Amendment guidelines resulting in the best sigma metrics (53% of analytes on one analyser and 46% on the other had acceptable sigma metrics) and the Royal College of Pathologists of Australia guidelines being the most stringent (21% and 23%). Sodium and chloride performed poorly across all guidelines (sigma < 3). There were also month-to-month variations that may result in acceptable sigma despite poor performance during certain months. Conclusion The sigma varies greatly depending on the total allowable error, but could be a valuable tool to save time and decrease costs in high-volume laboratories. Sigma metrics calculations need to be standardised.
Collapse
Affiliation(s)
- Marli van Heerden
- National Health Laboratory Service, Johannesburg, South Africa
- Faculty of Health Sciences, Charlotte Maxeke Johannesburg Academic Hospital, University of the Witwatersrand, Johannesburg, South Africa
| | - Jaya A. George
- National Health Laboratory Service, Johannesburg, South Africa
- Faculty of Health Sciences, Charlotte Maxeke Johannesburg Academic Hospital, University of the Witwatersrand, Johannesburg, South Africa
| | - Siyabonga Khoza
- National Health Laboratory Service, Johannesburg, South Africa
- Faculty of Health Sciences, Charlotte Maxeke Johannesburg Academic Hospital, University of the Witwatersrand, Johannesburg, South Africa
| |
Collapse
|
14
|
Wauthier L, Di Chiaro L, Favresse J. Sigma Metrics in Laboratory Medicine: A Call for Harmonization. Clin Chim Acta 2022; 532:13-20. [PMID: 35594921 DOI: 10.1016/j.cca.2022.05.012] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Revised: 04/27/2022] [Accepted: 05/13/2022] [Indexed: 11/25/2022]
Abstract
BACKGROUND AND AIM Sigma metrics are applied in clinical laboratories to assess the quality of analytical processes. A parameter associated to a Sigma >6 is considered "world class" whereas a Sigma <3 is "poor" or "unacceptable". The aim of this retrospective study was to quantify the impact of different approaches for Sigma metrics calculation. MATERIAL AND METHODS Two IQC levels of 20 different parameters were evaluated for a 12-month period. Sigma metrics were calculated using the formula: (allowable total error (TEa) (%) - bias (%))/(coefficient of variation (CV) (%)). Method precision was calculated monthly or annually. The bias was obtained from peer comparison program (PCP) or external quality assessment program (EQAP), and 9 different TEa sources were included. RESULTS There was a substantial monthly variation of Sigma metrics for all combinations, with a median variation of 32% (IQR, 25.6-41.3%). Variation across multiple analyzers and IQC levels were also observed. Furthermore, TEa source had the highest impact on Sigma calculation with proportions of Sigma >6 ranging from 17.5% to 84.4%. The nature of bias was less decisive. CONCLUSION In absence of a clear consensus, we recommend that laboratories calculate Sigma metrics on a sufficiently long period of time (>6 months) and carefully evaluate the choice of TEa source.
Collapse
Affiliation(s)
- Loris Wauthier
- Department of Laboratory Medicine, Clinique St-Luc Bouge, Namur, Belgium
| | - Laura Di Chiaro
- Department of Laboratory Medicine, Clinique St-Luc Bouge, Namur, Belgium
| | - Julien Favresse
- Department of Laboratory Medicine, Clinique St-Luc Bouge, Namur, Belgium; Department of Pharmacy, Namur Research Institute for LIfe Sciences, University of Namur, Namur, Belgium.
| |
Collapse
|
15
|
Pašić A, Šeherčehajić E. "Six Sigma" standard as a level of quality of biochemical laboratories. SANAMED 2022. [DOI: 10.5937/sanamed0-40408] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022] Open
Abstract
The principal role of biochemical laboratories is responsibility for reliable, reproducible, accurate, timely, and accurately interpreted analysis results that help in making clinical decisions, while ensuring the desired clinical outcomes. To achieve this goal, the laboratory should introduce and maintain quality control in all phases of work. The importance of applying the Six SIGMA quality model has been analyzed in a large number of scientific studies. The purpose of this review is to highlight the importance of using six SIGMA metrics in biochemical laboratories and the current application of six SIGMA metrics in all laboratory work procedures. It has been shown that the six SIGMA model can be very useful in improving all phases of laboratory work, as well as that a detailed assessment of all procedures of the phases of work and improvement of the laboratory's quality control system is crucial for the laboratory to have the highest level of six SIGMA. Clinical laboratories should use SIGMA metrics to monitor their performance, as it makes it easier to identify gaps in their performance, thereby improving their efficiency and patient safety. Medical laboratory quality managers should provide a systematic methodology for analyzing and correcting quality assurance systems to achieve Six SIGMA quality-level standards.
Collapse
|
16
|
Carboni-Huerta R, Sáenz-Flor KV. Sigma and Risk in the Quality Control Routine: Analysis in Chilean Clinical Laboratories. J Appl Lab Med 2021; 7:456-466. [PMID: 34904169 DOI: 10.1093/jalm/jfab145] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2021] [Accepted: 09/17/2021] [Indexed: 12/18/2022]
Abstract
BACKGROUND The Six Sigma methodology is focused toward improvement, based on the Total Quality Management. It has been implemented in analytical procedures for clinical laboratories in the form of Sigma Metrics. This method is used in the evaluation of analytical procedures, providing evidence for risk-based management. METHODS A descriptive study was carried using data from 18 Chilean clinical laboratories. The information of their performance and quality specifications used in their routine work was obtained from UNITY, an internal quality comparison program. RESULTS A total of 3461 sigma evaluations was gathered, mostly from biyearly controls. The general distribution shows a median of 5.5 with positive asymmetry similar to other publications. The reported quality specifications are based in CLIA for 51.2% of the cases, 30.2% from biological variation, and 10.7% from other programs for the external quality evaluation. Significant differences (P < 0.05) were found between medians against their specification source. CONCLUSIONS In the studied series, it would be feasible to implement a risk-based quality control system with simple rules and minimal control materials for 55.5% of the evaluated sigmas. 19.6% of the sigmas require improvement mainly in precision. The variety in specifications reveals a lack of harmonization in the specification's selections.
Collapse
Affiliation(s)
- Roberto Carboni-Huerta
- Cosulting Carboni-Muñoz y Asociados, Chilean Society of Clinical Chemistry, Santiago de Chile, Chile
| | - Klever V Sáenz-Flor
- Synlab Ecuador, Management Department, Central University of Ecuador, School of Medicine, Quito, Ecuador
| |
Collapse
|
17
|
Liu Q, Bian G, Chen X, Han J, Chen Y, Wang M, Yang F. Application of a six sigma model to evaluate the analytical performance of urinary biochemical analytes and design a risk-based statistical quality control strategy for these assays: A multicenter study. J Clin Lab Anal 2021; 35:e24059. [PMID: 34652033 PMCID: PMC8605169 DOI: 10.1002/jcla.24059] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2021] [Revised: 09/15/2021] [Accepted: 10/04/2021] [Indexed: 11/13/2022] Open
Abstract
Background The six sigma model has been widely used in clinical laboratory quality management. In this study, we first applied the six sigma model to (a) evaluate the analytical performance of urinary biochemical analytes across five laboratories, (b) design risk‐based statistical quality control (SQC) strategies, and (c) formulate improvement measures for each of the analytes when needed. Methods Internal quality control (IQC) and external quality assessment (EQA) data for urinary biochemical analytes were collected from five laboratories, and the sigma value of each analyte was calculated based on coefficients of variation, bias, and total allowable error (TEa). Normalized sigma method decision charts for these urinary biochemical analytes were then generated. Risk‐based SQC strategies and improvement measures were formulated for each laboratory according to the flowchart of Westgard sigma rules, including run sizes and the quality goal index (QGI). Results Sigma values of urinary biochemical analytes were significantly different at different quality control levels. Although identical detection platforms with matching reagents were used, differences in these analytes were also observed between laboratories. Risk‐based SQC strategies for urinary biochemical analytes were formulated based on the flowchart of Westgard sigma rules, including run size and analytical performance. Appropriate improvement measures were implemented for urinary biochemical analytes with analytical performance lower than six sigma according to the QGI calculation. Conclusions In multilocation laboratory systems, a six sigma model is an excellent quality management tool and can quantitatively evaluate analytical performance and guide risk‐based SQC strategy development and improvement measure implementation.
Collapse
Affiliation(s)
- Qian Liu
- Department of Laboratory Medicine, The Second People's Hospital of Lianyungang, Lianyungang, China
| | - Guangrong Bian
- Department of Laboratory Medicine, The Second People's Hospital of Lianyungang, Lianyungang, China
| | - Xinkuan Chen
- Department of Laboratory Medicine, Xuzhou Medical University Affiliated Hospital of Lianyungang, Lianyungang, China
| | - Jingjing Han
- Department of Laboratory Medicine, Wuxi Branch of Ruijin Hospital, Wuxi, China
| | - Ying Chen
- Department of Laboratory Medicine, Nantong Hospital of Traditional Chinese Medicine, Nantong, China
| | - Menglin Wang
- Department of Laboratory Medicine, Suqian First Hospital, Suqian, China
| | - Fumeng Yang
- Department of Laboratory Medicine, The Second People's Hospital of Lianyungang, Lianyungang, China
| |
Collapse
|
18
|
Westgard SA, Bayat H, Westgard JO. A multi-test planning model for risk based statistical quality control strategies. Clin Chim Acta 2021; 523:216-223. [PMID: 34592308 DOI: 10.1016/j.cca.2021.09.020] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Revised: 09/22/2021] [Accepted: 09/23/2021] [Indexed: 11/29/2022]
Abstract
BACKGROUND Efforts to improve QC for multi-test analytic systems should focus on risk-based bracketed SQC strategies, as recommended in the CLSI C24-Ed4 guidance for QC practices. The objective is to limit patient risk by controlling the expected number of erroneous patient test results that would be reported over the period an error condition goes undetected. METHODS A planning model is described to provide a structured process for considering critical variables for the development of SQC strategies for continuous production multi-test analytic systems. The model aligns with the principles of the CLSI C24-Ed4 "roadmap" and calculation of QC frequency, or run size, based on Parvin's patient risk model. Calculations are performed using an electronic spreadsheet to facilitate application of the planning model. RESULTS Three examples of published validation data are examined to demonstrate the application of the planning model for multi-test chemistry and enzyme analyzers. The ability to assess "what if" conditions is key to identifying the changes and improvements that are necessary to simplify the overall system to a manageable number of SQC procedures. CONCLUSIONS The planning of risk based SQC strategies should align operational requirements for workload and reporting intervals with QC frequency in terms of the run size or the number of patient samples between QC events. Computer tools that support the calculation of run sizes greatly facilitate the planning process and make it practical for medical laboratories to quickly assess the effects of critical variables.
Collapse
Affiliation(s)
| | | | - James O Westgard
- Westgard QC, Inc., Madison WI, USA; University of Wisconsin School of Public Health, Madison, WI, USA.
| |
Collapse
|
19
|
Park H, Ko Y. Internal Quality Control Data of Urine Reagent Strip Tests and Derivation of Control Rules Based on Sigma Metrics. Ann Lab Med 2021; 41:447-454. [PMID: 33824232 PMCID: PMC8041599 DOI: 10.3343/alm.2021.41.5.447] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2020] [Revised: 10/12/2020] [Accepted: 03/17/2021] [Indexed: 11/19/2022] Open
Abstract
Background Urine reagent strip test (URST) results are semi-quantitative; therefore, the precision of URSTs is evaluated as the proportion of categorical results from repeated measurements of a sample that are concordant with an expected result. However, URSTs have quantitative readout values before ordinal results challenging statistical monitoring for internal quality control (IQC) with control rules. This study aimed to determine the sigma metric of URSTs and derive appropriate control rules for IQC. Methods The URiSCAN Super Plus fully automated urine analyzer (YD Diagnostics, Yongin, Korea) was used for URSTs. Change in reflectance rate (change %R) data from IQC for URSTs performed between November 2018 and May 2020 were analyzed. Red blood cells, bilirubin, urobilinogen, ketones, protein, glucose, leukocytes, and pH were measured from 2-3 levels of control materials. The total allowable error (TEa) for a grade was the difference in midpoints of a predefined change %R range between two adjacent grades. The sigma metric was calculated as TEa/SD. Sigma metric-based control rules were determined with Westgard EZ Rules 3 software (Westgard QC, Madison, WI, USA). Results Seven out of the eight analytes had a sigma metric >4 in the control materials with a negative grade (-), which were closer to the cut-offs. Corresponding control rules ranged from 12.5s to 13.5s. Conclusions Although the URST is a semi-quantitative test, statistical IQC can be performed using the readout values. According to the sigma metric, control rules recommended for URST IQC in routine clinical practice are 12.5s to 13.5s.
Collapse
Affiliation(s)
- Haeil Park
- Department of Laboratory Medicine, Bucheon St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea
| | - Younsuk Ko
- Department of Laboratory Medicine, Bucheon St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea
| |
Collapse
|
20
|
Geto Z, Getahun T, Lejisa T, Tolcha Y, Bikila D, Bashea C, Meles M, Habtu W, Ashebir G, Negasa B, Sileshi M, Daniel Y, Gashu A, Challa F. Evaluation of Sigma Metrics and Westgard Rule Selection and Implementation of Internal Quality Control in Clinical Chemistry Reference Laboratory, Ethiopian Public Health Institute. Indian J Clin Biochem 2021; 37:285-293. [DOI: 10.1007/s12291-021-00994-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2020] [Accepted: 07/02/2021] [Indexed: 10/20/2022]
|
21
|
Peng S, Zhang J, Zhou W, Mao W, Han Z. Practical application of Westgard Sigma rules with run size in analytical biochemistry processes in clinical settings. J Clin Lab Anal 2021; 35:e23665. [PMID: 33270940 PMCID: PMC7957980 DOI: 10.1002/jcla.23665] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2020] [Revised: 11/07/2020] [Accepted: 11/10/2020] [Indexed: 11/15/2022] Open
Abstract
BACKGROUND The performance of 18 routine chemical detection methods was evaluated by the sigma (σ) metric, and Westgard Sigma rules with run size were used to establish internal quality control (IQC) standards to reduce patient risks. MATERIALS AND METHODS External quality assessment (EQA) and internal quality control data from 18 assays in a biochemical laboratory were collected from January to June 2020. The sigma values of each assay were calculated, based on the bias, total error allowable, and coefficient of variation, appropriate quality control rules were selected. According to the quality goal index, the main causes of poor performance were determined to guide quality improvement. RESULTS At IQC material level 1, seven of the 18 assays achieved five sigma (excellent), and five assays (UA, Crea, AMY, TC and Na) showed world-class performance. At IQC material level 2, 14 of the 18 assays achieved 5 sigma (excellent), and thirteen assays (UA, ALT, CK, Crea, AMY, K, AST, ALP, Na, LDH, Mg, TC and GGT) showed world-class performance. The quality goal index (QGI) was calculated for items with analysis performance <5 sigma, and the main causes of poor performance were determined to guide quality improvement. CONCLUSIONS Westgard sigma rules with run size are an effective tool for evaluating the performance of biochemical assays. These rules can be used to more simply and intuitively select the quality control strategy of related items and reduce the risk to patients.
Collapse
Affiliation(s)
- SongQing Peng
- Department of Clinical LaboratoryShengzhou People's HospitalShengzhou Branch of the First Affiliated Hospital of Zhejiang UniversityShengzhouChina
| | - JinFei Zhang
- Department of Clinical LaboratoryShengzhou People's HospitalShengzhou Branch of the First Affiliated Hospital of Zhejiang UniversityShengzhouChina
| | - WuQiong Zhou
- Department of Clinical LaboratoryShengzhou People's HospitalShengzhou Branch of the First Affiliated Hospital of Zhejiang UniversityShengzhouChina
| | - WeiLin Mao
- Department of Clinical LaboratoryShengzhou People's HospitalShengzhou Branch of the First Affiliated Hospital of Zhejiang UniversityShengzhouChina
- Key laboratory of digestive system diseases of ShengzhouShengzhou People’s HospitalShengzhouChina
| | - Zhong Han
- Department of Clinical LaboratoryShengzhou People's HospitalShengzhou Branch of the First Affiliated Hospital of Zhejiang UniversityShengzhouChina
| |
Collapse
|
22
|
Liu Q, Chen X, Han J, Chen Y, Wang M, Zhao J, Liang W, Yang F. Application of a six sigma model to the evaluation of the analytical performance of serum enzyme assays and the design of a quality control strategy for these assays: A multicentre study. Clin Biochem 2021; 91:52-58. [PMID: 33617847 DOI: 10.1016/j.clinbiochem.2021.02.004] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2020] [Revised: 01/29/2021] [Accepted: 02/10/2021] [Indexed: 02/04/2023]
Abstract
BACKGROUND Six medical testing laboratories at six different sites in China participated in this study. We applied a six sigma model for (a) the evaluation of the analytical performance of serum enzyme assays at each of the laboratories, (b) the design of individualized quality control programs and (c) the development of improvement measures for each of the assays, as appropriate. METHODS Internal quality control (IQC) and external quality assessment (EQA) data for selected serum enzyme assays were collected from each of the laboratories. Sigma values for these assays were calculated using coefficients of variation, bias, and total allowable error (TEa). Normalized sigma method decision charts were generated using these parameters. IQC design and improvement measures were defined using the Westgard sigma rules. The quality goal index (QGI) was used to assist with identification of deficiencies (bias problems, precision problems, or their combination) affecting the analytical performance of assays with sigma values <6. RESULTS Sigma values for the selected serum enzyme assays were significantly different at different levels of enzyme activity. Differences in assay quality in different laboratories were also seen, despite the use of identical testing instruments and reagents. Based on the six sigma data, individualized quality control programs were outlined for each assay with sigma <6 at each laboratory. CONCLUSIONS In multi-location laboratory systems, a six sigma model can evaluate the quality of the assays being performed, allowing management to design individualized IQC programs and strategies for continuous improvement as appropriate for each laboratory. This will improve patient care, especially for patients transferred between sites within multi-hospital systems.
Collapse
Affiliation(s)
- Qian Liu
- Department of Laboratory Medicine, The Second People's Hospital of Lianyungang, Lianyungang, PR China
| | - Xinkuan Chen
- Department of Laboratory Medicine, Xuzhou Medical University Affiliated Hospital of Lianyungang, Lianyungang, PR China
| | - Jingjing Han
- Department of Laboratory Medicine, Wuxi Branch of Ruijin Hospital, Wuxi, PR China
| | - Ying Chen
- Department of Laboratory Medicine, Nantong Hospital of Traditional Chinese Medicine, Nantong, PR China
| | - Menglin Wang
- Department of Laboratory Medicine, Suqian First Hospital, Suqian, PR China
| | - Jun Zhao
- Department of Laboratory Medicine, Wuxi Maternal and Child Health Hospital, Wuxi, PR China
| | - Wei Liang
- Department of Laboratory Medicine, The Second People's Hospital of Lianyungang, Lianyungang, PR China
| | - Fumeng Yang
- Department of Laboratory Medicine, The Second People's Hospital of Lianyungang, Lianyungang, PR China.
| |
Collapse
|
23
|
Liu Y, Cao Y, Liu X, Wu L, Cai W. Evaluation of the analytical performance of endocrine analytes using sigma metrics. J Clin Lab Anal 2020; 35:e23581. [PMID: 32951270 PMCID: PMC7843286 DOI: 10.1002/jcla.23581] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2020] [Revised: 08/24/2020] [Accepted: 08/29/2020] [Indexed: 11/11/2022] Open
Abstract
Background (a) To evaluate the clinical performance of endocrine analytes using the sigma metrics (σ) model. (b) To redesign quality control strategies for performance improvement. Methods The sigma values of the analytes were initially evaluated based on the allowable total error (TEa), bias, and coefficient of variation (CV) at QC materials level 1 and 2 in March 2018. And then, the normalized QC performance decision charts, personalized QC rules, quality goal index (QGI) analysis, and root causes analysis (RCA) were performed based on the sigma values of the analytes. Finally, the sigma values were re‐evaluated in September 2018 after a series of targeted corrective actions. Results Based on the initial sigma values, two analytes (FT3 and TSH) with σ > 6, only needed one QC rule (13S) with N2 and R500 for QC management. On the other hand, seven analytes (FT4, TT4, CROT, E2, PRL, TESTO, and INS) with σ < 4 at one QC material level or both needed multiple rules (13S/22S/R4S/41S/10X) with N6 and R10‐500 depending on different sigma values for QC management. Subsequently, detailed and comprehensive RCA and timely corrective actions were performed on all the analytes base on the QGI analysis. Compared with the initial sigma values, the re‐evaluated sigma metrics of all the analytes increased significantly. Conclusions It was demonstrated that the combination of sigma metrics, QGI analysis, and RCA provided a useful evaluation system for the analytical performance of endocrine analytes.
Collapse
Affiliation(s)
- Yanming Liu
- Department of Laboratory Medicine, YueBei People's Hospital, Shaoguan, China.,Guangdong Provincial Key Laboratory of Medical Molecular Diagnostics, Institute of Aging Research, Guangdong Medical University, Dongguan, China
| | - Yue Cao
- Department of Medical Technology, Medical College of Shaoguan University, Shaoguan, China
| | - Xijun Liu
- Department of Laboratory Medicine, YueBei People's Hospital, Shaoguan, China
| | - Liangyin Wu
- Department of Laboratory Medicine, YueBei People's Hospital, Shaoguan, China
| | - Wencan Cai
- Department of Laboratory Medicine, YueBei People's Hospital, Shaoguan, China
| |
Collapse
|
24
|
Zhou B, Wu Y, He H, Li C, Tan L, Cao Y. Practical application of Six Sigma management in analytical biochemistry processes in clinical settings. J Clin Lab Anal 2019; 34:e23126. [PMID: 31774217 PMCID: PMC6977137 DOI: 10.1002/jcla.23126] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2019] [Revised: 10/31/2019] [Accepted: 11/08/2019] [Indexed: 01/03/2023] Open
Abstract
BACKGROUND Six Sigma methodology with a zero-defect goal has long been applied in commercial settings and was utilized in this study to assure/improve the quality of various analytes. METHODS Daily internal quality control (QC) and external quality assessment data were collected and analyzed by calculating the sigma (σ) values for 19 analytes based on the coefficient of variation, bias, and total error allowable. Standardized QC sigma charts were established with these parameters. Quality goal index (QGI) analysis and root cause analysis (RCA) were used to discover potential problems for the analytes. RESULTS Five analytes with σ ≥ 6 achieved world-class performance, and only the Westgard rule (13s ) with one control measurement at two QC material levels (N2) per QC event and a run size of 1000 patient samples between QC events (R1000) was needed for QC. In contrast, more control rules (22s /R4s /41s ) along with high N values and low R values were needed for quality assurance for five analytes with 4 ≤ σ < 6. However, the sigma levels of nine analytes were σ < 4 at one or more QC levels, and a more rigorous QC procedure (13s /22s /R4s /41s /8x with N4 and R45) was implemented. The combination of QGI analysis and RCA further revealed inaccuracy or imprecision problems for these analytes with σ < 4 and discovered five aspects of potential causes considered for quality improvement. CONCLUSIONS Six Sigma methodology is an effective tool for evaluating the performance of biochemical analytes and is conducive to quality assurance and improvement.
Collapse
Affiliation(s)
- Bingfei Zhou
- Clinical Laboratory of Hunan Provincial People's Hospital, The First Affiliated Hospital of Hunan Normal University, Changsha, China.,Research Office of Clinical Laboratory, Clinical Translational Medicine Research Institute of Hunan Provincial People's Hospital, The First Affiliated Hospital of Hunan Normal University, Changsha, China
| | - Yi Wu
- Clinical Laboratory of Hunan Provincial People's Hospital, The First Affiliated Hospital of Hunan Normal University, Changsha, China
| | - Hanlin He
- Department of Medical laboratory of Hunan Normal University School of Medicine, Changsha, China
| | - Cunyan Li
- Clinical Laboratory of Hunan Provincial People's Hospital, The First Affiliated Hospital of Hunan Normal University, Changsha, China.,Research Office of Clinical Laboratory, Clinical Translational Medicine Research Institute of Hunan Provincial People's Hospital, The First Affiliated Hospital of Hunan Normal University, Changsha, China
| | - Liming Tan
- Clinical Laboratory of Hunan Provincial People's Hospital, The First Affiliated Hospital of Hunan Normal University, Changsha, China
| | - Youde Cao
- Clinical Laboratory of Hunan Provincial People's Hospital, The First Affiliated Hospital of Hunan Normal University, Changsha, China.,Research Office of Clinical Laboratory, Clinical Translational Medicine Research Institute of Hunan Provincial People's Hospital, The First Affiliated Hospital of Hunan Normal University, Changsha, China
| |
Collapse
|