1
|
Arnaud J, Weykamp C, Wenzel R, Patriarca M, González-Estecha M, Janssen L, Fofou-Caillierez MB, Alemany MV, Patriarca V, de Graaf I, Persoons R, Panadès M, China B, Winkel MT, van der Vuurst H, Thelen M. Analytical performance specifications for trace elements in biological fluids derived from six countries federated external quality assessment schemes over 10 years. Clin Chem Lab Med 2024; 0:cclm-2024-0551. [PMID: 39027966 DOI: 10.1515/cclm-2024-0551] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2024] [Accepted: 07/07/2024] [Indexed: 07/20/2024]
Abstract
OBJECTIVES This article defines analytical performance specifications (APS) for evaluating laboratory proficiency through an external quality assessment scheme. METHODS Standard deviations for proficiency assessment were derived from Thompson's characteristic function applied to robust data calculated from participants' submissions in the Occupational and Environmental Laboratory Medicine (OELM) external quality assurance scheme for trace elements in serum, whole blood and urine. Characteristic function was based on two parameters: (1) β - the average coefficient of variation (CV) at high sample concentrations; (2) α - the average standard deviation (SD) at low sample concentrations. APSs were defined as 1.65 standard deviations calculated by Thompson's approach. Comparison between OELM robust data and characteristic function were used to validate the model. RESULTS Application of the characteristic function allowed calculated APS for 18 elements across three matrices. Some limitations were noted, particularly for elements (1) with no sample concentrations near analytical technique limit of detection; (2) exhibiting high robust CV at high concentration; (3) exhibiting high analytical variability such as whole blood Tl and urine Pb; (4) with an unbalanced number of robust SD above and under the characteristic function such as whole blood Mn and serum Al and Zn. CONCLUSIONS The characteristic function was a useful means of deriving APS for trace elements in biological fluids where biological variation data or outcome studies were not available. However, OELM external quality assurance scheme data suggests that the characteristic functions are not appropriate for all elements.
Collapse
Affiliation(s)
- Josiane Arnaud
- Member of French Society for Clinical Biology (SFBC), and French Speaking Society for Trace Elements, Vitamins and Biofactors (SETViB), Paris, France
| | - Cas Weykamp
- MCA Laboratory, Queen Beatrix Hospital, Winterswijk, The Netherlands
| | - Ross Wenzel
- Pathology NSW, Royal North Shore Hospital, St Leonards, NSW, Australia
| | - Marina Patriarca
- Department of Food Safety, Nutrition and Veterinary Public Health, Istituto Superiore di Sanità, Rome, Italy
| | | | - Liesbeth Janssen
- MCA Laboratory, Queen Beatrix Hospital, Winterswijk, The Netherlands
| | | | | | - Valeria Patriarca
- Department of Food Safety, Nutrition and Veterinary Public Health, Istituto Superiore di Sanità, Rome, Italy
| | - Irene de Graaf
- MCA Laboratory, Queen Beatrix Hospital, Winterswijk, The Netherlands
| | - Renaud Persoons
- University of Grenoble Alpes, CNRS, Grenoble INP, CHU Grenoble Alpes, TIMC, Grenoble, France
| | - Mariona Panadès
- External Quality Assessment Schemes, Spanish Society of Laboratory Medicine, Barcelona, Spain
| | - Bernard China
- Department of Quality of Laboratories, Sciensano, Brussels, Belgium
| | - Marieke Te Winkel
- MCA Laboratory, Queen Beatrix Hospital, Winterswijk, The Netherlands
| | | | - Marc Thelen
- Foundation of Quality Assurance in Laboratory Medicine (SKML), Nijmegen, The Netherlands
- Department of Laboratory Medicine, Radboud University Medical Center, Nijmegen, The Netherlands
| |
Collapse
|
2
|
Coskun A. Prediction interval: A powerful statistical tool for monitoring patients and analytical systems. Biochem Med (Zagreb) 2024; 34:020101. [PMID: 38665871 PMCID: PMC11042565 DOI: 10.11613/bm.2024.020101] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Accepted: 01/23/2024] [Indexed: 04/28/2024] Open
Abstract
Monitoring is indispensable for assessing disease prognosis and evaluating the effectiveness of treatment strategies, both of which rely on serial measurements of patients' data. It also plays a critical role in maintaining the stability of analytical systems, which is achieved through serial measurements of quality control samples. Accurate monitoring can be achieved through data collection, following a strict preanalytical and analytical protocol, and the application of a suitable statistical method. In a stable process, future observations can be predicted based on historical data collected during periods when the process was deemed reliable. This can be evaluated using the statistical prediction interval. Statistically, prediction interval gives an "interval" based on historical data where future measurement results can be located with a specified probability such as 95%. Prediction interval consists of two primary components: (i) the set point and (ii) the total variation around the set point which determines the upper and lower limits of the interval. Both can be calculated using the repeated measurement results obtained from the process during its steady-state. In this paper, (i) the theoretical bases of prediction intervals were outlined, and (ii) its practical application was explained through examples, aiming to facilitate the implementation of prediction intervals in laboratory medicine routine practice, as a robust tool for monitoring patients' data and analytical systems.
Collapse
Affiliation(s)
- Abdurrahman Coskun
- Department of Medical Biochemistry, Acıbadem Mehmet Ali Aydinlar University, School of Medicine, Istanbul, Turkey
| |
Collapse
|
3
|
Ercan Ş. Comparison of Sigma metrics computed by three bias estimation approaches for 33 chemistry and 26 immunoassay analytes. ADVANCES IN LABORATORY MEDICINE 2023; 4:236-245. [PMID: 38162416 PMCID: PMC10756147 DOI: 10.1515/almed-2022-0095] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/06/2022] [Accepted: 06/05/2023] [Indexed: 01/03/2024]
Abstract
Objectives Sigma metric can be calculated using a simple equation. However, there are multiple sources for the elements in the equation that may produce different Sigma values. This study aimed to investigate the importance of different bias estimation approaches for Sigma metric calculation. Methods Sigma metrics were computed for 33 chemistry and 26 immunoassay analytes on the Roche Cobas 6000 analyzer. Bias was estimated by three approaches: (1) averaging the monthly bias values obtained from the external quality assurance (EQA) studies; (2) calculating the bias values from the regression equation derived from the EQA data; and (3) averaging the monthly bias values from the internal quality control (IQC) events. Sigma metrics were separately calculated for the two levels of the IQC samples using three bias estimation approaches. The resulting Sigma values were classified into five categories considering Westgard Sigma Rules as ≥6, <6 and ≥5, <5 and ≥4, <4 and ≥3, and <3. Results When classifying Sigma metrics estimated by three bias estimation approaches for each assay, 16 chemistry assays at the IQC level 1 and 2 were observed to fall into different Sigma categories under at least one bias estimation approach. Similarly, for 12 immunoassays at the IQC level 1 and 2, Sigma category was different depending on bias estimation approach. Conclusions Sigma metrics may differ depending on bias estimation approaches. This should be considered when using Six Sigma for assessing analytical performance or scheduling the IQC events.
Collapse
Affiliation(s)
- Şerif Ercan
- Department of Medical Biochemistry, Lüleburgaz State Hospital, Lüleburgaz Devlet Hastanesi İstiklal Mah, Kırklareli, Türkiye
| |
Collapse
|
4
|
Ercan Ş. Comparación de la métrica Sigma calculada con tres métodos de estimación del sesgo en 33 magnitudes químicas y 26 de inmunoensayo. ADVANCES IN LABORATORY MEDICINE 2023; 4:246-257. [PMID: 38162415 PMCID: PMC10756148 DOI: 10.1515/almed-2023-0095] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/06/2022] [Accepted: 06/05/2023] [Indexed: 01/03/2024]
Abstract
Objetivos Aunque la métrica Sigma se puede calcular mediante una sencilla ecuación, la diversidad de fuentes de las que se extraen los elementos de la ecuación pueden arrojar diferentes valores Sigma. El objetivo de este estudio era investigar la importancia de las distintas estrategias de estimación del sesgo para el cálculo de la métrica Sigma. Métodos Se calculó la métrica Sigma de 33 magnitudes químicas y 26 magnitudes de inmunoensayo en un analizador Roche Cobas 6,000. El sesgo se calculó mediante tres métodos: a) calculando la media del sesgo mensual obtenida en los estudios de control de calidad externo (EQA, por sus siglas en inglés); 2) calculando los valores de sesgo mediante una ecuación de regresión a partir de datos obtenidos del EQA; y 3) calculando la media de los valores de sesgo mensual de los eventos de control de calidad internos (IQC, por sus siglas en inglés). Se realizó una métrica Sigma para cada uno de los dos niveles de muestras de IQC empleando tres métodos para calcular el sesgo. Los valores Sigma obtenidos se clasificaron en cinco categorías, en función de las reglas Sigma de Westgard, siendo ≥6, <6 y ≥5, <5 y ≥4, <4 y ≥3, y <3. Resultados Al clasificar la métrica Sigma, calculada aplicando tres métodos de estimación del sesgo para cada magnitud, se observó que 16 magnitudes químicas en los niveles 1 y 2 de IQC fueron clasificadas en categorías Sigma diferentes por al menos uno de los métodos de estimación de la desviación. Del mismo modo, dependiendo del método de estimación del sesgo empleado, se clasificaba en diferentes categorías a 12 magnitudes de inmunoensayo con niveles 1 y 2 de IQC. Conclusiones La métrica Sigma puede variar dependiendo del método empleado para calcular el sesgo, lo cual debe ser tenido en cuenta a la hora de evaluar el rendimiento analítico o programar eventos de IQC aplicando el método Seis Sigma.
Collapse
Affiliation(s)
- Şerif Ercan
- Departamento de Bioquímica Médica, Lüleburgaz State Hospital, Kırklareli, Türkiye
| |
Collapse
|
5
|
Plebani M. Control interno de la calidad y garantía externa de la calidad: un gran pasado abre el camino a un brillante futuro. ADVANCES IN LABORATORY MEDICINE 2022; 3:218-220. [PMCID: PMC10197387 DOI: 10.1515/almed-2022-0080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
|
6
|
Plebani M. Internal quality control and external quality assurance: a great past opens the way to a bright future. ADVANCES IN LABORATORY MEDICINE 2022; 3:215-220. [PMID: 37362140 PMCID: PMC10197377 DOI: 10.1515/almed-2022-0075] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/28/2023]
Affiliation(s)
- Mario Plebani
- Honorary Professor of Clinical Biochemistry and Clinical Molecular Biology, School of Medicine, University of Padova, Padova, Italy
| |
Collapse
|