1
|
Panteghini M. What the Milan conference has taught us about analytical performance specification model definition and measurand allocation. Clin Chem Lab Med 2024; 62:1455-1461. [PMID: 38277658 DOI: 10.1515/cclm-2023-1257] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2023] [Accepted: 01/08/2024] [Indexed: 01/28/2024]
Abstract
Analytical performance specifications (APS) represent the criteria that specify the quality required for laboratory test information to satisfy clinical needs. In 2014 the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) considered timely to update the topic of APS by organizing a conference in Milan in which some strategic concepts were proposed. Here I summarize the essential points representing the EFLM Strategic Conference heritage and discuss the approaches that will permit us to become more concrete, including roles and main actions expected from each of involved stakeholders for contributing a quantum leap forward in the way of practicality of Milan consensus about APS.
Collapse
Affiliation(s)
- Mauro Panteghini
- Department of Laboratory Medicine, Ludwik Rydygier Collegium Medicum in Bydgoszcz, Nicolaus Copernicus University in Torun, Torun, Poland
| |
Collapse
|
2
|
Panteghini M. An improved implementation of metrological traceability concepts is needed to benefit from standardization of laboratory results. Clin Chem Lab Med 2024; 0:cclm-2024-0428. [PMID: 38687497 DOI: 10.1515/cclm-2024-0428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2024] [Accepted: 04/12/2024] [Indexed: 05/02/2024]
Abstract
Non-harmonization of laboratory results represents a concrete risk for patient safety. To avoid harms, it is agreed that measurements by in vitro diagnostic medical devices (IVD-MD) on clinical samples should be traceable to higher-order references and adjusted to give the same result. However, metrological traceability is not a formal claim and has to be correctly implemented, which in practice does not happen for a non-negligible number of measurands. Stakeholders, such as higher-order reference providers, IVD manufacturers, and External Quality Assessment organizers, have major responsibilities and should improve their contribution by unambiguously and rigorously applying what is described in the International Organization for Standardization 17511:2020 standard and other documents provided by the international scientific bodies, such as Joint Committee on Traceability in Laboratory Medicine and IFCC. For their part, laboratory professionals should take responsibility to abandon non-selective methods and move to IVD-MDs displaying proper selectivity, which is one of the indispensable prerequisites for the correct implementation of metrological traceability. The practicality of metrological traceability concepts is not impossible but relevant education and appropriate training of all involved stakeholders are essential to obtain the expected benefits in terms of standardization.
Collapse
Affiliation(s)
- Mauro Panteghini
- Department of Laboratory Medicine, Ludwik Rydygier Collegium Medicum in Bydgoszcz, Nicolaus Copernicus University, Torun, Poland
| |
Collapse
|
3
|
Theodorsson E, Meijer P, Badrick T. External quality assurance in the era of standardization. Clin Chim Acta 2024; 557:117876. [PMID: 38493945 DOI: 10.1016/j.cca.2024.117876] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2024] [Revised: 03/14/2024] [Accepted: 03/14/2024] [Indexed: 03/19/2024]
Abstract
Metrology in clinical chemistry aims to ensure the equivalence of measurement results from different in-vitro diagnostic measurement devices (IVD MD) for use in healthcare. The metrological traceability of measurement results to higher-order references is the cornerstone to achieving equivalent results. However, other fundamentals are also needed, including the commutability of reference materials and external quality assessment (EQA) materials for monitoring the equivalence of measurement results at the end-user level. This manuscript summarizes the findings and opinions expressed at the Joint Community for Traceability in Laboratory Medicine (JCTLM) workshop held on December 4-5, 2023. The workshop explored the relationship between EQA/proficiency testing and metrological traceability to higher-order references. EQA monitors the equivalence of measurement results from end-user IVD MDs. The workshop discussed the role and challenges of using EQA to improve and maintain the equivalence of measurement results. It also elucidated current developments in establishing the clinical suitability of laboratory results expressed as analytical performance specifications (APS).
Collapse
Affiliation(s)
- Elvar Theodorsson
- Department of Biomedical and Clinical Sciences, Division of Clinical Chemistry and Pharmacology, Linköping University, Linköping, Sweden.
| | - Piet Meijer
- ECAT Foundation, Voorschoten, The Netherlands
| | - Tony Badrick
- RCPA Quality Assurance Programs, St Leonards, Sydney, Australia
| |
Collapse
|
4
|
Çubukçu HC, Vanstapel F, Thelen M, van Schrojenstein Lantman M, Bernabeu-Andreu FA, Meško Brguljan P, Milinkovic N, Linko S, Panteghini M, Boursier G. APS calculator: a data-driven tool for setting outcome-based analytical performance specifications for measurement uncertainty using specific clinical requirements and population data. Clin Chem Lab Med 2024; 62:597-607. [PMID: 37978287 DOI: 10.1515/cclm-2023-0740] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Accepted: 10/18/2023] [Indexed: 11/19/2023]
Abstract
OBJECTIVES According to ISO 15189:2022, analytical performance specifications (APS) should relate to intended clinical use and impact on patient care. Therefore, we aimed to develop a web application for laboratory professionals to calculate APS based on a simulation of the impact of measurement uncertainty (MU) on the outcome using the chosen decision limits, agreement thresholds, and data of the population of interest. METHODS We developed the "APS Calculator" allowing users to upload and select data of concern, specify decision limits and agreement thresholds, and conduct simulations to determine APS for MU. The simulation involved categorizing original measurand concentrations, generating measured (simulated) results by introducing different degrees of MU, and recategorizing measured concentrations based on clinical decision limits and acceptable clinical misclassification rates. The agreements between original and simulated result categories were assessed, and values that met or exceeded user-specified agreement thresholds that set goals for the between-category agreement were considered acceptable. The application generates contour plots of agreement rates and corresponding MU values. We tested the application using National Health and Nutrition Examination Survey data, with decision limits from relevant guidelines. RESULTS We determined APS for MU of six measurands (blood total hemoglobin, plasma fasting glucose, serum total and high-density lipoprotein cholesterol, triglycerides, and total folate) to demonstrate the potential of the application to generate APS. CONCLUSIONS The developed data-driven web application offers a flexible tool for laboratory professionals to calculate APS for MU using their chosen decision limits and agreement thresholds, and the data of the population of interest.
Collapse
Affiliation(s)
- Hikmet Can Çubukçu
- General Directorate of Health Services, Rare Diseases Department, Turkish Ministry of Health, Ankara, Türkiye
- Hacettepe University Institute of Informatics, Ankara, Türkiye
| | - Florent Vanstapel
- Laboratory Medicine, University Hospital Leuven, Leuven, Belgium
- Department of Public Health, Biomedical Sciences Group, Catholic University Leuven, Leuven, Belgium
| | - Marc Thelen
- SKML, Foundation for Quality Assurance in Laboratory Medicine, Nijmegen, The Netherlands
- Department of Laboratory Medicine, Radboud University Medical Centre, Nijmegen, The Netherlands
| | - Marith van Schrojenstein Lantman
- SKML, Foundation for Quality Assurance in Laboratory Medicine, Nijmegen, The Netherlands
- Department of Laboratory Medicine, Radboud University Medical Centre, Nijmegen, The Netherlands
- Result Laboratory for Clinical Chemistry, Amphia Hospital Breda, Breda, The Netherlands
| | | | - Pika Meško Brguljan
- Department of Clinical Chemistry, University Clinic for Respiratory and Allergic Deseases, Golnik, Slovenia
| | - Neda Milinkovic
- Department of Medical Biochemistry, Faculty of Pharmacy, University of Belgrade, Belgrade, Serbia
| | | | - Mauro Panteghini
- Research Centre for Metrological Traceability in Laboratory Medicine (CIRME), University of Milan, Milan, Italy
| | - Guilaine Boursier
- Department of Molecular Genetics and Cytogenomics, Rare Diseases and Autoinflammatory Unit, CHU Montpellier, University of Montpellier, Montpellier, France
| |
Collapse
|
5
|
Oliva C, Arias A, Ruiz-Sala P, Garcia-Villoria J, Carling R, Bierau J, Ruijter GJG, Casado M, Ormazabal A, Artuch R. Targeted ultra performance liquid chromatography tandem mass spectrometry procedures for the diagnosis of inborn errors of metabolism: validation through ERNDIM external quality assessment schemes. Clin Chem Lab Med 2024; 0:cclm-2023-1291. [PMID: 38456798 DOI: 10.1515/cclm-2023-1291] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2023] [Accepted: 02/22/2024] [Indexed: 03/09/2024]
Abstract
OBJECTIVES Early diagnosis of inborn errors of metabolism (IEM) is crucial to ensure early detection of conditions which are treatable. This study reports on targeted metabolomic procedures for the diagnosis of IEM of amino acids, acylcarnitines, creatine/guanidinoacetate, purines/pyrimidines and oligosaccharides, and describes its validation through external quality assessment schemes (EQA). METHODS Analysis was performed on a Waters ACQUITY UPLC H-class system coupled to a Waters Xevo triple-quadrupole (TQD) mass spectrometer, operating in both positive and negative electrospray ionization mode. Chromatographic separation was performed on a CORTECS C18 column (2.1 × 150, 1.6 µm). Data were collected by multiple reaction monitoring. RESULTS The internal and EQA results were generally adequate, with a few exceptions. We calculated the relative measurement error (RME) and only a few metabolites displayed a RME higher than 30 % (asparagine and some acylcarnitine species). For oligosaccharides, semi-quantitative analysis of an educational panel clearly identified the 8 different diseases included. CONCLUSIONS Overall, we have validated our analytical system through an external quality control assessment. This validation will contribute to harmonization between laboratories, thus improving identification and management of patients with IEM.
Collapse
Affiliation(s)
- Clara Oliva
- Biochemistry and Molecular Genetics Department, 571524 Hospital Clínic de Barcelona , Barcelona, Spain
| | - Angela Arias
- Clinical Biochemistry Department, 16512 Institut de Recerca Sant Joan de Déu , Barcelona, Spain
| | - Pedro Ruiz-Sala
- Centre for Biomedical Network Research on Rare Diseases (CIBERER), Instituto de Salud Carlos III, Madrid, Spain
- Centro de Diagnóstico de Enfermedades Moleculares, Universidad Autónoma de Madrid, IdIPAZ, Madrid, Spain
| | - Judit Garcia-Villoria
- Biochemistry and Molecular Genetics Department, 571524 Hospital Clínic de Barcelona , Barcelona, Spain
- Centre for Biomedical Network Research on Rare Diseases (CIBERER), Instituto de Salud Carlos III, Madrid, Spain
- Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
| | - Rachel Carling
- Department of Biochemical Sciences, 8945 Synnovis, Guy's & St Thomas' NHSFT , London, UK
| | - Jörgen Bierau
- Department of Clinical Genetics, 570888 Maastricht University Medical Center , Maastricht, The Netherlands
- Department of Clinical Genetics, Erasmus Medical Center, Rotterdam, The Netherlands
| | - George J G Ruijter
- Center for Lysosomal and Metabolic Diseases, Department of Clinical Genetics, Erasmus University Medical Center, Rotterdam, The Netherlands
| | - Mercedes Casado
- Clinical Biochemistry Department, 16512 Institut de Recerca Sant Joan de Déu , Barcelona, Spain
- Centre for Biomedical Network Research on Rare Diseases (CIBERER), Instituto de Salud Carlos III, Madrid, Spain
| | - Aida Ormazabal
- Clinical Biochemistry Department, 16512 Institut de Recerca Sant Joan de Déu , Barcelona, Spain
- Centre for Biomedical Network Research on Rare Diseases (CIBERER), Instituto de Salud Carlos III, Madrid, Spain
| | - Rafael Artuch
- Clinical Biochemistry Department, 16512 Institut de Recerca Sant Joan de Déu , Barcelona, Spain
- Centre for Biomedical Network Research on Rare Diseases (CIBERER), Instituto de Salud Carlos III, Madrid, Spain
| |
Collapse
|
6
|
Panteghini M. Documenting and validating metrological traceability of serum alanine aminotransferase measurements: a priority for medical laboratory community for providing high quality service in hepatology. Clin Chem Lab Med 2024; 62:249-252. [PMID: 37698363 DOI: 10.1515/cclm-2023-0900] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2023] [Accepted: 08/29/2023] [Indexed: 09/13/2023]
Abstract
Alanine aminotransferase (ALT) represents the first-level test to detect individuals with hepatocellular damage of any etiology. However, it has been highlighted that the lack of assay harmonization may lead to overdiagnosis and unnecessary further testing if guideline-recommended fixed cut-offs are uncritically employed. To solve the issue of ALT (dis)harmonization and improve the interpretation of its values, a series of urgent actions for documenting and validating metrological traceability of serum ALT measurements, as described in this paper, are no longer postponeable. It is time that all medical laboratory stakeholders (in vitro diagnostic manufacturers, laboratorians, external quality assessment scheme organizers) actively co-operate to implement the ALT standardization in a concerted action following well-established theoretical assumptions and applying experimental approaches described in literature.
Collapse
Affiliation(s)
- Mauro Panteghini
- Research Centre for Metrological Traceability in Laboratory Medicine (CIRME), University of Milan, Milan, Italy
| |
Collapse
|
7
|
Sandberg S, Fauskanger P, Johansen JV, Keller T, Budd J, Greenberg N, Rej R, Panteghini M, Delatour V, Ceriotti F, Deprez L, Camara JE, MacKenzie F, Lyle AN, van der Hagen E, Burns C, Greg Miller W. Recommendations for Setting a Criterion and Assessing Commutability of Sample Materials Used in External Quality Assessment/Proficiency Testing Schemes. Clin Chem 2023; 69:1227-1237. [PMID: 37725906 DOI: 10.1093/clinchem/hvad135] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2023] [Accepted: 08/21/2023] [Indexed: 09/21/2023]
Abstract
It is important for external quality assessment materials (EQAMs) to be commutable with clinical samples; i.e., they should behave like clinical samples when measured using end-user clinical laboratory in vitro diagnostic medical devices (IVD-MDs). Using commutable EQAMs makes it possible to evaluate metrological traceability and/or equivalence of results between IVD-MDs. The criterion for assessing commutability of an EQAM between 2 IVD-MDs is that its result should be within the prediction interval limits based on the statistical distribution of the clinical sample results from the 2 IVD-MDs being compared. The width of the prediction interval is, among other things, dependent on the analytical performance characteristics of the IVD-MDs. A presupposition for using this criterion is that the differences in nonselectivity between the 2 IVD-MDs being compared are acceptable. An acceptable difference in nonselectivity should be small relative to the analytical performance specifications used in the external quality assessment scheme. The acceptable difference in nonselectivity is used to modify the prediction interval criterion for commutability assessment. The present report provides recommendations on how to establish a criterion for acceptable commutability for EQAMS, establish the difference in nonselectivity that can be accepted between IVD-MDs, and perform a commutability assessment. The report also contains examples for performing a commutability assessment of EQAMs.
Collapse
Affiliation(s)
- Sverre Sandberg
- Norwegian Organization for Quality Improvement of Laboratory Examinations (Noklus), Haraldsplass Deaconess Hospital, Bergen, Norway
- Norwegian Porphyria Centre, Department of Medical Biochemistry and Pharmacology, Haukeland University Hospital, Bergen, Norway
- Department of Global Public Health and Primary Care, University of Bergen, Bergen, Norway
| | - Pernille Fauskanger
- Norwegian Organization for Quality Improvement of Laboratory Examinations (Noklus), Haraldsplass Deaconess Hospital, Bergen, Norway
| | | | | | - Jeffrey Budd
- Jeff Budd Consulting, St. Paul, MN, United States
| | - Neil Greenberg
- Neil Greenberg Consulting, LLC, Rochester, NY, United States
| | - Robert Rej
- Department of Biomedical Sciences, School of Public Health, State University of New York at Albany, Albany, NY, United States
| | - Mauro Panteghini
- Research Centre for Metrological Traceability in Laboratory Medicine, University of Milan, Milan, Italy
| | | | | | - Liesbet Deprez
- European Commission, Joint Research Centre, Directorate F, Geel, Belgium
| | - Johanna E Camara
- National Institute of Standards and Technology, Gaithersburg, MD, United States
| | - Finlay MacKenzie
- Birmingham Quality/UK NEQAS, University Hospitals Birmingham NHS Foundation Trust, Birmingham, United Kingdom
| | - Alicia N Lyle
- Centers for Disease Control and Prevention, Atlanta, GA, United States
| | | | - Chris Burns
- National Institute for Biological Standards and Control, A Centre of the MHRA, Hertfordshire, United Kingdom
| | - W Greg Miller
- Virginia Commonwealth University, Richmond, VA, United States
| |
Collapse
|
8
|
Buchta C, Zeichhardt H, Aberle SW, Camp JV, Görzer I, Weseslindtner L, Puchhammer-Stöckl E, Huf W, Benka B, Allerberger F, Mielke M, Griesmacher A, Müller MM, Schellenberg I, Kammel M. Design of external quality assessment schemes and definition of the roles of their providers in future epidemics. THE LANCET. MICROBE 2023; 4:e552-e562. [PMID: 37156257 PMCID: PMC10162712 DOI: 10.1016/s2666-5247(23)00072-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Revised: 02/16/2023] [Accepted: 02/20/2023] [Indexed: 05/10/2023]
Abstract
During an epidemic, individual test results form the basis of epidemiological indicators such as case numbers or incidence. Therefore, the accuracy of measures derived from these indicators depends on the reliability of individual results. In the COVID-19 pandemic, monitoring and evaluating the performance of the unprecedented number of testing facilities in operation, and novel testing systems in use, was urgently needed. External quality assessment (EQA) schemes are unique sources of data reporting on testing performance, and their providers are recognised contacts and support for test facilities (for technical-analytical topics) and health authorities (for planning the monitoring of infection diagnostics). To identify information provided by SARS-CoV-2 genome detection EQA schemes that is relevant for public health microbiology, we reviewed the current literature published in PubMed between January, 2020, and July, 2022. We derived recommendations for EQA providers and their schemes for best practices to monitor pathogen-detection performance in future epidemics. We also showed laboratories, test facilities, and health authorities the information and benefits they can derive from EQA data, and from the non-EQA services of their providers.
Collapse
Affiliation(s)
- Christoph Buchta
- Austrian Association for Quality Assurance and Standardization of Medical and Diagnostic Tests, Vienna, Austria; European Organisation for External Quality Assurance Providers in Laboratory Medicine, Geneva, Switzerland.
| | - Heinz Zeichhardt
- INSTAND eV Society for Promoting Quality Assurance in Medical Laboratories, Düsseldorf, Germany; IQVD GmbH, Institut für Qualitätssicherung in der Virusdiagnostik, Berlin, Germany; GBD Gesellschaft für Biotechnologische Diagnostik, Berlin, Germany
| | - Stephan W Aberle
- Center for Virology, Medical University of Vienna, Vienna, Austria
| | - Jeremy V Camp
- Center for Virology, Medical University of Vienna, Vienna, Austria
| | - Irene Görzer
- Center for Virology, Medical University of Vienna, Vienna, Austria
| | | | | | - Wolfgang Huf
- Karl Landsteiner Institute for Clinical Risk Management, Vienna, Austria
| | - Bernhard Benka
- Austrian Agency for Health and Food Safety, Vienna, Austria
| | | | - Martin Mielke
- Department for Infectious Diseases, Robert Koch-Institute, Berlin, Germany
| | - Andrea Griesmacher
- Austrian Association for Quality Assurance and Standardization of Medical and Diagnostic Tests, Vienna, Austria
| | - Mathias M Müller
- Austrian Association for Quality Assurance and Standardization of Medical and Diagnostic Tests, Vienna, Austria
| | - Ingo Schellenberg
- INSTAND eV Society for Promoting Quality Assurance in Medical Laboratories, Düsseldorf, Germany
| | - Martin Kammel
- INSTAND eV Society for Promoting Quality Assurance in Medical Laboratories, Düsseldorf, Germany; IQVD GmbH, Institut für Qualitätssicherung in der Virusdiagnostik, Berlin, Germany; GBD Gesellschaft für Biotechnologische Diagnostik, Berlin, Germany
| |
Collapse
|
9
|
Stavelin A, Rønneseth E, Gidske G, Solsvik AE, Sandberg S. Using three external quality assurance schemes to achieve equivalent international normalized ratio results in primary and secondary healthcare. Clin Chem Lab Med 2023; 61:419-426. [PMID: 36538607 DOI: 10.1515/cclm-2022-1080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Accepted: 12/09/2022] [Indexed: 12/24/2022]
Abstract
OBJECTIVES Accurate prothrombin time international normalized ratio (INR) results are essential for safe anticoagulation treatment. Patients are treated both in primary and secondary healthcare, therefore equivalence of INR results from point-of-care (POC) and hospital measurement procedures (MPs) are important. It is not possible to evaluate this equivalence in traditional external quality assessment (EQA). The aim of this paper is to describe a special quality assurance system consisting of three different EQA schemes to monitor the harmonization of INR results in Norway. METHODS The EQA scheme for hospital laboratories uses commutable control materials and evaluates participant performance and the equivalence of hospital MPs. The EQA scheme for primary healthcare laboratories uses non-commutable control materials and evaluates participant performance. A third EQA scheme for selected primary healthcare laboratories uses native patient split samples and evaluates the equivalence between POC and hospital MPs. RESULTS The relationship between the three EQA schemes is presented. The split sample EQA scheme provides a link between the hospital scheme and the scheme for primary healthcare. Results from 2017 to 2022 are presented for all three schemes. When aberrant EQA results occur Noklus takes actions to be able to have a sustainable equivalence between INR results. CONCLUSIONS All three EQA schemes are important for monitoring the harmonization of INR results in Norway. This quality assurance system, including help and guidance of the participants, will reduce the risk of harm to patients due to non-equivalence of results from different MPs.
Collapse
Affiliation(s)
- Anne Stavelin
- The Norwegian Organization for Quality Improvement of Laboratory Examinations (Noklus), Haraldsplass Deaconess Hospital, Bergen, Norway
| | - Eva Rønneseth
- The Norwegian Organization for Quality Improvement of Laboratory Examinations (Noklus), Haraldsplass Deaconess Hospital, Bergen, Norway
| | - Gro Gidske
- The Norwegian Organization for Quality Improvement of Laboratory Examinations (Noklus), Haraldsplass Deaconess Hospital, Bergen, Norway
- Department of Global Public Health and Primary Care, University of Bergen, Bergen, Norway
| | - Anne Elisabeth Solsvik
- The Norwegian Organization for Quality Improvement of Laboratory Examinations (Noklus), Haraldsplass Deaconess Hospital, Bergen, Norway
| | - Sverre Sandberg
- The Norwegian Organization for Quality Improvement of Laboratory Examinations (Noklus), Haraldsplass Deaconess Hospital, Bergen, Norway
- Department of Global Public Health and Primary Care, University of Bergen, Bergen, Norway
| |
Collapse
|
10
|
Krintus M, Panteghini M. Judging the clinical suitability of analytical performance of cardiac troponin assays. Clin Chem Lab Med 2023; 61:801-810. [PMID: 36798043 DOI: 10.1515/cclm-2023-0027] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2023] [Accepted: 02/07/2023] [Indexed: 02/18/2023]
Abstract
New millennium diagnostic criteria for acute myocardial infarction precipitated a revolutionary shift from an approach based primarily on electrocardiography and clinical symptoms to a strategy based on biomarkers, and preferably cardiac troponins (cTn) I and T. In the last 20 years, clinical recommendations have strengthened the role of cTn and led to the development of highly sensitive (hs-cTn) assays, which are now leading players in all current clinical practice guidelines. To optimize the clinical use of these hs-cTn assays, focus on their analytical aspects has become increasingly important, emphasizing the need for the establishment of suitable analytical performance by the definition and implementation of appropriate specifications. An accurate estimate of measurement uncertainty, together with the acquisition of the highest analytical quality when very low concentrations of hs-cTn are measured, are essential requirements and should represent a practical laboratory standard in assuring optimal clinical use. Additional goals for further improving the quality of laboratory information should be the establishment of robust data concerning biological variation of cTn and the resolution of practical challenges opposed to the harmonization of cTn I results obtained by differing commercial measuring systems.
Collapse
Affiliation(s)
- Magdalena Krintus
- Department of Laboratory Medicine, Collegium Medicum, Nicolaus Copernicus University, Bydgoszcz, Torun, Poland
| | - Mauro Panteghini
- Department of Biomedical and Clinical Sciences, University of Milan, Milano, Italy
| |
Collapse
|
11
|
Methods and Advances in the Design, Testing and Development of In Vitro Diagnostic Instruments. Processes (Basel) 2023. [DOI: 10.3390/pr11020403] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023] Open
Abstract
With the continuous improvement of medical testing and instrumentation engineering technologies, the design, testing and development methods of in vitro diagnostic instruments are developing rapidly. In vitro diagnostic instruments are also gradually developing into a class of typical high-end medical equipment. The design of in vitro diagnostic instruments involves a variety of medical diagnostic methods and biochemical, physical and other related technologies, and its development process involves complex system engineering. This paper systematically organizes and summarizes the design, testing and development methods of in vitro diagnostic instruments and their development in recent years, focusing on summarizing the related technologies and core aspects of the R&D process, and analyzes the development trend of the in vitro diagnostic instrument market.
Collapse
|
12
|
Panteghini M. Redesigning the surveillance of in vitro diagnostic medical devices and of medical laboratory performance by quality control in the traceability era. Clin Chem Lab Med 2022; 61:759-768. [PMID: 36542481 DOI: 10.1515/cclm-2022-1257] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2022] [Accepted: 12/12/2022] [Indexed: 12/24/2022]
Abstract
Abstract
IVD manufacturers have total responsibility in terms of the traceability of marketed in vitro diagnostic medical devices (IVD-MD). This includes the provision of a quality control (QC) material as a part of the measuring system, suitable for traceability verification and alignment surveillance by end-users in daily practice. This material [to be used for the internal QC (IQC) component I as described in this paper] should have unbiased target values and an acceptability range corresponding to analytical performance specifications (APS) for suitable (expanded) measurement uncertainty (MU) on clinical samples. On the other hand, medical laboratories (by the IQC component II as described in this paper) should improve the IQC process and its judging criteria to establish a direct link between their performance, estimated as MU of provided results, and APS defined according to recommended models to apply corrective actions if the performance is worsening with the risk to jeopardize the clinical validity of test results. The participation to external quality assessment (EQA) programs that meet specific metrological criteria is also central to the evaluation of performance of IVD-MDs and of medical laboratories in terms of harmonization and clinical suitability of their measurements. In addition to the use of commutable materials, in this type of EQA it is necessary to assign values to them with selected reference procedures and to define and apply maximum allowable APS to substantiate the suitability of laboratory measurements in the clinical setting.
Collapse
Affiliation(s)
- Mauro Panteghini
- Centre for Metrological Traceability in Laboratory Medicine (CIRME) , University of Milan , Milano , Italy
| |
Collapse
|
13
|
Redolfi A, Archetti D, De Francesco S, Crema C, Tagliavini F, Lodi R, Ghidoni R, Gandini Wheeler-Kingshott CAM, Alexander DC, D'Angelo E. Italian, European, and international neuroinformatics efforts: An overview. Eur J Neurosci 2022. [PMID: 36310103 DOI: 10.1111/ejn.15854] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2022] [Revised: 10/18/2022] [Accepted: 10/18/2022] [Indexed: 12/15/2022]
Abstract
Neuroinformatics is a research field that focusses on software tools capable of identifying, analysing, modelling, organising and sharing multiscale neuroscience data. Neuroinformatics has exploded in the last two decades with the emergence of the Big Data phenomenon, characterised by the so-called 3Vs (volume, velocity and variety), which provided neuroscientists with an improved ability to acquire and process data faster and more cheaply thanks to technical improvements in clinical, genomic and radiological technologies. This situation has led to a 'data deluge', as neuroscientists can routinely collect more study data in a few days than they could in a year just a decade ago. To address this phenomenon, several neuroimaging-focussed neuroinformatics platforms have emerged, funded by national or transnational agencies, with the following goals: (i) development of tools for archiving and organising analytical data (XNAT, REDCap and LabKey); (ii) development of data-driven models evolving from reductionist approaches to multidimensional models (RIN, IVN, HBD, EuroPOND, E-DADS and GAAIN BRAIN); and (iii) development of e-infrastructures to provide sufficient computational power and storage resources (neuGRID, HBP-EBRAINS, LONI and CONP). Although the scenario is still fragmented, there are technological and economical attempts at both national and international levels to introduce high standards for open and Findable, Accessible, Interoperable and Reusable (FAIR) neuroscience worldwide.
Collapse
Affiliation(s)
- Alberto Redolfi
- Laboratory of Neuroinformatics, IRCCS Istituto Centro San Giovanni di Dio Fatebenefratelli, Brescia, Italy
| | - Damiano Archetti
- Laboratory of Neuroinformatics, IRCCS Istituto Centro San Giovanni di Dio Fatebenefratelli, Brescia, Italy
| | - Silvia De Francesco
- Laboratory of Neuroinformatics, IRCCS Istituto Centro San Giovanni di Dio Fatebenefratelli, Brescia, Italy
| | - Claudio Crema
- Laboratory of Neuroinformatics, IRCCS Istituto Centro San Giovanni di Dio Fatebenefratelli, Brescia, Italy
| | - Fabrizio Tagliavini
- Scientific Directorate, Fondazione IRCCS Istituto Neurologico Carlo Besta, Milan, Italy
| | - Raffaele Lodi
- Functional and Molecular Neuroimaging Unit, IRCCS Istituto delle Scienze Neurologiche di Bologna, Bologna, Italy.,Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
| | - Roberta Ghidoni
- Molecular Markers Laboratory, IRCCS Istituto Centro San Giovanni di Dio Fatebenefratelli, Brescia, Italy
| | - Claudia A M Gandini Wheeler-Kingshott
- NMR Research Unit, Queen Square MS Center, Department of Neuroinflammation, UCL Institute of Neurology, London, UK.,Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy.,Brain Connectivity Center, IRCCS Mondino Foundation, Pavia, Italy
| | - Daniel C Alexander
- Centre for Medical Image Computing, University College London, London, UK.,Department of Computer Science, University College London, London, UK
| | - Egidio D'Angelo
- Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy.,Brain Connectivity Center, IRCCS Mondino Foundation, Pavia, Italy
| |
Collapse
|
14
|
Braga F, Pasqualetti S, Frusciante E, Borrillo F, Chibireva M, Panteghini M. Harmonization Status of Serum Ferritin Measurements and Implications for Use as Marker of Iron-Related Disorders. Clin Chem 2022; 68:1202-1210. [PMID: 35794075 DOI: 10.1093/clinchem/hvac099] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Accepted: 05/06/2022] [Indexed: 11/13/2022]
Abstract
BACKGROUND Serum ferritin is considered a suitable biomarker of iron-related disorders. However, data about the comparability of results among commercial measuring systems (MSs) are contradictory. We performed an intercomparison study aimed at verifying the current interassay variability and its impact on clinical application of the test. Obtaining this information is vital because manufacturers continue to claim calibration alignment to different WHO preparations, which are not related to each other in terms of traceability. METHODS Four widely used MSs were evaluated. The interassay agreement was verified using 39 human serum pools. The recovery of WHO International Standard (IS) 94/572 (the only reference material available at the time of the study) was evaluated, after assessing the material commutability. Finally, an approach for harmonizing ferritin results was proposed. RESULTS Highly significant differences (P < 0.00001) among ferritin concentrations assayed by different MSs were detected and the interassay CV (median 22.9%; interquartile range 21.8-25.5) overlapped the desirable intermethod bias (24.6%). IS 94/572 was commutable for use only with Access and Centaur, with Access being the only MS correctly recovering its assigned value. Accordingly, we used regression data against Access to recalibrate MSs, indirectly aligning them to IS 94/572, with a substantial improvement in degree of harmonization and traceability to higher-order reference. CONCLUSIONS The harmonization among evaluated ferritin MSs is far from optimal, with the implementation of traceability to different WHO ISs being a factor of confusion. A recalibration approach, however, would permit measurement harmonization, allowing the use of common decision thresholds.
Collapse
Affiliation(s)
- Federica Braga
- Research Centre for Metrological Traceability in Laboratory Medicine (CIRME), Università degli Studi di Milano, Milan, Italy
| | - Sara Pasqualetti
- Research Centre for Metrological Traceability in Laboratory Medicine (CIRME), Università degli Studi di Milano, Milan, Italy
| | - Erika Frusciante
- Research Centre for Metrological Traceability in Laboratory Medicine (CIRME), Università degli Studi di Milano, Milan, Italy
| | - Francesca Borrillo
- Research Centre for Metrological Traceability in Laboratory Medicine (CIRME), Università degli Studi di Milano, Milan, Italy
| | - Mariia Chibireva
- Research Centre for Metrological Traceability in Laboratory Medicine (CIRME), Università degli Studi di Milano, Milan, Italy
| | - Mauro Panteghini
- Research Centre for Metrological Traceability in Laboratory Medicine (CIRME), Università degli Studi di Milano, Milan, Italy
| |
Collapse
|
15
|
Caruso S, Szoke D, Panteghini M. 'Penelope test': a practical instrument for checking appropriateness of laboratory tests. Clin Chem Lab Med 2022; 60:1342-1349. [PMID: 35785546 DOI: 10.1515/cclm-2022-0368] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2022] [Accepted: 06/22/2022] [Indexed: 11/15/2022]
Abstract
In medical laboratories, the appropriateness challenge directly revolves around the laboratory test and its proper selection, data analysis, and result reporting. However, laboratories have also a role in the appropriate management of those phases of total testing process (TTP) that traditionally are not under their direct control. So that, the laboratory obligation to act along the entire TTP is now widely accepted in order to achieve better care management. Because of the large number of variables involved in the overall TTP structure, it is difficult to monitor appropriateness in real time. However, it is possible to retrospectively reconstruct the body of the clinical process involved in the management of a specific laboratory test to track key passages that may be defective or incomplete in terms of appropriateness. Here we proposed an appropriateness check-list scheme along the TTP chain to be potentially applied to any laboratory test. This scheme consists of a series of questions that healthcare professionals should answer to achieve laboratory test appropriateness. In the system, even a single lacking answer may compromise the integrity of all appropriateness evaluation process as the inability to answer may involve a significant deviation from the optimal trajectory, which compromise the test appropriateness and the quality of subsequent steps. Using two examples of the check-list application, we showed that the proposed instrument may offer an objective help to avoid inappropriate use of laboratory tests in an integrated way involving both laboratory professionals and user clinicians.
Collapse
Affiliation(s)
- Simone Caruso
- Clinical Pathology Unit, ASST Fatebenefratelli-Sacco, Milan, Italy
| | - Dominika Szoke
- Clinical Pathology Unit, ASST Fatebenefratelli-Sacco, Milan, Italy
| | - Mauro Panteghini
- Clinical Pathology Unit, ASST Fatebenefratelli-Sacco, Milan, Italy
| |
Collapse
|
16
|
Panteghini M, Braga F, Camara JE, Delatour V, Van Uytfanghe K, Vesper HW, Zhang T. Optimizing Available Tools for Achieving Result Standardization: Value Added by Joint Committee on Traceability in Laboratory Medicine (JCTLM). Clin Chem 2021; 67:1590-1605. [PMID: 34633037 DOI: 10.1093/clinchem/hvab178] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2021] [Accepted: 08/12/2021] [Indexed: 12/14/2022]
Abstract
BACKGROUND The JCTLM created a Task Force on Reference Measurement System Implementation (TF-RMSI) to provide guidance on metrological traceability implementation for the in vitro diagnostics (IVD) community. CONTENT TF-RMSI investigated the reference measurement systems (RMS) for 13 common measurands by applying the following procedural steps: (a) extracting data from the JCTLM database of available certified reference materials (CRMs) and reference measurement procedures (RMPs); (b) describing the RMS to which each recruited CRM or RMP belongs; (c) identifying the intended use of the CRMs, and, if used as a common calibrator for IVD measuring systems and/or trueness assessment of field methods was included, checking the CRM's certificate for information about commutability with clinical samples; and (d) checking if the CRM or RMP measurement uncertainty (MU) has the potential to be small enough to avoid significantly affecting the analytical performance specifications (APS) for MU of clinical sample results when the MU from the IVD calibrator and from the end-user measuring system were combined. SUMMARY We produced a synopsis of JCTLM-listed higher-order CRMs and RMPs for the selected measurands, including their main characteristics for implementing traceability and fulfilling (or not) the APS for suitable MU. Results showed that traceability to higher-order references can be established by IVD manufacturers within the defined APS for most of the 13 selected measurands. However, some measurands do not yet have suitable CRMs for use as common calibrators. For these measurands, splitting clinical samples with a laboratory performing the RMP may provide a practical alternative for establishing a calibration hierarchy.
Collapse
Affiliation(s)
- Mauro Panteghini
- 'L. Sacco' Department of Biomedical and Clinical Sciences, Research Centre for Metrological Traceability in Laboratory Medicine (CIRME), University of Milan, Milano, Italy
| | - Federica Braga
- 'L. Sacco' Department of Biomedical and Clinical Sciences, Research Centre for Metrological Traceability in Laboratory Medicine (CIRME), University of Milan, Milano, Italy
| | - Johanna E Camara
- Chemical Sciences Division, National Institute of Standards and Technology, Gaithersburg, MD
| | - Vincent Delatour
- Chemistry and Biology Division, Laboratoire National de Metrologie et d'Essais (LNE), Paris, France
| | - Katleen Van Uytfanghe
- Ref4U-Laboratory of Toxicology, Department of Bioanalysis, Faculty of Pharmaceutical Sciences, Ghent University, Ghent, Belgium
| | - Hubert W Vesper
- Division of Laboratory Sciences, Centers for Disease Control and Prevention, Atlanta, GA
| | - Tianjiao Zhang
- Division of clinical chemistry, National Center for Clinical Laboratories, Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing, China
| | | |
Collapse
|
17
|
Zhang S, Cheng F, Wang H, Wen J, Zeng J, Zhang C, Liu W, Wang N, Jia T, Wang M, Zhang R, Yue Y, Xu J, Wang Z, Li Y, Chen W, Wang Q. Comparability of thyroid-stimulating hormone immunoassays using fresh frozen human sera and external quality assessment data. PLoS One 2021; 16:e0253324. [PMID: 34129644 PMCID: PMC8205121 DOI: 10.1371/journal.pone.0253324] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2021] [Accepted: 06/03/2021] [Indexed: 12/04/2022] Open
Abstract
Background This study aimed to assess the comparability among assays using freshly frozen human sera and external quality assessment (EQA) data in China. Methods Twenty-nine serum samples and two commercial EQA materials, obtained from the National Center for Clinical Laboratories (NCCL), were analyzed in triplicate using eight routine TSH assays. The commutability of commercial EQA materials (NCCL materials) was evaluated in accordance with the CLSI EP30-A and IFCC bias analysis. Median values obtained for the NCCL EQA materials were used to determine the systematic and commutability-related biases among immunoassays through back-calculation. The comparability of TSH measurements from a panel of clinical samples and NCCL EQA data was determined on the basis of Passing–Bablok regression. Furthermore, human serum pools were used to perform commutable EQA. Results NCCL EQA materials displayed commutability among three or five of seven assay combinations according CLSI or IFCC approach, respectively. The mean of systematic bias ranged from -13.78% to 9.85% for the eight routine TSH assays. After correcting for systematic bias, averaged commutability-related biases ranged between -42.26% and 12.19%. After correction for systematic and commutability -related biases, the slopes indicating interassay relatedness ranged from 0.801 to 1.299 using individual human sera, from 0.735 to 1.254 using NCCL EQA data, and from 0.729 to 1.115 using pooled human serum EQA(the commutable EQA). Conclusions The harmonization of TSH measurement is challenging; hence, systematic and commutability-related biases should be determined and corrected for accurate comparisons among assays when using human individual serum and the commercial EQA materials.
Collapse
Affiliation(s)
- Shunli Zhang
- Department of Clinical Laboratory, Beijing Chaoyang Hospital, Beijing Center for Clinical Laboratories, The Third Clinical Medical College of Capital Medical University, Beijing, P.R. China
| | - Fei Cheng
- Department of Clinical Laboratory, Wangjing Hospital, China Academy of Traditional Chinese Medicine, Beijing, P.R. China
| | - Hua Wang
- Department of Clinical Laboratory, China-Japan Friendship Hospital, Beijing, P.R. China
| | - Jiangping Wen
- Department of Clinical Laboratory, Beijing Tongren Hospital, Capital Medical University, Beijing, P.R. China
| | - Jie Zeng
- National Center for Clinical Laboratories, Beijing Hospital, National Center of Gerontology, Beijing Engineering Research Center of Laboratory Medicine, Beijing, P.R. China
| | - Chuanbao Zhang
- National Center for Clinical Laboratories, Beijing Hospital, National Center of Gerontology, Beijing Engineering Research Center of Laboratory Medicine, Beijing, P.R. China
| | - Wensong Liu
- Department of Clinical Laboratory, Beijing Hospital, Beijing, P.R. China
| | - Ning Wang
- Department of Clinical Laboratory, Beijing Chaoyang Hospital, The Third Clinical Medical College of Capital Medical University, Beijing, P.R. China
| | - Tingting Jia
- Department of Clinical Laboratory, Beijing Chaoyang Hospital, Beijing Center for Clinical Laboratories, The Third Clinical Medical College of Capital Medical University, Beijing, P.R. China
| | - Mo Wang
- Department of Clinical Laboratory, Beijing Chaoyang Hospital, Beijing Center for Clinical Laboratories, The Third Clinical Medical College of Capital Medical University, Beijing, P.R. China
| | - Rui Zhang
- Department of Clinical Laboratory, Beijing Chaoyang Hospital, Beijing Center for Clinical Laboratories, The Third Clinical Medical College of Capital Medical University, Beijing, P.R. China
| | - Yuhong Yue
- Department of Clinical Laboratory, Beijing Chaoyang Hospital, Beijing Center for Clinical Laboratories, The Third Clinical Medical College of Capital Medical University, Beijing, P.R. China
| | - Jing Xu
- Department of Clinical Laboratory, Beijing Chaoyang Hospital, The Third Clinical Medical College of Capital Medical University, Beijing, P.R. China
| | - Zhanyong Wang
- Department of Clinical Laboratory, Beijing Chaoyang Hospital, The Third Clinical Medical College of Capital Medical University, Beijing, P.R. China
| | - Yilong Li
- Department of Clinical Laboratory, Beijing Hospital, Beijing, P.R. China
| | - Wenxiang Chen
- National Center for Clinical Laboratories, Beijing Hospital, National Center of Gerontology, Beijing Engineering Research Center of Laboratory Medicine, Beijing, P.R. China
- * E-mail: (WC); (QW)
| | - Qingtao Wang
- Department of Clinical Laboratory, Beijing Chaoyang Hospital, Beijing Center for Clinical Laboratories, The Third Clinical Medical College of Capital Medical University, Beijing, P.R. China
- * E-mail: (WC); (QW)
| |
Collapse
|
18
|
Badrick T. Integrating quality control and external quality assurance. Clin Biochem 2021; 95:15-27. [PMID: 33965412 DOI: 10.1016/j.clinbiochem.2021.05.003] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2021] [Revised: 05/02/2021] [Accepted: 05/04/2021] [Indexed: 11/19/2022]
Abstract
Effective management of clinical laboratories relies upon an understanding of Quality Control and External Quality Assurance principles. These processes, when applied effectively, reduce patient risk and drive quality improvement. In this Review, we will describe the purpose of QC and EQA and their role in identifying analytical and process error. The two concepts are linked, and we will illustrate that linkage. Some EQA providers offer far more than analytical surveillance. They facilitate training and education and extend quality improvement and identify areas where there is potential for patient harm into the pre-and post-analytical phases of the total testing process.
Collapse
Affiliation(s)
- Tony Badrick
- Royal College of Pathologists of Australasia Quality Assurance Program, St Leonards, Sydney 2065, Australia.
| |
Collapse
|
19
|
Miller WG, Budd J, Greenberg N, Weykamp C, Althaus H, Schimmel H, Panteghini M, Delatour V, Ceriotti F, Keller T, Hawkins D, Burns C, Rej R, Camara JE, MacKenzie F, van der Hagen E, Vesper H. IFCC Working Group Recommendations for Correction of Bias Caused by Noncommutability of a Certified Reference Material Used in the Calibration Hierarchy of an End-User Measurement Procedure. Clin Chem 2021; 66:769-778. [PMID: 32335671 DOI: 10.1093/clinchem/hvaa048] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2019] [Accepted: 02/06/2020] [Indexed: 11/14/2022]
Abstract
Establishing metrological traceability to an assigned value of a matrix-based certified reference material (CRM) that has been validated to be commutable among available end-user measurement procedures (MPs) is central to producing equivalent results for the measurand in clinical samples (CSs) irrespective of the clinical laboratory MPs used. When a CRM is not commutable with CSs, the bias due to noncommutability will be propagated to the CS results causing incorrect metrological traceability to the CRM and nonequivalent CS results among different MPs. In a commutability assessment, a conclusion that a CRM is commutable or noncommutable for use with a specific MP is made when the difference in bias between the CRM and CSs meets or does not meet a criterion for that specific MP when compared to other MPs. A conclusion regarding commutability or noncommutability requires that the magnitude of the difference in bias observed in the commutability assessment remains unchanged over time. This conclusion requires the CRM to be stable and no substantive changes in the MPs. These conditions should be periodically reverified. If an available CRM is determined to be noncommutable for a specific MP, that CRM can be used in the calibration hierarchy for that MP when an appropriately validated MP-specific correction for the noncommutability bias is included. We describe with examples how a MP-specific correction and its uncertainty can be developed and applied in a calibration hierarchy to achieve metrological traceability of results for CSs to the CRM's assigned value.
Collapse
Affiliation(s)
| | | | | | - Cas Weykamp
- Queen Beatrix Hospital, Winterswijk, the Netherlands
| | - Harald Althaus
- Siemens Healthcare Diagnostics Products GmbH, Marburg, Germany
| | - Heinz Schimmel
- European Commission, Joint Research Centre, Directorate F, Geel, Belgium
| | - Mauro Panteghini
- Research Centre for Metrological Traceability in Laboratory Medicine (CIRME), University of Milan, Milan, Italy
| | - Vincent Delatour
- Laboratoire national de métrologie et d'essais (LNE), Paris, France
| | | | | | - Douglas Hawkins
- School of Statistics, University of Minnesota, Minneapolis, MN
| | - Chris Burns
- National Institute for Biological Standards and Control, A Centre of the MHRA, Hertfordshire, UK
| | - Robert Rej
- Wadsworth Center for Laboratories and Research, New York State Department of Health, and School of Public Health State University of New York at Albany, Albany, NY
| | - Johanna E Camara
- National Institute of Standards and Technology, Gaithersburg, MD
| | - Finlay MacKenzie
- Birmingham Quality/UK NEQAS, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | | | - Hubert Vesper
- Centers for Disease Control and Prevention, Atlanta, GA
| |
Collapse
|
20
|
van der Hagen EAE, Weykamp C, Sandberg S, Stavelin AV, MacKenzie F, Miller WG. Feasibility for aggregation of commutable external quality assessment results to evaluate metrological traceability and agreement among results. Clin Chem Lab Med 2020; 59:117-125. [PMID: 32759402 DOI: 10.1515/cclm-2020-0736] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2020] [Accepted: 07/22/2020] [Indexed: 11/15/2022]
Abstract
Objectives External quality assessment (EQA) with commutable samples is used for assessing agreement of results for patients' samples. We investigated the feasibility to aggregate results from four different EQA schemes to determine the bias between different measurement procedures and a reference target value. Methods We aggregated EQA results for creatinine from programs that used commutable EQA material by calculating the relative difference between individual participant results and the reference target value for each sample. The means and standard errors of the means were calculated for the relative differences. Results were partitioned by methods, manufacturers and instrument platforms to evaluate the biases for the measurement procedures. Results Data aggregated for enzymatic methods had biases that varied from -8.2 to 3.8% among seven instrument platforms for creatinine at normal concentrations (61-85 μmol/L). EQA schemes differed in the evidence provided about the commutability of their samples, and in the amount of detail collected from participants regarding the measurement procedures which limited the ability to sub-divide aggregated data by instrument platforms and models. Conclusions EQA data could be aggregated from four different programs using different commutable samples to determine bias among different measurement procedures. Criteria for commutability for EQA samples as well as standardization of reporting the measurement methods, reagents, instrument platforms and models used by participants are needed to improve the ability to aggregate the results for optimal assessment of performance of measurement procedures. Aggregating data from a larger number of EQA schemes is feasible to assess trueness on a global scale.
Collapse
Affiliation(s)
- Eline A E van der Hagen
- Dutch Foundation for Quality Assessment in Medical Laboratories (SKML), Nijmegen, The Netherlands.,Department of Clinical Chemistry, Queen Beatrix Hospital, Winterswijk, The Netherlands
| | - Cas Weykamp
- Dutch Foundation for Quality Assessment in Medical Laboratories (SKML), Nijmegen, The Netherlands.,Department of Clinical Chemistry, Queen Beatrix Hospital, Winterswijk, The Netherlands
| | - Sverre Sandberg
- The Norwegian Organisation for Quality Improvement of Laboratory Examinations (Noklus), Haraldsplass Deaconess Hospital, Noklus, Bergen, Norway
| | - Anne V Stavelin
- The Norwegian Organisation for Quality Improvement of Laboratory Examinations (Noklus), Haraldsplass Deaconess Hospital, Noklus, Bergen, Norway
| | - Finlay MacKenzie
- Birmingham Quality/UK NEQAS, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - W Greg Miller
- Department of Pathology, Virginia Commonwealth University, Richmond, VA, USA
| |
Collapse
|
21
|
Badrick T, Stavelin A. Harmonising EQA schemes the next frontier: challenging the status quo. Clin Chem Lab Med 2020; 58:1795-1797. [DOI: 10.1515/cclm-2020-0343] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2020] [Accepted: 04/28/2020] [Indexed: 01/17/2023]
Abstract
Abstract
There is a focus on standardisation and harmonisation of laboratory results to reduce the risk of misinterpretation of patient results assayed in different laboratories. External quality assessment (EQA) is critical to assess the need for harmonisation and to monitor the success of procedures to achieve harmonisation. However, EQA providers are being stretched to meet the needs of their participants with proven commutable material with reference method targets, a range of clinically significant levels of the materials, detailed and customised data analysis, and educational support. The path ahead for harmonisation of EQA schemes will require leadership from an organisation that has the support and confidence of EQA providers, like the European Organisation for External Qualily Assurance Providers in Laboratory Medicine.
Collapse
Affiliation(s)
- Tony Badrick
- Royal College of Pathologists of Australasia Quality Assurance Programs , St Leonards, Sydney , Australia
| | - Anne Stavelin
- The Norwegian Organisation for Quality Improvement of Laboratory Examinations (Noklus), Haraldsplass Diaconess Hospital , Bergen , Norway
| |
Collapse
|
22
|
The internal quality control in the traceability era. ACTA ACUST UNITED AC 2020; 59:291-300. [DOI: 10.1515/cclm-2020-0371] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2020] [Accepted: 03/24/2020] [Indexed: 11/15/2022]
Abstract
Abstract
To be accurate and equivalent, laboratory results should be traceable to higher-order references. Furthermore, their quality should fulfill acceptable measurement uncertainty (MU) as defined to fit the intended clinical use. With this aim, in vitro diagnostics (IVD) manufacturers should define a calibration hierarchy to assign traceable values to their system calibrators. Medical laboratories should know and verify how manufacturers have implemented the traceability of their calibrators and estimate the corresponding MU on clinical samples. Accordingly, the internal quality control (IQC) program should be redesigned to permit IVD traceability surveillance through the verification by medical laboratories that control materials, provided by the manufacturer as a part of measuring systems, are in the clinically suitable validation range (IQC component I). Separately, laboratories should also monitor the reliability of employed IVD measuring systems through the IQC component II, devoted to estimation of MU due to random effects and to obtaining MU of provided results, in order to apply prompt corrective actions if the performance is worsening when compared to appropriate analytical specifications, thus jeopardizing the clinical validity of test results.
Collapse
|
23
|
Braga F, Panteghini M. The utility of measurement uncertainty in medical laboratories. Clin Chem Lab Med 2020; 58:1407-1413. [PMID: 32126011 DOI: 10.1515/cclm-2019-1336] [Citation(s) in RCA: 57] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2019] [Accepted: 01/31/2020] [Indexed: 11/15/2022]
Abstract
The definition and enforcement of reference measurement systems, based on the implementation of metrological traceability of patient results to higher-order (reference) methods and/or materials, together with a clinically acceptable level of measurement uncertainty (MU), are fundamental requirements to produce accurate and equivalent laboratory results. The MU associated with each step of the traceability chain should be governed to obtain a final combined MU on clinical samples fulfilling the requested performance specifications. MU is useful for a number of reasons: (a) for giving objective information about the quality of individual laboratory performance; (b) for serving as a management tool for the medical laboratory and in vitro diagnostics (IVD) manufacturers, forcing them to investigate and eventually fix the identified problems; (c) for helping those manufacturers that produce superior products and measuring systems to demonstrate the superiority of those products; (d) for identifying analytes that need analytical improvement for their clinical use and ask IVD manufacturers to work for improving the quality of assay performance and (e) for abandoning assays with demonstrated insufficient quality. Accordingly, the MU should not be considered a parameter to be calculated by medical laboratories just to fulfill accreditation standards, but it must become a key quality indicator to describe both the performance of an IVD measuring system and the laboratory itself.
Collapse
Affiliation(s)
- Federica Braga
- Research Centre for Metrological Traceability in Laboratory Medicine (CIRME), Università di Milano, Milan, Italy.,UOC Patologia Clinica, ASST Fatebenefratelli-Sacco, Via GB Grassi 74, 20157 Milan, Italy, Phone: +390239042743, Fax: +390250319835
| | - Mauro Panteghini
- Research Centre for Metrological Traceability in Laboratory Medicine (CIRME), Università di Milano, Milan, Italy
| |
Collapse
|
24
|
Clinical and laboratory diagnosis of rare coagulation disorders (RCDs). Thromb Res 2019; 196:603-608. [PMID: 31515069 DOI: 10.1016/j.thromres.2019.09.006] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2019] [Revised: 09/04/2019] [Accepted: 09/05/2019] [Indexed: 12/17/2022]
Abstract
Rare coagulation disorders (RCDs) are a group of diseases due to coagulation factors deficiency leading to life-long bleeding diathesis. The diagnosis of RCDs is challenging due to the limited knowledge of these disorders and the large heterogeneity of their bleeding patterns. The clinical symptoms of RCDs are extremely diverse in terms of bleeding type, site, severity, age at onset, and duration. The strength of the association between clotting factor activity level in plasma and clinical symptoms is also variable within each RCD. The clinical evaluation of RCDs starts with a detailed collection of clinical history and has been facilitated by bleeding assessment tools, however their effectiveness in diagnosing RCDs requires further investigation. The following laboratory diagnosis of RCDs involves coagulation screening tests, including activated partial thromboplastin time, prothrombin time, and thrombin time. After ruling out the presence of an inhibitor by mixing studies, in case of abnormal results, the specific deficiency is identified by performing one-stage clotting assays using the specific factor-depleted plasmas as substrate. In fibrinogen and FXIII deficiencies coagulation screening tests are not informative, therefore additional tests are needed. Global assays have been developed and are thought to aid in patient management, however, they are not well standardized yet. In addition to outlining the principles of clinical and laboratory diagnosis, this review explores molecular basis of RCDs and laboratory techniques for genetic analysis, and discusses the importance and effectiveness of quality control programs to ensure standardized laboratory results.
Collapse
|
25
|
Ceriotti F, Cobbaert C. Harmonization of External Quality Assessment Schemes and their role - clinical chemistry and beyond. Clin Chem Lab Med 2019; 56:1587-1590. [PMID: 29715181 DOI: 10.1515/cclm-2018-0265] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2018] [Accepted: 04/05/2018] [Indexed: 11/15/2022]
Abstract
Abstract
The article tries to reply to the following three questions: Are External Quality Assessment Schemes (EQAS) really fit for purpose? Are all schemes equivalent and sufficiently harmonized? Is the role of EQAS similar and necessary in all branches of laboratory medicine? Although the reply to the first two questions is, unfortunately, negative for several reasons (lack of commutable material with reference method values, EQAS with different scopes, etc.), the reply to the third one is positive: EQAS are a necessary source of information on trueness and accuracy and must be fully developed for all the branches of the clinical laboratory.
Collapse
Affiliation(s)
- Ferruccio Ceriotti
- Clinical Laboratory, Fondazione IRCCS Ca' Granda Ospedale Maggiore Policlinico, Via Francesco Sforza 28, Milan 20122, Italy, Phone: +390255032876, Fax: +3902255032219
| | - Christa Cobbaert
- Department of Clinical Chemistry and Laboratory Medicine, Leiden University Medical Center, Leiden, The Netherlands
| |
Collapse
|
26
|
Braga F, Panteghini M. Commutability of reference and control materials: an essential factor for assuring the quality of measurements in Laboratory Medicine. ACTA ACUST UNITED AC 2019; 57:967-973. [DOI: 10.1515/cclm-2019-0154] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2019] [Accepted: 02/25/2019] [Indexed: 11/15/2022]
Abstract
Abstract
Traceability to a common reference ensures equivalence of results obtained by different assays. Traceability is achieved by an unbroken sequence of calibrations, using reference materials (RMs) that must be commutable. Using non-commutable RMs for calibration will introduce a bias in the calibrated method producing incorrect results for clinical samples (CS). Commutability was defined in 1973 as “the ability of an enzyme material to show inter-assay activity changes comparable to those of the same enzyme in human serum” and later extended as a characteristic of all RMs. However, the concept is still poorly understood and appreciated. Commutability assessment has been covered in CLSI guidelines and requires: (a) selection of 20 CS spanning the relevant concentration range; (b) analysis of both RM and CS with the pair of procedures; (c) data elaboration using regression analysis and calculation if RM fall within the 95% prediction interval defined by CS. This approach has been criticized and to improve it The International Federation of Clinical Chemistry and Laboratory Medicine established a working group that recently finalized recommendations. Commutability is also a requirement for the applicability of external quality assessment (EQA) results in the evaluation of the performance of participating laboratories in terms of standardization of their measurements. Unfortunately, EQA materials are usually not validated for commutability.
Collapse
Affiliation(s)
- Federica Braga
- Research Centre for Metrological Traceability in Laboratory Medicine (CIRME), University of Milan , Via G.B. Grassi 74 , Milano , Italy , Phone: +39 02 39042766
| | - Mauro Panteghini
- Research Centre for Metrological Traceability in Laboratory Medicine (CIRME), University of Milan , Milano , Italy
| |
Collapse
|
27
|
Thelen M, Vanstapel F, Brguljan PM, Gouget B, Boursier G, Barrett E, Kroupis C, Lohmander M, Šprongl L, Vodnik T, Bernabeu-Andreu F, Vukasović I, Sönmez Ç, Linko S, Brugnoni D, Vaubourdolle M, Huisman W, Panteghini M. Documenting metrological traceability as intended by ISO 15189:2012: A consensus statement about the practice of the implementation and auditing of this norm element. ACTA ACUST UNITED AC 2018; 57:459-464. [DOI: 10.1515/cclm-2018-1212] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2018] [Accepted: 11/12/2018] [Indexed: 11/15/2022]
Abstract
Abstract
ISO15189:2012 requires medical laboratories to document metrological traceability of their results. While the ISO17511:2003 standard on metrological traceability in laboratory medicine requires the use of the highest available level in the traceability chain, it recognizes that for many measurands there is no reference above the manufacturer’s selected measurement procedure and the manufacturer’s working calibrator. Some immunoassays, although they intend to measure the same quantity and may even refer to the same reference material, unfortunately produce different results because of differences in analytical selectivity as manufacturers select different epitopes and antibodies for the same analyte. In other cases, the cause is the use of reference materials, which are not commutable. The uncertainty associated with the result is another important aspect in metrological traceability implementation. As the measurement uncertainty on the clinical samples is influenced by the uncertainty of all steps higher in the traceability chain, laboratories should be provided with adequate and appropriate information on the uncertainty of the value assignment to the commercial calibrators that they use. Although the between-lot variation in value assignment will manifest itself as part of the long-term imprecision as estimated by the end-user, information on worst-case to be expected lot-lot variation has to be communicated to the end-user by the IVD provider. When laboratories use ancillary equipment that potentially could have a critical contribution to the reported results, such equipment needs verification of its proper calibration and criticality to the result uncertainty could be assessed by an approach based on risk analysis, which is a key element of ISO15189:2012 anyway. This paper discusses how the requirement for metrological traceability as stated in ISO15189 should be met by the medical laboratory and how this should be assessed by accreditation bodies.
Collapse
Affiliation(s)
- Marc Thelen
- Laboratory for Clinical Chemistry and Haematology , Amphia, PO Box 90158 , 4800 RK Breda , The Netherlands ; and SKML , Radboud University , Nijmegen , The Netherlands
| | - Florent Vanstapel
- Laboratory Medicine, Department of Public Health, Biomedical Sciences Group , University Hospital Leuven , Leuven , Belgium
| | | | | | - Guilaine Boursier
- CHU Montpellier , University Montpellier, Department of Genetics, Rare Diseases and Personalized Medicine , Montpellier , France
| | | | - Christos Kroupis
- Department of Clinical Biochemistry , Attikon University General Hospital, Medical School, National and Kapodistrian University of Athens , Haidari , Greece
| | | | - Luděk Šprongl
- Clinical Laboratory, Hospital Kladno , Kladno , Czech Republic
| | - Tatjana Vodnik
- Center of Medical Biochemistry, Clinical Center of Serbia, Center of Medical Biochemistry, Clinical Center of Serbia , Belgrade , Serbia
| | | | - Ines Vukasović
- Sestre Milosrdnice University Hospital Center , Department of Clinical Chemistry , Zagreb , Croatia
| | - Çiğdem Sönmez
- Central Laboratory – Oncology Education and Research Hospital , Ankara , Turkey
| | - Solveig Linko
- Faculty of Medicine – Helsinki University , Helsinki , Finland
| | - Duilio Brugnoni
- Clinical Chemistry Laboratory – Spedali Civili , Brescia , Italy
| | | | - Willem Huisman
- Consultant European Specialist in Clinical Chemistry and Laboratory Medicine , The Hague , The Netherlands
| | - Mauro Panteghini
- Department of Biomedical and Clinical Sciences “Luigi Sacco” , University of Milano Medical School, Research Centre for Metrological Traceability in Laboratory Medicine (CIRME) , Milan , Italy
| |
Collapse
|