Redesigning the surveillance of in vitro diagnostic medical devices and of medical laboratory performance by quality control in the traceability era

What the Milan conference has taught us about analytical performance specification model definition and measurand allocation

Analytical performance specifications (APS) represent the criteria that specify the quality required for laboratory test information to satisfy clinical needs. In 2014 the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) considered timely to update the topic of APS by organizing a conference in Milan in which some strategic concepts were proposed. Here I summarize the essential points representing the EFLM Strategic Conference heritage and discuss the approaches that will permit us to become more concrete, including roles and main actions expected from each of involved stakeholders for contributing a quantum leap forward in the way of practicality of Milan consensus about APS.

Analytical performance specifications for combined uncertainty budget in the implementation of metrological traceability

In addition to the correct implementation of calibration traceability, the definition and fulfillment of maximum allowable measurement uncertainty (MAU) are essential in assuring that laboratory measurements are clinically usable. Across the entire calibration hierarchy, three major contributors to the measurement uncertainty (MU) budget are identified, starting with the higher-order reference providers, extending through the in vitro diagnostic (IVD) manufacturers and their processes for assigning calibrator values, and ending with medical laboratories generating the random variability of results reported to clinicians. To understand if it is possible to achieve MAU and, consequently, to fix the possible drawbacks, the definition of combined MU budget limits across the entire calibration hierarchy has a central role. In particular, quality specifications for MU of reference and commercial calibrator materials should be defined according to the MAU on clinical samples. All involved stakeholders (i.e., higher-order reference providers, IVD manufacturers, medical laboratories) should be prepared to improve their performance whenever the clinical application of the test is made questionable by the failure to achieve MAU.

State-of-the-art model for derivation of analytical performance specifications: how to define the highest level of analytical performance technically achievable

To be accurate and equivalent among assays, laboratory results should be traceable to higher-order references and their quality should fulfill maximum allowable measurement uncertainty (MU) as defined to fit the intended clinical use. Accordingly, laboratory professionals should estimate and validate MU of performed tests using appropriate analytical performance specifications (APS). Current consensus supports the derivation of APS by using one of the three models established by the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) Strategic Conference held in Milan in 2014. It is recognized that some models are better suited for certain measurands than for others and the attention should be primarily directed towards their biological and clinical characteristics. Among others, model 3 should reflect the state of the art of the measurements that can be defined as the best analytical performance that is technically achievable. Taking serum C-reactive protein and ferritin as examples, here we describe the theoretical premises and the experimental protocol to be used to derive APS for MU when a measurand is allocated to this model. Although the model lacks a direct relationship with clinical outcomes, useful information about the in vitro diagnostic medical device performance and the average quality of provided results may be obtained.

Development and evaluation of a candidate reference measurement procedure for detecting 17α-hydroxyprogesterone in dried blood spots using isotope dilution liquid chromatography tandem mass spectrometry

17α-Hydroxyprogesterone (17α-OHP) quantification in dried blood spots (DBS) is essential for newborn screening for congenital adrenal hyperplasia (CAH), which is challenging due to its low physiological concentration. The high false-positive rates of immunoassays necessitate the development of more accurate methods. Liquid chromatography tandem mass spectrometry (LC-MS/MS) offers increased specificity and sensitivity, yet standardized procedures for 17α-OHP measurement are required for clinical application. A candidate reference measurement procedure (cRMP) using isotope dilution LC-MS/MS was developed for 17α-OHP quantification in DBS. By utilizing stable isotope-labeled D8-17α-OHP as an internal standard, the cRMP was optimized, covering sample preparation, calibration, and LC-MS/MS analysis. The method performance was validated across several parameters, including precision, accuracy, specificity, detection limits, and matrix effects. Clinical applicability was further assessed through the establishment of reference intervals for healthy newborns. The developed cRMP exhibited a linear range of 1.00 to 80.00 ng/mL for 17α-OHP, with detection and quantification limits of 0.14 ng/mL and 0.52 ng/mL, respectively. Inter- and intraday precision demonstrated coefficients of variation within 1.27 to 5.69%. The recovery rates and matrix effects were well within acceptable limits, ensuring method reliability. Clinical application showed distinct reference intervals for healthy newborns that were unaffected by sex but influenced by weight and gestational age. This method significantly enhances CAH diagnostic accuracy in newborns, providing a valuable tool for clinical laboratories and improving newborn screening program standardization and traceability.

An improved implementation of metrological traceability concepts is needed to benefit from standardization of laboratory results

Non-harmonization of laboratory results represents a concrete risk for patient safety. To avoid harms, it is agreed that measurements by in vitro diagnostic medical devices (IVD-MD) on clinical samples should be traceable to higher-order references and adjusted to give the same result. However, metrological traceability is not a formal claim and has to be correctly implemented, which in practice does not happen for a non-negligible number of measurands. Stakeholders, such as higher-order reference providers, IVD manufacturers, and External Quality Assessment organizers, have major responsibilities and should improve their contribution by unambiguously and rigorously applying what is described in the International Organization for Standardization 17511:2020 standard and other documents provided by the international scientific bodies, such as Joint Committee on Traceability in Laboratory Medicine and IFCC. For their part, laboratory professionals should take responsibility to abandon non-selective methods and move to IVD-MDs displaying proper selectivity, which is one of the indispensable prerequisites for the correct implementation of metrological traceability. The practicality of metrological traceability concepts is not impossible but relevant education and appropriate training of all involved stakeholders are essential to obtain the expected benefits in terms of standardization.

APS calculator: a data-driven tool for setting outcome-based analytical performance specifications for measurement uncertainty using specific clinical requirements and population data

OBJECTIVES

According to ISO 15189:2022, analytical performance specifications (APS) should relate to intended clinical use and impact on patient care. Therefore, we aimed to develop a web application for laboratory professionals to calculate APS based on a simulation of the impact of measurement uncertainty (MU) on the outcome using the chosen decision limits, agreement thresholds, and data of the population of interest.

METHODS

We developed the "APS Calculator" allowing users to upload and select data of concern, specify decision limits and agreement thresholds, and conduct simulations to determine APS for MU. The simulation involved categorizing original measurand concentrations, generating measured (simulated) results by introducing different degrees of MU, and recategorizing measured concentrations based on clinical decision limits and acceptable clinical misclassification rates. The agreements between original and simulated result categories were assessed, and values that met or exceeded user-specified agreement thresholds that set goals for the between-category agreement were considered acceptable. The application generates contour plots of agreement rates and corresponding MU values. We tested the application using National Health and Nutrition Examination Survey data, with decision limits from relevant guidelines.

RESULTS

We determined APS for MU of six measurands (blood total hemoglobin, plasma fasting glucose, serum total and high-density lipoprotein cholesterol, triglycerides, and total folate) to demonstrate the potential of the application to generate APS.

CONCLUSIONS

The developed data-driven web application offers a flexible tool for laboratory professionals to calculate APS for MU using their chosen decision limits and agreement thresholds, and the data of the population of interest.

Documenting and validating metrological traceability of serum alanine aminotransferase measurements: a priority for medical laboratory community for providing high quality service in hepatology

Alanine aminotransferase (ALT) represents the first-level test to detect individuals with hepatocellular damage of any etiology. However, it has been highlighted that the lack of assay harmonization may lead to overdiagnosis and unnecessary further testing if guideline-recommended fixed cut-offs are uncritically employed. To solve the issue of ALT (dis)harmonization and improve the interpretation of its values, a series of urgent actions for documenting and validating metrological traceability of serum ALT measurements, as described in this paper, are no longer postponeable. It is time that all medical laboratory stakeholders (in vitro diagnostic manufacturers, laboratorians, external quality assessment scheme organizers) actively co-operate to implement the ALT standardization in a concerted action following well-established theoretical assumptions and applying experimental approaches described in literature.

Quality standards and internal quality control practices in medical laboratories: an IFCC global survey of member societies

OBJECTIVES

The trueness and precision of clinical laboratory results are ensured through total quality management systems (TQM), which primarily include internal quality control (IQC) practices. However, quality practices vary globally. To understand the current global state of IQC practice and IQC management in relation to TQM the International Federation of Clinical Chemistry and Laboratory Medicine (IFCC) Task Force on Global Laboratory Quality (TF-GLQ) conducted a survey of IFCC member countries on IQC practices and management.

METHODS

The survey included 16 questions regarding IQC and laboratory TQM practices and was distributed to IFCC full and affiliate member countries (n=110). A total of 46 (41.8 %) responses were received from all regions except North America.

RESULTS

Of the responding countries, 78.3 % (n=36) had legislative regulations or accreditation requirements governing medical laboratory quality standards. However, implementation was not mandatory in 46.7 % (n=21) of responding countries. IQC practices varied considerably with 57.1 % (n=28) of respondents indicating that they run 2 levels of IQC, 66.7 % (n=24) indicating they run IQC every 24 h and 66.7 % (n=28) using assay manufacturer IQC material sources. Only 29.3 % (n=12) of respondents indicated that every medical laboratory in their country has written IQC policies and procedures. By contrast, 97.6 % (n=40) of responding countries indicated they take corrective action and result remediation in the event of IQC failure.

CONCLUSIONS

The variability in TQM and IQC practices highlights the need for more formal programs and education to standardize and improve TQM in medical laboratories.

Advances in internal quality control

Quality control practices in the modern laboratory are the result of significant advances over the many years of the profession. Major advance in conventional internal quality control has undergone a philosophical shift from a focus solely on the statistical assessment of the probability of error identification to more recent thinking on the capability of the measurement procedure (e.g. sigma metrics), and most recently, the risk of harm to the patient (the probability of patient results being affected by an error or the number of patient results with unacceptable analytical quality). Nonetheless, conventional internal quality control strategies still face significant limitations, such as the lack of (proven) commutability of the material with patient samples, the frequency of episodic testing, and the impact of operational and financial costs, that cannot be overcome by statistical advances. In contrast, patient-based quality control has seen significant developments including algorithms that improve the detection of specific errors, parameter optimization approaches, systematic validation protocols, and advanced algorithms that require very low numbers of patient results while retaining sensitive error detection. Patient-based quality control will continue to improve with the development of new algorithms that reduce biological noise and improve analytical error detection. Patient-based quality control provides continuous and commutable information about the measurement procedure that cannot be easily replicated by conventional internal quality control. Most importantly, the use of patient-based quality control helps laboratories to improve their appreciation of the clinical impact of the laboratory results produced, bringing them closer to the patients.Laboratories are encouraged to implement patient-based quality control processes to overcome the limitations of conventional internal quality control practices. Regulatory changes to recognize the capability of patient-based quality approaches, as well as laboratory informatics advances, are required for this tool to be adopted more widely.

Current performance of C-reactive protein determination and derivation of quality specifications for its measurement uncertainty

From External Quality Assessment data, current harmonization of CRP measuring systems appears to be satisfactory, the inter-assay CV being well below 10%. The inter-method variability is even better (close to 3%) when the widely used measuring systems are compared at CRP concentrations employed as cut-off for detecting sub-clinical infection (i.e., 10.0 mg/L) and measurement variability estimated, according to ISO 20914:2019 Technical Specification, from the intermediate within-lab reproducibility of 6-month consecutive measurement data. According to the state-of-the-art model (which is better suited for CRP), the maximum allowable measurement uncertainty (MAU) for CRP measurement on clinical samples with 10.0 mg/L concentrations is 3.76% (desirable quality). As measurement uncertainty (MU) of the only available reference material (ERM-DA474/IFCC) is ∼3%, to fulfil desirable MAU on clinical samples, IVD manufacturers should work to keep the contribution of remaining MU sources (commercial calibrator and intermediate within-lab reproducibility) lower than 2.3%.

C-reactive protein and clinical outcome in COVID-19 patients: the importance of harmonized measurements

C-reactive protein (CRP) is a cytokine-mediated acute phase reactant with a recognized role in inflammatory conditions and infectious disease. In coronavirus disease 2019 (COVID-19), elevated CRP concentrations in serum were frequently detected and significantly associated with poor outcome in terms of disease severity, need for intensive care, and in-hospital death. For these reasons, the marker was proposed as a powerful test for prognostic classification of COVID-19 patients. In most of available publications, there was however confounding information about how interpretative criteria for CRP in COVID-19 should be derived, including quality of employed assays and optimal cut-off definition. Assuring result harmonization and controlling measurement uncertainty in terms of performance specifications are fundamental to allow worldwide application of clinical information according to specific CRP thresholds and to avoid risk of patient misclassification.

Judging the clinical suitability of analytical performance of cardiac troponin assays

New millennium diagnostic criteria for acute myocardial infarction precipitated a revolutionary shift from an approach based primarily on electrocardiography and clinical symptoms to a strategy based on biomarkers, and preferably cardiac troponins (cTn) I and T. In the last 20 years, clinical recommendations have strengthened the role of cTn and led to the development of highly sensitive (hs-cTn) assays, which are now leading players in all current clinical practice guidelines. To optimize the clinical use of these hs-cTn assays, focus on their analytical aspects has become increasingly important, emphasizing the need for the establishment of suitable analytical performance by the definition and implementation of appropriate specifications. An accurate estimate of measurement uncertainty, together with the acquisition of the highest analytical quality when very low concentrations of hs-cTn are measured, are essential requirements and should represent a practical laboratory standard in assuring optimal clinical use. Additional goals for further improving the quality of laboratory information should be the establishment of robust data concerning biological variation of cTn and the resolution of practical challenges opposed to the harmonization of cTn I results obtained by differing commercial measuring systems.