The evolving role of commutability in metrological traceability

Using Bland-Altman plot-based harmonization algorithm to optimize the harmonization for immunoassays

OBJECTIVES

Harmonization has been recommended by the International Organization for Standard (ISO) to achieve equivalent results across in vitro diagnostic measurement devices (IVD-MDs). We aim to evaluate the effectiveness of Bland-Altman plot-based harmonization algorithm (BA-BHA) created in this study and compare it with weighted Deming regression-based harmonization algorithm (WD-BHA) proposed in ISO 21151:2020.

METHODS

Eighty patient sera were used as the harmonization reference material (HRM) to develop IVD-MD-specific harmonization algorithms. Another panel of 40 patient sera was used to validate the effectiveness of harmonization algorithms. We compared regression slopes, intercepts, Bland-Altman plot layouts, percent differences, limits of agreement (LoAs), between-method coefficients of variation (CV) before and after harmonization.

RESULTS

After harmonization by WD-BHA, acceptable slopes and intercepts between measured values and HRM targets were observed in weighted Deming regression, but not in Passing-Bablok analysis. Mean differences were -5.5 to 5.0 % and differences at specific levels were -33.9 to 23.9 %. LoAs were -64.6 to 74.6 %. Between-method CV was 22.9 % (±12.9 %). However, after harmonization by BA-BHA, both weighted Deming and Passing-Bablok regressions equations presented harmonized results. Mean differences were -0.3 to 0.2 % and differences at specific levels were -1.1 to 1.6 %. LoAs were -23.3 to 23.2 %. Between-method CV was 8.4 % (±4.0 %). The data points were evenly distributed at both sides of the mean in Bland-Altman plots.

CONCLUSIONS

The inequivalence of test results between different methods can be improved but unacceptable analytical differences at specific levels may be hidden in terms of an acceptable slope and intercept on WD-BHA. The new protocol BA-BHA may be a viable alternative to optimize the harmonization for immunoassays.

Feasibility of Metrological Traceability Implementation Using the Joint Committee on Traceability in Laboratory Medicine Database Entries Including the Fulfillment of "Fit-for-Purpose" Maximum Allowable Measurement Uncertainty

BACKGROUND

In previous publications, the Task Force on Reference Measurement System Implementation proposed a procedural approach combining a critical review of entries available in the Joint Committee on Traceability in Laboratory Medicine (JCTLM) database with a comparison of this information against analytical performance specifications for measurement uncertainty (MU) and applied it to a group of 13 measurands.

CONTENT

Here we applied this approach to 17 additional measurands, of which measurements are frequently requested. The aims of the study were (a) to describe the main characteristics for implementing traceability and the potential to fulfill the maximum allowable MU (MAU) at the clinical sample level of certified reference materials and reference measurement procedures listed in the JCTLM database; (b) to discuss limitations and obstacles, if any, to the achievement of the required quality of laboratory measurements; and (c) to provide a gap analysis by highlighting what is still missing in the database. Results were integrated with those obtained in the previous study, therefore offering an overview of where we are and what is still missing in the practical application of the metrological traceability concept to 30 common biochemical tests employed in laboratory medicine.

SUMMARY

Our analysis shows that for 28 out of 30 measurands, conditions exist to correctly implement metrological traceability to the International System of units and fulfill at least the MAU of the minimum quality level derived according to internationally recommended models. For 2 measurands (serum albumin and chloride), further improvements in MU of higher-order references would be necessary.

Discrepancies between two total IgE assays and difference in reference intervals in healthy adults

OBJECTIVE

To compare total immunoglobulin (Ig) E assay performance characteristics between Abbott Architect and Siemens Immulite test systems. Reference intervals were also determined for both platforms in an American population of healthy adults.

METHODS

Agreement of the two total IgE assays was evaluated in a cohort of 331 subjects with normal complete blood count (CBC) and comprehensive metabolic panel (CMP) results. Reference intervals were established in 302 subjects after exclusion of atopic individuals on the Abbott Architect and Siemens Immulite test systems.

RESULTS

We demonstrated a 32% positive bias for total IgE quantitation on the Siemens Immulite platform compared to the Abbott Architect, despite both methods calibrated against the same WHO international reference material (75/502), Furthermore, the upper limit of the reference interval (95th percentile) was determined to be higher for the Siemens Immulite assay compared to the Abbott Architect (132 and 102 IU/mL, respectively).

CONCLUSION

Despite the use of a common WHO reference material for total IgE assay calibration, significant differences in quantitation was observed between two FDA-cleared test systems. Given that, it is warranted for clinical laboratories to verify vendor established reference intervals and adjust accordingly based on internal assessment of the normal range.

External quality assurance in the era of standardization

Metrology in clinical chemistry aims to ensure the equivalence of measurement results from different in-vitro diagnostic measurement devices (IVD MD) for use in healthcare. The metrological traceability of measurement results to higher-order references is the cornerstone to achieving equivalent results. However, other fundamentals are also needed, including the commutability of reference materials and external quality assessment (EQA) materials for monitoring the equivalence of measurement results at the end-user level. This manuscript summarizes the findings and opinions expressed at the Joint Community for Traceability in Laboratory Medicine (JCTLM) workshop held on December 4-5, 2023. The workshop explored the relationship between EQA/proficiency testing and metrological traceability to higher-order references. EQA monitors the equivalence of measurement results from end-user IVD MDs. The workshop discussed the role and challenges of using EQA to improve and maintain the equivalence of measurement results. It also elucidated current developments in establishing the clinical suitability of laboratory results expressed as analytical performance specifications (APS).

Bias in Laboratory Medicine: The Dark Side of the Moon

Physicians increasingly use laboratory-produced information for disease diagnosis, patient monitoring, treatment planning, and evaluations of treatment effectiveness. Bias is the systematic deviation of laboratory test results from the actual value, which can cause misdiagnosis or misestimation of disease prognosis and increase healthcare costs. Properly estimating and treating bias can help to reduce laboratory errors, improve patient safety, and considerably reduce healthcare costs. A bias that is statistically and medically significant should be eliminated or corrected. In this review, the theoretical aspects of bias based on metrological, statistical, laboratory, and biological variation principles are discussed. These principles are then applied to laboratory and diagnostic medicine for practical use from clinical perspectives.

Commutability evaluation of candidate reference materials and ERM-DA470k/IFCC for immunoglobulin M using two international approaches

BACKGROUND

This study aimed to assess the commutability of frozen pooled human serum (PHS), high concentration of Immunoglobulin M (IgM) pure diluted materials (HPDM), commercialized pure materials (CPM), and dilutions of ERM-DA470k/IFCC in IgM detection using the CLSI and IFCC approaches, to support standardization or harmonization of IgM measurement.

METHODS

Twenty-four serum samples, relevant reference materials (PHS, HPDM, CPM), and different ERM-DA470k/IFCC dilutions were analyzed in triplicate using six routine methods. The commutability of the relevant reference materials was carried out following CLSI EP30-A and IFCC bias analysis.

RESULTS

According to the CLSI approach, low, medium, and high concentrations of PHS, HPDM, and CPM were commutable on 10, 13, 15, 13, and 8 of 15 assay combinations, respectively. Using the IFCC approach, low, medium, and high concentrations of PHS, HPDM, and CPM were commutable on 10, 11, 9, 15, and 10 of 15 assay combinations, respectively. The ERM-DA470k/IFCC dilutions with D-PBS and RPMI-1640 Medium were commutable on 13 of 15 assay combinations according to CLSI and were commutable on all 15 assay combinations using IFCC approach.

CONCLUSIONS

High concentration of PHS were commutable on all six detection systems using the CLSI approach. Low and medium concentration of PHS showed unsatisfied commutability. HPDM, not CPM have good commutability, has the potential to become reference materials. ERM-DA470k/IFCC diluted with different medium showed different commutability.

Commutability Assessment of Candidate Reference Materials for Lipoprotein(a) by Comparison of a MS-based Candidate Reference Measurement Procedure with Immunoassays

BACKGROUND

Elevated concentrations of lipoprotein(a) [Lp(a)] are directly related to an increased risk of cardiovascular diseases, making it a relevant biomarker for clinical risk assessment. However, the lack of global standardization of current Lp(a) measurement procedures (MPs) leads to inconsistent patient care. The International Federation for Clinical Chemistry and Laboratory Medicine working group on quantitating apolipoproteins by mass spectrometry (MS) aims to develop a next-generation SI (International system of units)-traceable reference measurement system consisting of a MS-based, peptide-calibrated reference measurement procedure (RMP) and secondary serum-based reference materials (RMs) certified for their apolipoprotein(a) [apo(a)] content. To reach measurement standardization through this new measurement system, 2 essential requirements need to be fulfilled: a sufficient correlation among the MPs and appropriate commutability of future serum-based RMs.

METHODS

The correlation among the candidate RMP (cRMP) and immunoassay-based MPs was assessed by measuring a panel of 39 clinical samples (CS). In addition, the commutability of 14 different candidate RMs was investigated.

RESULTS

Results of the immunoassay-based MPs and the cRMPs demonstrated good linear correlations for the CS but some significant sample-specific differences were also observed. The results of the commutability study show that RMs based on unspiked human serum pools can be commutable with CS, whereas human pools spiked with recombinant apo(a) show different behavior compared to CS.

CONCLUSIONS

The results of this study show that unspiked human serum pools are the preferred candidate secondary RMs in the future SI-traceable Lp(a) Reference Measurement System.

Commutability assessment of human urine certified reference materials for albumin and creatinine on multiple clinical analyzers using different statistical models

Urine albumin concentration and albumin-creatinine ratio are important for the screening of early-stage kidney damage. Commutable urine certified reference materials (CRMs) for albumin and creatinine are necessary for standardization of urine albumin and accurate measurement of albumin-urine ratio. Two urine CRMs for albumin and creatinine with certified values determined using higher-order reference measurement procedures were evaluated for their commutability on five brands/models of clinical analyzers where different reagent kits were used, including Roche Cobas c702, Roche Cobas c311, Siemens Atellica CH, Beckman Coulter AU5800, and Abbott Architect c16000. The commutability study was conducted by measuring at least 26 authentic patient urine samples and the human urine CRMs using both reference measurement procedures and the routine methods. Both the linear regression model suggested by the Clinical and Laboratory Standard Institute (CLSI) guidelines and log-transformed model recommended by the International Federation of Clinical Chemistry and Laboratory Medicine (IFCC) Commutability Working Group were used to evaluate the commutability of the human urine CRMs. The commutability of the human urine CRMs was found to be generally satisfactory on all five clinical analyzers for both albumin and creatinine, suggesting that they are suitable to be used routinely by clinical laboratories as quality control or for method validation of urine albumin and creatinine measurements.

A candidate reference method and multiple commutable control materials for serum 25-hydroxyvitamin D measurement

OBJECTIVES

The aim of the current study was to establish a reliable candidate reference method for serum 25-hydroxyvitamin D [25(OH)D] measurement and to assess the commutability of multiple control materials among liquid chromatography-tandem mass spectrometry (LC-MS/MS) methods.

METHODS

Serum 25-hydroxyvitamin D2 [25(OH)D2] and 25-hydroxyvitamin D3 [25(OH)D3] together with spiked internal standards were extracted with a one-step approach and then analyzed by LC-MS/MS. The commutability assessment for 25(OH)D was conducted according to the Clinical and Laboratory Standards Institute (CLSI) EP14-A3 protocol. 25(OH)D concentrations in 5 levels of unprocessed serum pools, 7 levels of serum pools spiked with 25(OH)D3 or 25(OH)D2, 3 levels of commercial control materials, 2 levels of spiked bovine serum, and 4 levels of external quality assessment (EQA) materials were measured along with 30 single-donor samples using the candidate reference method and two routine LC-MS/MS methods.

RESULTS

The candidate reference method could separate 25(OH)D2 and 25(OH)D3 from 14 potential interfering compounds completely within a 9-min analysis time. Good method precision was obtained, and measurement results on certified reference material NIST SRM 972a were within the uncertainty of the certified values. All candidate materials were assessed commutable for LC-MS/MS methods.

CONCLUSIONS

The candidate reference method for serum 25(OH)D measurement is precise, accurate, and robust against interferences and can provide an accuracy base for routine methods. The multiple alternative control materials with commutability among LC-MS/MS methods will facilitate the further standardization for serum 25(OH)D measurement.

Overcoming challenges regarding reference materials and regulations that influence global standardization of medical laboratory testing results

BACKGROUND

Standardized results for laboratory tests are particularly important when their interpretation depends on fixed medical practice guidelines or common reference intervals. The medical laboratory community has developed a roadmap for an infrastructure to achieve standardized test results described in the International Organization for Standardization standard 17511:2020 In vitro diagnostic medical devices - Requirements for establishing metrological traceability of values assigned to calibrators, trueness control materials and human samples. Among the challenges to implementing metrological traceability are the availability of fit-for-purpose matrix-based certified reference materials (CRMs) and requirements for regulatory review that differ among countries. A workshop in December 2021 focused on these two challenges and developed recommendations for improved practices.

DISCUSSION

The participants agreed that prioritization of measurands for standardization should be based on their impact on medical decisions in a clinical pathway. Ensuring that matrix-based CRMs are globally available for more measurands will enable fit-for-purpose calibration hierarchies for more laboratory tests. Regulation of laboratory tests is important to ensure safety and effectiveness for the populations served. Because regulations are country or region specific, manufacturers must submit recalibration changes intended to standardize results for regulatory review to all areas in which a measuring system is marketed.

RECOMMENDATIONS

A standardization initiative requires collaboration and planning among all interested stakeholders. Global collaboration should be further developed for prioritization of measurands for standardization, and for coordinating the production and supply of CRMs worldwide. More uniform regulatory submission requirements are desirable when recalibration is implemented to achieve internationally standardized results.

Development of Certified Reference Material for Amino Acids in Dried Blood Spots and Accuracy Assessment of Disc Sampling

To achieve the measurement reliability of amino acids used as diagnostic markers in clinical fields, establishing a reference measurement system is required, in which certified reference materials (CRMs) are an essential step in the hierarchy of measurement traceability. This study describes the development of dried blood spot (DBS) CRMs for amino acid analysis with complete measurement traceability to the International System of Units (SI). Six essential amino acids—proline, valine, isoleucine, leucine, phenylalanine, and tyrosine—were analyzed using isotope-dilution liquid chromatography–mass spectrometry (ID-MS). For minimizing measurement bias and uncertainty overestimation, whole spots with 50 μL of whole blood were adopted in the certification. The between-spot homogeneities by whole spot sampling were lower than 2.1%. The relative expanded uncertainties of the six amino acids in the developed DBS CRMs were lower than 5.7% at 95% confidence. The certified values are traceable to SI through both gravimetric preparation and the primary method in certification, ID-MS. Comparison among DBS testing laboratories revealed discrepancies between the whole spot and disc sampling methods. The actual sampling volume was accurately estimated by weighing, which revealed the possibility of underestimation in routine DBS testing. The candidate CRMs can support the standardization of DBS testing for amino acids through the qualification and validation of many kinds of measurement procedures to compensate the measurement bias caused by matrix-specific sampling error.

Measurement comparability of insulin assays using conventional immunoassay kits

BACKGROUND

The standardization of measurement aims to achieve comparability of results regardless of the analytical methods and the laboratory where analyses are carried out. In this paper, a comparison of results from several immunoassay-based insulin analysis kits is described, and the steps necessary to improve comparability are discussed.

METHODS

Four manual enzyme-linked immunosorbent assay (ELISA) kits produced by Mercodia, Alpco, Epitope Diagnostics, and Abcam, and three automated chemiluminescent (CLIA) insulin assay kits (Siemens Centaur XP, Unicel Dxl800, Cobas e801) were compared by analyzing human serum samples and certified reference materials for human insulin.

RESULTS

The seven evaluated assay kits showed substantial discrepancies in the results, with relative standard deviation ranges between 1.7% and 23.2%. We find that the traceability chains and the unit conversion factors are not yet harmonized, and current reference materials for insulin are not applicable for immunoassay-based method validation due to the use of different matrices.

CONCLUSIONS

The findings suggest the need to fine tune insulin analysis methods, measurement traceability, and any conversion factor used in post-analysis steps in accordance with the necessity for standardization.