Performance specifications for measurement uncertainty of common biochemical measurands according to Milan models

Quantifying sampling method-induced imprecision in user-friendly lateral upper arm blood collection: Introducing σ3-methodology (S3) for the verification of alternative sampling methods with TAP® II as a use case

BACKGROUND

Alternative means of blood sampling continue to grow due to the scarcity of phlebotomists and the need for person-centered care. It is crucial to consistently support these alternative blood sampling innovations with scientific evidence to guarantee the quality of care, especially when implementing for instance Lateral Upper-arm Blood Collection (LUBC) for use at home. Knowledge gaps remain in how to quantify imprecision introduced by the collection method and its impact on clinical use.

METHODS

We developed the Six Sigma analysis for alternative Sampling methods, including sampling method-induced imprecision, accuracy and precision, called σ3-methodology (S3). We performed a two-step verification using σ3-methodology for LUBC TAP® II, which included fourteen routine clinical analytes. We used venipuncture as the gold standard.

RESULTS

The biggest source of imprecision for all analytes was sampling method-induced imprecision, which, for the first time, was quantified, resulting in a varying effect on the clinical usability. TAP® II showed acceptable analytical performance for ALP, bilirubin, HDL-cholesterol, CRP and sodium. Unacceptable analytical performance was found for ALT, AST, cholesterol, creatinine, GGT, HbA1c, potassium, LDH and triglycerides.

CONCLUSION

Alternative blood sampling innovations hold promise for advancing diagnostic care, aiming to deliver accessible decentralised sample collection at home that does not require phlebotomist involvement. However, sampling method-induced imprecision should not be overlooked in the performance assessment to guarantee responsible development that will contribute to the success and desirable societal impact of alternative sampling technologies.

Development of an SI traceable value assigned amino acid matrix-matched material to underpin European external quality assessment

Plasma amino acid analysis plays a vital role in monitoring inherited metabolic diseases (IMDs), such as phenylketonuria (PKU), where dietary therapy is the cornerstone of management and patients are regularly monitored using blood or plasma phenylalanine throughout life. Recent findings from external quality assessment (EQA) schemes demonstrate large variability between results from different clinical laboratories. EQA schemes are hampered by factors including suboptimal sample type and frequency of distributions. Aiming to harmonise and standardise EQA schemes, this paper describes value assignment of an SI traceable matrix-matched amino acid material, and its use in an interlaboratory comparison (ERNDIM QAA-2106 study) that included 89 clinical laboratories from throughout Europe. The outcomes of the interlaboratory comparison are valuable in enabling clinical laboratories to refine their methodologies and, in a longer term, will lead to enhanced accuracy of results in clinical measurements and, ultimately, improved patient care in IMD management. A frozen, pooled human plasma sample was distributed to participating laboratories (n = 88). The sample was value assigned for phenylalanine by the National Measurement Laboratory (NML) traceable to the international system of units (SI), at approximately the target value for dietary monitoring of phenylketonuria (360 µmol/L). Participants used their routine method of analysis to measure 24 amino acids in triplicate and results were compared against desirable analytical performance. Mean intra- and inter-laboratory variability were acceptable for 20/20 and 19/20 amino acids respectively. Mean bias relative to the consensus values was acceptable for 17/20 amino acids. Overall performance of phenylalanine was acceptable; however, 15/87 laboratories failed to meet acceptable imprecision and 8/87 had unacceptable bias; additionally, an overall negative bias for phenylalanine measurement was identified. This study demonstrates the importance of ensuring a matrix material with an assigned value of the analyte(s) of interest (traceable to the SI) is available for regular EQA. The significant bias in the routine measurement of phenylalanine identified has the potential to impact disease management, which aims to control blood phenylalanine concentrations for preventing adverse neurological outcomes.

Systematic review and meta-analysis of biological variation data of urine albumin, albumin to creatinine ratio and other markers in urine

INTRODUCTION

Significant variations in Biological Variation (BV) estimates have been reported for urine markers. This study aimed to systematically review and critically appraise BV studies for albumin, creatinine, albumin-to-creatinine ratio (ACR), and other urine markers to perform a meta-analysis of eligible studies.

METHODS

Publications were identified through a systematic search and evaluated using the Biological Variation Data Critical Appraisal Checklist (BIVAC). BIVAC-compliant studies (grades A-C; A being fully compliant) conducted in healthy individuals were included in the meta-analysis, providing within-subject (CVI) and between-subject (CVG) BV estimates with 95% confidence intervals for various sample collection types.

RESULTS

Out of 37 studies evaluated, 16 were included (one grade A, three B, twelve C). No eligible publications were identified for meta-analysis of albumin and ACR. Limited data were available for first-morning urine specimens. A CVI between 15% and 30% was found for most measurands in 24-hour urine samples, while CVI estimates for random urine appeared higher.

CONCLUSION

Published BV studies on urine markers utilized different sample collections and reporting units. Most were considered unfit for use or ineligible for meta-analysis. Given the critical role of urine albumin and ACR in chronic kidney disease risk assessment, there is a need for more BIVAC-compliant studies.

Feasibility of Metrological Traceability Implementation Using the Joint Committee on Traceability in Laboratory Medicine Database Entries Including the Fulfillment of "Fit-for-Purpose" Maximum Allowable Measurement Uncertainty

BACKGROUND

In previous publications, the Task Force on Reference Measurement System Implementation proposed a procedural approach combining a critical review of entries available in the Joint Committee on Traceability in Laboratory Medicine (JCTLM) database with a comparison of this information against analytical performance specifications for measurement uncertainty (MU) and applied it to a group of 13 measurands.

CONTENT

Here we applied this approach to 17 additional measurands, of which measurements are frequently requested. The aims of the study were (a) to describe the main characteristics for implementing traceability and the potential to fulfill the maximum allowable MU (MAU) at the clinical sample level of certified reference materials and reference measurement procedures listed in the JCTLM database; (b) to discuss limitations and obstacles, if any, to the achievement of the required quality of laboratory measurements; and (c) to provide a gap analysis by highlighting what is still missing in the database. Results were integrated with those obtained in the previous study, therefore offering an overview of where we are and what is still missing in the practical application of the metrological traceability concept to 30 common biochemical tests employed in laboratory medicine.

SUMMARY

Our analysis shows that for 28 out of 30 measurands, conditions exist to correctly implement metrological traceability to the International System of units and fulfill at least the MAU of the minimum quality level derived according to internationally recommended models. For 2 measurands (serum albumin and chloride), further improvements in MU of higher-order references would be necessary.

Within- and between-subject biological variation data for whole blood HbA1c from 38 apparently healthy Turkish subjects

HbA1c plays an important role in the diagnosis and treatment of diabetes and is a valuable biomarker for evaluating glycemic control and predicting the risk of vascular complications. The study aimed to determine the biological variation (BV) for HbA1c and thereby contribute to analytical performance specifications, reference change values, and index of individuality. Fasting venous whole blood samples were collected from 38 presumably healthy subjects (20 females, 18 males) once a week for ten weeks, and analyzed in duplicate using the Roche Cobas c501 analyzer. BioVar, an online R-based biological variation analysis tool, was used for the statistical analysis. BV values were obtained by analysis of variance (ANOVA) after outlier detection, normality tests, steady-state, and homogeneity checks. The within-subject biological variation for HbA1c was 2.9%, and the between-subject biological variation was 7.9%. The index of the individuality of HbA1c was 0.37. Derived desirable analytical goals for imprecision, bias, total allowable error, and maximum expanded allowable measurement uncertainty were 1.4%, 1.8%, 4.2%, and 2.9% respectively. The reference change value is more appropriate for interpreting HbA1c results than a population-based reference interval.

Validation and verification framework and data integration of biosensors and in vitro diagnostic devices: a position statement of the IFCC Committee on Mobile Health and Bioengineering in Laboratory Medicine (C-MBHLM) and the IFCC Scientific Division

Advances in technology have transformed healthcare and laboratory medicine. Biosensors have emerged as a promising technology in healthcare, providing a way to monitor human physiological parameters in a continuous, real-time, and non-intrusive manner and offering value and benefits in a wide range of applications. This position statement aims to present the current situation around biosensors, their perspectives and importantly the need to set the framework for their validation and safe use. The development of a qualification framework for biosensors should be conceptually adopted and extended to cover digitally measured biomarkers from biosensors for advancing healthcare and achieving more individualized patient management and better patient outcome.

What the Milan conference has taught us about analytical performance specification model definition and measurand allocation

Analytical performance specifications (APS) represent the criteria that specify the quality required for laboratory test information to satisfy clinical needs. In 2014 the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) considered timely to update the topic of APS by organizing a conference in Milan in which some strategic concepts were proposed. Here I summarize the essential points representing the EFLM Strategic Conference heritage and discuss the approaches that will permit us to become more concrete, including roles and main actions expected from each of involved stakeholders for contributing a quantum leap forward in the way of practicality of Milan consensus about APS.

Analytical performance specifications for combined uncertainty budget in the implementation of metrological traceability

In addition to the correct implementation of calibration traceability, the definition and fulfillment of maximum allowable measurement uncertainty (MAU) are essential in assuring that laboratory measurements are clinically usable. Across the entire calibration hierarchy, three major contributors to the measurement uncertainty (MU) budget are identified, starting with the higher-order reference providers, extending through the in vitro diagnostic (IVD) manufacturers and their processes for assigning calibrator values, and ending with medical laboratories generating the random variability of results reported to clinicians. To understand if it is possible to achieve MAU and, consequently, to fix the possible drawbacks, the definition of combined MU budget limits across the entire calibration hierarchy has a central role. In particular, quality specifications for MU of reference and commercial calibrator materials should be defined according to the MAU on clinical samples. All involved stakeholders (i.e., higher-order reference providers, IVD manufacturers, medical laboratories) should be prepared to improve their performance whenever the clinical application of the test is made questionable by the failure to achieve MAU.

The role of analytical performance specifications in international guidelines and standards dealing with metrological traceability in laboratory medicine

The goal of metrological traceability is to have equivalent results for a measurand in clinical samples (CSs) irrespective of the in-vitro diagnostic medical device (IVD-MD) used for measurements. The International Standards Organization standard 17511 defines requirements for establishing metrological traceability of values assigned to calibrators, trueness control materials and human samples used with IVD-MDs. Each step in metrological traceability has an uncertainty associated with the value assigned to a material. The uncertainty at each step adds to the uncertainty from preceding steps such that the combined uncertainty gets larger at each step. The combined uncertainty for a CS result must fulfil an analytical performance specification (APS) for the maximum allowable uncertainty (umax CS). The umax CS can be partitioned among the steps in a metrological traceability calibration hierarachy to derive the APS for maximum allowable uncertainty at each step. Similarly, the criterion for maximum acceptable noncommutability bias can be derived from the umax CS. One of the challenges in determining if umax CS is fulfilled is determining the repeatability uncertainty (u Rw) from operating an IVD-MD within a clinical laboratory. Most of the current recommendations for estimating u Rw from internal quality control data do not use a sufficiently representative time interval to capture all relevant sources of variability in measurement results. Consequently, underestimation of u Rw is common and may compromise assessment of how well current IVD-MDs and their supporting calibration hierarchies meet the needs of clinical care providers.

Outcome-based analytical performance specifications: current status and future challenges

Analytical performance specifications (APS) based on outcomes refer to how 'good' the analytical performance of a test needs to be to do more good than harm to the patient. Analytical performance of a measurand affects its clinical performance. Without first setting clinical performance requirements, it is difficult to define how good analytically the test needs to be to meet medical needs. As testing is indirectly linked to health outcomes through clinical decisions on patient management, often simulation-based studies are used to assess the impact of analytical performance on the probability of clinical outcomes which is then translated to Model 1b APS according to the Milan consensus. This paper discusses the related key definitions, concepts and considerations that should assist in finding the most appropriate methods for deriving Model 1b APS. We review the advantages and limitations of published methods and discuss the criteria for transferability of Model 1b APS to different settings. We consider that the definition of the clinically acceptable misclassification rate is central to Model 1b APS. We provide some examples and guidance on a more systematic approach for first defining the clinical performance requirements for tests and we also highlight a few ideas to tackle the future challenges associated with providing outcome-based APS for laboratory testing.

Evaluation of Coefficients of Variation for Clinical Chemistry Tests Based on Internal Quality Control Data Across 5,425 Laboratories in China From 2013 to 2022

Background

Clinical chemistry tests are most widely used in clinical laboratories, and diverse measurement systems for these analyses are available in China. We evaluated the imprecision of clinical chemistry measurement systems based on internal QC (IQC) data.

Methods

IQC data for 27 general chemistry analytes were collected in February each year from 2013 to 2022. Four performance specifications were used to calculate pass rates for CVs of IQC data in 2022. Boxplots were drawn to analyze trends of CVs, and differences in CVs among different groups were assessed using the Mann-Whitney U-test or Kruskal-Wallis test.

Results

The number of participating laboratories increased significantly from 1,777 in 2013 to 5,425 in 2022. CVs significantly decreased for all 27 analytes, except creatine kinase and lipase. Triglycerides, total bilirubin, direct bilirubin, iron, and γ-glutamyl transferase achieved pass rates >80% for all goals. Nine analytes with pass rates <80% based on 1/3 allowable total error were further analyzed; the results indicated that closed systems exhibited lower CVs than open systems for all analytes, except total protein. For all nine analytes, differences were significant between tertiary hospitals and non-tertiary hospitals and between accredited and non-accredited laboratories.

Conclusions

The CVs of IQC data for clinical chemistry have seen a continuous overall improvement in China. However, there is ample room for imprecision improvement for several analytes, with stricter performance specifications.

An appraisal of the practice of duplicate testing for the detection of irregular analytical errors

OBJECTIVES

Our study aimed to determine the usefulness of duplicate testing in identifying irregular analytical errors and subsequent prevention of patient mismanagement.

METHODS

In our laboratory, all requests for Na+, Ca2+, alkaline phosphatase (ALP), and high-sensitivity cardiac-troponin-I (hs-cTnI) are run in duplicate. Data from four separate weeks for Na+ (n=21,649), Ca2+ (n=14,803) and ALP (n=19,698); and a full year for hs-cTnI (n=17,036) were gathered. For each test, pre-defined limits for differences between duplicates were used to identify erroneous results (Fliers). We further characterised a subset of such fliers as "critical errors", where duplicates fell on opposing sides of a reference/decision making threshold. The costs/benefits of running these tests in duplicate were then considered in light of increased number of tests analysed by this approach.

RESULTS

For Na+, 0.03 % of duplicates met our flier defining criteria, and 0.01 % of specimens were considered critical errors. For Ca2+ requests, 4.58 % of results met our flier defining criteria and 0.84 % were critical errors. For ALP, 0.22 % of results were fliers, and 0.01 % were critical errors. For hs-cTnI, 1.58 % of results were classified as fliers, whilst 0.14 % were classified as a critical error. Depending on the test in question, running all analyses in duplicate increased annual costs by as little as €1,100 (for sodium), and as much as €48,000 (for hs-cTnI).

CONCLUSIONS

Duplicate testing is effective at identifying and mitigating irregular laboratory errors, and is best suited for assays predisposed to such error, where costs are minimal, and clinical significance of an incorrect result can justify the practice.

APS calculator: a data-driven tool for setting outcome-based analytical performance specifications for measurement uncertainty using specific clinical requirements and population data

OBJECTIVES

According to ISO 15189:2022, analytical performance specifications (APS) should relate to intended clinical use and impact on patient care. Therefore, we aimed to develop a web application for laboratory professionals to calculate APS based on a simulation of the impact of measurement uncertainty (MU) on the outcome using the chosen decision limits, agreement thresholds, and data of the population of interest.

METHODS

We developed the "APS Calculator" allowing users to upload and select data of concern, specify decision limits and agreement thresholds, and conduct simulations to determine APS for MU. The simulation involved categorizing original measurand concentrations, generating measured (simulated) results by introducing different degrees of MU, and recategorizing measured concentrations based on clinical decision limits and acceptable clinical misclassification rates. The agreements between original and simulated result categories were assessed, and values that met or exceeded user-specified agreement thresholds that set goals for the between-category agreement were considered acceptable. The application generates contour plots of agreement rates and corresponding MU values. We tested the application using National Health and Nutrition Examination Survey data, with decision limits from relevant guidelines.

RESULTS

We determined APS for MU of six measurands (blood total hemoglobin, plasma fasting glucose, serum total and high-density lipoprotein cholesterol, triglycerides, and total folate) to demonstrate the potential of the application to generate APS.

CONCLUSIONS

The developed data-driven web application offers a flexible tool for laboratory professionals to calculate APS for MU using their chosen decision limits and agreement thresholds, and the data of the population of interest.

Documenting and validating metrological traceability of serum alanine aminotransferase measurements: a priority for medical laboratory community for providing high quality service in hepatology

Alanine aminotransferase (ALT) represents the first-level test to detect individuals with hepatocellular damage of any etiology. However, it has been highlighted that the lack of assay harmonization may lead to overdiagnosis and unnecessary further testing if guideline-recommended fixed cut-offs are uncritically employed. To solve the issue of ALT (dis)harmonization and improve the interpretation of its values, a series of urgent actions for documenting and validating metrological traceability of serum ALT measurements, as described in this paper, are no longer postponeable. It is time that all medical laboratory stakeholders (in vitro diagnostic manufacturers, laboratorians, external quality assessment scheme organizers) actively co-operate to implement the ALT standardization in a concerted action following well-established theoretical assumptions and applying experimental approaches described in literature.

Verifying measurements on Siemens Atellica® instruments using clinically acceptable analytical performance specifications

Measurements on clinical chemistry analysers must be verified to demonstrate applicability to their intended clinical use. We verified the performance of measurements on the Siemens Atellica® Solution chemistry analysers against the clinically acceptable analytical performance specifications, CAAPS, including the component of intra-individual biological variation, CVI. The relative standard uncertainty of measurement, i.e. analytical variation, CVA, was estimated for six example measurands, haemoglobin A1c in whole blood (B-HbA1c), albumin in urine (U-Alb), and the following measurands in plasma: sodium (P-Na), pancreatic amylase (P-AmylP), low-density lipoprotein cholesterol (P-LDL-C), and creatinine (P-Crea). Experimental CVA was calculated from single-instrument imprecision using control samples, variation between measurements on parallel instruments, and estimation of bias with pooled patient specimens. Each obtained CVA was compared with previously developed CAAPS. The calculated CVA was 1.4% for B-HbA1c (CAAPS 1.9% for single diagnostic testing, CAAPS 2.0% for monitoring after duplicate tests; IFCC units), 10.9% for U-Alb (CAAPS 44.9%), 1.2% for P-Na (CAAPS 0.6%, after triplicate testing 1.5%), 8.2% for P-AmylP (CAAPS 22.9%). The CVA was 4.9% for P-LDL-C (CAAPS for cardiovascular risk stratification 4.9% after four replicates), and 4.2% for P-Crea (CAAPS 8.0%). Three of the six measurands fulfilled the estimated clinical need. Results from P-Na measurements indicate a general need for improving the P-Na assays for emergency patients. It is necessary to consider CVI when creating diagnostic targets for laboratory tests, as emphasised by the CAAPS estimates of B-HbA1c and P-LDL-C.

Recommendations for Setting a Criterion for Assessing Commutability of Secondary Calibrator Certified Reference Materials

A secondary higher-order calibrator is required to be commutable with clinical samples to be suitable for use in the calibration hierarchy of an end-user clinical laboratory in vitro diagnostic medical device (IVD-MD). Commutability is a property of a reference material that means results for a reference material and for clinical samples have the same numeric relationship, within specified limits, across the measurement procedures for which the reference material is intended to be used. Procedures for assessing commutability have been described in the literature. This report provides recommendations for establishing a quantitative criterion to assess the commutability of a certified reference material (CRM). The criterion is the maximum allowable noncommutability bias (MANCB) that allows a CRM to be used as a calibrator in a calibration hierarchy for an IVD-MD without exceeding the maximum allowable combined standard uncertainty for a clinical sample result (umaxCS). Consequently, the MANCB is derived as a fraction of the umaxCS for the measurand. The suitability of an MANCB for practical use in a commutability assessment is determined by estimating the number of measurements of clinical samples and CRMs required based on the precision performance and nonselectivity for the measurand of the measurement procedures in the assessment. Guidance is also provided for evaluating indeterminate commutability conclusions and how to report results of a commutability assessment.

A comparative analysis of Sigma metrics using conventional and alternative formulas

BACKGROUND AND AIM

The Six Sigma approach, employing Sigma Metrics (SM), is commonly used to evaluate analytical performance in clinical laboratories. However, there is ongoing debate regarding the suitability of the conventional SM formula, which incorporates total allowable error (TEa) and bias. To address this, an alternative formula based on within-subject biological variation (CVI) as the tolerance range (TR) has been proposed. The study aimed to calculate and compare SM values using both formulas.

MATERIAL AND METHODS

Twenty clinical chemistry parameters were evaluated, and SM values were calculated using conventional formula with two TEa goals and the alternative formula. Intermediate precision (CVA%) values were obtained from internal quality control data, while bias values were derived from external quality assessment reports.

RESULTS

The results showed that using the conventional formula, 11 SM values based on CLIA TEa goals and 21 SM values based on BV TEa goals were deemed unacceptable (SM < 3). Additionally, 22 SM values calculated using the alternative formula were below 3.

CONCLUSION

The choice of TR had a substantial impact on the assessed analytical performance. Laboratories should carefully consider the appropriateness of each approach based on their specific quality objectives, analyte characteristics, and laboratory operations.

Current performance of C-reactive protein determination and derivation of quality specifications for its measurement uncertainty

From External Quality Assessment data, current harmonization of CRP measuring systems appears to be satisfactory, the inter-assay CV being well below 10%. The inter-method variability is even better (close to 3%) when the widely used measuring systems are compared at CRP concentrations employed as cut-off for detecting sub-clinical infection (i.e., 10.0 mg/L) and measurement variability estimated, according to ISO 20914:2019 Technical Specification, from the intermediate within-lab reproducibility of 6-month consecutive measurement data. According to the state-of-the-art model (which is better suited for CRP), the maximum allowable measurement uncertainty (MAU) for CRP measurement on clinical samples with 10.0 mg/L concentrations is 3.76% (desirable quality). As measurement uncertainty (MU) of the only available reference material (ERM-DA474/IFCC) is ∼3%, to fulfil desirable MAU on clinical samples, IVD manufacturers should work to keep the contribution of remaining MU sources (commercial calibrator and intermediate within-lab reproducibility) lower than 2.3%.

C-reactive protein and clinical outcome in COVID-19 patients: the importance of harmonized measurements

C-reactive protein (CRP) is a cytokine-mediated acute phase reactant with a recognized role in inflammatory conditions and infectious disease. In coronavirus disease 2019 (COVID-19), elevated CRP concentrations in serum were frequently detected and significantly associated with poor outcome in terms of disease severity, need for intensive care, and in-hospital death. For these reasons, the marker was proposed as a powerful test for prognostic classification of COVID-19 patients. In most of available publications, there was however confounding information about how interpretative criteria for CRP in COVID-19 should be derived, including quality of employed assays and optimal cut-off definition. Assuring result harmonization and controlling measurement uncertainty in terms of performance specifications are fundamental to allow worldwide application of clinical information according to specific CRP thresholds and to avoid risk of patient misclassification.

Evaluation of four automated clinical analyzers for the determination of total 25(OH)D in comparison to a certified LC-MS/MS

OBJECTIVES

The aim of this study was to compare the results of five methods for the determination of total 25(OH)D. For that purpose, two mass spectrometry and three immunoassay methods were used.

METHODS

A total of 124 serum samples were analyzed on five different methods (i.e., a reference LC-MS/MS, Cascadion, Lumipulse, Roche Elecsys II and Roche Elecsys III). Analytical performance against LC-MS/MS was evaluated and compared to the Milan models 1 (analytical performance based on the clinical outcome using thresholds of 12, 20 and 30 ng/mL) and 2 (analytical performance based on biological variation). Additionally, imprecision studies and accuracy using NIST SRM972a samples were carried out.

RESULTS

Compared to the reference LC-MS/MS method, the Lumipulse and the Roche Elecsys III assays reached the optimal criterion for bias, while the Cascadion met the desirable one. The Roche Elecsys II was not able to reach the minimal criteria. The proportion of correctly classified patients was higher using the Cascadion (95.2%) compared to the three immunoassays. In addition to its better precision, the Cascadion was not impacted by a high concentration of 3-epi-25(OH)D3 compared to the three immunoassays.

CONCLUSIONS

Compared to the LC-MS/MS reference method, the Cascadion presented the highest level of concordance at medical decision cut-offs for total 25(OH)D and reached the desirable specification for bias. Moreover, the presence of 3-epi-25(OH)D3 in enriched samples was only problematic in immunoassay methods, and especially considering Roche Elecsys methods. The release of performant fully automated mass spectrometry assays with high throughput might therefore facilitate the wide scale adoption of LC-MS/MS, even in non-specialized clinical laboratories.

Association of maternal folate and B12 vitamin status with gestational diabetes mellitus: still an open issue

OBJECTIVES

There is conflicting evidence about the role of folate and B₁₂in gestational diabetes mellitus (GDM) onset. The association of vitamin status with GDM was therefore revalued, also measuring the B₁₂active form holotranscobalamin.

METHODS

677 women were evaluated at 24-28 weeks of gestation when OGTT was carried out. The 'one-step' strategy was employed for GDM diagnosis. Odds ratio (OR) of having GDM was estimated to quantify the association with vitamin levels.

RESULTS

180 women (26.6%) had GDM. They were older (median, 34.6 vs. 33.3 years, p=0.019) and had higher body mass index (BMI) (25.8 vs. 24.1 kg/m², p<0.001). Multiparous women had lower levels of all evaluated micronutrients, while overweight lowered both folate and total B₁₂, but not holotranscobalamin. Lower total B₁₂(270 vs. 290 ng/L, p=0.005), but not holotranscobalamin, was observed in GDM, being weakly negatively correlated with fasting glycemia (r=-0.11, p=0.005) and 1-h OGTT serum insulin (r=-0.09, p=0.014). At multivariate analysis, age, BMI and multiparity remained the strongest GDM predictors, while total B₁₂(but not holotranscobalamin and folate) showed a slight protective effect (OR=0.996, p=0.038).

CONCLUSIONS

A weak association between total B₁₂ levels and GDM risk was shown, but it was not confirmed when holotranscobalamin was measured.

Total Analytical Error and Measurement Uncertainty for Analytical Performance Evaluation and Determination of Gray Zones of Glucose Critical Value Limits

OBJECTIVE

Total analytical error (TAE) and measurement uncertainty (MU) are important approaches to evaluating and improving the quality of measurement procedures. This study evaluates glucose analytical performance (AP) according to TAE and MU and calculates gray zones of glucose critical value limits.

METHODS

Using TAE and MU values, AP was evaluated according to 5 different analytical performance specifications (APS) and the gray zones of critical value limits were calculated. The number of patients in these zones was compared.

RESULTS

TAE was higher than MU at all 3 levels. The AP for the low glucose level was poor. The number of patients in the gray zones was statistically higher in the TAE groups than in the MU groups (P < .05).

CONCLUSION

TAE and MU values can be used to evaluate the AP of glucose measurement as well as to evaluate the compliance of patient results with decision limits by creating gray zones.

Clinical decision limits as criteria for setting analytical performance specifications for laboratory tests

BACKGROUND

The biological (CV_I), preanalytical (CV_PRE), and analytical variation (CV_A) are inherent to clinical laboratory testing and consequently, interpretation of clinical test results.

METHODS

The sum of the CV_I, CV_PRE, and CV_A, called diagnostic variation (CV_D), was used to derive clinically acceptable analytical performance specifications (CAAPS) for clinical chemistry measurands. The reference change concept was applied to clinically significant differences (CD) between two measurements, with the formula CD = z*√2* CV_D. CD for six measurands were sought from international guidelines. The CAAPS were calculated by subtracting variances of CV_I and CV_PRE from CV_D. Modified formulae were applied to consider statistical power (1-β) and repeated measurements.

RESULTS

The obtained CAAPS were 44.9% for urine albumin, 0.6% for plasma sodium, 22.9% for plasma pancreatic amylase, and 8.0% for plasma creatinine (z = 3, α = 2.5%, 1-β = 85%). For blood HbA_1c and plasma low-density lipoprotein cholesterol, replicate measurements were necessary to reach CAAPS for patient monitoring. The derived CAAPS were compared with analytical performance specifications, APS, based on biological variation.

CONCLUSIONS

The CAAPS models pose a new tool for assessing APS in a clinical laboratory. Their usability depends on the relevance of CD limits, required statistical power and the feasibility of repeated measurements.

Commutability assessment of human urine certified reference materials for albumin and creatinine on multiple clinical analyzers using different statistical models

Urine albumin concentration and albumin-creatinine ratio are important for the screening of early-stage kidney damage. Commutable urine certified reference materials (CRMs) for albumin and creatinine are necessary for standardization of urine albumin and accurate measurement of albumin-urine ratio. Two urine CRMs for albumin and creatinine with certified values determined using higher-order reference measurement procedures were evaluated for their commutability on five brands/models of clinical analyzers where different reagent kits were used, including Roche Cobas c702, Roche Cobas c311, Siemens Atellica CH, Beckman Coulter AU5800, and Abbott Architect c16000. The commutability study was conducted by measuring at least 26 authentic patient urine samples and the human urine CRMs using both reference measurement procedures and the routine methods. Both the linear regression model suggested by the Clinical and Laboratory Standard Institute (CLSI) guidelines and log-transformed model recommended by the International Federation of Clinical Chemistry and Laboratory Medicine (IFCC) Commutability Working Group were used to evaluate the commutability of the human urine CRMs. The commutability of the human urine CRMs was found to be generally satisfactory on all five clinical analyzers for both albumin and creatinine, suggesting that they are suitable to be used routinely by clinical laboratories as quality control or for method validation of urine albumin and creatinine measurements.

Performance specifications for sodium should not be based on biological variation

When increasing the quality in clinical laboratories by decreasing measurement uncertainty, reliable methods are needed not only to quantify the performance of measuring systems, but also to set goals for the performance. Sigma metrics used in medical laboratories for documenting and expressing levels of performance, are evidently totally dependent on the "total permissible error" used in the formulas. Although the conventional biological variation (BV) based model for calculation of the permissible (or allowable) total error is commonly used, it has been shown to be flawed. Alternative methods are proposed, mainly also based on the within-subject BV. Measurement uncertainty models might offer an alternative to total error models. Defining the limits for analytical quality still poses a challenge in both models. The aim of the present paper is to critically discuss current methods for establishing performance specifications by using the measurement of sodium concentrations in plasma or serum. Sodium can be measured with high accuracy but fails by far to meet conventional performance specifications based on BV. Since the use of sodium concentrations is well established for supporting clinical care, we question the concept that quality criteria for sodium and similar analytes that are under strict homeostatic control are best set by biology.

Definition and application of performance specifications for measurement uncertainty of 23 common laboratory tests: linking theory to daily practice

Laboratories should estimate and validate [using analytical performance specifications (APS)] the measurement uncertainty (MU) of performed tests. It is therefore essential to appropriately define APS for MU, but also to provide a perspective on suitability of the practical application of these APS. In this study, 23 commonly ordered measurands were allocated to the models defined during the 2014 EFLM Strategic Conference to derive APS for MU. Then, we checked if the performance of commercial measuring systems used in our laboratory may achieve them. Most measurands (serum alkaline phosphatase, aspartate aminotransferase, creatine kinase, γ-glutamyltransferase, lactate dehydrogenase, pancreatic amylase, total proteins, immunoglobulin G, A, M, magnesium, urate, and prostate-specific antigen, plasma homocysteine, and blood red and white cells) were allocated to the biological variation (BV) model and desirable APS were defined accordingly (2.65%, 4.75%, 7.25%, 4.45%, 2.60%, 3.15%, 1.30%, 2.20%, 2.50%, 2.95%, 1.44%, 4.16%, 3.40%, 3.52%, 1.55%, and 5.65%, respectively). Desirable APS for serum total cholesterol (3.00%) and urine albumin (9.00%) were derived using outcome-based model. Lacking outcome-based information, serum albumin, high-density lipoprotein cholesterol, triglycerides, and blood platelets were temporarily reallocated to BV model, the corresponding desirable APS being 1.25%, 2.84%, 9.90%, and 4.85%, respectively. A mix between the two previous models was employed for serum digoxin, with a 6.00% desirable APS. In daily practice by using our laboratory systems, 16 tests fulfilled desirable and five minimum APS, while two (serum albumin and plasma homocysteine) exceeded goals, needing improvements.

Redesigning the surveillance of in vitro diagnostic medical devices and of medical laboratory performance by quality control in the traceability era

IVD manufacturers have total responsibility in terms of the traceability of marketed in vitro diagnostic medical devices (IVD-MD). This includes the provision of a quality control (QC) material as a part of the measuring system, suitable for traceability verification and alignment surveillance by end-users in daily practice. This material [to be used for the internal QC (IQC) component I as described in this paper] should have unbiased target values and an acceptability range corresponding to analytical performance specifications (APS) for suitable (expanded) measurement uncertainty (MU) on clinical samples. On the other hand, medical laboratories (by the IQC component II as described in this paper) should improve the IQC process and its judging criteria to establish a direct link between their performance, estimated as MU of provided results, and APS defined according to recommended models to apply corrective actions if the performance is worsening with the risk to jeopardize the clinical validity of test results. The participation to external quality assessment (EQA) programs that meet specific metrological criteria is also central to the evaluation of performance of IVD-MDs and of medical laboratories in terms of harmonization and clinical suitability of their measurements. In addition to the use of commutable materials, in this type of EQA it is necessary to assign values to them with selected reference procedures and to define and apply maximum allowable APS to substantiate the suitability of laboratory measurements in the clinical setting.

Incidence and status of insulin secretion in pregnant women with flat plasma glucose profiles during oral glucose tolerance test

OBJECTIVES

Flat shaped glucose curves (FC) during oral glucose tolerance test (OGTT) in pregnant women (PW) are a not uncommon finding. We aimed to define the FC incidence in a large PW cohort and to describe the status of insulin and C-peptide secretion in women with FC when compared with a well-matched control group.

METHODS

1050 PW performing OGTT for gestational diabetes screening were enrolled. An increase <6 % in plasma glucose (PG) during OGTT defined a FC. Serum samples for measuring insulin and C-peptide were also obtained.

RESULTS

61 (5.8 %) women showed a FC. 60 of them, paired to a group of 60 no-FC women matched for age, body mass index and gestational age, were further investigated. C-peptide and insulin concentrations were significantly lower (P < 0.001) in FC in both 1-h and 2-h OGTT samples. When incremental area under the curves (AUC) normalized to PG were estimated, only AUCinsulin remained however significantly lower. The insulin sensitivity index was higher in FC.

CONCLUSIONS

PW with FC showed a hypersensitivity to insulin with normal β-cell function. Moreover, a delayed glucose absorption could be hypothesised because of the slight but continuously increasing shape of insulin curve found in FC group. Both phenomena could occur in parallel and contribute to FC.

Quality in laboratory medicine and the Journal: walking together

Quality in laboratory medicine is defined as "an unfinished journey", as the more essential the laboratory information provided, the more assured its quality should be. In the past decades, the Journal Clinical Chemistry and Laboratory Medicine has provided a valuable forum for garnering new insights into the analytical and extra-analytical phases of the testing cycle, and for debating crucial aspects of quality in clinical laboratories. The impressive number of papers published in the Journal is testimony to the efforts made by laboratory professionals, national and international scientific societies and federations in the quest to continuously improve upon the pre-, intra- and post-analytical steps of the testing cycle, thus enhancing the quality of laboratory information. The paper appearing in this special issue summarizes the most important and interesting contributions published in the Journal, thus updating our knowledge on quality in laboratory medicine and offering further stimuli to identify the most valuable measures of quality in clinical laboratories.

Sigma Metrics in Laboratory Medicine: A Call for Harmonization

BACKGROUND AND AIM

Sigma metrics are applied in clinical laboratories to assess the quality of analytical processes. A parameter associated to a Sigma >6 is considered "world class" whereas a Sigma <3 is "poor" or "unacceptable". The aim of this retrospective study was to quantify the impact of different approaches for Sigma metrics calculation.

MATERIAL AND METHODS

Two IQC levels of 20 different parameters were evaluated for a 12-month period. Sigma metrics were calculated using the formula: (allowable total error (TEa) (%) - bias (%))/(coefficient of variation (CV) (%)). Method precision was calculated monthly or annually. The bias was obtained from peer comparison program (PCP) or external quality assessment program (EQAP), and 9 different TEa sources were included.

RESULTS

There was a substantial monthly variation of Sigma metrics for all combinations, with a median variation of 32% (IQR, 25.6-41.3%). Variation across multiple analyzers and IQC levels were also observed. Furthermore, TEa source had the highest impact on Sigma calculation with proportions of Sigma >6 ranging from 17.5% to 84.4%. The nature of bias was less decisive.

CONCLUSION

In absence of a clear consensus, we recommend that laboratories calculate Sigma metrics on a sufficiently long period of time (>6 months) and carefully evaluate the choice of TEa source.

An approach for determining allowable between reagent lot variation

Clinicians trust medical laboratories to provide reliable results on which they rely for clinical decisions. Laboratories fulfil their responsibility for accurate and consistent results by utilizing an arsenal of approaches, ranging from validation and verification experiments to daily quality control procedures. All these procedures verify, on different moments, that the results of a certain examination procedure have analytical performance characteristics (APC) that meet analytical performance specifications (APS) set for a particular intended use. The APC can in part be determined by estimating the measurement uncertainty component under conditions of within-laboratory precision (uRw), which comprises all components influencing the measurement uncertainty of random sources. To maintain the adequacy of their measurement procedures, laboratories need to distinguish aspects that are manageable vs. those that are not. One of the aspects that may influence uRw is the momentary significant bias caused by shifts in reagent and/or calibrator lots, which, when accepted or unnoticed, become a factor of the APC. In this paper, we postulate a model for allocating a part of allowable uRw to between-reagent lot variation, based on the need for long-term consistency of the measurement variability for that specific measurand. The allocation manages the ratio between short-term and long-term variation and indicates laboratories when to reject or correct certain variations due to reagent lots.

A step towards optimal efficiency of HbA1c measurement as a first-line laboratory test: the TOP-HOLE (Towards OPtimal glycoHemOgLobin tEsting) project

OBJECTIVES

The TOP-HOLE (Towards OPtimal glycoHemOgLobin tEsting) project aimed to validate the HbA_1c enzymatic method on the Abbott Alinity c platform and to implement the HbA_1c testing process on the total laboratory automation (TLA) system of our institution.

METHODS

Three different measuring systems were employed: Architect c4000 stand-alone (s-a), Alinity c s-a, and Alinity c TLA. Eight frozen whole blood samples, IFCC value-assigned, were used for checking trueness. A comparison study testing transferability of HbA_1c results from Architect to Alinity was also performed. The alignment of Alinity TLA vs. s-a was verified and the measurement uncertainty (MU) estimated according to ISO 20914:2019. Turnaround time (TAT) and full time equivalent (FTE) were used as efficiency indicators.

RESULTS

For HbA_1c concentrations covering cut-offs adopted in clinical setting, the bias for both Architect and Alinity s-a was negligible. When compared with Architect, Alinity showed a mean positive bias of 0.54 mmol/mol, corresponding to a mean difference of 0.87%. A perfect alignment of Alinity TLA to the Alinity s-a was shown, and a MU of 1.58% was obtained, widely fulfilling the desirable 3.0% goal. After the full automation of HbA_1c testing, 90% of results were released with a maximum TAT of 1 h, 0.30 FTE resource was also saved.

CONCLUSIONS

The traceability of Alinity HbA_1c enzymatic assay to the IFCC reference system was correctly implemented. We successfully completed the integration of the HbA_1c testing on our TLA system, without worsening the optimal analytical performance. The shift of HbA_1c testing from s-a mode to TLA significantly decreased TAT.

Pancreatic lipase: why laboratory community does not take enough care of this clinically important test?

Although being the recommended laboratory test to diagnose acute pancreatitis, serum pancreatic lipase (LIP) is among the poorly standardized laboratory tests, and laboratory stakeholders often appear to not take enough care of the quality of its measurements. Here we discuss some important issues that, if not correctly managed and solved, make misdiagnosis of acute pancreatitis by using serum LIP a real possibility. First, the current unavailability of a suitable higher-order reference material to be used as common calibrator should be filled up to definitively improve the inter-method bias. Second, knowledge of the analytical characteristics that may explain the defective performance of LIP assays should be deepened. IVD manufacturers should be more explicit in providing this information, including description of their internal protocol for transferring LIP values from internal references to commercial calibrators. Third, recommended models for accurately estimating measurement uncertainty and reliably defining analytical performance specifications for LIP measurements should be applied. Finally, investments considering alternative options for measuring LIP (e.g., targeted to the development of automated LIP immunoassays) should be warranted. All involved stakeholders (standardization bodies, higher-order reference providers, in vitro diagnostics manufacturers, and laboratory professionals) should contribute to fill the existing gap.

Impact of optimizing pre-analytical phase on the diagnosis of gestational diabetes and related outcomes

OBJECTIVES

Pre-analytical plasma glucose (PG) sampling methodology may significantly affect gestational diabetes mellitus (GDM) incidence, but no studies directly examined the impact on perinatal outcomes. We compared the effect on oral glucose tolerance test (OGTT) results of using for blood sampling the traditional sodium fluoride (NaF) tubes, batched at controlled temperature, and the more effective citrate-buffered tubes, in terms of GDM diagnosis and related outcomes.

METHODS

We evaluated 578 pregnant women performing OGTT between 24- and 28-weeks' gestation. Paired NaF and citrate blood samples were drawn and analyzed for PG. GDM diagnosis was made by applying the 'one-step' American Diabetes Association strategy. Data on perinatal outcomes were collected in a subset of 330 women who delivered in our hospital network.

RESULTS

Using the standard NaF approach, 69 (11.9%) GDM women were detected. Using citrate PG values, 90 women were additionally identified as GDM, increasing the GDM prevalence to 27.5%. Perinatal outcomes were analyzed according to the different diagnostic allocation (NaF-diagnosed GDM, additional citrate-diagnosed GDM, and no GDM). NaF-diagnosed GDM showed a higher incidence of large for gestational age (LGA) (p=0.034), and of cesarean and preterm delivery (p<0.01) vs. no GDM. The only outcome remaining more frequent in the additional citrate diagnosed GDM when compared with no GDM group was LGA (17.2 vs. 6.8%, p=0.025).

CONCLUSIONS

If a health care system plans to use citrate tubes for GDM diagnosis, considerations about clinical implications are mandatory by balancing higher sensitivity in detecting a poor glycemic control with effects on outcomes to avoid "overdiagnosis".

Optimizing Available Tools for Achieving Result Standardization: Value Added by Joint Committee on Traceability in Laboratory Medicine (JCTLM)

BACKGROUND

The JCTLM created a Task Force on Reference Measurement System Implementation (TF-RMSI) to provide guidance on metrological traceability implementation for the in vitro diagnostics (IVD) community.

CONTENT

TF-RMSI investigated the reference measurement systems (RMS) for 13 common measurands by applying the following procedural steps: (a) extracting data from the JCTLM database of available certified reference materials (CRMs) and reference measurement procedures (RMPs); (b) describing the RMS to which each recruited CRM or RMP belongs; (c) identifying the intended use of the CRMs, and, if used as a common calibrator for IVD measuring systems and/or trueness assessment of field methods was included, checking the CRM's certificate for information about commutability with clinical samples; and (d) checking if the CRM or RMP measurement uncertainty (MU) has the potential to be small enough to avoid significantly affecting the analytical performance specifications (APS) for MU of clinical sample results when the MU from the IVD calibrator and from the end-user measuring system were combined.

SUMMARY

We produced a synopsis of JCTLM-listed higher-order CRMs and RMPs for the selected measurands, including their main characteristics for implementing traceability and fulfilling (or not) the APS for suitable MU. Results showed that traceability to higher-order references can be established by IVD manufacturers within the defined APS for most of the 13 selected measurands. However, some measurands do not yet have suitable CRMs for use as common calibrators. For these measurands, splitting clinical samples with a laboratory performing the RMP may provide a practical alternative for establishing a calibration hierarchy.

Improving the laboratory result release process in the light of ISO 15189:2012 standard

The ISO 15189:2012 standard section 5.9.1 requires laboratories to review results before release, considering quality control, previous results, and clinical information, if any, and to issue documented procedures about it. While laboratory result reporting is generally regarded as part of the post-analytical phase, the result release process requires a general view of the total examination process. Reviewing test results may follow with troubleshooting and test repetition, including reanalyzing an individual sample or resampling. A systematic understanding of the result release may help laboratory professionals carry out appropriate test repetition and ensure the plausibility of laboratory results. In this paper, we addressed the crucial steps in the result release process, including evaluation of sample quality, critical result notification, result reporting, and recommendations for the management of the result release, considering quality control alerts, instrument flags, warning messages, and interference indexes. Error detection tools and plausibility checks mentioned in the present paper can support the daily practice of results release.

Protective Effects of N1-Methylnicotinamide Against High-Fat Diet- and Age-Induced Hearing Loss via Moderate Overexpression of Sirtuin 1 Protein

Age-related hearing loss (ARHL) is the most common form of hearing loss and the predominant neurodegenerative disease associated with aging. Sirtuin 1 (SIRT1) is associated with the most complex physiological processes, including metabolism, cancer onset, and aging. SIRT1 protein levels are enhanced by the conversion of nicotinamide to N¹-methylnicotinamide (MNAM), independent of its mRNA levels. Moreover, MNAM has implications in increased longevity achieved through its mitohormetic effects. Nicotinamide N-methyltransferase (Nnmt) is an enzyme involved in MNAM metabolism, and its level increases under caloric restriction (CR) conditions. The CR condition has implications in delaying ARHL onset. In this study, we aimed to determine the relationship between diet, hearing function, SIRT1 and SIRT3 expression levels in the inner ear, and cochlear morphology. Mice fed with a high-fat diet (HFD), HFD + 1% MNAM, and low-fat diet (LFD) were monitored for age-related auditory-evoked brainstem responses, and changes in cochlear histology, metabolism, and protein and mRNA expressions were analyzed. Our results revealed that the HFD- and aging-mediated downregulated expression of SIRT1 and SIRT3 promoted hearing loss that was obfuscated by MNAM supplementation-induced upregulated expression of cochlear SIRT1 and SIRT3. Thus, our results suggest that MNAM can be used as a therapeutic agent for preventing ARHL.