Setting analytical performance specifications based on outcome studies - is it possible?

Assessment of accuracy of laboratory testing results, relative to peer group consensus values in external quality control, by bivariate z-score analysis: the example of D-Dimer

OBJECTIVES

The aim of this study is to develop a practical method for bivariate z-score analysis which can be applied to the survey of an external quality assessment programme.

METHODS

To develop the bivariate z-score analysis, the results of four surveys of the international D-Dimer external quality assessment programme of 2022 of the ECAT Foundation were used. The proposed methodology starts by identifying the bivariate outliers, using a Supervised Sequential Hotelling T2 control chart. The outlying data are removed, and all the remaining data are used to provide robust estimates of the parameters of the assumed underlying bivariate normal distribution. Based on these estimates two nested homocentric ellipses are drawn, corresponding to confidence levels of 95 and 99.7 %. The bivariate z-score plot described provides the laboratory with an indication of both systematic and random deviations from zero z-score values. The bivariate z-score analysis was examined within survey 2022-D4 across the three most frequently used methods.

RESULTS

The number of z-score pairs included varied between 830 and 857 and the number of bivariate outliers varied between 20 and 28. The correlation between the z-score pairs varied between 0.431 and 0.647. The correlation between the z-score pairs for the three most frequently used varied between 0.208 and 0.636.

CONCLUSIONS

The use of the bivariate z-score analysis is of major importance when multiple samples are distributed around in the same survey and dependency of the results is likely. Important lessons can be drawn from the shape of the ellipse with respect to random and systematic deviations, while individual laboratories have been informed about their position in the state-of-the-art distribution and whether they have to deal with systematic and/or random deviations.

How clinical laboratories select and use Analytical Performance Specifications (APS) in Italy

OBJECTIVES

Even if the topic of the analytical quality required to provide laboratory results "fit for purpose" exists since the beginning of the modern medical laboratory, there is the suspect that the expression "Analytical Performance Specifications" (APS) is not well-known. To investigate this aspect a survey was conducted.

METHODS

A questionnaire with seven questions related to the knowledge about the topic, the sources of information and the criteria used by the laboratories to set the APS and their applications was prepared. It was distributed to all the clinical pathology laboratories of Lombardy Region (143) and to the members of SIBioC Laboratory Medicine (excluding Lombardy).

RESULTS

We received 201 replies: 127 from Lombardy and 74 from the rest of Italy. Fifteen percent declared to ignore the meaning of APS and only 64 % of those knowing the meaning of the term declared to use them in the daily practice. The state-of-the-art was the principle used more frequently to set APS (about 48 %) followed by biological variation (41 %), and APS were typically applied to set goals for Internal Quality Control for selected measurands. Usually imprecision or total error APS were used, much less frequently uncertainty APS. In fact only 27 % of the laboratories declared to have calculated the measurement uncertainty for part or the majority of their measurands.

CONCLUSIONS

Even considering the limits of a survey that relies upon self-declarations, it appears clearly that, at list in Italy, there is some work to be done to promote the concept and the use of APS.

What the Milan conference has taught us about analytical performance specification model definition and measurand allocation

Analytical performance specifications (APS) represent the criteria that specify the quality required for laboratory test information to satisfy clinical needs. In 2014 the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) considered timely to update the topic of APS by organizing a conference in Milan in which some strategic concepts were proposed. Here I summarize the essential points representing the EFLM Strategic Conference heritage and discuss the approaches that will permit us to become more concrete, including roles and main actions expected from each of involved stakeholders for contributing a quantum leap forward in the way of practicality of Milan consensus about APS.

Applying the Milan models to setting analytical performance specifications - considering all the information

Analytical performance specifications (APS) are used for decisions about the required analytical quality of pathology tests to meet clinical needs. The Milan models, based on clinical outcome, biological variation, or state of the art, were developed to provide a framework for setting APS. An approach has been proposed to assign each measurand to one of the models based on a defined clinical use, physiological control, or an absence of quality information about these factors. In this paper we propose that in addition to such assignment, available information from all models should be considered using a risk-based approach that considers the purpose and role of the actual test in a clinical pathway and its impact on medical decisions and clinical outcomes in addition to biological variation and the state-of-the-art. Consideration of APS already in use and the use of results in calculations may also need to be considered to determine the most appropriate APS for use in a specific setting.

Outcome-based analytical performance specifications: current status and future challenges

Analytical performance specifications (APS) based on outcomes refer to how 'good' the analytical performance of a test needs to be to do more good than harm to the patient. Analytical performance of a measurand affects its clinical performance. Without first setting clinical performance requirements, it is difficult to define how good analytically the test needs to be to meet medical needs. As testing is indirectly linked to health outcomes through clinical decisions on patient management, often simulation-based studies are used to assess the impact of analytical performance on the probability of clinical outcomes which is then translated to Model 1b APS according to the Milan consensus. This paper discusses the related key definitions, concepts and considerations that should assist in finding the most appropriate methods for deriving Model 1b APS. We review the advantages and limitations of published methods and discuss the criteria for transferability of Model 1b APS to different settings. We consider that the definition of the clinically acceptable misclassification rate is central to Model 1b APS. We provide some examples and guidance on a more systematic approach for first defining the clinical performance requirements for tests and we also highlight a few ideas to tackle the future challenges associated with providing outcome-based APS for laboratory testing.

Analytical performance specifications for trace elements in biological fluids derived from six countries federated external quality assessment schemes over 10 years

OBJECTIVES

This article defines analytical performance specifications (APS) for evaluating laboratory proficiency through an external quality assessment scheme.

METHODS

Standard deviations for proficiency assessment were derived from Thompson's characteristic function applied to robust data calculated from participants' submissions in the Occupational and Environmental Laboratory Medicine (OELM) external quality assurance scheme for trace elements in serum, whole blood and urine. Characteristic function was based on two parameters: (1) β - the average coefficient of variation (CV) at high sample concentrations; (2) α - the average standard deviation (SD) at low sample concentrations. APSs were defined as 1.65 standard deviations calculated by Thompson's approach. Comparison between OELM robust data and characteristic function were used to validate the model.

RESULTS

Application of the characteristic function allowed calculated APS for 18 elements across three matrices. Some limitations were noted, particularly for elements (1) with no sample concentrations near analytical technique limit of detection; (2) exhibiting high robust CV at high concentration; (3) exhibiting high analytical variability such as whole blood Tl and urine Pb; (4) with an unbalanced number of robust SD above and under the characteristic function such as whole blood Mn and serum Al and Zn.

CONCLUSIONS

The characteristic function was a useful means of deriving APS for trace elements in biological fluids where biological variation data or outcome studies were not available. However, OELM external quality assurance scheme data suggests that the characteristic functions are not appropriate for all elements.

Evaluation of imprecision in the different detection methods of Zn based on 5 years of data from an external quality assessment program in China

BACKGROUND

This study examines the imprecision of zinc (Zn) measurements across various clinical detection methods by analyzing the external quality assessment (EQA) data from 2018 to 2022. The findings of this study aim to offer recommendations for enhancing Zn measurements.

METHODS

Participating laboratories were grouped into peer categories based on the detection methods. The robust mean and coefficient of variation (CV) of the samples were calculated following ISO 13528 guidelines. The evaluation criteria for optimal, desirable, and minimum allowable imprecision in Zn estimation are 2.50%, 5.05%, and 7.55%, respectively, based on biological variation. Furthermore, the study examined inter-lab CVs, inter-method bias, and the passing rate. The impact of sample concentration on CVs and the pass rate was also investigated.

RESULTS

Over the past five years, 4283 laboratories participated in the EQA program, showing a high pass rate that improved as sample concentration increased. Differential pulse polarography (DPP) demonstrated stable and low CVs (0.61-1.86%). Although differential pulse stripping (DPS) was less stable than DPP, it still exhibited a low CV (0.71-3.10%). Graphite furnace atomic absorption spectrometry (GFAAS) and flame atomic absorption spectrometry (FAAS) performed similarly and displayed stable CVs (2.39-4.42%) within the acceptable range of desirable imprecision (5.05%). However, the CVs for ICP-MS were unacceptable in three out of the five years (5.28-6.20%). In 2022, the number of participating laboratories for DDP, DPS, GFAAS, FAAS and ICP-MS is 131, 35, 35, 820 and 72, respectively.

CONCLUSION

This study provides reliable insights into the imprecision of Zn measurements in clinical laboratories. The findings indicate that additional efforts are required to reduce the imprecision of ICP-MS in Zn measurements.

Analytical performance specifications and quality assurance of point-of-care testing in primary healthcare

Point-of-care testing (POCT) is the fastest-growing segment of laboratory medicine. This review focuses on the essential aspects of setting analytical performance specifications (APS) and performing quality assurance for POCT in primary healthcare. In-vitro diagnostic medical devices for POCT are typically small and easy to operate. Users often have little to no laboratory experience and may not necessarily see the value of conducting quality assurance on their devices. Therefore, training, guidance, and motivation should be integral parts of the total quality management system, as they are vital for managing errors and ensuring reliable results. It is common to believe that the analytical quality of POCT should be comparable to that of laboratory testing, and as a result, APS should be the same. This paper challenges this concept. The APS for POCT can often be less stringent compared to those used in a central laboratory because the requester is closer to both the analytical and clinical situation. Point-of-care instruments should be selected based on clinical needs, the required analytical quality and user-friendliness in the intended usage setting.Quality assurance should include both internal quality control (IQC) and external quality assessment (EQA). It is recommended that IQC protocols should be dependent on the complexity of the POCT device. A scoring system to determine how frequent IQC should be analyzed in primary healthcare on different types of POCT devices has been suggested. The main challenge in EQA for POCT involves using suitable control materials that reflect instrument performance on patient samples. Obtaining commutable control materials for POCT is difficult since the matrix often is whole blood. An essential aspect of EQA for POCT is that feedback reports should be easily interpretable. Users should receive advice from the EQA organizer regarding the root causes of deviating results. Quality assurance for POCT is not an easy task and presents numerous challenges. However, there is evidence that quality assurance improves the quality of POCT measurements and, consequently, can enhance patient outcomes.

APS calculator: a data-driven tool for setting outcome-based analytical performance specifications for measurement uncertainty using specific clinical requirements and population data

OBJECTIVES

According to ISO 15189:2022, analytical performance specifications (APS) should relate to intended clinical use and impact on patient care. Therefore, we aimed to develop a web application for laboratory professionals to calculate APS based on a simulation of the impact of measurement uncertainty (MU) on the outcome using the chosen decision limits, agreement thresholds, and data of the population of interest.

METHODS

We developed the "APS Calculator" allowing users to upload and select data of concern, specify decision limits and agreement thresholds, and conduct simulations to determine APS for MU. The simulation involved categorizing original measurand concentrations, generating measured (simulated) results by introducing different degrees of MU, and recategorizing measured concentrations based on clinical decision limits and acceptable clinical misclassification rates. The agreements between original and simulated result categories were assessed, and values that met or exceeded user-specified agreement thresholds that set goals for the between-category agreement were considered acceptable. The application generates contour plots of agreement rates and corresponding MU values. We tested the application using National Health and Nutrition Examination Survey data, with decision limits from relevant guidelines.

RESULTS

We determined APS for MU of six measurands (blood total hemoglobin, plasma fasting glucose, serum total and high-density lipoprotein cholesterol, triglycerides, and total folate) to demonstrate the potential of the application to generate APS.

CONCLUSIONS

The developed data-driven web application offers a flexible tool for laboratory professionals to calculate APS for MU using their chosen decision limits and agreement thresholds, and the data of the population of interest.

Bias in Laboratory Medicine: The Dark Side of the Moon

Physicians increasingly use laboratory-produced information for disease diagnosis, patient monitoring, treatment planning, and evaluations of treatment effectiveness. Bias is the systematic deviation of laboratory test results from the actual value, which can cause misdiagnosis or misestimation of disease prognosis and increase healthcare costs. Properly estimating and treating bias can help to reduce laboratory errors, improve patient safety, and considerably reduce healthcare costs. A bias that is statistically and medically significant should be eliminated or corrected. In this review, the theoretical aspects of bias based on metrological, statistical, laboratory, and biological variation principles are discussed. These principles are then applied to laboratory and diagnostic medicine for practical use from clinical perspectives.

Verifying measurements on Siemens Atellica® instruments using clinically acceptable analytical performance specifications

Measurements on clinical chemistry analysers must be verified to demonstrate applicability to their intended clinical use. We verified the performance of measurements on the Siemens Atellica® Solution chemistry analysers against the clinically acceptable analytical performance specifications, CAAPS, including the component of intra-individual biological variation, CVI. The relative standard uncertainty of measurement, i.e. analytical variation, CVA, was estimated for six example measurands, haemoglobin A1c in whole blood (B-HbA1c), albumin in urine (U-Alb), and the following measurands in plasma: sodium (P-Na), pancreatic amylase (P-AmylP), low-density lipoprotein cholesterol (P-LDL-C), and creatinine (P-Crea). Experimental CVA was calculated from single-instrument imprecision using control samples, variation between measurements on parallel instruments, and estimation of bias with pooled patient specimens. Each obtained CVA was compared with previously developed CAAPS. The calculated CVA was 1.4% for B-HbA1c (CAAPS 1.9% for single diagnostic testing, CAAPS 2.0% for monitoring after duplicate tests; IFCC units), 10.9% for U-Alb (CAAPS 44.9%), 1.2% for P-Na (CAAPS 0.6%, after triplicate testing 1.5%), 8.2% for P-AmylP (CAAPS 22.9%). The CVA was 4.9% for P-LDL-C (CAAPS for cardiovascular risk stratification 4.9% after four replicates), and 4.2% for P-Crea (CAAPS 8.0%). Three of the six measurands fulfilled the estimated clinical need. Results from P-Na measurements indicate a general need for improving the P-Na assays for emergency patients. It is necessary to consider CVI when creating diagnostic targets for laboratory tests, as emphasised by the CAAPS estimates of B-HbA1c and P-LDL-C.

Interpreting changes in consecutive laboratory results: clinician's perspectives on clinically significant change

BACKGROUND

Clinical laboratory tests are inevitably affected by various factors. Therefore, when comparing consecutive test results, it is crucial to consider the inherent uncertainty of the test. Clinical laboratories use reference change value (RCV) to determine a significant change between 2 results. Whereas the criteria for the interpretation of consecutive results by clinicians are not well known. We investigated the clinician's interpretation of a clinically significant change in consecutive laboratory test results and compared them to RCV.

METHODS

We performed a questionnaire survey on clinicians, which comprised 2 scenarios with 22 laboratory test items suggesting initial test results. Clinicians were asked to choose a result showing clinically significant change. RCV of the analytes from EFLM database were collected.

RESULTS

We received 290 valid questionnaire responses. Clinicians' opinions on clinically significant change was inconsistent between clinicians and scenarios, and was generally larger than RCV. Clinicians commented that they were not familiar with the variability of the laboratory tests.

CONCLUSIONS

Clinicians' opinions on clinically significant changes were more prominent than RCV. Meanwhile, they tended to neglect the analytical and biological variation. Laboratories should properly guide clinicians on the RCV of tests for better decision-making on patients' clinical states.

Systematic review and meta-analysis of within-subject and between-subject biological variation data of coagulation and fibrinolytic measurands

OBJECTIVES

The diagnosis and monitoring of bleeding and thrombotic disorders depend on correct haemostatic measurements. The availability of high-quality biological variation (BV) data is important in this context. Many studies have reported BV data for these measurands, but results are varied. The present study aims to deliver global within-subject (CVI) and between-subject (CVG) BV estimates for haemostasis measurands by meta-analyses of eligible studies, by assessment with the Biological Variation Data Critical Appraisal Checklist (BIVAC).

METHODS

Relevant BV studies were graded by the BIVAC. Weighted estimates for CVI and CVG were obtained via meta-analysis of the BV data derived from BIVAC-compliant studies (graded A-C; whereby A represents optimal study design) performed in healthy adults.

RESULTS

In 26 studies BV data were reported for 35 haemostasis measurands. For 9 measurands, only one eligible publication was identified and meta-analysis could not be performed. 74% of the publications were graded as BIVAC C. The CVI and CVG varied extensively between the haemostasis measurands. The highest estimates were observed for PAI-1 antigen (CVI 48.6%; CVG 59.8%) and activity (CVI 34.9%; CVG 90.2%), while the lowest were observed for activated protein C resistance ratio (CVI 1.5%; CVG 4.5%).

CONCLUSIONS

This study provides updated BV estimates of CVI and CVG with 95% confidence intervals for a wide range of haemostasis measurands. These estimates can be used to form the basis for analytical performance specifications for haemostasis tests used in the diagnostic work-up required in bleeding- and thrombosis events and for risk assessment.

Clinical decision limits as criteria for setting analytical performance specifications for laboratory tests

BACKGROUND

The biological (CV_I), preanalytical (CV_PRE), and analytical variation (CV_A) are inherent to clinical laboratory testing and consequently, interpretation of clinical test results.

METHODS

The sum of the CV_I, CV_PRE, and CV_A, called diagnostic variation (CV_D), was used to derive clinically acceptable analytical performance specifications (CAAPS) for clinical chemistry measurands. The reference change concept was applied to clinically significant differences (CD) between two measurements, with the formula CD = z*√2* CV_D. CD for six measurands were sought from international guidelines. The CAAPS were calculated by subtracting variances of CV_I and CV_PRE from CV_D. Modified formulae were applied to consider statistical power (1-β) and repeated measurements.

RESULTS

The obtained CAAPS were 44.9% for urine albumin, 0.6% for plasma sodium, 22.9% for plasma pancreatic amylase, and 8.0% for plasma creatinine (z = 3, α = 2.5%, 1-β = 85%). For blood HbA_1c and plasma low-density lipoprotein cholesterol, replicate measurements were necessary to reach CAAPS for patient monitoring. The derived CAAPS were compared with analytical performance specifications, APS, based on biological variation.

CONCLUSIONS

The CAAPS models pose a new tool for assessing APS in a clinical laboratory. Their usability depends on the relevance of CD limits, required statistical power and the feasibility of repeated measurements.

Managing the impact of inter-method bias of prostate specific antigen assays on biopsy referral: the key to move towards precision health in prostate cancer management

OBJECTIVES

We assessed the inter-method bias of total (tPSA) and free (fPSA) prostate-specific antigen (PSA) immunoassays to establish if tPSA-based risk thresholds for advanced prostate cancer (PCa), obtained from one method (Roche) can be converted into the corresponding concentrations assayed by other methods. Then we evaluated the impact of the bias of tPSA and fPSA on the estimation of the %f/tPSA ratio and performed a re-calibration of the proposed thresholds for the %f/tPSA ratio according to the assay used.

METHODS

tPSA and fPSA were measured in 135 and 137 serum samples, respectively by Abbott Alinity i, Beckman Access Dxl, Roche Cobas e801, and Siemens Atellica IM analytical platforms. Scatterplots, Bland-Altman diagrams, Passing-Bablok (PB) were used to inspect and estimate the systematic and proportional bias between the methods. The linear equations with confidence intervals of the parameter estimates were used to transform the tPSA risk thresholds for advanced PCa into the corresponding concentrations measurable by the other analytical methods. To construct a correction coefficient for converting the %f/tPSA ratio from one method to the other, PB and non-parametric boostrapping were used.

RESULTS

The inter-method bias is not constant but strictly linear allowing the conversion of PSA results obtained from Roche into the other assays, which underestimate tPSA vs. Roche. Siemens and Abbott vs. Roche and Beckman assays, being characterized by a positive and a negative proportional bias for tPSA and fPSA measurements, tend to overestimate the %f/tPSA ratio.

CONCLUSIONS

There is a consistent risk to miss advanced PCa, if appropriate conversion factors are not applied.

Redesigning the surveillance of in vitro diagnostic medical devices and of medical laboratory performance by quality control in the traceability era

IVD manufacturers have total responsibility in terms of the traceability of marketed in vitro diagnostic medical devices (IVD-MD). This includes the provision of a quality control (QC) material as a part of the measuring system, suitable for traceability verification and alignment surveillance by end-users in daily practice. This material [to be used for the internal QC (IQC) component I as described in this paper] should have unbiased target values and an acceptability range corresponding to analytical performance specifications (APS) for suitable (expanded) measurement uncertainty (MU) on clinical samples. On the other hand, medical laboratories (by the IQC component II as described in this paper) should improve the IQC process and its judging criteria to establish a direct link between their performance, estimated as MU of provided results, and APS defined according to recommended models to apply corrective actions if the performance is worsening with the risk to jeopardize the clinical validity of test results. The participation to external quality assessment (EQA) programs that meet specific metrological criteria is also central to the evaluation of performance of IVD-MDs and of medical laboratories in terms of harmonization and clinical suitability of their measurements. In addition to the use of commutable materials, in this type of EQA it is necessary to assign values to them with selected reference procedures and to define and apply maximum allowable APS to substantiate the suitability of laboratory measurements in the clinical setting.

Quality in laboratory medicine and the Journal: walking together

Quality in laboratory medicine is defined as "an unfinished journey", as the more essential the laboratory information provided, the more assured its quality should be. In the past decades, the Journal Clinical Chemistry and Laboratory Medicine has provided a valuable forum for garnering new insights into the analytical and extra-analytical phases of the testing cycle, and for debating crucial aspects of quality in clinical laboratories. The impressive number of papers published in the Journal is testimony to the efforts made by laboratory professionals, national and international scientific societies and federations in the quest to continuously improve upon the pre-, intra- and post-analytical steps of the testing cycle, thus enhancing the quality of laboratory information. The paper appearing in this special issue summarizes the most important and interesting contributions published in the Journal, thus updating our knowledge on quality in laboratory medicine and offering further stimuli to identify the most valuable measures of quality in clinical laboratories.

Biological variation of cardiac myosin-binding protein C in healthy individuals

OBJECTIVES

Cardiac myosin-binding protein C (cMyC) is a novel biomarker of myocardial injury, with a promising role in the triage and risk stratification of patients presenting with acute cardiac disease. In this study, we assess the weekly biological variation of cMyC, to examine its potential in monitoring chronic myocardial injury, and to suggest analytical quality specification for routine use of the test in clinical practice.

METHODS

Thirty healthy volunteers were included. Non-fasting samples were obtained once a week for ten consecutive weeks. Samples were tested in duplicate on the Erenna® platform by EMD Millipore Corporation. Outlying measurements and subjects were identified and excluded systematically, and homogeneity of analytical and within-subject variances was achieved before calculating the biological variability (CVI and CVG), reference change values (RCV) and index of individuality (II).

RESULTS

Mean age was 38 (range, 21-64) years, and 16 participants were women (53%). The biological variation, RCV and II with 95% confidence interval (CI) were: CVA (%) 19.5 (17.8-21.6), CVI (%) 17.8 (14.8-21.0), CVG (%) 66.9 (50.4-109.9), RCV (%) 106.7 (96.6-120.1)/-51.6 (-54.6 to -49.1) and II 0.42 (0.29-0.56). There was a trend for women to have lower CVG. The calculated RCVs were comparable between genders.

CONCLUSIONS

cMyC exhibits acceptable RCV and low II suggesting that it could be suitable for disease monitoring, risk stratification and prognostication if measured serially. Analytical quality specifications based on biological variation are similar to those for cardiac troponin and should be achievable at clinically relevant concentrations.

Development and Provisional Validation of a Multiplex LC-MRM-MS Test for Timely Kidney Injury Detection in Urine

Kidney injury is a complication frequently encountered in hospitalized patients. Early detection of kidney injury prior to loss of renal function is an unmet clinical need that should be targeted by a protein-based biomarker panel. In this study, we aim to quantitate urinary kidney injury biomarkers at the picomolar to nanomolar level by liquid chromatography coupled to tandem mass spectrometry in multiple reaction monitoring mode (LC-MRM-MS). Proteins were immunocaptured from urinary samples, denatured, reduced, alkylated, and digested into peptides before LC-MRM-MS analysis. Stable-isotope-labeled peptides functioned as internal standards, and biomarker concentrations were attained by an external calibration strategy. The method was evaluated for selectivity, carryover, matrix effects, linearity, and imprecision. The LC-MRM-MS method enabled the quantitation of KIM-1, NGAL, TIMP2, IGFBP7, CXCL9, nephrin, and SLC22A2 and the detection of TGF-β1, cubilin, and uromodulin. Two to three peptides were included per protein, and three transitions were monitored per peptide for analytical selectivity. The analytical carryover was <1%, and minimal urine matrix effects were observed by combining immunocapture and targeted LC-MRM-MS analysis. The average total CV of all quantifier peptides was 26%. The linear measurement range was determined per measurand and found to be 0.05–30 nmol/L. The targeted MS-based method enables the multiplex quantitation of low-abundance urinary kidney injury biomarkers for future clinical evaluation.

The Time Has Come for Quantitative Protein Mass Spectrometry Tests That Target Unmet Clinical Needs

Protein mass spectrometry (MS) is an enabling technology that is ideally suited for precision diagnostics. In contrast to immunoassays with indirect readouts, MS quantifications are multiplexed and include identification of proteoforms in a direct manner. Although widely used for routine measurements of drugs and metabolites, the number of clinical MS-based protein applications is limited. In this paper, we share our experience and aim to take away the concerns that have kept laboratory medicine from implementing quantitative protein MS. To ensure added value of new medical tests and guarantee accurate test results, five key elements of test evaluation have been established by a working group within the European Federation for Clinical Chemistry and Laboratory Medicine. Moreover, it is emphasized to identify clinical gaps in the contemporary clinical pathways before test development is started. We demonstrate that quantitative protein MS tests that provide an additional layer of clinical information have robust performance and meet long-term desirable analytical performance specifications as exemplified by our own experience. Yet, the adoption of quantitative protein MS tests into medical laboratories is seriously hampered due to its complexity, lack of robotization and high initial investment costs. Successful and widespread implementation in medical laboratories requires uptake and automation of this next generation protein technology by the In-Vitro Diagnostics industry. Also, training curricula of lab workers and lab specialists should include education on enabling technologies for transitioning to precision medicine by quantitative protein MS tests.

Biological variation: Understanding why it is so important?

This Review will describe the increasing importance of the concepts of biological variation to clinical chemists. The idea of comparison to 'reference' is fundamental in measurement. For the biological measurands, that reference is the relevant patient population, a clinical decision point based on a trial or an individual patient's previous results. The idea of using biological variation to set quality goals was then realised for setting Quality Control (QC) and External Quality Assurance (EQA) limits. The current phase of BV integration into practice is using Patient-Based Real-Time Quality Control (PBRTQC) and Patient Based Quality Assurance (PBQA) to detect a change in assay performance. The challenge of personalised medicine is to determine an individual reference interval. The Athletes Biological Passport may provide the solution.

Analytical performance of cardiac troponin assays - Current status and future needs

Concurrent with the introduction of cardiac troponin measurements into the diagnostic definition of myocardial infarction (MI), clinicians and laboratory professionals signaled a clear clinical need for improved analytical quality. This was an important precipitant for developing high-sensitivity cardiac troponin (hs-cTn) assays, currently used in rapid algorithms guiding investigations of patients presenting to the emergency department with possible MI. The hs-cTn assays were also important for the detection and monitoring of low-grade chronic myocardial injury, a condition that has been linked to increased long-term risk of cardiovascular morbidity and mortality. This review summarizes the general recommendations for defining analytical performance specifications while providing relevant clinical situations related to analytical performance. Importantly, outcome studies suggest analytical quality performance for hs-cTn is sufficient for early discharge of patients investigated for possible MI. However, bias due to change in calibrators or reagents may significantly affect the percentage of patients discharged. Biological variation data is suitable for defining performance specifications when hs-cTn measurements are used for diagnosing and monitoring chronic myocardial injury. Further improvement in analytical performance for hs-cTn testing may result in even faster decision making in the emergency setting; while also identifying those with chronic injury at risk for an adverse cardiac event.

External quality assessment schemes for inorganic elements in the clinical laboratory: Lessons from the OELM scheme

Measurements of inorganic elements in clinical laboratories produce results used for the diagnosis, the treatment and the monitoring of deficiencies or overloads. The main objective of External Quality Assessment Schemes is to verify, on a regular frequency, that clinical laboratory results correspond to the quality requirement for patient care. Therefore, External Quality Assessment Schemes represent an essential component of a laboratory's quality management system. However, External Quality Assessment Schemes within the same analytical field remain heterogeneous for different reasons such as samples, determination of assigned value, acceptable limits, content of the reports. The aim of this review was to describe and illustrate some major critical aspects of External Quality Assessment Schemes based on Occupational and Environmental Laboratory Medicine external quality assessment scheme experience.

Toward a Framework for Outcome-Based Analytical Performance Specifications: A Methodology Review of Indirect Methods for Evaluating the Impact of Measurement Uncertainty on Clinical Outcomes

BACKGROUND

For medical tests that have a central role in clinical decision-making, current guidelines advocate outcome-based analytical performance specifications. Given that empirical (clinical trial-style) analyses are often impractical or unfeasible in this context, the ability to set such specifications is expected to rely on indirect studies to calculate the impact of test measurement uncertainty on downstream clinical, operational, and economic outcomes. Currently, however, a lack of awareness and guidance concerning available alternative indirect methods is limiting the production of outcome-based specifications. Therefore, our aim was to review available indirect methods and present an analytical framework to inform future outcome-based performance goals.

CONTENT

A methodology review consisting of database searches and extensive citation tracking was conducted to identify studies using indirect methods to incorporate or evaluate the impact of test measurement uncertainty on downstream outcomes (including clinical accuracy, clinical utility, and/or costs). Eighty-two studies were identified, most of which evaluated the impact of imprecision and/or bias on clinical accuracy. A common analytical framework underpinning the various methods was identified, consisting of 3 key steps: (a) calculation of "true" test values; (b) calculation of measured test values (incorporating uncertainty); and (c) calculation of the impact of discrepancies between (a) and (b) on specified outcomes. A summary of the methods adopted is provided, and key considerations are discussed.

CONCLUSIONS

Various approaches are available for conducting indirect assessments to inform outcome-based performance specifications. This study provides an overview of methods and key considerations to inform future studies and research in this area.

Risk analysis and assessment based on Sigma metrics and intended use

Introduction

In order to ensure the quality in clinical laboratories and meet the low risk requirements of patients and clinicians, a risk analysis and assessment model based on Sigma metrics and intended use was constructed, based on which differential sigma performance (σ) expectations of 42 analytes were developed.

Materials and methods

Failure mode and effects analysis was applied to produce an analytic risk rating based on three factors, each test of which was graded as follows: 1) Sigma metrics; 2) the severity of harm; 3) intended use. By multiplying the score of Sigma metrics by the score of severity of harm by the score of intended use, each was assigned a typical risk priority number (RPN), with RPN ≤ 25 rated as low risk. Low risk was defined as acceptable standards; the sigma performance expectations were calculated.

Results

Among the 42 analytes, tests with σ ≥ 6, 5 ≤ σ < 6, 4 ≤ σ < 5, 3 ≤ σ < 4, σ < 3 were 21, 5, 5, 6, and 5, respectively; there were 7 high-risk tests, 8 of them medium risk tests. According to the risk assessment conclusion, 13 tests had sigma performance expectations ≥ 6; 15 test items had sigma performance expectations ≥ 5, while 3 test items had sigma performance expectations ≥ 4; 11 test items had sigma performance expectations ≥ 3.

Conclusions

Constructing the risk analysis and assessment model based on Sigma metrics and intended use will help clinical laboratories to identify the high-risk tests more objectively and comprehensively. Such model can also be used to establish the sigma performance expectations and meet the low risk requirements of patients and clinicians.

Proteomic analysis of synovial fluid: current and potential uses to improve clinical outcomes

INTRODUCTION

Synovial fluid (SF) is in close proximity to tissues which are primarily altered during articular disease and has significant potential to better understand the underlying disease pathogeneses of articular pathologies and biomarker discovery. Although development of mass spectrometry-based methods has allowed faster and higher sensitivity techniques, interrogation of the SF proteome has been hindered by its large protein concentration dynamic range, impeding quantification of lower abundant proteins. Areas covered: Recent advances have developed methodologies to reduce the large protein concentration dynamic range of SF and subsequently allow deeper exploration of the SF proteome. This review concentrates on methods to overcome biofluid complexity, mass spectrometry proteomics methodologies, extracellular vesicles proteomics and the application of advances within the field in clinical disease, including osteoarthritis, rheumatoid arthritis, spondyloarthritis and juvenile arthritis. A narrative review was conducted with articles searched using PubMed, 1991-2018. Expert opinion: The SF proteomics field faces various challenges, including the requirement for rigorous and standardised methods of sample collection/storage, the sensitivity and specificity of proteomic assays, techniques to combat the large protein concentration dynamic range and comprehensive data analysis to reduce falsely identified markers. Additionally, there are challenges in developing multi 'omic' integration techniques, with computational integration enhancing analysis.

Kidney Injury Biomarkers in an Academic Hospital Setting: Where Are We Now?

Acute kidney injury (AKI) is a frequent complication in hospitalised patients and is diagnosed by urinary output and serum creatinine. Serum creatinine is an indirect marker for renal glomerular filtration, but lacks specificity for damage to kidney tissue and the relatively late response to injury precludes early recognition of AKI. Timely diagnosis of kidney injury using biomarkers that provide information about the aetiology of kidney injury is an unmet clinical need. To overcome the suboptimal performance of serum creatinine, injury biomarkers have been proposed that predict AKI in diverse clinical settings. The clinical performance of these markers is considered moderate due to the lack of specificity for kidney tissue or the underlying injury mechanisms, poor test specificity and confounding by interventions or comorbidities. Hence, it is not unequivocally beneficial to implement current kidney injury biomarkers in the clinical laboratory for diagnostic purposes. In this article we review biomarkers that might fulfil AKI-related unmet clinical needs in the academic hospital setting.

Analytical quality goals-a review

Analytical quality goals indicate how laboratory tests must perform to be clinically useful for their intended purpose. These goals have historically focused on analytical error assessment for quantitative methods and vary with measurand concentration or activity, and species. Although formalized quality goal models have been developed in human medicine, quality goals in veterinary medicine, to date, have not been formalized; use of human regulatory-based goals, consensus-based goals, or biologic variation-based goals have been reported most often. This review provides an overview of how quality goals are derived, how these may be used, and highlights challenges. Pending formal recommendations, individual veterinary laboratories should select quality goals that make the most sense clinically, logistically, and financially based on their individual needs and the needs of the clients that they serve.

Proteomics in Chronic Arthritis-Will We Finally Have Useful Biomarkers?

PURPOSE OF REVIEW

Current technical advances enable the assessment of the complex changes in body fluid proteomes and thus allow for the discovery of biomarker signatures rather than just following differences of a single marker. In this review, we aim to summarize current approaches to discover and evaluate multi-biomarker panels for improved monitoring of chronic arthritis disease activity.

RECENT FINDINGS

Mass spectrometry and affinity proteomic methodologies have been used to identify biomarker panels in synovial fluid, serum, plasma, or urine of pediatric and adult chronic arthritis patients. Notably, despite the numerous efforts to develop new and better biomarker panels, very few have undergone extensive analytical and clinical validation and been adopted into routine use for patient benefit. There remains a significant gap between discovery of chronic arthritis biomarker signatures and their validation for clinical use.

Methods for the evaluation of biomarkers in patients with kidney and liver diseases: multicentre research programme including ELUCIDATE RCT

Background

Protein biomarkers with associations with the activity and outcomes of diseases are being identified by modern proteomic technologies. They may be simple, accessible, cheap and safe tests that can inform diagnosis, prognosis, treatment selection, monitoring of disease activity and therapy and may substitute for complex, invasive and expensive tests. However, their potential is not yet being realised.

Design and methods

The study consisted of three workstreams to create a framework for research: workstream 1, methodology – to define current practice and explore methodology innovations for biomarkers for monitoring disease; workstream 2, clinical translation – to create a framework of research practice, high-quality samples and related clinical data to evaluate the validity and clinical utility of protein biomarkers; and workstream 3, the ELF to Uncover Cirrhosis as an Indication for Diagnosis and Action for Treatable Event (ELUCIDATE) randomised controlled trial (RCT) – an exemplar RCT of an established test, the ADVIA Centaur® Enhanced Liver Fibrosis (ELF) test (Siemens Healthcare Diagnostics Ltd, Camberley, UK) [consisting of a panel of three markers – (1) serum hyaluronic acid, (2) amino-terminal propeptide of type III procollagen and (3) tissue inhibitor of metalloproteinase 1], for liver cirrhosis to determine its impact on diagnostic timing and the management of cirrhosis and the process of care and improving outcomes.

Results

The methodology workstream evaluated the quality of recommendations for using prostate-specific antigen to monitor patients, systematically reviewed RCTs of monitoring strategies and reviewed the monitoring biomarker literature and how monitoring can have an impact on outcomes. Simulation studies were conducted to evaluate monitoring and improve the merits of health care. The monitoring biomarker literature is modest and robust conclusions are infrequent. We recommend improvements in research practice. Patients strongly endorsed the need for robust and conclusive research in this area. The clinical translation workstream focused on analytical and clinical validity. Cohorts were established for renal cell carcinoma (RCC) and renal transplantation (RT), with samples and patient data from multiple centres, as a rapid-access resource to evaluate the validity of biomarkers. Candidate biomarkers for RCC and RT were identified from the literature and their quality was evaluated and selected biomarkers were prioritised. The duration of follow-up was a limitation but biomarkers were identified that may be taken forward for clinical utility. In the third workstream, the ELUCIDATE trial registered 1303 patients and randomised 878 patients out of a target of 1000. The trial started late and recruited slowly initially but ultimately recruited with good statistical power to answer the key questions. ELF monitoring altered the patient process of care and may show benefits from the early introduction of interventions with further follow-up. The ELUCIDATE trial was an ‘exemplar’ trial that has demonstrated the challenges of evaluating biomarker strategies in ‘end-to-end’ RCTs and will inform future study designs.

Conclusions

The limitations in the programme were principally that, during the collection and curation of the cohorts of patients with RCC and RT, the pace of discovery of new biomarkers in commercial and non-commercial research was slower than anticipated and so conclusive evaluations using the cohorts are few; however, access to the cohorts will be sustained for future new biomarkers. The ELUCIDATE trial was slow to start and recruit to, with a late surge of recruitment, and so final conclusions about the impact of the ELF test on long-term outcomes await further follow-up. The findings from the three workstreams were used to synthesise a strategy and framework for future biomarker evaluations incorporating innovations in study design, health economics and health informatics.

Trial registration

Current Controlled Trials ISRCTN74815110, UKCRN ID 9954 and UKCRN ID 11930.

Funding

This project was funded by the NIHR Programme Grants for Applied Research programme and will be published in full inProgramme Grants for Applied Research; Vol. 6, No. 3. See the NIHR Journals Library website for further project information.

Discordant prostate specific antigen test results despite WHO assay standardization

Introduction:

Total PSA (tPSA) and free PSA (fPSA) are the most commonly used biomarkers for early detection of prostate cancer. Despite standardization efforts, many available PSA assays may still produce discordant results. In the present study, we compared four PSA assays calibrated to the WHO standards 96/670 and 96/668 for tPSA and fPSA, respectively.

Methods:

Within the scope of the Prostate Cancer Early Detection Study Based on a ‘‘Baseline’’ PSA Value in Young Men (PROBASE), we tested tPSA and fPSA in serum samples from 50 patients in the four different PROBASE sites using four WHO-calibrated assays from Roche (Elecsys, Cobas), Beckman-Coulter (Access-II) and Siemens (ADVIA Centaur). The comparison was performed using the Passing–Bablok regression method.

Results:

Compared to Access, the median tPSA levels for Centaur, Elecsys, and Cobas were +3%, +11%–20%, and +17%–23%, respectively, while for median fPSA levels the differences for Centaur, Elecsys, and Cobas were +49%, +29%–31%, and +22%, respectively.

Discussion:

Despite all investigated assays being WHO-calibrated, the Elecsys and Cobas tPSA assays produced considerably higher results than the Access and Centaur assays. Differences in fPSA-recovery between all investigated assays were even more pronounced. When applying the tPSA cutoff of 3.1 μg/L recommended for WHO-calibrated assays, the use of higher calibrated assays may lead to unnecessary prostate biopsies. Conversely, if the historical threshold of 4 μg/L is applied when using WHO-calibrated assays, it could lead to falsely omitted prostate biopsies.

External Quality Assessment in Croatia: problems, challenges, and specific circumstances

In Croatian medical laboratories (ML), external quality assessment (EQA) has a long tradition of almost half of a century. At national level, EQA is provided by Croatian Centre for Quality Assessment in Laboratory Medicine (CROQALM) which is a part of Croatian Society of Medical Biochemistry and Laboratory Medicine.
This case study aimed to summarize the main challenges, which are set to CROQALM and their possible solutions.
CROQALM has 10 schemes, covering majority of analysis for which medical biochemistry laboratories in Croatia are authorized for, including pre-analytical and post-analytical phase of laboratory work. Assessment scheme has three exercises per year. One sample per scheme and exercise is distributed to participants depending on their application. All data transfer and evaluation of the results are done using web interface and statistical software for evaluation of quality in laboratory medicine.
Since CROQALM has relatively small number of participating laboratories (N = 197) with lot of different manufacturers of instruments used for analysis in all schemes, constant challenges are present in the evaluation of the results (commutability problems, statistical analysis etc.). Further, number of participating medical laboratories is even lower for highly specific parameters, which are in the scope of clinical laboratories only.
Despite the obstacles we are faced to, EQA at national level is useful tool regarding standardization and harmonization aspects in total testing process within the country. Furthermore, it gives participating laboratories recognition and proof for meeting expected quality criteria in the community they serve.

Pre-analytical and analytical aspects affecting clinical reliability of plasma glucose results

The measurement of plasma glucose (PG) plays a central role in recognizing disturbances in carbohydrate metabolism, with established decision limits that are globally accepted. This requires that PG results are reliable and unequivocally valid no matter where they are obtained. To control the pre-analytical variability of PG and prevent in vitro glycolysis, the use of citrate as rapidly effective glycolysis inhibitor has been proposed. However, the commercial availability of several tubes with studies showing different performance has created confusion among users. Moreover, and more importantly, studies have shown that tubes promptly inhibiting glycolysis give PG results that are significantly higher than tubes containing sodium fluoride only, used in the majority of studies generating the current PG cut-points, with a different clinical classification of subjects. From the analytical point of view, to be equivalent among different measuring systems, PG results should be traceable to a recognized higher-order reference via the implementation of an unbroken metrological hierarchy. In doing this, it is important that manufacturers of measuring systems consider the uncertainty accumulated through the different steps of the selected traceability chain. In particular, PG results should fulfil analytical performance specifications defined to fit the intended clinical application. Since PG has tight homeostatic control, its biological variability may be used to define these limits. Alternatively, given the central diagnostic role of the analyte, an outcome model showing the impact of analytical performance of test on clinical classifications of subjects can be used. Using these specifications, performance assessment studies employing commutable control materials with values assigned by reference procedure have shown that the quality of PG measurements is often far from desirable and that problems are exacerbated using point-of-care devices.

Analytical Bias Exceeding Desirable Quality Goal in 4 out of 5 Common Immunoassays: Results of a Native Single Serum Sample External Quality Assessment Program for Cobalamin, Folate, Ferritin, Thyroid-Stimulating Hormone, and Free T4 Analyses

BACKGROUND

We undertook this study to evaluate method differences for 5 components analyzed by immunoassays, to explore whether the use of method-dependent reference intervals may compensate for method differences, and to investigate commutability of external quality assessment (EQA) materials.

METHODS

Twenty fresh native single serum samples, a fresh native serum pool, Nordic Federation of Clinical Chemistry Reference Serum X (serum X) (serum pool), and 2 EQA materials were sent to 38 laboratories for measurement of cobalamin, folate, ferritin, free T4, and thyroid-stimulating hormone (TSH) by 5 different measurement procedures [Roche Cobas (n = 15), Roche Modular (n = 4), Abbott Architect (n = 8), Beckman Coulter Unicel (n = 2), and Siemens ADVIA Centaur (n = 9)]. The target value for each component was calculated based on the mean of method means or measured by a reference measurement procedure (free T4). Quality specifications were based on biological variation. Local reference intervals were reported from all laboratories.

RESULTS

Method differences that exceeded acceptable bias were found for all components except folate. Free T4 differences from the uncommonly used reference measurement procedure were large. Reference intervals differed between measurement procedures but also within 1 measurement procedure. The serum X material was commutable for all components and measurement procedures, whereas the EQA materials were noncommutable in 13 of 50 occasions (5 components, 5 methods, 2 EQA materials).

CONCLUSIONS

The bias between the measurement procedures was unacceptably large in 4/5 tested components. Traceability to reference materials as claimed by the manufacturers did not lead to acceptable harmonization. Adjustment of reference intervals in accordance with method differences and use of commutable EQA samples are not implemented commonly.