APS calculator: a data-driven tool for setting outcome-based analytical performance specifications for measurement uncertainty using specific clinical requirements and population data

OBJECTIVES

According to ISO 15189:2022, analytical performance specifications (APS) should relate to intended clinical use and impact on patient care. Therefore, we aimed to develop a web application for laboratory professionals to calculate APS based on a simulation of the impact of measurement uncertainty (MU) on the outcome using the chosen decision limits, agreement thresholds, and data of the population of interest.

METHODS

We developed the "APS Calculator" allowing users to upload and select data of concern, specify decision limits and agreement thresholds, and conduct simulations to determine APS for MU. The simulation involved categorizing original measurand concentrations, generating measured (simulated) results by introducing different degrees of MU, and recategorizing measured concentrations based on clinical decision limits and acceptable clinical misclassification rates. The agreements between original and simulated result categories were assessed, and values that met or exceeded user-specified agreement thresholds that set goals for the between-category agreement were considered acceptable. The application generates contour plots of agreement rates and corresponding MU values. We tested the application using National Health and Nutrition Examination Survey data, with decision limits from relevant guidelines.

RESULTS

We determined APS for MU of six measurands (blood total hemoglobin, plasma fasting glucose, serum total and high-density lipoprotein cholesterol, triglycerides, and total folate) to demonstrate the potential of the application to generate APS.

CONCLUSIONS

The developed data-driven web application offers a flexible tool for laboratory professionals to calculate APS for MU using their chosen decision limits and agreement thresholds, and the data of the population of interest.

ISO 15189 is a sufficient instrument to guarantee high-quality manufacture of laboratory developed tests for in-house-use conform requirements of the European In-Vitro-Diagnostics Regulation

The EU In-Vitro Diagnostic Device Regulation (IVDR) aims for transparent risk-and purpose-based validation of diagnostic devices, traceability of results to uniquely identified devices, and post-market surveillance. The IVDR regulates design, manufacture and putting into use of devices, but not medical services using these devices. In the absence of suitable commercial devices, the laboratory can resort to laboratory-developed tests (LDT) for in-house use. Documentary obligations (IVDR Art 5.5), the performance and safety specifications of ANNEX I, and development and manufacture under an ISO 15189-equivalent quality system apply. LDTs serve specific clinical needs, often for low volume niche applications, or correspond to the translational phase of new tests and treatments, often extremely relevant for patient care. As some commercial tests may disappear with the IVDR roll-out, many will require urgent LDT replacement. The workload will also depend on which modifications to commercial tests turns them into an LDT, and on how national legislators and competent authorities (CA) will handle new competences and responsibilities. We discuss appropriate interpretation of ISO 15189 to cover IVDR requirements. Selected cases illustrate LDT implementation covering medical needs with commensurate management of risk emanating from intended use and/or design of devices. Unintended collateral damage of the IVDR comprises loss of non-profitable niche applications, increases of costs and wasted resources, and migration of innovative research to more cost-efficient environments. Taking into account local specifics, the legislative framework should reduce the burden on and associated opportunity costs for the health care system, by making diligent use of existing frameworks.

An approach for determining allowable between reagent lot variation

Clinicians trust medical laboratories to provide reliable results on which they rely for clinical decisions. Laboratories fulfil their responsibility for accurate and consistent results by utilizing an arsenal of approaches, ranging from validation and verification experiments to daily quality control procedures. All these procedures verify, on different moments, that the results of a certain examination procedure have analytical performance characteristics (APC) that meet analytical performance specifications (APS) set for a particular intended use. The APC can in part be determined by estimating the measurement uncertainty component under conditions of within-laboratory precision (uRw), which comprises all components influencing the measurement uncertainty of random sources. To maintain the adequacy of their measurement procedures, laboratories need to distinguish aspects that are manageable vs. those that are not. One of the aspects that may influence uRw is the momentary significant bias caused by shifts in reagent and/or calibrator lots, which, when accepted or unnoticed, become a factor of the APC. In this paper, we postulate a model for allocating a part of allowable uRw to between-reagent lot variation, based on the need for long-term consistency of the measurement variability for that specific measurand. The allocation manages the ratio between short-term and long-term variation and indicates laboratories when to reject or correct certain variations due to reagent lots.

Effect of Expanded Hemodialysis with Theranova® in Patients with COVID-19

INTRODUCTION

Cytokine storm control is the main target for improving severe COVID-19 by using immunosuppressive treatment. Effective renal replacement therapy (RRT) could give us an advantage removing cytokines in patients with RRT requirements superimposed on COVID-19.

METHODS

This is a prospective observational study in COVID-19 patients who required hemodialysis (HD). Patients were assigned to online hemodiafiltration (OL-HDF) and expanded HD (HDx) according to Brescia group recommendations. We measured several cytokines, β2 microglobulin and albumin levels pre/post-dialysis and on 1st-2nd week. We compared levels among both techniques and control group (HD without COVID-19).

RESULTS

We included 26 patients: 18 with COVID-19 on RRT (5 of them had acute kidney injury [AKI]) and 8 controls. We confirm higher cytokine levels in COVID-19 patients than controls and even higher in patients with AKI than in those with chronic kidney disease. Most cytokines raised during HD session, except IL-10 and TNFα. IL-10 was eliminated by any dialysis technique, while clearance of TNFα was higher in the HDx group. HDx achieved a deeper normalization of cytokines and β2 microglobulin reduction. Mortality was higher in the OL-HDF group than the HDx group.

DISCUSSION

Not all cytokines behave equally along HD session. The following characteristics should be taken into account, such as intrinsic kinetic profile during a HD session. HDx seems to get better performance, probably due to the combination of different factors; however, we did not reach statistical significance due to the small sample size, dropout, and reduction of AKI incidence during the 2nd pandemic wave.

CONCLUSION

HDx appears to provide better clearance for TNFα and β2 microglobulin during HD session and associates lower mortality. We propose the HDx technique for COVID-19 patients with RRT requirements since it seems to be safe and more effective than OL-HDF. Further studies are still needed, but we hope that our preliminary data may help us in future pandemic waves of SARS-CoV-2 or other viruses still to come.

Improving the laboratory result release process in the light of ISO 15189:2012 standard

The ISO 15189:2012 standard section 5.9.1 requires laboratories to review results before release, considering quality control, previous results, and clinical information, if any, and to issue documented procedures about it. While laboratory result reporting is generally regarded as part of the post-analytical phase, the result release process requires a general view of the total examination process. Reviewing test results may follow with troubleshooting and test repetition, including reanalyzing an individual sample or resampling. A systematic understanding of the result release may help laboratory professionals carry out appropriate test repetition and ensure the plausibility of laboratory results. In this paper, we addressed the crucial steps in the result release process, including evaluation of sample quality, critical result notification, result reporting, and recommendations for the management of the result release, considering quality control alerts, instrument flags, warning messages, and interference indexes. Error detection tools and plausibility checks mentioned in the present paper can support the daily practice of results release.

IL-6 and Other Biomarkers associated with Poor Prognosis in a Cohort of Hospitalized Patients with COVID-19 in Madrid

Objectives:

There are several published works on the prognostic value of biomarkers in relation to the severity or fatal outcome of coronavirus disease 2019 (COVID-19). In Spain, the second European country in incidence of the disease at the time of data collection, there are few studies that include both laboratory parameters and clinical parameters. Our aim is to study the relationship of a wide series of biomarkers with admission to intensive care and death in a hospital in the Autonomous Community of Madrid (Spain), with special attention to IL-6 due to its role in the systemic inflammatory response associated with a worse prognosis of the disease.

Methods:

Data were collected from 546 hospitalized patients with COVID-19. All of them had IL-6 results, in addition to other biochemical and haematological parameters. The difference of the medians for the selected parameters between the groups (ICU vs non-ICU, dead vs survivors) was studied using a Mann-Whitney analysis. The independent variables that predicted death were studied using a Cox proportional hazard regression model.

Results:

Higher age and blood concentrations of ALT, creatinine, CK, cTnI, LDH, NT-proBNP, CRP, IL-6, leucocyte count and D-dimer together with lower blood concentrations of albumin and lymphocyte count were associated with mortality in univariate analysis. Age, LDH, IL-6 and lymphocyte count remained associated with death in multivariate analysis.

Conclusions:

Age, LDH, IL-6 and lymphocyte count, as independent predictors of death, could be used to establish more aggressive therapies in COVID-19 patients.

Comparison of three methods for determining anti-thyrotropin receptor antibodies (TRAb) for diagnosis of Graves' disease: a clinical validation

Objectives

Graves' disease is secondary to the presence of anti-thyrotropin receptor antibodies (TRAb), which stimulate thyroid hormones. TRab determination is crucial for etiological diagnosis. The objectives of this study were (i) to compare two methods for determining TRab by chemoluminiscence vs. standard TRACE-immunofluorescence; (ii) to determine the diagnostic validity of the three methods.

Methods

A retrospective study in 194 patients with a TRAb determination request. TRAb were determined by immunofluorescence (Kryptor, ThermoFisher) and chemiluminescence (Immulite, Siemens and Maglumi, Snibe). Clinical validation: medical records were reviewed and categorized according to thyroid function. Statistical analysis: Differences in quantitative variables were assessed by intraclass correlation coefficient, Bland-Altman plot, and mean differences (mD). Qualitative variables were dichotomized by cut-off points; Kappa coefficient was calculated. Correlations were evaluated by Pearson's coefficient and Passing-Bablok regression analysis. The diagnostic validity of the three methods was investigated.

Results

Kryptor-Immulite: mD: 1.2 (95%CI: -16 to >18). Passing-Bablok: Constant error (95%CI: -0.8349 to -0.5987). Proportional error (95%CI: 0.7862-1.0387). ICC: 0.86 (95%CI: 0.82-0.89). Kappa coefficient: 0.68 (95%CI 0.59-0.78). Kryptor-Maglumi: mD: -0.3 (95%CI: -12 to >12). Passing-Bablok: Constant error (95%CI: -0.7701 to >0.1621. Proportional error (95%CI: 0.8571 to 1.3179. ICC: 0.93 (95%CI: 0.89-0.97). Kappa coefficient: 0.53 (95%CI: 0.32-0.74). Diagnosis of Graves' disease was confirmed in 113 patients (Kryptorf showed better specificity and positive predictive value, whereas Immulite demonstrated better sensitivity and negative predictive value).

Conclusions

The three methods have a good diagnostic performance for Graves' disease, with superimposable results on Bland-Altman plot. Interchangeability was not confirmed on the regression and agreement analysis, with the presence of biases.