Choice of Statistical Tools for Outlier Removal Causes Substantial Changes in Analyte Reference Intervals in Healthy Populations

Predictive and prognostic value of different cardiac troponin assays: a nationwide register-based cohort study

AIMS

Guidelines do not differentiate between the available assays of cardiac troponin (cTn). We compared the prognostic and predictive ability of cTn assays.

METHODS AND RESULTS

This was a nationwide cohort study of patients with acute coronary syndrome (ACS) and ≥ 2 cTn measurements of one of four assays: Roche high-sensitivity cTnT (hs-cTnT), Abbott high sensitivity cTnI (hs-cTnI), Siemens Vista cTnI, and Siemens cTnI Ultra. Data were collected from Danish registries from 2009-18. Peak cTn concentration normalized to the 99th percentile was used. Outcomes were myocardial infarction (MI) during admission, one-year all-cause-, cardiovascular-, and non-cardiovascular mortality. Receiver operating characteristics and logistic regression calculating odds ratios (OR) were used. A total of 90 705 patients were included, of which 20 550 (23%) had MI. Siemens Vista cTnI was the strongest predictor of MI, Area under the curve (auc) 0.93 (95% CI 0.93-0.93). In 1 year 9012 (9.9%) of patients had died. An inverted U-shape relationship was observed between concentration of cTn and all-cause mortality. Hs-cTnT OR 21.3 (95% CI 18.4-24.8) at 2-5 times the 99th percentile and 12.1 (95% CI 10.3-14.1) for concentrations >100 times the 99th percentile. The inverted U-shape relationship was only present for non-cardiovascular mortality. The strongest predictor of cardiovascular mortality was hs-cTnT, OR 11.3 (95% CI 6.4-21.8) at 1-2 times the 99th percentile and 88.8 (95% CI 53.2-163.0) for concentrations >100 times the 99th percentile.

CONCLUSION

Siemens Vista cTnI was the strongest predictor of MI and hs-cTnT was the strongest predictor of mortality. An inverted U-shape relationship was observed between cTn concentration and non-cardiovascular mortality.

Current status and challenges in establishing reference intervals based on real-world data

Reference intervals (RIs) are the cornerstone for evaluation of test results in clinical practice and are invaluable in judging patient health and making clinical decisions. Establishing RIs based on clinical laboratory data is a branch of real-world data mining research. Compared to the traditional direct method, this indirect approach is highly practical, widely applicable, and low-cost. Improving the accuracy of RIs requires not only the collection of sufficient data and the use of correct statistical methods, but also proper stratification of heterogeneous subpopulations. This includes the establishment of age-specific RIs and taking into account other characteristics of reference individuals. Although there are many studies on establishing RIs by indirect methods, it is still very difficult for laboratories to select appropriate statistical methods due to the lack of formal guidelines. This review describes the application of real-world data and an approach for establishing indirect reference intervals (iRIs). We summarize the processes for establishing iRIs using real-world data and analyze the principle and applicable scope of the indirect method model in detail. Moreover, we compare different methods for constructing growth curves to establish age-specific RIs, in hopes of providing laboratories with a reference for establishing specific iRIs and giving new insight into clinical laboratory RI research. (201 words).

Effects of Using Different Indirect Techniques on the Calculation of Reference Intervals: Observational Study

BACKGROUND

Reference intervals (RIs) play an important role in clinical decision-making. However, due to the time, labor, and financial costs involved in establishing RIs using direct means, the use of indirect methods, based on big data previously obtained from clinical laboratories, is getting increasing attention. Different indirect techniques combined with different data transformation methods and outlier removal might cause differences in the calculation of RIs. However, there are few systematic evaluations of this.

OBJECTIVE

This study used data derived from direct methods as reference standards and evaluated the accuracy of combinations of different data transformation, outlier removal, and indirect techniques in establishing complete blood count (CBC) RIs for large-scale data.

METHODS

The CBC data of populations aged ≥18 years undergoing physical examination from January 2010 to December 2011 were retrieved from the First Affiliated Hospital of China Medical University in northern China. After exclusion of repeated individuals, we performed parametric, nonparametric, Hoffmann, Bhattacharya, and truncation points and Kolmogorov-Smirnov distance (kosmic) indirect methods, combined with log or BoxCox transformation, and Reed-Dixon, Tukey, and iterative mean (3SD) outlier removal methods in order to derive the RIs of 8 CBC parameters and compared the results with those directly and previously established. Furthermore, bias ratios (BRs) were calculated to assess which combination of indirect technique, data transformation pattern, and outlier removal method is preferrable.

RESULTS

Raw data showed that the degrees of skewness of the white blood cell (WBC) count, platelet (PLT) count, mean corpuscular hemoglobin (MCH), mean corpuscular hemoglobin concentration (MCHC), and mean corpuscular volume (MCV) were much more obvious than those of other CBC parameters. After log or BoxCox transformation combined with Tukey or iterative mean (3SD) processing, the distribution types of these data were close to Gaussian distribution. Tukey-based outlier removal yielded the maximum number of outliers. The lower-limit bias of WBC (male), PLT (male), hemoglobin (HGB; male), MCH (male/female), and MCV (female) was greater than that of the corresponding upper limit for more than half of 30 indirect methods. Computational indirect choices of CBC parameters for males and females were inconsistent. The RIs of MCHC established by the direct method for females were narrow. For this, the kosmic method was markedly superior, which contrasted with the RI calculation of CBC parameters with high |BR| qualification rates for males. Among the top 10 methodologies for the WBC count, PLT count, HGB, MCV, and MCHC with a high-BR qualification rate among males, the Bhattacharya, Hoffmann, and parametric methods were superior to the other 2 indirect methods.

CONCLUSIONS

Compared to results derived by the direct method, outlier removal methods and indirect techniques markedly influence the final RIs, whereas data transformation has negligible effects, except for obviously skewed data. Specifically, the outlier removal efficiency of Tukey and iterative mean (3SD) methods is almost equivalent. Furthermore, the choice of indirect techniques depends more on the characteristics of the studied analyte itself. This study provides scientific evidence for clinical laboratories to use their previous data sets to establish RIs.

NT-proBNP Reference Intervals in Healthy U.S. Children, Adolescents, and Adults

BACKGROUND

N-terminal pro-B-type natriuretic peptide (NT-proBNP) is a cardiac biomarker used in the clinical management of heart failure. We sought to create updated reference intervals for NT-proBNP for healthy US children, adolescents, and adults.

METHODS

We identified a population of healthy individuals using the 1999 to 2004 cycles of the National Health and Nutrition Examination Survey (NHANES). We measured serum NT-proBNP in 12 346 adults and 15 752 children and adolescents with the Elecsys NT-proBNP assay on the Roche e601 autoanalyzer. We compared 4 methods for reference interval calculation, and presented the final reference intervals using the robust method partitioned by age and sex categories.

RESULTS

NT-proBNP values were available for 1949 healthy adults and 5250 healthy children and adolescents. NT-proBNP concentrations in males and females varied according to age, being higher in early childhood, relatively lower in late adolescence, and highest through middle age and older age. Females tended to have higher NT-proBNP concentrations compared to men from late adolescence until middle age. The upper reference limit, or 97.5th percentile, for 50 to 59 year-old men was 225 ng/L (90% CI: 158 to 236), and for 50 to 59 year-old women, 292 ng/L (90% CI: 242 to 348).

CONCLUSIONS

Among healthy individuals, NT-proBNP concentrations varied greatly according age and sex. The reference intervals presented here should inform future clinical decision limits and suggest that age- and sex-specific intervals may be necessary to more precisely characterize risk.

Agreement of LC-MS assays for IGF-1 traceable to NIST and WHO standards permits harmonization of reference intervals between laboratories

OBJECTIVES

In this study, we aimed to determine the feasibility of transferring IGF-1 reference intervals between two liquid chromatography-mass spectrometry assays with distinct assay formats and calibration traceability.

DESIGN AND METHODS

To adopt a reference interval (RI) for our new assay we have conducted RI transference and verification studies according to the CLSI C28-A3 and EP9c guidelines. Specifically, the analytical agreement between the assays was evaluated using the linear model and the appropriateness of the linear model for RI transference was assessed using Deming regression, correlation coefficients, Q-Q plot, difference plot and studentized residues for the LC-MS/MS against DiaSorin LiaisonXL IGF-1 immunoassay and the liquid chromatography-high resolution mass spectrometry (LC-MS/HRMS) IGF-1 assay. Both Diasorin immunoassay and LC-MS/HRMS assays are traceable to WHO, 02/254.

RESULTS

Our study showed a strong correlation (R²>0.93) and agreement (slope=1.006, negligible intercept) between LC-MS/MS and LC-MS/HRMS regardless of their traceability and all statistical criteria were met per CLSI guidelines. Conversely, while the LC-MS/MS and Diasorin immunoassay results showed a strong correlation (R²>0.97, slope=1.055), they failed to meet all statistical criteria for RI transference due to the bias (-44.91) and non-normal distribution of the residues. The RI verification study showed that 95% of the local LC-MS results fell within the RIs transferred from the reference LC-MS method, thus meeting CLSI C28-A3 guidelines and permitting the transference of the reference LC-MS RIs.

CONCLUSIONS

Taken together, this study provides data to suggest excellent agreement between assays traceable to distinct reference standards for IGF-1.

Outliers in nutrient intake data for U.S. adults: national health and nutrition examination survey 2017-2018

Objectives

An important step in preparing data for statistical analysis is outlier detection and removal, yet no gold standard exists in current literature. The objective of this study is to identify the ideal decision test using the National Health and Nutrition Examination Survey (NHANES) 2017-2018 dietary data.

Methods

We conducted a secondary analysis of NHANES 24-h dietary recalls, considering the survey's multi-stage cluster design. Six outlier detection and removal strategies were assessed by evaluating the decision tests' impact on the Pearson's correlation coefficient among macronutrients. Furthermore, we assessed changes in the effect size estimates based on pre-defined sample sizes. The data were collected as part of the 2017-2018 24-h dietary recall among adult participants (N=4,893).

Results

Effect estimate changes for macronutrients varied from 6.5 % for protein to 39.3 % for alcohol across all decision tests. The largest proportion of outliers removed was 4.0 % in the large sample size, for the decision test, >2 standard deviations from the mean. The smallest sample size, particularly for alcohol analysis, was most affected by the six decision tests when compared to no decision test.

Conclusions

This study, the first to use 2017-2018 NHANES dietary data for outlier evaluation, emphasizes the importance of selecting an appropriate decision test considering factors such as statistical power, sample size, normality assumptions, the proportion of data removed, effect estimate changes, and the consistency of estimates across sample sizes. We recommend the use of non-parametric tests for non-normally distributed variables of interest.

RIbench: A Proposed Benchmark for the Standardized Evaluation of Indirect Methods for Reference Interval Estimation

BACKGROUND

Indirect methods leverage real-world data for the estimation of reference intervals. These constitute an active field of research, and several methods have been developed recently. So far, no standardized tool for evaluation and comparison of indirect methods exists.

METHODS

We provide RIbench, a benchmarking suite for quantitative evaluation of any existing or novel indirect method. The benchmark contains simulated test sets for 10 biomarkers mimicking routine measurements of a mixed distribution of non-pathological (reference) values and pathological values. The non-pathological distributions represent 4 common distribution types: normal, skewed, heavily skewed, and skewed-and-shifted. To identify strengths and weaknesses of indirect methods, test sets have varying sample sizes and pathological distributions differ in location, extent of overlap, and fraction. For performance evaluation, we use an overall benchmark score and sub-scores derived from absolute z-score deviations between estimated and true reference limits. We illustrate the application of RIbench by evaluating and comparing the Hoffmann method and 4 modern indirect methods -TML (Truncated-Maximum-Likelihood), kosmic, TMC (Truncated-Minimum-Chi-Square), and refineR- against one another and against a nonparametric direct method (n = 120).

RESULTS

For the modern indirect methods, pathological fraction and sample size had a strong influence on the results: With a pathological fraction up to 20% and a minimum sample size of 5000, most methods achieved results comparable or superior to the direct method.

CONCLUSIONS

We present RIbench, an open-source R-package, for the systematic evaluation of existing and novel indirect methods. RIbench can serve as a tool for enhancement of indirect methods, improving the estimation of reference intervals.

Abnormal Micronutrient Intake Is Associated with the Risk of Periodontitis: A Dose-response Association Study Based on NHANES 2009-2014

The association between micronutrient intake and the risk of periodontitis has received much attention in recent years. However, most studies focused on the linear relationship between them. This study aimed to explore the dose–response association between micronutrient intake and periodontitis. A total of 8959 participants who underwent a periodontal examination, and reported their micronutrient intake levels were derived from the US National Health and Nutrition Examination Survey (NHANES, 2009–2014) database. Logistic regression was performed to evaluate associations between micronutrient intake and periodontitis after propensity score matching (PSM), and restricted cubic splines (RCS) analysis was conducted to explore the dose–response associations. Following PSM, 5530 participants were included in the RCS analysis. The risk of periodontitis was reduced with sufficient intake of the following micronutrients: vitamin A, vitamin B1, vitamin B2, and vitamin E. In addition, the risk of periodontitis was increased with excessive intake of the following micronutrients: vitamin B1 (1.8 mg/day, males; 1.3 mg/day, females), vitamin C (90 mg/day, males), and copper (1.1 mg/day, combined). In conclusion, a linear association was found between vitamin A, vitamin B2, vitamin C, and copper and periodontitis—namely, a sufficient intake of vitamin A and vitamin B2 might help reduce the prevalence of periodontitis; by contrast, a high intake of vitamin C and copper increased the risk. In addition, a nonlinear dose–response association was found for the incidence of periodontitis with vitamin B1 and vitamin E. When within reasonable limits, supplemental intake helped reduce the prevalence of periodontitis, while excessive intake did not help significantly and might even increase the risk. However, confounding factors, such as health awareness, should still be considered.

Novel immunoprofiling method for diagnosing SLE and evaluating therapeutic response

Objective

Diagnosis of SLE is based on clinical manifestations but is heterogeneous in early onset. Hence, we aimed to evaluate the feature of the immunoprofiling in patients with SLE and apply it to develop an immune signature algorithm for supporting SLE diagnosis.

Methods

We enrolled 13 newly diagnosed patients with SLE and 9 healthy controls (HCs) followed by analysing their immunoprofilings within their peripheral blood mononuclear cells (PBMCs) through flow cytometry. The immunoprofiling from the patients with SLE and HCs were ranked and formed an immune signature score. Besides, we enrolled four patients with SLE and monitored the changes in their immunoprofilings after immunosuppressant treatment.

Results

Among 93 immune cell subsets, 29 differed significantly between patients with SLE and HCs, and lower dendritic and natural killer cell percentages and a higher CD8⁺ T-cell percentage were identified in patients with SLE. In an investigation of immune-tolerant-related cell subsets, higher concentrations of CD8⁺ regulatory natural killer T cells, programmed cell death 1 (PD-1)⁺ T cells, and lower concentrations of programmed cell death ligand 1 (PD-L1)⁺ PBMCs were observed in the SLE group. The immune signature score from patients with SLE was significantly different from that from the HCs. After treatment, the disease activity of the four patients were tended to stable and percentages of PD-L1⁺ monocytes, PD-1⁺ CD4 T and CD8 T cells in patients with SLE exhibited positively and negatively correlation with the SLEDAI-2K (Systemic Lupus Erythematosus Disease Activity Index 2000) score, which might associate with the remission of SLE.

Conclusions

The comparison of immunprofiling between patients with SLE and HCs exhibited a distinct pattern. This difference and its application to immune signature algorithm shed light on the studies of SLE pathogenesis and immune-based diagnostic tool development in the future.

Determination of 97.5th and 99th percentile upper reference limits for heart-type fatty acid-binding protein (H-FABP) in a US population

BACKGROUND

Heart-type fatty acid binding protein (H-FABP), a low molecular weight protein found primarily in myocardial tissue, has been identified as a potential biomarker in the detection of acute coronary syndrome and acute kidney injury. To further investigate clinical utility, we sought to establish an upper reference limit (URL) of H-FABP within a healthy U.S.

POPULATION

METHODS

Serum samples of healthy donors were acquired from the AACC Universal Sample Bank. We analyzed 355 samples for H-FABP concentration using the Randox Laboratories immunoturbidimetric assay on the Roche Cobas 8000 series analyzer.

RESULTS

The final sample population consisted of individuals aged 18-74 y, with 170 males and 185 females. The distribution of the population exhibited a strong positive skew, affecting outlier analysis and URL determination. The 97.5th-percentile URL was found to be 7.4 ng/ml (95% CI: 6.3-9.2), while the 99th-percentile URL was 12.1 ng/ml (8.6-14.9).

CONCLUSION

As the URL for H-FABP is highly affected by population distribution and outlier removal, final determination for an assay cutoff should be made in the context of clinical utility, either as a standalone assay or in conjunction with other biomarkers, and the desired clinical sensitivity and specificity.

Data mining of pediatric reference intervals

Laboratory tests are essential to assess the health status and to guide patient care in individuals of all ages. The interpretation of quantitative test results requires availability of appropriate reference intervals, and reference intervals in children have to account for the extensive physiological dynamics with age in many biomarkers. Creation of reference intervals using conventional approaches requires the sampling of healthy individuals, which is opposed by ethical and practical considerations in children, due to the need for a large number of blood samples from healthy children of all ages, including neonates and young infants. This limits the availability and quality of pediatric reference intervals, and ultimately negatively impacts pediatric clinical decision-making. Data mining approaches use laboratory test results and clinical information from hospital information systems to create reference intervals. The extensive number of available test results from laboratory information systems and advanced statistical methods enable the creation of pediatric reference intervals with an unprecedented age-related accuracy for children of all ages. Ongoing developments regarding the availability and standardization of electronic medical records and of indirect statistical methods will further improve the benefit of data mining for pediatric reference intervals.

High sensitivity troponin, analytical advantages, clinical benefits and clinical challenges - An update

The measurement of cardiac troponin (cTn) by a high sensitivity method now represents the standard method for cTn measurement in the laboratory. High sensitivity method are not measuring a novel form of troponin but have undergone methodological improvement in assay sensitivity to allow both very low level detection and repeat measurements at low levels with very low degrees of analytical imprecision. The methods identify additional patients with myocardial injury who would benefit from evidence-based interventions. Rapid predictive algorithms utilising measurement on admission as well as short sampling periods (1-2 h) allow much more rapid categorisation of patients to appropriate clinical pathways. The shift in the diagnosis from traditional "cardiac enzymes" to troponin based on the 99th percentile has accounted for the majority of the detection of myocardial injury in patients without acute coronary syndromes. These patients have a worse prognosis irrespective of the underlying cause of their hospital admission. The appropriate management strategy in this group, beyond managing the underlying problem, remains to be defined. Measurement of cTn in otherwise asymptomatic individuals may have a role for patient selection for preventive treatment or for patients monitoring. Clinical trials in this area are awaited.