1
|
Velev J, LeBien J, Roche-Lima A. Unsupervised machine learning method for indirect estimation of reference intervals for chronic kidney disease in the Puerto Rican population. Sci Rep 2023; 13:17198. [PMID: 37821500 PMCID: PMC10567761 DOI: 10.1038/s41598-023-43830-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Accepted: 09/28/2023] [Indexed: 10/13/2023] Open
Abstract
Reference intervals (RIs) for clinical laboratory values are extremely important for diagnostics and treatment of patients. However, the determination of these ranges is costly and time-consuming. As a result, often different unverified RIs are used in practice for the same analyte and the same range is used for all patients despite evidence that the values are gender, age, and ethnicity dependent. Moreover, the abnormal flags are rudimentary, merely indicating if a value is within the RI. At the same time, clinical lab data generated in the everyday medical practice contains a wealth of information, that given the correct methodology, can help determine the RIs for each specific segment of the population, including populations that suffer from health disparities. In this work, we develop unsupervised machine learning methods, based on Gaussian mixtures, to determine RIs of analytes related to chronic kidney disease, using millions of routine lab results for the Puerto Rican population. We show that the measures are both gender and age dependent and we find evidence for normal age-related organ function deterioration and failure. We also show that the joint distribution of measures improves the diagnostic value of the lab results.
Collapse
Affiliation(s)
- Julian Velev
- Department of Physics, University of Puerto Rico, San Juan, PR, 00925-2537, USA.
- Abartys Health, San Juan, PR, 00907-3913, USA.
| | - Jack LeBien
- Abartys Health, San Juan, PR, 00907-3913, USA
| | - Abiel Roche-Lima
- Center for Collaborative Research in Health Disparities - CCHRD, RCMI Program, Medical Science Campus, University of Puerto Rico, San Juan, PR, 00936-5067, USA
| |
Collapse
|
2
|
Bokulić A, Zec I, Marijančević D, Goreta S. Androgens in women: Establishing reference intervals for dehydroepiandrostenedione sulphate and androstenedione on the Roche Cobas. Biochem Med (Zagreb) 2023; 33:020706. [PMID: 37324111 PMCID: PMC10231767 DOI: 10.11613/bm.2023.020706] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/17/2023] Open
Abstract
Introduction Immunoassays are the most common method in routine practice for measuring androgens in women. Study's aim was to establish new population specific indirect reference intervals (RI) for dehydroepiandrostenedione sulphate (DHEAS) and for new androstenedione test available on automated Roche Cobas electrochemiluminescent immunoassay method. Materials and methods From extracted laboratory records, testosterone, sex hormone binding globulin and follicle-stimulating hormone were used as reference tests to exclude possibly diseased women. After the data selection steps, the study included 3500 subjects for DHEAS and 520 for androstenedione aged 20-45 years. To evaluate the need for age partitioning, we calculated standard deviation ratio and bias ratio. For each hormone, 90% and 95% RIs were calculated with appropriate statistical method. Results Total age group (20-45 years) 95% RIs were: 2.77-11.50 µmol/L for DHEAS and 2.48-8.89 nmol/L for androstenedione. Age-stratified 95% RIs for DHEAS were: 3.65-12.76 µmol/L (20-25 years); 2.97-11.50 µmol/L (25-35 years) and 2.30-9.83 µmol/L (35-45 years). Age-stratified 95% RIs for androstenedione were: 3.02-9.43 nmol/L (20-30 years) and 2.23-7.75 nmol/L (30-45 years). Conclusion New RIs for DHEAS were slightly wider for age group 20-25 and 35-45, while the differences in the age group 25-35 years were more pronounced. Androstenedione RI showed significantly higher concentrations than the manufacturer's. Age-related decrease of androgens should be considered when calculating RIs. We propose population specific, age-stratified RIs for DHEAS and androstenedione on electrochemiluminescent method, which should improve test interpretation in women of reproductive age.
Collapse
Affiliation(s)
| | - Ivana Zec
- Corresponding author: , Submitted: December 13, 2022 Accepted: May 5, 2023
| | | | | |
Collapse
|
3
|
Martinez-Sanchez L, Gabriel-Medina P, Villena-Ortiz Y, García-Fernández AE, Blanco-Grau A, Cobbaert CM, Bravo-Nieto D, Garriga-Edo S, Sanz-Gea C, Gonzalez-Silva G, López-Hellín J, Ferrer-Costa R, Casis E, Rodríguez-Frías F, den Elzen WPJ. Harmonization of indirect reference intervals calculation by the Bhattacharya method. Clin Chem Lab Med 2023; 61:266-274. [PMID: 36395007 DOI: 10.1515/cclm-2022-0439] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Accepted: 11/03/2022] [Indexed: 11/18/2022]
Abstract
OBJECTIVES The aim of this study was to harmonize the criteria for the Bhattacharya indirect method Microsoft Excel Spreadsheet for reference intervals calculation to reduce between-user variability and use these criteria to calculate and evaluate reference intervals for eight analytes in two different years. METHODS Anonymized laboratory test results from outpatients were extracted from January 1st 2018 to December 31st 2019. To assure data quality, we examined the monthly results from an external quality control program. Reference intervals were determined by the Bhattacharya method with the St Vincent's hospital Spreadsheet firstly using original criteria and then using additional harmonized criteria defined in this study. Consensus reference intervals using the additional harmonized criteria were calculated as the mean of four users' lower and upper reference interval results. To further test the operation criteria and robustness of the obtained reference intervals, an external user validated the Spreadsheet procedure. RESULTS The extracted test results for all selected laboratory tests fulfilled the quality criteria and were included in the present study. Differences between users in calculated reference intervals were frequent when using the Spreadsheet. Therefore, additional criteria for the Spreadsheet were proposed and applied by independent users, such as: to set central bin as the mean of all the data, bin size as small as possible, at least three consecutive bins and a high proportion of bins within the curve. CONCLUSIONS The proposed criteria contributed to the harmonization of reference interval calculation between users of the Bhattacharya indirect method Spreadsheet.
Collapse
Affiliation(s)
- Luisa Martinez-Sanchez
- Biochemistry Department, Clinical Laboratories, Vall d'Hebron University Hospital, Barcelona, Spain
- Departament de Bioquímica i Biologia Molecular, Universitat Autònoma de Barcelona, Bellaterra, Spain
- Department of Clinical Chemistry and Laboratory Medicine, Leiden University Medical Centre, Leiden, The Netherlands
- Clinical Biochemistry Research Team, Vall d'Hebron Institute of Research (VHIR), Barcelona, Spain
| | - Pablo Gabriel-Medina
- Biochemistry Department, Clinical Laboratories, Vall d'Hebron University Hospital, Barcelona, Spain
- Departament de Bioquímica i Biologia Molecular, Universitat Autònoma de Barcelona, Bellaterra, Spain
- Clinical Biochemistry Research Team, Vall d'Hebron Institute of Research (VHIR), Barcelona, Spain
| | - Yolanda Villena-Ortiz
- Biochemistry Department, Clinical Laboratories, Vall d'Hebron University Hospital, Barcelona, Spain
- Departament de Bioquímica i Biologia Molecular, Universitat Autònoma de Barcelona, Bellaterra, Spain
- Clinical Biochemistry Research Team, Vall d'Hebron Institute of Research (VHIR), Barcelona, Spain
| | - Alba E García-Fernández
- Biochemistry Department, Clinical Laboratories, Vall d'Hebron University Hospital, Barcelona, Spain
- Clinical Biochemistry Research Team, Vall d'Hebron Institute of Research (VHIR), Barcelona, Spain
| | - Albert Blanco-Grau
- Biochemistry Department, Clinical Laboratories, Vall d'Hebron University Hospital, Barcelona, Spain
- Departament de Bioquímica i Biologia Molecular, Universitat Autònoma de Barcelona, Bellaterra, Spain
- Clinical Biochemistry Research Team, Vall d'Hebron Institute of Research (VHIR), Barcelona, Spain
| | - Christa M Cobbaert
- Department of Clinical Chemistry and Laboratory Medicine, Leiden University Medical Centre, Leiden, The Netherlands
| | - Daniel Bravo-Nieto
- Biochemistry Department, Clinical Laboratories, Vall d'Hebron University Hospital, Barcelona, Spain
- Clinical Biochemistry Research Team, Vall d'Hebron Institute of Research (VHIR), Barcelona, Spain
| | - Sarai Garriga-Edo
- Biochemistry Department, Clinical Laboratories, Vall d'Hebron University Hospital, Barcelona, Spain
- Clinical Biochemistry Research Team, Vall d'Hebron Institute of Research (VHIR), Barcelona, Spain
| | - Clara Sanz-Gea
- Biochemistry Department, Clinical Laboratories, Vall d'Hebron University Hospital, Barcelona, Spain
- Clinical Biochemistry Research Team, Vall d'Hebron Institute of Research (VHIR), Barcelona, Spain
| | - Gonzalo Gonzalez-Silva
- Biochemistry Department, Clinical Laboratories, Vall d'Hebron University Hospital, Barcelona, Spain
- Clinical Biochemistry Research Team, Vall d'Hebron Institute of Research (VHIR), Barcelona, Spain
| | - Joan López-Hellín
- Biochemistry Department, Clinical Laboratories, Vall d'Hebron University Hospital, Barcelona, Spain
- Clinical Biochemistry Research Team, Vall d'Hebron Institute of Research (VHIR), Barcelona, Spain
| | - Roser Ferrer-Costa
- Biochemistry Department, Clinical Laboratories, Vall d'Hebron University Hospital, Barcelona, Spain
- Clinical Biochemistry Research Team, Vall d'Hebron Institute of Research (VHIR), Barcelona, Spain
| | - Ernesto Casis
- Clinical Laboratories, Vall d'Hebron University Hospital, Barcelona, Spain
| | - Francisco Rodríguez-Frías
- Biochemistry Department, Clinical Laboratories, Vall d'Hebron University Hospital, Barcelona, Spain
- Departament de Bioquímica i Biologia Molecular, Universitat Autònoma de Barcelona, Bellaterra, Spain
- Clinical Biochemistry Research Team, Vall d'Hebron Institute of Research (VHIR), Barcelona, Spain
| | - Wendy P J den Elzen
- Clinical Biochemistry Research Team, Vall d'Hebron Institute of Research (VHIR), Barcelona, Spain
- Department of Clinical Chemistry, Amsterdam UMC, University of Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| |
Collapse
|
5
|
Ammer T, Schützenmeister A, Prokosch HU, Zierk J, Rank CM, Rauh M. RIbench: A Proposed Benchmark for the Standardized Evaluation of Indirect Methods for Reference Interval Estimation. Clin Chem 2022; 68:1410-1424. [PMID: 36264679 DOI: 10.1093/clinchem/hvac142] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2022] [Accepted: 07/12/2022] [Indexed: 11/14/2022]
Abstract
BACKGROUND Indirect methods leverage real-world data for the estimation of reference intervals. These constitute an active field of research, and several methods have been developed recently. So far, no standardized tool for evaluation and comparison of indirect methods exists. METHODS We provide RIbench, a benchmarking suite for quantitative evaluation of any existing or novel indirect method. The benchmark contains simulated test sets for 10 biomarkers mimicking routine measurements of a mixed distribution of non-pathological (reference) values and pathological values. The non-pathological distributions represent 4 common distribution types: normal, skewed, heavily skewed, and skewed-and-shifted. To identify strengths and weaknesses of indirect methods, test sets have varying sample sizes and pathological distributions differ in location, extent of overlap, and fraction. For performance evaluation, we use an overall benchmark score and sub-scores derived from absolute z-score deviations between estimated and true reference limits. We illustrate the application of RIbench by evaluating and comparing the Hoffmann method and 4 modern indirect methods -TML (Truncated-Maximum-Likelihood), kosmic, TMC (Truncated-Minimum-Chi-Square), and refineR- against one another and against a nonparametric direct method (n = 120). RESULTS For the modern indirect methods, pathological fraction and sample size had a strong influence on the results: With a pathological fraction up to 20% and a minimum sample size of 5000, most methods achieved results comparable or superior to the direct method. CONCLUSIONS We present RIbench, an open-source R-package, for the systematic evaluation of existing and novel indirect methods. RIbench can serve as a tool for enhancement of indirect methods, improving the estimation of reference intervals.
Collapse
Affiliation(s)
- Tatjana Ammer
- Friedrich-Alexander-Universität Erlangen-Nürnberg, Chair of Medical Informatics, Erlangen, Germany.,Roche Diagnostics GmbH, Biostatistics & Data Science, Penzberg, Germany
| | | | - Hans-Ulrich Prokosch
- Friedrich-Alexander-Universität Erlangen-Nürnberg, Chair of Medical Informatics, Erlangen, Germany
| | - Jakob Zierk
- Universitätsklinikum Erlangen, Department of Pediatrics and Adolescent Medicine, Erlangen, Germany.,Universitätsklinikum Erlangen, Center of Medical Information and Communication Technology, Erlangen, Germany
| | | | - Manfred Rauh
- Universitätsklinikum Erlangen, Department of Pediatrics and Adolescent Medicine, Erlangen, Germany
| |
Collapse
|
6
|
Bracho FJ. Reference intervals of automated reticulocyte count and immature reticulocyte fraction in a pediatric population. Int J Lab Hematol 2021; 44:461-467. [PMID: 34859588 DOI: 10.1111/ijlh.13776] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2021] [Revised: 11/10/2021] [Accepted: 11/12/2021] [Indexed: 11/29/2022]
Abstract
INTRODUCTION Reticulocytes are erythroid precursors that develop into mature erythrocytes, and they are an important tool to assess erythropoietic activity, as their count indicates the balance between the cells released from the bone marrow, their stage of maturity, and their rate of development into mature erythrocytes. Considering the described biological variability of the absolute reticulocyte count (ARC) and the immature reticulocyte fraction (IRF) and the limited information available on these hematological parameters in children, this study determined the reference intervals (RIs) of these parameters in a healthy pediatric population. METHODS A retrospective, observational, and analytical study was designed to establish RIs for the ARC and the IRF according to age and sex. An indirect sampling method was applied to a mixed database of complete blood counts from children aged 2 months to 18 years, using the truncated maximum likelihood indirect method for reference interval estimation. Percentiles were calculated to obtain bimodal RIs. RESULTS From a total of 190,812 samples, 6,814 were selected. Gender stratification was not necessary for the ARC and the IRF but they required partitioning into six and two age groups, respectively. CONCLUSION This study determined, by an indirect sampling method, RIs for the ARC and the IRF in a pediatric population according to age and sex.
Collapse
|