Criteria for the use of omics-based predictors in clinical trials: explanation and elaboration

High-throughput 'omics' technologies that generate molecular profiles for biospecimens have been extensively used in preclinical studies to reveal molecular subtypes and elucidate the biological mechanisms of disease, and in retrospective studies on clinical specimens to develop mathematical models to predict clinical endpoints. Nevertheless, the translation of these technologies into clinical tests that are useful for guiding management decisions for patients has been relatively slow. It can be difficult to determine when the body of evidence for an omics-based test is sufficiently comprehensive and reliable to support claims that it is ready for clinical use, or even that it is ready for definitive evaluation in a clinical trial in which it may be used to direct patient therapy. Reasons for this difficulty include the exploratory and retrospective nature of many of these studies, the complexity of these assays and their application to clinical specimens, and the many potential pitfalls inherent in the development of mathematical predictor models from the very high-dimensional data generated by these omics technologies. Here we present a checklist of criteria to consider when evaluating the body of evidence supporting the clinical use of a predictor to guide patient therapy. Included are issues pertaining to specimen and assay requirements, the soundness of the process for developing predictor models, expectations regarding clinical study design and conduct, and attention to regulatory, ethical, and legal issues. The proposed checklist should serve as a useful guide to investigators preparing proposals for studies involving the use of omics-based tests. The US National Cancer Institute plans to refer to these guidelines for review of proposals for studies involving omics tests, and it is hoped that other sponsors will adopt the checklist as well.

Laboratory aspects of circulating α-Klotho

BACKGROUND

α-Klotho is a protein mainly produced in the kidney. Its circulating form has been suggested to link renal damage and distant tissue pathology. As three assays to measure α-Klotho became commercially available, we performed an evaluation of these commercially available Klotho assays.

METHODS

We studied within-run variation, between-run variation, matrix effects, linearity, and recovery of added recombinant human Klotho in the α-Klotho assays of IBL (IBL International GmbH, Hamburg, Germany), Cusabio (Cusabio Biotech, Wuhan, China) and USCN (USCN life Science, Inc., Wuhan, China) using both serum and ethylenediaminetetraacetic acid plasma.

RESULTS

Within run variation was 4, 13 and 32% for the IBL, Cusabio and USCN assay, respectively. Agreement between serum and EDTA plasma was good in the IBL assay, but poor in the USCN and Cusabio assays however improved after modifications in the Cusabio assay. Standardization and agreement between assays was poor.

CONCLUSIONS

The commercially available methods for the measurement of α-Klotho differ in quality. Some of the manufacturers should improve their assays in order to produce accurate results so that reliable conclusions can be drawn from studies in which these assays are used.

Generic Protocols for the Analytical Validation of Next-Generation Sequencing-Based ctDNA Assays: A Joint Consensus Recommendation of the BloodPAC's Analytical Variables Working Group

Liquid biopsy, particularly the analysis of circulating tumor DNA (ctDNA), has demonstrated considerable promise for numerous clinical intended uses. Successful validation and commercialization of novel ctDNA tests have the potential to improve the outcomes of patients with cancer. The goal of the Blood Profiling Atlas Consortium (BloodPAC) is to accelerate the development and validation of liquid biopsy assays that will be introduced into the clinic. To accomplish this goal, the BloodPAC conducts research in the following areas: Data Collection and Analysis within the BloodPAC Data Commons; Preanalytical Variables; Analytical Variables; Patient Context Variables; and Reimbursement. In this document, the BloodPAC's Analytical Variables Working Group (AV WG) attempts to define a set of generic analytical validation protocols tailored for ctDNA-based Next-Generation Sequencing (NGS) assays. Analytical validation of ctDNA assays poses several unique challenges that primarily arise from the fact that very few tumor-derived DNA molecules may be present in circulation relative to the amount of nontumor-derived cell-free DNA (cfDNA). These challenges include the exquisite level of sensitivity and specificity needed to detect ctDNA, the potential for false negatives in detecting these rare molecules, and the increased reliance on contrived samples to attain sufficient ctDNA for analytical validation. By addressing these unique challenges, the BloodPAC hopes to expedite sponsors' presubmission discussions with the Food and Drug Administration (FDA) with the protocols presented herein. By sharing best practices with the broader community, this work may also save the time and capacity of FDA reviewers through increased efficiency.

Analytic Validation of the Automated Bone Scan Index as an Imaging Biomarker to Standardize Quantitative Changes in Bone Scans of Patients with Metastatic Prostate Cancer

A reproducible and quantitative imaging biomarker is needed to standardize the evaluation of changes in bone scans of prostate cancer patients with skeletal metastasis. We performed a series of analytic validation studies to evaluate the performance of the automated bone scan index (BSI) as an imaging biomarker in patients with metastatic prostate cancer.

METHODS

Three separate analytic studies were performed to evaluate the accuracy, precision, and reproducibility of the automated BSI. Simulation study: bone scan simulations with predefined tumor burdens were created to assess accuracy and precision. Fifty bone scans were simulated with a tumor burden ranging from low to high disease confluence (0.10-13.0 BSI). A second group of 50 scans was divided into 5 subgroups, each containing 10 simulated bone scans, corresponding to BSI values of 0.5, 1.0, 3.0, 5.0, and 10.0. Repeat bone scan study: to assess the reproducibility in a routine clinical setting, 2 repeat bone scans were obtained from metastatic prostate cancer patients after a single 600-MBq (99m)Tc-methylene diphosphonate injection. Follow-up bone scan study: 2 follow-up bone scans of metastatic prostate cancer patients were analyzed to determine the interobserver variability between the automated BSIs and the visual interpretations in assessing changes. The automated BSI was generated using the upgraded EXINI bone(BSI) software (version 2). The results were evaluated using linear regression, Pearson correlation, Cohen κ measurement, coefficient of variation, and SD.

RESULTS

Linearity of the automated BSI interpretations in the range of 0.10-13.0 was confirmed, and Pearson correlation was observed at 0.995 (n = 50; 95% confidence interval, 0.99-0.99; P < 0.0001). The mean coefficient of variation was less than 20%. The mean BSI difference between the 2 repeat bone scans of 35 patients was 0.05 (SD = 0.15), with an upper confidence limit of 0.30. The interobserver agreement in the automated BSI interpretations was more consistent (κ = 0.96, P < 0.0001) than the qualitative visual assessment of the changes (κ = 0.70, P < 0.0001) was in the bone scans of 173 patients.

CONCLUSION

The automated BSI provides a consistent imaging biomarker capable of standardizing quantitative changes in the bone scans of patients with metastatic prostate cancer.

Validation of a Commercially Available Enzyme ImmunoAssay for the Determination of Oxytocin in Plasma Samples from Seven Domestic Animal Species

The neurohormone oxytocin (OT) has a broad range of behavioral effects in mammals. It modulates a multitude of social behaviors, e.g., affiliative and sexual interactions. Consequently, the OT role in various animal species is increasingly explored. However, several issues have been raised regarding the peripheral OT measurement. Indeed, various methods have been described, leading to assay discrepancies and inconsistent results. This highlights the need for a recognized and reliable method to measure peripheral OT. Our aim was to validate a method combining a pre-extraction step, previously demonstrated as essential by several authors, and a commercially available enzyme immunoassay (EIA) for OT measurement, using plasma from seven domestic species (cat, dog, horse, cow, pig, sheep, and goat). The Oxytocin EIA kit (EnzoLifeSciences) was used to assay the solid-phase extracted samples following the manufacturer's instructions with slight modifications. For all species except dogs and cats, concentration factors were applied to work above the kit's sensitivity (15 pg/ml). To validate the method, the following performance characteristics were evaluated using Validation Samples (VS) at various concentrations in each species: extraction efficiency via spiking tests and intra- and inter-assay precision, allowing for the calculation of total errors. Parallelism studies to assess matrix effects could not be performed because of too low basal concentrations. Quantification ranges and associated precision profiles were established to account for the various OT plasma concentrations in each species. According to guidelines for bioanalytical validation of immunoassays, the measurements were sufficiently precise and accurate in each species to achieve a total error ≤30% in each VS sample. In each species, the inter-assay precision after 3 runs was acceptable, except in low concentration samples. The linearity under dilution of dogs and cats' samples was verified. Although matrix effects assessments are lacking, our results indicate that OT plasma levels can reliably be measured in several domestic animal species by the method described here. Studies involving samples with low OT plasma concentrations should pay attention to reproducibility issues. This work opens new perspectives to reliably study peripheral OT in a substantial number of domestic animal species in various behavioral contexts.

Biomarkers in early-phase trials: fundamental issues

Biomarkers are frequently being included in early-phase clinical trials. This article is meant to introduce clinical investigators to the fundamentals of choosing a biomarker test for use in an early phase trial. Steps to consider are briefly outlined including defining the role of the biomarker in the early phase trial; selecting a fit-for-purpose biomarker test and laboratory; describing the test procedures; carrying out analytical validation testing appropriate for the research objectives and the risk involved in the trial; implementing the test in the trial; and planning for the future. Examples illustrate analytical validation approaches in the context of typical biomarker roles. The importance of collaboration between clinical investigators and laboratory researchers is emphasized.

Clinical application of a cancer genomic profiling assay to guide precision medicine decisions

Aim:

Develop and apply a comprehensive and accurate next-generation sequencing based assay to help clinicians to match oncology patients to therapies.

Materials & methods:

The performance of the CANCERPLEX^® assay was assessed using DNA from well-characterized routine clinical formalin-fixed paraffin-embedded (FFPE) specimens and cell lines.

Results:

The maximum sensitivity of the assay is 99.5% and its accuracy is virtually 100% for detecting somatic alterations with an allele fraction of as low as 10%. Clinically actionable variants were identified in 93% of patients (930 of 1000) who underwent testing.

Conclusion:

The test's capacity to determine all of the critical genetic changes, tumor mutation burden, microsatellite instability status and viral associations has important ramifications on clinical decision support strategies, including identification of patients who are likely to benefit from immune checkpoint blockage therapies.

The analytical validation of the Oncotype DX Recurrence Score assay

In vitro diagnostic multivariate index assays are highly complex molecular assays that can provide clinically actionable information regarding the underlying tumour biology and facilitate personalised treatment. These assays are only useful in clinical practice if all of the following are established: analytical validation (i.e., how accurately/reliably the assay measures the molecular characteristics), clinical validation (i.e., how consistently/accurately the test detects/predicts the outcomes of interest), and clinical utility (i.e., how likely the test is to significantly improve patient outcomes). In considering the use of these assays, clinicians often focus primarily on the clinical validity/utility; however, the analytical validity of an assay (e.g., its accuracy, reproducibility, and standardisation) should also be evaluated and carefully considered. This review focuses on the rigorous analytical validation and performance of the Oncotype DX^® Breast Cancer Assay, which is performed at the Central Clinical Reference Laboratory of Genomic Health, Inc. The assay process includes tumour tissue enrichment (if needed), RNA extraction, gene expression quantitation (using a gene panel consisting of 16 cancer genes plus 5 reference genes and quantitative real-time RT-PCR), and an automated computer algorithm to produce a Recurrence Score^® result (scale: 0–100). This review presents evidence showing that the Recurrence Score result reported for each patient falls within a tight clinically relevant confidence interval. Specifically, the review discusses how the development of the assay was designed to optimise assay performance, presents data supporting its analytical validity, and describes the quality control and assurance programmes that ensure optimal test performance over time.

Validation and Clinical Applications of a Comprehensive Next Generation Sequencing System for Molecular Characterization of Solid Cancer Tissues

Identification of somatic molecular alterations in primary and metastatic solid tumor specimens can provide critical information regarding tumor biology and its heterogeneity, and enables the detection of molecular markers for clinical personalized treatment assignment. However, the optimal methods and target genes for clinical use are still being in development. Toward this end, we validated a targeted amplification-based NGS panel (Oncomine comprehensive assay v1) on a personal genome machine sequencer for molecular profiling of solid tumors. This panel covers 143 genes, and requires low amounts of DNA (20 ng) and RNA (10 ng). We used 27 FFPE tissue specimens, 10 cell lines, and 24 commercial reference materials to evaluate the performance characteristics of this assay. We also evaluated the performance of the assay on 26 OCT-embedded fresh frozen specimens (OEFF). The assay was found to be highly specific (>99%) and sensitive (>99%), with low false-positive and false-negative rates for single-nucleotide variants, indels, copy number alterations, and gene fusions. Our results indicate that this is a reliable method to determine molecular alterations in both fixed and fresh frozen solid tumor samples, including core needle biopsies.

High-throughput fetal fraction amplification increases analytical performance of noninvasive prenatal screening

Purpose

The percentage of a maternal cell-free DNA (cfDNA) sample that is fetal-derived (the fetal fraction; FF) is a key driver of the sensitivity and specificity of noninvasive prenatal screening (NIPS). On certain NIPS platforms, >20% of women with high body mass index (and >5% overall) receive a test failure due to low FF (<4%).

Methods

A scalable fetal fraction amplification (FFA) technology was analytically validated on 1264 samples undergoing whole-genome sequencing (WGS)–based NIPS. All samples were tested with and without FFA.

Results

Zero samples had FF < 4% when screened with FFA, whereas 1 in 25 of these same patients had FF < 4% without FFA. The average increase in FF was 3.9-fold for samples with low FF (2.3-fold overall) and 99.8% had higher FF with FFA. For all abnormalities screened on NIPS, z-scores increased 2.2-fold on average in positive samples and remained unchanged in negative samples, powering an increase in NIPS sensitivity and specificity.

Conclusion

FFA transforms low-FF samples into high-FF samples. By combining FFA with WGS–based NIPS, a single round of NIPS can provide nearly all women with confident results about the broad range of potential fetal chromosomal abnormalities across the genome.

Analytical validation of a multi-protein, serum-based assay for disease activity assessments in multiple sclerosis

PURPOSE

To characterize and analytically validate the MSDA Test, a multi-protein, serum-based biomarker assay developed using Olink^® PEA methodology.

EXPERIMENTAL DESIGN

Two lots of the MSDA Test panel were manufactured and subjected to a comprehensive analytical characterization and validation protocol to detect biomarkers present in the serum of patients with multiple sclerosis (MS). Biomarker concentrations were incorporated into a final algorithm used for calculating four Disease Pathway scores (Immunomodulation, Neuroinflammation, Myelin Biology, and Neuroaxonal Integrity) and an overall Disease Activity score.

RESULTS

Analytical characterization demonstrated that the multi-protein panel satisfied the criteria necessary for a fit-for-purpose validation considering the assay's intended clinical use. This panel met acceptability criteria for 18 biomarkers included in the final algorithm out of 21 biomarkers evaluated. VCAN was omitted based on factors outside of analytical validation; COL4A1 and GH were excluded based on imprecision and diurnal variability, respectively. Performance of the four Disease Pathway and overall Disease Activity scores met the established acceptability criteria.

CONCLUSIONS AND CLINICAL RELEVANCE

Analytical validation of this multi-protein, serum-based assay is the first step in establishing its potential utility as a quantitative, minimally invasive, and scalable biomarker panel to enhance the standard of care for patients with MS.

Validation and Implementation of a Highly Sensitive and Efficient Newborn Screening Assay for Mucopolysaccharidosis Type II

Mucopolysaccharidosis Type II (MPS II), also known as Hunter syndrome, is a lysosomal storage disorder (LSD) caused by a deficiency of the lysosomal enzyme iduronate-2-sulfatase (IDS). MPS II satisfies all criteria defined by the Advisory Committee on Heritable Disorders in Newborns and Children (ACHDNC) for inclusion in the Recommended Uniform Screening Panel (RUSP) for newborn screening, apart from the fact that only minimal prospective population screening data are available. This report details the analytical validation, clinical validation, and implementation of a fluorometric assay for measurement of IDS activity in newborn dried blood spot (DBS) specimens at the Missouri State Public Health Laboratory (MSPHL). The assay is performed in a microwell plate format requiring approximately 15 min of hands-on time per plate and an incubation time of two hours. The analytical validation of this assay included linearity, analytical sensitivity, precision, and carry-over testing. Clinical validation was completed using more than 5000 deidentified presumptive normal newborn DBS specimens as well as seven specimens from patients known to be affected with MPS II. Following validation, MSPHL began prospective screening using the IDS assay on 1 November 2018. In the first 18 months of screening (to 30 June 2020), 146,954 specimens were prospectively screened using the method. Two newborns were identified with severe Hunter syndrome and the assay had a presumptive positive rate of 0.022%.

Analytical validation of the CellMax platform for early detection of cancer by enumeration of rare circulating tumor cells

The CellMax (CMx®) platform was developed to enrich for epithelial circulating tumor cells (CTCs) in the whole blood. This report provides assay performance data, including accuracy, linearity, limit of blank, limit of detection (LOD), specificity, and precision of enumeration of cancer cell line cells (CLCs) spiked in cell culture medium or healthy donor blood samples. Additionally, assay specificity was demonstrated in 32 young healthy donors and clinical feasibility was demonstrated in a cohort of 47 subjects consisting of healthy donors and patients who were colonoscopy verified to have colorectal cancer, adenomas, or a negative result. The CMx platform demonstrated high accuracy, linearity, and sensitivity for the enumeration of all CLC concentrations tested, including the extremely low range of 1 to 10 cells in 2 mL of blood, which is most relevant for early cancer detection. Theoretically, the assay LOD is 0.71 CTCs in 2 mL of blood. The analytical specificity was 100% demonstrated using 32 young healthy donor samples. We also demonstrated precision across multiple days and multiple operators, with good reproducibility of recovery efficiency. In a clinical feasibility study, the CMx platform identified 8 of 10 diseased subjects as positive (80% clinical sensitivity) and 4 of 5 controls as negative (80% clinical specificity). We also compared processing time and transportation effects for similar blood samples from two different sites and assessed an artificial intelligence-based counting method. Finally, unlike other platforms for which captured CTCs are retained on ferromagnetic beads or tethered to the slide surface, the CMx platform's unique airfoam-enabled release of CTCs allows captured cells to be transferred from a microfluidic chip to an Eppendorf tube, enabling a seamless transition to downstream applications such as genetic analyses and live cell manipulations.

Analytical validation of an automated assay for the measurement of adenosine deaminase (ADA) and its isoenzymes in saliva and a pilot evaluation of their changes in patients with SARS-CoV-2 infection

OBJECTIVES

The aim of the present study was to validate a commercially available automated assay for the measurement of total adenosine deaminase (tADA) and its isoenzymes (ADA1 and ADA2) in saliva in a fast and accurate way, and evaluate the possible changes of these analytes in individuals with SARS-CoV-2 infection.

METHODS

The validation, in addition to the evaluation of precision and accuracy, included the analysis of the effects of the main procedures that are currently being used for SARS-CoV-2 inactivation in saliva and a pilot study to evaluate the possible changes in salivary tADA and isoenzymes in individuals infected with SARS-CoV-2.

RESULTS

The automated assay proved to be accurate and precise, with intra- and inter-assay coefficients of variation below 8.2%, linearity under dilution linear regression with R² close to 1, and recovery percentage between 80 and 120% in all cases. This assay was affected when the sample is treated with heat or SDS for virus inactivation but tolerated Triton X-100 and NP-40. Individuals with SARS-CoV-2 infection (n=71) and who recovered from infection (n=11) had higher mean values of activity of tADA and its isoenzymes than healthy individuals (n=35).

CONCLUSIONS

tADA and its isoenzymes ADA1 and ADA2 can be measured accurately and precisely in saliva samples in a rapid, economical, and reproducible way and can be analyzed after chemical inactivation with Triton X-100 and NP-40. Besides, the changes observed in tADA and isoenzymes in individuals with COVID-19 open the possibility of their potential use as non-invasive biomarkers in this disease.

Analytical validation of a 12-gene molecular test for the prediction of distant recurrence in breast cancer

Aim:

To validate the analytical performance of a 12-gene molecular assay that predicts distant recurrence for early-stage ER+/HER2- invasive breast cancer as run within a central reference laboratory.

Materials & methods:

Formalin-fixed paraffin-embedded breast resections were evaluated by quantitative reverse transcription polymerase chain reaction for the expression of eight target genes, three housekeeper genes and one control gene to assess for DNA contamination.

Results:

The assay results were highly correlated with a validated reference laboratory. The assay had a broad linear range for input RNA, with similar amplicon efficiencies for target and housekeeper genes. The assay test was highly reproducible, with comparable inter- and intrabatch precision to the reference laboratory.

Conclusion:

These studies demonstrate that the 12-gene molecular assay is highly robust and accurate.

Several tests have been developed to aid in breast cancer treatment decisions by assessing the likelihood that an individual’s breast cancer will recur. One such test is a 12-gene molecular assay. This test provides a clinical score that combines molecular information from genes within the tumor with clinical information to determine whether a breast cancer is at high or low risk of recurrence. The data presented here show that this test is very reproducible and robust, making it appropriate and reliable for clinical use.

Improvement and validation of d-xylose determination in urine and serum as a new tool for the noninvasive evaluation of lactase activity in humans

BACKGROUND

The phloroglucinol assay is the current method for d-xylose determination in urine/plasma/serum. However, its sensitivity is limited when low amounts of d-xylose are to be measured, such as in the noninvasive evaluation of intestinal lactase with 4-galactosylxylose (gaxilose). An improved assay was therefore needed.

METHODS

We developed and validated a modified version of the phloroglucinol-based assay for quantification of d-xylose in urine/serum samples. A method for gaxilose determination by gas chromatography (GC) was also optimized.

RESULTS

Linearity ranged from 0.125 to 5.0 mg/l (5-200 mg/l in original sample). Accuracy at LOQ (0.125 mg/l) was 0.97/2.49% in spiked urine/serum; for other quality controls (QC), it was <1.27%. Intra- and interassay precision at LOQ were 6.02% and 6.45% for urine, and 8.86% and 10.00%, respectively, for serum; for other QC, precision was <2.15%. Linearity of gaxilose determination by GC was 3.90-195.17 for urine and 9.75-195.17 mg/l for serum with acceptable sensitivity and reproducibility. The method proved adequate for the d-xylose determination in healthy and hypolactasic subjects after oral administration of gaxilose.

CONCLUSIONS

The modified method provides high sensitivity and robustness for d-xylose quantification in urine/serum for routine clinical use especially in the noninvasive diagnosis of intestinal lactase deficiency with the gaxilose test.

Liquid Biopsy Hotspot Variant Assays: Analytical Validation for Application in Residual Disease Detection and Treatment Monitoring

BACKGROUND

Analysis of circulating tumor DNA (ctDNA) in plasma is a powerful approach to guide decisions in personalized cancer treatment. Given the low concentration of ctDNA in plasma, highly sensitive methods are required to reliably identify clinically relevant variants.

METHODS

We evaluated the suitability of 5 droplet digital PCR (ddPCR) assays targeting KRAS, BRAF, and EGFR variants for ctDNA analysis in clinical use.

RESULTS

We investigated assay performance characteristics for very low amounts of variants, showing that the assays had very low limits of blank (0% to 0.11% variant allele frequency, VAF) and limits of quantification (0.41% to 0.7% VAF). Nevertheless, striking differences in detection and quantification of low mutant VAFs between the 5 tested assays were observed, highlighting the need for assay-specific analytical validation. Besides in-depth evaluation, a guide for clinical interpretation of obtained VAFs in plasma was developed, depending on the limits of blank and limits of quantification values.

CONCLUSION

It is possible to provide comprehensive clinical reports on actionable variants, allowing minimal residual disease detection and treatment monitoring in liquid biopsy.

Analytical validation of a novel multi-target blood-based test to detect hepatocellular carcinoma

INTRODUCTION

Surveillance is essential to diagnose and more effectively treat hepatocellular carcinoma (HCC) in at-risk patients. However, the performance of currently recommended surveillance strategies is suboptimal, particularly for early-stage detection, and patient adherence remains low. Here, we establish the analytical performance of a novel liquid biopsy test to evaluate the presence of HCC.

METHODS

The multi-target HCC blood test (mt-HBT) integrates results from three DNA methylation markers (HOXA1, TSPYL5, and B3GALT6), the protein biomarker α-fetoprotein (AFP), and patient sex. The methylation markers are quantified from cell-free DNA extracted from plasma, and AFP is measured from serum. We conducted analytical validation studies on the mt-HBT, including analytical sensitivity, linearity, cross-contamination, interference, analytical accuracy, and precision.

RESULTS

The mt-HBT performance met all pre-specified analytical performance criteria. The test demonstrated high reproducibility, with ≥97% concordance relative to the expected results for six categories of surrogate samples across the test's dynamic range. Of 17 candidate interfering substances, none caused significant interference to biomarker quantitation, and no occurrences of sample-to-sample cross-contamination were observed.

CONCLUSION

These data demonstrate that the mt-HBT can produce consistent, reliable results for patients in the intended-use population, for whom surveillance is recommended.

Analytical evaluation of the Nittobo Medical tartrate resistant acid phosphatase isoform 5b (TRACP-5b) EIA and comparison with IDS iSYS in different clinically defined populations

OBJECTIVES

Tartrate-resistant acid phosphatase, isoform 5b (TRACP-5b) is a bone resorption marker not influenced by renal function or food intake. TRACP-5b can be measured with Nittobo Medical enzymatic-immunoassay and IDS-iSYS automated immunoassay. We evaluated the Nittobo assay and established reference ranges for a Western-European population. We compared Nittobo and IDS results in different well-defined clinical populations.

METHODS

We established the limits of detection and quantification (LOD-LOQ), linearity, imprecision and the reference ranges in 119 males, 50 women (<45 years) and 120 women (>60 years) for TRACP-5b with the Nittobo assay. We compared both assays in 30 hemodialyzed (HD), and 40 stage 3-5 patients suffering from chronic kidney disease (CKD), 40 patients suffering from rheumatoid arthritis and osteoporosis and 80 post-menopausal women. We measured TRACP-5b, β-crosslaps (β-CTX), bone alkaline phosphatase (B-ALP) and PTH in 20 hemodialyzed (HD) and 40 CKD patients.

RESULTS

LOD and LOQ were 0.02 and 0.35 U/L. CV ranged from 8.3 to 4.3% (2/5 samples presenting CV > desirable CV). Method was linear up to of 11.3 U/L. Upper and lower limits of normality were 0.8-7.6 U/L in men, 0.9-4.7 U/L in women <45 and 0.9-7.1 U/L in women >60. The regression equation between the 2 methods was Nittobo = 1.13 (95% CI: 1.09-1.16) × iSYS - 0.4 (95% CI: -0.5; -0.3). TRACP-5b and b-ALP were in their respective reference ranges for most of CKD and HD patients. That was not the case for β-CTX, which increased with decreasing eGFR.

CONCLUSIONS

Nittobo TRACP-5b presents interesting analytical features and a good concordance with IDS iSYS. These methods could thus potentially be harmonized.

Validation of a commercial enzyme immunoassay to assess urinary oxytocin in humans

Within the last decade, oxytocin (OT) has attracted a lot of attention in the context of various human social behaviors. Besides its importance in regulating physiological processes in females related to giving birth and lactation, OT is involved in the establishment and maintenance of social relationships, trust and emotion recognition. However, results are not always consistent across studies, which may partly be due to the incomplete validation of methods used to assess OT levels. Carefully validating a method before its use is of crucial importance to ensure that it can be used to accurately, reliably and repeatedly assess OT levels. With this study we evaluated a commercially available Enzyme Immunoassay to assess OT in human urine samples by conducting a careful analytical validation. Results indicate that, with regard to parallelism and immunoreactivity, human urinary OT can be assessed reliably. However, extraction methods need further improvement to optimize measures of accuracy and extraction efficiency, especially in the lower range of the assay system. Tests on OT stability indicate that OT is affected by degradation when stored at 4°C or room temperature. Storing urine samples over longer periods revealed that OT levels are most stable when stored as ethanol extracts at -20°C compared to being stored as samples at -20°C or -80°C. Although some of the validated parameters did not reach the intended quality criteria, this study highlights the importance of such in depth validation procedures and reporting results to make them available to researchers embarking on projects utilizing such methods.

Analytical validation of hepatitis B core-related antigen (HBcrAg) using dried blood spots (DBS)

Limited access to nucleic acid testing (NAT) to quantify HBV DNA levels, an essential tool to determine anti-HBV treatment eligibility, represents a significant barrier to scale up HBV diagnostic services in resource-limited countries. Hepatitis B core-related antigen (HBcrAg) has the potential to become an affordable alternative because of its low cost (US$ <15/assay) and strong correlation with HBV DNA levels in treatment-naïve patients. However, the current assay requires plasma or serum. To further facilitate its application to decentralized settings, we developed and evaluated a standardized procedure to quantify HBcrAg using dried blood spots as a tool to diagnose HBV-infected people with high viraemia. We evaluated the following elution method optimized to quantify HBcrAg: suspension of a punched blood-soaked disc (11 mm) of Whatman 903 Protein Saver Card in 450 µL of PBS 0.05% Tween 20, followed by an incubation for 4 h at room temperature and a centrifugation at 10,000 g for 10 minutes. 150 µL of DBS eluate was used to quantify HBcrAg using chemiluminescent enzyme immunoassay (LUMIPULSE^® G600II, Fujirebio). The limit of detection of dried blood spot HBcrAg in relation with HBV DNA levels was 19,115 IU/mL across the five major HBV genotypes (A/B/C/D/E). A strong linear correlation was confirmed between dried blood spot HBcrAg and HBV DNA levels (r = 0.94, p < 0.0001) in samples with high viral loads (range: 3.7-7.0 log IU/mL). The coefficient of variation ranged between 4.0-11.2% for repeatability and 3.9-12.2% for reproducibility. Analytical specificity was 100% (95% CI: 83.9-100%) in HBV-negative samples. Using our elution method, it may be possible to identify HBV-infected patients with high viraemia who need antiviral therapy using dried blood spot and HBcrAg. A large-scale clinical validation is warranted in resource-limited countries.

Analytical Validation of HEARTBiT: A Blood-Based Multiplex Gene Expression Profiling Assay for Exclusionary Diagnosis of Acute Cellular Rejection in Heart Transplant Patients

BACKGROUND

HEARTBiT is a whole blood-based gene profiling assay using the nucleic acid counting NanoString technology for the exclusionary diagnosis of acute cellular rejection in heart transplant patients. The HEARTBiT score measures the risk of acute cellular rejection in the first year following heart transplant, distinguishing patients with stable grafts from those at risk for acute cellular rejection. Here, we provide the analytical performance characteristics of the HEARTBiT assay and the results on pilot clinical validation.

METHODS

We used purified RNA collected from PAXgene blood samples to evaluate the characteristics of a 12-gene panel HEARTBiT assay, for its linearity range, quantitative bias, precision, and reproducibility. These parameters were estimated either from serial dilutions of individual samples or from repeated runs on pooled samples.

RESULTS

We found that all 12 genes showed linear behavior within the recommended assay input range of 125 ng to 500 ng of purified RNA, with most genes showing 3% or lower quantitative bias and around 5% coefficient of variation. Total variation resulting from unique operators, reagent lots, and runs was less than 0.02 units standard deviation (SD). The performance of the analytically validated assay (AUC = 0.75) was equivalent to what we observed in the signature development dataset.

CONCLUSION

The analytical performance of the assay within the specification input range demonstrated reliable quantification of the HEARTBiT score within 0.02 SD units, measured on a 0 to 1 unit scale. This assay may therefore be of high utility in clinical validation of HEARTBiT in future biomarker observational trials.

Assessment of Commercially Available Immunoassays to Measure Glucocorticoid Metabolites in African Grey Parrot (Psittacus Erithacus) Droppings: A Ready Tool for Non-Invasive Monitoring of Stress

Simple Summary

The African Grey Parrot is a very popular bird commonly found in zoological collections. However, captivity can prevent it from meeting its natural needs and so become an ongoing stressor, leading sometimes to clinical and/or behavioral disorders. Non-invasive forms of stress assessment are of definite interest for monitoring welfare in captive bird populations. One notable stress outcome is the excretion of glucocorticoid metabolites (from the stress hormone corticosterone) in droppings. The aim of this study was to carefully assess methods of glucocorticoid metabolites extraction and measurement in droppings from African Grey Parrots. Several extraction and enzyme immunoassays procedures were tested, based on the evaluation of analytical quality parameters and biological relevance. The best procedure was found to be a combination of a 60% methanol extraction with the use of a commercial corticosterone enzyme immunoassay. To determine whether this method was suitable for assessing different stress levels, a significant correlation with another reliable stress marker in birds, the Heterophil: Lymphocyte Ratio, was evidenced. This method can thus be used to evaluate stress in African Gray Parrots in a non-invasive way and help to monitor their welfare in zoo populations for instance.

Abstract

Despite being undomesticated, African Grey Parrots (Psittacus erithacus) are commonly found in captivity, in zoos or as pets. Captivity can be an ongoing stressor. Non-invasive glucocorticoid metabolites (GCM) measurements from bird droppings are of interest for assessing stress but require careful evaluation in each newly studied species. This study describes the assessment of such methods for Psittacus erithacus to provide tools for evaluating stress and monitoring welfare. We evaluated 12 method combinations of GCM extraction and enzyme immunoassay (EIA) from a pool of African Grey Parrot droppings, through the validation of several analytical parameters. Then, Heterophil: Lymphocyte Ratios (HLR), another reliable stress marker, were determined and correlated to individual dropping GCM concentrations for 29 birds to determine whether the method is biologically relevant. We found that the best procedure to measure GCM in African Grey Parrot droppings is a combination of 60% methanol extraction measured using a Corticosterone EIA kit (Cayman Chemical Company) from fresh or dry droppings. The establishment of a significant correlation (Pearson coefficient correlation = 0.48; p = 0.0082) between HLR and GCM in the studied population confirmed the method biological relevance. This method can thus be applied to assess stress in Psittacus erithacus and support welfare monitoring in zoo populations.

Technical feasibility of newborn screening for spinal muscular atrophy by next-generation DNA sequencing

Newborn screening (NBS) assays for spinal muscular atrophy (SMA) typically use a polymerase chain reaction (PCR) based assay to identify individuals with homozygous deletion in exon 7 of the SMN1 gene. Due to high DNA sequence homology between SMN1 and SMN2, it has previously been difficult to accurately bioinformatically map short reads from next-generation DNA sequencing (NGS) to SMN1, resulting in low analytical performance and preventing NGS being used for SMA screening. Advances in bioinformatics have allowed NGS to be used in diagnostic settings, but to date these assays have not reached the scale required for high volume population newborn screening and have not been performed on the dried blood spot samples that NBS programs currently use. Here we integrate an NGS assay using hybridisation-based capture with a customised bioinformatics algorithm and purpose designed high throughput reporting software into an existing NBS program to achieve a laboratory workflow for population SMA screening. We tested the NGS assay on over 2500 newborns born over 2 weeks in a NBS program in a technical feasibility study and show high sensitivity and specificity. Our results suggest NGS may be an alternate method for SMA screening by NBS programs, providing a multiplex testing platform on which potentially hundreds of inherited conditions could be simultaneously tested.

The validation of a commercial enzyme-linked immunosorbent assay and the effect of freeze-thaw cycles of serum on the stability of cortisol and testosterone concentrations in Aceh cattle

Background: To obtain accurate measurements of cortisol (C) and testosterone (T) in Aceh cattle, commercial enzyme-linked immunosorbent assay (ELISA) kits need to be carefully validated. Moreover, repeated freeze-thaw cycles during the storage of the samples may affect the stability of the hormones in the serum. Here, the reliability of C and T concentration measurements in the serum of Aceh cattle, was tested using commercial C and T ELISA kits designed to measure human C and T concentrations. Further, the effect of repeated freeze-thaw cycles on the stability of C and T concentrations in the serum was evaluated. Methods: Commercial C (Cat. no. EIA-1887) and T (Cat. no. EIA-1559) ELISA kits from DRG Instruments GmbH were validated through an analytical validation test (i.e., parallelism, accuracy, and precision) and a biological validation test (for C: effect of transportation on the C secretion; for T: the concentrations of T between bulls and cows). To test the effects of freeze-thaw cycles, cattle serum was subjected to the following treatments: (i) remained frozen at -20 OC (control group); (ii) exposed to freeze-thaw cycles for two, four, six, and eight times (test groups).   Results: Parallelism, accuracy, and precision tests showed that both  C and T ELISA kits adequately measured C and T in the serum of Aceh cattle. Concentrations of C post-transportation were significantly higher than pre-transportation (p<0.01). Concentrations of T in bulls were significantly higher than in cows (p<0.01). After four to eight freeze-thaw cycles, C concentrations were significantly lower compared to the control group (all p < 0.05). In contrast, T concentrations remained stable (all p>0.05). Conclusions: Commercial C (EIA-1887) and T (EIA-1559) ELISA kits are reliable assays for measuring serum C and T, respectively, in Aceh cattle. Repeated freeze-thaw cycles significantly affected the stability of serum C, but did not for T.