Quantitative Assessment of Commutability for Clinical Viral Load Testing Using a Digital PCR-Based Reference Standard

The IPTA Nashville Consensus Conference on Post-Transplant lymphoproliferative disorders after solid organ transplantation in children: III - Consensus guidelines for Epstein-Barr virus load and other biomarker monitoring

The International Pediatric Transplant Association convened an expert consensus conference to assess current evidence and develop recommendations for various aspects of care relating to post-transplant lymphoproliferative disorders after solid organ transplantation in children. In this report from the Viral Load and Biomarker Monitoring Working Group, we reviewed the existing literature regarding the role of Epstein-Barr viral load and other biomarkers in peripheral blood for predicting the development of PTLD, for PTLD diagnosis, and for monitoring of response to treatment. Key recommendations from the group highlighted the strong recommendation for use of the term EBV DNAemia instead of "viremia" to describe EBV DNA levels in peripheral blood as well as concerns with comparison of EBV DNAemia measurement results performed at different institutions even when tests are calibrated using the WHO international standard. The working group concluded that either whole blood or plasma could be used as matrices for EBV DNA measurement; optimal specimen type may be clinical context dependent. Whole blood testing has some advantages for surveillance to inform pre-emptive interventions while plasma testing may be preferred in the setting of clinical symptoms and treatment monitoring. However, EBV DNAemia testing alone was not recommended for PTLD diagnosis. Quantitative EBV DNAemia surveillance to identify patients at risk for PTLD and to inform pre-emptive interventions in patients who are EBV seronegative pre-transplant was recommended. In contrast, with the exception of intestinal transplant recipients or those with recent primary EBV infection prior to SOT, surveillance was not recommended in pediatric SOT recipients EBV seropositive pre-transplant. Implications of viral load kinetic parameters including peak load and viral set point on pre-emptive PTLD prevention monitoring algorithms were discussed. Use of additional markers, including measurements of EBV specific cell mediated immunity was discussed but not recommended though the importance of obtaining additional data from prospective multicenter studies was highlighted as a key research priority.

Matrix Matters: Assessment of Commutability among BK Virus Assays and Standards

Quantitative testing of BK virus (BKPyV) nucleic acid has become the standard of care in transplant patients. While the relationship between interassay harmonization and commutability has been well characterized for other transplant-related viruses, it has been less well studied for BKPyV, particularly regarding differences in commutability between matrices. Here, interassay agreement was evaluated among six real-time nucleic acid amplification tests (NAATs) and one digital PCR (dPCR) BKPyV assay. Differences in the commutability of three quantitative standards was examined across all assays using a variety of statistical approaches. Panels, including 40 samples each of plasma and urine samples previously positive for BKPyV, together with one previously negative plasma sample and four previously negative urine samples, were tested using all assays, with each real-time NAAT utilizing its usual quantitative calibrators. Serial dilutions of WHO, National Institute for Standards and Technology (NIST), and commercially produced (Exact/Bio-Rad) reference materials were also run by each assay as unknowns. The agreement of the clinical sample values was assessed as a group and in a pairwise manner. The commutability was estimated using both relativistic and quantitative means. The quantitative agreement across assays in the urine samples was within a single log10 unit across all assays, while the results from the plasma samples varied by 2 to 3 log10 IU/mL. The commutability showed a similar disparity between the matrices. Recalibration using international standards diminished the resulting discrepancies in some but not all cases. Differences in the sample matrix can affect the commutability and interassay agreement of quantitative BKPyV assays. Differences in commutability between matrices may largely be due to factors other than those such as amplicon size, previously described as important in the case of cytomegalovirus. Continued efforts to standardize viral load measurements must address multiple sources of variability and account for differences in assay systems, quantitative standards, and sample matrices.

Persistent Challenges of Interassay Variability in Transplant Viral Load Testing

While quantification of viruses that cause important infections in transplant recipients has been the standard of care for years, important challenges related to standardization remain. The issues are wide ranging, and until they are adequately addressed, the full impact of viral load testing regarding clinical management decisions will not be realized. This review focuses on a broad array of problems, including the lack of available FDA-approved/cleared tests, limited uptake of international standards, accurate quantification of secondary standards, specific assay characteristics, and commutability. Though some of these topics are nuanced, taken together they greatly influence the clinical utility of testing. For example, it has not been possible to define thresholds that predict the risk of developing disease and determine significant changes in serial viral load values for a given patient. Moreover, the utility of international guidelines may be limited due to the lack of a standardized assay. By summarizing the issues, the hope is that commercial companies, regulatory agencies, and professional societies can come together to advance the field and solve these problems.

Digital PCR—An Emerging Technology with Broad Applications in Microbiology

BACKGROUND

The PCR and its variant, quantitative PCR (qPCR), have revolutionized the practice of clinical microbiology. Continued advancements in PCR have led to a new derivative, digital PCR (dPCR), which promises to address certain limitations inherent to qPCR.

CONTENT

Here we highlight the important technical differences between qPCR and dPCR, and the potential advantages and disadvantages of each. We then review specific situations in which dPCR has been implemented in clinical microbiology and the results of such applications. Finally, we attempt to place dPCR in the context of other emerging technologies relevant to the clinical laboratory, including next-generation sequencing.

SUMMARY

dPCR offers certain clear advantages over traditional qPCR, but these are to some degree offset by limitations of the technology, at least as currently practiced. Laboratories considering implementation of dPCR should carefully weigh the potential advantages and disadvantages of this powerful technique for each specific application planned.

Impact of Fragmentation on Commutability of Epstein-Barr Virus and Cytomegalovirus Quantitative Standards

Despite the adaptation of international standards, quantitative viral load testing of transplant-associated viruses continues to be limited by interlaboratory disagreement. Studies have suggested that this disagreement and the poor commutability of standards may, in some cases, be linked to amplicon size and the fragmentation of circulating viral DNA. We evaluated target fragmentation as a cause of noncommutability and pretest fragmentation of quantitative standards as a potential means of increasing commutability and interassay agreement. Forty-two cytomegalovirus (CMV)-positive and 41 Epstein-Barr virus (EBV)-positive plasma samples, together with two different quantitative standards for each virus, were tested as unknowns using 10 different quantitative PCR assays at 5 different laboratories. Standards were tested both intact and after intentional fragmentation by ultrasonication. Quantitative agreement between methods was assessed, together with commutability, using multiple statistical approaches. Most assays yielded results within 0.5 log₁₀ IU/ml of the mean for CMV, while for EBV a greater variability of up to 1.5 log₁₀ IU/ml of the mean was shown. Commutability showed marked improvement following fragmentation of both CMV standards but not after fragmentation of the EBV standards. These findings confirm the impact of amplicon size and target fragmentation on commutability for CMV and suggest that for some (but not all) viruses, interlaboratory harmonization can be improved through the use of fragmented quantitative standards.

Evaluation of the Abbott RealTime quantitative CMV and EBV assays using the maxCycle protocol in a laboratory automation context

Real-time PCR are often used for the diagnosis and monitoring of Cytomegalovirus (CMV) and Epstein-Barr virus (EBV) infections in susceptible populations. In this context, we evaluated the analytical performances of the Abbott RealTime CMV/EBV maxCycle protocol automated on the m2000 platform (Abbott). It was compared to our routinely-used procedure consisting of a NucleoMag® DNA extraction automated on a STARlet platform followed by manually processed CMV and EBV quantitative real-time PCR (Diagenode). In this study, we showed that both EBV assays exhibited a similar sensitivity but with a better precision for the EBV Abbott RealTime assay. For the CMV performances, the Abbott assay was more sensitive and more precise than our routine method. The use of WHO International Standards also indicated a slight underestimation of the viral loads (-0.25 log₁₀ IU/mL and -0.21 log₁₀ IU/mL for CMV and EBV assays respectively) while these were rather overestimated with the Starlet/Diagenode method (0.48 log₁₀ IU/mL and 0.19 log₁₀ IU/mL for CMV and EBV assays respectively). These trends were confirmed using relevant whole-blood clinical samples and external quality controls. The workflows were also compared and we highlighted a significant technician hands-on time reduction (-63%) using the Abbott CMV/EBV maxCycle automated protocol.

EBV Viral Loads in Diagnosis, Monitoring, and Response Assessment

The quantification of circulating Epstein Barr virus (EBV) DNA loads has played an important role in the diagnosis and management of EBV-associated lymphoid malignancies. Viral load measurement is particularly useful for monitoring EBV-DNA in hematopoietic stem cell transplant patients, and for assessing the prognosis or response to therapy of EBV-associated intractable lymphomas like extranodal NK/T-cell lymphoma, nasal type. Cell-free EBV-DNA in plasma can be used as a biomarker for estimating the severity or prognosis of these lymphomas. In addition to plasma, whole blood has been used for the management of transplant patients. Although measuring EBV-DNA has been useful, there is a lack of standardization and the optimal specimens for measuring viral loads are unknown. This can be attributed to the different forms of EBV-DNA that exist in peripheral blood and the different pathologies that result from diverse EBV disease states. As a result, guidelines for EBV diagnosis or the initiation of treatment are unclear. However, the newly established World Health Organization standard for EBV quantification will encourage collaborative studies across institutions and countries to establish proper guidelines for EBV diagnosis and the initiation of treatment.

A Comprehensive Statistical Framework for Determination of Commutability, Accuracy, and Agreement in Clinical DNAemia Assays

Despite advances in the standardization of quantitative DNAemia tests and efforts to better understand and characterize the performance of reference materials in different assays, it remains unclear how the commutability performance of reference materials is related to intra- and interassay agreement. Building upon previous work, we describe a comprehensive framework to determine the relationship of commutability with assay accuracy and agreement. The use of this framework is illustrated using previously generated data regarding the performance of four quantitative Epstein-Bar virus (EBV) PCR assays with the WHO and ABI standards as examples. The use of these statistical tools can link the performance characteristics of one or more assays with predetermined clinical decision limits and may help improve the development, validation, and clinical utility of such DNAemia tests.

Circulating pre-treatment Epstein-Barr virus DNA as prognostic factor in locally-advanced nasopharyngeal cancer in a non-endemic area

The prognostic value of pre-treatment Epstein-Barr Virus (EBV) DNA viral load for non-endemic, locally-advanced, EBV-related nasopharyngeal cancer (NPC) patients is yet to be defined. All patients with EBV encoded RNA (EBER)-positive NPC treated at our Institution from 2005 to 2014 with chemotherapy (CT) concurrent with radiation (RT) +/- induction chemotherapy (ICT) were retrospectively reviewed. Pre-treatment baseline plasma EBV DNA (b-EBV DNA) viral load was detected and quantified by PCR. Median b-EBV DNA value was correlated to potential influencing factors by univariate analysis. Significant variables were then extrapolated and included in a multivariate linear regression model. The same variables, including b-EBV DNA, were correlated with Disease Free Survival (DFS) and Overall Survival (OS) by univariate and multivariate analysis.

A total of 130 locally-advanced EBER positive NPC patients were evaluated. Overall, b-EBV DNA was detected in 103 patients (79.2%). Median viral load was 554 copies/mL (range 50–151075), and was positively correlated with T stage (p=0.002), N3a-b vs N0-1-2 stage (p=0.048), type of treatment (ICT followed by CTRT, p=0.006) and locoregional and/or distant disease recurrence (p=0.034). In the overall population, DFS and OS were significantly longer in patients with pre-treatment negative EBV DNA than in positive subjects at the multivariate analysis.

Negative b-EBV DNA can be considered as prognostic biomarker of longer DFS and OS in NPC in non-endemic areas. This finding needs confirmation in larger prospective series, with standardized and inter-laboratory harmonized method of plasma EBV DNA quantification.

Quantification of Torque Teno Virus and Epstein-Barr Virus Is of Limited Value for Predicting the Net State of Immunosuppression After Lung Transplantation

Background

Major hurdles for survival after lung transplantation are rejections and infectious complications. Adequate methods for monitoring immune suppression status are lacking. Here, we evaluated quantification of torque teno virus (TTV) and Epstein-Barr virus (EBV) as biomarkers for defining the net state of immunosuppression in lung-transplanted patients.

Methods

This prospective single-center study included 98 patients followed for 2 years after transplantation. Bacterial infections, fungal infections, viral respiratory infections (VRTI), cytomegalovirus (CMV) viremia, and acute rejections, as well as TTV and EBV levels, were monitored.

Results

The levels of torque teno virus DNA increased rapidly after transplantation, likely due to immunosuppressive treatment. A modest increase in levels of Epstein-Barr virus DNA was also observed after transplantation. There were no associations between either TTV or EBV and infectious events or acute rejection, respectively, during follow-up. When Tacrolimus was the main immunosuppressive treatment, TTV DNA levels were significantly elevated 6–24 months after transplantation as compared with Cyclosporine treatment.

Conclusions

Although replication of TTV, but not EBV, appears to reflect the functionality of the immune system, depending on the type of immunosuppressive treatment, quantification of TTV or EBV as biomarkers has limited potential for defining the net state of immune suppression.

Applications of Digital PCR for Clinical Microbiology

Digital PCR (dPCR) is an important new tool for use in the clinical microbiology laboratory. Its advantages over quantitative PCR (qPCR), including absolute quantification without a standard curve, improved precision, improved accuracy in the presence of inhibitors, and more accurate quantitation when amplification efficiency is low, make dPCR the assay of choice for several specimen testing applications. This minireview will discuss the advantages and disadvantages of dPCR compared to qPCR, its applications in clinical microbiology, and considerations for implementation of the method in a clinical laboratory.