Evaluation of multiple laboratory performance and variability in analysis of recreational freshwaters by a rapid Escherichia coli qPCR method (Draft Method C)

Public health use and lessons learned from a statewide SARS-CoV-2 wastewater monitoring program (MiNET)

The global SARS-CoV-2 monitoring effort has been extensive, resulting in many states and countries establishing wastewater-based epidemiology programs to address the spread of the virus during the pandemic. Challenges for programs include concurrently optimizing methods, training new laboratories, and implementing successful surveillance programs that can rapidly translate results for public health, and policy making. Surveillance in Michigan early in the pandemic in 2020 highlights the importance of quality-controlled data and explores correlations with wastewater and clinical case data aggregated at the state level. The lessons learned and potential measures to improve public utilization of results are discussed. The Michigan Network for Environmental Health and Technology (MiNET) established a network of laboratories that partnered with local health departments, universities, wastewater treatment plants (WWTPs) and other stakeholders to monitor SARS-CoV-2 in wastewater at 214 sites in Michigan. MiNET consisted of nineteen laboratories, twenty-nine local health departments, 6 Native American tribes, and 60 WWTPs monitoring sites representing 45 % of Michigan's population from April 6 and December 29, 2020. Three result datasets were created based on quality control criteria. Wastewater results that met all quality assurance criteria (Dataset Mp) produced strongest correlations with reported clinical cases at 16 days lag (rho = 0.866, p < 0.05). The project demonstrated the ability to successfully track SARS-CoV-2 on a large, state-wide scale, particularly data that met the outlined quality criteria and provided an early warning of increasing COVID-19 cases. MiNET is currently poised to leverage its competency to complement public health surveillance networks through environmental monitoring for new and emerging pathogens of concern and provides a valuable resource to state and federal agencies to support future responses.

Fecal Impairment Framework, A New Conceptual Framework for Assessing Fecal Contamination in Recreational Waters

Fecal pollution of surface water is a pervasive problem that negatively affects waterbodies concerning both public health and ecological functions. Current assessment methods monitor fecal indicator bacteria (FIB) to identify pollution sources using culture-based quantification and microbial source tracking (MST). These types of information assist stakeholders in identifying likely sources of fecal pollution, prioritizing them for remediation, and choosing appropriate best management practices. While both culture-based quantification and MST are useful, they yield different kinds of information, potentially increasing uncertainty in prioritizing sources for management. This study presents a conceptual framework that takes separate human health risk estimates based on measured MST and E. coli concentrations as inputs and produces an estimate of the overall fecal impairment risk as its output. The proposed framework is intended to serve as a supplemental screening tool for existing monitoring programs to aid in identifying and prioritizing sites for remediation. In this study, we evaluated the framework by applying it to two primarily agricultural watersheds and several freshwater recreational beaches using existing routine monitoring data. Based on a combination of E. coli and MST results, the proposed fecal impairment framework identified four sites in the watersheds as candidates for remediation and identified temporal trends in the beach application. As these case studies demonstrate, the proposed fecal impairment framework is an easy-to-use and cost-effective supplemental screening tool that provides actionable information to managers using existing routine monitoring data, without requiring specialized expertize.

Using watershed characteristics to enhance fecal source identification

Fecal pollution is one of the most prevalent forms of pollution affecting waterbodies worldwide, threatening public health and negatively impacting aquatic environments. Microbial source tracking (MST) applies polymerase chain reaction (PCR) technology to help identify the source of fecal pollution. In this study, we combine spatial data for two watersheds with general and host-associated MST markers to target human (HF183/BacR287), bovine (CowM2), and general ruminant (Rum2Bac) sources. Concentrations of MST markers in samples were determined with droplet digital PCR (ddPCR). The three MST markers were detected at all sites (n = 25), but bovine and general ruminant markers were significantly associated with watershed characteristics. MST results, combined with watershed characteristics, suggest that streams draining areas with low-infiltration soil groups and high agricultural land use are at an increased risk for fecal contamination. Microbial source tracking has been applied in numerous studies to aid in identifying the sources of fecal contamination, but these studies usually lack information on the involvement of watershed characteristics. Our study combined watershed characteristics with MST results to provide more comprehensive insight into the factors that influence fecal contamination in order to implement the most effective best management practices.

Validity assessment of Michigan's proposed qPCR threshold value for rapid water-quality monitoring of E. coli contamination

Michigan's water-quality standards specify that E. coli concentrations at bathing beaches must not exceed 300 E. coli per 100 mL, as determined by the geometric mean of culture-based concentrations in three or more representative samples from a given beach on a given day. Culture-based analysis requires 18⁠-⁠24 h to complete, so results are not available on the day of sampling. This one-day delay is problematic because results cannot be used to prevent recreation at beaches that are unsafe on the sampling day, nor do they reliably indicate whether recreation should be prevented the next day, due to high between-day variability in E. coli concentrations demonstrated by previous studies. By contrast, qPCR-based E. coli concentrations can be obtained in 3-4 h, making same-day beach notification decisions possible. Michigan has proposed a qPCR threshold value (qTV) for E. coli of 1.863 log₁₀ gene copies per reaction as a potential equivalent value to the state standard, based on statistical analysis of a set of state-wide training data from 2016 to 2018. The main purpose of the present study is to assess the validity of the proposed qTV by determining whether the implied qPCR-based beach notification decisions agree well with culture-based decisions on two sets of test data from 2016⁠-⁠2018 (6,564 samples) and 2019-2020 (3,205 samples), and whether performance of the proposed qTV is similar on the test and training data. The results show that performance of Michigan's proposed qTV on both sets of test data was consistently good (e.g., 95% agreement with culture-based beach notification decisions during 2019⁠-⁠2020) and was as good as or better than its performance on the training data set. The false-negative rate for the proposed qTV was 25-29%, meaning that beach notification decisions based on the qTV would be expected to permit recreation on the day of sampling in 25-29% of cases where the beach exceeds the state standard for FIB contamination. This false-negative rate is higher than one would hope to see but is well below the corresponding error rate for culture-based decisions, which permit recreation at beaches that exceed the state standard on the day of sampling in 100% of cases because of the one-day delay in obtaining results. The key advantage of qPCR-based analysis is that it permits a large percentage (71-75%) of unsafe beaches to be identified in time to prevent recreation on the day of sampling.

Interlaboratory performance and quantitative PCR data acceptance metrics for NIST SRM® 2917

Surface water quality quantitative polymerase chain reaction (qPCR) technologies are expanding from a subject of research to routine environmental and public health laboratory testing. Readily available, reliable reference material is needed to interpret qPCR measurements, particularly across laboratories. Standard Reference Material® 2917 (NIST SRM® 2917) is a DNA plasmid construct that functions with multiple water quality qPCR assays allowing for estimation of total fecal pollution and identification of key fecal sources. This study investigates SRM 2917 interlaboratory performance based on repeated measures of 12 qPCR assays by 14 laboratories (n = 1008 instrument runs). Using a Bayesian approach, single-instrument run data are combined to generate assay-specific global calibration models allowing for characterization of within- and between-lab variability. Comparable data sets generated by two additional laboratories are used to assess new SRM 2917 data acceptance metrics. SRM 2917 allows for reproducible single-instrument run calibration models across laboratories, regardless of qPCR assay. In addition, global models offer multiple data acceptance metric options that future users can employ to minimize variability, improve comparability of data across laboratories, and increase confidence in qPCR measurements.

Bacterial and viral fecal indicator predictive modeling at three Great Lakes recreational beach sites

Coliphage are viruses that infect Escherichia coli (E. coli) and may indicate the presence of enteric viral pathogens in recreational waters. There is an increasing interest in using these viruses for water quality monitoring and forecasting; however, the ability to use statistical models to predict the concentrations of coliphage, as often done for cultured fecal indicator bacteria (FIB) such as enterococci and E. coli, has not been widely assessed. The same can be said for FIB genetic markers measured using quantitative polymerase chain reaction (qPCR) methods. Here we institute least-angle regression (LARS) modeling of previously published concentrations of cultured FIB (E. coli, enterococci) and coliphage (F+, somatic), along with newly reported genetic concentrations measured via qPCR for E. coli, enterococci, and general Bacteroidales. We develop site-specific models from measures taken at three beach sites on the Great Lakes (Grant Park, South Milwaukee, WI; Edgewater Beach, Cleveland, OH; Washington Park, Michigan City, IN) to investigate the efficacy of a statistical predictive modeling approach. Microbial indicator concentrations were measured in composite water samples collected five days per week over a beach season (∼15 weeks). Model predictive performance (cross-validated standardized root mean squared error of prediction [SRMSEP] and R2PRED) were examined for seven microbial indicators (using log10 concentrations) and water/beach parameters collected concurrently with water samples. Highest predictive performance was seen for qPCR-based enterococci and Bacteroidales models, with F+ coliphage consistently yielding poor performing models. Influential covariates varied by microbial indicator and site. Antecedent rainfall, bird abundance, wave height, and wind speed/direction were most influential across all models. Findings suggest that some fecal indicators may be more suitable for water quality forecasting than others at Great Lakes beaches.

Performance of NIST SRM® 2917 with 13 recreational water quality monitoring qPCR assays

Fecal pollution remains a significant challenge for recreational water quality management worldwide. In response, there is a growing interest in the use of real-time quantitative PCR (qPCR) methods to achieve same-day notification of recreational water quality and associated public health risk as well as to characterize fecal pollution sources for targeted mitigation. However, successful widespread implementation of these technologies requires the development of and access to a high-quality standard control material. Here, we report a single laboratory qPCR performance assessment of the National Institute of Standards and Technology Standard Reference Material 2917 (NIST SRM® 2917), a linearized plasmid DNA construct that functions with 13 recreational water quality qPCR assays. Performance experiments indicate the generation of standard curves with amplification efficiencies ranging from 0.95 ± 0.006 to 0.99 ± 0.008 and coefficient of determination values (R2) ≥ 0.980. Regardless of qPCR assay, variability in repeated measurements at each dilution level were very low (quantification threshold standard deviations ≤ 0.657) and exhibited a heteroscedastic trend characteristic of qPCR standard curves. The influence of a yeast carrier tRNA added to the standard control material buffer was also investigated. Findings demonstrated that NIST SRM® 2917 functions with all qPCR methods and suggests that the future use of this control material by scientists and water quality managers should help reduce variability in concentration estimates and make results more consistent between laboratories.

Absolute quantification of E. coli virulence and housekeeping genes to determine pathogen loads in enumerated environmental samples

Quantifying pathogenic genes with q-PCR in complex samples to determine the pathogen loads is influenced by a wide range of factors, including choice of extraction method, standard curve, and the decision to use relative versus absolute quantification of the genes. The aim was to investigate the standardisation of q-PCR methods to determine enumerated E. coli gene ratios grown with the IDEXX Colilert^® Quanti-Trays^® using enteropathogenic E. coli as the model pathogen. q-PCR targeting the eaeA and gadAB genes was used to calculate the eaeA: gadAB ratios for clinical strains collected between [2005–2006 (n = 55)] and [2008–2009 (n = 19)] using the LinRegPCR software and Corbett Research Thermal cycler software. Both programs grouped the isolates into two distinct groups based on the gene ratios although the Corbett Research Thermal cycler software gave results one log higher than the LinRegPCR program. Although the eaeA: gadAB ratio range was determined using extracted E. coli DNA, the impact of free DNA and other bacteria present in the sample needed to be understood. Standard curve variations using serially diluted extracted E. coli DNA, serially diluted pure E. coli culture followed by DNA extraction from each dilution with or without other bacteria was tested using the eaeA q-PCR to quantify the genes. Comparison of the standard curves showed no significant difference between standard curves prepared with diluted DNA or with cells diluted before the DNA is extracted (P = 0.435). Significant differences were observed when background DNA was included in the diluent or Coliform cells added to the diluent to dilute cells before the DNA is extracted (P < 0.001). The “carrier” DNA and Coliform cells enhanced the DNA extraction results resulting in better PCR efficiency. This will have an influence on the quantification of gene ratios and pathogen load in samples containing lower numbers of E. coli.

Large-scale comparison of E. coli levels determined by culture and a qPCR method (EPA Draft Method C) in Michigan towards the implementation of rapid, multi-site beach testing

Fecal pollution remains a challenge for water quality managers at Great Lakes and inland recreational beaches. The fecal indicator of choice at these beaches is typically Escherichia coli (E. coli), determined by culture-based methods that require over 18 h to obtain results. Researchers at the United States Environmental Protection Agency (EPA) have developed a rapid E. coli qPCR methodology (EPA Draft Method C) that can provide same-day results for improving public health protection with demonstrated sensitivity, specificity, and data acceptance criteria. However, limited information is currently available to compare the occurrence of E. coli determined by cultivation and by EPA Draft Method C (Method C). This study provides a large-scale data collection effort to compare the occurrence of E. coli determined by these alternative methods at more than 100 Michigan recreational beach and other sites using the complete set of quantitative data pairings and selected subsets of the data and sites meeting various eligibility requirements. Simple linear regression analyses of composite (pooled) data indicated a correlation between results of the E. coli monitoring approaches for each of the multi-site datasets as evidenced by Pearson R-squared values ranging from 0.452 to 0.641. Theoretical Method C threshold values, expressed as mean log10 target gene copies per reaction, that corresponded to an established E. coli culture method water quality standard of 300 MPN or CFU /100 mL varied only from 1.817 to 1.908 for the different datasets using this model. Different modeling and derivation approaches that incorporated within and between-site variability in the estimates also gave Method C threshold values in this range but only when relatively well-correlated datasets were used to minimize the error. A hypothetical exercise to evaluate the frequency of water impairments based on theoretical qPCR thresholds corresponding to the E. coli water quality standard for culture methods suggested that the methods may provide the same beach notification outcomes over 90% of the time with Method C results differing from culture method results that indicated acceptable and unacceptable water quality at overall rates of 1.9% and 6.6%, respectively. Results from this study provide useful information about the relationships between E. coli determined by culture and qPCR methods across many diverse freshwater sites and should facilitate efforts to implement qPCR-based E. coli detection for rapid recreational water quality monitoring on a large scale in the State of Michigan.

A short history of methods used to measure bathing beach water quality

The enumeration of fecal indicators of bathing beach water to determine quality have been used since the mid-20th century. In the 1930s and as late the 1970s, the Most Probable Number procedure for estimating microbial densities in water was in general use. The most probable number procedure was replaced as a method of choice by the membrane filter procedure. The membrane filter had been developed in the early 1950s but did not find widespread use until the 1970s. Another development during the 1970s was the quanti -tray method, a proprietary multi-well tray, which was introduced as an innovative form of the Most Probable Number procedure. In 2005 molecular methods were introduced as a rapid 3-hourh procedure for measuring bathing beach water quality. Several variations of this approach are currently in use or in development.

A comparison of E. coli concentration estimates quantified by the EPA and a Michigan laboratory network using EPA Draft Method C

We evaluated data from 10 laboratories that analyzed water samples from 82 recreational water sites across the state of Michigan between 2016 and 2018. Water sample replicates were analyzed by experienced U.S. Environmental Protection Agency (EPA) analysts and Michigan laboratories personnel, many of whom were newly trained, using EPA Draft Method C-a rapid quantitative polymerase chain reaction (qPCR) technique that provides same day Escherichia coli (E. coli) concentration results. Beach management decisions (i.e. remain open or issue an advisory or closure) based on E. coli concentration estimates obtained by Michigan labs and by the EPA were compared; the beach management decision agreed in 94% of the samples analyzed. We used the Wilcoxon one-sample signed rank test and nonparametric quantile regression to assess (1) the degree of agreement between E. coli concentrations quantified by Michigan labs versus the EPA and (2) Michigan lab E. coli measurement precision, relative to EPA results, in different years and water body types. The median quantile regression curve for Michigan labs versus EPA approximated the 1:1 line of perfect agreement more closely as years progressed. Similarly, Michigan lab E. coli estimates precision also demonstrated yearly improvements. No meaningful difference was observed in the degree of association between Michigan lab and EPA E. coli concentration estimates for inland lake and Great Lakes samples (median regression curve average slopes 0.93 and 0.95, respectively). Overall, our study shows that properly trained laboratory personnel can perform Draft Method C to a degree comparable with experienced EPA analysts. This allows health departments that oversee recreational water quality monitoring to be confident in qPCR results generated by the local laboratories responsible for analyzing the water samples.

Microbial Indicators of Fecal Pollution: Recent Progress and Challenges in Assessing Water Quality

PURPOSE OF REVIEW

Fecal contamination of water is a major public health concern. This review summarizes recent developments and advancements in water quality indicators of fecal contamination.

RECENT FINDINGS

This review highlights a number of trends. First, fecal indicators continue to be a valuable tool to assess water quality and have expanded to include indicators able to detect sources of fecal contamination in water. Second, molecular methods, particularly PCR-based methods, have advanced considerably in their selected targets and rigor, but have added complexity that may prohibit adoption for routine monitoring activities at this time. Third, risk modeling is beginning to better connect indicators and human health risks, with the accuracy of assessments currently tied to the timing and conditions where risk is measured. Research has advanced although challenges remain for the effective use of both traditional and alternative fecal indicators for risk characterization, source attribution and apportionment, and impact evaluation.

Simplified Analysis of Measurement Data from A Rapid E. coli qPCR Method (EPA Draft Method C) Using A Standardized Excel Workbook

Draft method C is a standardized method for quantifying E. coli densities in recreational waters using quantitative polymerase chain reaction (qPCR). The method includes a Microsoft Excel workbook that automatically screens for poor-quality data using a set of previously proposed acceptance criteria, generates weighted linear regression (WLR) composite standard curves, and calculates E. coli target gene copies in test samples. We compared standard curve parameter values and test sample results calculated with the WLR model to those from a Bayesian master standard curve (MSC) model using data from a previous multi-lab study. The two models' mean intercept and slope estimates from twenty labs' standard curves were within each other's 95% credible or confidence intervals for all labs. E. coli gene copy estimates of six water samples analyzed by eight labs were highly overlapping among labs when quantified with the WLR and MSC models. Finally, we compared multiple labs' 2016-2018 composite curves, comprised of data from individual curves where acceptance criteria were not used, to their corresponding composite curves with passing acceptance criteria. Composite curves developed from passing individual curves had intercept and slope 95% confidence intervals that were often narrower than without screening and an analysis of covariance test was passed more often. The Excel workbook WLR calculation and acceptance criteria will help laboratories implement draft method C for recreational water analysis in an efficient, cost-effective, and reliable manner.

Standardized data quality acceptance criteria for a rapid Escherichia coli qPCR method (Draft Method C) for water quality monitoring at recreational beaches

There is growing interest in the application of rapid quantitative polymerase chain reaction (qPCR) and other PCR-based methods for recreational water quality monitoring and management programs. This interest has strengthened given the publication of U.S. Environmental Protection Agency (EPA)-validated qPCR methods for enterococci fecal indicator bacteria (FIB) and has extended to similar methods for Escherichia coli (E. coli) FIB. Implementation of qPCR-based methods in monitoring programs can be facilitated by confidence in the quality of the data produced by these methods. Data quality can be determined through the establishment of a series of specifications that should reflect good laboratory practice. Ideally, these specifications will also account for the typical variability of data coming from multiple users of the method. This study developed proposed standardized data quality acceptance criteria that were established for important calibration model parameters and/or controls from a new qPCR method for E. coli (EPA Draft Method C) based upon data that was generated by 21 laboratories. Each laboratory followed a standardized protocol utilizing the same prescribed reagents and reference and control materials. After removal of outliers, statistical modeling based on a hierarchical Bayesian method was used to establish metrics for assay standard curve slope, intercept and lower limit of quantification that included between-laboratory, replicate testing within laboratory, and random error variability. A nested analysis of variance (ANOVA) was used to establish metrics for calibrator/positive control, negative control, and replicate sample analysis data. These data acceptance criteria should help those who may evaluate the technical quality of future findings from the method, as well as those who might use the method in the future. Furthermore, these benchmarks and the approaches described for determining them may be helpful to method users seeking to establish comparable laboratory-specific criteria if changes in the reference and/or control materials must be made.