1
|
Kevill JL, Farkas K, Ridding N, Woodhall N, Malham SK, Jones DL. Use of Capsid Integrity-qPCR for Detecting Viral Capsid Integrity in Wastewater. Viruses 2023; 16:40. [PMID: 38257740 PMCID: PMC10819219 DOI: 10.3390/v16010040] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Revised: 12/18/2023] [Accepted: 12/21/2023] [Indexed: 01/24/2024] Open
Abstract
Quantifying viruses in wastewater via RT-qPCR provides total genomic data but does not indicate the virus capsid integrity or the potential risk for human infection. Assessing virus capsid integrity in sewage is important for wastewater-based surveillance, since discharged effluent may pose a public health hazard. While integrity assays using cell cultures can provide this information, they require specialised laboratories and expertise. One solution to overcome this limitation is the use of photo-reactive monoazide dyes (e.g., propidium monoazide [PMAxx]) in a capsid integrity-RT-qPCR assay (ci-RT-qPCR). In this study, we tested the efficiency of PMAxx dye at 50 μM and 100 μM concentrations on live and heat-inactivated model viruses commonly detected in wastewater, including adenovirus (AdV), hepatitis A (HAV), influenza A virus (IAV), and norovirus GI (NoV GI). The 100 μM PMAxx dye concentration effectively differentiated live from heat-inactivated viruses for all targets in buffer solution. This method was then applied to wastewater samples (n = 19) for the detection of encapsulated AdV, enterovirus (EV), HAV, IAV, influenza B virus (IBV), NoV GI, NoV GII, and SARS-CoV-2. Samples were negative for AdV, HAV, IAV, and IBV but positive for EV, NoV GI, NoV GII, and SARS-CoV-2. In the PMAxx-treated samples, EV, NoV GI, and NoV GII showed -0.52-1.15, 0.9-1.51, and 0.31-1.69 log reductions in capsid integrity, indicating a high degree of potentially infectious virus in wastewater. In contrast, SARS-CoV-2 was only detected using RT-qPCR but not after PMAxx treatment, indicating the absence of encapsulated and potentially infectious virus. In conclusion, this study demonstrates the utility of PMAxx dyes to evaluate capsid integrity across a diverse range of viruses commonly monitored in wastewater.
Collapse
Affiliation(s)
- Jessica L. Kevill
- School of Environmental and Natural Sciences, Bangor University, Bangor, Gwynedd LL57 2UW, UK; (K.F.); (N.R.); (N.W.); or (D.L.J.)
| | - Kata Farkas
- School of Environmental and Natural Sciences, Bangor University, Bangor, Gwynedd LL57 2UW, UK; (K.F.); (N.R.); (N.W.); or (D.L.J.)
| | - Nicola Ridding
- School of Environmental and Natural Sciences, Bangor University, Bangor, Gwynedd LL57 2UW, UK; (K.F.); (N.R.); (N.W.); or (D.L.J.)
| | - Nicholas Woodhall
- School of Environmental and Natural Sciences, Bangor University, Bangor, Gwynedd LL57 2UW, UK; (K.F.); (N.R.); (N.W.); or (D.L.J.)
| | - Shelagh K. Malham
- School of Ocean Sciences, Bangor University, Menai Bridge, Anglesey LL59 5AB, UK;
| | - Davey L. Jones
- School of Environmental and Natural Sciences, Bangor University, Bangor, Gwynedd LL57 2UW, UK; (K.F.); (N.R.); (N.W.); or (D.L.J.)
- Centre for Sustainable Farming Systems, Food Futures Institute, Murdoch University, Murdoch, WA 6150, Australia
| |
Collapse
|
2
|
Zhang Y, Zhang L, Duan X, Qu S, Xu L. Development of a revised ICC-qPCR method used for Pseudorabies virus inactivation validation study of biologically sourced materials. Anal Biochem 2020; 592:113576. [PMID: 31917958 DOI: 10.1016/j.ab.2020.113576] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2019] [Revised: 01/03/2020] [Accepted: 01/03/2020] [Indexed: 11/28/2022]
Abstract
To develop a precise and convenient method to evaluate the virus transmission risk of biologically sourced materials, an integrated cell culture-qPCR (ICC-qPCR) method for Pseudorabies virus (PRV) was established and revised for applications to this new field. The optimized post-infection period was found at 12-hr to achieve a reasonable detection limit (-0.25 Log10TCID50/100 μL, Logs) and a quantitative range (0.75-3.75 Logs). The results of mimic samples suggested that three 10-fold dilutions at the time of virus inoculation combined with three washes after virus absorption, and the sets of non-amplified samples as controls could efficiently eliminate the false positive signals caused by high levels of noninfectious viruses. The virus inactivation validation studies of acellular porcine corneas suggested that the logs inactivation of PRV at 12 kGy irradiation dose obtained by general ICC-qPCR, revised ICC-qPCR and cell culture were 2.49, 4.85 and 5.08, respectively. At 25 kGy, those were 2.31, 4.85 and 5.08, respectively. The results obtained by the revised ICC-qPCR were consistent with cell culture and more precise than general ICC-qPCR. Therefore, the revised ICC-qPCR proposed in this study has an application prospect in the PRV inactivation validation studies of biologically sourced materials.
Collapse
Affiliation(s)
- Yu Zhang
- School of Life Science and Engineering, Southwest Jiaotong University, Chengdu, 610031, China; National Institutes for Food and Drug Control, Beijing, 102629, China
| | - Le Zhang
- National Institutes for Food and Drug Control, Beijing, 102629, China
| | - Xiaojie Duan
- National Institutes for Food and Drug Control, Beijing, 102629, China.
| | - Shuxin Qu
- School of Materials Science and Engineering, Southwest Jiaotong University, Chengdu, 610031, China.
| | - Liming Xu
- School of Life Science and Engineering, Southwest Jiaotong University, Chengdu, 610031, China; National Institutes for Food and Drug Control, Beijing, 102629, China.
| |
Collapse
|
3
|
Prado T, de Castro Bruni A, Barbosa MRF, Garcia SC, de Jesus Melo AM, Sato MIZ. Performance of wastewater reclamation systems in enteric virus removal. THE SCIENCE OF THE TOTAL ENVIRONMENT 2019; 678:33-42. [PMID: 31075600 DOI: 10.1016/j.scitotenv.2019.04.435] [Citation(s) in RCA: 45] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/28/2019] [Revised: 04/29/2019] [Accepted: 04/29/2019] [Indexed: 05/18/2023]
Abstract
Analysis of virus removal by tertiary or advanced sewage treatment processes is an emerging topic due to importance of reusing water on a global level. This study aimed to monitor important human viral pathogens: the human adenovirus (HAdV), JC polyomavirus (JCV) and Species A rotaviruses (RVA) in urban sewage, secondary effluents and reclaimed water from metropolitan São Paulo (MSP), Brazil. Four large wastewater treatment plants (WWTPs) in MSP were sampled monthly during a one-year period (April 2015 to March 2016). The viruses were quantified by quantitative PCR (qPCR), and HAdV viability was tested by the integrated cell culture (ICC)-qPCR assay. WWTPs are composed of activated sludge processes and different tertiary treatments (coagulation/sedimentation, sand-anthracite filters, membrane bioreactors (MBRs)/reverse osmosis (RO) and disinfection by chlorination). Physicochemical parameters were also evaluated to verify association with density of viruses detected in different treatment stages. HAdV, JCV and RVA were consistently detected (100%) in the sewage influent samples (range: 106-108 genome copies GC/L). In the secondary effluent, HAdV was detected in 100% (48/48) of the analysed samples, JCV in 85.4% and RVA in 97.9% (range: 104-107 GC/L for all viruses tested). HAdV was the most frequently detected virus in the tertiary effluent (62.2%) (28/45), exhibiting a viability between 0 and 44% of the tested samples in the wastewater reclamation systems. The MBR/RO systems demonstrated better virus removal efficiencies (range: 2.3-2.9 log10). Temperature, pH, turbidity and total organic carbon presented association with the viral density in the reclaimed water samples. Presence of viruses in treated effluents can indicates health risks depending on uses of recovery water. Further risk assessment studies should be conducted to better assess health risks under different exposure scenarios for water recovery in urban settings.
Collapse
Affiliation(s)
- Tatiana Prado
- Department of Environmental Analysis, Division of Microbiology and Parasitology, Environmental Company of the São Paulo State (CETESB), Av. Prof. Frederico Hermann Jr., 345, São Paulo, SP 05459-900, Brazil.
| | - Antônio de Castro Bruni
- Department of Environmental Analysis, Division of Microbiology and Parasitology, Environmental Company of the São Paulo State (CETESB), Av. Prof. Frederico Hermann Jr., 345, São Paulo, SP 05459-900, Brazil
| | - Mikaela Renata Funada Barbosa
- Department of Environmental Analysis, Division of Microbiology and Parasitology, Environmental Company of the São Paulo State (CETESB), Av. Prof. Frederico Hermann Jr., 345, São Paulo, SP 05459-900, Brazil
| | - Suzi Cristina Garcia
- Department of Environmental Analysis, Division of Microbiology and Parasitology, Environmental Company of the São Paulo State (CETESB), Av. Prof. Frederico Hermann Jr., 345, São Paulo, SP 05459-900, Brazil
| | - Adalgisa Maria de Jesus Melo
- Department of Environmental Analysis, Division of Microbiology and Parasitology, Environmental Company of the São Paulo State (CETESB), Av. Prof. Frederico Hermann Jr., 345, São Paulo, SP 05459-900, Brazil
| | - Maria Inês Zanoli Sato
- Department of Environmental Analysis, Division of Microbiology and Parasitology, Environmental Company of the São Paulo State (CETESB), Av. Prof. Frederico Hermann Jr., 345, São Paulo, SP 05459-900, Brazil
| |
Collapse
|
4
|
Zhang Y, Qu S, Xu L. Progress in the study of virus detection methods: The possibility of alternative methods to validate virus inactivation. Biotechnol Bioeng 2019; 116:2095-2102. [PMID: 31038205 DOI: 10.1002/bit.27003] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2019] [Revised: 03/21/2019] [Accepted: 04/25/2019] [Indexed: 11/09/2022]
Abstract
Virus inactivation validation studies have been widely applied in the risk assessment of biogenic material-based medical products, such as biological products, animal tissue-derived biomaterials, and allogeneic biomaterials, to decrease the risk of virus transmission. Traditional virus detection methods in an inactivation validation study utilize cell culture as a tool to quantify the infectious virus by observing cytopathic effects (CPEs) after virus inactivation. However, this is susceptible to subjective factors because CPEs must be observed by experts under a microscope during virus titration. In addition, this method is costly and time- and labor-consuming. Molecular biological technologies such as quantitative polymerase chain reaction (qPCR) have been widely used for virus detection but cannot distinguish infectious and noninfectious viruses. Therefore, qPCR cannot be directly applied to virus inactivation validation studies. In this paper, methods to detect viruses and progress in the challenge of differentiating infectious and noninfectious viruses with the combination of pretreatment and qPCR techniques such as the integrated cell culture-qPCR (ICC-qPCR) method are reviewed. In addition, the advantages and disadvantages of each new method, as well as its prospect in virus inactivation validation studies, are discussed.
Collapse
Affiliation(s)
- Yu Zhang
- Institute for Medical Devices Control, National Institutes for Food and Drug Control, Beijing, China.,School of Life Science and Engineering, Southwest Jiaotong University, Chengdu, Sichuan, China
| | - Shuxin Qu
- School of Life Science and Engineering, Southwest Jiaotong University, Chengdu, Sichuan, China
| | - Liming Xu
- Institute for Medical Devices Control, National Institutes for Food and Drug Control, Beijing, China
| |
Collapse
|
5
|
Kaas L, Ogorzaly L, Lecellier G, Berteaux-Lecellier V, Cauchie HM, Langlet J. Detection of Human Enteric Viruses in French Polynesian Wastewaters, Environmental Waters and Giant Clams. FOOD AND ENVIRONMENTAL VIROLOGY 2019; 11:52-64. [PMID: 30426392 DOI: 10.1007/s12560-018-9358-0] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/01/2018] [Accepted: 11/02/2018] [Indexed: 05/27/2023]
Abstract
Lack of wastewater treatment efficiency causes receiving seawaters and bivalve molluscan shellfish to become contaminated, which can lead to public health issues. Six wastewater samples, five seawater samples and three batches of giant clams from Tahiti (French Polynesia) were investigated for the presence of enteric viruses, but also if present, for the diversity, infectivity and integrity of human adenoviruses (HAdV). Enteroviruses (EV), sapoviruses (SaV) and human polyomaviruses (HPyV) were detected in all wastewater samples. In decreasing frequency, noroviruses (NoV) GII and HAdV, rotaviruses (RoV), astroviruses (AsV), NoV GI and finally hepatitis E viruses (HEV) were also observed. Nine types of infectious HAdV were identified. HPyV and EV were found in 80% of seawater samples, NoV GII in 60%, HAdV and SaV in 40% and AsV and RoV in 20%. NoV GI and HEV were not detected in seawater. Intact and infectious HAdV-41 were detected in one of the two seawater samples that gave a positive qPCR result. Hepatitis A viruses were never detected in any water types. Analysis of transcriptomic data from giant clams revealed homologues of fucosyltransferases (FUT genes) involved in ligand biosynthesis that strongly bind to certain NoV strains, supporting the giant clams ability to bioaccumulate NoV. This was confirmed by the presence of NoV GII in one of the three batches of giant clams placed in a contaminated marine area. Overall, all sample types were positive for at least one type of virus, some of which were infectious and therefore likely to cause public health concerns.
Collapse
Affiliation(s)
- Laetitia Kaas
- Enteric, Environmental and Food Virology Laboratory, Institute of Environmental Science and Research (ESR), Kenepuru Science Centre, PO BOX 50-348, Porirua, 5240, New Zealand
| | - Leslie Ogorzaly
- Department of Environmental Research and Innovation (ERIN), Luxembourg Institute of Science and Technology (LIST), Belvaux, Luxembourg
| | - Gaël Lecellier
- PSL CRIOBE USR3278 CNRS-EPHE-UPVD, Labex CORAIL, Papetoai, Moorea, French Polynesia
- Département de Biologie, Université de Paris Saclay UVSQ, 45 Ave des Etats-Unis, 78000, Versailles, France
- UMR250/9220 ENTROPIE IRD-CNRS-UR, Labex CORAIL, Promenade Roger-Laroque, Noumea Cedex, New Caledonia, France
| | - Véronique Berteaux-Lecellier
- PSL CRIOBE USR3278 CNRS-EPHE-UPVD, Labex CORAIL, Papetoai, Moorea, French Polynesia
- UMR250/9220 ENTROPIE IRD-CNRS-UR, Labex CORAIL, Promenade Roger-Laroque, Noumea Cedex, New Caledonia, France
| | - Henry-Michel Cauchie
- Department of Environmental Research and Innovation (ERIN), Luxembourg Institute of Science and Technology (LIST), Belvaux, Luxembourg
| | - Jérémie Langlet
- Enteric, Environmental and Food Virology Laboratory, Institute of Environmental Science and Research (ESR), Kenepuru Science Centre, PO BOX 50-348, Porirua, 5240, New Zealand.
| |
Collapse
|
6
|
Girardi V, Mena KD, Albino SM, Demoliner M, Gularte JS, de Souza FG, Rigotto C, Quevedo DM, Schneider VE, Paesi SO, Tarwater PM, Spilki FR. Microbial risk assessment in recreational freshwaters from southern Brazil. THE SCIENCE OF THE TOTAL ENVIRONMENT 2019; 651:298-308. [PMID: 30240914 DOI: 10.1016/j.scitotenv.2018.09.177] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/20/2018] [Revised: 09/12/2018] [Accepted: 09/13/2018] [Indexed: 06/08/2023]
Abstract
In this study, total coliforms (TC), Escherichia coli, enterovirus (EV), rotavirus (RV), and human mastadenovirus species C and F (HAdV-C and HAdV-F) were evaluated in water samples from Belo Stream. For HAdV-C and F, the infectivity was assessed by integrated cell culture quantitative real-time polymerase chain reaction (ICC-qPCR). Samples were collected monthly (May/2015 to April/2016) at four sites. Viral analyses were performed for both ultracentrifuge-concentrated and unconcentrated samples. For site P4 (used for recreational purposes), QMRA was applied to estimate health risks associated with exposure to E. coli and HAdV-C and F. TC and E. coli were present throughout the collection period. EV and RV were not detected. HAdV-C were present in 8.51% (1.89E + 06 to 2.28E + 07 GC (Genomic Copies)/L) and 21.27% (2.36E + 05 to 1.29E + 07 GC/L) for unconcentrated and concentrated samples, respectively. For HAdV-F were 12.76% (2.77E + 07 to 3.31E + 08 GC/L) and 48.93% (1.10E + 05 to 4.50E + 08 GC/L) for unconcentrated and concentrated samples, respectively. For unconcentrated samples, infectivity for HAdV-C was detected in 37.20% (1st ICC-qPCR) and 25.58% (2nd ICC-qPCR). For HAdV-F, infectivity was detected in 6.97% (1st ICC-qPCR) and 6.97% (2nd ICC-qPCR). For concentrated samples, HAdV-C infectious was observed in 17.02% (1st ICC-qPCR) and in 8.51% (2nd ICC-qPCR). For HAdV-F, were present in 8.51% for both 1st and 2nd ICC-qPCR. Statistical analyzes showed significant difference between the collection sites when analyzed the molecular data of HAdV-F, data of TC and E. coli. Correlation tests showed direct correlation between HAdV-F with E. coli and TC. E. coli concentrations translated to the lowest estimates of infection risks (8.58E-05 to 2.17E-03). HAdV-F concentrations were associated with the highest infection risks at 9.99E-01 and for group C, 1.29E-01 to 9.99E-01. These results show that commonly used bacterial indicators for water quality may not infer health risks associated with viruses in recreational freshwaters.
Collapse
Affiliation(s)
- Viviane Girardi
- Laboratório de Microbiologia Molecular, Universidade Feevale, ERS 239, no 2755, Novo Hamburgo, RS 93352-000, Brazil.
| | - Kristina D Mena
- School of Public Health, The University of Texas Health Science Center at Houston, El Paso, TX 79902, USA
| | - Suelen M Albino
- Departamento de Bioquímica, Instituto de Ciências Básicas da Saúde, Universidade Federal do Rio Grande do Sul, Ramiro Barcelos, no 2600, Porto Alegre, RS, Brazil
| | - Meriane Demoliner
- Laboratório de Microbiologia Molecular, Universidade Feevale, ERS 239, no 2755, Novo Hamburgo, RS 93352-000, Brazil
| | - Juliana S Gularte
- Laboratório de Microbiologia Molecular, Universidade Feevale, ERS 239, no 2755, Novo Hamburgo, RS 93352-000, Brazil
| | - Fernanda G de Souza
- Laboratório de Vírus, Instituto de Ciências Biológicas, Universidade Federal de Minas Gerais, Av. Antônio Carlos, no 6627, Belo Horizonte, MG, Brazil
| | - Caroline Rigotto
- Laboratório de Microbiologia Molecular, Universidade Feevale, ERS 239, no 2755, Novo Hamburgo, RS 93352-000, Brazil
| | - Daniela M Quevedo
- Programa de Pós-Graduação em Qualidade Ambiental, Universidade Feevale, ERS 239, no 2755, Novo Hamburgo, RS 93352-000, Brazil
| | - Vania E Schneider
- Instituto de Saneamento Ambiental (ISAM), Universidade de Caxias do Sul, Rua Francisco Getúlio Vargas, no 1130, Caxias do Sul, RS 95070-560, Brazil
| | - Suelen O Paesi
- Laboratório de Diagnóstico Molecular, Instituto de Biotecnologia, Universidade de Caxias do Sul, Rua Francisco Getúlio Vargas, no 1130, Caxias do Sul, RS 95070-560, Brazil
| | - Patrick M Tarwater
- School of Public Health, Department of Biostatistics, The University of Texas Health Science Center at Houston, El Paso, TX 79902, USA
| | - Fernando R Spilki
- Laboratório de Microbiologia Molecular, Universidade Feevale, ERS 239, no 2755, Novo Hamburgo, RS 93352-000, Brazil
| |
Collapse
|
7
|
Hamza IA, Bibby K. Critical issues in application of molecular methods to environmental virology. J Virol Methods 2019; 266:11-24. [PMID: 30659861 DOI: 10.1016/j.jviromet.2019.01.008] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2018] [Revised: 01/15/2019] [Accepted: 01/16/2019] [Indexed: 12/16/2022]
Abstract
Waterborne diseases have significant public health and socioeconomic implications worldwide. Many viral pathogens are commonly associated with water-related diseases, namely enteric viruses. Also, novel recently discovered human-associated viruses have been shown to be a causative agent of gastroenteritis or other clinical symptoms. A wide range of analytical methods is available for virus detection in environmental water samples. Viral isolation is historically carried out via propagation on permissive cell lines; however, some enteric viruses are difficult or not able to propagate on existing cell lines. Real-time polymerase chain reaction (qPCR) screening of viral nucleic acid is routinely used to investigate virus contamination in water due to the high sensitivity and specificity. Additionally, the introduction of metagenomic approaches into environmental virology has facilitated the discovery of viruses that cannot be grown in cell culture. This review (i) highlights the applications of molecular techniques in environmental virology such as PCR and its modifications to overcome the critical issues associated with the inability to discriminate between infectious viruses and nonviable viruses, (ii) outlines the strengths and weaknesses of Nucleic Acid Sequence Based Amplification (NASBA) and microarray, (iii) discusses the role of digital PCR as an emerging water quality monitoring assay and its advantages over qPCR, (iv) addresses the viral metagenomics in terms of detecting emerging viral pathogens and diversity in aquatic environment. Indeed, there are many challenges for selecting methods to detect classic and emerging viruses in environmental samples. While the existing techniques have revealed the importance and diversity of viruses in the water environment, further developments are necessary to enable more rapid and accurate methodologies for viral water quality monitoring and regulation.
Collapse
Affiliation(s)
- Ibrahim Ahmed Hamza
- Department of Water Pollution Research, National Research Centre, Cairo, Egypt.
| | - Kyle Bibby
- Department of Civil & Environmental Engineering & Earth Sciences, University of Notre Dame, USA
| |
Collapse
|
8
|
Sedji MI, Varbanov M, Meo M, Colin M, Mathieu L, Bertrand I. Quantification of human adenovirus and norovirus in river water in the north-east of France. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2018; 25:30497-30507. [PMID: 30168112 DOI: 10.1007/s11356-018-3045-4] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/02/2018] [Accepted: 08/23/2018] [Indexed: 04/16/2023]
Abstract
Human adenoviruses (HAdVs) are a major cause of infection and have been proposed as viral indicators of water quality. Human noroviruses (NoV) are the main cause of viral acute gastroenteritis. Quantitative data on the environmental prevalence of both viruses are needed. The genomes of HAdVs enteric adenovirus type 41 (HAdV41) and noroviruses of genogroups I and II (NoV GGI and GGII) were quantified over a 6-month period in a river located in north-eastern France. The samples were collected downstream from the discharge of a wastewater treatment plant. The viruses were concentrated using a glass wool method and the viral genomes were quantified using digital droplet PCR (ddPCR). All river water samples (15/15) were positive for the genomes of HAdVs, HAdV41, NoV GGI and NoV GGII. Concentrations of HAdVs, HAdV41 and NoV GII genomes were similar and HAdV41 represented ~ 80% of HAdVs. Infectious HAdVs were quantified in these samples using an integrated cell culture-quantitative PCR method (ICC-qPCR); they were detected in 93% (14/15) and quantified in 53% (8/15) of the samples. Thus, infectious HAdVs represented 0.3 to 12.2% of total HAdV particles detected by ddPCR. Infectious HAdV41 particles were found in 73% (11/15) of the samples. This common presence of pathogenic enteric viruses underlines the impact of wastewater discharge on quality of surface waters and may constitute a threat for human health. The relative abundance of genome of HAdV41 underlines the need for studies focusing on the specific detection of its infectious forms along water cycle.
Collapse
Affiliation(s)
- Maryse Iris Sedji
- Université de Lorraine, CNRS, LCPME (Laboratoire de Chimie Physique et Microbiologie pour les Matériaux et l'Environnement), F-54000, Nancy, France
| | - Mihayl Varbanov
- Université de Lorraine, CNRS, L2CM (Laboratoire Lorrain de Chimie Moléculaire), F-54000, Nancy, France
| | - Marie Meo
- Université de Lorraine, CNRS, LCPME (Laboratoire de Chimie Physique et Microbiologie pour les Matériaux et l'Environnement), F-54000, Nancy, France
| | - Marius Colin
- Université de Lorraine, CNRS, L2CM (Laboratoire Lorrain de Chimie Moléculaire), F-54000, Nancy, France
| | - Laurence Mathieu
- Université de Lorraine, CNRS, LCPME (Laboratoire de Chimie Physique et Microbiologie pour les Matériaux et l'Environnement), F-54000, Nancy, France
- EPHE, PSL Research University, LCPME, F-54000, Nancy, France
| | - Isabelle Bertrand
- Université de Lorraine, CNRS, LCPME (Laboratoire de Chimie Physique et Microbiologie pour les Matériaux et l'Environnement), F-54000, Nancy, France.
| |
Collapse
|
9
|
Guo X, Wang S, Zhao CL, Li JW, Zhong JY. An integrated cell absorption process and quantitative PCR assay for the detection of the infectious virus in water. THE SCIENCE OF THE TOTAL ENVIRONMENT 2018; 635:964-971. [PMID: 29710618 DOI: 10.1016/j.scitotenv.2018.04.223] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/07/2017] [Revised: 04/16/2018] [Accepted: 04/16/2018] [Indexed: 06/08/2023]
Abstract
Here we developed an integrated cell absorption process and quantitative (reverse transcription) polymerase chain reaction (ICAP-q(RT)PCR) assay to detect infectious viruses, which based on the detection of the viral nucleic acid (RNA or DNA) in the early stage of viral attachment and entry towards cells. The results showed that the poliovirus or adenovirus whose concentration was as low as 0.2 TCID50/mL could be detected by ICAP-q(RT)PCR after 4 h incubation. The ICAP-q(RT)PCR exhibited much higher sensitivity than the plaque assay. In parallel, it took shorter time to detect the viruses towards field samples compared with the integrated cell culture (ICC)-qPCR, but could still get the consistent detecting results with ICC-qPCR. This method is verified by detecting four different kinds of viruses including poliovirus, adenovirus, rotavirus, and astrovirus, which existed in the actual water samples. Among all the 24 Jinhe river samples, 50% (12/24) of river water samples were positive for poliovirus when detected by ICAP-q(RT)PCR, which was in accordance with the results detected by ICC-qPCR. However, 21% (5/24) and 68% (18/24) of the samples were detected to be positive for poliovirus by the plaque counting and the direct qPCR method, respectively. Compared with ICAP-q(PT)PCR and ICC-qPCR, the detecting results of qPCR or plaque assay displayed a marked expansion or decline, respectively, which lead to the evident deviations in the accuracy. The results demonstrated that our developed ICAP-q(RT)PCR method could dramatically reduce the test duration and quite improve the sensitivity towards infectious viruses. Therefore, the ICAP-q(RT)PCR method could be an effective and quantitative tool for detecting infectious viruses in water environments.
Collapse
Affiliation(s)
- Xuan Guo
- Research Institute of Chemical Defense, No. 1 Huaiyin Road, Beijing 102205, China; State Key Lab of NBC Protection for Civilian, No. 1 Huaiyin Road, Beijing 102205, China.
| | - Shang Wang
- Institute of Environmental and Operational Medicine, Key Laboratory of Risk Assessment and Control for Environment & Food Safety, No. 1 Dali Road, Tianjin 300050, China
| | - Chong-Lin Zhao
- Research Institute of Chemical Defense, No. 1 Huaiyin Road, Beijing 102205, China; State Key Lab of NBC Protection for Civilian, No. 1 Huaiyin Road, Beijing 102205, China
| | - Jun-Wen Li
- Institute of Environmental and Operational Medicine, Key Laboratory of Risk Assessment and Control for Environment & Food Safety, No. 1 Dali Road, Tianjin 300050, China
| | - Jin-Yi Zhong
- Research Institute of Chemical Defense, No. 1 Huaiyin Road, Beijing 102205, China; State Key Lab of NBC Protection for Civilian, No. 1 Huaiyin Road, Beijing 102205, China.
| |
Collapse
|
10
|
Shih YJ, Tao CW, Tsai HC, Huang WC, Huang TY, Chen JS, Chiu YC, Hsu TK, Hsu BM. First detection of enteric adenoviruses genotype 41 in recreation spring areas of Taiwan. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2017. [PMID: 28639027 DOI: 10.1007/s11356-017-9513-4] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/16/2023]
Abstract
Human adenoviruses (HAdVs) are DNA viruses found in recreational water, such as water parks and swimming pools. Human adenovirus 41 (HAdV-41) is the most common serotype detected and is a leading cause of acute diarrheal disease. The focus of this study is to determine the prevalence of HAdVs in hot springs. Of 57 samples collected from four different geological sites, 16 samples have shown evidence of HAdVs (28.1%). HAdV-41 and porcine adenovirus 5 (PAdV-5) were the two types isolated, with a greater frequency of HAdV-41, which in other settings has been associated with acute diarrhea. The highest occurrence was found in private hot tubs/Yuya (37.5%), followed by an outlet of hot springs (30.8%); public pools and foot pools shared the same detection rate of 21.4% (3/14). However, there was no evidence supporting a link between water quality indicators and HAdV detection rate. From a phylogenic analysis and BLAST against the NCBI database, it was concluded that HAdV-41 obtained from hot spring areas are closely related to global environmental genotypes.
Collapse
Affiliation(s)
- Yi-Jia Shih
- Department of Earth and Environmental Sciences, National Chung Cheng University, Chiayi, Taiwan, Republic of China
| | - Chi-Wei Tao
- Section of Respiratory Therapy, Cheng Hsin General Hospital, Taipei, Taiwan, Republic of China
| | - Hsin-Chi Tsai
- School of Medicine, Tzu-Chi University, Hualien, Taiwan, Republic of China
- Department of Psychiatry, Tzu-Chi General Hospital, Hualien, Taiwan, Republic of China
| | - Wen-Chien Huang
- Department of Medicine, Mackay Medicine College, Taipei, Taiwan, Republic of China
- Department of Thoracic Surgery, Mackay Memorial Hospital, Taipei, Taiwan, Republic of China
- Mackay Junior College of Medicine, Nursing, and Management, Taipei, Taiwan, Republic of China
| | - Tung-Yi Huang
- Department of Earth and Environmental Sciences, National Chung Cheng University, Chiayi, Taiwan, Republic of China
| | - Jung-Sheng Chen
- Graduate Institute of Life Sciences, National Defense Medical Center, Taipei, Taiwan, Republic of China
| | - Yi-Chou Chiu
- General Surgery, Surgical Department, Cheng Hsin General Hospital, Taipei, Taiwan, Republic of China
| | - Tsui-Kang Hsu
- Department of Ophthalmology, Cheng Hsin General Hospital, Taipei, Taiwan, Republic of China
| | - Bing-Mu Hsu
- Department of Earth and Environmental Sciences, National Chung Cheng University, Chiayi, Taiwan, Republic of China.
| |
Collapse
|
11
|
Hassard F, Gwyther CL, Farkas K, Andrews A, Jones V, Cox B, Brett H, Jones DL, McDonald JE, Malham SK. Abundance and Distribution of Enteric Bacteria and Viruses in Coastal and Estuarine Sediments-a Review. Front Microbiol 2016; 7:1692. [PMID: 27847499 PMCID: PMC5088438 DOI: 10.3389/fmicb.2016.01692] [Citation(s) in RCA: 60] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2016] [Accepted: 10/10/2016] [Indexed: 11/26/2022] Open
Abstract
The long term survival of fecal indicator organisms (FIOs) and human pathogenic microorganisms in sediments is important from a water quality, human health and ecological perspective. Typically, both bacteria and viruses strongly associate with particulate matter present in freshwater, estuarine and marine environments. This association tends to be stronger in finer textured sediments and is strongly influenced by the type and quantity of clay minerals and organic matter present. Binding to particle surfaces promotes the persistence of bacteria in the environment by offering physical and chemical protection from biotic and abiotic stresses. How bacterial and viral viability and pathogenicity is influenced by surface attachment requires further study. Typically, long-term association with surfaces including sediments induces bacteria to enter a viable-but-non-culturable (VBNC) state. Inherent methodological challenges of quantifying VBNC bacteria may lead to the frequent under-reporting of their abundance in sediments. The implications of this in a quantitative risk assessment context remain unclear. Similarly, sediments can harbor significant amounts of enteric viruses, however, the factors regulating their persistence remains poorly understood. Quantification of viruses in sediment remains problematic due to our poor ability to recover intact viral particles from sediment surfaces (typically <10%), our inability to distinguish between infective and damaged (non-infective) viral particles, aggregation of viral particles, and inhibition during qPCR. This suggests that the true viral titre in sediments may be being vastly underestimated. In turn, this is limiting our ability to understand the fate and transport of viruses in sediments. Model systems (e.g., human cell culture) are also lacking for some key viruses, preventing our ability to evaluate the infectivity of viruses recovered from sediments (e.g., norovirus). The release of particle-bound bacteria and viruses into the water column during sediment resuspension also represents a risk to water quality. In conclusion, our poor process level understanding of viral/bacterial-sediment interactions combined with methodological challenges is limiting the accurate source apportionment and quantitative microbial risk assessment for pathogenic organisms associated with sediments in aquatic environments.
Collapse
Affiliation(s)
| | - Ceri L. Gwyther
- Department of Engineering and Innovation, Open UniversityMilton Keynes, UK
| | - Kata Farkas
- School of Environment, Natural Resources and Geography, Bangor UniversityBangor, UK
| | | | | | | | | | - Davey L. Jones
- School of Environment, Natural Resources and Geography, Bangor UniversityBangor, UK
| | | | | |
Collapse
|
12
|
Fernandez-Cassi X, Silvera C, Cervero-Aragó S, Rusiñol M, Latif-Eugeni F, Bruguera-Casamada C, Civit S, Araujo RM, Figueras MJ, Girones R, Bofill-Mas S. Evaluation of the microbiological quality of reclaimed water produced from a lagooning system. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2016; 23:16816-33. [PMID: 27194016 DOI: 10.1007/s11356-016-6812-0] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/07/2016] [Accepted: 05/02/2016] [Indexed: 05/07/2023]
Abstract
The use of lagooning as a complementary natural method of treating secondary effluents of wastewater treatment plants has been employed as an affordable and easy means of producing reclaimed water. However, using reclaimed water for some purposes, for example, for food irrigation, presents some risks if the effluents contain microbial pathogens. Classical bacterial indicators that are used to assess faecal contamination in water do not always properly indicate the presence of bacterial or viral pathogens. In the current study, the presence of faecal indicator bacteria (FIB), heterotrophic bacterial counts (HBC), pathogens and opportunistic pathogens, such as Legionella spp., Aeromonas spp., Arcobacter spp., free-living amoeba (FLA), several viral indicators (human adenovirus and polyomavirus JC) and viral pathogens (noroviruses and hepatitis E virus) were analysed for 1 year in inlet and outlet water to assess the removal efficiency of a lagooning system. We observed 2.58 (1.17-4.59) and 1.65 (0.15-3.14) log reductions in Escherichia coli (EC) and intestinal enterococci (IE), respectively, between the inlet and outlet samples. Genomic copies of the viruses were log reduced by 1.18 (0.24-2.93), 0.64 (0.12-1.97), 0.45 (0.04-2.54) and 0.72 (0.22-2.50) for human adenovirus (HAdV), JC polyomavirus (JCPyV) and human noroviruses (NoV GI and GII), respectively. No regrowth of opportunistic pathogens was observed within the system. FLA, detected in all samples, did not show a clear trend. The reduction of faecal pathogens was irregular with 6 out of 12 samples and 4 out of 12 samples exceeding the EC and IE values, specified in the Spanish legislation for reclaimed water (RD 1620/2007). This data evidences that there is a need for more studies to evaluate the removal mechanisms of lagooning systems in order to optimize pathogen reduction. Moreover, surveillance of water used to irrigate raw edible vegetables should be conducted to ensure the fulfilment of the microbial requirements for the production of safe reclaimed water.
Collapse
Affiliation(s)
- X Fernandez-Cassi
- Department of Microbiology, Faculty of Biology, University of Barcelona, Barcelona, Spain.
| | - C Silvera
- Unitat de Microbiologia, Departament de Ciènces Médiques Bàsiques, Facultat de Medicina i Ciències de la Salut, IISPV, Universitat Rovira i Virgili, Reus, Spain
| | - S Cervero-Aragó
- Department of Microbiology, Faculty of Biology, University of Barcelona, Barcelona, Spain
- Water Hygiene, Institute for Hygiene and Applied Immunology, Medical University of Vienna, Vienna, Austria
- ICC Water and Health, Vienna, Austria
| | - M Rusiñol
- Department of Microbiology, Faculty of Biology, University of Barcelona, Barcelona, Spain
| | - F Latif-Eugeni
- Unitat de Microbiologia, Departament de Ciènces Médiques Bàsiques, Facultat de Medicina i Ciències de la Salut, IISPV, Universitat Rovira i Virgili, Reus, Spain
| | - C Bruguera-Casamada
- Department of Microbiology, Faculty of Biology, University of Barcelona, Barcelona, Spain
| | - S Civit
- Department of Statistics, Faculty of Biology, University of Barcelona, Barcelona, Spain
| | - R M Araujo
- Department of Microbiology, Faculty of Biology, University of Barcelona, Barcelona, Spain
| | - M J Figueras
- Unitat de Microbiologia, Departament de Ciènces Médiques Bàsiques, Facultat de Medicina i Ciències de la Salut, IISPV, Universitat Rovira i Virgili, Reus, Spain
| | - R Girones
- Department of Microbiology, Faculty of Biology, University of Barcelona, Barcelona, Spain
| | - S Bofill-Mas
- Department of Microbiology, Faculty of Biology, University of Barcelona, Barcelona, Spain
| |
Collapse
|
13
|
Rames E, Roiko A, Stratton H, Macdonald J. Technical aspects of using human adenovirus as a viral water quality indicator. WATER RESEARCH 2016; 96:308-26. [PMID: 27065054 DOI: 10.1016/j.watres.2016.03.042] [Citation(s) in RCA: 75] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/05/2015] [Revised: 03/01/2016] [Accepted: 03/18/2016] [Indexed: 05/21/2023]
Abstract
Despite dramatic improvements in water treatment technologies in developed countries, waterborne viruses are still associated with many of cases of illness each year. These illnesses include gastroenteritis, meningitis, encephalitis, and respiratory infections. Importantly, outbreaks of viral disease from waters deemed compliant from bacterial indicator testing still occur, which highlights the need to monitor the virological quality of water. Human adenoviruses are often used as a viral indicator of water quality (faecal contamination), as this pathogen has high UV-resistance and is prevalent in untreated domestic wastewater all year round, unlike enteroviruses and noroviruses that are often only detected in certain seasons. Standard methods for recovering and measuring adenovirus numbers in water are lacking, and there are many variations in published methods. Since viral numbers are likely under-estimated when optimal methods are not used, a comprehensive review of these methods is both timely and important. This review critically evaluates how estimates of adenovirus numbers in water are impacted by technical manipulations, such as during adenovirus concentration and detection (including culturing and polymerase-chain reaction). An understanding of the implications of these issues is fundamental to obtaining reliable estimation of adenovirus numbers in water. Reliable estimation of HAdV numbers is critical to enable improved monitoring of the efficacy of water treatment processes, accurate quantitative microbial risk assessment, and to ensure microbiological safety of water.
Collapse
Affiliation(s)
- Emily Rames
- Genecology Research Centre, School of Science and Engineering, University of the Sunshine Coast, 90 Sippy Downs Dr, Sippy Downs, Queensland, 4556, Australia
| | - Anne Roiko
- School of Medicine and Menzies Health Institute Queensland, Griffith University, Australia; Smart Water Research Centre, Griffith University, Gold Coast Campus, Edmund Rice Drive, Queensland, 4222, Australia
| | - Helen Stratton
- Smart Water Research Centre, Griffith University, Gold Coast Campus, Edmund Rice Drive, Queensland, 4222, Australia; School of Natural Sciences, Griffith University, Australia
| | - Joanne Macdonald
- Genecology Research Centre, School of Science and Engineering, University of the Sunshine Coast, 90 Sippy Downs Dr, Sippy Downs, Queensland, 4556, Australia; Division of Experimental Therapeutics, Columbia University, New York, NY 10032, USA.
| |
Collapse
|
14
|
Calusinska M, Marynowska M, Goux X, Lentzen E, Delfosse P. Analysis of dsDNA and RNA viromes in methanogenic digesters reveals novel viral genetic diversity. Environ Microbiol 2016; 18:1162-75. [PMID: 26568175 PMCID: PMC7163765 DOI: 10.1111/1462-2920.13127] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2014] [Revised: 08/17/2015] [Accepted: 11/06/2015] [Indexed: 01/08/2023]
Abstract
Although viruses are not the key players of the anaerobic digestion process, they may affect the dynamics of bacterial and archaeal populations involved in biogas production. Until now viruses have received very little attention in this specific habitat; therefore, as a first step towards their characterization, we optimized a virus filtration protocol from anaerobic sludge. Afterwards, to assess dsDNA and RNA viral diversity in sludge samples from nine different reactors fed either with waste water, agricultural residues or solid municipal waste plus agro‐food residues, we performed metagenomic analyses. As a result we showed that, while the dsDNA viromes (21 assigned families in total) were dominated by dsDNA phages of the order Caudovirales, RNA viruses (14 assigned families in total) were less diverse and were for the main part plant‐infecting viruses. Interestingly, less than 2% of annotated contigs were assigned as putative human and animal pathogens. Our study greatly extends the existing view of viral genetic diversity in methanogenic reactors and shows that these viral assemblages are distinct not only among the reactor types but also from nearly 30 other environments already studied, including the human gut, fermented food, deep sea sediments and other aquatic habitats.
Collapse
Affiliation(s)
- Magdalena Calusinska
- Luxembourg Institute of Science and Technology, Environmental Research and Innovation (ERIN), 41 rue du Brill, L-4422, Belvaux, Luxembourg
| | - Martyna Marynowska
- Luxembourg Institute of Science and Technology, Environmental Research and Innovation (ERIN), 41 rue du Brill, L-4422, Belvaux, Luxembourg.,Intercollegiate Faculty of Biotechnology, University of Gdansk and Medical University of Gdansk, ul. Kladki 24, 80-822, Gdansk, Poland
| | - Xavier Goux
- Luxembourg Institute of Science and Technology, Environmental Research and Innovation (ERIN), 41 rue du Brill, L-4422, Belvaux, Luxembourg
| | - Esther Lentzen
- Luxembourg Institute of Science and Technology, Materials Research and Technology (MRT), 41 rue du Brill, L-4422, Belvaux, Luxembourg
| | - Philippe Delfosse
- Luxembourg Institute of Science and Technology, Environmental Research and Innovation (ERIN), 41 rue du Brill, L-4422, Belvaux, Luxembourg
| |
Collapse
|
15
|
Ogorzaly L, Walczak C, Galloux M, Etienne S, Gassilloud B, Cauchie HM. Human Adenovirus Diversity in Water Samples Using a Next-Generation Amplicon Sequencing Approach. FOOD AND ENVIRONMENTAL VIROLOGY 2015; 7:112-121. [PMID: 25917314 DOI: 10.1007/s12560-015-9194-4] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/18/2014] [Accepted: 03/30/2015] [Indexed: 05/18/2023]
Abstract
This study aims to establish a straightforward and original workflow for high-throughput typing of human adenoviruses (HAdVs) in environmental samples. Occurrence of HAdVs in water is well documented worldwide, but data on diversity of HAdV types circulating in water are scarcely available. Here, the characterisation of viral particles was performed by determination of amplicon sequences using a next-generation sequencing (NGS) approach. Adenoviral DNA was either directly isolated from wastewater or river water concentrates or after a cell culture passage. Genome amplification targeted a hyper variable region of the hexon gene, allowing the discrimination of the 54 human adenoviral types described until now. After read generation on the benchtop MiSeq platform (Illumina), data were analysed using the Mothur software for identification of all HAdV species and types simultaneously present in a unique sample. NGS results showed a relatively wide HAdV diversity of up to six types in one sample, whereas Sanger sequencing always only retrieved the dominant one. Detected types included HAdV-1, HAdV-2, HAdV-3, HAdV-6, HAdV-12, HAdV-31, HAdV-40 and HAdV-41, HAdV-41 being the most abundant in tested samples. In addition, the influence of the cell line (A549 vs 293A cells) on the infectious HAdV typing results was clearly determined. The 293A appeared to be the most suitable cell line allowing the detection of a larger diversity of infectious HAdVs and reflecting a more realistic initial species distribution than using the A549 cells. These findings demonstrated the feasibility of amplicon sequencing NGS approach to identify viruses in complex environmental water samples.
Collapse
Affiliation(s)
- Leslie Ogorzaly
- Department of Environmental Research and Innovation (ERIN), Luxembourg Institute of Science and Technology (LIST), 41, rue du Brill, 4422, Belvaux, Luxembourg,
| | | | | | | | | | | |
Collapse
|
16
|
P2X2 and P2X5 Receptors Mediate Bladder Hyperesthesia in ICC in Female Overactive Bladder. Cell Biochem Biophys 2015; 72:375-83. [DOI: 10.1007/s12013-014-0471-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
17
|
Field evaluation of an improved cell line for the detection of human adenoviruses in environmental samples. J Virol Methods 2014; 205:68-74. [DOI: 10.1016/j.jviromet.2014.05.002] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2013] [Revised: 04/23/2014] [Accepted: 05/02/2014] [Indexed: 11/19/2022]
|