1
|
Burgess C, Todd SM, Hungerford L, Lahmers K. Determining diagnostic sensitivity loss limits for sample pooling in duplex rtPCR surveillance testing: Theileria orientalis and Anaplasma marginale. J Vet Diagn Invest 2025; 37:71-78. [PMID: 39460723 PMCID: PMC11559834 DOI: 10.1177/10406387241287516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2024] Open
Abstract
To expand surveillance testing capacity through sample pooling, a thorough understanding is needed of how sample dilution through pooling affects the sensitivity of candidate assays. We validated a robust and representative framework for assessing the dilution effect of sample pooling using duplex rtPCR surveillance of Theileria orientalis and Anaplasma marginale, both of which are causative agents of severe anemia in cattle and a serious threat to the cattle industry in Virginia and many other states. We used 200 known-positive samples with Ct values representative of typical surveillance results in a series of pools in which we re-tested each sample individually, followed by each sample diluted in equal volumes with negative samples to make pools of 2, 4, 6, 8, and 10 total samples. We compared the Ct values of the individual positives with the Ct values of each pool size to determine if Ct values increase past the limit of detection in the 45-cycle assay. We observed a maximum of 2% sensitivity loss (no more than 2 of 100 samples returned a false-negative result) for both T. orientalis and A. marginale during the pooling series, with lower-than-expected average Ct increase and sensitivity loss. We conclude that pooling up to 10 samples would be acceptable for regional surveillance of T. orientalis and A. marginale using our rtPCR assay. The described strategy is applicable to validate pooling for a wide range of single and duplex rtPCR assays, which could expand efficient disease surveillance.
Collapse
Affiliation(s)
- Catharine Burgess
- Department of Biomedical Sciences and Pathobiology, Virginia Maryland College of Veterinary Medicine, Virginia Tech, Blacksburg, VA, USA
- Graduate Program in Translational Biology, Medicine and Health, Virginia Maryland College of Veterinary Medicine, Virginia Tech, Blacksburg, VA, USA
| | - S. Michelle Todd
- Department of Biomedical Sciences and Pathobiology, Virginia Maryland College of Veterinary Medicine, Virginia Tech, Blacksburg, VA, USA
- Virginia Tech Animal Laboratory Services(ViTALS), Virginia Maryland College of Veterinary Medicine, Virginia Tech, Blacksburg, VA, USA
| | - Laura Hungerford
- Department of Population Health Science, Virginia Maryland College of Veterinary Medicine, Virginia Tech, Blacksburg, VA, USA
| | - Kevin Lahmers
- Department of Biomedical Sciences and Pathobiology, Virginia Maryland College of Veterinary Medicine, Virginia Tech, Blacksburg, VA, USA
- Virginia Tech Animal Laboratory Services(ViTALS), Virginia Maryland College of Veterinary Medicine, Virginia Tech, Blacksburg, VA, USA
| |
Collapse
|
2
|
Saraiva GQ. Pool testing with dilution effects and heterogeneous priors. Health Care Manag Sci 2023; 26:651-672. [PMID: 37526758 DOI: 10.1007/s10729-023-09650-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2022] [Accepted: 06/25/2023] [Indexed: 08/02/2023]
Abstract
The Dorfman pooled testing scheme is a process in which individual specimens (e.g., blood, urine, swabs, etc.) are pooled and tested together; if the merged sample tests positive for infection, then each specimen from the pool is tested individually. Through this procedure, laboratories can reduce the expected number of tests required to screen the population, as individual tests are only carried out when the pooled test detects an infection. Several different partitions of the population can be used to form the pools. In this study, we analyze the performance of ordered partitions, those in which subjects with similar probability of infection are pooled together. We derive sufficient conditions under which ordered partitions outperform other types of partitions in terms of minimizing the expected number of tests, the expected number of false negatives, and the expected number of false positive classifications. These sufficient conditions can be easily verified in practical applications once the dilution effect has been estimated. We also propose a measure of equity and present conditions under which this measure is maximized by ordered partitions.
Collapse
Affiliation(s)
- Gustavo Quinderé Saraiva
- Business School, Pontificia Universidad Católica de Chile, Vicuña Mackenna 4860, Macul, Santiago, Chile.
| |
Collapse
|
3
|
Warasi S, Tebbs JM, McMahan CS, Bilder CR. Estimating the prevalence of two or more diseases using outcomes from multiplex group testing. Biom J 2023; 65:e2200270. [PMID: 37192524 PMCID: PMC11099910 DOI: 10.1002/bimj.202200270] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Revised: 02/26/2023] [Accepted: 03/01/2023] [Indexed: 05/18/2023]
Abstract
When screening a population for infectious diseases, pooling individual specimens (e.g., blood, swabs, urine, etc.) can provide enormous cost savings when compared to testing specimens individually. In the biostatistics literature, testing pools of specimens is commonly known as group testing or pooled testing. Although estimating a population-level prevalence with group testing data has received a large amount of attention, most of this work has focused on applications involving a single disease, such as human immunodeficiency virus. Modern methods of screening now involve testing pools and individuals for multiple diseases simultaneously through the use of multiplex assays. Hou et al. (2017, Biometrics, 73, 656-665) and Hou et al. (2020, Biostatistics, 21, 417-431) recently proposed group testing protocols for multiplex assays and derived relevant case identification characteristics, including the expected number of tests and those which quantify classification accuracy. In this article, we describe Bayesian methods to estimate population-level disease probabilities from implementing these protocols or any other multiplex group testing protocol which might be carried out in practice. Our estimation methods can be used with multiplex assays for two or more diseases while incorporating the possibility of test misclassification for each disease. We use chlamydia and gonorrhea testing data collected at the State Hygienic Laboratory at the University of Iowa to illustrate our work. We also provide an online R resource practitioners can use to implement the methods in this article.
Collapse
Affiliation(s)
- S. Warasi
- Department of Mathematics and Statistics, Radford University, Radford, VA 24142, USA
| | - Joshua M. Tebbs
- Department of Statistics, University of South Carolina, Columbia, SC 29208, USA
| | - Christopher S. McMahan
- School of Mathematical and Statistical Sciences, Clemson University, Clemson, SC 29634, USA
| | | |
Collapse
|
4
|
Self S, McMahan C, Mokalled S. Capturing the pool dilution effect in group testing regression: A Bayesian approach. Stat Med 2022; 41:4682-4696. [PMID: 35879887 PMCID: PMC9489666 DOI: 10.1002/sim.9532] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2021] [Revised: 07/01/2022] [Accepted: 07/05/2022] [Indexed: 01/07/2023]
Abstract
Group (pooled) testing is becoming a popular strategy for screening large populations for infectious diseases. This popularity is owed to the cost savings that can be realized through implementing group testing methods. These methods involve physically combining biomaterial (eg, saliva, blood, urine) collected on individuals into pooled specimens which are tested for an infection of interest. Through testing these pooled specimens, group testing methods reduce the cost of diagnosing all individuals under study by reducing the number of tests performed. Even though group testing offers substantial cost reductions, some practitioners are hesitant to adopt group testing methods due to the so-called dilution effect. The dilution effect describes the phenomenon in which biomaterial from negative individuals dilute the contributions from positive individuals to such a degree that a pool is incorrectly classified. Ignoring the dilution effect can reduce classification accuracy and lead to bias in parameter estimates and inaccurate inference. To circumvent these issues, we propose a Bayesian regression methodology which directly acknowledges the dilution effect while accommodating data that arises from any group testing protocol. As a part of our estimation strategy, we are able to identify pool specific optimal classification thresholds which are aimed at maximizing the classification accuracy of the group testing protocol being implemented. These two features working in concert effectively alleviate the primary concerns raised by practitioners regarding group testing. The performance of our methodology is illustrated via an extensive simulation study and by being applied to Hepatitis B data collected on Irish prisoners.
Collapse
Affiliation(s)
- Stella Self
- Department of Epidemiology and Biostatistics, Arnold School of Public HealthUniversity of South CarolinaColumbiaSouth CarolinaUSA
| | - Christopher McMahan
- School of Mathematical and Statistical SciencesClemson UniversityClemsonSouth CarolinaUSA
| | - Stefani Mokalled
- School of Mathematical and Statistical SciencesClemson UniversityClemsonSouth CarolinaUSA
| |
Collapse
|
5
|
Warasi MS, Hungerford LL, Lahmers K. Optimizing Pooled Testing for Estimating the Prevalence of Multiple Diseases. JOURNAL OF AGRICULTURAL, BIOLOGICAL AND ENVIRONMENTAL STATISTICS 2022; 27:713-727. [PMID: 35975123 PMCID: PMC9373899 DOI: 10.1007/s13253-022-00511-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/01/2022] [Revised: 05/27/2022] [Accepted: 07/27/2022] [Indexed: 11/25/2022]
Abstract
Pooled testing can enhance the efficiency of diagnosing individuals with diseases of low prevalence. Often, pooling is implemented using standard groupings (2, 5, 10, etc.). On the other hand, optimization theory can provide specific guidelines in finding the ideal pool size and pooling strategy. This article focuses on optimizing the precision of disease prevalence estimators calculated from multiplex pooled testing data. In the context of a surveillance application of animal diseases, we study the estimation efficiency (i.e., precision) and cost efficiency of the estimators with adjustments for the number of expended tests. This enables us to determine the pooling strategies that offer the highest benefits when jointly estimating the prevalence of multiple diseases, such as theileriosis and anaplasmosis. The outcomes of our work can be used in designing pooled testing protocols, not only in simple pooling scenarios but also in more complex scenarios where individual retesting is performed in order to identify positive cases. A software application using the shiny package in R is provided with this article to facilitate implementation of our methods. Supplementary materials accompanying this paper appear online.
Collapse
Affiliation(s)
- Md S. Warasi
- Department of Mathematics and Statistics, Radford University, Whitt Hall 224, Radford, VA 24142 USA
| | - Laura L. Hungerford
- Virginia-Maryland College of Veterinary Medicine, Virginia Tech, Blacksburg, VA 24061 USA
| | - Kevin Lahmers
- Virginia-Maryland College of Veterinary Medicine, Virginia Tech, Blacksburg, VA 24061 USA
| |
Collapse
|
6
|
Mokalled SC, McMahan CS, Tebbs JM, Andrew Brown D, Bilder CR. Incorporating the dilution effect in group testing regression. Stat Med 2021; 40:2540-2555. [PMID: 33598950 DOI: 10.1002/sim.8916] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2020] [Revised: 11/25/2020] [Accepted: 02/03/2021] [Indexed: 11/10/2022]
Abstract
When screening for infectious diseases, group testing has proven to be a cost efficient alternative to individual level testing. Cost savings are realized by testing pools of individual specimens (eg, blood, urine, saliva, and so on) rather than by testing the specimens separately. However, a common concern that arises in group testing is the so-called "dilution effect." This occurs if the signal from a positive individual's specimen is diluted past an assay's threshold of detection when it is pooled with multiple negative specimens. In this article, we propose a new statistical framework for group testing data that merges estimation and case identification, which are often treated separately in the literature. Our approach considers analyzing continuous biomarker levels (eg, antibody levels, antigen concentrations, and so on) from pooled samples to estimate both a binary regression model for the probability of disease and the biomarker distributions for cases and controls. To increase case identification accuracy, we then show how estimates of the biomarker distributions can be used to select diagnostic thresholds on a pool-by-pool basis. Our proposals are evaluated through numerical studies and are illustrated using hepatitis B virus data collected on a prison population in Ireland.
Collapse
Affiliation(s)
- Stefani C Mokalled
- School of Mathematical and Statistical Sciences, Clemson University, Clemson, South Carolina, USA
| | - Christopher S McMahan
- School of Mathematical and Statistical Sciences, Clemson University, Clemson, South Carolina, USA
| | - Joshua M Tebbs
- Department of Statistics, University of South Carolina, Columbia, South Carolina, USA
| | - Derek Andrew Brown
- School of Mathematical and Statistical Sciences, Clemson University, Clemson, South Carolina, USA
| | - Christopher R Bilder
- Department of Statistics, University of Nebraska-Lincoln, Lincoln, Nebraska, USA
| |
Collapse
|