Consensus-based reporting standards for diagnostic test accuracy studies for paratuberculosis in ruminants

PRIDASE 2024 guidelines for reporting diagnostic accuracy studies in endodontics: A consensus-based development

Studies investigating the accuracy of diagnostic tests should provide data on how effectively they identify or exclude disease in order to inform clinicians responsible for managing patients. This consensus-based project was undertaken to develop reporting guidelines for authors submitting manuscripts, which describe studies that have evaluated the accuracy of diagnostic tests in endodontics. These guidelines are known as the Preferred Reporting Items for Diagnostic Accuracy Studies in Endodontics (PRIDASE) 2024 guidelines. A nine-member steering committee created an initial checklist by integrating and modifying items from the Standards for Reporting of Diagnostic Accuracy (STARD) 2015 checklist and the Clinical and Laboratory Images in Publications (CLIP) principles, as well as adding a number of new items specific to the specialty of endodontics. Thereafter, the steering committee formed the PRIDASE Delphi Group (PDG) and the PRIDASE Online Meeting Group (POMG) in order to collect expert feedback on the preliminary draft checklist. Members of the Delphi group engaged in an online Delphi process to reach consensus on the clarity and suitability of the items in the checklist. The online meeting group then held an in-depth discussion on the online Delphi-generated items via the Zoom platform on 20 October 2023. According to the feedback obtained, the steering committee revised the PRIDASE checklist, which was then piloted by several authors when preparing manuscripts describing diagnostic accuracy studies in endodontics. Feedback from this process resulted in the final version of the PRIDASE 2024 checklist, which has 11 sections and 66 items. Authors are encouraged to use the PRIDASE 2024 guidelines when developing manuscripts on diagnostic accuracy in endodontics in order to improve the quality of reporting in this area. Editors of relevant journals will be invited to include these guidelines in their instructions to authors.

Estimating the sensitivity and specificity of serum ELISA and pooled and individual fecal PCR for detecting Mycobacterium avium subspecies paratuberculosis in Canadian cow-calf herds using Bayesian latent class models

While Johne's disease (JD) is less common in beef than in dairy herds, consolidation is increasing transmission risk. Estimates of Mycobacterium avium spp. paratuberculosis (MAP) prevalence and test performance in cow-calf herds are needed to inform control programs. Objectives of this study included describing the prevalence of MAP in Canadian cow-calf herds and comparing the relative performance of a serum ELISA, pooled fecal PCR and individual fecal PCR using Bayesian latent class models, and to investigate factors associated with positive MAP tests. Blood and fecal samples (n = 3,171) were collected from 159 Canadian cow-calf herds. All samples were analyzed using serum ELISA and fecal PCR (pools of five samples) and a subset of 913 fecal samples were also tested with individual PCR. Based on latent class analysis, MAP prevalence was higher in eastern compared to western Canada for both animals {East, 3% [95% Credible Interval (CrI) 1-7%]; West, 1% [95% CrI 0.2-2%]} and herds [East, 15% (95% CrI 2-35%); West, 10% (95% CrI 1-26%), based on one or more positive results]. Sensitivity (Se) and specificity (Sp) for animal level individual PCR were 96% (95% CrI 80-100%) and 98% (95% CrI 96-100%), respectively followed by pooled PCR [Se = 54% (95% CrI 36-72%), Sp > 99.9% (95% CrI 99.8-100%)] and ELISA [Se = 36% (95% CrI 22-52%), Sp = 98% (95% CrI 96-99%)]. Based on 20 samples per herd, the herd level Se of ELISA was 79% (95% CrI 47-100%) (at least one positive sample) compared to 43% (95% CrI 14-94%) for pooled PCR. Herd-level Sp was 99% (95% CrI 96-100%) for pooled PCR and 90% (95% CrI 83-100%) for ELISA. Cows from herds with dairy cattle on farm and cows with symptoms of JD in the past 3 years were more likely to be MAP positive. Herds that had animals with JD symptoms in the previous 3 years and those with more breeding females were most likely to test positive for MAP. While serum ELISA can be effective for herd screening, PCR performed better for animal testing. Pooled PCR testing could be a less costly option; however, determining the most cost-effective approach will require further economic analysis.

Bayesian estimation of sensitivity and specificity of fecal culture, fecal PCR and serum ELISA for diagnosis of Mycobacterium avium subsp. paratuberculosis infections in sheep

The objective of the present study was to evaluate the diagnostic accuracy of the individual fecal culture (IFC), fecal PCR (FPCR), and serum ELISA for the detection of Mycobacterium avium subsp. paratuberculosis (MAP) infections in sheep from four governorates in Egypt, using a latent class model (LCM) fitted within a Bayesian framework. Furthermore, the within-governorate prevalence of MAP infection in sheep was estimated as a secondary objective. Fecal and blood samples were collected from 370 sheep in four Egyptian governorates. Fecal samples were analyzed by IFC and RT-PCR based on ISMav2 gene, while ELISA was performed on serum samples. The sensitivity (Se) and specificity (Sp) of the three diagnostic tests were estimated using a three-tests-four-populations Bayesian LCM to obtain posterior estimates [medians and 95% Bayesian credible intervals (95% BCI)] for each parameter. The median Se estimates (95% BCI) for IFC, FPCR, and serum ELISA were 31.8% (22.8-41.4), 49.7% (31.8-79.9), and 61.2% (39.8-81.4), respectively. The median Sp estimates (95% BCI) for IFC, FPCR, and serum ELISA were 97.7% (96.1-98.9), 97.7% (95.6-99.5), and 98.4% (96.9-99.3), respectively. The median within-governorate paratuberculosis prevalence (95% BCI) was 5.2% (1.1-13.6), 8.4% (2.9-17.7), 9.4% (3.0-20.7), and 18.2% (10.5-29.5) for the Gharbia, Menoufia, Qalyubia, and Kafr El-Sheikh governorates, respectively. In conclusion, at a ratio of the optical density (OD) sample/OD positive control threshold of > 45%, ELISA showed the highest Se among the three tests and comparable Sp to IFC and FPCR. The test ELISA evaluated in this study is an interesting alternative for detecting MAP in sheep due to its higher Se, lower cost, and shorter turnaround laboratory time compared to IFC and FPCR.

Portable stroke detection devices: a systematic scoping review of prehospital applications

BACKGROUND

The worldwide burden of stroke remains high, with increasing time-to-treatment correlated with worse outcomes. Yet stroke subtype determination, most importantly between stroke/non-stroke and ischemic/hemorrhagic stroke, is not confirmed until hospital CT diagnosis, resulting in suboptimal prehospital triage and delayed treatment. In this study, we survey portable, non-invasive diagnostic technologies that could streamline triage by making this initial determination of stroke type, thereby reducing time-to-treatment.

METHODS

Following PRISMA guidelines, we performed a scoping review of portable stroke diagnostic devices. The search was executed in PubMed and Scopus, and all studies testing technology for the detection of stroke or intracranial hemorrhage were eligible for inclusion. Extracted data included type of technology, location, feasibility, time to results, and diagnostic accuracy.

RESULTS

After a screening of 296 studies, 16 papers were selected for inclusion. Studied devices utilized various types of diagnostic technology, including near-infrared spectroscopy (6), ultrasound (4), electroencephalography (4), microwave technology (1), and volumetric impedance spectroscopy (1). Three devices were tested prior to hospital arrival, 6 were tested in the emergency department, and 7 were tested in unspecified hospital settings. Median measurement time was 3 minutes (IQR: 3 minutes to 5.6 minutes). Several technologies showed high diagnostic accuracy in severe stroke and intracranial hematoma detection.

CONCLUSION

Numerous emerging portable technologies have been reported to detect and stratify stroke to potentially improve prehospital triage. However, the majority of these current technologies are still in development and utilize a variety of accuracy metrics, making inter-technology comparisons difficult. Standardizing evaluation of diagnostic accuracy may be helpful in further optimizing portable stroke detection technology for clinical use.

Bayesian estimation of sensitivity and specificity of a rapid mastitis test kit, bacterial culture, and PCR for detection of Staphylococcus aureus, Streptococcus species, and coliforms in bovine milk samples

Our objectives were to evaluate the diagnostic accuracy of a rapid and novel immunochromatography-based mastitis kit that includes 3 independent tests to detect coliforms (Escherichia coli or Klebsiella pneumoniae), Streptococcus spp., and Staphylococcus aureus. The kit was developed to facilitate diagnostic-based mastitis treatment. Validation of the kit was based on 154 aseptically collected mastitis samples from 2 clinical herds (clinical population) and 120 milk samples from 3 nonclinical herds (nonclinical population) without clinical cases at the time of enrollment. One herd sampled at different times was common to both populations. A 3-test in 2-population Bayesian latent class model with uniform priors for all test parameters except specificity of culture, which was modeled informatively, was used to estimate sensitivity (Se) and specificity (Sp) of the test kit, culture, and PCR at the cow level. The mastitis test kit's 96.9% Sp for Streptococcus spp. had a low false positive percentage (3.1%), which, together with the kit's rapid turnaround time for results, makes it a suitable initial screening test that producers can use to identify clinical cows to treat based on Streptococcus spp. mastitis in kit-positive results. Due to the 60.4% kit Se, producers should follow up on Streptococcus spp. kit-negative cows using a confirmatory test such as PCR (Sp of 98.4%) or culture (Sp of 99.6%). In contrast, aerobic culture had Se of 76.5% and Sp of 99.6% for Streptococcus spp. Similarly, the Sp of the kit (98.2%) and culture (99.8%) for Staph. aureus were particularly high, and even though the kit's Se (61.0%) was lower than culture (88.4%; posterior probability of difference 98%), the kit could be beneficial before use of a confirmatory test for kit-negative samples due to its ease and rapid turnaround time. Mostly, quantitative real-time (q)PCR outperformed the kit's Se (37.7%) and Sp (92.9%) for coliforms, as well as the kit's Se (60.4%) for Streptococcus spp. However, qPCR may require more technical skills and turnaround time for final results. Use of the on-farm mastitis test kit evaluated in the present study could enhance sustainable antimicrobial drug use by rapidly identifying Streptococcus mastitis for targeted treatment. Furthermore, the kit may be used in a Staph. aureus outbreak where cows can be rapidly screened to identify cases for segregation or culling during an outbreak and kit-negative cows further confirmed by milk culture or qPCR. However, the cost-effectiveness of such an approach has not been investigated.

Cross-sectional survey on Mycobacterium avium Subsp. paratuberculosis in Dromedary Camels: Seroprevalence and risk factors

Johne's disease is a chronic disease with great concern in ruminants and caused by Mycobacterium avium subsp. paratuberculosis (MAP). A cross-sectional study was conducted from February 2019 to January 2020 to estimate the prevalence of MAP infection among camels which are kept in three governorates in Nile Delta of Egypt. A total of 440 serum samples were examined by ELISA for detection of MAP antibodies. The multivariable logistic regression model was performed to determine the associated risk factors for MAP infection in examined camels. Overall, the seroprevalence of MAP infection was found to be 7.5% among examined camels. The multivariable logistic regression model was performed to determine the associated risk factors for MAP infection in examined camels. The main findings revealed that the risk of getting MAP infection increased among elder camels (>10 years old) with signs of diarrhea, having communal water source and in camels grazing in the same pasture (odds ratio >1). However, geographic location, sex and contact with cattle had not significant impact regarding to seroprevalence of MAP infection in camels. The present findings confirm presence of MAP among camels which is a potential risk factor for contamination of environment and spreading of infection. Therefore, further studies for detection of infected animals in early stage are needed beside the estimated risk factors in this study to build an efficient control program.

Comparative performance of different antigens on the lateral flow assay (LFA) platform for the rapid serodiagnosis of paratuberculosis

Paratuberculosis is a globally prevalent disease, that adversely affects the economy of livestock farming. Control is largely based on early detection followed by 'Test and Cull' or 'Test and Segregate' Policy. Implementation of paratuberculosis control is a special challenge due to the non-availability of point of care diagnostics (PoCD). Therefore, the present study aimed to optimize and evaluate a lateral flow assay (LFA) for the rapid serodiagnosis of paratuberculosis in ruminant species, especially in the view of the resource-limited areas. Performance of three different antigenic preparations including native purified protoplasmic antigen (nPPA-LFA), commercial purified protoplasmic antigen (cPPA-LFA), and a cocktail of recombinant secretory proteins (RP-LFA) was evaluated as detection reagents for coating LFA strips. Comparative performance of the optimized LFA was also evaluated with gold standard tissue culture, fecal PCR (polymerase chain reaction), and plate ELISA. In addition, the onsite testing of animals belonging to different farms (endemic), species, and regions using optimized LFA was also done to highlight the on-farm testing approach. Findings revealed recombinant secretory proteins based LFA (RP-LFA) had a higher sensitivity of detection compared to other antigens. RP-LFA had a sensitivity of 77.7%, 75.44%, and 75.16% in comparison to gold standard tissue culture, fecal PCR, and plate ELISA, respectively. The specificity of RP-LFA was 100% with all reference tests. In comparison to plate ELISA, RP-LFA had a detection limit of 100% when the S/P ratio of the serum sample is ≥1.0 and 80% when the S/P ratio range of 0.8-1.0. Using RP-LFA, on-farm testing of 608 animals was done and 283 (46.5%) were found positive. Kappa analysis of present RP-LFA revealed 'good strength of agreement' with gold standard tissue culture, fecal PCR, and plate ELISA. Optimized RP-LFA had no cross-reactivity with bovine tuberculosis (bovine TB). The RP-LFA was found reproducible, user-friendly and test results can be interpreted within five minutes. In conclusion, the findings of the present study advocate the huge potential of LFA-based PoCD in the rapid diagnosis and control of paratuberculosis.

A Comparative Study on the Efficiency of Two Mycobacterium avium subsp. paratuberculosis (MAP)-Derived Lipopeptides of L3P and L5P as Capture Antigens in an In-House Milk ELISA Test

Mycobacterium avium subsp. paratuberculosis (MAP) surface-exposed lipopeptides could be specific capture-antigen molecules targeting antibodies against MAP, in milk, through ELISA. Previous studies have revealed that MAP strains, isolated from sheep (S) or cow (C), could produce specific lipopeptides, L3P or L5P, respectively. In this study, we used L3P and L5P as capture antigens in an in-house milk ELISA (H-MELISA) to assess how these antigens perform, in comparison with other ELISA tests, on well-defined milk samples from MAP-infected sheep. The overall positivity rates of H-MELISA via L3P and L5P varied by the source of milk samples, in which, at bulk-tank-milk (BTM) level, the majority of positive cases (63.83%) reacted more against L5P, whereas a predominant number (69.14%) of milk samples were more responsive against L3P at the individual level. To clarify whether the positivity status of milk samples in H-MELISA L3P/L5P were predictive of MAP strain-types (S/C), strain-typing was carried out using PCR IS1311-restriction enzyme analysis. Although the presence of three MAP strains (S/C/bison types) was detected among the milk samples, the C-type (46.67%) and S-type (75%) MAP strains were detected with higher incidence among BTMs and individual milk samples, respectively. However, further examination on the H-MELISA L3P/L5P-positivity pattern of each C/S-type-MAP sample revealed that some samples had a reverse reactivity against both L3P and L5P. These results could be the consequence of either cross-reactivity between L3P and L5P (due to the similarity in the structures of the two epitopes) or simply a within-herd mixed infection with MAP strains of C and S types. These findings suggest that lipopeptide antigens could contribute a diagnostic test with optimal performance, considering the diversity of MAP strains.

Is vaccination a viable method to control Johne's disease caused by Mycobacterium avium subsp. paratuberculosis? Data from 12 million ovine vaccinations and 7.6 million carcass examinations in New South Wales, Australia from 1999-2009

BACKGROUND

Mycobacterium avium subsp. paratuberculosis (MAP) causes Johne's disease (or paratuberculosis), a chronic wasting disease of ruminants and other animals resulting from granulomatous enteritis. There are increasing concerns that MAP is zoonotic. The prevalence of Johne's disease is increasing worldwide. In an attempt to control an epidemic of ovine Johne's disease (OJD) in New South Wales (NSW), a government/industry sponsored voluntary vaccination/on-farm management program commenced in 2000. We report herein an observational study of changes in disease prevalence as vaccination progressed, based on abattoir surveillance data for OJD from 1999 to 2009. We also discuss the epidemiological, policy, regulatory, research, economic and sociological elements that contributed to the development of a mature control program, whose aim was to halt the epidemic spread of OJD in a naïve sheep population.

METHODS

NSW was divided into areas of "High" (HPA), "Medium" (MPA) and "Low" (LPA) OJD prevalence. A killed whole cell vaccine (Gudair®) was administered to sheep from 2000 to 2009. Trained examiners evaluated the viscera of adult sheep carcasses at slaughter for gross evidence of OJD. MAP infection was confirmed by histopathology.

PRINCIPAL FINDINGS

From 2000-2009, 12 million vaccine doses were administered in NSW (91%; 10.9 million in the HPA). Many of the vaccinated flocks were suffering > 5% annual mortality in adult sheep, with some individual flocks with 10-15% losses attributable to OJD. A total of 7.6 million carcasses were examined (38%; 2.9 million from the HPA). Overall, 16% of slaughter consignments (sheep consigned to the abattoir from a single vendor) were positive for OJD, of which 94% were from the HPA. In the HPA, the percentage of animals with lesions attributable to OJD at slaughter fell progressively from 2.4% (10,406/432,860) at commencement of vaccination in 2000 to 0.8% (1,573/189,564) by 2009. Herd immunity from vaccination in the HPA was estimated at 70% by 2009, the target commonly espoused for an effective control program based on vaccination. This coincided with a progressive decrease in reports of clinical disease and mortalities in vaccinated flocks.

SIGNIFICANCE

We show a decrease in the prevalence of lesions attributable to OJD in NSW concomitant with initiation of voluntary vaccination, on-farm management plans, abattoir monitoring and feedback of animal prevalence data to sheep producers. We conclude that a target of ≤ 1% regional prevalence of OJD affected sheep at slaughter is achievable using these interventions.

Electrochemical Detection of Serum Antibodies Against Mycobacterium avium Subspecies paratuberculosis

Mycobacterium avium subsp. paratuberculosis (MAP) causes a chronic inflammatory intestinal disease, called Johne's disease (JD) in many ruminants. In the dairy industry, JD is responsible for significant economic losses due to decreased milk production and premature culling of infected animals. Test-and-cull strategy in conjunction with risk management is currently recommended for JD control in dairy herds. However, current diagnostic tests are labor-intensive, time-consuming, and/or too difficult to operate on site. In this study, we developed a new method for the detection of anti-M. paratuberculosis antibodies from sera of M. paratuberculosis-infected animals. M. paratuberculosis antigen-coated magnetic beads were sequentially reacted with bovine serum followed by a horseradish peroxidase (HRP)-labeled secondary antibody. The reaction of HRP with its substrate was then quantitatively measured electrochemically using a redox-active probe, ferrocyanide. After optimization of electrochemical conditions and concentration of the redox-active probe, we showed that the new electrochemical detection method could distinguish samples of M. paratuberculosis-infected cattle from those of uninfected cattle with greater separation between the two groups of samples when compared with a conventional colorimetric testing method. Since electrochemical detection can be conducted with an inexpensive, battery-operated portable device, this new method may form a basis for the development of an on-site diagnostic system for JD.

Preferred Reporting Items for Diagnostic Accuracy Studies in Endodontics (PRIDASE) guidelines: a development protocol

Diagnostic accuracy studies play an important role in informing clinical practice and patient management, by evaluating the ability of diagnostic testing and imaging to identify the presence or absence of a disease or condition. These studies compare the relative diagnostic strength of the test or device with a reference standard, therefore, guiding clinical decisions on the reliability of the test, the need for further tests, and whether to monitor or treat a particular condition. Inadequate and incomplete reporting of diagnostic accuracy studies can disguise methodological deficiencies and ultimately result in study bias and the inability to translate research findings into daily clinical practice. The Preferred Reporting Items for Diagnostic Accuracy Studies in Endodontics (PRIDASE) guidelines are being developed in order to improve the accuracy, transparency, completeness and reproducibility of diagnostic accuracy studies in the speciality of Endodontology. The aim of this paper is to report the process used to develop the PRIDASE guidelines based on a well-established consensus process. The project leaders (PD, VN) formed a steering committee of nine members (PD, VN, PA, AF, DR, SP, CK, MP, HD) to oversee and manage the project. The PRIDASE steering committee will develop the initial draft of the PRIDASE guidelines by adapting and modifying the Standards for Reporting of Diagnostic Accuracy Studies (STARD) 2015 guidelines, adding new items related specifically to the nature of Endodontics and incorporate the Clinical and Laboratory Images in Publication (CLIP) principles. The initial guidelines will consist of a series of domains and individual items and will be validated by the members of a PRIDASE Delphi Group (PDG) consisting of a minimum of 30 individuals who will evaluate independently the individual items based on two parameters: 'clarity' using a dichotomous scoring (yes/no) and 'suitability' for inclusion using a 9-point Likert Scale. The scores awarded by each member and any suggestions for improvement will be shared with the PDG to inform an iterative process that will result in a series of items that are clear and suitable for inclusion in the new PRIDASE guidelines. Once the PDG has completed its work, the steering committee will create a PRIDASE Meeting Group (PMG) of 20 individuals from around the world. Members of the PDG will be eligible to be the part of PMG. The draft guidelines and flowchart approved by the PDG will then be presented for further validation and agreement by the PMG. As a result of these discussions, the PRIDASE guidelines will be finalized and then disseminated to relevant stakeholders through publications and via the Preferred Reporting Items for study Designs in Endodontology (PRIDE) website (http://pride-endodonticguidelines.org). Periodic updates to the PRIDASE guidelines will be made based on feedback from stakeholders and end-users.

Serological and Molecular Characterization of Mycobacterium avium Subsp. paratuberculosis (MAP) from Sheep, Goats, Cattle and Camels in the Eastern Province, Saudi Arabia

Simple Summary

Mycobacterium avium subsp. paratuberculosis (MAP) is the causative agent of Johne’s disease, affecting small and large ruminants and causing chronic diarrhea and severe emaciation. MAP is prevalent in many countries, including Saudi Arabia. Serological and molecular characterization of MAP and determination of the prevalent strains are essential for the control strategies. The results obtained from 31 herds showed that the sheep type (S-type) was the most prevalent MAP type and the molecular characterization revealed different strain profiles distributed among the sheep, goat, cattle, and camel herds in Eastern Province, Saudi Arabia.

Abstract

The objectives of the present study were to characterize Mycobacterium avium subsp. paratuberculosis (MAP) infection using serological and molecular tools and investigate the distribution and molecular characterization of MAP strains (cattle (C) and sheep (S) types) in sheep, goat, cattle, and camel herds in Eastern Province, Saudi Arabia. Serum and fecal samples were collected from all animals aged >2 years old in 31 herds (sheep = 8, goats = 6, cattle = 8 and camels = 9) from January to December 2019. Serum samples were tested by ELISA for the detection of MAP antibodies. Fecal samples were tested by PCR for the detection of MAP IS900 gene and the identification of MAP strains. MAP antibodies were detected in 19 (61.3%) herds. At the animal level, antibodies against MAP were detected in 43 (19.5%) sheep, 21 (17.1%) goats, 13 (19.7%) cattle and 22 (9.1%) camels. The IS900 gene of MAP was detected in 23 (74.2%) herds and was directly amplified from fecal samples of 59 (26.8%) sheep, 34 (27.6%) goats, 20 (30.3%) cattle and 36 (15.0%) camels. The S-type was the most prevalent MAP type identified in 15 herds, and all were identified as type-I, while the C-type was identified in only 8 herds. The IS900 sequences revealed genetic differences among the MAP isolates recovered from sheep, goats, cattle and camels. Results from the present study show that MAP was prevalent and confirm the distribution of different MAP strains in sheep, goat, cattle and camel herds in Eastern Province, Saudi Arabia.

Estimation of the sensitivity and specificity of four serum ELISA and one fecal PCR for diagnosis of paratuberculosis in adult dairy cattle in New Zealand using Bayesian latent class analysis

In New Zealand, a new diagnostic approach for the control of paratuberculosis in mixed aged milking cows has been developed using a combination of ELISA and quantitative fecal PCR (f-qPCR). Our analysis was designed to evaluate performance of these individual tests in infected or infectious mixed aged cows across the prevalence of infection typically encountered on NZ dairy farms and calculate test accuracy when used as a screening test of serological ELISAs for four separate antigens read in parallel followed by a confirmatory quantitative f-qPCR test. Data from a cross-sectional study of 20 moderate prevalence herds was combined with existing data from 2 low and 20 high prevalence herds forming a dataset of 3845 paired serum and fecal samples. Incidence of clinical Johne's disease (JD) was used to classify herds into three prevalence categories. High (≥ 3% annual clinical JD for the last three years), moderate (<3 - 1%) and low (<1% incidence for at least the last five years). Positive tests were declared if> 50 ELISA units and f-qPCR at two cut-points (≥1 × 10⁴ genomes/mL or >1 × 10³ genomes/mL). Fixed Bayesian latent class models at both f-qPCR cut-points, accounted for conditional independence and paired conditional dependence. Mixed models at both f-qPCR cut-points, using a different mechanism to account for conditional dependencies between tests were also implemented. Models (24 in number) were constructed using OpenBUGS. The aim was to identify Mycobacterium avium subsp. paratuberculosis (MAP) infected cows that met at least one of two criteria: shedding sufficient MAP in feces to be detected by f-qPCR or mounting a detectable MAP antibody response. The best fit to the data was obtained by modelling pairwise dependencies between tests in a fixed model or by accounting for dependencies in a mixed model at a fecal cut-off of ≥1 × 10⁴ genomes/mL. Test performance differed with prevalence, but models were robust to prior assumptions. For the fixed model, at a prevalence of 0.29 (95 % probability interval (PI) = 0.25-0.33), as a screening plus confirmatory f-qPCR, post-test probability for disease in a positive animal was 0.84 (95 %PI = 0.80-0.88) and 0.16 (95 %PI = 0.15-0.18) for disease in a test negative animal. In low prevalence herds (0.01(95 %PI = 0.00-0.04)) the equivalent figures were 0.84 (95 %PI = 0.08-0.92) and 0.00 (95 %PI = 0.00-0.02). These results suggest this is a useful tool to control JD on dairy farms, particularly in herds with higher levels of infection, where the sampling and testing cost per animal is defrayed across more detected animals.

Validation of laboratory tests for infectious diseases in wild mammals: review and recommendations

Evaluation of the diagnostic sensitivity (DSe) and specificity (DSp) of tests for infectious diseases in wild animals is challenging, and some of the limitations may affect compliance with the OIE-recommended test validation pathway. We conducted a methodologic review of test validation studies for OIE-listed diseases in wild mammals published between 2008 and 2017 and focused on study design, statistical analysis, and reporting of results. Most published papers addressed Mycobacterium bovis infection in one or more wildlife species. Our review revealed limitations or missing information about sampled animals, identification criteria for positive and negative samples (case definition), representativeness of source and target populations, and species in the study, as well as information identifying animals sampled for calculations of DSe and DSp as naturally infected captive, free-ranging, or experimentally challenged animals. The deficiencies may have reflected omissions in reporting rather than design flaws, although lack of random sampling might have induced bias in estimates of DSe and DSp. We used case studies of validation of tests for hemorrhagic diseases in deer and white-nose syndrome in hibernating bats to demonstrate approaches for validation when new pathogen serotypes or genotypes are detected and diagnostic algorithms are changed, and how purposes of tests evolve together with the evolution of the pathogen after identification. We describe potential benefits of experimental challenge studies for obtaining DSe and DSp estimates, methods to maintain sample integrity, and Bayesian latent class models for statistical analysis. We make recommendations for improvements in future studies of detection test accuracy in wild mammals.

Modelling Bovine Granuloma Formation In Vitro upon Infection with Mycobacterium Avium Subspecies Paratuberculosis

Mycobacterium avium subspecies paratuberculosis (Map) causes chronic granulomatous disease in cattle and ruminant livestock, causing substantial economic losses. Current vaccines delay clinical signs but cannot train the immune system to fully eradicate latent Map. During latency, Map uses host defenses, cage-like macrophage clusters called granuloma, as incubators for months or years. We used an in vitro model to investigate the early coordination of macrophages into granuloma upon Map infection over ten days. We found that at multiplicities of infection (MOI; Map:macrophages) of 1:2 and below, the macrophages readily form clusters and evolve pro-inflammatory cytokines in keeping with a cell-mediated immune response. At higher MOIs, viability of host macrophages is negatively impacted. At 1:4 MOI, we quantified viable Map in our model and confirmed that intracellular Map reproduced over the first five days of infection. Host cells expressed Type 1-specific cytokines, and Map-infected macrophages displayed reduced motility compared to Map-exposed, uninfected macrophages, suggesting an important role for uninfected macrophages in the early aggregative response. Reported is the first in vitro JD granuloma model capturing Map and macrophage viability, size distribution of resulting clusters, motility of monocyte-derived macrophages, and cytokine response during clustering, allowing quantitative analysis of multiple parameters of the Map-specific granulomatous response.

Control of Mycobacterium avium subsp. paratuberculosis infection on a New Zealand pastoral dairy farm

Background

Johne’s disease is a major production limiting disease of dairy cows caused by infection with Mycobacterium avium subsp. paratuberculosis in calf-hood. The disease is chronic, progressive, contagious and widespread with no treatment and no cure. Economic losses arise from decreased productivity through reduced growth, milk yield, fertility and also capital losses due to premature culling or death. Control chiefly centers upon removing those animals which actively shed bacteria and protecting calves from infection. A prolonged pre-clinical shedding phase, lack of test sensitivity, organism persistence and abundance in the environment as well as management systems that expose susceptible calves to infection make control challenging, particularly in pastoral, seasonal dairy systems. Combining a novel testing strategy to remove infected cows along with limited measures to protect vulnerable calves at pasture, this study reports the successful reduction over a four-year period of seroprevalence of cows testing positive for MAP infection in a New Zealand pastoral dairy herd.

Results

For all age groups considered the apparent seroprevalence of cows testing positive decreased from 297 / 1,122 (26%) in 2013–2014, to 24 / 1,030 (2.3%) in 2016–2017. Over the same period, the apparent seroprevalence in primiparous cows decreased from 39 / 260 (15%) to 7 / 275 (2.5%) and in multiparous cows from 258 / 862 (29.9%) to 17 / 755 (2.3%). The reported proportion of calved cows culled annually from suspected clinical Johne’s disease fell from 55 / 1,201 (5%) in the year preceding the control program to 5 / 1,283 (0.4%) in the final year of the study.

Conclusions

On this farm, reduction in the prevalence of infection was achieved by reducing the infectious pressure through targeted culling of heavily shedding animals together with limited measures to protect calves at pasture from exposure to Mycobacterium avium subsp. paratuberculosis. Whilst greater protection of young animals through separation from infected cows and their colostrum and milk would have reduced the risk of neonatal infection, this study demonstrates, in this case, that these management measures while prudent were not essential for effective reduction in the prevalence of MAP infection.

Control of paratuberculosis: who, why and how. A review of 48 countries

Paratuberculosis, a chronic disease affecting ruminant livestock, is caused by Mycobacterium avium subsp. paratuberculosis (MAP). It has direct and indirect economic costs, impacts animal welfare and arouses public health concerns. In a survey of 48 countries we found paratuberculosis to be very common in livestock. In about half the countries more than 20% of herds and flocks were infected with MAP. Most countries had large ruminant populations (millions), several types of farmed ruminants, multiple husbandry systems and tens of thousands of individual farms, creating challenges for disease control. In addition, numerous species of free-living wildlife were infected. Paratuberculosis was notifiable in most countries, but formal control programs were present in only 22 countries. Generally, these were the more highly developed countries with advanced veterinary services. Of the countries without a formal control program for paratuberculosis, 76% were in South and Central America, Asia and Africa while 20% were in Europe. Control programs were justified most commonly on animal health grounds, but protecting market access and public health were other factors. Prevalence reduction was the major objective in most countries, but Norway and Sweden aimed to eradicate the disease, so surveillance and response were their major objectives. Government funding was involved in about two thirds of countries, but operations tended to be funded by farmers and their organizations and not by government alone. The majority of countries (60%) had voluntary control programs. Generally, programs were supported by incentives for joining, financial compensation and/or penalties for non-participation. Performance indicators, structure, leadership, practices and tools used in control programs are also presented. Securing funding for long-term control activities was a widespread problem. Control programs were reported to be successful in 16 (73%) of the 22 countries. Recommendations are made for future control programs, including a primary goal of establishing an international code for paratuberculosis, leading to universal acknowledgment of the principles and methods of control in relation to endemic and transboundary disease. An holistic approach across all ruminant livestock industries and long-term commitment is required for control of paratuberculosis.

Mycobacterium avium paratuberculosis and Mycobacterium avium complex and related subspecies as causative agents of zoonotic and occupational diseases

Mycobacterium avium complex (MAC) and Mycobacterium avium paratuberculosis (MAP) cause zoonotic infections transmitted by birds and livestock herds. These pathogens have remained as serious economic and health threats in most areas of the world. As zoonotic diseases, the risk of development of occupational disease and even death outcome necessitate implementation of control strategies to prevent its spread. Zoonotic MAP infections include Crohn's disease, inflammatory bowel disease, ulcerative colitis, sarcoidosis, diabetes mellitus, and immune-related diseases (such as Hashimoto's thyroiditis). Paratuberculosis has classified as type B epidemic zoonotic disease according to world health organization which is transmitted to human through consumption of dairy and meat products. In addition, MAC causes pulmonary manifestations and lymphadenitis in normal hosts and human immunodeficiency virus (HIV) progression (by serotypes 1, 4, and 8). Furthermore, other subspecies have caused respiratory abscesses, neck lymph nodes, and disseminated osteomyelitis in children and ulcers. However, the data over the occupational relatedness of these subspecies is rare. These agents can cause occupational infections in susceptible herd breeders. Several molecular methods have been recognized as proper strategies for tracking the infection. In this study, some zoonotic aspects, worldwide prevalence and control strategies regarding infections due to MAP and MAC and related subspecies has been reviewed.

Design, statistical analysis and reporting standards for test accuracy studies for infectious diseases in animals: Progress, challenges and recommendations

The quality of diagnostic accuracy studies (DAS) for infectious diseases of animals has improved over the last 20 years because of international educational efforts, use of design and reporting standards to guide researchers and test developers, and acceptance of the use of latent class models to account for imperfect reference tests. In this review, we focus on measurement of diagnostic sensitivity and specificity as a measure of clinical validity, describe the leadership role of the World Organisation of Animal Health (OIE) in setting standards for test validation in the context of fitness-for-purpose, and describe how design and reporting quality have facilitated the increased use of systematic reviews and meta-analysis of DAS. Ongoing challenges for design, conduct, analysis and reporting of DAS are identified; and we make recommendations for improvements in these areas for OIE-listed and non-listed infectious diseases.

Observational Study Design in Veterinary Pathology, Part 2: Methodology

Observational studies are a basis for much of our knowledge of veterinary pathology, yet considerations for conducting pathology-based observational studies are not readily available. In part 1 of this series, we offered advice on planning and carrying out an observational study. Part 2 of the series focuses on methodology. Our general recommendations are to consider using already-validated methods, published guidelines, data from primary sources, and quantitative analyses. We discuss 3 common methods in pathology research—histopathologic scoring, immunohistochemistry, and polymerase chain reaction—to illustrate principles of method validation. Some aspects of quality control include use of clear objective grading criteria, validation of key reagents, assessing sample quality, determining specificity and sensitivity, use of technical and biologic negative and positive controls, blinding of investigators, approaches to minimizing operator-dependent variation, measuring technical variation, and consistency in analysis of the different study groups. We close by discussing approaches to increasing the rigor of observational studies by corroborating results with complementary methods, using sufficiently large numbers of study subjects, consideration of the data in light of similar published studies, replicating the results in a second study population, and critical analysis of the study findings.

The effect of sub-clinical infection with Mycobacterium avium subsp. paratuberculosis on milk production in a New Zealand dairy herd

Background

Johne’s disease is a major production limiting disease of dairy cows. The disease is chronic, progressive, contagious and widespread; there is no treatment and there is no cure. Economic losses arise from decreased productivity through reduced growth, milk yield and fertility and capital losses due to premature culling or death. This study attempts to address the effect of subclinical JD on milk production under New Zealand pastoral dairy farming conditions using a new testing approach. Blood samples were taken from all lactating animals from a single seasonally calving New Zealand dairy herd in the autumn of 2013 and 2014. Samples were subject to serological assay for antibodies to Mycobacterium avium subsp. paratuberculosis using a combination of four ELISA tests in parallel followed by selective quantitative fecal PCR to confirm the fecal shedding characteristics of ELISA positive cows. ELISA status was classified as Not-Detected, Low, Moderate or High and fecal PCR status as Not-Detected, Moderate or High.

Results

A mixed generalized regression model indicated that, compared to cows where MAP was not detected, daily milk solids production was 4% less for high ELISA positive cows (p = 0.004), 6% less for moderate fPCR cows (p = 0.036) and 12% less for high fPCR cows (p < 0.001).

Conclusions

This study confirms that sub-clinical JD can have a significant impact on milk production and that the testing methodology used stratified the animals in this herd on their likely impact on production and disease spread. This allowed the farmer to prioritize removal of heavily shedding, less-productive animals and so reduce the risk of infection of young stock. This is the first longitudinal study based in New Zealand looking at the effect of Johne’s infection status on daily milk production allowing for intermediary and confounding factors.

Diagnostic accuracy of enzyme-linked immunosorbent assay (ELISA) and immunoblot (IB) for the detection of antibodies against Neospora caninum in milk from dairy cows

The aim of the study was to estimate the sensitivity and specificity of enzyme-linked immunosorbent assay (ELISA) and immunoblot (IB) for detecting antibodies of Neospora caninum in dairy cows, in the absence of a gold standard. The study complies with STRADAS-paratuberculosis guidelines for reporting the accuracy of the test. We tried to apply Bayesian models that do not require conditional independence of the tests under evaluation, but as convergence problems appeared, we used Bayesian methodology, that does not assume conditional dependence of the tests. Informative prior probability distributions were constructed, based on scientific inputs regarding sensitivity and specificity of the IB test and the prevalence of disease in the studied populations. IB sensitivity and specificity were estimated to be 98.8% and 91.3%, respectively, while the respective estimates for ELISA were 60% and 96.7%. A sensitivity analysis, where modified prior probability distributions concerning IB diagnostic accuracy applied, showed a limited effect in posterior assessments. We concluded that ELISA can be used to screen the bulk milk and secondly, IB can be used whenever needed.

Estimation of the sensitivity and specificity of two serum ELISAs and one fecal qPCR for diagnosis of paratuberculosis in sub-clinically infected young-adult French sheep using latent class Bayesian modeling

Background

The objective was to evaluate the diagnostic accuracy of two serum ELISAs and one quantitative PCR on feces for the diagnosis of paratuberculosis in sub-clinically infected young-adult sheep. A cross-sectional study was performed to collect 1197 individual blood and fecal samples from 2- to 3-year-old sub-clinically infected ewes in 14 closed meat sheep flocks in France. Fecal excretion was determined using qPCR based on IS900 sequence detection, and serology was performed on serum samples using two commercial ELISAs. Data were analyzed in a 3-test multiple-population Bayesian latent class model accounting for potential dependence between the three tests fitted in OpenBUGS. Separate analyses were performed according to whether doubtful ELISA results were handled as positive or negative and based on two thresholds for fecal qPCR (Ct ≤ 42 or Ct ≤ 40).

Results

The best fit to the data was provided by accounting for a pairwise dependence between the two ELISAs on sensitivity and pairwise dependence between the three tests on specificity. Under this model, the estimated ELISA sensitivities were 17.4% (95% PCI: 10.6 – 25.9) and 17.9% (95% PCI 11.4 – 25.6), with estimated specificities of 94.8% (95% PCI: 93.1 – 96.3) and 94.0% (95% PCI: 92.2 – 95.7). Fecal qPCR demonstrated significantly higher sensitivity (47.5%; 95% PCI: 29.3 – 69.9) and specificity (99.0%; 95% PCI: 97.9 – 99.9) than the ELISAs. Assumptions regarding doubtful ELISA results and qPCR thresholds had only a slight impact on test accuracy estimates. Models not accounting for pairwise dependence between ELISA and fecal qPCR results yielded higher sensitivity and specificity estimates but always provided a worse fit to the data.

Conclusions

Although the overall sensitivity of serum ELISAs and fecal qPCR remains low, the higher diagnostic performances of fecal qPCR make it more suitable for paratuberculosis diagnosis in sub-clinically infected sheep. Our results also illustrate that all dependence structures should be investigated when evaluating diagnostic test accuracy and selection based on a rigorous statistical approach.

Electronic supplementary material

The online version of this article (doi:10.1186/s12917-017-1145-x) contains supplementary material, which is available to authorized users.

Modeling environmental transmission of MAP infection in dairy cows

Johne's disease is caused by Mycobacterium avium subspecies paratuberculosis(MAP). It is a chronic, progressive, and inflammatory disease which has a long incubation period. One main problem with the disease is the reduction of milk production in infected dairy cows. In our study we develop a system of ordinary differential equations to describe the dynamics of MAP infection in a dairy farm. This model includes the progression of the disease and the age structure of the cows. To investigate the effect of persistence of this bacteria on the farm on transmission in our model, we include environmental compartments, representing the pathogen input in an explicit way. The effect of indirect transmission from the bacteria in the environment and the culling of high-shedding adults can be seen in the numerical simulations. Since culling usually only happens once a year, we include a novel feature in the simulations with a discrete action of removing high-shedding adults once a year. We conclude that with culling of high shedders even at a high rate, the infection will persist in the modeled farm setting.

Inferring biomarkers for Mycobacterium avium subsp. paratuberculosis infection and disease progression in cattle using experimental data

Available diagnostic assays for Mycobacterium avium subsp. paratuberculosis (MAP) have poor sensitivities and cannot detect early stages of infection, therefore, there is need to find new diagnostic markers for early infection detection and disease stages. We analyzed longitudinal IFN-γ, ELISA-antibody and fecal shedding experimental sensitivity scores for MAP infection detection and disease progression. We used both statistical methods and dynamic mathematical models to (i) evaluate the empirical assays (ii) infer and explain biological mechanisms that affect the time evolution of the biomarkers, and (iii) predict disease stages of 57 animals that were naturally infected with MAP. This analysis confirms that the fecal test is the best marker for disease progression and illustrates that Th1/Th2 (IFN-γ/ELISA antibodies) assays are important for infection detection, but cannot reliably predict persistent infections. Our results show that the theoretical simulated macrophage-based assay is a potential good diagnostic marker for MAP persistent infections and predictor of disease specific stages. We therefore recommend specifically designed experiments to test the use of a based assay in the diagnosis of MAP infections.

STARD-BLCM: Standards for the Reporting of Diagnostic accuracy studies that use Bayesian Latent Class Models

The Standards for the Reporting of Diagnostic Accuracy (STARD) statement, which was recently updated to the STARD2015 statement, was developed to encourage complete and transparent reporting of test accuracy studies. Although STARD principles apply broadly, the checklist is limited to studies designed to evaluate the accuracy of tests when the disease status is determined from a perfect reference procedure or an imperfect one with known measures of test accuracy. However, a reference standard does not always exist, especially in the case of infectious diseases with a long latent period. In such cases, a valid alternative to classical test evaluation involves the use of latent class models that do not require a priori knowledge of disease status. Latent class models have been successfully implemented in a Bayesian framework for over 20 years. The objective of this work was to identify the STARD items that require modification and develop a modified version of STARD for studies that use Bayesian latent class analysis to estimate diagnostic test accuracy in the absence of a reference standard. Examples and elaborations for each of the modified items are provided. The new guidelines, termed STARD-BLCM (Standards for Reporting of Diagnostic accuracy studies that use Bayesian Latent Class Models), will facilitate improved quality of reporting on the design, conduct and results of diagnostic accuracy studies that use Bayesian latent class models.

Evaluation of a PCR assay on overgrown environmental samples cultured for Mycobacterium avium subsp. paratuberculosis

Culture of Mycobacterium avium subsp. paratuberculosis (MAP) is the definitive antemortem test method for paratuberculosis. Microbial overgrowth is a challenge for MAP culture, as it complicates, delays, and increases the cost of the process. Additionally, herd status determination is impeded when noninterpretable (NI) results are obtained. The performance of PCR is comparable to fecal culture, thus it may be a complementary detection tool to classify NI samples. Our study aimed to determine if MAP DNA can be identified by PCR performed on NI environmental samples and to evaluate the performance of PCR before and after the culture of these samples in liquid media. A total of 154 environmental samples (62 NI, 62 negative, and 30 positive) were analyzed by PCR before being incubated in an automated system. Growth was confirmed by acid-fast bacilli stain and then the same PCR method was again applied on incubated samples, regardless of culture and stain results. Change in MAP DNA after incubation was assessed by converting the PCR quantification cycle (Cq) values into fold change using the 2−ΔCq method (ΔCq = Cq after culture − Cq before culture). A total of 1.6% (standard error [SE] = 1.6) of the NI environmental samples had detectable MAP DNA. The PCR had a significantly better performance when applied after culture than before culture ( p = 0.004). After culture, a 66-fold change (SE = 17.1) in MAP DNA was observed on average. Performing a PCR on NI samples improves MAP culturing. The PCR method used in our study is a reliable and consistent method to classify NI environmental samples.

Evaluation of fecal culture and fecal RT-PCR to detect Mycobacterium avium ssp. paratuberculosis fecal shedding in dairy goats and dairy sheep using latent class Bayesian modeling

Background

The study’s objective was to evaluate the ability of fecal culture (FCUL) and fecal PCR (FPCR) to identify dairy goat and dairy sheep shedding Mycobacterium avium ssp. paratuberculosis. A cross-sectional study of the small ruminant populations was performed in Ontario, Canada between October 2010 and August 2011. Twenty-nine dairy goat herds and 21 dairy sheep flocks were visited, and 20 lactating females > two years of age were randomly selected from each farm resulting in 580 goats and 397 sheep participating in the study. Feces were collected per rectum and cultured using the BD BACTEC™ MGIT™ 960 system using a standard (49 days) and an extended (240 days) incubation time, and underwent RT-PCR based on the hsp-X gene (Tetracore®). Statistical analysis was performed using a 2-test latent class Bayesian hierarchical model for each species fitted in WinBUGS.

Results

Extending the fecal culture incubation time statistically improved FCUL sensitivity from 23.1 % (95 % PI: 15.9-34.1) to 42.7 % (95 % PI: 33.0-54.5) in dairy goats and from 5.8 % (95 % PI: 2.3-12.4) to 19.0 % (95 % PI: 11.9-28.9) in dairy sheep. FPCR demonstrated statistically higher sensitivity than FCUL (49 day incubation) with a sensitivity of 31.9 % (95 % PI: 22.4-43.1) in goats and 42.6 % (95 % PI: 28.8-63.3) in sheep.

Conclusions

Fecal culture demonstrates such low sensitivity at the standard incubation time it cannot be recommended as a screening test to detect shedding of MAP in either goats or sheep. Extending the incubation time resulted in improved sensitivity; however, it is still disappointingly low for screening purposes. Fecal PCR should be the screening test of choice in both species; however, it is important to recognize that control programs should not be based on testing alone when they demonstrate such low sensitivity.

Electronic supplementary material

The online version of this article (doi:10.1186/s12917-016-0814-5) contains supplementary material, which is available to authorized users.

Structure determination of lipopeptides from Mycobacterium avium subspecies paratuberculosis and identification of antigenic lipopeptide probes

Mycobacterium avium subspecies paratuberculosis (MAP) causes chronic illnesses mostly in ruminants. MAP infection of intestinal tissue triggers a fatal inflammatory disorder, Johne's disease (paratuberculosis). Development of fast and reliable diagnostic methods for Johne's disease in clinically suspected ruminants requires the discovery of MAP-specific antigens that induce immune responses. Despite a longtime interest in finding such antigens that can detect serum antibody responses with high sensitivity, the antigens currently used for a diagnosis of the MAP infections are the crude extracts from the whole cell. We performed the serum antibody response assay-guided purification of the ethanol extract from MAP isolated from an infected cow. With the results of extensive fractionations and in vitro assays, we identified that arachidyl-d-Phe-N-Me-l-Val-l-Ile-l-Phe-l-Ala-OH (named lipopeptide IIß, 3) exhibited the highest antibody binding activity in serum of a MAP-infected cattle compared with the other lipopeptides isolated from MAP. The absolute chemistry of 3 was determined unequivocally via our high-performance liquid chromatography (HPLC)-amino acid databases. α-Amino lipopeptide IIß and its fluorescent probes were synthesized and evaluated in serum antibody binding activity assays. Lipopeptide IIß-(2S)-NH2 (9) and its dansyl and fluorescein isothiocyanate (FITC) probes (10 and 11) exhibited antibody-mediated binding activity; thus, such MAP-specific lipopeptide probes can be potential biomarkers for the development of rapid and accurate diagnosis of Johne's disease.

Recommended reporting standards for test accuracy studies of infectious diseases of finfish, amphibians, molluscs and crustaceans: the STRADAS-aquatic checklist

Complete and transparent reporting of key elements of diagnostic accuracy studies for infectious diseases in cultured and wild aquatic animals benefits end-users of these tests, enabling the rational design of surveillance programs, the assessment of test results from clinical cases and comparisons of diagnostic test performance. Based on deficiencies in the Standards for Reporting of Diagnostic Accuracy (STARD) guidelines identified in a prior finfish study (Gardner et al. 2014), we adapted the Standards for Reporting of Animal Diagnostic Accuracy Studies-paratuberculosis (STRADAS-paraTB) checklist of 25 reporting items to increase their relevance to finfish, amphibians, molluscs, and crustaceans and provided examples and explanations for each item. The checklist, known as STRADAS-aquatic, was developed and refined by an expert group of 14 transdisciplinary scientists with experience in test evaluation studies using field and experimental samples, in operation of reference laboratories for aquatic animal pathogens, and in development of international aquatic animal health policy. The main changes to the STRADAS-paraTB checklist were to nomenclature related to the species, the addition of guidelines for experimental challenge studies, and the designation of some items as relevant only to experimental studies and ante-mortem tests. We believe that adoption of these guidelines will improve reporting of primary studies of test accuracy for aquatic animal diseases and facilitate assessment of their fitness-for-purpose. Given the importance of diagnostic tests to underpin the Sanitary and Phytosanitary agreement of the World Trade Organization, the principles outlined in this paper should be applied to other World Organisation for Animal Health (OIE)-relevant species.

Bayesian estimation of sensitivity and specificity of a commercial serum/milk ELISA against the Mycobacterium avium subsp. Paratuberculosis (MAP) antibody response for each lactation stage in Greek dairy sheep

A total of 854 paired milk and blood samples were collected from ewes of a Greek flock and used to estimate the sensitivity and specificity of a commercial ELISA for detection of Mycobacterium avium subsp. paratuberculosis (MAP) specific antibodies in each stage of lactation. We implemented Bayesian mixture models to derive the distributions of the test response for the healthy and the infected ewes. In the colostrum period, early, mid and late lactation stage the median values of the area under the curves (AUC) were 0.61 (95% credible interval: 0.50; 0.84), 0.61 (0.51;0.84), 0.65 (0.51;0.91), 0.65(0.51;0.89) for the serum ELISA and and 0.60 (0.50; 0.84), 0.61 (0.50; 0.84), 0.67(0.51; 0.91), 0.66(0.50; 0.90) for the milk ELISA, respectively. Both serum and milk ELISA had low to average overall discriminatory ability as measured by the area under the curves and comparable sensitivities and specificities at the recommended cutoffs.

Sensitivity of solid culture, broth culture, and real-time PCR assays for milk and colostrum samples from Mycobacterium avium ssp. paratuberculosis-infectious dairy cows

Mycobacterium avium ssp. paratuberculosis (MAP) can be shed in feces, milk, and colostrum. The goal of this study was to assess assays that detect MAP in these sample types, including effects of lactation stage or season. Understanding the performance of these assays could improve how they are used, limiting the risk of infection to calves. Forty-six previously confirmed MAP-positive cows from 7 Atlantic Canadian dairy farms were identified for colostrum sampling and monthly sampling of milk and feces over a 12-mo period. Samples were assayed for MAP using solid culture, broth culture, and direct real-time PCR (qPCR). Across assay types, test sensitivity when applied to milk samples averaged 25% of that when applied to fecal samples. For colostrum samples, sensitivity depended on assay type, with sensitivity of qPCR being approximately 46% of that in feces. Across sample types, sensitivity of qPCR was higher than that of the other assays. Sensitivity of qPCR, when applied to milk samples, was significantly higher in summer than in other seasons. Summer was also the season with highest agreement between milk and fecal samples collected within the same month. Our results suggest that qPCR would detect more cows shedding MAP in their milk and colostrum than solid or broth culture assays, particularly during the summer, thus providing better management information to limit exposure of calves to this infectious organism.

Sensitivity and specificity of repeated test results from a commercial milk enzyme-linked immunosorbent assay for detection of Mycobacterium avium subspecies paratuberculosis in dairy cattle

OBJECTIVE

To investigate the sensitivity and specificity of results of initial and repeated milk ELISAs (at 6- or 12-month intervals) to detect cows that were shedding Mycobacterium avium subsp paratuberculosis (ie, were infectious) and to evaluate factors influencing the probability that the results of a repeated milk ELISA would be positive for an infectious cow if the results of the initial milk ELISA were negative.

DESIGN

Prospective cohort study.

ANIMALS

3,145 dairy cows from 32 herds.

PROCEDURES

Herds from the 3 Maritime provinces in Canada (Prince Edward Island, New Brunswick, and Nova Scotia), participating in a Dairy Herd Improvement program, and that had undergone a prior Mycobacterium avium subsp paratuberculosis awareness project were selected for the study. Sample collection occurred between April 2009 and March 2011 with milk and fecal samples collected from all lactating cows in study herds every 6 months. Herds completing < 3 herd visits with collection of individual cow fecal or milk samples, within this sampling timeframe, were excluded from analyses. Fecal samples were cultured in liquid medium and a cow was defined as infectious if ≥ 1 sample was culture positive (reference test). A milk ELISA (index test) was completed with a commercial kit, following manufacturer's instructions.

RESULTS

For a 6-month test interval, sensitivities of the milk ELISA to detect infectious cows were 22.0% and 32.6% for initial and combined initial and repeated tests (parallel interpretation), respectively. Specificity of the initial ELISA was 99.6% and was 99.2% for combined tests. For a 12-month test interval, sensitivities of the milk ELISA to detect infectious cows were 25.6% and 45.3% for initial and combined initial and repeated tests (parallel interpretation), respectively. Specificity of the initial ELISA was 99.6% and was 98.9% for combined tests. In infectious cows, magnitude of the initial negative ELISA result was a positive predictor for a positive repeated ELISA result.

CONCLUSIONS AND CLINICAL RELEVANCE

Results of a repeated milk ELISA improved detection of Mycobacterium avium subsp paratuberculosis infectious cows, with minimal loss of specificity. A 12-month test interval provided a greater increase in sensitivity, relative to an initial test, than did a 6-month interval. Infectious cows with an initial negative milk ELISA result close to the cutoff for a positive test were more likely to have positive results on a repeated ELISA. Repeated testing improved detection of infectious cows and reduced risk of misclassification compared with a single ELISA result.

The potential Public Health Impact of Mycobacterium avium ssp. paratuberculosis: Global Opinion Survey of Topic Specialists

Global research knowledge has accumulated over the past few decades, and there is reasonable evidence for a positive association between Mycobacterium avium spp. paratuberculosis and Crohn's disease in humans, although its role as a human pathogen has not been entirely accepted. For this reason, management of public health risk due to M. paratuberculosis remains an important policy issue in agri-food public health arenas in many countries. Responsible authorities must decide whether existing mitigation strategies are sufficient to prevent or reduce human exposure to M. paratuberculosis. A Web-based questionnaire was administered to topic specialists to elicit empirical knowledge and opinion on the overall public health impact of M. paratuberculosis, the importance of various routes of human exposure to the pathogen, existing mitigation strategies and the need for future strategies. The questionnaire had four sections and consisted of 20 closed and five open questions. Topic specialists believed that M. paratuberculosis is likely a risk to human health (44.8%) and, given the paucity of available evidence, most frequently ranked it as a moderate public health issue (40.1%). A significant correlation was detected between topic specialists' commitment to M. paratuberculosis in terms of the number of years or proportion of work dedicated to this topic, and the likelihood of an extreme answer (high or low) to the above questions. Topic specialists identified contact with ruminants and dairy products as the most likely routes of exposure for humans. There was consensus on exposure routes for ruminants and what commodities to target in mitigation efforts. Described mandatory programmes mainly focused on culling diseased animals and voluntary on-farm prevention programmes. Despite ongoing difficulties in the identification of subclinical infections in animals, the topic specialists largely agreed that further enhancement of on-farm programmes in affected commodities by the agri-food industry (68.4%) and allocation of resources by governments to monitor the issue (92%) are most appropriate given the current state of evidence.

Hui and Walter's latent-class model extended to estimate diagnostic test properties from surveillance data: a latent model for latent data

Diagnostic test sensitivity and specificity are probabilistic estimates with far reaching implications for disease control, management and genetic studies. In the absence of ‘gold standard’ tests, traditional Bayesian latent class models may be used to assess diagnostic test accuracies through the comparison of two or more tests performed on the same groups of individuals. The aim of this study was to extend such models to estimate diagnostic test parameters and true cohort-specific prevalence, using disease surveillance data. The traditional Hui-Walter latent class methodology was extended to allow for features seen in such data, including (i) unrecorded data (i.e. data for a second test available only on a subset of the sampled population) and (ii) cohort-specific sensitivities and specificities. The model was applied with and without the modelling of conditional dependence between tests. The utility of the extended model was demonstrated through application to bovine tuberculosis surveillance data from Northern and the Republic of Ireland. Simulation coupled with re-sampling techniques, demonstrated that the extended model has good predictive power to estimate the diagnostic parameters and true herd-level prevalence from surveillance data. Our methodology can aid in the interpretation of disease surveillance data, and the results can potentially refine disease control strategies.

Improvements are needed in reporting of accuracy studies for diagnostic tests used for detection of finfish pathogens

Indices of test accuracy, such as diagnostic sensitivity and specificity, are important considerations in test selection for a defined purpose (e.g., screening or confirmation) and affect the interpretation of test results. Many biomedical journals recommend that authors clearly and transparently report test accuracy studies following the Standards for Reporting of Diagnostic Accuracy (STARD) guidelines ( www.stard-statement.org ). This allows readers to evaluate overall study validity and assess potential bias in diagnostic sensitivity and specificity estimates. The purpose of the present study was to evaluate the reporting quality of studies evaluating test accuracy for finfish diseases using the 25 items in the STARD checklist. Based on a database search, 11 studies that included estimates of diagnostic accuracy were identified for independent evaluation by three reviewers. For each study, STARD checklist items were scored as "yes," "no," or "not applicable." Only 10 of the 25 items were consistently reported in most (≥80%) papers, and reporting of the other items was highly variable (mostly between 30% and 60%). Three items ("number, training, and expertise of readers and testers"; "time interval between index tests and reference standard"; and "handling of indeterminate results, missing data, and outliers of the index tests") were reported in less than 10% of papers. Two items ("time interval between index tests and reference standard" and "adverse effects from testing") were considered minimally relevant to fish health because test samples usually are collected postmortem. Modification of STARD to fit finfish studies should increase use by authors and thereby improve the overall reporting quality regardless of how the study was designed. Furthermore, the use of STARD may lead to the improved design of future studies.

Validation of an automated ELISA system for detection of antibodies to Aleutian mink disease virus using blood samples collected in filter paper strips

Background

Aleutian mink disease virus (AMDV) is the cause of a chronic immune complex disease, Aleutian disease (AD), which is common in mink-producing countries. In 2005, implementation of an AMDV eradication programme in Finland created a need for an automated high-throughput assay. The aim of this study was to validate an AMDV-VP2 -recombinant antigen ELISA, which we developed earlier, in an automated assay format for the detection of anti-AMDV antibodies in mink blood and to determine the accuracy of this test compared with the reference standard (counter-current immunoelectrophoresis, CIEP).

Methods

A blood sampling method based on filter paper 12-strips (blood combs) and a device to introduce these strips to an ELISA plate for elution of the samples were developed. Blood and serum samples were collected from 761 mink from two farms with low (2%) and high (81%) seroprevalences of AMDV infection in 2008. ELISA sensitivity and specificity were estimated with a Bayesian 2-test 2-population model that allowed for conditional dependence between CIEP and ELISA. Agreement between the two tests was assessed with kappa statistic and proportion agreement.

Results

The sensitivity and specificity of the automated ELISA system were estimated to be 96.2% and 98.4%, respectively. Agreement between CIEP and ELISA was high, with a kappa value of 0.976 and overall proportion agreement of 98.8%.

Conclusions

The automated ELISA system combined with blood comb sampling is an accurate test format for the detection of anti-AMDV antibodies in mink blood and offers several advantages, including improved blood sampling and data handling, fast sample throughput time, and reductions in costs and labour inputs.

Sensitive and specific enzyme-linked immunosorbent assay for detecting serum antibodies against Mycobacterium avium subsp. paratuberculosis in fallow deer

The enzyme-linked immunosorbent assay (ELISA) is the diagnostic test most commonly used in efforts to control paratuberculosis in domestic ruminants. However, commercial ELISAs have not been validated for detecting antibodies against Mycobacterium avium subsp. paratuberculosis in wild animals. In this study, we compared the sensitivities and specificities of five ELISAs using individual serum samples collected from 41 fallow deer with or without histopathological lesions consistent with paratuberculosis. Two target antigenic preparations were selected, an ethanol-treated protoplasmic preparation obtained from a fallow deer M. avium subsp. paratuberculosis isolate (ELISAs A and B) and a paratuberculosis protoplasmic antigen (PPA3) (ELISAs C and D). Fallow deer antibodies bound to the immobilized antigens were detected by using a horseradish peroxidase (HRP)-conjugated anti-fallow deer IgG antibody (ELISAs A and C) or HRP-conjugated protein G (ELISAs B and D). A commercially available assay, ELISA-E, which was designed to detect M. avium subsp. paratuberculosis antibodies in cattle, sheep, and goats, was also tested. Although ELISAs A, C, and E had the same sensitivity (72%), ELISAs A and C were more specific (100%) for detecting fallow deer with lesions consistent with paratuberculosis at necropsy than was the ELISA-E (87.5%). In addition, the ELISA-A was particularly sensitive for detecting fallow deer in the latent stages of infection (62.5%). The antibody responses detected with the ELISA-A correlated with both the severity of enteric lesions and the presence of acid-fast bacteria in gut tissue samples. In summary, our study shows that the ELISA-A can be a cost-effective diagnostic tool for preventing the spread of paratuberculosis among fallow deer populations.

Relation of completeness of reporting of health research to journals' endorsement of reporting guidelines: systematic review

OBJECTIVE

To assess whether the completeness of reporting of health research is related to journals' endorsement of reporting guidelines.

DESIGN

Systematic review.

DATA SOURCES

Reporting guidelines from a published systematic review and the EQUATOR Network (October 2011). Studies assessing the completeness of reporting by using an included reporting guideline (termed "evaluations") (1990 to October 2011; addendum searches in January 2012) from searches of either Medline, Embase, and the Cochrane Methodology Register or Scopus, depending on reporting guideline name.

STUDY SELECTION

English language reporting guidelines that provided explicit guidance for reporting, described the guidance development process, and indicated use of a consensus development process were included. The CONSORT statement was excluded, as evaluations of adherence to CONSORT had previously been reviewed. English or French language evaluations of included reporting guidelines were eligible if they assessed the completeness of reporting of studies as a primary intent and those included studies enabled the comparisons of interest (that is, after versus before journal endorsement and/or endorsing versus non-endorsing journals).

DATA EXTRACTION

Potentially eligible evaluations of included guidelines were screened initially by title and abstract and then as full text reports. If eligibility was unclear, authors of evaluations were contacted; journals' websites were consulted for endorsement information where needed. The completeness of reporting of reporting guidelines was analyzed in relation to endorsement by item and, where consistent with the authors' analysis, a mean summed score.

RESULTS

101 reporting guidelines were included. Of 15,249 records retrieved from the search for evaluations, 26 evaluations that assessed completeness of reporting in relation to endorsement for nine reporting guidelines were identified. Of those, 13 evaluations assessing seven reporting guidelines (BMJ economic checklist, CONSORT for harms, PRISMA, QUOROM, STARD, STRICTA, and STROBE) could be analyzed. Reporting guideline items were assessed by few evaluations.

CONCLUSIONS

The completeness of reporting of only nine of 101 health research reporting guidelines (excluding CONSORT) has been evaluated in relation to journals' endorsement. Items from seven reporting guidelines were quantitatively analyzed, by few evaluations each. Insufficient evidence exists to determine the relation between journals' endorsement of reporting guidelines and the completeness of reporting of published health research reports. Journal editors and researchers should consider collaborative prospectively designed, controlled studies to provide more robust evidence.

SYSTEMATIC REVIEW REGISTRATION

Not registered; no known register currently accepts protocols for methodology systematic reviews.

Invited review: Systematic review of diagnostic tests for reproductive-tract infection and inflammation in dairy cows

The objective of this study was to conduct a systematic and critical appraisal of the quality of previous publications and describe diagnostic methods, diagnostic criteria and definitions, repeatability, and agreement among methods for diagnosis of vaginitis, cervicitis, endometritis, salpingitis, and oophoritis in dairy cows. Publications (n=1,600) that included the words "dairy," "cows," and at least one disease of interest were located with online search engines. In total, 51 papers were selected for comprehensive review by pairs of the authors. Only 61% (n=31) of the 51 reviewed papers provided a definition or citation for the disease or diagnostic methods studied, and only 49% (n=25) of the papers provided the data or a citation to support the test cut point used for diagnosing disease. Furthermore, a large proportion of the papers did not provide sufficient detail to allow critical assessment of the quality of design or reporting. Of 11 described diagnostic methods, only one complete methodology, i.e., vaginoscopy, was assessed for both within- and between-operator repeatability (κ=0.55-0.60 and 0.44, respectively). In the absence of a gold standard, comparisons between different tests have been undertaken. Agreement between the various diagnostic methods is at a low level. These discrepancies may indicate that these diagnostic methods assess different aspects of reproductive health and underline the importance of tying diagnostic criteria to objective measures of reproductive performance. Those studies that used a reproductive outcome to select cut points and tests have the greatest clinical utility. This approach has demonstrated, for example, that presence of (muco)purulent discharge in the vagina and an increased proportion of leukocytes in cytological preparations following uterine lavage or cytobrush sampling are associated with poorer reproductive outcomes. The lack of validated, consistent definitions and outcome variables makes comparisons of the different tests difficult. The quality of design and reporting in future publications could be improved by using checklists as a guideline. Further high-quality research based on published standards to improve study design and reporting should improve cow-side diagnostic tests. Specifically, more data on intra- and interobserver agreement are needed to evaluate test variability. Also, more studies are necessary to determine optimal cut points and time postpartum of examination.