An inter- laboratory proficiency testing exercise for rabies diagnosis in Latin America and the Caribbean

Evaluating Rabies Test Accuracy: A Systematic Review and Meta-Analysis of Human and Canine Diagnostic Methods

Background/Objectives: Rabies is almost invariably fatal once clinical symptoms manifest. Timely and accurate diagnosis is essential for effective treatment and prevention. Dogs are the principal reservoirs of the virus, particularly in developing nations, highlighting the importance of precise diagnostic and control measures to prevent human cases. This systematic review and meta-analysis assessed the accuracy of laboratory tests for diagnosing rabies in humans and dogs. Methods: The PubMed database was searched for published studies on rabies diagnosis between 1990 and 2024. Following PRISMA statement recommendations, we included 60 studies that met the selection criteria. Results: The results demonstrated the effectiveness of immunological tests like the Enzyme-Linked Immunosorbent Assay (ELISA) and molecular tests such as Reverse Transcription Polymerase Chain Reaction (RT-PCR) for both humans and dogs. In this study, the Direct Fluorescent Antibody Test (DFAT) exhibited lower diagnostic performance, with an area under the curve for false positive rates (AUCFPR = 0.887). In contrast, ELISA (AUCFPR = 0.909) and RT-PCR (AUCFPR = 0.905) provided more consistent results. Notably, the Rapid Immunochromatographic Test (RIT) showed the best performance (AUCFPR = 0.949), highlighting its superior diagnostic capabilities compared to DFAT. Conclusions: These findings underscore the need to modernize rabies diagnostic protocols by incorporating advanced methodologies to improve diagnostic accuracy, reduce transmission, and decrease mortality rates.

Tracking lethal threat: in-depth review of rabies

An infectious disease known as rabies (family Rhabdoviridae, genus Lyssavirus) causes severe damage to mammals' central nervous systems (CNS). This illness has been around for a very long time. The majority of human cases of rabies take place in underdeveloped regions of Africa and Asia. Following viral transmission, the Rhabdovirus enters the peripheral nervous system and proceeds to the CNS, where it targets the encephalon and produces encephalomyelitis. Postbite prophylaxis requires laboratory confirmation of rabies in both people and animals. All warm-blooded animals can transmit the Lyssavirus infection, while the virus can also develop in the cells of cold-blooded animals. In the 21st century, more than 3 billion people are in danger of contracting the rabies virus in more than 100 different nations, resulting in an annual death toll of 50,000-59,000. There are three important elements in handling rabies disease in post exposure prophylaxis (PEP), namely wound care, administration of anti-rabies serum, and anti-rabies vaccine. Social costs include death, lost productivity as a result of early death, illness as a result of vaccination side effects, and the psychological toll that exposure to these deadly diseases has on people. Humans are most frequently exposed to canine rabies, especially youngsters and the poor, and there are few resources available to treat or prevent exposure, making prevention of human rabies challenging.

Alternative Methods to Current In Vivo Procedures to Address the 3Rs Tenet in Rabies Proficiency Testing

Canine rabies is responsible for an estimated 59,000 human deaths every year. In an attempt to reach the ZeroBy30 goal, robust disease surveillance coupled with improved diagnostics play a paramount role in ensuring reliable data and gradually attesting rabies control advancements. In this context, proficiency testing is organized to harmonize rabies diagnostic capacities. In most exercises, rabies-positive samples consist of brains collected from intracerebrally inoculated mice. This procedure causes distress and severe suffering to animals, raising important ethical concerns that can no longer be ignored. In the last decades, the 3Rs tenet (Replace, Reduce, Refine) has been successfully implemented in several scientific areas, and we strongly support its application in the framework of rabies proficiency testing. Here, we discuss cell-based technologies as innovative sustainable in vitro candidate systems to replace in vivo experiments for the production of proficiency testing samples. The application of these alternative methods can allow completely in vitro or ex vivo production of rabies proficiency testing panels, which would represent an important replacement or reduction/refinement for current in vivo procedures.

External quality assessment of Rift Valley fever diagnosis in countries at risk of the disease: African, Indian Ocean and Middle-East regions

Rift Valley fever virus (RVFV), an arbovirus belonging to the Phlebovirus genus of the Phenuiviridae family, causes the zoonotic and mosquito-borne RVF. The virus, which primarily affects livestock (ruminants and camels) and humans, is at the origin of recent major outbreaks across the African continent (Mauritania, Libya, Sudan), and in the South-Western Indian Ocean (SWIO) islands (Mayotte). In order to be better prepared for upcoming outbreaks, to predict its introduction in RVFV unscathed countries, and to run efficient surveillance programmes, the priority is harmonising and improving the diagnostic capacity of endemic countries and/or countries considered to be at risk of RVF. A serological inter-laboratory proficiency test (PT) was implemented to assess the capacity of veterinary laboratories to detect antibodies against RVFV. A total of 18 laboratories in 13 countries in the Middle East, North Africa, South Africa, and the Indian Ocean participated in the initiative. Two commercial kits and two in-house serological assays for the detection of RVFV specific IgG antibodies were tested. Sixteen of the 18 participating laboratories (88.9%) used commercial kits, the analytical performance of test sensitivity and specificity based on the seroneutralisation test considered as the reference was 100%. The results obtained by the laboratories which used the in-house assay were correct in only one of the two criteria (either sensitivity or specificity). In conclusion, most of the laboratories performed well in detecting RVFV specific IgG antibodies and can therefore be considered to be prepared. Three laboratories in three countries need to improve their detection capacities. Our study demonstrates the importance of conducting regular proficiency tests to evaluate the level of preparedness of countries and of building a network of competent laboratories in terms of laboratory diagnosis to better face future emerging diseases in emergency conditions.

Multi-annual performance evaluation of laboratories in post-mortem diagnosis of animal rabies: Which techniques lead to the most reliable results in practice?

Rabies diagnosis proficiency tests on animal specimens using four techniques (FAT, RTCIT, conventional RT-PCR and real-time RT-PCR) were organised over 10 years (2009–2019). Seventy-three laboratories, of which 59% were from Europe, took part. As the panels were prepared with experimentally-infected samples, the error rate of laboratories on positive and negative samples was accurately estimated. Based on fitted values produced by mixed modelling including the variable “laboratory” as a random variable to take into account the longitudinal design of our dataset, the technique that provided the most concordant results was conventional RT-PCR (99.3%; 95% CI 99.0–99.6), closely followed by FAT (99.1%; 95% CI 98.7–99.4), real-time RT-PCR (98.7%; 95% CI 98.1–99.3) and then RTCIT (96.8%; 95% CI 95.8–97.7). We also found that conventional RT-PCR provided a better diagnostic sensitivity level (99.3% ±4.4%) than FAT (98.7% ±1.6%), real-time RT-PCR (97.9% ±0.8%) and RTCIT (95.3% ±5.1%). Regarding diagnostic specificity, RTCIT was the most specific technique (96.4% ±3.9%) followed closely by FAT (95.6% ±3.8%), real-time RT-PCR (95.0% ±1.8%) and conventional RT-PCR (92.9% ±0.5%). Due to multiple testing of the samples with different techniques, the overall diagnostic conclusion was also evaluated, and found to reach an inter-laboratory concordance level of 99.3%. The concordance for diagnostic sensitivity was 99.6% ±2.0% and for diagnostic specificity, 98.0% ±8.5%. Molecular biology techniques were, however, found to be less specific than expected. The potential reasons for such findings are discussed herein. The regular organisation of performance tests has contributed to an increase in the performance of participating laboratories over time, demonstrating the benefits of such testing. Maintaining a high-quality rabies diagnosis capability on a global scale is key to achieving the goal of eliminating dog-mediated human rabies deaths. The regular organisation of exercises on each continent using selected local strains to be tested according to the local epidemiological situation is one factor that could help increase reliable diagnosis worldwide. Rabies diagnosis capabilities could indeed be enhanced by providing adequate and sustainable proficiency testing on a large scale and in the long term

This study shares the rabies diagnosis proficiency test results of 73 laboratories on animal specimens using four techniques (FAT, RTCIT, conventional RT-PCR and real-time RT-PCR) organised over a 10-year period. This long-term exercise allowed us to compute accurate sensitivity and specificity values for the rabies diagnosis test for a large panel of laboratories. Conventional RT-PCR provided a better diagnostic sensitivity level than FAT, real-time RT-PCR and RTCIT. Regarding diagnostic specificity, RTCIT was the most specific technique followed closely by FAT, real-time RT-PCR and conventional RT-PCR. The specificity of molecular biology techniques was found to be lower than expected. The potential reasons for such findings are discussed herein. The regular organisation of performance tests has contributed to an increase in the performance of participating laboratories over time, demonstrating the likely benefits of such testing.

Evaluation of the diagnostic accuracy of lateral flow devices as a tool to diagnose rabies in post-mortem animals

Implementation of lateral flow devices (LFDs) for rabies antigen detection is expected to improve surveillance through the efficient detection of rabid animals in resource-limited settings; however, the use of LFDs for diagnosis remains controversial because some commercially available kits show low sensitivity. Therefore, we compared the diagnostic efficacy of three LFDs (ADTEC, Bionote, and Elabscience kits) paralleled with the direct fluorescent antibody test (dFAT) using fresh samples and investigated the diagnostic accuracies. To do so, we evaluated rabies-suspected samples submitted to the Regional Animal Disease Diagnostic Laboratory III, Philippines. Furthermore, we conducted real-time RT-PCR and sequencing to measure the accuracy of field laboratory diagnosis. The total number of animals submitted during this study period was 184 cases, including negative control samples. Of these, 53.9% (84 cases) were positive in the dFAT. Dogs were the most common rabies-suspected animal (n = 135). The sensitivities of the ADTEC and Bionote kits were 0.88 (74 cases) and 0.95 (80 cases), respectively. The specificity of both kits was 1.00 (100 cases). Furthermore, the sensitivity and specificity of the ADTEC kit after directly homogenizing the samples in assay buffer without dilution in phosphate-buffered saline (ADTEC kit DM) were 0.94 (79 cases) and 1.00 (100 cases), respectively. By contrast, there were no positive results using the Elabscience kit among all dFAT-positive samples. The sensitivity and specificity of LFDs make these tests highly feasible if properly used. Therefore, LFD tests can be used to strengthen the surveillance of rabies-infected animals in endemic and resource-limited settings.

Towards the elimination of dog-mediated rabies: development and application of an evidence-based management tool

BACKGROUND

International organizations advocate for the elimination of dog-mediated rabies, but there is only limited guidance on interpreting surveillance data for managing elimination programmes. With the regional programme in Latin America approaching elimination of dog-mediated rabies, we aimed to develop a tool to evaluate the programme's performance and generate locally-tailored rabies control programme management guidance to overcome remaining obstacles.

METHODS

We developed and validated a robust algorithm to classify progress towards rabies elimination within sub-national administrative units, which we applied to surveillance data from Brazil and Mexico. The method combines criteria that are easy to understand, including logistic regression analysis of case detection time series, assessment of rabies virus variants, and of incursion risk. Subjecting the algorithm to robustness testing, we further employed simulated data sub-sampled at differing levels of case detection to assess the algorithm's performance and sensitivity to surveillance quality.

RESULTS

Our tool demonstrated clear epidemiological transitions in Mexico and Brazil: most states progressed rapidly towards elimination, but a few regressed due to incursions and control lapses. In 2015, dog-mediated rabies continued to circulate in the poorest states, with foci remaining in only 1 of 32 states in Mexico, and 2 of 27 in Brazil, posing incursion risks to the wider region. The classification tool was robust in determining epidemiological status irrespective of most levels of surveillance quality. In endemic settings, surveillance would need to detect less than 2.5% of all circulating cases to result in misclassification, whereas in settings where incursions become the main source of cases the threshold detection level for correct classification should not be less than 5%.

CONCLUSION

Our tool provides guidance on how to progress effectively towards elimination targets and tailor strategies to local epidemiological situations, while revealing insights into rabies dynamics. Post-campaign assessments of dog vaccination coverage in endemic states, and enhanced surveillance to verify and maintain freedom in states threatened by incursions were identified as priorities to catalyze progress towards elimination. Our finding suggests genomic surveillance should become increasingly valuable during the endgame for discriminating circulating variants and pinpointing sources of incursions.

Performance evaluation of the polyclonal anti-rabies virus ribonucleoprotein IgG antibodies produced in-house for use in direct fluorescent antibody test

Fluorescein isothiocyanate (FITC) labelled anti-rabies virus ribonucleoprotein (RNP) antibodies can be used as immunoreagents in direct fluorescent antibody testing (dFAT) for rabies diagnoses. While in-house products are occasionally used by laboratories, most conjugates are commercial reagents. Commercial anti-RNP antibodies are only available for research purposes in Brazil, however, which contributes to the increasing use of in-house produced antibodies. Considering that conjugate quality may influence the results obtained during rabies diagnosis, we sought to analyze the performance requirements of in-house produced polyclonal anti-RNP IgG-FITC for application in dFAT. To that end, their reproducibility, diagnostic sensitivity, and specificity were evaluated. The titer of polyclonal anti-RNP IgG-FITC was initially determined and evaluated by dFAT, using central nervous system (CNS) samples of different animal species (dogs, cats, bovines, equines, bats, and non-human primates). As our main result, the polyclonal anti-RNP IgG-FITC reached a titer of 1:30/1:40 in dFAT, with 100% of diagnostic sensitivity and specificity. In terms of reproducibility, the antibodies, regardless the production batch, presented the same performances. In conclusion, the in-house produced polyclonal anti-RNP IgG-FITC proved suitable for rabies virus antigen detection by dFAT.

Economic and feasibility comparison of the dRIT and DFA for decentralized rabies diagnosis in resource-limited settings: The use of Nigerian dog meat markets as a case study

BACKGROUND

Rabies lyssavirus (RABV) is the aetiologic agent of rabies, a disease that is severely underreported in Nigeria as well as elsewhere in Africa and Asia. Despite the role that rabies diagnosis plays towards elucidating the true burden of the disease, Nigeria-a country of 180 million inhabitants-has a limited number of diagnostic facilities. In this study, we sought to investigate two of the World Organization for Animal Health (OIE)-recommended diagnostic assays for rabies-viz; the direct fluorescent antibody test (DFA) and the direct rapid immunohistochemical test (dRIT) in terms of their relative suitability in resource-limited settings. Our primary considerations were (1) the financial feasibility for implementation and (2) the diagnostic efficacy. As a case study, we used suspect rabies samples from dog meat markets in Nigeria.

METHODS/PRINCIPAL FINDINGS

By developing a simple simulation framework, we suggested that the assay with the lowest cost to implement and routinely use was the dRIT assay. The costs associated with the dRIT were lower in all simulated scenarios, irrespective of the number of samples tested per year. In addition to the cost analysis, the diagnostic efficacies of the two assays were evaluated. To do this, a cohort of DFA-positive and -negative samples collected from dog meat markets in Nigeria were initially diagnosed using the DFA in Nigeria and subsequently sent to South Africa for diagnostic confirmation. In South Africa, all the specimens were re-tested with the DFA, the dRIT and a quantitative real-time polymerase chain reaction (qRT-PCR). In our investigation, discrepancies were observed between the three diagnostic assays; with the incongruent results being resolved by means of confirmatory testing using the heminested reverse transcription polymerase reaction and sequencing to confirm that they were not contamination.

CONCLUSIONS/SIGNIFICANCE

The data obtained from this study suggested that the dRIT was not only an effective diagnostic assay that could be used to routinely diagnose rabies, but that the assay was also the most cost-effective option among all of the OIE recommended methods. In addition, the results of our investigation confirmed that some of the dogs slaughtered in dog markets were rabies-positive and that the markets posed a potential public health threat. Lastly, our data showed that the DFA, although regarded as the gold standard test for rabies, has some limitations-particularly at low antigen levels. Based on the results reported here and the current challenges faced in Nigeria, we believe that the dRIT assay would be the most suitable laboratory test for decentralized or confirmatory rabies diagnosis in Nigeria, given its relative speed, accuracy, cost and ease of use.

An inter-laboratory trial as a tool to increase rabies diagnostic capabilities of Sub-Saharan African Veterinary laboratories

To achieve the goal of eliminating dog-mediated human rabies deaths by 2030, many African countries have agreed to list rabies as a priority zoonotic disease and to undertake both short and long-term control programs. Within this context, reliable local diagnosis is essential for the success of field surveillance systems. However, a harmonized, sustainable and supportive diagnostic offer has yet to be achieved in the continent. We herewith describe the organization and outcome of a proficiency test (PT) for the post-mortem diagnosis of rabies in animals, involving thirteen veterinary laboratories and one public health laboratory in Africa. Participants were invited to assess both the performance of the Direct Fluorescent Antibody (DFA) test and of a conventional RT-PCR. From the submitted results, while thirteen laboratories proved to be able to test the samples through DFA test, eleven performed the RT-PCR method; ten applied both techniques. Of note, the number of laboratories able to apply rabies RT-PCR had increased from four to ten after the exercise. Importantly, results showed a higher proficiency in applying the molecular test compared to the DFA test (concordance, sensitivity and specificity: 98.2%, 96.97% and 100% for RT-PCR; 87.69%, 89.23% and 86.15% for DFA test), indicating the feasibility of molecular methods to diagnose animal pathogens in Africa. Another positive outcome of this approach was that negative and positive controls were made available for further in-house validation of new techniques; in addition, a detailed questionnaire was provided to collect useful and relevant information on the diagnostic procedures and biosafety measures applied at laboratory level.

First inter-laboratory comparison of Echinococcus granulosus sensu lato diagnosis in Latin America

OBJECTIVE

To compare the performance of polymerase chain reaction (PCR) and enzyme-linked immunosorbent assay (ELISA) tests for diagnosing Echinococcus granulosus in dog feces among national reference laboratories in Argentina, Chile, Peru, and Uruguay.

METHODS

National laboratories affiliated with the Ministry of Health/Agriculture of each country exchanged panels of 10 positive/negative samples obtained from their regular national surveillance programs in November 2015 - November 2016. All laboratories applied PCR; two also applied ELISA techniques. Sensitivity and specificity were determined for each laboratory and concordance of results among the laboratories was evaluated by Cohen Kappa coefficient.

RESULTS

Poor concordance (3 of 10 paired comparisons had values of Kappa > 0.4), low sensitivity and specificity across all laboratories, and poor performance of both techniques in detecting E. granulosus in canine feces was demonstrated in this study. An ex-post comparison of the laboratories' test protocols showed substantial heterogeneity that could partially explain poor concordance of results.

CONCLUSION

The results underscore the heterogeneity of canine echinococcosis diagnosis across the region and indicate possible sources of variability. Efforts to standardize canine echinococcosis testing must be included in the plan of action for the Regional Initiative for the Control of Cystic Echinococcosis. Future comparisons with fecal samples of known parasite load are needed.

Rabies in the Americas: 1998-2014

Through national efforts and regional cooperation under the umbrella of the Regional Program for the Elimination of Rabies, dog and human rabies have decreased significantly in Latin America and Caribbean (LAC) countries over the last three decades. To achieve this decline, LAC countries had to develop national plans, and consolidate capabilities such as regular mass dog vaccination, opportune post-exposure prophylaxis and sensitive surveillance. This paper presents longitudinal data for 21 LAC countries on dog vaccination, PEP and rabies surveillance collected from the biannual regional meeting for rabies directors from 1998-2014 and from the Regional Epidemiologic Surveillance System for Rabies (SIRVERA). Differences in human and dog rabies incidence rates and dog vaccination rates were shown between low, middle and high-income countries. At the peak, over 50 million dogs were vaccinated annually in national campaigns in the countries represented. The reported number of animal exposures remained fairly stable during the study period with an incidence rate ranging from 123 to 191 reported exposures per 100,000 people. On average, over 2 million doses of human vaccine were applied annually. In the most recent survey, only 37% of countries reported that they had sufficient financial resources to meet the program objectives. The data show a sufficient and sustained effort of the LAC countries in the area of dog vaccination and provide understanding of the baseline effort required to reduce dog-mediated rabies incidence.

Application and Comparative Evaluation of Fluorescent Antibody, Immunohistochemistry and Reverse Transcription Polymerase Chain Reaction Tests for the Detection of Rabies Virus Antigen or Nucleic Acid in Brain Samples of Animals Suspected of Rabies in India

Accurate and early diagnosis of animal rabies is critical for undertaking public health measures. Whereas the direct fluorescent antibody (DFA) technique is the recommended test, the more convenient, direct rapid immunochemistry test (dRIT), as well as the more sensitive, reverse transcription polymerase chain reaction (RT-PCR), have recently been employed for the laboratory diagnosis of rabies. We compared the three methods on brain samples from domestic (dog, cat, cattle, buffalo, horse, pig and goat) and wild (leopard, wolf and jackal) animals from various parts of India. Of the 257 samples tested, 167 were positive by all the three tests; in addition, 35 of the 36 decomposed samples were positive by RT-PCR. This is the first study in which such large number of animal samples have been subjected to the three tests simultaneously. The results confirm 100% corroboration between DFA and dRIT, buttress the applicability of dRIT in the simple and rapid diagnosis of rabies in animals, and reaffirm the suitability of RT-PCR for samples unfit for testing either by DFA or dRIT.

Quantifying the burden of vampire bat rabies in Peruvian livestock

Background

Knowledge of infectious disease burden is necessary to appropriately allocate resources for prevention and control. In Latin America, rabies is among the most important zoonoses for human health and agriculture, but the burden of disease attributed to its main reservoir, the common vampire bat (Desmodus rotundus), remains uncertain.

Methodology/Principal findings

We used questionnaires to quantify under-reporting of livestock deaths across 40 agricultural communities with differing access to health resources and epidemiological histories of vampire bat rabies (VBR) in the regions of Apurimac, Ayacucho and Cusco in southern Peru. Farmers who believed VBR was absent from their communities were one third as likely to report livestock deaths from disease as those who believed VBR was present, and under-reporting increased with distance from reporting offices. Using generalized mixed-effect models that captured spatial autocorrelation in reporting, we project 4.6 (95% CI: 4.4–8.2) rabies cases per reported case and identify geographic areas with potentially greater VBR burden than indicated by official reports. Spatially-corrected models estimate 505–724 cattle deaths from VBR in our study area during 2014 (421–444 deaths/100,000 cattle), costing US$121,797–171,992. Cost benefit analysis favoured vaccinating all cattle over the current practice of partial vaccination or halting vaccination all together.

Conclusions

Our study represents the first estimate of the burden of VBR in Latin America to incorporate data on reporting rates. We confirm the long-suspected cost of VBR to small-scale farmers and show that vaccinating livestock is a cost-effective solution to mitigate the burden of VBR. More generally, results highlight that ignoring geographic variation in access to health resources can bias estimates of disease burden and risk.

The number of cases and monetary cost of a disease guides how resources for prevention and control are allocated. In Latin America, rabies transmitted by vampire bats is one of the most recognized zoonoses affecting humans and livestock, but its burden on lives and livelihoods has been difficult to calculate because the percentage of outbreaks that are not reported to surveillance systems is unknown. Here, using surveys to calculate farmers’ tendencies to report livestock deaths, we estimate that over 500 cattle died of rabies in southern Peru in 2014, a loss of approximately US$170,000 or over 700 months of local income. Our results also show that the perceived risk of rabies strongly affected reporting of cattle mortality and vaccination coverage, suggesting that campaigns to increase awareness could reduce the burden of rabies.