Assessment of the required performance and the development of corresponding program decision rules for neglected tropical diseases diagnostic tests: Monitoring and evaluation of soil-transmitted helminthiasis control programs as a case study

Potential Impact of a Diagnostic Test for Detecting Prepatent Guinea Worm Infections in Dogs

Chad has seen a considerable reduction in cases of Guinea worm disease (or dracunculiasis) in domestic dogs in recent years. Tethering of dogs and application of Abate® larvicide to water sources appear to have contributed to this progress, but with 767 reported dog cases in 2021, accelerating elimination of the disease in Chad may require additional tools. We investigate the potential benefits of a hypothetical diagnostic test that could be capable of detecting prepatent infections in dogs. We adapt an agent-based simulation model for forecasting the impact of interventions on guinea worm disease in dogs to examine the interaction of multiple test factors including test accuracy, when the test can detect infection, dog selection, and dog-owner compliance with tethering recommendations. We find that a diagnostic test could be successful if used in conjunction with existing interventions, and elimination can be achieved within 2 years with 80% or higher test sensitivity, 90% or higher specificity, systematic testing of each dog twice per year, and more than 90% long-term tethering compliance when a dog tests positive or a worm is emerging. Because of the long incubation period of Guinea worm disease (10-14 months) and the fact that no treatment exists, the benefits of the test rely on the testing rollout and response of dog owners. If the test could estimate the timing of worm emergence, long-term tethering could be eliminated and infected dogs could be tethered only when the worms are expected, minimizing the related resources (human and financial) to support the intervention.

Vaccine value profile for Hookworm

Hookworm, a parasitic infection, retains a considerable burden of disease, affecting the most underprivileged segments of the general population in endemic countries and remains one of the leading causes of mild to severe anemia in Low and Middle Income Countries (LMICs), particularly in pregnancy and children under 5. Despite repeated large scale Preventive Chemotherapy (PC) interventions since more than 3 decades, there is broad consensus among scholars that elimination targets set in the newly launched NTD roadmap will require additional tools and interventions. Development of a vaccine could constitute a promising expansion of the existing arsenal against hookworm. Therefore, we have evaluated the biological and implementation feasibility of the vaccine development as well as the added value of such a novel tool. Based on pipeline landscaping and the current knowledge on key biological aspects of the pathogen and its interactions with the host, we found biological feasibility of development of a hookworm vaccine to be moderate. Also, our analysis on manufacturing and regulatory issues as well as potential uptake yielded moderate implementation feasibility. Modelling studies suggest a that introduction of a vaccine in parallel with ongoing integrated interventions (PC, WASH, shoe campaigns), could substantially reduce burden of disease in a cost - saving mode. Finally a set of actions are recommended that might impact positively the likelihood of timely development and introduction of a hookworm vaccine.

A general framework to support cost-efficient fecal egg count methods and study design choices for large-scale STH deworming programs-monitoring of therapeutic drug efficacy as a case study

BACKGROUND

Soil-transmitted helminth (STH) control programs currently lack evidence-based recommendations for cost-efficient survey designs for monitoring and evaluation. Here, we present a framework to provide evidence-based recommendations, using a case study of therapeutic drug efficacy monitoring based on the examination of helminth eggs in stool.

METHODS

We performed an in-depth analysis of the operational costs to process one stool sample for three diagnostic methods (Kato-Katz, Mini-FLOTAC and FECPAKG2). Next, we performed simulations to determine the probability of detecting a truly reduced therapeutic efficacy for different scenarios of STH species (Ascaris lumbricoides, Trichuris trichiura and hookworms), pre-treatment infection levels, survey design (screen and select (SS); screen, select and retest (SSR) and no selection (NS)) and number of subjects enrolled (100-5,000). Finally, we integrated the outcome of the cost assessment into the simulation study to estimate the total survey costs and determined the most cost-efficient survey design.

PRINCIPAL FINDINGS

Kato-Katz allowed for both the highest sample throughput and the lowest cost per test, while FECPAKG2 required both the most laboratory time and was the most expensive. Counting of eggs accounted for 23% (FECPAKG2) or ≥80% (Kato-Katz and Mini-FLOTAC) of the total time-to-result. NS survey designs in combination with Kato-Katz were the most cost-efficient to assess therapeutic drug efficacy in all scenarios of STH species and endemicity.

CONCLUSIONS/SIGNIFICANCE

We confirm that Kato-Katz is the fecal egg counting method of choice for monitoring therapeutic drug efficacy, but that the survey design currently recommended by WHO (SS) should be updated. Our generic framework, which captures laboratory time and material costs, can be used to further support cost-efficient choices for other important surveys informing STH control programs. In addition, it can be used to explore the value of alternative diagnostic techniques, like automated egg counting, which may further reduce operational costs.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03465488.

A review on innovative optical devices for the diagnosis of human soil-transmitted helminthiasis and schistosomiasis: from research and development to commercialization

Diagnosis of soil-transmitted helminth (STH) and schistosome infections relies largely on conventional microscopy which has limited sensitivity, requires highly trained personnel and is error-prone. Rapid advances in miniaturization of optical systems, sensors and processors have enhanced research and development of digital and automated microscopes suitable for the detection of these diseases in resource-limited settings. While some studies have reported proof-of-principle results, others have evaluated the performance of working prototypes in field settings. The extensive commercialization of these innovative devices has, however, not yet been achieved. This review provides an overview of recent publications (2010–2022) on innovative field applicable optical devices which can be used for the diagnosis of STH and schistosome infections. Using an adapted technology readiness level (TRL) scale taking into account the WHO target product profile (TPP) for these diseases, the developmental stages of the devices were ranked to determine the readiness for practical applications in field settings. From the reviewed 18 articles, 19 innovative optical devices were identified and ranked. Almost all of the devices (85%) were ranked with a TRL score below 8 indicating that, most of the devices are not ready for commercialization and field use. The potential limitations of these innovative devices were discussed. We believe that the outcome of this review can guide the end-to-end development of automated digital microscopes aligned with the WHO TPP for the diagnosis of STH and schistosome infections in resource-limited settings.

The development of an artificial intelligence-based digital pathology for neglected tropical diseases: A platform specific analysis of the World Health Organization diagnostic target product profile for soil-transmitted helminthiasis

The World Health Organization (WHO) recently published target product profiles (TPPs) for neglected tropical diseases (NTDs) to inform and accelerate the development of diagnostics tools necessary to achieve targets in the decade ahead. These TPPs describe the minimal and ideal requirements for various diagnostic needs related to NTD specific use-cases. An early step towards the manufacture and implementation of new diagnostics is to critically review the TPPs and translate these into an initial design and ultimately into user requirement specifications (URS). Artificial intelligence-based digital pathology (AI-DP) may overcome critical shortcomings of current standards for most NTDs reliant on microscopy, such as poor reproducibility and error-prone manual read-out. Furthermore, a digitalised workflow can create opportunities to reduce operational costs via increased throughput and automated data capture, analysis, and reporting. Despite these promising benefits, a critical review of the NTD TPPs with consideration to an AI-DP diagnostic solution is lacking. We present a systematic analysis of one of the WHO TPPs with the aim to inform the development of a URS for an AI-DP solution for NTDs. As a case study we focused on monitoring and evaluation (M&E) of programs designed to control soil-transmitted helminths (STHs). To this end, we start by outlining a brief overview of diagnostic needs for STHs, after which we systematically analyse the recently published WHO TPPs, highlighting the technical considerations for an AI-DP diagnostic solution to meet the minimal requirements for this TPP. Finally, we further reflect on the feasibility of an AI-DP informing STH programs towards the WHO 2030 targets in due time.

Comparison of coproprevalence and seroprevalence to guide decision-making in national soil-transmitted helminthiasis control programs: Ethiopia as a case study

BACKGROUND

WHO recommends periodical assessment of the prevalence of any soil-transmitted helminth (STH) infections to adapt the frequency of mass drug administration targeting STHs. Today, detection of eggs in stool smears (Kato-Katz thick smear) remains the diagnostic standard. However, stool examination (coprology) has important operational drawbacks and impedes integrated surveys of multiple neglected tropical diseases. Therefore, the aim of the present study was to assess the potential of applying serology instead of coprology in STH control program decision-making.

METHODOLOGY

An antibody-ELISA based on extract of Ascaris lung stage larvae (AsLungL3-ELISA) was applied in ongoing monitoring activities of the Ethiopian national control program against schistosomiasis and soil-transmitted helminthiasis. Blood and stool samples were collected from over 6,700 students (median age: 11) from 63 schools in 33 woredas (districts) across the country. Stool samples of two consecutive days were analyzed applying duplicate Kato-Katz thick smear.

PRINCIPAL FINDINGS

On woreda level, qualitative (seroprevalence) and quantitative (mean optical density ratio) serology results were highly correlated, and hence seroprevalence was chosen as parameter. For 85% of the woredas, prevalence based on serology was higher than those based on coprology. The results suggested cross-reactivity of the AsLungL3-ELISA with Trichuris. When extrapolating the WHO coproprevalence thresholds, there was a moderate agreement (weighted κ = 0.43) in program decision-making. Using the same threshold values would predominantly lead to a higher frequency of drug administration.

SIGNIFICANCE

This is the first time that serology for soil-transmitted helminthiasis is applied on such large scale, thereby embedded in a control program context. The results underscore that serology holds promise as a tool to monitor STH control programs. Further research should focus on the optimization of the diagnostic assay and the refinement of serology-specific program decision-making thresholds.

Two-stage lot quality assurance sampling framework for monitoring and evaluation of neglected tropical diseases, allowing for imperfect diagnostics and spatial heterogeneity

Background

Monitoring and evaluation (M&E) is a key component of large-scale neglected tropical diseases (NTD) control programs. Diagnostic tests deployed in these M&E surveys are often imperfect, and it remains unclear how this affects the population-based program decision-making.

Methodology

We developed a 2-stage lot quality assurance sampling (LQAS) framework for decision-making that allows for both imperfect diagnostics and spatial heterogeneity of infections. We applied the framework to M&E of soil-transmitted helminth control programs as a case study. For this, we explored the impact of the diagnostic performance (sensitivity and specificity), spatial heterogeneity (intra-cluster correlation), and survey design on program decision-making around the prevalence decisions thresholds recommended by WHO (2%, 10%, 20% and 50%) and the associated total survey costs.

Principal findings

The survey design currently recommended by WHO (5 clusters and 50 subjects per cluster) may lead to incorrect program decisions around the 2% and 10% prevalence thresholds, even when perfect diagnostic tests are deployed. To reduce the risk of incorrect decisions around the 2% prevalence threshold, including more clusters (≥10) and deploying highly specific diagnostic methods (≥98%) are the most-cost saving strategies when spatial heterogeneity is moderate-to-high (intra-cluster correlation >0.017). The higher cost and lower throughput of improved diagnostic tests are compensated by lower required sample sizes, though only when the cost per test is <6.50 US$ and sample throughput is ≥3 per hour.

Conclusion/Significance

Our framework provides a means to assess and update M&E guidelines and guide product development choices for NTD. Using soil-transmitted helminths as a case study, we show that current M&E guidelines may severely fall short, particularly in low-endemic and post-control settings. Furthermore, specificity rather than sensitivity is a critical parameter to consider. When the geographical distribution of an NTD within a district is highly heterogeneous, sampling more clusters (≥10) may be required.