Dynamical Malaria Forecasts Are Skillful at Regional and Local Scales in Uganda up to 4 Months Ahead

A systematic review of sample size estimation accuracy on power in malaria cluster randomised trials measuring epidemiological outcomes

INTRODUCTION

Cluster randomised trials (CRTs) are the gold standard for measuring the community-wide impacts of malaria control tools. CRTs rely on well-defined sample size estimations to detect statistically significant effects of trialled interventions, however these are often predicted poorly by triallists. Here, we review the accuracy of predicted parameters used in sample size calculations for malaria CRTs with epidemiological outcomes.

METHODS

We searched for published malaria CRTs using four online databases in March 2022. Eligible trials included those with malaria-specific epidemiological outcomes which randomised at least six geographical clusters to study arms. Predicted and observed sample size parameters were extracted by reviewers for each trial. Pair-wise Spearman's correlation coefficients (rs) were calculated to assess the correlation between predicted and observed control-arm outcome measures and effect sizes (relative percentage reductions) between arms. Among trials which retrospectively calculated an estimate of heterogeneity in cluster outcomes, we recalculated study power according to observed trial estimates.

RESULTS

Of the 1889 records identified and screened, 108 articles were eligible and comprised of 71 malaria CRTs. Among 91.5% (65/71) of trials that included sample size calculations, most estimated cluster heterogeneity using the coefficient of variation (k) (80%, 52/65) which were often predicted without using prior data (67.7%, 44/65). Predicted control-arm prevalence moderately correlated with observed control-arm prevalence (rs: 0.44, [95%CI: 0.12,0.68], p-value < 0.05], with 61.2% (19/31) of prevalence estimates overestimated. Among the minority of trials that retrospectively calculated cluster heterogeneity (20%, 13/65), empirical values contrasted with those used in sample size estimations and often compromised study power. Observed effect sizes were often smaller than had been predicted at the sample size stage (72.9%, 51/70) and were typically higher in the first, compared to the second, year of trials. Overall, effect sizes achieved by malaria interventions tested in trials decreased between 1995 and 2021.

CONCLUSIONS

Study findings reveal sample size parameters in malaria CRTs were often inaccurate and resulted in underpowered studies. Future trials must strive to obtain more representative epidemiological sample size inputs to ensure interventions against malaria are adequately evaluated.

REGISTRATION

This review is registered with PROSPERO (CRD42022315741).

Decision-support tools to build climate resilience against emerging infectious diseases in Europe and beyond

Climate change is one of several drivers of recurrent outbreaks and geographical range expansion of infectious diseases in Europe. We propose a framework for the co-production of policy-relevant indicators and decision-support tools that track past, present, and future climate-induced disease risks across hazard, exposure, and vulnerability domains at the animal, human, and environmental interface. This entails the co-development of early warning and response systems and tools to assess the costs and benefits of climate change adaptation and mitigation measures across sectors, to increase health system resilience at regional and local levels and reveal novel policy entry points and opportunities. Our approach involves multi-level engagement, innovative methodologies, and novel data streams. We take advantage of intelligence generated locally and empirically to quantify effects in areas experiencing rapid urban transformation and heterogeneous climate-induced disease threats. Our goal is to reduce the knowledge-to-action gap by developing an integrated One Health-Climate Risk framework.

Assessment of Climate-Driven Variations in Malaria Transmission in Senegal Using the VECTRI Model

Several vector-borne diseases, such as malaria, are sensitive to climate and weather conditions. When unusual conditions prevail, for example, during periods of heavy rainfall, mosquito populations can multiply and trigger epidemics. This study, which consists of better understanding the link between malaria transmission and climate factors at a national level, aims to validate the VECTRI model (VECtor borne disease community model of ICTP, TRIeste) in Senegal. The VECTRI model is a grid-distributed dynamical model that couples a biological model for the vector and parasite life cycles to a simple compartmental Susceptible-Exposed-Infectious-Recovered (SEIR) representation of the disease progression in the human host. In this study, a VECTRI model driven by reanalysis data (ERA-5) was used to simulate malaria parameters, such as the entomological inoculation rate (EIR) in Senegal. Observed malaria data from the National Malaria Control Program in Senegal (PNLP/Programme National de Lutte contre le Paludisme au Senegal) and outputs from the climate data used in this study were compared. The findings highlight the unimodal shape of temporal malaria occurrence, and the seasonal malaria transmission contrast is closely linked to the latitudinal variation of the rainfall, showing a south–north gradient over Senegal. This study showed that the peak of malaria takes place from September to October, with a lag of about one month from the peak of rainfall in Senegal. There is an agreement between observations and simulations about decreasing malaria cases on time. These results indicate that the southern area of Senegal is at the highest risk of malaria spread outbreaks. The findings in the paper are expected to guide community-based early-warning systems and adaptation strategies in Senegal, which will feed into the national malaria prevention, response, and care strategies adapted to the needs of local communities.

Probabilistic seasonal dengue forecasting in Vietnam: A modelling study using superensembles

BACKGROUND

With enough advanced notice, dengue outbreaks can be mitigated. As a climate-sensitive disease, environmental conditions and past patterns of dengue can be used to make predictions about future outbreak risk. These predictions improve public health planning and decision-making to ultimately reduce the burden of disease. Past approaches to dengue forecasting have used seasonal climate forecasts, but the predictive ability of a system using different lead times in a year-round prediction system has been seldom explored. Moreover, the transition from theoretical to operational systems integrated with disease control activities is rare.

METHODS AND FINDINGS

We introduce an operational seasonal dengue forecasting system for Vietnam where Earth observations, seasonal climate forecasts, and lagged dengue cases are used to drive a superensemble of probabilistic dengue models to predict dengue risk up to 6 months ahead. Bayesian spatiotemporal models were fit to 19 years (2002-2020) of dengue data at the province level across Vietnam. A superensemble of these models then makes probabilistic predictions of dengue incidence at various future time points aligned with key Vietnamese decision and planning deadlines. We demonstrate that the superensemble generates more accurate predictions of dengue incidence than the individual models it incorporates across a suite of time horizons and transmission settings. Using historical data, the superensemble made slightly more accurate predictions (continuous rank probability score [CRPS] = 66.8, 95% CI 60.6-148.0) than a baseline model which forecasts the same incidence rate every month (CRPS = 79.4, 95% CI 78.5-80.5) at lead times of 1 to 3 months, albeit with larger uncertainty. The outbreak detection capability of the superensemble was considerably larger (69%) than that of the baseline model (54.5%). Predictions were most accurate in southern Vietnam, an area that experiences semi-regular seasonal dengue transmission. The system also demonstrated added value across multiple areas compared to previous practice of not using a forecast. We use the system to make a prospective prediction for dengue incidence in Vietnam for the period May to October 2020. Prospective predictions made with the superensemble were slightly more accurate (CRPS = 110, 95% CI 102-575) than those made with the baseline model (CRPS = 125, 95% CI 120-168) but had larger uncertainty. Finally, we propose a framework for the evaluation of probabilistic predictions. Despite the demonstrated value of our forecasting system, the approach is limited by the consistency of the dengue case data, as well as the lack of publicly available, continuous, and long-term data sets on mosquito control efforts and serotype-specific case data.

CONCLUSIONS

This study shows that by combining detailed Earth observation data, seasonal climate forecasts, and state-of-the-art models, dengue outbreaks can be predicted across a broad range of settings, with enough lead time to meaningfully inform dengue control. While our system omits some important variables not currently available at a subnational scale, the majority of past outbreaks could be predicted up to 3 months ahead. Over the next 2 years, the system will be prospectively evaluated and, if successful, potentially extended to other areas and other climate-sensitive disease systems.

Estimating the malaria transmission over the Indian subcontinent in a warming environment using a dynamical malaria model

Malaria is a major public health problem in India. The malaria transmission is sensitive to climatic parameters. The regional population-related factors also influence malaria transmission. To take into account temperature and rainfall variability and associated population-related effects (in a changing climate) on the malaria transmission over India, a regional dynamical malaria model, namely VECTRI (vector-borne disease community model) is used. The daily temperature and rainfall data derived from the historical (years 1961-2005) and representative concentration pathway (years 2006-2050) runs of the Coupled Model Intercomparison Project Phase 5 models have been used for the analysis. The model results of the historical run are compared with the observational data. The spatio-temporal changes (region-specific as well as seasonal changes) in the malaria transmission as a result of climate change are quantified over the India. The parameters related to the breeding cycle of malaria as well as those which estimate the malaria cases are analyzed in the global warming scenario.

Applied mathematical modelling to inform national malaria policies, strategies and operations in Tanzania

BACKGROUND

More than ever, it is crucial to make the best use of existing country data, and analytical tools for developing malaria control strategies as the heterogeneity in malaria risk within countries is increasing, and the available malaria control tools are expanding while large funding gaps exist. Global and local policymakers, as well as funders, increasingly recognize the value of mathematical modelling as a strategic tool to support decision making. This case study article describes the long-term use of modelling in close collaboration with the National Malaria Control Programme (NMCP) in Tanzania, the challenges encountered and lessons learned.

CASE DESCRIPTION

In Tanzania, a recent rebound in prevalence led to the revision of the national malaria strategic plan with interventions targeted to the malaria risk at the sub-regional level. As part of the revision, a mathematical malaria modelling framework for setting specific predictions was developed and used between 2016 and 2019 to (1) reproduce setting specific historical malaria trends, and (2) to simulate in silico the impact of future interventions. Throughout the project, multiple stakeholder workshops were attended and the use of mathematical modelling interactively discussed.

EVALUATION

In Tanzania, the model application created an interdisciplinary and multisectoral dialogue platform between modellers, NMCP and partners and contributed to the revision of the national malaria strategic plan by simulating strategies suggested by the NMCP. The uptake of the modelling outputs and sustained interest by the NMCP were critically associated with following factors: (1) effective sensitization to the NMCP, (2) regular and intense communication, (3) invitation for the modellers to participate in the strategic plan process, and (4) model application tailored to the local context.

CONCLUSION

Empirical data analysis and its use for strategic thinking remain the cornerstone for evidence-based decision-making. Mathematical impact modelling can support the process both by unifying all stakeholders in one strategic process and by adding new key evidence required for optimized decision-making. However, without a long-standing partnership, it will be much more challenging to sensibilize programmes to the usefulness and sustained use of modelling and local resources within the programme or collaborating research institutions need to be mobilized.