Objective monitoring of Insecticide-treated bednet use to improve malaria prevention: SmartNet development and validation

Remote bednet use monitoring to describe patterns of use and exposure to female Anopheles mosquitoes in an Ugandan cohort

Background

Long lasting insecticide-treated bednets (LLINs) are the most widely used tool for preventing malaria. There has been a plateau in progress in the highest burden African countries since 2015, leading to questions about the effectiveness of LLINs. In this study, remote LLIN use monitors were deployed in a cohort in Eastern Uganda to explore how LLIN use interacts with mosquito exposure.

Methods

The SmartNet study included 20 households from May to October 2019. SmartNet devices recorded, every 15 min, whether an LLIN was unfurled or folded up. Unannounced visits were used to assess SmartNet accuracy. Risk factors associated with poor LLIN use were assessed using generalized linear equations. Female Anopheles exposure was estimated by combining hourly probabilities of exposure from human landing catches and measures of density from biweekly CDC light traps in participants rooms. Mosquito exposure averted by LLINs was quantified using SmartNet measurements and age-related differences were estimated using generalized linear equations, adjusting for relevant covariates and household clustering.

Results

96 individuals contributed 5,640 SmartNet observation nights. In 126 unannounced visits, SmartNet had an area under the curve of 0.869 in classifying whether the LLIN was up or down. The rate of non-use was 13.5% of nights (95% CI: 12.6-14.3%). Compared to children under 5, non-use was 1.8 times higher (95% CI: 1.6-2.1; p < 0.001) in children 5-15 years and 2.6 times higher (95% CI: 2.2-3.1; p < 0.001) in participants aged 15-<30years. There was no difference between children under 5 years and adults > 30 years. LLIN use averted 50.3% of female Anopheles mosquito exposure (95% CI: 40.0-60.0%), with decreasing point estimates of efficacy across age groups: from 61.7% (95% CI: 42.6-80.7%) in children under 5 years to 48.0% (95% CI: 29.1-66.8%) in adults over 30.

Conclusions

Objective monitors are accurate and can feasibly be deployed to obtain data about LLIN use. LLINs provided protection from only 50% of female Anopheles mosquito exposure in this cohort and protection was dependent upon age. In assessing the role of LLINs in malaria prevention it is crucial to consider the dynamics between mosquito exposure and LLIN use behaviors.

A qualitative study of the acceptability of remote electronic bednet use monitoring in Uganda

BACKGROUND

Distribution of long-lasting insecticide treated nets (LLINs) is the most widely used intervention for the prevention of malaria but recall and social desirability biases may lead to challenges in accurately measuring use of bednets. SmartNet is a remote electronic monitor that provides objective measurements of bednet use over weeks at a time. Assessing local acceptability is important when implementing innovative global health technologies such as SmartNet. This study draws on established models such as the Technology Acceptance Model (TAM) and Theoretical Framework of Acceptability (TFA) to assess acceptability of SmartNet in Ugandan households.

METHODS

Semi-structured qualitative interviews were conducted at weeks one and six following installation of SmartNet in ten households in Western Uganda. Heads-of-households answered open-ended questions addressing the main acceptability domains of the TFA and TAM models (i.e. perceived ease of use, ethicality, etc.). Responses were digitally recorded, transcribed, coded and analyzed using a thematic analysis approach.

RESULTS

Seven out of ten households interviewed reported no difference in use between SmartNet and a standard LLIN. Households stated the large size, soft fabric, and the efficacy of SmartNet relative to a standard LLIN contributed to perceived usefulness and perceived ease of use. Opportunity costs of the novel monitoring system expressed by households included difficulty washing nets and dislike of blinking lights on the device. Barriers to SmartNet use focused on questions of the ethics of bednet use monitoring, discomfort with technical aspects of the device and a poor understanding of its function amongst others in the community. However, explaining SmartNet to other community members resolved these concerns and often resulted in interest and acceptance among peers.

CONCLUSION

Objective monitoring of bednet use with SmartNet appears acceptable to these households in Uganda. Use of SmartNet seems to be similar to behaviors around use of standard LLINs. Viewpoints on many aspects of SmartNet were generally favorable. Concerns around ethicality of bednet monitoring are present and indicate the need for continuing community education. The device will continue to be optimized to make it more acceptable to users and to accurately reflect standard LLIN use to improve our understanding of prevention behaviors in malaria endemic settings.

Evaluation of an accelerometer-based monitor for detecting bed net use and human entry/exit using a machine learning algorithm

Background

Distribution of long-lasting insecticidal bed nets (LLINs) is one of the main control strategies for malaria. Improving malaria prevention programmes requires understanding usage patterns in households receiving LLINs, but there are limits to what standard cross-sectional surveys of self-reported LLIN use can provide. This study was designed to assess the performance of an accelerometer-based approach for measuring a range of LLIN use behaviours as a proof of concept for more granular LLIN-use monitoring over longer time periods.

Methods

This study was carried out under controlled conditions from May to July 2018 in Liverpool, UK. A single accelerometer was affixed to the side panel of an LLIN and participants carried out five LLIN use behaviours: (1) unfurling a net; (2) entering an unfurled net; (3) lying still as if sleeping; (4) exiting from under a net; and, (5) folding up a net. The randomForest package in R, a supervised non-linear classification algorithm, was used to train models on 20-s epochs of tagged accelerometer data. Models were compared in a validation dataset using overall accuracy, sensitivity and specificity, receiver operating curves and the area under the curve (AUC).

Results

The five-category model had overall accuracy of 82.9% in the validation dataset, a sensitivity of 0.681 for entering a net, 0.632 for exiting, 0.733 for net down, and 0.800 for net up. A simplified four-category model, combining entering/exiting a net into one category had accuracy of 94.8%, and increased sensitivity for net down (0.756) and net up (0.829). A further simplified three-category model, identifying sleeping, net up, and a combined net down/enter/exit category had accuracy of 96.2% (483/502), with an AUC of 0.997 for net down and 0.987 for net up. Models for detecting entering/exiting by adults were significantly more accurate than for children (87.8% vs 70.0%; p < 0.001) and had a higher AUC (p = 0.03).

Conclusions

Understanding how LLINs are used is crucial for planning malaria prevention programmes. Accelerometer-based systems provide a promising new methodology for studying LLIN use. Further work exploring accelerometer placement, frequency of measurements and other machine learning approaches could make these methods even more accurate in the future.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12936-022-04102-z.

"After those nets are torn, most people use them for other purposes": an examination of alternative bed net use in western Kenya

BACKGROUND

Alternative long-lasting insecticidal net (LLIN) use for purposes other than sleeping protection from mosquitoes is widely debated as a limitation to successful malaria control efforts, yet rarely rigorously studied.

METHODS

A cross-sectional survey of 1217 households in an epidemic highland site and an endemic lowland site in western Kenya collected information on alternative use in three ways: direct observations, participant self-report, and participant reporting of community-level practices. LLIN misuse was defined as use of an intact net for alternative purposes and repurposing as alternatively using an old or damaged net. Associations between households with observed repurposed nets and universal access and household net use were examined.

RESULTS

Households describe repurposing nets when they are torn and/or old. Repurposed nets were observed in 8.1% (52/643) highlands households and 33.0% (184/574) lowlands households. Repurposed nets served as chicken coops (33% highlands, 20% lowlands), fences (37% highlands, 25% lowlands), tree covers (22% lowlands), curtains (3% highlands), covering bathrooms (1.5% highlands, 9% lowlands), and washing sponges (13% lowlands). No association was found between repurposing and universal access or household net use. Misuse was rare. Of 379 repurposed nets, 4 (1.06%) were in good condition with no holes. Of 1,758 active nets, 13 (0.74%) were misused.

CONCLUSIONS

Alternative net use in this study involved repurposing rather than misuse. Repurposing was not detrimental to malaria prevention efforts in these communities. Standardized measurement of alternative net use should be used to better understand the practice and its potential impact on the success of malaria interventions.

How Are Insecticide-Treated Bednets Used in Ugandan Households? A Comprehensive Characterization of Bednet Adherence Using a Remote Monitor

Long-lasting insecticide-treated bednets are widely used and promoted for malaria control. Limitations in measurement methods have resulted in a poor understanding of how bednets are used in practice. We deployed a novel remote monitoring tool in Uganda to obtain, for the first time, a comprehensive characterization of bednet use in households at risk for malaria. Ten households each used one SmartNet adherence monitor over a commonly used sleeping area for 6 weeks. SmartNet continuously measures and records bednet use every 15 minutes. Bednet use was monitored for a total of 9,258 hours overall, with an average of 42 nights per household (SD: 3.5). Average duration of bednet use was 9 hours 49 minutes per night (SD: 1 hour 56 minutes), and adherence was 85-90% from 2100 to 0600. Bednets were not used at all on 4.5% (19/418) of observation nights. Overall, the average clock time that bednets were unfurled was 2034 (SD: 1 hour 25 minutes) and they were folded up at 0743 (SD: 43 minutes). The rate of interruptions per night observed in all households was 0.23 (86/369), with an average duration of 48 minutes (SD: 49 minutes). There was substantial heterogeneity between households, and some households had consistently poorer adherence relative to others. Variations in bednet use behaviors are a potentially important, and under-researched, component of long-lasting insecticide-treated bednet effectiveness. Remote bednet use monitors can provide novel insights into how bednets are used in practice, helping identify both households at risk of malaria due to poor adherence and also potentially novel targets for improving malaria prevention.

Objective monitoring of mosquito bednet usage and the ethical challenge of respecting study bystanders' privacy

Insecticide-treated bednets are among the most prevalent and cost-effective tools for preventing malaria throughout the world. Consistent bednet use is crucial for effectiveness, but assessing adherence is challenging due to limitations in current measurement tools. Recent technologies have introduced methods for remote electronic bednet use monitoring. While valuable for researchers, these monitoring tools create potential ethical concerns for study bystanders because the monitors are typically unable to discriminate between individuals who are or are not study participants. Considerations related to study bystanders, including privacy, ancillary care obligations, and community perceptions, are discussed.

Net age, but not integrity, may be associated with decreased protection against Plasmodium falciparum infection in southern Malawi

BACKGROUND

Distribution campaigns for insecticide-treated nets (ITN) have increased the use of ITNs in Malawi, but malaria prevalence remains high even among those using the nets. Previous studies have addressed ITN ownership, insecticide resistance, and frequency of ITN use as possible contributing factors to the high prevalence of malaria infection despite high ITN coverage, but have rarely considered whether the condition of the ITN, or how many people use it, impacts efficacy. This study assessed how ITN integrity, ITN age, and the number of persons sharing a net might mitigate or reduce protective efficacy among self-identified ITN users in Malawi.

METHODS

From 2012 to 2014, six cross-sectional surveys were conducted in both the rainy and dry seasons in southern Malawi. Data were collected on ITN use, integrity (number and size of holes), and age. Blood samples for detecting Plasmodium falciparum infection were obtained from reported ITN users over 6 months of age. Generalized linear mixed models were used to account for clustering at the household and community level. The final model controlled for gender, household eaves, and community-level infection prevalence during the rainy season.

RESULTS

There were 9646 ITN users with blood samples across six surveys, 15% of whom tested positive for P. falciparum infection. Among children under 5 years old, there was a 50% increased odds of P. falciparum infection among those sleeping under an ITN older than two years, compared to those using an ITN less than 2 years old (OR = 1.50; 95% CI 1.07-2.08). ITN integrity and number of individuals sharing an ITN were not associated with P. falciparum infection.

CONCLUSIONS

Older ITNs were associated with higher rates of P. falciparum in young children, which may indicate that insecticide concentrations play a larger role in infection prevention than the physical barrier of an ITN. ITN use was self-reported and the integrity measures lacked the precision of newer methods, suggesting a need for objective measures of ITN use and more precise assessment of ITN integrity.

Quantifying bias in measuring insecticide-treated bednet use: meta-analysis of self-reported vs objectively measured adherence

Background

Insecticide-treated bednets (ITNs) are recommended for use by 3.4 billion people at risk of malaria world-wide. Policy makers rely on measurements of ITN use to optimize malaria prevention efforts. Self-reports are the most common means of assessing ITN use, but self-reports may be biased in a way that reduces their reliability as a proxy for ITN adherence. This meta-analysis compared self-reported and two methods which are more objective measures of ITN use to explore whether self-reports overestimate actual ITN adherence.

Methods

A comprehensive search of electronic databases and hand searching reference lists resulted in screening 2885 records and 202 articles were read in full. Sixteen articles with comparable data were chosen for the meta-analysis. Comparable data was defined as self-reported and objectively measured ITN use (observation of a mounted ITN or surprise visits confirming use) at the same unit of analysis, covering the same time period and same population. A random effects model was used to determine a weighted average risk difference between self-reported and objectively measured ITN use. Additional stratified analyses were conducted to explore study heterogeneity.

Results

Self-reported ITN use is 8 percentage points (95% confidence interval CI: 3 to 13) higher than objectively measured ITN use, representing a 13.6% overestimation relative to the proportion measured as adherent to ITN use by objective measures. Wide variations in the discrepancies between self-reports and objective measures were unable to be explained using stratified analyses of variables including location, year of publication, seasonality and others.

Conclusions

Self-reports overestimate ITN adherence relative to objectively measured ITN use by 13.6% and do so in an unpredictable manner that raises questions about the reliability of using self-reported ITN use alone as a surveillance tool and a guide for making policy decisions.