Evaluation of a laboratory quality assurance pilot programme for malaria diagnostics in low-transmission areas of Kenya, 2013

The Walter Reed Project, Kisumu Field Station: Impact of Research on Malaria Policy, Management, and Prevention

The Walter Reed Project is a collaboration between the Walter Reed Army Institute of Research of the United States Department of Defense and the Kenya Medical Research Institute. The Kisumu field station, comprising four campuses, has until recently been devoted primarily to research on malaria countermeasures. The Kombewa Clinical Research Center is dedicated to conducting regulated clinical trials of therapeutic and vaccine candidates in development. The center's robust population-based surveillance platform, along with an active community engagement strategy, guarantees consistent recruitment and retention of participants in clinical trials. The Malaria Diagnostic Center, backed by WHO-certified microscopists and a large malaria blood film collection, champions high-quality malaria diagnosis and strict quality assurance through standardized microscopy trainings. The Malaria Drug Resistance Laboratory leverages cutting-edge technology such as real-time Polymerase Chain Reaction (qPCR) to conduct comprehensive research on resistance markers and obtain information on drug efficacy. The laboratory has been working on validating artemisinin resistance markers and improving tracking methods for current and future antimalarial compounds. Finally, the Basic Science Laboratory employs advanced genomic technology to examine endpoints such as immunogenicity and genomic fingerprinting for candidate drugs and vaccine efficacy. Herein, we examine the site's significant contributions to malaria policy, management, and prevention practices in Kenya and around the world.

Factors influencing health workers' compliance with outpatient malaria 'test and treat' guidelines during the plateauing performance phase in Kenya, 2014-2016

Background

Health workers’ compliance with outpatient malaria ‘test and treat’ guidelines has improved since 2010 but plateaued from 2014 at suboptimal levels in Kenya. This study examined the factors associated with high but suboptimal compliance levels at facilities with available malaria tests and drugs.

Methods

Data from four national, cross-sectional health facility surveys undertaken between 2014 and 2016 in Kenya were analysed. Association between 31 factors and compliance with malaria testing (survey range (SR): 65–69%) and no anti-malarial treatment for test negative patients (SR: 90–92%) were examined using multilevel logistic regression models.

Results

A total of 2,752 febrile patients seen by 594 health workers at 486 health facilities were analysed. Higher odds of malaria testing were associated with lake endemic (aOR = 12.12; 95% CI: 5.3–27.6), highland epidemic (aOR = 5.06; 95% CI: 2.7–9.5) and semi-arid seasonal (aOR = 2.07; 95% CI: 1.2–3.6) compared to low risk areas; faith-based (FBO)/ non-governmental organization (NGO)-owned compared to government-owned facilities (aOR = 5.80; 95% CI: 3.2–10.6); health workers’ perception of malaria endemicity as high-risk (aOR = 3.05; 95% CI: 1.8–5.2); supervision with feedback (aOR = 1.84; 95% CI: 1.2–2.9); access to guidelines (aOR = 1.96; 95% CI: 1.1–3.4); older patients compared to infants, higher temperature measurements and main complaints of fever, diarrhoea, headache, vomiting and chills. Lower odds of testing were associated with febrile patients having main complaints of a cough (aOR = 0.65; 95% CI: 0.5–0.9), a rash (aOR = 0.32; 95% CI: 0.2–0.7) or a running nose (aOR = 0.59; 95% CI: 0.4–0.9). Other factors associated with compliance with test negative results included the type of diagnostic test available at the facility, in-service training, health workers’ age, and correct knowledge of the targeted treatment policy.

Conclusions

To optimize outpatient malaria case-management, reduce testing compliance gaps and eliminate overtreatment of test negative patients, there is a need to focus on compliance within low malaria risk areas in addition to ensuring the universal and continuous availability of ‘test and treat’ commodities. Targeting of older and government health workers; dissemination of updated guidelines; and continuing with in-service training and supportive supervision with feedback is essential. Lastly, there is a need to improve health workers’ knowledge about malaria testing criteria considering their perceptions of endemicity.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12936-022-04093-x.

Determinants of improvement trends in health workers' compliance with outpatient malaria case-management guidelines at health facilities with available "test and treat" commodities in Kenya

BACKGROUND

Health workers' compliance with outpatient malaria case-management guidelines has been improving in Africa. This study examined the factors associated with the improvements.

METHODS

Data from 11 national, cross-sectional health facility surveys undertaken from 2010-2016 were analysed. Association between 31 determinants and improvement trends in five outpatient compliance outcomes were examined using interactions between each determinant and time in multilevel logistic regression models and reported as an adjusted odds ratio of annual trends (T-aOR).

RESULTS

Among 9,173 febrile patients seen at 1,208 health facilities and by 1,538 health workers, a higher annual improvement trend in composite "test and treat" performance was associated with malaria endemicity-lake endemic (T-aOR = 1.67 annually; p<0.001) and highland epidemic (T-aOR = 1.35; p<0.001) zones compared to low-risk zone; with facilities stocking rapid diagnostic tests only (T-aOR = 1.49; p<0.001) compared to microscopy only services; with faith-based/non-governmental facilities compared to government-owned (T-aOR = 1.15; p = 0.036); with a daily caseload of >25 febrile patients (T-aOR = 1.46; p = 0.003); and with under-five children compared to older patients (T-aOR = 1.07; p = 0.013). Other factors associated with the improvement trends in the "test and treat" policy components and artemether-lumefantrine administration at the facility included the absence of previous RDT stock-outs, community health workers dispensing drugs, access to malaria case-management and Integrated Management of Childhood Illness (IMCI) guidelines, health workers' gender, correct health workers' knowledge about the targeted malaria treatment policy, and patients' main complaint of fever. The odds of compliance at the baseline were variable for some of the factors.

CONCLUSIONS

Targeting of low malaria risk areas, low caseload facilities, male and government health workers, continuous availability of RDTs, improving health workers' knowledge about the policy considering age and fever, and dissemination of guidelines might improve compliance with malaria guidelines. For prompt treatment and administration of the first artemether-lumefantrine dose at the facility, task-shifting duties to community health workers can be considered.

Evaluation of the colorimetric malachite green loop-mediated isothermal amplification (MG-LAMP) assay for the detection of malaria species at two different health facilities in a malaria endemic area of western Kenya

Background

Prompt diagnosis and effective malaria treatment is a key strategy in malaria control. However, the recommended diagnostic methods, microscopy and rapid diagnostic tests (RDTs), are not supported by robust quality assurance systems in endemic areas. This study compared the performance of routine RDTs and smear microscopy with a simple molecular-based colorimetric loop-mediated isothermal amplification (LAMP) at two different levels of the health care system in a malaria-endemic area of western Kenya.

Methods

Patients presenting with clinical symptoms of malaria at Rota Dispensary (level 2) and Siaya County Referral Hospital (level 4) were enrolled into the study after obtaining written informed consent. Capillary blood was collected to test for malaria by RDT and microscopy at the dispensary and county hospital, and for preparation of blood smears and dried blood spots (DBS) for expert microscopy and real-time polymerase chain reaction (RT-PCR). Results of the routine diagnostic tests were compared with those of malachite green loop-mediated isothermal amplification (MG-LAMP) performed at the two facilities.

Results

A total of 264 participants were enrolled into the study. At the dispensary level, the positivity rate by RDT, expert microscopy, MG-LAMP and RT-PCR was 37%, 30%, 44% and 42%, respectively, and 42%, 43%, 57% and 43% at the county hospital. Using RT-PCR as the reference test, the sensitivity of RDT and MG-LAMP was 78.1% (CI 67.5–86.4) and 82.9% (CI 73.0–90.3) at Rota dispensary. At Siaya hospital the sensitivity of routine microscopy and MG-LAMP was 83.3% (CI 65.3–94.4) and 93.3% (CI 77.9–99.2), respectively. Compared to MG-LAMP, there were 14 false positives and 29 false negatives by RDT at Rota dispensary and 3 false positives and 13 false negatives by routine microscopy at Siaya Hospital.

Conclusion

MG-LAMP is more sensitive than RDTs and microscopy in the detection of malaria parasites at public health facilities and might be a useful quality control tool in resource-limited settings.

Evaluation of malaria microscopy diagnostic performance at private health facilities in Tanzania

Background

The World Health Organization (WHO) recommends use of parasitological diagnosis of malaria for all age groups in all malaria transmission settings. Many private health facilities rely on malaria microscopy for malaria diagnosis. However, quality of malaria microscopy is affected by number of factors including availability of skilled laboratory microscopists and lack of quality assurance systems in many malaria endemic countries. This study was carried out to assess quality of malaria microscopy in selected private health facilities in Tanzania.

Methods

A cross sectional study was conducted from August to September, 2017. A total of 40 private health laboratories in five regions were invited to participate in the study. Data were collected by distributing standardized pre-validated malaria slide-panels to each health facility. Sensitivity, specificity, and strength of agreement (with kappa score) were calculated to assess performance in detecting and quantification of Plasmodium species.

Results

Among the 40 health facilities, 31 (77.5%) returned their results to the reference centre (Muhimbili University of Health and Allied Sciences). Overall, the measures of malaria diagnostic accuracy were high, i.e. the sensitivity and specificity of malaria parasite detection by microscopy in the health facilities were 84.3% (95% CI 77–90) and 90.8% (95% CI 83.3–95.7), respectively. There was substantial agreement in parasite detection with (Kappa value: 0.74 (95% 0.65–0.83). However, only 17.8% (24 of 134) of blood slides were interpreted correctly at the health facilities in terms of parasite density counts.

Conclusion

Although there was substantial agreement between the private health microscopists and experienced microscopists in malaria parasite detection, there was poor performance in parasite counts. This calls for regular in-service training and external quality assessments at private health facilities to enhance the skills of private health facility microscopists in malaria microscopy.

Quality evaluation of malaria diagnosis in the local laboratories network and in intermediate laboratories in a setting towards the disease elimination in Ecuador

Introduction: To reach the goal of malaria elimination in Ecuador for the year 2020, it is necessary to have a laboratory network with the capacity to perform microscopic diagnosis according to the WHO/PAHO quality standards and to provide the adequate treatment of cases. Objective: To determine the level of competence for parasitological diagnosis of the microscopists from the local public network and the performance of intermediate reference laboratories. Materials and methods: We conducted a cross-sectional study based on the information collected in workshops carried out to appraise the competence for microscopic diagnosis of the local laboratory network (zonal health coordinating offices 1 to 8) using a slide panel to evaluate diagnosis agreement, as well as the diagnostic performance of the intermediate laboratories using an external quality assessment program. The results were compared against the reference standards of the supranational laboratory in Perú. Results: We evaluated the competencies of 191 microscopists in 11 workshops and 153 (80.1%) of them were approved. The medians of the indicators were the following: concordance for parasite detection, 100% (Q1- Q3: 96-100), concordance for species identification, 100% (Q1- Q3: 93-100), and concordances for stage identification, 93.0% (Q1- Q3: 86-95) and parasite counting, 77.0% (Q1- Q3: 71-82). In the external quality assessment, the three intermediate laboratories obtained 100% in parasite detection concordance and 96% for species detection concordance. Conclusions: The results for the primary network and the performance indicators for the intermediate laboratories showed the high-quality standards of the training program implemented in the country.

Performance Outcomes from Africa-Based Malaria Diagnostic Competency Assessment Courses

The U.S. President's Malaria Initiative-funded MalariaCare project implemented an external quality assurance scheme to support malaria diagnostics and case management across a spectrum of health facilities in participating African countries. A component of this program was a 5-day, malaria diagnostic competency assessment (MDCA) course for health facility laboratory staff conducting malaria microscopy. The MDCA course provided a method to quantify participant skill levels in microscopic examination of malaria across three major diagnosis areas: parasite detection, species identification, and parasite quantification. A total of 817 central-, regional-, and peripheral-level microscopists from 45 MDCA courses across nine African countries were included in the analysis. Differences in mean scores with respect to daily marginal performance were positive and statistically significant (P < 0.001) for each challenge type across all participants combined. From pretest to assessment day 4, mean scores for parasite detection, species identification, and parasite quantification increased by 19.1, 34.9, and 38.2 percentage points, respectively. In addition, sensitivity and specificity increased by 20.8 and 13.8 percentage points, respectively, by assessment day 4. Furthermore, the ability of MDCA participants to accurately report Plasmodium falciparum species when present increased from 44.5% at pretest to 67.1% by assessment day 4. The MDCA course rapidly improved the microscopy performance of participants over a short period of time. Because of its rigor, the MDCA course could serve as a mechanism for measuring laboratory staff performance against country-specific minimum competency standards and could easily be adapted to serve as a national certification course.

Metanetwork Transmission Model for Predicting a Malaria-Control Strategy

Background: Mosquitoes are the primary vectors responsible for malaria transmission to humans, with numerous experiments having been conducted to aid in the control of malaria transmission. One of the main approaches aims to develop malaria parasite resistance within the mosquito population by introducing a resistance (R) allele. However, when considering this approach, some critical factors, such as the life of the mosquito, female mosquito fertility capacity, and human and mosquito mobility, have not been considered. Thus, an understanding of how mosquitoes and humans affect disease dynamics is needed to better inform malaria control policymaking. Methods: In this study, a method was proposed to create a metanetwork on the basis of the geographic maps of Gambia, and a model was constructed to simulate evolution within a mixed population, with factors such as birth, death, reproduction, biting, infection, incubation, recovery, and transmission between populations considered in the network metrics. First, the same number of refractory mosquitoes (RR genotype) was introduced into each population, and the prevalence of the R allele (the ratio of resistant alleles to all alleles) and malaria were examined. In addition, a series of simulations were performed to evaluate two different deployment strategies for the reduction of the prevalence of malaria. The R allele and malaria prevalence were calculated for both the strategies, with 10,000 refractory mosquitoes deployed into randomly selected populations or selection based on nodes with top-betweenness values. The 10,000 mosquitoes were deployed among 1, 5, 10, 20, or 40 populations. Results: The simulations in this paper showed that a higher RR genotype (resistant-resistant genes) ratio leads to a higher R allele prevalence and lowers malaria prevalence. Considering the cost of deployment, the simulation was performed with 10,000 refractory mosquitoes deployed among 1 or 5 populations, but this approach did not reduce the original malaria prevalence. Thus, instead, the 10,000 refractory mosquitoes were distributed among 10, 20, or 40 populations and were shown to effectively reduce the original malaria prevalence. Thus, deployment among a relatively small fraction of central nodes can offer an effective strategy to reduce malaria. Conclusion: The standard network centrality measure is suitable for planning the deployment of refractory mosquitoes. Importance: Malaria is an infectious disease that is caused by a plasmodial parasite, and some control strategies have focused on genetically modifying the mosquitoes. This work aims to create a model that takes into account mosquito development and malaria transmission among the population and how these factors influence disease dynamics so as to better inform malaria-control policymaking.

Evaluation of Routine Microscopy Performance for Malaria Diagnosis at Three Different Health Centers in Brazzaville, Republic of Congo

Background

In Republic of Congo, malaria diagnosis still widely relies on microscopy. We aimed to evaluate the performance of routine microscopy for malaria diagnosis at three different health centers in Brazzaville.

Methods

A total of 259, 416, and 131 patients with clinical signs of uncomplicated malaria were enrolled at the Hôpital de Mfilou, Centre de Santé Intégré "Maman Mboualé," and Laboratoire National de Santé Publique, respectively. Two thick blood smears were prepared for each patient, the first being examined by routine microscopists and the second by expert.

Results

At the Hôpital de Mfilou, sensitivity was 62.1% and specificity was 67.3%. Positive and negative predictive values were 55.6% and 72.9%, respectively. At the Centre de Santé Intégré "Maman Mboualé," sensitivity was 94.2% and specificity was 33.6%. Positive and negative predictive values were 50% and 89.1%, respectively. At the Laboratoire National de Santé Publique, sensitivity and specificity were high with 91.7% and 94.9%, respectively. Positive and negative predictive values were 64.7% and 99.1%, respectively.

Conclusion

The performance of routine malaria microscopy in Brazzaville remains inaccurate with large variations among different health centers. Therefore, repeated training including supervision and evaluation would improve routine malaria diagnosis for better management of malaria in Brazzaville, the Republic of Congo.

Monitoring health systems readiness and inpatient malaria case-management at Kenyan county hospitals

BACKGROUND

Change of severe malaria treatment policy from quinine to artesunate, a major malaria control advance in Africa, is compromised by scarce data to monitor policy translation into practice. In Kenya, hospital surveys were implemented to monitor health systems readiness and inpatient malaria case-management.

METHODS

All 47 county referral hospitals were surveyed in February and October 2016. Data collection included hospital assessments, interviews with inpatient health workers and retrospective review of patients' admission files. Analysis included 185 and 182 health workers, and 1162 and 1224 patients admitted with suspected malaria, respectively, in all 47 hospitals. Cluster-adjusted comparisons of the performance indicators with exploratory stratifications were performed.

RESULTS

Malaria microscopy was universal during both surveys. Artesunate availability increased (63.8-85.1%), while retrospective stock-outs declined (46.8-19.2%). No significant changes were observed in the coverage of artesunate trained (42.2% vs 40.7%) and supervised health workers (8.7% vs 12.8%). The knowledge about treatment policy improved (73.5-85.7%; p = 0.002) while correct artesunate dosing knowledge increased for patients < 20 kg (42.7-64.6%; p < 0.001) and > 20 kg (70.3-80.8%; p = 0.052). Most patients were tested on admission (88.6% vs 92.1%; p = 0.080) while repeated malaria testing was low (5.2% vs 8.1%; p = 0.034). Artesunate treatment for confirmed severe malaria patients significantly increased (69.9-78.7%; p = 0.030). No changes were observed in artemether-lumefantrine treatment for non-severe test positive patients (8.0% vs 8.8%; p = 0.796). Among test negative patients, increased adherence to test results was observed for non-severe (68.6-78.0%; p = 0.063) but not for severe patients (59.1-62.1%; p = 0.673). Overall quality of malaria case-management improved (48.6-56.3%; p = 0.004), both for children (54.1-61.5%; p = 0.019) and adults (43.0-51.0%; p = 0.041), and in both high (51.1-58.1%; p = 0.024) and low malaria risk areas (47.5-56.0%; p = 0.029).

CONCLUSION

Most health systems and malaria case-management indicators improved during 2016. Gaps, often specific to different inpatient populations and risk areas, however remain and further programmatic interventions including close monitoring is needed to optimize policy translation.

Stabilization of RDT target antigens present in dried Plasmodium falciparum-infected samples for validating malaria rapid diagnostic tests at the point of care

BACKGROUND

Malaria rapid diagnostic tests (RDTs) are a great achievement in implementation of parasite based diagnosis as recommended by World Health Organization. A major drawback of RDTs is lack of positive controls to validate different batches/lots at the point of care. Dried Plasmodium falciparum-infected samples with the RDT target antigens have been suggested as possible positive control but their utility in resource limited settings is hampered by rapid loss of activity over time.

METHODS

This study evaluated the effectiveness of chemical additives to improve long term storage stability of RDT target antigens (HRP2, pLDH and aldolase) in dried P. falciparum-infected samples using parasitized whole blood and culture samples. Samples were treated with ten selected chemical additives mainly sucrose, trehalose, LDH stabilizer and their combinations. After baseline activity was established, the samples were air dried in bio-safety cabinet and stored at room temperatures (~ 25 °C). Testing of the stabilized samples using SD Bioline, BinaxNOW, CareStart, and First Response was done at intervals for 53 weeks.

RESULTS

Stability of HRP2 at ambient temperature was reported at 21-24 weeks while that of PAN antigens (pLDH and aldolase) was 2-18 weeks of storage at all parasite densities. The ten chemical additives increased the percentage stability of HRP2 and PAN antigens. Sucrose alone and its combinations with Alsever's solution or biostab significantly increased stability of HRP2 by 56% at 2000 p/µL (p < 0.001). Trehalose and its combinations with biostab, sucrose or glycerol significantly increased stability of HRP2 by 57% (p < 0.001). Unlike sucrose, the stability of the HRP2 was significantly retained by trehalose at lower concentrations (500, and 200 p/µL). Trehalose in combination biostab stabilizer increased the percentage stability of PAN antigens by 42, and 32% at 2000 and 500 p/µL respectively (p < 0.01). This was also the chemical combination with the shortest reconstitution time (~ < 20 min).

CONCLUSIONS

These findings confirm that stabilizing RDT target antigens in dried P. falciparum-infected samples using chemical additives provides field-stable positive controls for malaria RDTs.

Factors associated with malaria microscopy diagnostic performance following a pilot quality-assurance programme in health facilities in malaria low-transmission areas of Kenya, 2014

BACKGROUND

Malaria accounts for ~21% of outpatient visits annually in Kenya; prompt and accurate malaria diagnosis is critical to ensure proper treatment. In 2013, formal malaria microscopy refresher training for microscopists and a pilot quality-assurance (QA) programme for malaria diagnostics were independently implemented to improve malaria microscopy diagnosis in malaria low-transmission areas of Kenya. A study was conducted to identify factors associated with malaria microscopy performance in the same areas.

METHODS

From March to April 2014, a cross-sectional survey was conducted in 42 public health facilities; 21 were QA-pilot facilities. In each facility, 18 malaria thick blood slides archived during January-February 2014 were selected by simple random sampling. Each malaria slide was re-examined by two expert microscopists masked to health-facility results. Expert results were used as the reference for microscopy performance measures. Logistic regression with specific random effects modelling was performed to identify factors associated with accurate malaria microscopy diagnosis.

RESULTS

Of 756 malaria slides collected, 204 (27%) were read as positive by health-facility microscopists and 103 (14%) as positive by experts. Overall, 93% of slide results from QA-pilot facilities were concordant with expert reference compared to 77% in non-QA pilot facilities (p < 0.001). Recently trained microscopists in QA-pilot facilities performed better on microscopy performance measures with 97% sensitivity and 100% specificity compared to those in non-QA pilot facilities (69% sensitivity; 93% specificity; p < 0.01). The overall inter-reader agreement between QA-pilot facilities and experts was κ = 0.80 (95% CI 0.74-0.88) compared to κ = 0.35 (95% CI 0.24-0.46) between non-QA pilot facilities and experts (p < 0.001). In adjusted multivariable logistic regression analysis, recent microscopy refresher training (prevalence ratio [PR] = 13.8; 95% CI 4.6-41.4), ≥5 years of work experience (PR = 3.8; 95% CI 1.5-9.9), and pilot QA programme participation (PR = 4.3; 95% CI 1.0-11.0) were significantly associated with accurate malaria diagnosis.

CONCLUSIONS

Microscopists who had recently completed refresher training and worked in a QA-pilot facility performed the best overall. The QA programme and formal microscopy refresher training should be systematically implemented together to improve parasitological diagnosis of malaria by microscopy in Kenya.