A Cluster Randomised Trial Introducing Rapid Diagnostic Tests into Registered Drug Shops in Uganda: Impact on Appropriate Treatment of Malaria

Examining Intervention Design: Lessons from the Development of Eight Related Malaria Health Care Intervention Studies

Abstract—Rigorous evidence of “what works” to improve health care is in demand, but methods for the development of interventions have not been scrutinized in the same ways as methods for evaluation. This article presents and examines intervention development processes of eight malaria health care interventions in East and West Africa. A case study approach was used to draw out experiences and insights from multidisciplinary teams who undertook to design and evaluate these studies. Four steps appeared necessary for intervention design: (1) definition of scope, with reference to evaluation possibilities; (2) research to inform design, including evidence and theory reviews and empirical formative research; (3) intervention design, including consideration and selection of approaches and development of activities and materials; and (4) refining and finalizing the intervention, incorporating piloting and pretesting. Alongside these steps, projects produced theories, explicitly or implicitly, about (1) intended pathways of change and (2) how their intervention would be implemented.The work required to design interventions that meet and contribute to current standards of evidence should not be underestimated. Furthermore, the process should be recognized not only as technical but as the result of micro and macro social, political, and economic contexts, which should be acknowledged and documented in order to infer generalizability. Reporting of interventions should go beyond descriptions of final intervention components or techniques to encompass the development process. The role that evaluation possibilities play in intervention design should be brought to the fore in debates over health care improvement.

Public stewardship of private for-profit healthcare providers in low- and middle-income countries

BACKGROUND

Governments use different approaches to ensure that private for-profit healthcare services meet certain quality standards. Such government guidance, referred to as public stewardship, encompasses government policies, regulatory mechanisms, and implementation strategies for ensuring accountability in the delivery of services. However, the effectiveness of these strategies in low- and middle-income countries (LMICs) have not been the subject of a systematic review.

OBJECTIVES

To assess the effects of public sector regulation, training, or co-ordination of the private for-profit health sector in low- and middle-income countries.

SEARCH METHODS

For related systematic reviews, we searched the Cochrane Database of Systematic Reviews (CDSR) 2015, Issue 4; Database of Abstracts of Reviews of Effectiveness (DARE) 2015, Issue 1; Health Technology Assessment Database (HTA) 2015, Issue 1; all part of The Cochrane Library, and searched 28 April 2015. For primary studies, we searched MEDLINE, Epub Ahead of Print, In-Process & Other Non-Indexed Citations, MEDLINE Daily and MEDLINE 1946 to Present, OvidSP (searched 16 June 2016); Science Citation Index and Social Sciences Citation Index 1987 to present, and Emerging Sources Citation Index 2015 to present, ISI Web of Science (searched 3 May 2016 for papers citing included studies); Cochrane Central Register of Controlled Trials (CENTRAL), 2015, Issue 3, part of The Cochrane Library (including the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register) (searched 28 April 2015); Embase 1980 to 2015 Week 17, OvidSP (searched 28 April 2015); Global Health 1973 to 2015 Week 16, OvidSP (searched 30 April 2015); WHOLIS, WHO (searched 30 April 2015); Science Citation Index and Social Sciences Citation Index 1975 to present, ISI Web of Science (searched 30 April 2015); Health Management, ProQuest (searched 22 November 2013). In addition, in April 2016, we searched the reference lists of relevant articles, WHO International Clinical Trials Registry Platform, Clinicaltrials.gov, and various electronic databases of grey literature.

SELECTION CRITERIA

Randomised trials, non-randomised trials, interrupted time series studies, or controlled before-after studies.

DATA COLLECTION AND ANALYSIS

Two authors independently assessed study eligibility and extracted data, comparing their results and resolving discrepancies by consensus. We expressed study results as risk ratios (RR) or mean differences (MD) with 95% confidence intervals (CI), where appropriate, and assessed the certainty of the evidence using Grades of Recommendation, Assessment, Development and Evaluation (GRADE). We did not conduct meta-analysis because of heterogeneity of interventions and study designs.

MAIN RESULTS

We identified 20,177 records, 50 of them potentially eligible. We excluded 39 potentially eligible studies because they did not involve a rigorous evaluation of training, regulation, or co-ordination of private for-profit healthcare providers in LMICs; five studies identified after the review was submitted are awaiting assessment; and six studies met our inclusion criteria. Two included studies assessed training alone; one assessed regulation alone; three assessed a multifaceted intervention involving training and regulation; and none assessed co-ordination. All six included studies targeted private for-profit pharmacy workers in Africa and Asia.Three studies found that training probably increases sale of oral rehydration solution (one trial in Kenya, 106 pharmacies: RR 3.04, 95% CI 1.37 to 6.75; and one trial in Indonesia, 87 pharmacies: RR 1.41, 95% CI 1.03 to 1.93) and dispensing of anti-malarial drugs (one trial in Kenya, 293 pharmacies: RR 8.76, 95% CI 0.94 to 81.81); moderate-certainty evidence.One study conducted in the Lao People's Democratic Republic shows that regulation of the distribution and sale of registered pharmaceutical products may improve composite pharmacy indicators (one trial, 115 pharmacies: improvements in four of six pharmacy indicators; low-certainty evidence).The outcome in three multifaceted intervention studies was the quality of pharmacy practice; including the ability to ask questions, give advice, and provide appropriate treatment. The trials applied regulation, training, and peer influence in sequence; and the study design does not permit separation of the effects of the different interventions. Two trials conducted among 136 pharmacies in Vietnam found that the multifaceted intervention may improve the quality of pharmacy practice; but the third study, involving 146 pharmacies in Vietnam and Thailand, found that the intervention may have little or no effects on the quality of pharmacy practice (low-certainty evidence).Only two studies (both conducted in Vietnam) reported cost data, with no rigorous assessment of the economic implications of implementing the interventions in resource-constrained settings. No study reported data on equity, mortality, morbidity, adverse effects, satisfaction, or attitudes.

AUTHORS' CONCLUSIONS

Training probably improves quality of care (i.e. adherence to recommended practice), regulation may improve quality of care, and we are uncertain about the effects of co-ordination on quality of private for-profit healthcare services in LMICs. The likelihood that further research will find the effect of training to be substantially different from the results of this review is moderate; implying that monitoring of the impact is likely to be needed if training is implemented. The low certainty of the evidence for regulation implies that the likelihood of further research finding the effect of regulation to be substantially different from the results of this review is high. Therefore, an impact evaluation is warranted if government regulation of private for-profit providers is implemented in LMICs. Rigorous evaluations of these interventions should also assess other outcomes such as impacts on equity, cost implications, mortality, morbidity, and adverse effects.

A cross-sectional study of the availability and price of anti-malarial medicines and malaria rapid diagnostic tests in private sector retail drug outlets in rural Western Kenya, 2013

BACKGROUND

Although anti-malarial medicines are free in Kenyan public health facilities, patients often seek treatment from private sector retail drug outlets. In mid-2010, the Affordable Medicines Facility-malaria (AMFm) was introduced to make quality-assured artemisinin-based combination therapy (ACT) accessible and affordable in private and public sectors.

METHODS

Private sector retail drug outlets stocking anti-malarial medications within a surveillance area of approximately 220,000 people in a malaria perennial high-transmission area in rural western Kenya were identified via a census in September 2013. A cross-sectional study was conducted in September-October 2013 to determine availability and price of anti-malarial medicines and malaria rapid diagnostic tests (RDTs) in drug outlets. A standardized questionnaire was administered to collect drug outlet and personnel characteristics and availability and price of anti-malarials and RDTs.

RESULTS

Of 181 drug outlets identified, 179 (99 %) participated in the survey. Thirteen percent were registered pharmacies, 25 % informal drug shops, 46 % general shops, 13 % homesteads and 2 % other. One hundred sixty-five (92 %) had at least one ACT type: 162 (91 %) had recommended first-line artemether-lumefantrine (AL), 22 (12 %) had recommended second-line dihydroartemisinin-piperaquine (DHA-PPQ), 85 (48 %) had sulfadoxine-pyrimethamine (SP), 60 (34 %) had any quinine (QN) formulation, and 14 (8 %) had amodiaquine (AQ) monotherapy. The mean price (range) of an adult treatment course for AL was $1.01 ($0.35-4.71); DHA-PPQ was $4.39 ($0.71-7.06); QN tablets were $2.24 ($0.12-4.71); SP was $0.62 ($0.24-2.35); AQ monotherapy was $0.42 ($0.24-1.06). The mean AL price with or without the AMFm logo did not differ significantly ($1.01 and 1.07, respectively; p = 0.45). Only 17 (10 %) drug outlets had RDTs; 149 (84 %) never stocked RDTs. The mean RDT price was $0.92 ($0.24-2.35).

CONCLUSIONS

Most outlets never stocked RDTs; therefore, testing prior to treatment was unlikely for customers seeking treatment in the private retail sector. The recommended first-line treatment, AL, was widely available. Although SP and AQ monotherapy are not recommended for treatment, both were less expensive than AL, which might have caused preferential use by customers. Interventions that create community demand for malaria diagnostic testing prior to treatment and that increase RDT availability should be encouraged.

Evaluation of SMS reminder messages for altering treatment adherence and health seeking perceptions among malaria care-seekers in Nigeria

In Nigeria, access to malaria diagnostics may be expanded if drug retailers were allowed to administer malaria rapid diagnostic tests (RDTs). A 2012 pilot intervention showed that short message service (SMS) reminder messages could boost treatment adherence to RDT results by 10–14% points. This study aimed to replicate the SMS intervention in a different population, and additionally test the effect of an expanded message about anticipated RDT access policy change on customers’ acceptability for drug retailers’ administration of RDTs. One day after being tested with an RDT, participants who purchased malaria treatment from drug shops were randomized to receive (1) a basic SMS reminder repeating the RDT result and appropriate treatment actions, (2) an expanded SMS reminder additionally saying that the ‘government might allow pharmacists/chemists to do RDTs’ or (3) no SMS reminders (i.e. control). Using regression analysis, we estimate intent-to-treat (ITT) and treatment effects on the treated for 686 study participants. Results corroborate previous findings that a basic SMS reminder increased treatment adherence [odds ratio (OR) = 1.53, 95% CI 0.96–2.44] and decreased use of unnecessary anti-malarials for RDT-negative adults [OR = 0.63, 95% CI 0.39–1.00]. The expanded SMS also increased adherence for adults [OR = 1.42, 95% CI 0.97–2.07], but the effects for sick children differed—the basic SMS did not have any measurable impact on treatment adherence [OR = 0.87, 95% CI 0.24–3.09] or use of unnecessary anti-malarials [OR = 1.27, 95% CI 0.32–1.93], and the expanded SMS actually led to poorer treatment adherence [OR = 0.26, 95% CI 0.10–0.66] and increased use of unnecessary anti-malarials [OR = 4.67, 95% CI 1.76–12.43]. Further, the targeted but neutral message in the expanded SMS lowered acceptance for drug retailers' administration of RDTs [OR = 0.55, 95% CI 0.10–2.93], counter to what we hypothesized. Future SMS interventions should show consistent positive results across populations and be attuned to message length and content before initiating a larger messaging campaign.

Health workers' compliance to rapid diagnostic tests (RDTs) to guide malaria treatment: a systematic review and meta-analysis

Background

The World Health Organization recommends malaria to be confirmed by either microscopy or a rapid diagnostic test (RDT) before treatment. The correct use of RDTs in resource-limited settings facilitates basing treatment onto a confirmed diagnosis; contributes to speeding up considering a correct alternative diagnosis, and prevents overprescription of anti-malarial drugs, reduces costs and avoids unnecessary exposure to adverse drug effects. This review aims to evaluate health workers’ compliance to RDT results and factors contributing to compliance.

Methods

A PROSPERO-registered systematic review was conducted to evaluate health workers’ compliance to RDTs in sub-Saharan Africa, following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Studies published up to November 2015 were searched without language restrictions in Medline/Ovid, Embase, Cochrane Central Register of Controlled Trials, Web of Science, LILACS, Biosis Previews and the African Index Medicus. The primary outcome was health workers treating patients according to the RDT results obtained.

Results

The literature search identified 474 reports; 14 studies were eligible and included in the quantitative analysis. From the meta-analysis, health workers’ overall compliance in terms of initiating treatment or not in accordance with the respective RDT results was 83 % (95 % CI 80–86 %). Compliance to positive and negative results was 97 % (95 % CI 94–99 %) and 78 % (95 % CI 66–89 %), respectively. Community health workers had higher compliance rates to negative test results than clinicians. Patient expectations, work experience, scepticism of results, health workers’ cadres and perceived effectiveness of the test, influenced compliance.

Conclusions

With regard to published data, compliance to RDT appears to be generally fair in sub-Saharan Africa; compliance to negative results will need to improve to prevent mismanagement of patients and overprescribing of anti-malarial drugs. Improving diagnostic capacity for other febrile illnesses and developing local evidence-based guidelines may help improve compliance and management of negative RDT results.

Trial registration: CRD42015016151 (PROSPERO)

Electronic supplementary material

The online version of this article (doi:10.1186/s12936-016-1218-5) contains supplementary material, which is available to authorized users.

Challenges and Opportunities of Centrifugal Microfluidics for Extreme Point-of-Care Testing

The advantages offered by centrifugal microfluidic systems have encouraged its rapid adaptation in the fields of in vitro diagnostics, clinical chemistry, immunoassays, and nucleic acid tests. Centrifugal microfluidic devices are currently used in both clinical and point-of-care settings. Recent studies have shown that this new diagnostic platform could be potentially used in extreme point-of-care settings like remote villages in the Indian subcontinent and in Africa. Several technological inventions have decentralized diagnostics in developing countries; however, very few microfluidic technologies have been successful in meeting the demand. By identifying the finest difference between the point-of-care testing and extreme point-of-care infrastructure, this review captures the evolving diagnostic needs of developing countries paired with infrastructural challenges with technological hurdles to healthcare delivery in extreme point-of-care settings. In particular, the requirements for making centrifugal diagnostic devices viable in developing countries are discussed based on a detailed analysis of the demands in different clinical settings including the distinctive needs of extreme point-of-care settings.

The Method of Randomization for Cluster-Randomized Trials: Challenges of Including Patients with Multiple Chronic Conditions

Cluster-randomized clinical trials (CRT) are trials in which the unit of randomization is not a participant but a group (e.g. healthcare systems or community centers). They are suitable when the intervention applies naturally to the cluster (e.g. healthcare policy); when lack of independence among participants may occur (e.g. nursing home hygiene); or when it is most ethical to apply an intervention to all within a group (e.g. school-level immunization). Because participants in the same cluster receive the same intervention, CRT may approximate clinical practice, and may produce generalizable findings. However, when not properly designed or interpreted, CRT may induce biased results. CRT designs have features that add complexity to statistical estimation and inference. Chief among these is the cluster-level correlation in response measurements induced by the randomization. A critical consideration is the experimental unit of inference; often it is desirable to consider intervention effects at the level of the individual rather than the cluster. Finally, given that the number of clusters available may be limited, simple forms of randomization may not achieve balance between intervention and control arms at either the cluster- or participant-level. In non-clustered clinical trials, balance of key factors may be easier to achieve because the sample can be homogenous by exclusion of participants with multiple chronic conditions (MCC). CRTs, which are often pragmatic, may eschew such restrictions. Failure to account for imbalance may induce bias and reducing validity. This article focuses on the complexities of randomization in the design of CRTs, such as the inclusion of patients with MCC, and imbalances in covariate factors across clusters.

Introducing rapid diagnostic tests for malaria into registered drug shops in Uganda: lessons learned and policy implications

Background

Malaria is a major public health problem in Uganda and the current policy recommends introduction of rapid diagnostic tests for malaria (RDTs) to facilitate effective case management. However, provision of RDTs in drug shops potentially raises a new set of issues, such as adherence to RDTs results, management of severe illnesses, referral of patients, and relationship with caretakers. The main objective of the study was to examine the impact of introducing RDTs in registered drug shops in Uganda and document lessons and policy implications for future scale-up of malaria control in the private health sector.

Methods

A cluster-randomized trial introducing RDTs into registered drug shops was implemented in central Uganda from October 2010 to July 2012. An evaluation was undertaken to assess the impact and the processes involved with the introduction of RDTs into drug shops, the lessons learned and policy implications.

Results

Introducing RDTs into drug shops was feasible. To scale-up this intervention however, drug shop practices need to be regulated since the registration process was not clear, supervision was inadequate and record keeping was poor. Although initially it was anticipated that introducing a new practice of record keeping would be cumbersome, but at evaluation this was not found to be a constraint. This presents an important lesson for introducing health management information system into drug shops. Involving stakeholders, especially the district health team, in the design was important for ownership and sustainability. The involvement of village health teams in community sensitization to the new malaria treatment and diagnosis policy was a success and this strategy is recommended for future interventions.

Conclusion

Introducing RDTs into drug shops was feasible and it increased appropriate treatment of malaria with artemisinin-based combination therapy. It is anticipated that the lessons presented will help better implementation of similar interventions in the private sector.

Rapid diagnostic tests for malaria

Maintaining quality, competitiveness and innovation in global health technology is a constant challenge for manufacturers, while affordability, access and equity are challenges for governments and international agencies. In this paper we discuss these issues with reference to rapid diagnostic tests for malaria. Strategies to control and eliminate malaria depend on early and accurate diagnosis. Rapid diagnostic tests for malaria require little training and equipment and can be performed by non-specialists in remote settings. Use of these tests has expanded significantly over the last few years, following recommendations to test all suspected malaria cases before treatment and the implementation of an evaluation programme to assess the performance of the malaria rapid diagnostic tests. Despite these gains, challenges exist that, if not addressed, could jeopardize the progress made to date. We discuss recent developments in rapid diagnostic tests for malaria, highlight some of the challenges and provide suggestions to address them.