The multi-country evaluation of the integrated management of childhood illness strategy: lessons for the evaluation of public health interventions

Perceptions of Interns Toward Integrated Management of Childhood Illness (IMCI) Pre-service Education and Its Impact on Their Clinical Knowledge: A Study at Sultan Qaboos University, Muscat

Objectives The study aims to assess interns' perceptions of Integrated Management of Childhood Illness (IMCI) pre-service education at Sultan Qaboos University (SQU). Specifically, it evaluates how IMCI training during phases 2 and 3 influences interns' clinical practice readiness and knowledge acquisition. The findings will inform evidence-based enhancements to IMCI training programs, ensuring they meet interns' educational needs and optimize clinical skills acquisition. Methods This cross-sectional study was conducted at the College of Medicine and Health Sciences (CoMHS) at SQU, Muscat, over a two-month period (September 20, 2023, to November 30, 2023). The questionnaire evaluated interns' sociodemographic factors, perceptions regarding pre-service IMCI training, and IMCI knowledge. IBM SPSS Statistics for Windows, Version 24 (Released 2016; IBM Corp., Armonk, New York) was used to analyze Likert scale responses for frequencies and proportions. Results Out of 103 invited interns, 75 participated in the study, resulting in a response rate of 72.8%. Interns who attended three or more IMCI lectures, tutorials, and practical sessions demonstrated a more advanced understanding of IMCI principles compared to those attending fewer sessions. Overall, 63 (84.0%) interns agreed on the effectiveness of IMCI training, 57 (76.0%) interns acknowledged skill enhancement, and 69 (92.0%) interns perceived its practicality for illness assessment. However, only 60.0% (n=45) felt confident in managing sick children. The knowledge assessment revealed varied understanding of IMCI objectives (82.7%, n=62) and components (61.3% (n=46) to 64.0% (n=48)). Clinical case evaluation showed mixed recognition of clinical features and danger signs of childhood illnesses, while awareness of disease preventability through immunization was generally high, except for tuberculosis (74.7%, n=56) and rotavirus (40.0%, n=30). Conclusion Interns exhibit positive attitudes towards IMCI principles, demonstrating a strong grasp of related concepts through effective case-based question responses. These results highlight the effectiveness of IMCI training in improving interns' understanding of pediatric healthcare principles, with potential implications for enhancing clinical practice and patient care. Future investigations should explore the impact of IMCI training on interns' clinical practice and patient outcomes.

Integrated Diagnosis in Africa's Low- and Middle-Income Countries: What Is It, What Works, and for Whom? A Realist Synthesis

Introduction

Integrated diagnosis can improve health outcomes and patient experiences through early diagnosis and identification of cases that could otherwise be overlooked. Although existing research highlight the feasibility of integrated diagnosis across various conditions, a significant evidence gap remains regarding its direct impact on patient experiences and health outcomes. This review explores the conceptualizations of integrated diagnosis by different stakeholders along the healthcare pathway and examines the necessary contexts and mechanisms crucial for its effectiveness.

Methods

This study adopts a realist methodology to explore integrated diagnosis. Using a systematic approach, the research aims to collect, assess, and synthesize existing evidence on integrated diagnosis, guided by a program theory developed through literature review and expert consultations. Primary studies and reviews related to integrated diagnosis, multi-disease testing, or integrated healthcare with a diagnostic focus were sourced from major databases and global health organization websites. The collected evidence was used to construct and refine the evolving theoretical framework.

Results

This study identified three models of integrated diagnosis interventions: individual/human resource integration, facility or mobile-based integration, and technology integration. Successful implementation of these models relies on understanding the values and perceptions of both healthcare workers and patients/clients. This research emphasizes a holistic approach that considers all elements within the health system and underscores their interdependence. Using the WHO health systems framework to contextualise factors, the study positions diagnosis as an integral component of the broader health ecosystem. A key finding of the research is the importance of addressing the barriers and facilitators of integrated diagnosis interventions. This includes policy frameworks, diagnostic tools, funding mechanisms, treatment pathways, and human resource issues. Improving patient experiences requires cultivating positive relationships with healthcare workers ensuring elements such as respect, confidentiality, accessibility, and timeliness of services are prioritised.

Discussion and Conclusion

The diverse conceptualisations of integrated diagnosis highlight the importance of clear definitions for each intervention. This clarity is essential for transferring lessons learned, comparing programs, and effectively measuring results. The success of integrated diagnosis is not a one-size-fits-all scenario; decisions regarding the approach, conditions to be integrated, and timing of integration must be guided by local contexts to ensure sustainable outcomes. The review findings suggest that integrated diagnosis may be suitable at the primary care level in LMICs under specific circumstances. Successful implementation hinges on addressing the perspectives of healthcare workers and patients/clients alike, requiring adequate time, resources, and a well-defined intervention model.

Monitoring and evaluating the implementation of essential packages of health services

Essential packages of health services (EPHS) are a critical tool for achieving universal health coverage, especially in low-income and lower middle-income countries. However, there is a lack of guidance and standards for monitoring and evaluation (M&E) of EPHS implementation. This paper is the final in a series of papers reviewing experiences using evidence from the Disease Control Priorities, third edition publications in EPHS reforms in seven countries. We assess current approaches to EPHS M&E, including case studies of M&E approaches in Ethiopia and Pakistan. We propose a step-by-step process for developing a national EPHS M&E framework. Such a framework would start with a theory of change that links to the specific health system reforms the EPHS is trying to accomplish, including explicit statements about the 'what' and 'for whom' of M&E efforts. Monitoring frameworks need to consider the additional demands that could be placed on weak and already overstretched data systems, and they must ensure that processes are put in place to act quickly on emergent implementation challenges. Evaluation frameworks could learn from the field of implementation science; for example, by adapting the Reach, Effectiveness, Adoption, Implementation and Maintenance framework to policy implementation. While each country will need to develop its own locally relevant M&E indicators, we encourage all countries to include a set of core indicators that are aligned with the Sustainable Development Goal 3 targets and indicators. Our paper concludes with a call to reprioritise M&E more generally and to use the EPHS process as an opportunity for strengthening national health information systems. We call for an international learning network on EPHS M&E to generate new evidence and exchange best practices.

Implementation of UNICEF and WHO's care for child development package: Lessons from a global review and key informant interviews

Introduction

In the last decade, there has been increased global policy and program momentum to promote early childhood development. The Care for Child Development (CCD) package, developed by UNICEF and the WHO, is a key tool responding to the global demand. The CCD package comprises two age-specific evidence-based recommendations for caregivers to 1) play and communicate and 2) responsively interact with their children (0-5 years) and was designed to be integrated within existing services to strengthen nurturing care for child development. The aim of this report was to provide an up-to-date global review of the implementation and evaluation of the CCD package.

Methods

In addition to a systematic review of 55 reports, we interviewed 23 key informants (including UNICEF and WHO personnel) to better understand the implementation of CCD.

Results

The CCD package has been or is being implemented in 54 low- and middle-income countries and territories, and it has been integrated into government services across the health, social, and education sectors in 26 countries. Across these contexts, CCD has been adapted in three primary ways: 1) translations of CCD materials (mostly counseling cards) into local language(s), 2) adaptations of CCD materials for the local context, vulnerable children, or a humanitarian/emergency setting (e.g., including local play activities, using activities that are better suited to children with visual impairments), and 3) substantive modifications to the content of CCD materials (e.g., expansion of play and communication activities, addition of new themes, creation of a structured curriculum). While there is promising evidence and examples of good implementation practice, there has been mixed experience about implementation of CCD with respect to adaptation, training, supervision, integration into existing services, and monitoring implementation fidelity and quality. For example, many users of CCD found difficulties with training the workforce, garnering buy-in from governments, and ensuring benefits for families, among others.

Discussion

Additional knowledge on how to improve the effectiveness, implementation fidelity and quality, and acceptance of CCD is needed. Based on the findings of the review we make recommendations for future efforts to implement CCD at-scale.

Prevalence and associated factors of common childhood illnesses in sub-Saharan Africa from 2010 to 2020: a cross-sectional study

OBJECTIVE

This study aimed to assess the prevalence and determinants of common childhood illnesses in sub-Saharan Africa.

DESIGN

Cross-sectional study.

SETTING

Sub-Saharan Africa.

PARTICIPANTS

Under-5 children.

PRIMARY OUTCOME

Common childhood illnesses.

METHODS

Secondary data analysis was conducted using data from recent Demographic and Health Survey datasets from 33 sub-Saharan African countries. We used the Kids Record dataset file and we included only children under the age of 5 years. A total weighted sample size of 208 415 from the pooled (appended) data was analysed. STATA V.14.2 software was used to clean, recode and analyse the data. A multilevel binary logistic regression model was fitted, and adjusted OR with a 95% CI and p value of ≤0.05 were used to declare significantly associated factors. To check model fitness and model comparison, intracluster correlation coefficient, median OR, proportional change in variance and deviance (-2 log-likelihood ratio) were used.

RESULT

In this study, the prevalence of common childhood illnesses among under-5 children was 50.71% (95% CI: 44.18% to 57.24%) with a large variation between countries which ranged from Sierra Leone (23.26%) to Chad (87.24%). In the multilevel analysis, rural residents, mothers who are currently breast feeding, educated mothers, substandard floor material, high community women education and high community poverty were positively associated with common childhood illnesses in the sub-Saharan African countries. On the other hand, children from older age mothers, children from the richest household and children from large family sizes, and having media access, electricity, a refrigerator and improved toilets were negatively associated.

CONCLUSIONS

The prevalence of common illnesses among under-5 children was relatively high in sub-Saharan African countries. Individual-level and community-level factors were associated with the problem. Improving housing conditions, interventions to improve toilets and strengthening the economic status of the family and the communities are recommended to reduce common childhood diseases.

Estimating the impact of donor programs on child mortality in low- and middle-income countries: a synthetic control analysis of child health programs funded by the United States Agency for International Development

Background

Significant levels of funding have been provided to low- and middle-income countries for development assistance for health, with most funds coming through direct bilateral investment led by the USA and the UK. Direct attribution of impact to large-scale programs funded by donors remains elusive due the difficulty of knowing what would have happened without those programs, and the lack of detailed contextual information to support causal interpretation of changes.

Methods

This study uses the synthetic control analysis method to estimate the impact of one donor’s funding (United States Agency for International Development, USAID) on under-five mortality across several low- and middle-income countries that received above average levels of USAID funding for maternal and child health programs between 2000 and 2016.

Results

In the study period (2000–16), countries with above average USAID funding had an under-five mortality rate lower than the synthetic control by an average of 29 deaths per 1000 live births (year-to-year range of − 2 to − 38). This finding was consistent with several sensitivity analyses.

Conclusions

The synthetic control method is a valuable addition to the range of approaches for quantifying the impact of large-scale health programs in low- and middle-income countries. The findings suggest that adequately funded donor programs (in this case USAID) help countries to reduce child mortality to significantly lower rates than would have occurred without those investments.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12963-021-00278-9.

Integrated management of neonatal and childhood illness strategy in Zimbabwe: An evaluation

More than five million children under the age of five die each year worldwide, primarily from preventable and treatable causes. In response, the World Health Organization's Integrated Management of Childhood Illnesses (IMNCI) strategy has been adopted in more than 95 low- and middle-income countries, 41 of them from Africa. Despite IMNCI's widespread implementation, evidence on its impact on child mortality and institutional deliveries is limited. This study examined the effect of IMNCI strategy in the context of Zimbabwe, where neonatal and infant mortality rates are among the highest in the world. We used binary logistic regression to analyze cross-sectional data from the 2015 Zimbabwe Demographic and Health Survey. Zimbabwe implemented the IMNCI strategy in 2012. Our empirical strategy involved comparing neonatal and infant mortality and institutional deliveries within the same geographic area before and after IMNCI implementation in a nationally representative sample of children born between 2010 and 2015. Exposure to IMNCI was significantly associated with a reduction in neonatal mortality (adjusted odds ratio (95% CI): 0.70 (0.50, 0.98)) and infant mortality (adjusted odds ratio (95% CI): 0.69 (0.54, 0.91)). The strategy also helped increase institutional deliveries significantly (adjusted odds ratio (95% CI): 1.95 (1.67, 2.28)). Further analyses revealed that these associations were concentrated among educated women and in rural areas.The IMNCI strategy in Zimbabwe seems to be successful in delivering its intended goals. Future programmatic and policy efforts should target women with low education and those residing in urban areas. Furthermore, sustaining the positive impact and achieving the child health-related Sustainable Development Goals will require continued political will in raising domestic financial investments to ensure the sustainability of maternal and child health programs.

Integrated Management of Childhood Illnesses implementation-related factors at 18 Colombian cities

BACKGROUND

Integrated Management of Childhood Illnesses (IMCI) is a strategy developed by the World Health Organization (WHO) and UNICEF in 1992. It was deployed as an integrated approach to improve children's health in the world. This strategy is divided into three components: organizational, clinical, and communitarian. If the Integrated Management of Childhood Illnesses implementation-related factors in low- and middle-income countries are known, the likelihood of decreasing infant morbidity and mortality rates could be increased. This work aimed to identify, from the clinical component of the strategy, the implementation-related factors to Integrated Management of Childhood Illnesses at 18 Colombian cities.

METHODS

A quantitative cross-sectional study was performed with a secondary analysis of databases of a study conducted in Colombia by the Public Health group of Universidad de Los Andes in 2016. An Integrated Care Index was calculated as a dependent variable and descriptive bivariate and multivariate analyses to find the relationship between this index and the relevant variables from literature.

RESULTS

Information was obtained from 165 medical appointments made by nurses, general practitioners, and pediatricians. Health access is given mainly in the urban area, in the first level care and outpatient context. Essential medicines availability, necessary supplies, second-level care, medical appointment periods longer than 30 min, and care to the child under 30 months are often related to higher rates of Integrated Care Index.

CONCLUSION

Health care provided to children under five remains incomplete because it does not present the basic minimums for the adequate IMCI's implementation in the country. It is necessary to provide integrated care that provides medicine availability and essential supplies that reduce access barriers and improve the system's fragmentation.

Prioritizing the Care of Critically Ill Children in South Africa: How Does SCREEN Perform Against Other Triage Tools?

OBJECTIVE

Childhood mortality remains unacceptably high. In low-resource settings, children with critical illness often present for care. Current triage strategies are time consuming and require trained health care workers. To address this limitation, our team developed a simple subjective tool, SCREEN (Sick Children Require Emergency Evaluation Now), which is easy to administer, to identify critically ill children. This article presents the development of the SCREEN program and evaluates its performance when compared with other commonly implemented triage tools in low-resource settings.

METHODS

We measured the sensitivity and specificity of SCREEN, to identify critically ill children, compared with 4 other previously validated triage tools: the Integrated Management of Childhood Illnesses, the Pediatric Early Warning, the Pediatric South African Triage Scale, and the World Health Organization Emergency Triage Treatment Tool.

FINDINGS

SCREEN has high sensitivity (100%-98.73%; P < 0.001) and specificity (64.41%-50.71%; P < 0.001) when compared with other validated triage tools.

CONCLUSIONS

The SCREEN tool may offer a simple and effective method to identify critically ill children in low-resource environments.

Results from one-year use of an electronic Clinical Decision Support System in a post-conflict context: An implementation research

BACKGROUND

In 2017, the Adamawa State Primary Healthcare Development Agency introduced ALMANACH, an electronic clinical decision support system based on a modified version of IMCI. The target area was the Federal State of Adamawa (Nigeria), a region recovering after the Boko Haram insurgency. The aim of this implementation research was to assess the improvement in terms of quality care offered after one year of utilization of the tool.

METHODS

We carried out two cross-sectional studies in six Primary Health Care Centres to assess the improvements in comparison with the baseline carried out before the implementation. One survey was carried out inside the consultation room and was based on the direct observation of 235 consultations of children aged from 2 to 59 months old. The second survey questioned 189 caregivers outside the health facility for their opinion about the consultation carried out through using the tablet, the prescriptions and medications given.

RESULTS

In comparison with the baseline, more children were checked for danger signs (60.0% vs. 37.1% at baseline) and in addition, children were actually weighed (61.1% vs. 27.7%) during consultation. Malnutrition screening was performed in 35.1% of children (vs. 12.1%). Through ALMANACH, also performance of preventive measures was significantly improved (p<0.01): vaccination status was checked in 39.8% of cases (vs. 10.6% at baseline), and deworming and vitamin A prescription was increased to 46.5% (vs. 0.7%) and 48.3% (vs. 2.8%) respectively. Furthermore, children received a complete physical examination (58.3% vs. 45.5%, p<0.01) and correct treatment (48.4% vs. 29.5%, p<0.01). Regarding antibiotic prescription, 69.3% patients received at least one antibiotic (baseline 77.7%, p<0.05).

CONCLUSIONS

Our findings highlight major improvements in terms of quality of care despite many questions still pending to be answered in relation to a full integration of the tool in the Adamawa health system.

Evolution of the World Health Organization's programmatic actions to control diarrheal diseases

The Program for the Control of Diarrheal Diseases (CDD) of the World Health Organization (WHO) was created in 1978, the year the Health for All Strategy was launched at the Alma Ata International Conference on Primary Health Care. CDD quickly became one of the pillars of this strategy, with its primary goal of reducing diarrhea-associated mortality among infants and young children in developing countries. WHO expanded the previous cholera-focused unit into one that addressed all diarrheal diseases, and uniquely combined support to research and to national CDD Programs. We describe the history of the Program, summarize the results of the research it supported, and illustrate the outcome of the Program's control efforts at country and global levels. We then relate the subsequent evolution of the Program to an approach that was more technically broad and programmatically narrow and describe how this affected diarrheal diseases-related activities globally and in countries.

Review of Integrated Management of Childhood Illness (IMCI) in 16 countries in Central Asia and Europe: implications for primary healthcare in the era of universal health coverage

The Integrated Management of Childhood Illness (IMCI) was introduced in Central Asia and Europe to address the absence of evidence-based guidelines, antibiotics misuse, polypharmacy and overhospitalisation. This study in 16 countries analyses status, strengths of and barriers to IMCI implementation and investigates how health systems affect the problems IMCI aims to address. 220 key informants were interviewed ranging from 5 to 37 per country (median 12). Data were analysed for arising themes and peer-reviewed. IMCI has not been fully used either as a strategy or as an algorithmic diagnostic and treatment decision tool. Inherent incentives include: economic factors taking precedence over evidence and the best interest of the child in treatment decisions; financing mechanisms and payment schemes incentivising unnecessary or prolonged hospitalisation; prescription of drugs other than IMCI drugs for revenue generation or because believed superior by doctors or parents; parents' perception that the quality of care at the primary healthcare level is poor; preference for invasive treatment and medicalised care. Despite the long-standing recognition that supportive health systems are a requirement for IMCI implementation, efforts to address health system barriers have been limited. Making healthcare truly universal for children will require a shift towards health systems designed around and for children and away from systems centred on providers' needs and parents' expectations. Prerequisites will be sufficient remuneration, sound training, improved health literacy among parents, conducive laws and regulations and reimbursement systems with adequate checks and balances to ensure the best possible care.

Drivers of the reduction in childhood diarrhea mortality 1980-2015 and interventions to eliminate preventable diarrhea deaths by 2030

BACKGROUND

Childhood diarrhea deaths have declined more than 80% from 1980 to 2015, in spite of an increase in the number of children in low- and middle-income countries (LMIC). Possible drivers of this remarkable accomplishment can guide the further reduction of the half million annual child deaths from diarrhea that still occur.

METHODS

We used the Lives Saved Tool, which models effects on mortality due to changes in coverage of preventive or therapeutic interventions or risk factors, for 50 LMIC to determine the proximal drivers of the diarrhea mortality reduction.

RESULTS

Diarrhea treatment (oral rehydration solution [ORS], zinc, antibiotics for dysentery and management of persistent diarrhea) and use of rotavirus vaccine accounted for 49.7% of the diarrhea mortality reduction from 1980 to 2015. Improvements in nutrition (stunting, wasting, breastfeeding practices, vitamin A) accounted for 38.8% and improvements in water, sanitation and handwashing for 11.5%. The contribution of ORS was greater from 1980 to 2000 (58.0% of the reduction) than from 2000 to 2015 (30.7%); coverage of ORS increased from zero in 1980 to 29.5% in 2000 and more slowly to 44.1% by 2015. To eliminate the remaining childhood diarrhea deaths globally, all these interventions will be needed. Scaling up diarrhea treatment and rotavirus vaccine, to 90% coverage could reduce global child diarrhea mortality by 74.1% from 2015 levels by 2030. Adding improved nutrition could increase that to 89.1%. Finally, adding increased use of improved water sources, sanitation and handwashing could result in a 92.8% reduction from the 2015 level.

CONCLUSIONS

Employing the interventions that have resulted in such a large reduction in diarrhea mortality in the last 35 years can virtually eliminate remaining childhood diarrhea deaths by 2030.

Peek Community Eye Health - mHealth system to increase access and efficiency of eye health services in Trans Nzoia County, Kenya: study protocol for a cluster randomised controlled trial

BACKGROUND

Globally, eye care provision is currently insufficient to meet the requirement for eye care services. Lack of access and awareness are key barriers to specialist services; in addition, specialist services are over-utilised by people with conditions that could be managed in the community or primary care. In combination, these lead to a large unmet need for eye health provision. We have developed a validated smartphone-based screening algorithm (Peek Community Screening App). The application (App) is part of the Peek Community Eye Health system (Peek CEH) that enables Community Volunteers (CV) to make referral decisions about patients with eye problems. It generates referrals, automated short messages service (SMS) notifications to patients or guardians and has a program dashboard for visualising service delivery. We hypothesise that a greater proportion of people with eye problems will be identified using the Peek CEH system and that there will be increased uptake of referrals, compared to those identified and referred using the current community screening approaches.

STUDY DESIGN

A single masked, cluster randomised controlled trial design will be used. The unit of randomisation will be the 'community unit', defined as a dispensary or health centre with its catchment population. The community units will be allocated to receive either the intervention (Peek CEH system) or the current care (periodic health centre-based outreach clinics with onward referral for further treatment). In both arms, a triage clinic will be held at the link health facility four weeks from sensitisation, where attendance will be ascertained. During triage, participants will be assessed and treated and, if necessary, referred onwards to Kitale Eye Unit.

DISCUSSION

We aim to evaluate a M-health system (Peek CEH) geared towards reducing avoidable blindness through early identification and improved adherence to referral for those with eye problems and reducing demand at secondary care for conditions that can be managed effectively at primary care level.

TRIAL REGISTRATION

The Pan African Clinical Trials Registry (PACTR), 201807329096632 . Registered on 8 June 2018.

The child survival impact of the Ghana Essential Health Interventions Program: A health systems strengthening plausibility trial in Northern Ghana

Background

The Ghana Health Service in collaboration with partner institutions implemented a five-year primary health systems strengthening program known as the Ghana Essential Health Intervention Program (GEHIP). GEHIP was a plausibility trial implemented in an impoverished region of northern Ghana around the World Health Organizations (WHO) six pillars combined with community engagement, leadership development and grassroots political support, the program organized a program of training and action focused on strategies for saving newborn lives and community-engaged emergency referral services. This paper analyzes the effect of the GEHIP program on child survival.

Methods

Birth history data assembled from baseline and endline surveys are used to assess the hazard of child mortality in GEHIP treatment and comparison areas prior to and after the start of treatment. Difference-in-differences (DiD) methods are used to compare mortality change over time among children exposed to GEHIP relative to children in the comparison area over the same time period. Models test the hypothesis that a package of systems strengthening activities improved childhood survival. Models adjusted for the potentially confounding effects of baseline differentials, secular mortality trends, household characteristics such as relative wealth and parental educational attainment, and geographic accessibility of clinical care.

Results

The GEHIP combination of health systems strengthening activities reduced neonatal mortality by approximately one half (HR = 0.52, 95% CI = 0.28,0.98, p = 0.045). There was a null incremental effect of GEHIP on mortality of post-neonate infants (from 1 to 12 months old) (HR = 0.72; 95% CI = 0.30,1.79; p = 0.480) and post-infants (from 1 year to 5 years old) -(HR = 1.02; 95% CI = 0.55–1.90; p = 0.940). Age-specific analyses show that impact was concentrated among neonates. However, effect ratios for post-infancy were inefficiently assessed owing to extensive survival history censoring for the later months of childhood. Children were observed only rarely for periods over 40 months of age.

Conclusion

GEHIP results show that a comprehensive approach to newborn care is feasible, if care is augmented by community-based nurses. It supports the assertion that if appropriate mechanisms are put in place to enable the various pillars of the health system as espoused by WHO in rural impoverished settings where childhood mortality is high, it could lead to accelerated reductions in mortality thereby increasing survival of children. Policy implications of the pronounced neonatal effect of GEHIP merit national review for possible scale-up.

Addressing malnutrition among children in routine care: how is the Integrated Management of Childhood Illnesses strategy implemented at health centre level in Burundi?

Background

The Integrated Management of Childhood Illness (IMCI) strategy was adopted in Burundi in 2003. Our aim was to evaluate to what extent the malnutrition component of the IMCI guidelines is implemented at health facilities level.

Methods

We carried out direct observations of curative outpatient consultations for children aged 6–59 months in 90 health centres selected randomly. We considered both the child and the health worker (HW) as units of analysis and used bivariate analysis to explore characteristics of HWs associated with tasks systematically or never performed.

Results

A total of 514 consultations carried out by 145 HWs were observed. Among the 250 children under two years, less than 30% were asked questions on breastfeeding. None of them had all seven nutrition-related questions asked to their caregivers and none of the 200 children over the age of two years had all five nutrition-related questions asked to their caregivers. Only 13 cases (3%) had all of the six examinations/tasks (weight, height/length, mid-upper arm circumference, oedema, filling in and discussing the growth curve and calculating the weight for height z-score) performed as part of their care. 393 cases (76%) reported that they had not being given any nutrition advice.

With regards to HWs, among 99 of them who had received children under two, only 21 (21.2%)[14.2–30.5%) systematically asked the question regarding ‘ongoing breastfeeding’.

Only 56 (38.6%)[31–46.9%] weighed or discussed the weight taken prior the consultation for each child they reviewed, only 38 (26.2%)[19.6–34.1%] measured the height/length or discussed it for each child reviewed and 23 (15.9%)[10.7–22.8%] performed (systematically?) the WHZ-score.

More than 50% never gave nutrition advices to any child reviewed.

HWs who daily manage severe acute malnutrition were the most likely to systematically ask the question regarding ‘ongoing breastfeeding’ and to perform a ‘weight examination’. Those who had not received supervision visit on the topic of malnutrition predominantly never performed a ‘weight examination’. The ‘height/length’ examination’ was predominantly performed by female HWs and those who have ‘contract with the government.

Conclusion

This study has found poor compliance by HWs to IMCI in Burundi. This indicates that a substantial proportion of children do not receive early and appropriate care, especially that pertaining to malnutrition. This alarming situation calls for strong action by actors committed to child health in the country.

Trial registration

Clinical Trials.gov Identifier: NCT02721160; March 2016 (retrospectively registered).

Can the use of digital algorithms improve quality care? An example from Afghanistan

BACKGROUND

Quality of care is a difficult parameter to measure. With the introduction of digital algorithms based on the Integrated Management of Childhood Illness (IMCI), we are interested to understand if the adherence to the guidelines improved for a better quality of care for children under 5 years old.

METHODS

More than one year after the introduction of digital algorithms, we carried out two cross sectional studies to assess the improvements in comparison with the situation prior to the implementation of the project, in two Basic Health Centres in Kabul province. One survey was carried out inside the consultation room and was based on the direct observation of 181 consultations of children aged 2 months to 5 years old, using a checklist completed by a senior physicians. The second survey queried 181 caretakers of children outside the health facility for their opinion about the consultation carried out through the tablet and prescriptions and medications given.

RESULTS

We measured the quality of care as adherence to the IMCI's guidelines. The study evaluated the quality of the physical examination and the therapies prescribed with a special attention to antibiotic prescription. We noticed a dramatic improvement (p<0.05) of several indicators following the introduction of digital algorithms. The baseline physical examination was appropriate only for 23.8% [IC% 19.9-28.1] of the patients, 34.5% [IC% 30.0-39.2] received a correct treatment and 86.1% [IC% 82.4-89.2] received at least one antibiotic. With the introduction of digital algorithms, these indicators statistically improved respectively to 84.0% [IC% 77.9-88.6], >85% and less than 30%.

CONCLUSIONS

Our findings suggest that digital algorithms improve quality of care by applying the guidelines more effectively. Our experience should encourage to test this tool in different settings and to scale up its use at province/state level.

Evaluation of methods for linking household and health care provider data to estimate effective coverage of management of child illness: results of a pilot study in Southern Province, Zambia

Background

Existing population-based surveys have limited accuracy for estimating the coverage and quality of management of child illness. Linking household survey data with health care provider assessments has been proposed as a means of generating more informative population-level estimates of effective coverage, but methodological issues need to be addressed.

Methods

A 2016 survey estimated effective coverage of management of child illness in Southern Province, Zambia, using multiple methods for linking temporally and geographically proximate household and health care provider data. Mothers of children <5 years were surveyed about seeking care for child illness. Information on health care providers’ capacity to manage child illness, or structural quality, was assessed using case scenarios and a tool modeled on the WHO Service Availability and Readiness Assessment (SARA). Each sick child was assigned the structural quality score of their stated (exact-match) source of care. Effective coverage was calculated as the average structural quality experienced by all sick children. Children were also ecologically linked to providers using measures of geographic proximity, with and without data on non-facility providers, to assess the effects of these linking methods on effective coverage estimates.

Results

Data were collected on 83 providers and 385 children with fever, diarrhea, and/or symptoms of ARI in the preceding 2 weeks. Most children sought care from government facilities or community-based agents (CBAs). Effective coverage of management of child illness estimated through exact-match linking was approximately 15-points lower in each stratum than coverage of seeking skilled care due to providers’ limited structural quality. Estimates generated using most measures of geographic proximity were similar to the exact-match estimate, with the exception of the kernel density estimation method in the urban area. Estimates of coverage in rural areas were greatly reduced across all methods using facility-only data if seeking care from CBAs was treated as unskilled care.

Conclusions

Linking household and provider data may generate more informative estimates of effective coverage of management of child illness. Ecological linking with provider data on a sample of all skilled providers may be as effective as exact-match linking in areas with low variation in structural quality within a provider category or minimal provider bypassing.

Consistency of Integrated Management of Newborn and Childhood Illness (IMNCI) in Shire Governmental Health Institution in 2017

Objective

In an effort to reduce infant mortality and morbidity, the World Health Organization and other technical partners developed the Integrated Management of Newborn and Childhood Illness (IMNCI). This study focuses on assessment of consistency and completeness of integrated management of neonatal and child hood illness in primary health care units.

Results

A total of 384 cases were taken from 3562 cases both from young infant registration (under-2 month old) and child registration (2 months–5 year old). Out of 384 cases, 241 (62.8%) cases were correctly classified and 143 (37.2%) were incorrect classifications. Similarly 164 (42.7%) cases were treated correctly where as 220 (57.3%) treated incorrectly. Only 95 (24.7%) cases have given appropriate appointments where as 289 (75.3%) cases were appointed incorrectly. The overall consistency of IMNCI management is poor. Unless continuous follow up of and training was given, children are not treated as expected. More over using electronic method of IMNCI may alleviate the problem.

Hyak mortality monitoring system: innovative sampling and estimation methods - proof of concept by simulation

Traditionally health statistics are derived from civil and/or vital registration. Civil registration in low- to middle-income countries varies from partial coverage to essentially nothing at all. Consequently the state of the art for public health information in low- to middle-income countries is efforts to combine or triangulate data from different sources to produce a more complete picture across both time and space - data amalgamation. Data sources amenable to this approach include sample surveys, sample registration systems, health and demographic surveillance systems, administrative records, census records, health facility records and others. We propose a new statistical framework for gathering health and population data - Hyak - that leverages the benefits of sampling and longitudinal, prospective surveillance to create a cheap, accurate, sustainable monitoring platform. Hyak has three fundamental components: Data amalgamation: A sampling and surveillance component that organizes two or more data collection systems to work together: (1) data from HDSS with frequent, intense, linked, prospective follow-up and (2) data from sample surveys conducted in large areas surrounding the Health and Demographic Surveillance System (HDSS) sites using informed sampling so as to capture as many events as possible;Cause of death: Verbal autopsy to characterize the distribution of deaths by cause at the population level; andSocioeconomic status (SES): Measurement of SES in order to characterize poverty and wealth. We conduct a simulation study of the informed sampling component of Hyak based on the Agincourt HDSS site in South Africa. Compared with traditional cluster sampling, Hyak's informed sampling captures more deaths, and when combined with an estimation model that includes spatial smoothing, produces estimates of both mortality counts and mortality rates that have lower variance and small bias.

Care for Child Development: an intervention in support of responsive caregiving and early child development

BACKGROUND

An estimated 43% of children younger than 5 years of age are at elevated risk of failing to achieve their human potential. In response, the World Health Organization and UNICEF developed Care for Child Development (CCD), based on the science of child development, to improve sensitive and responsive caregiving and promote the psychosocial development of young children.

METHODS

In 2015, the World Health Organization and UNICEF identified sites where CCD has been implemented and sustained. The sites were surveyed, and responses were followed up by phone interviews. Project reports provided information on additional sites, and a review of published studies was undertaken to document the effectiveness of CCD for improving child and family outcomes, as well as its feasibility for implementation in resource-constrained communities.

RESULTS

The inventory found that CCD had been integrated into existing services in diverse sectors in 19 countries and 23 sites, including child survival, health, nutrition, infant day care, early education, family and child protection and services for children with disabilities. Published and unpublished evaluations have found that CCD interventions can improve child development, growth and health, as well as responsive caregiving. It has also been reported to reduce maternal depression, a known risk factor for poor pregnancy outcomes and poor child health, growth and development. Although CCD has expanded beyond initial implementation sites, only three countries reported having national policy support for integrating CCD into health or other services.

CONCLUSIONS

Strong interest exists in many countries to move beyond child survival to protect and support optimal child development. The United Nations Sustainable Development Goals depend on children realizing their potential to build healthy and emotionally, cognitively and socially competent future generations. More studies are needed to guide the integration of the CCD approach under different conditions. Nevertheless, the time is right to provide for the scale-up of CCD as part of services for families and children.

Effectiveness of two community-based strategies on disease knowledge and health behaviour regarding malaria, diarrhoea and pneumonia in Ghana

Background

Ghana has developed two community-based strategies that aim to increase access to quality treatment for malaria, diarrhoea and suspected pneumonia, and to improve household and family practices: integrated Community Case Management (iCCM) and Community-based Health Planning and Services (CHPS). The objective of the study was to assess the effectiveness of iCCM and CHPS on disease knowledge and health behaviour regarding malaria, diarrhoea and pneumonia.

Methods

A household survey was conducted two and eight years after implementation of iCCM in the Volta and Northern Regions of Ghana respectively, and more than ten years of CHPS implementation in both regions. The study population included 1356 carers of children under- five years of age who had fever, diarrhoea and/or cough in the two weeks prior to the interview. Disease knowledge was assessed based on the knowledge of causes and identification of signs of severe disease and its association with the sources of health education messages received. Health behaviour was assessed based on reported prompt care seeking behaviour, adherence to treatment regime, utilization of mosquito nets and having improved sanitation facilities, and its association with the sources of health education messages received.

Results

Health education messages from community-based agents (CBAs) in the Northern Region were associated with the identification of at least two signs of severe malaria (adjusted Odds Ratio (OR) 1.8, 95%CI 1.0, 3.3, p = 0.04), two practices that can cause diarrhoea (adjusted OR 4.7, 95%CI 1.4, 15.5, p = 0.02) 0and two signs of severe pneumonia (adjusted OR 7.7, 95%CI2.2, 26.5, p = 0.01)-the later also associated with prompt care seeking behaviour (p = 0.04). In the Volta Region, receiving messages on diarrhoea from CHPS was associated with the identification of at least two signs of severe diarrhoea (adjusted OR 3.6, 95%CI 1.4, 9.0), p = 0.02). iCCM was associated with prompt care seeking behaviour in the Volta Region and CHPS with prompt care seeking behaviour in the Northern Region (p < 0.5).

Conclusions

Both iCCM and CHPS were associated with disease knowledge and health behaviour, but this was more pronounced for iCCM and in the Northern Region. HBC should continue to be considered as the strategy through which community-IMCI is implemented.

Electronic supplementary material

The online version of this article (10.1186/s12889-017-4964-6) contains supplementary material, which is available to authorized users.

Methodological Considerations for Use of Routine Health Information System Data to Evaluate Malaria Program Impact in an Era of Declining Malaria Transmission

Coverage of malaria control interventions is increasing dramatically across endemic countries. Evaluating the impact of malaria control programs and specific interventions on health indicators is essential to enable countries to select the most effective and appropriate combination of tools to accelerate progress or proceed toward malaria elimination. When key malaria interventions have been proven effective under controlled settings, further evaluations of the impact of the intervention using randomized approaches may not be appropriate or ethical. Alternatives to randomized controlled trials are therefore required for rigorous evaluation under conditions of routine program delivery. Routine health management information system (HMIS) data are a potentially rich source of data for impact evaluation, but have been underused in impact evaluation due to concerns over internal validity, completeness, and potential bias in estimates of program or intervention impact. A range of methodologies were identified that have been used for impact evaluations with malaria outcome indicators generated from HMIS data. Methods used to maximize internal validity of HMIS data are presented, together with recommendations on reducing bias in impact estimates. Interrupted time series and dose-response analyses are proposed as the strongest quasi-experimental impact evaluation designs for analysis of malaria outcome indicators from routine HMIS data. Interrupted time series analysis compares the outcome trend and level before and after the introduction of an intervention, set of interventions or program. The dose-response national platform approach explores associations between intervention coverage or program intensity and the outcome at a subnational (district or health facility catchment) level.

Malaria Control Interventions Contributed to Declines in Malaria Parasitemia, Severe Anemia, and All-Cause Mortality in Children Less Than 5 Years of Age in Malawi, 2000-2010

Malaria control intervention coverage increased nationwide in Malawi during 2000-2010. Trends in intervention coverage were assessed against trends in malaria parasite prevalence, severe anemia (hemoglobin < 8 g/dL), and all-cause mortality in children under 5 years of age (ACCM) using nationally representative household surveys. Associations between insecticide-treated net (ITN) ownership, malaria morbidity, and ACCM were also assessed. Household ITN ownership increased from 27.4% (95% confidence interval [CI] = 25.9-29.0) in 2004 to 56.8% (95% CI = 55.6-58.1) in 2010. Similarly intermittent preventive treatment during pregnancy coverage increased from 28.2% (95% CI = 26.7-29.8) in 2000 to 55.0% (95% CI = 53.4-56.6) in 2010. Malaria parasite prevalence decreased significantly from 60.5% (95% CI = 53.0-68.0) in 2001 to 20.4% (95% CI = 15.7-25.1) in 2009 in children aged 6-35 months. Severe anemia prevalence decreased from 20.4% (95% CI: 17.3-24.0) in 2004 to 13.1% (95% CI = 11.0-15.4) in 2010 in children aged 6-23 months. ACCM decreased 41%, from 188.6 deaths per 1,000 live births (95% CI = 179.1-198.0) during 1996-2000, to 112.1 deaths per 1,000 live births (95% CI = 105.8-118.5) during 2006-2010. When controlling for other covariates in random effects logistic regression models, household ITN ownership was protective against malaria parasitemia in children (odds ratio [OR] = 0.81, 95% CI = 0.72-0.92) and severe anemia (OR = 0.82, 95% CI = 0.72-0.94). After considering the magnitude of changes in malaria intervention coverage and nonmalaria factors, and given the contribution of malaria to all-cause mortality in malaria-endemic countries, the substantial increase in malaria control interventions likely improved child survival in Malawi during 2000-2010.

SCREEN: A simple layperson administered screening algorithm in low resource international settings significantly reduces waiting time for critically ill children in primary healthcare clinics

BACKGROUND

In low resource settings, an inadequate number of trained healthcare workers and high volumes of children presenting to Primary Healthcare Centers (PHC) result in prolonged waiting times and significant delays in identifying and evaluating critically ill children. The Sick Children Require Emergency Evaluation Now (SCREEN) program, a simple six-question screening algorithm administered by lay healthcare workers, was developed in 2014 to rapidly identify critically ill children and to expedite their care at the point of entry into a clinic. We sought to determine the impact of SCREEN on waiting times for critically ill children post real world implementation in Cape Town, South Africa.

METHODS AND FINDINGS

This is a prospective, observational implementation-effectiveness hybrid study that sought to determine: (1) the impact of SCREEN implementation on waiting times as a primary outcome measure, and (2) the effectiveness of the SCREEN tool in accurately identifying critically ill children when utilised by the QM and adherence by the QM to the SCREEN algorithm as secondary outcome measures. The study was conducted in two phases, Phase I control (pre-SCREEN implementation- three months in 2014) and Phase II (post-SCREEN implementation-two distinct three month periods in 2016). In Phase I, 1600 (92.38%) of 1732 children presenting to 4 clinics, had sufficient data for analysis and comprised the control sample. In Phase II, all 3383 of the children presenting to the 26 clinics during the sampling time frame had sufficient data for analysis. The proportion of critically ill children who saw a professional nurse within 10 minutes increased tenfold from 6.4% to 64% (Phase I to Phase II) with the median time to seeing a professional nurse reduced from 100.3 minutes to 4.9 minutes, (p < .001, respectively). Overall layperson screening compared to Integrated Management of Childhood Illnesses (IMCI) designation by a nurse had a sensitivity of 94.2% and a specificity of 88.1%, despite large variance in adherence to the SCREEN algorithm across clinics.

CONCLUSIONS

The SCREEN program when implemented in a real-world setting can significantly reduce waiting times for critically ill children in PHCs, however further work is required to improve the implementation of this innovative program.

Effect of childhood nutrition counselling on intelligence in adolescence: a 15-year follow-up of a cluster-randomised trial

Objective

The present study aimed to assess the effects of an early childhood nutrition counselling intervention on intelligence (as measured by the intelligence quotient (IQ)) at age 15–16 years.

Design

A single-blind, cluster-randomised trial.

Setting

In 1998, in Southern Brazil, mothers of children aged 18 months or younger were enrolled in a nutrition counselling intervention (n 424). Counselling included encouragement and promotion of exclusive breast-feeding until 6 months of age and continued breast-feeding supplemented by protein-, lipid- and carbohydrate-rich foods after age 6 months up to age 2 years. The control group received routine feeding advice. In 2013, the fourth round of follow-up of these individuals, at the age of 15–16 years, was undertaken. IQ was assessed using the short form of the Wechsler Adult Intelligence Scale (WAIS-III). Mental disorders (evaluated using the Development and Well-Being Assessment (DAWBA)) and self-reported school failure, smoking and alcohol use were also investigated. Adjusted analyses were conducted using a multilevel model in accordance with the sampling process.

Subjects

Adolescents, mean (sd) age of 15·4 (0·5) years (n 339).

Results

Mean (sd) total IQ score was lower in the intervention group than the control group (93·4 (11·4) and 95·8 (11·2), respectively) but the association did not persist after adjustment. The prevalence of any mental disorders was similar between intervention and control groups (23·1 and 23·5 %, respectively). There were no differences between groups regarding school failure, smoking and alcohol use.

Conclusions

Nutrition counselling intervention in early childhood had no effect on intelligence measured during adolescence.

A Hypothetical Model to Predict the Potential Impact of Government and Management Support in Implementing Integrated Management of Childhood Illness Practices

OBJECTIVES

Despite broad adoption and implementation of Integrated Management of Childhood Illness (IMCI) in more than 100 countries, childhood mortality and morbidity rates continue to prevail. This calls for further investigation to identify the factors that prevent actual application of IMCI-recommended clinical practices. This study tests a hypothetical structural model to investigate potential role of government and healthcare policymakers on improving implementation and application of IMCI-recommended practices in clinical setting.

METHODS

The study was carried out at Sur and Ibra Nursing Institutes in Oman, in June 2016. We used six pre-tested and validated constructs for developing a hypothetical structural model. The constructs were used as underlying variables to examine the probable influence of government and policymakers on actual application of IMCI-recommended practices. Data were collected through structured questionnaires, which designed to measure healthcare professionals' perceptions. Each construct was pre-loaded with three sub-constructs. Cronbach's alpha (CA) was used to calculate the internal consistency and reliability.

RESULTS

Factor loadings for each item in the model were ≥ 0.700. CA values for all the studied constructs were > 0.600. The average variance extracted values for all the constructs were > 0.500.

CONCLUSIONS

The findings support the hypothetical structural model and highlights governments could play a significant role in ensuring that IMCI strategy is not only implemented, but also its recommended practices are applied in clinical setting.

Reliability and validity of pediatric triage tools evaluated in Low resource settings: a systematic review

BACKGROUND

Despite the high burden of pediatric mortality from preventable conditions in low and middle income countries and the existence of multiple tools to prioritize critically ill children in low-resource settings, no analysis exists of the reliability and validity of these tools in identifying critically ill children in these scenarios.

METHODS

The authors performed a systematic search of the peer-reviewed literature published, for studies pertaining to for triage and IMCI in low and middle-income countries in English language, from January 01, 2000 to October 22, 2013. An updated literature search was performed on on July 1, 2015. The databases searched included the Cochrane Library, EMBASE, Medline, PubMed and Web of Science. Only studies that presented data on the reliability and validity evaluations of triage tool were included in this review. Two independent reviewers utilized a data abstraction tool to collect data on demographics, triage tool components and the reliability and validity data and summary findings for each triage tool assessed.

RESULTS

Of the 4,717 studies searched, seven studies evaluating triage tools and 10 studies evaluating IMCI were included. There were wide varieties in method for assessing reliability and validity, with different settings, outcome metrics and statistical methods.

CONCLUSIONS

Studies evaluating triage tools for pediatric patients in low and middle income countries are scarce. Furthermore the methodology utilized in the conduct of these studies varies greatly and does not allow for the comparison of tools across study sites.

Reproductive, maternal, newborn, and child health: key messages from Disease Control Priorities 3rd Edition

As part of Disease Control Priorities 3rd Edition, the World Bank will publish a volume on Reproductive, Maternal, Newborn, and Child Health that identifies essential cost-effective health interventions that can be scaled up to reduce maternal, newborn, and child deaths, and stillbirths. This Review summarises the volume's key findings and estimates the effect and cost of expanded implementation of these interventions. Recognising that a continuum of care from the adolescent girl, woman, or mother to child is needed, the volume includes details of preventive and therapeutic health interventions in integrated packages: Maternal and Newborn Health and Child Health (along with folic acid supplementation, a key reproductive health intervention). Scaling up all interventions in these packages from coverage in 2015 to hypothetically immediately achieve 90% coverage would avert 149 000 maternal deaths, 849 000 stillbirths, 1 498 000 neonatal deaths, and 1 515 000 additional child deaths. In alternative calculations that consider only the effects of reducing the number of pregnancies by provision of contraceptive services as part of a Reproductive Health package, meeting 90% of the unmet need for contraception would reduce global births by almost 28 million and consequently avert deaths that could have occurred at 2015 rates of fertility and mortality. Thus, 67 000 maternal deaths, 440 000 neonatal deaths, 473 000 child deaths, and 564 000 stillbirths could be averted from avoided pregnancies. Particularly effective interventions in the Maternal and Newborn Health and Child Health packages would be management of labour and delivery, care of preterm births, and treatment of serious infectious diseases and acute malnutrition. Nearly all of these essential interventions can be delivered by health workers in the community or in primary health centres, which can increase population access to needed services. The annual incremental cost of immediately scaling up these essential interventions would be US$6·2 billion in low-income countries, $12·4 billion in lower-middle-income countries, and $8·0 billion in upper-middle-income countries. With the additional funding, greater focus on high-effect integrated interventions and innovations in service delivery, such as task shifting to other groups of health workers and supply and demand incentives, can help rectify major gaps in accessibility and quality of care. In recent decades, reduction of avoidable maternal and child deaths has been a global priority. With continued priority and expansion of essential reproductive, maternal, newborn, and child health interventions to high coverage, equity, and quality, as well as interventions to address underlying problems such as women's low status in society and violence against women, these deaths and substantial morbidity can be largely eliminated in another generation.

Prioritising the care of critically ill children: a pilot study using SCREEN reduces clinic waiting times

Objective

In low-resource settings, childhood mortality secondary to delays in triage and treatment remains high. This paper seeks to evaluate the impact of the novel Sick Children Require Emergency Evaluation Now (SCREEN) tool on the waiting times of critically ill children who present for care to primary healthcare clinics in Cape Town, South Africa.

Methods

We used a pre/postevaluation study design to calculate the median waiting times of all children who presented to four randomly chosen clinics for 5 days before, and 5 days after, the implementation of SCREEN.

Findings

The SCREEN programme resulted in statistical and clinically significant reductions in waiting times for children with critical illness to see a professional nurse (2 hours 45 min to 1 hour 12 min; p<0.001). There was also a statistically significant reduction in the proportion of children who left without being seen by a professional nurse (25.8% to 18.48%; p<0.001).

Conclusions

SCREEN is a novel programme that uses readily available laypersons, trained to make a subjective assessment of children arriving at primary healthcare centres, and provides a low cost, simple methodology to prioritise children and reduce waiting times in low-resource healthcare clinics.

Using an eIMCI-Derived Decision Support Protocol to Improve Provider-Caretaker Communication for Treatment of Children Under 5 in Tanzania

In Tanzania, significant effort has been made to reduce under-5 mortality rates, and has been somewhat successful in recent years. Many factors have contributed to this, such as using standard treatment protocols for sick children. Using mobile technology has become increasingly popular in health care delivery. This study examines whether the use of mobile technology can leverage a standardized treatment protocol to improve the impact of counseling for children's caretakers and result in better understanding of what needs to be done at home after the clinical visit. A randomized cluster design was utilized in clinics in Dar es Salaam, Tanzania. Children were treated using either test electronic protocols (eIMCI) or control paper (pIMCI) protocols. Providers using the eIMCI protocol were shown to counsel the mother significantly more frequently than providers using the pIMCI protocol. Caretakers receiving care by providers using the eIMCI protocol recalled significantly more problems and advice when to return and medications than those receiving care by providers using the pIMCI protocol. There was no significant difference among caretakers regarding the frequency and duration to administer medications. This study indicates the use of mobile technology as an important aide in increasing the delivery and recall of counseling messages.

Effects of the integrated Community Case Management of Childhood Illness Strategy on Child Mortality in Ethiopia: A Cluster Randomized Trial

We conducted a cluster randomized trial of the effects of the integrated community case management of childhood illness (iCCM) strategy on careseeking for and coverage of correct treatment of suspected pneumonia, diarrhea, and malaria, and mortality among children aged 2-59 months in 31 districts of the Oromia region of Ethiopia. We conducted baseline and endline coverage and mortality surveys approximately 2 years apart, and assessed program strength after about 1 year of implementation. Results showed strong iCCM implementation, with iCCM-trained workers providing generally good quality of care. However, few sick children were taken to iCCM providers (average 16 per month). Difference in differences analyses revealed that careseeking for childhood illness was low and similar in both study arms at baseline and endline, and increased only marginally in intervention (22.9-25.7%) and comparison (23.3-29.3%) areas over the study period (P = 0.77). Mortality declined at similar rates in both study arms. Ethiopia's iCCM program did not generate levels of demand and utilization sufficient to achieve significant increases in intervention coverage and a resulting acceleration in reductions in child mortality. This evaluation has allowed Ethiopia to strengthen its strategic approaches to increasing population demand and use of iCCM services.

A framework for scaling up health interventions: lessons from large-scale improvement initiatives in Africa

Background

Scaling up complex health interventions to large populations is not a straightforward task. Without intentional, guided efforts to scale up, it can take many years for a new evidence-based intervention to be broadly implemented. For the past decade, researchers and implementers have developed models of scale-up that move beyond earlier paradigms that assumed ideas and practices would successfully spread through a combination of publication, policy, training, and example.

Drawing from the previously reported frameworks for scaling up health interventions and our experience in the USA and abroad, we describe a framework for taking health interventions to full scale, and we use two large-scale improvement initiatives in Africa to illustrate the framework in action. We first identified other scale-up approaches for comparison and analysis of common constructs by searching for systematic reviews of scale-up in health care, reviewing those bibliographies, speaking with experts, and reviewing common research databases (PubMed, Google Scholar) for papers in English from peer-reviewed and “gray” sources that discussed models, frameworks, or theories for scale-up from 2000 to 2014. We then analyzed the results of this external review in the context of the models and frameworks developed over the past 20 years by Associates in Process Improvement (API) and the Institute for Healthcare improvement (IHI). Finally, we reflected on two national-scale improvement initiatives that IHI had undertaken in Ghana and South Africa that were testing grounds for early iterations of the framework presented in this paper.

Results

The framework describes three core components: a sequence of activities that are required to get a program of work to full scale, the mechanisms that are required to facilitate the adoption of interventions, and the underlying factors and support systems required for successful scale-up. The four steps in the sequence include (1) Set-up, which prepares the ground for introduction and testing of the intervention that will be taken to full scale; (2) Develop the Scalable Unit, which is an early testing phase; (3) Test of Scale-up, which then tests the intervention in a variety of settings that are likely to represent different contexts that will be encountered at full scale; and (4) Go to Full Scale, which unfolds rapidly to enable a larger number of sites or divisions to adopt and/or replicate the intervention.

Conclusions

Our framework echoes, amplifies, and systematizes the three dominant themes that occur to varying extents in a number of existing scale-up frameworks. We call out the crucial importance of defining a scalable unit of organization. If a scalable unit can be defined, and successful results achieved by implementing an intervention in this unit without major addition of resources, it is more likely that the intervention can be fully and rapidly scaled. When tying this framework to quality improvement (QI) methods, we describe a range of methodological options that can be applied to each of the four steps in the framework’s sequence.

Evaluation of validity of Integrated Management of Childhood Illness guidelines in identifying edema of nutritional causes among Egyptian children

OBJECTIVE

The aim of this study was to assess the validity of the Integrated Management of Childhood Illness (IMCI) algorithm to detect edematous type of malnutrition in Egyptian infants and children ranging in age from 2 months to 5 years.

MATERIALS AND METHODS

This study was carried out by surveying 23 082 children aged between 2 months and 5 years visiting the pediatric outpatient clinic, Ain Shams University Hospital, over a period of 6 months. Thirty-eight patients with edema of both feet on their primary visit were enrolled in the study. Every child was assessed using the IMCI algorithm 'assess and classify' by the same physician, together with a systematic clinical evaluation with all relevant investigations.

RESULTS

Twenty-two patients (57.9%) were proven to have nutritional etiology. 'Weight for age' sign had a sensitivity of 95.5%, a specificity of 56%, and a diagnostic accuracy of 78.95% in the identification of nutritional edema among all cases of bipedal edema. Combinations of IMCI symptoms 'pallor, visible severe wasting, fever, diarrhea', and 'weight for age' increased the sensitivity to 100%, but with a low specificity of 38% and a diagnostic accuracy of 73.68%.

CONCLUSION AND RECOMMENDATIONS

Bipedal edema and low weight for age as part of the IMCI algorithm can identify edema because of nutritional etiology with 100% sensitivity, but with 37% specificity. Revisions need to be made to the IMCI guidelines published in 2010 by the Egyptian Ministry of Health in the light of the new WHO guidelines of 2014.

Field Test of the World Health Organization Multi-Professional Patient Safety Curriculum Guide

Introduction

Although the importance of training in patient safety has been acknowledged for over a decade, it remains under-utilized and under-valued in most countries. WHO developed the Multi-professional Patient Safety Curriculum Guide to provide schools with the requirements and tools for incorporating patient safety in education. It was field tested with 12 participating schools across the six WHO regions, to assess its effectiveness for teaching patient safety to undergraduate and graduate students in a global variety of settings.

Methods

The evaluation used a combined prospective/retrospective design to generate formative information on the experiences of working with the Guide and summative information on the impacts of the Guide. Using stakeholder interviews and student surveys, data were gathered from each participating school at three times: the start of the field test (baseline), soon after each school started teaching, and soon after each school finished teaching.

Results

Stakeholders interviewed were strongly positive about the Guide, noting that it emphasized universally important patient safety topics, was culturally appropriate for their countries, and gave credibility and created a focus on patient safety at their schools. Student perceptions and attitudes regarding patient safety improved substantially during the field test, and their knowledge of the topics they were taught doubled, from 10.7% to 20.8% of correct answers on the student survey.

Discussion

This evaluation documented the effectiveness of the Curriculum Guide, for both ease of use by schools and its impacts on improving the patient safety knowledge of healthcare students. WHO should be well positioned to refine the contents of the Guide and move forward in encouraging broader use of the Guide globally for teaching patient safety.

Measuring Implementation Strength for Integrated Community Case Management in Malawi: Results from a National Cell Phone Census

Program managers, investors, and evaluators need real-time information on how program strategies are being scaled up and implemented. Integrated Community Case Management (iCCM) of childhood illnesses is a strategy for increasing access to diagnosis and treatment of malaria, pneumonia, and diarrhea through community-based health workers. We collected real-time data on iCCM implementation strength through cell phone interviews with community-based health workers in Malawi and calculated indicators of implementation strength and utilization at district level using consensus definitions from the Ministry of Health (MOH) and iCCM partners. All of the iCCM implementation strength indicators varied widely within and across districts. Results show that Malawi has made substantial progress in the scale-up of iCCM since the 2008 program launch. However, there are wide differences in iCCM implementation strength by district. Districts that performed well according to the survey measures demonstrate that MOH implementation strength targets are achievable with the right combination of supportive structures. Using the survey results, specific districts can now be targeted with additional support.

Mentoring and quality improvement strengthen integrated management of childhood illness implementation in rural Rwanda

OBJECTIVE

Integrated Management of Childhood Illness (IMCI) is the leading clinical protocol designed to decrease under-five mortality globally. However, impact is threatened by gaps in IMCI quality of care (QOC). In 2010, Partners In Health and the Rwanda Ministry of Health implemented a nurse mentorship intervention Mentoring and Enhanced Supervision at Health Centres (MESH) in two rural districts. This study measures change in QOC following the addition of MESH to didactic training.

DESIGN

Prepost intervention study of change in QOC after 12 months of MESH support measured by case observation using a standardised checklist. Study sample was children age 2 months to 5 years presenting on the days of data collection (292 baseline, 413 endpoint).

SETTING

21 rural health centres in Rwanda.

OUTCOMES

Primary outcome was a validated index of key IMCI assessments. Secondary outcomes included assessment, classification and treatment indicators, and QOC variability across providers. A mixed-effects regression model of the index was created.

RESULTS

In multivariate analyses, the index significantly improved in southern Kayonza (β-coefficient 0.17, 95% CI 0.12 to 0.22) and Kirehe (β-coefficient 0.29, 95% CI 0.23 to 0.34) districts. Children seen by IMCI-trained nurses increased from 83.2% to 100% (p<0.001) and use of IMCI case recording forms improved from 65.9% to 97.1% (p<0.001). Correct classification improved (56.0% to 91.5%, p<0.001), as did correct treatment (78.3% to 98.2%, p<0.001). Variability in QOC decreased (intracluster correlation coefficient 0.613-0.346).

CONCLUSIONS

MESH was associated with significant improvements in all domains of IMCI quality. MESH could be an innovative strategy to improve IMCI implementation in resource-limited settings working to decrease under-five mortality.

Implementation of the integrated management of childhood illness with parasitological diagnosis of malaria in rural Ghana: health worker perceptions

BACKGROUND

Timely and appropriate management of febrile illness among children under five years of age will contribute to achieving Millennium Development Goal-4. The revised World Health Organization-Global Malaria Programme's policy on test-based management of malaria must integrate effectively into the Integrated Management of Childhood Illness (IMCI). This study reports on perceptions of health workers on the health system factors influencing effective delivery of test-based diagnosis of malaria with IMCI.

METHODS

A qualitative study was conducted among a range of health workers at different levels of the health system in the Brong Ahafo Region of Ghana. Interview transcripts were transferred into Nvivo 8 software for data management and analysis. A frame-work approach at two levels was used in the analysis, which included the processes required for implementation of test-based management of malaria and the health systems context.

RESULTS

Forty-nine in-depth interviews were conducted. The National Health Insurance Scheme (NHIS) was perceived to have led to an increase in health facility attendance, thereby increasing the workload of health workers. Workload was reported as the main reason that health workers were not able to complete all of the examinations included in the IMCI algorithm. The NHIS financing guidelines were seen to be determining diagnosis and treatment practices by health-care givers. Concern was expressed about the erratic supply of malaria rapid diagnostic test kits (RDTs), the quality of RDTs related to potential false negative results when clinical symptoms were consistent with malaria. IMCI was seen as important but practically impossible to fully implement due to workload.

CONCLUSIONS

Implementation of the WHO-revised IMCI guideline is confronted with a myriad of health systems challenges. The perceptions of front-line health workers on the accuracy and need for RDTs together with the capacity of health systems to support implementation plays a crucial role. The NHIS financing guidelines of diagnostics and treatments are influencing clinical decision-making in this setting. Further study is needed to understand the impact of the NHIS on the feasibility of integrating test-based management for malaria into the IMCI guidelines.

Development and validation of weight, height and age bands to guide the prescription of fixed-dose dispersible tablet formulations

OBJECTIVES

Conversion of pediatric essential drugs from syrup to dispersible tablet formulations would require fixed dose options guided by the weight band in which a child falls or a proxy for weight, such as height or age. The purpose of this study was to determine whether weight, height, or age bands can be created that would lead to greater than 95% of children receiving a therapeutic dose of 6 commonly prescribed essential drugs, including paracetamol, iron sulfate, amoxicillin, co-trimoxazole (i.e., trimethoprim/sulfamethoxazole), ciprofloxacin, and co-artemether (i.e., artemether/lumefantrine).

METHODS

Using World Health Organization growth standards, we created 4 weight bands and then matched them to height and age 50th percentile growth curves. The resulting weight, height, and age bands were then applied to Ugandan and Bangladeshi anthropometric data sets, and the percentage of children who would have received a correct therapeutic dose based upon weight, height, or age was determined. This percentage was interpreted as acceptable if >95%, marginal if 90% to 95% and unacceptable if <90%.

RESULTS

Applying the 4 weight bands to the 6 selected drugs, greater than 95% of children would have received an acceptable therapeutic dose across the 4 weight bands for each of the 6 drugs tested. None of the drugs tested would deliver an acceptable therapeutic dose across all bands based upon height or age among Ugandan children, and only co-trimoxazole would have been delivered at acceptable therapeutic levels based upon these bands in Bangladeshi children.

CONCLUSIONS

For the 6 drugs tested, dispersible tablets prescribed on the basis of a 4-dose regimen determined by weight bands would deliver an acceptable therapeutic dose greater than 95% of the time. Substituting weight for age or height bands would result in unacceptable levels of under- or overdosing.

Long and short Integrated Management of Childhood Illness (IMCI) training courses in Afghanistan: a cross-sectional cohort comparison of post-course knowledge and performance

BACKGROUND

In 2003 the Afghan Ministry of Public Health (MoPH) adopted the Integrated Management of Childhood Illness (IMCI) for delivering child health services in primary care facilities. Key problems were subsequently identified: high cost of training, frequent health worker turnover and poor quality of IMCI implementation by those trained - specifically in the use of job aids and protocols for assessment, classification, treatment and counselling. The high financial, human resources and opportunity costs of implementing IMCI spurred the MoPH to prioritize developing a shortened IMCI course of comparable quality to the 11-Day training.

METHODS

This cross-sectional evaluation compared knowledge before and after training, and health worker performance in assessment, classification and treatment of sick children in two similar cohorts, eight months post-training.

RESULTS

The mean increase in knowledge scores of the thirty 7-Day course trainees was 29 [95% Confidence Interval (CI): 24, 34] compared to 23 (95% CI: 18, 28) in the 31 trained in the 11-Day course. During assessment visits, mean scores in the 7-Day course trainees and the 11-Day course trainees were 93% (95% CI: 91, 95) versus 94% (95% CI: 91, 96) in assessment; 95% (95% CI: 89, 100) versus 96% (95% CI: 91, 100) in classification; 95% (95% CI: 92, 100) versus 97% (95% CI: 95, 100) in treatment; and 81% (95% CI: 76, 86) versus 80% (95% CI: 75, 85) in counselling. The 7-Day course was 36% less expensive than the 11-Day course. For each course opportunity costs, measured as numbers of children who potentially received poorer care than usual during trainee absence, were 3,160 for the 11-Day course and 2,016 for the 7-Day course. This measure was chosen because trainee absence commonly resulted in higher patient volumes per remaining provider or complete closure of a health facility with one single health worker.

CONCLUSION

Given similar performance and knowledge of health workers trained in both courses, potential cost savings, the possibility of training more health workers and the relative ease with which health workers in remote settings might participate in a shorter course, it seems prudent to standardize the 7-Day course in Afghanistan where child mortality rates remain unacceptably high.

Childhood Obesity Research Demonstration project: cross-site evaluation methods

INTRODUCTION

The Childhood Obesity Research Demonstration (CORD) project links public health and primary care interventions in three projects described in detail in accompanying articles in this issue of Childhood Obesity. This article describes a comprehensive evaluation plan to determine the extent to which the CORD model is associated with changes in behavior, body weight, BMI, quality of life, and healthcare satisfaction in children 2-12 years of age.

DESIGN/METHODS

The CORD Evaluation Center (EC-CORD) will analyze the pooled data from three independent demonstration projects that each integrate public health and primary care childhood obesity interventions. An extensive set of common measures at the family, facility, and community levels were defined by consensus among the CORD projects and EC-CORD. Process evaluation will assess reach, dose delivered, and fidelity of intervention components. Impact evaluation will use a mixed linear models approach to account for heterogeneity among project-site populations and interventions. Sustainability evaluation will assess the potential for replicability, continuation of benefits beyond the funding period, institutionalization of the intervention activities, and community capacity to support ongoing program delivery. Finally, cost analyses will assess how much benefit can potentially be gained per dollar invested in programs based on the CORD model.

CONCLUSIONS

The keys to combining and analyzing data across multiple projects include the CORD model framework and common measures for the behavioral and health outcomes along with important covariates at the individual, setting, and community levels. The overall objective of the comprehensive evaluation will develop evidence-based recommendations for replicating and disseminating community-wide, integrated public health and primary care programs based on the CORD model.

Assessing the impact of integrated community case management (iCCM) programs on child mortality: Review of early results and lessons learned in sub-Saharan Africa

Aim

To accelerate progress in reducing child mortality, many countries in sub–Saharan Africa have adopted and scaled–up integrated community case management (iCCM) programs targeting the three major infectious killers of children under–five. The programs train lay community health workers to assess, classify and treat uncomplicated cases of pneumonia with antibiotics, malaria with antimalarial drugs and diarrhea with Oral Rehydration Salts (ORS) and zinc. Although management of these conditions with the respective appropriate drugs has proven efficacious in randomized trials, the effectiveness of large iCCM scale–up programs in reducing child mortality is yet to be demonstrated. This paper reviews recent experience in documenting and attributing changes in under–five mortality to the specific interventions of a variety of iCCM programs.

Methods

Eight recent studies have been identified and assessed in terms of design, mortality measurement and results. Impact of the iCCM program on mortality among children age 2–59 months was assessed through a difference in differences approach using random effect Poisson regression.

Results

Designs used by these studies include cluster randomized trials, randomized stepped–wedge and quasi–experimental trials. Child mortality is measured through demographic surveillance or household survey with full birth history conducted at the end of program implementation. Six of the eight studies showed a higher decline in mortality among children 2–59 months in program areas compared to comparison areas, although this acceleration was statistically significant in only one study with a decline of 76% larger in intervention than in comparison areas.

Conclusion

Studies that evaluate large scale iCCM programs and include assessment of mortality impact must ensure an appropriate design. This includes required sample sizes and sufficient number of program and comparison districts that allow adequate inference and attribution of impact. In addition, large–scale program utilization, and a significant increase in coverage of care seeking and treatment of targeted childhood illnesses are preconditions to measurable mortality impact. Those issues need to be addressed before large investments in assessing changes in child mortality is undertaken, or the results of mortality impact evaluation will most likely be inconclusive.

Every Newborn: health-systems bottlenecks and strategies to accelerate scale-up in countries

Universal coverage of essential interventions would reduce neonatal deaths by an estimated 71%, benefit women and children after the first month, and reduce stillbirths. However, the packages with the greatest effect (care around birth, care of small and ill newborn babies), have low and inequitable coverage and are the most sensitive markers of health system function. In eight of the 13 countries with the most neonatal deaths (55% worldwide), we undertook a systematic assessment of bottlenecks to essential maternal and newborn health care, involving more than 600 experts. Of 2465 bottlenecks identified, common constraints were found in all high-burden countries, notably regarding the health workforce, financing, and service delivery. However, bottlenecks for specific interventions might differ across similar health systems. For example, the implementation of kangaroo mother care was noted as challenging in the four Asian country workshops, but was regarded as a feasible aspect of preterm care by respondents in the four African countries. If all high-burden countries achieved the neonatal mortality rates of their region's fastest progressing countries, then the mortality goal of ten or fewer per 1000 livebirths by 2035 recommended in this Series and the Every Newborn Action Plan would be exceeded. We therefore examined fast progressing countries to identify strategies to reduce neonatal mortality. We identified several key factors: (1) workforce planning to increase numbers and upgrade specific skills for care at birth and of small and ill newborn babies, task sharing, incentives for rural health workers; (2) financial protection measures, such as expansion of health insurance, conditional cash transfers, and performance-based financing; and (3) dynamic leadership including innovation and community empowerment. Adapting from the 2005 Lancet Series on neonatal survival and drawing on this Every Newborn Series, we propose a country-led, data-driven process to sharpen national health plans, seize opportunities to address the quality gap for care at birth and care of small and ill newborn babies, and systematically scale up care to reach every mother and newborn baby, particularly the poorest.

Management of febrile children under five years in hospitals and health centres of rural Ghana

BACKGROUND

The case management of febrile children in hospitals' and health centres' pre-roll out of the new WHO policy on parasitological diagnosis was assessed. The delivery of artemisinin combination therapy (ACT) at these two levels of the health system was compared.

METHODS

Structured observations and exit interviews of 1,222 febrile children attending five hospitals and 861 attending ten health centres were conducted in six districts of the Brong Ahafo Region of Ghana. Effectiveness of delivery of case management of malaria was assessed. Proportions of children receiving ACT, anti-malarial monotherapy and antibiotics were described. Predictors of: a febrile child being given an ACT, a febrile child being given an antibiotic and of carers knowing how to correctly administer the ACT were assessed using logistic regression models stratified by hospitals and health centres.

RESULTS

The system's effectiveness of delivering an ACT to febrile children diagnosed with malaria (parasitologically or clinically) was 31.4 and 42.4% in hospitals and health centres, respectively. The most ineffective process was that of ensuring that carers knew how to correctly administer the ACT. Overall 278 children who were not given an ACT were treated with anti-malarial monotherapy other than quinine. The majority of these children, 232/278 were given amodiaquine, 139 of these were children attending hospitals and 93 attending health centres. The cadre of health staff conducting consultation was a common predictor of the outcomes of interest. Presenting symptoms and examinations conducted were predictive of being given an ACT in hospitals and antibiotic in hospitals and health centres but not of being given an ACT in health centres. Treatment-seeking factors were predictive of being given an ACT if it was more than seven days since the fever began and an antibiotic in hospitals but not in health centres.

CONCLUSION

Interventions to improve adherence to negative parasitological tests are needed, together with guidance on dispensing of antibiotics, but improving the education of carers on how to administer ACT will lead to the greatest immediate increase in the effectiveness of case management. Guidance is needed on implementation of the new test-based treatment for malaria policy in health facilities.

Clinical mentorship to improve pediatric quality of care at the health centers in rural Rwanda: a qualitative study of perceptions and acceptability of health care workers

BACKGROUND

Despite evidence supporting Integrated Management of Childhood Illness (IMCI) as a strategy to improve pediatric care in countries with high child mortality, its implementation faces challenges related to lack of or poor post-didactic training supervision and gaps in necessary supporting systems. These constraints lead to health care workers' inability to consistently translate IMCI knowledge and skills into practice. A program providing mentoring and enhanced supervision at health centers (MESH), focusing on clinical and systems improvement was implemented in rural Rwanda as a strategy to address these issues, with the ultimate goal of improving the quality of pediatric care at rural health centers. We explored perceptions of MESH from the perspective of IMCI clinical mentors, mentees, and district clinical leadership.

METHODS

We conducted focus group discussions with 40 health care workers from 21 MESH-supported health centers. Two FGDs in each district were carried out, including one for nurses and one for director of health centers. District medical directors and clinical mentors had individual in-depth interviews. We performed a hermeneutic analysis using Atlas.ti v5.2.

RESULTS

Study participants highlighted program components in five key areas that contributed to acceptability and impact, including: 1) Interactive, collaborative capacity-building, 2) active listening and relationships, 3) supporting not policing, 4) systems improvement, and 5) real-time feedback. Staff turn-over, stock-outs, and other facility/systems gaps were identified as barriers to MESH and IMCI implementation.

CONCLUSION

Health care workers reported high acceptance and positive perceptions of the MESH model as an effective strategy to build their capacity, bridge the gap between knowledge and practice in pediatric care, and address facility and systems issues. This approach also improved relationships between the district supervisory team and health center-based care providers. Despite some challenges, many perceived a strong benefit on clinical performance and outcomes. This study can inform program implementers and policy makers of key components needed for developing similar health facility-based mentorship interventions and potential barriers and resistance which can be proactively addressed to ensure success.

A systematic review of barriers to and facilitators of the use of evidence by policymakers

Background

The gap between research and practice or policy is often described as a problem. To identify new barriers of and facilitators to the use of evidence by policymakers, and assess the state of research in this area, we updated a systematic review.

Methods

Systematic review. We searched online databases including Medline, Embase, SocSci Abstracts, CDS, DARE, Psychlit, Cochrane Library, NHSEED, HTA, PAIS, IBSS (Search dates: July 2000 - September 2012). Studies were included if they were primary research or systematic reviews about factors affecting the use of evidence in policy. Studies were coded to extract data on methods, topic, focus, results and population.

Results

145 new studies were identified, of which over half were published after 2010. Thirteen systematic reviews were included. Compared with the original review, a much wider range of policy topics was found. Although still primarily in the health field, studies were also drawn from criminal justice, traffic policy, drug policy, and partnership working. The most frequently reported barriers to evidence uptake were poor access to good quality relevant research, and lack of timely research output. The most frequently reported facilitators were collaboration between researchers and policymakers, and improved relationships and skills. There is an increasing amount of research into new models of knowledge transfer, and evaluations of interventions such as knowledge brokerage.

Conclusions

Timely access to good quality and relevant research evidence, collaborations with policymakers and relationship- and skills-building with policymakers are reported to be the most important factors in influencing the use of evidence. Although investigations into the use of evidence have spread beyond the health field and into more countries, the main barriers and facilitators remained the same as in the earlier review. Few studies provide clear definitions of policy, evidence or policymaker. Nor are empirical data about policy processes or implementation of policy widely available. It is therefore difficult to describe the role of evidence and other factors influencing policy. Future research and policy priorities should aim to illuminate these concepts and processes, target the factors identified in this review, and consider new methods of overcoming the barriers described.