Building Learning Health Systems to Accelerate Research and Improve Outcomes of Clinical Care in Low- and Middle-Income Countries

Ethiopian primary healthcare clinical guidelines 5 years on-processes and lessons learnt from scaling up a primary healthcare initiative

Many effective health system innovations fail to reach those who need them most, falling short of the goal of universal health coverage. In the 5 years since the Federal Ministry of Health in Ethiopia localised the Practical Approach to Care Kit (PACK) programme to support primary care reforms, PACK has been scaled-up to over 90% of the country's primary care health centres. Known as the Ethiopian Primary Healthcare Clinical Guideline (EPHCG), the programme comprises a comprehensive, policy-aligned clinical decision support tool (EPHCG guide) and an implementation strategy to embed comprehensive, integrated care into every primary care consultation for individuals over 5 years of age, while addressing barriers to streamlined primary healthcare delivery. We describe the components of the EPHCG programme and the work done to establish it in Ethiopia. Yamey's framework for successful scale-up is used to examine the programme and health system factors that enabled its scale-up within a 5-year period. These included high-level ministry leadership and support, a cascade model of implementation embedded in all levels of the health system, regular EPHCG guide and training material updates and strategies to generate stakeholder buy-in from managers, health workers, patients and communities. Challenges, including stakeholder resistance, training fidelity and quality and procurement of medicines and diagnostic tests, are described, along with efforts to resolve them. Insights and learnings will be of interest to those implementing PACK programmes elsewhere, and managers and researchers responsible for design and delivery of health systems strengthening innovations at scale in low-income and middle-income countries.

Characteristics of children readmitted with severe pneumonia in Kenyan hospitals

BACKGROUND

Pneumonia is a leading cause of childhood morbidity and mortality. Hospital re-admission may signify missed opportunities for care or undiagnosed comorbidities.

METHODS

We conducted a retrospective cohort study including children aged ≥ 2 months-14 years hospitalised with severe pneumonia between 2013 and 2021 in a network of 20 primary referral hospitals in Kenya. Severe pneumonia was defined using the 2013 World Health Organization criteria, and re-admission was based on clinical documentation from individual patient case notes. We estimated the prevalence of re-admission, described clinical management practices, and modelled risk factors for re-admission and inpatient mortality.

RESULTS

Among 20,603 children diagnosed with severe pneumonia, 2,274 (11.0%, 95% CI 10.6-11.5) were readmitted. Re-admission was independently associated with age (12-59 months vs. 2-11 months: adjusted odds ratio (aOR) 1.70, 1.54-1.87; >5 years vs. 2-11 months: aOR 1.85, 1.55-2.22), malnutrition (weight-for-age-z-score (WAZ) <-3SD vs. WAZ> -2SD: aOR 2.05, 1.84-2.29); WAZ - 2 to -3 SD vs. WAZ> -2SD: aOR 1.37, 1.20-1.57), wheeze (aOR 1.17, 1.03-1.33) and presence of a concurrent neurological disorder (aOR 4.42, 1.70-11.48). Chest radiography was ordered more frequently among those readmitted (540/2,274 [23.7%] vs. 3,102/18,329 [16.9%], p < 0.001). Readmitted patients more frequently received second-line antibiotics (808/2,256 [35.8%] vs. 5,538/18,173 [30.5%], p < 0.001), TB medication (69/2,256 [3.1%] vs. 298/18,173 [1.6%], p < 0.001), salbutamol (530/2,256 [23.5%] vs. 3,707/18,173 [20.4%], p = 0.003), and prednisolone (157/2,256 [7.0%] vs. 764/18,173 [4.2%], p < 0.001). Inpatient mortality was 2,354/18,329 (12.8%) among children admitted with a first episode of severe pneumonia and 269/2,274 (11.8%) among those who were readmitted (adjusted hazard ratio (aHR) 0.93, 95% CI 0.82-1.07). Age (12-59 months vs. 2-11 months: aHR 0.62, 0.57-0.67), male sex (aHR 0.81, 0.75-0.88), malnutrition (WAZ <-3SD vs. WAZ >-2SD: aHR 1.87, 1.71-2.05); WAZ - 2 to -3 SD vs. WAZ >-2SD: aHR 1.46, 1.31-1.63), complete vaccination (aHR 0.74, 0.60-0.91), wheeze (aHR 0.87, 0.78-0.98) and anaemia (aHR 2.14, 1.89-2.43) were independently associated with mortality.

CONCLUSIONS

Children readmitted with severe pneumonia account for a substantial proportion of pneumonia hospitalisations and deaths. Further research is required to develop evidence-based approaches to screening, case management, and follow-up of children with severe pneumonia, prioritising those with underlying risk factors for readmission and mortality.

Clinical decision support tools for paediatric sepsis in resource-poor settings: an international qualitative study

OBJECTIVE

New paediatric sepsis criteria are being developed by an international task force. However, it remains unknown what type of clinical decision support (CDS) tools will be most useful for dissemination of those criteria in resource-poor settings. We sought to design effective CDS tools by identifying the paediatric sepsis-related decisional needs of multidisciplinary clinicians and health system administrators in resource-poor settings.

DESIGN

Semistructured qualitative focus groups and interviews with 35 clinicians (8 nurses, 27 physicians) and 5 administrators at health systems that regularly provide care for children with sepsis, April-May 2022.

SETTING

Health systems in Africa, Asia and Latin America, where sepsis has a large impact on child health and healthcare resources may be limited.

PARTICIPANTS

Participants had a mean age of 45 years, a mean of 15 years of experience, and were 45% female.

RESULTS

Emergent themes were related to the decisional needs of clinicians caring for children with sepsis and to the needs of health system administrators as they make decisions about which CDS tools to implement. Themes included variation across regions and institutions in infectious aetiologies of sepsis and available clinical resources, the need for CDS tools to be flexible and customisable in order for implementation to be successful, and proposed features and format of an ideal paediatric sepsis CDS tool.

CONCLUSION

Findings from this study will directly contribute to the design and implementation of CDS tools to increase the uptake and impact of the new paediatric sepsis criteria in resource-poor settings.

Health System Considerations for Community-Based Implementation of Automated Respiratory Counters to Identify Childhood Pneumonia in 5 Regions of Ethiopia: A Qualitative Study

BACKGROUND

In Ethiopia, childhood pneumonia is diagnosed in primary healthcare settings by measuring respiratory rate (RR) along with the presence of cough, chest indrawing, difficulty breathing, and fast breathing. Our aim was to identify health system-level lessons from implementing two automated RR counters, Children's Automated Respiration Monitor (ChARM) by Phillips® and Rad-G by Masimo®, to provide considerations for integrating such devices into child health programmes and health systems. This study was part of an initiative called the Acute Respiratory Infection Diagnostic Aids (ARIDA).

METHODS

Key informant interviews (KIIs) were conducted with 57 participants (health workers in communities and facilities, trainers of health workers, district management, and key decision-makers) in five regions of Ethiopia. Data were analyzed in ATLAS.ti using thematic content analysis and themes were categorized using the Tanahashi bottleneck analysis.

RESULTS

All participants recommended scaling up the ARIDA initiative nationally as part of Integrated Management of Newborn and Childhood Illness (IMNCI) in primary healthcare. Health workers perceived the devices as: time saving, acceptable by parents and children, and facilitating diagnosis and referrals. Health workers perceived an increased demand for services and reduced numbers of sick children not seeking care. Participants recommended increasing the number of devices distributed and health workers trained. Strengthening drug supply chains, improving oxygen gas availability, and strengthening referral networks would maximize perceived benefits. While training improved knowledge, more supportive supervision, integration with current guidelines and more guidance related to community engagement was recommended.

CONCLUSION

Automatic RR counters for the decentralized diagnosis of childhood pneumonia could have positive impact on improving the quality of diagnosis and management of pneumonia in children. However, the study has shown that a health system approach is required to ensure all steps along the pneumonia pathway are adequate, including drug and oxygen supply, community engagement, health worker training and support, and referral pathways.

Awareness and knowledge of female genital schistosomiasis in a population with high endemicity: a cross-sectional study in Madagascar

Introduction

Female genital schistosomiasis (FGS) is a neglected disease with long-term physical and psychosocial consequences, affecting approximately 50 million women worldwide and generally representing an unmet medical need on a global scale. FGS is the chronic manifestation of a persistent infection with Schistosoma haematobium. FGS services are not routinely offered in endemic settings with a small percentage of women at risk receiving adequate care. Madagascar has over 60% prevalence of FGS and no guidelines for the management of the disease. This study aimed to determine FGS knowledge among women and health care workers (HCWs) in a highly endemic area of Madagascar.

Methods

A convenience sampling strategy was used for this cross-sectional study. Descriptive statistics including proportions and 95% confidence intervals (CI) were calculated, reporting socio-demographic characteristics of the population. Knowledge sources were evaluated descriptively. Binary Poisson regression with robust standard errors was performed; crude (CPR) and adjusted prevalence ratio (APR) with 95% CIs were calculated.

Results

A total of 783 participants were included in the study. Among women, 11.3% (n = 78) were aware of FGS while among the HCWs 53.8% (n = 50) were aware of FGS. The highest level of knowledge was observed among women in an urban setting [24%, (n = 31)] and among those with a university education/vocational training [23% (n = 13)]. A lower APR of FGS knowledge was observed in peri-urban [APR 0.25 (95% CI: 0.15; 0.45)] and rural [APR 0.37 (95% CI 0.22; 0.63)] settings in comparison to the urban setting. Most HCWs reported other HCWs [40% (n = 20)] while women mainly reported their family [32% (n = 25)] as being their main source of information in the 6 months prior to the survey.

Discussion and conclusions

Our study shows limited awareness and knowledge of FGS among population groups in the highly endemic Boeny region of Madagascar. With this study we contribute to identifying an important health gap in Madagascar, which relates to a disease that can silently affect millions of women worldwide. In alignment with the targets of the NTD roadmap, addressing schistosomiasis requires a paradigm shift for its control and management including a greater focus on chronic forms of the disease.

Determinants of Implementation of a Critical Care Registry in Asia: Lessons From a Qualitative Study

BACKGROUND

The Collaboration for Research, Implementation, and Training in Critical Care in Asia (CCA) is implementing a critical care registry to capture real-time data to facilitate service evaluation, quality improvement, and clinical studies.

OBJECTIVE

The purpose of this study is to examine stakeholder perspectives on the determinants of implementation of the registry by examining the processes of diffusion, dissemination, and sustainability.

METHODS

This study is a qualitative phenomenological inquiry using semistructured interviews with stakeholders involved in registry design, implementation, and use in 4 South Asian countries. The conceptual model of diffusion, dissemination, and sustainability of innovations in health service delivery guided interviews and analysis. Interviews were coded using the Rapid Identification of Themes from Audio recordings procedure and were analyzed based on the constant comparison approach.

RESULTS

A total of 32 stakeholders were interviewed. Analysis of stakeholder accounts identified 3 key themes: innovation-system fit; influence of champions; and access to resources and expertise. Determinants of implementation included data sharing, research experience, system resilience, communication and networks, and relative advantage and adaptability.

CONCLUSIONS

The implementation of the registry has been possible due to efforts to increase the innovation-system fit, influence of motivated champions, and the support offered by access to resources and expertise. The reliance on individuals and the priorities of other health care actors pose a risk to sustainability.

Development and implementation experience of a learning healthcare system for facility based newborn care in low resource settings: The Neotree

Introduction

Improving peri- and postnatal facility-based care in low-resource settings (LRS) could save over 6000 babies' lives per day. Most of the annual 2.4 million neonatal deaths and 2 million stillbirths occur in healthcare facilities in LRS and are preventable through the implementation of cost-effective, simple, evidence-based interventions. However, their implementation is challenging in healthcare systems where one in four babies admitted to neonatal units die. In high-resource settings healthcare systems strengthening is increasingly delivered via learning healthcare systems to optimise care quality, but this approach is rare in LRS.

Methods

Since 2014 we have worked in Bangladesh, Malawi, Zimbabwe, and the UK to co-develop and pilot the Neotree system: an android application with accompanying data visualisation, linkage, and export. Its low-cost hardware and state-of-the-art software are used to support healthcare professionals to improve postnatal care at the bedside and to provide insights into population health trends. Here we summarise the formative conceptualisation, development, and preliminary implementation experience of the Neotree.

Results

Data thus far from ~18 000 babies, 400 healthcare professionals in four hospitals (two in Zimbabwe, two in Malawi) show high acceptability, feasibility, usability, and improvements in healthcare professionals' ability to deliver newborn care. The data also highlight gaps in knowledge in newborn care and quality improvement. Implementation has been resilient and informative during external crises, for example, coronavirus disease 2019 (COVID-19) pandemic. We have demonstrated evidence of improvements in clinical care and use of data for Quality Improvement (QI) projects.

Conclusion

Human-centred digital development of a QI system for newborn care has demonstrated the potential of a sustainable learning healthcare system to improve newborn care and outcomes in LRS. Pilot implementation evaluation is ongoing in three of the four aforementioned hospitals (two in Zimbabwe and one in Malawi) and a larger scale clinical cost effectiveness trial is planned.

HeAlth System StrEngThening in four sub-Saharan African countries (ASSET) to achieve high-quality, evidence-informed surgical, maternal and newborn, and primary care: protocol for pre-implementation phase studies

To achieve universal health coverage, health system strengthening (HSS) is required to support the of delivery of high-quality care. The aim of the National Institute for Health Research Global Research Unit on HeAlth System StrEngThening in Sub-Saharan Africa (ASSET) is to address this need in a four-year programme, with three healthcare platforms involving eight work-packages. Key to effective health system strengthening (HSS) is the pre-implementation phase of research where efforts focus on applying participatory methods to embed the research programme within the existing health system. To conceptualise the approach, we provide an overview of the key methods applied across work-package to address this important phase of research conducted between 2017 and 2021.Work-packages are being undertaken in publicly funded health systems in rural and urban areas in Ethiopia, Sierra Leone, South Africa, and Zimbabwe. Stakeholders including patients and their caregivers, community representatives, clinicians, managers, administrators, and policymakers are the main research participants.In each work-package, initial activities engage stakeholders and build relationships to ensure co-production and ownership of HSSIs. A mixed-methods approach is then applied to understand and address determinants of high-quality care delivery. Methods such as situation analysis, cross-sectional surveys, interviews and focus group discussions are adopted to each work-package aim and context. At the end of the pre-implementation phase, findings are disseminated using focus group discussions and participatory Theory of Change workshops where stakeholders from each work package use findings to select HSSIs and develop a programme theory.ASSET places a strong emphasis of the pre-implementation phase in order to provide an in-depth and systematic diagnosis of the existing heath system functioning, needs for strengthening and stakeholder engagement. This common approach will inform the design and evaluation of the HSSIs to increase effectiveness across work packages and contexts, to better understand what works, for whom, and how.

Factors to be Considered in Advancing Pediatric Critical Care Across the World

This article reviews the many factors that have to be taken into account as we consider the advancement of pediatric critical care (PCC) in multiple settings across the world. The extent of PCC and the range of patients who are cared for in this environment are considered. Along with a review of the ongoing treatment and technology advances in the PCC setting, the structures and systems required to support these services are also considered. Finally the question of how PCC can be made sustainable in a volatile world with the impacts of global crises such as climate change is addressed.

Identifying requisite learning health system competencies: a scoping review

OBJECTIVES

Learning health systems (LHS) integrate knowledge and practice through cycles of continuous quality improvement and learning to increase healthcare quality. LHS have been conceptualised through multiple frameworks and models. Our aim is to identify and describe the requisite individual competencies (knowledge, skills and attitudes) and system competencies (capacities, characteristics and capabilities) described in existing literature in relation to operationalising LHS.

METHODS

A scoping review was conducted with descriptive and thematic analysis to identify and map competencies of LHS for individuals/patients, health system workers and systems. Articles until April 2020 were included based on a systematic literature search and selection process. Themes were developed using a consensus process until agreement was reached among team members.

RESULTS

Eighty-nine articles were included with most studies conducted in the USA (68 articles). The largest number of publications represented competencies at the system level, followed by health system worker competencies. Themes identified at the individual/patient level were knowledge and skills to understand and share information with an established system and the ability to interact with the technology used to collect data. Themes at the health system worker level were skills in evidence-based practice, leadership and teamwork skills, analytical and technological skills required to use a 'digital ecosystem', data-science knowledge and skill and self-reflective capacity. Researchers embedded within LHS require a specific set of competencies. Themes identified at the system level were data, infrastructure and standardisation; integration of data and workflow; and culture and climate supporting ongoing learning.

CONCLUSION

The identified individual stakeholder competencies within LHS and the system capabilities of LHS provide a solid base for the further development and evaluation of LHS. International collaboration for stimulating LHS will assist in further establishing the knowledge base for LHS.

Promises and pitfalls in implementation science from the perspective of US-based researchers: learning from a pre-mortem

BACKGROUND

Implementation science is at a sufficiently advanced stage that it is appropriate for the field to reflect on progress thus far in achieving its vision, with a goal of charting a path forward. In this debate, we offer such reflections and report on potential threats that might stymie progress, as well as opportunities to enhance the success and impact of the field, from the perspective of a group of US-based researchers.

MAIN BODY

Ten mid-career extramurally funded US-based researchers completed a "pre-mortem" or a group brainstorming exercise that leverages prospective hindsight to imagine that an event has already occurred and to generate an explanation for it - to reduce the likelihood of a poor outcome. We came to consensus on six key themes related to threats and opportunities for the field: (1) insufficient impact, (2) too much emphasis on being a "legitimate science," (3) re-creation of the evidence-to-practice gap, (4) difficulty balancing accessibility and field coherence, (5) inability to align timelines and priorities with partners, and (6) overly complex implementation strategies and approaches.

CONCLUSION

We submit this debate piece to generate further discussion with other implementation partners as our field continues to develop and evolve. We hope the key opportunities identified will enhance the future of implementation research in the USA and spark discussion across international groups. We will continue to learn with humility about how best to implement with the goal of achieving equitable population health impact at scale.

What are the barriers to the diagnosis and management of chronic respiratory disease in sub-Saharan Africa? A qualitative study with healthcare workers, national and regional policy stakeholders in five countries

OBJECTIVES

Chronic respiratory diseases (CRD) are among the top four non-communicable diseases globally. They are associated with poor health and approximately 4 million deaths every year. The rising burden of CRD in low/middle-income countries will strain already weak health systems. This study aimed to explore the perspectives of healthcare workers and other health policy stakeholders on the barriers to effective diagnosis and management of CRD in Kenya, Malawi, Sudan, Tanzania and Uganda.

STUDY DESIGN

Qualitative descriptive study.

SETTINGS

Primary, secondary and tertiary health facilities, government agencies and civil society organisations in five sub-Saharan African countries.

PARTICIPANTS

We purposively selected 60 national and district-level policy stakeholders, and 49 healthcare workers, based on their roles in policy decision-making or health provision, and conducted key informant interviews and in-depth interviews, respectively, between 2018 and 2019. Data were analysed through framework approach.

RESULTS

We identified intersecting vicious cycles of neglect of CRD at strategic policy and healthcare facility levels. Lack of reliable data on burden of disease, due to weak information systems and diagnostic capacity, negatively affected inclusion in policy; this, in turn, was reflected by low budgetary allocations for diagnostic equipment, training and medicines. At the healthcare facility level, inadequate budgetary allocations constrained diagnostic capacity, quality of service delivery and collection of appropriate data, compounding the lack of routine data on burden of disease.

CONCLUSION

Health systems in the five countries are ill-equipped to respond to CRD, an issue that has been brought into sharp focus as countries plan for post-COVID-19 lung diseases. CRD are underdiagnosed, under-reported and underfunded, leading to a vicious cycle of invisibility and neglect. Appropriate diagnosis and management require health systems strengthening, particularly at the primary healthcare level.

Recognising the deterioration of patients in acute care wards: a qualitative study

Background: Infrastructure, equipment and staff constraints are often cited as barriers to the recognition and rescue of deteriorating patients in resource-limited settings. The impact of health-system organisation, decision-making and organisational culture on recognition of deterioration is however poorly understood. This study explores how health care providers recognise deterioration of patients in acute care in Sri Lanka. Methods: In-depth interviews exploring decision making and care processes related to recognition of deterioration, were conducted with a purposive sample of 23 health care workers recruited from ten wards at a district hospital in Sri Lanka. Interviews were audio-recorded, transcribed and coded thematically, line-by-line, using a general inductive approach. Results: A legacy of initial assessment on admission and inimical organisational culture undermined recognition of deteriorating patients in hospital. Informal triaging at the time of ward admission resulted in patients presenting with red-flag diagnoses and vital sign derangement requiring resuscitation being categorised as "bad". The legacy of this categorisation was a series of decision-making biases anchored in the initial assessment, which remained with the patient throughout their stay. Management for patients categorised as "bad" was prioritised by healthcare workers coupled with a sense of fatalism regarding adverse outcomes. Health care workers were reluctant to deviate from the original plan of care despite changes in patient condition (continuation bias). Organisational culture - vertical hierarchy, siloed working and a reluctance to accept responsibility- resulted in omissions which undermined recognition of deterioration. Fear of blame was a barrier to learning from adverse events. Conclusions: The legacy of admission assessment and hospital organisational culture undermined recognition of deterioration. Opportunities for improving recognition of deterioration in this setting may include establishing formal triage and medical emergency teams to facilitate timely recognition and escalation.

Recognising the deterioration of patients in acute care wards: a qualitative study

Background: Infrastructure, equipment and staff constraints are often cited as barriers to the recognition and rescue of deteriorating patients in resource-limited settings. The impact of health-system organisation, decision-making and organisational culture on recognition of deterioration is however poorly understood. This study explores how health care providers recognise deterioration of patients in acute care in Sri Lanka. Methods: In-depth interviews exploring decision making and care processes related to recognition of deterioration, were conducted with a purposive sample of 23 health care workers recruited from ten wards at a district hospital in Sri Lanka. Interviews were audio-recorded, transcribed and coded thematically, line-by-line, using a general inductive approach. Results: A legacy of initial assessment on admission and inimical organisational culture undermined recognition of deteriorating patients in hospital. Informal triaging at the time of ward admission resulted in patients presenting with red-flag diagnoses and vital sign derangement requiring resuscitation being categorised as "bad". The legacy of this categorisation was a series of decision-making biases anchored in the initial assessment, which remained with the patient throughout their stay. Management for patients categorised as “bad” was prioritised by healthcare workers coupled with a sense of fatalism regarding adverse outcomes. Health care workers were reluctant to deviate from the original plan of care despite changes in patient condition (continuation bias). Organisational culture - vertical hierarchy, siloed working and a reluctance to accept responsibility- resulted in omissions which undermined recognition of deterioration. Fear of blame was a barrier to learning from adverse events. Conclusions: The legacy of admission assessment and hospital organisational culture undermined recognition of deterioration. Opportunities for improving recognition of deterioration in this setting may include establishing formal triage and medical emergency teams to facilitate timely recognition and escalation.

Improving in-patient neonatal data quality as a pre-requisite for monitoring and improving quality of care at scale: A multisite retrospective cohort study in Kenya

The objectives of this study were to (1)explore the quality of clinical data generated from hospitals providing in-patient neonatal care participating in a clinical information network (CIN) and whether data improved over time, and if data are adequate, (2)characterise accuracy of prescribing for basic treatments provided to neonatal in-patients over time. This was a retrospective cohort study involving neonates ≤28 days admitted between January 2018 and December 2021 in 20 government hospitals with an interquartile range of annual neonatal inpatient admissions between 550 and 1640 in Kenya. These hospitals participated in routine audit and feedback processes on quality of documentation and care over the study period. The study's outcomes were the number of patients as a proportion of all eligible patients over time with (1)complete domain-specific documentation scores, and (2)accurate domain-specific treatment prescription scores at admission, reported as incidence rate ratios. 80,060 neonatal admissions were eligible for inclusion. Upon joining CIN, documentation scores in the monitoring, other physical examination and bedside testing, discharge information, and maternal history domains demonstrated a statistically significant month-to-month relative improvement in number of patients with complete documentation of 7.6%, 2.9%, 2.4%, and 2.0% respectively. There was also statistically significant month-to-month improvement in prescribing accuracy after joining the CIN of 2.8% and 1.4% for feeds and fluids but not for Antibiotic prescriptions. Findings suggest that much of the variation observed is due to hospital-level factors. It is possible to introduce tools that capture important clinical data at least 80% of the time in routine African hospital settings but analyses of such data will need to account for missingness using appropriate statistical techniques. These data allow exploration of trends in performance and could support better impact evaluation, exploration of links between health system inputs and outcomes and scrutiny of variation in quality and outcomes of hospital care.

Interventions to reduce preterm birth and stillbirth, and improve outcomes for babies born preterm in low- and middle-income countries: A systematic review

BACKGROUND

Reducing preterm birth and stillbirth and improving outcomes for babies born too soon is essential to reduce under-5 mortality globally. In the context of a rapidly evolving evidence base and problems with extrapolating efficacy data from high- to low-income settings, an assessment of the evidence for maternal and newborn interventions specific to low- and middle-income countries (LMICs) is required.

METHODS

A systematic review of the literature was done. We included all studies performed in LMICs since the Every Newborn Action Plan, between 2013 - 2018, which reported on interventions where the outcome assessed was reduction in preterm birth or stillbirth incidence and/or a reduction in preterm infant neonatal mortality. Evidence was categorised according to maternal or neonatal intervention groups and a narrative synthesis conducted.

RESULTS

179 studies (147 primary evidence studies and 32 systematic reviews) were identified in 82 LMICs. 81 studies reported on maternal interventions and 98 reported on neonatal interventions. Interventions in pregnant mothers which resulted in significant reductions in preterm birth and stillbirth were (i) multiple micronutrient supplementation and (ii) enhanced quality of antenatal care. Routine antenatal ultrasound in LMICs increased identification of fetal antenatal conditions but did not reduce stillbirth or preterm birth due to the absence of services to manage these diagnoses. Interventions in pre-term neonates which improved their survival included (i) feeding support including probiotics and (ii) thermal regulation. Improved provision of neonatal resuscitation did not improve pre-term mortality rates, highlighting the importance of post-resuscitation care. Community mobilisation, for example through community education packages, was found to be an effective way of delivering interventions.

CONCLUSIONS

Evidence supports the implementation of several low-cost interventions with the potential to deliver reductions in preterm birth and stillbirth and improve outcomes for preterm babies in LMICs. These, however, must be complemented by overall health systems strengthening to be effective. Quality improvement methodology and learning health systems approaches can provide important means of understanding and tackling implementation challenges within local contexts. Further pragmatic efficacy trials of interventions in LMICs are essential, particularly for interventions not previously tested in these contexts.

Participatory codesign of patient involvement in a Learning Health System: How can data-driven care be patient-driven care?

BACKGROUND

A Learning Health System (LHS) is a model of how routinely collected health data can be used to improve care, creating 'virtuous cycles' between data and improvement. This requires the active involvement of health service stakeholders, including patients themselves. However, to date, research has explored the acceptability of being 'data donors' rather than considering patients as active contributors. The study aimed to understand how patients should be actively involved in an LHS.

DESIGN

Ten participatory codesign workshops were conducted with eight experienced public contributors using visual, collective and iterative methods. This led contributors to challenge and revise not only the idea of an LHS but also revise the study aims and outputs.

RESULTS

The contributors proposed three exemplar roles for patients in patient-driven LHS, which aligned with the idea of three forms of transparency: informational, participatory and accountability. 'Epistemic injustice' was considered a useful concept to express the risks of an LHS that did not provide active roles to patients (testimonial injustice) and that neglected their experience through collecting data that did not reflect the complexity of their lives (hermeneutic injustice).

DISCUSSION

Patient involvement in an LHS should be 'with and by' patients, not 'about or for'. This requires systems to actively work with and respond to patient feedback, as demonstrated within the study itself by the adaptive approach to responding to contributor questions, to work in partnership with patients to create a 'virtuous alliance' to achieve change.

PATIENT OR PUBLIC CONTRIBUTION

Public contributors were active partners throughout, and co-authored the paper.

Decentralized facility financing versus performance-based payments in primary health care: a large-scale randomized controlled trial in Nigeria

BACKGROUND

Health system financing presents a challenge in many developing countries. We assessed two reform packages, performance-based financing (PBF) and direct facility financing (DFF), against each other and business-as-usual for maternal and child healthcare (MCH) provision in Nigeria.

METHODS

We sampled 571 facilities (269 in PBF; 302 in DFF) in 52 districts randomly assigned to PBF or DFF, and 215 facilities in 25 observable-matched control districts. PBF facilities received $2 ($1 for operating grants plus $1 for bonuses) for every $1 received by DFF facilities (operating grants alone). Both received autonomy, supervision, and enhanced community engagement, isolating the impact of additional performance-linked facility and health worker payments. Facilities and households with recent pregnancies in facility catchments were surveyed at baseline (2014) and endline (2017). Outcomes were Penta3 immunization, institutional deliveries, modern contraceptive prevalence rate (mCPR), four-plus antenatal care (ANC) visits, insecticide-treated mosquito net (ITN) use by under-fives, and directly observed quality of care (QOC). We estimated difference-in-differences with state fixed effects and clustered standard errors.

RESULTS

PBF increased institutional deliveries by 10% points over DFF and 7% over business-as-usual (p<0.01). PBF and DFF were more effective than business-as-usual for Penta3 (p<0.05 and p<0.01, respectively); PBF also for mCPR (p<0.05). Twenty-one of 26 QOC indicators improved in both PBF and DFF relative to business-as-usual (p<0.05). However, except for deliveries, PBF was as or less effective than DFF: Penta3 immunization and ITN use were each 6% less than DFF (p<0.1 for both) and QOC gains were also comparable. Utilization gains come from the middle of the rural wealth distribution (p<0.05).

CONCLUSIONS

Our findings show that both PBF and DFF represent significant improvements over business-as-usual for service provision and quality of care. However, except for institutional delivery, PBF and DFF do not differ from each other despite PBF disbursing $2 for every dollar disbursed by DFF. These findings highlight the importance of direct facility financing and decentralization in improving PHC and suggest potential complementarities between the two approaches in strengthening MCH service delivery.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03890653 ; May 8, 2017. Retrospectively registered.

Pulse oximetry adoption and oxygen orders at paediatric admission over 7 years in Kenya: a multihospital retrospective cohort study

OBJECTIVES

To characterise adoption and explore specific clinical and patient factors that might influence pulse oximetry and oxygen use in low-income and middle-income countries (LMICs) over time; to highlight useful considerations for entities working on programmes to improve access to pulse oximetry and oxygen.

DESIGN

A multihospital retrospective cohort study.

SETTINGS

All admissions (n=132 737) to paediatric wards of 18 purposely selected public hospitals in Kenya that joined a Clinical Information Network (CIN) between March 2014 and December 2020.

OUTCOMES

Pulse oximetry use and oxygen prescription on admission; we performed growth-curve modelling to investigate the association of patient factors with study outcomes over time while adjusting for hospital factors.

RESULTS

Overall, pulse oximetry was used in 48.8% (64 722/132 737) of all admission cases. Use rose on average with each month of participation in the CIN (OR: 1.11, 95% CI 1.05 to 1.18) but patterns of adoption were highly variable across hospitals suggesting important factors at hospital level influence use of pulse oximetry. Of those with pulse oximetry measurement, 7% (4510/64 722) had hypoxaemia (SpO2 <90%). Across the same period, 8.6% (11 428/132 737) had oxygen prescribed but in 87%, pulse oximetry was either not done or the hypoxaemia threshold (SpO2 <90%) was not met. Lower chest-wall indrawing and other respiratory symptoms were associated with pulse oximetry use at admission and were also associated with oxygen prescription in the absence of pulse oximetry or hypoxaemia.

CONCLUSION

The adoption of pulse oximetry recommended in international guidelines for assessing children with severe illness has been slow and erratic, reflecting system and organisational weaknesses. Most oxygen orders at admission seem driven by clinical and situational factors other than the presence of hypoxaemia. Programmes aiming to implement pulse oximetry and oxygen systems will likely need a long-term vision to promote adoption, guideline development and adherence and continuously examine impact.

Implementation and Scale-Up of Integrated Depression Care in South Africa: An Observational Implementation Research Protocol

BACKGROUND

People with chronic general medical conditions who have comorbid depression experience poorer health outcomes. This problem has received scant attention in low- and middle-income countries. The aim of the ongoing study reported here is to refine and promote the scale-up of an evidence-based task-sharing collaborative care model, the Mental Health Integration (MhINT) program, to treat patients with comorbid depression and chronic disease in primary health care settings in South Africa.

METHODS

Adopting a learning-health-systems approach, this study uses an onsite, iterative observational implementation science design. Stage 1 comprises assessment of the original MhINT model under real-world conditions in an urban subdistrict in KwaZulu-Natal, South Africa, to inform refinement of the model and its implementation strategies. Stage 2 comprises assessment of the refined model across urban, semiurban, and rural contexts. In both stages, population-level effects are assessed by using the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) evaluation framework with various sources of data, including secondary data collection and a patient cohort study (N=550). The Consolidated Framework for Implementation Research is used to understand contextual determinants of implementation success involving quantitative and qualitative interviews (stage 1, N=78; stage 2, N=282).

RESULTS

The study results will help refine intervention components and implementation strategies to enable scale-up of the MhINT model for depression in South Africa.

NEXT STEPS

Next steps include strengthening ongoing engagements with policy makers and managers, providing technical support for implementation, and building the capacity of policy makers and managers in implementation science to promote wider dissemination and sustainment of the intervention.

Aiming for quality: a global compass for national learning systems

INTRODUCTION

Transforming a health system into a learning one is increasingly recognized as necessary to support the implementation of a national strategic direction on quality with a focus on frontline experience. The approach to a learning system that bridges the gap between practice and policy requires active exploration.

METHODS

This scoping review adapted the methodological framework for scoping studies from Arksey and O'Malley. The central research question focused on common themes for learning to improve the quality of health services at all levels of the national health system, from government policy to point-of-care delivery.

RESULTS

A total of 3507 records were screened, resulting in 101 articles on strategic learning across the health system: health professional level (19%), health organizational level (15%), subnational/national level (26%), multiple levels (35%), and global level (6%). Thirty-five of these articles focused on learning systems at multiple levels of the health system. A national learning system requires attention at the organizational, subnational, and national levels guided by the needs of patients, families, and the community. The compass of the national learning system is centred on four cross-cutting themes across the health system: alignment of priorities, systemwide collaboration, transparency and accountability, and knowledge sharing of real-world evidence generated at the point of care.

CONCLUSION

This paper proposes an approach for building a national learning system to improve the quality of health services. Future research is needed to validate the application of these guiding principles and make improvements based on the findings.

Value of stakeholder engagement in improving newborn care in Kenya: a qualitative description of perspectives and lessons learned

OBJECTIVE

Embedding researchers within health systems results in more socially relevant research and more effective uptake of evidence into policy and practice. However, the practice of embedded health service research remains poorly understood. We explored and assessed the development of embedded participatory approaches to health service research by a health research team in Kenya highlighting the different ways multiple stakeholders were engaged in a neonatal research study.

METHODS

We conducted semistructured qualitative interviews with key stakeholders. Data were analysed thematically using both inductive and deductive approaches.

SETTING

Over recent years, the Health Services Unit within the Kenya Medical Research Institute (KEMRI)-Wellcome Trust Research Programme in Nairobi Kenya, has been working closely with organisations and technical stakeholders including, but not limited to, medical and nursing schools, frontline health workers, senior paediatricians, policymakers and county officials, in developing and conducting embedded health research. This involves researchers embedding themselves in the contexts in which they carry out their research (mainly in county hospitals, local universities and other training institutions), creating and sustaining social networks. Researchers collaboratively worked with stakeholders to identify clinical, operational and behavioural issues related to routine service delivery, formulating and exploring research questions to bring change in practice PARTICIPANTS: We purposively selected 14 relevant stakeholders spanning policy, training institutions, healthcare workers, regulatory councils and professional associations.

RESULTS

The value of embeddedness is highlighted through the description of a recently completed project, Health Services that Deliver for Newborns (HSD-N). We describe how the HSD-N research process contributed to and further strengthened a collaborative research platform and illustrating this project's role in identifying and generating ideas about how to tackle health service delivery problems CONCLUSIONS: We conclude with a discussion about the experiences, challenges and lessons learned regarding engaging stakeholders in the coproduction of research.

Employing learning health system principles to advance research on severe neonatal and paediatric illness in Kenya

We have worked to develop a Clinical Information Network (CIN) in Kenya as an early form of learning health systems (LHS) focused on paediatric and neonatal care that now spans 22 hospitals. CIN's aim was to examine important outcomes of hospitalisation at scale, identify and ultimately solve practical problems of service delivery, drive improvements in quality and test interventions. By including multiple routine settings in research, we aimed to promote generalisability of findings and demonstrate potential efficiencies derived from LHS. We illustrate the nature and range of research CIN has supported over the past 7 years as a form of LHS. Clinically, this has largely focused on common, serious paediatric illnesses such as pneumonia, malaria and diarrhoea with dehydration with recent extensions to neonatal illnesses. CIN also enables examination of the quality of care, for example that provided to children with severe malnutrition and the challenges encountered in routine settings in adopting simple technologies (pulse oximetry) and more advanced diagnostics (eg, Xpert MTB/RIF). Although regular feedback to hospitals has been associated with some improvements in quality data continue to highlight system challenges that undermine provision of basic, quality care (eg, poor access to blood glucose testing and routine microbiology). These challenges include those associated with increased mortality risk (eg, delays in blood transfusion). Using the same data the CIN platform has enabled conduct of randomised trials and supports malaria vaccine and most recently COVID-19 surveillance. Employing LHS principles has meant engaging front-line workers, clinical managers and national stakeholders throughout. Our experience suggests LHS can be developed in low and middle-income countries that efficiently enable contextually appropriate research and contribute to strengthening of health services and research systems.

The role of evaluation in iterative learning and implementation of quality of care interventions

Background: The Lancet Global Health Commission (LGHC) has argued that quality of care (QoC) is an emergent property that requires an iterative process to learn and implement. Such iterations are required given that health systems are complex adaptive systems.Objective: This paper explores the multiple roles that evaluations need to play in order to help with iterative learning and implementation. We argue evaluation needs to shift from a summative focus toward an approach that promotes learning in complex systems. A framework is presented to help guide the iterative learning, and includes the dimensions of clinical care, person-centered care, continuum of care, and 'more than medicine. Multiple roles of evaluation corresponding to each of the dimensions are discussed.Methods: This paper is informed by reviews of the literature on QoC and the roles of evaluation in complex systems. The proposed framework synthesizes the multiple views of QoC. The recommendations of the roles of evaluation are informed both by review and experience in evaluating multiple QoC initiatives.Results: The specific roles of different evaluation approaches, including summative, realist, developmental, and participatory, are identified in relationship to the dimensions in our proposed framework. In order to achieve the potential of LGHC, there is a need to discuss how different evaluation approaches can be combined in a coherent way to promote iterative learning and implementation of QoC initiatives.Conclusion: One of the implications of the QoC framework discussed in the paper is that time needs to be spent upfront in recognizing areas in which knowledge of a specific intervention is not complete at the outset. This, of course, implies taking stock of areas of incompleteness in knowledge of context, theory of change, support structures needed in order for the program to succeed in specific settings. The role of evaluation should not be limited to only providing an external assessment, but an important goal in building evaluation capacity should be to promote adaptive management among planners and practitioners. Such iterative learning and adaptive management are needed to achieve the goals of sustainable development goals.

Paediatric emergencies and related mortality in Nicaragua: results from a multi-site paediatric emergency registry

BACKGROUND

We aim to describe the characteristics and outcomes of the severe spectrum of paediatric emergency visits using a multi-site registry developed as part of an international cooperation project.

METHODS

This observational registry-based study presented descriptive statistics of clinical and outcome data on urgent-emergency paediatric visits from 7 Nicaraguan hospitals, including the national referral paediatric hospital, between January and December 2017. Extensive piloting to ensure data collection feasibility, sustainability and accuracy was carried out in 2016 with substantial input and feedback from local stakeholders.

RESULTS

Overall, 3521 visits of patients <15 years of age, of whom two-thirds <5 years, met predefined inclusion criteria of urgent-emergency visits. Respiratory (1619/3498; 46%), gastrointestinal (407/3498; 12%) and neurological (368/3498; 11%) complaints were the most common symptoms. Malnutrition was reported in 18% (610/3448) of presentations. Mortality was 7% (233/3521); 52% (120/233) of deaths occurred in the <1-year subgroup; 32% (71/3521) of deaths occurred within the first 24 hours of presentation. The most common immediate causes of death were septic shock (99/233; 43%), respiratory failure (58/233; 25%) and raised intracranial pressure (24/233; 10%).

CONCLUSIONS

The mortality rate of urgent-emergency paediatric visits in Nicaragua is high, with younger children being most at risk and the majority of deaths being eventually caused by septic shock or respiratory failure. Our data provide useful information for the development of a Paediatric Emergency Care network to help direct training efforts, resources and logistic/organisational interventions to improve children's health in an emergency setting in Nicaragua.

Digital Health Innovations, Tools, and Resources to Support Helping Babies Survive Programs

The Helping Babies Survive (HBS) initiative features a suite of evidence-based curricula and simulation-based training programs designed to provide health workers in low- and middle-income countries (LMICs) with the knowledge, skills, and competencies to prevent, recognize, and manage leading causes of newborn morbidity and mortality. Global scale-up of HBS initiatives has been rapid. As HBS initiatives rolled out across LMIC settings, numerous bottlenecks, gaps, and barriers to the effective, consistent dissemination and implementation of the programs, across both the pre- and in-service continuums, emerged. Within the first decade of expansive scale-up of HBS programs, mobile phone ownership and access to cellular networks have also concomitantly surged in LMICs. In this article, we describe a number of HBS digital health innovations and resources that have been developed from 2010 to 2020 to support education and training, data collection for monitoring and evaluation, clinical decision support, and quality improvement. Helping Babies Survive partners and stakeholders can potentially integrate the described digital tools with HBS dissemination and implementation efforts in a myriad of ways to support low-dose high-frequency skills practice, in-person refresher courses, continuing medical and nursing education, on-the-job training, or peer-to-peer learning, and strengthen data collection for key newborn care and quality improvement indicators and outcomes. Thoughtful integration of purpose-built digital health tools, innovations, and resources may assist HBS practitioners to more effectively disseminate and implement newborn care programs in LMICs, and facilitate progress toward the achievement of Sustainable Development Goal health goals, targets, and objectives.

Digital health Systems in Kenyan Public Hospitals: a mixed-methods survey

Background

As healthcare facilities in Low- and Middle-Income Countries adopt digital health systems to improve hospital administration and patient care, it is important to understand the adoption process and assess the systems’ capabilities. This survey aimed to provide decision-makers with information on the digital health systems landscape and to support the rapidly developing digital health community in Kenya and the region by sharing knowledge.

Methods

We conducted a survey of County Health Records Information Officers (CHRIOs) to determine the extent to which digital health systems in public hospitals that serve as internship training centres in Kenya are adopted. We conducted site visits and interviewed hospital administrators and end users who were at the facility on the day of the visit. We also interviewed digital health system vendors to understand the adoption process from their perspective. Semi-structured interview guides adapted from the literature were used. We identified emergent themes using a thematic analysis from the data.

Results

We obtained information from 39 CHRIOs, 58 hospital managers and system users, and 9 digital health system vendors through semi-structured interviews and completed questionnaires.

From the survey, all facilities mentioned purchased a digital health system primarily for administrative purposes. Radiology and laboratory management systems were commonly standalone systems and there were varying levels of interoperability within facilities that had multiple systems. We only saw one in-patient clinical module in use. Users reported on issues such as system usability, inadequate training, infrastructure and system support. Vendors reported the availability of a wide range of modules, but implementation was constrained by funding, prioritisation of services, users’ lack of confidence in new technologies and lack of appropriate data sharing policies.

Conclusion

Public hospitals in Kenya are increasingly purchasing systems to support administrative functions and this study highlights challenges faced by hospital users and vendors. Significant work is required to ensure interoperability of systems within hospitals and with other government services. Additional studies on clinical usability and the workflow fit of digital health systems are required to ensure efficient system implementation. However, this requires support from key stakeholders including the government, international donors and regional health informatics organisations.

LAGOS: learning health systems and how they can integrate with patient care

PROBLEM

Learning health systems (LHS) are an underexplored concept. How LHS will operate in clinical practice is not well understood. This paper investigates the relationships between LHS, clinical care process specifications (CCPS) and the established levels of medical practice to enable LHS integration into daily healthcare practice.

METHODS

Concept analysis and thematic analysis were used to develop an LHS characterisation. Pathway theory was used to create a framework by relating LHS, CCPS, health information systems and the levels of medical practice. A case study approach evaluates the framework in an established health informatics project.

RESULTS

Five concepts were identified and used to define the LHS learning cycle. A framework was developed with five pathways, each having three levels of practice specificity spanning population to precision medicine. The framework was evaluated through application to case studies not previously understood to be LHS.

DISCUSSION

Clinicians show limited understanding of LHS, increasing resistance and limiting adoption and integration into care routine. Evaluation of the presented framework demonstrates that its use enables: (1) correct analysis and characterisation of LHS; (2) alignment and integration into the healthcare conceptual setting; (3) identification of the degree and level of patient application; and (4) impact on the overall healthcare system.

CONCLUSION

This paper contributes a theoretical framework for analysis, characterisation and use of LHS. The framework allows clinicians and informaticians to correctly identify, characterise and integrate LHS within their daily routine. The overall contribution improves understanding, practice and evaluation of the LHS application in healthcare.

Evidence map of knowledge translation strategies, outcomes, facilitators and barriers in African health systems

BACKGROUND

The need for research-based knowledge to inform health policy formulation and implementation is a chronic global concern impacting health systems functioning and impeding the provision of quality healthcare for all. This paper provides a systematic overview of the literature on knowledge translation (KT) strategies employed by health system researchers and policy-makers in African countries.

METHODS

Evidence mapping methodology was adapted from the social and health sciences literature and used to generate a schema of KT strategies, outcomes, facilitators and barriers. Four reference databases were searched using defined criteria. Studies were screened and a searchable database containing 62 eligible studies was compiled using Microsoft Access. Frequency and thematic analysis were used to report study characteristics and to establish the final evidence map. Focus was placed on KT in policy formulation processes in order to better manage the diversity of available literature.

RESULTS

The KT literature in African countries is widely distributed, problematically diverse and growing. Significant disparities exist between reports on KT in different countries, and there are many settings without published evidence of local KT characteristics. Commonly reported KT strategies include policy briefs, capacity-building workshops and policy dialogues. Barriers affecting researchers and policy-makers include insufficient skills and capacity to conduct KT activities, time constraints and a lack of resources. Availability of quality locally relevant research was the most reported facilitator. Limited KT outcomes reflect persisting difficulties in outcome identification and reporting.

CONCLUSION

This study has identified substantial geographical gaps in knowledge and evidenced the need to boost local research capacities on KT practices in low- and middle-income countries. Evidence mapping is also shown to be a useful approach that can assist local decision-making to enhance KT in policy and practice.

Kenyan health stakeholder views on individual consent, general notification and governance processes for the re-use of hospital inpatient data to support learning on healthcare systems

BACKGROUND

Increasing adoption of electronic health records in hospitals provides new opportunities for patient data to support public health advances. Such learning healthcare models have generated ethical debate in high-income countries, including on the role of patient and public consent and engagement. Increasing use of electronic health records in low-middle income countries offers important potential to fast-track healthcare improvements in these settings, where a disproportionate burden of global morbidity occurs. Core ethical issues have been raised around the role and form of information sharing processes for learning healthcare systems, including individual consent and individual and public general notification processes, but little research has focused on this perspective in low-middle income countries.

METHODS

We conducted a qualitative study on the role of information sharing and governance processes for inpatient data re-use, using in-depth interviews with 34 health stakeholders at two public hospitals on the Kenyan coast, including health managers, providers and researchers. Data were collected between March and July 2016 and analysed using a framework approach, with Nvivo 10 software to support data management.

RESULTS

Most forms of clinical data re-use were seen as an important public health good. Individual consent and general notification processes were often argued as important, but contingent on interrelated influences of the type of data, use and secondary user. Underlying concerns were linked to issues of patient privacy and autonomy; perceived risks to trust in health systems; and fairness in how data would be used, particularly for non-public sector re-users. Support for engagement often turned on the anticipated outcomes of information-sharing processes, as building or undermining trust in healthcare systems.

CONCLUSIONS

As reported in high income countries, learning healthcare systems in low-middle counties may generate a core ethical tension between supporting a public good and respecting patient autonomy and privacy, with the maintenance of public trust acting as a core requirement. While more evidence is needed on patient and public perspectives on learning healthcare activities, greater collaboration between public health and research governance systems is likely to support the development of efficient and locally responsive learning healthcare activities in LMICs.

Strategies to improve research capacity across European general practice: The views of members of EGPRN and Wonca Europe

Background: The effectiveness of any national healthcare system is highly correlated with the strength of primary care within that system. A strong research basis is essential for a firm and vibrant primary care system. General practitioners (GPs) are at the centre of most primary care systems.

Objectives: To inform on actions required to increase research capacity in general practice, particularly in low capacity countries, we collected information from the members of the European General Practice Research Network (EGPRN) and the European World Organization of Family Doctors (Wonca).

Methods: A qualitative design including eight semi-structured interviews and two discursive workshops were undertaken with members of EGPRN and Wonca Europe. Appreciative inquiry methods were utilized. Krueger’s (1994) framework analysis approach was used to analyse the data.

Results: Research performance in general practice requires improvements in the following areas: visibility of research; knowledge acquisition; mentoring and exchange; networking and research networks; collaboration with industry, authorities and other stakeholders. Research capacity building (RCB) strategies need to be both flexible and financially supported. Leadership and collaboration are crucial.

Conclusion: Members of the GP research community see the clear need for both national and international primary care research networks to facilitate appropriate RCB interventions. These interventions should be multifaceted, responding to needs at different levels and tailored to the context where they are to be implemented.

Using a mentorship model to localise the Practical Approach to Care Kit (PACK): from South Africa to Ethiopia

The Federal Ministry of Health, Ethiopia, recognised the potential of the Practical Approach to Care Kit (PACK) programme to promote integrated, comprehensive and evidence-informed primary care as a means to achieving universal health coverage. Localisation of the PACK guide to become the 'Ethiopian Primary Health Care Clinical Guidelines' (PHCG) was spearheaded by a core team of Ethiopian policy and technical experts, mentored by the Knowledge Translation Unit, University of Cape Town. A research collaboration, ASSET (heAlth Systems StrEngThening in sub-Saharan Africa), has brought together policy-makers from the Ministry of Health and health systems researchers from Ethiopia (Addis Ababa University) and overseas partners for the PACK localisation process, and will develop, implement and evaluate health systems strengthening interventions needed for a successful scale-up of the Ethiopian PHCG. Localisation of PACK for Ethiopia included expanding the guide to include a wider range of infectious diseases and an expanded age range (from 5 to 15 years). Early feedback from front-line primary healthcare (PHC) workers is positive: the guide gives them greater confidence and is easy to understand and use. A training cascade has been initiated, with a view to implementing in 400 PHC facilities in phase 1, followed by scale-up to all 3724 health centres in Ethiopia during 2019. Monitoring and evaluation of the Ministry of Health implementation at scale will be complemented by indepth evaluation by ASSET in demonstration districts. Anticipated challenges include availability of essential medications and laboratory investigations and the need for additional training and supervisory support to deliver care for non-communicable diseases and mental health. The strong leadership from the Ministry of Health of Ethiopia combined with a productive collaboration with health systems research partners can help to ensure that Ethiopian PHCG achieves standardisation of clinical practice at the primary care level and quality healthcare for all.

Prevalence, outcome and quality of care among children hospitalized with severe acute malnutrition in Kenyan hospitals: A multi-site observational study

Background

Severe acute malnutrition (SAM) remains a major cause of admission and inpatient mortality worldwide in children aged less than 5 years. In this study, we explored SAM prevalence and outcomes in children admitted in 13 Kenyan hospitals participating in a Clinical Information Network (CIN). We also describe their immediate in-patient management.

Methods

We analyzed data for children aged 1–59 months collected retrospectively from medical records after discharge. Mean, median and ranges were used to summarize pooled and age-specific prevalence and mortality associated with SAM. Documentation of key signs and symptoms (S/S) and performance of indicators of quality of care for selected aspects of the WHO management steps were assessed. Logistic regression models were used to evaluate associations between documented S/S and mortality among SAM patients aged 6–59 months. Loess curves were used to explore performance change over time for indicators of selected SAM management steps.

Results

5306/54140 (9.8%) children aged 1–59 months admitted with medical conditions in CIN hospitals between December 2013 and November 2016 had SAM. SAM prevalence identified by clinicians and case fatality varied widely across hospitals with median proportion (range) of 10.1% (4.6–18.2%) and 14.8% (6.0–28.6%) respectively. Seventeen variables were associated with increased mortality. Performance change over time of management steps varied across hospitals and across selected indicators but suggests some effect of regular audit and feedback.

Conclusion

Identification of SAM patients, their mortality and adherence to in-patient management recommendations varied across hospitals. An important group of SAM patients are aged less than 6 months. Continued efforts are required to improve management of SAM in routine settings as part of efforts to reduce inpatient mortality.

Implementing an Open Source Electronic Health Record System in Kenyan Health Care Facilities: Case Study

BACKGROUND

The Kenyan government, working with international partners and local organizations, has developed an eHealth strategy, specified standards, and guidelines for electronic health record adoption in public hospitals and implemented two major health information technology projects: District Health Information Software Version 2, for collating national health care indicators and a rollout of the KenyaEMR and International Quality Care Health Management Information Systems, for managing 600 HIV clinics across the country. Following these projects, a modified version of the Open Medical Record System electronic health record was specified and developed to fulfill the clinical and administrative requirements of health care facilities operated by devolved counties in Kenya and to automate the process of collating health care indicators and entering them into the District Health Information Software Version 2 system.

OBJECTIVE

We aimed to present a descriptive case study of the implementation of an open source electronic health record system in public health care facilities in Kenya.

METHODS

We conducted a landscape review of existing literature concerning eHealth policies and electronic health record development in Kenya. Following initial discussions with the Ministry of Health, the World Health Organization, and implementing partners, we conducted a series of visits to implementing sites to conduct semistructured individual interviews and group discussions with stakeholders to produce a historical case study of the implementation.

RESULTS

This case study describes how consultants based in Kenya, working with developers in India and project stakeholders, implemented the new system into several public hospitals in a county in rural Kenya. The implementation process included upgrading the hospital information technology infrastructure, training users, and attempting to garner administrative and clinical buy-in for adoption of the system. The initial deployment was ultimately scaled back due to a complex mix of sociotechnical and administrative issues. Learning from these early challenges, the system is now being redesigned and prepared for deployment in 6 new counties across Kenya.

CONCLUSIONS

Implementing electronic health record systems is a challenging process in high-income settings. In low-income settings, such as Kenya, open source software may offer some respite from the high costs of software licensing, but the familiar challenges of clinical and administration buy-in, the need to adequately train users, and the need for the provision of ongoing technical support are common across the North-South divide. Strategies such as creating local support teams, using local development resources, ensuring end user buy-in, and rolling out in smaller facilities before larger hospitals are being incorporated into the project. These are positive developments to help maintain momentum as the project continues. Further integration with existing open source communities could help ongoing development and implementations of the project. We hope this case study will provide some lessons and guidance for other challenging implementations of electronic health record systems as they continue across Africa.

Clinical stroke research in resource limited settings: Tips and hints

Background Most stroke research is conducted in high income countries, yet most stroke occurs in low- and middle-income countries. There is an urgent need to build stroke research capacity in low- and middle-income countries. Aims To review the global health literature on how to improve research capacity in low- and middle-income countries, provide additional data from the recently completed ATTEND Trial and provide examples from our own experience. Summary of review The main themes from our literature review were: manpower and workload, research training, research question and methodology and research funding. The literature and our own experience emphasized the importance of local stakeholders to ensure that the research was appropriate, that there were robust local ethics and regulatory processes, and research was conducted by trained personnel. Research training opportunities can be developed locally, or internationally, with many international schemes available to help support new researchers from low- and middle-income country settings. International collaboration can successfully leverage funding from high income countries that not only generate data for the local country, but also provide new data appropriate to high income countries. Conclusions Building stroke research capacity in low- and middle-income countries will be vital in improving global health given the huge burden of stroke in these countries.

Comparative effectiveness of injectable penicillin versus a combination of penicillin and gentamicin in children with pneumonia characterised by indrawing in Kenya: a retrospective observational study

OBJECTIVES

Kenyan guidelines for antibiotic treatment of pneumonia recommended treatment of pneumonia characterised by indrawing with injectable penicillin alone in inpatient settings until early 2016. At this point, they were revised becoming consistent with WHO guidance after results of a Kenyan trial provided further evidence of equivalence of oral amoxicillin and injectable penicillin. This change also made possible use of oral amoxicillin for outpatient treatment in this patient group. However, given non-trivial mortality in Kenyan children with indrawing pneumonia, it remained possible they would benefit from a broader spectrum antibiotic regimen. Therefore, we compared the effectiveness of injectable penicillin monotherapy with a regimen combining penicillin with gentamicin.

SETTING

We used a large routine observational dataset that captures data on all admissions to 13 Kenyan county hospitals.

PARTICIPANTS AND MEASURES

The analyses included children aged 2-59 months. Selection of study population was based on inclusion criteria typical of a prospective trial, primary analysis (experiment 1, n=4002), but we also explored more pragmatic inclusion criteria (experiment 2, n=6420) as part of a secondary analysis. To overcome the challenges associated with the non-random allocation of treatments and missing data, we used propensity score (PS) methods and multiple imputation to minimise bias. Further, we estimated mortality risk ratios using log binomial regression and conducted sensitivity analyses using an instrumental variable and PS trimming.

RESULTS

The estimated risk of dying, in experiment 1, in those receiving penicillin plus gentamicin was 1.46 (0.85 to 2.43) compared with the penicillin monotherapy group. In experiment 2, the estimated risk was 1.04(0.76 to 1.40).

CONCLUSION

There is no statistical difference in the treatment of indrawing pneumonia with either penicillin or penicillin plus gentamicin. By extension, it is unlikely that treatment with penicillin plus gentamicin would offer an advantage to treatment with oral amoxicillin.

Framing the conversation: use of PRECIS-2 ratings to advance understanding of pragmatic trial design domains

Background

There continues to be debate about what constitutes a pragmatic trial and how it is distinguished from more traditional explanatory trials. The NIH Pragmatic Trials Collaborative Project, which includes five trials and a coordinating unit, has adopted the Pragmatic-Explanatory Continuum Indicator Summary (PRECIS-2) instrument. The purpose of the study was to collect PRECIS-2 ratings at two points in time to assess whether the tool was sensitive to change in trial design, and to explore with investigators the rationale for rating shifts.

Methods

A mixed-methods design included sequential collection and analysis of quantitative data (PRECIS-2 ratings) and qualitative data. Ratings were collected at two annual, in-person project meetings, and subsequent interviews conducted with investigators were recorded, transcribed, and coded using NVivo 11 Pro for Windows. Rating shifts were coded as either (1) actual change (reflects a change in procedure or protocol), (2) primarily a rating shift reflecting rater variability, or (3) themes that reflect important concepts about the tool and/or pragmatic trial design.

Results

Based on PRECIS-2 ratings, each trial was highly pragmatic at the planning phase and remained so 1 year later in the early phases of trial implementation. Over half of the 45 paired ratings for the nine PRECIS-2 domains indicated a rating change from Time 1 to Time 2 (N = 24, 53%). Of the 24 rating changes, only three represented a true change in the design of the trial. Analysis of rationales for rating shifts identified critical themes associated with the tool or pragmatic trial design more generally. Each trial contributed one or more relevant comments, with Eligibility, Flexibility of Adherence, and Follow-up each accounting for more than one.

Conclusions

PRECIS-2 has proved useful for “framing the conversation” about trial design among members of the Pragmatic Trials Collaborative Project. Our findings suggest that design elements assessed by the PRECIS-2 tool may represent mostly stable decisions. Overall, there has been a positive response to using PRECIS-2 to guide conversations around trial design, and the project’s focus on the use of the tool by this group of early adopters has provided valuable feedback to inform future trainings on the tool.

The Role of Free/Libre and Open Source Software in Learning Health Systems

Objective: To give an overview of the role of Free/Libre and Open Source Software (FLOSS) in the context of secondary use of patient data to enable Learning Health Systems (LHSs). Methods: We conducted an environmental scan of the academic and grey literature utilising the MedFLOSS database of open source systems in healthcare to inform a discussion of the role of open source in developing LHSs that reuse patient data for research and quality improvement. Results: A wide range of FLOSS is identified that contributes to the information technology (IT) infrastructure of LHSs including operating systems, databases, frameworks, interoperability software, and mobile and web apps. The recent literature around the development and use of key clinical data management tools is also reviewed. Conclusions: FLOSS already plays a critical role in modern health IT infrastructure for the collection, storage, and analysis of patient data. The nature of FLOSS systems to be collaborative, modular, and modifiable may make open source approaches appropriate for building the digital infrastructure for a LHS.

Conceptualisation of job-related wellbeing, stress and burnout among healthcare workers in rural Ethiopia: a qualitative study

BACKGROUND

Wellbeing of healthcare workers is important for the effective functioning of health systems. The aim of this study was to explore the conceptualisations of wellbeing, stress and burnout among healthcare workers in primary healthcare settings in rural Ethiopia in order to inform the development of contextually appropriate interventions.

METHODS

A qualitative study was conducted in a rural zone of southern Ethiopia. A total of 52 frontline primary healthcare workers participated in in-depth interviews (n = 18) or Focus Group Discussions (FGDs) (4 groups, total n = 34). There were 35 facility based healthcare professionals and 17 community-based health workers. Data were analysed using thematic analysis.

RESULTS

Most participants conceptualised wellbeing as absence of stress rather than as a positive state. Many threats to wellbeing were identified. For facility-based workers, the main stressors were inadequate supplies leading to fears of acquiring infection and concerns about performance evaluation. For community health workers, the main stressor was role ambiguity. Workload and economic self-sufficiency were a concern for both groups. Burnout and its symptoms were recognised and reported by most as a problem of other healthcare workers. Derogatory and stigmatising terms, such as "chronics", were used to refer to those who had served for many years and who appeared to have become drained of all compassion. Most participants viewed burnout as inevitable if they continued to work in their current workplace without career progression. Structural and environmental aspects of work emerged as potential targets to improve wellbeing, combined with tackling stigmatising attitudes towards mental health problems. An unmet need for intervention for healthcare workers who develop burnout or emotional difficulties was identified.

CONCLUSION

Ethiopian primary healthcare workers commonly face job-related stress and experience features of burnout, which may contribute to the high turnover of staff and dissatisfaction of both patients and providers. Recent initiatives to integrate mental healthcare into primary care provide an opportunity to promote the wellbeing of healthcare workers and intervene to address burnout and emotional problems by creating a better understanding of mental health.