Can the use of digital algorithms improve quality care? An example from Afghanistan

Digitalizing Clinical Guidelines: Experiences in the Development of Clinical Decision Support Algorithms for Management of Childhood Illness in Resource-Constrained Settings

Clinical decision support systems (CDSSs) can strengthen the quality of integrated management of childhood illness (IMCI) in resource-constrained settings. Several IMCI-related CDSSs have been developed and implemented in recent years. Yet, despite having a shared starting point, the IMCI-related CDSSs are markedly varied due to the need for interpretation when translating narrative guidelines into decision logic combined with considerations of context and design choices. Between October 2019 and April 2021, we conducted a comparative analysis of 4 IMCI-related CDSSs. The extent of adaptations to IMCI varied, but common themes emerged. Scope was extended to cover a broader range of conditions. Content was added or modified to enhance precision, align with new evidence, and support rational resource use. Structure was modified to increase efficiency, improve usability, and prioritize care for severely ill children. The multistakeholder development processes involved syntheses of recommendations from existing guidelines and literature; creation and validation of clinical algorithms; and iterative development, implementation, and evaluation. The common themes surrounding adaptations of IMCI guidance highlight the complexities of digitalizing evidence-based recommendations and reinforce the rationale for leveraging standards for CDSS development, such as the World Health Organization's SMART Guidelines. Implementation through multistakeholder dialogue is critical to ensure CDSSs can effectively and equitably improve quality of care for children in resource-constrained settings.

Digital health in fragile states in the Middle East and North Africa (MENA) region: A scoping review of the literature

INTRODUCTION

Conflict, fragility and political violence, that are taking place in many countries in the Middle East and North Africa (MENA) region have devastating effects on health. Digital health technologies can contribute to enhancing the quality, accessibility and availability of health care services in fragile and conflict-affected states of the MENA region. To inform future research, investments and policy processes, this scoping review aims to map out the evidence on digital health in fragile states in the MENA region.

METHOD

We conducted a scoping review following the Joanna Briggs Institute (JBI) guidelines. We conducted descriptive analysis of the general characteristics of the included papers and thematic analysis of the key findings of included studies categorized by targeted primary users of different digital health intervention.

RESULTS

Out of the 10,724 articles identified, we included 93 studies. The included studies mainly focused on digital health interventions targeting healthcare providers, clients and data services, while few studies focused on health systems or organizations managers. Most of the included studies were observational studies (49%). We identified no systematic reviews. Most of the studies were conducted in Lebanon (32%) followed by Afghanistan (13%) and Palestine (12%). The first authors were mainly affiliated with institutions from countries outside the MENA region (57%), mainly United Kingdom and United States. Digital health interventions provided a platform for training, supervision, and consultation for health care providers, continuing education for medical students, and disease self-management. The review also highlighted some implementation considerations for the adoption of digital health such as computer literacy, weak technological infrastructure, and privacy concerns.

CONCLUSION

This review showed that digital health technologies can provide promising solutions in addressing health needs in fragile and conflict-affected states. However, rigorous evaluation of digital technologies in fragile settings and humanitarian crises are needed to inform their design and deployment.

ePOCT+ and the medAL-suite: Development of an electronic clinical decision support algorithm and digital platform for pediatric outpatients in low- and middle-income countries

Electronic clinical decision support algorithms (CDSAs) have been developed to address high childhood mortality and inappropriate antibiotic prescription by helping clinicians adhere to guidelines. Previously identified challenges of CDSAs include their limited scope, usability, and outdated clinical content. To address these challenges we developed ePOCT+, a CDSA for the care of pediatric outpatients in low- and middle-income settings, and the medical algorithm suite (medAL-suite), a software for the creation and execution of CDSAs. Following the principles of digital development, we aim to describe the process and lessons learnt from the development of ePOCT+ and the medAL-suite. In particular, this work outlines the systematic integrative development process in the design and implementation of these tools required to meet the needs of clinicians to improve uptake and quality of care. We considered the feasibility, acceptability and reliability of clinical signs and symptoms, as well as the diagnostic and prognostic performance of predictors. To assure clinical validity, and appropriateness for the country of implementation the algorithm underwent numerous reviews by clinical experts and health authorities from the implementing countries. The digitalization process involved the creation of medAL-creator, a digital platform which allows clinicians without IT programming skills to easily create the algorithms, and medAL-reader the mobile health (mHealth) application used by clinicians during the consultation. Extensive feasibility tests were done with feedback from end-users of multiple countries to improve the clinical algorithm and medAL-reader software. We hope that the development framework used for developing ePOCT+ will help support the development of other CDSAs, and that the open-source medAL-suite will enable others to easily and independently implement them. Further clinical validation studies are underway in Tanzania, Rwanda, Kenya, Senegal, and India.

Coronavirus Disease 2019 (COVID-19) Diagnostic Clinical Decision Support: A Pre-Post Implementation Study of CORAL (COvid Risk cALculator)

BACKGROUND

Isolation of hospitalized persons under investigation (PUIs) for coronavirus disease 2019 (COVID-19) reduces nosocomial transmission risk. Efficient evaluation of PUIs is needed to preserve scarce healthcare resources. We describe the development, implementation, and outcomes of an inpatient diagnostic algorithm and clinical decision support system (CDSS) to evaluate PUIs.

METHODS

We conducted a pre-post study of CORAL (COvid Risk cALculator), a CDSS that guides frontline clinicians through a risk-stratified COVID-19 diagnostic workup, removes transmission-based precautions when workup is complete and negative, and triages complex cases to infectious diseases (ID) physician review. Before CORAL, ID physicians reviewed all PUI records to guide workup and precautions. After CORAL, frontline clinicians evaluated PUIs directly using CORAL. We compared pre- and post-CORAL frequency of repeated severe acute respiratory syndrome coronavirus 2 nucleic acid amplification tests (NAATs), time from NAAT result to PUI status discontinuation, total duration of PUI status, and ID physician work hours, using linear and logistic regression, adjusted for COVID-19 incidence.

RESULTS

Fewer PUIs underwent repeated testing after an initial negative NAAT after CORAL than before CORAL (54% vs 67%, respectively; adjusted odd ratio, 0.53 [95% confidence interval, .44-.63]; P < .01). CORAL significantly reduced average time to PUI status discontinuation (adjusted difference [standard error], -7.4 [0.8] hours per patient), total duration of PUI status (-19.5 [1.9] hours per patient), and average ID physician work-hours (-57.4 [2.0] hours per day) (all P < .01). No patients had a positive NAAT result within 7 days after discontinuation of precautions via CORAL.

CONCLUSIONS

CORAL is an efficient and effective CDSS to guide frontline clinicians through the diagnostic evaluation of PUIs and safe discontinuation of precautions.

Strategies Used for Implementing and Promoting Adherence to Antibiotic Guidelines in Low- and Lower-Middle-Income Countries: A Systematic Review

Containing antimicrobial resistance and reducing high levels of antibiotic consumption in low- and lower middle-income countries are a major challenge. Clinical guidelines targeting antibiotic prescribing can reduce consumption, however, the degrees to which clinical guidelines are adopted and adhered to are challenging for developers, policy makers and users. The aim of this study was to review the strategies used for implementing and promoting antibiotic guideline adherence in low- and lower middle-income countries. A review of published literature was conducted using PubMed, Cochrane Library, SCOPUS and the information systems of the World Health Organization and the Australian National University according to PRISMA guidelines and our PROSPERO protocol. The strategies were grouped into five broad categories based on the Cochrane Effective Practice and Organization of Care taxonomy. The 33 selected studies, representing 16 countries varied widely in design, setting, disease focus, methods, intervention components, outcomes and effects. The majority of interventions were multifaceted and resulted in a positive direction of effect. The nature of the interventions and study variability made it impossible to tease out which strategies had the greatest impact on improving CG compliance. Audit and feedback coupled with either workshops and/or focus group discussions were the most frequently used intervention components. All the reported strategies are established practices used in antimicrobial stewardship programs in high-income countries. We recommend interrupted time series studies be used as an alternative design to pre- and post-intervention studies, information about the clinical guidelines be made more transparent, and prescriber confidence be investigated.

An Integrated eDiagnosis Approach (IeDA) versus standard IMCI for assessing and managing childhood illness in Burkina Faso: a stepped-wedge cluster randomised trial

BACKGROUND

The Integrated eDiagnosis Approach (IeDA), centred on an electronic Clinical Decision Support System (eCDSS) developed in line with national Integrated Management of Childhood Illness (IMCI) guidelines, was implemented in primary health facilities of two regions of Burkina Faso. An evaluation was performed using a stepped-wedge cluster randomised design with the aim of determining whether the IeDA intervention increased Health Care Workers' (HCW) adherence to the IMCI guidelines.

METHODS

Ten randomly selected facilities per district were visited at each step by two trained nurses: One observed under-five consultations and the second conducted a repeat consultation. The primary outcomes were: overall adherence to clinical assessment tasks; overall correct classification ignoring the severity of the classifications; and overall correct prescription according to HCWs' classifications. Statistical comparisons between trial arms were performed on cluster/step-level summaries.

RESULTS

On average, 54 and 79% of clinical assessment tasks were observed to be completed by HCWs in the control and intervention districts respectively (cluster-level mean difference = 29.9%; P-value = 0.002). The proportion of children for whom the validation nurses and the HCWs recorded the same classifications (ignoring the severity) was 73 and 79% in the control and intervention districts respectively (cluster-level mean difference = 10.1%; P-value = 0.004). The proportion of children who received correct prescriptions in accordance with HCWs' classifications were similar across arms, 78% in the control arm and 77% in the intervention arm (cluster-level mean difference = - 1.1%; P-value = 0.788).

CONCLUSION

The IeDA intervention improved substantially HCWs' adherence to IMCI's clinical assessment tasks, leading to some overall increase in correct classifications but to no overall improvement in correct prescriptions. The largest improvements tended to be observed for less common conditions. For more common conditions, HCWs in the control districts performed relatively well, thus limiting the scope to detect an overall impact.

TRIAL REGISTRATION

ClinicalTrials.gov NCT02341469 ; First submitted August 272,014, posted January 19, 2015.

Conducting operational research in humanitarian settings: is there a shared path for humanitarians, national public health authorities and academics?

In humanitarian contexts, it is a difficult and multi-faceted task to enlist academics, humanitarian actors and health authorities in a collaborative research effort. The lack of research in such settings has been widely described in the past decade, but few have analysed the challenges in building strong and balanced research partnerships. The major issues include considering operational priorities, ethical imperatives and power differentials. This paper analyses in two steps a collaborative empirical endeavour to assess health service utilization by Syrian refugee and Lebanese women undertaken by the International Committee of the Red Cross (ICRC), the Lebanese Ministry of Public Health (MoPH) and the Harvard François-Xavier Bagnoud (FXB) Center. First, based on challenges documented in the literature, we shed light on how we negotiated appropriate research questions, methodologies, bias analyses, resource availability, population specificities, security, logistics, funding, ethical issues and organizational cultures throughout the partnership. Second, we describe how the negotiations required each partner to go outside their comfort zones. For the academics, the drivers to engage included the intellectual value of the collaboration, the readiness of the operational partners to conduct an empirical investigation and the possibility that such work might lead to a better understanding in public health terms of how the response met population needs. For actors responding to the humanitarian crisis (the ICRC and the MOPH), participating in a technical collaboration permitted methodological issues to be worked through in the context of deliberations within the wider epistemic community. We find that when they collaborate, academics, humanitarian actors and health authorities deploy their respective complementarities to build a more comprehensive approach. Barriers such as the lack of uptake of research results or weak links to the existing literature were overcome by giving space to define research questions and develop a longer-term collaboration involving individual and institutional learning. There is the need ahead of time to create balanced decision-making mechanisms, allow for relative financial autonomy, and define organizational responsibilities. Ultimately, mutual respect, trust and the recognition of each other's expertise formed the basis of an initiative that served to better understand populations affected by conflict and meet their needs.

Electronic clinical decision support algorithms incorporating point-of-care diagnostic tests in low-resource settings: a target product profile

Health workers in low-resource settings often lack the support and tools to follow evidence-based clinical recommendations for diagnosing, treating and managing sick patients. Digital technologies, by combining patient health information and point-of-care diagnostics with evidence-based clinical protocols, can help improve the quality of care and the rational use of resources, and save patient lives. A growing number of electronic clinical decision support algorithms (CDSAs) on mobile devices are being developed and piloted without evidence of safety or impact. Here, we present a target product profile (TPP) for CDSAs aimed at guiding preventive or curative consultations in low-resource settings. This document will help align developer and implementer processes and product specifications with the needs of end users, in terms of quality, safety, performance and operational functionality. To identify the characteristics of CDSAs, a multidisciplinary group of experts (academia, industry and policy makers) with expertise in diagnostic and CDSA development and implementation in low-income and middle-income countries were convened to discuss a draft TPP. The TPP was finalised through a Delphi process to facilitate consensus building. An agreement greater than 75% was reached for all 40 TPP characteristics. In general, experts were in overwhelming agreement that, given that CDSAs provide patient management recommendations, the underlying clinical algorithms should be human-interpretable and evidence-based. Whenever possible, the algorithm’s patient management output should take into account pretest disease probabilities and likelihood ratios of clinical and diagnostic predictors. In addition, validation processes should at a minimum show that CDSAs are implementing faithfully the evidence they are based on, and ideally the impact on patient health outcomes. In terms of operational needs, CDSAs should be designed to fit within clinic workflows and function in connectivity-challenged and high-volume settings. Data collected through the tool should conform to local patient privacy regulations and international data standards.

Results from one-year use of an electronic Clinical Decision Support System in a post-conflict context: An implementation research

BACKGROUND

In 2017, the Adamawa State Primary Healthcare Development Agency introduced ALMANACH, an electronic clinical decision support system based on a modified version of IMCI. The target area was the Federal State of Adamawa (Nigeria), a region recovering after the Boko Haram insurgency. The aim of this implementation research was to assess the improvement in terms of quality care offered after one year of utilization of the tool.

METHODS

We carried out two cross-sectional studies in six Primary Health Care Centres to assess the improvements in comparison with the baseline carried out before the implementation. One survey was carried out inside the consultation room and was based on the direct observation of 235 consultations of children aged from 2 to 59 months old. The second survey questioned 189 caregivers outside the health facility for their opinion about the consultation carried out through using the tablet, the prescriptions and medications given.

RESULTS

In comparison with the baseline, more children were checked for danger signs (60.0% vs. 37.1% at baseline) and in addition, children were actually weighed (61.1% vs. 27.7%) during consultation. Malnutrition screening was performed in 35.1% of children (vs. 12.1%). Through ALMANACH, also performance of preventive measures was significantly improved (p<0.01): vaccination status was checked in 39.8% of cases (vs. 10.6% at baseline), and deworming and vitamin A prescription was increased to 46.5% (vs. 0.7%) and 48.3% (vs. 2.8%) respectively. Furthermore, children received a complete physical examination (58.3% vs. 45.5%, p<0.01) and correct treatment (48.4% vs. 29.5%, p<0.01). Regarding antibiotic prescription, 69.3% patients received at least one antibiotic (baseline 77.7%, p<0.05).

CONCLUSIONS

Our findings highlight major improvements in terms of quality of care despite many questions still pending to be answered in relation to a full integration of the tool in the Adamawa health system.