Insights into the design, development and implementation of a novel digital health tool for skilled birth attendants to support quality maternity care in Kenya

Clinical decision support systems for maternity care: a systematic review and meta-analysis

Background

The use of Clinical Decision Support Systems (CDSS) is increasing throughout healthcare and may be able to improve safety and outcomes in maternity care, but maternity care has key differences to other disciplines that complicate the use of CDSS. We aimed to identify evaluated CDSS and synthesise evidence of their impact on maternity care.

Methods

We conducted a systematic review for articles published before 24th May 2024 that described i) CDSS that ii) investigated the impact of their use iii) in maternity settings. Medline, CINAHL, CENTRAL and HMIC were searched for articles relating to evaluations of CDSS in maternity settings, with forward- and backward-citation tracing conducted for included articles. Risk of bias was assessed using the Mixed Methods Assessment Tool, and CDSS were described according to the clinical problem, purpose, design, and technical environment. Quantitative results from articles reporting appropriate data were meta-analysed to estimate odds of a CDSS achieving its desired outcome using a multi-level random effects model, first by individual CDSS and then across all CDSS. PROSPERO ID: CRD42022348157.

Findings

We screened 12,039 papers and included 87 articles describing 47 unique CDSS. 24 articles (28%) described randomised controlled trials, 30 (34%) described non-randomised interventional studies, 10 (11%) described mixed methods studies, 10 (11%) described qualitative studies, 7 (8%) described quantitative descriptive studies, and 7 (8%) described economic evaluations. 49 (56%) were in High-Income Countries and 38 (44%) in Low- and Middle-Income countries, with no CDSS trialled in both income categories. Meta-analysis of 35 included studies found an odds ratio for improved outcomes of 1.69 (95% confidence interval 1.24-2.30). There was substantial variation in effects, aims, CDSS types, context, study designs, and outcomes.

Interpretation

Most CDSS evaluations showed improvements in outcomes, but there was heterogeneity in all aspects of design and evaluation of systems. CDSS are increasingly important in delivering healthcare, and Electronic Health Records and mHealth will increase their availability, but traditional epidemiological methods may be limited in guiding design and demonstrating effectiveness due to rapid CDSS development lifecycles and the complex systems in which they are embedded. Development methods that are attentive to context, such as Human Centred Design, will help to meet this need.

Funding

None.

Implementation Outcomes Assessment of a Digital Clinical Support Tool for Intrapartum Care in Rural Kenya: Observational Analysis

Background

iDeliver, a digital clinical support system for maternal and neonatal care, was developed to support quality of care improvements in Kenya.

Objective

Taking an implementation research approach, we evaluated the adoption and fidelity of iDeliver over time and assessed the feasibility of its use to provide routine Ministry of Health (MOH) reports.

Methods

We analyzed routinely collected data from iDeliver, which was implemented at the Transmara West Sub-County Hospital from December 2018 to September 2020. To evaluate its adoption, we assessed the proportion of actual facility deliveries that was recorded in iDeliver over time. We evaluated the fidelity of iDeliver use by studying the completeness of data entry by care providers during each stage of the labor and delivery workflow and whether the use reflected iDeliver’s envisioned function. We also examined the data completeness of the maternal and neonatal indicators prioritized by the Kenya MOH.

Results

A total of 1164 deliveries were registered in iDeliver, capturing 45.31% (1164/2569) of the facility’s deliveries over 22 months. This uptake of registration improved significantly over time by 6.7% (SE 2.1) on average in each quarter-year (P=.005), from 9.6% (15/157) in the fourth quarter of 2018 to 64% (235/367) in the third quarter of 2020. Across iDeliver’s workflow, the overall completion rate of all variables improved significantly by 2.9% (SE 0.4) on average in each quarter-year (P<.001), from 22.25% (257/1155) in the fourth quarter of 2018 to 49.21% (8905/18,095) in the third quarter of 2020. Data completion was highest for the discharge-labor summary stage (16,796/23,280, 72.15%) and lowest for the labor signs stage (848/5820, 14.57%). The completion rate of the key MOH indicators also improved significantly by 4.6% (SE 0.5) on average in each quarter-year (P<.001), from 27.1% (69/255) in the fourth quarter of 2018 to 83.75% (3346/3995) in the third quarter of 2020.

Conclusions

iDeliver’s adoption and data completeness improved significantly over time. The assessment of iDeliver’ use fidelity suggested that some features were more easily used because providers had time to enter data; however, there was low use during active childbirth, which is when providers are necessarily engaged with the woman and newborn. These insights on the adoption and fidelity of iDeliver use prompted the team to adapt the application to reflect the users’ culture of use and further improve the implementation of iDeliver.

Digital Solutions for Community and Primary Health Workers: Lessons From Implementations in Africa

The agenda for Universal Health Coverage has driven the exploration of various innovative approaches to expanding health services to the general population. As more African countries have adopted digital health tools as part of the strategic approach to expanding health services, there is a need for defining a standard framework for implementation across board. Therefore, there is a need to review and employ an evidence-based approach to inform managing challenges, adopting best approaches, and implement informed recommendations. We reviewed a variety of digital health tools applied to different health conditions in primary care settings and highlighted the challenges faced, approaches that worked and relevant recommendations. These include limited coverage and network connectivity, lack of technological competence, lack of power supply, limited mobile phone usage and application design challenges. Despite these challenges, this review suggests that mHealth solutions could attain effective usage when healthcare workers receive adequate onsite training, deploying applications designed in an intuitive and easy to understand approach in a manner that fits into the users existing workflows, and involvement of the stakeholders at all levels in the design, planning, and implementation stages of the interventions.

Implementing Electronic Health Records in Primary Care Using the Theory of Change: A Nigerian Case Study (Preprint)

Background

Objective

Methods

Results

Conclusions