Does an innovative paper-based health information system (PHISICC) improve data quality and use in primary healthcare? Protocol of a multicountry, cluster randomised controlled trial in sub-Saharan African rural settings

Common data quality elements for health information systems: a systematic review

BACKGROUND

Data quality in health information systems has a complex structure and consists of several dimensions. This research conducted for identify Common data quality elements for health information systems.

METHODS

A literature review was conducted and search strategies run in Web of Knowledge, Science Direct, Emerald, PubMed, Scopus and Google Scholar search engine as an additional source for tracing references. We found 760 papers, excluded 314 duplicates, 339 on abstract review and 167 on full-text review; leaving 58 papers for critical appraisal.

RESULTS

Current review shown that 14 criteria are categorized as the main dimensions for data quality for health information system include: Accuracy, Consistency, Security, Timeliness, Completeness, Reliability, Accessibility, Objectivity, Relevancy, Understandability, Navigation, Reputation, Efficiency and Value- added. Accuracy, Completeness, and Timeliness, were the three most-used dimensions in literature.

CONCLUSIONS

At present, there is a lack of uniformity and potential applicability in the dimensions employed to evaluate the data quality of health information system. Typically, different approaches (qualitative, quantitative and mixed methods) were utilized to evaluate data quality for health information system in the publications that were reviewed. Consequently, due to the inconsistency in defining dimensions and assessing methods, it became imperative to categorize the dimensions of data quality into a limited set of primary dimensions.

A Systematic Literature Review of Health Information Systems for Healthcare

Health information system deployment has been driven by the transformation and digitalization currently confronting healthcare. The need and potential of these systems within healthcare have been tremendously driven by the global instability that has affected several interrelated sectors. Accordingly, many research studies have reported on the inadequacies of these systems within the healthcare arena, which have distorted their potential and offerings to revolutionize healthcare. Thus, through a comprehensive review of the extant literature, this study presents a critique of the health information system for healthcare to supplement the gap created as a result of the lack of an in-depth outlook of the current health information system from a holistic slant. From the studies, the health information system was ascertained to be crucial and fundament in the drive of information and knowledge management for healthcare. Additionally, it was asserted to have transformed and shaped healthcare from its conception despite its flaws. Moreover, research has envisioned that the appraisal of the current health information system would influence its adoption and solidify its enactment within the global healthcare space, which is highly demanded.

Digitalization of routine health information systems: Bangladesh, Indonesia, Pakistan

Objective

To describe a systematic process of transforming paper registers into a digital system optimized to enhance service provision and fulfil reporting requirements.

Methods

We designed a formative study around primary health workers providing reproductive, maternal, newborn and child health services in three countries in Bangladesh, Indonesia and Pakistan. The study ran from November 2014 to June 2018. We developed a prototype digital application after conducting a needs assessment of health workers' responsibilities, workflows, routine data requirements and service delivery needs. Methods included desk reviews, focus group discussions, in-depth interviews; data mapping of paper registers; observations of health workers; co-design workshops with health workers; and usability testing. Finally, we conducted an observational feasibility assessment to monitor uptake of the application.

Findings

Researchers reviewed a total of 17 paper registers across the sites, which we transformed into seven modules within a digital application running on mobile devices. Modules corresponded to the services provided, including household enumeration, antenatal care, family planning, immunization, nutrition and child health. A total of 65 health workers used the modules during the feasibility assessment, and average weekly form submissions ranged from 8 to 234, depending on the health worker and their responsibilities. We also observed variability in the use of modules, requiring consistent monitoring support for health workers.

Conclusion

Lessons learnt from this study shaped key global initiatives and resulted in a software global good. The deployment of digital systems requires well-designed applications, change management and strengthening human resources to realize and sustain health system gains.

Using and improving the PHISICC paper-based tools in the health facility laboratories: Examples of Human Centered Design taking systems thinking into practice, in Côte d'Ivoire and Nigeria

Background

Health workers in low- and middle-income countries are increasingly demanded to collect more and more data to report them to higher levels of the health information system (HIS), in detriment of useful data for clinical and public health decision-making, potentially compromising the quality of their health care provison. In order to support health workers' decision-making, we engaged with partners in Côte d'Ivoire, Mozambique and Nigeria in a research project to conceive, design, produce, implement and test paper-based health information tools: the PHISICC tools. Our aim was to understand the use of PHISICC tools by health workers and to improve them based on their feedback.

Methods

The design Health Facility Laboratories (HF Labs) in Côte d'Ivoire and in Nigeria were set up after months of use of PHISICC tools. Activities were structured in three phases or 'sprints' of co-creative research. We used a transdisciplinary approach, including anthropology and Human Centered Design (HCD), observations, shadowing, structured interviews and co-creation.

Results

Health workers appreciated the standardization of the tools across different health care areas, with a common visual language that optimized use. Several design issues were raised, in terms of formats and contents. They strongly appreciated how the PHISICC registers guided their clinical decision-making and how it facilitated tallying and counting for monthly reporting. However, adherence to new procedures was not universal. The co-creation sessions resulted in modifications to the PHISICC tools of out-patient care and postnatal care.

Discussion

Although health systems and systemic thinking allowed the teams to embrace complexity, it was the HCD approach that actually produced a shift in researchers' mind-set: from HIS as data management tools to HIS as quality of care instruments. HCD allowed navigating the complexity of health systems interventions due to its capacity to operate change: it not only allowed us to understand how the PHISICC tools were used but also how to further improve them. In the absence of (or even with) an analytical health systems framework, HCD approaches can work in real-life situations for the ideation, testing and implementation of interventions to improve health systems and health status outcomes.

Framework synthesis to inform the ideation and design of a paper-based health information system (PHISICC)

Background

Health information systems (HIS) are meant to support decision‐making at all levels of the system, including frontline health workers. In field studies in Côte d’Ivoire, Mozambique and Nigeria, we observed health workers' interactions with the HIS and identified twelve decision‐making components of HIS. The objective of this framework synthesis is to portray these components in HIS research, in order to inform the ideation of a paper‐based HIS intervention (PHISICC).

Methods

We searched studies in the Cochrane Central Register of Controlled Trials (CENTRAL), Embase, Epistemonikos, Medline, in‐Process on the Ovid platform, OpenGrey, PDQ  Evidence (“pretty darnd quick” Evidence), the World Health Organization (WHO) Global Health Library and included studies focussing on HIS interventions, data quality, information support tools and data use for decision‐making in the context of the governmental health care sector. We assessed the methodological quality of studies using the Critical Appraisal Skills Programme tool. We synthesised the findings based on the decision‐making components of HIS and thematic areas.

Results

The search identified 6784 studies; 50 were included. Most of the 50 studies had quality concerns. All studies included at least one of the decision‐making components: the most prominent were the technical aspects of ‘recording’ and ‘reporting’. Data use for decision‐making was much less represented.

Conclusion

HIS research focuses on the more technical aspects of HIS. Further research on HIS, given the strong push towards HIS digitalisation, should consider putting at the centre the human experience of decision‐making and data use, in order to make HIS relevant for quality of care.

Across the health system, Health Information Systems (HIS) are meant to support data management and use, which are key activities of health care delivery.

Informed by existing frameworks and by fieldwork in three African countries, we identified twelve decision‐making components of HIS.

In this framework synthesis, we found that the most common decision‐making components in the HIS literature were those related to the technical aspects of data ‘recording’ and ‘reporting’; data use for decision‐making was much less represented.

For HIS instruments to facilitate improved health care delivery, clinical and public health decision‐making components of HIS should be put at the centre for HIS research, ideation and implementation.

Researching, co-creating and testing innovations in paper-based health information systems (PHISICC) to support health workers' decision-making: protocol of a multi-country, transdisciplinary, mixed-methods research programme in three sub-Saharan countries

Background

Health information systems are crucial to provide data for decision-making and demand for data is constantly growing. However, the link between data and decisions is not always rational or linear and the management of data ends up overloading frontline health workers, which may compromise quality of healthcare delivery. Despite limited evidence, there is an increasing push for the digitalization of health information systems, which poses enormous challenges, particularly in remote, rural settings in low- and middle-income countries. Paper-based tools will continue to be used in combination with digital solutions and this calls for efforts to make them more responsive to local needs. Paper-based Health Information Systems in Comprehensive Care (PHISICC) is a transdisciplinary, multi-country research initiative to create and test innovative paper-based health information systems in three sub-Saharan African countries.

Methods/Design

The PHISICC initiative is being carried out in remote, rural settings in Côte d’Ivoire, Mozambique and Nigeria through partnership with ministries of health and research institutions. We began with research syntheses to acquire the most up-to-date knowledge on health information systems. These were coupled with fieldwork in the three countries to understand the current design, patterns and contexts of use, and healthcare worker perspectives. Frontline health workers, with designers and researchers, used co-creation methods to produce the new PHISICC tools. This suite of tools is being tested in the three countries in three cluster-randomized controlled trials. Throughout the project, we have engaged with a wide range of stakeholders and have maintained the highest scientific standards to ensure that results are relevant to the realities in the three countries.

Discussion

We have deployed a comprehensive research approach to ensure the robustness and future policy uptake of findings. Besides the innovative PHISICC paper-based tools, our process is in itself innovative. Rather than emphasizing the technical dimensions of data management, we focused instead on frontline health workers’ data use and decision-making. By tackling the whole scope of primary healthcare areas rather than a subset of them, we have developed an entirely new design and visual language for a suite of tools across healthcare areas. The initiative is being tested in remote, rural areas where the most vulnerable live.