Tracking health commodity inventory and notifying stock levels via mobile devices: a mixed methods systematic review

BACKGROUND

Health systems need timely and reliable access to essential medicines and health commodities, but problems with access are common in many settings. Mobile technologies offer potential low-cost solutions to the challenge of drug distribution and commodity availability in primary healthcare settings. However, the evidence on the use of mobile devices to address commodity shortages is sparse, and offers no clear way forward.

OBJECTIVES

Primary objective To assess the effects of strategies for notifying stock levels and digital tracking of healthcare-related commodities and inventory via mobile devices across the primary healthcare system Secondary objectives To describe what mobile device strategies are currently being used to improve reporting and digital tracking of health commodities To identify factors influencing the implementation of mobile device interventions targeted at reducing stockouts of health commodities SEARCH METHODS: We searched CENTRAL, MEDLINE Ovid, Embase Ovid, Global Index Medicus WHO, POPLINE K4Health, and two trials registries in August 2019. We also searched Epistemonikos for related systematic reviews and potentially eligible primary studies. We conducted a grey literature search using mHealthevidence.org, and issued a call for papers through popular digital health communities of practice. Finally, we conducted citation searches of included studies. We searched for studies published after 2000, in any language.

SELECTION CRITERIA

For the primary objective, we included individual and cluster-randomised trials, controlled before-after studies, and interrupted time series studies. For the secondary objectives, we included any study design, which could be quantitative, qualitative, or descriptive, that aimed to describe current strategies for commodity tracking or stock notification via mobile devices; or aimed to explore factors that influenced the implementation of these strategies, including studies of acceptability or feasibility. We included studies of all cadres of healthcare providers, including lay health workers, and others involved in the distribution of health commodities (administrative staff, managerial and supervisory staff, dispensary staff); and all other individuals involved in stock notification, who may be based in a facility or a community setting, and involved with the delivery of primary healthcare services. We included interventions aimed at improving the availability of health commodities using mobile devices in primary healthcare settings. For the primary objective, we included studies that compared health commodity tracking or stock notification via mobile devices with standard practice. For the secondary objectives, we included studies of health commodity tracking and stock notification via mobile device, if we could extract data relevant to our secondary objectives.

DATA COLLECTION AND ANALYSIS

For the primary objective, two authors independently screened all records, extracted data from the included studies, and assessed the risk of bias. For the analyses of the primary objectives, we reported means and proportions where appropriate. We used the GRADE approach to assess the certainty of the evidence, and prepared a 'Summary of findings' table. For the secondary objective, two authors independently screened all records, extracted data from the included studies, and applied a thematic synthesis approach to synthesise the data. We assessed methodological limitation using the Ways of Evaluating Important and Relevant Data (WEIRD) tool. We used the GRADE-CERQual approach to assess our confidence in the evidence, and prepared a 'Summary of qualitative findings' table.

MAIN RESULTS

Primary objective For the primary objective, we included one controlled before-after study conducted in Malawi. We are uncertain of the effect of cStock plus enhanced management, or cStock plus effective product transport on the availability of commodities, quality and timeliness of stock management, and satisfaction and acceptability, because we assessed the evidence as very low-certainty. The study did not report on resource use or unintended consequences. Secondary objective For the secondary objectives, we included 16 studies, using a range of study designs, which described a total of eleven interventions. All studies were conducted in African (Tanzania, Kenya, Malawi, Ghana, Ethiopia, Cameroon, Zambia, Liberia, Uganda, South Africa, and Rwanda) and Asian (Pakistan and India) countries. Most of the interventions aimed to make data about stock levels and potential stockouts visible to managers, who could then take corrective action to address them. We identified several factors that may influence the implementation of stock notification and tracking via mobile device. These include challenges tied to infrastructural issues, such as poor access to electricity or internet, and broader health systems issues, such as drug shortages at the national level which cannot be mitigated by interventions at the primary healthcare level (low confidence). Several factors were identified as important, including strong partnerships with local authorities, telecommunication companies, technical system providers, and non-governmental organizations (very low confidence); availability of stock-level data at all levels of the health system (low confidence); the role of supportive supervision and responsive management (moderate confidence); familiarity and training of health workers in the use of the digital devices (moderate confidence); availability of technical programming expertise for the initial development and ongoing maintenance of the digital systems (low confidence); incentives, such as phone credit for personal use, to support regular use of the system (low confidence); easy-to-use systems built with user participation (moderate confidence); use of basic or personal mobile phones to support easier adoption (low confidence); consideration for software features, such as two-way communication (low confidence); and data availability in an easy-to-use format, such as an interactive dashboard (moderate confidence).

AUTHORS' CONCLUSIONS

We need more, well-designed, controlled studies comparing stock notification and commodity management via mobile devices with paper-based commodity management systems. Further studies are needed to understand the factors that may influence the implementation of such interventions, and how implementation considerations differ by variations in the intervention.

The association between use of a clinical decision support tool and adherence to monitoring for medication-laboratory guidelines in the ambulatory setting

BACKGROUND

Stage 2 Meaningful Use criteria require the use of clinical decision support systems (CDSS) on high priority health conditions to improve clinical quality measures. Although CDSS hold great promise, implementation has been fraught with challenges, evidence of their impact is mixed, and the optimal method of content delivery is unknown.

OBJECTIVE

The authors investigated whether implementation of a simple clinical decision support (CDS) tool was associated with improved prescriber adherence to national medication-laboratory monitoring guidelines for safety (hepatic function, renal function, myalgias/rhabdomyolysis) and intermediate outcomes for antidiabetic (Hemoglobin A(1c); HbA(1c)) and antihyperlipidemic (low density lipoprotein; LDL) medications prescribed within a diabetes registry.

METHODS

This was a retrospective observational study conducted in three phases of CDS implementation (2008-2009): pre-, transition-, and post-Prescriptions evaluated were ordered from an electronic health record within a multispecialty medical group. Adherence was evaluated within and without applying guideline-imposed time constraints.

RESULTS

Forty-thousand prescriptions were ordered over three timeframes. For hepatic and renal function, the proportion of prescriptions for which labs were monitored at any time increased from 52% to 65% (p<0.001); those that met time guidelines, from 14% to 21% (p<0.001). Only 6% of required labs were drawn to monitor for myalgias/rhabdomyolysis, regardless of timeframe. Over 90% of safety labs were within normal limits. The proportion of labs monitored at any time for LDL increased from 56% to 64% (p<0.001); those that met time guidelines from 11% to 17% (p<0.001). The proportion of labs monitored at any time for HbA(1c) remained the same (72%); those that met time guidelines decreased from 45% to 41% (p<0.001).

CONCLUSION

A simple CDS tool may be associated with improved adherence to guidelines. Efforts are needed to confirm findings and improve the timeliness of monitoring; investigations to optimize alerts should be ongoing.

The impact of accelerating electronic prescribing on hospitals' productivity levels: can health information technology bend the curve?

This paper examines how different strategies for implementing computerized prescriber order entry (CPOE) impact hospitals' productivity. We used the American Hospital Association's Annual Survey to construct hospital-level measures for 1,812 facilities and analyzed the productivity indices against CPOE use rates. The relationship between CPOE use rates and indices for "technical efficiency change" and "total factor productivity" was significant. Hospitals introducing CPOE facilitywide in a one-year period (where usage went from zero to more than 50%) experienced declines in both productivity indices. One implication is that hospitals achieving the goals of the "meaningful use" program promoted by the Centers for Medicare and Medicaid Services may do so at the expense of productivity.

Ability of pharmacy clinical decision-support software to alert users about clinically important drug-drug interactions

OBJECTIVE

Pharmacy clinical decision-support (CDS) software that contains drug-drug interaction (DDI) information may augment pharmacists' ability to detect clinically significant interactions. However, studies indicate these systems may miss some important interactions. The purpose of this study was to assess the performance of pharmacy CDS programs to detect clinically important DDIs.

DESIGN

Researchers made on-site visits to 64 participating Arizona pharmacies between December 2008 and November 2009 to analyze the ability of pharmacy information systems and associated CDS to detect DDIs. Software evaluation was conducted to determine whether DDI alerts arose from prescription orders entered into the pharmacy computer systems for a standardized fictitious patient. The fictitious patient's orders consisted of 18 different medications including 19 drug pairs-13 of which were clinically significant DDIs, and six were non-interacting drug pairs.

MEASUREMENTS

The sensitivity, specificity, positive predictive value, negative predictive value, and percentage of correct responses were measured for each of the pharmacy CDS systems.

RESULTS

Only 18 (28%) of the 64 pharmacies correctly identified eligible interactions and non-interactions. The median percentage of correct DDI responses was 89% (range 47-100%) for participating pharmacies. The median sensitivity to detect well-established interactions was 0.85 (range 0.23-1.0); median specificity was 1.0 (range 0.83-1.0); median positive predictive value was 1.0 (range 0.88-1.0); and median negative predictive value was 0.75 (range 0.38-1.0).

CONCLUSIONS

These study results indicate that many pharmacy clinical decision-support systems perform less than optimally with respect to identifying well-known, clinically relevant interactions. Comprehensive system improvements regarding the manner in which pharmacy information systems identify potential DDIs are warranted.