Paving the Way for the Implementation of a Decision Support System for Antibiotic Prescribing in Primary Care in West Africa: Preimplementation and Co-Design Workshop With Physicians

Electronic Co-design (ECO-design) Workshop for Increasing Clinician Participation in the Design of Health Services Interventions: Participatory Design Approach

BACKGROUND

Participation from clinician stakeholders can improve the design and implementation of health care interventions. Participatory design methods, especially co-design methods, comprise stakeholder-led design activities that are time-consuming. Competing work demands and increasing workloads make clinicians' commitments to typical participatory methods even harder. The COVID-19 pandemic further exacerbated barriers to clinician participation in such interventions.

OBJECTIVE

The aim of this study was to explore a web-based participatory design approach to conduct economical, electronic co-design (ECO-design) workshops with primary care clinicians.

METHODS

We adapted traditional in-person co-design workshops to web-based delivery and adapted co-design workshop series to fit within a single 1-hour session. We applied the ECO-design workshop approach to codevelop feedback interventions regarding abnormal test result follow-up in primary care. We conducted ECO-design workshops with primary care clinicians at a medical center in Southern Texas, using videoconferencing software. Each workshop focused on one of three types of feedback interventions: conversation guide, email template, and dashboard prototype. We paired electronic materials and software features to facilitate participant interactions, prototyping, and data collection. The workshop protocol included four main activities: problem identification, solution generation, prototyping, and debriefing. Two facilitators were assigned to each workshop and one researcher resolved technical problems. After the workshops, our research team met to debrief and evaluate workshops.

RESULTS

A total of 28 primary care clinicians participated in our ECO-design workshops. We completed 4 parallel workshops, each with 5-10 participants. We conducted traditional analyses and generated a clinician persona (ie, representative description) and user interface prototypes. We also formulated recommendations for future ECO-design workshop recruitment, technology, facilitation, and data collection. Overall, our adapted workshops successfully enabled primary care clinicians to participate without increasing their workload, even during a pandemic.

CONCLUSIONS

ECO-design workshops are viable, economical alternatives to traditional approaches. This approach fills a need for efficient methods to involve busy clinicians in the design of health care interventions.

Barriers and facilitators of implementing interventions to improve appropriate antibiotic use in low- and middle-income countries: a systematic review based on the Consolidated Framework for Implementation Research

Background

Behavior change interventions that aim to improve rational antibiotic use in prescribers and users have been widely conducted in both high- and LMICs. However, currently, no review has systematically examined challenges unique to LMICs and offered insights into the underlying contextual factors that influence these interventions. We adopted an implementation research perspective to systematically synthesize the implementation barriers and facilitators in LMICs.

Methods

We conducted literature searches in five electronic databases and identified studies that involved the implementation of behavior change interventions to improve appropriate antibiotic use in prescribers and users in LMICs and reported implementation barriers and facilitators. Behavior change interventions were defined using the behavior change wheel, and the coding and synthesis of barriers and facilitators were guided by the Consolidated Framework for Implementation Research (CFIR).

Results

We identified 52 eligible studies, with the majority targeting prescribers practicing at tertiary facilities (N=39, 75%). The most commonly reported factors influencing implementation were found in the inner setting domain of the CFIR framework, particularly related to constraints in resources and the infrastructure of the facilities where interventions were implemented. Barriers related to the external policy environment (e.g., lack of national initiatives and policies on antibiotic use), and individual characteristics of target populations (e.g., reluctance to change prescribing behaviors) were also common, as well as facilitators related to intervention characteristics (e.g., embedding interventions in routine practice) and process (e.g., stakeholder engagement). We also provided insights into the interrelationships between these factors and the underlying causes contributing to the implementation challenges in LMICs.

Conclusion

We presented a comprehensive overview of the barriers and facilitators of implementing behavior change interventions to promote rational antibiotic use in LMICs. Our findings suggest that facilitating the implementation of interventions to improve rational antibiotic use needs comprehensive efforts to address challenges at policy, organizational, and implementation levels. Specific strategies include (1) strengthening political commitment to prompt mobilization of domestic resources and formulation of a sustainable national strategy on AMR, (2) improving the infrastructure of health facilities that allow prescribers to make evidence-based clinical decisions, and (3) engaging local stakeholders to improve their buy-in and facilitate contextualizing interventions.

Trial registration

PROSPERO: CRD42021252715.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-022-01209-4.

External validation of a mobile clinical decision support system for diarrhea etiology prediction in children: a multicenter study in Bangladesh and Mali

Background: Diarrheal illness is a leading cause of antibiotic use for children in low- and middle-income countries. Determination of diarrhea etiology at the point-of-care without reliance on laboratory testing has the potential to reduce inappropriate antibiotic use.

Methods: This prospective observational study aimed to develop and externally validate the accuracy of a mobile software application ('App') for the prediction of viral-only etiology of acute diarrhea in children 0-59 months in Bangladesh and Mali. The App used a previously derived and internally validated model consisting of patient-specific ('present patient') clinical variables (age, blood in stool, vomiting, breastfeeding status, and mid-upper arm circumference) as well as location-specific viral diarrhea seasonality curves. The performance of additional models using the 'present patient' data combined with other external data sources including location-specific climate, data, recent patient data, and historical population-based prevalence were also evaluated in secondary analysis. Diarrhea etiology was determined with TaqMan Array Card using episode-specific attributable fraction (AFe) >0.5.

Results: Of 302 children with acute diarrhea enrolled, 199 had etiologies above the AFe threshold. Viral-only pathogens were detected in 22% of patients in Mali and 63% in Bangladesh. Rotavirus was the most common pathogen detected (16% Mali; 60% Bangladesh). The present patient + viral seasonality model had an AUC of 0.754 (0.665-0.843) for the sites combined, with calibration-in-the-large α=-0.393 (-0.455 - -0.331) and calibration slope β=1.287 (1.207 - 1.367). By site, the present patient + recent patient model performed best in Mali with an AUC of 0.783 (0.705 - 0.86); the present patient + viral seasonality model performed best in Bangladesh with AUC 0.710 (0.595 - 0.825).

Conclusion: The App accurately identified children with high likelihood of viral-only diarrhea etiology. Further studies to evaluate the App's potential use in diagnostic and antimicrobial stewardship are underway.

Funding: Funding for this study was provided through grants from the Bill and Melinda Gates Foundation (OPP1198876) and the National Institute of Allergy and Infectious Diseases (R01AI135114). Several investigators were also partially supported by a grant from the National Institute of Diabetes and Digestive and Kidney Diseases (R01DK116163). This investigation was also supported by the University of Utah Population Health Research (PHR) Foundation, with funding in part from the National Center for Advancing Translational Sciences of the National Institutes of Health under Award Number UL1TR002538. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The funders had no role in the study design, data collection, data analysis, interpretation of data, or in the writing or decision to submit the manuscript for publication.

Clinical Utility and Functionality of an Artificial Intelligence-Based App to Predict Mortality in COVID-19: Mixed Methods Analysis

Background

The artificial neural network (ANN) is an increasingly important tool in the context of solving complex medical classification problems. However, one of the principal challenges in leveraging artificial intelligence technology in the health care setting has been the relative inability to translate models into clinician workflow.

Objective

Here we demonstrate the development of a COVID-19 outcome prediction app that utilizes an ANN and assesses its usability in the clinical setting.

Methods

Usability assessment was conducted using the app, followed by a semistructured end-user interview. Usability was specified by effectiveness, efficiency, and satisfaction measures. These data were reported with descriptive statistics. The end-user interview data were analyzed using the thematic framework method, which allowed for the development of themes from the interview narratives. In total, 31 National Health Service physicians at a West London teaching hospital, including foundation physicians, senior house officers, registrars, and consultants, were included in this study.

Results

All participants were able to complete the assessment, with a mean time to complete separate patient vignettes of 59.35 (SD 10.35) seconds. The mean system usability scale score was 91.94 (SD 8.54), which corresponds to a qualitative rating of “excellent.” The clinicians found the app intuitive and easy to use, with the majority describing its predictions as a useful adjunct to their clinical practice. The main concern was related to the use of the app in isolation rather than in conjunction with other clinical parameters. However, most clinicians speculated that the app could positively reinforce or validate their clinical decision-making.

Conclusions

Translating artificial intelligence technologies into the clinical setting remains an important but challenging task. We demonstrate the effectiveness, efficiency, and system usability of a web-based app designed to predict the outcomes of patients with COVID-19 from an ANN.

Development and Preliminary Validation of LoAD Calc, a Mobile App for Calculating the Maximum Safe Single Dose of Local Anesthetics

Local anesthetics systemic toxicity can lead to life-threatening situations. Correct calculation of the maximum safe dose is therefore paramount in preventing such complications. Different solutions have already emerged to support anesthesiologists but are seldom used in clinical practice as they require either access to a computer or specific documents to be at hand. A mobile app could provide an easy and practical solution; however, the few apps already created for this purpose often lack key elements, allowing invalid data to be entered and suggesting doses that might exceed the maximum safe dose. We describe the development of LoAD Calc, a mobile health (mHealth) app developed using a modified version of the Information Systems Research framework, which adds design thinking modes to the original framework. The app was enhanced through multiple iterations and developed with the aid of contextual observations and interviews, brainswarming sessions, prototyping, and continuous feedback. The design process led to the creation of two prototypes which underwent thorough testing by a sample of eight anesthesiologists. The final version of the app, LoAD Calc, was deployed on Apple and Android mobile test platforms and tested again by the same sample until deemed fit for release.

A Systematic Review of Design Workshops for Health Information Technologies

Background: Design workshops offer effective methods in eliciting end-user participation from design inception to completion. Workshops unite stakeholders in the utilization of participatory methods, coalescing in the best possible creative solutions. Objective: This systematic review aimed to identify design approaches whilst providing guidance to health information technology designers/researchers in devising and organizing workshops. Methods: A systematic literature search was conducted in five medical/library databases identifying 568 articles. The initial duplication removal resulted in 562 articles. A criteria-based screening of the title field, abstracts, and pre-full-texts reviews resulted in 72 records for full-text review. The final review resulted in 10 article exclusions. Results: 62 publications were included in the review. These studies focused on consumer facing and clinical health information technologies. The studied technologies involved both clinician and patients and encompassed an array of health conditions. Diverse workshop activities and deliverables were reported. Only seven publications reported workshop evaluation data. Discussion: This systematic review focused on workshops as a design and research activity in the health informatics domain. Our review revealed three themes: (1) There are a variety of ways of conducting design workshops; (2) Workshops are effective design and research approaches; (3) Various levels of workshop details were reported.

Antimicrobial stewardship solutions with a smart innovative tool

BACKGROUND

Antimicrobial consumption has been increasing lately. Hence, effective strategies are required to control antimicrobial use and decrease the development of antimicrobial resistance.

OBJECTIVE

To evaluate the impact of the use of a mobile app on the implementation of antimicrobial stewardship program (ASP) interventions.

METHODS

This was a longitudinal study conducted at El-Nile Badrawi Hospital in Cairo, Egypt, on inpatients receiving antimicrobials from January 2018 to December 2019. The study included 2 phases: the preimplementation phase, which included a paper-based ASP developed according to the Centers for Disease Control and Prevention Core Elements of Hospital Antibiotic Stewardship Programs 2014, and the mobile app phase where the MEDIcare Pro mobile app was developed and used in ASP intervention implementation. The study outcomes were antimicrobial consumption and cost, length of hospital and intensive care unit (ICU) stay, 30-day mortality rate and readmission rate, and detection of drug-related problems (DRPs).

RESULTS

The mobile app statistically significantly decreased antimicrobial consumption from 75.1 defined daily dose (DDD)/100 bed-days in the preimplementation phase to 64.65 DDD/100 bed-days in the mobile app phase, with a total cost savings of E£1,237,476. There was a significant reduction in the length of ICU stay, with a mean difference of 1.63 days between the 2 phases, but no significance was detected regarding length of hospital stay or readmission rate. There was a statistically significant decrease in mortality rate from 1.17% in the preimplementation phase to 0.83% in the mobile app phase (P = 0.02). The frequency of DRPs detected by pharmacists statistically significantly increased from 0.54/100 bed-days in the preimplementation phase to 3.23/100 bed-days in the mobile app phase.

CONCLUSION

The use of a mobile app was found to be effective, applicable, and usable in guiding health professionals on rational antimicrobial use.

Are We Making the Most of Community Pharmacies? Implementation of Antimicrobial Stewardship Measures in Community Pharmacies: A Narrative Review

Community pharmacists recognize the need to implement antimicrobial stewardship activities in community pharmacies. They are in a unique position to provide triage for common primary care indications and to lower the burden of patients at general practitioners’ offices. However, research shows that, in some areas, dispensing of antimicrobials without valid prescription is still highly prevalent. Regardless of training, every community pharmacist can give his contribution to antimicrobial stewardship. One of the basic elements should be antimicrobial dispensing according to regulations, either prescription only, or according to guidelines where pharmacists have prescribing authority. Patient consultation supported with educational materials, such as leaflets, may reduce patients’ expectations to receive antibiotics for self-limiting infections and reduce pressure on general practitioners to prescribe antibiotics on patients’ demand. Treatment optimization may be achieved in collaboration with the prescribing general practitioners or by providing feedback. At last, pharmacists provided with additional training may be encouraged to provide consultation services to long-term care facilities, to introduce point-of-care testing for infectious diseases in their pharmacies or prescribe antimicrobials for uncomplicated infections. These services are welcomed by patients and communities. Expanding pharmacy services and pharmacists’ prescribing autonomy have shown a positive impact by reducing antibiotics consumption, thus ensuring better compliance with treatment guidelines.