Patient and physician predictors of patient receipt of therapies recommended by a computerized decision support system when initially prescribed broad-spectrum antibiotics: a cohort study

Effects of a Pharmacist-Designed Clinical Decision Support System on Antimicrobial Stewardship

BACKGROUND

 Clinical decision support systems (CDSSs) are computer applications, which can be applied to give guidance to practitioners in antimicrobial stewardship (AS) activities; however, further information is needed for their optimal use.

OBJECTIVES

 Our objective was to analyze the implementation of a CDSS program in a second-level hospital, describing alerts, recommendations, and the effects on consumption and clinical outcomes.

METHODS

 In October 2020, a pharmacist-driven CDSS designed for AS was implemented in a second-level hospital. The program provides a list of alerts related to antimicrobial treatment and microbiology, which were automatized for revision by the AS professionals. To analyze the implementation of the CDSS, a pre-post-intervention, retrospective study was designed. AS-triggered alerts and recommendations (total number and rate of acceptance) were compiled. The effect of the CDSS was measured using antimicrobial consumption, duration of antimicrobial treatments, in-hospital mortality, and length of stay (LOS) for patients admitted for infectious causes.

RESULTS

 The AS team revised a total of 7,543 alerts and 772 patients had at least one recommendation, with an acceptance rate of 79.3%. Antimicrobial consumption decreased from 691.1 to 656.8 defined daily doses (DDD)/1,000 beds-month (p = 0.04) and the duration of antimicrobial treatment from 3.6 to 3.3 days (p < 0.01). In-hospital mortality decreased from 6.6 to 6.2% (p = 0.46) and mean LOS from 7.2 to 6.2 days (p < 0.01).

CONCLUSION

 The implementation of a CDSS resulted in a significant reduction of antimicrobial DDD, duration of antimicrobial treatments, and hospital LOS. There was no significant difference in mortality.

Are physicians ready for precision antibiotic prescribing? A qualitative analysis of the acceptance of artificial intelligence-enabled clinical decision support systems in India and Singapore

OBJECTIVES

Artificial intelligence (AI)-driven clinical decision support systems (CDSSs) can augment antibiotic decision-making capabilities, but physicians' hesitancy in adopting them may undermine their utility. We conducted a cross-country comparison of physician perceptions on the barriers and facilitators in accepting an AI-enabled CDSS for antibiotic prescribing.

METHODS

We conducted in-depth interviews with physicians from the National Centre for Infectious Diseases (NCID), Singapore, and Christian Medical College Vellore (CMCV), India, between April and December 2022. Our semi-structured in-depth interview guides were anchored on Venkatesh's UTAUT model. We used clinical vignettes to illustrate the application of AI in clinical decision support for antibiotic prescribing and explore medico-legal concerns.

RESULTS

Most NCID physicians felt that an AI-enabled CDSS could facilitate antibiotic prescribing, while most CMCV physicians were sceptical about the tool's utility. The hesitancy in adopting an AI-enabled CDSS stems from concerns about the lack of validated and successful examples, fear of losing autonomy and clinical skills, difficulty of use, and impediment in work efficiency. Physicians from both sites felt that a user-friendly interface, integration with workflow, transparency of output, a guiding medico-legal framework, and training and technical support would improve the uptake of an AI-enabled CDSS.

CONCLUSION

In conclusion, the acceptance of AI-enabled CDSSs depends on the physician's confidence with the tool's recommendations, perceived ease of use, familiarity with AI, the organisation's digital culture and support, and the presence of medico-legal governance of AI. Progressive implementation and continuous feedback are essential to allay scepticism around the utility of AI-enabled CDSSs.

Sustaining Antimicrobial Stewardship in a High-Antibiotic Resistance Setting

IMPORTANCE

There is a lack of studies comparing the intended and unintended consequences of prospective review and feedback (PRF) with computerized decision support systems (CDSS), especially in the longer term in antimicrobial stewardship.

OBJECTIVE

To examine the outcomes associated with the sequential implementation of PRF and CDSS and changes to these interventions with long-term use of antibiotics for and incidence of multidrug resistant organisms (MDROs) and other unintended outcomes.

DESIGN, SETTING, AND PARTICIPANTS

This cohort study used an interrupted time series with segmented regression analysis of data from January 2007 to December 2018. Data were extracted from the electronic medical records of patients admitted at a large university teaching hospital with high rates of antibiotic resistance in Singapore. Data were analyzed from June 2019 to June 2020.

EXPOSURES

PRF of piperacillin-tazobactam and carbapenems (intervention 1, April 2009), with the addition of hospital-wide CDSS (intervention 2, April 2011), and lifting of CDSS for half of the hospital wards for 6 months (intervention 3, March 2017).

MAIN OUTCOMES AND MEASURES

Monthly antimicrobial use was measured in defined daily doses (DDDs) per 1000 patient-days. The monthly incidence of MDROs was calculated as number of clinical isolates detected per 1000 inpatient-days over a 6-month period. Unintended outcomes examined included in-hospital mortality and age-adjusted length of stay (LOS).

RESULTS

The number of inpatients increased from 56 263 in 2007 to 63 572 in 2018. During the same period, the mean monthly patient days increased from 33 929 in 2007 to 45 603 in 2018, and the proportion of patients older than 65 years increased from 45.5% in 2007 to 56.6% in 2018. After intervention 1, there were 0.33 (95% CI, 0.18 to 0.48) more DDDs per 1000 patient-days per month of piperacillin-tazobactam and carbapenems and -11.05 (95% CI, -15.55 to -6.55) fewer DDDs per 1000 patient-days per month for other broad-spectrum antibiotics. After intervention 2, there were -0.22 (95% CI, -0.33 to -0.10) fewer DDDs per 1000 patient-days per month of piperacillin-tazobactam and carbapenems and -2.10 (95% CI, -3.13 to -1.07) fewer DDDs per 1000 patient-days per month for other broad-spectrum antibiotics. After intervention 3, use of piperacillin-tazobactam and carbapenem increased by 0.28 (95% CI, 0.02 to 0.55) DDDs per 1000 patient-days per month. After intervention 2, incidence of Clostridioides difficile decreased (estimate, -0.02 [95% CI, -0.03 to -0.01] cases per 1000 patient-days per month).

CONCLUSIONS AND RELEVANCE

In this cohort study, concurrent PRF and CDSS were associated with limiting the use of piperacillin-tazobactam and carbapenems while reducing use of other antibiotics.

Hospital Pharmacists and Antimicrobial Stewardship: A Qualitative Analysis

Antimicrobial stewardship programmes (ASPs) in hospitals are predominantly led by specific ASP physicians and pharmacists. Limited studies have been conducted to appreciate non-ASP-trained hospital pharmacists' perspectives on their roles in antimicrobial stewardship. Focus group discussions (FGDs) were conducted with 74 pharmacists, purposively sampled from the 3 largest acute-care public hospitals in Singapore, to explore facilitators and barriers faced by them in antimicrobial stewardship. Applied thematic analysis was conducted and codes were categorised using the social-ecological model (SEM). At the intrapersonal level, pharmacists identified themselves as reviewers for drug safety before dispensing, confining to a restricted advisory role due to lack of clinical knowledge, experience, and empowerment to contribute actively to physicians' prescribing decisions. At the interpersonal level, pharmacists expressed difficulties conveying their opinions and recommendations on antibiotic therapy to physicians despite frequent communications, but they assumed critical roles as educators for patients and their caregivers on proper antibiotic use. At the organisational level, in-house antibiotic guidelines supported pharmacists' antibiotic interventions and recommendations. At the community level, pharmacists were motivated to improve low public awareness and knowledge on antibiotic use and antimicrobial resistance. These findings provide important insights into the gaps to be addressed in order to harness the untapped potential of hospital pharmacists and fully engage them in antimicrobial stewardship.

Effective Antimicrobial StewaRdship StrategIES (ARIES): Cluster Randomized Trial of Computerized Decision Support System and Prospective Review and Feedback

Background

Prospective review and feedback (PRF) of antibiotic prescriptions and compulsory computerized decision support system (CDSS) are 2 strategies of antimicrobial stewardship. There are limited studies investigating their combined effects. We hypothesized that the use of on-demand (voluntary) CDSS would achieve similar patient outcomes compared with automatically triggered (compulsory) CDSS whenever broad-spectrum antibiotics are ordered.

Methods

A parallel-group, 1:1 block cluster randomized crossover study was conducted in 32 medical and surgical wards from March to August 2017. CDSS use for piperacillin-tazobactam or carbapenem in the intervention clusters was at the demand of the doctor, while in the control clusters CDSS use was compulsory. PRF was continued for both arms. The primary outcome was 30-day mortality.

Results

Six hundred forty-one and 616 patients were randomized to voluntary and compulsory CDSS, respectively. There were no differences in 30-day mortality (hazard ratio [HR], 0.87; 95% CI, 0.67–1.12), re-infection and re-admission rates, antibiotic duration, length of stay, or hospitalization cost. The proportion of patients receiving PRF recommendations was not significantly lower in the voluntary CDSS arm (62 [10%] vs 81 [13%]; P = .05). Appropriate indication of antibiotics was high in both arms (351/448 [78%] vs 330/433 [74%]; P = .18). However, in geriatric medicine patients where antibiotic appropriateness was <50%, prescription via compulsory CDSS resulted in a shorter length of stay and lower hospitalization cost.

Conclusions

Voluntary broad-spectrum antibiotics with PRF via CDSS did not result in differing clinical outcomes, antibiotic duration, or length of stay. However, in the setting of low antibiotic appropriateness, compulsory CDSS may be beneficial.

Clinical Decision Support Systems and Their Role in Antibiotic Stewardship: a Systematic Review

PURPOSE OF REVIEW

The purpose of this article is to perform a systematic review over the past 5 years on the role and effectiveness of clinical decision support systems (CDSSs) on antibiotic stewardship.

RECENT FINDINGS

CDDS interventions found a significant impact on multiple outcomes relevant to antibiotic stewardship. There are various types of CDSS implementations, both active and passive (provider initiated). Passive interventions were associated with more significant outcomes; however, both interventions appeared effective. In the reviewed literature, CDSSs were consistently associated with decreasing antibiotic consumption and narrowing the spectrum of antibiotic usage. Generally, guideline adherence was improved with CDSS, although this was not universal. The effect on other outcomes, such as mortality, Clostridiodes difficile infections, length of stay, and cost, inconsistently showed a significant difference. Overall, CDDS implementation has effectively decreased antibiotic consumption and improved guideline adherence across the various types of CDSS. Other positive outcomes were noted in certain settings, but were not universal. When creating a new intervention, it is important to identify the optimal structure and deployment of a CDSS for a specific setting.

Determinants of antibiotic prescribing for upper respiratory tract infections in an emergency department with good primary care access: a qualitative analysis

Upper respiratory tract infections (URTIs) account for substantial attendances at emergency departments (EDs). There is a need to elucidate determinants of antibiotic prescribing in time-strapped EDs - popular choices for primary care despite highly accessible primary care clinics. Semi-structured in-depth interviews were conducted with purposively sampled physicians (n = 9) in an adult ED in Singapore. All interviews were analysed using thematic analysis and further interpreted using the Social Ecological Model to explain prescribing determinants. Themes included: (1) reliance on clinical knowledge and judgement, (2) patient-related factors, (3) patient-physician relationship factors, (4) perceived practice norms, (5) policies and treatment guidelines and (6) patient education and awareness. The physicians relied strongly on their clinical knowledge and judgement in managing URTI cases and seldom interfered with their peers' clinical decisions. Despite departmental norms of not prescribing antibiotics for URTIs, physicians would prescribe antibiotics when faced with uncertainty in patients' diagnoses, treating immunocompromised or older patients with comorbidities, and for patients demanding antibiotics, especially under time constraints. Participants had a preference for antibiotic prescribing guidelines based on local epidemiology, but viewed hospital policies on prescribing as a hindrance to clinical judgement. Participants highlighted the need for more public education and awareness on the appropriate use of antibiotics and management of URTIs. Organisational practice norms strongly influenced antibiotic prescribing decisions by physicians, who can be swayed by time pressures and patient demands. Clinical decision support tools, hospital guidelines and patient education targeting at individual, interpersonal and community levels could reduce unnecessary antibiotic use.

CDS in a Learning Health Care System: Identifying Physicians' Reasons for Rejection of Best-Practice Recommendations in Pneumonia through Computerized Clinical Decision Support

BACKGROUND

Local implementation of guidelines for pneumonia care is strongly recommended, but the context of care that affects implementation is poorly understood. In a learning health care system, computerized clinical decision support (CDS) provides an opportunity to both improve and track practice, providing insights into the implementation process.

OBJECTIVES

This article examines physician interactions with a CDS to identify reasons for rejection of guideline recommendations.

METHODS

We implemented a multicenter bedside CDS for the emergency department management of pneumonia that integrated patient data with guideline-based recommendations. We examined the frequency of adoption versus rejection of recommendations for site-of-care and antibiotic selection. We analyzed free-text responses provided by physicians explaining their clinical reasoning for rejection, using concept mapping and thematic analysis.

RESULTS

Among 1,722 patient episodes, physicians rejected recommendations to send a patient home in 24%, leaving text in 53%; reasons for rejection of the recommendations included additional or alternative diagnoses beyond pneumonia, and comorbidities or signs of physiologic derangement contributing to risk of outpatient failure that were not processed by the CDS. Physicians rejected broad-spectrum antibiotic recommendations in 10%, leaving text in 76%; differences in pathogen risk assessment, additional patient information, concern about antibiotic properties, and admitting physician preferences were given as reasons for rejection.

CONCLUSION

While adoption of CDS recommendations for pneumonia was high, physicians rejecting recommendations frequently provided feedback, reporting alternative diagnoses, additional individual patient characteristics, and provider preferences as major reasons for rejection. CDS that collects user feedback is feasible and can contribute to a learning health system.

The effectiveness of computerised decision support on antibiotic use in hospitals: A systematic review

Background

Inappropriate antimicrobial use has been shown to be an important determinant of the emergence of antimicrobial resistance (AMR). Health information technology (HIT) in the form of Computerised Decision Support (CDS) represents an option for improving antimicrobial prescribing and containing AMR.

Objectives

To evaluate the evidence for CDS in improving quantitative and qualitative measures of antibiotic prescribing in inpatient hospital settings.

Methods

A systematic literature search was conducted of articles published from inception to 20^th December 2014 using eight electronic databases: MEDLINE, EMBASE, PUBMED, Web of Science, CINAHL, Cochrane Library, HMIC and PsychINFo. An updated systematic literature search was conducted from January 1^st 2015 to October 1^st 2016 using PUBMED. The search strategy used combinations of the following terms: (electronic prescribing) OR (clinical decision support) AND (antibiotic or antibacterial or antimicrobial) AND (hospital or secondary care or inpatient). Studies were evaluated for quality using a 10-point rating scale.

Results

Eighty-one studies were identified matching the inclusion criteria. Seven outcome measures were evaluated: adequacy of antibiotic coverage, mortality, volume of antibiotic usage, length of stay, antibiotic cost, compliance with guidelines, antimicrobial resistance, and CDS implementation and uptake. Meta-analysis of pooled outcomes showed CDS significantly improved the adequacy of antibiotic coverage (n = 13; odds ratio [OR], 2.11 [95% CI, 1.67 to 2.66, p ≤ 0.00001]). Also, CDS was associated with marginally lowered mortality (n = 20; OR, 0.85 [CI, 0.75 to 0.96, p = 0.01]). CDS was associated with lower antibiotic utilisation, increased compliance with antibiotic guidelines and reductions in antimicrobial resistance. Conflicting effects of CDS on length of stay, antibiotic costs and system uptake were also noted.

Conclusions

CDS has the potential to improve the adequacy of antibiotic coverage and marginally decrease mortality in hospital-related settings.

The value of participatory development to support antimicrobial stewardship with a clinical decision support system

BACKGROUND

Current clinical decision support systems (CDSSs) for antimicrobial stewardship programs (ASPs) are guideline- or expert-driven. They are focused on (clinical) content, not on supporting real-time workflow. Thus, CDSSs fail to optimally support prudent antimicrobial prescribing in daily practice. Our aim was to demonstrate why and how participatory development (involving end-users and other stakeholders) can contribute to the success of CDSSs in ASPs.

METHODS

A mixed-methods approach was applied, combining scenario-based prototype evaluations (to support verbalization of work processes and out-of-the-box thinking) among 6 medical resident physicians with an online questionnaire (to cross-reference findings of the prototype evaluations) among 54 Dutch physicians.

RESULTS

The prototype evaluations resulted in insight into the end-users and their way of working, as well as their needs and expectations. The online questionnaire that was distributed among a larger group of medical specialists, including lung and infection experts, complemented the findings of the prototype evaluations. It revealed a say/do problem concerning the unrecognized need of support for selecting diagnostic tests.

CONCLUSIONS

Low-fidelity prototypes of a technology allow researchers to get to know the end-users, their way of working, and their work context. Involving experts allows technology developers to continuously check the fit between technology and clinical practice. The combination enables the participatory development of technology to successfully support ASPs.

Carbapenem Resistance in Gram-Negative Bacteria: The Not-So-Little Problem in the Little Red Dot

Singapore is an international travel and medical hub and faces a genuine threat for import and dissemination of bacteria with broad-spectrum resistance. In this review, we described the current landscape and management of carbapenem resistance in Gram-negative bacteria (GNB) in Singapore. Notably, the number of carbapenem-resistant Enterobacteriaceae has exponentially increased in the past two years. Resistance is largely mediated by a variety of mechanisms. Polymyxin resistance has also emerged. Interestingly, two Escherichia coli isolates with plasmid-mediated mcr-1 genes have been detected. Evidently, surveillance and infection control becomes critical in the local setting where resistance is commonly related to plasmid-mediated mechanisms, such as carbapenemases. Combination antibiotic therapy has been proposed as a last-resort strategy in the treatment of extensively drug-resistant (XDR) GNB infections, and is widely adopted in Singapore. The diversity of carbapenemases encountered, however, presents complexities in both carbapenemase detection and the selection of optimal antibiotic combinations. One unique strategy introduced in Singapore is a prospective in vitro combination testing service, which aids physicians in the selection of individualized combinations. The outcome of this treatment strategy has been promising. Unlike countries with a predominant carbapenemase type, Singapore has to adopt management strategies which accounts for diversity in resistance mechanisms.

Mortality Benefits of Antibiotic Computerised Decision Support System: Modifying Effects of Age

Antibiotic computerised decision support systems (CDSSs) are shown to improve antibiotic prescribing, but evidence of beneficial patient outcomes is limited. We conducted a prospective cohort study in a 1500-bed tertiary-care hospital in Singapore, to evaluate the effectiveness of the hospital’s antibiotic CDSS on patients’ clinical outcomes, and the modification of these effects by patient factors. To account for clustering, we used multilevel logistic regression models. One-quarter of 1886 eligible inpatients received CDSS-recommended antibiotics. Receipt of antibiotics according to CDSS’s recommendations seemed to halve mortality risk of patients (OR 0.54, 95% CI 0.26–1.10, P = 0.09). Patients aged ≤65 years had greater mortality benefit (OR 0.45, 95% CI 0.20–1.00, P = 0.05) than patients that were older than 65 (OR 1.28, 95% CI 0.91–1.82, P = 0.16). No effect was observed on incidence of Clostridium difficile (OR 1.02, 95% CI 0.34–3.01), and multidrug-resistant organism (OR 1.06, 95% CI 0.42–2.71) infections. No increase in infection-related readmission (OR 1.16, 95% CI 0.48–2.79) was found in survivors. Receipt of CDSS-recommended antibiotics reduced mortality risk in patients aged 65 years or younger and did not increase the risk in older patients. Physicians should be informed of the benefits to increase their acceptance of CDSS recommendations.