Supporting deprescribing in hospitalised patients: formative usability testing of a computerised decision support tool

The Unseen Hand: AI-Based Prescribing Decision Support Tools and the Evaluation of Drug Safety and Effectiveness

The use of artificial intelligence (AI)-based tools to guide prescribing decisions is full of promise and may enhance patient outcomes. These tools can perform actions such as choosing the 'safest' medication, choosing between competing medications, promoting de-prescribing or even predicting non-adherence. These tools can exist in a variety of formats; for example, they may be directly integrated into electronic medical records or they may exist in a stand-alone website accessible by a web browser. One potential impact of these tools is that they could manipulate our understanding of the benefit-risk of medicines in the real world. Currently, the benefit risk of approved medications is assessed according to carefully planned agreements covering spontaneous reporting systems and planned surveillance studies. But AI-based tools may limit or even block prescription to high-risk patients or prevent off-label use. The uptake and temporal availability of these tools may be uneven across healthcare systems and geographies, creating artefacts in data that are difficult to account for. It is also hard to estimate the 'true impact' that a tool had on a prescribing decision. International borders may also be highly porous to these tools, especially in cases where tools are available over the web. These tools already exist, and their use is likely to increase in the coming years. How they can be accounted for in benefit-risk decisions is yet to be seen.

Patient and Clinician Perceptions of the Pulse Oximeter in a Remote Monitoring Setting for COVID-19: Qualitative Study

BACKGROUND

As a response to the COVID-19 pandemic, the Sydney Local Health District in New South Wales, Australia, launched the rpavirtual program, the first full-scale virtual hospital in Australia, to remotely monitor and follow up stable patients with COVID-19. As part of the intervention, a pulse oximeter wearable device was delivered to patients to monitor their oxygen saturation levels, a critical indicator of COVID-19 patient deterioration. Understanding users' perceptions toward the device is fundamental to assessing its usability and acceptability and contributing to the effectiveness of the intervention, but no research to date has explored the user experience of the pulse oximeter for remote monitoring in this setting.

OBJECTIVE

This study aimed to explore the use, performance, and acceptability of the pulse oximeter by clinicians and patients in rpavirtual during COVID-19.

METHODS

Semistructured interviews and usability testing were conducted. Stable adult patients with COVID-19 (aged ≥18 years) who used the pulse oximeter and were monitored by rpavirtual, and rpavirtual clinicians monitoring these patients were interviewed. Clinicians could be nurses, doctors, or staff who were part of the team that assisted patients with the use of the pulse oximeter. Usability testing was conducted with patients who had the pulse oximeter when they were contacted. Interviews were coded using the Theoretical Framework of Acceptability. Usability testing was conducted using a think-aloud protocol. Data were collected until saturation was reached.

RESULTS

Twenty-one patients (average age 51, SD 13 years) and 15 clinicians (average age 41, SD 11 years) completed the interview. Eight patients (average age 51, SD 13 years) completed the usability testing. All participants liked the device and thought it was easy to use. They also had a good understanding of how to use the device and the device's purpose. Patients' age and device use-related characteristics (eg, the warmth of hands and hand steadiness) were identified by users as factors negatively impacting the accurate use of the pulse oximeter.

CONCLUSIONS

Patients and clinicians had very positive perceptions of the pulse oximeter for COVID-19 remote monitoring, indicating high acceptability and usability of the device. However, factors that may impact the accuracy of the device should be considered when delivering interventions using the pulse oximeter for remote monitoring. Targeted instructions about the use of the device may be necessary for specific populations (eg, older people and patients unfamiliar with technology). Further research should focus on the integration of the pulse oximeter data into electronic medical records for real-time and secure patient monitoring.

Impact of a Comprehensive Intervention Bundle Including the Drug Burden Index on Deprescribing Anticholinergic and Sedative Drugs in Older Acute Inpatients: A Non-randomised Controlled Before-and-After Pilot Study

INTRODUCTION

Implementation of the Drug Burden Index (DBI) as a risk assessment tool in clinical practice may facilitate deprescribing.

OBJECTIVE

The purpose of this study is to evaluate how a comprehensive intervention bundle using the DBI impacts (i) the proportion of older inpatients with at least one DBI-contributing medication stopped or dose reduced on discharge, compared with admission; and (ii) the changes in deprescribing of different DBI-contributing medication classes during hospitalisation.

METHODS

This before-and-after study was conducted in an Australian metropolitan tertiary referral hospital. Patients aged ≥ 75 years admitted to the acute aged care service for ≥ 48 h from December 2020 to October 2021 and prescribed DBI-contributing medication were included. During the control period, usual care was provided. During the intervention, access to the intervention bundle was added, including a clinician interface displaying DBI score in the electronic medical record. In a subsequent 'stewardship' period, a stewardship pharmacist used the bundle to provide clinicians with patient-specific recommendations on deprescribing of DBI-contributing medications.

RESULTS

Overall, 457 hospitalisations were included. The proportion of patients with at least one DBI-contributing medication stopped/reduced on discharge increased from 29.9% (control period) to 37.5% [intervention; adjusted risk difference (aRD) 6.5%, 95% confidence intervals (CI) -3.2 to 17.5%] and 43.1% (stewardship; aRD 12.1%, 95% CI 1.0-24.0%). The proportion of opioid prescriptions stopped/reduced rose from 17.9% during control to 45.7% during stewardship (p = 0.04).

CONCLUSION

Integrating a comprehensive intervention bundle and accompanying stewardship program is a promising strategy to facilitate deprescribing of sedative and anticholinergic medications in older inpatients.

Human factors and safety analysis methods used in the design and redesign of electronic medication management systems: A systematic review

INTRODUCTION

Poorly designed electronic medication management systems (EMMS) or computerized physician order entry (CPOE) systems in hospital settings can result in usability issues and in turn, patient safety risks. As a safety science, human factors and safety analysis methods have potential to support the safe and usable design of EMMS.

OBJECTIVE

To identify and describe human factors and safety analysis methods that have been used in the design or redesign of EMMS used in hospital settings.

MATERIALS AND METHODS

A systematic review, following PRISMA guidelines, was conducted by searching online databases and relevant journals from January 2011 to May 2022. Studies were included if they described the practical application of human factors and safety analysis methods to support the design or redesign of a clinician-facing EMMS, or its components. Methods used were extracted and mapped to human centered design (HCD) activities: understanding context of use; specifying user requirements; producing design solutions; and evaluating the design.

RESULTS

Twenty-one papers met the inclusion criteria. Overall, 21 human factors and safety analysis methods were used in the design or redesign of EMMS with prototyping, usability testing, participant surveys/questionnaires and interviews the most frequent. Human factors and safety analysis methods were most frequently used to evaluate the design of a system (n = 67; 56.3%). Nineteen of 21 (90%) methods used aimed to identify usability issues and/or support iterative design; only one paper utilized a safety-oriented method and one, a mental workload assessment method.

DISCUSSION AND CONCLUSION

While the review identified 21 methods, EMMS design primarily utilized a subset of available methods, and rarely a method focused on safety. Given the high-risk nature of medication management in complex hospital environments, and the potential for harm due to poorly designed EMMS, there is significant potential to apply more safety-oriented human factors and safety analysis methods to support EMMS design.

Polypharmacy and precision medicine

Precision medicine is an approach to maximise the effectiveness of disease treatment and prevention and minimise harm from medications by considering relevant demographic, clinical, genomic and environmental factors in making treatment decisions. Precision medicine is complex, even for decisions about single drugs for single diseases, as it requires expert consideration of multiple measurable factors that affect pharmacokinetics and pharmacodynamics, and many patient-specific variables. Given the increasing number of patients with multiple conditions and medications, there is a need to apply lessons learned from precision medicine in monotherapy and single disease management to optimise polypharmacy. However, precision medicine for optimisation of polypharmacy is particularly challenging because of the vast number of interacting factors that influence drug use and response. In this narrative review, we aim to provide and apply the latest research findings to achieve precision medicine in the context of polypharmacy. Specifically, this review aims to (1) summarise challenges in achieving precision medicine specific to polypharmacy; (2) synthesise the current approaches to precision medicine in polypharmacy; (3) provide a summary of the literature in the field of prediction of unknown drug-drug interactions (DDI) and (4) propose a novel approach to provide precision medicine for patients with polypharmacy. For our proposed model to be implemented in routine clinical practice, a comprehensive intervention bundle needs to be integrated into the electronic medical record using bioinformatic approaches on a wide range of data to predict the effects of polypharmacy regimens on an individual. In addition, clinicians need to be trained to interpret the results of data from sources including pharmacogenomic testing, DDI prediction and physiological-pharmacokinetic-pharmacodynamic modelling to inform their medication reviews. Future studies are needed to evaluate the efficacy of this model and to test generalisability so that it can be implemented at scale, aiming to improve outcomes in people with polypharmacy.

Usability of the IDDEAS prototype in child and adolescent mental health services: A qualitative study for clinical decision support system development

INTRODUCTION

Child and adolescent mental health services (CAMHS) clinical decision support system (CDSS) provides clinicians with real-time support as they assess and treat patients. CDSS can integrate diverse clinical data for identifying child and adolescent mental health needs earlier and more comprehensively. Individualized Digital Decision Assist System (IDDEAS) has the potential to improve quality of care with enhanced efficiency and effectiveness.

METHODS

We examined IDDEAS usability and functionality in a prototype for attention deficit hyperactivity disorder (ADHD), using a user-centered design process and qualitative methods with child and adolescent psychiatrists and clinical psychologists. Participants were recruited from Norwegian CAMHS and were randomly assigned patient case vignettes for clinical evaluation, with and without IDDEAS. Semi-structured interviews were conducted as one part of testing the usability of the prototype following a five-question interview guide. All interviews were recorded, transcribed, and analyzed following qualitative content analysis.

RESULTS

Participants were the first 20 individuals from the larger IDDEAS prototype usability study. Seven participants explicitly stated a need for integration with the patient electronic health record system. Three participants commended the step-by-step guidance as potentially helpful for novice clinicians. One participant did not like the aesthetics of the IDDEAS at this stage. All participants were pleased about the display of the patient information along with guidelines and suggested that wider guideline coverage will make IDDEAS much more useful. Overall, participants emphasized the importance of maintaining the clinician as the decision-maker in the clinical process, and the overall potential utility of IDDEAS within Norwegian CAMHS.

CONCLUSION

Child and adolescent mental health services psychiatrists and psychologists expressed strong support for the IDDEAS clinical decision support system if better integrated in daily workflow. Further usability assessments and identification of additional IDDEAS requirements are necessary. A fully functioning, integrated version of IDDEAS has the potential to be an important support for clinicians in the early identification of risks for youth mental disorders and contribute to improved assessment and treatment of children and adolescents.

Recent Updates on Risk and Management Plans Associated with Polypharmacy in Older Population

The concept of polypharmacy encompasses adverse drug reactions and non-adherence factors in elderly individuals. It also leads to the increased use of healthcare services and negative health outcomes. The problem is further alleviated by the odds of potentially inappropriate medications (PIM), which lead to the development of drug-related problems. Since polypharmacy is more commonly observed in the elderly population, urgency is required to introduce operative protocols for preventing and managing this problem. The family medicine model of care can be associated with favorable illness outcomes regarding satisfaction with consultation, treatment adherence, self-management behaviors, adherence to medical advice, and healthcare utilization. Hence, interventions built on family medicine models can provide significant support in improving the outcomes of the older population and their quality of life. In this regard, the authors have taken up the task of explaining the accessible resources which can be availed to improve the application of health care services in the field of geriatric medicine.

Geriatric medicine and health care for older people in Australia

Aged care coverage in Australia is universal but fragmented and has been challenged by government policy to deregulate aged care and open it up to market forces. A recent inquiry into aged care (Royal Commission into Aged Care Quality and Safety) documented the outcome of this policy-substandard care at most levels. The provision of services to older Aboriginal and Torres Strait Islander peoples, who have high prevalence of frailty and cognitive impairment, was also identified as inadequate. The effects of yet to be implemented changes in policy and funding in response to this report remain to be seen. Despite this policy backdrop, geriatricians have contributed to a steady growth in medical services and interventions focussed on specific geriatric issues such as dementia, falls, polypharmacy and orthogeriatrics. These are often driven by, or in collaboration with researchers, and aim to generate research data as well as provide patient care. The numbers of academic geriatricians and other aged care health professionals is increasing, and the training of specialist geriatricians now includes a significant research component.

Development, validation and evaluation of the Goal-directed Medication review Electronic Decision Support System (G-MEDSS)©

OBJECTIVES

1) To understand and investigate the experiences of accredited clinical pharmacists (ACP) using computerised clinical decision support systems (CCDSS) during medication reviews for older people, including those living with dementia; 2) To design, develop, validate, and evaluate a CCDSS that incorporates pharmacological and other deprescribing tools to aid person-centred management of high-risk medications in older adults living with and without dementia.

METHODS

This study consisted of three phases and was designed on scenario-based methodology: a) the development phase, which included an exploratory survey and prototype building; b) the validation phase, which included qualitative data collection and usability testing with ACPs, general practitioners (GPs) and carers for people living with dementia; and c) the evaluation phase, using mixed-methods analyses.

RESULTS

The exploratory survey found that ACPs required a flexible, and reliable CCDSS to support them with clinical decisions regarding high-risk medication use in older adults. The Goal-directed Medication review Electronic Decision Support System (G-MEDSS)© was developed and validated using quantitative and qualitative feedback received from ACPs, GPs and carers for people with dementia. The mean (SD) System Usability Scale score was 69.0 (12.9), which indicated fair-good usability.

DISCUSSION AND CONCLUSIONS

Involving end-users in the design process refined and improved the design of G-MEDSS, allowing for a person-centred and goal-directed delivery of pharmaceutical care. G-MEDSS allows healthcare practitioners conducting medication reviews for older adults living with and without dementia to tailor pharmaceutical care to meet their goals and preferences. Future studies may explore integration of G-MEDSS with prescribing or dispensing software.