A Sociotechnical Approach to Evaluating the Impact of ICT on Clinical Care Environments

Beyond Getting Rid of Stupid Stuff in the Electronic Health Record (Beyond-GROSS): Protocol for a User-Centered, Mixed-Method Intervention to Improve the Electronic Health Record System

BACKGROUND

Up to 60% of health care providers experience one or more symptoms of burnout. Perceived clinician burden resulting in burnout arises from factors such as electronic health record (EHR) usability or lack thereof, perceived loss of autonomy, and documentation burden leading to less clinical time with patients. Burnout can have detrimental effects on health care quality and contributes to increased medical errors, decreased patient satisfaction, substance use, workforce attrition, and suicide.

OBJECTIVE

This project aims to improve the user-centered design of the EHR by obtaining direct input from clinicians about deficiencies. Fixing identified deficiencies via user-centered design has the potential to improve usability, thereby increasing satisfaction by reducing EHR-induced burnout.

METHODS

Quantitative and qualitative data will be obtained from clinician EHR users. The input will be received through a form built in a REDCap database via a link embedded in the home page of the EHR. The REDCap data will be analyzed in 2 main dimensions, based on nature of the input, what section of the EHR is affected, and what is required to fix the issue(s). Identified issues will be escalated to relevant stakeholders responsible for rectifying the problems identified. Data analysis, project evaluation, and lessons learned from the evaluation will be incorporated in a Plan-Do-Study-Act (PDSA) manner every 4-6 weeks.

RESULTS

The pilot phase of the study began in October 2020 in the Gastroenterology Division at Mount Sinai Hospital, New York City, NY, which includes 39 physicians and 15 nurses. The pilot is expected to run over a 4-6-month period. The results of the REDCap data analysis will be reported within 1 month of completing the pilot phase. We will analyze the nature of requests received and the impact of rectified issues on the clinician EHR user. We expect that the results will reveal which sections of the EHR have the highest deficiencies while also highlighting issues about workflow difficulties. Perceived impact of the project on provider engagement, patient safety, and workflow efficiency will also be captured by evaluation survey and other qualitative methods where possible.

CONCLUSIONS

The project aims to improve user-centered design of the EHR by soliciting direct input from clinician EHR users. The ultimate goal is to improve efficiency, reduce EHR inefficiencies with the possibility of improving staff engagement, and lessen EHR-induced clinician burnout. Our project implementation includes using informatics expertise to achieve the desired state of a learning health system as recommended by the National Academy of Medicine as we facilitate feedback loops and rapid cycles of improvement.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/25148.

[Strategic framework to Support the evaluation of complex and innovative digital health projects]

Digital technologies play a central role in strategies to improve access, quality and efficiency of health care and services. However, many digital health projects have failed to become sustainable and spread across health organizations and systems. This situation is partly due to the fact that these projects are often developed and evaluated by reducing the issues linked mainly to the technological dimension. Such tradition has paid little attention to the fact that technology is introduced into pluralistic and complex sociotechnical systems such as health organizations and systems. The aim of this article is to propose practical and theorical, non-prescriptive, elements of reflection that can serve as a basis for evaluating complex and innovative digital health projects. This reflection builds on the lessons learned from the application of a strategic framework for evaluating three major complex and innovative digital health projects in Quebec over the last 15 years.

Staff perspectives on the usability of electronic patient records for planning and delivering dementia care in nursing homes: a multiple case study

BACKGROUND

The electronic patient record (EPR) has been introduced into nursing homes in order to facilitate documentation practices such as assessment and care planning, which play an integral role in the provision of dementia care. However, little is known about how the EPR facilitates or hinders these practices from the end-user's perspective. Therefore, the objective of this qualitative study was to explore the usability issues associated with the EPR for assessment and care planning for people with dementia in nursing homes from a staff perspective.

METHODS

An exploratory, qualitative research design with a multiple case study approach was used. Contextual Inquiry was carried out with a variety of staff members (n = 21) who used the EPR in three nursing homes situated in Belgium, Czech Republic and Spain. Thematic analysis was used to code interview data, with codes then sorted into a priori components of the Health Information Technology Evaluation Framework: device, software functionality, organisational support. Two additional themes, structure and content, were also added.

RESULTS

Staff provided numerous examples of the ways in which EPR systems are facilitating and hindering assessment and care planning under each component, particularly for people with dementia, who may have more complex needs in comparison to other residents. The way in which EPR systems were not customisable was a common theme across all three homes. A comparison of organisational policies and practices revealed the importance of training, system support, and access, which may be linked with the successful adoption of the EPR system in nursing homes.

CONCLUSIONS

EPR systems introduced into the nursing home environment should be customisable and reflect best practice guidelines for dementia care, which may lead to improved outcomes and quality of life for people with dementia living in nursing homes. All levels of nursing home staff should be consulted during the development, implementation and evaluation of EPR systems as part of an iterative, user-centred design process.

Using algorithms to initiate needs-based interventions for people on antipsychotic medication: implementation protocol

Introduction

Non-adherence to antipsychotic medications for individuals with serious mental illness increases risk of relapse and hospitalisation. Real time monitoring of adherence would allow for early intervention. AI² is a both a personal nudging system and a clinical decision support tool that applies machine learning on Medicare prescription and benefits data to raise alerts when patients have discontinued antipsychotic medications without supervision, or when essential routine health checks have not been performed.

Methods and analysis

We outline two intervention models using AI². In the first use-case, the personal nudging system, patients receive text messages when an alert of a missed medication or routine health check is detected by AI². In the second use-case, as a clinical decision support tool, AI² generated alerts are presented as flags through a dashboard to the community mental health professionals. Implementation protocols for different scenarios of AI², along with a mixed-methods evaluation, are planned to identify pragmatic issues necessary to inform a larger randomised control trial, as well as improve the application.

Ethics and dissemination

This study protocol has been approved by The Southern Adelaide Clinical Human Research Ethics Committee. The dissemination of this trial will serve to inform further implementation of the AI² into daily personal and clinical practice.

Health Care Personnel's Perspective on Potential Electronic Health Interventions to Prevent Hospitalizations for Older Persons Receiving Community Care: Qualitative Study

Background

The use of electronic health (eHealth) interventions is suggested to help monitor and treat degenerative and chronic diseases through the use of sensors, alarms, and reminders and can potentially prevent hospitalizations for home-dwelling older persons receiving community care. It is increasingly recognized that the health care personnel’s acceptance of a technological application remains a key challenge in adopting an intervention, thus interventions must be perceived to be useful and fit for purpose by the actual users.

Objective

The aim of this study was to identify and explore the perspectives of managers and health care personnel in community care regarding the use of eHealth interventions in terms of prevention of hospitalizations for home-dwelling older persons receiving community care.

Methods

A case study with a qualitative approach was carried out in community care in a Norwegian municipality, comprising individual interviews and focus group interviews. A total of 5 individual interviews and 2 focus group interviews (n=12) were undertaken to provide the health care personnel’s and managers’ perspective regarding the use of eHealth interventions, which could potentially prevent hospitalizations for home-dwelling older persons receiving community care. Data were analyzed by way of systematic text condensation, as described by Malterud.

Results

The data analysis of focus group interviews and individual interviews resulted in 2 categories: potential technological applications and potential patient groups. Discussions in the focus groups generated several suggestions and wishes related to technical applications that they could make use of in their day-to-day practice. The health care personnel warranted tools and measures to enhance and document their clinical observations in contact with patients. They also identified patient groups, such as patients with chronic obstructive pulmonary disease or dehydration or urinary tract infections, for whom hospitalizations could potentially have been prevented.

Conclusions

We have shown that the health care personnel in community care warrant various technological applications that have the potential to improve quality of care and resource utilization in the studied municipality. We have identified needs and important matters in practice, which are paramount for acceptance and adoption of an intervention in community care.

Developing a framework for evidence-based grading and assessment of predictive tools for clinical decision support

BACKGROUND

Clinical predictive tools quantify contributions of relevant patient characteristics to derive likelihood of diseases or predict clinical outcomes. When selecting predictive tools for implementation at clinical practice or for recommendation in clinical guidelines, clinicians are challenged with an overwhelming and ever-growing number of tools, most of which have never been implemented or assessed for comparative effectiveness. To overcome this challenge, we have developed a conceptual framework to Grade and Assess Predictive tools (GRASP) that can provide clinicians with a standardised, evidence-based system to support their search for and selection of efficient tools.

METHODS

A focused review of the literature was conducted to extract criteria along which tools should be evaluated. An initial framework was designed and applied to assess and grade five tools: LACE Index, Centor Score, Well's Criteria, Modified Early Warning Score, and Ottawa knee rule. After peer review, by six expert clinicians and healthcare researchers, the framework and the grading of the tools were updated.

RESULTS

GRASP framework grades predictive tools based on published evidence across three dimensions: 1) Phase of evaluation; 2) Level of evidence; and 3) Direction of evidence. The final grade of a tool is based on the highest phase of evaluation, supported by the highest level of positive evidence, or mixed evidence that supports a positive conclusion. Ottawa knee rule had the highest grade since it has demonstrated positive post-implementation impact on healthcare. LACE Index had the lowest grade, having demonstrated only pre-implementation positive predictive performance.

CONCLUSION

GRASP framework builds on widely accepted concepts to provide standardised assessment and evidence-based grading of predictive tools. Unlike other methods, GRASP is based on the critical appraisal of published evidence reporting the tools' predictive performance before implementation, potential effect and usability during implementation, and their post-implementation impact. Implementing the GRASP framework as an online platform can enable clinicians and guideline developers to access standardised and structured reported evidence of existing predictive tools. However, keeping GRASP reports up-to-date would require updating tools' assessments and grades when new evidence becomes available, which can only be done efficiently by employing semi-automated methods for searching and processing the incoming information.

The impact of nurse practitioners on care delivery in the emergency department: a multiple perspectives qualitative study

BACKGROUND

Despite well-articulated benefits, the introduction of Nurse Practitioners (NPs) in Australia has been slow. Poorly defined nomenclature relating to advanced practice roles in nursing and variations in such roles both across Australia and worldwide have resulted in confusion and uncertainty regarding the functions and roles of NPs. Qualitative studies focussing on the perceived impact on the care settings into which NPs are introduced are scarce, but are valuable in providing a complete contextual account of NPs in care delivery settings. This study aimed to investigate the perceived impact of the NP on the delivery of care in the ED by senior doctors, nurses, and NPs. Results will facilitate adoption and best use of this human resource innovation.

METHODS

A cross-sectional qualitative study was undertaken in the Emergency Departments (EDs) of two large Australian metropolitan public teaching hospitals. Semi-structured, in-depth interviews were conducted with five nurse practitioners, four senior doctors (staff specialists and ED directors) and five senior nurses. Transcribed interviews were analysed using a grounded theory approach to develop themes in relation to the conceptualisation of the impact of the NP role on the ED. Member checking of results was conducted by revisiting the sites to clarify findings with participants and further explore emergent themes.

RESULTS

The impact of the NP role was perceived differently by different groups of participants. Whilst NPs were observed to deliver few quantitative improvements to ED functioning from the perspective of ED directors, NPs believed that they assisted doctors in managing the increasing subacute presentations to the contemporary ED. NPs also believed they embraced a preventative paradigm of care which addressed the long term priorities of chronic disease prevention and cost containment in the broader healthcare environment. The ambiguous position of the NP role, which crosses the gap between nursing and medicine, emerged and resulted in a duality of NP governance.

CONCLUSIONS

Interpretation of the NPs' role occurred through different frames of reference. This has implications for the development of the NP role in the ED. Collaboration and dialogue between various stakeholders, such as ED doctors and senior nursing management is required.

The role of ICT in supporting disruptive innovation: a multi-site qualitative study of nurse practitioners in emergency departments

BACKGROUND

The disruptive potential of the Nurse Practitioner (NP) is evident in their ability to offer services traditionally provided by primary care practitioners and their provision of a health promotion model of care in response to changing health trends. No study has qualitatively investigated the role of the Emergency NP in Australia, nor the impact of Information and Communication Technology (ICT) on this disruptive workforce innovation. This study aimed to investigate ways in which Nurse Practitioners (NP) have incorporated the use of ICT as a mechanism to support their new clinical role within Emergency Departments.

METHODS

A cross-sectional qualitative study was undertaken in the Emergency Departments (EDs) of two large Australian metropolitan public teaching hospitals. Semi-structured, in-depth interviews were conducted with five nurse practitioners, four senior physicians and five senior nurses. Transcribed interviews were analysed using a grounded theory approach to develop themes in relation to the conceptualisation of the ED nurse practitioner role and the influences of ICT upon the role. Member checking of results was achieved by revisiting the sites to clarify findings with participants and further explore emergent themes.

RESULTS

The role of the ENP was distinguished from those of Emergency nurses and physicians by two elements: advanced practice and holistic care, respectively. ICT supported the advanced practice dimension of the NP role in two ways: availability and completeness of electronic patient information enhanced timeliness and quality of diagnostic and therapeutic decision-making, expediting patient access to appropriate care. The ubiquity of patient data sourced from a central database supported and improved quality of communication between health professionals within and across sites, with wider diffusion of the Electronic Medical Record holding the potential to further facilitate team-based, holistic care.

CONCLUSIONS

ICT is a facilitator through which the disruptive impact of NPs can be extended. However, integration of ICT into work practices without detracting from provider-patient interaction is crucial to ensure utilisation of such interventions and realisation of potential benefits.