Acute kidney injury electronic alerts: mixed methods Normalisation Process Theory evaluation of their implementation into secondary care in England

Mapping regional implementation of 'Making Every Contact Count': mixed-methods evaluation of implementation stage, strategies, barriers and facilitators of implementation

BACKGROUND

The Making Every Contact Count (MECC) programme provides training and materials to support public-facing workers to encourage health-promoting behaviour change by using the day-to-day interactions between organisations and individuals. This project aimed to analyse MECC implementation through a comparative analysis of implementation stage, strategies used for implementation and enablers/barriers of the implementation process within a region in England-the North East and North Cumbria (NENC).

METHODS

A mixed-methods process evaluation was conducted applying normalisation process theory and theoretical domains framework. MECC programme documents were reviewed and mapped against specific criteria (eg, implementation strategies). An online mapping survey was conducted to establish current implementation/delivery of MECC within NENC settings (eg, local government, healthcare and voluntary community sector). Qualitative research, using individual interviews and group discussions, was conducted to establish further understanding of MECC implementation.

RESULTS

Our findings were informed by reviewing documents (n=5), surveying participants (n=34), interviews (n=18) and group discussions (n=48). Overall, the implementation of MECC within the region was at an early stage, with training mostly delivered between, rather than within, organisations. Qualitative findings highlighted factors that influence stakeholders to implement MECC (eg, organisational goals that were facilitated by MECC implementation, including the prevention agenda), supported resources that facilitate the implementation of MECC (eg, logic models) and enabling factors that promote MECC sustainability across the region (eg, buy-in from leadership and management).

CONCLUSIONS

The NENC MECC programme is built around regional leadership that supports the implementation process. This process evaluation identified key influences of MECC implementation across the region. We discuss evidence-based recommendation for policy and practice that can be taken forward to develop targeted strategies to support future MECC implementation. For example, a co-ordinated infrastructure and strategy is needed to combat delivery and implementation issues identified.

Geriatric Assessment in CKD Care: An Implementation Study

Rationale & Objective

Older people with progressive chronic kidney disease (CKD) have complex health care needs. Geriatric evaluation preceding decision making for kidney replacement is recommended in guidelines, but implementation is lacking in routine care. We aimed to evaluate implementation of geriatric assessment in CKD care.

Study Design

Mixed methods implementation study.

Setting & Participants

Dutch nephrology centers were approached for implementation of geriatric assessment in patients aged ≥70 years and with an estimated glomerular filtration rate of ≤20 mL/min/1.73 m2.

Quality Improvement Activities/Exposure

We implemented a consensus-based nephrology-tailored geriatric assessment: a patient questionnaire and professionally administered test set comprising 16 instruments covering functional, cognitive, psychosocial, and somatic domains and patient-reported outcome measures.

Outcomes

We aimed for implementation in 10 centers and 200 patients. Implementation was evaluated by (i) perceived enablers and barriers of implementation, including integration in work routines (Normalization Measure Development Tool) and (ii) relevance of the instruments to routine care for the target population.

Analytical Approach

Variations in implementation practices were described based on field notes. The postimplementation survey among health care professionals was analyzed descriptively, using an explanatory qualitative approach for open-ended questions.

Results

Geriatric assessment was implemented in 10 centers among 191 patients. Survey respondents (n = 71, 88% response rate) identified determinants that facilitated implementation, ie, multidisciplinary collaboration (with geriatricians) -meetings and reports and execution of assessments by nurses. Barriers to implementation were patient illiteracy or language barrier, time constraints, and patient burden. Professionals considered geriatric assessment sufficiently integrated into work routines (mean, 6.7/10 ± 2.0 [SD]) but also subject to improvement. Likewise, the relevance of geriatric assessment for routine care was scored as 7.8/10 ± 1.2. The Clinical Frailty Score and Montreal Cognitive Assessment were perceived as the most relevant instruments.

Limitations

Selection bias of interventions' early adopters may limit generalizability.

Conclusions

Geriatric assessment could successfully be integrated in CKD care and was perceived relevant to health care professionals.

Information displays for automated surveillance algorithms of in-hospital patient deterioration: a scoping review

OBJECTIVE

Surveillance algorithms that predict patient decompensation are increasingly integrated with clinical workflows to help identify patients at risk of in-hospital deterioration. This scoping review aimed to identify the design features of the information displays, the types of algorithm that drive the display, and the effect of these displays on process and patient outcomes.

MATERIALS AND METHODS

The scoping review followed Arksey and O'Malley's framework. Five databases were searched with dates between January 1, 2009 and January 26, 2022. Inclusion criteria were: participants-clinicians in inpatient settings; concepts-intervention as deterioration information displays that leveraged automated AI algorithms; comparison as usual care or alternative displays; outcomes as clinical, workflow process, and usability outcomes; and context as simulated or real-world in-hospital settings in any country. Screening, full-text review, and data extraction were reviewed independently by 2 researchers in each step. Display categories were identified inductively through consensus.

RESULTS

Of 14 575 articles, 64 were included in the review, describing 61 unique displays. Forty-one displays were designed for specific deteriorations (eg, sepsis), 24 provided simple alerts (ie, text-based prompts without relevant patient data), 48 leveraged well-accepted score-based algorithms, and 47 included nurses as the target users. Only 1 out of the 10 randomized controlled trials reported a significant effect on the primary outcome.

CONCLUSIONS

Despite significant advancements in surveillance algorithms, most information displays continue to leverage well-understood, well-accepted score-based algorithms. Users' trust, algorithmic transparency, and workflow integration are significant hurdles to adopting new algorithms into effective decision support tools.

Facilitators and Barriers to Interacting With Clinical Decision Support in the ICU: A Mixed-Methods Approach

OBJECTIVES

Clinical decision support systems (CDSSs) are used in various aspects of healthcare to improve clinical decision-making, including in the ICU. However, there is growing evidence that CDSS are not used to their full potential, often resulting in alert fatigue which has been associated with patient harm. Clinicians in the ICU may be more vulnerable to desensitization of alerts than clinicians in less urgent parts of the hospital. We evaluated facilitators and barriers to appropriate CDSS interaction and provide methods to improve currently available CDSS in the ICU.

DESIGN

Sequential explanatory mixed-methods study design, using the BEhavior and Acceptance fRamework.

SETTING

International survey study.

PATIENT/SUBJECTS

Clinicians (pharmacists, physicians) identified via survey, with recent experience with clinical decision support.

INTERVENTIONS

An initial survey was developed to evaluate clinician perspectives on their interactions with CDSS. A subsequent in-depth interview was developed to further evaluate clinician (pharmacist, physician) beliefs and behaviors about CDSS. These interviews were then qualitatively analyzed to determine themes of facilitators and barriers with CDSS interactions.

MEASUREMENTS AND MAIN RESULTS

A total of 48 respondents completed the initial survey (estimated response rate 15.5%). The majority believed that responding to CDSS alerts was part of their job (75%) but felt they experienced alert fatigue (56.5%). In the qualitative analysis, a total of five facilitators (patient safety, ease of response, specificity, prioritization, and feedback) and four barriers (excess quantity, work environment, difficulty in response, and irrelevance) were identified from the in-depth interviews.

CONCLUSIONS

In this mixed-methods survey, we identified areas that institutions should focus on to improve appropriate clinician interactions with CDSS, specific to the ICU. Tailoring of CDSS to the ICU may lead to improvement in CDSS and subsequent improved patient safety outcomes.

Can Artificial Intelligence Assist in Delivering Continuous Renal Replacement Therapy?

Continuous renal replacement therapy (CRRT) is widely utilized to support critically ill patients with acute kidney injury. Artificial intelligence (AI) has the potential to enhance CRRT delivery, but evidence is limited. We reviewed existing literature on the utilization of AI in CRRT with the objective of identifying current gaps in evidence and research considerations. We conducted a scoping review focusing on the development or use of AI-based tools in patients receiving CRRT. Ten papers were identified; 6 of 10 (60%) published in 2021, and 6 of 10 (60%) focused on machine learning models to augment CRRT delivery. All innovations were in the design/early validation phase of development. Primary research interests focused on early indicators of CRRT need, prognostication of mortality and kidney recovery, and identification of risk factors for mortality. Secondary research priorities included dynamic CRRT monitoring, predicting CRRT-related complications, and automated data pooling for point-of-care analysis. Literature gaps included prospective validation and implementation, biases ascertainment, and evaluation of AI-generated health care disparities. Research on AI applications to enhance CRRT delivery has grown exponentially in the last years, but the field remains premature. There is a need to evaluate how these applications could enhance bedside decision-making capacity and assist structure and processes of CRRT delivery.

Prior to Implementation of Digital Pathology-Assessment of Expectations among Staff by Means of Normalization Process Theory

The Region of Southern Denmark is the first in Denmark to implement digital pathology (DIPA), starting at the end of 2020. The DIPA process involves changes in workflow, and the pathologist will have to diagnose based on digital whole slide imaging instead of through the traditional use of the conventional light microscope and glass slides. In addition, in the laboratory, the employees will have to implement one more step to their workflow—scanning of tissue. The aim of our study was to assess the expectations and readiness among employees and management towards the implementation of DIPA, including their thoughts and motivations for starting to use DIPA. We used a mixed-method approach. Based on the findings derived from 18 semi-structured interviews with employees from the region’s departments of pathology, we designed a questionnaire, including questions from the normalization measure development tool. The questionnaires were e-mailed to 181 employees. Of these employees, 131 responded to the survey. Overall, they reported feeling sufficiently tech-savvy to be able to use DIPA, and they had high expectations as well as motivation and readiness for the upcoming changes. However, the employees were skeptical regarding the allocation of resources, and few were aware of reports about the effects of DIPA. Based on the findings, it seems to be important to provide not only a thorough introduction to the new intervention and the changes it will entail, but also to continue to ensure that the staff know how it works and why it is necessary to implement.

Translational framework for implementation evaluation and research: a normalisation process theory coding manual for qualitative research and instrument development

Background

Normalisation Process Theory (NPT) is frequently used to inform qualitative research that aims to explain and evaluate processes that shape late-stage translation of innovations in the organisation and delivery of healthcare. A coding manual for qualitative researchers using NPT will facilitate transparent data analysis processes and will also reduce the cognitive and practical burden on researchers.

Objectives

(a) To simplify the theory for the user. (b) To describe the purposes, methods of development, and potential application of a coding manual that translates normalisation process theory (NPT) into an easily usable framework for qualitative analysis. (c) To present an NPT coding manual that is ready for use.

Method

Qualitative content analysis of papers and chapters that developed normalisation process theory, selection and structuring of theory constructs, and testing constructs against interview data and published empirical studies using NPT.

Results

A coding manual for NPT was developed. It consists of 12 primary NPT constructs and conforms to the Context-Mechanism-Outcome configuration of realist evaluation studies. Contexts are defined as settings in which implementation work is done, in which strategic intentions, adaptive execution, negotiating capability, and reframing organisational logics are enacted. Mechanisms are defined as the work that people do when they participate in implementation processes and include coherence-building, cognitive participation, collective action, and reflexive monitoring. Outcomes are defined as effects that make visible how things change as implementation processes proceed and include intervention mobilisation, normative restructuring, relational restructuring, and sustainment.

Conclusion

The coding manual is ready to use and performs three important tasks. It consolidates several iterations of theory development, makes the application of NPT simpler for the user, and links NPT constructs to realist evaluation methods. The coding manual forms the core of a translational framework for implementation research and evaluation.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-022-01191-x.

Translational framework for implementation evaluation and research: a normalisation process theory coding manual for qualitative research and instrument development

BACKGROUND

Normalisation Process Theory (NPT) is frequently used to inform qualitative research that aims to explain and evaluate processes that shape late-stage translation of innovations in the organisation and delivery of healthcare. A coding manual for qualitative researchers using NPT will facilitate transparent data analysis processes and will also reduce the cognitive and practical burden on researchers.

OBJECTIVES

(a) To simplify the theory for the user. (b) To describe the purposes, methods of development, and potential application of a coding manual that translates normalisation process theory (NPT) into an easily usable framework for qualitative analysis. (c) To present an NPT coding manual that is ready for use.

METHOD

Qualitative content analysis of papers and chapters that developed normalisation process theory, selection and structuring of theory constructs, and testing constructs against interview data and published empirical studies using NPT.

RESULTS

A coding manual for NPT was developed. It consists of 12 primary NPT constructs and conforms to the Context-Mechanism-Outcome configuration of realist evaluation studies. Contexts are defined as settings in which implementation work is done, in which strategic intentions, adaptive execution, negotiating capability, and reframing organisational logics are enacted. Mechanisms are defined as the work that people do when they participate in implementation processes and include coherence-building, cognitive participation, collective action, and reflexive monitoring. Outcomes are defined as effects that make visible how things change as implementation processes proceed and include intervention mobilisation, normative restructuring, relational restructuring, and sustainment.

CONCLUSION

The coding manual is ready to use and performs three important tasks. It consolidates several iterations of theory development, makes the application of NPT simpler for the user, and links NPT constructs to realist evaluation methods. The coding manual forms the core of a translational framework for implementation research and evaluation.

The impact of e-alerts on inpatient diagnosis and management of acute kidney injury

AIMS/BACKGROUND

Electronic alerts can help with the early detection of acute kidney injury in hospitalised patients. Evidence for their role in improving patient care is limited. The authors have completed an audit loop to evaluate the impact of electronic alerts, and an associated acute kidney injury management pathway, on patient care.

METHODS

The audits were conducted at a large tertiary care hospital in the UK. Case notes were reviewed for 99 patients over two periods: pre-alert (in 2013; n=55) and post-alert (in 2018; n=44), using the same methodology. Patients for case note reviews were randomly chosen from the list of acute kidney injury alerts generated by the local laboratory information management system.

RESULTS

Recognition of acute kidney injury, as documented in the case notes, increased from 15% to 43% between the two periods. Time to first medical review (following electronic alerts) improved by 17 minutes (median 4 hours 4 minutes in 2013 vs 3 hours 47 minutes in 2018). Completion of pre-defined acute kidney injury assessment tasks (review of vital signs, biochemistry and acid-base parameters, evidence of fluid balance assessment, consideration of possible sepsis, and examination or requesting urinalysis) improved in 2018. However, acute kidney injury management tasks (correction of hypovolaemia, addressing or investigating obstruction, medications review, renal referral, requesting of further biochemical tests, addressing possible sepsis) showed very little or no improvement.

CONCLUSIONS

The introduction of acute kidney injury electronic alerts and management pathway resulted in improved recognition and initial assessment of patients with acute kidney injury. Further steps are needed to translate this in to improved patient management.