Implementation of a Patient Reported Experience Measure in a Dutch disability care organisation: a qualitative study

Uptake of pediatric patient-reported outcome and experience measures and challenges associated with their implementation in Alberta: a mixed-methods study

BACKGROUND

Implementing Patient-reported Outcome Measures (PROMs) and Patient-reported Experience Measures (PREMs) is an effective way to deliver patient- and family-centered care (PFCC). Although Alberta Health Services (AHS) is Canada's largest and fully integrated health system, PROMs and PREMs are yet to be routinely integrated into the pediatric healthcare system. This study addresses this gap by investigating the current uptake, barriers, and enablers for integrating PROMs and PREMs in Alberta's pediatric healthcare system.

METHODS

Pediatric clinicians and academic researchers with experience using PROMs and PREMs were invited to complete a quantitative survey. Additionally, key stakeholders were qualitatively interviewed to understand current challenges in implementing pediatric PROMs and PREMs within AHS. Quantitative data gathered from 22 participants were descriptively analyzed, and qualitative data from 14 participants were thematically analyzed.

RESULTS

Participants identified 33 PROMs and 6 PREMs showing diversity in the types of pediatric PROMs and PREMs currently being used in Alberta and their mode of administration. The qualitatively identified challenges were associated with patients, family caregivers, and clinicians. The absence of system-level support, such as integration within electronic medical records, is considered a significant system-level challenge.

CONCLUSIONS

The significant variation in the types of PROMs and PREMs used, the rationale for their use, and their mode of administration demonstrate the diverse and sporadic use of these measures in Alberta. These findings highlight the need for province-wide uniform implementation of pediatric PROMs and PREMs in Alberta. Our results could benefit healthcare organizations in developing evidence-based PROM and PREM implementation strategies in pediatrics.

Patient and healthcare provider perceptions on using patient-reported experience measures (PREMs) in routine clinical care: a systematic review of qualitative studies

BACKGROUND

Patient-reported experience measures (PREMs) assess quality-of-care from patients' perspectives. PREMs can be used to enhance patient-centered care and facilitate patient engagement in care. With increasing quality improvement studies in clinical practice, the use of PREMs has surged. As a result, knowledge about stakeholder experiences of using PREMs to assess quality of care across diverse clinical settings is needed to inform PREM implementation efforts. To address this, this review examines the qualitative literature on patient and healthcare provider experiences of using PREMs in clinical practice.

METHODS

Medline, Embase and PsycInfo were systematically searched from inception to May 2021. Additional searching of reference lists for all included articles and relevant review articles were performed. Retrieved articles were screened for eligibility by one reviewer and 25% cross-checked by a second reviewer across all stages of the review. Full texts meeting eligibility criteria were appraised against the COREQ checklist for quality assessment and thematic analysis was used to analyze textual data extracted from the results.

RESULTS

Electronic searches identified 2683 records, of which 20 studies met eligibility criteria. Extracted data were synthesized into six themes: facilitators to PREM implementation; barriers to PREM implementation; healthcare providers' perspectives towards using PREMs; patients' perspectives towards using PREMs; advantages of using PREMs in clinical practice; limitations and practical considerations to reduce resistance of PREM usage. The primary factors facilitating and impeding the use of PREMs include organizational-, staff- and patient-related factors.

CONCLUSION

Results can be used to guide the usage and implementation of PREMs in clinical settings by addressing the identified barriers and building on the perceived benefits to encourage adoption of PREMs. Results around facilitators to PREM implementation and practical considerations could also promote appropriate use of PREMs by healthcare providers, helping to improve practice and the quality of care based on patient feedback.

Implementation of a patient-reported experience measure in a Dutch disability care organization: A process evaluation of cocreated tailored strategies

INTRODUCTION

In 24/7 disability care facilities, patient-reported experience measures (PREMs) are important to help healthcare professionals understand what matters to care users and to improve the quality of care. However, the successful implementation of a PREM is complex. In a Dutch disability care organization, stakeholders cocreated tailored implementation strategies aimed at improving the use and integration of a qualitative PREM. This study gives insights into the uptake and experiences with these cocreated implementation strategies and the perceived impact of the set of strategies.

METHODS

We performed a prospective process evaluation between February 2020 and February 2021. We collected data in three disability care facilities from 35 care users, 11 professionals, 3 facility managers and 4 organization representatives. Data collection included observations during kick-offs and learning goal meetings and several attendance checklists. We collected 133 questionnaires (Time 0 and Time 1). We conducted 35 individual semistructured interviews and an online focus group interview. Quantitative data were analysed using descriptive statistics and qualitative data using directed content analysis.

RESULTS

The exposure to and adoption of strategies was between 76% and 100%. Participants were positive about tailoring the strategies to each facility. Implementation was hindered by challenges in care users' communication and COVID-19. The perceived impact referred to an improved understanding of the goal and added value of the PREM and better preparation and execution of the PREM. The impact of the set of strategies was mainly experienced on the micro level.

CONCLUSION

The uptake of the cocreated implementation strategies was acceptable. The participants valued the tailored approach, which enabled them to focus on facility-specific learning goals. Stakeholder engagement and co-created strategies may have strengthened the adoption of and experiences with the implementation.

PATIENT OR PUBLIC CONTRIBUTION

In this article, we present the process evaluation of implementation strategies for the integrated use of a PREM in disability care. A development group consisting of communication vulnerable care users, trainers and professionals developed the implementation strategies. The disability care organization was responsible for the planning and organization of the implementation process. During the process evaluation the end users, trainers, professionals and managers tailored the implementation strategies to their own settings and needs. Researchers observed this implementation process and interviewed the stakeholders about their experiences and the perceived impact.

How to foster successful implementation of a patient reported experience measurement in the disability sector: an example of developing strategies in co-creation

BACKGROUND

The integrated uptake of patient-reported experience measures, using outcomes for the micro, meso and macro level, calls for a successful implementation process which depends on how stakeholders are involved in this process. Currently, the impact of stakeholders on strategies to improve the integrated use is rarely reported, and information about how stakeholders can be engaged, including care-users who are communication vulnerable, is limited. This study illustrates the impact of all stakeholders on developing tailored implementation strategies and provides insights into supportive conditions to involve care-users who are communication vulnerable.

METHODS

With the use of participatory action research, implementation strategies were co-created by care-users who are communication vulnerable (n = 8), professionals (n = 12), management (n = 6) and researchers (n = 5) over 9 months. Data collection consisted of audiotapes, reports, and researchers' notes. Conventional content analysis was performed.

RESULTS

The impact of care-users concerned the strategies' look and feel, understandability and relevance. Professionals influenced impact on how to use strategies and terminology. The impact of management was on showing the gap between policy and practice, and learning from previous improvement failures. Researchers showed impact on analysis, direction of strategy changes and translating academic and development experience into practice. The engagement of care-users who are communication vulnerable was supported, taking into account organisational issues and the presentation of information.

CONCLUSIONS

The impact of all engaged stakeholders was identified over the different levels strategies focused on. Care-users who are communication vulnerable were valuable engaged in co-creation implementation strategies by equipping them to their needs and routines, which requires adaptation in communication, delimited meetings and a safe group environment.

TRIAL REGISTRATION

Reviewed by the Medical Ethics Committee of Zuyderland-Zuyd (METCZ20190006). NL7594 registred at https://www.trialregister.nl/ .

Stakeholder engagement from problem analysis to implementation strategies for a patient-reported experience measure in disability care: A qualitative study on the process and experiences

Background

In implementation science, vast gaps exist between theoretical and practical knowledge. These gaps prevail in the process of getting from problem analysis to selecting implementation strategies while engaging stakeholders including care users.

Objective

To describe a process of how to get from problem analysis to strategy selection, how to engage stakeholders, and to provide insights into stakeholders’ experiences.

Design

A qualitative descriptive design.

Setting and participants

The setting was a care organization providing long‐term care to people with acquired brain injuries who are communication vulnerable. Fourteen stakeholders (care users, professionals and researchers) participated. Data were collected by a document review, five interviews and one focus group. Inductive content analysis and deductive framework analysis were applied.

Intervention

Stakeholder engagement.

Main outcome measures

A three‐step process model and stakeholders experiences.

Results and conclusion

We formulated a three‐step process: (a) reaching consensus and prioritizing barriers; (b) categorizing the prioritized barriers and idealization; and (c) composing strategies. Two subthemes continuously played a role in how stakeholders were engaged during the process: communication supportive strategies and continuous contact. The experiences of stakeholder participation resulted in the following themes: stakeholders and their roles, use of co‐creation methods and communication supportive strategies, building relationships, stimulus of stakeholders to engage, sharing power, empowerment of stakeholders, feeling a shared responsibility and learning from one another. We conclude that the inclusion of communication‐vulnerable care users is possible if meetings are prepared, communication‐friendly presentations and reports are used, and relationship building is prioritized.

A retrospective assessment of the KLIK PROM portal implementation using the Consolidated Framework for Implementation Research (CFIR)

Purpose

The KLIK Patient-Reported Outcome Measure (PROM) portal is an evidence-based intervention implemented in clinical practice in > 25 Dutch hospitals for patients (children and adults) who regularly visit the outpatient clinic. Implementation science frameworks can be used to understand why implementation succeeded or failed, to structure barriers and enablers, and to develop implementation strategies to overcome barriers. This paper aimed to (A) retrospectively describe determinants of successful KLIK PROM implementation using the Consolidated Framework for Implementation Research (CFIR), and (B) identify current barriers and match implementation strategies.

Methods

(A) The KLIK implementation process was described retrospectively based on literature and experience, using the 39 CFIR constructs organized in five general domains: intervention characteristics, outer setting, inner setting, characteristics of individuals, and implementation process. (B) The CFIR-Expert Recommendations for Implementing Change (ERIC) Implementation Strategy Matching tool identified current barriers in the KLIK implementation and matched implementation strategies that addressed the identified barriers.

Results

(A) The most prominent determinants of successful KLIK PROM implementation lie in the following CFIR domains: intervention characteristics (e.g., easy to use), characteristics of individuals (e.g., motivation), and process of implementation (e.g., support). (B) 13 CFIR constructs were identified as current barriers for implementing the KLIK PROM portal. The highest overall advised ERIC strategy for the specific KLIK barriers was to identify and prepare champions.

Conclusion

Using an implementation science framework, e.g., CFIR, is recommended for groups starting to use PROMs in clinical care as it offers a structured approach and provides insight into possible enablers and barriers.

Electronic supplementary material

The online version of this article (10.1007/s11136-020-02586-3) contains supplementary material, which is available to authorized users.