The role of co-production in Learning Health Systems

Using Focus Groups to Evaluate a Self-Assessment Approach to Coproduction Value Creation in an International Community of Practice: Phase 2 of the CO-VALUE Study

INTRODUCTION

Coproduction learning health system models clearly define the use of clinical and patient-reported data for system learning and quality improvement, but less is known about how to document formative learning about coproduction value creation over the course of a quality improvement initiative. The authors aimed to 1) assess the feasibility, utility, and acceptability of novel self-assessment tools for coproduction value creation and 2) identify domains of coproduction value creation.

METHODS

The authors conducted 4 focus groups with quality improvement teams from 4 health systems in the United States and Sweden between June 2021 and September 2023. A single analyst coded transcripts and proposed themes, with investigator triangulation validating results.

RESULTS

Participants found the self-assessment tools acceptable and useful. The improvement passport was seen as more feasible for routine use than the full self-assessment guide. Peer learning within the community of practice, diverse multidisciplinary improvement teams, and leadership support facilitated teams' work. Domains of coproduction value creation included communication, self-efficacy, interconnectedness, direct and indirect costs of health care utilization, health professional experience, and access to the right care.

DISCUSSION

Peer learning and camaraderie within the community of practice maintained momentum among participating teams during a challenging time of limited resources and mounting responsibilities in health care settings, suggesting enhanced resiliency through approaching difficult tasks in community.

CONCLUSION

The authors identified themes of coproduction value creation and drivers of engagement. Future research will draw on the measurement domains established in this study to inform the development of measures of coproduction value creation. Those measures could then be incorporated into the data-rich environments of coproduction learning health systems to enhance focus on value from service user and professional perspectives.

Strategies and practices for organizational learning in integrated care

PURPOSE

The purpose of this study is to identify important strategies and practices supporting inter-organizational learning (IOL) in integrated care. The two research questions ask how organizational network architectures can help involved organizations overcome the barriers of IOL in integrated care (RQ1) and what design recommendations can strengthen the processes of IOL in integrated care (RQ2).

DESIGN/METHODOLOGY/APPROACH

This study applies a qualitative design to analyze an improvement initiative in a regional, integrated care service for elderly patients with multiple illnesses in Norway. An inductive thematic analysis for the triangulating of qualitative data from different sources was applied. Patterns within the data were organized into themes, categories and subcategories. No software was applied.

FINDINGS

The identified characteristics of the organizational network architectures supporting IOL in integrated care in the case under study were: equality of the involved parties, shared goals, recognition of expertise and the abilities to coordinate, design IOL processes and make joint decisions (RQ1). The categories of practices supporting the process of IOL were: insight into complex realities, contradictions, iteration, motivation and prototypes (RQ2).

ORIGINALITY/VALUE

This study offers much-needed insight into a successful approach for IOL in integrated care. The results offer strategies to be considered when building organizational networks for the improvement of integrated care and relevant practices useful when designing IOL processes in such care services. We believe such knowledge has important implications for policymakers, frontline personnel, education, research and leaders.

The impact of patient engagement on patient safety in care transitions after cancer treatment: Protocol for a systematic review and meta-analysis

BACKGROUND

Transitions of care after cancer treatment pose a major challenge for patient safety as adverse events and unplanned healthcare utilization occur frequently. At this point, patient and family engagement (PFE) is particularly valuable since patients and their families experience various challenges along this pathway, such as changing roles and recurrent needs to navigate across structural gaps between different services. However, there is currently a lack of evidence on the impact of PFE on patient safety in transitions after cancer treatment.

OBJECTIVE

To systematically review and synthesize evidence on effects of different PFE interventions on patient safety in the transition of care after cancer treatment.

METHODS

This protocol for a systematic review with meta-analysis follows PRISMA-P guidelines. A comprehensive database search will be conducted in MEDLINE, EMBASE, CENTRAL, CINAHL, and APA PsycInfo. Trial registries and grey literature will be searched, forward and backward citation tracking will be performed. Trials with prospective, longitudinal, interventional study designs will be included if they evaluate PFE interventions on patient safety outcomes (primary outcomes: healthcare utilization, patient harm, adherence, patient experience; secondary: quality of life, distress); eligible studies need to survey patients with any oncological disease during or after transition following cancer treatment. Results will be synthesized narratively and meta-analytically using a random-effects model. Risk of bias will be assessed using the Cochrane RoB-2 and revised JBI critical appraisal tool. The certainty of evidence will be judged according to the GRADE approach.

DISCUSSION

Robust evidence of effectiveness is needed to establish PFE interventions for patient safety in care transitions for oncological patients. This review will allow evidence-based conclusions about types and effects of different PFE interventions for transitional safety in oncology care and inform stakeholders in designing sustainable PFE activities.

TRIAL REGISTRATION

PROSPERO (CRD42024546938), OSF (doi.org/10.17605/OSF.IO/9XAMU).

Interventions to improve system-level coproduction in the Cystic Fibrosis Learning Network

BACKGROUND

Coproduction is defined as patients and clinicians collaborating equally and reciprocally in healthcare and is a crucial concept for quality improvement (QI) of health services. Learning Health Networks (LHNs) provide insights to integrate coproduction with QI efforts from programmes from various health systems.

OBJECTIVE

We describe interventions to develop and maintain patient and family partner (PFP) coproduction, measured by PFP-reported and programme-reported scales. We aim to increase percentage of programmes with PFPs reporting active QI work within their programme, while maintaining satisfaction in PFP-clinician relationships.

METHODS

Conducted in the Cystic Fibrosis Learning Network (CFLN), an LHN comprising over 30 cystic fibrosis (CF) programmes, people with CF, caregivers and clinicians cocreated interventions in readiness awareness, inclusive PFP recruitment, onboarding process, partnership development and leadership opportunities. Interventions were adapted by CFLN programmes and summarised in a change package for existing programmes and the orientation of new ones. We collected monthly assessments for PFP and programme perceptions of coproduction and PFP self-rated competency of QI skills and satisfaction with programme QI efforts. We used control charts to analyse coproduction scales and run charts for PFP self-ratings.

RESULTS

Between 2018 and 2022, the CFLN expanded to 34 programmes with 52% having ≥1 PFP reporting active QI participation. Clinicians from 76% of programmes reported PFPs were actively participating or leading QI efforts. PFPs reported increased QI skills competency (17%-32%) and consistently high satisfaction and feeling valued in their work.

CONCLUSIONS

Implementing system-level programmatic strategies to engage and sustain partnerships between clinicians and patients and families with CF improved perceptions of coproduction to conduct QI work. Key adaptable strategies for programmes included onboarding and QI training, supporting multiple PFPs simultaneously and developing financial recognition processes. Interventions may be applicable in other health conditions beyond CF seeking to foster the practice of coproduction.

Use of the iPRISM webtool in a learning community to assess implementation context and fit of a novel clinical decision support tool for physical therapy triage in acute care hospitals

BACKGROUND

The iPRISM webtool is an interactive tool designed to aid the process of applying the Practical, Robust Implementation and Sustainability Model (PRISM) for the assessment of and fit with context. A learning community (LC) is a multidisciplinary group of partners addressing a complex problem. Our LC coproduced the Physical TheraPy frEqueNcy Clinical decIsion support tooL (PT-PENCIL) to guide the use of physical therapist services in acute care hospitals.

OBJECTIVE

To describe our LC's activities to co-produce the PT-PENCIL, use of the iPRISM webtool to assess its preimplementation context and fit, and develop a multicomponent implementation strategy for the PT-PENCIL.

DESIGN

A descriptive research design.

SETTING

Three tertiary care hospitals.

PARTICIPANTS

Thirteen LC partners: six clinical physical therapists, three rehabilitation managers, three researchers, and a bioinformaticist.

INTERVENTIONS

Not applicable.

OUTCOME MEASURES

Using the iPRISM webtool, expected fit of the PT-PENCIL was rated 1 (not aligned) to 6 (well aligned) for each PRISM domain and expected reach, effectiveness, adoption, implementation, and maintenance were rated 1 (not likely at all) to 6 (very likely). Discrete implementation strategies were identified from the Expert Recommendations for Implementing Change.

RESULTS

The process spanned 18 meetings over 8 months. Ten LC partners completed the iPRISM webtool. PRISM domains with the lowest expected alignment were the "implementation and sustainability infrastructure" (mean = 4.7 out of 6; range = 3-6) and the "external environment" (mean = 4.9 of 6; range = 4-6). Adoption was the outcome with the lowest expected likelihood (mean = 4.5 out of 6; range = 1-6). Six discrete implementation strategies were identified and combined into a multicomponent strategy.

CONCLUSIONS

Within a LC, we used existing implementation science resources to co-produce a novel clinical decision support tool for acute care physical therapists and develop a strategy for its implementation. Our methodology can be replicated for similar projects given the public availability of each resource used.

Implementation and evaluation of a national quality improvement initiative in cancer surgery

BACKGROUND

In 2017, the Canadian Partnership Against Cancer, a Canadian federally sponsored organisation, initiated a national multijurisdictional quality improvement (QI) initiative to maximise the use of synoptic data to drive cancer system improvements, known as the Evidence for Surgical Synoptic Quality Improvement Programme. The goal of our study was to evaluate the outcomes, determinants and learning of this nationally led initiative across six jurisdictions in Canada, integrating a mix of cancer surgery disease sites and clinicians.

METHODS

A mixed-methods evaluation (surveys, semistructured interviews and focus groups) of this initiative was focused on the ability of each jurisdiction to use synoptic reporting data to successfully implement and sustain QI projects to beyond the completion of the initiative and the lessons learnt in the process. Resources provided to the jurisdictions included operational funding, training in QI methodology, national forums, expert coaches, and ad hoc monitoring and support. The programme emphasised foundational concepts of the QI process including data literacy, audit and feedback reports, communities of practice (CoP) and positive deviance methodology.

RESULTS

101 CoP meetings were held and 337 clinicians received feedback reports. There were 23 projects, and 22 of 23 (95%) showed improvements with 15 of 23 (65%) achieving the proposed targets. Enablers of effective data utilisation/feedback reports for QI included the need for clinicians to trust the data, have comparative data for feedback, and the engagement of both data scientists and clinicians in designing feedback reports. Enablers of sustainability of QI within each jurisdiction included QI training for clinicians, the ability to continue CoP meetings, executive and broad stakeholder engagement, and the ability to use pre-existing organisational infrastructures and processes. Barriers to continue QI work included lack of funding for core team members, lack of automated data collection processes and lack of clinician incentives (financial and other).

CONCLUSION

Success and sustainability in data-driven QI in cancer surgery require skills in QI methodology, data literacy and feedback, dedicated supportive personnel and an environment that promotes the process of collective learning and shared accountability. Building these capabilities in jurisdictional teams, tailoring interventions to facility contexts and strong leadership engagement will create the capacity for continued success in QI for cancer surgery.

Experiences of co-producing person-centred and cohesive clinical pathways in the national system for knowledge-based management in Swedish healthcare: a qualitative study

BACKGROUND

When the 21 Swedish county councils decided to collaborate in the creation of a national system for knowledge-based management, patient participation was mandatory. Patient and next-of-kin representatives (PR) co-produced person-centred and cohesive clinical pathways together with healthcare professionals (HPR). Research on co-production in healthcare at the national level is scarce. The aim of this study is to explore experiences of patient participation from the perspectives of both PRs and HPRs when co-producing clinical pathways within the Swedish nationwide healthcare system for knowledge-based management.

METHODS

A qualitative study was conducted. A strategic sample of nine PRs and eight HPRs were interviewed individually between August 2022 and January 2023 using a semi-structured interview guide. We analysed data using an inductive content analysis.

RESULTS

Three main categories were identified: (1) Finding appropriate patient representativeness; (2) Working methods that facilitate a patient perspective; and (3) Influence of the patient perspective in the clinical pathways.

CONCLUSIONS

The study demonstrates the importance of patient and next-of-kin participation in the construction of clinical pathways at the national level. The results provide a platform for further research on patient participation on the national level and add to studies on if and how patient participation on this level has an impact on how the clinical pathways are put into practice at the micro level, and the support provided at the meso level. The study contributes to the growing body of literature studying patient participation and co-production.

TRIAL REGISTRATION

Region Örebro County ID 276,940. An advisory opinion was obtained from the Swedish Ethical Review Authority (2021-05899-01).

Assessing care quality in general practice: a qualitative study of GPs in Ireland

BACKGROUND

It is estimated that each year in Ireland, approximately 29 million consultations occur in general practice with a patient satisfaction level of 90%. To date, research has been lacking on how GPs assess the quality of care.

AIM

To examine how GPs assess care quality during routine practice with respect to the following pillars of quality improvement: effectiveness, safety, timeliness, equity, efficiency, sustainability, and person-centredness.

DESIGN & SETTING

Qualitative study of GPs in Ireland.

METHOD

In this qualitative study, semi-structured interviews were conducted with 10 GPs who were recruited via a snowball sampling strategy. Interviews were recorded, transcribed, and analysed. Quality 'assessment points' were identified and themes were synthesised to produce a theoretical framework.

RESULTS

Five female and five male GPs practising in a variety of settings were interviewed. The age range was 33-68 years. In total, 122 assessment points emerged from the data and were collated into the following eight themes: the GP as a professional person factors; the patient and coproduction factors; care team factors; direct care factors; outcome factors; practice environment and organisation factors; external environment factors; and improvement approach factors.

CONCLUSION

This is the first study to examine how GPs in Ireland assess care quality as a holistic construct during daily care. The qualitative approach applied yielded rich and diverse insights into the many assessment points that GPs use to inform their approach and actions as clinicians, managers, collaborators, and leaders to maximise patient care. The theory produced is likely useful and applicable for practising GPs, healthcare administration, policymakers, and funders in planning and executing changes for quality improvement.

Development and use of a novel tool for assessing and improving researcher embeddedness in learning health systems and applied system improvements

This paper outlines the development, deployment and use, and testing of a tool for measuring and improving healthcare researcher embeddedness - i.e., being connected to and engaged with key leverage points and stakeholders in a health system. Despite the widely acknowledged importance of embeddedness for learning health systems and late-stage translational research, we were not aware of useful tools for addressing and improving embeddedness in scholar training programs. We developed the MN-LHS Embeddedness Tool covering connections to committees, working groups, leadership, and other points of contact across four domains: patients and caregivers; local practice (e.g., operations and workflows); local institutional research (e.g., research committees and agenda- or initiative-setting groups); and national (strategic connections within professional groups, conferences, etc.). We used qualitative patterns and narrative findings from 11 learning health system training program scholars to explore variation in scholar trajectories and the embeddedness tool's usefulness in scholar professional development. Tool characteristics showed moderate evidence of construct validity; secondarily, we found significant differences in embeddedness, as a score, from baseline through program completion. The tool has demonstrated simple, practical utility in making embeddedness an explicit (rather than hidden) part of applied and learning health system researcher training, alongside emerging evidence for validity.

An Evaluation of the Relationship between Training of Health Practitioners in a Person-Centred Care Model and their Person-Centred Attitudes

Introduction

The Esther Network (EN) person-centred care (PCC) advocacy training aims to promote person-centred attitudes among health practitioners in Singapore. This study aimed to assess the relationship between the training and practitioners' PCC attributes over a 3-month period, and to explore power sharing by examining the PCC dimensions of "caring about the service user as a whole person" and the "sharing of power, control and information".

Methods

A repeated-measure study design utilising the Patient-Practitioner Orientation Scale (PPOS), was administered to 437 training participants at three time points - before training (T1), immediately after (T2) and three months after training (T3). A five-statement questionnaire captured knowledge of person-centred care at T1 and T2. An Overall score, Caring and Sharing sub-scores were derived from the PPOS. Scores were ranked and divided into three groups (high, medium and low). Ordinal Generalised Estimating Equation (GEE) model analysed changes in PPOS scores over time.

Results

A single, short-term training appeared to result in measurable improvements in person-centredness of health practitioners, with slight attenuation at T3. There was greater tendency to "care" than to "share power" with service users across all three time points, but the degree of improvement was larger for sharing after training. The change in overall person-centred scores varied by sex and profession (females score higher than males, allied health showed a smaller attenuation at T3).

Conclusion

Training as a specific intervention, appeared to have potential to increase health practitioners' person-centredness but the aspect of equalising power was harder to achieve within a hierarchical structure and clinician-centric culture. An ongoing network to build relationships, and a supportive system to facilitate individual and organisational reflexivity can reinforce learning.

The Experiences of Community Health Workers in Preventing Noncommunicable Diseases in an Urban Area, the Philippines: A Qualitative Study

(1) Background: Barangay health workers (BHWs) play important roles as community health workers in preventing noncommunicable diseases (NCDs), where the shortage of health professionals is felt more acutely in the Philippines. However, there is little research on the experiences of BHWs as community health workers in preventing NCDs. This study aimed to clarify the roles and difficulties of BHWs in conducting activities for the prevention of NCDs. (2) Methods: Qualitative data were collected from 25 BHWs. (3) Results: The mean age of the participants was 50.4 ± 9.5 years, 23 were women, and the mean length of time as a BHW was 9.1 ± 7.7 years. Three major themes about the role of BHWs in preventing NCDs-"screening for NCDs", "assisting patients with management of their conditions", and "promoting healthy behaviors"-and four major themes about the difficulties-"insufficient awareness of preventative behaviors", "economic burdens", "lack of resources for managing NCDs", and "difficulty of access to medical care facilities"-were identified. (4) Conclusions: Through the findings of this study, focusing interventions aimed at addressing the difficulties for the prevention of NCDs among BHWs may help reduce health inequities.

Effectiveness of a Therapeutic Educational Oral Health Program for Persons with Schizophrenia: A Cluster Randomized Controlled Trial and Qualitative Approach

BACKGROUND

The oral health of people with schizophrenia (PWS) is very poor, suggesting a need for oral health promotion programmes with a high level of evidence. The aim of the EBENE study (Clinicaltrials.gov: NCT02512367) was to develop and evaluate the effectiveness of a multidisciplinary therapeutic educational programme in oral health (TEPOH) for PWS.

METHODS

A multicentre cluster randomised controlled trial, with outpatient psychiatry centres as the unit of randomisation, was designed to compare the effectiveness of TEPOH (intervention group) versus standard care (control group). The trial was conducted in 26 outpatient psychiatry centres in France (14 in the intervention group, 12 in the control group). Eligible patients with a diagnosis of schizophrenia were enroled between 2016 and 2020 and followed for 6 months. The TEPOH group received a multicomponent intervention (comprising an introductory session, three educational sessions, and a debriefing session). The primary endpoint was the evaluation of periodontal disease as a community periodontal index (CPI) score ≥ 3 at Month 6. The trial was completed using a qualitative approach based on semi-structured interviews with caregivers conducted between July 2018 and December 2019. The trial was stopped early due to difficulties in recruiting patients.

RESULTS

Overall, 81 patients (of 250 planned) were included, and 54 patients completed the trial: 40 in the TEPOH group and 14 in the control group. At baseline, the percentage of CPI ≥ 3 was 42.5% in the TEPOH group and 9.1% in the control group. At Month 6, the percentage of CPI ≥ 3 was 20% in the TEPOH group and 14.3% in the control group. The qualitative evaluation underlined that the professionals emphasised the "seriousness" and "assiduity" of the patients' participation in this programme and that the TEPOH reinforced carers' investment in oral hygiene. It also highlighted structural factors (lack of resources for professionals, lack of teeth in PWS, COVID-19 pandemic) that may have exacerbated the difficulties with enrolment and follow-up.

CONCLUSIONS

The effectiveness of this TEPOH, developed for PWS as part of the EBENE study, has not been demonstrated. Certain aspects of the programme's content and implementation need to be reconsidered. In particular, an adapted subjective measurement scale should be developed.

The Cystic Fibrosis Learning Network: A mixed methods evaluation of program goals, attributes, and impact

Introduction

The Cystic Fibrosis (CF) Foundation sponsored the design, pilot testing, and implementation of the CF Learning Network (CFLN) to explore how the Foundation's Care Center Network (CCN) could become a learning health system. Six years after the design, the Foundation commissioned a formative mixed methods evaluation of the CFLN to assess: CFLN participants' understanding of program goals, attributes, and perceptions of current and future impact.

Methods

We performed semi-structured interviews with CFLN participants to identify perceived goals, attributes, and impact of the network. Following thematic analyses, we developed and distributed a survey to CFLN members and a matched sample of CCN programs to understand whether the themes were unique to the CFLN.

Results

Interviews with 24 CFLN participants were conducted. Interviewees identified the primary CFLN goal as improving outcomes for people living with CF, with secondary goals of providing training in quality improvement (QI), creating a learning community, engaging all stakeholders in improvement, and spreading best practices to the CCN. Project management, use of data, common QI methods, and the learning community were seen as critical to success. Survey responses were collected from 103 CFLN members and 25 CCN members. The data revealed that CFLN respondents were more likely than CCN respondents to connect with other CF programs, routinely use data for QI, and engage patient and family partners in QI.

Conclusions

Our study suggests that the CFLN provides value beyond that achieved by the CCN. Key questions remain about whether spread of the CFLN could improve outcomes for more people living with CF.

Establishing a Cystic Fibrosis Learning Network: Interventions to promote collaboration and data-driven improvement at scale

Introduction

A learning health network is a type of learning health system in which stakeholders use network organization to improve health and health care. Building on existing resources in the cystic fibrosis (CF) community, the Cystic Fibrosis Learning Network (CFLN) was designed to improve medical outcomes and quality of life through an intentional focus on achieving reliable evidence-based chronic care delivery and creating a system for data-driven collaborative learning.

Methods

We describe the development and growth of the CFLN considering six domains of a Network Maturity Grid: system leadership; governance and policy management; quality improvement (QI); engagement and community building; data and analytics; and research. We illustrate the impact of the CFLN experience on chronic care processes and indicators of collaborative infrastructure.

Results

The CFLN represents 36 accredited care centers in the CF Foundation Care Center Network caring for over 6300 patients. Of 6779 patient clinical care visits/quarter, 77% are entered into the CF Foundation Patient Registry within 30 days, providing timely means to track outcomes. Collaborative visit planning is occurring in 93% of clinical care visits to share agenda setting with patients and families. Almost all CFLN teams (94%, n = 34) have a patient/family partner (PFP), and 74% of PFPs indicate they are actively participating, taking ownership of, or leading QI initiatives with the interdisciplinary care team. In 2022, 97% of centers reported completing 1-13 improvement cycles per month, and 82% contributed to monthly QI progress reports to share learning.

Conclusion

The CFLN is a maturing, collaborative infrastructure. CFLN centers practice at an advanced level of coproduction. The CFLN fosters interdisciplinary and PFP leadership and the performance of consistent data-driven improvement cycles. CFLN centers are positioned to respond to rapid changes in evidence-based care and advance the practice of QI and implementation science on a broader scale.

Stroke Learning Health Systems: A Topical Narrative Review With Case Examples

To our knowledge, the adoption of Learning Health System (LHS) concepts or approaches for improving stroke care, patient outcomes, and value have not previously been summarized. This topical review provides a summary of the published evidence about LHSs applied to stroke, and case examples applied to different aspects of stroke care from high and low-to-middle income countries. Our attempt to systematically identify the relevant literature and obtain real-world examples demonstrated the dissemination gaps, the lack of learning and action for many of the related LHS concepts across the continuum of care but also elucidated the opportunity for continued dialogue on how to study and scale LHS advances. In the field of stroke, we found only a few published examples of LHSs and health systems globally implementing some selected LHS concepts, but the term is not common. A major barrier to identifying relevant LHS examples in stroke may be the lack of an agreed taxonomy or terminology for classification. We acknowledge that health service delivery settings that leverage many of the LHS concepts do so operationally and the lessons learned are not shared in peer-reviewed literature. It is likely that this topical review will further stimulate the stroke community to disseminate related activities and use keywords such as learning health system so that the evidence base can be more readily identified.

Trust as a key measure of quality and safety after the restriction of family contact in Canadian long-term care settings during the COVID-19 pandemic

Family caregivers in Canadian long-term care homes are estimated to provide 10 h per week of direct care to approximately 30% of residents through roles including mobility support, mealtime assistance, personal care, social interaction, psychological care, care coordination, and advocacy. Despite these contributions, they continue to be viewed as visitors rather than as key participants in the interdependent relationships that support the long-term care sector. Their marginalization was evident during the COVID-19 pandemic, as Canadian public health policy focused on preventing them from entering long-term care, rather than supporting personal risk management, symptom screening, personal protective equipment, and other mechanisms for safe involvement in care. Several iatrogenic resident outcomes have been attributed to this, including decreased cognitive function, decreased mobility, increased incontinence, weight loss, increased depression and anxiety, increased responsive behaviours amongst those living with dementia, and increased delirium. In this commentary article, we argue that family caregiver presence was conflated as a risk when instead, it contributed to unintended harm. We identify nine well-known human social cognitive predispositions that may have contributed to this. We then examine their implications for trust in long-term care, and consider how quality and safety can be further fostered in long-term care by working in partnership with family caregivers to rebuild trust through enquiry and collaboration. We advocate incorporating trust as an essential measure of quality health service.

How a point-of-care dashboard facilitates co-production of health care and health for and with individuals with psychotic disorders: a mixed-methods case study

BACKGROUND

Individuals with psychotic disorders experience widespread treatment failures and risk early death. Sweden's largest department specializing in psychotic disorders sought to improve patients' health by developing a point-of-care dashboard to support joint planning and co-production of care. The dashboard was tested for 18 months and included more than 400 patients at two outpatient clinics.

METHODS

This study evaluates the dashboard by addressing two questions: 1) Can differences in health-related outcome measures be attributed to the use of the dashboard? 2) How did the case managers experience the accessibility, use, and usefulness of the dashboard for co-producing care with individuals with psychotic disorders? This mixed-method case study used both Patient-Reported Outcome Measures (PROM) and data from a focus group interview with case managers. Data collection and analysis were framed by the Clinical Adoption Meta Model (CAMM) phases: i) accessibility, ii) system use, iii) behavior, and iv) clinical outcomes. The PROM used was the 12-item World Health Organization Disability Assessment Schedule (WHODAS 2.0), which assesses functional impairment and disability. Patients at clinics using the dashboard were matched with patients at clinics not using the dashboard. PROM data were compared using non-parametric statistics due to skewness in distribution. The focus group included five case managers who had experience using the dashboard with patients.

RESULTS

Compared to patients from clinics that did not use the dashboard, patients from clinics that did use the dashboard improved significantly overall (p = 0.045) and in the domain self-care (p = 0.041). Focus group participants reported that the dashboard supported data feedback-informed care and a proactive stance related to changes in patients' health. The dashboard helped users identify critical changes and enabled joint planning and evaluation.

CONCLUSION

Dashboard use was related to better patient health (WHODAS scores) when compared with matched patients from clinics that did not use the dashboard. In addition, case managers had a positive experience using the dashboard. Dashboard use might have lowered the risk for missing critical changes in patients' health while increasing the ability to proactively address needs. Future studies should investigate how to enhance patient co-production through use of supportive technologies.

Consensus on how to optimise patient/family engagement in hospital planning and improvement: a Delphi survey

OBJECTIVE

Patient and family engagement (PE) in health service planning and improvement is widely advocated, yet little prior research offered guidance on how to optimise PE, particularly in hospitals. This study aimed to engage stakeholders in generating evidence-informed consensus on recommendations to optimise PE.

DESIGN

We transformed PE processes and resources from prior research into recommendations that populated an online Delphi survey.

SETTING AND PARTICIPANTS

Panellists included 58 persons with PE experience including: 22 patient/family advisors and 36 others (PE managers, clinicians, executives and researchers) in round 1 (100%) and 55 in round 2 (95%).

OUTCOME MEASURES

Ratings of importance on a seven-point Likert scale of 48 strategies organised in domains: engagement approaches, strategies to integrate diverse perspectives, facilitators, strategies to champion engagement and hospital capacity for engagement.

RESULTS

Of 50 recommendations, 80% or more of panellists prioritised 32 recommendations (27 in round 1, 5 in round 2) across 5 domains: 5 engagement approaches, 4 strategies to identify and integrate diverse patient/family advisor perspectives, 9 strategies to enable meaningful engagement, 9 strategies by which hospitals can champion PE and 5 elements of hospital capacity considered essential for supporting PE. There was high congruence in rating between patient/family advisors and healthcare professionals for all but six recommendations that were highly rated by patient/family advisors but not by others: capturing diverse perspectives, including a critical volume of advisors on committees/teams, prospectively monitoring PE, advocating for government funding of PE, including PE in healthcare worker job descriptions and sharing PE strategies across hospitals.

CONCLUSIONS

Decision-makers (eg, health system policy-makers, hospitals executives and managers) can use these recommendations as a framework by which to plan and operationalise PE, or evaluate and improve PE in their own settings. Ongoing research is needed to monitor the uptake and impact of these recommendations on PE policy and practice.