A science of collaborative learning health systems

Strategies and practices for organizational learning in integrated care

PURPOSE

The purpose of this study is to identify important strategies and practices supporting inter-organizational learning (IOL) in integrated care. The two research questions ask how organizational network architectures can help involved organizations overcome the barriers of IOL in integrated care (RQ1) and what design recommendations can strengthen the processes of IOL in integrated care (RQ2).

DESIGN/METHODOLOGY/APPROACH

This study applies a qualitative design to analyze an improvement initiative in a regional, integrated care service for elderly patients with multiple illnesses in Norway. An inductive thematic analysis for the triangulating of qualitative data from different sources was applied. Patterns within the data were organized into themes, categories and subcategories. No software was applied.

FINDINGS

The identified characteristics of the organizational network architectures supporting IOL in integrated care in the case under study were: equality of the involved parties, shared goals, recognition of expertise and the abilities to coordinate, design IOL processes and make joint decisions (RQ1). The categories of practices supporting the process of IOL were: insight into complex realities, contradictions, iteration, motivation and prototypes (RQ2).

ORIGINALITY/VALUE

This study offers much-needed insight into a successful approach for IOL in integrated care. The results offer strategies to be considered when building organizational networks for the improvement of integrated care and relevant practices useful when designing IOL processes in such care services. We believe such knowledge has important implications for policymakers, frontline personnel, education, research and leaders.

Interventions to improve system-level coproduction in the Cystic Fibrosis Learning Network

BACKGROUND

Coproduction is defined as patients and clinicians collaborating equally and reciprocally in healthcare and is a crucial concept for quality improvement (QI) of health services. Learning Health Networks (LHNs) provide insights to integrate coproduction with QI efforts from programmes from various health systems.

OBJECTIVE

We describe interventions to develop and maintain patient and family partner (PFP) coproduction, measured by PFP-reported and programme-reported scales. We aim to increase percentage of programmes with PFPs reporting active QI work within their programme, while maintaining satisfaction in PFP-clinician relationships.

METHODS

Conducted in the Cystic Fibrosis Learning Network (CFLN), an LHN comprising over 30 cystic fibrosis (CF) programmes, people with CF, caregivers and clinicians cocreated interventions in readiness awareness, inclusive PFP recruitment, onboarding process, partnership development and leadership opportunities. Interventions were adapted by CFLN programmes and summarised in a change package for existing programmes and the orientation of new ones. We collected monthly assessments for PFP and programme perceptions of coproduction and PFP self-rated competency of QI skills and satisfaction with programme QI efforts. We used control charts to analyse coproduction scales and run charts for PFP self-ratings.

RESULTS

Between 2018 and 2022, the CFLN expanded to 34 programmes with 52% having ≥1 PFP reporting active QI participation. Clinicians from 76% of programmes reported PFPs were actively participating or leading QI efforts. PFPs reported increased QI skills competency (17%-32%) and consistently high satisfaction and feeling valued in their work.

CONCLUSIONS

Implementing system-level programmatic strategies to engage and sustain partnerships between clinicians and patients and families with CF improved perceptions of coproduction to conduct QI work. Key adaptable strategies for programmes included onboarding and QI training, supporting multiple PFPs simultaneously and developing financial recognition processes. Interventions may be applicable in other health conditions beyond CF seeking to foster the practice of coproduction.

A regional learning health system of congregate care facilities for COVID-19 response

Introduction

The COVID-19 pandemic disproportionately affected congregate care (CC) facilities due to communal living, presence of vulnerable populations, inadequate preventive resources, and limited ability to respond to the pandemic's rapidly evolving phases. Most facilities function independently and are not organized for collaborative learning and operations.

Methods

We formed a learning health system of CC facilities in our 14-county metropolitan region, coordinated with public health and health care sectors, to address challenges driven by COVID-19. A CC steering committee (SC) was formed that represented diverse institutions and viewpoints, including skilled nursing facilities, transitional care facilities, residential facilities, prisons, and shelters. The SC met regularly and was guided by situational awareness and systems thinking. A regional CC COVID-19 dashboard was developed based on publicly available data and weekly data submitted by participating facilities. Those experiencing outbreaks or supply shortages were quickly identified. As the pandemic progressed, the role of the SC shifted to address new and forecasted needs.

Results

Over 60 facilities participated in data sharing. The SC shared new guidelines, regulations, educational material, and best practices with the participating facilities. Information about testing sites, supplies, vaccination rollout, and facilities that had the capacity to accept COVID-19 patients was regularly disseminated. The SC was able to direct resources to those facilities experiencing outbreaks or supply shortages.

Conclusions

A novel learning health system of regional CC facilities enabled preparedness, situational awareness, collaboration, and rapid dissemination of best practices across pandemic phases. Such collaborative efforts can play an important role in addressing other public and preventive health challenges.

Building a regional pediatric asthma learning health system in support of optimal, equitable outcomes

Introduction

Asthma is characterized by preventable morbidity, cost, and inequity. We sought to build an Asthma Learning Health System (ALHS) to coordinate regional pediatric asthma improvement activities.

Methods

We generated quantitative and qualitative insights pertinent to a better, more equitable care delivery system. We used electronic health record data to calculate asthma hospitalization rates for youth in our region. We completed an "environmental scan" to catalog the breadth of asthma-related efforts occurring in our children's hospital and across the region. We supplemented the scan with group-level assessments and focus groups with parents, clinicians, and community partners. We used insights from this descriptive epidemiology to inform the definition of shared aims, drivers, measures, and prototype interventions.

Results

Greater Cincinnati's youth are hospitalized for asthma at a rate three times greater than the U.S. average. Black youth are hospitalized at a rate five times greater than non-Black youth. Certain neighborhoods bear the disproportionate burden of asthma morbidity. Across Cincinnati, there are many asthma-relevant activities that seek to confront this morbidity; however, efforts are largely disconnected. Qualitative insights highlighted the importance of cross-sector coordination, evidence-based acute and preventive care, healthy homes and neighborhoods, and accountability. These insights also led to a shared, regional aim: to equitably reduce asthma-related hospitalizations. Early interventions have included population-level pattern recognition, multidisciplinary asthma action huddles, and enhanced social needs screening and response.

Conclusion

Learning health system methods are uniquely suited to asthma's complexity. Our nascent ALHS provides a scaffold atop which we can pursue better, more equitable regional asthma outcomes.

Conceptualizing and redefining successful patient engagement in patient advisory councils in learning health networks

Introduction

Patient engagement has historically referenced engagement in one's healthcare, with more recent definitions expanding patient engagement to encompass patient advocacy work in Learning Health Networks (LHNs). Efforts to conceptualize and define what patient engagement means-and what successful patient engagement means-are, however, lacking and a barrier to meaningful and sustainable patient engagement via patient advisory councils (PACs) across LHNs.

Methods

Several co-authors (Madeleine Huwe, Becky Woolf, Jennie David) are former ImproveCareNow (ICN) PAC members, and we integrate a narrative review of the extant literature and a case study of our lived experiences as former ICN PAC members. We present nuanced themes of successful patient engagement from our lived experiences on ICN's PAC, with illustrative quotes from other PAC members, and then propose themes and metrics to consider in patient engagement across LHNs.

Results

Successful patient engagement in our experiences with ICN's PAC reaches beyond the "levels of engagement" previously described in the literature. We posit that our successful patient/PAC engagement experiences with ICN represent key mechanisms that could be applied across LHNs, including (1) personal growth for PAC members, (2) PAC internal engagement/community, (3) PAC engagement and presence within the LHN, (4) local institutional engagement for those who participate in the LHN, and (5) tangible resources/products from PAC members.

Conclusion

Patient engagement in LHNs, like ICN, holds significant power to meaningfully shape and co-produce healthcare systems, and engagement is undervalued and conceptualized dichotomously (eg, engaged or not engaged). Reconceptualizing successful patient/PAC engagement is critical in ongoing efforts to study, support, and understand mechanisms of sustainable and successful patient engagement. Having a modern, multidimensional definition for successful patient engagement in LHNs can support efforts to increase underrepresented voices in PACs, measure and track successful multidimensional patient engagement, and study how successful patient engagement may impact outcomes for patients and LHNs.

21st century (clinical) decision support in nursing and allied healthcare. Developing a learning health system: a reasoned design of a theoretical framework

In this paper, we present a framework for developing a Learning Health System (LHS) to provide means to a computerized clinical decision support system for allied healthcare and/or nursing professionals. LHSs are well suited to transform healthcare systems in a mission-oriented approach, and is being adopted by an increasing number of countries. Our theoretical framework provides a blueprint for organizing such a transformation with help of evidence based state of the art methodologies and techniques to eventually optimize personalized health and healthcare. Learning via health information technologies using LHS enables users to learn both individually and collectively, and independent of their location. These developments demand healthcare innovations beyond a disease focused orientation since clinical decision making in allied healthcare and nursing is mainly based on aspects of individuals' functioning, wellbeing and (dis)abilities. Developing LHSs depends heavily on intertwined social and technological innovation, and research and development. Crucial factors may be the transformation of the Internet of Things into the Internet of FAIR data & services. However, Electronic Health Record (EHR) data is in up to 80% unstructured including free text narratives and stored in various inaccessible data warehouses. Enabling the use of data as a driver for learning is challenged by interoperability and reusability.To address technical needs, key enabling technologies are suitable to convert relevant health data into machine actionable data and to develop algorithms for computerized decision support. To enable data conversions, existing classification and terminology systems serve as definition providers for natural language processing through (un)supervised learning.To facilitate clinical reasoning and personalized healthcare using LHSs, the development of personomics and functionomics are useful in allied healthcare and nursing. Developing these omics will be determined via text and data mining. This will focus on the relationships between social, psychological, cultural, behavioral and economic determinants, and human functioning.Furthermore, multiparty collaboration is crucial to develop LHSs, and man-machine interaction studies are required to develop a functional design and prototype. During development, validation and maintenance of the LHS continuous attention for challenges like data-drift, ethical, technical and practical implementation difficulties is required.

A Scoping Review on Learning Health Networks Available in Pediatric Surgical Specialties

BACKGROUND

Learning health networks (LHN) are consortia of institutions that collaborate and embrace the elements of the learning health system (LHS), including quality improvement, education, research, and stakeholder involvement. Their ultimate goal is rapid information dissemination in clinical care. Pediatric surgical specialties perform unique yet high-impact procedures that could benefit from LHN, thereby improving surgical outcomes and care through LHS approaches. Consequently, health system leaders should be aware of LHN and their importance in enhancing surgical care and improving outcomes. This scoping review aims to map and characterize the existing LHN applied in pediatric surgical specialties.

METHODS

A systematic literature search was performed on Medline, EMBASE, and Scopus up to June 2022, with an update search conducted in May 2023. Additionally, Google Scholar, ProQuest and inquiry from topic experts were used for cross-referencing relevant review articles to identify grey literature. This scoping review was conducted and reported according to the PRISMA-scoping review extension.

RESULTS

A total of 56 publications for 19 LHN were identified and included in this scoping review. Out of 19 identified LHN in pediatric surgical specialties, 18 were organized in North America. Eight of the networks are related to pediatric general surgery and another eight were related to pediatric transplantation. The 16 out of 19 LHN were initiated after 2001. To date, only eight of the LHNs generated reports of comparative improved outcomes.

CONCLUSION

This scoping review provides an overview of the available LHNs in pediatric surgical specialties. Over the past decade, several pediatric surgical specialties have embraced the principles of learning health systems, forming inter-institutional collaborations that utilize information technology to generate big data on patient-level clinical information, engage in quality improvement cycles, adopt evidence-based practices, and actively involve patients and stakeholders.

LEVEL OF EVIDENCE

IV.

The Cystic Fibrosis Learning Network: A mixed methods evaluation of program goals, attributes, and impact

Introduction

The Cystic Fibrosis (CF) Foundation sponsored the design, pilot testing, and implementation of the CF Learning Network (CFLN) to explore how the Foundation's Care Center Network (CCN) could become a learning health system. Six years after the design, the Foundation commissioned a formative mixed methods evaluation of the CFLN to assess: CFLN participants' understanding of program goals, attributes, and perceptions of current and future impact.

Methods

We performed semi-structured interviews with CFLN participants to identify perceived goals, attributes, and impact of the network. Following thematic analyses, we developed and distributed a survey to CFLN members and a matched sample of CCN programs to understand whether the themes were unique to the CFLN.

Results

Interviews with 24 CFLN participants were conducted. Interviewees identified the primary CFLN goal as improving outcomes for people living with CF, with secondary goals of providing training in quality improvement (QI), creating a learning community, engaging all stakeholders in improvement, and spreading best practices to the CCN. Project management, use of data, common QI methods, and the learning community were seen as critical to success. Survey responses were collected from 103 CFLN members and 25 CCN members. The data revealed that CFLN respondents were more likely than CCN respondents to connect with other CF programs, routinely use data for QI, and engage patient and family partners in QI.

Conclusions

Our study suggests that the CFLN provides value beyond that achieved by the CCN. Key questions remain about whether spread of the CFLN could improve outcomes for more people living with CF.

Establishing a Cystic Fibrosis Learning Network: Interventions to promote collaboration and data-driven improvement at scale

Introduction

A learning health network is a type of learning health system in which stakeholders use network organization to improve health and health care. Building on existing resources in the cystic fibrosis (CF) community, the Cystic Fibrosis Learning Network (CFLN) was designed to improve medical outcomes and quality of life through an intentional focus on achieving reliable evidence-based chronic care delivery and creating a system for data-driven collaborative learning.

Methods

We describe the development and growth of the CFLN considering six domains of a Network Maturity Grid: system leadership; governance and policy management; quality improvement (QI); engagement and community building; data and analytics; and research. We illustrate the impact of the CFLN experience on chronic care processes and indicators of collaborative infrastructure.

Results

The CFLN represents 36 accredited care centers in the CF Foundation Care Center Network caring for over 6300 patients. Of 6779 patient clinical care visits/quarter, 77% are entered into the CF Foundation Patient Registry within 30 days, providing timely means to track outcomes. Collaborative visit planning is occurring in 93% of clinical care visits to share agenda setting with patients and families. Almost all CFLN teams (94%, n = 34) have a patient/family partner (PFP), and 74% of PFPs indicate they are actively participating, taking ownership of, or leading QI initiatives with the interdisciplinary care team. In 2022, 97% of centers reported completing 1-13 improvement cycles per month, and 82% contributed to monthly QI progress reports to share learning.

Conclusion

The CFLN is a maturing, collaborative infrastructure. CFLN centers practice at an advanced level of coproduction. The CFLN fosters interdisciplinary and PFP leadership and the performance of consistent data-driven improvement cycles. CFLN centers are positioned to respond to rapid changes in evidence-based care and advance the practice of QI and implementation science on a broader scale.

Toward an ontology of collaborative learning healthcare systems

Objective

To establish a basis for a domain ontology - a formal, explicit specification of a shared conceptualization - of collaborative learning healthcare systems (CLHSs) in order to facilitate measurement, explanation, and improvement.

Methods

We adapted the "Methontology" approach to begin building an ontology of CLHSs. We specified the purpose of an ontology, acquired domain knowledge via literature review, conceptualized a common framework of CLHSs using a grounded approach, refined these concepts based on expert panel input, and illustrated concept application via four cases.

Results

The set of concepts identified as important to include in an ontology includes goals, values, structure, actors, environment, and products. To establish this set of concepts, we gathered input from content experts in two ways. First, expert panel methods were used to elicit feedback on these concepts and to test the elicitation of terms for the vocabulary of the Values concept. Second, from these discussions we developed a mapping exercise to test the intuitiveness of the concepts, requesting that network leaders from four CLHSs complete a mapping exercise to associate characteristics of their networks with the high-level concepts, building the vocabulary for each concept in a grounded fashion. We also solicited feedback from these participants on the experience of completing the mapping exercise, finding that the exercise is acceptable and could aid in CLHS development and collaboration. Respondents identified opportunities to improve the operational definitions of each concept to ensure that corresponding vocabularies are distinct and non-overlapping.

Discussion

Our results provide a foundation for developing a formal, explicit shared conceptualization of CLHSs. Once developed, such a tool can be useful for measurement, explanation, and improvement. Further work, including alignment to a top-level ontology, expanding the vocabulary, and defining relations between vocabulary is required to formally build out an ontology for these uses.

A scoping review of the use of quality improvement methods by community organizations in the United States, Australia, New Zealand, and Canada to improve health and well-being in community settings

Background

Health-care facilities have used quality improvement (QI) methods extensively to improve quality of care. However, addressing complex public health issues such as coronavirus disease 2019 and their underlying structural determinants requires community-level innovations beyond health care. Building community organizations’ capacity to use QI methods is a promising approach to improving community health and well-being.

Objectives

We explore how community health improvement has been defined in the literature, the extent to which community organizations have knowledge and skill in QI and how communities have used QI to drive community-level improvements.

Methods

Per a published study protocol, we searched Scopus, Web of Science, and Proquest Health management for articles between 2000 and 2019 from USA, Australia, New Zealand, and Canada. We included articles describing any QI intervention in a community setting to improve community well-being. We screened, extracted, and synthesized data. We performed a quantitative tabulation and a thematic analysis to summarize results.

Results

Thirty-two articles met inclusion criteria, with 31 set in the USA. QI approaches at the community level were the same as those used in clinical settings, and many involved multifaceted interventions targeting chronic disease management or health promotion, especially among minority and low-income communities. There was little discussion on how well these methods worked in community settings or whether they required adaptations for use by community organizations. Moreover, decision-making authority over project design and implementation was typically vested in organizations outside the community and did not contribute to strengthening the capability of community organizations to undertake QI independently.

Conclusion

Most QI initiatives undertaken in communities are extensions of projects in health-care settings and are not led by community residents. There is urgent need for additional research on whether community organizations can use these methods independently to tackle complex public health problems that extend beyond health-care quality.

Cystic fibrosis learning network telehealth innovation lab during the COVID-19 pandemic: a success QI story for interdisciplinary care and agenda setting

INTRODUCTION

The Cystic Fibrosis Foundation chronic care guidelines recommend monitoring clinical status of a patient with cystic fibrosis (CF) through quarterly interdisciplinary visits. At the beginning of the COVID-19 pandemic, the Cystic Fibrosis Learning Network (CFLN) designed and initiated a telehealth (TH) innovation lab (TH ILab) to support transition from the classic CF care model of quarterly in-person office visits to a care model that included TH.

AIM

The specific aims of the TH ILab were to increase the percentage of virtual visits with interdisciplinary care (IDC) from 60% to 85% and increase the percentage of virtual visits in which patients and families participated in shared agenda setting (AS) from 52% to 85% by 31 December 2020.

METHODS

The model for improvement methodology was used to determine the ILab aims, theory, interventions and measures. In the testing phase of the ILab, data related to process and outcome measures as well as learnings from plan-do-study-act cycles were collected, analysed and shared weekly with the TH ILab teams. Participating centres created processes for IDC and AS for TH visits and developed and shared quality improvement tools specific to their local context with other centres during the ILab weekly meetings and via a secure CFLN-maintained platform.

RESULTS

Both specific aims were achieved ahead of the expected target date. By August 2020, 85% of the TH ILab visits provided IDC and 92% of patients were seen for CF care by teams from the TH ILab that participated in AS.

CONCLUSION

Shared learning through a collaborative, data-driven process in the CFLN TH ILab rapidly led to standardised TH IDC and AS, which achieved reliable and sustainable processes which could be reproduced by other networks.

Comparative effectiveness of paediatric kidney stone surgery (the PKIDS trial): study protocol for a patient-centred pragmatic clinical trial

INTRODUCTION

The strength of the evidence base for the comparative effectiveness of three common surgical modalities for paediatric nephrolithiasis (ureteroscopy, shockwave lithotripsy and percutaneous nephrolithotomy) and its relevance to patients and caregivers are insufficient. We describe the methods and rationale for the Pediatric KIDney Stone (PKIDS) Care Improvement Network Trial with the aim to compare effectiveness of surgical modalities in paediatric nephrolithiasis based on stone clearance and lived patient experiences. This protocol serves as a patient-centred alternative to randomised controlled trials for interventions where clinical equipoise is lacking.

METHODS AND ANALYSIS

The PKIDS is a collaborative learning organisation composed of 26 hospitals that is conducting a prospective pragmatic clinical trial comparing the effectiveness of ureteroscopy, shockwave lithotripsy and percutaneous nephrolithotomy for youth aged 8-21 years with kidney and/or ureteral stones. Embedded within clinical care, the PKIDS trial will collect granular patient-level, surgeon-level and institution-level data, with a goal enrolment of 1290 participants over a 21-month period. The primary study outcome is stone clearance, defined as absence of a residual calculus of >4 mm on postoperative ultrasound. Secondary outcomes include patient-reported physical, emotional and social health outcomes (primarily using the Patient-Reported Outcome Measurement Information System), analgesic use and healthcare resource use. Timing and content of secondary outcomes assessments were set based on feedback from patient partners. Heterogeneity of treatment effect for stone clearance and patient-reported outcomes by participant and stone characteristics will be assessed.

ETHICS AND DISSEMINATION

This study is approved by the central institutional review board with reliance across participating sites. Participating stakeholders will review results and contribute to development dissemination at regional, national and international meetings.

TRIAL REGISTRATION NUMBER

NCT04285658; Pre-results.