Identifying requisite learning health system competencies: a scoping review

Learning Health System to rapidly improve the implementation of a school physical activity policy

BACKGROUND

Learning Health Systems (LHS) - characterised by cycles of evidence generation and application - are increasingly recognised for their potential to improve public health interventions and optimise health impacts; however there is little evidence of their application in the context of public health practice. Here, we describe how an Australian public health unit applied a LHS approach to successfully improve a model of support for implementation of a school-based physical activity policy.

METHODS

This body of work was undertaken in the context of a strong research-practice partnership. Core LHS capabilities included: i) partnerships and stakeholder engagement; ii) workforce development and learning health communities; iii) multi-disciplinary scientific expertise; iv) practice data collection and management system; v) evidence surveillance and synthesis; and vi) governance and organisational processes of decision making. Three cycles of data generation and application were used. Within each cycle, randomised controlled trials conducted in NSW primary schools were used to generate data on the support model's effectiveness for improving schools' implementation of a government physical activity policy, its delivery costs, and process measures such as adoption and acceptability. Each type of data were analysed independently, synthesised, and then presented to a multi-disciplinary team of researchers and practitioners, in consult with stakeholders, leading to collaborative decisions for incremental improvements to the support model.

RESULTS

Cycle 1 tested the first version of the support model (composed of five implementation strategies targeting identified barriers of policy implementation) and showed the model's feasibility and efficacy for improving schools' policy implementation. Data-informed changes were made to enhance impact, including the addition of three implementation strategies to address outstanding barriers. Cycle 2 (now, testing a package of eight implementation strategies) established the model's effectiveness and cost-effectiveness for improving school's policy implementation. Data-informed changes were made to reduce delivery costs, specifically adapting the costliest strategies to reduce in-person contact from external support personnel. Cycle 3 showed that the adaptations minimised the relative cost of delivery without adversely impacting on the effect.

CONCLUSIONS

Through this process, we identified an effective, cost-effective, acceptable and scalable policy implementation support model for service delivery. This provides important information to inform or support LHS approaches for other agencies seeking to optimise the health impact of evidence-based interventions.

Health-care organization characteristics in cancer care delivery: an integrated conceptual framework with content validation

Context can influence cancer-related outcomes. For example, health-care organization characteristics, including ownership, leadership, and culture, can affect care access, communication, and patient outcomes. Health-care organization characteristics and other contextual factors can also influence whether and how clinical discoveries reduce cancer incidence, morbidity, and mortality. Importantly, policy, market, and technology changes are transforming health-care organization design, culture, and operations across the cancer continuum. Consequently, research is essential to examine when, for whom, and how organizational characteristics influence person-level, organization-level, and population-level cancer outcomes. Understanding organizational characteristics-the structures, processes, and other features of entities involved in health care delivery-and their dynamics is an important yet understudied area of care delivery research across the cancer continuum. Research incorporating organizational characteristics is critical to address health inequities, test care delivery models, adapt interventions, and strengthen implementation. The field lacks conceptual grounding, however, to help researchers identify germane organizational characteristics. We propose a framework identifying organizational characteristics relevant for cancer care delivery research based on conceptual work in health services, organizational behavior, and management science and refined using a systematic review and key informant input. The proposed framework is a tool for organizing existing research and enhancing future cancer care delivery research. Following a 2012 Journal of the National Cancer Institute monograph, this work complements National Cancer Institute efforts to stimulate research addressing the relationship between cancer outcomes and contextual factors at the patient, provider, team, delivery organization, community, and health policy levels.

Using implementation science to operate as a learning health system to improve outcomes in early psychosis

AIM

Early interventions are well understood to improve psychosis outcomes, but their successful implementation remains limited. This article introduces a three-step roadmap for advancing the implementation of evidence-based practices to operate as a learning health system, which can be applied to early interventions for psychosis and is intended for an audience that is relatively new to systematic approaches to implementation.

METHODS

The roadmap is grounded in implementation science, which specializes in methods to promote routine use of evidence-based innovations. The roadmap draws on learning health system principles that call for commitment of leadership, application of evidence, examination of care experiences, and study of health outcomes. Examples are discussed for each roadmap step, emphasizing both data- and stakeholder-related considerations applicable throughout the roadmap.

CONCLUSIONS

Early psychosis care is a promising topic through which to discuss the critical need to move evidence into practice. Despite remarkable advances in early psychosis interventions, population-level impact of those interventions is yet to be realized. By providing an introduction to how implementation science principles can be operationalized in a learning health system and sharing examples from early psychosis care, this article prompts inclusion of a wider audience in essential discourse on the role that implementation science can play for moving evidence into practice for other realms of psychiatric care as well. To this end, the proposed roadmap can serve as a conceptual guiding template and framework through which various psychiatric services can methodically pursue timely implementation of evidence-based interventions for higher quality care and improved outcomes.

Enrichment of core competencies to maximize health system impact: An analysis of an embedded research training program

Introduction

The Health System Impact (HSI) Fellowship is an embedded research training program that aims to prepare doctoral trainees and postdoctoral fellows for stronger career readiness and greater impact as emerging leaders within and beyond the academy, including in learning health systems (LHS). The program supports fellows to develop 10 leadership and research competencies that comprise the Enriched Core Competency Framework in Health Services and Policy Research through a combination of experiential learning, mentorship, and professional development training. This study tracks competency development of HSI fellows over time and examines fellows' perspectives on which program design elements support their competency development.

Methods

A competency assessment tool developed for the program was independently completed by 95 postdoctoral and 36 doctoral fellows (self-assessments) and their respective 203 dyad (academic and health system) supervisors in the 2017 to 2019 program cohorts, who independently rated the strength of fellows' 10 competencies at baseline and several points thereafter. Competency strength ratings were analyzed to understand change over time and differences in ratings across groups (between fellows' sex, supervisor type, and supervisor vs. fellow). Program design element ratings were examined to understand perspectives on their contribution toward fellows' competency development.

Results

Fellows' competency strength significantly improved in all 10 domains over time, based on independent assessments by the fellows and their dyad supervisors. Supervisors tended to rate the fellows' competency strength higher than the fellows did. Differences in competency ratings between male and female fellows (self-assessments) and between academic and health system supervisors were either negligble or not significant. Fellows identified all nine program design elements as enriching their competency development.

Conclusion

The HSI Fellowship provides an opportunity for fellows to develop the full suite of enriched core competencies and to prepare a cadre of emerging leaders with the skills and experience to contribute to the advancement of LHS.

Progress with the Learning Health System 2.0: a rapid review of Learning Health Systems' responses to pandemics and climate change

BACKGROUND

Pandemics and climate change each challenge health systems through increasing numbers and new types of patients. To adapt to these challenges, leading health systems have embraced a Learning Health System (LHS) approach, aiming to increase the efficiency with which data is translated into actionable knowledge. This rapid review sought to determine how these health systems have used LHS frameworks to both address the challenges posed by the COVID-19 pandemic and climate change, and to prepare for future disturbances, and thus transition towards the LHS2.0.

METHODS

Three databases (Embase, Scopus, and PubMed) were searched for peer-reviewed literature published in English in the five years to March 2023. Publications were included if they described a real-world LHS's response to one or more of the following: the COVID-19 pandemic, future pandemics, current climate events, future climate change events. Data were extracted and thematically analyzed using the five dimensions of the Institute of Medicine/Zurynski-Braithwaite's LHS framework: Science and Informatics, Patient-Clinician Partnerships, Continuous Learning Culture, Incentives, and Structure and Governance.

RESULTS

The search yielded 182 unique publications, four of which reported on LHSs and climate change. Backward citation tracking yielded 13 additional pandemic-related publications. None of the climate change-related papers met the inclusion criteria. Thirty-two publications were included after full-text review. Most were case studies (n = 12, 38%), narrative descriptions (n = 9, 28%) or empirical studies (n = 9, 28%). Science and Informatics (n = 31, 97%), Continuous Learning Culture (n = 26, 81%), Structure and Governance (n = 23, 72%) were the most frequently discussed LHS dimensions. Incentives (n = 21, 66%) and Patient-Clinician Partnerships (n = 18, 56%) received less attention. Twenty-nine papers (91%) discussed benefits or opportunities created by pandemics to furthering the development of an LHS, compared to 22 papers (69%) that discussed challenges.

CONCLUSIONS

An LHS 2.0 approach appears well-suited to responding to the rapidly changing and uncertain conditions of a pandemic, and, by extension, to preparing health systems for the effects of climate change. LHSs that embrace a continuous learning culture can inform patient care, public policy, and public messaging, and those that wisely use IT systems for decision-making can more readily enact surveillance systems for future pandemics and climate change-related events.

TRIAL REGISTRATION

PROSPERO pre-registration: CRD42023408896.

Qualitative study of international key informants' perspectives on the current and future state of healthcare quality measurement and feedback

OBJECTIVES

The aim of this study is to explore the current and future state of quality measurement and feedback and identify factors influencing measurement feedback systems, including the barriers and enablers to their effective design, implementation, use and translation into quality improvement.

DESIGN

This qualitative study used semistructured interviews with key informants. A deductive framework analysis was conducted to code transcripts to the Theoretical Domains Framework (TDF). An inductive analysis was used to produce subthemes and belief statements within each TDF domain.

SETTING

All interviews were conducted by videoconference and audio-recorded.

PARTICIPANTS

Key informants were purposively sampled experts in quality measurement and feedback, including clinical (n=5), government (n=5), research (n=4) and health service leaders (n=3) from Australia (n=7), the USA (n=4), the UK (n=2), Canada (n=2) and Sweden (n=2).

RESULTS

A total of 17 key informants participated in the study. The interview length ranged from 48 to 66 min. 12 theoretical domains populated by 38 subthemes were identified as relevant to measurement feedback systems. The most populous domains included environmental context and resources, memory, attention and decision-making, and social influences. The most populous subthemes included 'quality improvement culture', 'financial and human resource support' and 'patient-centred measurement'. There were minimal conflicting beliefs outside of 'data quality and completeness'. Conflicting beliefs in these subthemes were predominantly between government and clinical leaders.

CONCLUSIONS

Multiple factors were found to influence measurement feedback systems and future considerations are presented within this manuscript. The barriers and enablers that impact these systems are complex. While there are some clear modifiable factors in the design of measurement and feedback processes, influential factors described by key informants were largely socioenvironmental. Evidence-based design and implementation, coupled with a deeper understanding of the implementation context, may lead to enhanced quality measurement feedback systems and ultimately improved care delivery and patient outcomes.