Scoping literature review on the Learning Organisation concept as applied to the health system

Organizational learning in surgery in Tanzania's health system: a descriptive cross-sectional study

Organizational learning is critical for delivering safe, high-quality surgical care, especially in low- and middle-income countries (LMICs) where perioperative outcomes remain poor. While current investments in LMICs prioritize physical infrastructure, equipment, and staffing, investments in organizational learning are equally important to support innovation, creativity, and continuous improvement of surgical quality. This study aims to assess the extent to which health facilities in Tanzania's Lake Zone perform as learning organizations from the perspectives of surgical providers. The insights gained from this study can motivate future quality improvement initiatives and investments to improve surgical outcomes. We conducted a cross-sectional analysis using data from an adapted survey to explore the key components of organizational learning, including a supportive learning environment, effective learning processes, and encouraging leadership. Our sample included surgical team members and leaders at 20 facilities (health centers, district hospitals, and regional hospitals). We calculated the average of the responses at individual facilities. Responses that were 5+ on a 7-point scale or 4+ on a 5-point scale were considered positive. We examined the variation in responses by facility characteristics using a one-way ANOVA or Student's t-test. We used univariate and multiple regression to assess relationships between facility characteristics and perceptions of organizational learning. Ninety-eight surgical providers and leaders participated in the survey. The mean facility positive response rate was 95.1% (SD 6.1%). Time for reflection was the least favorable domain with a score of 62.5% (SD 35.8%). There was variation by facility characteristics including differences in time for reflection when comparing by level of care (P = .02) and location (P = .01), and differences in trying new approaches (P = .008), capacity building (P = .008), and information transfer (P = .01) when comparing public versus faith-based facilities. In multivariable analysis, suburban centers had less time for reflection than urban facilities (adjusted difference = -0.48; 95% CI: -0.95, -0.01; P = .046). Surgical team members reported more positive responses compared to surgical team leaders. We found a high overall positive response rate in characterizing organizational learning in surgery in 20 health facilities in Tanzania's Lake Zone. Our findings identify areas for improvement and provide a baseline for assessing the effectiveness of change initiatives. Future research should focus on validating the adapted survey and exploring the impact of strong learning environments on surgical outcomes in LMICs. Organizational learning is crucial in surgery and further research, funding, and policy work should be dedicated to improving learning cultures in health facilities.

Protocol for exploring the use of hospitals as a learning organisation: a cross-sectional study in South Africa's Eastern Cape province

INTRODUCTION

In today's highly competitive environment, where changes happen at a rapid pace, organisations that stand a chance to survive are those that are proactive and easily adapt to changes. Hospitals are faced with various challenges including scrutiny from stakeholders. This study seeks to investigate learning strategies used by hospitals in one of South Africa's provinces to achieve the principle of a learning organisation.

METHODS AND ANALYSIS

This study will employ a quantitative approach using a cross-sectional survey on health professionals of a South African province. Stratified random sampling will be used to select hospitals and participants in three phases. The study will use a structured self-administered questionnaire, designed to collect data on learning strategies used by hospitals to achieve the principle of a learning organisation between June and December 2022. Descriptive statistics (mean, median, percentages, frequency, etc) will then be used to describe the raw data and allow the discovery of patterns. Inferential statistics will also be used to make inferences and predictions about the learning habits of health professionals in the selected hospitals.

ETHICS AND DISSEMINATION

The approval to access the research sites with reference number: EC_202108_011 has been granted by the Provincial Health Research Committees of the Eastern Cape Department. Ethical clearance with Protocol Ref no: M211004 has been approved at the Human Research Ethics Committee of the Faculty of Health Sciences at the University of Witwatersrand. Finally, results will be shared with all key stakeholders, including hospital management, clinical staff, through public presentation and direct engagements with stakeholders. The findings may guide hospital leaders and other relevant stakeholders to develop guidelines and policies on creating a learning organisation that contributes to the improvement of quality patient care.

How has Guinea learnt from the response to outbreaks? A learning health system analysis

INTRODUCTION

Learning is a key attribute of a resilient health system and, therefore, is central to health system strengthening. The main objective of this study was to analyse how Guinea's health system has learnt from the response to outbreaks between 2014 and 2021.

METHODS

We used a retrospective longitudinal single embedded case study design, applying the framework conceptualised by Sheikh and Abimbola for analysing learning health systems. Data were collected employing a mixed methods systematic review carried out in March 2022 and an online survey conducted in April 2022.

RESULTS

The 70 reports included in the evidence synthesis were about the 2014-2016 Ebola virus disease (EVD), Measles, Lassa Fever, COVID-19, 2021 EVD and Marburg virus disease. The main lessons were from 2014 to 2016 EVD and included: early community engagement in the response, social mobilisation, prioritising investment in health personnel, early involvement of anthropologists, developing health infrastructure and equipment and ensuring crisis communication. They were learnt through information (research and experts' opinions), action/practice and double-loop and were progressively incorporated in the response to future outbreaks through deliberation, single-loop, double-loop and triple-loop learning. However, advanced learning aspects (learning through action, double-loop and triple-loop) were limited within the health system. Nevertheless, the health system successfully controlled COVID-19, the 2021 EVD and Marburg virus disease. Survey respondents' commonly reported that enablers were the creation of the national agency for health security and support from development partners. Barriers included cultural and political issues and lack of funding. Common recommendations included establishing a knowledge management unit within the Ministry of Health with representatives at regional and district levels, investing in human capacities and improving the governance and management system.

CONCLUSION

Our study highlights the importance of learning. The health system performed well and achieved encouraging and better outbreak response outcomes over time with learning that occurred.

Frameworks for Integrating Learning Analytics With the Electronic Health Record

The information systems designed to support clinical care have evolved separately from those that support health professions education. This has resulted in a considerable digital divide between patient care and education, one that poorly serves practitioners and organizations, even as learning becomes ever more important to both. In this perspective, we advocate for the enhancement of existing health information systems so that they intentionally facilitate learning. We describe three well-regarded frameworks for learning that can point toward how health care information systems can best evolve to support learning. The Master Adaptive Learner model suggests ways that the individual practitioner can best organize their activities to ensure continual self-improvement. The PDSA cycle similarly proposes actions for improvement but at a health care organization's workflow level. Senge's Five Disciplines of the Learning Organization, a more general framework from the business literature, serves to further inform how disparate information and knowledge flows can be managed for continual improvement. Our main thesis holds that these types of learning frameworks should inform the design and integration of information systems serving the health professions. An underutilized mediator of educational improvement is the ubiquitous electronic health record. The authors list learning analytic opportunities, including potential modifications of learning management systems and the electronic health record, that would enhance health professions education and support the shared goal of delivering high-quality evidence-based health care.

Conceptualising learning healthcare systems and organisations in the context of rehabilitation: a scoping review protocol

Background: Transformative system wide action is needed for healthcare systems to meet the needs of an increasing aging population and changing health needs. One idea is that health systems can become “learning organisations” (LO) or “learning healthcare systems” (LHS) that continuously generate and apply evidence, innovation, quality, and value to provide better care. This is of value to non-acute healthcare settings such as rehabilitation, which are complex, multi-dimensional and multi-disciplinary in nature. Little is known about how these frameworks have been applied to rehabilitation settings. Objective and inclusion criteria: The aim of this scoping review is to systematically map and summarise the literature conceptualising and operationalising LHS and LO in rehabilitation settings. Studies will be included which define a LO or LHS; or describe an operating LHS/LO; or include the translation of research evidence generated from LHS/LO data into healthcare improvement within a rehabilitation context will be included. Study designs such as quantitative, qualitative, mixed method studies, and case studies will be included. Methods: The guidelines from the Joanna Briggs institute methodology for scoping reviews will be used for this review. The literature search will be performed using a three-step search strategy: an initial limited search of two databases has been performed to identify relevant key words and index terms. The developed search string will be adapted and applied across the following databases: OVID MEDLINE, EMBASE, CINAHL Plus, APA PsycINFO and COCHRANE Database of Systematic Reviews. This will be followed by search of the reference lists of selected sources and relevant data-hubs. A draft data extraction framework will be used and updated iteratively to extract data. Frequency counts and qualitative content analysis will be employed to address the research question of how LHS and LO have been conceptualised and operationalised in the context of rehabilitation.

Learning health systems in low-income and middle-income countries: exploring evidence and expert insights

Introduction

Learning health systems (LHS) is a multifaceted subject. This paper reviewed current concepts as well as real-world experiences of LHS, drawing on published and unpublished knowledge in order to identify and describe important principles and practices that characterise LHS in low/middle-income country (LMIC) settings.

Methods

We adopted an exploratory approach to the literature review, recognising there are limited studies that focus specifically on system-wide learning in LMICs, but a vast set of connected bodies of literature. 116 studies were included, drawn from an electronic literature search of published and grey literature. In addition, 17 interviews were conducted with health policy and research experts to gain experiential knowledge.

Results

The findings were structured by eight domains on learning enablers. All of these interact with one another and influence actors from community to international levels.

We found that learning comes from the connection between information, deliberation, and action. Moreover, these processes occur at different levels. It is therefore important to consider experiential knowledge from multiple levels and experiences. Creating spaces and providing resources for communities, staff and managers to deliberate on their challenges and find solutions has political implications, however, and is challenging, particularly when resources are constrained, funding and accountability are fragmented and the focus is short-term and narrow. Nevertheless, we can learn from countries that have managed to develop institutional mechanisms and human capacities which help health systems respond to changing environments with ‘best fit’ solutions.

Conclusion

Health systems are knowledge producers, but learning is not automatic. It needs to be valued and facilitated. Everyday governance of health systems can create spaces for reflective practice and learning within routine processes at different levels. This article highlights important enablers, but there remains much work to be done on developing this field of knowledge.

Defining and utilizing individualized learning objectives to achieve learning priorities for global health leaders

INTRODUCTION

Learning objectives (LOs) are a common tool used to define learning goals and guide curricula. As the field of global health has expanded, more rigorous and tailored approaches to effectively teach the next generation of the workforce are needed. The STAR project developed and utilized individualized LOs as the basis for on-the-job learning plans for senior global health leaders from low- and middle-income countries and from the US.

METHODS

We analyzed basic demographic information and LOs from 36 STAR fellows. Descriptive statistics provided an overview of the STAR fellows, competency areas and planned outputs of their LOs. We utilized qualitative thematic analysis to further explore the LOs themselves.

RESULTS

STAR fellows were based in the US and in low- and middle-income countries (LMICs). The majority had over 10 years of experience and at least one advanced degree. Fellows commonly worked on LOs related to capacity strengthening, communications, and development practice. Capacity strengthening LOs focused on mentorship, decision-making, and technical skills such as data analysis. Communications LOs focused on language skills, dissemination of information, and writing. Development practice LOs included gaining understanding of key stakeholders in global health and building effective partnerships and teams.

DISCUSSION

Our experience developing tailored LOs provided deeper understanding of diverse learning needs of global health leaders. While not representative of all global health learners, we captured priorities of senior US- and LMIC-based leaders and identified common themes for learning. Despite the labor required to tailor curricula in this way, more global health education programs can benefit by integrating similar processes.

Mobilizing health district management teams through digital tools: Lessons from the District.Team initiative in Benin and Guinea using an action research methodology

BACKGROUND

Improving capacities of health systems to quickly respond to emerging health issues, requires a health information system (HIS) that facilitates evidence-informed decision-making at the operational level. In many sub-Saharan African countries, HIS are mostly designed to feed decision-making purposes at the central level with limited feedback and capabilities to take action from data at the operational level. This article presents the case of an eHealth innovation designed to capacitate health district management teams (HDMTs) through participatory evidence production and peer-to-peer exchange.

METHODS

We used an action research design to develop the eHealth initiative called "District.Team," a web-based and facilitated platform targeting HDMTs that was tested in Benin and Guinea from January 2016 to September 2017. On District.Team, rounds of knowledge sharing processes were organized into cycles of five steps. Quantitative and qualitative data were collected to assess the participation of HDMTs and identify enablers and barriers of using District.Team.

RESULTS

Participation of HDMTs in District.Team varied between cycles and steps. In Benin, 79% to 94% of HDMTs filled in the online questionnaire per cycle compared to 61% to 100% in Guinea per cycle. In Benin, 26% to 41% of HDMTs shared a commentary on the results published on the platform while 21% to 47% participated in the online discussion forum. In Guinea, only 3% to 8% of HDMTs shared a commentary on the results published on the platform while 8% to 74% participated in the online discussion forum. Five groups of factors affected the participation: characteristics of the digital tools, the quality of the facilitation, profile of participants, shared content and data, and finally support from health authorities.

CONCLUSION

District.Team has shown that knowledge management platforms and processes valuing horizontal knowledge sharing among peers at the decentralized level of health systems are feasible in limited resource settings.

Aiming for quality: a global compass for national learning systems

INTRODUCTION

Transforming a health system into a learning one is increasingly recognized as necessary to support the implementation of a national strategic direction on quality with a focus on frontline experience. The approach to a learning system that bridges the gap between practice and policy requires active exploration.

METHODS

This scoping review adapted the methodological framework for scoping studies from Arksey and O'Malley. The central research question focused on common themes for learning to improve the quality of health services at all levels of the national health system, from government policy to point-of-care delivery.

RESULTS

A total of 3507 records were screened, resulting in 101 articles on strategic learning across the health system: health professional level (19%), health organizational level (15%), subnational/national level (26%), multiple levels (35%), and global level (6%). Thirty-five of these articles focused on learning systems at multiple levels of the health system. A national learning system requires attention at the organizational, subnational, and national levels guided by the needs of patients, families, and the community. The compass of the national learning system is centred on four cross-cutting themes across the health system: alignment of priorities, systemwide collaboration, transparency and accountability, and knowledge sharing of real-world evidence generated at the point of care.

CONCLUSION

This paper proposes an approach for building a national learning system to improve the quality of health services. Future research is needed to validate the application of these guiding principles and make improvements based on the findings.

The United States Army Medical Command, becoming a learning organization

Purpose

This study aims to describe how the Army and the Army Medical Department matured as a learning organization (LO) during the period after the 2014 Military Health System Review through the incorporation of changes aimed at improving patient safety, data transparency and becoming a high-reliability organization (HRO). This study explores the relationship between HRO and LO concepts by adding to the body of knowledge in both disciplines.

Design/methodology/approach

Four large-scale system changes are presented and evaluated against the principles of the LO. Metric data were collected longitudinally and presented as submitted to several nationally-recognized organizations in healthcare quality and safety. Post initiative observations are paired with a corresponding LO principle to assess US Army Medical Command’s (MEDCOM’s) maturation as a LO. System changes/improvements and the advancement of LO principles are discussed.

Findings

System improvements, analyzed critically alongside paired LO principles, show strong correlation between high-reliability and LO principles. Despite inherent institutional barriers, this study demonstrates that, when leveraged effectively, the leadership hierarchy and command culture can accelerate transformation into an LO.

Originality/value

This study explores changes implemented in MEDCOM, as it evolved as a stronger LO. It demonstrates how healthcare organizations and other high-risk industries that embrace high-reliability concepts will become better LOs and expands current knowledge on how LO concepts in healthcare can affect better system accountability and improved patient safety. Organizations can learn from MEDCOM’s journey changes that can hasten progress toward adoption of LO principles, especially in hierarchical organizations.

Collective sensemaking for action: researchers and decision makers working collaboratively to strengthen health systems

Lucy Gilson and colleagues draw on experiences from Kenya and South Africa to consider the practice, benefits, and challenges of research co-production for strengthening health systems

Communities of practice in Alberta Health Services: advancing a learning organisation

Background

In 2009, Alberta Health Services (AHS) became Canada’s first and largest fully integrated healthcare system, involving the amalgamation of nine regional health authorities and three provincial services. Within AHS, communities of practice (CoPs) meet regularly to learn from one another and to find ways to improve service quality. This qualitative study examined CoPs as an applied practice of a learning organisation along with their potential influence in a healthcare system by exploring the perspectives of CoP participants.

Methods

A collective case study method was used to enable the examination of a cross-section of cases in the study organisation. Semi-structured interviews were conducted with 31 participants representing 28 distinct CoPs. Using Senge’s framework of a learning organisation, CoP influences associated with team learning and organisational change were explored.

Results

CoPs in AHS were described as diverse in practice domains, focus, membership boundaries, attendance and sphere of influence. Using small-scale resource investments, CoPs provided members with opportunities for meaningful interactions, the capacity to build information pathways, and enhanced abilities to address needs at the point of care and service delivery. Overall, CoPs delivered a sophisticated array of engagement and knowledge-sharing activities perceived as supportive of organisational change, systems thinking, and the team learning practice critical to a learning organisation.

Conclusion

CoPs enable the diverse wealth of knowledge embedded in people, local conditions and special circumstances to flow from practice domain groups to programme and service areas, and into the larger system where it can effect organisational change. This research highlights the potential of CoPs to influence practice and broad-scale change more directly than previously understood or reported in the literature. As such, this study suggests that CoPs have the potential to influence and advance widespread systems change in Canadian healthcare.

Policy learning and Universal Health Coverage in low- and middle-income countries

Learning is increasingly seen as an essential component to spur progress towards universal health coverage (UHC) in low- and middle-income countries (LMICs). However, learning remains an elusive concept, with different understandings and uses that vary from one person or organisation to another. Specifically, it appears that 'learning for UHC' is dominated by the teacher mode - notably scientists and experts as 'teachers' conveying to local decision/policy-makers as 'learners' what to do. This article shows that, to meet countries' needs, it is important to acknowledge that UHC learning situations are not restricted to the most visible epistemic learning approach practiced today. This article draws on an analytical framework proposed by Dunlop and Radaelli, whereby they identified four learning modes that can emerge according to the specific characteristics of the policy process: epistemic learning, learning in the shadow of hierarchy, learning through bargaining and reflexive learning. These learning modes look relevant to help widen the learning prospects that LMICs need to advance their UHC agenda. Actually, they open up new perspectives in a research field that, until now, has appeared scattered and relatively blurry.

Multi-level analysis of the learning health system: Integrating contributions from research on organizations and implementation

Introduction

Organizations and systems that deliver health care may better adapt to rapid change in their environments by acting as learning organizations and learning health systems (LHSs). Despite widespread recognition that multilevel forces shape capacity for learning within care delivery organizations, there is no agreed-on, comprehensive, multilevel framework to inform LHS research and practice.

Methods

We develop such a framework, which can enhance both research on LHSs and practical steps toward their development. We draw on existing frameworks and research within organization and implementation science and synthesize contributions from three influential frameworks: the Consolidated Framework for Implementation Research, the social-ecological framework, and the organizational change framework. These frameworks come, respectively, from the fields of implementation science, public health, and organization science.

Results

Our proposed integrative framework includes both intraorganizational levels (individual, team, mid-management, organization) and the operating and general environments in which delivery organizations operate. We stress the importance of examining interactions among influential factors both within and across system levels and focus on the effects of leadership, incentives, and culture. Additionally, we indicate that organizational learning depends substantially on internal and cross-level alignment of these factors. We illustrate the contribution of our multilevel perspective by applying it to the analysis of three diverse implementation initiatives that aimed at specific care improvements and enduring system learning.

Conclusions

The framework and perspective developed here can help investigators and practitioners broadly scan and then investigate forces influencing improvement and learning and may point to otherwise unnoticed interactions among influential factors. The framework can also be used as a planning tool by managers and practitioners.

Learning for Universal Health Coverage

The journey to universal health coverage (UHC) is full of challenges, which to a great extent are specific to each country. 'Learning for UHC' is a central component of countries' health system strengthening agendas. Our group has been engaged for a decade in facilitating collective learning for UHC through a range of modalities at global, regional and national levels. We present some of our experience and draw lessons for countries and international actors interested in strengthening national systemic learning capacities for UHC. The main lesson is that with appropriate collective intelligence processes, digital tools and facilitation capacities, countries and international agencies can mobilise the many actors with knowledge relevant to the design, implementation and evaluation of UHC policies. However, really building learning health systems will take more time and commitment. Each country will have to invest substantively in developing its specific learning systemic capacities, with an active programme of work addressing supportive leadership, organisational culture and knowledge management processes.

Designing a program evaluation for a medical-dental service for adults with autism and intellectual disabilities using the RE-AIM framework

INTRODUCTION

Robust evaluation of service models can improve the quality and efficiency of care while articulating the models for potential replication. Even though it is an essential part of learning health systems, evaluations that benchmark and sustain models serving adults with developmental disabilities are lacking, impeding pilot programs from becoming official care pathways. Here, we describe the development of a program evaluation for a specialized medical-dental community clinic serving adults with autism and intellectual disabilities in Montreal, Canada.

METHOD

Using a Participatory Action-oriented approach, researchers and staff co-designed an evaluation for a primary care service for this population. We performed an evaluability assessment to identify the processes and outcomes that were feasible to capture and elicited perspectives at both clinical and health system levels. The RE-AIM framework was used to categorize and select tools to capture data elements that would inform practice at the clinic.

RESULTS

We detail the process of conceptualizing the evaluation framework and operationalizing the domains using a mixed-methods approach. Our experience demonstrated (1) the utility of a comprehensive framework that captures contextual factors in addition to clinical outcomes, (2) the need for validated measures that are not cumbersome for everyday practice, (3) the importance of understanding the functional needs of the organization and building a sustainable data infrastructure that addresses those needs, and (4) the need to commit to an evolving, "living" evaluation in a dynamic health system.

CONCLUSIONS

Evaluation employing rigorous patient-centered and systems-relevant metrics can help organizations effectively implement and continuously improve service models. Using an established framework and a collaborative approach provides an important blueprint for a program evaluation in a learning health system. This work provides insight into the process of integrating care for vulnerable populations with chronic conditions in health care systems and integrated knowledge generation processes between research and health systems.

The place of learning in a universal health coverage health policy process: the case of the RAMED policy in Morocco

BACKGROUND

To progress towards universal health coverage (UHC), each country will have to develop its systemic learning capacity. This study aims at documenting how, across time, learning can feed into a UHC policy process, and how the latter can itself strengthen (or not) the learning capacity of the health system. It specifically focuses on the development of a major health financing policy aligned with the UHC goal in Morocco, the RAMED, a health financing scheme covering hospital costs for the poorest segment of the population.

METHODS

We conducted a retrospective analysis of the RAMED policy for the period between 1997 and 2018, along with a case study design. For the data collection and analysis, we developed a framework combining Garvin's learning organisation framework and the heuristic health policy analysis framework. We gathered data from key informants and document reviews.

RESULTS

The study confirmed the importance of learning during the different stages of the RAMED policy process. There is evidence of a leadership encouraging learning, the introduction and adoption of knowledge management processes, and the start of a transformation of the administrative culture. Yet, our study also showed some major shortcomings, especially the lack of structure of the learning, and insufficient effort to systemise and sustain a transformation of practices within the health administration. Our study also confirms that the learning changes in nature across the different stages of the policy process.

CONCLUSION

The policy decisions and the implementation strategy create a learning dynamic, though not structured in all cases. Despite the positive interaction between learning and the RAMED policy, the opportunity to push forward a more structural transformation towards a learning system has not been fully seized. Hierarchical logics still largely prevail in the Moroccan health administration. The impact of future health policies for both the target beneficiaries and the health system will be bigger if their design integrates purposeful and structured actions in favour of organisational learning. This recommendation probably applies beyond Morocco.

Evaluation of the maternal deaths surveillance and response system at the health district level in Guinea in 2017 through digital communication tools

BACKGROUND

Reducing maternal mortality still remains a major challenge in low-income countries. This study aims to explore how digital communication tools can be used to evaluate the maternal deaths surveillance and response (MDSR) system at the health district level in Guinea.

METHODS

A descriptive cross-sectional study was conducted, using an innovative digital approach called District.Team, from April to September 2017. This study targeted all 38 district medical officers in Guinea. In addition to district medical officers, the participation of health actors from regional and central levels were also expected in the online discussion forum. Data collected through the questionnaire were mixed and those from the online discussion forum were entirely qualitative.

RESULTS

In total, 23 (61%) district medical officers (DMOs) participated in the study. Out of health districts (87%) which had updated guidelines and standards for the MDSR, 4 (20%) did not apply the content. In two health districts (8.7%), not all health facilities had maternal deaths notification forms. Three districts (13%) did not have maternal death review committees. In 2016, only half (50.2%) of reported maternal deaths were reviewed. The main recommendation formulated was related to quality of care. Other needs were also highlighted including continuous training of health care providers on emergency obstetric and neonatal care. Less than half (45%) of the review committee's recommendations were implemented. Six health districts (26.1%) did not have a response plan to reported maternal deaths and no district annual report on the MDSR was published in 2016. The weaknesses identified were, among others, insufficiency of human resources and lack of financial resources. Fifty-eight messages related to MDSR weaknesses and improvement solutions were posted in the online discussion forum by 28 participants (23 DMOs and 5 health actors from regional and central levels).

CONCLUSION

Digital tools can be used to assess the functioning of a system like maternal deaths surveillance and response. Moreover, the findings of the evaluation conducted will help stakeholders (starting from the health districts themselves) to design strategies and interventions for an effective MDSR.

Building capacity for change: evaluation of an organisation-wide leadership development program

Objective This study evaluated Leading 4 Change, a change leadership development program designed to support healthcare middle managers through a period of significant organisational change and enhance workplace resilience. Methods A mixed methods evaluation was conducted within the program’s framework of a quality improvement activity. Quantitative measures were participant responses (n=160) to online questionnaires, which were compared before and after the program, using an uncontrolled pre-post study design. Four questionnaires were used: Resilience @ Work, General Self-Efficacy, the 11-item Learning Organization Survey and organisational climate. Differences between the pre- and post-program periods were compared using linear mixed-effects models, incorporating repeated measures between ‘pre’ and ‘post’ periods. Qualitative data were obtained by interviewing four participants on three occasions during the program, and through text responses provided by participants during a presentation session after the program finished. Both interview data and textual data were subjected to thematic analysis. Results Integration of data from quantitative and qualitative analyses generated three main findings: (1) participants were satisfied and engaged with the program, which met their learning objectives; (2) the program led to increased workplace resilience, in particular the ability to manage stress and self-efficacy for individuals; and (3) organisational learning perceptions were unchanged. Conclusion Although conducted during a period of intense internal and external pressure, Leading 4 Change led to demonstrable effects. It effectively engaged middle managers across a health system. However, there was no evidence that the effect of the program extended beyond individual participants to their perceptions of their work environment as a learning organisation. What is known about the topic? Although much has been written about change management and change leadership within healthcare, the failure to manage the ‘people’ element and engage employees hampers the success of that change. However, how to engage employees and enhance their resilience and self-efficacy (self-belief to proactively manage) during change has been little explored. Further, the concept of a learning organisation has been developed in private, non-healthcare fields and there is little known about it in other areas, such as healthcare, particularly during change. What does this paper add? The paper describes the evaluation of a 16-week change leadership development program (Leading 4 Change) for middle managers of a public health system undergoing significant reform. It assesses how the program engaged employees, and how and to what extent their workplace resilience, self-efficacy and perceptions of their workplace as a learning organisation changed after the program. Based on the present study, individual development of staff does not necessarily translate directly to better staff perceptions of organisational outcomes. What are the implications for practitioners? Despite being clearly engaged with Leading 4 Change, quantitative and qualitative measures suggested mixed effects of the program on participants. Participants’ self-rated workplace resilience, ability to manage stress and self-efficacy increased after the program. However, there was no evidence that the effect of the program improved staff perceptions of their work as a learning organisation. For complex public sector healthcare organisations to become learning organisations, other organisational factors, in addition to staff development and training, require consideration.

Are our 'UHC systems' learning systems? Piloting an assessment tool and process in six African countries

BACKGROUND

If there is one universal recommendation to countries wanting to make progress towards Universal Health Coverage (UHC), it is to develop the learning capacities that will enable them to 'find their own way' - this is especially true for countries struggling with fragmented health financing systems. This paper explores results from a multi-country study whose main aim was to assess the extent to which UHC systems and processes at country level operate as 'learning systems'.

METHOD

This study is part of a multi-year action-research project implemented by two communities of practice active in Africa. For this specific investigation, we adapted the concept of the learning organisation to so-called 'UHC systems'. Our framework organises the assessment around 92 questions divided into blocks, sub-blocks and levels of learning, with a seven scale score in a standardised questionnaire developed during a protocol and methodology workshop attended by all the research teams. The study was implemented in six francophone African countries by national research teams involving researchers and cadres of the ministries involved in the UHC policy. Across the six countries, the questionnaire was administrated to 239 UHC actors. Data were analysed per country, per blocks and sub-blocks, by levels of learning and per question.

RESULTS

The study confirms the feasibility and relevance of adapting the learning organisation framework to UHC systems. All countries scored between 4 and 5 for all the sub-blocks of the learning system. The study and the validation workshops organised in the six countries indicate that the tool is particularly powerful to assess weaknesses within a specific country. However, some remarkable patterns also emerge from the cross-country analysis. Our respondents recognise the leadership developed at governmental level for UHC, but they also report some major weaknesses in the UHC system, especially the absence of a learning agenda and the limited use of data.

CONCLUSION

Countries will not progress towards UHC without strong learning systems. Our tool has allowed us to document the situation in six countries, create some awareness at country level and initiate a participatory action-oriented process.

The international knowledge base for new care models relevant to primary care-led integrated models: a realist synthesis

Background

The Multispecialty Community Provider (MCP) model was introduced to the NHS as a primary care-led, community-based integrated care model to provide better quality, experience and value for local populations.

Objectives

The three main objectives were to (1) articulate the underlying programme theories for the MCP model of care; (2) identify sources of theoretical, empirical and practice evidence to test the programme theories; and (3) explain how mechanisms used in different contexts contribute to outcomes and process variables.

Design

There were three main phases: (1) identification of programme theories from logic models of MCP vanguards, prioritising key theories for investigation; (2) appraisal, extraction and analysis of evidence against a best-fit framework; and (3) realist reviews of prioritised theory components and maps of remaining theory components.

Main outcome measures

The quadruple aim outcomes addressed population health, cost-effectiveness, patient experience and staff experience.

Data sources

Searches of electronic databases with forward- and backward-citation tracking, identifying research-based evidence and practice-derived evidence.

Review methods

A realist synthesis was used to identify, test and refine the following programme theory components: (1) community-based, co-ordinated care is more accessible; (2) place-based contracting and payment systems incentivise shared accountability; and (3) fostering relational behaviours builds resilience within communities.

Results

Delivery of a MCP model requires professional and service user engagement, which is dependent on building trust and empowerment. These are generated if values and incentives for new ways of working are aligned and there are opportunities for training and development. Together, these can facilitate accountability at the individual, community and system levels. The evidence base relating to these theory components was, for the most part, limited by initiatives that are relatively new or not formally evaluated. Support for the programme theory components varies, with moderate support for enhanced primary care and community involvement in care, and relatively weak support for new contracting models.

Strengths and limitations

The project benefited from a close relationship with national and local MCP leads, reflecting the value of the proximity of the research team to decision-makers. Our use of logic models to identify theories of change could present a relatively static position for what is a dynamic programme of change.

Conclusions

Multispecialty Community Providers can be described as complex adaptive systems (CASs) and, as such, connectivity, feedback loops, system learning and adaptation of CASs play a critical role in their design. Implementation can be further reinforced by paying attention to contextual factors that influence behaviour change, in order to support more integrated working.

Future work

A set of evidence-derived ‘key ingredients’ has been compiled to inform the design and delivery of future iterations of population health-based models of care. Suggested priorities for future research include the impact of enhanced primary care on the workforce, the effects of longer-term contracts on sustainability and capacity, the conditions needed for successful continuous improvement and learning, the role of carers in patient empowerment and how community participation might contribute to community resilience.

Study registration

This study is registered as PROSPERO CRD42016039552.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.