"To mean something to someone": sport-for-development as a lever for social inclusion

Background

Socially excluded groups are at higher risk of low well-being and poor health. The link between social exclusion and health inequities is complex, and not being involved in society makes it difficult to be reached by standard prevention programs. Sport-for-development (SFD) programs are low-threshold and may be promising settings for inclusive actions. We explore the underlying mechanisms through which SFD might have an impact on social inclusion and examine the necessary conditions that work as a catalyst for these underlying mechanisms.

Methods

A realist evaluation approach was adopted. A non-profit SFD organization in a middle-large city in Flanders, Belgium, formed the setting for a single case study. Document analysis, participatory observations, interviews, and a focus group, were sources for identifying necessary context elements and essential mechanisms through which SFD could promote its participants’ health and wellbeing.

Results

Among the most efficient mechanisms triggered by the Foundation’s activities are learning by fun, connecting with peers (of whom some serve as role model) and engaging as a volunteer with some responsibilities. Building trust in oneself and in others is a necessary process throughout all these mechanisms. Facilitating context factors include the activities’ accessibility and unconditional approach (creating a sense of safety), the popularity of the first division football team the Foundation is associated with (leading to a sense of belonging), a steady network of social partners and a strongly positive relationship with the SFD coach(es).

Conclusions

Our findings demonstrate that a SFD setting may be a vehicle for engaging hard-to-reach population groups. It enhances socially vulnerable persons’ sense of competence and connectedness, leading to opportunities to improve life and work skills transferrable outside SFD settings. Based on these findings, suggestions are provided that may enhance the field and help to develop feasible (policy-led) interventions designed to promote social inclusion.

Can sexual health interventions make community-based health systems more responsive to adolescents? A realist informed study in rural Zambia

Introduction

Community-based sexual reproductive interventions are key in attaining universal health coverage for all by 2030, yet adolescents in many countries still lack health services that are responsive to their sexual reproductive health and rights’ needs. As the first step of realist evaluation, this study provides a programme theory that explains how, why and under what circumstances community-based sexual reproductive health interventions can transform (or not) ‘ordinary’ community-based health systems (CBHSs) into systems that are responsive to the sexual reproductive health of adolescents.

Methods

This realist approach adopted a case study design. We nested the study in the full intervention arm of the Research Initiative to Support the Empowerment of Girls trial in Zambia. Sixteen in-depth interviews were conducted with stakeholders involved in the development and/or implementation of the trial. All the interviews were recorded and analysed using NVIVO version 12.0. Thematic analysis was used guided by realist evaluation concepts. The findings were later synthesized using the Intervention−Context−Actors−Mechanism−Outcomes conceptualization tool. Using the retroduction approach, we summarized the findings into two programme theories.

Results

We identified two initial testable programme theories. The first theory presumes that adolescent sexual reproductive health and rights (SRHR) interventions that are supported by contextual factors, such as existing policies and guidelines related to SRHR, socio-cultural norms and CBHS structures are more likely to trigger mechanisms among the different actors that can encourage uptake of the interventions, and thus contribute to making the CBHS responsive to the SRHR needs of adolescents. The second and alternative theory suggests that SRHR interventions, if not supported by contextual factors, are less likely to transform the CBHSs in which they are implemented. At individual level the mechanisms, awareness and knowledge were expected to lead to value clarification’, which was also expected would lead to individuals developing a ‘supportive attitude towards adolescent SRHR. It was anticipated that these individual mechanisms would in turn trigger the collective mechanisms, communication, cohesion, social connection and linkages.

Conclusion

The two alternative programme theories describe how, why and under what circumstances SRHR interventions that target adolescents can transform ‘ordinary’ community-based health systems into systems that are responsive to adolescents.

Uptake of a primary care atrial fibrillation screening program (AF-SMART): a realist evaluation of implementation in metropolitan and rural general practice

Background

Screening for atrial fibrillation (AF) in people aged ≥65 years is recommended by international guidelines. The Atrial Fibrillation Screen, Management And guideline-Recommended Therapy (AF-SMART) studies of opportunistic AF screening in 16 metropolitan and rural general practices were conducted from November 2016–June 2019. These studies trialled custom-designed eHealth tools to support all stages of AF screening in general practice.

Methods

A realist evaluation of the AF-SMART studies, which aimed to explain the circumstances in which the program worked (or not) to increase the proportion of people screened for AF. The initial program theory was based on our previous research, policy documents and screening studies. To test this, we conducted 45 semi-structured interviews with general practitioners (GPs), nurses and practice managers across all participating practices, and collected observational and quantitative screening data. These data were analysed and interpreted to refine the program theory.

Results

GPs/nurses liked the eHealth tools, although technical problems sometimes disrupted screening. Time was the main barrier to screening for GPs/nurses, so systems need to be very efficient. Practices with leadership from a senior GP ‘screening champion’ had broader uptake, especially from the nursing team. Providing regular feedback on screening data was beneficial for quality improvement and motivation. Clear protocols for follow-up of abnormal results were required for successful nurse-led screening in a hierarchical system. Participation in the program had broader benefits of improving AF knowledge and raising the profile of cardiovascular health in the practice. Screening for a shorter, more intense period (eg during influenza vaccination) worked well for practices where sufficient staff time was allocated.

Conclusions

Introducing an AF screening program is likely to be successful in contexts where there is a senior GP ‘screening champion’, a clear protocol exists for abnormal results, and there is regular data reporting to staff. These contexts link to mechanisms around motivation, leadership, empowerment of nurses, and efficient screening systems. The contexts and mechanisms contribute to the longer-term outcomes of increasing the proportion of people screened and treated for AF, which is recommended by guidelines as a key strategy for the prevention of AF-related stroke.

Trial registrations

AF SMART (metropolitan): ACTRN12616000850471 (Australia New Zealand Clinical Trials Registry).

AF SMART II (rural): ACTRN12618000004268 (Australia New Zealand Clinical Trials Registry).

A realist evaluation to identify contexts and mechanisms that enabled and hindered implementation and had an effect on sustainability of a lean intervention in pediatric healthcare

BACKGROUND

In 2012, the Saskatchewan Ministry for Health mandated a system-wide Lean transformation. Research has been conducted on the implementation processes of this system-wide Lean implementation. However, no research has been done on the sustainability of these Lean efforts. We conducted a realist evaluation on the sustainability of Lean in pediatric healthcare. We used the context (C) + mechanism (M) = outcome (O) configurations (CMOcs) heuristic to explain under what contexts, for whom, how and why Lean efforts are sustained or not sustained in pediatric healthcare.

METHODS

We employed a case study research design. Guided by a realist evaluation framework, we conducted qualitative realist interviews with various stakeholder groups across four pediatric hospital units 'cases' at one acute hospital. Interview data was analyzed using an integrated approach of CMOc categorization coding, CMOc connecting and pattern matching.

RESULTS

We conducted thirty-two interviews across the four cases. Five CMOcs emerged from our realist interview data. These configurations illustrated a 'ripple-effect' from implementation outcomes to contexts for sustainability. Sense-making and staff engagement were prominent mechanisms to the sustainment of Lean efforts. Failure to trigger these mechanisms resulted in resistance. The implementation approach used influenced mechanisms and outcomes for sustainability, more so than Lean itself. Specifically, the language, messaging and training approaches used triggered mechanisms of innovation fatigue, poor 'sense-making' and a lack of engagement for frontline staff. The mandated, top-down, externally led nature of implementation and lack of customization to context served as potential pitfalls. Overall, there was variation between leadership and frontline staff's perceptions on how embedded Lean was in their contexts, and the degree to which participants supported Lean sustainability.

CONCLUSIONS

This research illuminates important contextual factors and mechanisms to the process of Lean sustainment that can be applicable to those implementing systems changes. Future work is needed to continue to develop the science on the sustainability of interventions for healthcare improvement.

A realist evaluation of the implementation of open visiting in an acute care setting for older people

BACKGROUND

Open visiting refers to the principle of unrestricted visiting hours in the hospital setting to enable relatives, families and carers to visit at any time. There has been recognition that open visiting supports the principle of patient and family supported care and improves communication. Despite this there has been difficulty in implementing open visiting and barriers identified. The aims of this study were therefore to evaluate the implementation of open visiting, the barriers to implementation, sustainability and the impact of open visiting on communication between health care professionals, families and carers.

METHODS

The study was conducted on two large acute wards for the older person. Realist evaluation methods were used to understand 'what works well, how, for whom and to what extent.' Mixed methods were employed including qualitative interviews and descriptive analyses of routine data sets. Following the methodology of realist evaluation, programme theories were identified a long with the context, mechanisms and outcomes of implementation, to better understand the implementation process.

RESULTS

The results of this study identified some key findings, demonstrating that open visiting does improve communication and can help to build trusting relationships between families/carers and health care professionals (HCP). Barriers to implementation were based on the belief that it would impinge on routines within the ward setting. To achieve the principles of patient and family/carer centred care, the key mechanisms are the confidence and skills of individual nurses and health care assistants to engage with relatives/carers, whilst retaining a sense of control, particularly when care is being delivered to other patients.

CONCLUSION

In summary, open visiting creates a positive culture which fosters better relationships between families/carers and HCPs. Involving families/carers as partners in care does not happen automatically in an environment where open visiting is the policy, but requires engagement with staff to encourage and support relatives/carers.

Transforming towards sustainable health and wellbeing systems: Eight guiding principles based on the experiences of nine Dutch Population Health Management initiatives

INTRODUCTION

Population Health Management initiatives are increasingly introduced, aiming to develop towards sustainable health and wellbeing systems. Yet, little is known about which strategies to implement during this development. This study provides insights into which strategies are used, why, and when, based on the experiences of nine Dutch Population Health Management initiatives.

METHODS

The realist evaluation approach was used to gain an understanding of the relationships between context, mechanisms and outcomes when Population Health Management strategies were implemented. Data were retrieved from three interview rounds (n = 207) in 2014, 2016 and 2017. Data was clustered into guiding principles, underpinned with strategy-context-mechanism-outcome configurations.

RESULTS

The Dutch initiatives experienced different developments, varying between immediate large-scale collaborations with eventual relapse, and incremental growth towards cross-sector collaboration. Eight guiding principles for development towards health and wellbeing systems were identified, focusing on: 1. Shared commitment for a Population Health Management-vision; 2. Mutual understanding and trust; 3. Accountability; 4. Aligning politics and policy; 5. Financial incentives; 6. A learning cycle based on a data-infrastructure; 7. Community input and involvement; and 8. Stakeholder representation and leadership.

CONCLUSION

Development towards a sustainable health and wellbeing system is complex and time-consuming. Its success not only depends on the implementation of all eight guiding principles, but is also influenced by applying the right strategies at the right moment in the development.

Collaborative governance in the Quebec Cancer Network: a realist evaluation of emerging mechanisms of institutionalization, multi-level governance, and value creation using a longitudinal multiple case study design

BACKGROUND

People living with and beyond cancer (PLC) receive various forms of specialty care at different locations and many interventions concurrently or over time. They are affected by the operation of professional and organizational silos. This results in undue delays in access, unmet needs, sub-optimal care experiences and clinical outcomes, and human and financial costs for PLCs and healthcare systems. National cancer control programs advocate organizing in a network to coordinate actions, solve fragmentation problems, and thus improve clinical outcomes and care experiences for every dollar invested. The variable outcomes of such networks and factors explaining them have been documented. Governance is the "missing link" for understanding outcomes. Governance refers to the coordination of collective action by a body in a position of authority in pursuit of a common goal. The Quebec Cancer Network (QCN) offers the opportunity to study in a natural environment how, why, by whom, for whom, and under what conditions collaborative governance contributes to practices that produce value-added outcomes for PLCs, healthcare providers, and the healthcare system.

METHODS/DESIGN

The study design consists of a longitudinal case study, with multiple nested cases (4 local networks nested in the QCN), mobilizing qualitative and quantitative data and mixed data from various sources and collected using different methods, using the realist evaluation approach. Qualitative data will be used for a thematic analysis of collaborative governance. Quantitative data from validated questionnaires will be analyzed to measure relational coordination and teamwork, care experience, clinical outcomes, and health-related health-related quality of life, as well as a cost analysis of service utilization. Associations between context, governance mechanisms, and outcomes will be sought. Robust data will be produced to support decision-makers to guide network governance towards optimized clinical outcomes and the reduction of the economic toxicity of cancer for PLCs and health systems.

Development of an evaluation tool for geriatric rehabilitation care

BACKGROUND

Geriatric rehabilitation care (GRC) is short-term and multidisciplinary rehabilitation care for older vulnerable clients. Studies were conducted about its effects. However, elements that influence the quality of GRC have not been studied previously.

METHODS

In this study realist evaluation is used to find out which are the mechanisms and outcomes and which (groups of) persons are the context for GRC, according to GRC professionals. The mechanisms, outcomes and context of GRC were explored in three consecutive phases of qualitative data gathering, i.e. individual interviews, expert meeting, and focus groups.

RESULTS

Eight mechanisms - client centeredness, client satisfaction during rehabilitation, therapeutic climate, information provision to client and informal care givers, consultation about the rehabilitation (process), cooperation within the MultiDisciplinary Team (MDT), professionalism of GRC professionals, and organizational aspects - were found. Four context groups-the client, his family and/or informal care giver(s), the individual GRC professional, and the MDT-were mentioned by the respondents. Last, two outcome factors were determined, i.e. client satisfaction at discharge and rehabilitation goals accomplished.

CONCLUSIONS

In order to translate these insights into a practical tool that can be used by MDTs in the practice of GRC, identified mechanisms, contexts, and outcomes were visualized in a GRC evaluation tool. A graphic designer developed an interactive PDF which is the GRC evaluation tool. This tool may enable MDTs to discuss, prioritize, evaluate, and improve the quality of their GRC practice.

In search for gold - The relevance of realist reviews and evaluations to pharmacy research and policy development

Pharmacy services and programs can be regarded as complex interventions which are developed and implemented within the open, complex system of overall healthcare. Realist research considers matters of complexity and provides insights into what programs and interventions work, why and in which contexts. Based on the philosophy of science of critical realism, realist evaluations and realist reviews generate causative explanations which inform pharmacy practitioners, educators and policy makers in which context programs and services achieve particular outcomes. This more nuanced understanding of how pharmacy services contribute to overall healthcare provides guidance for the refinement and targeting of programs, interventions and practice models. This article outlines key aspects of realist research approaches and provides insight into how realism can contribute to research in and the practice of pharmacy.

What is the impact of large-scale implementation of stroke Early Supported Discharge? A mixed methods realist evaluation study protocol

BACKGROUND

Stroke Early Supported Discharge (ESD) is a service innovation that facilitates discharge from hospital and delivery of specialist rehabilitation in patients' homes. There is currently widespread implementation of ESD services in many countries, driven by robust clinical trial evidence. In England, the type of ESD service patients receive on the ground is variable, and in some regions, ESD is still not offered at all. This protocol presents a study designed to investigate the mechanisms and outcomes of implementing ESD at scale in real-world conditions. This will help to establish which models of ESD are most effective and in what context.

METHODS

A realist evaluation approach composed of two interlinking work packages will be adopted to investigate how and why ESD works, for whom and in what circumstances. Work package 1 (WP1) will begin with a rapid evidence synthesis to formulate preliminary realist hypotheses. Quantitative analyses of historical prospective Sentinel Stroke National Audit Programme (SSNAP) data will be performed to evaluate service outcomes based on the degree to which evidence-based ESD has been implemented. Work package 2 (WP2) will involve the qualitative investigation of purposively selected case study sites featuring in WP1 and covering different regions in England. The perspectives of clinicians, managers, commissioners, and service users will be explored qualitatively. Cost implications of ESD models will be examined using a cost-consequence analysis. Cross-case comparisons and triangulation of the data sources from both work packages will be performed to test, revise, and refine initial programme theories and address research aims.

DISCUSSION

This study will investigate whether and how current large-scale implementation of ESD is achieving the outcomes suggested by the evidence base. The theory-driven evaluation approach will highlight key mechanisms and contextual conditions necessary to optimise outcomes and allow us to draw transferable lessons to inform the effective implementation and sustainability of ESD in clinical practice. In addition, the methodological framework will progress the theoretical understanding of implementation and evaluation of complex rehabilitation interventions in stroke care.

TRIAL REGISTRATION

ISRCTN: 15568163, registration date: 26 October 2018.

A realist process evaluation of Enhanced Triple P for Baby and Mellow Bumps, within a Trial of Healthy Relationship Initiatives for the Very Early years (THRIVE): study protocol for a randomized controlled trial

Background

THRIVE is a three-arm randomised controlled trial (RCT) that aims to evaluate whether antenatal and early postnatal interventions, Enhanced Triple B for Baby (ETPB) plus care as usual (CAU) or Mellow Bumps (MB) plus CAU (versus CAU alone), can: 1) improve the mental health and well-being of pregnant women with complex health and social care needs; 2) improve mother-infant bonding and interaction; 3) reduce child maltreatment; and 4) improve child language acquisition. This paper focuses on THRIVE’s realist process evaluation, which is carefully monitoring what is happening in the RCT.

Methods

Realistic evaluation provides the theoretical rationale for the process evaluation. We question: 1) how faithfully are MB and ETPB implemented? 2) What are the mechanisms by which they work, if they do, and who do they work for and how? 3) What contextual factors are necessary for the programmes to function, or might prevent them functioning?

The mixed-methods design includes quantitative measures, which are pre- and post-training/intervention questionnaires for facilitators and mothers-to-be, and post-session evaluation forms. Qualitative data collection methods include participant observation of facilitator training and the delivery of a series of antenatal sessions in selected intervention groups (n = 3 for ETPB and n = 3 for MB), semi-structured interviews with facilitators, pregnant women, partners, and referring facilitators, and telephone interviews examining the content of the postnatal components of ETPB and MB.

Discussion

The findings of this process evaluation will help researchers and decision makers interpret the outcomes of THRIVE. It will provide a greater understanding of: how the interventions work (if they do); the extent and quality of their implementation; contextual factors facilitating and constraining intervention functioning; variations in response within and between subgroups of vulnerable parents; and benefits or unintended consequences of either intervention. Few studies to date have published detailed research protocols illustrating how realist process evaluation is designed and conducted as an integral part of a randomised controlled trial.

Trial registration

ISRCTN, ISRCTN21656568. Registered on 8 November 2013.

Electronic supplementary material

The online version of this article (10.1186/s13063-019-3395-3) contains supplementary material, which is available to authorized users.

Health service brokerage to improve primary care access for populations experiencing vulnerability or disadvantage: a systematic review and realist synthesis

BACKGROUND

Individuals experiencing disadvantage or marginalisation often face difficulty accessing primary health care. Overcoming access barriers is important for improving the health of these populations. Brokers can empower and enable people to access resources; however, their role in increasing access to health services has not been well-defined or researched in the literature. This review aims to identify whether a health service broker working with health and social service providers in the community can (a) identify individuals experiencing vulnerability who may benefit from improved access to quality primary care, and (b) link these individuals with an appropriate primary care provider for enduring, appropriate primary care.

METHODS

Six databases were searched for studies published between January 2008 and August 2015 that evaluated a health service broker intervention linking adults experiencing vulnerability to primary care. Relevant websites were also searched. Included studies were analysed using candidacy theory and a realist matrix was developed to identify mechanisms that may have contributed to changes in response to the interventions in different contexts.

RESULTS

Eleven studies were included in the review. Of the eight studies judged to provide detailed description of the programs, the interventions predominately addressed two domains of candidacy (identification of candidacy and navigation), with limited applicability to the third and fourth dimensions (permeability of services and appearances at health services). Six of the eight studies were judged to have successfully linked their target group to primary care. The majority of the interventions focused on assisting patients to reach services and did not look at ways that providers or health services could alter the way they deliver care to improve access.

CONCLUSIONS

While specific mechanisms behind the interventions could not be identified, it is suggested that individual advocacy may be a key element in the success of these types of interventions. The interventions were found to address some dimensions of candidacy, with health service brokers able to help people to identify their need for care and to access, navigate and interact with services. More consideration should be given to the influence of providers on patient candidacy, rather than placing the onus on patients.

A Realist Evaluation of Local Networks Designed to Achieve More Integrated Care

INTRODUCTION

Not surprisingly given their multi-component nature, initiatives to improve integrated care often evolve to find the best way to bring about change. This paper provides an example of how an evaluation evolved alongside such an initiative designed to better integrate care across primary, community and hospital services in South Auckland, New Zealand.

THEORY AND METHODS

Using the explanatory power of a realist evaluative approach, theories of new ways of working that might be prompted by the initiative were explored in: (i) interviews with stakeholders in 2012 and 2015, (ii) online surveys of general practices and local care organisations, and (iii) a purposive sample of ten general practices.

RESULTS

The results highlighted the institutional contexts that led to difficulties in implementing population health initiatives. They also revealed that changes in work practices focussed mostly on activities that improved the coordination of care for individuals at risk of hospital admissions.

DISCUSSION

Multi-component complex interventions can vary in their delivery and be vulnerable to one or more components not being implemented as originally intended. In the case of this intervention, the move towards strengthening local relationships arose when contractual arrangements stalled. Realist evaluative approaches offer a logic that helps unpick the complexity of the relationships and politics in play, and uncover the assumptions made by those developing, implementing and assessing health service changes.

CONCLUSION

Given the multi-component and evolving nature of initiatives seeking to better integrate care, the realist evaluative emphasis on surfacing early the theories to explain how change is expected to occur helps overcome the challenge of evaluating "a moving target".

Dealing with context in logic model development: Reflections from a realist evaluation of a community health worker programme in Nigeria

Logic models (LMs) have been used in programme evaluation for over four decades. Current debate questions the ability of logic modelling techniques to incorporate contextual factors into logic models. We share experience of developing a logic model within an ongoing realist evaluation which assesses the extent to which, and under what circumstances a community health workers (CHW) programme promotes access to maternity services in Nigeria. The article contributes to logic modelling debate by: i) reflecting on how other scholars captured context during LM development in theory-driven evaluations; and ii) explaining how we explored context during logic model development for realist evaluation of the CHW programme in Nigeria. Data collection methods that informed our logic model development included documents review, email discussions and teleconferences with programme stakeholders and a technical workshop with researchers to clarify programme goals and untangle relationships among programme elements. One of the most important findings is that, rather than being an end in itself, logic model development is an essential step for identifying initial hypotheses for tentative relevant contexts, mechanisms and outcomes (CMOs) and CMO configurations of how programmes produce change. The logic model also informed development of a methodology handbook that is guiding verification and consolidation of underlying programme theories.

Evidence use in equity focused health impact assessment: a realist evaluation

BACKGROUND

Equity-focused health impact assessment (EFHIA) can function as a framework and tool that supports users to collate data, information, and evidence related to health equity in order to identify and mitigate the impact of a current or proposed initiative on health inequities. Despite education efforts in both the clinical and public health settings, practitioners have found implementation and the use of evidence in completing equity focussed assessment tools to be challenging.

METHODS

We conducted a realist evaluation of evidence use in EFHIA in three phases: 1) developing propositions informed by a literature scan, existing theoretical frameworks, and stakeholder engagement; 2) data collection at four case study sites using online surveys, semi-structured interviews, document analysis, and observation; and 3) a realist analysis and identification of context-mechanism-outcome patterns and demi-regularities.

RESULTS

We identified limited use of academic evidence in EFHIA with two explanatory demi-regularities: 1) participants were unable to "identify with" academic sources, acknowledging that evidence based practice and use of academic literature was valued in their organization, but seen as less likely to provide answers needed for practice and 2) use of academic evidence was not associated with a perceived "positive return on investment" of participant energy and time. However, we found that knowledge brokering at the local site can facilitate evidence familiarity and manageability, increase user confidence in using evidence, and increase the likelihood of evidence use in future work.

CONCLUSIONS

The findings of this study provide a realist perspective on evidence use in practice, specifically for EFHIA. These findings can inform ongoing development and refinement of various knowledge translation interventions, particularly for practitioners delivering front-line public health services.

Protocol for pilot cluster RCT of project respect: a school-based intervention to prevent dating and relationship violence and address health inequalities among young people

Background

Dating and relationship violence (DRV)—intimate partner violence during adolescence—encompasses physical, sexual and emotional abuse. DRV is associated with a range of adverse health outcomes including injuries, sexually transmitted infections, adolescent pregnancy and mental health issues. Experiencing DRV also predicts both victimisation and perpetration of partner violence in adulthood.

Prevention targeting early adolescence is important because this is when dating behaviours begin, behavioural norms become established and DRV starts to manifest. Despite high rates of DRV victimisation in England, from 22 to 48% among girls and 12 to 27% among boys ages 14–17 who report intimate relationships, no RCTs of DRV prevention programmes have taken place in the UK. Informed by two school-based interventions that have shown promising results in RCTs in the USA—Safe Dates and Shifting Boundaries—Project Respect aims to optimise and pilot a DRV prevention programme for secondary schools in England.

Methods

Design: optimisation and pilot cluster RCT. Trial will include a process evaluation and assess the feasibility of conducting a phase III RCT with embedded economic evaluation. Cognitive interviewing will inform survey development.

Participants: optimisation involves four schools and pilot RCT involves six (four intervention, two control). All are secondary schools in England. Baseline surveys conducted with students in years 8 and 9 (ages 12–14). Follow-up surveys conducted with the same cohort, 16 months post-baseline. Optimisation sessions to inform intervention and research methods will involve consultations with stakeholders, including young people.

Intervention: school staff training, including guidance on reviewing school policies and addressing ‘hotspots’ for DRV and gender-based harassment; information for parents; informing students of a help-seeking app; and a classroom curriculum for students in years 9 and 10, including a student-led campaign.

Primary outcome: the primary outcome of the pilot RCT will be whether progression to a phase III RCT is justified. Testing within the pilot will also determine which of two existing scales is optimal for assessing DRV victimisation and perpetration in a phase III RCT.

Discussion

This will be the first RCT of an intervention to prevent DRV in the UK. If findings indicate feasibility and acceptability, we will undertake planning for a phase III RCT of effectiveness.

Trial registration

ISRCTN, ISRCTN 65324176. Registered 8 June 2017.

Electronic supplementary material

The online version of this article (10.1186/s40814-019-0391-z) contains supplementary material, which is available to authorized users.

Can oral healthcare for older people be embedded into routine community aged care practice? A realist evaluation using normalisation process theory

BACKGROUND

An intervention 'Better Oral Health in Home Care' was introduced (2012-2014) to improve the oral health of older people receiving community aged care services. Implementation of the intervention was theoretically framed by the Promoting Action on Research Implementation in Health Services framework. Process outcomes demonstrated significant improvements in older people's oral health.

OBJECTIVE

To evaluate the extent to which the intervention has been embedded and sustained into routine community aged care practice 3 years after the initial implementation project.

DESIGN

A Realist Evaluation applying Normalisation Process Theory within a single case study setting.

SETTING

Community aged care (home care) provider in South Australia, Australia.

PARTICIPANTS

Purposeful sampling was undertaken. Twelve staff members were recruited from corporate, management and direct care positions. Two consumers representing high and low care recipients also participated.

METHODS

Qualitative methods were applied in two subcases, reflecting different contextual settings. Data were collected via semi-structured interviews and analysed deductively by applying the Normalisation Process Theory core constructs (with the recommended phases of the Realist Evaluation cycle). Retrospective and prospective analytic methods investigated how the intervention has been operationalised by comparing two timeframes: Time 1 (Implementation June 2012-December 2014) and Time 2 (Post-implementation July 2017-July 2018).

RESULTS

At Time 1, the initial program theory proposed that multi-level facilitation contributed to a favourable context that triggered positive mechanisms supportive of building organisational and workforce oral healthcare capacity. At Time 2, an alternative program theory of how the intervention has unfolded in practice described a changed context following the withdrawal of the project facilitation processes with the triggering of alternative mechanisms that have made it difficult for staff to embed sustainable practice.

CONCLUSION

Findings concur with the literature that successful implementation outcomes do not necessarily guarantee sustainability. The study has provided a deeper explanation of how contextual characteristics have contributed to the conceptualisation of oral healthcare as a low priority, basic work-ready personal care task and how this, in turn, hindered the embedding of sustainable oral healthcare into routine community aged care practice. This understanding can be used to better inform the development of strategies, such as multi-level facilitation, needed to navigate contextual barriers so that sustainable practice can be achieved.

Mechanisms, contexts and points of contention: operationalizing realist-informed research for complex health interventions

Background

The concept of “mechanism” is central to realist approaches to research, yet research teams struggle to operationalize and apply the concept in empirical research. Our large, interdisciplinary research team has also experienced challenges in making the concept useful in our study of the implementation of models of integrated community-based primary health care (ICBPHC) in three international jurisdictions (Ontario and Quebec in Canada, and in New Zealand).

Methods

In this paper we summarize definitions of mechanism found in realist methodological literature, and report an empirical example of a realist analysis of the implementation ICBPHC.

Results

We use our empirical example to illustrate two points. First, the distinction between contexts and mechanisms might ultimately be arbitrary, with more distally located mechanisms becoming contexts as research teams focus their analytic attention more proximally to the outcome of interest. Second, the relationships between mechanisms, human reasoning, and human agency need to be considered in greater detail to inform realist-informed analysis; understanding these relationships is fundamental to understanding the ways in which mechanisms operate through individuals and groups to effect the outcomes of complex health interventions.

Conclusions

We conclude our paper with reflections on human agency and outline the implications of our analysis for realist research and realist evaluation.

District-level implementation of British Columbia's school food and beverage sales policy: a realist evaluation exploring intervention mechanisms in urban and rural contexts

Intervention

British Columbia’s (BC) provincial school food and beverage sales policy.

Research question

What are the processes associated with district-level implementation of BC’s school food and beverage sales policy?

Methods

We adopted a realist approach and a qualitative, multiple case study design that included three urban and two rural BC school districts. Data collection involved semi-structured interviews and questionnaires with health, education, and industry stakeholders, observations, document analysis and website scans. Analysis identified: (i) mechanisms influencing if and how stakeholders engage in implementation activities at the district level and (ii) specific dimensions of context influencing these mechanisms.

Results

We identified three mechanisms driving implementation processes at the school district level associated with BC’s school food and beverage sales policy. These mechanisms are influenced by various dimensions of context that lead to a range of implementation outcomes. The ‘mandatory mechanism’ refers to the mandatory nature of the policy effectively triggering implementation efforts, influenced by a normative acceptance of the education system hierarchy. The ‘money mechanism’ refers to how this district demand leads vendors to create a compliant supply; it is influenced by beliefs about children’s food preferences, health and food, and the existence of competition. Finally, the ‘monitoring mechanism’ refers to how systems of informal monitoring are used to promote compliance in the context of a competitive sales environment.

Conclusion

The outcomes of these three policy mechanisms are influenced by complex dimensions of context. Identifying context–mechanism interactions can help inform public health policymakers interested in interventions for improving school food environments.

Intensive home care packages for people with dementia: a realist evaluation protocol

BACKGROUND

Dementia presents a significant challenge to health systems and to the person and family affected. Home care is increasingly seen as a key service in addressing this challenge in a person-centred and cost-effective way. Intensive Home Care Packages (IHCPs) were introduced in Ireland to provide personalised and high levels of support for people with dementia to remain at home or be discharged home from hospital, and to build on the work of the HSE & Genio Dementia Programme. This realist evaluation is concerned with real world questions of feasibility and effectiveness; specifically understanding in what ways IHCPs work, how optimum outcomes are achieved, for whom and in what contexts do IHCPs work best.

METHODS

A mixed-method, multi-stakeholder study was designed within a realist evaluation conceptual framework. The process evaluation includes semi-structured interviews with health service staff at all levels, social network analysis and secondary database analysis; the outcomes evaluation includes quantitative measures and qualitative data collected through in-depth interviews with people with dementia and family carers; and the cost evaluation includes analysis of data from the Resource Utilisation in Dementia (RUD). The four stage cycle of realist evaluation is adopted, with iterative rounds of theory formulation, data collection and theory testing throughout.

DISCUSSION

This realist evaluation of a complex intervention involves a variety of data and perspectives in order to provide confidence in moving from hypothetical constructs about how IHCPs might work to explanations of potential or observable causal mechanisms. In spite of being a key form of service delivery in most healthcare systems, the ways in which home care works to produce the desired outcomes seems to be poorly understood. While there is much descriptive and comparative work, there is a lack of understanding regarding which patient groups might benefit most from home care, or the influence of different service or cultural contexts on outcomes from home care. As well as addressing the core research objectives, this study aims to make a contribution to the underlying theory of home care in ways that can progress our understanding of how outcomes are produced for home care recipients.

Successfully developing advanced practitioner roles: policy and practice mechanisms

PURPOSE

The purpose of this paper is to lay out how advanced practitioner development occurs in New Zealand primary health care settings. The paper specifically focuses on mechanisms occurring across policy creation and in practice leading to successful role development.

DESIGN/METHODOLOGY/APPROACH

The authors applied a realist approach involving interviews, document review and field log observations to create refined theories explaining how successful development occurs.

FINDINGS

Three final mechanisms were found to influence successful advanced practitioner role development: engagement in planning and integrating roles; establishing opportunities as part of a well-defined career pathway; and championing role uptake and work to full scopes of practice.

RESEARCH LIMITATIONS/IMPLICATIONS

This research focuses on one snapshot in time only; it illustrates the importance of actively managing health workforce change. Future investigations should involve the continued and systematic evaluation of advanced practitioner development.

PRACTICAL IMPLICATIONS

The successful development of advanced practitioner roles in a complex system necessitates recognising how to trigger mechanisms occurring at times well beyond their introduction.

SOCIAL IMPLICATIONS

Potential candidates for new roles should expect roadblocks in their development journey. Successfully situating these roles into practice through having a sustainable and stable workforce supply provides patients with access to a wider range of services.

ORIGINALITY/VALUE

This is the first time a realist evaluation has been undertaken, in New Zealand, of similar programmes operating across multiple sites. The paper brings insights into the process of developing new health programmes within an already established system.

Supporting the health and well-being of school-aged children through a school nurse programme: a realist evaluation

BACKGROUND

The school nurse's role varies across countries. In Scotland, the Chief Nursing Officer recommended that the role should be refocused. The refocused programme emphasises nine care pathways with a view to improve pupils' health and wellbeing. Two sites were identified to test this new programme. Our aim was to assess how, for whom and under what circumstances the programme works in order to provide learning to support school nurse training and intended national roll-out.

METHODS

This study was a mixed methods study, using a realist evaluation approach, and conducted in three phases. In phase one, six nurse managers from both study sites took part in individual interviews or focus groups and this was complemented by programme documents to develop initial programme theory. In phase two, the programme theory was tested using qualitative data from 27 school nurses, and quantitative data from the first 6 months of the programme that captured patterns of referral. The programme theory was refined through analyses and interpretation of data in phase three.

RESULTS

The findings show that the programme enhanced opportunities for early and improved identification of health and wellbeing needs. The context of the nine pathways worked through the mechanism of streamlining referral of relevant cases to school nurses, and yielded positive outcomes by extending school nurses and thus children's engagement with wider services. The mental health and wellbeing pathway was the most frequently used, and nurses referred complex mental health cases to more specialist mental health services, but felt less equipped to deal with low to moderate cases.

CONCLUSIONS

The programme facilitated early identification of risk but was less successful at equipping school nurses to actually deliver specific interventions as intended. Capacity building strategies for school nurses should seek to enhance intervention delivery skills within the parameters of the pathways. Realist evaluation provided a useful framework in terms of identifying contextual and mechanistic influences that required strengthening prior to wider implementation.

Community based interventions for strengthening adolescent sexual reproductive health and rights: how can they be integrated and sustained? A realist evaluation protocol from Zambia

BACKGROUND

Research that explores how community-based interventions for strengthening adolescent sexual reproductive health and rights (SRHR) can be integrated and sustained in community health systems, is, to the best of our knowledge, very scarce, if not absent. It is important to document mechanisms that shape integration process in order to improve health systems' responsiveness towards adolescents' SRHR. This realist evaluation protocol will contribute to this knowledge in Zambia where there is increased attention towards promoting maternal, neonatal and child health as a means of addressing the current high early pregnancy and marriage rates. The protocol will ascertain: why, how, and under what conditions the integration of SRHR interventions into Zambian community health systems will optimise (or not) acceptability and adoption of SRHR services. This study is embedded within a randomized controlled trial - "Research Initiative to Support the Empowerment of Girls (RISE)"- which aims to reduce adolescent girl pregnancies and marriages through a package of interventions including economic support to families, payment of school fees to keep girls in school, pocket money for girls, as well as youth club and community meetings on reproductive health.

METHODS

This is a multiple-case study design. Data will be collected from schools, health facilities and communities through individual and group interviews, photovoice, documentary review, and observations. The study process will involve 1) developing an initial causal theory that proposes an explanation of how the integration of a community-based intervention that aimed to integrate adolescent SRHR into the community health system may lead to adolescent-friendly services; 2) refining the causal theory through case studies; 3) identifying contextual conditions and mechanisms that shape the integration process; and 4) finally proposing a refined causal theory and set of recommendations to guide policy makers, steer further research, and inform teaching programmes.

DISCUSSION

The study will document relevant values as well as less formal and horizontal mechanisms which shape the integration process of SRHR interventions at community level. Knowledge on mechanisms is essential for guiding development of strategies for effectively facilitating the integration process, scaling up processes and sustainability of interventions aimed at reducing SRH problems and health inequalities among adolescents.

Protocol for a longitudinal mixed methods realist evaluation of holistic needs assessment and care planning for people affected by cancer

Background

In 2012, approximately 14 million new cases of cancer were diagnosed. As a result of advances in treatment, screening and prevention programmes the number of people surviving cancer globally is also increasing.

The growing understanding of the diversity and scale of the need for support, compounded by the increasing prevalence of cancer survivors has fuelled the development and evaluation of a range of services and models to meet them. A key intervention is the holistic needs assessment and care planning, however there is little homogeneity in its actual delivery to cancer survivors. To fill this evidence gap there is a need to understand any effect implementation variables have on patient experiences, measurable outcomes and resource use. We are exploring this through a realist evaluation of holistic needs assessment and care planning.

Methods

This longitudinal, mixed method realist evaluation has been approached in 4 phases. Phases 1 and 2 have been completed (2014–2017) and a summary of this work is presented. We then provide a detailed protocol for Phases 3 and 4 (2017 onwards). Phase 1: Establishment of programme theory for HNA and care planning; Phase 2: Exploration and documentation of local programme theories; Phase 3: Theory testing and refinement and Phase 4 - Theory validation and dissemination.

Phase 3 draws on a range of data derived from 6 study sites. Methods include analysis of patient characteristics and concerns identified, qualitative interviews /fieldwork with local project staff, national stakeholders, professionals using the needs assessment tool and patients, a three-year longitudinal online survey of wider programme stakeholders and a review and synthesis of local project evaluations and patient care plans.

Discussion

This intervention is a key component globally of cancer survivorship care. The results of this realist evaluation can be used to optimise the delivery and development of HNA and care planning for people affected by cancer. To our knowledge this is the first study of this type. By utilising the discipline of Realistic Evaluation this mixed methods study will elicit findings with greater potential for generalisability and transferability within Scotland, the UK and beyond.

An overview of realist evaluation for simulation-based education

This article describes the key features of realist (realistic) evaluation and illustrates their application using, as an example, a simulation-based course for final year medical students. The use of simulation-based education (SBE) is increasing and so too is the evidence supporting its value as a powerful technique which can lead to substantial educational benefits. Accompanying these changes is a call for research into its use to be more theory-driven and to investigate both 'Did it work?' and as importantly 'Why did it work (or not)?' An evaluation methodology that is capable of answering both questions is realist evaluation. Realist evaluation is an emerging methodology that is suited to evaluating complex interventions such as SBE. The realist philosophy positions itself between positivist and constructivist paradigms and seeks to answer the question 'What works for whom, in what circumstances and why?' In seeking to answer this question, realist evaluation sets out to identify three fundamental components of an intervention, namely context, mechanism and outcome. Educational programmes work (successful outcomes) when theory-driven interventions (mechanisms) are applied to groups under appropriate conditions (context). Realist research uses a mixed methods (qualitative and quantitative) approach to gathering data in order to test the proposed context-mechanism-outcome (CMO) configurations of the intervention under investigation. Realist evaluation offers a valuable methodology for researchers investigating interventions utilising simulation-based education. By investigating and understanding the context, mechanisms and outcomes of SBE interventions, realist evaluation can provide the deeper level of understanding being called for.