Assessing Patient-Reported Outcomes in Routine Cancer Clinical Care Using Electronic Administration and Telehealth Technologies: Realist Synthesis of Potential Mechanisms for Improving Health Outcomes

BACKGROUND

The routine measurement of patient-reported outcomes in cancer clinical care using electronic patient-reported outcome measures (ePROMs) is gaining momentum worldwide. However, a deep understanding of the mechanisms underpinning ePROM interventions that could inform their optimal design to improve health outcomes is needed.

OBJECTIVE

This study aims to identify the implicit mechanisms that underpin the effectiveness of ePROM interventions and develop program theories about how and when ePROM interventions improve health outcomes.

METHODS

A realist synthesis of the literature about ePROM interventions in cancer clinical care was performed. A conceptual framework of ePROM interventions was constructed to define the scope of the review and frame the initial program theories. Literature searches of Ovid MEDLINE, Ovid Embase, Scopus, and CINAHL, supplemented by citation tracking, were performed to identify relevant literature to develop, refine, and test program theories. Quality appraisal of relevant studies was performed using the Mixed Methods Appraisal Tool.

RESULTS

Overall, 61 studies were included in the realist synthesis: 15 (25%) mixed methods studies, 9 (15%) qualitative studies, 13 (21%) descriptive studies, 21 (34%) randomized controlled trials, and 3 (5%) quasi-experimental studies. In total, 3 initial program theories were developed regarding the salient components of ePROM interventions-remote self-reporting, real-time feedback to clinicians, and clinician-patient telecommunication. The refined theories posit that remote self-reporting enables patients to recognize and report symptoms accurately and empowers them to communicate these to clinicians, real-time feedback prompts clinicians to manage symptoms proactively, and clinician-patient telephone interactions and e-interactions between clinic encounters improve symptom management by reshaping how clinicians and patients communicate. However, the intervention may not achieve the intended benefit if ePROMs become a reminder to patients of their illness and are not meaningful to them and when real-time feedback to clinicians lacks relevance and increases the workload.

CONCLUSIONS

The key to improving health outcomes through ePROM interventions is enabling better symptom reporting and communication through remote symptom self-reporting, promoting proactive management of symptoms through real-time clinician feedback, and facilitating clinician-patient interactions. Patient engagement with self-reporting and clinician engagement in responding to feedback are vital and may reinforce each other in improving outcomes. Effective ePROM interventions might fundamentally alter how clinicians and patients interact between clinic encounters.

Re-orientating systematic reviews to rigorously examine what works, for whom and how: Example of a realist systematic review of school-based prevention of dating and gender violence

Conventional systematic reviews offer few insights into for whom and how interventions work. 'Realist reviews' examine such questions via examining 'context-mechanism-outcome configurations' (CMOCs) but are insufficiently rigorous in how evidence is identified, assessed and synthesised. We developed 'realist systematic reviews', addressing similar questions to realist reviews but using rigorous methods. We applied this to synthesising evidence on school-based prevention of dating and relationship violence (DRV) and gender-based violence (GBV). This paper reflects on overall methods and findings, drawing on papers reporting each analysis. Drawing on intervention descriptions, theories of change and process evaluations, we developed initial CMOC hypotheses: interventions triggering 'school-transformation' mechanisms (preventing violence by changing school environments) will achieve larger effects than those triggering 'basic-safety' (stopping violence by emphasising its unacceptability) or 'positive-development' (developing students' broader skills and relationships) mechanisms; however, school transformation would only work in schools with high organisational capacity. We used various innovative analyses, some of which aimed to test these hypotheses and some of which were inductive, drawing on available findings to augment and refine the CMOCs. Overall, interventions were effective in reducing long-term DRV but not GBV or short-term DRV. DRV prevention occurred most effectively via the 'basic-safety' mechanism. 'School-transformation' mechanisms were more effective in preventing GBV but only in high-income countries. Impacts on long-term DRV victimisation were greater when working with a critical mass of participating girls. Impacts on long-term DRV perpetration were greater for boys. Interventions were more effective when focusing on skills, attitudes and relationships, or lacking parental involvement or victim stories. Our method provided novel insights and should be useful to policy-makers seeking the best interventions for their contexts and the most information to inform implementation.

Realist review of interprofessional education for health care students: What works for whom and why

Interprofessional education (IPE) programs, are complex, logistically challenging, and can be expensive to deliver, but these matters are offset by the perceived benefits of IPE. There is little clarity regarding how IPE contributes to the desirable development of collaborative practitioners. To guide educators in the design of IPE programs there is a need to understand the elements that promote optimal learning. A realist review was conducted to identify the mechanisms and resources that contribute to IPE outcomes. Four databases were searched until April 2020 for empirical studies describing mandatory IPE for pre-registration medical, nursing and other health professional students. Twelve articles met the inclusion criteria. Two novel learning design elements were identified; interdependence, where there is a need for genuine contribution of skills and knowledge from the professions learning together to successfully complete tasks, and embodiment, where through being immersed in an authentic scenario, learners feel what it is like to work in their professions. Other observations supported previous research findings such as the importance of skilled facilitators to promote interaction and reflection. Interprofessional interventions incorporating these specific learning design features seem likely to enhance the impact of IPE, thus making the best use of limited institutional resources and student time.

The Use of Digital Health Interventions for Cardiometabolic Diseases Among South Asian and Black Minority Ethnic Groups: Realist Review

BACKGROUND

Digital health interventions (DHIs) for the prevention and management of cardiometabolic diseases have become increasingly common. However, there is limited evidence for the suitability of these approaches in minority ethnic populations, who are at an increased risk of these diseases.

OBJECTIVE

This study aimed to investigate the use of DHIs for cardiovascular disease and type 2 diabetes among minority ethnic populations in countries with a majority of White, English-speaking populations, focusing on people who identified as South Asian, Black, or African American.

METHODS

A realist methodology framework was followed. A literature search was conducted to develop context-mechanism-outcome configurations, including the contexts in which DHIs work for the target minority ethnic groups, mechanisms that these contexts trigger, and resulting health outcomes. After systematic searches, a qualitative analysis of the included studies was conducted using deductive and inductive coding.

RESULTS

A total of 15 studies on the uptake of DHIs for cardiovascular disease or diabetes were identified, of which 13 (87%) focused on people with an African-American background. The review found evidence supporting the use of DHIs in minority ethnic populations when specific factors are considered in implementation and design, including patients' beliefs, health needs, education and literacy levels, material circumstances, culture, social networks, and wider community and the supporting health care systems.

CONCLUSIONS

Our context-mechanism-outcome configurations provide a useful guide for the future development of DHIs targeted at South Asian and Black minority ethnic populations, with specific recommendations for improving cultural competency and promoting accessibility and inclusivity of design.

Adoption and scale-up of the cardiovascular Polypill: a realist institutional analysis

Efforts to promote the adoption and scale-up of health system innovations must contend with the existing institutional context. But there are no commonly used frameworks to ensure that the insights of actors involved in such institutional efforts connect to one another. To test and modify a potential framework-the 'four-by-four' framework-we interviewed researcher-entrepreneurs involved in the unfolding story of the cardiovascular Polypill. The framework has four types/levels of institutions that affect adoption and scale-up: (1) informal institutions (L1, e.g. social norms), (2) formal institutions (L2, e.g. government policies and regulation), (3) organizational structures (L3, e.g. organizational boards and mission) and (4) everyday exchange (L4, e.g. service delivery), vis-à-vis four potential entrepreneurial strategies in response: (1) abide by existing institutions, (2) evade them, (3) alter them and/or (4) exit entrepreneurial action. Using this framework, we conducted a realist-informed analysis to understand how context (i.e. institutions) and mechanism (i.e. entrepreneurial strategies) influence each other to shape outcomes (i.e. adoption and scale-up). We found that researcher-entrepreneurs began with efforts to abide with existing institutions but encountered institutional obstacles at each level. Efforts to abide were followed by seeking to evade and/or alter unfavourable institutions, with greater success evading and/or altering lower (L3 and L4) than upper (L1 and L2) institutions. Exit considerations followed the failure of the evade or alter strategy. Shifts between strategies were propelled by 'learning'. The 'four-by-four' framework can be used as a scaffold to generate narratives of adoption or scale-up efforts, a sensitizing tool to prospectively map out contingencies and a matrix to synthesize narratives and experiences across multiple innovations or settings. Used in these ways, the 'four-by-four' framework can help to optimize the transferability and cumulation of insights on how to promote the adoption and scale-up of health system innovations.

Young carers, mental health and psychosocial wellbeing: A realist synthesis

Growing evidence demonstrates that the mental and psychosocial health impacts of caring vary significantly for individual children, depending on who they are, the person that they care for, their responsibilities and the wider family situation. Although individual studies have made progress in identifying the range of impacts, there is a lack of clarity around which impacts affect who and in what circumstances. This synthesis, based on RAMESES realist protocols, aims to increase clarity concerning how and why the mental and psychosocial health impacts of caring for a family member vary for different children. There were 12 391 unique search results screened at title, abstract and full-paper levels. Forty-four retained studies were analysed, resulting in the development of a model with 17 context-mechanism-outcome configurations. The model divides the configurations into three interlinking domains. The caregiving responsibilities domain considers how the impacts of caring vary with the circumstances of the individual young carer, the person they care for and their family. The identity domain details the development of a caring identity that potentially mitigates the negative effects of caring and enables positive benefits. The support domain concerns the support provided from family, community and services that, depending on quality, can mitigate or exacerbate the impacts of caring. Support also moderates the care identity by affecting self-perception of the caring role. The model has the potential to inform the development of interventions that target particular mechanisms to enable positive change for young carers. This potential can be enhanced by further research to test the model, with a focus on refining configurations where less evidence is available. There is a particular need to focus on identification which is under-represented in the model as both a mechanism and a contextual factor due to unidentified young carers being largely absent from past research.

A Rapid Realist Review of Quality Care Process Metrics Implementation in Nursing and Midwifery Practice

Quality measurement initiatives promote quality improvement in healthcare but can be challenging to implement effectively. This paper presents a Rapid Realist Review (RRR) of published literature on Quality Care-Process Metrics (QCP-M) implementation in nursing and midwifery practice. An RRR informed by RAMESES II standards was conducted as an efficient means to synthesize evidence using an expert panel. The review involved research question development, quality appraisal, data extraction, and evidence synthesis. Six program theories summarised below identify the key characteristics that promote positive outcomes in QCP-M implementation. Program Theory 1: Focuses on the evidence base and accessibility of the QCP-M and their ease of use by nurses and midwives working in busy and complex care environments. Program Theory 2: Examines the influence of external factors on QCP-M implementation. Program Theory 3: Relates to existing cultures and systems within clinical sites. Program Theory 4: Relates to nurses’ and midwives’ knowledge and beliefs. Program Theory 5: Builds on the staff theme of Programme Theory four, extending the culture of organizational learning, and highlights the meaningful engagement of nurses and midwives in the implementation process as a key characteristic of success. Program Theory 6: Relates to patient needs. The results provide nursing and midwifery policymakers and professionals with evidence-based program theory that can be translated into action-orientated strategies to help guide successful QCP-M implementation.

How Australian Health Care Services Adapted to Telehealth During the COVID-19 Pandemic: A Survey of Telehealth Professionals

Background: In Australia, telehealth services were used as an alternative method of health care delivery during the COVID-19 pandemic. Through a realist analysis of a survey of health professionals, we have sought to identify the underlying mechanisms that have assisted Australian health services adapt to the physical separation between clinicians and patients.

Methods: Using a critical realist ontology and epistemology, we undertook an online survey of health professionals subscribing to the Australian Telehealth Society newsletter. The survey had close- and open-ended questions, constructed to identify contextual changes in the operating environment for telehealth services, and assess the mechanisms which had contributed to these changes. We applied descriptive and McNemar's Chi-square analysis for the close-ended component of the survey, and a reflexive thematic analysis approach for the open-ended questions which were framed within the activity based funding system which had previously limited telehealth services to regional Australia.

Results: Of the 91 respondents most (73%) reported a higher volume of telephone-based care since COVID and an increase in use of video consultations (60% of respondents). Respondents felt that the move to provide care using telehealth services had been a “forced adoption” where clinicians began to use telehealth services (often for the first time) to maintain health care. Respondents noted significant changes in managerial and medical culture which supported the legitimisation of telehealth services as a mode of access to care. The support of leaders and the use personal and organisational networks to facilitate the operation of telehealth service were felt to be particularly valuable. Access to, and reliability of, the technology were considered extremely important for services. Respondents also welcomed the increased availability of more human and financial resources.

Conclusions: During the pandemic, mechanisms that legitimise practise, build confidence, support relationships and supply resources have fostered the use of telehealth. This ongoing interaction between telehealth services, contexts and mechanisms is complex. The adoption of telehealth access to enable physically separated care, may mark a “new context;” or it could be that once the pandemic passes, previous policies and practises will re-assert themselves and curb support for telehealth-enabled care.

Effectiveness of Family-Based Behavior Change Interventions on Obesity-Related Behavior Change in Children: A Realist Synthesis

Effective treatment interventions for childhood obesity involve parents, are multicomponent and use behavior change strategies, but more information is needed on the mechanisms influencing behavioral outcomes and the type of parental involvement that is efficacious in behavioral treatment interventions with school-age children. This review aimed to understand key characteristics of programs that contribute to dietary and physical activity behavioral outcomes, and through which key mechanisms. This was a systematic review with narrative synthesis following PRISMA guidelines and realist analysis using RAMESES guidelines to explain outcome patterns and influence of parental involvement. Overall, the findings contribute to understanding the complex relationship between family barriers to behavior change, strategies employed in treatment interventions and behavioral outcomes. Implications for enhancing future policy and practice include involving parents in goal setting, motivational counselling, role modeling, and restructuring the physical environment to promote mutual empowerment of both parents and children, shared value and whole-family ownership in which intrinsic motivation and self-efficacy are implicit. These characteristics were associated with positive dietary and physical activity behavior change in children and may be useful considerations for the design and implementation of future theory-based treatment interventions to encourage habitual healthy diet and physical activity to reduce childhood obesity.

'Function First-Be Active, Stay Independent'-promoting physical activity and physical function in people with long-term conditions by primary care: a protocol for a realist synthesis with embedded co-production and co-design

INTRODUCTION

People with long-term conditions typically have reduced physical functioning, are less physically active and therefore become less able to live independently and do the things they enjoy. However, assessment and promotion of physical function and physical activity is not part of routine management in primary care. This project aims to develop evidence-based recommendations about how primary care can best help people to become more physically active in order to maintain and improve their physical function, thus promoting independence.

METHODS AND ANALYSIS

This study takes a realist synthesis approach, following RAMESES guidance, with embedded co-production and co-design. Stage 1 will develop initial programme theories about physical activity and physical function for people with long-term conditions, based on a review of the scientific and grey literature, and two multisector stakeholder workshops using LEGO® SERIOUS PLAY®. Stage 2 will involve focused literature searching, data extraction and synthesis to provide evidence to support or refute the initial programme theories. Searches for evidence will focus on physical activity interventions involving the assessment of physical function which are relevant to primary care. We will describe 'what works', 'for whom' and 'in what circumstances' and develop conjectured programme theories using context, mechanism and outcome configurations. Stage 3 will test and refine these theories through individual stakeholder interviews. The resulting theory-driven recommendations will feed into Stage 4 which will involve three sequential co-design stakeholder workshops in which practical ideas for service innovation in primary care will be developed.

ETHICS AND DISSEMINATION

Healthcare and Medical Sciences Academic Ethics Committee (Reference 2018-16308) and NHS Wales Research Ethics Committee 5 approval (References 256 729 and 262726) have been obtained. A knowledge mobilisation event will address issues relevant to wider implementation of the intervention and study findings. Findings will be disseminated through peer-reviewed journal publications, conference presentations and formal and informal reports.

PROSPERO REGISTRATION NUMBER

CRD42018103027.

Understanding Determinants of Sustainability Through a Realist Investigation of a Large-Scale Quality Improvement Initiative (Lean): A Refined Program Theory

BACKGROUND

Implementation science research seeks to understand ways to best ensure uptake of research-based initiatives to health care; however, there is little research done on how to sustain such efforts. Sustainability is the degree to which an initiative continues to be used in practice after efforts of implementation have ended. Sustainability research is a growing field of implementation science that needs further research to understand how to predict and measure the long-term use of effective initiatives to improve health care. The question of what influences the sustainability of research-based initiatives to improve health care remains unknown.

PURPOSE

The purpose of this article was to present a refined program theory on the contextual factors and mechanisms that influence the sustainability of one large-scale quality management initiative (Lean) in pediatric health care.

DESIGN

We conducted a multiphase realist investigation to explain under what contexts, for whom, how, and why Lean efforts are sustained or not sustained in pediatric health care through the generation of an explanatory program theory.

METHODS

This article presents the theoretical triangulation of our multiphase realist investigation, resulting in a refined program theory. We integrated the initial program theories (IPTs) from each research phase to form a refined program theory. It involved going back and forth from the initial IPT to the findings from each phase and our middle-range theories and examining the most substantiated IPTs on the contextual factors and mechanisms that influenced the sustainability of Lean efforts.

FINDINGS

The refined program theory depicts the complex nature to sustaining Lean efforts and that sustainability as a small, often unrepresentative portion of something much larger or more complex that cannot yet be seen or understood. The approach and nature of implementation is critical to shaping contexts for sustainability. Outcomes from implementation become facilitating or hindering contexts for sustainability. Customization to context is an important contextual factor for sustainability. Sense making, value congruency, and staff engagement are critical aspects from early implementation that enable or hinder processes of sustainment. Such mechanisms can trigger staff empowerment that can lead to a greater likelihood of sustainability.

CONCLUSIONS

These findings have important implications for sustainability research, in understanding the determinants of sustainability of research-based initiatives in health care.

CLINICAL RELEVANCE

It is important to understand and explain determinants of sustainability through theory-driven evaluative research in order to assist key stakeholders in sustaining the effective research-based initiatives made to improve healthcare services, patient care, and outcomes.

The impacts of decentralization on health system equity, efficiency and resilience: a realist synthesis of the evidence

One constant refrain in evaluations and reviews of decentralization is that the results are mixed. But given that decentralization is a complex intervention or phenomenon, what is more important is to generate evidence to inform implementation strategies. We therefore synthesized evidence from the literature to understand why, how and under what circumstances decentralization influences health system equity, efficiency and resilience. In doing this, we adopted the realist approach to evidence synthesis and included quantitative and qualitative studies in high-, low- and middle-income countries that assessed the the impact of decentralization on health systems. We searched the Medline and Embase databases via Ovid, and the Cochrane library of systematic reviews and included 51 studies with data from 25 countries. We identified three mechanisms through which decentralization impacts on health system equity, efficiency and resilience: 'Voting with feet' (reflecting how decentralization either exacerbates or assuages the existing patterns of inequities in the distribution of people, resources and outcomes in a jurisdiction); 'Close to ground' (reflecting how bringing governance closer to the people allows for use of local initiative, information, feedback, input and control); and 'Watching the watchers' (reflecting mutual accountability and support relations between multiple centres of governance which are multiplied by decentralization, involving governments at different levels and also community health committees and health boards). We also identified institutional, socio-economic and geographic contextual factors that influence each of these mechanisms. By moving beyond findings that the effects of decentralization on health systems and outcomes are mixed, this review presents mechanisms and contextual factors to which policymakers and implementers need to pay attention in their efforts to maximize the positive and minimize the negative impact of decentralized governance.

Promoting social inclusion for young people affected by psycho-social disability in India - a realist evaluation of a pilot intervention

India has 600 million young people, more than any other country in the world. Mental illness is the leading burden of disease for young people, and those affected experience restrictions in social participation that compromise recovery. The aim of this study was to assess the impact of a peer-led, community-based, participatory group intervention on social inclusion and mental health among 142 young people affected by psycho-social disability (PSD) in Dehradun district, Uttarakhand. Qualitative data were obtained via in-depth interviews and focus-group discussions. A realist evaluation identified contextual factors, mechanisms and outcomes to develop the programme theory. Group participants described intermediate outcomes including establishment of new peer friendship networks, increased community participation, greater self-efficacy (for young women particularly), and improved public image (for young men) that are likely to have contributed to the primary outcomes of greater (self-perceived) social inclusion and improved mental health (as assessed quantitatively). Mechanisms were identified that explain the link between intervention and outcomes. These findings demonstrate the effectiveness of a brief intervention to improve mental health and social inclusion for young people with PSD and are potentially relevant to programme implementers and policy-makers working with young people and promoting social inclusion, in other low- and middle-income settings.

Exposing the impact of intensive advice services on health: A realist evaluation

Attention has turned to welfare advice as a potential health and social care intervention. However, establishing direct evidence of health impact has proven difficult. This is compounded by the need to understand both the facilitative contexts and mechanisms through which this impact occurs. This study investigated if, how and in which circumstances an intensive advice service had an impact on stress and well-being (as precursors to health impacts), for clients attending a branch of Citizens Advice, located in the North East of England. A mixed methods realist evaluation of three intensive advice services offered by Citizens Advice (CA) was operationalised in five phases: (a) Building programme theories, (b) refining programme theories, (c) Development of a data recording tool, (d) Testing programme theories with empirical data, (e) Impact interviews. This paper focuses on phase 4. The Warwick Edinburgh Mental Wellbeing Scale (WEMWBS) and Perceived Stress Scale (PSS) were completed by 191 clients, with a 91% follow-up rate (data collected: February 2016 to March 2017). Twenty-two CA clients participated in interviews (data collected: October 2015 to November 2016). The PSS indicated a significant decrease in stress from initial consultation to approximately 4-6 weeks post advice from 31.4 to 10.3 (p < 0.001) and the WEMWBS indicated a significant increase in client well-being from a mean of 26.9 to 46.5 (p < 0.001). Nine refined programme theories are presented which combine the qualitative and quantitative analysis; they are underpinned by three abstract theories: Capabilities model, The Decision to Trust Model, and Third Space. An explanatory framework is presented covering the micro, meso, and macro levels of CA. Use of a stress and well-being lens has allowed insight into the precursors of health in those receiving intensive advice. Using these measures whilst explaining contextual and mechanistic properties, begins to build a complex and real picture of how advice services impact on health.

A realist qualitative study to explore how low-income pregnant women use Healthy Start food vouchers

Healthy Start is the UK government's food voucher programme for low-income pregnant women and young children. It was introduced in 2006, but the impact of the programme on nutritional outcomes remains understudied. This study sought to explore potential outcomes of the Healthy Start programme (including intended and unintended outcomes) and develop explanations for how and why these outcomes might occur. A realist review preceded this study, in which programme theories were developed and tested using existing evidence. This qualitative study aimed to further refine and consolidate the programme theories from the realist review while remaining open to new and emerging theories (or hypotheses) about how low-income pregnant women use Healthy Start vouchers. Semistructured interviews were conducted with 11 low-income women from North West England, who received Healthy Start vouchers during pregnancy. A realist logic of analysis was applied to generate clear and transparent linkages between outcomes and explanations. The findings suggested that some women used the vouchers to improve their diets during pregnancy (intended outcome), whereas some women were diverted towards alternative or unintended outcomes. Women's circumstances, values, beliefs, and motivations influenced how they perceived and responded to the vouchers. This paper presents four evidence-based programme theories to explain four contrasting (and potentially overlapping) outcomes: dietary improvements (theory refined from review), shared benefits (new theory), financial assistance (theory refined from review), and stockpiling formula (new theory). It considers how the Healthy Start programme could be improved, to increase the possibilities for low-income women to experience the intended outcome of dietary improvements.

A realist review to explore how low-income pregnant women use food vouchers from the UK's Healthy Start programme

OBJECTIVES

To explore how low-income pregnant women use Healthy Start food vouchers, the potential impacts of the programme, and which women might experience these impacts and why.

DESIGN

A realist review.

ELIGIBILITY CRITERIA FOR SELECTING STUDIES

Primary or empirical studies (of any design) were included if they contributed relevant evidence or insights about how low-income women use food vouchers from the Healthy Start (UK) or the Special Supplemental Nutrition Program for Women, Infants and Children (WIC) programmes. The assessment of 'relevance' was deliberately broad to ensure that reviewers remained open to new ideas from a variety of sources of evidence.

ANALYSIS

A combination of evidence synthesis and realist analysis techniques was used to modify, refine and substantiate programme theories, which were constructed as explanatory 'context-mechanism-outcome'-configurations.

RESULTS

38 primary studies were included in this review: four studies on Healthy Start and 34 studies on WIC. Two main outcome strands were identified: dietary improvements (intended) and financial assistance (unintended). Three evidence-informed programme theories were proposed to explain how aspects of context (and mechanisms) may generate these outcomes: the 'relative value' of healthy eating (prioritisation of resources); retailer discretion (pressure to 'bend the rules'); the influence of other family members (disempowerment).

CONCLUSIONS

This realist review suggests that some low-income pregnant women may use Healthy Start vouchers to increase their consumption of fruits and vegetables and plain cow's milk, whereas others may use them to reduce food expenditure and save money for other things.

Collaborative action around implementation in Collaborations for Leadership in Applied Health Research and Care: towards a programme theory

OBJECTIVES

In theory, greater interaction between researchers and practitioners should result in increased potential for implementation. However, we know little about whether this is the case, or what mechanisms might operate to make it happen. This paper reports findings from a study that is identifying and tracking implementation mechanisms, processes, influences and impacts in real time, over time in the Collaborations for Leadership in Applied Health Research and Care (CLAHRCs).

METHODS

This is a longitudinal, realist evaluation case study. The development of the conceptual framework and initial hypotheses involved literature reviewing and stakeholder consultation. Primary data were collected through interviews, observations and documents within three CLAHRCs, and analysed thematically against the framework and hypotheses.

RESULTS

The first round of data collection shows that the mechanisms of collaborative action, relationship building, engagement, motivation, knowledge exchange and learning are important to the processes and outcomes of CLAHRCs' activity, including their capacity for implementation. These mechanisms operated in different contexts such as competing agendas, availability of resources and the CLAHRCs' brand. Contexts and mechanisms result in different impact, including the CLAHRCs' approach to implementation, quality of collaboration, commitment and ownership, and degree of sharing and managing knowledge.

CONCLUSION

Emerging features of a middle range theory of implementation within collaboration include alignment in organizational structures and cognitive processes, history of partnerships, responsiveness and resilience in rapidly changing contexts. CLARHCs' potential to mobilize knowledge may be further realized by how they develop insights into their function as collaborative entities.

Realistic nurse-led policy implementation, optimization and evaluation: novel methodological exemplar

AIM

To report the first large-scale realistic nurse-led implementation, optimization and evaluation of a complex children's continuing-care policy.

BACKGROUND

Health policies are increasingly complex, involve multiple Government departments and frequently fail to translate into better patient outcomes. Realist methods have not yet been adapted for policy implementation.

DESIGN

Research methodology - Evaluation using theory-based realist methods for policy implementation.

METHODS

An expert group developed the policy and supporting tools. Implementation and evaluation design integrated diffusion of innovation theory with multiple case study and adapted realist principles. Practitioners in 12 English sites worked with Consultant Nurse implementers to manipulate the programme theory and logic of new decision-support tools and care pathway to optimize local implementation. Methods included key-stakeholder interviews, developing practical diffusion of innovation processes using key-opinion leaders and active facilitation strategies and a mini-community of practice. New and existing processes and outcomes were compared for 137 children during 2007-2008.

RESULTS

Realist principles were successfully adapted to a shorter policy implementation and evaluation time frame. Important new implementation success factors included facilitated implementation that enabled 'real-time' manipulation of programme logic and local context to best-fit evolving theories of what worked; using local experiential opinion to change supporting tools to more realistically align with local context and what worked; and having sufficient existing local infrastructure to support implementation. Ten mechanisms explained implementation success and differences in outcomes between new and existing processes.

CONCLUSIONS

Realistic policy implementation methods have advantages over top-down approaches, especially where clinical expertise is low and unlikely to diffuse innovations 'naturally' without facilitated implementation and local optimization.