Understanding the Impacts of Online Mental Health Peer Support Forums: Realist Synthesis

BACKGROUND

Online forums are widely used for mental health peer support. However, evidence of their safety and effectiveness is mixed. Further research focused on articulating the contexts in which positive and negative impacts emerge from forum use is required to inform innovations in implementation.

OBJECTIVE

This study aimed to develop a realist program theory to explain the impacts of online mental health peer support forums on users.

METHODS

We conducted a realist synthesis of literature published between 2019 and 2023 and 18 stakeholder interviews with forum staff.

RESULTS

Synthesis of 102 evidence sources and 18 interviews produced an overarching program theory comprising 22 context-mechanism-outcome configurations. Findings indicate that users' perceptions of psychological safety and the personal relevance of forum content are foundational to ongoing engagement. Safe and active forums that provide convenient access to information and advice can lead to improvements in mental health self-efficacy. Within the context of welcoming and nonjudgmental communities, users may benefit from the opportunity to explore personal difficulties with peers, experience reduced isolation and normalization of mental health experiences, and engage in mutual encouragement. The program theory highlights the vital role of moderators in creating facilitative online spaces, stimulating community engagement, and limiting access to distressing content. A key challenge for organizations that host mental health forums lies in balancing forum openness and anonymity with the need to enforce rules, such as restrictions on what users can discuss, to promote community safety.

CONCLUSIONS

This is the first realist synthesis of online mental health peer support forums. The novel program theory highlights how successful implementation depends on establishing protocols for enhancing safety and strategies for maintaining user engagement to promote forum sustainability.

TRIAL REGISTRATION

PROSPERO CRD42022352528; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=352528.

Introducing the revised framework for developing and evaluating complex interventions: A challenge and a resource for nursing research

This invited discussion paper highlights key updates in the MRC/NIHR's revised framework for the development and evaluation of complex nursing interventions and reflects on the implications for nursing research.

Reprint of: 'A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance'

The UK Medical Research Council's widely used guidance for developing and evaluating complex interventions has been replaced by a new framework, commissioned jointly by the Medical Research Council and the National Institute for Health Research, which takes account of recent developments in theory and methods and the need to maximise the efficiency, use, and impact of research.

Designing a Library of Lived Experience for Mental Health: integrated realist synthesis and experience-based co-design study in UK mental health services

OBJECTIVE

Living Library events involve people being trained as living 'Books', who then discuss aspects of their personal experiences in direct conversation with attendees, referred to as 'Readers'. This study sought to generate a realist programme theory and a theory-informed implementation guide for a Library of Lived Experience for Mental Health (LoLEM).

DESIGN

Integrated realist synthesis and experience-based co-design.

SETTING

Ten online workshops with participants based in the North of England.

PARTICIPANTS

Thirty-one participants with a combination of personal experience of using mental health services, caring for someone with mental health difficulties and/or working in mental health support roles.

RESULTS

Database searches identified 30 published and grey literature evidence sources which were integrated with data from 10 online co-design workshops conducted over 12 months. The analysis generated a programme theory comprising five context-mechanism-outcome (CMO) configurations. Findings highlight how establishing psychological safety is foundational to productive Living Library events (CMO 1). For Readers, direct conversations humanise others' experiences (CMO 2) and provide the opportunity to flexibly explore new ways of living (CMO 3). Through participation in a Living Library, Books may experience personal empowerment (CMO 4), while the process of self-authoring and co-editing their story (CMO 5) can contribute to personal development. This programme theory informed the co-design of an implementation guide highlighting the importance of tailoring event design and participant support to the contexts in which LoLEM events are held.

CONCLUSIONS

The LoLEM has appeal across stakeholder groups and can be applied flexibly in a range of mental health-related settings. Implementation and evaluation are required to better understand the positive and negative impacts on Books and Readers.

TRIAL REGISTRATION NUMBER

PROSPERO CRD42022312789.

Realist synthesis protocol for understanding which strategies are effective to prevent urinary tract infection in older people in care homes

AIM

To identify and characterize strategies, which contribute to the prevention of urinary tract infection (UTI) in older people living in care homes.

DESIGN

The realist synthesis has four iterative stages to (1) develop initial programme theory; (2) search for evidence; (3) test and refine theory supported by relevant evidence and (4) formulate recommendations. Data from research articles and other sources will be used to explore the connection between interventions and the context in which they are applied in order to understand the mechanisms, which influence the outcomes to prevent UTI.

METHODS

A scoping search of the literature and workshops with stakeholders will identify initial programme theories. These theories will be tested and refined through a systematic search for evidence relating to mechanisms that trigger prevention and recognition of UTI in older people in care homes. Interviews with key stakeholders will establish practical relevance of the theories and their potential for implementation.

DISCUSSION

UTI is the most commonly diagnosed infection in care home residents. Evidence on the effectiveness of strategies to prevent UTI in long-term care facilities does not address the practicality of implementing these approaches in UK care homes. The realist synthesis is designed to examine this important gap in evidence.

IMPACT

Our evidence-informed programme theory will help inform programmes to improve practice to reduce the incidence of UTI in older people living in care homes and related research. Patient and public involvement will be crucial to ensuring that our findings reach carers and the public.

PATIENT AND PUBLIC CONTRIBUTION

Involvement of patient and public representatives is embedded throughout the study to ensure it is underpinned by multiple perspectives of importance to care home residents. Our co-investigator representing patient and public involvement is a lay member of the team and will chair the Project Advisory Group, which has two additional lay members. This will help to ensure that our findings and resources reach carers and the public and represent their voice in our publications and presentations to professional and lay audiences.

Facilitating cardiopulmonary resuscitation training in high-risk areas of England: A study protocol

Introduction

Bystanders' interventions improve chances of survival from out-of-hospital cardiac arrest (OHCA) before Emergency Medical Services arrive. Some areas in England are of concern. These high-risk areas have a higher incidence of cardiac arrest combined with lower-than-average bystander CPR rates and are characterised by higher proportions of minority ethnic group residents and deprivation.Collaborating with people from the Black African and Caribbean and South Asian minority communities in deprived areas of England, we aim to develop and evaluate the implementation of theoretically informed intervention(s) to address factors contributing to lower bystander intervention rates.

Methods

The study is a collaborative realist enquiry, informed by the Theoretical Domains Framework and associated Behaviour Change Wheel. It consists of 1) a realist evidence synthesis to produce initial program theories developed from primary workshop data and published evidence. It will include identifying factors contributing to the issue and potential interventions to address them; 2) theoretically informed intervention development, using the initial program theories and behaviour change theory and 3) a realist mixed methods implementation evaluation with embedded feasibility.Public involvement (PPI) as study team and public advisory group members is key to this study.We will conduct realist evidence synthesis, qualitative and statistical analyses appropriate to the various methods used.

Dissemination

We will develop a dissemination plan and materials targeted to members of the public in high-risk areas as well as academic outputs. We will hold an event for participating community groups and stakeholders to share findings and seek advice on next steps.

Study registration

ISRCTN90350842. Registration date 28.03.2023. The study was registered after its start date.

Improving Peer Online Forums (iPOF): protocol for a realist evaluation of peer online mental health forums to inform practice and policy

INTRODUCTION

Peer online mental health forums are commonly used and offer accessible support. Positive and negative impacts have been reported by forum members and moderators, but it is unclear why these impacts occur, for whom and in which forums. This multiple method realist study explores underlying mechanisms to understand how forums work for different people. The findings will inform codesign of best practice guidance and policy tools to enhance the uptake and effectiveness of peer online mental health forums.

METHODS AND ANALYSIS

In workstream 1, we will conduct a realist synthesis, based on existing literature and interviews with approximately 20 stakeholders, to generate initial programme theories about the impacts of forums on members and moderators and mechanisms driving these. Initial theories that are relevant for forum design and implementation will be prioritised for testing in workstream 2.Workstream 2 is a multiple case study design with mixed methods with several online mental health forums differing in contextual features. Quantitative surveys of forum members, qualitative interviews and Corpus-based Discourse Analysis and Natural Language Processing of forum posts will be used to test and refine programme theories. Final programme theories will be developed through novel triangulation of the data.Workstream 3 will run alongside workstreams 1 and 2. Key stakeholders from participating forums, including members and moderators, will be recruited to a Codesign group. They will inform the study design and materials, refine and prioritise theories, and codesign best policy and practice guidance.

ETHICS AND DISSEMINATION

Ethical approval was granted by Solihull Research Ethics Committee (IRAS 314029). Findings will be reported in accordance with RAMESES (Realist And MEta-narrative Evidence Syntheses: Evolving Standards) guidelines, published as open access and shared widely, along with codesigned tools.

TRIAL REGISTRATION NUMBER

ISRCTN 62469166; the protocol for the realist synthesis in workstream one is prospectively registered at PROSPERO CRD42022352528.

Connecting the science and practice of implementation - applying the lens of context to inform study design in implementation research

The saying "horses for courses" refers to the idea that different people and things possess different skills or qualities that are appropriate in different situations. In this paper, we apply the analogy of "horses for courses" to stimulate a debate about how and why we need to get better at selecting appropriate implementation research methods that take account of the context in which implementation occurs. To ensure that implementation research achieves its intended purpose of enhancing the uptake of research-informed evidence in policy and practice, we start from a position that implementation research should be explicitly connected to implementation practice. Building on our collective experience as implementation researchers, implementation practitioners (users of implementation research), implementation facilitators and implementation educators and subsequent deliberations with an international, inter-disciplinary group involved in practising and studying implementation, we present a discussion paper with practical suggestions that aim to inform more practice-relevant implementation research.

Designing a library of lived experience for mental health (LoLEM): protocol for integrating a realist synthesis and experience based codesign approach

INTRODUCTION

People with lived expertise in managing mental health challenges can be an important source of knowledge and support for other people facing similar challenges, and for carers to learn how best to help. However, opportunities for sharing lived expertise are limited. Living libraries support people with lived expertise to be 'living books', sharing their experiences in dialogue with 'readers' who can ask questions. Living libraries have been piloted worldwide in health-related contexts but without a clear model of how they work or rigorous evaluation of their impacts. We aim to develop a programme theory about how a living library could be used to improve mental health outcomes, using this theory to codesign an implementation guide that can be evaluated across different contexts.

METHODS AND ANALYSIS

We will use a novel integration of realist synthesis and experience-based codesign (EBCD) to produce a programme theory about how living libraries work and a theory and experience informed guide to establishing a library of lived experience for mental health (LoLEM). Two workstreams will run concurrently: (1) a realist synthesis of literature on living libraries, combined with stakeholder interviews, will produce several programme theories; theories will be developed collaboratively with an expert advisory group of stakeholders who have hosted or taken part in a living library and will form our initial analysis framework; a systematic search will identify literature about living libraries; data will be coded into our analysis framework, and we will use retroductive reasoning to explain living libraries' impacts across multiple contexts. Individual stakeholder interviews will help refine and test theories; (2) data from workstream 1 will inform 10 EBCD workshops with people with experience of managing mental health difficulties and health professionals to produce a LoLEM implementation guide; data from this process will also inform the theory in workstream 1.

ETHICS AND DISSEMINATION

Ethical approval was granted by Coventry and Warwick National Health Service Research Ethics Committee on 29 December 2021 (reference number 305975). The programme theory and implementation guide will be published as open access and shared widely through a knowledge exchange event, a study website, mental health provider and peer support networks, peer reviewed journals and a funders report.

PROSPERO REGISTRATION DETAILS

CRD42022312789.

Prioritising Responses Of Nurses To deteriorating patient Observations (PRONTO): a pragmatic cluster randomised controlled trial evaluating the effectiveness of a facilitation intervention on recognition and response to clinical deterioration

BACKGROUND

Most hospitals use physiological signs to trigger an urgent clinical review. We investigated whether facilitation could improve nurses' vital sign measurement, interpretation, treatment and escalation of care for deteriorating patients.

METHODS

In a pragmatic cluster randomised controlled trial, we randomised 36 inpatient wards at four acute hospitals to receive standard clinical practice guideline (CPG) dissemination to ward staff (n=18) or facilitated implementation for 6 months following standard dissemination (n=18). Expert, hospital and ward facilitators tailored facilitation techniques to promote nurses' CPG adherence. Patient records were audited pre-intervention, 6 and 12 months post-intervention on randomly selected days. Escalation of care as per hospital policy was the primary outcome at 6 and 12 months after implementation. Patients, nurses and assessors were blinded to group assignment. Analysis was by intention-to-treat.

RESULTS

From 10 383 audits, improved escalation as per hospital policy was evident in the intervention group at 6 months (OR 1.47, 95% CI (1.06 to 2.04)) with a complete set of vital sign measurements sustained at 12 months (OR 1.22, 95% CI (1.02 to 1.47)). There were no significant differences in escalation of care as per hospital policy between study groups at 6 or 12 months post-intervention. After adjusting for patient and hospital characteristics, a significant change from T0 in mean length of stay between groups at 12 months favoured the intervention group (-2.18 days, 95% CI (-3.53 to -0.82)).

CONCLUSION

Multi-level facilitation significantly improved escalation as per hospital policy at 6 months in the intervention group that was not sustained at 12 months. The intervention group had increased vital sign measurement by nurses, as well as shorter lengths of stay for patients at 12 months. Further research is required to understand the dose of facilitation required to impact clinical practice behaviours and patient outcomes.

TRIAL REGISTRATION NUMBER

ACTRN12616000544471p.

Optimising the Conceptualisation of Context Comment on "Stakeholder Perspectives of Attributes and Features of Context Relevant to Knowledge Translation in Health Settings: A Multi-country Analysis"

Context matters. Therefore, efforts to develop greater conceptual clarity are important for science and practice. In this commentary, we outline some key issues that were prompted by Squire's et al.'s contribution. Specifically, we reinforce context as an interactive concept and therefore something that is hard to 'pin down', the problematic nature of conceptualising context in implementation and de-implementation, and a requirement for the development of culturally sensitive understandings. Finally, we suggest it is vital that continued investment into providing a more comprehensive list of determinants needs to be accompanied by an equal effort in developing practical methods and tools to support use and application.

Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update

BACKGROUND

The Medical Research Council published the second edition of its framework in 2006 on developing and evaluating complex interventions. Since then, there have been considerable developments in the field of complex intervention research. The objective of this project was to update the framework in the light of these developments. The framework aims to help research teams prioritise research questions and design, and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods.

METHODS

There were four stages to the update: (1) gap analysis to identify developments in the methods and practice since the previous framework was published; (2) an expert workshop of 36 participants to discuss the topics identified in the gap analysis; (3) an open consultation process to seek comments on a first draft of the new framework; and (4) findings from the previous stages were used to redraft the framework, and final expert review was obtained. The process was overseen by a Scientific Advisory Group representing the range of relevant National Institute for Health Research and Medical Research Council research investments.

RESULTS

Key changes to the previous framework include (1) an updated definition of complex interventions, highlighting the dynamic relationship between the intervention and its context; (2) an emphasis on the use of diverse research perspectives: efficacy, effectiveness, theory-based and systems perspectives; (3) a focus on the usefulness of evidence as the basis for determining research perspective and questions; (4) an increased focus on interventions developed outside research teams, for example changes in policy or health services delivery; and (5) the identification of six 'core elements' that should guide all phases of complex intervention research: consider context; develop, refine and test programme theory; engage stakeholders; identify key uncertainties; refine the intervention; and economic considerations. We divide the research process into four phases: development, feasibility, evaluation and implementation. For each phase we provide a concise summary of recent developments, key points to address and signposts to further reading. We also present case studies to illustrate the points being made throughout.

LIMITATIONS

The framework aims to help research teams prioritise research questions and design and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods. In many of the areas of innovation that we highlight, such as the use of systems approaches, there are still only a few practical examples. We refer to more specific and detailed guidance where available and note where promising approaches require further development.

CONCLUSIONS

This new framework incorporates developments in complex intervention research published since the previous edition was written in 2006. As well as taking account of established practice and recent refinements, we draw attention to new approaches and place greater emphasis on economic considerations in complex intervention research. We have introduced a new emphasis on the importance of context and the value of understanding interventions as 'events in systems' that produce effects through interactions with features of the contexts in which they are implemented. The framework adopts a pluralist approach, encouraging researchers and research funders to adopt diverse research perspectives and to select research questions and methods pragmatically, with the aim of providing evidence that is useful to decision-makers.

FUTURE WORK

We call for further work to develop relevant methods and provide examples in practice. The use of this framework should be monitored and the move should be made to a more fluid resource in the future, for example a web-based format that can be frequently updated to incorporate new material and links to emerging resources.

FUNDING

This project was jointly funded by the Medical Research Council (MRC) and the National Institute for Health Research (Department of Health and Social Care 73514).

Realising the full potential of data-enabled trials in the UK: a call for action

RATIONALE

Clinical trials are the gold standard for testing interventions. COVID-19 has further raised their public profile and emphasised the need to deliver better, faster, more efficient trials for patient benefit. Considerable overlap exists between data required for trials and data already collected routinely in electronic healthcare records (EHRs). Opportunities exist to use these in innovative ways to decrease duplication of effort and speed trial recruitment, conduct and follow-up.

APPROACH

The National Institute of Health Research (NIHR), Health Data Research UK and Clinical Practice Research Datalink co-organised a national workshop to accelerate the agenda for 'data-enabled clinical trials'. Showcasing successful examples and imagining future possibilities, the plenary talks, panel discussions, group discussions and case studies covered: design/feasibility; recruitment; conduct/follow-up; collecting benefits/harms; and analysis/interpretation.

REFLECTION

Some notable studies have successfully accessed and used EHR to identify potential recruits, support randomised trials, deliver interventions and supplement/replace trial-specific follow-up. Some outcome measures are already reliably collected; others, like safety, need detailed work to meet regulatory reporting requirements. There is a clear need for system interoperability and a 'route map' to identify and access the necessary datasets. Researchers running regulatory-facing trials must carefully consider how data quality and integrity would be assessed. An experience-sharing forum could stimulate wider adoption of EHR-based methods in trial design and execution.

DISCUSSION

EHR offer opportunities to better plan clinical trials, assess patients and capture data more efficiently, reducing research waste and increasing focus on each trial's specific challenges. The short-term emphasis should be on facilitating patient recruitment and for postmarketing authorisation trials where research-relevant outcome measures are readily collectable. Sharing of case studies is encouraged. The workshop directly informed NIHR's funding call for ambitious data-enabled trials at scale. There is the opportunity for the UK to build upon existing data science capabilities to identify, recruit and monitor patients in trials at scale.

Theory and practical guidance for effective de-implementation of practices across health and care services: a realist synthesis

Background

Health-care systems across the globe are facing increased pressures to balance the efficient use of resources and at the same time provide high-quality care. There is greater requirement for services to be evidence based, but practices that are of limited clinical effectiveness or cost-effectiveness still occur.

Objectives

Our objectives included completing a concept analysis of de-implementation, surfacing decision-making processes associated with de-implementing through stakeholder engagement, and generating an evidence-based realist programme theory of ‘what works’ in de-implementation.

Design

A realist synthesis was conducted using an iterative stakeholder-driven four-stage approach. Phase 1 involved scoping the literature and conducting stakeholder interviews to develop the concept analysis and an initial programme theory. In Phase 2, systematic searches of the evidence were conducted to test and develop this theory, expressed in the form of contingent relationships. These are expressed as context–mechanism–outcomes to show how particular contexts or conditions trigger mechanisms to generate outcomes. Phase 3 consisted of validation and refinement of programme theories through stakeholder interviews. The final phase (i.e. Phase 4) formulated actionable recommendations for service leaders.

Participants

In total, 31 stakeholders (i.e. user/patient representatives, clinical managers, commissioners) took part in focus groups and telephone interviews.

Data sources

Using keywords identified during the scoping work and concept analysis, searches of bibliographic databases were conducted in May 2018. The databases searched were the Cochrane Library, Campbell Collaboration, MEDLINE (via EBSCOhost), the Cumulative Index to Nursing and Allied Health Literature (via EBSCOhost), the National Institute for Health Research Journals Library and the following databases via the ProQuest platform: Applied Social Sciences Index and Abstracts, Social Services Abstracts, International Bibliography of the Social Sciences, Social Sciences Database and Sociological Abstracts. Alerts were set up for the MEDLINE database from May 2018 to December 2018. Online sources were searched for grey literature and snowballing techniques were used to identify clusters of evidence.

Results

The concept analysis showed that de-implementation is associated with five main components in context and over time: (1) what is being de-implemented, (2) the issues driving de-implementation, (3) the action characterising de-implementation, (4) the extent that de-implementation is planned or opportunistic and (5) the consequences of de-implementation. Forty-two papers were synthesised to identify six context–mechanism–outcome configurations, which focused on issues ranging from individual behaviours to organisational procedures. Current systems can perpetuate habitual decision-making practices that include low-value treatments. Electronic health records can be designed to hide or remove low-value treatments from choice options, foregrounding best evidence. Professionals can be made aware of their decision-making strategies through increasing their attention to low-value practice behaviours. Uncertainty about diagnosis or patients’ expectations for certain treatments provide opportunities for ‘watchful waiting’ as an active strategy to reduce inappropriate investigations and prescribing. The emotional component of clinician–patient relationships can limit opportunities for de-implementation, requiring professional support through multimodal educational interventions. Sufficient alignment between policy, public and professional perspectives is required for de-implementation success.

Limitations

Some specific clinical issues (e.g. de-prescribing) dominate the de-implementation evidence base, which may limit the transferability of the synthesis findings. Any realist inquiry generates findings that are essentially cumulative and should be developed through further investigation that extends the range of sources into, for example, clinical research and further empirical studies.

Conclusions

This review contributes to our understanding of how de-implementation of low-value procedures and services can be improved within health-care services, through interventions that make professional decision-making more accountable and the prominence of a whole-system approach to de-implementation. Given the whole-system context of de-implementation, a range of different dissemination strategies will be required to engage with different stakeholders, in different ways, to change practice and policy in a timely manner.

Study registration

This study is registered as PROSPERO CRD42017081030.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 9, No. 2. See the NIHR Journals Library website for further project information.

Re-Framing the Knowledge to Action Challenge Through NIHR Knowledge Mobilisation Research Fellows Comment on "CIHR Health System Impact Fellows: Reflections on 'Driving Change' Within the Health System"

The ambition of the Canadian Institutes for Health Research Health System Impact (HSI) Fellowship initiative to modernise the health system is impressive. Embedded researchers who work between academia and non-academic settings offer an opportunity to reframe the problem of evidence uptake as a product of a gap between those who produce knowledge and those who use it. As such, there has been an increasing interest in the potential of people in embedded research roles to work with stakeholders in the co-production of knowledge to address service challenges. In this commentary, we draw on research and experiential evidence of an embedded researcher initiative, which has similar intentions to the HSI Fellowships programme: the National Institute for Health Research (NIHR) Knowledge Mobilisation Research Fellowship (KMRF) scheme. We outline the similarities and differences between the two schemes, and then consider the work, characteristics and skills, and organisational arrangements evident in operationalising these types of roles.

An online supported self-management toolkit for relatives of people with psychosis or bipolar experiences: the IMPART multiple case study

Background

Digital health interventions have the potential to improve the delivery of psychoeducation to people with mental health problems and their relatives. Despite substantial investment in the development of digital health interventions, successful implementation into routine clinical practice is rare.

Objectives

Use the implementation of the Relatives’ Education And Coping Toolkit (REACT) for psychosis/bipolar disorder to identify critical factors affecting uptake and use, and develop an implementation plan to support the delivery of REACT.

Design

This was an implementation study using a mixed-methods, theory-driven, multiple case study approach. A study-specific implementation theory for REACT based on normalisation process theory was developed and tested, and iterations of an implementation plan to address the key factors affecting implementation were developed.

Setting

Early-intervention teams in six NHS mental health trusts in England (three in the north and three in the south).

Participants

In total, 281 staff accounts and 159 relatives’ accounts were created, 129 staff and 23 relatives took part in qualitative interviews about their experiences, and 132 relatives provided demographic data, 56 provided baseline data, 21 provided data at 12 weeks’ follow-up and 20 provided data at 24 weeks’ follow-up.

Interventions

REACT is an online supported self-management toolkit, offering 12 evidence-based psychoeducation modules and support via a forum, and a confidential direct messaging service for relatives of people with psychosis or bipolar disorder. The implementation intervention was developed with staff and iteratively adapted to address identified barriers. Adaptations included modifications to the toolkit and how it was delivered by teams.

Main outcome measures

The main outcome was factors affecting implementation of REACT, assessed primarily through in-depth interviews with staff and relatives. We also assessed quantitative measures of delivery (staff accounts and relatives’ invitations), use of REACT (relatives’ logins and time spent on the website) and the impact of REACT [relatives’ distress (General Health Questionnaire-28), and carer well-being and support (Carer Well-being and Support Scale questionnaire)].

Results

Staff and relatives were generally positive about the content of REACT, seeing it as a valuable resource that could help services improve support and meet clinical targets, but only within a comprehensive service that included face-to-face support, and with some additional content. Barriers to implementation included high staff caseloads and difficulties with prioritising supporting relatives; technical difficulties of using REACT; poor interoperability with trust information technology systems and care pathways; lack of access to mobile technology and information technology training; restricted forum populations leading to low levels of use; staff fears of managing risk, online trolling, or replacement by technology; and uncertainty around REACT’s long-term availability. There was no evidence that REACT would reduce staff time supporting relatives (which was already very low), and might increase it by facilitating communication. In all, 281 staff accounts were created, but only 57 staff sent relatives invitations. In total, 355 relatives’ invitations were sent to 310 unique relatives, leading to the creation of 159 relatives’ accounts. The mean number of logins for relatives was 3.78 (standard deviation 4.43), but with wide variation from 0 to 31 (median 2, interquartile range 1–8). The mean total time spent on the website was 40.6 minutes (standard deviation 54.54 minutes), with a range of 0–298 minutes (median 20.1 minutes, interquartile range 4.9–57.5 minutes). There was a pattern of declining mean scores for distress, social dysfunction, depression, anxiety and insomnia, and increases in relatives’ well-being and eHealth literacy, but no changes were statistically significant.

Conclusions

Digital health interventions, such as REACT, should be iteratively developed, evaluated, adapted and implemented, with staff and service user input, as part of a long-term strategy to develop integrated technology-enabled services. Implementation strategies must instil a sense of ownership for staff and ensure that they have adequate training, risk protocols and resources to deliver the technology. Cost-effectiveness and impact on workload and inequalities in accessing health care need further testing, along with the generalisability of our findings to other digital health interventions.

Limitations

REACT was offered by the same team running the IMPlementation of A Relatives’ Toolkit (IMPART) study, and was perceived by staff and relatives as a time-limited research study rather than ongoing clinical service, which affected engagement. Access to observational data was limited.

Trial registration

Current Controlled Trials ISRCTN16267685.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 8, No. 37. See the NIHR Journals Library website for further project information.

The use of the PARIHS framework in implementation research and practice-a citation analysis of the literature

BACKGROUND

The Promoting Action on Research Implementation in Health Services (PARIHS) framework was developed two decades ago and conceptualizes successful implementation (SI) as a function (f) of the evidence (E) nature and type, context (C) quality, and the facilitation (F), [SI = f (E,C,F)]. Despite a growing number of citations of theoretical frameworks including PARIHS, details of how theoretical frameworks are used remains largely unknown. This review aimed to enhance the understanding of the breadth and depth of the use of the PARIHS framework.

METHODS

This citation analysis commenced from four core articles representing the key stages of the framework's development. The citation search was performed in Web of Science and Scopus. After exclusion, we undertook an initial assessment aimed to identify articles using PARIHS and not only referencing any of the core articles. To assess this, all articles were read in full. Further data extraction included capturing information about where (country/countries and setting/s) PARIHS had been used, as well as categorizing how the framework was applied. Also, strengths and weaknesses, as well as efforts to validate the framework, were explored in detail.

RESULTS

The citation search yielded 1613 articles. After applying exclusion criteria, 1475 articles were read in full, and the initial assessment yielded a total of 367 articles reported to have used the PARIHS framework. These articles were included for data extraction. The framework had been used in a variety of settings and in both high-, middle-, and low-income countries. With regard to types of use, 32% used PARIHS in planning and delivering an intervention, 50% in data analysis, 55% in the evaluation of study findings, and/or 37% in any other way. Further analysis showed that its actual application was frequently partial and generally not well elaborated.

CONCLUSIONS

In line with previous citation analysis of the use of theoretical frameworks in implementation science, we also found a rather superficial description of the use of PARIHS. Thus, we propose the development and adoption of reporting guidelines on how framework(s) are used in implementation studies, with the expectation that this will enhance the maturity of implementation science.

Using Nonparticipant Observation as a Method to Understand Implementation Context in Evidence-Based Practice

BACKGROUND

The uptake of evidence-based knowledge in practice is influenced by context. Observations are suggested as a valuable but under-used approach in implementation research for gaining a holistic understanding of contexts.

AIM

The aim of this paper is to demonstrate how data from observations can provide insights about context and evidence use in implementation research.

METHODS

Data were collected over 24 months in a randomised trial with an embedded realist evaluation in 24 nursing homes across four European countries; notes from 183 observations (representing 335 hours) were triangulated with interview transcripts and context survey data (from 357 staff interviews and 725 questionnaire responses, respectively).

RESULTS

Although there were similarities in several elements of context within survey, interview and observation data, the observations provided additional features of the implementation context. In particular, observations demonstrated if and how the resources (staffing and supplies) and leadership (formal and informal, teamwork, and professional autonomy) affected knowledge use and implementation. Further, the observations illuminated the influence of standards and the physical nursing environment on evidence-based practice, and the dynamic interaction between different aspects of context.

LINKING EVIDENCE TO ACTION

Although qualitative observations are resource-intensive, they add value when used with other data collection methods, further enlightening the understanding of the implementation context and how evidence use and sharing are influenced by context elements. Observations can enhance an understanding of the context, evidence use and knowledge-sharing triad in implementation research.

'Mind the gaps': the accessibility and implementation of an effective depression relapse prevention programme in UK NHS services: learning from mindfulness-based cognitive therapy through a mixed-methods study

OBJECTIVES

Mindfulness-based cognitive therapy (MBCT) is an evidence-based approach for people at risk of depressive relapse to support their long-term recovery. However, despite its inclusion in guidelines, there is an 'implementation cliff'. The study objective was to develop a better explanation of what facilitates MBCT implementation.

SETTING

UK primary and secondary care mental health services.

DESIGN, PARTICIPANTS AND METHODS

A national two-phase, multi-method qualitative study was conducted, which was conceptually underpinned by the Promoting Action on Research Implementation in Health Services framework. Phase I involved interviews with stakeholders from 40 service providers about current provision of MBCT. Phase II involved 10 purposively sampled case studies to obtain a more detailed understanding of MBCT implementation. Data were analysed using adapted framework analysis, refined through stakeholder consultation.

RESULTS

Access to MBCT is variable across the UK services. Where available, services have adapted MBCT to fit their context by integrating it into their care pathways. Evidence was often important to implementation but took different forms: the NICE depression guideline, audits, evaluations, first person accounts, experiential taster sessions and pilots. These were used to build a platform from which to develop MBCT services. The most important aspect of facilitation was the central role of the MBCT implementers. These were generally self-designated individuals who 'championed' grass-roots implementation. Our explanatory framework mapped out a prototypical implementation journey, often over many years with a balance of bottom-up and top-down factors influencing the fit of MBCT into service pathways. 'Pivot points' in the implementation journey provided windows of either challenge or opportunity.

CONCLUSIONS

This is one of the largest systematic studies of the implementation of a psychological therapy. While access to MBCT across the UK is improving, it remains patchy. The resultant explanatory framework about MBCT implementation provides a heuristic that informed an implementation resource.

Understanding how and why de-implementation works in health and care: research protocol for a realist synthesis of evidence

BACKGROUND

Strategies to improve the effectiveness and quality of health and care have predominantly emphasised the implementation of new research and evidence into service organisation and delivery. A parallel, but less understood issue is how clinicians and service leaders stop existing practices and interventions that are no longer evidence based, where new evidence supersedes old evidence, or interventions are replaced with those that are more cost effective. The aim of this evidence synthesis is to produce meaningful programme theory and practical guidance for policy makers, managers and clinicians to understand how and why de-implementation processes and procedures can work.

METHODS AND ANALYSIS

The synthesis will examine the attributes or characteristics that constitute the concept of de-implementation. The research team will then draw on the principles of realist inquiry to provide an explanatory account of how, in what context and for whom to explain the successful processes and impacts of de-implementation. The review will be conducted in four phases over 18 months. Phase 1: develop a framework to map the preliminary programme theories through an initial scoping of the literature and consultation with key stakeholders. Phase 2: systematic searches of the evidence to develop the theories identified in phase 1. Phase 3: validation and refinement of programme theories through stakeholder interviews. Phase 4: formulating actionable recommendations for managers, commissioners and service leaders about what works through different approaches to de-implementation.

DISCUSSION

This evidence synthesis will address gaps in knowledge about de-implementation across health and care services and ensure that guidance about strategies and approaches accounts for contextual factors, which may be operating at different organisational and decision-making levels. Through the development of the programme theory, which explains what works, how and under which circumstances, findings from the evidence synthesis will support managers and service leaders to make measured decisions about de-implementation.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42017081030.

The development and theoretical application of an implementation framework for dialectical behaviour therapy: a critical literature review

BACKGROUND

Dialectical behaviour therapy (DBT) is a third wave behaviour therapy combining behaviour based components with elements of mindfulness. Although DBT effectiveness has been explored, relatively little attention has been given to its implementation. Frameworks are often the basis for gathering information about implementation and can also direct how the implementation of an intervention is conducted. Using existing implementation frameworks, this critical literature review scoped the DBT implementation literature to develop and refine a bespoke DBT implementation framework.

METHOD AND RESULTS

The initial framework was developed by consolidating existing implementation frameworks and published guidance on DBT implementation. The critical literature review retrieved papers from Medline, CINAHL, PsycInfo, PubMed, and the reference lists of included papers. Framework elements were used as codes which were applied to the literature and guided the synthesis. Findings from the synthesis refined the framework.The critical literature review retrieved 60 papers but only 14 of these explicitly focused on implementation. The DBT implementation framework captured all the execution barriers and facilitators described in the literature. However, the evidence synthesis led to a more parsimonious framework as some elements (e.g., research and published guidance) were seldom discussed in DBT implementation.

CONCLUSION

To our knowledge this is the first published review exploring DBT implementation. The literature synthesis suggests some tentative recommendations which warrant further exploration. For instance, if DBT implementation is not pre-planned, having someone in the organisation who champions DBT can be advantageous. However, as the literature is limited and has methodological limitations, further prospective studies of DBT implementation are needed.

How Should We Evaluate and Use Evidence to Improve Population Oral Health?

Generating and implementing evidence-based policy is an important aim for many publicly funded health systems. In dentistry, this is based on the assumption that evidence-based health care increases the efficiency and effectiveness of interventions to improve oral health at a population level. This article argues that a linear logic model that links the generation of research evidence with its use is overly simplistic. It also challenges an uncritical interpretation of the evidence-based paradigm and explores approaches to the evaluation of complex interventions and how they can be embedded into policy and practice to improve oral health at a population level.

The generation of consensus guidelines for carrying out process evaluations in rehabilitation research

BACKGROUND

Although in recent years there has been a strong increase in published research on theories (e.g. realist evaluation, normalization process theory) driving and guiding process evaluations of complex interventions, there is limited guidance to help rehabilitation researchers design and carry out process evaluations. This can lead to the risk of process evaluations being unsystematic. This paper reports on the development of new consensus guidelines that address the specific challenges of conducting process evaluations alongside clinical trials of rehabilitation interventions.

METHODS

A formal consensus process was carried out based on a modified nominal group technique, which comprised two phases. Phase I was informed by the findings of a systematic review, and included a nominal group meeting with an expert panel of participants to rate and discuss the proposed statements. Phase II was an in depth semi-structured telephone interviews with expert panel participants in order to further discuss the structure and contents of the revised guidelines. Frequency of rating responses to each statement was calculated and thematic analysis was carried out on all qualitative data.

RESULTS

The guidelines for carrying out process evaluations within complex intervention rehabilitation research were produced by combining findings from Phase I and Phase II. The consensus guidelines include recommendations that are grouped in seven sections. These sections are theoretical work, design and methods, context, recruitment and retention, intervention staff, delivery of the intervention and results. These sections represent different aspects or stages of the evaluation process.

CONCLUSION

The consensus guidelines here presented can play a role at assisting rehabilitation researchers at the time of designing and conducting process evaluations alongside trials of complex interventions. The guidelines break new ground in terms of concepts and theory and works towards a consensus in regards to how rehabilitation researchers should go about carrying out process evaluations and how this evaluation should be linked into the proposed trials. These guidelines may be used, adapted and tested by rehabilitation researchers depending on the research stage or study design (e.g. feasibility trial, pilot trial, etc.).

Facilitating Implementation of Research Evidence (FIRE): an international cluster randomised controlled trial to evaluate two models of facilitation informed by the Promoting Action on Research Implementation in Health Services (PARIHS) framework

BACKGROUND

Health care practice needs to be underpinned by high quality research evidence, so that the best possible care can be delivered. However, evidence from research is not always utilised in practice. This study used the Promoting Action on Research Implementation in Health Services (PARIHS) framework as its theoretical underpinning to test whether two different approaches to facilitating implementation could affect the use of research evidence in practice.

METHODS

A pragmatic clustered randomised controlled trial with embedded process and economic evaluation was used. The study took place in four European countries across 24 long-term nursing care sites, for people aged 60 years or more with documented urinary incontinence. In each country, sites were randomly allocated to standard dissemination, or one of two different types of facilitation. The primary outcome was the documented percentage compliance with the continence recommendations, assessed at baseline, then at 6, 12, 18, and 24 months after the intervention. Data were analysed using STATA15, multi-level mixed-effects linear regression models were fitted to scores for compliance with the continence recommendations, adjusting for clustering.

RESULTS

Quantitative data were obtained from reviews of 2313 records. There were no significant differences in the primary outcome (documented compliance with continence recommendations) between study arms and all study arms improved over time.

CONCLUSIONS

This was the first cross European randomised controlled trial with embedded process evaluation that sought to test different methods of facilitation. There were no statistically significant differences in compliance with continence recommendations between the groups. It was not possible to identify whether different types and "doses" of facilitation were influential within very diverse contextual conditions. The process evaluation (Rycroft-Malone et al., Implementation Science. doi: 10.1186/s13012-018-0811-0) revealed the models of facilitation used were limited in their ability to overcome the influence of contextual factors.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN11598502 . Date 4/2/10. The research leading to these results has received funding from the European Union's Seventh Framework Programme (FP7/2007-2013) under grant agreement no. 223646.

A realist process evaluation within the Facilitating Implementation of Research Evidence (FIRE) cluster randomised controlled international trial: an exemplar

BACKGROUND

Facilitation is a promising implementation intervention, which requires theory-informed evaluation. This paper presents an exemplar of a multi-country realist process evaluation that was embedded in the first international randomised controlled trial evaluating two types of facilitation for implementing urinary continence care recommendations. We aimed to uncover what worked (and did not work), for whom, how, why and in what circumstances during the process of implementing the facilitation interventions in practice.

METHODS

This realist process evaluation included theory formulation, theory testing and refining. Data were collected in 24 care home sites across four European countries. Data were collected over four time points using multiple qualitative methods: observation (372 h), interviews with staff (n = 357), residents (n = 152), next of kin (n = 109) and other stakeholders (n = 128), supplemented by facilitator activity logs. A combined inductive and deductive data analysis process focused on realist theory refinement and testing.

RESULTS

The content and approach of the two facilitation programmes prompted variable opportunities to align and realign support with the needs and expectations of facilitators and homes. This influenced their level of confidence in fulfilling the facilitator role and ability to deliver the intervention as planned. The success of intervention implementation was largely dependent on whether sites prioritised their involvement in both the study and the facilitation programme. In contexts where the study was prioritised (including release of resources) and where managers and staff support was sustained, this prompted collective engagement (as an attitude and action). Internal facilitators' (IF) personal characteristics and abilities, including personal and formal authority, in combination with a supportive environment prompted by managers triggered the potential for learning over time. Learning over time resulted in a sense of confidence and personal growth, and enactment of the facilitation role, which resulted in practice changes.

CONCLUSION

The scale and multi-country nature of this study provided a novel context to conduct one of the few trial embedded realist-informed process evaluations. In addition to providing an explanatory account of implementation processes, a conceptual platform for future facilitation research is presented. Finally, a realist-informed process evaluation framework is outlined, which could inform future research of this nature.

TRIAL REGISTRATION

Current controlled trials ISRCTN11598502 .

NHS managers’ use of nursing workforce planning and deployment technologies: a realist synthesis

Background

Policy and reviews of health-care safety and quality emphasise the role of NHS managers in ensuring safe, good-quality patient care through effective staffing. Guidance requires that NHS managers combine professional judgement with evidence-based workforce planning and deployment tools and technologies (WPTs). Evidence has focused on the effectiveness of WPTs, but little is known about supporting their implementation, or the impact of using WPTs across settings.

Objectives

The review answered the following question: ‘NHS managers’ use of workforce planning and deployment technologies and their impacts on nursing staffing and patient care: what works, for whom, how and in what circumstances?’.

Design

A realist synthesis was conducted. A programme theory was formulated and expressed as hypotheses in the form of context, mechanisms and outcomes; this considered how, through using WPTs, particular conditions produced responses to generate outcomes. There were four phases: (1) development of a theoretical territory to understand nurse workforce planning and deployment complexity, resulting in an initial programme theory; (2) retrieval, review and synthesis of evidence, guided by the programme theory; (3) testing and refinement of the programme theory for practical application; and (4) actionable recommendations to support NHS managers in the implementation of WPTs for safe staffing.

Participants

NHS managers, patient and public representatives and policy experts informed the programme theory in phase 1, which was validated in interviews with 10 NHS managers. In phase 3, 11 NHS managers were interviewed to refine the programme theory.

Results

Workforce planning and deployment tools and technologies can be characterised functionally by their ability to summarise and aggregate staffing information, communicate about staffing, allocate staff and facilitate compliance with standards and quality assurance. NHS managers need to combine local knowledge and professional judgement with data from WPTs for effective staffing decisions. WPTs are used in a complex workforce system in which proximal factors (e.g. the workforce satisfaction with staffing) can influence distal factors (e.g. organisational reputation and potential staff recruitment). The system comprises multiple organisational strategies (e.g. professional and financial), which may (or may not) align around effective staffing. The positive impact of WPTs can include ensuring that staff are allocated effectively, promoting the patient safety agenda within an organisation, learning through comparison about ‘what works’ in effective staffing and having greater influence in staffing work. WPTs appear to have a positive impact when they visibly integrate data on needs and resources and when there is technical and leadership support. A collaborative process appears to be best for developing and implementing WPTs, so that they are fit for purpose.

Limitations

The evidence, predominantly from acute care, often lacked detail on how managers applied professional judgement to WPTs for staffing decisions. The evidence lacked specificity about how managers develop skills on communicating staffing decisions to patients and the public.

Conclusions and recommendations

The synthesis produced initial explanations of the use and impact of WPTs for decision-making and what works to support NHS managers to use these effectively. It is suggested that future research should further evaluate the programme theory.

Study registration

This study is registered as PROSPERO CRD42016038132.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

Managing diabetes in people with dementia: a realist review

BACKGROUND

Dementia and diabetes mellitus are common long-term conditions that coexist in a large number of older people. People living with dementia and diabetes may be at increased risk of complications such as hypoglycaemic episodes because they are less able to manage their diabetes.

OBJECTIVES

To identify the key features or mechanisms of programmes that aim to improve the management of diabetes in people with dementia and to identify areas needing further research.

DESIGN

Realist review, using an iterative, stakeholder-driven, four-stage approach. This involved scoping the literature and conducting stakeholder interviews to develop initial programme theories, systematic searches of the evidence to test and develop the theories, and the validation of programme theories with a purposive sample of stakeholders.

PARTICIPANTS

Twenty-six stakeholders (user/patient representatives, dementia care providers, clinicians specialising in dementia or diabetes and researchers) took part in interviews and 24 participated in a consensus conference.

DATA SOURCES

The following databases were searched from 1990 to March 2016: MEDLINE (PubMed), Cumulative Index to Nursing and Allied Health Literature, Scopus, The Cochrane Library (including the Cochrane Database of Systematic Reviews), Database of Abstracts of Reviews of Effects, the Health Technology Assessment (HTA) database, NHS Economic Evaluation Database, AgeInfo (Centre for Policy on Ageing - UK), Social Care Online, the National Institute for Health Research (NIHR) portfolio database, NHS Evidence, Google (Google Inc., Mountain View, CA, USA) and Google Scholar (Google Inc., Mountain View, CA, USA).

RESULTS

We included 89 papers. Ten papers focused directly on people living with dementia and diabetes, and the rest related to people with dementia or diabetes or other long-term conditions. We identified six context-mechanism-outcome (CMO) configurations that provide an explanatory account of how interventions might work to improve the management of diabetes in people living with dementia. This includes embedding positive attitudes towards people living with dementia, person-centred approaches to care planning, developing skills to provide tailored and flexible care, regular contact, family engagement and usability of assistive devices. A general metamechanism that emerges concerns the synergy between an intervention strategy, the dementia trajectory and social and environmental factors, especially family involvement. A flexible service model for people with dementia and diabetes would enable this synergy in a way that would lead to the improved management of diabetes in people living with dementia.

LIMITATIONS

There is little evidence relating to the management of diabetes in people living with dementia, although including a wider literature provided opportunities for transferable learning. The outcomes in our CMOs are largely experiential rather than clinical. This reflects the evidence available. Outcomes such as increased engagement in self-management are potential surrogates for better clinical management of diabetes, but this is not proven.

CONCLUSIONS

This review suggests that there is a need to prioritise quality of life, independence and patient and carer priorities over a more biomedical, target-driven approach. Much current research, particularly that specific to people living with dementia and diabetes, identifies deficiencies in, and problems with, current systems. Although we have highlighted the need for personalised care, continuity and family-centred approaches, there is much evidence to suggest that this is not currently happening. Future research on the management of diabetes in older people with complex health needs, including those with dementia, needs to look at how organisational structures and workforce development can be better aligned to the needs of people living with dementia and diabetes.

STUDY REGISTRATION

This study is registered as PROSPERO CRD42015020625.

FUNDING

The NIHR HTA programme.

Developing a multidisciplinary rehabilitation package following hip fracture and testing in a randomised feasibility study: Fracture in the Elderly Multidisciplinary Rehabilitation (FEMuR)

BACKGROUND

Proximal femoral fracture is a major health problem in old age, with annual UK health and social care costs of £2.3B. Rehabilitation has the potential to maximise functional recovery and maintain independent living, but evidence of clinical effectiveness and cost-effectiveness is lacking.

OBJECTIVES

To develop an enhanced community-based rehabilitation package following surgical treatment for proximal femoral fracture and to assess acceptability and feasibility for a future definitive randomised controlled trial (RCT) and economic evaluation.

DESIGN

Phase I - realist review, survey and focus groups to develop the rehabilitation package. Phase II - parallel-group, randomised (using a dynamic adaptive algorithm) feasibility study with focus groups and an anonymised cohort study.

SETTING

Recruitment was from orthopaedic wards of three acute hospitals in the Betsi Cadwaladr University Health Board, North Wales. The intervention was delivered in the community following hospital discharge.

PARTICIPANTS

Older adults (aged ≥ 65 years) who had received surgical treatment for hip fracture, lived independently prior to fracture, had mental capacity (assessed by the clinical team) and received rehabilitation in the North Wales area.

INTERVENTIONS

Participants received usual care (control) or usual care plus an enhanced rehabilitation package (intervention). Usual care was variable and consisted of multidisciplinary rehabilitation delivered by the acute hospital, community hospital and community services depending on need and availability. The intervention was designed to enhance rehabilitation by improving patients' self-efficacy and increasing the amount and quality of patients' practice of physical exercise and activities of daily living. It consisted of a patient-held information workbook, a goal-setting diary and six additional therapy sessions.

MAIN OUTCOME MEASURES

The primary outcome measure was the Barthel Activities of Daily Living (BADL) index. The secondary outcome measures included the Nottingham Extended Activities of Daily Living (NEADL) scale, EuroQol-5 Dimensions, ICEpop CAPability measure for Older people, General Self-Efficacy Scale, Falls Efficacy Scale - International (FES-I), Self-Efficacy for Exercise scale, Hospital Anxiety and Depression Scale (HADS) and service use measures. Outcome measures were assessed at baseline and at 3-month follow-up by blinded researchers.

RESULTS

Sixty-two participants were recruited (23% of those who were eligible), 61 were randomised (control, n = 32; intervention, n = 29) and 49 (79%) were followed up at 3 months. Compared with the cohort study, a younger, healthier subpopulation was recruited. There were minimal differences in most outcomes between the two groups, including the BADL index, with an adjusted mean difference of 0.5 (Cohen's d = 0.29). The intervention group showed a medium-sized improvement on the NEADL scale relative to the control group, with an adjusted mean difference between groups of 3.0 (Cohen's d = 0.63). There was a trend for greater improvement in FES-I and HADS in the intervention group, but with small effect sizes, with an adjusted mean difference of 4.2 (Cohen's d = 0.31) and 1.3 (Cohen's d = 0.20), respectively. The cost of delivering the intervention was £231 per patient. There was a possible small relative increase in quality-adjusted life-years in the intervention group. No serious adverse events relating to the intervention were reported.

CONCLUSIONS

Trial methods were feasible in terms of eligibility, recruitment and retention, although recruitment was challenging. The NEADL scale was more responsive than the BADL index, suggesting that the intervention could enable participants to regain better levels of independence compared with usual care. This should be tested in a definitive Phase III RCT. There were two main limitations of the study: the feasibility study lacked power to test for differences between the groups and a ceiling effect was observed in the primary measure.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN22464643.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 21, No. 44. See the NIHR Journals Library for further project information.

From Linear to Complicated to Complex Comment on "Using Complexity and Network Concepts to Inform Healthcare Knowledge Translation"

Attention to collaborative approaches to encouraging evidence use in healthcare practice are gaining traction. The inherent complexities in collaborative and networked approaches to knowledge translation (KT) have been embraced by Kitson and colleagues in their complexity network model. In this commentary, the potential of complexity as presented by Kitson et al within their model is considered. The utility of such a model will be contingent upon how easy users find it to understand and apply to their challenge, and doing so in a way that is useful to not only help with explanation, but also with prediction.

Managing Faecal INcontinence in people with advanced dementia resident in Care Homes (FINCH) study: a realist synthesis of the evidence

BACKGROUND

Eighty per cent of care home residents in the UK are living with dementia. The prevalence of faecal incontinence (FI) in care homes is estimated to range from 30% to 50%. There is limited evidence of what is effective in the reduction and management of FI in care homes.

OBJECTIVE

To provide a theory-driven explanation of the effectiveness of programmes that aim to improve FI in people with advanced dementia in care homes.

DESIGN

A realist synthesis. This was an iterative approach that involved scoping of the literature and consultation with five stakeholder groups, a systematic search and analysis of published and unpublished evidence, and a validation of programme theories with relevant stakeholders.

DATA SOURCES

The databases searched included PubMed, Cumulative Index to Nursing and Allied Health Literature, The Cochrane Library, Scopus, SocAbs, Applied Social Sciences Index and Abstracts, BiblioMap, Sirius, OpenGrey, Social Care Online and the National Research Register.

RESULTS

The scoping identified six programme theories with related context-mechanism-outcome configurations for testing. These addressed (1) clinician-led support, assessment and review, (2) the contribution of teaching and support for care home staff on how to reduce and manage FI, (3) the causes and prevention of constipation, (4) how the cognitive and physical capacity of the resident affect outcomes, (5) how the potential for recovery, reduction and management of FI is understood by those involved and (6) how the care of people living with dementia and FI is integral to the work patterns of the care home and its staff. Data extraction was completed on 62 core papers with iterative searches of linked literature. Dementia was a known risk factor for FI, but its affect on the uptake of different interventions and the dementia-specific continence and toileting skills staff required was not addressed. Most care home residents with FI will be doubly incontinent and, therefore, there is limited value in focusing solely on FI or on single causes of FI such as constipation. Clinical assessment, knowledge of the causes of FI and strategies that recognise the individuals' preferences are necessary contextual factors. Valuing the intimate and personal care work that care home staff provide to people living with dementia and addressing the dementia-related challenges when providing continence care within the daily work routines are key to helping to reduce and manage FI in this population.

LIMITATIONS

The synthesis was constrained by limited evidence specific to FI and people with dementia in care homes and by the lack of dementia-specific evidence on continence aids.

CONCLUSIONS

This realist synthesis provides a theory-driven understanding of the conditions under which improvement in care for care home residents living with dementia and FI is likely to be successful.

FUTURE WORK

Future multicomponent interventions need to take account of how the presence of dementia affects the behaviours and choices of those delivering and receiving continence care within a care home environment.

STUDY REGISTRATION

This study is registered as PROSPERO CRD42014009902.

FUNDING

The National Institute for Health Research Health Technology Assessment programme.

Implementation and trial evidence: a plea for fore-thought

In a world where evidence-based practice is see as the foundation of modern healthcare, this paper asks when and how should we be accounting for the input of patients, the public, dental professionals, commissioners and policy-makers in the evidence generation process?

IMPlementation of A Relatives' Toolkit (IMPART study): an iterative case study to identify key factors impacting on the implementation of a web-based supported self-management intervention for relatives of people with psychosis or bipolar experiences in a National Health Service: a study protocol

BACKGROUND

Web-based interventions to support people to manage long-term health conditions are available and effective but rarely used in clinical services. The aim of this study is to identify critical factors impacting on the implementation of an online supported self-management intervention for relatives of people with recent onset psychosis or bipolar disorder into routine clinical care and to use this information to inform an implementation plan to facilitate widespread use and inform wider implementation of digital health interventions.

METHODS

A multiple case study design within six early intervention in psychosis (EIP) services in England, will be used to test and refine theory-driven hypotheses about factors impacting on implementation of the Relatives' Education And Coping Toolkit (REACT). Qualitative data including behavioural observation, document analysis, and in-depth interviews collected in the first two EIP services (wave 1) and analysed using framework analysis, combined with quantitative data describing levels of use by staff and relatives and impact on relatives' distress and wellbeing, will be used to identify factors impacting on implementation. Consultation via stakeholder workshops with staff and relatives and co-facilitated by relatives in the research team will inform development of an implementation plan to address these factors, which will be evaluated and refined in the four subsequent EIP services in waves 2 and 3. Transferability of the implementation plan to non-participating services will be explored.

DISCUSSION

Observation of implementation in a real world clinical setting, across carefully sampled services, in real time provides a unique opportunity to understand factors impacting on implementation likely to be generalizable to other web-based interventions, as well as informing further development of implementation theories. However, there are inherent challenges in investigating implementation without influencing the process under observation. We outline our strategies to ensure our design is transparent, flexible, and responsive to the timescales and activities happening within each service whilst also meeting the aims of the project.

TRIAL REGISTRATION

ISCTRN 16267685 (09/03/2016).

Development of an evidence-based complex intervention for community rehabilitation of patients with hip fracture using realist review, survey and focus groups

OBJECTIVES

To develop an evidence and theory-based complex intervention for improving outcomes in elderly patients following hip fracture.

DESIGN

Complex-intervention development (Medical Research Council (MRC) framework phase I) using realist literature review, surveys and focus groups of patients and rehabilitation teams.

SETTING

North Wales.

PARTICIPANTS

Surveys of therapy managers (n=13), community and hospital-based physiotherapists (n=129) and occupational therapists (n=68) throughout the UK. Focus groups with patients (n=13), their carers (n=4) and members of the multidisciplinary rehabilitation teams in North Wales (n=13).

RESULTS

The realist review provided understanding of how rehabilitation interventions work in the real-world context and three programme theories were developed: improving patient engagement by tailoring the intervention to individual needs; reducing fear of falling and improving self-efficacy to exercise and perform activities of daily living; and coordination of rehabilitation delivery. The survey provided context about usual rehabilitation practice; focus groups provided data on the experience, acceptability and feasibility of rehabilitation interventions. An intervention to enhance usual rehabilitation was developed to target these theory areas comprising: a physical component consisting of six additional therapy sessions; and a psychological component consisting of a workbook to enhance self-efficacy and a patient-held goal-setting diary for self-monitoring.

CONCLUSIONS

A realist approach may have advantages in the development of evidence-based interventions and can be used in conjunction with other established methods to contribute to the development of potentially more effective interventions. A rehabilitation intervention was developed which can be tested in a future randomised controlled trial (MRC framework phases II and III).

TRIAL REGISTRATION NUMBER

ISRCTN22464643, Pre-results.

Intervention Now to Eliminate Repeat Unintended Pregnancy in Teenagers (INTERUPT): a systematic review of intervention effectiveness and cost-effectiveness, and qualitative and realist synthesis of implementation factors and user engagement

BACKGROUND

Unintended repeat conceptions can result in emotional, psychological and educational harm to young women, often with enduring implications for their life chances. This study aimed to identify which young women are at the greatest risk of repeat unintended pregnancies; which interventions are effective and cost-effective; and what are the barriers to and facilitators for the uptake of these interventions.

METHODS

We conducted a mixed-methods systematic review which included meta-analysis, framework synthesis and application of realist principles, with stakeholder input and service user feedback to address this. We searched 20 electronic databases, including MEDLINE, Excerpta Medica database, Applied Social Sciences Index and Abstracts and Research Papers in Economics, to cover a broad range of health, social science, health economics and grey literature sources. Searches were conducted between May 2013 and June 2014 and updated in August 2015.

RESULTS

Twelve randomised controlled trials (RCTs), two quasi-RCTs, 10 qualitative studies and 53 other quantitative studies were identified. The RCTs evaluated psychosocial interventions and an emergency contraception programme. The primary outcome was repeat conception rate: the event rate was 132 of 308 (43%) in the intervention group versus 140 of 289 (48%) for the control group, with a non-significant risk ratio (RR) of 0.92 [95% confidence interval (CI) 0.78-1.08]. Four studies reported subsequent birth rates: 29 of 237 (12%) events for the intervention arm versus 46 out of 224 (21%) for the control arm, with an RR of 0.60 (95% CI 0.39-0.93). Many repeat conceptions occurred in the context of poverty, low expectations and aspirations and negligible opportunities. Qualitative and realist evidence highlighted the importance of context, motivation, future planning and giving young women a central and active role in the development of new interventions.

CONCLUSIONS

Little or no evidence for the effectiveness or cost-effectiveness of any of the interventions to reduce repeat pregnancy in young women was found. Qualitative and realist evidence helped to explain gaps in intervention design that should be addressed. More theory-based, rigorously evaluated programmes need to be developed to reduce unintended repeat pregnancy in young women.

TRIAL REGISTRATION

PROSPERO, CRD42012003168 . Cochrane registration number: i = fertility/0068.

What works for whom in the management of diabetes in people living with dementia: a realist review

BACKGROUND

Dementia and diabetes mellitus are common long-term conditions and co-exist in a large number of older people. People living with dementia (PLWD) may be less able to manage their diabetes, putting them at increased risk of complications such as hypoglycaemia. The aim of this review was to identify key mechanisms within different interventions that are likely to improve diabetes outcomes in PLWD.

METHODS

This is a realist review involving scoping of the literature and stakeholder interviews to develop theoretical explanations of how interventions might work, systematic searches of the evidence to test and develop the theories and their validation with a purposive sample of stakeholders. Twenty-six stakeholders - user/patient representatives, dementia care providers, clinicians specialising in diabetes or dementia and researchers - took part in interviews, and 24 participated in a consensus conference.

RESULTS

We included 89 papers. Ten focused on PLWD and diabetes, and the remainder related to people with either dementia, diabetes or other long-term conditions. We identified six context-mechanism-outcome configurations which provide an explanatory account of how interventions might work to improve the management of diabetes in PLWD. This includes embedding positive attitudes towards PLWD, person-centred approaches to care planning, developing skills to provide tailored and flexible care, regular contact, family engagement and usability of assistive devices. An overarching contingency emerged concerning the synergy between an intervention strategy, the dementia trajectory and social and environmental factors, especially family involvement.

CONCLUSIONS

Evidence highlighted the need for personalised care, continuity and family-centred approaches, although there was limited evidence that this happens routinely. This review suggests there is a need for a flexible service model that prioritises quality of life, independence and patient and carer priorities. Future research on the management of diabetes in older people with complex health needs, including those with dementia, needs to look at how organisational structures and workforce development can be better aligned to their needs.

TRIAL REGISTRATION

PROSPERO, CRD42015020625. Registered on 18 May 2015.

Prioritising Responses Of Nurses To deteriorating patient Observations (PRONTO) protocol: testing the effectiveness of a facilitation intervention in a pragmatic, cluster-randomised trial with an embedded process evaluation and cost analysis

BACKGROUND

Vital signs are the primary indicator of physiological status and for determining the need for urgent clinical treatment. Yet, if physiological signs of deterioration are missed, misinterpreted or mismanaged, then critical illness, unplanned intensive care admissions, cardiac arrest and death may ensue. Although evidence demonstrates the benefit of early recognition and management of deteriorating patients, failure to escalate care and manage deteriorating patients remains a relatively frequent occurrence in hospitals.

METHODS/DESIGN

A pragmatic cluster-randomised controlled trial design will be used to measure clinical effectiveness and cost of a facilitation intervention to improve nurses' vital sign measurement, interpretation, treatment and escalation of care for patients with abnormal vital signs. A cost consequence analysis will evaluate the intervention cost and effectiveness, and a process evaluation will determine how the implementation of the intervention contributes to outcomes. We will compare clinical outcomes and costs from standard implementation of clinical practice guidelines (CPGs) to facilitated implementation of CPGs. The primary outcome will be adherence to the CPGs by nurses, as measured by escalation of care as per organisational policy. The study will be conducted in four Australian major metropolitan teaching hospitals. In each hospital, eight to ten wards will be randomly allocated to intervention and control groups. Control wards will receive standard implementation of CPGs, while intervention wards will receive standard CPG implementation plus facilitation, using facilitation methods and processes tailored to the ward context. The intervention will be administered to all nursing staff at the ward level for 6 months. At each hospital, two types of facilitators will be provided: a hospital-level facilitator as the lead; and two ward-level facilitators for each ward.

DISCUSSION

This study uses an innovative, networked approach to facilitation to enable uptake of CPGs. Findings will inform the intervention utility and knowledge translation measurement approaches. If successful, the study methodology and intervention has potential for translation to other health care standards.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry (ANZCTR), ACTRN12616000544471p.

Standards for Reporting Implementation Studies (StaRI): explanation and elaboration document

OBJECTIVES

Implementation studies are often poorly reported and indexed, reducing their potential to inform the provision of healthcare services. The Standards for Reporting Implementation Studies (StaRI) initiative aims to develop guidelines for transparent and accurate reporting of implementation studies.

METHODS

An international working group developed the StaRI guideline informed by a systematic literature review and e-Delphi prioritisation exercise. Following a face-to-face meeting, the checklist was developed iteratively by email discussion and critical review by international experts.

RESULTS

The 27 items of the checklist are applicable to the broad range of study designs employed in implementation science. A key concept is the dual strands, represented as 2 columns in the checklist, describing, on the one hand, the implementation strategy and, on the other, the clinical, healthcare or public health intervention being implemented. This explanation and elaboration document details each of the items, explains the rationale and provides examples of good reporting practice.

CONCLUSIONS

Previously published reporting statements have been instrumental in improving reporting standards; adoption by journals and authors may achieve a similar improvement in the reporting of implementation strategies that will facilitate translation of effective interventions into routine practice.

Standards for Reporting Implementation Studies (StaRI) Statement

Implementation studies are often poorly reported and indexed, reducing their potential to inform initiatives to improve healthcare services. The Standards for Reporting Implementation Studies (StaRI) initiative aimed to develop guidelines for transparent and accurate reporting of implementation studies. Informed by the findings of a systematic review and a consensus-building e-Delphi exercise, an international working group of implementation science experts discussed and agreed the StaRI Checklist comprising 27 items. It prompts researchers to describe both the implementation strategy (techniques used to promote implementation of an underused evidence-based intervention) and the effectiveness of the intervention that was being implemented. An accompanying Explanation and Elaboration document (published in BMJ Open, doi:10.1136/bmjopen-2016-013318) details each of the items, explains the rationale, and provides examples of good reporting practice. Adoption of StaRI will improve the reporting of implementation studies, potentially facilitating translation of research into practice and improving the health of individuals and populations.

Accessibility and implementation in the UK NHS services of an effective depression relapse prevention programme: learning from mindfulness-based cognitive therapy through a mixed-methods study

Background

Depression affects as many as one in five people in their lifetime and often runs a recurrent lifetime course. Mindfulness-based cognitive therapy (MBCT) is an effective psychosocial approach that aims to help people at risk of depressive relapse to learn skills to stay well. However, there is an ‘implementation cliff’: access to those who could benefit from MBCT is variable and little is known about why that is the case, and how to promote sustainable implementation. As such, this study fills a gap in the literature about the implementation of MBCT.

Objectives

To describe the existing provision of MBCT in the UK NHS, develop an understanding of the perceived costs and benefits of MBCT implementation, and explore the barriers and critical success factors for enhanced accessibility. We aimed to synthesise the evidence from multiple data sources to create an explanatory framework of the how and why of implementation, and to co-develop an implementation resource with key stakeholders.

Design

A two-phase qualitative, exploratory and explanatory study, which was conceptually underpinned by the Promoting Action on Research Implementation in Health Services framework.

Setting

UK NHS services.

Methods

Phase 1 involved interviews with participants from 40 areas across the UK about the current provision of MBCT. Phase 2 involved 10 case studies purposively sampled with differing degrees of MBCT provision, and from each UK country. Case study methods included interviews with key stakeholders, including commissioners, managers, MBCT practitioners and teachers, and service users. Observations were conducted and key documents were also collected. Data were analysed using a modified approach to framework analysis. Emerging findings were verified through stakeholder discussions and workshops.

Results

Phase 1: access to and the format of MBCT provision across the NHS remains variable. NHS services have typically adapted MBCT to their context and its integration into care pathways was also highly variable even within the same trust or health board. Participants’ accounts revealed stories of implementation journeys that were driven by committed individuals that were sometimes met by management commitment. Phase 2: a number of explanations emerged that explained successful implementation. Critically, facilitation was the central role of the MBCT implementers, who were self-designated individuals who ‘championed’ implementation, created networks and over time mobilised top-down organisational support. Our explanatory framework mapped out a prototypical implementation journey, often over many years. This involved implementers working through grassroots initiatives and over time mobilising top-down organisational support, and a continual fitting of evidence, with the MBCT intervention, contextual factors and the training/supervision of MBCT teachers. Key pivot points in the journey provided windows of challenge or opportunity.

Limitations

The findings are largely based on informants’ accounts and, therefore, are at risk of the bias of self-reporting.

Conclusions

Although access to MBCT across the UK is improving, it remains very patchy. This study provides an explanatory framework that helps us understand what facilitates and supports sustainable MBCT implementation.

Future work

The framework and stakeholder workshops are being used to develop online implementation guidance.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

Intervention Now to Eliminate Repeat Unintended Pregnancy in Teenagers (INTERUPT): a systematic review of intervention effectiveness and cost-effectiveness, and qualitative and realist synthesis of implementation factors and user engagement

BACKGROUND

The UK has one of the highest rates of teenage pregnancies in Western Europe. One-fifth of these are repeat pregnancies. Unintended conceptions can cause substantial emotional, psychological and educational harm to teenagers, often with enduring implications for life chances. Babies of teenage mothers have increased mortality and are at a significantly increased risk of poverty, educational underachievement and unemployment later in life, with associated costs to society. It is important to identify effective, cost-effective and acceptable interventions.

OBJECTIVES

To identify who is at the greatest risk of repeat unintended pregnancies; which interventions are effective and cost-effective; and what the barriers to and facilitators of the uptake of these interventions are.

DATA SOURCES

We conducted a multistreamed, mixed-methods systematic review informed by service user and provider consultation to examine worldwide peer-reviewed evidence and UK-generated grey literature to find and evaluate interventions to reduce repeat unintended teenage pregnancies. We searched the following electronic databases: MEDLINE and MEDLINE In-Process & Other Non-Indexed Citations, PsycINFO, Cumulative Index to Nursing and Allied Health Literature, The Cochrane Library (Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects and the Health Technology Assessment Database), EMBASE (Excerpta Medica database), British Nursing Index, Educational Resources Information Center, Sociological Abstracts, Applied Social Sciences Index and Abstracts, BiblioMap (the Evidence for Policy and Practice Information and Co-ordinating Centre register of health promotion and public health research), Social Sciences Citation Index (supported by Web of Knowledge), Research Papers in Economics, EconLit (American Economic Association's electronic bibliography), OpenGrey, Scopus, Scirus, Social Care Online, National Research Register, National Institute for Health Research Clinical Research Network Portfolio and Index to THESES. Searches were conducted in May 2013 and updated in June 2014. In addition, we conducted a systematic search of Google (Google Inc., Mountain View, CA, USA) in January 2014. Database searches were guided by an advisory group of stakeholders.

REVIEW METHODS

To address the topic's complexities, we used a structured, innovative and iterative approach combining methods tailored to each evidence stream. Quantitative data (effectiveness, cost-effectiveness, risk factors and effect modifiers) were synthesised with reference to Cochrane guidelines for evaluating evidence on public health interventions. Qualitative evidence addressing facilitators of and barriers to the uptake of interventions, experience and acceptability of interventions was synthesised thematically. We applied the principles of realist synthesis to uncover theories and mechanisms underpinning interventions (what works, for whom and in what context). Finally, we conducted an overarching narrative of synthesis of evidence and gathered service user feedback.

RESULTS

We identified 8664 documents initially, and 816 in repeat searches. We filtered these to 12 randomised controlled trials (RCTs), four quasi-RCTs, 10 qualitative studies and 53 other quantitative studies published between 1996 and 2012. None of the RCTs was based in the UK. The RCTs evaluated an emergency contraception programme and psychosocial interventions. We found no evidence for effectiveness with regard to condom use, contraceptive use or rates of unprotected sex or use of birth control. Our primary outcome was repeat conception rate: the event rate was 132 of 308 (43%) in the intervention group versus 140 of 289 (48%) for the control goup, with a non-significant risk ratio (RR) of 0.92 [95% confidence interval (CI) 0.78 to 1.08]. Four studies reported subsequent birth rates: 29 of 237 (12%) events for the intervention arm versus 46 out of 224 (21%) for the control arm, with a RR of 0.60 (95% CI 0.39 to 0.93). Many repeat conceptions occurred in the context of poverty, low expectations and aspirations, and negligible opportunities. Service user feedback suggested that there were specific motivations for many repeat conceptions, for example to replace loss or to please a partner. Realist synthesis highlighted that context, motivation, planning for the future and letting young women take control with connectedness and tailoring provide a conceptual framework for future research.

LIMITATIONS

Included studies rarely characterised adolescent pregnancy as intended or unintended, that is interventions to reduce repeat conceptions rarely addressed whether or not pregnancies were intended. Furthermore, interventions were often not clearly defined, had multiple aims and did not indicate which elements were intended to address which aims. Nearly all of the studies were conducted in the USA and focused largely on African American or Hispanic and Latina American populations.

CONCLUSIONS

We found no evidence to indicate that existing interventions to reduce repeat teenage pregnancy were effective; however, subsequent births were reduced by home-based interventions. Qualitative and realist evidence helped to explain gaps in intervention design that should be addressed. More theory-based, rigorously evaluated programmes need to be developed to reduce repeat teenage pregnancy in the UK.

STUDY REGISTRATION

This study is registered as PROSPERO CRD42012003168. Cochrane registration number: i=fertility/0068.

FUNDING

The National Institute for Health Research Health Technology Assessment programme.

Process evaluations in neurological rehabilitation: a mixed-evidence systematic review and recommendations for future research

OBJECTIVE

To systematically review how process evaluations are currently designed, what methodologies are used and how are they developed alongside or within neurological rehabilitation trials.

METHODS

This mixed-methods systematic review had two evidence streams: stream I, studies reporting process evaluations alongside neurorehabilitation trials research and stream II, methodological guidance on process evaluation design and methodology. A search strategy was designed for each evidence stream. Data regarding process evaluation core concepts and design issues were extracted using a bespoke template. Evidence from both streams was analysed separately and then synthesised in a final overarching synthesis proposing a number of recommendations for future research.

RESULTS

A total of 124 process evaluation studies, reporting on 106 interventions, were included in stream I evidence. 30 studies were included as stream II evidence. Synthesis 1 produced 9 themes, and synthesis 2 identified a total of 8 recommendations for process evaluation research. The overall synthesis resulted in 57 'synthesis recommendations' about process evaluation methodology grouped into 9 research areas, including the use of theory, the investigation of context, intervention staff characteristics and the delivery of the trial intervention.

CONCLUSIONS

There remains no consensus regarding process evaluation terminology within the neurological rehabilitation field. There is a need for process evaluations to address the nature and influence of context over time. Process evaluations should clearly describe what intervention staff bring to a trial, including skills and experience prior to joining the research. Process evaluations should monitor intervention staff's learning effects and the possible impact that these may have on trial outcomes.

Reducing repeat pregnancies in adolescence: applying realist principles as part of a mixed-methods systematic review to explore what works, for whom, how and under what circumstances

BACKGROUND

Previous research has demonstrated emotional, psychological and educational harm to young mothers following unintended conceptions. The UK has one of the highest rates of pregnancies in adolescence in Western Europe with a high proportion of these being repeat pregnancies, making it a topic of interest for public health policy makers, and health and social care practitioners. As part of a wider mixed-methods systematic review, realist principles were applied to synthesise evidence about interventions aiming to reduce repeat pregnancies in adolescence.

METHODS

A multi-streamed, mixed-methods systematic review was conducted searching 11 major electronic databases and 9 additional databases from 1995 onwards, using key terms such as pregnancy, teen or adolescent. The principles of realist synthesis were applied to all included literature to uncover theories about what works, for whom, how and in what context. Initial theory areas were developed through evidence scoping, group discussion by the authors and stakeholder engagement to uncover context + mechanism = outcome (CMO) configurations and related narratives.

RESULTS

The searches identified 8,664 documents initially, and 403 in repeat searches, filtering to 81 included studies, including qualitative studies, randomised controlled trials, quantitative studies and grey literature. Three CMO configurations were developed. The individual experiences of young mothers' triggered self-efficacy, notions of perceived risks, susceptibility and benefits of pregnancy, resulting in the adolescent taking control of their fertility and sexual encounters. The choice between motherhood and other goals triggered notions of motivations, resulting in the adolescent managing their expectations of motherhood and controlling their fertility and sexual encounters. Barriers and facilitators to accessing services triggered notions of connectedness and self-determination; resulting in interventions that are tailored so they are relevant to young persons, and improve access to services and engagement with the issue of pregnancy in adolescence.

CONCLUSIONS

Pregnancy in adolescence is a complex issue with many factors to consider. The conceptual platform described here could help guide policy makers and professionals towards a number of areas that need to be attended to in order to increase the likelihood of an intervention working to prevent rapid repeat pregnancy in adolescence.

TRIAL REGISTRATION

PROSPERO CRD42012003168.

Managers' use of nursing workforce planning and deployment technologies: protocol for a realist synthesis of implementation and impact

INTRODUCTION

Nursing staffing levels in hospitals appear to be associated with improved patient outcomes. National guidance indicates that the triangulation of information from workforce planning and deployment technologies (WPTs; eg, the Safer Nursing Care Tool) and 'local knowledge' is important for managers to achieve appropriate staffing levels for better patient outcomes. Although WPTs provide managers with predictive information about future staffing requirements, ensuring patient safety and quality care also requires the consideration of information from other sources in real time. Yet little attention has been given to how to support managers to implement WPTs in practice. Given this lack of understanding, this evidence synthesis is designed to address the research question: managers' use of WPTs and their impacts on nurse staffing and patient care: what works, for whom, how and in what circumstances?

METHODS AND ANALYSIS

To explain how WPTs may work and in what contexts, we will conduct a realist evidence synthesis through sourcing relevant evidence, and consulting with stakeholders about the impacts of WPTs on health and relevant public service fields. The review will be in 4 phases over 18 months. Phase 1: we will construct an initial theoretical framework that provides plausible explanations of what works about WPTs. Phase 2: evidence retrieval, review and synthesis guided by the theoretical framework; phase 3: testing and refining of programme theories, to determine their relevance; phase 4: formulating actionable recommendations about how WPTs should be implemented in clinical practice.

ETHICS AND DISSEMINATION

Ethical approval has been gained from the study's institutional sponsors. Ethical review from the National Health Service (NHS) is not required; however research and development permissions will be obtained. Findings will be disseminated through stakeholder engagement and knowledge mobilisation activities. The synthesis will develop an explanatory programme theory of the implementation and impact of nursing WPTs, and practical guidance for nurse managers.

TRIAL REGISTRATION NUMBER

CRD42016038132.

Improving skills and care standards in the support workforce for older people: a realist synthesis of workforce development interventions

OBJECTIVES

This evidence review was conducted to understand how and why workforce development interventions can improve the skills and care standards of support workers in older people's services.

DESIGN

Following recognised realist synthesis principles, the review was completed by (1) development of an initial programme theory; (2) retrieval, review and synthesis of evidence relating to interventions designed to develop the support workforce; (3) 'testing out' the synthesis findings to refine the programme theories, and establish their practical relevance/potential for implementation through stakeholder interviews; and (4) forming actionable recommendations.

PARTICIPANTS

Stakeholders who represented services, commissioners and older people were involved in workshops in an advisory capacity, and 10 participants were interviewed during the theory refinement process.

RESULTS

Eight context-mechanism-outcome (CMO) configurations were identified which cumulatively comprise a new programme theory about 'what works' to support workforce development in older people's services. The CMOs indicate that the design and delivery of workforce development includes how to make it real to the work of those delivering support to older people; the individual support worker's personal starting points and expectations of the role; how to tap into support workers' motivations; the use of incentivisation; joining things up around workforce development; getting the right mix of people engaged in the design and delivery of workforce development programmes/interventions; taking a planned approach to workforce development, and the ways in which components of interventions reinforce one another, increasing the potential for impacts to embed and spread across organisations.

CONCLUSIONS

It is important to take a tailored approach to the design and delivery of workforce development that is mindful of the needs of older people, support workers, health and social care services and the employing organisations within which workforce development operates. Workforce development interventions need to balance the technical, professional and emotional aspects of care.

TRIAL REGISTRATION NUMBER

CRD42013006283.

The politics of the evidencebased practice movements

In the United Kingdom the election of the Labour government in 1997 signalled the arrival of evidence-based policy making based on a philosophy of ‘what counts is what works’. Mirroring the emphasis on evidence-based policy-making has been a concern about encouraging the use of evidence in practice. As an ideology it has penetrated the consciousness, discourse and working practices of professionals. However, despite the apparent engagement with evidence-based approaches to care, there remain a number of key areas that stimulate discussion and warrant debate. This discussion paper highlights some of these issues and considers their implications. Specifically, the political context of the evidence-based movements is considered and the resulting consequences outlined. These include issues about how nursing has signed up to evidence-based practice, the way in which evidence is conceptualised and the continuing gap between evidence and practice. Finally, a number of issues are presented that need to be tackled if there is a genuine desire to improve the evidence base and increase its influence on policy and practice.

Challenges, solutions and future directions in the evaluation of service innovations in health care and public health

Evaluating service innovations in health care and public health requires flexibility, collaboration and pragmatism; this collection identifies robust, innovative and mixed methods to inform such evaluations.