The Use of Vignettes to Improve the Validity of Qualitative Interviews for Realist Evaluation

Although realist evaluation (RE) requires multiple data collection methods, qualitative interviews are considered most valuable and are most frequently used. The guiding principles of RE may limit the emergence of new Context-Mechanism-Outcome (CMO) configurations by evoking particular underlying mechanisms. This paper proposes a new method for conducting semi-structured interviews in the RE context by drawing on the literature and examining the ability of vignettes to explore perceptions about specific situations. Vignettes are developed based on researchers' knowledge of the setting and program theory and are updated through an iterative process throughout data collection. Interviews focus on situations illustrated in the vignette to capture variations in interviewees' perceptions. This method constrains interviewees to using retroduction to identify the hidden underlying mechanisms that link contextual elements to outcomes based on their experiences. This method allows researchers to focus on CMO configurations without evoking mechanisms, which contributes to the rigor of the method.

Key elements and contextual factors that influence successful implementation of large-system transformation initiatives in the New Zealand health system: a realist evaluation

BACKGROUND

Despite three decades of policy initiatives to improve integration of health care, delivery of health care in New Zealand remains fragmented, and health inequities persist for Māori and other high priority populations. An evidence base is needed to increase the chances of success with implementation of large-system transformation (LST) initiatives in a complex adaptive system.

METHODS

This research aimed to identify key elements that support implementation of LST initiatives, and to investigate contextual factors that influence these initiatives. The realist logic of enquiry, nested within the macro framing of complex adaptive systems, formed the overall methodology for this research and involved five phases: theory gleaning from a local LST initiative, literature review, interviews, workshop, and online survey. NVivo software programme was used for thematic analysis of the interview, workshop, and the survey data. We identified key elements and explained variations in success (outcomes) by identifying mechanisms triggered by various contexts in which LST initiatives are implemented.

RESULTS

The research found that a set of 10 key elements need to be present in the New Zealand health system to increase chances of success with implementation of LST initiatives. These are: (i) an alliancing way of working; (ii) a commitment to te Tiriti o Waitangi; (iii) an understanding of equity; (iv) clinical leadership and involvement; (v) involved people, whānau, and community; (vi) intelligent commissioning; (vii) continuous improvement; (viii) integrated health information; (ix) analytic capability; and (x) dedicated resources and time. The research identified five contextual factors that influenced implementation of LST initiatives: a history of working together, distributed leadership from funders, the maturity of Alliances, capacity and capability for improvement, and a continuous improvement culture. The research found that the key mechanism of trust is built and nurtured over time through sharing of power by senior health leaders by practising distributed leadership, which then creates a positive history of working together and increases the maturity of Alliances.

DISCUSSION

Two authors (KMS and PBJ) led the development and implementation of the local LST initiative. This prior knowledge and experience provided a unique perspective to the research but also created a conflict of interest and introduced potential bias, these were managed through a wide range of data collection methods and informed consent from participants. The evidence-base for successful implementation of LST initiatives produced in this research contains knowledge and experience of senior system leaders who are often in charge of leading these initiatives. This evidence base enables decision makers to make sense of complex processes involved in the successful implementation of LST initiatives.

CONCLUSIONS

Use of informal trust-based networks provided a critical platform for successful implementation of LST initiatives in the New Zealand health system. Maturity of these networks relies on building and sustaining high-trust relationships among the network members. The role of local and central agencies and the government is to provide the policy settings and conditions in which trust-based networks can flourish.

OTHER

This study was approved by the Victoria University of Wellington Human Ethics Committee (Ethics Approval Number 27,356). The research was supported by the Victoria University of Wellington research grant (222,809) and from the University of Auckland Department of Medicine research fund (H10779).

Modified realist evaluation of a complex, multi-centred, multi-intervention programme

Well North was a complex, multi-intervention health improvement programme spanning 10 sites across the North of England. The aim was to address inequalities by improving the health of the poorest fastest, increasing resilience and reducing levels of worklessness. The intention of the programme was for all sites to have freedom and flexibility to conduct different interventions reflecting local priorities. Evaluation ran concurrently with the programme, and an iterative approach was required to ensure constant feedback, allowing the programme to be adapted and improved as necessary. Realist methodology was chosen for evaluation, as it provides insight into what works, for whom and in what circumstances. Due to the complex nature of the programme and diverse approaches, it was necessary to adapt the methodology to meet the needs of the evaluation. The Evaluation Team utilized a range of qualitative and quantitative techniques within the context of a Rapid Cycle Evaluation framework. For each project, Contexts, Mechanisms and Outcomes (CMOs) were identified at three stages and were incorporated into the CMO configuration, leading to the development of a middle range theory. Validation and testing of theory took place at every stage. Realist methodology was the most appropriate existing method. However, it still necessitated modification.

Audit and feedback to reduce unwarranted clinical variation at scale: a realist study of implementation strategy mechanisms

BACKGROUND

Unwarranted clinical variation in hospital care includes the underuse, overuse, or misuse of services. Audit and feedback is a common strategy to reduce unwarranted variation, but its effectiveness varies widely across contexts. We aimed to identify implementation strategies, mechanisms, and contextual circumstances contributing to the impact of audit and feedback on unwarranted clinical variation.

METHODS

Realist study examining a state-wide value-based healthcare program implemented between 2017 and 2021 in New South Wales, Australia. Three initiatives within the program included audit and feedback to reduce unwarranted variation in inpatient care for different conditions. Multiple data sources were used to formulate the initial audit and feedback program theory: a systematic review, realist review, program document review, and informal discussions with key program stakeholders. Semi-structured interviews were then conducted with 56 participants to refute, refine, or confirm the initial program theories. Data were analysed retroductively using a context-mechanism-outcome framework for 11 transcripts which were coded into the audit and feedback program theory. The program theory was validated with three expert panels: senior health leaders (n = 19), Agency for Clinical Innovation (n = 11), and Ministry of Health (n = 21) staff.

RESULTS

The program's audit and feedback implementation strategy operated through eight mechanistic processes. The strategy worked well when clinicians (1) felt ownership and buy-in, (2) could make sense of the information provided, (3) were motivated by social influence, and (4) accepted responsibility and accountability for proposed changes. The success of the strategy was constrained when the audit process led to (5) rationalising current practice instead of creating a learning opportunity, (6) perceptions of unfairness and concerns about data integrity, 7) development of improvement plans that were not followed, and (8) perceived intrusions on professional autonomy.

CONCLUSIONS

Audit and feedback strategies may help reduce unwarranted clinical variation in care where there is engagement between auditors and local clinicians, meaningful audit indicators, clear improvement plans, and respect for clinical expertise. We contribute theoretical development for audit and feedback by proposing a Model for Audit and Feedback Implementation at Scale. Recommendations include limiting the number of audit indicators, involving clinical staff and local leaders in feedback, and providing opportunities for reflection.

Knowledge and awareness of policies and programmes to reduce adolescent pregnancy in Ghana: a qualitative study among key stakeholders

INTRODUCTION

Adolescent sexual and reproductive health continues to be a major public health issue in low-and middle-income countries. While many countries have policies aimed at reducing adolescent pregnancy, evidence of their impact is unclear. This study sought to explore the knowledge and awareness of policies and programmes aimed at reducing adolescent pregnancy among health and education professionals and grassroot workers in Ghana.

METHODS

We employed a cross-sectional, qualitative study design involving semi-structured interviews with 30 key informants (health and education professionals and grassroot workers) in the Central Region of Ghana. We also conducted a desktop review of policies aimed at reducing adolescent pregnancy in Ghana. We used content analysis to analyse the data.

RESULTS

Eight of the 30 participants demonstrated awareness of policies aimed at reducing adolescent pregnancy but only two could elaborate on this. By contrast, 19 of the 30 participants were aware of relevant programmes and provided detailed description of their implementation and activities carried out under each programme. Despite participants' low policy awareness and knowledge, their descriptions of the activities carried out under each programme aligned with the strategies and activities of the policies mentioned, as evident from the desktop review of the policies.

CONCLUSION

Greater engagement of stakeholders in future policy development should increase policy awareness. Dissemination of policy content through community-based media channels and in local languages should promote and facilitate stakeholder engagement, which in turn should increase effective policy implementation with subsequent reduction of adolescent pregnancy.

Interventions to Increase Physical Activity in Community-Dwelling Older Adults in Regional and Rural Areas: A Realist Synthesis Review Protocol

The importance of physical activity (PA) for the health and wellbeing of older adults is well documented, yet many older adults are insufficiently active. This issue is more salient in regional and rural areas, where evidence of the most critical components of interventions that explain PA participation and maintenance in older populations is sparse. This realist review will (1) systematically identify and synthesise literature on PA interventions in community-dwelling older adults in regional and rural areas, and (2) explore how and why those interventions increase PA in that population. Using a realist synthesis framework and the behaviour change wheel (BCW), context-mechanism-outcome (C-M-O) patterns of PA interventions for older adults in regional and rural areas will be synthesised. Thematic analysis will be employed to compare, contrast, and refine emerging C-M-O patterns to understand how contextual factors trigger mechanisms that influence regional and rural community-dwelling older adults' participation in PA interventions. This realist review will be the first to adopt a BCW analysis and a realist synthesis framework to explore PA interventions in community-dwelling older adults in regional and rural areas. This review will provide recommendations for evidence-based interventions to improve PA participation and adherence by revealing the important mechanisms apparent in this context. Systematic review registration: (PROSPERO CRD42023402499).

A realist evaluation of a support and training program for family caregivers in the municipality of Envigado: A research protocol

AIMS

In Envigado, Colombia, the Secretariat of Health has implemented, since 2011, an interprofessional program involving nurses to support and train relatives to improve the quality of life of people with a loss of autonomy and their family caregivers. The objectives of this study are to assess the outcomes of this program and to explore the contextual elements and mechanisms that can explain these outcomes.

DESIGN

This article presents the research protocol for a realist evaluation that will be carried out to gather the perspectives of various local stakeholders involved.

METHODS

Four outcomes on family caregivers will be measured quantitatively using self-administered questionnaires and numerical scales. Contextual elements and mechanisms will then be explored qualitatively through focus groups and individual interviews. An iterative analysis will enable the refinement of a program theory.

RESULTS

The results will inform a program theory that underlies the outcomes of the family caregiver support and training program.

PATIENT OR PUBLIC CONTRIBUTION

Community stakeholders, family caregivers, people with a loss of autonomy and their relatives will be involved in data collection and/or in the validation of the program theory.

UK nurses' and midwives' experiences of healthful leadership practices during the COVID-19 pandemic: A rapid realist review

AIM

We aim to explore healthful leadership practices in nursing and midwifery evident within the COVID-19 pandemic in the United Kingdom, the contextual facilitators, barriers and outcomes.

BACKGROUND

Globally, the health and care sectors are under pressure and despite nurses and other professionals, demonstrating resilience and resourcefulness in the COVID-19 pandemic; this has negatively impacted on their health and wellbeing and on patient care.

EVALUATION

Two searches were conducted in July 2021 and December 2021. Inclusion/exclusion criteria were identified to refine the search, including papers written since the beginning of the pandemic in 2020. A total of 38 papers were included principally from the United States and United Kingdom. Ten were research papers; the others were commentaries, opinion pieces and editorials. MS Teams literature repository was created. A unique critical appraisal tool was devised to capture contexts, mechanisms and outcomes whilst reflecting more standardized tools, that is, the Critical Appraisal Skills Programme and the Authority, Accuracy, Coverage, Objectivity and Date tool for reviewing grey literature to refine the search further.

KEY ISSUES

Six tentative theories of healthful leadership emerged from the literature around leadership strategies, which are relational, being visible and present; being open and engaging; caring for self and others; embodying values; being prepared and preparing others; and using available information and support. Contextual factors that enable healthful leadership practices are in the main, created by leaders' values, attributes and style. The literature suggests that leaders who embody values of compassion, empathy, courage and authenticity create conditions for positive and healthful relations between leaders and others. Nurse and midwives' voices are however absent from the literature in this review.

CONCLUSION

Current available literature would suggest healthful leadership practices are not prioritized by nurse leaders. Perspectives of nurses' and midwives' about the impact of such practices on their wellbeing is also missing. Tentative theories are offered as a means of identifying healthful leadership strategies, the context that enable these and potential outcomes for nurses and midwives. These will be explored in phase two of this study.

IMPLICATIONS FOR NURSING MANAGEMENT

Nurse leaders must be adequately prepared to create working environments that support nurses' and midwives' wellbeing, so that they may be able to provide high-quality care. Ensuring a supportive organizational culture, which embodies the values of healthfulness, may help to mitigate the impact of the COVID-19 pandemic on nurses' and midwives' wellbeing in the immediate aftermath and going forward.

Barriers and facilitators regarding the implementation of policies and programmes aimed at reducing adolescent pregnancy in Ghana: an exploratory qualitative study

OBJECTIVES

This study explored the perceived barriers and facilitators regarding the implementation of policies and programmes aimed at reducing adolescent pregnancy among health and education professionals ('professionals'), grassroots workers and adolescent girls in Ghana.

DESIGN AND SETTING

We employed an exploratory qualitative study design involving interviews with professionals, grassroots workers and adolescent girls in the Central Region of Ghana.

PARTICIPANTS

This study involved 15 professionals employed in government or non-governmental organisations, 15 grassroots workers and 51 pregnant/parenting and non-pregnant adolescent girls.

DATA ANALYSIS

Thematic analysis was conducted deductively using the ecological framework for understanding effective implementation.

RESULTS

Eighteen themes mapped to the five domains of the ecological framework emerged. Perceived barriers included gender inequality, family poverty, stigma, community support for early childbearing and cohabitation, inadequate data systems, lack of collaboration between stakeholders and lack of political will. Effective implementation of community by-laws, youth involvement, use of available data, and collaboration and effective coordination between stakeholders were the perceived facilitators.

CONCLUSION

Political leaders and community members should be actively engaged in the implementation of adolescent sexual and reproductive health policies and programmes. Gender empowerment programmes such as education and training of adolescent girls should be implemented and strengthened at both the community and national levels. Community members should be sensitised on the negative effects of norms that support child marriage, gender-based violence and early childbearing.

Speaking COVID-19: supporting COVID-19 communication and engagement efforts with people from culturally and linguistically diverse communities

Background

Since the emergence of COVID-19, issues have been raised regarding the approach used to engage with Culturally and Linguistically Diverse (CaLD) communities during this public health crisis. This study aimed to understand the factors impacting communication and engagement efforts during the COVID-19 pandemic from the perspective of crucial CaLD community stakeholders and opinion leaders.

Methods

Forty-six semi-structured telephone interviews were undertaken with key stakeholders who have an active role (established before the pandemic) in delivering services and other social support to CaLD communities in Australia.

Results

Seven key themes emerged: (1) the digital divide and how to connect with people; (2) information voids being filled by international material; (3) Differentiating established with new and emerging communities’ needs; (4) speaking COVID-19; (5) ineffectiveness of direct translations of English language resources; (6) coordination is needed to avoid duplication and address gaps and (7) recognising the improvements in governments’ approach.

Conclusion

Alliances must be set up that can be activated in the future to reduce issues around resource development, translation, and dissemination of messages to minimise gaps in the response. Financial assistance must be provided in a timely way to community organisations to support the development and dissemination of culturally appropriate communication materials.

Sustainability of locally driven centres for those affected by dementia: a protocol for the get real with meeting centres realist evaluation

INTRODUCTION

Improving support for people with early to moderate dementia to live at home in their communities is a global public health goal. Community adult social care is not robust in many parts of the UK, however, with the pandemic increasing pressure on services for this population. Community-led interventions can play a key role in supporting people postdiagnosis, helping delay decline, but many interventions struggle to sustain beyond 1-2 years. Meeting Centres (MCs) are one such intervention, which many UK community groups find attractive and achievable. However, it is not understood how these communities can ensure they are putting in place strategies that will help them sustain in the longer term, beyond start-up phase.

METHODS AND ANALYSIS

This realist evaluation aims to understand the factors affecting sustainability of MCs in rural areas and learn lessons from MCs that have sustained beyond 3 years. Data will be collected using mixed methods: interviews and group discussions with stakeholders involved at every level in three case study locations in England and Wales, analysed with Soft Systems modelling; a Discrete Choice Experiment exploring what people across the UK value and are willing to pay for MCs, analysed with regression modelling. All data will be synthesised using a Realist logic of analysis to build a theoretical model of how, why, for whom, in what contexts and to what extent MCs can be successfully implemented for the long term.

ETHICS AND DISSEMINATION

As participants may lack capacity for informed consent, favourable ethical opinion was received from a Health Research Authority research ethics committee. Resulting recommendations will be of interest to stakeholders including those commissioning, planning, running, supporting or attending MCs, as well as policy-makers and healthcare professionals. Knowledge will be shared with emerging MCs to help accelerate scale up of this intervention.

The in-practice prevention programme: an example of flexible commissioning from Yorkshire and the Humber

Introduction An In-Practice Prevention (IPP) programme was developed by the Local Dental Network in the North Yorkshire and the Humber area in England in response to an oral health needs assessment. The underpinning logic model drew on a flexible commissioning approach and aimed to incentivise dental teams with NHS contracts to promote the delivery of prevention. This used care pathways that involved the whole dental team and was cost-neutral.Aim The programme was evaluated using realist methodology to identify 'what works, in which circumstances, how and for who?'.Design Realist evaluations are explanatory in nature and attempt to understand the factors that appear to influence the success (or not) of an intervention, rather than demonstrating causality.Methods and results Following a review of the pertinent literature, semi-structured interviews and focus groups, five theory areas were considered to be critical to the delivery of IPP. In order of stated priority, these were: 1) clinical leadership; 2) 'skill mix'; 3) financial incentives; 4) institutional logic/practice culture; and 5) behaviour change.Conclusion The results appear to show that clinically-led programmes could offer value to dental commissioners within a flexible commissioning model, although this would need to be further tested using an experiment design.

Developing New Methods for Person-Centred Approaches to Adjudicate Context-Mechanism-Outcome Configurations in Realist Evaluation

Realist evaluation provides a general method of evaluating the application of interventions including policy, legislation, projects, and new processes in social settings such as law enforcement, healthcare and education. Realist evaluation focuses on what about interventions works, for whom, and in what circumstances, and there is a growing body of work using realist evaluation to analyse interventions in healthcare organizations, including those using Lean Six Sigma improvement methodologies. Whilst realist evaluation facilitates the analysis of interventions using both qualitative and quantitative research, there is little guidance given on methods of data collection and analysis. The purpose of this study is to address this lack of guidance through detailing the use of innovative person-centred methods of data collection and analysis in a realist evaluation that enabled us to understand the contribution of Lean Six Sigma to person-centred care and cultures. This use of person-centred principles in the adjudication of identified program theories has informed novel methods of collecting and analysing data in realist evaluation that facilitate a person-centred approach to working with research participants and a way of making the implicit explicit when adjudicating program theory.

Missed nursing care and complexity theory: a conceptual paper

Background

Missed nursing care is a complex healthcare problem. Extant literature in this area identifies several interventions that can be used in acute hospital settings to minimise the impact of missed nursing care. However, controversy still exists as to the effectiveness of these interventions on reducing the occurrence of missed nursing care.

Aim

This theoretical paper aimed to provide a conceptual understanding of missed nursing care using complexity theory.

Methods

The method utilised for this paper is based on a literature review on missed care and complexity theory in healthcare.

Results

We found that the key virtues of complexity theory relevant to the missed nursing care phenomenon were adaptation and self-organisation, non-linear interactions and history. It is suggested that the complex adaptive systems approach may be more useful for nurse managers to inform and prepare nurses to meet uncertain encounters in their everyday clinical practice and therefore reduce instances of missed care.

Conclusions

This paper envisions that it is time that methods used to explore missed care changed. Strategies proposed in this paper may have an important impact on the ability of nursing staff to provide quality and innovative healthcare in the modern healthcare system.

Promoting physical activity and physical function in people with long-term conditions in primary care: the Function First realist synthesis with co-design

Background

As people age and accumulate long-term conditions, their physical activity and physical function declines, resulting in disability and loss of independence. Primary care is well placed to empower individuals and communities to reduce this decline; however, the best approach is uncertain.

Objectives

To develop a programme theory to explain the mechanisms through which interventions improve physical activity and physical function in people with long-term conditions in different primary care contexts, and to co-design a prototype intervention.

Data sources

Systematic literature searches of relevant databases with forwards and backwards citation tracking, grey literature searches and further purposive searches were conducted. Qualitative data were collected through workshops and interviews.

Design

Realist evidence synthesis and co-design for primary care service innovation.

Setting

Primary care in Wales and England.

Participants

Stakeholders included people with long-term conditions, primary care professionals, people working in relevant community roles and researchers.

Methods

The realist evidence synthesis combined evidence from varied sources of literature with the views, experiences and ideas of stakeholders. The resulting context, mechanism and outcome statements informed three co-design workshops and a knowledge mobilisation workshop for primary care service innovation.

Results

Five context, mechanism and outcome statements were developed. (1) Improving physical activity and function is not prioritised in primary care (context). If the practice team culture is aligned to the elements of physical literacy (mechanism), then physical activity promotion will become routine and embedded in usual care (outcome). (2) Physical activity promotion is inconsistent and unco-ordinated (context). If specific resources are allocated to physical activity promotion (in combination with a supportive practice culture) (mechanism), then this will improve opportunities to change behaviour (outcome). (3) People with long-term conditions have varying levels of physical function and physical activity, varying attitudes to physical activity and differing access to local resources that enable physical activity (context). If physical activity promotion is adapted to individual needs, preferences and local resources (mechanism), then this will facilitate a sustained improvement in physical activity (outcome). (4) Many primary care practice staff lack the knowledge and confidence to promote physical activity (context). If staff develop an improved sense of capability through education and training (mechanism), then they will increase their engagement with physical activity promotion (outcome). (5) If a programme is credible with patients and professionals (context), then trust and confidence in the programme will develop (mechanism) and more patients and professionals will engage with the programme (outcome). A prototype multicomponent intervention was developed. This consisted of resources to nurture a culture of physical literacy, materials to develop the role of a credible professional who can promote physical activity using a directory of local opportunities and resources to assist with individual behaviour change.

Limitations

Realist synthesis and co-design is about what works in which contexts, so these resources and practice implications will need to be modified for different primary care contexts.

Conclusions

We developed a programme theory to explain how physical activity could be promoted in primary care in people with long-term conditions, which informed a prototype intervention.

Future work

A future research programme could further develop the prototype multicomponent intervention and assess its acceptability in practice alongside existing schemes before it is tested in a feasibility study to inform a future randomised controlled trial.

Study registration

This study is registered as PROSPERO CRD42018103027.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 9, No. 16. See the NIHR Journals Library website for further project information.

Combining Realist approaches and Normalization Process Theory to understand implementation: a systematic review

BACKGROUND

Realist approaches and Normalization Process Theory (NPT) have both gained significant traction in implementation research over the past 10 years. The aim of this study was therefore to explore how the approaches are combined to understand problems of implementation, to determine the degree of complementarity of the two approaches and to provide practical approaches for using them together.

METHODS

Systematic review of research studies combining Realist and NPT approaches. Realist methodology is concerned with understanding and explaining causation, that is, how and why policies, programmes and interventions achieve their effects. NPT is a theory of implementation that explains how practices become normalised. Databases searched (January 2020) were ASSIA, CINAHL, Health Research Premium Collection via Proquest (Family Health Database, Health & Medical Collection, Health Management Database, MEDLINE, Nursing & Allied Health Database, Psychology Database, Public Health Database) and PsycARTICLES. Studies were included if the author(s) stated they used both approaches: a scientific Realist perspective applying the principles of Pawson and Tilley's Realist Evaluation or Pawson's Realist Synthesis and Normalization Process Theory either solely or in addition to other theories. Two authors screened records; discrepancies were reviewed by a third screener. Data was extracted by three members of the team and a narrative synthesis was undertaken.

RESULTS

Of 245 total records identified, 223 unique records were screened and 39 full-text papers were reviewed, identifying twelve papers for inclusion in the review. These papers represented eight different studies. Extent and methods of integration of the approaches varied. In most studies (6/8), Realist approaches were the main driver. NPT was mostly used to enhance the explanatory power of Realist analyses, informing development of elements of Contexts, Mechanisms and Outcomes (a common heuristic in realist work). Authors' reflections on the integration of NPT and Realist approaches were limited.

CONCLUSIONS

Using Realist and NPT approaches in combination can add explanatory power for understanding the implementation of interventions and programmes. Attention to detailed reporting on methods and analytical process when combining approaches, and appraisal of theoretical and practical utility is advised for advancing knowledge of applying these approaches in research.

SYSTEMATIC REVIEW REGISTRATION

Not registered.

Realist Process Evaluation of the implementation and impact of an organisational cultural transformation programme in the Children and Young People's Secure Estate (CYPSE) in England: study protocol

INTRODUCTION

Young people in contact with the youth justice system are more likely to present with complex ongoing needs than young people in the general population. To address this, the Framework for Integrated Care (SECURE STAIRS) is being implemented in the Children and Young People's Secure Estate: a 'whole systems' approach to support secure settings to develop trauma-informed and relationally based environments, supporting staff to provide consistent, therapeutic care. This paper aims to present the protocol for a national cohort study examining the impact and implementation of this cultural transformation programme.

METHODS AND ANALYSIS

A mixed-methods realist evaluation will be conducted. Data collection will take place between August 2018 and December 2020. Eighteen sites will collect routine service activity data and questionnaires completed by young people, parents/guardians and staff. Semi-structured interviews and non-participant observations will be conducted across five qualitative focus sites with young people and staff. An economic evaluation will examine value for money. The results will be triangulated at the analysis stage to gain an in-depth understanding of experiences.

ETHICS AND DISSEMINATION

Ethical approval was granted by the Health Research Authority, Her Majesty's Prison and Probation Service and UCL Ethics Committee. Findings will be disseminated via project reports, site feedback, peer-reviewed journal publications and conference presentations.

Organizational supports for knowledge translation in paediatric health centres and research institutes: insights from a Canadian environmental scan

BACKGROUND

Organizational supports are thought to help address wide-ranging barriers to evidence-informed health care (EIHC) and knowledge translation (KT). However, little is known about the nature of the resources and services that exist within paediatric health care and research settings across Canada to facilitate evidence use in health care delivery. This survey examined existing supports for EIHC/KT within these organizations to inform the design of similar EIHC/KT support programmes.

METHODS

A national environmental scan was conducted using a bilingual online survey distributed to leaders at Canadian paediatric academic health science centres and their affiliated research institutes. Participants were invited through email, social media and webinar invitations and snowball sampling. Supports of interest included personnel, resources, services, organizational structures or processes, and partnerships or collaborations; barriers and successes were also probed. Data were compiled by site, reported using descriptive statistics, or grouped thematically. Supports were described using the AIMD (Aims, Ingredients, Mechanism, Delivery) framework.

RESULTS

Thirty-one respondents from 17 sites across seven provinces represented a 49% site response rate. Eleven (65%) sites reported an on-site library with variable staffing and services. Ten (59%) sites reported a dedicated KT support unit or staff person. Supports ranged from education, resource development and consultation to protocol development, funded initiatives and collaborations. Organizations leveraged internal and external supports, with the majority also employing supports for clinical research integration. Supports perceived as most effective included personnel, targeted initiatives, leadership, interdepartmental expertise, external drivers and logistical support. Barriers included operational constraints, individual-level factors and lack of infrastructure.

CONCLUSIONS

This first survey of organizational supports for EIHC/KT identified the range of supports in place in paediatric research and health care organizations across Canada. The diversity of supports reported across sites may reflect differences in resource capacity and objectives. Similarities in EIHC/KT and research integration supports suggest common infrastructure may be feasible. Moreover, stakeholder engagement in research was common, but not pervasive. Tailored support programmes can target multi-faceted barriers. Findings can inform the development, refinement and evaluation of EIHC/KT support programmes and guide the study of the effectiveness and sustainability of these strategies.

How and why does Local Area Coordination work for people in different contexts?

The increasing adoption of Local Area Coordination across the United Kingdom as a strengths-based approach to acting on inequalities which impact on individual health and well-being, and reducing reliance and avoidable use of health and social care services, has catalysed increasing calls for evidence to justify economic commitment. In a time of austerity where extreme pressure is on resources to prove short-term outputs, Pawson and Tilley’s realist evaluation methodology holds significant promise in asking critical questions of how and why programmes work. Ultimately, such philosophical standpoints facilitate opportunities to examine whether the sustainability of programmes are cost-effective for the system in the longer term. This article draws upon the findings of a realist evaluation of Local Area Coordination on the Isle of Wight and establishes how and why the programme works for people and local communities. A blend of realist approaches, Q-method and realist interviews were adopted within this study. The study’s sample was a cross section of 18 people who engaged with the Local Area Coordination programme across the Isle of Wight. The findings of the evaluation established that the Local Area Coordinators’ ability to facilitate a ‘golden triangle’ of listening, trust and time were factors which made Local Area Coordination work. It was also clear that Local Area Coordination worked for different people in different ways, demonstrated through the contextual differences between three subgroups who were categorised based on shared viewpoints, and presented through the holistic narratives and corroborating interview data.

Identifying Best Implementation Practices for Smoking Cessation in Complex Cancer Settings

Background: In response to evidence about the health benefits of smoking cessation at time of cancer diagnosis, Ontario Health (Cancer Care Ontario) (OH-CCO) instructed Regional Cancer Centres (RCC) to implement smoking cessation interventions (SCI). RCCs were given flexibility to implement SCIs according to their context but were required to screen new patients for tobacco status, advise patients about the importance of quitting, and refer patients to cessation supports. The purpose of this evaluation was to identify practices that influenced successful implementation across RCCs. Methods: A realist evaluation approach was employed. Realist evaluations examine how underlying processes of an intervention (mechanisms) in specific settings (contexts) interact to produce results (outcomes). A realist evaluation may thus help to generate an understanding of what may or may not work across contexts. Results: The RCCs with the highest Tobacco Screening Rates used a centralized system. Regarding the process for advising and referring, three RCCs offered robust smoking cessation training, resulting in advice and referral rates between 80% and 100%. Five RCCs surpassed the target for Accepted Referral Rates; acceptance rates for internal referral were highest overall. Conclusion: Findings highlight factors that may influence successful SCI implementation.

Brief smoking cessation in acute Welsh hospitals: a realist approach

This implementation study sought to determine what works to support brief smoking cessation (BSC) in acute hospital settings, through exploration of organizational delivery and the role of healthcare professionals (HCPs). We used a realist approach, with embedded stakeholder engagement, within a large health organization. We conducted interviews (n = 27), a survey (n = 279) and organization documentation review (n = 44). The final programme theory suggests HCPs implement BSC when they value it as part of their role in contributing to improved patient outcomes; this is due to personal and professional influences, such as knowledge or experience. Organizational support, training and working in an environment where BSC is visible as standard care, positively influences implementation. However, the context exerts a strong influence on whether BSC is implemented, or not. HCPs make nuanced judgements on whether to implement BSC based on their assessment of the patient's responses, the patient's condition and other acute care demands. HCPs are less likely to implement BSC in dynamic and uncertain environments, as they are concerned about adversely impacting on the clinician-patient relationship and prioritize other acute care requirements. Organizations should actively promote BSC as a core function of the acute hospital setting and improve professional practice through leadership, training, feedback and visible indicators of organizational commitment. HCPs can be persuaded that implementing BSC is an acute care priority and an expectation of standard practice for improving patient outcomes.

The delivery of compassionate nursing care in a tick-box culture: Qualitative perspectives from a realist evaluation of intentional rounding

Background

Compassion is integral to professional nursing practice worldwide and a fundamental value in healthcare. Following serious care failures at a healthcare provider in the United Kingdom, a government commissioned report (the Francis Report) made several recommendations for strengthening compassion in nursing care and consequently ‘intentional rounding’ was incorporated into nursing practice in the United Kingdom. Intentional rounding is a structured process implemented primarily in the United Kingdom, North America and Australia, whereby nurses conduct 1–2 hourly checks on every patient using a standardised protocol and documentation.

Objectives

To examine the role of intentional rounding in the delivery of compassionate nursing care in England from multiple perspectives.

Methods

This paper reports qualitative findings from one phase of a realist evaluation of intentional rounding which used a mixed-methods approach. Individual, semi-structured interviews were undertaken with 33 nursing staff, 17 senior nurse managers, 34 patients and 28 family carers from three geographically spread case study hospital sites in England. Interviews elicited detailed reflections on the contexts, mechanisms and outcomes of intentional rounding and how it impacted the interviewee and those around them.

Results

This study found little evidence that intentional rounding ensures the comfort, safety or dignity of patients or increases the delivery of compassionate care. The systematised approach of intentional rounding emphasises transactional care delivery in the utilisation of prescribed methods of recording or tick boxes rather than relational, individualised patient care. It has the potential to reduce the scope of nursing care to a minimum standard, leading to a focus on the fundamentals as well as the prevention of adverse events. Its documentation is primarily valued by nursing staff as a means of protecting themselves through written proof or ‘evidence’ of care delivered, rather than as a means of increasing compassionate care.

Conclusions

This large-scale, theoretically-driven study of intentional rounding – the first of its kind – demonstrates that intentional rounding prioritises data collection through tick boxes or a prescriptive and structured recording of care. Thus, intentional rounding neither improves the delivery of compassionate nursing care nor addresses the policy imperative it was intended to target. This study raises questions about the role, contribution and outcomes from intentional rounding and suggests a need for a wider, international debate within the nursing profession about its future use. If an intervention to increase compassionate nursing care is required, it may be better to start afresh, rather than attempting to adapt the system currently implemented.

'Function First-Be Active, Stay Independent'-promoting physical activity and physical function in people with long-term conditions by primary care: a protocol for a realist synthesis with embedded co-production and co-design

INTRODUCTION

People with long-term conditions typically have reduced physical functioning, are less physically active and therefore become less able to live independently and do the things they enjoy. However, assessment and promotion of physical function and physical activity is not part of routine management in primary care. This project aims to develop evidence-based recommendations about how primary care can best help people to become more physically active in order to maintain and improve their physical function, thus promoting independence.

METHODS AND ANALYSIS

This study takes a realist synthesis approach, following RAMESES guidance, with embedded co-production and co-design. Stage 1 will develop initial programme theories about physical activity and physical function for people with long-term conditions, based on a review of the scientific and grey literature, and two multisector stakeholder workshops using LEGO® SERIOUS PLAY®. Stage 2 will involve focused literature searching, data extraction and synthesis to provide evidence to support or refute the initial programme theories. Searches for evidence will focus on physical activity interventions involving the assessment of physical function which are relevant to primary care. We will describe 'what works', 'for whom' and 'in what circumstances' and develop conjectured programme theories using context, mechanism and outcome configurations. Stage 3 will test and refine these theories through individual stakeholder interviews. The resulting theory-driven recommendations will feed into Stage 4 which will involve three sequential co-design stakeholder workshops in which practical ideas for service innovation in primary care will be developed.

ETHICS AND DISSEMINATION

Healthcare and Medical Sciences Academic Ethics Committee (Reference 2018-16308) and NHS Wales Research Ethics Committee 5 approval (References 256 729 and 262726) have been obtained. A knowledge mobilisation event will address issues relevant to wider implementation of the intervention and study findings. Findings will be disseminated through peer-reviewed journal publications, conference presentations and formal and informal reports.

PROSPERO REGISTRATION NUMBER

CRD42018103027.

Adaptations and patient responses to behavioral intervention components in a depression-focused chronic disease care model implemented in India

Integrated care models offer one approach to treat patients with chronic multimorbidity. However, because these models consist of multiple components designed to provide individualized care, they should be adapted to best meet the needs of patients in diverse settings. This paper presents qualitative and quantitative data from a realist process evaluation embedded in the INtegrating DEPrEssioN and Diabetes treatmENT (INDEPENDENT) study to uncover what worked, for whom, how, and in what circumstances. We aimed to examine adaptations made to a care coordinator-led behavioral intervention, and how patients responded to adaptations, through a secondary analysis of these data. A purposive sample of 62 patients and 3 care coordinators were recruited based on their involvement with the INDEPENDENT care model across two clinics. Patients were interviewed and surveyed about their experiences in the care model and care coordinators were interviewed about their experiences implementing intervention components. Interview data were coded for reported modifications in intervention content, tools, and delivery; then, these adaptations were categorized by how they served to enhance implementation in the Indian context. Adaptations made in the delivery of this care model served two functions: (a) to improve health promotion communication between care coordinators and patients and (b) to improve patient engagement. Patients' expressed needs were consistent with what care coordinators perceived. Patients were satisfied with adaptations designed to improve intervention fit for local contexts. Study findings demonstrate that adapting components of an integrated care model can enhance patient satisfaction and engagement with behavioral interventions.

Enhancing Mentoring in Palliative Care: An Evidence Based Mentoring Framework

BACKGROUND

Growing concerns over ethical issues in mentoring in medicine and surgery have hindered efforts to reinitiate mentoring for Palliative Care (PC) physicians following the easing of COVID-19 restrictions. Ranging from the misappropriation of mentee's work to bullying, ethical issues in mentoring are attributed to poor understanding and structuring of mentoring programs, underlining the need for a consistent approach to mentoring practices.

METHODS

Given diverse practices across different settings and the employ of various methodologies, a novel approach to narrative reviews (NR)s is proposed to summarize, interpret, and critique prevailing data on novice mentoring. To overcome prevailing concerns surrounding the reproducibility and transparency of narrative reviews, the Systematic Evidenced Based Approach (SEBA) adopts a structured approach to searching and summarizing the included articles and employed concurrent content and thematic analysis that was overseen by a team of experts.

RESULTS

A total of 18 915 abstracts were reviewed, 62 full text articles evaluated and 41 articles included. Ten themes/categories were ascertained identified including Nature; Stakeholders; Relationship; Approach; Environment; Benefits; Barriers; Assessments; Theories and Definitions.

CONCLUSION

By compiling and scrutinizing prevailing practice it is possible to appreciate the notion of the mentoring ecosystem which sees each mentee, mentor, and host organization brings with them their own microenvironment that contains their respective goals, abilities, and contextual considerations. Built around competency based mentoring stages, it is possible to advance a flexible yet consistent novice mentoring framework.

Intentional rounding in hospital wards to improve regular interaction and engagement between nurses and patients: a realist evaluation

© Crown copyright 2013. Contains public sector information licensed under the Open Government Licence v3.0© Queen’s Printer and Controller of HMSO 2019. This work was produced by Harriset al.under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care. This issue may be freely reproduced for the purposes of private research and study and extracts (or indeed, the full report) may be included in professional journals provided that suitable acknowledgement is made and the reproduction is not associated with any form of advertising. Applications for commercial reproduction should be addressed to: NIHR Journals Library, National Institute for Health Research, Evaluation, Trials and Studies Coordinating Centre, Alpha House, University of Southampton Science Park, Southampton SO16 7NS, UK.20132019Crown copyrightQueen’s Printer and Controller of HMSO

Background

The government response to the care failures at the Mid Staffordshire NHS Foundation Trust led to the policy imperative of ‘regular interaction and engagement between nurses and patients’ (Francis R.Report of the Mid Staffordshire NHS Foundation Trust Public Inquiry. London: The Stationery Office; 2013. © Crown copyright 2013. Contains public sector information licensed under the Open Government Licence v3.0) in the NHS. The pressure on nursing to act resulted in the introduction of the US model, known as ‘intentional rounding’, into nursing practice. This is a timed, planned intervention that sets out to address fundamental elements of nursing care by means of a regular bedside ward round.

Objectives

The study aims were to examine what it is about intentional rounding in hospital wards that works, for whom and in what circumstances.

Design

A multimethod study design was undertaken using realist evaluation methodology. The study was conducted in four phases: (1) theory development; (2) a national survey of all NHS acute trusts in England; (3) in-depth case studies of six wards, involving individual interviews, observations, retrieval of routinely collected ward outcome data and analysis of costs; and (4) synthesis of the study findings.

Setting

The study was conducted in acute NHS trusts in England.

Participants

A total of 108 acute NHS trusts participated in the survey. Seventeen senior managers, 33 front-line nurses, 28 non-nursing professionals, 34 patients and 28 carers participated in individual interviews. Thirty-nine members of nursing staff were shadowed during their delivery of intentional rounding and the direct care received by 28 patients was observed.

Review methods

A realist synthesis was undertaken to identify eight context–mechanism–outcome configurations, which were tested and refined using evidence collected in subsequent research phases.

Results

The national survey showed that 97% of NHS trusts had implemented intentional rounding in some way. Data synthesis from survey, observation and interview findings showed that only two of the original eight mechanisms were partially activated (consistency and comprehensiveness, and accountability). The evidence for two mechanisms was inconclusive (visibility of nurses and anticipation); there was minimal evidence for one mechanism (multidisciplinary teamwork and communication) and no evidence for the remaining three (allocated time to care, nurse–patient relationships and communication, and patient empowerment). A total of 240 intentional rounds were observed within 188 hours of care delivery observation. Although 86% of all intentional rounding interactions were observed to be documented, fidelity to the original intervention [i.e. the Studer Group protocol (Studer Group.Best Practices: Sacred Heart Hospital, Pensacola, Florida. Hourly Rounding Supplement. Gulf Breeze, FL: Studer Group; 2007)] was generally low.

Limitations

Intentional rounding was often difficult for researchers to observe, as it was rarely delivered as a discrete activity but instead undertaken alongside other nursing activities. Furthermore, a lack of findings about the influence of intentional rounding on patient outcomes in the safety thermometer data limits inferences on how mechanisms link to clinical outcomes for patients.

Conclusions

The evidence from this study demonstrates that the effectiveness of intentional rounding, as currently implemented and adapted in England, is very weak and falls short of the theoretically informed mechanisms. There was ambivalence and concern expressed that intentional rounding oversimplifies nursing, privileges a transactional and prescriptive approach over relational nursing care, and prioritises accountability and risk management above individual responsive care.

Future work

It is suggested that the insights and messages from this study inform a national conversation about whether or not intentional rounding is the optimum intervention to support the delivery of fundamental nursing care to patients, or if the time is right to shape alternative solutions.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

Realist synthesis of intentional rounding in hospital wards: exploring the evidence of what works, for whom, in what circumstances and why

BACKGROUND

Intentional rounding (IR) is a structured process whereby nurses conduct one to two hourly checks with every patient using a standardised protocol.

OBJECTIVE

A realist synthesis of the evidence on IR was undertaken to develop IR programme theories of what works, for whom, in what circumstances and why.

METHODS

A three-stage literature search and a stakeholder consultation event was completed. A variety of sources were searched, including AMED, CINAHL, MEDLINE, PsycINFO, HMIC, Google and Google Scholar, for published and unpublished literature. In line with realist synthesis methodology, each study's 'fitness for purpose' was assessed by considering its relevance and rigour.

RESULTS

A total of 44 papers met the inclusion criteria. To make the programme theories underpinning IR explicit, we identified eight a priori propositions: (1) when implemented in a comprehensive and consistent way, IR improves healthcare quality and satisfaction, and reduces potential harms; (2) embedding IR into daily routine practice gives nurses 'allocated time to care'; (3) documenting IR checks increases accountability and raises fundamental standards of care; (4) when workload and staffing levels permit, more frequent nurse-patient contact improves relationships and increases awareness of patient comfort and safety needs; (5) increasing time when nurses are in the direct vicinity of patients promotes vigilance, provides reassurance and reduces potential harms; (6) more frequent nurse-patient contact enables nurses to anticipate patient needs and take pre-emptive action; (7) IR documentation facilitates teamwork and communication; and (8) IR empowers patients to ask for what they need to maintain their comfort and well-being. Given the limited evidence base, further research is needed to test and further refine these propositions.

CONCLUSIONS

Despite widespread use of IR, this paper highlights the paradox that there is ambiguity surrounding its purpose and limited evidence of how it works in practice.

Project SoL-A Community-Based, Multi-Component Health Promotion Intervention to Improve Healthy Eating and Physical Activity Practices among Danish Families with Young Children Part 2: Evaluation

Project SoL is implemented over a period of four years with the aim to promote healthy eating and physical activity among children aged 3⁻8 years by targeting the families in a Danish municipality based on the multi-component, supersetting strategy. Interventions are implemented in childcare centres, schools and supermarkets in three local communities as well as in local mass media and social media during a 19 months period in the Municipality of Bornholm. The matching Municipality of Odsherred serves as a control site based on its similarity to Bornholm regarding several socio-demographic and health indicators. The present paper gives an account of the design used for the summative and formative evaluation based on a realistic evaluation and a mixed methods approach combining qualitative and quantitative methods. Summative studies are conducted on changes of health behaviours among the involved families and within the municipalities in general, changes in community awareness of the project, changes in purchase patterns, changes in overweight and obesity among the targeted children and changes in knowledge and preferences among children due to sensory education workshops. The formative research comprises studies on children's perceptions of health, perceptions of staff at supermarkets and media professionals on their roles in supporting the health promotion agenda, and motivations and barriers of community stakeholders to engage in health promotion at community level. The paper discusses operational issues and lessons learnt related to studying complex community interventions, cross-disciplinarily, interfaces between practice and research and research capacity strengthening; and suggests areas for future research. The development and implementation of the intervention and its theoretical foundation is described in a separate paper.

The international knowledge base for new care models relevant to primary care-led integrated models: a realist synthesis

Background

The Multispecialty Community Provider (MCP) model was introduced to the NHS as a primary care-led, community-based integrated care model to provide better quality, experience and value for local populations.

Objectives

The three main objectives were to (1) articulate the underlying programme theories for the MCP model of care; (2) identify sources of theoretical, empirical and practice evidence to test the programme theories; and (3) explain how mechanisms used in different contexts contribute to outcomes and process variables.

Design

There were three main phases: (1) identification of programme theories from logic models of MCP vanguards, prioritising key theories for investigation; (2) appraisal, extraction and analysis of evidence against a best-fit framework; and (3) realist reviews of prioritised theory components and maps of remaining theory components.

Main outcome measures

The quadruple aim outcomes addressed population health, cost-effectiveness, patient experience and staff experience.

Data sources

Searches of electronic databases with forward- and backward-citation tracking, identifying research-based evidence and practice-derived evidence.

Review methods

A realist synthesis was used to identify, test and refine the following programme theory components: (1) community-based, co-ordinated care is more accessible; (2) place-based contracting and payment systems incentivise shared accountability; and (3) fostering relational behaviours builds resilience within communities.

Results

Delivery of a MCP model requires professional and service user engagement, which is dependent on building trust and empowerment. These are generated if values and incentives for new ways of working are aligned and there are opportunities for training and development. Together, these can facilitate accountability at the individual, community and system levels. The evidence base relating to these theory components was, for the most part, limited by initiatives that are relatively new or not formally evaluated. Support for the programme theory components varies, with moderate support for enhanced primary care and community involvement in care, and relatively weak support for new contracting models.

Strengths and limitations

The project benefited from a close relationship with national and local MCP leads, reflecting the value of the proximity of the research team to decision-makers. Our use of logic models to identify theories of change could present a relatively static position for what is a dynamic programme of change.

Conclusions

Multispecialty Community Providers can be described as complex adaptive systems (CASs) and, as such, connectivity, feedback loops, system learning and adaptation of CASs play a critical role in their design. Implementation can be further reinforced by paying attention to contextual factors that influence behaviour change, in order to support more integrated working.

Future work

A set of evidence-derived ‘key ingredients’ has been compiled to inform the design and delivery of future iterations of population health-based models of care. Suggested priorities for future research include the impact of enhanced primary care on the workforce, the effects of longer-term contracts on sustainability and capacity, the conditions needed for successful continuous improvement and learning, the role of carers in patient empowerment and how community participation might contribute to community resilience.

Study registration

This study is registered as PROSPERO CRD42016039552.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

How embedded is public involvement in mainstream health research in England a decade after policy implementation? A realist evaluation

Objectives To explore how embedded patient and public involvement is within mainstream health research following two decades of policy-driven work to underpin health research with patient and public involvement in England. Methods Realist evaluation using Normalization Process Theory as a programme theory to understand what enabled patient and public involvement to be embedded as normal practice. Data were collected through a national scoping and survey, and qualitative methods to track patient and public involvement processes and impact over time within 22 nationally funded research projects. Results In research studies that were able to create reciprocal working relationships and to embed patient and public involvement this was contingent on: the purpose of patient and public involvement being clear; public contributors reflecting research end-beneficiaries; researchers understanding the value of patient and public involvement; patient and public involvement opportunities being provided throughout the research and ongoing evaluation of patient and public involvement. Key contested areas included: whether to measure patient and public involvement impact; seeking public contributors to maintain a balance between being research-aware and an outsider standpoint seen as 'authentically' lay; scaling-up patient and public involvement embedded within a research infrastructure rather than risk token presence and whether patient and public involvement can have a place within basic science. Conclusions While patient and public involvement can be well-integrated within all types of research, policy makers should take account of tensions that must be navigated in balancing moral and methodological imperatives.

Evaluating the impact of a falls prevention community of practice in a residential aged care setting: a realist approach

BACKGROUND

Falls are a major socio-economic problem among residential aged care (RAC) populations resulting in high rates of injury including hip fracture. Guidelines recommend that multifactorial prevention strategies are implemented but these require translation into clinical practice. A community of practice (CoP) was selected as a suitable model to support translation of the best available evidence into practice, as it could bring together like-minded people with falls expertise and local clinical knowledge providing a social learning opportunity in the pursuit of a common goal; falls prevention. The aims of this study were to evaluate the impact of a falls prevention CoP on its membership; actions at facility level; and actions at organisation level in translating falls prevention evidence into practice.

METHODS

A convergent, parallel mixed methods evaluation design based on a realist approach using surveys, audits, observations and semi-structured interviews. Participants were 20 interdisciplinary staff nominating as CoP members between Nov 2013-Nov 2015 representing 13 facilities (approximately 780 beds) of a RAC organisation. The impact of the CoP was evaluated at three levels to identify how the CoP influenced the observed outcomes in the varying contexts of its membership (level i.), the RAC facility (level ii.) and RAC organisation (level iii.).

RESULTS

Staff participating as CoP members gained knowledge and awareness in falls prevention (p < 0.001) through connecting and sharing. Strategies prioritised and addressed at RAC facility level culminated in an increase in the proportion of residents supplemented with vitamin D (p = 0.002) and development of falls prevention education. At organisation level a falls policy reflecting preventative evidence-based guidelines and a new falls risk assessment procedure with aligned management plans were written, modified and implemented. A key disenabling mechanism identified by CoP members was limited time to engage in translation of evidence into practice whilst enabling mechanisms included proactive behaviours by staff and management.

CONCLUSIONS

Interdisciplinary staff participating in a falls prevention CoP gained connectivity and knowledge and were able to facilitate the translation of falls prevention evidence into practice in the context of their RAC facility and RAC organisation. Support from RAC organisational and facility management to make the necessary investment in staff time to enable change in falls prevention practice is essential for success.

Factors associated with alcohol reduction in harmful and hazardous drinkers following alcohol brief intervention in Scotland: a qualitative enquiry

Background

Alcohol Brief Intervention (ABI) uses a motivational counselling approach to support individuals to reduce excessive alcohol consumption. There is growing evidence on ABI’s use within various health care settings, although how they work and which components enhance success is largely unknown. This paper reports on the qualitative part of a mixed methods study. It explores enablers and barriers associated with alcohol reduction following an ABI. It focuses on alcohol’s place within participants’ lives and their personal perspectives on reducing consumption. There are a number of randomised controlled trials in this field though few ABI studies have addressed the experiences of hazardous/harmful drinkers. This study examines factors associated with alcohol reduction in harmful/hazardous drinkers following ABI.

Methods

This qualitative study was underpinned by a realist evaluation approach and involved semi-structured interviews with ten harmful or hazardous alcohol drinkers. Participants (n = 10) were from the intervention arm of a randomised controlled trial (n = 124). All had received ABI, a 20 min motivational counselling interview, six months previously, and had reduced their alcohol consumption. Interviews were recorded, transcribed verbatim and thematically analysed.

Results

Participants described their views on alcohol, its’ place in their lives, their personal perspectives on reducing their consumption and future aspirations.

Conclusions

The findings provide an insight into participants’ views on alcohol, ABI, and the barriers and enablers to change. Participants described a cost benefit analysis, with some conscious consideration of the advantages and disadvantages of reducing intake or abstaining from alcohol. Findings suggest that, whilst hospital admission can act as a catalyst, encouraging individuals to reflect on their alcohol consumption through ABI may consolidate this, turning this reflective moment into action. Sustainability may be enhanced by the presence of a ‘significant other’ who encourages and experiences benefit. In addition having a purpose or structure with activities linked to employment and/or social and leisure pursuits offers the potential to enhance and sustain reduced alcohol consumption.

Trial registration

Trial registration number TRN NCT00982306 September 22nd 2009.

Improving skills and care standards in the support workforce for older people: a realist synthesis of workforce development interventions

Background

Support workers make up the majority of the workforce in health and social care services for older people. There is evidence to suggest that support workers are not deployed as effectively as possible, are often undervalued, and that there are gaps in understanding support worker roles across different care settings. In the context of a population that is growing older, having a skilled and knowledgeable workforce is an imperative. Workforce development includes the support required to equip those providing care to older people with the right skills, knowledge and behaviours to deliver safe and high-quality services.

Objective

The review answered the question ‘how can workforce development interventions improve the skills and the care standards of support workers within older people’s health and social care services?’.

Design

A realist synthesis was conducted. In realist synthesis, contingent relationships are expressed as context–mechanism–outcomes (CMOs), to show how particular contexts or conditions trigger mechanisms to generate outcomes. The review was conducted in four iterative stages over 18 months: (1) development of a theoretical framework and initial programme theory; (2) retrieval, review and synthesis of evidence relating to interventions designed to develop the support workforce, guided by the programme theories; (3) ‘testing out’ the synthesis findings to refine the programme theories and establish their practical relevance/potential for implementation; and (4) forming recommendations about how to improve current workforce development interventions to ensure high standards in the care of older people.

Participants

Twelve stakeholders were involved in workshops to inform programme theory development, and 10 managers, directors for training/development and experienced support workers were interviewed in phase 4 of the study to evaluate the findings and inform knowledge mobilisation.

Results

Eight CMO configurations emerged from the review process, which provide a programme theory about ‘what works’ in developing the older person’s support workforce. The findings indicate that the design and delivery of workforce development should consider and include a number of starting points. These include personal factors about the support worker, the specific requirements of workforce development and the fit with broader organisational strategy and goals.

Conclusions and recommendations

The review has resulted in an explanatory account of how the design and delivery of workforce development interventions work to improve the skills and care standards of support workers in older people’s health and social care services. Implications for the practice of designing and delivering older person’s support workforce development interventions are directly related to the eight CMO configuration of the programme theory. Our recommendations for future research relate both to aspects of research methods and to a number of research questions to further evaluate and explicate our programme theory.

Limitations

We found that reports of studies evaluating workforce development interventions tended to lack detail about the interventions that were being evaluated. We found a lack of specificity in reports about what were the perceived and actual intended impacts from the workforce development initiatives being implemented and/or evaluated.

Study registration

This study is registered as PROSPRERO CRD42013006283.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

ReseArch with Patient and Public invOlvement: a RealisT evaluation – the RAPPORT study

Background

Patient and public involvement (PPI) is a prerequisite for many funding bodies and NHS research ethics approval. PPI in research is defined as research carried out with or by the public rather than to, about or for them. While the benefits of PPI have been widely discussed, there is a lack of evidence on the impact and outcomes of PPI in research.

Objectives

To determine the types of PPI in funded research, describe key processes, analyse the contextual and temporal dynamics of PPI and explore the experience of PPI in research for all those involved. Mechanisms contributing to the routine incorporation of PPI in the research process were assessed, the impact of PPI on research processes and outcomes evaluated, and barriers and enablers to effective PPI identified.

Design

A three-staged realist evaluation drawing on Normalisation Process Theory to understand how far PPI was embedded within health-care research in six areas: diabetes mellitus, arthritis, cystic fibrosis, dementia, public health and learning disabilities. The first two stages comprised a scoping exercise and online survey to chief investigators to assess current PPI activity. The third stage consisted of case studies tracked over 18 months through interviews and document analysis. The research was conducted in four regions of England.

Participants

Non-commercial studies currently running or completed within the previous 2 years eligible for adoption on the UK Clinical Research Network portfolio. A total of 129 case study participants included researchers and PPI representatives from 22 research studies, and representatives from funding bodies and PPI networks.

Results

In the scoping 51% (n = 92) of studies had evidence of PPI and in the survey 79% (n = 80), with funder requirements and study design the strongest influence on the extent of PPI. There was little transparency about PPI in publicly accessible information. In case studies, context–mechanism–outcome configurations suggested that six salient actions were required for effective PPI. These were a clear purpose, role and structure for PPI; ensuring diversity; whole research team engagement with PPI; mutual understanding and trust between the researchers and lay representatives; ensuring opportunities for PPI throughout the research process; and reflecting on, appraising and evaluating PPI within a research study. PPI models included a ‘one-off’ model with limited PPI, a fully intertwined model in which PPI was fully embedded and an outreach model with lay representatives linking to broader communities. Enabling contexts included funder, topic/design, resources, research host, organisation of PPI and, most importantly, relationships. In some case studies, lack of coherence in defining PPI persisted, with evidence of a dual role of PPI representative/study participant. Evidence of PPI outcomes included changes to study design, improvements to recruitment materials and rates, and dissemination.

Conclusions

Six salient actions were required for effective PPI and were characterised by a shared understanding of moral and methodological purposes of PPI, a key individual co-ordinating PPI, ensuring diversity, a research team positive about PPI input and fully engaged with it, based on relationships that were established and maintained over time, and PPI being evaluated in a proactive and systematic approach. Future work recommendations include exploring the impact of virtual PPI, cost analysis and economic evaluation of the different models of PPI, and a longer-term follow-up study of the outcomes of PPI on research findings and impact on services and clinical practice.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

Using realist evaluation to open the black box of knowledge translation: a state-of-the-art review

BACKGROUND

In knowledge translation, complex interventions may be implemented in the attempt to improve uptake of research-based knowledge in practice. Traditional evaluation efforts that focus on aggregate effectiveness represent an oversimplification of both the environment and the interventions themselves. However, theory-based approaches to evaluation, such as realist evaluation (RE), may be better-suited to examination of complex knowledge translation interventions with a view to understanding what works, for whom, and under what conditions. It is the aim of the present state-of-the-art review to examine current literature with regard to the use of RE in the assessment of knowledge translation interventions implemented within healthcare environments.

METHODS

Multiple online databases were searched from 1997 through June 2013. Primary studies examining the application or implementation of knowledge translation interventions within healthcare settings and using RE were selected for inclusion. Varying applications of RE across studies were examined in terms of a) reporting of core elements of RE, and b) potential feasibility of this evaluation method.

RESULTS

A total of 14 studies (6 study protocols), published between 2007 and 2013, were identified for inclusion. Projects were initiated in a variety of healthcare settings and represented a range of interventions. While a majority of authors mentioned context (C), mechanism (M) and outcome (O), a minority reported the development of C-M-O configurations or testable hypotheses based on these configurations. Four completed studies reported results that included refinement of proposed C-M-O configurations and offered explanations within the RE framework. In the few studies offering insight regarding challenges associated with the use of RE, difficulties were expressed regarding the definition of both mechanisms and contextual factors. Overall, RE was perceived as time-consuming and resource intensive.

CONCLUSIONS

The use of RE in knowledge translation is relatively new; however, theory-building approaches to the examination of complex interventions in this area may be increasing as researchers attempt to identify what works, for whom and under what circumstances. Completion of the RE cycle may be challenging, particularly in the development of C-M-O configurations; however, as researchers approach challenges and explore innovations in its application, rich and detailed accounts may improve feasibility.

Interprofessional teamwork in stroke care: Is it visible or important to patients and carers?

Interprofessional teamwork is seen in healthcare policy and practice as a key strategy for providing safe, efficient and holistic healthcare and is an accepted part of evidence-based stroke care. The impact of interprofessional teamwork on patient and carer experience(s) of care is unknown, although some research suggests a relationship might exist. This study aimed to explore patient and carer perceptions of good and poor teamwork and its impact on experiences of care. Critical incident interviews were conducted with 50 patients and 33 carers in acute, inpatient rehabilitation and community phases of care within two UK stroke care pathways. An analytical framework, derived from a realist synthesis of 13 'mechanisms' (processes) of interprofessional teamwork, was used to identify positive and negative 'indicators' of teamwork. Participants identified several mechanisms of teamwork, but it was not a subject most talked about readily. This suggests that interprofessional teamwork is not a concept that is particularly important to stroke patients and carers; they do not readily perceive any impacts of teamwork on their experiences. These findings are a salient reminder that what might be expected by healthcare professionals to be important influences on experience may not be perceived to be so by patients and carers.

Improving skills and care standards in the support workforce for older people: a realist review

INTRODUCTION

In the context of a population that is growing older, and a number of high-profile scandals about care standards in hospital and community settings, having a skilled and knowledgeable workforce caring for older people is an ethical and policy imperative. Support workers make up the majority of the workforce in health and social care services for older people (aged 65 years and over), and yet little is known about the best way to facilitate their development. Given this gap, this review will draw on evidence to address the question: how can workforce development interventions improve the skills and the care standards of support workers within older people's health and social care services?

METHODS AND ANALYSIS

As we are interested in how and why workforce development interventions might work, in what circumstances and with whom, we will conduct a realist review, sourcing evidence from health, social care, policing and education. The review will be conducted in four steps over 18 months to (1) construct a theoretical framework, that is, the review's programme theories; (2) retrieve, review and synthesise evidence relating to interventions designed to develop the support workforce guided by the programme theories; (3) 'test out' our synthesis findings and refine the programme theories, establish their practical relevance/potential for implementation and (4) formulate recommendations about improvements to current workforce development interventions to contribute to the improvement of care standards in older people's health and social care services, potentially transferrable to other services.

ETHICS AND DISSEMINATION

Ethical approval is not required to undertake this review. Knowledge exchange activities through stakeholder engagement and online postings are embedded throughout the lifetime of the project. The main output from this review will be a new theory driven framework for skill development for the support workforce in health and social care for older people.

TRIAL REGISTRATION NUMBER

CRD42013006283.