Extending systematic reviews to include evidence on implementation: Methodological work on a review of community-based initiatives to prevent injuries

Pierre M, Belle-Isle L, Gagnon M, Bevan S, Sanchez T, Arlt S, Monahan-Ellison M, O'Hara J, Boivin M, Costiniuk C. Clinical Practice Guidelines for Cannabis and Cannabinoid-Based Medicines in the Management of Chronic Pain and Co-Occurring Conditions

Background: One in five individuals live with chronic pain globally, which often co-occurs with sleep problems, anxiety, depression, and substance use disorders. Although these conditions are commonly managed with cannabinoid-based medicines (CBM), health care providers report lack of information on the risks, benefits, and appropriate use of CBM for therapeutic purposes. Aims: We present these clinical practice guidelines to help clinicians and patients navigate appropriate CBM use in the management of chronic pain and co-occurring conditions. Materials and Methods: We conducted a systematic review of studies investigating the use of CBM for the treatment of chronic pain. Articles were dually reviewed in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Clinical recommendations were developed based on available evidence from the review. Values and preferences and practical tips have also been provided to support clinical application. The GRADE system was used to rate the strength of recommendations and quality of evidence. Results: From our literature search, 70 articles met inclusion criteria and were utilized in guideline development, including 19 systematic reviews and 51 original research studies. Research typically demonstrates moderate benefit of CBM in chronic pain management. There is also evidence for efficacy of CBM in the management of comorbidities, including sleep problems, anxiety, appetite suppression, and for managing symptoms in some chronic conditions associated with pain including HIV, multiple sclerosis, fibromyalgia, and arthritis. Conclusions: All patients considering CBM should be educated on risks and adverse events. Patients and clinicians should work collaboratively to identify appropriate dosing, titration, and administration routes for each individual. Systematic Review Registration: PROSPERO no. 135886.

What is known about what works in community-involved decision-making relating to urban green and blue spaces? A realist review protocol

BACKGROUND

There is now a relatively well-established evidence base suggesting that greener living environments and time spent in urban green and blue spaces (UGBS) can be beneficial for human health and wellbeing. However, benefits are not universal and there remain widespread social inequalities in access to such resources and experiences, particularly along axes of class, race, ethnicity, age and disability, and in relation to efforts to increase the availability and accessibility of such spaces. These injustices often relate to distributive, procedural and recognition-based processes. There is growing interest in how to ensure that efforts to increase access to or use of UGBS (whether through infrastructural or social programmes) result in equitable outcomes whilst minimising potential for exacerbating existing inequalities and injustices. Community engagement is considered an important step towards more inclusive UGBS decision-making, from planning and design to management and maintenance processes. It is thought to contribute to better and more widely trusted decisions, enhanced democracy, community satisfaction, civic interest and feelings of green space ownership, and greater longevity of UGBS projects. However, uneven representation and barriers to participation can create imbalances and undermine these benefits.

METHODS

An iterative, multi-stage realist-inspired review will be conducted to ask what works, in what context and in what ways relating to the meaningful involvement of communities in UGBS decision-making, focusing on the skills, capacities and capabilities of different stakeholders and the role of contexts and processes. 'Effectiveness' (or what works) will be understood as a multifaceted outcome, encompassing both the processes and results of community engagement efforts. Following a scoping stage to identify initial programme theory, inclusion/exclusion criteria and derive search terms, relevant databases and grey literature will be searched to identify interdisciplinary literature in two phases. The first phase will be used to further develop programme theories, which will be articulated as 'if then' statements. The second phase searches will be used to identify sources to further explore and evidence the programme and formal theory. We will assess all includable evidence for conceptual richness, prioritising more conceptually rich sources if needed.

DISCUSSION

The realist synthesis will explore the key context, mechanism and outcome configurations that appear to explain if and how different approaches to community-involved UGBS decision-making are or are not effective. We will consider factors such as different conceptualisations of community, and if and how they have been involved in UGBS decision-making; the types of tools and approaches used; and the socio-cultural and political or governance structures within which decision-making takes place.

Community mental health funding, stakeholder engagement and outcomes: a realist synthesis

Mental health services continues to be a high priority for healthcare and social service systems. Funding structures within community mental health settings have shown to impact service providers' behaviour and practices. Additionally, stakeholder engagement is suggested as an important mechanism to achieving the intended goals. However, the literature on community mental health funding reform and associated outcomes is inconsistent and there are no consistent best practices for stakeholder engagement in such efforts.

OBJECTIVES

This study sought to understand how stakeholder engagement impacts outcomes when there is a change in public funding within community mental health settings.

DESIGN

A realist synthesis approach was used to address the research question to fully understand the role of stakeholder engagement as a mechanism in achieving outcomes (system and service user) in the context of community mental health service reform. An iterative process was used to identify programme theories and context-mechanism-outcome configurations within the literature.

RESULTS

Findings highlight that in the absence of stakeholder engagement, funding changes may lead to negative outcomes. When stakeholders were engaged in some form, funding changes were more often associated with positive outcomes. Stakeholder engagement is multifaceted and requires considerable time and investment to support achieving intended outcomes when funding changes are implemented.

CONCLUSIONS

To support successful transformation of community mental health programmes, it is important that stakeholders are meaningfully engaged during funding allocation changes. Stakeholder engagement may entail connecting around a shared purpose, individual participation and meaningful interactions and dialogue.

Implementation of a standardised perioperative nutrition care pathway in upper gastrointestinal cancer surgery: a multi-site pilot study

BACKGROUND

Perioperative nutrition support is recommended for patients undergoing upper gastrointestinal (UGI) cancer surgery; however, limited evidence exists regarding implementation of a nutrition care pathway in clinical practice. The aims of this pilot study were to determine if implementation of a standardised perioperative nutrition pathway for patients undergoing UGI cancer surgery improves access to dietetics care, and to evaluate study feasibility, fidelity, resource requirements and effect on clinical outcomes.

METHODS

Patients with newly diagnosed UGI cancer from four major metropolitan hospitals in Melbourne, planned for curative intent surgery, were included in the prospective pilot study (n=35), with historical controls (n=35) as standard care. Outcomes were dietetics care (dietetics contacts) nutritional status; hand grip strength; weight change; preoperative hospital admissions; complications and length of stay; recruitment feasibility; fidelity and adherence; and, resource requirements. Continuous data were analysed using independent samples t-test accounting for unequal variances or Mann-Whitney U test. Dichotomous data were analysed using Fisher's exact test.

RESULTS

The percentage of participants receiving preoperative dietetic intervention increased from 55% to 100% (p<0.001). Mean and standard deviation (SD) dietetics contacts increased from 2.2 (3.7) to 5.9 (3.9) (p<0.001). Non-statistically significant decreases in preoperative nutrition-related hospital admissions, and surgical complications were demonstrated in patients who underwent neoadjuvant therapy. Recruitment rate was 81%, and adherence to the nutrition pathway was high (>70% for all stages of the pathway). The mean estimated resource requirement for the preoperative period was 3.7 (2.8) hours per patient.

CONCLUSION

Implementation of this standardised nutrition pathway resulted in improved access to dietetics care. Recruitment feasibility and high fidelity to the intervention suggest that a larger study would be viable. This article is protected by copyright. All rights reserved.

Clinical guidelines for managing hearing loss as a complication of drug-resistant tuberculosis treatment: an evaluation of implementation fidelity in Kano, Nigeria

Background

Nigeria has a high burden of Tuberculosis (TB) including Drug-resistant Tuberculosis (DR-TB) and hearing loss. Despite several efforts directed toward its control, many patients fail to respond to treatment, having developed DR-TB. Lack of adherence to the DR-TB guidelines/improper implementation of the guideline has been identified as one of the factors impeding on effective treatment. This study sought to measure the implementation fidelity of health workers to management guidelines for hearing loss resulting from DR-TB treatment and to identify its determinants.

Method

A questionnaire-based cross-sectional study was conducted at the Infectious Disease Hospital, Kano. Implementation fidelity of the Programmatic Management guidelines for the treatment of Drug-resistant Tuberculosis was measured under the four domains of content, coverage, duration and frequency. The determinants examined are intervention complexity, facilitation strategies, quality of delivery and participant responsiveness as proposed by the Carroll et al. framework. Other determinants used are age, sex, professional cadre and work experience of healthcare providers.

Results

The Implementation fidelity score ranged from 40 to 64% with a mean of 47.6%. Quality of delivery, intervention complexity, participants’ responsiveness, and being a medical doctor exerted a positive effect on implementation fidelity while facilitation strategy, age and work experience exerted a negative effect on implementation fidelity.

Conclusion

The implementation fidelity of management guidelines for hearing loss resulting from DR-TB treatment was low. Implementation fidelity should be assessed early and at intervals in the course of implementing the Programmatic Management of Drug-resistant Tuberculosis guideline and indeed, in the implementation of any intervention.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-07536-y.

Fungi in the indoor air of critical hospital areas: a review

Invasive fungal infection is an important cause of mortality and morbidity in neonates, especially in low-birthweight neonates. The contribution of fungi in the indoor air to the incidence of mucocutaneous colonization and to the risk of invasive fungal infection in this population is uncertain. This review aimed to identify and to summarize the best available evidence on the fungal contamination in the indoor air of critical hospital areas with an emphasis on pediatric/neonatal ICUs. Publications from 2005 to 2019 were searched in the databases Scientific Electronic Library Online (SciELO), US National Library of Medicine National Institutes of Health Search (PubMed), and Latin American Caribbean Health Sciences (LILACS). Descriptors in Health Sciences (DeCS) were used. Research papers published in Portuguese, English, and Spanish were included. Twenty-nine papers on all continents except Australia were selected. The results showed that the air mycobiota contained several fungal species, notably Aspergillus, Penicillium, Cladosporium, Fusarium, and yeast (Candida) species. The selected papers point out the risks that fungi pose to neonates, who have immature immune system, and describe simultaneous external factors (air humidity, seasonality, air and people flow, use of particulate filters, and health professionals' hand hygiene) that contribute to indoor air contamination with fungi. Improving communication among health professionals is a great concern because this can prevent major health complications in neonates, especially in low-birthweight neonates. The results reinforced the need to monitor environmental fungi more frequently and efficiently in hospitals, especially in neonatal ICUs.

Maintaining Intervention Fidelity When Using Technology Delivery Across Studies

The current standard in healthcare research is to maintain scientific fidelity of any intervention being tested. Fidelity is defined as the consistent delivery of interventions that ensures that all participants are provided the same information, guidance, and/or materials. Notably, the methods for ensuring fidelity of intervention delivery must also be consistent. This article describes our Intervention and Technology Delivery Fidelity Checklists used to ensure consistency. These checklists were completed by trained nurse observers who rated the intervention implementation and the technology delivery. Across our clinical trials and pilot studies, the fidelity scores were tabulated and compared. Intervention information and materials were delivered by a variety of devices including telehealth monitors, videophones, and/or iPads. Each of the devices allows audiovisual connections between health professionals from their offices and patients and participants in their homes. Our checklists guide the monitoring of fidelity of technology delivery. Overall checklist ratings across our studies demonstrate consistent intervention, implementation, and technology delivery approaches. Uniquely, the fidelity checklist verifies the interventionist's correct use of the technology devices to ensure consistent audiovisual delivery. Checklist methods to ensure intervention fidelity and technology delivery are essential research procedures, which can be adapted for use by researchers across multiple disciplines.

Canadian clinical practice guidelines for the use of plant-based cannabis and cannabinoid-based products in the management of chronic non-cancer pain and co-occurring conditions: protocol for a systematic literature review

INTRODUCTION

Chronic pain and co-occurring disorders, such as sleep disorders, anxiety, depression, post-traumatic stress disorder and substance use disorders, are among the most common conditions for which cannabis and cannabinoid-based products derived from the cannabis plant (CBP) are used for therapeutic purposes. However, healthcare providers report that they lack sufficient information on the risks, benefits and appropriate use of cannabis and CBP derived from the cannabis plant for therapeutic purposes.

METHODS AND ANALYSIS

We will conduct a systematic review of studies investigating the use of cannabis and CBP derived from the cannabis plant for the treatment of chronic pain and co-occurring conditions. Randomised controlled trials, meta-analyses and observational studies will be prioritised. We will exclude reviews of cannabinoid mechanisms of actions, commentary articles and narrative reviews. The primary outcome of interest will be efficacy in relieving chronic pain. Secondary outcomes will be efficacy in ameliorating conditions such as sleep disorders, anxiety, depression, post-traumatic stress disorder and substance use disorders. We will search electronic bibliographic databases including Academic Search Complete, Cochrane Database of Systematic Reviews, Evidence based Medicine Reviewes, OVID Medline, PsychINFO, PubMed, CINAHL and Web of Science. Two reviewers will conduct screening and data collection independently. Study level of bias will be assessed using the Cochrane Risk of Bias Assessment Tool for randomised controlled trials and non-randomised studies. Narrative analysis will be utilised to interpret the data.

ETHICS AND DISSEMINATION

The results of this systematic review will inform guideline development for the use of cannabis and CBP derived from the cannabis plant in the management of chronic pain and co-occurring conditions. Areas requiring further study will also be highlighted.

PROSPERO REGISTRATION NUMBER

CRD42020135886.

Title: Can changing the physical environment promote walking and cycling? A systematic review of what works and how

Environmental changes aimed at encouraging walking or cycling may promote activity and improve health, but evidence suggests small or inconsistent effects in practice. Understanding how an intervention works might help explain the effects observed and provide guidance about generalisability. We therefore aimed to review the literature on the effects of this type of intervention and to understand how and why these may or may not be effective. We searched eight electronic databases for existing systematic reviews and mined these for evaluative studies of physical environmental changes and assessed changes in walking, cycling or physical activity. We then searched for related sources including quantitative or qualitative studies, policy documents or reports. We extracted information on the evidence for effects ('estimation'), contexts and mechanisms ('explanation') and assessed credibility, and synthesised material narratively. We identified 13 evaluations of interventions specifically targeting walking and cycling and used 46 related sources. 70% (n = 9 evaluations) scored 3 or less on the credibility criteria for effectiveness. 6 reported significant positive effects, but higher quality evaluations were more likely to report positive effects. Only two studies provided rich evidence of mechanisms. We identified three common resources that interventions provide to promote walking and cycling: (i) improving accessibility and connectivity; (ii) improving traffic and personal safety; and (iii) improving the experience of walking and cycling. The most effective interventions appeared to target accessibility and safety in both supportive and unsupportive contexts. Although the evidence base was relatively limited, we were able to understand the role of context in the success of interventions. Researchers and policy makers should consider the context and mechanisms which might operate before evaluating and implementing interventions.

A realist review of which advocacy interventions work for which abused women under what circumstances

BACKGROUND

Intimate partner abuse (including coercive control, physical, sexual, economic, emotional and economic abuse) is common worldwide. Advocacy may help women who are in, or have left, an abusive intimate relationship, to stop or reduce repeat victimisation and overcome consequences of the abuse. Advocacy primarily involves education, safety planning support and increasing access to different services. It may be stand-alone or part of other services and interventions, and may be provided within healthcare, criminal justice, social, government or specialist domestic violence services. We focus on the abuse of women, as interventions for abused men require different considerations.

OBJECTIVES

To assess advocacy interventions for intimate partner abuse in women, in terms of which interventions work for whom, why and in what circumstances.

SEARCH METHODS

In January 2019 we searched CENTRAL, MEDLINE, 12 other databases, two trials registers and two relevant websites. The search had three phases: scoping of articles to identify candidate theories; iterative recursive search for studies to explore and fill gaps in these theories; and systematic search for studies to test, confirm or refute our explanatory theory.

SELECTION CRITERIA

Empirical studies of any advocacy or multi-component intervention including advocacy, intended for women aged 15 years and over who were experiencing or had experienced any form of intimate partner abuse, or of advocates delivering such interventions, or experiences of women who were receiving or had received such an intervention. Partner abuse encompasses coercive control in the absence of physical abuse. For theory development, we included studies that did not strictly fit our original criteria but provided information useful for theory development.

DATA COLLECTION AND ANALYSIS

Four review authors independently extracted data, with double assessment of 10% of the data, and assessed risk of bias and quality of the evidence. We adopted RAMESES (Realist and meta-narrative evidence syntheses: evolving standards) standards for reporting results. We applied a realist approach to the analysis.

MAIN RESULTS

We included 98 studies (147 articles). There were 88 core studies: 37 focused on advocates (4 survey-based, 3 instrument development, 30 qualitative focus) and seven on abused women (6 qualitative studies, 1 survey); 44 were experimental intervention studies (some including qualitative evaluations). Ten further studies (3 randomised controlled trials (RCTs), 1 intervention process evaluation, 1 qualitative study, 2 mixed methods studies, 2 surveys of women, and 1 mixed methods study of women and staff) did not fit the original criteria but added useful information, as befitting a realist approach. Two studies are awaiting classification and three are ongoing.Advocacy interventions varied considerably in contact hours, profession delivering and setting.We constructed a conceptual model from six essential principles based on context-mechanism-outcome (CMO) patterns.We have moderate and high confidence in evidence for the importance of considering both women's vulnerabilities and intersectionalities and the trade-offs of abuse-related decisions in the contexts of individual women's lives. Decisions should consider the risks to the woman's safety from the abuse. Whether actions resulting from advocacy increase or decrease abuse depends on contextual factors (e.g. severity and type of abuse), and the outcomes the particular advocacy intervention is designed to address (e.g. increasing successful court orders versus decreasing depression).We have low confidence in evidence regarding the significance of physical dependencies, being pregnant or having children. There were links between setting (high confidence), and potentially also theoretical underpinnings of interventions, type, duration and intensity of advocacy, advocate discipline and outcomes (moderate and low confidence). A good therapeutic alliance was important (high confidence); this alliance might be improved when advocates are matched with abused women on ethnicity or abuse experience, exercise cultural humility, and remove structural barriers to resource access by marginalised women. We identified significant challenges for advocates in inter-organisational working, vicarious traumatisation, and lack of clarity on how much support to give a woman (moderate and high confidence). To work effectively, advocates need ongoing training, role clarity, access to resources, and peer and institutional support.Our provisional model highlights the complex way that factors combine and interact for effective advocacy. We confirmed the core ingredients of advocacy according to both women and advocates, supported by studies and theoretical considerations: education and information on abuse; rights and resources; active referral and liaising with other services; risk assessment and safety planning. We were unable to confirm the impact of complexity of the intervention (low confidence). Our low confidence in the evidence was driven mostly by a lack of relevant studies, rather than poor-quality studies, despite the size of the review.

AUTHORS' CONCLUSIONS

Results confirm the core ingredients of advocacy and suggest its use rests on sound theoretical underpinnings. We determined the elements of a good therapeutic alliance and how it might be improved, with a need for particular considerations of the factors affecting marginalised women. Women's goals from advocacy should be considered in the contexts of their personal lives. Women's safety was not necessarily at greatest risk from staying with the abuser. Potentially, if undertaken for long enough, advocacy should benefit an abused woman in terms of at least one outcome providing the goals are matched to each woman's needs. Some outcomes may take months to be determined. Where abuse is severe, some interventions may increase abuse. Advocates have a challenging role and must be supported emotionally, through provision of resources and through professional training, by organisations and peers.Future research should consider the different principles identified in this review, and study outcomes should be considered in relation to the mechanisms and contexts elucidated. More longitudinal evidence is needed. Single-subject research designs may help determine exactly when effect no longer increases, to determine the duration of longitudinal work, which will likely differ for vulnerable and marginalised women. Further work is needed to ascertain how to tailor advocacy interventions to cultural variations and rural and resource-poor settings. The methods used in the included studies may, in some cases, limit the applicability and completeness of the data reported. Economic analyses are required to ascertain if resources devoted to advocacy interventions are cost-effective in healthcare and community settings.

To the bone: Comment on "I wanted a skeleton … they brought a prince": A qualitative investigation of factors mediating the implementation of a Performance Based Incentive program in Malawi

Recently, McMahon and colleagues set out to build on a widely-used fidelity framework, assessing the role of moderating factors during the implementation of performance-based financing programs in Malawi. Their attempt draws again the attention to the importance of approaching real word implementation issues from a theoretical perspective. It also highlights the importance of fidelity assessment within process evaluation of health programs. In this comment we argue that theoretical developments in the field of implementation science in global health would benefit from an accurate understanding of existing conceptual frameworks as well as from taking into account all contemporary contributions.

Conceptual frameworks for the workplace change adoption process: elements integration from decision making and learning cycle process

Sound workplace ergonomics and safety-related interventions may be resisted by employees, and this may be detrimental to multiple stakeholders. Understanding fundamental aspects of decision-making, behavioural change, and learning cycles may provide insights into pathways influencing employees' acceptance of interventions. This manuscript reviews published literature on thinking processes and other topics relevant to decision making and incorporates the findings into two new conceptual frameworks of the workplace change adoption process. Such frameworks are useful for thinking about adoption in different ways and testing changes to traditional intervention implementation processes. Moving forward, it is recommended that future research focuses on systematic exploration of implementation process activities that integrate principles from the research literature on sense-making, decision-making, and learning processes. Such exploration may provide the groundwork for development of specific implementation strategies that are theoretically grounded and provide a revised understanding of how successful intervention adoption processes work. Practitioner summary: Adoption and acceptance of workplace changes may be facilitated through sound implementation strategies. This manuscript explores several principles of sense-making and decision-making processes that can potentially be used by industrial practitioners to inform the design and development of implementation strategies for interventions that improve workplace ergonomics and safety.

ABBREVIATIONS

 Musculoskeletal Disorders (MSDs); National Institute for Occupational Safety and Health (NIOSH); National Occupational Research Agenda (NORA); Health and Safety Executive (HSE).

Development of programme theory for integration of service user and caregiver involvement in mental health system strengthening: protocol for realist systematic review

Background

There is international recognition of the need for service user and caregiver involvement in mental health system strengthening. However, little is known about how best to integrate this approach into the mental healthcare system; what works to advance involvement, under what conditions, how and when does involvement bring added value, and how can it work in resource-poor settings in low and middle-income countries.

Objective

To describe the methodology for a realist systematic review protocol to synthesise the evidence to explain the contexts, outcomes, and underlying mechanisms for involvement of service users with severe mental health problems and their caregivers in mental healthcare policy-making and planning, advocacy, service development, monitoring and improvement.

Methods/designs

The proposed realist systematic review will involve five steps: (i) clarifying the review scope, (ii) a systematic search for evidence, (iii) evidence appraisal and data extraction, (iv) data analysis, (v) synthesis of evidence and formation of revised programme theory. Inputs from a formative qualitative study, consultative Theory of Change meetings with key stakeholder groups, and scoping reviews will be used to identify candidate theory/theories that will guide the selection, appraisal and analysis of studies, and refine the Theory of Change model that will be piloted and evaluated. Synthesis of data will be undertaken using realist logic, constant comparison and thematic analysis. In a consultative meeting with stakeholders the Theory of Change model will then be situated with respect to relevant programme theories and adapted to incorporate the synthesized evidence of relevance to the local context. The finalized Theory of Change model will be piloted and evaluated in a primary health care setting in rural Ethiopia.

Discussion

Realist review methodology has not been applied to the area of mental health service user involvement in low- and middle-income country settings. In this protocol, we describe how this contextualized approach will be applied to identify and refine a theory-driven and transferable model of involvement of service users, embedded in ongoing work in Ethiopia.Systematic review registration PROSPERO CRD42018084595.

Developing a multidisciplinary rehabilitation package following hip fracture and testing in a randomised feasibility study: Fracture in the Elderly Multidisciplinary Rehabilitation (FEMuR)

BACKGROUND

Proximal femoral fracture is a major health problem in old age, with annual UK health and social care costs of £2.3B. Rehabilitation has the potential to maximise functional recovery and maintain independent living, but evidence of clinical effectiveness and cost-effectiveness is lacking.

OBJECTIVES

To develop an enhanced community-based rehabilitation package following surgical treatment for proximal femoral fracture and to assess acceptability and feasibility for a future definitive randomised controlled trial (RCT) and economic evaluation.

DESIGN

Phase I - realist review, survey and focus groups to develop the rehabilitation package. Phase II - parallel-group, randomised (using a dynamic adaptive algorithm) feasibility study with focus groups and an anonymised cohort study.

SETTING

Recruitment was from orthopaedic wards of three acute hospitals in the Betsi Cadwaladr University Health Board, North Wales. The intervention was delivered in the community following hospital discharge.

PARTICIPANTS

Older adults (aged ≥ 65 years) who had received surgical treatment for hip fracture, lived independently prior to fracture, had mental capacity (assessed by the clinical team) and received rehabilitation in the North Wales area.

INTERVENTIONS

Participants received usual care (control) or usual care plus an enhanced rehabilitation package (intervention). Usual care was variable and consisted of multidisciplinary rehabilitation delivered by the acute hospital, community hospital and community services depending on need and availability. The intervention was designed to enhance rehabilitation by improving patients' self-efficacy and increasing the amount and quality of patients' practice of physical exercise and activities of daily living. It consisted of a patient-held information workbook, a goal-setting diary and six additional therapy sessions.

MAIN OUTCOME MEASURES

The primary outcome measure was the Barthel Activities of Daily Living (BADL) index. The secondary outcome measures included the Nottingham Extended Activities of Daily Living (NEADL) scale, EuroQol-5 Dimensions, ICEpop CAPability measure for Older people, General Self-Efficacy Scale, Falls Efficacy Scale - International (FES-I), Self-Efficacy for Exercise scale, Hospital Anxiety and Depression Scale (HADS) and service use measures. Outcome measures were assessed at baseline and at 3-month follow-up by blinded researchers.

RESULTS

Sixty-two participants were recruited (23% of those who were eligible), 61 were randomised (control, n = 32; intervention, n = 29) and 49 (79%) were followed up at 3 months. Compared with the cohort study, a younger, healthier subpopulation was recruited. There were minimal differences in most outcomes between the two groups, including the BADL index, with an adjusted mean difference of 0.5 (Cohen's d = 0.29). The intervention group showed a medium-sized improvement on the NEADL scale relative to the control group, with an adjusted mean difference between groups of 3.0 (Cohen's d = 0.63). There was a trend for greater improvement in FES-I and HADS in the intervention group, but with small effect sizes, with an adjusted mean difference of 4.2 (Cohen's d = 0.31) and 1.3 (Cohen's d = 0.20), respectively. The cost of delivering the intervention was £231 per patient. There was a possible small relative increase in quality-adjusted life-years in the intervention group. No serious adverse events relating to the intervention were reported.

CONCLUSIONS

Trial methods were feasible in terms of eligibility, recruitment and retention, although recruitment was challenging. The NEADL scale was more responsive than the BADL index, suggesting that the intervention could enable participants to regain better levels of independence compared with usual care. This should be tested in a definitive Phase III RCT. There were two main limitations of the study: the feasibility study lacked power to test for differences between the groups and a ceiling effect was observed in the primary measure.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN22464643.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 21, No. 44. See the NIHR Journals Library for further project information.

Development of an evidence-based complex intervention for community rehabilitation of patients with hip fracture using realist review, survey and focus groups

OBJECTIVES

To develop an evidence and theory-based complex intervention for improving outcomes in elderly patients following hip fracture.

DESIGN

Complex-intervention development (Medical Research Council (MRC) framework phase I) using realist literature review, surveys and focus groups of patients and rehabilitation teams.

SETTING

North Wales.

PARTICIPANTS

Surveys of therapy managers (n=13), community and hospital-based physiotherapists (n=129) and occupational therapists (n=68) throughout the UK. Focus groups with patients (n=13), their carers (n=4) and members of the multidisciplinary rehabilitation teams in North Wales (n=13).

RESULTS

The realist review provided understanding of how rehabilitation interventions work in the real-world context and three programme theories were developed: improving patient engagement by tailoring the intervention to individual needs; reducing fear of falling and improving self-efficacy to exercise and perform activities of daily living; and coordination of rehabilitation delivery. The survey provided context about usual rehabilitation practice; focus groups provided data on the experience, acceptability and feasibility of rehabilitation interventions. An intervention to enhance usual rehabilitation was developed to target these theory areas comprising: a physical component consisting of six additional therapy sessions; and a psychological component consisting of a workbook to enhance self-efficacy and a patient-held goal-setting diary for self-monitoring.

CONCLUSIONS

A realist approach may have advantages in the development of evidence-based interventions and can be used in conjunction with other established methods to contribute to the development of potentially more effective interventions. A rehabilitation intervention was developed which can be tested in a future randomised controlled trial (MRC framework phases II and III).

TRIAL REGISTRATION NUMBER

ISRCTN22464643, Pre-results.

Towards an understanding of how appraisal of doctors produces its effects: a realist review

CONTEXT

Revalidation was launched in the UK to provide assurances to the public that doctors are up to date and fit to practice. Appraisal is a fundamental component of revalidation. Approximately 150 000 doctors are appraised annually, costing an estimated £97 million over 10 years. There is little understanding of the theory of how and why appraisal is supposed to produce its effects. A realist review of the literature was utilised to explore these issues, as they generate context-mechanism-outcome (CMO) configurations, resulting in the creation of theories of how and why appraisal of doctors produces its effects.

METHODS

A programme theory of appraisal was created by convening stakeholders in appraisal and searching a database of research on appraisal of doctors. Supplementary searches provided literature on theories identified in the programme theory. Relevant sections of texts relating to the programme theory were extracted from included articles, coded in NVivo and synthesised using realist logic of analysis. A classification tool categorised the included articles' contributions to programme theory.

RESULTS

One hundred and twenty-five articles were included. Three mechanisms were identified: dissonance, denial and self-affirmation. The dissonance mechanism is most likely to cause outcomes of reflection and insight. Important contexts for the dissonance mechanism include the appraiser being highly skilled, the appraisee's working environment being supportive and the appraisee having the right attitude. The denial mechanism is more likely to be enacted if the opposite of these contexts occurs and could lead to game-playing behaviour. A skilled appraiser was also important in triggering the self-affirmation mechanism, resulting in reflection and insight. The contexts, mechanisms and outcomes identified were, however, limited by a lack of evidence that could enable further refining of the CMO configurations.

CONCLUSION

This review makes a significant contribution to our understanding of appraisal by identifying different ways that appraisal of doctors produces its effects. Further research will focus on testing the CMO configurations.

Technical Packages in Injury and Violence Prevention to Move Evidence Into Practice: Systematic Reviews and Beyond

Injury and violence prevention strategies have greater potential for impact when they are based on scientific evidence. Systematic reviews of the scientific evidence can contribute key information about which policies and programs might have the greatest impact when implemented. However, systematic reviews have limitations, such as lack of implementation guidance and contextual information, that can limit the application of knowledge. "Technical packages," developed by knowledge brokers such as the federal government, nonprofit agencies, and academic institutions, have the potential to be an efficient mechanism for making information from systematic reviews actionable. Technical packages provide information about specific evidence-based prevention strategies, along with the estimated costs and impacts, and include accompanying implementation and evaluation guidance to facilitate adoption, implementation, and performance measurement. We describe how systematic reviews can inform the development of technical packages for practitioners, provide examples of technical packages in injury and violence prevention, and explain how enhancing review methods and reporting could facilitate the use and applicability of scientific evidence.

Critical stakeholder determinants to the implementation of intersectoral community approaches targeting childhood obesity

Several intersectoral community approaches targeting childhood obesity (IACOs) have been launched in the Netherlands. Translation of these approaches into practice is however arduous and implementation. We therefore studied the implementation of five IACOs in the Netherlands for one-and-a-half years. IACO implementation was evaluated via an adapted version of the MIDI questionnaire, consisting of 18 theory-based constructs. A response rate of 62% was obtained. A hierarchical multivariate linear regression model was used to analyse our data; the final regression model predicted 65% of the variance in adherence. Higher levels of self-efficacy, being an implementer embedded in community B, and having more than 1 year of experience with IACO implementation were associated with higher degrees of adherence. Formal ratification of implementation by management and being prescribed a higher number of activities were related to lower degrees of adherence. We advise that, when designing implementation strategies, emphasis should be placed on the enhancement of professionals' self-efficacy, limitation of the number of activities prescribed and allocation of sufficient time to get acquainted and experienced with IACO implementation. Longitudinal studies are needed to further evaluate interaction between and change within critical determinants while progressing through the innovation process.

Practice and power: a review and interpretive synthesis focused on the exercise of discretionary power in policy implementation by front-line providers and managers

Tackling the implementation gap is a health policy concern in low- and middle-income countries (LMICs). Limited attention has so far been paid to the influence of power relations over this gap. This article presents, therefore, an interpretive synthesis of qualitative health policy articles addressing the question: how do actors at the front line of health policy implementation exercise discretionary power, with what consequences and why? The article also demonstrates the particular approach of thematic synthesis and contributes to discussion of how such work can inform future health policy research. The synthesis drew from a broader review of published research on any aspect of policy implementation in LMICs for the period 1994-2009. From an initial set of 50 articles identified as relevant to the specific review question, a sample of 16 articles were included in this review. Nine report experience around decentralization, a system-level change, and seven present experience of implementing a range of reproductive health (RH) policies (new forms of service delivery). Three reviewers were involved in a systematic process of data extraction, coding, analysis, synthesis and article writing. The review findings identify: the practices of power exercised by front-line health workers and their managers; their consequences for policy implementation and health system performance; the sources of this power and health workers' reasons for exercising power. These findings also provide the basis for an overarching synthesis of experience, highlighting the importance of actors, power relations and multiple, embedded contextual elements as dimensions of health system complexity. The significance of this synthesis lies in its insights about: the micropractices of power exercised by front-line providers; how to manage this power through local level strategies both to influence and empower providers to act in support of policy goals; and the focus and nature of future research on these issues.

A modified theoretical framework to assess implementation fidelity of adaptive public health interventions

BACKGROUND

One of the major debates in implementation research turns around fidelity and adaptation. Fidelity is the degree to which an intervention is implemented as intended by its developers. It is meant to ensure that the intervention maintains its intended effects. Adaptation is the process of implementers or users bringing changes to the original design of an intervention. Depending on the nature of the modifications brought, adaptation could either be potentially positive or could carry the risk of threatening the theoretical basis of the intervention, resulting in a negative effect on expected outcomes. Adaptive interventions are those for which adaptation is allowed or even encouraged. Classical fidelity dimensions and conceptual frameworks do not address the issue of how to adapt an intervention while still maintaining its effectiveness.

DISCUSSION

We support the idea that fidelity and adaptation co-exist and that adaptations can impact either positively or negatively on the intervention's effectiveness. For adaptive interventions, research should answer the question how an adequate fidelity-adaptation balance can be reached. One way to address this issue is by looking systematically at the aspects of an intervention that are being adapted. We conducted fidelity research on the implementation of an empowerment strategy for dengue prevention in Cuba. In view of the adaptive nature of the strategy, we anticipated that the classical fidelity dimensions would be of limited use for assessing adaptations. The typology we used in the assessment-implemented, not-implemented, modified, or added components of the strategy-also had limitations. It did not allow us to answer the question which of the modifications introduced in the strategy contributed to or distracted from outcomes. We confronted our empirical research with existing literature on fidelity, and as a result, considered that the framework for implementation fidelity proposed by Carroll et al. in 2007 could potentially meet our concerns. We propose modifications to the framework to assess both fidelity and adaptation. The modified Carroll et al.'s framework we propose may permit a comprehensive assessment of the implementation fidelity-adaptation balance required when implementing adaptive interventions, but more empirical research is needed to validate it.

Investigating variations in implementation fidelity of an organizational-level occupational health intervention

BACKGROUND

The workplace has been suggested as an important arena for health promotion, but little is known about how the organizational setting influences the implementation of interventions.

PURPOSE

The aims of this study are to evaluate implementation fidelity in an organizational-level occupational health intervention and to investigate possible explanations for variations in fidelity between intervention units.

METHOD

The intervention consisted of an integration of health promotion, occupational health and safety, and a system for continuous improvements (Kaizen) and was conducted in a quasi-experimental design at a Swedish hospital. Implementation fidelity was evaluated with the Conceptual Framework for Implementation Fidelity and implementation factors used to investigate variations in fidelity with the Framework for Evaluating Organizational-level Interventions. A multi-method approach including interviews, Kaizen notes, and questionnaires was applied.

RESULTS

Implementation fidelity differed between units even though the intervention was introduced and supported in the same way. Important differences in all elements proposed in the model for evaluating organizational-level interventions, i.e., context, intervention, and mental models, were found to explain the differences in fidelity.

CONCLUSION

Implementation strategies may need to be adapted depending on the local context. Implementation fidelity, as well as pre-intervention implementation elements, is likely to affect the implementation success and needs to be assessed in intervention research. The high variation in fidelity across the units indicates the need for adjustments to the type of designs used to assess the effects of interventions. Thus, rather than using designs that aim to control variation, it may be necessary to use those that aim at exploring and explaining variation, such as adapted study designs.

Role of context in care transition interventions for medically complex older adults: a realist synthesis protocol

INTRODUCTION

Approximately 30-50% of older adults have two or more conditions and are referred to as multimorbid or complex patients. These patients often require visits to various healthcare providers in a number of settings and are therefore susceptible to fragmented healthcare delivery while transitioning to receive care. Care transition interventions have been implemented to improve continuity of care, however, current evidence suggests that some interventions or components of interventions are only effective within certain contexts. There is therefore a need to unpack the mechanisms of how and within which contexts care transition interventions and their components are effective. Realist review is a synthesis method that explains how complex programmes work within various contexts. The purpose of this study is to explain the effect of context on the activities and mechanisms of care transition interventions in medically complex older adults using a realist review approach.

METHODS AND ANALYSIS

This synthesis will be guided by Pawson and colleagues' 2004 and 2005 protocols for conducting realist reviews. The underlying theories of care transition interventions were determined based on an initial literature search using relevant databases. English language peer-reviewed studies published after 1993 will be included. Several relevant databases will be searched using medical subject headings and text terms. A screening form will be piloted and titles, abstracts and full text of potentially relevant articles will be screened in duplicate. Abstracted data will include study characteristics, intervention type, contextual factors, intervention activities and underlying mechanisms. Patterns in Context-Activity-Mechanism-Outcome (CAMO) configurations will be reported.

ETHICS AND DISSEMINATION

Internal knowledge translation activities will occur throughout the review and existing partnerships will be leveraged to disseminate findings to frontline staff, hospital administrators and policymakers. Finalised results will be presented at local, national and international conferences, and disseminated via peer-reviewed publications in relevant journals.

Providing effective and preferred care closer to home: a realist review of intermediate care

Intermediate care is one of the number of service delivery models intended to integrate care and provide enhanced health and social care services closer to home, especially to reduce reliance on acute care hospital beds. In order for health and social care practitioners, service managers and commissioners to make informed decisions, it is vital to understand how to implement the admission avoidance and early supported discharge components of intermediate care within the context of local care systems. This paper reports the findings of a theory-driven (realist) review conducted in 2011-2012. A broad range of evidence contained in 193 sources was used to construct a conceptual framework for intermediate care. This framework forms the basis for exploring factors at service user, professional and organisational levels that should be considered when designing and delivering intermediate care services within a particular local context. Our synthesis found that involving service users and their carers in collaborative decision-making about the objectives of care and the place of care is central to achieving the aims of intermediate care. This pivotal involvement of the service user relies on practitioners, service managers and commissioners being aware of the impact that organisational structures at the local level can have on enabling or inhibiting collaborative decision-making and care co-ordination. Through all interactions with service users and their care networks, health and social care professionals should establish the meaning which alternative care environments have for different service users. Doing so means decisions about the best place of care will be better informed and gives service users choice. This in turn is likely to support psychological and social stability, and the attainment of functional goals. At an organisational level, integrated working can facilitate the delivery of intermediate care, but there is not a straightforward relationship between integrated organisational processes and integrated professional practice.

Implementing health promotion programmes in schools: a realist systematic review of research and experience in the United Kingdom

Background

Schools have long been viewed as a good setting in which to encourage healthy lifestyles amongst children, and schools in many countries aspire to more comprehensive, integrated approaches to health promotion. Recent reviews have identified evidence of the effects of school health promotion on children’s and young people’s health. However, understanding of how such programmes can be implemented in schools is more limited.

Methods

We conducted a realist review to identify the conditions and actions which lead to the successful implementation of health promotion programmes in schools. We used the international literature to develop programme theories which were then tested using evaluations of school health promotion programmes conducted in the United Kingdom (UK). Iterative searching and screening was conducted to identify sources and clear criteria applied for appraisal of included sources. A review advisory group comprising educational and public health practitioners, commissioners, and academics was established at the outset.

Results

In consultation with the review advisory group, we developed four programme theories (preparing for implementation, initial implementation, embedding into routine practice, adaptation and evolution); these were then refined using the UK evaluations in the review. This enabled us to identify transferable mechanisms and enabling and constraining contexts and investigate how the operation of mechanisms differed in different contexts. We also identified steps that should be taken at a senior level in relation to preparing for implementation (which revolved around negotiation about programme delivery) and initial implementation (which centred on facilitation, support, and reciprocity—the latter for both programme deliverers and pupils). However, the depth and rigour of evidence concerning embedding into routine practice and adaptation and evolution was limited.

Conclusions

Our findings provide guidance for the design, implementation, and evaluation of health promotion in schools and identify the areas where further research is needed.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-015-0338-6) contains supplementary material, which is available to authorized users.

Implementing health promotion programmes in schools: a realist systematic review of research and experience in the United Kingdom

BACKGROUND

Schools have long been viewed as a good setting in which to encourage healthy lifestyles amongst children, and schools in many countries aspire to more comprehensive, integrated approaches to health promotion. Recent reviews have identified evidence of the effects of school health promotion on children's and young people's health. However, understanding of how such programmes can be implemented in schools is more limited.

METHODS

We conducted a realist review to identify the conditions and actions which lead to the successful implementation of health promotion programmes in schools. We used the international literature to develop programme theories which were then tested using evaluations of school health promotion programmes conducted in the United Kingdom (UK). Iterative searching and screening was conducted to identify sources and clear criteria applied for appraisal of included sources. A review advisory group comprising educational and public health practitioners, commissioners, and academics was established at the outset.

RESULTS

In consultation with the review advisory group, we developed four programme theories (preparing for implementation, initial implementation, embedding into routine practice, adaptation and evolution); these were then refined using the UK evaluations in the review. This enabled us to identify transferable mechanisms and enabling and constraining contexts and investigate how the operation of mechanisms differed in different contexts. We also identified steps that should be taken at a senior level in relation to preparing for implementation (which revolved around negotiation about programme delivery) and initial implementation (which centred on facilitation, support, and reciprocity-the latter for both programme deliverers and pupils). However, the depth and rigour of evidence concerning embedding into routine practice and adaptation and evolution was limited.

CONCLUSIONS

Our findings provide guidance for the design, implementation, and evaluation of health promotion in schools and identify the areas where further research is needed.

A Systematic Review of Reporting Tools Applicable to Sexual and Reproductive Health Programmes: Step 1 in Developing Programme Reporting Standards

BACKGROUND

Complete and accurate reporting of programme preparation, implementation and evaluation processes in the field of sexual and reproductive health (SRH) is essential to understand the impact of SRH programmes, as well as to guide their replication and scale-up.

OBJECTIVES

To provide an overview of existing reporting tools and identify core items used in programme reporting with a focus on programme preparation, implementation and evaluation processes.

METHODS

A systematic review was completed for the period 2000-2014. Reporting guidelines, checklists and tools, irrespective of study design, applicable for reporting on programmes targeting SRH outcomes, were included. Two independent reviewers screened the title and abstract of all records. Full texts were assessed in duplicate, followed by data extraction on the focus, content area, year of publication, validation and description of reporting items. Data was synthesized using an iterative thematic approach, where items related to programme preparation, implementation and evaluation in each tool were extracted and aggregated into a consolidated list.

RESULTS

Out of the 3,656 records screened for title and abstracts, full texts were retrieved for 182 articles, out of which 108 were excluded. Seventy-four full text articles corresponding to 45 reporting tools were retained for synthesis. The majority of tools were developed for reporting on intervention research (n = 15), randomized controlled trials (n = 8) and systematic reviews (n = 7). We identified a total of 50 reporting items, across three main domains and corresponding sub-domains: programme preparation (objective/focus, design, piloting); programme implementation (content, timing/duration/location, providers/staff, participants, delivery, implementation outcomes), and programme evaluation (process evaluation, implementation barriers/facilitators, outcome/impact evaluation).

CONCLUSIONS

Over the past decade a wide range of tools have been developed to improve the reporting of health research. Development of Programme Reporting Standards (PRS) for SRH can fill a significant gap in existing reporting tools. This systematic review is the first step in the development of such standards. In the next steps, we will draft a preliminary version of the PRS based on the aggregate list of identified items, and finalize the tool using a consensus process among experts and user-testing.

Understanding how environmental enhancement and conservation activities may benefit health and wellbeing: a systematic review

BACKGROUND

Action taken to enhance or conserve outdoor environments may benefit health and wellbeing through the process of participation but also through improving the environment. There is interest, amongst both health and environmental organisations, in using such activities as health promotion interventions. The objective of this systematic review was to investigate the health and wellbeing impacts of participation in environmental enhancement and conservation activities and to understand how these activities may be beneficial, to whom and in what circumstances or contexts.

METHODS

A theory-led mixed-method systematic review was used to assess evidence of effect and to identify pathways to change (protocol: http://onlinelibrary.wiley.com/doi/ 10.1002/14651858.CD010351/full ). Due to the multi-disciplinary, dispersed and disparate body of evidence an extensive multi-stage search strategy was devised and undertaken. Twenty-seven databases and multiple sources of grey literature were searched and over 200 relevant organisations were contacted. The heterogenous evidence was synthesised using a narrative approach and a conceptual model was developed to illustrate the mechanisms of effect. Due to the limited nature of the evidence additional higher order evidence was sought to assess the plausibility of the proposed mechanisms of effect through which health and wellbeing may accrue.

RESULTS

The majority of the quantitative evidence (13 studies; all poor quality and lower-order study designs) was inconclusive, though a small number of positive and negative associations were observed. The qualitative evidence (13 studies; 10 poor quality, 3 good) indicated that the activities were perceived to have value to health and wellbeing through a number of key mechanisms; including exposure to natural environments, achievement, enjoyment and social contact. Additional high level evidence indicated that these pathways were plausible.

CONCLUSIONS

Despite interest in the use of environmental enhancement activities as a health intervention there is currently little direct evidence of effect, this is primarily due to a lack of robust study designs. Further rigorous research is needed to understand the potential of the activities to benefit health and environment.

Development, inter-rater reliability and feasibility of a checklist to assess implementation (Ch-IMP) in systematic reviews: the case of provider-based prevention and treatment programs targeting children and youth

BACKGROUND

Several papers report deficiencies in the reporting of information about the implementation of interventions in clinical trials. Information about implementation is also required in systematic reviews of complex interventions to facilitate the translation and uptake of evidence of provider-based prevention and treatment programs. To capture whether and how implementation is assessed within systematic effectiveness reviews, we developed a checklist for implementation (Ch-IMP) and piloted it in a cohort of reviews on provider-based prevention and treatment interventions for children and young people. This paper reports on the inter-rater reliability, feasibility and reasons for discrepant ratings.

METHODS

Checklist domains were informed by a framework for program theory; items within domains were generated from a literature review. The checklist was pilot-tested on a cohort of 27 effectiveness reviews targeting children and youth. Two raters independently extracted information on 47 items. Inter-rater reliability was evaluated using percentage agreement and unweighted kappa coefficients. Reasons for discrepant ratings were content analysed.

RESULTS

Kappa coefficients ranged from 0.37 to 1.00 and were not influenced by one-sided bias. Most kappa values were classified as excellent (n = 20) or good (n = 17) with a few items categorised as fair (n = 7) or poor (n = 1). Prevalence-adjusted kappa coefficients indicate good or excellent agreement for all but one item. Four areas contributed to scoring discrepancies: 1) clarity or sufficiency of information provided in the review; 2) information missed in the review; 3) issues encountered with the tool; and 4) issues encountered at the review level. Use of the tool demands time investment and it requires adjustment to improve its feasibility for wider use.

CONCLUSIONS

The case of provider-based prevention and treatment interventions showed relevancy in developing and piloting the Ch-IMP as a useful tool for assessing the extent to which systematic reviews assess the quality of implementation. The checklist could be used by authors and editors to improve the quality of systematic reviews, and shows promise as a pedagogical tool to facilitate the extraction and reporting of implementation characteristics.

Implementation of intersectoral community approaches targeting childhood obesity: a systematic review

The implementation of intersectoral community approaches targeting childhood obesity (IACO) is considered challenging. To help overcome these challenges, an overview of the evidence to date is needed. We searched four databases to identify papers that reported on the determinants of successful implementation of IACOs, resulting in the inclusion of 25 studies. We appraised study quality with the Crowe Critical Appraisal Tool and the Quality Framework; reported implementation outcome indicators were reviewed via narrative synthesis. Quality of included studies varied. The most frequently reported indicators of implementation success were fidelity and coverage. Determinants related to the social-political context and the organization were most often cited as influencing implementation, in particular, 'collaboration between community partners', 'the availability of (human) resources' and 'time available for implementation'. The association between determinants and implementation variability was never explicated. We conclude that although some insights into the effective implementation of IACOs are present, more research is needed. Emphasis should be placed on elucidating the relationship between determinants and implementation success. Research should further focus on developing a 'golden standard' for evaluating and reporting on implementation research. These actions will improve the comparison of study outcomes and may constitute the cumulative development of knowledge about the conditions for designing evidence-based implementation strategies.

Immigrant women's experiences of maternity-care services in Canada: a systematic review using a narrative synthesis

BACKGROUND

Canada's diverse society and its statutory commitment to multiculturalism means that a synthesis of knowledge related to the healthcare experiences of immigrants is essential to realise the health potential for future Canadians. Although concerns about the maternity experiences of immigrants in Canada are relatively new, recent national guidelines explicitly call for the tailoring of services to user needs. We therefore assessed the experiences of immigrant women accessing maternity-care services in Canada. In particular, we investigated the experiences of immigrant women in Canada in accessing and navigating maternity and related healthcare services from conception to 6 months postpartum in Canada. Our focus was on (a) the accessibility and acceptability of maternity-care services for immigrant women and (b) the effects of the perceptions and experiences of these women on their birth and postnatal outcomes.

METHODS

We conducted a systematic review using a systematic search and narrative synthesis of peer-reviewed and non-peer-reviewed reports of empirical research, with the aim of providing stakeholders with perspectives on maternity-care services as experienced by immigrant women. We partnered with key stakeholders ('integrated knowledge users') to ensure the relevancy of topics and to tailor recommendations for effective translation into future policy, practice and programming. Two search phases and a three-stage selection process for published and grey literature were conducted prior to appraisal of literature quality and narrative synthesis of the findings.

RESULTS

Our knowledge synthesis of maternity care among immigrants to Canada provided a coherent evidence base for (a) eliciting a better understanding of the factors that generate disparities in accessibility, acceptability and outcomes during maternity care; and (b) improving culturally based competency in maternity care. Our synthesis also identified pertinent issues in multiple sectors that should be addressed to configure maternity services and programs appropriately.

CONCLUSIONS

Although immigrant women in Canada are generally given the opportunity to obtain necessary services, they face many barriers in accessing and utilising these services. These barriers include lack of information about or awareness of the services, insufficient supports to access these services and discordant expectations between the women and their service providers.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO registration number: CRD42012002185 .

Understanding how appraisal of doctors produces its effects: a realist review protocol

INTRODUCTION

UK doctors are now required to participate in revalidation to maintain their licence to practise. Appraisal is a fundamental component of revalidation. However, objective evidence of appraisal changing doctors' behaviour and directly resulting in improved patient care is limited. In particular, it is not clear how the process of appraisal is supposed to change doctors' behaviour and improve clinical performance. The aim of this research is to understand how and why appraisal of doctors is supposed to produce its effect.

METHODS AND ANALYSIS

Realist review is a theory-driven interpretive approach to evidence synthesis. It applies realist logic of inquiry to produce an explanatory analysis of an intervention that is, what works, for whom, in what circumstances, in what respects. Using a realist review approach, an initial programme theory of appraisal will be developed by consulting with key stakeholders in doctors' appraisal in expert panels (ethical approval is not required), and by searching the literature to identify relevant existing theories. The search strategy will have a number of phases including a combination of: (1) electronic database searching, for example, EMBASE, MEDLINE, the Cochrane Library, ASSIA, (2) 'cited by' articles search, (3) citation searching, (4) contacting authors and (5) grey literature searching. The search for evidence will be iteratively extended and refocused as the review progresses. Studies will be included based on their ability to provide data that enable testing of the programme theory. Data extraction will be conducted, for example, by note taking and annotation at different review stages as is consistent with the realist approach. The evidence will be synthesised using realist logic to interrogate the final programme theory of the impact of appraisal on doctors' performance. The synthesis results will be written up according to RAMESES guidelines and disseminated through peer-reviewed publication and presentations.

TRIAL REGISTRATION NUMBER

The protocol is registered with PROSPERO 2014:CRD42014007092.

Creating a national home visiting research network

Home visiting can play a key role in the early childhood system of services. For home visiting to achieve its potential, decision-makers must make informed choices regarding adoption, adaptation, coordination, scale-up, and sustainment. We need a coordinated, focused, and theory-based home visiting research infrastructure to inform such decisions. The transdisciplinary Home Visiting Research Network (HVRN) was established in July 2012 with funding from the Health Resources and Services Administration. Its goal is to promote the translation of research findings into policy and practice. Its objectives are to (1) develop a national home visiting research agenda, (2) advance the use of innovative research methods; and (3) provide a research environment that is supportive of the professional development of emerging researchers interested in home visiting. A Management Team designs and directs activities to achieve these objectives through Work Teams. A Steering Committee of national leaders representing stakeholder groups oversees progress. HVRN's Coordinating Center supports the Work Teams and HVRN's Home visiting Applied Research Collaborative, a practice-based research network of home visiting programs. This article describes HVRN's rationale, approach, and anticipated products. We use home visiting-primary care coordination as an illustration, noting potential roles for pediatric practices and pediatric researchers and research educators in HVRN activities. HVRN creates the infrastructure for a rigorous program of research to inform policy and practice on home visiting as part of the system of services to improve family functioning, parenting, and child outcomes.

Immigrant women's experiences of postpartum depression in Canada: a protocol for systematic review using a narrative synthesis

BACKGROUND

Literature documents that immigrant women in Canada have a higher prevalence of postpartum depression symptomatology than Canadian-born women. There exists a need to synthesize information on the contextual factors and social determinants of health that influence immigrant women's reception of and behavior in accessing existing mental health services. Our research question is: what are the ethnoculturally defined patterns of help-seeking behaviors and decision-making and other predictive factors for therapeutic mental health care access and outcomes with respect to postpartum depression for immigrant women in Canada?

METHODS/DESIGN

Our synthesis incorporates a systematic review using narrative synthesis of reports (peer- and non-peer reviewed) of empirical research and aims to provide stakeholders with perspectives on postpartum mental health care services as experienced by immigrant women. To reach this goal we are using integrated knowledge translation, thus partnering with key stakeholders throughout the planning, implementation and dissemination stages to ensure topic relevancy and impact on future practice and policy. The search and selection strategies draw upon established systematic review methodologies as outlined by the Centre for Reviews and Dissemination and also incorporate guidelines for selection and appraisal of gray literature. Two search phases (a database and a gray literature phase) will identify literature for screening and final selection based on an inclusion/exclusion checklist. Quality appraisal will be performed using the tools produced by the Centre for Evidence Based Management. The narrative synthesis will be informed by Popay et al. (2006) framework using identified tools for each of its four elements. The integrated knowledge translation plan will ensure key messages are delivered in an audience-specific manner to optimize their impact on policy and practice change throughout health service, public health, immigration and community sectors.

DISCUSSION

The narrative synthesis methodology will facilitate understandings and acknowledgement of the broader influences of theoretical and contextual variables, such as race, gender, socio-economic status, pre-migration history and geographical location. Our review aims to have a substantive and sustainable impact on health outcomes, practice, programs and/or policy in the context of postpartum mental health of immigrant women. PROSPERO registration number CRD42012003020.

Implementing health promotion in schools: protocol for a realist systematic review of research and experience in the United Kingdom (UK)

BACKGROUND

School-based interventions and campaigns are used to promote health and address a wide variety of public health problems. Schools are considered to be key sites for the implementation of health promotion programmes for their potential to reach the whole population in particular age-groups and instil healthy patterns of behavior early in life. However, evidence for the effectiveness of school-based health promotion interventions is highly variable. Systematic reviews of the evidence of school-based interventions tend to be highly problem- or intervention- specific, thereby missing potential generic insights into implementation and effectiveness of such programmes across problems.

METHODS/DESIGN

A realist systematic review will be undertaken to explain how, why and in what circumstances schools can provide feasible settings for effective health promotion programmes in the United Kingdom (UK). The review will be conducted in two phases. Phase 1 will identify programme theories about implementation (ideas about what enables or inhibits effective health promotion to be delivered in a school setting). Phase 2 will test the programme theories so that they can be challenged, endorsed and/or refined. A Review Advisory Group of education and health professionals will be convened to help identify and choose potential programme theories, provide a 'reality check' on the clarity and explanatory strength of the mechanisms to be tested, and help shape the presentation of findings to be usable by practitioners and decision-makers. Review findings will be disseminated through liaison with decision-makers, and voluntary and professional groups in the fields of education and health.

Using documents to investigate links between implementation and sustainability in a complex community intervention: the PRISM study

The increasing imperative to find what works in health services has meant a rise in research trialing interventions deemed 'complex'. While the strength of these interventions comes from taking a 'whole of problem' approach using multiple and inter-linking strategies, ways of examining implementation are under-explored. Building sustainability is an important part of implementing complex intervention research, but this too has received little exploration in the implementation literature. This paper explores issues of implementation and sustainability by examining the case of PRISM (Program of Resources, Information and Support for Mothers), a community randomised trial in Victoria, Australia aimed at improving maternal health and wellbeing. It examines documents placed on the project website. Three groups of documents relating to implementation of the intervention were examined - implementation reports, media reports and community newsletters. Analysing these documents allowed a focus on the 'work' of the intervention - who does the work and what activities comprise the work - in order to examine implementation as it relates to sustainability. Document analysis provides a useful way of considering implementation and sustainability of complex intervention research. It can 'value add' to findings from process evaluation and extend our understanding of an intervention beyond outcome measures. Analysis of the documents in this case provides insights into why sustainability of an intervention may be difficult to achieve during implementation.

Immigrant women's experiences of maternity-care services in Canada: a protocol for systematic review using a narrative synthesis

BACKGROUND

Canada's diverse society and statutory commitment to multiculturalism means that the synthesis of knowledge related to the health care experiences of immigrants is essential to realize the health potential for future Canadians. Although concerns about the maternity experiences of immigrants in Canada are relatively new, recent national guidelines explicitly call for tailoring of services to user needs. We are therefore assessing the experiences of immigrant women in Canada accessing maternity-care services. We are focusing on: 1) accessibility and acceptability (as an important dimension of access) to maternity-care services as perceived and experienced by immigrant women, and 2) the birth and postnatal outcomes of these women.

METHODS

The aim of this study is to use a narrative synthesis, incorporating both a systematic review using narrative synthesis of reports of empirical research (qualitative, quantitative, and mixed-method designs), and a literature review of non-empirically based reports, both of which include 'grey' literature. The study aims to provide stakeholders with perspectives on maternity-care services as experienced by immigrant women. To achieve this, we are using integrated knowledge translation, partnering with key stakeholders to ensure topic relevancy and to tailor recommendations for effective translation into future policy and practice/programming. Two search phases and a three-stage selection process are being conducted (database search retrieved 1487 hits excluding duplicates) to provide evidence to contribute jointly to both the narrative synthesis and the non-empirical literature review. The narrative synthesis will be informed by the previous framework published in 2006 by Popay et al., using identified tools for each of its four elements. The non-empirical literature review will build upon the narrative-synthesis findings and/or identify omissions or gaps in the empirical research literature. The integrated knowledge translation plan will ensure that key messages are delivered in an audience-specific manner to optimize their effect on policy and practice change throughout the health service, and the public health, immigration and community sectors.

DISCUSSION

Narrative-synthesis methods of systematic review facilitate understanding and acknowledgement of the broader influences of theoretical and contextual variables, such as race, gender, socioeconomic status, and geographical location. They also enable understanding of the shaping of differences between reported outcomes and study designs related to childbearing populations, and the development and implementation of maternity services and health interventions across diverse settings.

PROSPERO REGISTRATION

Number 2185.

The role of systematic reviews of qualitative evidence in evaluating interventions: a case study

Systematic reviews of qualitative evidence have been widely used to provide information on the context and implementation of interventions, and their potential barriers and facilitators. However, such reviews face a number of methodological challenges, and there are ongoing debates as to how qualitative evidence can best be used to inform our understanding of interventions. In this paper, we use a case study of two systematic reviews of qualitative evidence on the prevention of skin cancer to explore these issues. We find that qualitative evidence not directly related to interventions is likely to be of value for such reviews, that it is often not possible to construct fully comprehensive search strategies, and that there are diminishing returns to the synthesis, in terms of added value or insight, from the inclusion of large numbers of primary studies. We conclude that there are a number of ways in which systematic reviews of qualitative evidence can be utilised in conjunction with evidence on intervention effectiveness, without compromising the rigour of the review process. In particular, the use of theory to inform frameworks for synthesis is a promising way to integrate a broader range of qualitative evidence. Copyright © 2012 John Wiley & Sons, Ltd.

Identifying facilitators and barriers for home injury prevention interventions for pre-school children: a systematic review of the quantitative literature

Injuries are the leading cause of childhood death internationally; steep social gradients exist in mortality and morbidity. The majority of pre-school injuries occur in the home, but implementing research into practice for injury prevention has received little attention. This systematic review describes key facilitators and barriers when implementing injury prevention interventions. The review used articles included in a Cochrane systematic review of the effectiveness of home safety education, with or without the provision of safety equipment. Each paper was screened to ensure that children under 5 years, intervention details and process measures and/or barriers and facilitators were included. Two authors independently reviewed each paper and extracted data. Themes were identified and framework analysis used in an iterative process. Ninety-nine papers were identified, 42 excluded and 57 included in the analysis. Seven facilitators and six barriers were identified. Facilitators related to the approach used, focused messages, minimal changes, deliverer characteristics, equipment accessibility, behaviour change and including incentives. The barriers included complex interventions, cultural, socio-economic, physical and behavioural barriers and deliverer constraints. Barriers and facilitators should be addressed when implementing injury prevention interventions and studies should explicitly explore factors that help or hinder the process.