Looking inside the black box: results of a theory-based process evaluation exploring the results of a randomized controlled trial of printed educational messages to increase primary care physicians' diabetic retinopathy referrals [Trial registration number ISRCTN72772651]

Implementing traumatic brain injury screening in behavioral health treatment settings: results of an explanatory sequential mixed-methods investigation

BACKGROUND

Traumatic brain injury (TBI) is a complex condition common among individuals treated in behavioral healthcare, but TBI screening has not been adopted in these settings which can affect optimal clinical decision-making. Integrating evidence-based practices that address complex health comorbidities into behavioral healthcare settings remains understudied in implementation science, limited by few studies using theory-driven hypotheses to disentangle relationships between proximal and medial indicators on distal implementation outcomes. Grounded in the Theory of Planned Behavior, we examined providers' attitudes, perceived behavioral control (PBC), subjective norms, and intentions to adopt The Ohio State University TBI Identification Method (OSU TBI-ID) in behavioral healthcare settings.

METHODS

We used an explanatory sequential mixed-methods design. In Phase I, 215 providers from 25 organizations in the USA completed training introducing the OSU TBI-ID, followed by a survey assessing attitudes, PBC, norms, and intentions to screen for TBI. After 1 month, providers completed another survey assessing the number of TBI screens conducted. Data were analyzed using structural equation modeling (SEM) with logistic regressions. In Phase II, 20 providers were purposively selected for semi-structured interviews to expand on SEM results. Qualitative data were analyzed using thematic analysis, integrated with quantitative results, and combined into joint displays.

RESULTS

Only 25% (55/215) of providers adopted TBI screening, which was driven by motivations to trial the intervention. Providers who reported more favorable attitudes (OR: 0.67, p < .001) and greater subjective norms (OR: 0.12, p < .001) toward TBI screening demonstrated increased odds of intention to screen, which resulted in greater TBI screening adoption (OR: 0.30; p < .01). PBC did not affect intentions or adoption. Providers explained that although TBI screening can improve diagnostic and clinical decision-making, they discussed that additional training, leadership engagement, and state-level mandates are needed to increase the widespread, systematic uptake of TBI screening.

CONCLUSIONS

This study advances implementation science by using theory-driven hypothesis testing to disentangle proximal and medial indicators at the provider level on TBI screening adoption. Our mixed-methods approach added in-depth contextualization and illuminated additional multilevel determinants affecting intervention adoption, which guides a more precise selection of implementation strategies.

"Augmenting the referral pathway for retinal services among diabetic patients at Reiyukai Eiko Masunaga Eye Hospital, Nepal: a non-randomized, pre-post intervention study"

BACKGROUND

Diabetic Retinopathy (DR) is an important public health issue in Nepal. Despite the availability of retinal services, people may not access them because of the lack of knowledge about DR and poor referral systems. DR screening uptake was low at Reiyukai Eiko Masunaga Eye Hospital(REMEH) since retina services were started. Scheer Memorial Hospital is a multispeciality hospital near to REMEH. It has no eye department but has been running a regular diabetic clinic. This was a site for referring diabetic patients for DR screening. Improving DR awareness among general physicians has the potential to address these challenges.

METHODS

The aim of our study was to investigate the effectiveness of providing health education to selected health personnel and establish a referral pathway on the attendance of diabetic patients for retinal screening at REMEH. This was a non-randomized, pre-post intervention study design. Total of three health education sessions were provided to the health care professionals of Scheer on diabetic retinopathy using Power Point presentations, posters, pamphlets and videos. The study period was 16 months (2020 June -2021 September) and divided into 8 months pre-intervention(baseline data collection) and 8 months post intervention period. The proportional increase in number of diabetes attendance pre and post intervention was calculated by Z test. The change in knowledge of health care personnels pre and post intervention was scored and evaluated through a questionnaire and calculated by paired- t test. Data was analyzed using Excel and Epi Info 7.The Protocol was published on August 21, 2021, in JMIR Publications.

RESULTS

The proportional increase in number of referrals of diabetes attendance post intervention increased from 50 to 95% and was statistically significant (p < 0.001, 95% CI: 0.214-0.688). The mean score of knowledge gained by physicians on DR awareness was more at post intervention (8.8 ± 1.32) than pre intervention (6.4 ± 1.51). It was statistically significant (p < 0.001).

CONCLUSION

This study shows that a well-planned health education intervention changes the knowledge in physicians about DR. There is an increase in the number of referrals and attendance of patients for DR screening with the change in knowledge and referral mechanism.

TRIAL REGISTRATION

Clinical Trials.gov NCT04829084; https://clinicaltrials.gov/ct2/show/NCT04829084 :02/04/2021.

Barriers and Enablers to Delegating Malnutrition Care Activities to Dietitian Assistants

Delegation of malnutrition care to dietitian assistants can positively influence patient, healthcare, and workforce outcomes. However, nutrition care for hospital inpatients with or at risk of malnutrition remains primarily individually delivered by dietitians—an approach that is not considered sustainable. This study aimed to identify barriers and enablers to delegating malnutrition care activities to dietitian assistants. This qualitative descriptive study was nested within a broader quality assurance activity to scale and spread systematised and interdisciplinary malnutrition models of care. Twenty-three individual semi-structured interviews were completed with nutrition and dietetic team members across seven hospitals. Inductive thematic analysis was undertaken, and barriers and enablers to delegation of malnutrition care to dietitian assistants were grouped into four themes: working with the human factors; balancing value and risk of delegation; creating competence, capability, and capacity; and recognizing contextual factors. This study highlights novel insights into barriers and enablers to delegating malnutrition care to dietitian assistants. Successful delegation to dietitian assistants requires the unique perspectives of humans as individuals and in their collective healthcare roles, moving from words to actions that value delegation; engaging in processes to improve competency, capability, and capacity of all; and being responsive to climate and contextual factors.

The use of theory in process evaluations conducted alongside randomized trials of implementation interventions: A systematic review

Interventions to implement changes into health care practice (i.e., implementation interventions) are critical to improving care but their effects are poorly understood. Two strategies to better understand intervention effects are conducting process evaluations and using theoretical approaches (i.e., theories, models, frameworks). The extent to which theoretical approaches have been used in process evaluations conducted alongside trials of implementation interventions is unclear. In this study context, we reviewed (a) the proportion of process evaluations citing theoretical approaches, (b) which theoretical approaches were cited, and (c) whether and how theories were used. Systematic review (PROSPERO: CRD42016042789). MEDLINE, PsycINFO, Embase, CINAHL, and Cochrane CENTRAL were searched up to July 31, 2017. For all studies, data extraction included names and types of theoretical approaches cited. For studies citing a theory, data extraction included study characteristics and extent of theory use (i.e., "informed by," "applied," "tested," "built/created" theory). We identified 123 process evaluations. Key findings: (a) 77 (63%) process evaluations cited a theoretical approach; (b) the most cited theory was normalization process theory; (c) 32 (26%) process evaluations used theory: 7 (22%) were informed by, 18 (56%) applied, 7 (22%) tested, and none built/created theory. Although nearly two thirds of process evaluations cited a theoretical approach, only a quarter were informed by, applied, or tested a theory-despite the potential complementarity of these strategies. When theory was used, it was primarily applied. Using theory more substantively in process evaluations may accelerate our understanding of how implementation interventions operate.

Implementation fidelity of the Systems for Person-Centered Elder Care (SPEC): a process evaluation study

BACKGROUND

The Systems for Person-Centered Elder Care (SPEC), a complex intervention, was conducted to examine its effectiveness as a technology-enhanced, multidisciplinary, and integrated care model for frail older persons among ten nursing homes (NHs) in South Korea where formal long-term care has recently been introduced. The purpose of this study was to evaluate the implementation fidelity of the SPEC intervention and to identify moderating factors that influence the implementation fidelity.

METHODS

This study was a process evaluation based on an evidence-based framework for implementation fidelity using a mixed-methods design. Quantitative data from consultant logbooks, NH documentations, an information and communications technology (ICT) system, and a standardized questionnaire were collected from April 2015 to December 2016 and analyzed by calculating the descriptive statistics. Semi-structured focus group interviews were held with multidisciplinary teams from the participating NHs. Qualitative data from a semi-structured questionnaire and the focus group interviews were analyzed using content analysis.

RESULTS

The SPEC program demonstrated good implementation fidelity, and adherence to the SPEC program was strong in all aspects, such as content, coverage, frequency, and duration. Of the participating on-site coordinators, 60% reported that the SPEC model positively impacted needs assessment and the reporting system for resident care. The important facilitating factors were tailored facilitating strategies, assurance of the quality of delivery, and recruitment strategies.

CONCLUSION

The effectiveness of the SPEC program was driven by good implementation fidelity. The key factors of good implementation fidelity were tailored delivery of evidence-based interventions over process evaluation work, facilitating strategies, and ICT support. Larger implementation studies with a more user-friendly ICT system are recommended.

TRIAL REGISTRATION

ISRCTN registry, ISRCTN11972147 . Registered on 16 March 2015.

Barriers to and enablers of attendance at diabetic retinopathy screening experienced by immigrants to Canada from multiple cultural and linguistic minority groups

AIM

To identify barriers to/enablers of attendance at eye screening among three groups of immigrantsto Canada from cultural/linguistic minority groups living with diabetes.

METHODS

Using a patient-oriented research approach leveraging Diabetes Action Canada's patient engagement platform, we interviewed a purposeful sample of people with type 2 diabetes who had immigrated to Canada from: Pakistan (interviews in Urdu), China (interviews in Mandarin) and French-speaking African and Caribbean nations (interviews in French). We collected and analysed data based on the Theoretical Domains Framework covering key modifiable factors that may operate as barriers to or enablers of attending eye screening. We used directed content analysis to code barrier/enabler domains. Barriers/enablers were mapped to behaviour change techniques to inform future intervention development.

RESULTS

We interviewed 39 people (13 per group). Many barriers/enablers were consistent across groups, including views about harms caused by screening itself, practical appointment issues including forgetting, screening costs, wait times and making/getting to an appointment, lack of awareness about retinopathy screening, language barriers, and family and clinical support. Group-specific barriers/enablers included a preference to return to one's country of birth for screening, the impact of winter, and preferences for alternative medicine.

CONCLUSION

Our results can inform linguistic and culturally competent interventions to support immigrants living with diabetes in attending eye screening to prevent avoidable blindness.

Enhancing the translation of health behaviour change research into practice: a selective conceptual review of the synergy between implementation science and health psychology

Health psychology is at the forefront of developing and disseminating evidence, theories, and methods that have improved the understanding of health behaviour change. However, current dissemination approaches may be insufficient for promoting broader application and impact of this evidence to benefit the health of patients and the public. Nevertheless, behaviour change theory/methods typically directed towards health behaviours are now used in implementation science to understand and support behaviour change in individuals at different health system levels whose own behaviour impacts delivering evidence-based health behaviour change interventions. Despite contributing to implementation science, health psychology is perhaps doing less to draw from it. A redoubled focus on implementation science in health psychology could provide novel prospects for enhancing the impact of health behaviour change evidence. We report a Health Psychology Review-specific review-of-reviews of trials of health behaviour change interventions published from inception to April 2020. We identified 34 reviews and assessed whether implementation readiness of behaviour change interventions was discussed. We then narratively review how implementation science has integrated theory/methods from health psychology and related discipline. Finally, we demonstrate how greater synergy between implementation science and health psychology could promote greater follow-through on advances made in the science of health behaviour change.

Designing and undertaking randomised implementation trials: guide for researchers

Implementation science is the study of methods to promote the systematic uptake of evidence based interventions into practice and policy to improve health. Despite the need for high quality evidence from implementation research, randomised trials of implementation strategies often have serious limitations. These limitations include high risks of bias, limited use of theory, a lack of standard terminology to describe implementation strategies, narrowly focused implementation outcomes, and poor reporting. This paper aims to improve the evidence base in implementation science by providing guidance on the development, conduct, and reporting of randomised trials of implementation strategies. Established randomised trial methods from seminal texts and recent developments in implementation science were consolidated by an international group of researchers, health policy makers, and practitioners. This article provides guidance on the key components of randomised trials of implementation strategies, including articulation of trial aims, trial recruitment and retention strategies, randomised design selection, use of implementation science theory and frameworks, measures, sample size calculations, ethical review, and trial reporting. It also focuses on topics requiring special consideration or adaptation for implementation trials. We propose this guide as a resource for researchers, healthcare and public health policy makers or practitioners, research funders, and journal editors with the goal of advancing rigorous conduct and reporting of randomised trials of implementation strategies.

The effect of educational program based on theory of planned behavior on promoting retinopathy preventive behaviors in patients with type 2 diabetes: RCT

BACKGROUND

Diabetic retinopathy is the most common microvascular complication of diabetes and it is a leading cause of visual impairment and blindness among patients with diabetes. This study aimed to investigate the effect of educational program based on Theory of Planned Behavior (TPB) on promoting retinopathy preventive behaviors in patients with type 2 diabetes.

METHODS

The present study is an educational randomized controlled trial research that was conducted on 94 patients with type 2 diabetes who had gone to diabetes clinic. The samples were randomly assigned to the intervention (N = 47) and control groups (N = 47). Data collection instrument was a researcher-made questionnaire based on TPB and FBS and HbA1C tests. Then, educational program was performed for the intervention group through four educational sessions. After 3 months, data collection was repeated for the two groups and FBS, HbA1C testes were done again and data were analyzed.

RESULTS

The performance of the intervention group on preventive behaviors of retinopathy increased from 2.48 ± 1.42 to 4.48 45 1.45 after the education (p < 0.001). The mean of FBS and HbA1c in the intervention group also decreased after the intervention (P < 0.05).

CONCLUSION

Applying the TPB model proved is very effective in developing an educational program for patients with diabetes, to control their blood sugar and enhance preventive behaviors of retinopathy. Besides such programs, follow-up education for controlling and monitoring are highly recommended. This theory serves as a helpful theoretical framework for health-related behaviors and can be an appropriate pattern to plan for educational interventions.

TRIAL REGISTRATION

This trial has been registered at Iranian Registry of Clinical Trials, IRCT20180819040834N1 . Prospectively registered 8 Apr 2019, https://en.irct.ir/trial/38401.

Learning Integrated Health System to Mobilize Context-Adapted Knowledge With a Wiki Platform to Improve the Transitions of Frail Seniors From Hospitals and Emergency Departments to the Community (LEARNING WISDOM): Protocol for a Mixed-Methods Implementation Study

BACKGROUND

Elderly patients discharged from hospital experience fragmented care, repeated and lengthy emergency department (ED) visits, relapse into their earlier condition, and rapid cognitive and functional decline. The Acute Care for Elders (ACE) program at Mount Sinai Hospital in Toronto, Canada uses innovative strategies, such as transition coaches, to improve the care transition experiences of frail elderly patients. The ACE program reduced the lengths of hospital stay and readmission for elderly patients, increased patient satisfaction, and saved the health care system over Can $4.2 million (US $2.6 million) in 2014. In 2016, a context-adapted ACE program was implemented at one hospital in the Centre intégré de santé et de services sociaux de Chaudière-Appalaches (CISSS-CA) with a focus on improving transitions between hospitals and the community. The quality improvement project used an intervention strategy based on iterative user-centered design prototyping and a "Wiki-suite" (free web-based database containing evidence-based knowledge tools) to engage multiple stakeholders.

OBJECTIVE

The objectives of this study are to (1) implement a context-adapted CISSS-CA ACE program in four hospitals in the CISSS-CA and measure its impact on patient-, caregiver-, clinical-, and hospital-level outcomes; (2) identify underlying mechanisms by which our context-adapted CISSS-CA ACE program improves care transitions for the elderly; and (3) identify underlying mechanisms by which the Wiki-suite contributes to context-adaptation and local uptake of knowledge tools.

METHODS

Objective 1 will involve staggered implementation of the context-adapted CISSS-CA ACE program across the four CISSS-CA sites and interrupted time series to measure the impact on hospital-, patient-, and caregiver-level outcomes. Objectives 2 and 3 will involve a parallel mixed-methods process evaluation study to understand the mechanisms by which our context-adapted CISSS-CA ACE program improves care transitions for the elderly and by which our Wiki-suite contributes to adaptation, implementation, and scaling up of geriatric knowledge tools.

RESULTS

Data collection started in January 2019. As of January 2020, we enrolled 1635 patients and 529 caregivers from the four participating hospitals. Data collection is projected to be completed in January 2022. Data analysis has not yet begun. Results are expected to be published in 2022. Expected results will be presented to different key internal stakeholders to better support the effort and resources deployed in the transition of seniors. Through key interventions focused on seniors, we are expecting to increase patient satisfaction and quality of care and reduce readmission and ED revisit.

CONCLUSIONS

This study will provide evidence on effective knowledge translation strategies to adapt best practices to the local context in the transition of care for elderly people. The knowledge generated through this project will support future scale-up of the ACE program and our wiki methodology in other settings in Canada.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04093245; https://clinicaltrials.gov/ct2/show/NCT04093245.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/17363.

The value of social practice theory for implementation science: learning from a theory-based mixed methods process evaluation of a randomised controlled trial

Background

Although there is trial evidence that complex interventions are effective for the self-management of heart failure, little evidence supports their effectiveness in routine practice. We used Social Practice Theory to guide a Type 1 Hybrid Trial: a mixed methods process evaluation of a complex intervention for heart failure. The objective of this paper is to explore the value of Social Practice Theory for implementation science.

Methods

Social Practice Theory informed a mixed methods process evaluation of a multi-centre randomised controlled trial of a 12 week home-based intervention to optimise self-care support for people with heart failure and their caregivers - Rehabilitation EnAblement in Chronic Heart Failure (REACH-HF). Interviews were conducted with 19 people with heart failure and 17 caregivers at 4 months and 12 months after recruitment into the trial. Cases were constructed at the level of the individual, couple, facilitator and centre; and included multi-modal process and outcome data. Evaluative coding and subsequent within- and cross-case analyses enabled the development of a typology of relationships linking fidelity of intervention delivery and tailoring of content to individual needs and concerns. Social Practice Theory was used to interrogate the relationships between elements of the intervention and their implementation.

Results

Of 216 trial participants, 107 were randomised to the intervention (REACH-HF plus usual care). The intervention was most effective when fidelity was high and delivery was tailored to the individual’s needs, but less effective when both tailoring and fidelity were low. Theory-based analysis enabled us to model complex relationships between intervention elements (competencies, materials and meanings) and social context. The findings illustrate how intervention fidelity and tailoring are contextual and how the effectiveness of the REACH-HF intervention depended on both optimal alignment and implementation of these elements.

Conclusion

The study demonstrates the utility of theory-based analysis which integrates data from multiple sources to highlight contexts and circumstances in which interventions work best. Social Practice Theory provides a framework for guiding and analysing the processes by which a complex intervention is evaluated in a clinical trial, and has the potential to guide context-specific implementation strategies for clinical practice.

Trial registration

ISRCTN, IISRCTN86234930. Registered 13th November 2014.

Understanding implementation success: protocol for an in-depth, mixed-methods process evaluation of a cluster randomised controlled trial testing methods to improve detection of Lynch syndrome in Australian hospitals

INTRODUCTION

In multisite intervention trials, implementation success often varies widely across settings. Process evaluations are crucial to interpreting trial outcomes and understanding contextual factors and causal chains necessary for successful implementation. Lynch syndrome is a hereditary cancer predisposition conferring an increased risk of colorectal, endometrial and other cancer types. Despite systematic screening protocols to identify Lynch syndrome, the condition remains largely underdiagnosed. The Hide and Seek Project ('HaSP') is a cluster randomised controlled trial determining the effectiveness of two approaches to improving Lynch syndrome detection at eight Australian hospital networks. To enhance widespread implementation of optimal Lynch syndrome identification, there is a need to understand not only what works, but also why, in what contexts, and at what costs. Here we describe an in-depth investigation of factors influencing successful implementation of procedures evaluated in the HaSP trial.

METHODS AND ANALYSIS

A mixed-methods, theory-driven process evaluation will be undertaken in parallel to the HaSP trial. Data will include: interviews of Implementation Leads and Lynch syndrome stakeholders, pre-post implementation questionnaires, audio analysis of meetings and focus groups, observation of multidisciplinary team meetings, fidelity checklists and project log analysis. Results will be triangulated and coded, drawing on the Theoretical Domains Framework, Consolidated Framework for Implementation Research and Proctor's implementation outcomes.

ETHICS AND DISSEMINATION

Use of a theory-based process evaluation will enhance interpretation and generalisability of HaSP trial findings, and contribute to the implementation research field by furthering understanding of the conditions necessary for implementation success. Ethical approval has been granted and results will be disseminated via publications in peer-reviewed journals and conference presentations. At trial completion, key findings will be fed back to sites to enable refinement of intervention strategies, both in the context of Lynch syndrome and for the possible generalisability of intervention components in other genetic and broader clinical specialties.

HASP TRIAL REGISTRATION NUMBER

Australian New Zealand Clinical Trials Registry (Identifier: ACTRN12618001072202). Registered 27 June 2018. http://www.ANZCTR.org.au/ACTRN12618001072202.aspx.

De-implementing wisely: developing the evidence base to reduce low-value care

Choosing Wisely (CW) campaigns globally have focused attention on the need to reduce low-value care, which can represent up to 30% of the costs of healthcare. Despite early enthusiasm for the CW initiative, few large-scale changes in rates of low-value care have been reported since the launch of these campaigns. Recent commentaries suggest that the focus of the campaign should be on implementation of evidence-based strategies to effectively reduce low-value care. This paper describes the Choosing Wisely De-Implementation Framework (CWDIF), a novel framework that builds on previous work in the field of implementation science and proposes a comprehensive approach to systematically reduce low-value care in both hospital and community settings and advance the science of de-implementation.The CWDIF consists of five phases: Phase 0, identification of potential areas of low-value healthcare; Phase 1, identification of local priorities for implementation of CW recommendations; Phase 2, identification of barriers to implementing CW recommendations and potential interventions to overcome these; Phase 3, rigorous evaluations of CW implementation programmes; Phase 4, spread of effective CW implementation programmes. We provide a worked example of applying the CWDIF to develop and evaluate an implementation programme to reduce unnecessary preoperative testing in healthy patients undergoing low-risk surgeries and to further develop the evidence base to reduce low-value care.

Peer-support to increase uptake of screening for diabetic retinopathy: process evaluation of the DURE cluster randomized trial

BACKGROUND

There is limited evidence on how implementation of peer support interventions influences effectiveness, particularly for individuals with diabetes. We conducted a cluster randomized controlled trial to compare the effectiveness of a peer-led health education package versus usual care to increase uptake of screening for diabetic retinopathy (DR).

METHODS

Our process evaluation used a mixed-method design to investigate the recruitment and retention, reach, dose, fidelity, acceptability, and context of implementation, and was guided by the Consolidated Framework for Implementation Research (CFIR). We reviewed trial documents, conducted semi-structured interviews with key informants (n = 10) and conducted four focus group discussions with participants in both arms of the trial. Three analysts undertook CFIR theory-driven content analysis of the qualitative data. Quantitative data was analyzed to provide descriptive statistics relevant to the objectives of the process evaluation.

RESULTS

The trial had positive implementation outcomes, 100% retention of clusters and 96% retention for participants, 83% adherence to delivery of content of group talks (fidelity), and 78% attendance (reach) to at least 50% (3/6) of the group talks (dose). The data revealed that intervention characteristics, outer setting, inner setting, individual characteristics, and process (all the constructs of CFIR) influenced the implementation. There were more facilitators than barriers to the implementation. Facilitators included the relative advantage of the intervention compared with current practice (intervention characteristics); awareness of the growing prioritization of diabetes in the national health policy framework (outer setting); tension for change due to the realization of the vulnerability to vision loss from DR (inner setting); a strong collective sense of accountability of peer supporters to implement the intervention (individual characteristics); and regular feedback on the progress with implementation (process). Potential barriers included the need to queue at the eye clinic (intervention characteristic), travel inconveniences (inner setting), and socio-political disruption (outer setting).

CONCLUSIONS

The intervention was implemented with high retention, reach, fidelity, and dose. The CFIR provided a valuable framework for evaluating contextual factors that influenced implementation and helped to understand what adaptations may be needed during scale up.

TRIAL REGISTRATION

Pan African Clinical Trials Registry: PACTR201707002430195 registered 15 July 2017.

Understanding the uptake of a national retinopathy screening programme: An audit of people with diabetes in two large primary care centres

Background: Diabetic retinopathy (DR) is estimated to affect 25–26% of the Irish population with diabetes and is one of the leading causes of blindness among working-age adults. Regular diabetic retinopathy screening (DRS) can reduce the risk of sight loss. In 2013, the new national screening programme (RetinaScreen) was introduced in Ireland. Maximising DRS uptake (consent to participate in the programme and attendance once invited) is a priority, therefore it is important to identify characteristics which determine DRS uptake among those with diabetes in Ireland. We report uptake in an Irish primary care population during the initial phase of implementation of RetinaScreen and investigate factors which predict consenting to participate in the programme. Methods: In two primary care practices, data were extracted from records of people with diabetes (type 1 and type 2) aged ≥18 years who were eligible to participate in RetinaScreen between November 2013 and August 2015. Records were checked for a RetinaScreen letter. RetinaScreen were contacted to establish the status of those without a letter on file. Multivariable Poisson regression was used to examine associations between socio-demographic variables and consenting. Adjusted incident rate ratios (IRR) with 95% CI were generated as a measure of association. Results: Of 722 people with diabetes, one fifth (n=141) were not registered with RetinaScreen. Of 582 who were registered, 63% (n=365) had participated in screening. Most people who consented subsequently attended (n=365/382, 96%). People who had attended another retinopathy screening service were less likely to consent (IRR 0.65 [95%CI 0.5-0.8]; p<0.001). Other predictors were not significantly associated with consent. Conclusions: Over one third of eligible participants in RetinaScreen had not consented. Research is needed to understand barriers and enablers of DRS uptake in the Irish context. Implementing strategies to improve DRS uptake, barriers to consent in particular, should be a priority.

Action, actor, context, target, time (AACTT): a framework for specifying behaviour

BACKGROUND

Designing implementation interventions to change the behaviour of healthcare providers and other professionals in the health system requires detailed specification of the behaviour(s) targeted for change to ensure alignment between intervention components and measured outcomes. Detailed behaviour specification can help to clarify evidence-practice gaps, clarify who needs to do what differently, identify modifiable barriers and enablers, design interventions to address these and ultimately provides an indicator of what to measure to evaluate an intervention's effect on behaviour change. An existing behaviour specification framework proposes four domains (Target, Action, Context, Time; TACT), but insufficiently clarifies who is performing the behaviour (i.e. the Actor). Specifying the Actor is especially important in healthcare settings characterised by multiple behaviours performed by multiple different people. We propose and describe an extension and re-ordering of TACT to enhance its utility to implementation intervention designers, practitioners and trialists: the Action, Actor, Context, Target, Time (AACTT) framework. We aim to demonstrate its application across key steps of implementation research and to provide tools for its use in practice to clarify the behaviours of stakeholders across multiple levels of the healthcare system.

METHODS AND RESULTS

We used French et al.'s four-step implementation process model to describe the potential applications of the AACTT framework for (a) clarifying who needs to do what differently, (b) identifying barriers and enablers, (c) selecting fit-for-purpose intervention strategies and components and (d) evaluating implementation interventions.

CONCLUSIONS

Describing and detailing behaviour using the AACTT framework may help to enhance measurement of theoretical constructs, inform development of topic guides and questionnaires, enhance the design of implementation interventions and clarify outcome measurement for evaluating implementation interventions.

Process evaluations of primary care interventions addressing chronic disease: a systematic review

OBJECTIVE

Process evaluations (PEs) alongside randomised controlled trials of complex interventions are valuable because they address questions of for whom, how and why interventions had an impact. We synthesised the methods used in PEs of primary care interventions, and their main findings on implementation barriers and facilitators.

DESIGN

Systematic review using the UK Medical Research Council guidance for PE as a guide.

DATA SOURCES

Academic databases (MEDLINE, SCOPUS, PsycINFO, Cumulative Index to Nursing and Allied Health Literature, EMBASE and Global Health) were searched from 1998 until June 2018.

ELIGIBILITY CRITERIA

We included PE alongside randomised controlled trials of primary care interventions which aimed to improve outcomes for patients with non-communicable diseases.

DATA EXTRACTION AND SYNTHESIS

Two independent reviewers screened and conducted the data extraction and synthesis, with a third reviewer checking a sample for quality assurance.

RESULTS

69 studies were included. There was an overall lack of consistency in how PEs were conducted and reported. The main weakness is that only 30 studies were underpinned by a clear intervention theory often facilitated by the use of existing theoretical frameworks. The main strengths were robust sampling strategies, and the triangulation of qualitative and quantitative data to understand an intervention's mechanisms. Findings were synthesised into three key themes: (1) a fundamental mismatch between what the intervention was designed to achieve and local needs; (2) the required roles and responsibilities of key actors were often not clearly understood; and (3) the health system context-factors such as governance, financing structures and workforce-if unanticipated could adversely impact implementation.

CONCLUSION

Greater consistency is needed in the reporting and the methods of PEs, in particular greater use of theoretical frameworks to inform intervention theory. More emphasis on formative research in designing interventions is needed to align the intervention with the needs of local stakeholders, and to minimise unanticipated consequences due to context-specific barriers.

PROSPERO REGISTRATION NUMBER

CRD42016035572.

Understanding the uptake of a national retinopathy screening programme: An audit of patients with diabetes in two large primary care centres

Background: Diabetic retinopathy (DR) affects 8.2% of the Irish population with type 2 diabetes over 50 years and is one of the leading causes of blindness among working-age adults. Regular diabetic retinopathy screening (DRS) can reduce the risk of sight loss. In 2013, the new national screening programme (RetinaScreen) was introduced in Ireland. Maximising DRS uptake (consent to participate in the programme and attendance once invited) is a priority, therefore it is important to identify characteristics which determine DRS uptake among those with diabetes in Ireland. We report uptake in an Irish primary care population during the initial phase of implementation of RetinaScreen and investigate factors which predict consenting to participate in the programme. Methods:  In two primary care practices, data were extracted from records of people with diabetes (type 1 and type 2) aged ≥18 years who were eligible to participate in RetinaScreen between November 2013 and August 2015. Records were checked for a RetinaScreen letter. RetinaScreen were contacted to establish the status of those without a letter on file. Multivariable Poisson regression was used to examine associations between socio-demographic variables and consenting. Adjusted incident rate ratios (IRR) with 95% CI were generated as a measure of association. Results: Of 722 people with diabetes, one fifth (n=141) were not registered with RetinaScreen. Of 582 who were registered, 63% (n=365) had participated in screening. Most people who consented subsequently attended (n=365/382, 96%). People who had attended another retinopathy screening service were less likely to consent (IRR 0.65 [95%CI 0.5-0.8]; p<0.001). Other predictors were not significantly associated with consent. Conclusions: Over one third of people eligible to participate in RetinaScreen had not consented. Research is needed to understand barriers and enablers of DRS uptake in the Irish context. Implementing strategies to improve DRS uptake (consent and attendance) should be a priority.

What works to increase attendance for diabetic retinopathy screening? An evidence synthesis and economic analysis

BACKGROUND

Diabetic retinopathy screening (DRS) is effective but uptake is suboptimal.

OBJECTIVES

To determine the effectiveness of quality improvement (QI) interventions for DRS attendance; describe the interventions in terms of QI components and behaviour change techniques (BCTs); identify theoretical determinants of attendance; investigate coherence between BCTs identified in interventions and determinants of attendance; and determine the cost-effectiveness of QI components and BCTs for improving DRS.

DATA SOURCES AND REVIEW METHODS

Phase 1 - systematic review of randomised controlled trials (RCTs) evaluating interventions to increase DRS attendance (The Cochrane Library, MEDLINE, EMBASE and trials registers to February 2017) and coding intervention content to classify QI components and BCTs. Phase 2 - review of studies reporting factors influencing attendance, coded to theoretical domains (MEDLINE, EMBASE, PsycINFO and sources of grey literature to March 2016). Phase 3 - mapping BCTs (phase 1) to theoretical domains (phase 2) and an economic evaluation to determine the cost-effectiveness of BCTs or QI components.

RESULTS

Phase 1 - 7277 studies were screened, of which 66 RCTs were included in the review. Interventions were multifaceted and targeted patients, health-care professionals (HCPs) or health-care systems. Overall, interventions increased DRS attendance by 12% [risk difference (RD) 0.12, 95% confidence interval (CI) 0.10 to 0.14] compared with usual care, with substantial heterogeneity in effect size. Both DRS-targeted and general QI interventions were effective, particularly when baseline attendance levels were low. All commonly used QI components and BCTs were associated with significant improvements, particularly in those with poor attendance. Higher effect estimates were observed in subgroup analyses for the BCTs of 'goal setting (outcome, i.e. consequences)' (RD 0.26, 95% CI 0.16 to 0.36) and 'feedback on outcomes (consequences) of behaviour' (RD 0.22, 95% CI 0.15 to 0.29) in interventions targeting patients and of 'restructuring the social environment' (RD 0.19, 95% CI 0.12 to 0.26) and 'credible source' (RD 0.16, 95% CI 0.08 to 0.24) in interventions targeting HCPs. Phase 2 - 3457 studies were screened, of which 65 non-randomised studies were included in the review. The following theoretical domains were likely to influence attendance: 'environmental context and resources', 'social influences', 'knowledge', 'memory, attention and decision processes', 'beliefs about consequences' and 'emotions'. Phase 3 - mapping identified that interventions included BCTs targeting important barriers to/enablers of DRS attendance. However, BCTs targeting emotional factors around DRS were under-represented. QI components were unlikely to be cost-effective whereas BCTs with a high probability (≥ 0.975) of being cost-effective at a societal willingness-to-pay threshold of £20,000 per QALY included 'goal-setting (outcome)', 'feedback on outcomes of behaviour', 'social support' and 'information about health consequences'. Cost-effectiveness increased when DRS attendance was lower and with longer screening intervals.

LIMITATIONS

Quality improvement/BCT coding was dependent on descriptions of intervention content in primary sources; methods for the identification of coherence of BCTs require improvement.

CONCLUSIONS

Randomised controlled trial evidence indicates that QI interventions incorporating specific BCT components are associated with meaningful improvements in DRS attendance compared with usual care. Interventions generally used appropriate BCTs that target important barriers to screening attendance, with a high probability of being cost-effective. Research is needed to optimise BCTs or BCT combinations that seek to improve DRS attendance at an acceptable cost. BCTs targeting emotional factors represent a missed opportunity to improve attendance and should be tested in future studies.

STUDY REGISTRATION

This study is registered as PROSPERO CRD42016044157 and PROSPERO CRD42016032990.

FUNDING

The National Institute for Health Research Health Technology Assessment programme.

Cluster randomised controlled trial of a theory-based multiple behaviour change intervention aimed at healthcare professionals to improve their management of type 2 diabetes in primary care

Background

National diabetes audits in the UK show room for improvement in the quality of care delivered to people with type 2 diabetes in primary care. Systematic reviews of quality improvement interventions show that such approaches can be effective but there is wide variability between trials and little understanding concerning what explains this variability. A national cohort study of primary care across 99 UK practices identified modifiable predictors of healthcare professionals’ prescribing, advising and foot examination.

Our objective was to evaluate the effectiveness of an implementation intervention to improve six guideline-recommended health professional behaviours in managing type 2 diabetes in primary care: prescribing for blood pressure and glycaemic control, providing physical activity and nutrition advice and providing updated diabetes education and foot examination.

Methods

Two-armed cluster randomised trial involving 44 general practices. Primary outcomes (at 12 months follow-up): from electronic medical records, the proportion of patients receiving additional prescriptions for blood pressure and insulin initiation for glycaemic control and having a foot examination; and from a patient survey of a random sample of 100 patients per practice, reported receipt of updated diabetes education and physical activity and nutrition advice.

Results

The implementation intervention did not lead to statistically significant improvement on any of the six clinical behaviours. 1,138,105 prescriptions were assessed. Intervention (29% to 37% patients) and control arms (31% to 35%) increased insulin initiation relative to baseline but were not statistically significantly different at follow-up (IRR 1.18, 95%CI 0.95–1.48). Intervention (45% to 53%) and control practices (45% to 50%) increased blood pressure prescription from baseline to follow-up but were not statistically significantly different at follow-up (IRR 1.05, 95%CI 0.96 to 1.16). Intervention (75 to 78%) and control practices (74 to 79%) increased foot examination relative to baseline; control practices increased statistically significantly more (OR 0.84, 95%CI 0.75–0.94). Fewer patients in intervention (33%) than control practices (40%) reported receiving updated diabetes education (OR = 0.74, 95%CI 0.57–0.97). No statistically significant differences were observed in patient reports of having had a discussion about nutrition (intervention = 73%; control = 72%; OR = 0.98, 95%CI 0.59–1.64) or physical activity (intervention = 57%; control = 62%; OR = 0.79, 95%CI 0.56–1.11). Development and delivery of the intervention cost £1191 per practice.

Conclusions

There was no measurable benefit to practices’ participation in this intervention. Despite widespread use of outreach interventions worldwide, there is a need to better understand which techniques at which intensity are optimally suited to address the multiple clinical behaviours involved in improving care for type 2 diabetes.

Trial registration

ISRCTN, ISRCTN66498413. Registered April 4, 2013

Electronic supplementary material

The online version of this article (10.1186/s13012-018-0754-5) contains supplementary material, which is available to authorized users.

Why is announcement training more effective than conversation training for introducing HPV vaccination? A theory-based investigation

BACKGROUND

Improving healthcare providers' communication about HPV vaccination is critical to increasing uptake. We previously demonstrated that training providers to use presumptive announcements to introduce HPV vaccination improved uptake, whereas training them to use participatory conversations had no effect. To understand how communication training changed provider perceptions and communication practices, we evaluated intermediate outcomes and process measures from our randomized clinical trial, with a particular focus on identifying mechanisms that might explain the announcement training's impact.

METHODS

In 2015, a physician educator delivered 1-h in-clinic HPV vaccination recommendation trainings at 20 primary care clinics in North Carolina serving 11,578 patients age 11 or 12. Clinics were randomized to receive training to use "announcements" that presume parents are ready to vaccinate or "conversations" that invite dialog about vaccination. Training participants were 83 HPV vaccine providers. Pre- and post-training surveys assessed constructs from the theory of planned behavior (TPB), including providers' attitudes and subjective norms about HPV vaccination and their perceived behavioral control to recommend HPV vaccination. Surveys also assessed providers' perceptions of the announcement and conversation communication strategies.

RESULTS

Both trainings improved TPB-related constructs, including providers' positive attitudes toward HPV vaccination, subjective norms, and perceived behavioral control to recommend the vaccine (all p < .001, Cohen's d = .62-.90). Furthermore, in both trainings, the amount of time providers reported needing to discuss HPV vaccination with parents decreased from pre-training to 1-month follow-up (mean = 3.8 vs. 3.2 min, p = .01, d = .28). However, announcement trainings outperformed conversation trainings on other measures. For example, providers who received announcement training more often reported that the communication strategy saved them time, was easy to use, helped them promote HPV vaccination as routine care, and increased HPV vaccination coverage in their clinics (all p < .05; d = .44-.60).

CONCLUSIONS

Both announcement and conversation trainings improved providers' HPV vaccine-related perceptions. However, providers viewed announcements as easier to use and more effective, which may help to explain the success of this training approach. Future provider communication interventions should consider implementation outcomes, including acceptability, alongside more traditional TPB constructs.

TRIAL REGISTRATION

clinicaltrials.gov, NCT02377843 . Registered on February 27, 2015.

Interventions to increase attendance for diabetic retinopathy screening

BACKGROUND

Despite evidence supporting the effectiveness of diabetic retinopathy screening (DRS) in reducing the risk of sight loss, attendance for screening is consistently below recommended levels.

OBJECTIVES

The primary objective of the review was to assess the effectiveness of quality improvement (QI) interventions that seek to increase attendance for DRS in people with type 1 and type 2 diabetes.Secondary objectives were:To use validated taxonomies of QI intervention strategies and behaviour change techniques (BCTs) to code the description of interventions in the included studies and determine whether interventions that include particular QI strategies or component BCTs are more effective in increasing screening attendance;To explore heterogeneity in effect size within and between studies to identify potential explanatory factors for variability in effect size;To explore differential effects in subgroups to provide information on how equity of screening attendance could be improved;To critically appraise and summarise current evidence on the resource use, costs and cost effectiveness.

SEARCH METHODS

We searched the Cochrane Library, MEDLINE, Embase, PsycINFO, Web of Science, ProQuest Family Health, OpenGrey, the ISRCTN, ClinicalTrials.gov, and the WHO ICTRP to identify randomised controlled trials (RCTs) that were designed to improve attendance for DRS or were evaluating general quality improvement (QI) strategies for diabetes care and reported the effect of the intervention on DRS attendance. We searched the resources on 13 February 2017. We did not use any date or language restrictions in the searches.

SELECTION CRITERIA

We included RCTs that compared any QI intervention to usual care or a more intensive (stepped) intervention versus a less intensive intervention.

DATA COLLECTION AND ANALYSIS

We coded the QI strategy using a modification of the taxonomy developed by Cochrane Effective Practice and Organisation of Care (EPOC) and BCTs using the BCT Taxonomy version 1 (BCTTv1). We used Place of residence, Race/ethnicity/culture/language, Occupation, Gender/sex, Religion, Education, Socioeconomic status, and Social capital (PROGRESS) elements to describe the characteristics of participants in the included studies that could have an impact on equity of access to health services.Two review authors independently extracted data. One review author entered the data into Review Manager 5 and a second review author checked them. Two review authors independently assessed risks of bias in the included studies and extracted data. We rated certainty of evidence using GRADE.

MAIN RESULTS

We included 66 RCTs conducted predominantly (62%) in the USA. Overall we judged the trials to be at low or unclear risk of bias. QI strategies were multifaceted and targeted patients, healthcare professionals or healthcare systems. Fifty-six studies (329,164 participants) compared intervention versus usual care (median duration of follow-up 12 months). Overall, DRS attendance increased by 12% (risk difference (RD) 0.12, 95% confidence interval (CI) 0.10 to 0.14; low-certainty evidence) compared with usual care, with substantial heterogeneity in effect size. Both DRS-targeted (RD 0.17, 95% CI 0.11 to 0.22) and general QI interventions (RD 0.12, 95% CI 0.09 to 0.15) were effective, particularly where baseline DRS attendance was low. All BCT combinations were associated with significant improvements, particularly in those with poor attendance. We found higher effect estimates in subgroup analyses for the BCTs 'goal setting (outcome)' (RD 0.26, 95% CI 0.16 to 0.36) and 'feedback on outcomes of behaviour' (RD 0.22, 95% CI 0.15 to 0.29) in interventions targeting patients, and 'restructuring the social environment' (RD 0.19, 95% CI 0.12 to 0.26) and 'credible source' (RD 0.16, 95% CI 0.08 to 0.24) in interventions targeting healthcare professionals.Ten studies (23,715 participants) compared a more intensive (stepped) intervention versus a less intensive intervention. In these studies DRS attendance increased by 5% (RD 0.05, 95% CI 0.02 to 0.09; moderate-certainty evidence).Fourteen studies reporting any QI intervention compared to usual care included economic outcomes. However, only five of these were full economic evaluations. Overall, we found that there is insufficient evidence to draw robust conclusions about the relative cost effectiveness of the interventions compared to each other or against usual care.With the exception of gender and ethnicity, the characteristics of participants were poorly described in terms of PROGRESS elements. Seventeen studies (25.8%) were conducted in disadvantaged populations. No studies were carried out in low- or middle-income countries.

AUTHORS' CONCLUSIONS

The results of this review provide evidence that QI interventions targeting patients, healthcare professionals or the healthcare system are associated with meaningful improvements in DRS attendance compared to usual care. There was no statistically significant difference between interventions specifically aimed at DRS and those which were part of a general QI strategy for improving diabetes care. This is a significant finding, due to the additional benefits of general QI interventions in terms of improving glycaemic control, vascular risk management and screening for other microvascular complications. It is likely that further (but smaller) improvements in DRS attendance can also be achieved by increasing the intensity of a particular QI component or adding further components.

Social Interface Model: Theorizing Ecological Post-Delivery Processes for Intervention Effects

Successful prevention programs depend on a complex interplay among aspects of the intervention, the participant, the specific intervention setting, and the broader set of contexts with which a participant interacts. There is a need to theorize what happens as participants bring intervention ideas and behaviors into other life-contexts, and theory has not yet specified how social interactions about interventions may influence outcomes. To address this gap, we use an ecological perspective to develop the social interface model. This paper presents the key components of the model and its potential to aid the design and implementation of prevention interventions. The model is predicated on the idea that intervention message effectiveness depends not only on message aspects but also on the participants' adoption and adaptation of the message vis-à-vis their social ecology. The model depicts processes by which intervention messages are received and enacted by participants through social processes occurring within and between relevant microsystems. Mesosystem interfaces (negligible interface, transference, co-dependence, and interdependence) can facilitate or detract from intervention effects. The social interface model advances prevention science by theorizing that practitioners can create better quality interventions by planning for what occurs after interventions are delivered.

Promoting deceased organ and tissue donation registration in family physician waiting rooms (RegisterNow-1 trial): study protocol for a pragmatic, stepped-wedge, cluster randomized controlled registry

Background

There is a worldwide shortage of organs available for transplant, leading to preventable mortality associated with end-stage organ disease. While most citizens in many countries with an intent-to-donate “opt-in” system support organ donation, registration rates remain low. In Canada, most Canadians support organ donation but less than 25% in most provinces have registered their desire to donate their organs when they die. The family physician office is a promising yet underused setting in which to promote organ donor registration and address known barriers and enablers to registering for deceased organ and tissue donation. We developed a protocol to evaluate an intervention to promote registration for organ and tissue donation in family physician waiting rooms.

Methods/design

This protocol describes a planned, stepped-wedge, cluster randomized registry trial in six family physician offices in Ontario, Canada to evaluate the effectiveness of reception staff providing patients with a pamphlet that addresses barriers and enablers to registration including a description of how to register for organ donation. An Internet-enabled tablet will also be provided in waiting rooms so that interested patients can register while waiting for their appointments. Family physicians and reception staff will be provided with training and/or materials to support any conversations about organ donation with their patients. Following a 2-week control period, the six offices will cross sequentially into the intervention arm in randomized sequence at 2-week intervals until all offices deliver the intervention. The primary outcome will be the proportion of patients visiting the office who are registered organ donors 7 days following their office visit. We will evaluate this outcome using routinely collected registry data from provincial administrative databases. A post-trial qualitative evaluation process will assess the experiences of reception staff and family physicians with the intervention and the stepped-wedge trial design.

Discussion

Promoting registration for organ donation in family physician offices is a potentially useful strategy for increasing registration for organ donation. Increased registration may ultimately help to increase the number of organs available for transplant. The results of this trial will provide important preliminary data on the effectiveness of using family physician offices to promote registration for organ donation.

Trial registration

ClinicalTrials.gov, ID: NCT03213171. Registered on 11 July 2017.

Electronic supplementary material

The online version of this article (doi:10.1186/s13063-017-2333-5) contains supplementary material, which is available to authorized users.

What theory, for whom and in which context? Reflections on the application of theory in the development and evaluation of complex population health interventions

Recent years have seen a growing emphasis on the value of building and testing middle range theory throughout the development and evaluation of complex population health interventions. We agree that a coherent theoretical basis for intervention development, and use of evaluation to test key causal assumptions and build theory, are crucial. However, in this editorial, we argue that such recommendations have often been operationalised in somewhat simplistic terms with potentially perverse consequences, and that an uncritical assumption that an intervention explicitly based on theory is inherently superior carries significant risks. We first argue that the drive for theory-based approaches may have exacerbated a propensity to select ‘off-the-shelf’ theories, leading to the selection of inappropriate theories which distract attention from the mechanisms through which a problem is actually sustained. Second, we discuss a tendency toward over-reliance on individual-level theorising. Finally, we discuss the relatively slow progress of population health intervention research in attending to issues of context, and the ecological fit of interventions with the systems whose functioning they attempt to change. We argue that while researchers should consider a broad range of potential theoretical perspectives on a given population health problem, citing a popular off-the-shelf theory as having informed an intervention and its evaluation does not inherently make for better science. Before identifying or developing a theory of change, researchers should develop a clear understanding of how the problem under consideration is created and sustained in context. A broader conceptualisation of theory that reaches across disciplines is vital if theory is to enhance, rather than constrain, the contribution of intervention research. Finally, intervention researchers need to move away from viewing interventions as discrete packages of components which can be described in isolation from their contexts, and better understand the systems into which change is being introduced.

A theory-based process evaluation alongside a randomised controlled trial of printed educational messages to increase primary care physicians' prescription of thiazide diuretics for hypertension [ISRCTN72772651]

BACKGROUND

Pragmatic trials of implementation interventions focus on evaluating whether an intervention changes professional behaviour under real-world conditions rather than investigating the mechanism through which change occurs. Theory-based process evaluations conducted alongside pragmatic randomised trials address this by assessing whether the intervention changes theoretical constructs proposed to mediate change. The Ontario Printed Educational Materials (PEM) cluster trial was designed to increase family physicians' guideline-recommended prescription of thiazide diuretics. The trial found no intervention effect. Using the theory of planned behaviour (TPB), we hypothesised that changes in thiazide prescribing would be reflected in changes in intention, consistent with changes in attitude and subjective norm, with no change to their perceived behavioural control (PBC), and tested this alongside the RCT.

METHODS

We developed and sent TPB postal questionnaires to a random sub-sample of family physicians in each trial arm 2 months before and 6 months after dissemination of the PEMs. We used analysis of covariance to test for group differences using a 2 × 3 factorial design. We content-analysed an open-ended question about perceived barriers to thiazide prescription. Using control group data, we tested whether baseline measures of TPB constructs predicted self-reported thiazide prescribing at follow-up.

RESULTS

Four hundred twenty-six physicians completed pre- and post-intervention questionnaires. Baseline scores on measures of TPB constructs were high: intention mean = 5.9 out of 7 (SD = 1.4), attitude mean = 5.8 (SD = 1.1), subjective norm mean = 5.8 (SD = 1.1) and PBC mean = 6.2 (SD = 1.0). The arms did not significantly differ post-intervention on any of the theory-based constructs, suggesting a possible ceiling effect. Content analysis of perceived barriers suggested post-intentional barriers to prescribing thiazides most often focused on specific patient clinical characteristics and potential side effects. Baseline intention (β = 0.63, p < 0.01) but not PBC (β = 0.04, p = 0.78) predicted 42.6 % of the variance in self-reported behaviour at follow-up in the control group.

CONCLUSIONS

Congruent with the Ontario Printed Educational Messages trial results and aligned with the TPB, we saw no impact of the intervention on any TPB constructs. The theoretical basis of this evaluation suggests possible explanations for the failure of the PEM intervention to change professional behaviour, which can directly inform the design and content of future theory-based PEM interventions to change professional behaviour.

TRIAL REGISTRATION

ISRCTN, Canada ISRCTN72772651.

A theory-based evaluation of a dissemination intervention to improve childcare cooks' intentions to implement nutritional guidelines on their menus

BACKGROUND

Childcare services represent a key setting to implement nutritional interventions to support the development of healthy eating behaviours in young children. Childcare-specific nutritional guidelines outlining recommendations for provision of food in care have been developed. Despite this, research suggests that few childcare services currently implement these guidelines. This study aimed to examine the impact of providing printed educational materials on childcare service cooks' intentions to use nutritional guidelines and provide fruit and vegetables on their menu.

FINDINGS

A randomised controlled trial was conducted with 77 childcare services (38 control and 39 intervention). Intervention service cooks were mailed a two-page educational material together with a menu planning checklist. Intervention development and evaluation was guided by the theory of planned behaviour. Outcome data assessing intentions to use nutritional guidelines and serves of fruit and vegetables provided on menus (primary outcomes) as well as secondary outcomes (attitudes, behavioural regulation and social norms) were collected via a telephone interview with cooks. Relative to the comparison group, cooks in the intervention arm had significantly higher intentions to use the guidelines (p value 0.0005), accompanied by significant changes in perceived behavioural control (p value 0.0008) and attitudes (p value 0.0071). No significant difference in serves of fruit (p value 0.7278) and vegetables (p value 0.0573) was observed.

CONCLUSIONS

The use of educational materials can improve childcare service cooks' intentions to use nutritional guidelines; however, as a standalone strategy, it may not improve provision of food on menus.

How Effective are Behavior Change Interventions Based on the Theory of Planned Behavior?

Abstract. The theory of planned behavior (TPB) is a prominent framework for predicting and explaining behavior in a variety of domains. The theory is also increasingly being used as a framework for conducting behavior change interventions. In this meta-analysis, we identified 82 papers reporting results of 123 interventions in a variety of disciplines. Our analysis confirmed the effectiveness of TPB-based interventions, with a mean effect size of .50 for changes in behavior and effect sizes ranging from .14 to .68 for changes in antecedent variables (behavioral, normative, and control beliefs, attitude, subjective norm, perceived behavioral control, and intention). Further analyses revealed that the interventions’ effectiveness varied for the diverse behavior change methods. In addition, interventions conducted in public and with groups were more successful than interventions in private locations or focusing on individuals. Finally, we identified gender and education as well as behavioral domain as moderators of the interventions’ effectiveness.

Challenges, solutions and future directions in the evaluation of service innovations in health care and public health

Evaluating service innovations in health care and public health requires flexibility, collaboration and pragmatism; this collection identifies robust, innovative and mixed methods to inform such evaluations.

Printed educational messages aimed at family practitioners fail to increase retinal screening among their patients with diabetes: a pragmatic cluster randomized controlled trial [ISRCTN72772651]

Background

Evidence of the effectiveness of printed educational messages in narrowing the gap between guideline recommendations and practice is contradictory. Failure to screen for retinopathy exposes primary care patients with diabetes to risk of eye complications. Screening is initiated by referral from family practitioners but adherence to guidelines is suboptimal. We aimed to evaluate the ability of printed educational messages aimed at family doctors to increase retinal screening of primary care patients with diabetes.

Methods

Design: Pragmatic 2×3 factorial cluster trial randomized by physician practice, involving 5,048 general practitioners (with 179,833 patients with diabetes). Setting: Ontario family practitioners. Interventions: Reminders (that retinal screening helps prevent diabetes-related vision loss and is covered by provincial health insurance for patients with diabetes) with prompts to encourage screening were mailed to each physician in conjunction with a widely-read professional newsletter. Alternative printed materials formats were an ‘outsert’ (short, directive message stapled to the outside of the newsletter), and/or a two-page, evidence-based article (‘insert’) and a pre-printed sticky note reminder for patients. Main outcome measure: A successful outcome was an eye examination (which includes retinal screening) provided to a patient with diabetes, not screened in the previous 12 months, within 90 days after visiting a family practitioner. Analysis accounted for clustering of doctors within practice groups.

Results

No intervention effect was detected (eye exam rates were 31.6% for patients of control physicians, 31.3% for the insert, 32.8% for the outsert, 32.3% for those who received both, and 31.2% for those who received both plus the patient reminder with the largest 95% confidence interval around any effect extending from −1.3% to 1.1%).

Conclusions

This large trial conclusively failed to demonstrate any impact of printed educational messages on screening uptake. Despite their low cost, printed educational messages should not be routinely used in attempting to close evidence-practice gaps relating to diabetic retinopathy screening.

Trial registration

ISRCTN72772651

Electronic supplementary material

The online version of this article (doi:10.1186/1748-5908-9-87) contains supplementary material, which is available to authorized users.