Planning and process evaluation of a multi-faceted influenza vaccination implementation strategy for health care workers in acute health care settings

Developing an Evidence-Based Tool for Planning and Evaluating Vaccination Strategies Aimed at Improving Coverage in Elderly and At-Risk Adult Population

Background: Vaccination coverages need to be constantly maintained and improved with the implementation of vaccination strategies. This paper describes the development of an evidence-based tool to guide their planning and evaluation.

Methods: A scoping review was performed in MEDLINE and institutional websites to search for similar available tools. A first version of the tool was developed considering review results and a four-step method used for the control and continuous improvement of processes and products, namely the Deming cycle. A panel of eight experts was then involved in a Delphi study for the finalization of the tool that was eventually discussed in a face-to-face meeting.

Results: The scoping review found only one document and the first version of the tool was composed of 30 items. After the Delphi first round, 11 additional items were suggested and 5 original items amended. After the Delphi second round 41 items were eventually included. During the face-to-face meeting, 7 items were recognized as requisites for setting vaccination strategies, whereas 17 as relevant ones.

Conclusions: Current public health challenges impose the need for evidence-based tools to organize effective vaccination strategies. Our tool is a first proposal which aims to reflect this focus.

Use of Intervention Mapping for Occupational Risk Prevention and Health Promotion: A Systematic Review of Literature

Aim: Intervention mapping (IM) is a method to systematically design interventions that is applied regularly within the public health domain. This study investigates whether IM is effectively used within the occupational safety and health domain as well. Specifically, this study explores the relation between the fidelity regarding the use of the IM protocol for intervention development, the implementation process and the effectiveness of the occupational risk prevention and health promotion interventions. Methods: A systematic review was conducted including articles on development, implementation, and effects of occupational risk prevention and health promotion interventions that were developed according to the IM-protocol. By means of a checklist, two authors reviewed the articles and rated them on several indicators regarding the fidelity of the IM-protocol, the implementation process, and the intervention effect. Results: A literature search resulted in a total of 12 interventions as described in 38 articles. The fidelity to the IM-protocol was relatively low for participation throughout the development process and implementation planning. No relationship was found between fidelity of the IM-protocol and the intervention effect. A theory-based approach (as one of the core elements of IM) appears to be positively related to a successful implementation process. Conclusion: Results of the review suggest that organizing a participative approach and implementation planning is difficult in practice. In addition, results imply that conducting matrices of change objectives as part of the intervention development, although challenging and time-consuming, may ultimately pay off, resulting in a tailored intervention that matches the target group.

A web-based self-management programme for people with type 2 diabetes: the HeLP-Diabetes research programme including RCT

Background

In the UK, 6% of the UK population have diabetes mellitus, 90% of whom have type 2 diabetes mellitus (T2DM). Diabetes mellitus accounts for 10% of NHS expenditure (£14B annually). Good self-management may improve health outcomes. NHS policy is to refer all people with T2DM to structured education, on diagnosis, to improve their self-management skills, with annual reinforcement thereafter. However, uptake remains low (5.6% in 2014–15). Almost all structured education is group based, which may not suit people who work, who have family or other caring commitments or who simply do not like group-based formats. Moreover, patient needs vary with time and a single education session at diagnosis is unlikely to meet these evolving needs. A web-based programme may increase uptake.

Objectives

Our aim was to develop, evaluate and implement a web-based self-management programme for people with T2DM at any stage of their illness journey, with the goal of improving access to, and uptake of, self-management support, thereby improving health outcomes in a cost-effective manner. Specific objectives were to (1) develop an evidence-based theoretically informed programme that was acceptable to patients and health-care professionals (HCPs) and that could be readily implemented within routine NHS care, (2) determine the clinical effectiveness and cost-effectiveness of the programme compared with usual care and (3) determine how best to integrate the programme into routine care.

Design

There were five linked work packages (WPs). WP A determined patient requirements and WP B determined HCP requirements for the self-management programme. WP C developed and user-tested the Healthy Living for People with type 2 Diabetes (HeLP-Diabetes) programme. WP D was an individually randomised controlled trial in primary care with a health economic analysis. WP E used a mixed-methods and case-study design to study the potential for implementing the HeLP-Diabetes programme within routine NHS practice.

Setting

English primary care.

Participants

People with T2DM (WPs A, D and E) or HCPs caring for people with T2DM (WPs B, C and E).

Intervention

The HeLP-Diabetes programme; an evidence-based theoretically informed web-based self-management programme for people with T2DM at all stages of their illness journey, developed using participatory design principles.

Main outcome measures

WPs A and B provided data on user ‘wants and needs’, including factors that would improve the uptake and accessibility of the HeLP-Diabetes programme. The outcome for WP C was the HeLP-Diabetes programme itself. The trial (WP D) had two outcomes measures: glycated haemoglobin (HbA1c) level and diabetes mellitus-related distress, as measured with the Problem Areas in Diabetes (PAID) scale. The implementation outcomes (WP E) were the adoption and uptake at clinical commissioning group, general practice and patient levels and the identification of key barriers and facilitators.

Results

Data from WPs A and B supported our holistic approach and addressed all areas of self-management (medical, emotional and role management). HCPs voiced concerns about linkage with the electronic medical records (EMRs) and supporting patients to use the programme. The HeLP-Diabetes programme was developed and user-tested in WP C. The trial (WP D) recruited to target (n = 374), achieved follow-up rates of over 80% and the intention-to-treat analysis showed that there was an additional improvement in HbA1c levels at 12 months in the intervention group [mean difference –0.24%, 95% confidence interval (CI) –0.44% to –0.049%]. There was no difference in overall PAID score levels (mean difference –1.5 points, 95% CI –3.9 to 0.9 points). The within-trial health economic analysis found that incremental costs were lower in the intervention group than in the control group (mean difference –£111, 95% CI –£384 to £136) and the quality-adjusted life-years (QALYs) were higher (mean difference 0.02 QALYs, 95% CI 0.000 to 0.044 QALYs), meaning that the HeLP-Diabetes programme group dominated the control group. In WP E, we found that the HeLP-Diabetes programme could be successfully implemented in primary care. General practices that supported people in registering for the HeLP-Diabetes programme had better uptake and registered patients from a wider demographic than those relying on patient self-registration. Some HCPs were reluctant to do this, as they did not see it as part of their professional role.

Limitations

We were unable to link the HeLP-Diabetes programme with the EMRs or to determine the effects of the HeLP-Diabetes programme on users in the implementation study.

Conclusions

The HeLP-Diabetes programme is an effective self-management support programme that is implementable in primary care.

Future work

The HeLP-Diabetes research team will explore the following in future work: research to determine how to improve patient uptake of self-management support; develop and evaluate a structured digital educational pathway for newly diagnosed people; develop and evaluate a digital T2DM prevention programme; and the national implementation of the HeLP-Diabetes programme.

Trial registration

Research Ethics Committee reference number 10/H0722/86 for WPs A–C; Research Ethics Committee reference number 12/LO/1571 and UK Clinical Research Network/National Institute for Health Research (NIHR) Portfolio 13563 for WP D; and Research Ethics Committee 13/EM/0033 for WP E. In addition, for WP D, the study was registered with the International Standard Randomised Controlled Trial Register as reference number ISRCTN02123133.

Funding details

This project was funded by the NIHR Programme Grants for Applied Research programme and will be published in full in Programme Grants for Applied Research; Vol. 6, No. 5. See the NIHR Journals Library website for further project information.

The potential economic value of influenza vaccination for healthcare workers in The Netherlands

Background

Despite the clinical evidence, influenza vaccination coverage of healthcare workers remains low. To assess the health economic value of implementing an influenza immunization program among healthcare workers (HCW) in University Medical Centers (UMCs) in the Netherlands, a cost‐benefit model was developed using a societal perspective.

Methods/Patients

The model was based on a trial performed among all UMCs in the Netherlands that included both hospital staff and patients admitted to the pediatrics and internal medicine departments. The model structure and parameters estimates were based on the trial and complemented with literature research, and the impact of uncertainty explored with sensitivity analyses.

Results

In a base‐case scenario without vaccine coverage, influenza‐related annual costs were estimated at € 410 815 for an average UMC with 8000 HCWs and an average occupancy during the influenza period of 6000 hospitalized patients. Of these costs, 82% attributed to the HCWs and 18% were patient‐related. With a vaccination coverage of 15.47%, the societal program’s savings were € 2861 which corresponds to a saving of € 270.53 per extended hospitalization. Univariate sensitivity analyses show that the results are most sensitive to changes in the model parameters vaccine effectiveness in reducing influenza‐like illness (ILI) and the vaccination‐related costs.

Conclusion

In addition to the decreased burden of patient morbidity among hospitalized patients, the effects of the hospital immunization program slightly outweigh the economic investments. These outcomes may support healthcare policymakers’ recommendations about the influenza vaccination program for healthcare workers.

The role of intervention mapping in designing disease prevention interventions: A systematic review of the literature

Objective

To assess the role of Intervention Mapping (IM) in designing disease prevention interventions worldwide.

Methods

Systematic search and review of the relevant literature—peer-reviewed and grey—was conducted using the Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) guidelines.

Findings

Only five of the twenty two included studies reviewed were RCTs that compared intervention using IM protocol with placebo intervention, and provided the outcomes in terms of percentage increase in the uptake of disease-prevention programmes, and only one of the five studies provided an effect measure in the form of relative risk (RR = 1.59, 95% CI = 1.08–2.34, p = 0.02). Of the five RCTs, three were rated as strong evidences, one as a medium evidence and one as a weak evidence, and they all reported statistically significant difference between the two study groups, with disease prevention interventions that have used the intervention mapping approach generally reported significant increases in the uptake of disease-prevention interventions, ranging from 9% to 28.5% (0.0001 ≤ p ≤ 0.02), On the other hand, all the 22 studies have successfully identified the determinants of the uptake of disease prevention interventions that is essential to the success of disease prevention programmes.

Conclusion

Intervention Mapping has been successfully used to plan, implement and evaluate interventions that showed significant increase in uptake of disease prevention programmes. This study has provided a good understanding of the role of intervention mapping in designing disease prevention interventions, and a good foundation upon which subsequent reviews can be guided.

[The intervention mapping protocol: A structured process to develop, implement and evaluate health promotion programs]

BACKGROUND

Health promotion programs are expected to improve population health and reduce social inequalities in health. However, their theoretical foundations are frequently ill-defined, and their implementation faces many obstacles. The aim of this article is to describe the intervention mapping protocol in health promotion programs planning, used recently in several countries.

METHODS

The challenges of planning health promotion programs are presented, and the six steps of the intervention mapping protocol are described with an example. Based on a literature review, the use of this protocol, its requirements and potential limitations are discussed.

RESULTS

The intervention mapping protocol has four essential characteristics: an ecological perspective (person-environment), a participative approach, the use of theoretical models in human and social sciences and the use of scientific evidence. It comprises six steps: conduct a health needs assessment, define change objectives, select theory-based change techniques and practical applications, organize techniques and applications into an intervention program (logic model), plan for program adoption, implementation, and sustainability, and generate an evaluation plan. This protocol was used in different countries and domains such as obesity, tobacco, physical activity, cancer and occupational health. Although its utilization requires resources and a critical stance, this protocol was used to develop interventions which efficacy was demonstrated.

CONCLUSION

The intervention mapping protocol is an integrated process that fits the scientific and practical challenges of health promotion. It could be tested in France as it was used in other countries, in particular to reduce social inequalities in health.

Hospital-based cluster randomised controlled trial to assess effects of a multi-faceted programme on influenza vaccine coverage among hospital healthcare workers and nosocomial influenza in the Netherlands, 2009 to 2011

Nosocomial influenza is a large burden in hospitals. Despite recommendations from the World Health Organization to vaccinate healthcare workers against influenza, vaccine uptake remains low in most European countries. We performed a pragmatic cluster randomised controlled trial in order to assess the effects of implementing a multi-faceted influenza immunisation programme on vaccine coverage in hospital healthcare workers (HCWs) and on in-patient morbidity. We included hospital HCWs of three intervention and three control University Medical Centers (UMCs), and 3,367 patients. An implementation programme was offered to the intervention UMCs to assess the effects on both vaccine uptake among hospital staff and patient morbidity. In 2009/10, the coverage of seasonal, the first and second dose of pandemic influenza vaccine as well as seasonal vaccine in 2010/11 was higher in intervention UMCs than control UMCs (all p<0.05). At the internal medicine departments of the intervention group with higher vaccine coverage compared to the control group, nosocomial influenza and/or pneumonia was recorded in 3.9% and 9.7% of patients of intervention and control UMCs, respectively (p=0.015). Though potential bias could not be completely ruled out, an increase in vaccine coverage was associated with decreased patient in-hospital morbidity from influenza and/or pneumonia.