Planning and studying improvement in patient care: the use of theoretical perspectives

A consistent finding in articles on quality improvement in health care is that change is difficult to achieve. According to the research literature, the majority of interventions are targeted at health care professionals. But success in achieving change may be influenced by factors other than those relating to individual professionals, and theories may help explain whether change is possible. This article argues for a more systematic use of theories in planning and evaluating quality-improvement interventions in clinical practice. It demonstrates how different theories can be used to generate testable hypotheses regarding factors that influence the implementation of change, and it shows how different theoretical assumptions lead to different quality-improvement strategies.

Evidence for the impact of quality improvement collaboratives: systematic review

OBJECTIVE

To evaluate the effectiveness of quality improvement collaboratives in improving the quality of care.

DATA SOURCES

Relevant studies through Medline, Embase, PsycINFO, CINAHL, and Cochrane databases.

STUDY SELECTION

Two reviewers independently extracted data on topics, participants, setting, study design, and outcomes.

DATA SYNTHESIS

Of 1104 articles identified, 72 were included in the study. Twelve reports representing nine studies (including two randomised controlled trials) used a controlled design to measure the effects of the quality improvement collaborative intervention on care processes or outcomes of care. Systematic review of these nine studies showed moderate positive results. Seven studies (including one randomised controlled trial) reported an effect on some of the selected outcome measures. Two studies (including one randomised controlled trial) did not show any significant effect.

CONCLUSIONS

The evidence underlying quality improvement collaboratives is positive but limited and the effects cannot be predicted with great certainty. Considering that quality improvement collaboratives seem to play a key part in current strategies focused on accelerating improvement, but may have only modest effects on outcomes at best, further knowledge of the basic components effectiveness, cost effectiveness, and success factors is crucial to determine the value of quality improvement collaboratives.

Integrated care programmes for chronically ill patients: a review of systematic reviews

OBJECTIVE

To investigate effectiveness, definitions, and components of integrated care programmes for chronically ill patients on the basis of systematic reviews.

DESIGN

Literature review from January 1996 to May 2004.

MAIN MEASURES

Definitions and components of integrated care programmes and all effects reported on the quality of care.

RESULTS

Searches in the Medline and Cochrane databases identified 13 systematic reviews of integrated care programmes for chronically ill patients. Despite considerable heterogeneity in interventions, patient populations, and processes and outcomes of care, integrated care programmes seemed to have positive effects on the quality of patient care. No consistent definitions were present for the management of patients with chronic illnesses. In all the reviews the aims of integrated care programmes were very similar, namely reducing fragmentation and improving continuity and coordination of care, but the focus and content of the programmes differed widely. The most common components of integrated care programmes were self-management support and patient education, often combined with structured clinical follow-up and case management; a multidisciplinary patient care team; multidisciplinary clinical pathways and feedback, reminders, and education for professionals.

CONCLUSION

Integrated care programmes seemed to have positive effects on the quality of care. However, integrated care programmes have widely varying definitions and components and failure to recognize these variations leads to inappropriate conclusions about the effectiveness of these programmes and to inappropriate application of research results. To compare programmes and better understand the (cost) effectiveness of the programmes, consistent definitions must be used and component interventions must be well described.

Antibiotic prescribing in hospitals: a social and behavioural scientific approach

Antibiotics have dramatically changed the prognoses of patients with severe infectious diseases over the past 50 years. However, the emergence and dissemination of resistant organisms has endangered the effectiveness of antibiotics. One possible approach to the resistance problem is the appropriate use of antibiotic drugs for preventing and treating infections. This Review describes how the volume and appropriateness of antibiotic use in hospitals vary between countries, hospitals, and physicians. At each specific level-cultural, contextual, and behavioural-we discuss the determinants that influence hospital antibiotic use and the possible improvement strategies to make it more appropriate. Changing hospital antibiotic use is a challenge of formidable complexity. On each level, many determinants play a part, so that the measures or strategies undertaken to improve antibiotic use need to be equally diverse. Although various strategies for improving antibiotic use are available, a programme with activities at all three levels is needed for hospitals. Evaluating these programme activities in a way that provides external validity of the conclusions is crucial.

Process evaluation on quality improvement interventions

To design potentially successful quality improvement (QI) interventions, it is crucial to make use of detailed breakdowns of the implementation processes of successful and unsuccessful interventions. Process evaluation can throw light on the mechanisms responsible for the result obtained in the intervention group. It enables researchers and implementers to (1). describe the intervention in detail, (2). check actual exposure to the intervention, and (3). describe the experience of those exposed. This paper presents a framework containing features of QI interventions that might influence success. Attention is paid to features of the target group, the implementers or change agents, the frequency of intervention activities, and features of the information imparted. The framework can be used as a starting point to address all three aspects of process evaluation mentioned above. Process evaluation can be applied to small scale improvement projects, controlled QI studies, and large scale QI programmes; in each case it plays a different role.

A systematic review of hand hygiene improvement strategies: a behavioural approach

BACKGROUND

Many strategies have been designed and evaluated to address the problem of low hand hygiene (HH) compliance. Which of these strategies are most effective and how they work is still unclear. Here we describe frequently used improvement strategies and related determinants of behaviour change that prompt good HH behaviour to provide a better overview of the choice and content of such strategies.

METHODS

Systematic searches of experimental and quasi-experimental research on HH improvement strategies were conducted in Medline, Embase, CINAHL, and Cochrane databases from January 2000 to November 2009. First, we extracted the study characteristics using the EPOC Data Collection Checklist, including study objectives, setting, study design, target population, outcome measures, description of the intervention, analysis, and results. Second, we used the Taxonomy of Behavioural Change Techniques to identify targeted determinants.

RESULTS

We reviewed 41 studies. The most frequently addressed determinants were knowledge, awareness, action control, and facilitation of behaviour. Fewer studies addressed social influence, attitude, self-efficacy, and intention. Thirteen studies used a controlled design to measure the effects of HH improvement strategies on HH behaviour. The effectiveness of the strategies varied substantially, but most controlled studies showed positive results. The median effect size of these strategies increased from 17.6 (relative difference) addressing one determinant to 49.5 for the studies that addressed five determinants.

CONCLUSIONS

By focussing on determinants of behaviour change, we found hidden and valuable components in HH improvement strategies. Addressing only determinants such as knowledge, awareness, action control, and facilitation is not enough to change HH behaviour. Addressing combinations of different determinants showed better results. This indicates that we should be more creative in the application of alternative improvement activities addressing determinants such as social influence, attitude, self-efficacy, or intention.

Determinants of success of quality improvement collaboratives: what does the literature show?

CONTEXT

The apparent inconsistency between the widespread use of quality improvement collaboratives and the available evidence heightens the importance of thoroughly understanding the relative strength of the approach. More insight into factors influencing outcome would mean future collaboratives could be tailored in ways designed to increase their chances of success. This review describes potential determinants of team success and how they relate to effectiveness.

METHOD

We searched Medline, CINAHL, Embase, Cochrane, and PsycINFO databases from January 1995 to June 2006. The 1995-2006 search was updated in June 2009. Reference lists of included papers were reviewed to identify additional papers. We included papers that were written in English, contained data about the effectiveness of collaboratives, had a healthcare setting, met our definition for collaborative, and quantitatively assessed a relationship between any determinant and any effect parameter.

FINDINGS

Of 1367 abstracts identified, 23 papers (reporting on 26 collaboratives) provided information on potential determinants and their relationship with effectiveness. We categorised potential determinants of success using the definition for collaboratives as a template. Numerous potential determinants were tested, but only a few related to empirical effectiveness. Some aspects of teamwork and participation in specific collaborative activities enhanced short-term success. If teams remained intact and continued to gather data, chances of long-term success were higher. There is no empirical evidence of positive effects of leadership support, time and resources.

CONCLUSIONS

These outcomes provide guidance to organisers, participants and researchers of collaboratives. To advance knowledge in this area we propose a more systematic exploration of potential determinants by applying theory and practice-based knowledge and by performing methodologically sound studies that clearly set out to test such determinants.

Quality indicators to measure appropriate antibiotic use in hospitalized adults

BACKGROUND

An important requirement for an effective antibiotic stewardship program is the ability to measure appropriateness of antibiotic use. The aim of this study was to develop quality indicators (QIs) that can be used to measure appropriateness of antibiotic use in the treatment of all bacterial infections in hospitalized adult patients.

METHODS

A RAND-modified Delphi procedure was used to develop a set of QIs. Potential QIs were retrieved from the literature. In 2 questionnaire mailings with an in-between face-to-face consensus meeting, an international multidisciplinary expert panel of 17 experts appraised and prioritized these potential QIs.

RESULTS

The literature search resulted in a list of 24 potential QIs. Nine QIs describing recommended care at patient level were selected: (1) take 2 blood cultures, (2) take cultures from suspected sites of infection, (3) prescribe empirical antibiotic therapy according to local guideline, (4) change empirical to pathogen-directed therapy, (5) adapt antibiotic dosage to renal function, (6) switch from intravenous to oral, (7) document antibiotic plan, (8) perform therapeutic drug monitoring, and (9) discontinue antibiotic therapy if infection is not confirmed. Two QIs describing recommended care at the hospital level were also selected: (1) a local antibiotic guideline should be present, and (2) these local guidelines should correspond to the national antibiotic guidelines.

CONCLUSIONS

The selected QIs can be used in antibiotic stewardship programs to determine for which aspects of antibiotic use there is room for improvement. At this moment we are testing the clinimetric properties of these QIs in 1800 hospitalized patients, in 22 Dutch hospitals.

A systematic literature review to clarify the concept of vaccine hesitancy

Vaccine hesitancy (VH) is considered a top-10 global health threat. The concept of VH has been described and applied inconsistently. This systematic review aims to clarify VH by analysing how it is operationalized. We searched PubMed, Embase and PsycINFO databases on 14 January 2022. We selected 422 studies containing operationalizations of VH for inclusion. One limitation is that studies of lower quality were not excluded. Our qualitative analysis reveals that VH is conceptualized as involving (1) cognitions or affect, (2) behaviour and (3) decision making. A wide variety of methods have been used to measure VH. Our findings indicate the varied and confusing use of the term VH, leading to an impracticable concept. We propose that VH should be defined as a state of indecisiveness regarding a vaccination decision.

Barriers to optimal antibiotic use for community-acquired pneumonia at hospitals: a qualitative study

BACKGROUND

Physician adherence to key recommendations of guidelines for community-acquired pneumonia (CAP) is often not optimal. A better understanding of factors influencing optimal performance is needed to plan effective change.

METHODS

The authors used semistructured interviews with care providers in three Dutch medium-sized hospitals to qualitatively study and understand barriers to appropriate antibiotic use in patients with CAP. They discussed recommendations about the prescription of empirical antibiotic therapy that adheres to the guidelines, timely administration of antibiotics, adjusting antibiotic dosage to accommodate decreased renal function, switching and streamlining therapy, and blood and sputum culturing. The authors then classified the barriers each recommendation faced into categories using a conceptual framework (Cabana).

RESULTS

Eighteen interviews were performed with residents and specialists in pulmonology and internal medicine, with medical microbiologists and a clinical pharmacist. Two additional multidisciplinary small group interviews which included nurses were performed. Each guideline recommendation elicited a different type of barrier. Regarding the choice of guideline-adherent empirical therapy, treating physicians said that they worried about patient outcome when prescribing narrow-spectrum antibiotic therapy. Regarding the timeliness of antibiotic administration, barriers such as conflicting guidelines and organisational factors (for example, delayed laboratory results, antibiotics not directly available, lack of time) were reported. Not streamlining therapy after culture results became available was thought to be due to the physicians' attitude of "never change a winning team".

CONCLUSIONS

Efforts to improve the use of antibiotics for patients with CAP should consider the range of barriers that care providers face. Each recommendation meets its own barriers. Interventions to improve adherence should be tailored to these factors.

Impact of a team and leaders-directed strategy to improve nurses' adherence to hand hygiene guidelines: a cluster randomised trial

BACKGROUND

Improving hand hygiene compliance is still a major challenge for most hospitals. Innovative approaches are needed.

OBJECTIVE

We tested whether an innovative, theory based, team and leaders-directed strategy would be more effective in increasing hand hygiene compliance rates in nurses than a literature based state-of-the-art strategy.

DESIGN AND SETTING

A cluster randomised controlled trial called HELPING HANDS was conducted in 67 nursing wards of three hospitals in the Netherlands.

PARTICIPANTS

All affiliated nurses of the nursing wards. Wards were randomly assigned to either the team and leaders-directed strategy (30 wards) or the state-of-the-art strategy (37 wards).

METHODS

The control arm received a state-of-the-art strategy including education, reminders, feedback and targeting adequate products and facilities. The experimental group received all elements of the state-of-the-art strategy supplemented with interventions based on social influence and leadership, comprising specific team and leaders-directed activities. Strategies were delivered during a period of six months. We monitored nurses' HH compliance during routine patient care before and directly after strategy delivery, as well as six months later. Secondary outcomes were compliance with each type of hand hygiene opportunity, the presence of jewellery and whether the nurses wore long-sleeved clothes. The effects were evaluated on an intention-to-treat basis by comparing the post-strategy hand hygiene compliance rates with the baseline rates. Multilevel analysis was applied to compensate for the clustered nature of the data using mixed linear modelling techniques.

RESULTS

During the study, we observed 10,785 opportunities for appropriate hand hygiene in 2733 nurses. The compliance in the state-of-the-art group increased from 23% to 42% in the short term and to 46% in the long run. The hand hygiene compliance in the team and leaders-directed group improved from 20% to 53% in the short term and remained 53% in the long run. The difference between both strategies showed an Odds Ratio of 1.64 (95% CI 1.33-2.02) in favour of the team and leaders-directed strategy.

CONCLUSIONS

Our results support the added value of social influence and enhanced leadership in hand hygiene improvement strategies. The methodology of the latter also seems promising for improving team performance with other patient safety issues.

TRIAL REGISTRATION

ClinicalTrials.gov [NCT00548015].

Antibiotic stewardship: does it work in hospital practice? A review of the evidence base

BACKGROUND

Guidelines for developing and implementing stewardship programmes include recommendations on appropriate antibiotic use to guide the stewardship team's choice of potential stewardship objectives. They also include recommendations on behavioural change interventions to guide the team's choice of potential interventions to ensure that professionals actually use antibiotics appropriately in daily practice.

AIMS

To summarize the evidence base of both appropriate antibiotic use recommendations (the 'what') and behavioural change interventions (the 'how') in hospital practice.

SOURCES

Published systematic reviews/Medline.

CONTENT

The literature shows low-quality evidence of the positive effects of appropriate antibiotic use in hospital patients. The literature shows that any behavioural change intervention might work to ensure that professionals actually perform appropriate antibiotic use recommendations in daily practice. Although effects were overall positive, there were large differences in improvement between studies that tested similar change interventions.

IMPLICATIONS

The literature showed a clear need for studies that apply appropriate study designs- (randomized) controlled designs-to test the effectiveness of appropriate antibiotic use on achieving meaningful outcomes. Most current studies used designs prone to confounding by indication. In the process of selecting behavioural change interventions that might work best in a chosen setting, much should be learned from behavioural sciences. The challenge for stewardship teams lies in selecting change interventions on the careful assessment of barriers and facilitators, and on a theoretical base while linking determinants to change interventions. Future studies should apply more robust designs and evaluations when assessing behavioural change interventions.

Perceptions of cardiovascular risk among patients with hypertension or diabetes

We aimed to examine risk perceptions among patients at moderate to high cardiovascular risk. A questionnaire about perceived absolute risk of myocardial infarction and stroke was sent to 2424 patients with hypertension or diabetes. Response rate was 86.3% and 1557 patients without atherosclerotic disease were included. Actual cardiovascular risk was calculated by using Framingham risk functions. A total of 363 (23.3%) of the 1557 patients did not provide any risk estimates and these were particularly older patients, patients with a lower educational level, and patients reporting no alcohol consumption. The remaining 1194 patients tended to overestimate their risk. In 42.3% (497/1174) and 46.8% (541/1155) of the cases, patients overestimated their actual 10-year risk for myocardial infarction and stroke, respectively, by more than 20%. Older age, smoking, familial history of cardiovascular disease (CVD), and actual absolute risk predicted higher levels of perceived absolute risk. Male sex, higher scores for an internal health locus of control, lower scores for a physician locus of control, and self-rated excellent or (very) good health were positively related to higher accuracy. In conclusion, patients showed inadequate perceptions of their absolute risk of cardiovascular events and physicians should thus provide greater information about absolute risk when offering preventive therapy.

Antibiotic use: how to improve it?

Antibiotics are an extremely important weapon in the fight against infections. However, antimicrobial resistance is a growing problem. That is why the appropriate use of antibiotics is of great importance. A proper analysis of factors influencing appropriate antibiotic use is at the heart of an effective improvement programme, as interventions can only result in improved medical behaviour if they are well attuned to the problems, the target group, and the setting in which the change is to take place. Determinants of appropriate and inappropriate prescribing are not only found in patient knowledge and behaviour, in the way medical professionals think and act, and in the way in which patient care is organised, but also in the wider, socio-cultural environment of doctors and their patients. We present several relevant factors at each of these 4 levels and various possible measures that could be an effective response to them. The reasons why antibiotic use is inappropriate are complex. This means that any programme to rationalise antibiotic use - if it is to be effective - will have to include activities at all 4 levels discussed above. A national programme for 'appropriate antibiotic use' could be considered, including patient, professional and organisational-oriented activities. In addition, close international cooperation is required involving international guidelines, agreements, monitoring and feedback of information, and implementation programmes.

How orthodox protestant parents decide on the vaccination of their children: a qualitative study

Background

Despite high vaccination coverage, there have recently been epidemics of vaccine preventable diseases in the Netherlands, largely confined to an orthodox protestant minority with religious objections to vaccination. The orthodox protestant minority consists of various denominations with either low, intermediate or high vaccination coverage. All orthodox protestant denominations leave the final decision to vaccinate or not up to their individual members.

Methods

To gain insight into how orthodox protestant parents decide on vaccination, what arguments they use, and the consequences of their decisions, we conducted an in-depth interview study of both vaccinating and non-vaccinating orthodox protestant parents selected via purposeful sampling. The interviews were thematically coded by two analysts using the software program Atlas.ti. The initial coding results were reviewed, discussed, and refined by the analysts until consensus was reached. Emerging concepts were assessed for consistency using the constant comparative method from grounded theory.

Results

After 27 interviews, data saturation was reached. Based on characteristics of the decision-making process (tradition vs. deliberation) and outcome (vaccinate or not), 4 subgroups of parents could be distinguished: traditionally non-vaccinating parents, deliberately non-vaccinating parents, deliberately vaccinating parents, and traditionally vaccinating parents. Except for the traditionally vaccinating parents, all used predominantly religious arguments to justify their vaccination decisions. Also with the exception of the traditionally vaccinating parents, all reported facing fears that they had made the wrong decision. This fear was most tangible among the deliberately vaccinating parents who thought they might be punished immediately by God for vaccinating their children and interpreted any side effects as a sign to stop vaccinating.

Conclusions

Policy makers and health care professionals should stimulate orthodox protestant parents to make a deliberate vaccination choice but also realize that a deliberate choice does not necessarily mean a choice to vaccinate.

Development of indicators for patient-centred cancer care

Purpose

Assessment of current practice with a valid set of indicators is the key to successfully improving the quality of patient-centred care. For improvement purposes, we developed indicators of patient-centred cancer care and tested them on a population of patients with non-small cell lung cancer (NSCLC).

Methods

Recommendations for patient-centred care were extracted from clinical guidelines, and patients were interviewed to develop indicators for assessing the patient-centredness of cancer care. These indicators were tested with regard to psychometric characteristics (room for improvement, applicability, discriminating capacity and reliability) on 132 patients with NSCLC treated in six hospitals in the east Netherlands. Data were collected from patients by means of questionnaires.

Results

Eight domains of patient-centred cancer care were extracted from 61 oncology guidelines and 37 patient interviews and were translated into 56 indicators. The practice test amongst patients with NSCLC showed the most room for improvement within the domains ‘emotional and psychosocial support’, ‘physical support’ and ‘information supply’. Overall, 26 of the 56 indicators had good psychometric characteristics.

Conclusions

Developing a valid set of patient-centred indicators is a first step towards improving the patient centredness of cancer care. Indicators can be based on recommendations from guidelines, but adding patient opinions leads to a more complete picture of patient centredness. The practice test on patients with NSCLC showed that the patient centredness of cancer care can be improved. Our set of indicators may also be useful for future quality assessments for other patients with cancers or chronic diseases.

Review article: Effectiveness of patient care teams and the role of clinical expertise and coordination: a literature review

Health care is increasingly provided by teams of health professionals rather than by individual doctors. For decision makers, it is imperative to identify the critical elements for effective teams to transform health care workplaces into effective team-based environments. The authors reviewed the research literature published between 1990 and February 2008. The available research indicated that teams with enhanced clinical expertise improved professional performance and had mixed effects on patient outcomes. Teams with improved coordination had some positive effects on patient outcomes and limited effects on costs and resource utilization. The combination of enhanced expertise and coordination only showed some limited effect on patient outcomes. The authors conclude that enhancement of the clinical expertise is a potentially effective component of improving the impact of patient care teams. The added value of coordination functions remained unclear. Overall, current studies provide little insight into the underlying mechanisms of teamwork.

Religious subgroups influencing vaccination coverage in the Dutch Bible belt: an ecological study

Background

The Netherlands has experienced epidemics of vaccine preventable diseases largely confined to the Bible belt, an area where -among others- orthodox protestant groups are living. Lacking information on the vaccination coverage in this minority, and its various subgroups, control of vaccine preventable diseases is focused on the geographical area of the Bible belt. However, the adequacy of this strategy is questionable. This study assesses the influence of presence of various orthodox protestant subgroups (orthodox protestant denominations, OPDs) on municipal vaccination coverage in the Bible belt.

Methods

We performed an ecological study at municipality level. Data on number of inhabitants, urbanization level, socio-economical status, immigration and vaccination coverage were obtained from national databases. As religion is not registered in the Netherlands, membership numbers of the OPDs had to be obtained from church year books and via church offices. For all municipalities in the Netherlands, the effect of presence or absence of OPDs on vaccination coverage was assessed by comparing mean vaccination coverage. For municipalities where OPDs were present, the effect of each of them (measured as membership ratio, the number of members proportional to total number of inhabitants) on vaccination coverage was assessed by bivariate correlation and multiple regression analysis in a model containing the determinants immigration, socio-economical status and urbanization as well.

Results

Mean vaccination coverage (93.5% ± 4.7) in municipalities with OPDs (n = 135) was significantly lower (p < 0.001) than in 297 municipalities without OPDs (96.9% ± 2.1). Multiple regression analyses showed that in municipalities with OPDs 84% of the variance in vaccination coverage was explained by the presence of these OPDs. Immigration had a significant, but small explanatory effect as well. Membership ratios of all OPDs were negatively related to vaccination coverage; this relationship was strongest for two very conservative OPDs.

Conclusion

As variance in municipal vaccination coverage in the Bible belt is largely explained by membership ratios of the various OPDs, control of vaccine preventable diseases should be focused on these specific risk groups. In current policy part of the orthodox protestant risk group is missed.

Tailored interventions to improve antibiotic use for lower respiratory tract infections in hospitals: a cluster-randomized, controlled trial

BACKGROUND

Limited data exist on the most effective approach to increase the quality of antibiotic use for lower respiratory tract infections at hospitals.

METHODS

One thousand nine hundred six patients with community-acquired pneumonia or an exacerbation of chronic obstructive pulmonary disease (acute exacerbation of chronic bronchitis) were included in a cluster-randomized, controlled trial at 6 medium-to-large Dutch hospitals. A multifaceted guideline-implementation strategy that was tailored to baseline performance and considered the barriers in the target group was used. Principal outcome measures were (1) guideline-adherent antibiotic prescription, (2) adaptation of dose and dose interval of antibiotics according to renal function, (3) switches in therapy, (4) streamlining of therapy, and (5) Gram staining and culture of sputum samples. Secondary process outcomes were applicable to community-acquired pneumonia (e.g., timely administration of antibiotics) or acute exacerbation of chronic bronchitis (e.g., not prescribing macrolides).

RESULTS

The rate of guideline-adherent antibiotic prescription increased from 50.3% to 64.3% in the intervention hospitals (odds ratio [OR], 2.63; 95% confidence interval [CI], 1.57-4.42; P=.0008). The rate of adaptation of antibiotic dose according to renal function increased from 79.4% to 95.1% in the intervention hospitals (OR, 7.32; 95% CI, 2.09-25.7; P=.02). The switch from intravenous to oral therapy improved more in the control hospitals (from 53.3% to 71.9%) than in the intervention hospitals (from 74% to 83.6%). The change from broad-spectrum empirical therapy to pathogen-directed therapy improved by 5.7% in the intervention hospitals (P = not significant). Fewer sputum samples were obtained from both the intervention group (rate of sputum samples obtained decreased from 55.8% to 53.1%) and the control group (rate of sputum samples obtained decreased from 49.6% to 42.7%). Timely administration of antibiotics for community-acquired pneumonia increased significantly in the intervention group (from 55.2% to 62.9%; OR, 2.49; 95% CI, 1.11-5.57; P=.026).

CONCLUSIONS

With regard to some important aspects, tailoring interventions to change antibiotic use improved the quality of treatment for patients hospitalized with lower respiratory tract infection.

Quality of antibiotic use for lower respiratory tract infections at hospitals: (how) can we measure it?

BACKGROUND

To assess and improve the quality of antibiotic use in patients with community-acquired pneumonia (CAP) and acute exacerbation of chronic bronchitis or chronic obstructive pulmonary disease (AECB), a valid set of quality indicators is required. This set should also be applicable in practice.

METHODS

Guidelines and literature were reviewed to derive potential indicators for quality of antibiotic use in treating hospitalized patients with lower respiratory tract infection (LRTI). To assess the evidence base of each indicator, a literature review was performed. Grade A recommendations were considered valid. For grade B-D recommendations, an expert panel performed a consensus procedure on the indicator's relevance to patient health, reduction of antimicrobial resistance, and cost containment. To test applicability in practice, feasibility, opportunity for improvement, reliability, and case-mix stability were determined for a data set of 899 hospitalized patients with LRTI.

RESULTS

None of the potential indicators from guidelines and literature were supported by grade A evidence. Nineteen indicators were selected by consensus procedure (12 indicators for CAP and 7 indicators for AECB). Lack of feasibility and of opportunity for improvement led to the exclusion of 4 indicators. A final set of 15 indicators was defined (9 indicators for CAP and 6 indicators for AECB).

CONCLUSIONS

A valid set of quality indicators for antibiotic use in hospitalized patients with LRTI was developed by combining evidence and expert opinion in a carefully planned procedure. Subjecting indicators to an applicability test is essential before using them in quality-improvement projects. In our demonstration setting, 4 of the 19 indicators were inapplicable in practice.

Applicability of generic quality indicators for appropriate antibiotic use in daily hospital practice: a cross-sectional point-prevalence multicenter study

The ability to monitor the appropriateness of hospital antibiotic use is a key element of an effective antibiotic stewardship program. A set of 11 generic quality indicators (QIs) was previously developed to assess the quality of antibiotic use in hospitalized adults treated for a bacterial infection. The primary aim of the current study was to assess the clinimetric properties of these QIs (nine process and two structure indicators) in daily clinical practice. In a cross-sectional point-prevalence survey, performed in 2011 and 2012, 1890 inpatients from 22 hospitals in the Netherlands treated with antibiotics for a suspected bacterial infection were included, and data were extracted from medical records. In this cohort we tested the measurability, applicability, reliability, room for improvement and case mix stability of the previously developed QIs. Low applicability (≤10% of reviewed patients) was found for the QIs 'therapeutic drug monitoring', 'adapting antibiotics to renal function' and 'discontinue empirical therapy in case of lack of clinical and/or microbiological evidence of infection'. For the latter, we also found a low inter-observer agreement (kappa <0.4). One QI showed low improvement potential. The remaining seven QIs had sound clinimetric properties. Case-mix correction was necessary for most process QIs. For all QIs, we found ample room for improvement and large variation between hospitals. Establishing the clinimetric properties was essential, as four of the 11 previously selected QIs showed unsatisfactory properties in this practice test. Since the quality of antibiotic use and the process of documenting data is changing over time and may vary per country, QIs should always be tested in practice first.

Optimizing design of research to evaluate antibiotic stewardship interventions: consensus recommendations of a multinational working group

BACKGROUND

Antimicrobial stewardship interventions and programmes aim to ensure effective treatment while minimizing antimicrobial-associated harms including resistance. Practice in this vital area is undermined by the poor quality of research addressing both what specific antimicrobial use interventions are effective and how antimicrobial use improvement strategies can be implemented into practice. In 2016 we established a working party to identify the key design features that limit translation of existing research into practice and then to make recommendations for how future studies in this field should be optimally designed. The first part of this work has been published as a systematic review. Here we present the working group's final recommendations.

METHODS

An international working group for design of antimicrobial stewardship intervention evaluations was convened in response to the fourth call for leading expert network proposals by the Joint Programming Initiative on Antimicrobial Resistance (JPIAMR). The group comprised clinical and academic specialists in antimicrobial stewardship and clinical trial design from six European countries. Group members completed a structured questionnaire to establish the scope of work and key issues to develop ahead of a first face-to-face meeting that (a) identified the need for a comprehensive systematic review of study designs in the literature and (b) prioritized key areas where research design considerations restrict translation of findings into practice. The working group's initial outputs were reviewed by independent advisors and additional expertise was sought in specific clinical areas. At a second face-to-face meeting the working group developed a theoretical framework and specific recommendations to support optimal study design. These were finalized by the working group co-ordinators and agreed by all working group members.

RESULTS

We propose a theoretical framework in which consideration of the intervention rationale the intervention setting, intervention features and the intervention aims inform selection and prioritization of outcome measures, whether the research sets out to determine superiority or non-inferiority of the intervention measured by its primary outcome(s), the most appropriate study design (e.g. experimental or quasi- experimental) and the detailed design features. We make 18 specific recommendation in three domains: outcomes, objectives and study design.

CONCLUSIONS

Researchers, funders and practitioners will be able to draw on our recommendations to most efficiently evaluate antimicrobial stewardship interventions.

The role of religious leaders in promoting acceptance of vaccination within a minority group: a qualitative study

BACKGROUND

Although childhood vaccination programs have been very successful, vaccination coverage in minority groups may be considerably lower than in the general population. In order to increase vaccination coverage in such minority groups involvement of faith-based organizations and religious leaders has been advocated. We assessed the role of religious leaders in promoting acceptance or refusal of vaccination within an orthodox Protestant minority group with low vaccination coverage in The Netherlands.

METHODS

Semi-structured interviews were conducted with orthodox Protestant religious leaders from various denominations, who were selected via purposeful sampling. Transcripts of the interviews were thematically analyzed, and emerging concepts were assessed for consistency using the constant comparative method from grounded theory.

RESULTS

Data saturation was reached after 12 interviews. Three subgroups of religious leaders stood out: those who fully accepted vaccination and did not address the subject, those who had religious objections to vaccination but focused on a deliberate choice, and those who had religious objections to vaccination and preached against vaccination. The various approaches of the religious leaders seemed to be determined by the acceptance of vaccination in their congregation as well as by their personal point of view. All religious leaders emphasized the importance of voluntary vaccination programs and religious exemptions from vaccination requirements. In case of an epidemic of a vaccine preventable disease, they would appreciate a dialogue with the authorities. However, they were not willing to promote vaccination on behalf of authorities.

CONCLUSION

Religious leaders' attitudes towards vaccination vary from full acceptance to clear refusal. According to orthodox Protestant church order, local congregation members appoint their religious leaders themselves. Obviously they choose leaders whose views are compatible with the views of the congregation members. Moreover, the positions of orthodox Protestant religious leaders on vaccination will not change easily, as their objections to vaccination are rooted in religious doctrine and they owe their authority to their interpretation and application of this doctrine. Although the dialogue with religious leaders that is pursued by the Dutch government may be helpful in controlling epidemics by other means than vaccination, it is unlikely to increase vaccination coverage.

Patient-related determinants of antibiotic use: a systematic review

OBJECTIVES

We aimed to assess patient-related determinants potentially influencing antibiotic use.

METHODS

Studies published in MEDLINE until 30 September 2015 were searched. We included: qualitative studies describing patients' self-reported determinants of antibiotic use; and quantitative studies on either self-reported or objectively assessed determinants associated with antibiotic use. Whenever possible, reported determinants were categorized as 'barriers' or 'facilitators' of responsible antibiotic use.

RESULTS

A total of 87 studies from 33 countries were included. Seventy-five (86.2%) were quantitative and described self-reported (45/75, 60.0%), objectively assessed (20/75, 26.7%) or self-reported and objectively assessed (10/75, 13.3%) patient-related determinants. Twelve (12/87, 13.8%) were qualitative studies or had a qualitative and quantitative component. Eighty-six of the studies (98.8%) concerned the outpatient setting. We identified seven broad categories of determinants having an impact on different aspects of antibiotic use (in descending order of frequency): demographic and socio-economic characteristics, patient-doctor interactions (e.g. counselling), treatment characteristics (e.g. administration frequency), attitudes (e.g. expecting antibiotics), access to treatment (e.g. patients' direct costs), characteristics of the condition for which the antibiotic was prescribed (e.g. duration of symptoms), knowledge (e.g. regarding indications for treatment). Most determinants were classified as 'barriers' to responsible antibiotic use.

CONCLUSION

A large variety of patient-related determinants impact antibiotic use. The most easily 'modifiable' determinants concern patient-doctor interactions, treatment characteristics and knowledge. Data from the inpatient setting and low- and middle-income countries were underrepresented. Further studies should develop and test interventions that take these determinants into account with the ultimate aim of improving responsible use of antibiotics.

The Team Climate Inventory: application in hospital teams and methodological considerations

OBJECTIVE

To test the validity, reliability and discriminating capacity of an instrument to assess team climate, the Team Climate Inventory (TCI), in a sample of Dutch hospital teams. The TCI is based on a four-factor theory of team climate for innovation.

DESIGN

Validation study.

SETTING

Hospital teams in The Netherlands.

PARTICIPANTS

424 healthcare professionals; 355 nurses working in 22 nursing teams and 69 nurses and doctors working in 14 quality-improvement teams.

MAIN OUTCOME MEASURES

Exploratory and confirmatory factor analyses, Pearson's product moment correlations, internal homogeneity of the TCI scales based on Cronbach alpha, and the TCI capability to discriminate between two types of healthcare teams, namely nursing teams and quality-improvement teams.

RESULTS

The validity test revealed the TCI's five-factor structure and moderate data fit. The Cronbach alphas of the five scales showed acceptable reliabilities. The TCI discriminated between nursing teams and quality-improvement teams. The mean scores of quality-improvement teams were all significantly higher than those of the nursing teams.

CONCLUSION

Patient care teams are essential for high-quality patient care, and team climate is an important characteristic of successful teams. This study shows that the TCI is a valid, reliable and discriminating self-report measure of team climate in hospital teams. The TCI can be used as a quality-improvement tool or in quality-of-care research.