IBCD: development and testing of a checklist to improve quality of care for hospitalized general medical patients

Effectiveness of Catch-Up Vaccination Interventions Versus Standard or Usual Care Procedures in Increasing Adherence to Recommended Vaccinations Among Different Age Groups: Systematic Review and Meta-Analysis of Randomized Controlled Trials and Before-After Studies

BACKGROUND

To address the global challenge of vaccine hesitancy, the Strategic Advisory Group of Experts on Immunization strongly promotes vaccination reminder and recall interventions. Coupled with the new opportunities presented by scientific advancements, these measures are crucial for successfully immunizing target population groups.

OBJECTIVE

This systematic review and meta-analysis aims to assess the effectiveness of various interventions in increasing vaccination coverage compared with standard or usual care. The review will cover all vaccinations recommended for different age groups.

METHODS

In February 2022, 2 databases were consulted, retrieving 1850 studies. Following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, 79 manuscripts were included after the assessment phase. These comprised 46 trials/randomized controlled trials (RCTs) and 33 before-after studies. A meta-analysis using a random-effects model was performed with STATA software (version 14.1.2). The selected outcome was the risk ratio (RR) of vaccination coverage improvement effectiveness. Additionally, meta-regression analyses were conducted for the included manuscripts.

RESULTS

The analyses showed an overall efficacy of RR 1.22 (95% CI 1.19-1.26) for RCTs and RR 1.70 (95% CI 1.54-1.87) for before-after studies when considering all interventions cumulatively. Subgroup analyses identified multicomponent interventions (RR 1.58, 95% CI 1.36-1.85) and recall clinical interventions (RR 1.24, 95% CI 1.17-1.32) as the most effective in increasing vaccination coverage for RCTs. By contrast, educational interventions (RR 2.13, 95% CI 1.60-2.83) and multicomponent interventions (RR 1.61, 95% CI 1.43-1.82) achieved the highest increases for before-after studies. Meta-regression analyses indicated that the middle-aged adult population was associated with a higher increase in vaccination coverage (RCT: coefficient 0.54, 95% CI 0.12-0.95; before-after: coefficient 1.27, 95% CI 0.70-1.84).

CONCLUSIONS

Community, family, and health care-based multidimensional interventions, as well as education-based catch-up strategies, effectively improve vaccination coverage. Therefore, their systematic implementation is highly relevant for targeting undervaccinated population groups. This approach aligns with national vaccination schedules and aims to eliminate or eradicate vaccine-preventable diseases.

Evaluation of staff satisfaction after the implementation of a daily goals sheet in the routine work of an oral outpatient department and its influence on work efficiency

BACKGROUND

In March 2021, the supervision group of our hospital inspected the daily work of the outpatient department in the branch and found many problems in the process, such as an excessive number of daily check-up forms, nurses' confusion regarding the daily check-up process, and the omission of daily check-up items. Therefore, focusing on these problem, our hospital established a quality improvement team to conduct a status survey and perform this study. This study evaluated the feasibility, availability and sustainability of using a daily goals sheet in the routine work of a stomatological outpatient department and investigated the satisfaction of the nursing staff with the sheet.

METHODS

After determining the theme of this study through the status survey, 60 nurses were randomly selected and divided into an experimental group and a control group by a random grouping method. Then, the study was divided into two stages: Applying the PDCA cycle method and following the MECE (Mad Exclusive, Collectively Exhaustive) principle to design, manufacture and apply the daily goals sheet. After the expert group performed Stage one, an analysis of work efficiency and routine omissions and a staff satisfaction survey were carried out. The results of the groups either using the daily goals sheet (n = 30) or not (n = 30) were analysed and compared.

RESULTS

The average work time of the daily goals sheet group was 15.20 ± 1.70 min, and that of the nondaily goals sheet group was 25.30 ± 2.70 min (P < 0.001). The omission rate was 0% in the daily goals sheet group and 16.67% in the nondaily goals sheet group. Staff satisfaction with the use of the daily goals sheet was high.

CONCLUSION

The daily goals sheet can make routine work more efficient and convenient in a stomatological outpatient department. It is recommended for use in stomatological outpatient departments or hospitals.

Manually-generated reminders delivered on paper: effects on professional practice and patient outcomes

BACKGROUND

Health professionals sometimes do not use the best evidence to treat their patients, in part due to unconscious acts of omission and information overload. Reminders help clinicians overcome these problems by prompting them to recall information that they already know, or by presenting information in a different and more accessible format. Manually-generated reminders delivered on paper are defined as information given to the health professional with each patient or encounter, provided on paper, in which no computer is involved in the production or delivery of the reminder. Manually-generated reminders delivered on paper are relatively cheap interventions, and are especially relevant in settings where electronic clinical records are not widely available and affordable. This review is one of three Cochrane Reviews focused on the effectiveness of reminders in health care.

OBJECTIVES

1. To determine the effectiveness of manually-generated reminders delivered on paper in changing professional practice and improving patient outcomes. 2. To explore whether a number of potential effect modifiers influence the effectiveness of manually-generated reminders delivered on paper.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, CINAHL and two trials registers on 5 December 2018. We searched grey literature, screened individual journals, conference proceedings and relevant systematic reviews, and reviewed reference lists and cited references of included studies.

SELECTION CRITERIA

We included randomised and non-randomised trials assessing the impact of manually-generated reminders delivered on paper as a single intervention (compared with usual care) or added to one or more co-interventions as a multicomponent intervention (compared with the co-intervention(s) without the reminder component) on professional practice or patients' outcomes. We also included randomised and non-randomised trials comparing manually-generated reminders with other quality improvement (QI) interventions.

DATA COLLECTION AND ANALYSIS

Two review authors screened studies for eligibility and abstracted data independently. We extracted the primary outcome as defined by the authors or calculated the median effect size across all reported outcomes in each study. We then calculated the median percentage improvement and interquartile range across the included studies that reported improvement related outcomes, and assessed the certainty of the evidence using the GRADE approach.

MAIN RESULTS

We identified 63 studies (41 cluster-randomised trials, 18 individual randomised trials, and four non-randomised trials) that met all inclusion criteria. Fifty-seven studies reported usable data (64 comparisons). The studies were mainly located in North America (42 studies) and the UK (eight studies). Fifty-four studies took place in outpatient/ambulatory settings. The clinical areas most commonly targeted were cardiovascular disease management (11 studies), cancer screening (10 studies) and preventive care (10 studies), and most studies had physicians as their target population (57 studies). General management of a clinical condition (17 studies), test-ordering (14 studies) and prescription (10 studies) were the behaviours more commonly targeted by the intervention. Forty-eight studies reported changes in professional practice measured as dichotomous process adherence outcomes (e.g. compliance with guidelines recommendations), 16 reported those changes measured as continuous process-of-care outcomes (e.g. number of days with catheters), eight reported dichotomous patient outcomes (e.g. mortality rates) and five reported continuous patient outcomes (e.g. mean systolic blood pressure). Manually-generated reminders delivered on paper probably improve professional practice measured as dichotomous process adherence outcomes) compared with usual care (median improvement 8.45% (IQR 2.54% to 20.58%); 39 comparisons, 40,346 participants; moderate certainty of evidence) and may make little or no difference to continuous process-of-care outcomes (8 comparisons, 3263 participants; low certainty of evidence). Adding manually-generated paper reminders to one or more QI co-interventions may slightly improve professional practice measured as dichotomous process adherence outcomes (median improvement 4.24% (IQR -1.09% to 5.50%); 12 comparisons, 25,359 participants; low certainty of evidence) and probably slightly improve professional practice measured as continuous outcomes (median improvement 0.28 (IQR 0.04 to 0.51); 2 comparisons, 12,372 participants; moderate certainty of evidence). Compared with other QI interventions, manually-generated reminders may slightly decrease professional practice measured as process adherence outcomes (median decrease 7.9% (IQR -0.7% to 11%); 14 comparisons, 21,274 participants; low certainty of evidence). We are uncertain whether manually-generated reminders delivered on paper, compared with usual care or with other QI intervention, lead to better or worse patient outcomes (dichotomous or continuous), as the certainty of the evidence is very low (10 studies, 13 comparisons). Reminders added to other QI interventions may make little or no difference to patient outcomes (dichotomous or continuous) compared with the QI alone (2 studies, 2 comparisons). Regarding resource use, studies reported additional costs per additional point of effectiveness gained, but because of the different currencies and years used the relevance of those figures is uncertain. None of the included studies reported outcomes related to harms or adverse effects.

AUTHORS' CONCLUSIONS

Manually-generated reminders delivered on paper as a single intervention probably lead to small to moderate increases in outcomes related to adherence to clinical recommendations, and they could be used as a single QI intervention. It is uncertain whether reminders should be added to other QI intervention already in place in the health system, although the effects may be positive. If other QI interventions, such as patient or computerised reminders, are available, they should be preferred over manually-generated reminders, but under close evaluation in order to decrease uncertainty about their potential effect.

Enhancing medical evaluations of sick-listed employees: an educational intervention to improve professional practice of physicians performing work ability assessments of employees on long-term sick leave

PURPOSE

Long-term sick leave (LTSL) is a complex phenomenon. Medical and non-medical factors can delay return-to-work (RTW); therefore, the assessment of work ability is complicated. A checklist for identifying factors associated with delayed RTW was developed in a prior study to facilitate the exploration of barriers and facilitators for RTW. The purpose of the present study was to determine if use of the checklist enhances professional practice of physicians performing work ability assessments of employees on long-term sick leave and whether the reporting of work ability assessments improved when using the checklist in the routinely practice-based context.

METHODS

An educational intervention study was performed using qualitative framework analysis. Thirty-five Dutch physicians were asked to identify and report the barriers and facilitators for RTW and the consequences for the work ability and for the prognosis regarding work reintegration using the checklist. A pre-post qualitative analysis of the medical records was performed using a gradual classification of the reporting of the work ability to evaluate the change in reporting following the educational intervention.

RESULTS

A total of 337 work ability assessments were performed using the checklist. The identification of factors influencing RTW and the comprehensiveness of the medical records increased when compared with the reporting before the educational intervention. The reporting of the work ability assessments improved after the educational intervention. Most physicians reported at least one of the factors of the checklist. 72% participants reported and described adequately at least one factor. 48% participants reported how the factors influenced the work ability, 20% participants reported how the factors influenced the prognosis regarding RTW and 12% participants reported which advice was provided by the physician to influence the barriers for RTW.

CONCLUSIONS

Use of the checklist enhances professional practice of physicians performing work ability assessments of employees on long-term sick leave and is associated with increased identification of barriers and facilitators for RTW. The use of the checklist should be considered to improve professional practice of physicians performing work ability assessments.

Design and α-testing of an electronic rounding tool (CERTAINp) to improve process of care in pediatric intensive care unit

Increasing process complexity in the pediatric intensive care unit (PICU) can lead to information overload resulting in missing pertinent information and potential errors during morning rounds. An efficient model using a novel electronic rounding tool was designed as part of a broader critical care decision support system-checklist for early recognition and treatment of acute illness and injury in pediatrics (CERTAINp). We aimed to evaluate its impact on improving the process of care during rounding. Prospective pre- and post-interventional data included: team performance baseline assessment, patient safety discussion, guideline adherence, rounding time, and a survey of Residents' and Nurses' perception using a Likert scale. Attending physicians were blinded to the components of the assessment. A total of 113 pre-intervention and 114 post-intervention roundings were recorded by direct observation. Pre-intervention (108) and post-intervention staff surveys (80) were obtained. Adherence to standard of care guidelines improved to >97 % in all data points, with maximum increase seen in discussions of ulcer prophylaxis, bowel protocol, DVT prophylaxis, skin care, glucose control and head of bed elevation (2-28 % pre-vs. 100 % for all post-intervention, p < 0.01). Significant improvement was noticed in spontaneous breathing trials, sedation breaks and need for devices (45-57 % pre- vs. 100 % for all post-intervention, p < 0.01). Rounding time (mean ± SD) increased by 2 min/patient (8.0 ± 5.8 min pre-intervention vs. 9.9 ± 5.7 min post-intervention, p = 0.002). Staff reported improved perception of all aspects of rounding. Utilization of the CERTAINp rounding tool led to perfect compliance to the discussion of best practice guidelines; had minimal impact on rounding time and improved PICU staff satisfaction.

A review of acute care interventions to improve inpatient pneumococcal vaccination

OBJECTIVE

To provide a narrative review of the impact of provider-based, organizational strategies in acute care settings to improve pneumococcal vaccination rates among patients over 65, and 2-64 years with high risk medical conditions.

METHODS

A search was conducted using MEDLINE, Scopus, CINAHL and Web of Science databases for hospital-based, inpatient studies which evaluated strategies to improve pneumococcal vaccination rates. Studies published in English from 1983 to 2013 were included. Data abstracted was analyzed descriptively.

RESULTS

A total of 35 studies were included; 15 evaluated physician reminders (e.g. chart or paper reminders, pre-printed orders (PPOs), computerized reminders, checklists) and 21 standing orders programs (SOPs). The most common study design was pre/post, and only 7 studies had a control group. Overall, 32 studies showed improvements in the rate of pneumococcal vaccination following intervention (19 statistically significant), with reminders showing 29-74% immunization rate, PPCO 5-42%, and SOPs 3.4-78%.

CONCLUSION

Hospital-based interventions improve pneumococcal vaccination in older adults and younger individuals at risk. Although this review found that more success was observed with SOPs the impact on immunization rates in eligible patients varied significantly. Thus, high quality, randomized-controlled studies are required to determine the effect of each type of institutional immunization strategy.

Implementation of a checklist to assess factors relevant for work ability assessments of employees on long-term sick leave

OBJECTIVE

To implement the use of a checklist with factors relevant for work ability assessments of employees on long-term sick leave in daily practice of Dutch insurance physicians (IPs).

SUBJECTS/DESIGN

Two hundred and twenty IPs were asked to participate in a nationwide implementation study.

METHODS

A context analysis identified the barriers and promoting factors for the implementation. Then, participants were asked to assess, identify and report the factors that hinder or promote return to work (RTW) of employees on long-term sick leave using the checklist during six work ability assessments in daily practice. The outcome measure was the percentage of IPs that used the checklist in at least three of six work ability assessments. The use of the checklist was defined as the assessment of at least one of nine factors from the checklist. A frequency analysis was performed. Official work ability assessment records were analysed to determine whether the IPs reported the assessed factors.

RESULTS

Most identified barriers and facilitators were related to the potential users, the work environment and the characteristics of the checklist. The implementation goal was achieved. A total of 79 IPs participated. Almost all the IPs (96 %) assessed at least one factor; 89 % used the checklist in at least 3 work ability assessments. An analysis of 474 official work ability assessment records indicated that 90 % of the IPs reported at least one of the factors.

CONCLUSIONS

The implementation of a checklist to assess barriers and facilitators for RTW of long-term sick-listed employees was successful.

Future: new strategies for hospitalists to overcome challenges in teaching on today's wards

Changes in the clinical learning environment under resident duty hours restrictions have introduced a number of challenges on today's wards. Additionally, the current group of medical trainees is largely represented by the Millennial Generation, a generation characterized by an affinity for technology, interaction, and group-based learning. Special attention must be paid to take into account the learning needs of a generation that has only ever known life with duty hours. A mnemonic for strategies to augment teaching rounds for hospitalists was created using an approach that considers time limitations due to duty hours as well as the preferences of Millennial learners. These strategies to enhance learning during teaching rounds are Flipping the Wards, Using Documentation to Teach, Technology-Enabled Teaching, Using Guerilla Teaching Tactics, Rainy Day Teaching, and Embedding Teaching Moments into Rounds (FUTURE). Hospitalists serving as teaching attendings should consider these possible strategies as ways to enhance teaching in the post-duty hours era. These techniques appeal to the preferences of today's learners in an environment often limited by time constraints. Hospitalists are well positioned to champion innovative approaches to teaching in a dynamic and evolving clinical learning environment.