Block design allowed for control of the Hawthorne effect in a randomized controlled trial of test ordering

Audit and feedback to improve laboratory test and transfusion ordering in critical care: a systematic review

BACKGROUND

Laboratory tests and transfusions are sometimes ordered inappropriately, particularly in the critical care setting, which sees frequent use of both. Audit and Feedback (A&F) is a potentially useful intervention for modifying healthcare provider behaviors, but its application to the complex, team-based environment of critical care is not well understood. We conducted a systematic review of the literature on A&F interventions for improving test or transfusion ordering in the critical care setting.

METHODS

Five databases, two registries, and the bibliographies of relevant articles were searched. We included critical care studies that assessed the use of A&F targeting healthcare provider behaviors, alone or in combination with other interventions to improve test and transfusion ordering, as compared to historical practice, no intervention, or another healthcare behaviour change intervention. Studies were included only if they reported laboratory test or transfusion orders, or the appropriateness of orders, as outcomes. There were no restrictions based on study design, date of publication, or follow-up time. Intervention characteristics and absolute differences in outcomes were summarized. The quality of individual studies was assessed using a modified version of the Effective Practice and Organisation of Care Cochrane Review Group's criteria.

RESULTS

We identified 16 studies, including 13 uncontrolled before-after studies, one randomized controlled trial, one controlled before-after study, and one controlled clinical trial (quasi-experimental). These studies described 17 interventions, mostly (88%) multifaceted interventions with an A&F component. Feedback was most often provided in a written format only (41%), more than once (53%), and most often only provided data aggregated to the group-level (41%). Most studies saw a change in the hypothesized direction, but not all studies provided statistical analyses to formally test improvement. Overall study quality was low, with studies often lacking a concurrent control group.

CONCLUSIONS

Our review summarizes characteristics of A&F interventions implemented in the critical care context, points to some mechanisms by which A&F might be made more effective in this setting, and provides an overview of how the appropriateness of orders was reported. Our findings suggest that A&F can be effective in the context of critical care; however, further research is required to characterize approaches that optimize the effectiveness in this setting alongside more rigorous evaluation methods.

TRIAL REGISTRATION

PROSPERO CRD42016051941.

A workplace intervention to reduce alcohol and drug consumption: a nonrandomized single-group study

BACKGROUND

The consumption of alcohol and other drugs causes social and health problems in industrialized societies. Furthermore, alcohol and drug consumption in the workplace is associated with work accidents, absenteeism and low productivity. The aim of the current study is to reduce alcohol and drug consumption among workers in the service industry and, as a secondary aim, to improve their healthy habits through the reduction of alcohol and other drug consumption in their leisure time.

METHODS

This nonrandomized, single-group study was conducted in 12 work centers. The intervention began in 2009 and emphasized 1) health promotion and health monitoring, which included a) alcohol and drug awareness and b) the evaluation and monitoring of alcohol and drug consumption through a semistructured interview designed to assess risky consumption; urine tests aimed at detecting alcohol, cannabis and cocaine use; an Alcotest based on expired air to test for the recent consumption of alcohol and a saliva exam to test for the recent consumption of six drugs; and 2) secondary prevention if risky consumption was identified. Risky alcohol consumption was defined as the ingestion of more than 28 standard drink units (SDUs)/week among men and more than 17 SDUs/week among women (taking into account both work and leisure time). Drug consumption was considered risky consumption.

RESULTS

A total of 1103 workers participated, and each received 5 h of awareness training. Those who presented with risky consumption received secondary prevention training. The prevalence of risky alcohol consumption decreased by 4.1% (baseline: 14.7% reduced to 10.6% in the first year; p = 0.001), a reduction that was maintained over a 3-year follow-up period.

CONCLUSION

A comprehensive program of worker health surveillance that involves stakeholders and includes monitoring can be a means of potentially improving compliance with workplace promotion programs, resulting in the facilitation of such beneficial, desired behavior change in areas such as alcohol and drug consumption.

Effectiveness of Practices to Support Appropriate Laboratory Test Utilization: A Laboratory Medicine Best Practices Systematic Review and Meta-Analysis

Objectives

To evaluate the effectiveness of practices used to support appropriate clinical laboratory test utilization.

Methods

This review followed the Centers for Disease Control and Prevention (CDC) Laboratory Medicine Best Practices A6 cycle method. Eligible studies assessed one of the following practices for effect on outcomes relating to over- or underutilization: computerized provider order entry (CPOE), clinical decision support systems/tools (CDSS/CDST), education, feedback, test review, reflex testing, laboratory test utilization (LTU) teams, and any combination of these practices. Eligible outcomes included intermediate, systems outcomes (eg, number of tests ordered/performed and cost of tests), as well as patient-related outcomes (eg, length of hospital stay, readmission rates, morbidity, and mortality).

Results

Eighty-three studies met inclusion criteria. Fifty-one of these studies could be meta-analyzed. Strength of evidence ratings for each practice ranged from high to insufficient.

Conclusion

Practice recommendations are made for CPOE (specifically, modifications to existing CPOE), reflex testing, and combined practices. No recommendation for or against could be made for CDSS/CDST, education, feedback, test review, and LTU. Findings from this review serve to inform guidance for future studies.

The Hawthorne effect in direct observation research with physicians and patients

RATIONALE, AIMS, AND OBJECTIVES

This study examines the degree to which a "Hawthorne effect" alters outpatient-visit content.

METHODS

Trained research nurses directly observed 4454 visits to 138 family physicians. Multiple data sources were used to examine the Hawthorne effect including differences in medical record documentation for observed visits and the prior visit by the same patient, time use during visits on the first versus the second observation day of each physician, and report by the patient, physician, and observer of the effect of observation.

RESULTS

Visits on the first versus the second observation day were longer by an average of 1 minute (P < .001); there were time-use differences for 4 of 20 behaviour categories evaluated. No effect of the observer on the interaction was reported by 74% of patients and 55% of physicians. Most of those that reported an affect indicated it was slight. Patients with non-White race, lower-educational level, and poorer health were more likely to report being affected by the observer.

CONCLUSIONS

In a study that was designed to minimize the Hawthorne effect, the presence of an observer had little effect on most patient-physician visits but appeared to at least slightly effect a subgroup of vulnerable patients.

Effect of audit and feedback with peer review on general practitioners' prescribing and test ordering performance: a cluster-randomized controlled trial

BACKGROUND

Much research worldwide is focussed on cost containment and better adherence to guidelines in healthcare. The research focussing on professional behaviour is often performed in a well-controlled research setting. In this study a large-scale implementation of a peer review strategy was tested on both test ordering and prescribing behaviour in primary care in the normal quality improvement setting.

METHODS

We planned a cluster-RCT in existing local quality improvement collaboratives (LQICs) in primary care. The study ran from January 2008 to January 2011. LQICs were randomly assigned to one of two trial arms, with each arm receiving the same intervention of audit and feedback combined with peer review. Both arms were offered five different clinical topics and acted as blind controls for the other arm. The differences in test ordering rates and prescribing rates between both arms were analysed in an intention-to-treat pre-post analysis and a per-protocol analysis.

RESULTS

Twenty-one LQIC groups, including 197 GPs working in 88 practices, entered the trial. The intention-to-treat analysis did not show a difference in the changes in test ordering or prescribing performance between intervention and control groups. The per-protocol analysis showed positive results for half of the clinical topics. The increase in total tests ordered was 3% in the intervention arm and 15% in the control arm. For prescribing the increase in prescriptions was 20% in the intervention arm and 66% in the control group. It was observed that the groups with the highest baseline test ordering and prescription volumes showed the largest improvements.

CONCLUSIONS

Our study shows that the results from earlier work could not be confirmed by our attempt to implement the strategy in the field. We did not see a decrease in the volumes of tests ordered or of the drugs prescribed but were able to show a lesser increase instead. Implementing the peer review with audit and feedback proved to be not feasible in primary care in the Netherlands.

TRIAL REGISTRATION

This trial was registered at the Dutch trial register under number ISRCTN40008171 on August 7^th 2007.

The effect of an acupressure backrest on pain and disability in office workers with chronic low back pain: A randomized, controlled study and patients' preferences

OBJECTIVE

This study investigated the effects of an acupoint-stimulating lumbar backrest on pain and disability in office workers who suffering from low back pain (LBP) as well as the preference influence on pain and disability.

METHODS

Sixty-four participants were randomly assigned to two groups: one with no intervention (n=32) and another with 1 month of backrest use (n=32). An additional group (n=37) who wished to try 1 month of acupressure backrest were recruited to indicate the preference effect. Pain and disability were two key outcomes.

RESULTS

Significant differences between control and randomized acupressure backrest groups were found at 2 week period for disability and at 4 weeks for pain after the backrest use. Also, significant differences were found in both groups for 3 month period with an increase of the treatment effect on pain and disability. Both control and randomized acupressure backrest groups showed greater improvement in pain and disability scores which were more than the minimal clinically important change (30% improvement for both outcomes). No significant difference was found for pain and disability between the randomized and preferred backrest groups.

CONCLUSION

These findings suggested 1-month of acupressure backrest use could improve LBP conditions. Preference was not a powerful moderator to the significant treatment effect.

The balanced incomplete block design is not suitable for the evaluation of complex interventions

OBJECTIVES

In quality of care research, the balanced incomplete block (BIB) design is regularly claimed to have been used when evaluating complex interventions. In this article, we reflect on the appropriateness of using this design for evaluating complex interventions.

STUDY DESIGN AND SETTING

Literature study using PubMed and handbooks.

RESULTS

After studying various articles on health services research that claim to have applied the BIB and the original methodological literature on this design, it became clear that the applied method is in fact not a BIB design.

CONCLUSION

We conclude that the use of this design is not suited for evaluating complex interventions. We stress that, to prevent improper use of terms, more attention should be paid to proper referencing of the original methodological literature.

The effect of an active implementation of a disease management programme for chronic obstructive pulmonary disease on healthcare utilization--a cluster-randomised controlled trial

BACKGROUND

The growing population living with chronic conditions calls for efficient healthcare-planning and effective care. Implementing disease-management-programmes is one option for responding to this demand. Knowledge is scarce about the effect of implementation processes and their effect on patients; only few studies have reported the effectiveness of disease-management-programmes targeting patients with chronic obstructive pulmonary disease (COPD). The objective of this paper was to determine the effect on healthcare-utilization of an active implementation model for a disease-management-programme for patients with one of the major multimorbidity diseases, COPD.

METHODS

The standard implementation of a new disease-management-programme for COPD was ongoing during the study-period from November 2008 to November 2010 in the Central Denmark Region. We wanted to test a strategy using Breakthrough Series, academic detailing and lists of patients with COPD. It targeted GPs and three hospitals serving approx. 60,000 inhabitants aged 35 or older and included interventions directed at professionals, organisations and patients. The study was a non-blinded block- and cluster-randomised controlled trial with GP-practices as the unit of randomisation. In Ringkoebing-Skjern Municipality, Denmark, 16 GP-practices involving 38 GPs were randomised to either the intervention-group or the control-group. A comparable neighbouring municipality acted as an external-control-group which included nine GP-practices with 25 GPs. An algorithm based on health-registry-data on lung-related contacts to the healthcare-system identified 2,736 patients who were alive at the end of the study-period. The population included in this study counted 1,372 (69.2%) patients who responded to the baseline questionnaire and confirmed their COPD diagnosis; 458 (33.4%) patients were from the intervention-group, 376 (27.4%) from the control-group and 538(39.2%) from the external-control-group. The primary outcome was adherence to the disease-management-programme measured at patient-level by use of specific services from general practice. Secondary outcomes were use of out-of-hours-services, outpatient-clinic, and emergency-department and hospital-admissions.

RESULTS

The intervention practices provided more planned preventive consultations, additional preventive consultations and spirometries than non-intervention practices. A comparison of the development in the intervention practices with the development in the control-practices showed that the intervention resulted in more planned preventive-consultations, fewer conventional consultations and fewer patients admitted without a lung-related-diagnosis.

CONCLUSIONS

Use of the active implementation model for the disease-management-programme for COPD changed the healthcare utilization in accordance with the programme.

TRIAL REGISTRATION

Clinicaltrials.gov identifier: NCT01228708.

Patient-experienced effect of an active implementation of a disease management programme for COPD - a randomised trial

BACKGROUND

People living with chronic disease currently account for the majority of the total healthcare costs. The Central Denmark Region implemented a disease management programme (DMP) for chronic obstructive pulmonary disease (COPD) in 2008. This presented an opportunity to examine the effect of an evidence-based, planned and proactive implementation of a DMP compared to the usual implementation strategy.

METHODS

We performed a block- and cluster-randomised controlled trial with two groups and an extra external control group. The primary outcome was patients' assessment of their care after using an active implementation model for a DMP for COPD measured with the Patient-Assessment-of-Chronic-Illness-Care (PACIC) instrument. At baseline, questionnaires were sent to 2,895 patients identified by an algorithm based on health registry data on lung-related contacts to the healthcare system. Patients were asked to confirm or refute their diagnosis of COPD. Of those who responded, 1,445 (72.8%) confirmed their diagnosis. PACIC data were collected at baseline and at a 12-month follow-up for 744 (51.1%) patients.

RESULTS

Comparing the three groups after the implementation of the DMP, we found a statistically significantly higher change in the PACIC score in the intervention group than in the control groups. No statistically significant differences were found between the control and the external control groups in any of the dimensions.

CONCLUSIONS

Reinforcing the role of general practice as coordinator for care-and self-management-support with an active implementation of a DMP for COPD made patients score higher on the PACIC instrument, which indicates a better experience of the received healthcare.

TRIAL REGISTRATION

NCT01228708.

Influence of multiple initiatives in Sweden to enhance ARB prescribing efficiency following generic losartan; findings and implications for other countries

BACKGROUND

Encouraging the prescribing of ACEIs first line vs. angiotensin receptor blockers (ARBs) has been a health authority focus with generic ACEIs as ACEIs and ARBs have similar effectiveness and there is limited coughing with ACEIs. This includes Sweden with its multiple initiatives keeping expenditure on renin-angiotensin inhibitor drugs similar between 2001 and 2007 despite appreciably increased volumes. Generic losartan became available and was reimbursed in March 2010 providing further opportunities for the authorities in Sweden to save costs with all ARBs seen as similar in managing hypertension and CHF at appropriate doses.

AIMS

The main aim of this study was to assess changes in the utilisation of losartan vs. other single ARBs after generic losartan alongside accompanying demand-side measures. Additional aims were to (i) assess changes in the price of generic losartan and single ARB expenditure over time; (ii) suggest additional programmes, if needed; and (iii) analyse utilisation of ARB FDCs and compare with ACEI FDCs.

METHODS

Retrospective observational study using an interrupted time series design.

RESULTS

Multiple demand-side measures introduced among the 21 Counties in Sweden significantly enhanced the utilisation of generic losartan, growing from 26% to 27% of total ARBs (DDD basis) before generic losartan to 40% by August 2011. Losartan was principally generics (97% by August 2011). Expenditure/DDD for generic losartan was 10% of the pre-patent loss price in August 2011. This reduced total single ARB expenditure by 26% by the study end despite a 16% increase in utilisation. Greater utilisation of ARB FDCs than seen with ACEI FDCs. This may be due to similarities in prices between single and FDC ARBs.

DISCUSSION

Multiple demand-side measures appreciably enhanced ARB prescribing efficiency, mirroring other studies. No significant increase in losartan utilisation following generics was seen in European countries where no specific measures were instigated. Losartan price reduction was in line with expectations.

CONCLUSION

Multiple and intensive demand-side measures are needed to change physician prescribing habits. Authorities cannot rely on physicians transferring their activities from one class to another without interventions.

Best strategies to implement clinical pathways in an emergency department setting: study protocol for a cluster randomized controlled trial

BACKGROUND

The clinical pathway is a tool that operationalizes best evidence recommendations and clinical practice guidelines in an accessible format for 'point of care' management by multidisciplinary health teams in hospital settings. While high-quality, expert-developed clinical pathways have many potential benefits, their impact has been limited by variable implementation strategies and suboptimal research designs. Best strategies for implementing pathways into hospital settings remain unknown. This study will seek to develop and comprehensively evaluate best strategies for effective local implementation of externally developed expert clinical pathways.

DESIGN/METHODS

We will develop a theory-based and knowledge user-informed intervention strategy to implement two pediatric clinical pathways: asthma and gastroenteritis. Using a balanced incomplete block design, we will randomize 16 community emergency departments to receive the intervention for one clinical pathway and serve as control for the alternate clinical pathway, thus conducting two cluster randomized controlled trials to evaluate this implementation intervention. A minimization procedure will be used to randomize sites. Intervention sites will receive a tailored strategy to support full clinical pathway implementation. We will evaluate implementation strategy effectiveness through measurement of relevant process and clinical outcomes. The primary process outcome will be the presence of an appropriately completed clinical pathway on the chart for relevant patients. Primary clinical outcomes for each clinical pathway include the following: Asthma--the proportion of asthmatic patients treated appropriately with corticosteroids in the emergency department and at discharge; and Gastroenteritis--the proportion of relevant patients appropriately treated with oral rehydration therapy. Data sources include chart audits, administrative databases, environmental scans, and qualitative interviews. We will also conduct an overall process evaluation to assess the implementation strategy and an economic analysis to evaluate implementation costs and benefits.

DISCUSSION

This study will contribute to the body of evidence supporting effective strategies for clinical pathway implementation, and ultimately reducing the research to practice gaps by operationalizing best evidence care recommendations through effective use of clinical pathways.

TRIAL REGISTRATION

ClinicalTrials.gov: NCT01815710.

Are specific initiatives required to enhance prescribing of generic atypical antipsychotics in Scotland?: International implications

BACKGROUND

National and regional authorities in Scotland have introduced multiple measures to appreciably enhance prescribing efficiency for the proton pump inhibitors (PPIs), statins and renin-angiotensin inhibitor drugs. Generic oral risperidone recently became available in Scotland; however, schizophrenia is a complex disease with advice from respected authorities suggesting that treatment should be individualised.

AIMS

To assess (i) changes in atypical antipsychotic drug (AAP) utilisation and expenditure following the availability of oral generic risperidone in Scotland; (ii) to determine (a) current INN prescribing rates for risperidone following generic availability and (b) decrease in expenditure/DDD for generic risperidone; (iii) to suggest additional measures that could possibly be introduced in Scotland to further enhance prescribing of generic AAPs; and (iv) to provide guidance to NHS Scotland as well as other European authorities on the implications.

METHODS

Retrospective observational study and an interrupted time series design.

RESULTS

No appreciable change in the utilisation patterns of risperidone pre- and postgeneric availability. Appreciable INN prescribing averaged 93-98% of total oral risperidone. Generic risperidone was 84% below prepatent loss prices by study end, reducing annual expenditure for oral risperidone in 2010 by GB£3.19mn compared with prepatent loss situation. However, overall expenditure on AAPs increased by 42% from 2005 to 2010.

DISCUSSION

As expected, there was no change in utilisation patterns for risperidone, although potential to influence prescribing patterns. Continued high INN prescribing suggests no problems with generic risperidone in practice. Costs will start to decrease as more AAPs lose their patents (olanzapine and quetiapine). There is the possibility to accelerate this reduction through educational activities.

CONCLUSION

There is potential to realise some savings with generic AAPs. However, this is limited by the complexity of the disease area. Any measures introduced must aim at increasing the prescribing of generic AAPs first line in suitable patients.

Potential to enhance the prescribing of generic drugs in patients with mental health problems in austria; implications for the future

BACKGROUND

Scrutiny over pharmaceutical expenditure is increasing leading to multiple reforms. This includes Austria with measures to lower generic prices and enhance their utilization. However the situation for newer antidepressants and atypical antipsychotic medicines (AAPs) is different to PPIs, statins, and renin-angiotensin inhibitor drugs with greater tailoring of therapy and no wish to switch products in stable patients. Authorities welcome generics though given the high costs particularly of single-sourced AAPs.

OBJECTIVE

Assess (a) changes in utilization of venlafaxine versus other newer antidepressants before and after availability of generics, (b) utilization of generic versus originator venlafaxine, (c) price reductions of venlafaxine over time and their influence on total expenditure, (d) utilization of risperidone versus other AAPs, (e) suggest potential additional reforms that could be introduced if pertinent to further enhance the use of generics.

METHODOLOGY

A quasi-experimental study design with a segmented time series and an observational study. Utilization measured in defined daily doses (DDDs) and total expenditure per DDD and over time.

RESULTS

No appreciable changes in the utilization of venlafaxine and risperidone after generics. The reduction in expenditure/DDD for venlafaxine decreased overall expenditure on newer antidepressants by 5% by the end of the study versus just before generics despite a 37% increase in utilization. Expenditure will further decrease if reduced prescribing of duloxetine.

CONCLUSION

Depression, schizophrenia, and bipolar diseases are complex diseases. As a result, specific measures are needed to encourage the prescribing of generic risperidone and venlafaxine when multiple choices are appropriate. Authorities cannot rely on a "Hawthorne" effect between classes to enhance the use of generics. Measures may include prescribing restrictions for duloxetine. No specific measures planned for AAPs with more multiple-sourced AAPs becoming available.

Quality in quality improvement research--a new benchmark

Expanded abstract

Complementary and alternative methods in cerebral palsy

There are no published studies specifically addressing complementary and alternative treatments in adults with cerebral palsy (CP). However, national surveys of adults with chronic disabilities document that a majority of them use such treatments, that they are willing to pay out of pocket, if necessary, and that they believe that pursuing such treatment relieves pain, reduces stress and anxiety, and leads to improved feelings of fitness and well-being. Individuals enjoy taking charge of their own health care decisions, and frequently feel more in control with these therapies than with more traditional methods. In contrast to adults, there is some information on complementary and alternative methods (CAM) in children with CP. This article discusses some of the CAM used in children that may be carried over into adulthood, as well as the pitfalls for patients and conventional physicians as they try to sort out what might be helpful and what might be harmful in this arena. Practitioners of both conventional and CAM therapies believe that exercise can be beneficial; accordingly, activities such as recreational sports, yoga, and hippotherapy may be continued from childhood into adulthood. General treatments for stress and anxiety, through such activities as yoga and meditation, though not directed at CP per se, may be more popular for adults than children. Research in this area should first identify what methods are being utilized and then subject these methods to well-designed outcome studies that take into account any associated risks.

A cluster randomized controlled trial aimed at implementation of local quality improvement collaboratives to improve prescribing and test ordering performance of general practitioners: study protocol

Background

The use of guidelines in general practice is not optimal. Although evidence-based methods to improve guideline adherence are available, variation in physician adherence to general practice guidelines remains relatively high. The objective for this study is to transfer a quality improvement strategy based on audit, feedback, educational materials, and peer group discussion moderated by local opinion leaders to the field. The research questions are: is the multifaceted strategy implemented on a large scale as planned?; what is the effect on general practitioners' (GPs) test ordering and prescribing behaviour?; and what are the costs of implementing the strategy?

Methods

In order to evaluate the effects, costs and feasibility of this new strategy we plan a multi-centre cluster randomized controlled trial (RCT) with a balanced incomplete block design. Local GP groups in the south of the Netherlands already taking part in pharmacotherapeutic audit meeting groups, will be recruited by regional health officers. Approximately 50 groups of GPs will be randomly allocated to two arms. These GPs will be offered two different balanced sets of clinical topics. Each GP within a group will receive comparative feedback on test ordering and prescribing performance. The feedback will be discussed in the group and working agreements will be created after discussion of the guidelines and barriers to change. The data for the feedback will be collected from existing and newly formed databases, both at baseline and after one year.

Discussion

We are not aware of published studies on successes and failures of attempts to transfer to the stakeholders in the field a multifaceted strategy aimed at GPs' test ordering and prescribing behaviour. This pragmatic study will focus on compatibility with existing infrastructure, while permitting a certain degree of adaptation to local needs and routines.

Trial registration

Nederlands Trial Register ISRCTN40008171

Impact of 2 different levels of performance feedback on compliance with infection control process measures in 2 intensive care units

BACKGROUND

Performance monitoring and feedback of infection control process measures is an important tool for improving guideline adherence. Different feedback strategies may lead to distinctive outcomes.

OBJECTIVES

Our objective was to determine the relative impact of 2 different levels of feedback on compliance in an intensive care unit (ICU) setting.

METHODS

Proportion of head of bed (HOB) elevation, hand hygiene (HH) compliance, and proportion of femoral catheter (FC) to all central venous catheter-days were observed in a medical ICU and a surgical ICU. After a 3-month baseline observation phase (phase 1; P1), we provided quarterly feedback on these process measures and major health care-associated infections (HAIs) to unit leaders from July 2004 to June 2005 (P2). From July 2005 to June 2006 (P3), feedback parameters were also provided to unit leaders and to all staff via 48 x 72-inch color posters in ICU personnel-only areas. At the end of the study, a survey was performed to assess the influence of the posters and HH observations.

RESULTS

The analysis of IC process measures included 6948 HOB elevation observations, 1576 HH opportunities, and 16,591 catheter-days. In P2, the overall compliance with HOB elevation and the proportion of FC use significantly improved from 51% to 88% (P < .001) and 13% to 7% (P < .001), respectively. No significant difference in HH compliance was observed during this phase (40% vs 47%, respectively; P = .28). Comparing P3 with P2, HH compliance significantly improved from 47% to 71% (P < .001), and there was a slight improvement in HOB elevation rate from 88% to 93% (P < .001). There was no significant change in FC use in P3. There were 53 survey respondents. Sixty percent reported that the poster information changed their practices. Nearly all respondents (92%) knew that their HH behavior was being observed; however, 61% claimed that HH compliance was not influenced by observation.

CONCLUSION

Feedback of infection control process measures and major HAIs to unit leadership significantly improved compliance with HOB elevation rate and FC use but not HH. Multilevel feedback significantly improved HH compliance and delivered a satisfactory level of compliance with HOB and FC use in both ICUs during the study period.

Clinical evidence continuous medical education: a randomised educational trial of an open access e-learning program for transferring evidence-based information - ICEKUBE (Italian Clinical Evidence Knowledge Utilization Behaviour Evaluation) - study protocol

BACKGROUND

In an effort to ensure that all physicians have access to valid and reliable evidence on drug effectiveness, the Italian Drug Agency sponsored a free-access e-learning system, based on Clinical Evidence, called ECCE. Doctors have access to an electronic version and related clinical vignettes. Correct answers to the interactive vignettes provide Continuing Medical Education credits. The aims of this trial are to establish whether the e-learning program (ECCE) increases physicians' basic knowledge about common clinical scenarios, and whether ECCE is superior to the passive diffusion of information through the printed version of Clinical Evidence.

DESIGN

All Italian doctors naïve to ECCE will be randomised to three groups. Group one will have access to ECCE for Clinical Evidence chapters and vignettes lot A and will provide control data for Clinical Evidence chapters and vignettes lot B; group two vice versa; group three will receive the concise printed version of Clinical Evidence. There are in fact two designs: a before and after pragmatic trial utilising a two by two incomplete block design (group one versus group two) and a classical design (group one and two versus group three). The primary outcome will be the retention of Clinical Evidence contents assessed from the scores for clinical vignettes selected from ECCE at least six months after the intervention. To avoid test-retest effects, we will randomly select vignettes out of lot A and lot B, avoiding repetitions. In order to preserve the comparability of lots, we will select vignettes with similar, optimal psychometric characteristics.

Feasibility and acceptability of a computerised system with automated reminders for prescribing behaviour in primary care

OBJECTIVE

To evaluate the feasibility and acceptability of a computer reminder system (CRS) to improve prescribing behaviour in general practice and to explore the strengths and weaknesses of a reminder system. One group of GPs received reminders on cholesterol lowering drugs, the other group on antibiotics, asthma and COPD drugs.

METHODS

Process evaluation of the computer reminder system being used by 53 GPs in 20 practices, by means of an analysis of the research database of the CRS. In addition, a questionnaire and semi-structured face-to-face interview were conducted with all GP practices, two project leaders, and one technical consultant.

RESULTS

The strategy was largely carried out as planned, although the development period for the CRS had to be extended. Nine percent of the GPs dropped out. We found a significant learning curve without extinguishing effect (p=0.03) for the antibiotics reminders. The questionnaire showed that, in general, GPs were satisfied with the user-friendliness and the content of the different types of reminders, but less satisfied with certain specific technical performance issues of the system. The GPs reported mixed feelings towards the CRS in the interviews. They were generally positive about the guidelines themselves, but negative regarding to the organisational context and the method of implementing the CRS. GPs stated that they sometimes manipulated the system to bypass reminders. Interviews with the project leaders and technical consultant revealed barriers to cooperation and miscommunication between the different parties, and technical problems with multiple updates of the GP information system and the operating system.

CONCLUSIONS

This process evaluation demonstrated that the implementation of the CRS was mainly carried out as planned, but the subjective experience of working with the CRS was not only positive. Participating GPs had mixed feelings, and quite a number of barriers need to be addressed to facilitate large-scale implementation of the CRS. Costs cannot be neglected, so it is important to analyse the balance between costs and effects.

Instituting Surveillance Guidelines and Adverse Outcomes in Preeclampsia

OBJECTIVE

To assess the incidence of combined adverse maternal and perinatal outcomes in women with preeclampsia before and after introducing standardized assessment and surveillance.

METHODS

This study was a preintervention (retrospective) compared with a postintervention (prospective) cohort comparison in a single-tertiary, perinatal unit that included women admitted to hospital with preeclampsia. We interrogated an existing retrospective 24-month database and then introduced the guidelines, assessing the incidence of the combined adverse maternal and perinatal outcomes for 41 months (September 2003 through February 2007). Tests of organ (dys)function were performed at least as often as on the day of admission, admission day +1, every Monday and Thursday, day of delivery, and delivery day +1. All data were checked for errors. The combined maternal outcome was maternal death or one or more of hepatic failure, hematoma, or rupture, Glasgow coma score of less than 13, stroke, at least two seizures, cortical blindness, need for positive inotrope support, myocardial infarction, infusion of any third antihypertensive, renal dialysis, renal transplantation, at least 50% FIO(2) for greater than 1 hour, intubation, or transfusion of at least 10 units of blood products. The combined perinatal outcome was perinatal or infant mortality, bronchopulmonary dysplasia, necrotizing enterocolitis, grade III/IV intraventricular hemorrhage, cystic periventricular leukomalacia, or stage 3-5 retinopathy of prematurity.

RESULTS

Two hundred ninety-five and 405 women were in the preintervention and postintervention cohorts, respectively. The incidence of adverse maternal outcome fell (5.1% to 0.7%; Fisher P<.001; odds ratio 0.14, 95% confidence interval 0.04-0.49). Perinatal outcomes did not change.

CONCLUSION

Standardized surveillance of women with preeclampsia was associated with reduced maternal risk.

The effect of computer reminders on GPs' prescribing behaviour: a cluster-randomised trial

OBJECTIVE

It is difficult to control drug-prescribing behaviour in general practice, despite the development and distribution of guidelines. The purpose of this study was to assess the effect on drug-prescribing behaviour of implementing prescribing guidelines by means of a reactive computer reminder system (CRS).

DESIGN

Cluster-randomised controlled trial with an incomplete block design in the south of the Netherlands: 25 GPs (7 GP practices) received reminders about antibiotics and asthma/COPD prescriptions, 28 GPs (7 GP practices) received reminders about cholesterol prescriptions. Prescription guidelines were integrated into the computerised GP information system.

MEASUREMENTS

Both performance indicators and prescription volumes were calculated as the main outcome measures. Next to individual volume measure, sum scores were constructed on the volume measures per drug group (antibiotics, asthma/COPD and cholesterol).

RESULTS

Variation between GPs turned out to be larger and more skewed than expected. No differences between groups were found for indicators and volumes related to recommendations advocating certain drugs. Although there was a tendency towards clinically relevant results for prescription volumes that were supposed to drop, the difference in sum score between the groups was not significant. For antibiotic prescriptions that were supposed to drop, the sum score for the intervention group was 28.2 (95% CI: 20.8-44.5) prescriptions per 1000 patients per GP, while this was 39.7 (95% CI: 29.7-64.1) for the control group (p 0.2). For prescriptions asthma/COPD that were supposed to drop, the sum score for the intervention group was 1.1 (95% CI: 0.6-2.6) prescriptions per 1000 patients per GP, while this was 2.2 (95% CI: 1.4-4.3) for the control group (p 0.1). On three specific recommendations (on quinolones for cystitis, corticosteroids for CPOD, and antibiotics for acute sore throat) significant differences were found.

CONCLUSIONS

This study turned out to be underpowered due to high inter doctor variation in prescribing behaviour. Nevertheless, computerised reminders sometimes have a favourable effect on restricting certain drugs that are not or no longer indicated in general practice.

Physician pain reminder as an intervention to enhance analgesia for extremity and clavicle injuries in pediatric emergency

The purpose of this study was to document analgesic use for limb and clavicle injuries in the pediatric emergency department (ED) and to determine whether a physician-oriented pain scale form on the patient's chart would enhance the administration of analgesia. Patients 3 to 18 years old were recruited prospectively in our tertiary pediatric ED in Toronto. The study included 4 crossover periods, 2 with the pain scale form on the patient's chart and 2 without. A total of 310 patients were recruited, mean age was 10 years, 64% were boys, and 62% had sustained fractures. The mean pain score was 4.4. Only 90 (29%) patients received an analgesic in the ED, and 65 (72%) of them were ordered by a physician. Only 24 (20%) in the study group and 22 (14%) in the control group received sufficient analgesia (P = .13). The median time to physician-initiated analgesia after arrival was 2.0 hours (1.0 to 3.3 hours), without a significant difference between groups. Pain control was 4-fold more appropriate in children receiving opioids versus nonopioids. Physician pain reminders did not enhance, and other measures should be taken to increase the dispensing of analgesia.

PERSPECTIVE

This is the first study to evaluate whether the addition of a physician-oriented pain-scale form on the chart of patients with injuries improves administration of analgesia in the ED. We found that physicians do not give sufficient analgesia even with this reminder form.

Outpatient process quality evaluation and the Hawthorne Effect

We examine the evidence that the behavior of clinicians is impacted by the fact that they are being observed by a research team. Data on the quality of care provided by clinicians in Arusha region of Tanzania show a marked fall in quality over time as new patients are consulted. By conducting detailed interviews with patients who consulted both before and after our research team arrived we are able to show strong evidence of the Hawthorne effect. Patient-reported quality is steady before we arrive, rises significantly (by 13 percentage points) at the moment we arrive and then falls steadily thereafter. We show that quality after we arrive begins to look similar to quality before we arrived between the 10th and 15th consultations. Implications for quality measurement and policy are discussed.

The influence of observation and setting on community health workers' practices

OBJECTIVE

To determine whether results from an evaluation that involved observation of community health workers while they performed patient consultations in a hospital reflected normal everyday practices.

DESIGN

Comparison of two samples of ill-child consultations: (i) consultations performed during an evaluation in which we observed community health workers in a hospital in-patient and outpatient department from February to March 2001 and (ii) consultations performed under no observation in villages and documented in clinical registers within the 90 days before the hospital evaluation.

SETTING

Siaya District Hospital and villages in Kenya.

STUDY PARTICIPANTS

Community health workers.

MAIN OUTCOME MEASURE

Treatment error indicator, defined as the percentage of consultations where at least one recommended treatment (where recommended treatments were those that were indicated based on community health worker assessments of the child's condition) was not prescribed.

RESULTS

We analyzed data on 1132 consultations (372 from the hospital evaluation and 760 from the community) performed by 103 community health workers. For all types of consultations combined, the difference between treatment error indicators (hospital minus community) was -16.4 [95% confidence interval (CI): -25.6, -7.1].

CONCLUSIONS

We found that community health workers made treatment errors less frequently when they were observed in a hospital in-patient or outpatient department than when they were not observed in the community. Evaluations that involve the observation of community health workers in a hospital setting might overestimate the quality of care that they normally give in their villages.

Feasibility and cost efficiency of a diagnostic guideline for chronic polyneuropathy: a prospective implementation study

BACKGROUND

Extensive investigations are often performed to reveal the cause of chronic polyneuropathy. It is not known whether a restrictive diagnostic guideline improves cost efficiency without loss of diagnostic reliability.

METHODS

In a prospective multicentre study, a comparison was made between the workup in patients with chronic polyneuropathy before and after guideline implementation.

RESULTS

Three hundred and ten patients were included: 173 before and 137 after guideline implementation. In all patients, the diagnosis would remain the same if the workup was limited to the investigations in the guideline. After guideline implementation, the time to reach a diagnosis decreased by two weeks. There was a reduction of 33% in the number and costs of routine laboratory investigations/patient, and a reduction of 27% in the total number of laboratory tests/patient, despite low guideline adherence.

CONCLUSION

The implementation of a diagnostic guideline for chronic polyneuropathy can reduce diagnostic delay and the number and costs of investigations for each patient without loss of diagnostic reliability. Continuous evaluation strategies after guideline implementation may improve guideline adherence and cost efficiency.

No difference between two splint and exercise regimens for people with osteoarthritis of the thumb: a randomised controlled trial

The purpose of this study was to compare the effects of two 6-week splint and exercise regimens for patients with trapeziometacarpal osteoarthritis. Forty participants were enrolled in a randomised, controlled clinical trial. The experimental group received a newly designed thumb strap splint and an abduction exercise regimen, whereas the control group received current clinical practice consisting of a short opponens splint and a pinch exercise regimen. Outcome measures included pain (VAS at rest in cm), strength (tip pinch in kg), and hand function (Sollerman Test of Hand Function scored out of 80), measured by a blinded assessor at Weeks 0, 2, and 6. By Week 6 there was no significant difference in the extent of mean improvement between the groups in: pain, 0.5 cm (95% CI -1.1 to 2.1); strength, 0.1 kg (95% CI -0.8 to 0.9); or hand function, 0.7 points (95% CI -3.6 to 5.0). While both groups improved, neither regimen is superior to the other in patients with trapeziometacarpal osteoarthritis.

Improving compliance with postpolypectomy surveillance guidelines: an interventional study using a continuous quality improvement initiative

BACKGROUND

Despite guidelines, physicians tend to perform postpolypectomy surveillance colonoscopies too frequently.

OBJECTIVE

The objective of the study was to determine the baseline compliance rate with postpolypectomy guidelines in our unit and to determine the influence of a continuous quality improvement (CQI) intervention on improving the compliance rate and on decreasing the potential additional costs because of the scheduling of postpolypectomy surveillance colonoscopies earlier than indicated.

DESIGN

This was a single-arm, pretest-posttest design.

SETTING

This study took place at a tertiary care, academic medical center.

PATIENTS

The medical records of all patients who underwent colonoscopy with polypectomy in our unit retrospectively during 6 months preceding (baseline period) and prospectively for 6 months after an intervention (postintervention period) were reviewed for patient demographics, colonoscopy findings, and scheduling of repeat colonoscopies.

INTERVENTION

We used 3 components: (1) distribution of a wallet-size card with a summary of postpolypectomy guidelines to all endoscopists, (2) placement of guideline charts near computers used for typing endoscopy reports, and (3) distribution and reinforcement of the guidelines in a monthly continuous quality improvement meeting.

MAIN OUTCOME MEASURES

The main outcome measures were compliance rates, mean times to repeat colonoscopy, and additional costs from surveillance colonoscopies being scheduled earlier than indicated were compared between the two periods.

RESULTS

There were 278 patients in the baseline period and 242 in the postintervention period, with similar patient and polyp characteristics. After the intervention, the compliance rate with guidelines improved from 57.2% to 81% (p < 0.001). The mean time to a repeat colonoscopy increased from 4.5 to 5.2 years (p = 0.003) (i.e., a 14% reduction in the number of postpolypectomy surveillance colonoscopies performed per year). This would result in a reduction of a total of 73 surveillance colonoscopies per year in our unit, with a projected cost savings of 171,331 dollars per year (cost of a colonoscopy assumed at 2347 dollars).

LIMITATIONS

The limitation of the study was possible enhanced performance secondary to being observed (Hawthorne effect). Because more than 1 intervention was used, we do not know which one is more effective.

CONCLUSIONS

Relatively simple and easy-to-implement quality improvement initiatives can significantly enhance compliance with postpolypectomy guidelines and result in cost savings because of a reduction in the number of postpolypectomy surveillance colonoscopies being scheduled earlier than recommended guidelines.

Complementary and alternative therapies for cerebral palsy

The optimal practice of medicine includes integrating individual clinical expertise with the best available clinical evidence from systematic research. This article reviews nine treatment modalities used for children who have cerebral palsy (CP), including hyperbaric oxygen, the Adeli Suit, patterning, electrical stimulation, conductive education, equine-assisted therapy, craniosacral therapy, Feldenkrais therapy, and acupuncture. Unfortunately, these modalities have different degrees of published evidence to support or refute their effectiveness. Uncontrolled and controlled trials of hippotherapy have shown beneficial effects on body structures and functioning. Studies of acupuncture are promising, but more studies are required before specific recommendations can be made. Most studies of patterning have been negative and its use cannot be recommended. However, for the other interventions, such as hyperbaric oxygen, more evidence is required before recommendations can be made. The individual with CP and his or her family have a right to full disclosure of all possible treatment options and whatever knowledge currently is available regarding these therapies.