Human computation as a new method for evidence-based knowledge transfer in Web-based guideline development groups: proof of concept randomized controlled trial

BACKGROUND

Guideline developers use different consensus methods to develop evidence-based clinical practice guidelines. Previous research suggests that existing guideline development techniques are subject to methodological problems and are logistically demanding. Guideline developers welcome new methods that facilitate a methodologically sound decision-making process. Systems that aggregate knowledge while participants play a game are one class of human computation applications. Researchers have already proven that these games with a purpose are effective in building common sense knowledge databases.

OBJECTIVE

We aimed to evaluate the feasibility of a new consensus method based on human computation techniques compared to an informal face-to-face consensus method.

METHODS

We set up a randomized design to study 2 different methods for guideline development within a group of advanced students completing a master of nursing and obstetrics. Students who participated in the trial were enrolled in an evidence-based health care course. We compared the Web-based method of human-based computation (HC) with an informal face-to-face consensus method (IC). We used 4 clinical scenarios of lower back pain as the subject of the consensus process. These scenarios concerned the following topics: (1) medical imaging, (2) therapeutic options, (3) drugs use, and (4) sick leave. Outcomes were expressed as the amount of group (dis)agreement and the concordance of answers with clinical evidence. We estimated within-group and between-group effect sizes by calculating Cohen's d. We calculated within-group effect sizes as the absolute difference between the outcome value at round 3 and the baseline outcome value, divided by the pooled standard deviation. We calculated between-group effect sizes as the absolute difference between the mean change in outcome value across rounds in HC and the mean change in outcome value across rounds in IC, divided by the pooled standard deviation. We analyzed statistical significance of within-group changes between round 1 and round 3 using the Wilcoxon signed rank test. We assessed the differences between the HC and IC groups using Mann-Whitney U tests. We used a Bonferroni adjusted alpha level of .025 in all statistical tests. We performed a thematic analysis to explore participants' arguments during group discussion. Participants completed a satisfaction survey at the end of the consensus process.

RESULTS

Of the 135 students completing a master of nursing and obstetrics, 120 participated in the experiment. We formed 8 HC groups (n=64) and 7 IC groups (n=56). The between-group comparison demonstrated that the human computation groups obtained a greater improvement in evidence scores compared to the IC groups, although the difference was not statistically significant. The between-group effect size was 0.56 (P=.30) for the medical imaging scenario, 0.07 (P=.97) for the therapeutic options scenario, and 0.89 (P=.11) for the drug use scenario. We found no significant differences in improvement in the degree of agreement between HC and IC groups. Between-group comparisons revealed that the HC groups showed greater improvement in degree of agreement for the medical imaging scenario (d=0.46, P=.37) and the drug use scenario (d=0.31, P=.59). Very few evidence arguments (6%) were quoted during informal group discussions.

CONCLUSIONS

Overall, the use of the IC method was appropriate as long as the evidence supported participants' beliefs or usual practice, or when the availability of the evidence was sparse. However, when some controversy about the evidence existed, the HC method outperformed the IC method. The findings of our study illustrate the importance of the choice of the consensus method in guideline development. Human computation could be an acceptable methodology for guideline development specifically for scenarios in which the evidence shows no resonance with participants' beliefs. Future research is needed to confirm the results of this study and to establish practical significance in a controlled setting of multidisciplinary guideline panels during real-life guideline development.

Can training improve laypersons helping behaviour in first aid? A randomised controlled deception trial

BACKGROUND

There is limited evidence indicating that laypersons trained in first aid provide better help, but do not help more often than untrained laypersons. This study investigated the effect of conventional first aid training versus conventional training plus supplementary training aimed at decreasing barriers to helping.

METHODS

The authors conducted a randomised controlled trial. After 24 h of conventional first aid training, the participants either attended an experimental lesson to reduce barriers to helping or followed a control lesson. The authors used a deception test to measure the time between the start of the unannounced simulated emergency and seeking help behaviour and the number of particular helping actions.

RESULTS

The authors randomised 72 participants to both groups. 22 participants were included in the analysis for the experimental group and 36 in the control group. The authors found no statistically or clinically significant differences for any of the outcome measures. The time until seeking help (geometrical mean and 95% CI) was 55.5 s (42.9 to 72.0) in the experimental group and 56.5 s (43.0 to 74.3) in the control group. 57% of the participants asked a bystander to seek help, 40% left the victim to seek help themselves and 3% did not seek any help.

CONCLUSION

Supplementary training on dealing with barriers to helping did not alter the helping behaviour. The timing and appropriateness of the aid provided can be improved.

TRIAL REGISTRATION

The authors registered this trial at ClinicalTrials.gov as NCT00954161.

Effectiveness of electronic guideline-based implementation systems in ambulatory care settings - a systematic review

Background

Electronic guideline-based decision support systems have been suggested to successfully deliver the knowledge embedded in clinical practice guidelines. A number of studies have already shown positive findings for decision support systems such as drug-dosing systems and computer-generated reminder systems for preventive care services.

Methods

A systematic literature search (1990 to December 2008) of the English literature indexed in the Medline database, Embase, the Cochrane Central Register of Controlled Trials, and CRD (DARE, HTA and NHS EED databases) was conducted to identify evaluation studies of electronic multi-step guideline implementation systems in ambulatory care settings. Important inclusion criterions were the multidimensionality of the guideline (the guideline needed to consist of several aspects or steps) and real-time interaction with the system during consultation. Clinical decision support systems such as one-time reminders for preventive care for which positive findings were shown in earlier reviews were excluded. Two comparisons were considered: electronic multidimensional guidelines versus usual care (comparison one) and electronic multidimensional guidelines versus other guideline implementation methods (comparison two).

Results

Twenty-seven publications were selected for analysis in this systematic review. Most designs were cluster randomized controlled trials investigating process outcomes more than patient outcomes. With success defined as at least 50% of the outcome variables being significant, none of the studies were successful in improving patient outcomes. Only seven of seventeen studies that investigated process outcomes showed improvements in process of care variables compared with the usual care group (comparison one). No incremental effect of the electronic implementation over the distribution of paper versions of the guideline was found, neither for the patient outcomes nor for the process outcomes (comparison two).

Conclusions

There is little evidence at the moment for the effectiveness of an increasingly used and commercialised instrument such as electronic multidimensional guidelines. After more than a decade of development of numerous electronic systems, research on the most effective implementation strategy for this kind of guideline-based decision support systems is still lacking. This conclusion implies a considerable risk towards inappropriate investments in ineffective implementation interventions and in suboptimal care.

The attitude of Belgian social insurance physicians towards evidence-based practice and clinical practice guidelines

Background

Evidence-based medicine has broadened its scope and is starting to reach insurance medicine. Although still in its initial stages, physicians in the area of insurance medicine should keep up-to-date with the evidence on various diseases in order to correctly assess disability and to give appropriate advice about health care reimbursement. In order to explore future opportunities of evidence-based medicine to improve daily insurance medicine, there is a need for qualitative studies to better understand insurance physicians' perceptions of EBM. The present study was designed to identify the attitude of insurance physicians towards evidence-based medicine and clinical practice guidelines, and to determine their ability to access, retrieve and appraise the health evidence and the barriers for applying evidence to practice.

Methods

A cross-sectional survey study was carried out among all Dutch-speaking insurance physicians employed at one of the six Belgian social insurance sickness funds and at the National Institute of Disability and Health care Insurance (n = 224). Chi-square tests were used to compare nominal and ordinal variables. Student's t-tests, ANOVA, Mann-Whitney and Kruskal-Wallis were used to compare means of continuous variables for different groups.

Results

The response rate was 48.7%. The majority of respondents were positive towards evidence-based medicine and clinical practice guidelines. Their knowledge of EBM was rather poor. Perceived barriers for applying evidence to practice were mainly time and lack of EBM skills.

Conclusion

Although the majority of physicians were positive towards EBM and welcomed more guidelines, the use of evidence and clinical practice guidelines in insurance medicine is low at present. It is in the first place important to eradicate the perceived inertia which limits the use of EBM and to further investigate the EBM principles in the context of insurance medicine. Available high-quality evidence-based resources (at the moment mainly originating from other medical fields) need to be structured in a way that is useful for insurance physicians and global access to this information needs to be ensured.

The attitude of Flemish occupational health physicians toward evidence-based occupational health and clinical practice guidelines

PURPOSE

To identify the attitude of occupational health physicians toward evidence-based occupational health (EBOH) and clinical practice guidelines (CPGs); to determine their ability to access, retrieve and appraise the health evidence and the barriers to applying evidence to practice.

METHODS

A cross-sectional survey study was carried out among all Dutch-speaking occupational health physicians in Belgium (584 physicians could be reached).

RESULTS

A response rate of 25.5% was achieved. The majority of respondents were positive toward EBOH and CPGs. Most respondents were less confident in basic skills of EBM, except for their searching skills. Perceived barriers to applying evidence to practice were mainly time and lack of EBM skills.

CONCLUSIONS

Belgian occupational health physicians are interested in the implementation of EBOH in their daily occupational practice and have a general knowledge of EBM. However, there are barriers in the legislative framework, the education and the information infrastructure, which first have to be removed. The time has come for the responsible authorities to take educational initiatives and to take a huge leap forward in the integration of EBOH into occupational practice.

International comparison of orthotic brace prices

This study compared market prices (i.e. third-party reimbursement and patient co-payment) of prefabricated neck, wrist and knee braces in Belgium, France, the Netherlands, Ontario (Canada) and the UK. Data were collected through contacts with health authorities, health insurance funds, manufacturers and distributors. Market prices varied substantially between countries, indicating that manufacturers adapt their price setting strategy to the policy environment and the structure of the brace market of a country. Belgian prices tended to exceed prices in other countries for the selected neck, wrist and knee braces. There seems to be scope for reducing Belgian prices of selected braces.

Measuring appropriate use of antibiotics in pyelonephritis in Belgian hospitals

Inappropriate use of antibiotics can induce antibiotic resistance, treatment failure, increased costs and even mortality. We developed a methodology for measuring guideline compliance of hospital antibiotic prescriptions in community-acquired acute pyelonephritis in Belgium. The claims and clinical data of all Belgian hospitalizations for community-acquired acute pyelonephritis were extracted from a nationwide administrative database. In a clinically homogeneous subset of patients, the percentage of patients who received a guideline-compliant prescription was calculated according to prescription guidelines disseminated in Belgium. In the group of non-pregnant adult female patients, 31% of the prescriptions were not in strict compliance with the guideline. Interhospital variability ranged from 0% to 100% compliance. We conclude that administrative databases can be used to analyze antibiotic prescription behavior in hospitals for homogeneous and clinically relevant patient groups. The interhospital variability observed in Belgian hospitals indicate that there is a clear room for improvement.

Ostomy appliance prices in Europe

OBJECTIVE

This article aims to compare market prices (i.e., third-party reimbursement and patient co-payment) of one-piece and two-piece colostomy, ileostomy and ureterostomy appliances in Belgium, Denmark, England and the Netherlands in 2005.

METHODS

Data were collected through contacts with health authorities, health insurance companies, manufacturers, industry associations and distributors. The price difference between Belgium and another country was expressed as a proportion of the Belgian price.

RESULTS

A total of 64 out of the 72 ostomy appliance products considered were cheaper in Belgium. Prices of one-piece colostomy appliances and two-piece ileostomy appliances were consistently lower in Belgium. The highest prices of ostomy appliances were observed in the Netherlands. Sixteen out of 20 products and 21 out of 25 products were more expensive in Denmark and England, respectively, than in Belgium. Colostomy appliances were more expensive in England than in Belgium.

CONCLUSIONS

Market prices varied substantially between countries, indicating that manufacturers adapt their pricing strategy to the policy environment existing in the ostomy appliance market of each country. Also, there appears to be scope for reducing prices in some countries.

Cost-effectiveness of statins in the primary prevention of cardiovascular disease: a systematic review and economic analysis for Belgium

OBJECTIVES

8% of total drug spending by the Belgian government goes to statins. The aim of this study is to determine the cost-effectiveness of statins for the primary prevention of cardiovascular disease (CVD) in middle-aged Belgian populations.

METHODS AND RESULTS

Economic evaluations were identified in a systematic literature search and were critically appraised. Furthermore, because prices decreased drastically, a previously published model was adapted applying recent cost data from the Belgian national health insurance. Eleven full economic evaluations were identified. Nine studies compared statins with no treatment and presented heterogeneous results. If alternative interventions, such as smoking cessation or low-dose aspirin treatment were included in the analysis, statin therapy became less cost-effective. Prescribing the cheapest statin on the Belgian market (< Euro 90 medication cost per year) resulted in an incremental cost of Euro 29,173 per life-year gained (LYG) in a male high-risk group aged 60 compared to low-dose aspirin. The incremental cost in a male moderate-risk group aged 50 was Euro 87,022/LYG. Low-dose aspirin was more cost-effective ranging from Euro 3,854/LYG to Euro 29,509/LYG compared to smoking cessation therapy. Smoking cessation therapy was the most cost-effective intervention, providing savings compared to no treatment.

CONCLUSIONS

In Belgium, the cost-effectiveness of statins for the primary prevention of CVD is rather elevated in comparison with low-dose aspirin, even if the cheapest statin is prescribed. From an economic point of view, prevention with low-dose aspirin is more cost-effective and may present a first choice in primary prevention. Smoking cessation, which is a dominant strategy, should be encouraged at all times.

Estimation and comparison of ostomy appliance costs with tariffs in Belgium

This study estimated costs of production and distribution of ostomy appliances, and compared cost estimates with tariffs in Belgium. The cost model took into account manufacturing costs, overhead, R&D, warehousing, profits, and distribution margins. Data were derived from manufacturers, a decomposition of finished products, and interviews with stakeholders. The cost model generated estimated retail prices of euro 2.96 for one-piece appliances, euro 1.62 for two-piece pouches, and euro 2.06 for two-piece flanges. Production and distribution costs accounted for 40 and 60% of retail prices, respectively. Estimated retail prices corresponded well with tariffs for one-piece appliances and for two-piece pouches. For two-piece regular flanges, a substantial difference was observed between the calculated price of euro 2.06 and the tariffs of euro 6.05. In the absence of publicly disclosed information on the cost structure of appliances, estimating ostomy appliance costs is valuable to reimbursement agencies when setting tariffs.

Do tariffs and prices correspond with costs? A case study of orthotic braces

OBJECTIVES

The Belgian third-party payer wishes to set reimbursement tariffs at a level that reflects the costs of orthotic braces. This article aims to calculate production and distribution costs of a prefabricated hard neck and knee brace and to explore whether Belgian tariffs and actual retail prices correspond with estimated costs of these two braces.

METHODS

The cost model considered manufacturing costs, general overheads, research and development costs, warehousing costs, profit and distribution margins. Data were gathered from manufacturers, a production site visit, desk research, a decomposition of finished products and stakeholder interviews. The price year was 2007.

RESULTS

The cost model estimated a retail price of euro55-euro150 for the neck brace, depending on assumptions. The estimated retail price for the neck brace was lower than the reimbursement tariff of euro194 and the actual retail price of euro241. The estimated retail price of euro331-euro694 for the knee brace was lower than the actual retail price of euro948.

CONCLUSIONS

Actual retail prices and reimbursement tariffs for a neck brace and a knee brace exceeded prices based on estimated costs. Therefore, there appears to be scope for reducing tariffs.

Cost effectiveness of implantable cardioverter-defibrillators for primary prevention in a Belgian context

BACKGROUND

Implantable cardioverter-defibrillator (ICD) therapy was traditionally applied in patients who survived a cardiac arrest or who experienced a symptomatic ventricular tachyarrhythmia. Its use in primary prevention (i.e. in patients who have yet to experience a serious arrhythmic event, but who are considered at high risk for sudden cardiac death) has become more common, and policy makers question whether ICD therapy should be reimbursed in these instances.

OBJECTIVE

To assess the cost effectiveness of primary prevention ICD therapy versus conventional therapy from the perspective of the Belgian health insurance system.

METHOD

A lifetime 1-month cycle Markov model was constructed and populated with clinical and effectiveness data from the SCD-HeFT study and real-world Belgian cost data expressed in year 2005 values. Probabilistic modelling and sensitivity analyses were performed.

RESULTS

ICD therapy results in 1.22 life-years gained (LYG) or 1.03 QALYs gained. The lifetime cost-effectiveness and cost-utility ratios were euro 59,989 (95% CI 35 873, 113 518) per LYG and euro 71 428 (95% CI 40 225, 134 623) per QALY gained, respectively. A cost-effectiveness ratio <euro 50,000 per QALY gained was obtained in 15.5% of 1000 simulations. Increasing the service life of the device from 5 to 7 years would improve the cost effectiveness to euro 57,229 (95% CI 32 568, 106 410) per QALY gained.

CONCLUSIONS

ICD therapy may not be judged cost effective for the primary prevention of death in patients with a SCD-HeFT profile in the Belgian context using current technology and patient selection. A combination of price reductions and increased service life of the device may alter this conclusion.

Cardiovascular autonomic function in conscious rats: a novel approach to facilitate stationary conditions

BACKGROUND

An experimental setting and software were developed to evaluate cardiovascular autonomic function in conscious rats. A restrained approach was used, which, upon proper habituation, induced little or no stress in the rats and limited motion artifacts.

METHODS

The ECG and arterial blood pressure were recorded. Time- and frequency-domain indices of heart rate variability (HRV) and blood pressure variability (BPV) were calculated. The spontaneous baroreflex sensitivity (spBRS) was estimated using the method of statistical dependence.

RESULTS

The power spectra clearly concentrated in a frequency band with center frequency around 0.4 Hz, the low frequency (LF) component, and one at the respiratory frequency at 1.5 Hz, the high frequency (HF) component. In baseline conditions, a direct association existed between mean R-R and especially HRV parameters denoting vagal modulation such as rMSSD, pNN5, and HF power. Beta-adrenergic blockade by propranolol diminished basal heart rate. Vagal indices increased while there was an exclusive decrease in the low frequency band of HRV. Alpha-adrenergic blockade with phentolamine produced a depressor response with tachycardia, and a clear decrease in the LF component of BPV. Both the LF and HF component in the HRV spectrum were virtually absent. Cholinergic blockade with atropine did not significantly alter BP but induced a clear tachycardia with decreased vagal indices. The HF component of HRV was completely abolished and the LF band was reduced.

CONCLUSIONS

Both alpha- and beta-adrenergic blockade left spBRS virtually unaltered, while cholinergic blockade profoundly diminished spBRS. Spectral fluctuations of beta-sympathetic tone were restricted to the LF range of HRV, while the HF respiratory component represented vagal modulation. The alpha-sympathetic system played a dominant role in the LF oscillations of BPV. A role of the vagus in the HF oscillations of BPV in the rat is questioned. The baroreflex depended mainly on changes in vagal activity.

Balancing evidence and public opinion in health technology assessments: The case of leukoreduction

Leukoreduction, filtering white blood cells from transfusion blood, effectively avoids leukocyte-related complications of blood transfusion. The technology has proven its relative cost-effectiveness for specific patient populations. With the advent of variant Creutzfeldt–Jakob disease, a transmittable spongiform encephalopathy caused by mad cow disease (bovine spongiform encephalopathy), the hard hit United Kingdom introduced universal leukoreduction for all patients as a precaution for transmission of prions in 1999. This costly policy was followed by many other countries, in the absence of much evidence of an actual health problem or of a more than presumed effectiveness of leukoreduction in preventing prion transmission. The core problem proved to be legal. The blood banks are legally accountable for blood safety. This accountability is absolute, based on avoidance of all possible risks, regardless of costs. This strategy leads to inefficiencies in health care: (i) blood safety management is guided by available rather than cost-effective technology, and (ii) private insurance premiums for civil liability are sharply increasing, while they are in no way related to the expected returns and the high and increasing blood safety. A rational safety policy is to be optimal, taking into account costs and effects of the safety procedures. This issue will need an open discussion with the general public of the real risks and a clear and unambiguous definition of proportionality in the precautionary principle, based on the European law.

More is not better in the early care of acute myocardial infarction: a prospective cohort analysis on administrative databases

AIMS

To assess the outcome and costs of patients with acute myocardial infarction (AMI) after initial admission to hospitals with or without catheterization facilities in Belgium.

METHODS AND RESULTS

From a nationwide hospital register, we retrieved the data of 34 961 patients discharged during 1999-2001 with a principal diagnosis of AMI. They were initially admitted to hospitals without catheterization facilities (A), with diagnostic (B1) or interventional catheterization facilities (B2). Mortality has been recorded till the end of 2003 and re-admissions till the end of 2001. The mortality hazard ratio and 95% CI of 5 years mortality of A vs. B2 was 1.01 (0.97, 1.06) and of B1 vs. B2 was 1.03 (0.98, 1.09). Re-admission rates and 95% CI for cardiovascular reason per 100 patient-years were 23.5 (22.7, 24.3) for A, 23.8 (22.5, 25.1) for B1, and 22.0 (21.2, 22.9) for B2. The mean cost in hospital of a patient at low risk with a single stay was in A 4072 euro (median: 3,861; IQR: 4467-3476), in B1 5083 euro (median: 5153; IQR: 5769-4340), and in B2 7741 euro (median: 7553; IQR: 8211-7298).

CONCLUSION

Services with catheterization facilities compared with services without them showed no better health outcomes, but delivered more expensive care.

Drawing on international experience to reform the Belgian market for ostomy appliances

This article aims to review the regulatory framework governing the Belgian ostomy appliance market in the light of the experience of Denmark, France, the Netherlands and Ontario (Canada) with regulation of ostomy appliances. Information about the regulatory framework was derived from the international literature, analysis of legal texts and a survey completed by national experts. The comparative analysis revealed that these countries have adopted varying approaches towards regulating their domestic ostomy appliance market. Strategies to keep down prices include public procurement in Denmark, maximum prices in France and exclusion of expensive appliances from reimbursement in the Netherlands. To contain public expenditure on ostomy appliances, consumption patterns are monitored in the Netherlands, the quantity of reimbursed appliances is limited in Belgium and public reimbursement is restricted in Ontario. Ostomy appliances are generally distributed by community pharmacies and medical equipment shops. In countries that emphasise home care delivery such as Denmark, domiciliary distributors dominate the market to the detriment of community pharmacies which do not seem to be able to offer this service at a competitive price. An avenue for reforming the Belgian ostomy appliance market is proposed which valorizes the role of ostomy care nurses in guiding the choice of ostomy appliances. Furthermore, it is recommended that a competitive tendering process determines the price of ostomy appliances, that reimbursement for service provision by distributors is separated from reimbursement of appliances, and that patients receive a fixed grant from the third-party payer to buy ostomy appliances.

EFFECTS OF AUTONOMIC BLOCKADE ON NON-LINEAR CARDIOVASCULAR VARIABILITY INDICES IN RATS

1. The present study assesses the effects of autonomic blockade (alpha- and beta-adrenoceptor and cholinergic) on cardiovascular function studied by heart rate variability (HRV), blood pressure variability (BPV) and baroreflex sensitivity in rats using non-linear dynamics. Little is known about the influence of pharmacological autonomic nervous system interventions on non-linear cardiovascular regulatory indices. 2. In 13 conscious rats, heart rate and aortic blood pressure were measured continuously before, during and after autonomic blockade with atropine, phentolamine and propranolol. Non-linear scaling properties were studied using 1/f slope, fractal dimension and long- and short-term correlation. Non-linear complexity was described with correlation dimension, Lyapunov exponent and approximate entropy. Non-linear indices were compared with linear time and frequency domain indices. 3. Beta-adrenoceptor blockade did not alter the non-linear characteristics of HRV and BPV, although low-frequency power of HRV was depressed. Alpha-adrenoceptor blockade decreased the scaling behaviour of HRV, whereas cholinergic blockade decreased the complexity of the non-linear system of HRV. For BPV, the scaling behaviour was increased during alpha-adrenoceptor blockade and the complexity was increased during cholinergic blockade. The linear indices of HRV and BPV were decreased. 4. The present results indicate that the beta-adrenoceptor system has little involvement in the generation of non-linear HRV and BPV in rats. 5. Alpha-adrenoceptor blockade mostly influenced the scaling properties of the time series, whereas cholinergic blockade induced changes in the complexity measures. 6. The absence of the baroreflex mechanism can trigger a compensatory feed-forward system increasing the complexity of BPV.

[Systemic validation of clinical practice guidelines: the AGREE network]

INTRODUCTION

Over recent decades, the number of available clinical practice guidelines has enormously grown. Guidelines should meet specific quality criteria to ensure good quality. There is a growing need for the developement of a set of criteria to ensure that potential biases inherent in guideline development have been properly addressed and that the recommendations for practice are valid and reliable.

AIM

The AGREE-collaboration is an international network that developed an instrument to critically appraise the methodological quality of guidelines. AGREE promotes a clear strategy to produce, disseminate and evaluate guidelines of high quality.

METHOD

In the first phase of the international project the AGREE-instrument was tested in 11 different countries. Based on this experience the instrument was refined and optimised. In the second phase it was disseminated, promoted and evaluated in 18 participating countries. Belgium was one of them.

RESULTS

The Belgian partner in the AGREE-project developed 3 workshops and established 13 validation committees to validate guidelines from Belgian developer groups. We collected 33 questionnaires from participants of the workshops and the validation committees, in which we asked for primary experiences and information on the usefulness and applicability of the instrument. We were also interested in the shortcomings of the instrument and potential strategies to bridge them.

DISCUSSION

More efforts should be made to train methodological experts to gain certain skills for a critical appraisal of clinical practice guidelines. Promoting the AGREE-instrument will lead to a broader knowledge and use of quality criteria in guideline development and appraisal.

CONCLUSION

The development and dissemination of an international list of criteria to appraise the quality of guidelines will stimulate the development of methodologically sound guidelines. International comparisons between existing guidelines will lead to a better collaboration between guideline developers throughout the world.

Protected carotid artery stenting (PCAS): a short medical technology assessment

After a period of experimenting with angioplasty and stenting, carotid artery stenting under embolic protection (PCAS) is becoming a viable alternative for carotid endarterectomy (CEA). A standard literature review showed that, at January 2005, there was no evidence that PCAS is more effective than CEA. The high costs of stent and protection device makes PCAS then inferior to CEA. PCAS may be the sole possible option in patients with symptomatic carotid artery stenosis unfit for surgery, where the high risk of stroke overrides uncertainty about health effects and overrides cost-effectiveness. These are a few patients per year in Belgium. Several randomised controlled trials comparing PCAS and CEA are now recruiting patients. To have answers on key questions of cost-effectiveness, it is of paramount importance that these trials recruit and publish rapidly. The KCE (Belgian HealthCare Knowledge Center/Centre Fédéral d'Expertise des Soins de Santé/Federaal Kenniscentrum voor de Gezondheidszorg) therefore advises cooperation with these trials. Outside these trials and compassionate use in the few symptomatic patients unfit for CEA, the use of PCAS raises serious ethical questions.

Different evolutions in heart rate variability after heart transplantation: 10-year follow-up

BACKGROUND

After heart transplantation, the donor heart is extrinsically denervated. No input of sympathetic or vagal nerves can influence the heart rate, resulting in a flat power spectrum of the beat-to-beat variability. The occurrence and the significance of reinnervation remain controversial.

METHODS AND RESULTS

We monitored the evolution of heart rate variability (HRV) after heart transplantation, starting from a few weeks postoperatively up to 10 years after surgery. Twenty-four-hour Holter recordings of 216 heart-transplant patients were analyzed using time and frequency domain analysis of HRV. Analysis of all data revealed an increase in 24-hour and night-time total power starting from 2 years after transplantation. Low-frequency oscillations calculated over the total 24 hours, day- and nighttime increased significantly starting from year 4 and onward (year 4-8: P < 0.005). No evolution was found in high-frequency power. Subgroup analysis revealed a group with a clear spectral component (n = 16), a group with a small component (n = 124), and a group with a flat spectrum (n = 76). Only the first group revealed an evolution in both high- and low-frequency power.

CONCLUSION

These results indicate three different types of evolution in HRV, with reinnervating patterns present in only a minority of the patients. The vast majority of the patients show no signs of reinnervation.

A systematic review of appraisal tools for clinical practice guidelines: multiple similarities and one common deficit

OBJECTIVE

To identify a critical appraisal tool for clinical practice guidelines that could serve as a basis for the development of an appraisal tool for clinical pathways.

DESIGN

Systematic review of the literature and personal contacts. Databases searched were: Medline, Embase, and Cinahl. Search terms were: practice guidelines, appraisal, and evaluation. The items of the identified appraisal tools were examined and thematically grouped into 10 guideline dimensions. Content analysis and scoring of these domains by the appraisal tools was evaluated.

RESULTS

Twenty-four different appraisal tools of practice guidelines were identified. None scored the evidence base of the clinical content of guidelines. Four tools scored all the guideline dimensions. The Cluzeau instrument is the only one of these four that has been validated. Of the three instruments based on the Cluzeau instrument, the AGREE instrument is the only validated instrument that uses a numerical scale.

CONCLUSIONS

Being a simplified version of the Cluzeau instrument, the AGREE instrument has the most potential to serve as a basis for the development of an appraisal tool for clinical pathways. However, important limitations will have to be dealt with when developing such a tool.