Completeness of reporting of trials published in languages other than English: implications for conduct and reporting of systematic reviews

A highly sensitive search strategy for clinical trials in Literatura Latino Americana e do Caribe em Ciências da Saúde (LILACS) was developed

BACKGROUND

Systematic reviews should include as many articles as possible. However, many systematic reviews use only databases with high English language content as sources of trials. Literatura Latino Americana e do Caribe em Ciências da Saúde (LILACS) is an underused source of trials, and there is not a validated strategy for searching clinical trials to be used in this database.

OBJECTIVE

The objective of this study was to develop a sensitive search strategy for clinical trials in LILACS.

STUDY DESIGN AND SETTING

An analytical survey was performed. Several single and multiple-term search strategies were tested for their ability to retrieve clinical trials in LILACS. Sensitivity, specificity, and accuracy of each single and multiple-term strategy were calculated using the results of a hand-search of 44 Chilean journals as gold standard.

RESULTS

After combining the most sensitive, specific, and accurate single and multiple-term search strategy, a strategy with a sensitivity of 97.75% (95% confidence interval [CI]=95.98-99.53) and a specificity of 61.85 (95% CI=61.19-62.51) was obtained.

CONCLUSIONS

LILACS is a source of trials that could improve systematic reviews. A new highly sensitive search strategy for clinical trials in LILACS has been developed. It is hoped this search strategy will improve and increase the utilization of LILACS in future systematic reviews.

Systematic review of the benefits and harms of calcitriol and alfacalcidol for fractures and falls

Our objective was to conduct a systematic review on the benefits and harms of calcitriol and alfacalcidol in the reduction of fracture and fall risk. Randomized controlled trials (RCTs) comparing these agents to placebo or calcium and reporting fracture and fall incidence were retrieved from MEDLINE, Embase, and the Cochrane Central Register of Controlled Trials. Two reviewers independently determined study eligibility, assessed trial quality, and extracted data. Twenty-three RCTs were included (2139 participants), and 16 trials had sufficient data for meta-analysis. Vertebral fractures were not significantly reduced based on the combined results of 13 trials; however, subgroup analyses demonstrated a significant reduction with alfacalcidol [odds ratio (OR) = 0.50, 95% confidence interval (CI), 0.25-0.98], but not with calcitriol. There was a significant reduction in nonvertebral fractures (six trials, OR = 0.51, 95% CI, 0.30-0.88), and falls (two trials, OR = 0.66, 95% CI, 0.44-0.98). There was an increased risk of hypercalcemia (OR = 3.63, 95% CI, 1.51-8.73) and a trend toward an increased risk of hypercalciuria. There is evidence to suggest that these agents may reduce the incidence of nonvertebral fractures and falls; however, their benefit on vertebral fracture reduction may depend on the type of active vitamin D. Hypercalcemia and hypercalciuria are potential side effects.

Fecal incontinence: the quality of reported randomized, controlled trials in the last ten years

PURPOSE

This study was designed to analyze the characteristics and the quality of reporting of randomized, controlled trials published during the last ten years on fecal incontinence.

METHODS

An electronic search for all randomized, controlled trials on fecal incontinence was undertaken by using the MEDLINE database via PubMed. The data collected were divided into general data, characteristics of reporting, methodology quality assessment using the Jadad scale and a validated methodology quality score (MINCIR score), evaluation of the items published in the CONSORT statement, and the journal impact factor. Reports were divided into two groups: published articles from 1996 to 2000 (Group 1), and from 2001 to 2005 (Group 2).

RESULTS

Forty-two trials fulfilled the inclusion criteria of the study (Group 1, n = 15; and Group 2, n = 27). There were no significant differences in general characteristics of randomized, controlled trials between the two groups. In Group 2, there were a statistically significant higher number of studies that reported a flow chart (P < 0.001), written informed consent (P = 0.008), sample size calculation (P = 0.023), and withdrawals and dropouts (P < 0.001). We found a statistically significant higher score in Jadad scale (P = 0.046) and MINCIR score (P = 0.016) in the published studies in Group 2. Also we found higher journal impact factor of journals that published these randomized, controlled trials during the most recent years (P = 0.04).

CONCLUSIONS

There is a lack of high-quality reported randomized, controlled trials on fecal incontinence during the last ten years. Reports of randomized, controlled trials involving patients with fecal incontinence published after 2001 were better reported than in the previous five years.

Financial ties and concordance between results and conclusions in meta-analyses: retrospective cohort study

OBJECTIVE

To determine whether financial ties to one drug company are associated with favourable results or conclusions in meta-analyses on antihypertensive drugs.

DESIGN

Retrospective cohort study.

SETTING

Meta-analyses published up to December 2004 that were not duplicates and evaluated the effects of antihypertensive drugs compared with any comparator on clinical end points in adults. Financial ties were categorised as one drug company compared with all others.

MAIN OUTCOME MEASURES

The main outcomes were the results and conclusions of meta-analyses, with both outcomes separately categorised as being favourable or not favourable towards the study drug. We also collected data on characteristics of meta-analyses that the literature suggested might be associated with favourable results or conclusions.

RESULTS

124 meta-analyses were included in the study, 49 (40%) of which had financial ties to one drug company. On univariate logistic regression analyses, meta-analyses of better methodological quality were more likely to have favourable results (odds ratio 1.16, 95% confidence interval 1.07 to 1.27). Although financial ties to one drug company were not associated with favourable results, such ties constituted the only characteristic significantly associated with favourable conclusions (4.09, 1.30 to 12.83). When controlling for other characteristics of meta-analyses in multiple logistic regression analyses, meta-analyses that had financial ties to one drug company remained more likely to report favourable conclusions (5.11, 1.54 to 16.92).

CONCLUSION

Meta-analyses on antihypertensive drugs and with financial ties to one drug company are not associated with favourable results but are associated with favourable conclusions.

A systematic review evaluating the potential for bias and the methodological quality of meta-analyses in vaccinology

A systematic review was undertaken to produce an annotated bibliography of meta-analyses in vaccinology and to evaluate their methodological quality. Based on our evaluation using the Oxman and Guyatt index, the methodological quality of the 121 meta-analyses included in this study is not satisfactory. The most frequent limitations include non-comprehensive bibliographic research; bias in the selection of the studies; lack of quality assessment of individual studies; absence of evaluation of heterogeneity among studies and publication bias. The methodological quality significantly increases with the year of publication and with declared financial support, without differences between profit and non-profit support. Meta-analyses with a higher Oxman and Guyatt quality score are more likely to include only randomized trials and to explore appropriately potential sources of heterogeneity. Most of the methodological deficiencies of meta-analyses in vaccinology could be corrected easily, and meta-analysts should improve the methodological quality of their work to maintain their impact on policy decisions.

Oral versus intra-vaginal imidazole and triazole anti-fungal treatment of uncomplicated vulvovaginal candidiasis (thrush)

BACKGROUND

Anti-fungals are available for oral and intra-vaginal treatment of uncomplicated vulvovaginal candidiasis (thrush).

OBJECTIVES

The primary objective of this review was to assess the relative effectiveness of oral versus intra-vaginal anti-fungals for the treatment of uncomplicated vulvovaginal candidiasis. The secondary objectives of the review were to assess the cost-effectiveness, safety and patient preference of oral versus intra-vaginal anti-fungals.

SEARCH STRATEGY

The following sources were searched for the original review: The Cochrane Library (Issue 4, 1999), MEDLINE (January 1985 to May 2000), EMBASE (January 1980 to January 2000) and the Cochrane Sexually Transmitted Disease (STD) Group Specialised Register of Controlled Trials. The manufacturers of anti-fungals available in the UK were contacted. For the update, CENTRAL (January 2000 to August 2006), PUBMED (January 2000 to August 2006), EMBASE (January 2000 to August 2006) and the Cochrane STD Group Specialised Register were searched in August 2006. The reference lists of retrieved articles were reviewed manually.

SELECTION CRITERIA

Randomised controlled trials published in any language. Trials had to compare at least one oral anti-fungal with one intra-vaginal anti-fungal. Women (aged 16 years or over) with uncomplicated vulvovaginal candidiasis. The diagnosis of vulvovaginal candidiasis to be made mycologically (i.e. a positive culture and / or microscopy for yeast). Trials were excluded if they solely involved subjects who were HIV positive, immunocompromised, pregnant, breast feeding or diabetic. The primary outcome measure was clinical cure.

DATA COLLECTION AND ANALYSIS

Two reviewers screened titles and abstracts of the electronic search results and full text of potentially relevant papers. Independent duplicate abstraction was performed by two reviewers. Disagreements regarding trial inclusion or data abstraction were resolved by discussion between the reviewers. Odds ratios were pooled using the fixed effects models (except for two analyses when random effects models were used because of potentially important heterogeneity).

MAIN RESULTS

Two new trials reporting three comparisons were found in the update. Nineteen trials are included in the review, reporting 22 oral versus intra-vaginal anti-fungal comparisons. No statistically significant differences were shown between oral and intra-vaginal anti-fungal treatment for clinical cure at short term (OR 0.94, 95% CI, 0.75 to 1.17) and long term (OR 1.07, 95% CI, 0.82 to 1.41) follow-up. No statistically significant differences for mycological cure were observed between oral and intra-vaginal treatment at short term (OR 1.15, 95% CI, 0.94 to 1.42). There was a statistically significant difference for long term follow-up (OR 1.29, 95% CI, 1.05 to 1.60) in favour of oral treatment, however the clinical significance of this result is uncertain. Two trials each reported one withdrawal from treatment due to an adverse reaction. Treatment preference data were poorly reported.

AUTHORS' CONCLUSIONS

No statistically significant differences were observed in clinical cure rates of anti-fungals administered by the oral and intra-vaginal routes for the treatment of uncomplicated vaginal candidiasis. No definitive conclusion can be made regarding the relative safety of oral and intra-vaginal anti-fungals for uncomplicated vaginal candidiasis. The decision to prescribe or recommend the purchase of an anti-fungal for oral or intra-vaginal administration should take into consideration: safety, cost and treatment preference. Unless there is a previous history of adverse reaction to one route of administration or contraindications, women who are purchasing their own treatment should be given full information about the characteristics and costs of treatment to make their own decision. If health services are paying the treatment cost, decision-makers should consider whether the higher cost of some oral anti-fungals is worth the gain in convenience, if this is the patient's preference.

Dietary antioxidants and primary prevention of age related macular degeneration: systematic review and meta-analysis

OBJECTIVE

To evaluate the effectiveness of dietary antioxidants in the primary prevention of age related macular degeneration (AMD).

DESIGN

Systematic review and meta-analysis.

DATA SOURCES

Search of seven databases without limits on year or language of publication, and retrieval of references in pertinent reviews and articles.

METHODS

Two reviewers independently searched the databases and selected the studies, using standardised criteria. Randomised clinical trials and prospective cohort studies were included. Of the 4192 abstracts initially identified, 12 studies (nine prospective cohort studies and three randomised clinical trials) met the selection criteria and were included. Data extraction and study quality evaluation were independently reviewed, using standardised criteria. Results were pooled quantitatively using meta-analytic methods.

RESULTS

The nine prospective cohort studies included 149 203 people, with 1878 incident cases of early AMD. The antioxidants investigated differed across studies, and not all studies contributed to the meta-analysis of each antioxidant. Pooled results from prospective cohort studies indicated that vitamin A, vitamin C, vitamin E, zinc, lutein, zeaxanthin, alpha carotene, beta carotene, beta cryptoxanthin, and lycopene have little or no effect in the primary prevention of early AMD. The three randomised clinical trials did not show that antioxidant supplements prevented early AMD.

CONCLUSIONS

There is insufficient evidence to support the role of dietary antioxidants, including the use of dietary antioxidant supplements, for the primary prevention of early AMD.

The quality of reporting of randomized controlled trials of traditional Chinese medicine: a survey of 13 randomly selected journals from mainland China

BACKGROUND

The number of randomized controlled trials (RCTs) of traditional Chinese medicine (TCM) is increasing. However, there have been few systematic assessments of the quality of reporting of these trials.

OBJECTIVE

This study was undertaken to evaluate the quality of reporting of RCTs in TCM journals published in mainland China from 1999 to 2004.

METHODS

Thirteen TCM journals were randomly selected by stratified sampling of the approximately 100 TCM journals published in mainland China. All issues of the selected journals published from 1999 to 2004 were hand-searched according to guidelines from the Cochrane Centre. All reviewers underwent training in the evaluation of RCTs at the Chinese Centre of Evidence-based Medicine. A comprehensive quality assessment of each RCT was completed using a modified version of the Consolidated Standards of Reporting Trials (CONSORT) checklist (total of 30 items) and the Jadad scale. Disagreements were resolved by consensus.

RESULTS

Seven thousand four hundred twenty-two RCTs were identified. The proportion of published RCTs relative to all types of published clinical trials increased significantly over the period studied, from 18.6% in 1999 to 35.9% in 2004 (P < 0.001). The mean (SD) Jadad score was 1.03 (0.61) overall. One RCT had a Jadad score of 5 points; 14 had a score of 4 points; and 102 had a score of 3 points. The mean (SD) Jadad score was 0.85 (0.53) in 1999 (746 RCTs) and 1.20 (0.62) in 2004 (1634 RCTs). Across all trials, 39.4% of the items on the modified CONSORT checklist were reported, which was equivalent to 11.82 (5.78) of the 30 items. Some important methodologic components of RCTs were incompletely reported, such as sample-size calculation (reported in 1.1% of RCTs), randomization sequence (7.9%), allocation concealment (0.3 %), implementation of the random-allocation sequence (0%), and analysis of intention to treat (0%).

CONCLUSION

The findings of this study indicate that the quality of reporting of RCTs of TCM has improved, but remains poor.

Randomized controlled trials of treatments for hematologic malignancies: study characteristics and outcomes

BACKGROUND

Although randomized controlled trials (RCTs) require a great deal of time, money, and effort, the majority of them have resulted in failure to verify a priori hypotheses. Therefore, the intention in the current study was to clarify the differential elements of studies with 'positive' and 'negative' outcomes.

METHODS

The authors performed a comprehensive search of RCT reports on treatments for hematologic malignancies published between 1995 and 2004, with 264 reports eventually identified. The expected rate and the observed rate for the primary endpoint were compared for 70 studies with all relevant information available.

RESULTS

Of all the superiority trials (n = 256), positive studies accounted for 33%. Most of the major study characteristics were not found to be associated with the study outcome except for the primary endpoint. Studies evaluating event-free survival were more likely to report positive results than were those evaluating overall survival (P = .061). For the experimental treatment arm, the mean difference between the expected and observed rates was -10.1% (standard deviation [SD], 10.1%) in the negative studies, which indicates a rate lower than expected, and was 1.3% (SD, 9.2%) in the positive studies (P < .0001). In contrast, no statistical significance was observed for the standard treatment arm because the mean difference was 6.3% (SD, 10.7%) for the negative studies and 3.0% (SD, 9.0%) for the positive studies (P = .1885). The journal impact factor was statistically significantly higher for the positive than for the negative reports (P < .0001).

CONCLUSIONS

Giving adequate consideration to the estimated effect of an experimental therapy may be critical when planning an RCT.

Superficial or deep cervical plexus block for carotid endarterectomy: a systematic review of complications †

Carotid endarterectomy is commonly conducted under regional (deep, superficial, intermediate, or combined) cervical plexus block, but it is not known if complication rates differ. We conducted a systematic review of published papers to assess the complication rate associated with superficial (or intermediate) and deep (or combined deep plus superficial/intermediate). The null hypothesis was that complication rates were equal. Complications of interest were: (1) serious complications related to the placement of block, (2) incidence of conversion to general anaesthesia, and (3) serious systemic complications of the surgical-anaesthetic process. We retrieved 69 papers describing a total of 7558 deep/combined blocks and 2533 superficial/intermediate blocks. Deep/combined block was associated with a higher serious complication rate related to the injecting needle when compared with the superficial/intermediate block (odds ratio 2.13, P = 0.006). The conversion rate to general anaesthesia was also higher with deep/combined block (odds ratio 5.15, P < 0.0001), but there was an equivalent incidence of other systemic serious complications (odds ratio 1.13, P = 0.273; NS). We conclude that superficial/intermediate block is safer than any method that employs a deep injection. The higher rate of conversion to general anaesthesia with the deep/combined block may have been influenced by the higher incidence of direct complications, but may also suggest that the superficial/combined block provides better analgesia during surgery.

Predictors of mortality after aortic valve replacement

Aortic valve replacement (AVR) is recommended as a standard surgical procedure for aortic valve disease. Still the evidence for commonly claimed predictors of post-AVR prognosis, in particular mortality, appears scant. This systematic review reports on the evidence for predictors of post-AVR mortality, and may be helpful in pre-surgical risk-stratification. In PubMed, we searched for original reports of post-AVR follow-up studies. We assessed the quality of study design and methods with a standardized checklist. Data of the reported predictors of mortality and outcomes were extracted. Twenty-eight studies met our inclusion criteria. Sixteen studies were considered of high quality. There is strong evidence that the risk of early mortality is increased by emergency surgery, while the risk of late mortality is increased with older age and preoperative atrial fibrillation. There is moderate evidence that the risk of early mortality is increased by older age, aortic insufficiency, coronary artery disease, longer cardiopulmonary bypass time, reduced left ventricular ejection fraction (LV-EF), infective endocarditis, hypertension, mechanical valves, preoperative pacing, dialysis-dependent renal failure and valve size; and that the risk for late mortality is increased by emergency surgery and urgency of the operation. There is little evidence for high New York Heart Association class, concomitant coronary artery bypass graft and many other commonly claimed risk factors for post-AVR mortality. The reported evidence on predictors of post-AVR mortality will help for pre-surgical risk-stratification, i.e. to discern patients at high or low risk for early and late post-AVR mortality. Future prognostic studies should take the evidence from this review into account and should focus on derivation of a predictive model for post-AVR survival.

An evaluation of search and selection methods used in dental systematic reviews published in English

BACKGROUND

Increasing numbers of systematic reviews are published each year, though little has been done to evaluate their search and selection methodology.

METHODS

The authors searched dental systematic reviews published between Jan. 1, 2000, and July 14, 2005, for descriptions of how researchers used multiple electronic databases and secondary searches. They evaluated search and selection methods of identified systematic reviews against the guidelines found in the 2005 Cochrane Handbook for Systematic Reviews of Interventions.

RESULTS

The authors identified 220 unique dental systematic reviews. They found that all aspects of search and selection methodology had improved. In 2005, most systematic reviews documented database names and search dates (90 percent), electronic search terms (95 percent) and inclusion-exclusion criteria (95 percent), and most employed secondary searching (100 percent). Many still failed to search more than MEDLINE (20 percent), document the search strategy (20 percent), use multiple reviewers for selecting studies (25 percent) and include all languages (39 percent).

CONCLUSIONS AND CLINICAL IMPLICATIONS

Systematic review methodology is improving, though key components frequently are absent. Reviews should be read critically and in consideration of the methodological flaws.

[Randomized and nonrandomized controlled clinical trials in a German surgical journal]

BACKGROUND

Comprehensive identification of relevant literature is mandatory for valid assessment of the effectiveness of surgical interventions. Thus, electronic database searches are often complemented by handsearching of relevant surgical journals. The aim of this study was to assess the quantity and quality of randomized controlled (RCTs) and controlled clinical trials (CCTs) in the German surgical journal Der Chirurg.

METHODS

Quantitative and qualitative assessment was made after handsearching of studies published from 1948 to 2005 in Der Chirurg. Systematic database search (MEDLINE) was used for comparison of RCTs published in Der Chirurg and international surgical journals.

RESULTS

Overall, 112 controlled clinical trials (90 RCTs, 22 CCTs) were identified by handsearching. The implementation of sample size calculation was reported in 12 of 90 (13%) RCTs. Forty-six (51%) did not specify the randomization process, and five (6%) incorporated the "intention to treat" principle in their analyses. After 2000, RCTs were published in declining frequency in Der Chirurg, whereas international surgical journals printed stable quantities of these studies.

CONCLUSION

Improving the prerequisites of patient-centered clinical research in surgery, rigorous implementation of principles of the CONSORT statement, and modified publication strategies may improve the quality and quantity of reports on clinical studies in Germany.

Progressive high-intensity resistance training and bone mineral density changes among premenopausal women: evidence of discordant site-specific skeletal effects

Regular weight-bearing physical activity has been widely recommended for adult women and may be beneficial in preserving bone mineral density (BMD). However, there is conflicting evidence regarding the effects of resistance training on BMD in premenopausal women. Novel systematic review and meta-analysis evidence is presented on the effects of progressive high-intensity resistance training on BMD in premenopausal women. Structured computer searches of MEDLINE, EMBASE, PubMed, Web of Science, SportDiscus and Evidence Based Medicine Reviews Multifile were undertaken along with hand-searching of key journals and reference lists to locate relevant studies published up to September 2004. Criteria for included studies were published controlled studies and randomised controlled trials (RCTs) evaluating the effects of progressive, high-intensity resistance training studies on BMD in premenopausal women. Two authors reached consensus on all included and excluded studies. Study outcomes for analysis were radiographic BMD assessment from first follow-up at lumbar spine and femoral neck. Primary outcomes for analysis were absolute changes in BMD g/cm(2) at lumbar spine and femoral neck. Relative changes (percentage change) in BMD at lumbar spine were also assessed. Data were extracted from studies including study design, participant characteristics and treatment mode, intensity and duration, using electronic data extraction forms. Where necessary, relevant information was obtained by contacting study authors. Methodological quality of studies was assessed using a well recognised three-question instrument designed to assess bias. Informal assessment for small sample study effects and potential bias was undertaken through visual inspection of funnel plots. The weighted mean difference method (inverse of the variances) was used for combining study group estimates. Quantification of the effect of heterogeneity among study outcomes was assessed using the I(2) statistic. Random effects and fixed-effect models were applied according to observed study heterogeneity. Comparisons resulting in I(2) > 50.0% were considered heterogeneous. Where heterogeneity was observed, a random effects model was applied. Pooled estimates of effect were calculated using the Cochrane Collaboration's Review Manager (RevMan) 4.2.1 software.High-intensity progressive resistance training was shown to be efficacious in increasing absolute BMD at the lumbar spine (p < 0.00001) but not the femoral neck (p = 0.78) in premenopausal women. The weighted mean difference (WMD) using a fixed-effect model for six controlled trials investigating the lumbar spine BMD change was 0.014 g/cm(2) (95% CI 0.009, 0.019; p < 0.00001). The relative BMD change for this site was 0.98% (WMD [random effects], 95% CI 0.49, 3.91%; p = 0.04). In contrast, studies evaluating femoral neck BMD changes showed no significant BMD change (WMD [fixed effect], 0.001 g/cm(2) 95% CI -0.006, 0.008; p = 0.78). Funnel plot inspection of lumbar spine effects indicated that smaller studies demonstrated larger treatment effects. An asymmetry towards studies with positive BMD outcomes was also noted. The methodological quality score of all included studies was low and no study presented a valid intention-to-treat accounting for participant drop-out (attrition). As such, the modest overall treatment effects for resistance training on BMD among premenopausal women observed in this review may be biased and should be interpreted with caution. It is concluded that further RCTs of resistance training of sufficiently long duration and providing optimum type, intensity and volume of loading, with intention-to-treat analysis are now required.

Is Recurrent Venous Thromboembolism After Therapy Reduced by Low-Molecular-Weight Heparin Compared With Oral Anticoagulants?

PURPOSES

To evaluate whether the incidence of recurrent venous thromboembolism (VTE) events after therapy differs for patients treated with long-term low-molecular-weight heparin (LMWH) or oral anticoagulant therapy (OAT).

METHODS

All randomized studies were searched through computerized queries of MEDLINE, the Cochrane Controlled Trials Register, the American Society of Hematology abstract database, and the American Society of Clinical Oncology abstract database.

RESULTS

Eleven studies including 2,907 patients were identified. Seven studies evaluated a period of 3 to 9 months after cessation of the allocated treatment: 5.4% of patients in the LMWH group vs 4% in the arm allocated to OAT had an episode of recurrent symptomatic VTE. Combined analysis showed a nonsignificant trend in lowering recurrent symptomatic VTE in favor of OAT (relative risk [RR], 1.29; 95% confidence interval [CI], 0.82 to 2.02; p = 0.27). By contrast, during active treatment, a statistically significant reduction of the risk of recurrent symptomatic VTE in favor of LMWH over OAT was registered (RR, 0.63; 95% CI, 0.47 to 0.83; p = 0.001). Regarding cancer patients only, 37 of 569 patients (6.5%) in the LMWH group had recurrent symptomatic VTE vs 69 of 546 patients (12.6%) in the OAT group, with a statistically significant reduction of the risk of recurrent symptomatic VTE in favor of LMWH (RR, 0.52; 95% CI, 0.35 to 0.76; p = 0.001).

CONCLUSIONS

Despite the significant reduction of the risk of recurrent symptomatic VTE in favor of LMWH over OAT during treatment, patients treated with long-term LMWH do not seem to have more frequently recurrent VTE events compared with OAT after cessation of therapy. The significant difference favoring LMWH over OAT among all patients receiving treatment comes mostly from studies enrolling cancer patients.

A practical guide to meta-analysis

The wealth of medical research published on a yearly basis demands methods to summarize the literature. Narrative or expert reviews were the traditional method to provide this summary; however, biases associated with narrative reviews raise questions regarding whether this process provides sufficient evidence to guide practice. Meta-analysis is becoming increasingly popular because it can combine results from similar studies to calculate an overall estimate of a treatment effect. Although meta-analysis has its limitations, a thoughtful and well-planned analysis is a valuable tool in providing a high level of evidence. We discuss the steps needed to perform a meta-analysis as a guideline for those interested in pursuing this type of research.

Seasonal patterns and preterm birth: a systematic review of the literature and an analysis in a London-based cohort

OBJECTIVE

The objectives of this study included a systematic review of the countries in which a seasonal pattern of preterm birth has been reported and an analysis on the seasonal variability of preterm birth in a London-based cohort.

DESIGN

Cross-sectional study.

SETTING

Eighteen maternity units in a London health region from 1988 to 2000.

POPULATION

The study population comprised 482,765, live singleton births born after 24 weeks of gestation and weighing more than 200 g.

METHODS

Systematic review and secondary analysis of seasonality over 13 years of births from the St Mary's Maternity Information System (SMMIS).

MAIN OUTCOME MEASURE

Annual patterns of preterm birth and a comparison of risk by seasons.

RESULTS

Three studies from developing countries and three from developed countries reported a seasonal pattern of preterm birth. One study from the USA reported no seasonal pattern of preterm birth. No British studies were located. Rates of preterm birth in developed countries were highest twice a year (once in winter and again in summer). In London (SMMIS data set), however, preterm births peaked only once a year, in winter. Babies born in winter were 10% more likely to be preterm compared with those born in spring (OR 1.10, 95% CI 1.07-1.14).

CONCLUSION

Establishing a seasonal pattern of birth can have important implications for the delivery of healthcare services. Most studies from both developed and developing countries support the existence of preterm birth seasonality. This study has shown that the seasonality of preterm births in this London-based cohort differs from other developed countries that have previously reported a seasonal pattern of preterm birth.

Analgesics for pain after traumatic or orthopaedic surgery: what is the evidence-a systematic review

OBJECTIVE

To assess analgesic drugs in the treatment of postoperative pain after traumatic and orthopaedic surgery (TOS).

DESIGN

A systematic review of randomised clinical trials (RCTs).

DATA SOURCES

Electronic PubMed, EMBASE, The Cochrane Library, and hand searches.

STUDY SELECTION

RCTs of analgesics administered by oral, intramuscular, intravenous, subcutaneous or rectal route, were compared to other analgesics or placebo, in patients under TOS. Study design, characteristics of the study population, analgesic drugs tested, pain intensity and pain relief scores, and adverse effects were assessed.

RESULTS

Ninety-two RCTs (9,596 patients) met our inclusion criteria. Forty-two (46%) were placebo-controlled, and 50 (54%) were direct comparisons between non-opioid, opioid, and/or combinations of both. Patients' mean age (SD) was 49 years (18). In most trials, gastrointestinal ulcer, liver and renal diseases were exclusion criteria. Only 30 trials (33%) were double-blind and reported standardised outcomes of pain intensity and pain relief; 19 of these were single-dose, and follow up of analgesic effects lasted no more than 12 h in 23 (77%). Globally, only nine trials (10%) were double blind, described dropouts or withdrawals, performed analysis by intention to treat, and reported the effects magnitude.

CONCLUSION

Evidence from RCTs on the treatment of postoperative pain after TOS is inadequate for clinical decision making. Assessment of analgesics in pain after TOS should be based on agreed clinically relevant outcomes, in representative patients, and for longer observation periods. In addition, it should include direct comparisons between candidate drugs or their combinations and between various drug administration schedules.

Quality of reporting of randomized controlled trials of herbal medicine interventions

BACKGROUND

Public interest in herbal medicines has generated an increasing number of trials evaluating their efficacy. Trials with poor methodologic quality have exaggerated estimates of treatment effect, and incomplete reporting of trials causes difficulties in assessing trial methodologic quality. The objective of this project was to examine the quality of reporting of randomized controlled intervention trials of herbal medicine.

METHODS

MEDLINE (1966 to September 2003) was searched for randomized controlled trials of 10 herbal medicines. Two individuals (J. G. and J. D.) independently assessed trials using the Consolidated Standard of Reporting Trials checklist. Disagreements were resolved by consensus. The mean number of checklist items reported across all and for individual herbal medicines was calculated. The influence of decade of publication and species of herbal medicine tested was explored using an analysis of variance.

RESULTS

A total of 206 randomized controlled trials of herbal medicine were included. Interrater reliability on reporting quality assessment was high. A total of 45% of items were reported across all trials. The quality of reporting improved across decades from the 1970s to the 2000s. Individual herbal species differed in the total number of items reported, with echinacea, ginkgo, St. John's wort, and kava trials reporting the most items.

CONCLUSIONS

Important methodologic components of randomized controlled trials of herbal medicines are incompletely reported including allocation concealment, method used to generate the allocation sequence, and whether an intention-to-treat analysis was used. Also, key information unique to these trials may be missing, such as percentage of active constituents and type or form of the herbal medicine preparation. We suggest trialists consult a recent extension of the Consolidated Standard of Reporting Trials statement specific to herbal medicine trials when designing and reporting randomized controlled intervention trials of herbal medicines.

Search and selection methodology of systematic reviews in orthodontics (2000-2004)

INTRODUCTION

More systematic reviews related to orthodontic topics are published each year, although little has been done to evaluate their search and selection methodologies.

METHODS

Systematic reviews related to orthodontics published between January 1, 2000, and December 31, 2004, were searched for their use of multiple electronic databases and secondary searches. The search and selection methods of identified systematic reviews were evaluated against the Cochrane Handbook's guidelines.

RESULTS

Sixteen orthodontic systematic reviews were identified in this period. The percentage of reviews documenting and using each criterion of article searching has changed over the last 5 years, with no recognizable directional trend. On average, most systematic reviews documented their electronic search terms (88%) and inclusion-exclusion criteria (100%), and used secondary searching (75%). Many still failed to search more than MEDLINE (56%), failed to document the database names and search dates (37%), failed to document the search strategy (62%), did not use several reviewers for selecting studies (75%), and did not include all languages (81%).

CONCLUSIONS

The methodology of systematic reviews in orthodontics is still limited, with key methodological components frequently absent or not appropriately described.

Cautionary tales in the interpretation of systematic reviews of therapy trials

This is the second in a series of articles emphasizing the cautions in the interpretation of health-care studies. Systematic reviews are presented as comprehensive, unbiased summaries of evidence and are often referred to by clinicians, guideline developers and health policy-makers. Their strengths and limitations, and how their results can be subject to bias and misinterpretation, are discussed.

Literature search parameters marginally improved the pooled estimate accuracy for ultrasound in detecting deep venous thrombosis

BACKGROUND AND OBJECTIVES

Data collection remains of utmost importance to avoid publication bias in systematic reviews. Our objectives were to compare search strategies with and without methodological terms in Medline, to find out how other databases complement Medline, and how these strategies affect the pooled estimates of the accuracy.

STUDY DESIGN AND SETTING

A study was eligible if it prospectively compared ultrasound to venography for the diagnosis of deep venous thrombosis in the lower limbs. All relevant articles found with all databases, searched from 1966 through 2003, constitute the reference standard. Sensitivity was defined as the proportion of relevant studies found by Medline searches divided by the total number of articles in the reference standard.

RESULTS

Of a total of 1,473 citations, 237 abstracts were included. The sensitivity of strategies without methodological terms was higher (96%) than those with (95%, 76%, and 95%). Searches of multiple databases found seven articles not found with Medline. Searches of congress proceedings (International Society of Thrombosis and Haemostasis) found three abstracts not published in full. The diagnostic odds ratio OR was 5.66 (95% confidence interval CI = 4.84-6.48) when multiple databases were searched and 5.57 (95% CI = 3.49-7.65) when only English-language articles in Medline were identified.

CONCLUSION

Medline searches combining free text and MeSH terms were more sensitive. Single Medline search affects only marginally the pooled estimate accuracy.

Non-invasive imaging compared with intra-arterial angiography in the diagnosis of symptomatic carotid stenosis: a meta-analysis

BACKGROUND

Accurate carotid imaging is important for effective secondary stroke prevention. Non-invasive imaging, now widely available, is replacing intra-arterial angiography for carotid stenosis, but the accuracy remains uncertain despite an extensive literature. We systematically reviewed the accuracy of non-invasive imaging compared with intra-arterial angiography for diagnosing carotid stenosis in patients with carotid territory ischaemic symptoms.

METHODS

We searched for articles published between 1980 and April 2004; included studies comparing non-invasive imaging with intra-arterial angiography that met Standards for Reporting of Diagnostic Accuracy (STARD) criteria; extracted data to calculate sensitivity and specificity of non-invasive imaging, to test for heterogeneity and to perform sensitivity analyses; and categorised percent stenosis by the North American Symptomatic Carotid Endarterectomy Trial (NASCET) method.

RESULTS

In 41 included studies (2541 patients, 4876 arteries), contrast-enhanced MR angiography was more sensitive (0.94, 95% CI 0.88-0.97) and specific (0.93, 95% CI 0.89-0.96) for 70-99% stenosis than Doppler ultrasound, MR angiography, and CT angiography (sensitivities 0.89, 0.88, 0.76; specificities 0.84, 0.84, 0.94, respectively). Data for 50-69% stenoses and combinations of non-invasive tests were sparse and unreliable. There was heterogeneity between studies and evidence of publication bias.

INTERPRETATION

Non-invasive tests, used cautiously, could replace intra-arterial carotid angiography for 70-99% stenosis. However, more data are required to determine their accuracy, especially at 50-69% stenoses where the balance of risk and benefit for carotid endarterectomy is particularly narrow, and to explore and overcome heterogeneity. Methodology for evaluating imaging tests should be improved; blinded, prospective studies in clinically relevant patients are essential basic characteristics.

Reporting of Randomized Controlled Trials in Hodgkin Lymphoma in Biomedical Journals

BACKGROUND

Randomized controlled trials (RCTs) are the best tool to evaluate the effectiveness of clinical interventions. The Consolidated Standards for Reporting Trials (CONSORT) statement was introduced in 1996 to improve reporting of RCTs. We aimed to determine the extent of ambiguity and reporting quality as assessed by adherence to the CONSORT statement in published reports of RCTs involving patients with Hodgkin lymphoma from 1966 through 2002.

METHODS

We analyzed 242 published full-text reports of RCTs in patients with Hodgkin lymphoma. Quality of reporting was assessed using a 14-item questionnaire based on the CONSORT checklist. Reporting was studied in two pre-CONSORT periods (1966-1988 and 1989-1995) and one post-CONSORT period (1996-2002).

RESULTS

Only six of the 14 items were addressed in 75% or more of the studies in all three time periods. Most items that are necessary to assess the methodologic quality of a study were reported by fewer than 20% of the studies. Improvements over time were seen for some items, including the description of statistics methods used, reporting of primary research outcomes, performance of power calculations, method of randomization and concealment allocation, and having performed intention-to-treat analysis.

CONCLUSIONS

Despite recent improvements, reporting levels of CONSORT items in RCTs involving patients with Hodgkin lymphoma remain unsatisfactory. Further concerted action by journal editors, learned societies, and medical schools is necessary to make authors even more aware of the need to improve the reporting RCTs in medical journals to allow assessment of validity of published clinical research.

Librarians, surgeons, and knowledge

are indicative of the ferment of change brought about by the digital revolution, and of the continuing determination of health information professionals to rise to the challenges involved in supporting surgeons and everyone in the surgical team, as they endeavor to provide the best possible care for their patients. Libraries as we know them have changed, and are changing. The scholarly communications process is also undergoing profound transformation. The authors discuss these changes and their implications for surgeons.

THE PROMISE AND PITFALLS OF SYSTEMATIC REVIEWS

The systematic review "movement" that has transformed medical journal reports of clinical trials and reviews of clinical trials has taken hold in public health, with the most recent milestone, the publication of the first edition of The Guide to Community Health Services in 2005. In this paper we define and distinguish current terms, point out important resources for systematic reviews, describe the impact of systematic review on the quality of primary studies and summaries of the evidence, and provide perspectives on the promise of systematic reviews for shaping the agenda for public health research. Several pitfalls are discussed, including a false sense of rigor implied by the terms "systematic review" and "meta-analysis" and substantial variation in the validity of claims that a particular intervention is "evidence based," and the difficulty of translating conclusions from systematic reviews into public health advocacy and practice.

Are Manual Therapies Effective in Reducing Pain From Tension-Type Headache?

OBJECTIVES

A systematic review was performed to establish whether manual therapies have specific efficacy in reducing pain from tension-type headache (TTH).

METHODS

Computerized literature searches were performed in MEDLINE, EMBASE, AMED, MANTIS, CINAHL, PEDro, and Cochrane databases. Papers were included if they described clinical (open noncontrolled studies) or randomized controlled trials in which any form of manual therapy was used for TTH, and if they were published after 1994 in the English language. The methodologic quality of the trials was assessed using the PEDro scale. Levels of scientific evidence, based on the quality and the outcomes of the studies, were established for each manual therapy: strong, moderate, limited, and inconclusive evidence.

RESULTS

Only six studies met the inclusion criteria. These trials evaluated different manual therapy modalities: spinal manipulation (three trials), classic massage (one trial), connective tissue manipulation (two trials), soft tissue massage (one trial), Dr. Cyriax's vertebral mobilization (one trial), manual traction (one trial), and CV-4 craniosacral technique (one trial). Methodologic PEDro quality scores ranged from 2 to 8 points out of a theoretical maximum of 10 points (mean=5.8+/-2.1). Analysis of the quality and the outcomes of all trials did not provide rigorous evidence that manual therapies have a positive effect in reducing pain from TTH: spinal manipulative therapy showed inconclusive evidence of effectiveness (level 4), whereas soft tissue techniques showed limited evidence (level 3).

CONCLUSIONS

The authors found no rigorous evidence that manual therapies have a positive effect in the evolution of TTH. The most urgent need for further research is to establish the efficacy beyond placebo of the different manual therapies currently applied in patients with TTH.

A survey identified publication bias in the secondary literature

OBJECTIVE

To investigate the existence of publication bias in the translation of evidence from the primary to the secondary literature, using the ACP Journal Club (ACPJC) as a representative of secondary literature and Medline as a representative of primary literature.

METHODS

A cross-sectional survey of randomly selected randomized controlled trials of therapy published between 1994 and 2002 in English in Medline and all summaries of therapy trials published by ACPJC between the same dates. The main outcome measure was the rate of positive trials from among those trials aiming to find a difference between groups.

RESULTS

831 trials from Medline and 823 summaries of trials from ACPJC met the inclusion criteria and were included in the study. Compared to trials cataloged in Medline, ACPJC preferentially summarized trials with a positive outcome (P < .001). This bias remained after controlling for other selection biases seen in the ACPJC such as preferentially summarizing multicentered trials with large sample size, no active treatment control, blinding, and in certain disease fields (adjusted odds ratio 2.8, 95% confidence interval 2.02-3.93).

CONCLUSION

The ACPJC preferentially summarizes trials with a positive outcome. Efforts should be made to reduce this bias.

A systematic review and meta-analysis of misuse of antibiotic therapies in the community

Misuse of antibiotic therapy can have a profound negative impact both on individuals and on the community. The objective of this meta-analysis was to estimate the prevalence of antibiotic misuse in terms of non-compliance with therapy or reuse of leftover antibiotics in the community. Of 2848 screened articles, 46 contained the required information on the number of participants, the number compliant/using leftovers and the measurement technique. Mean compliance with antibiotics was 62.2% (95% confidence interval (CI), 56.4-68.0%) and mean use of leftover antibiotics was 28.6% (95% CI, 21.8-35.4%). Although variation in the methods resulted in substantial heterogeneity in the estimates, results were generally consistent by region and measurement technique. Patient education and simpler antibiotic regimens should be encouraged to promote responsible use of antibiotic therapy.

Challenges in Creating a Good Randomized Controlled Trial in Hand Surgery

The goal of this article is to inform readers of hand surgery literature and, more importantly, investigators about key design issues in randomized trials in hand surgery. Specifically, it describes the application of the Consolidated Standards of Reporting Trials in hand surgery trials and provides tips for reading the hand surgery literature. Unique challenges in the execution of a randomized controlled trial in hand surgery are explained, including the surgical learning curve, randomization, concealment and blinding, loss to follow-up, intention to treat analysis, surgical equipoise, differential care, and treatment effect and its implications for sample size. Additionally, the relevance of incorporating economic analyses into hand surgery trials and the importance of changing the hand surgeons' research culture are addressed.

For randomized controlled trials, the quality of reports of complementary and alternative medicine was as good as reports of conventional medicine

OBJECTIVE

To compare the quality of reporting of reports randomized controlled trials (RCTs) published in English and in languages other than English (LOE), and to determine whether there were differences between conventional medicine (CM) and complementary and alternative medicine (CAM) reports.

STUDY DESIGN AND SETTING

We examined more than 600 RCTs associated with 125 systematic reviews. We extracted characteristics of each RCT using a standardized data collection form. We assessed quality using the Jadad scale and the adequacy of allocation concealment.

RESULTS

There were only minor differences in the quality of reports of RCTs published in English compared with other languages (median quality score of 3 vs. 2, P=.10), and the quality of reports of CAM RCTs was similar to the CM reports (median score of 3 vs. 2, P=.14). There was no effect of language of publication on quality of reporting for CM trials (median score of 2 vs. 2, P=.12). Among CAM trials, however, overall quality scores were higher for reports in English than for reports in other languages (median score of 3 vs. 2, P=.04).

CONCLUSION

The overall quality of reports published in languages other than English is similar to that of English-language reports. Moreover, the overall quality of reporting of RCTs of CAM interventions is as good as that for CM interventions.

Language of publication restrictions in systematic reviews gave different results depending on whether the intervention was conventional or complementary

OBJECTIVE

To assess whether language of publication restrictions impact the estimates of an intervention's effectiveness, whether such impact is similar for conventional medicine and complementary medicine interventions, and whether the results are influenced by publication bias and statistical heterogeneity.

STUDY DESIGN AND SETTING

We set out to examine the extent to which including reports of randomized controlled trials (RCTs) in languages other than English (LOE) influences the results of systematic reviews, using a broad dataset of 42 language-inclusive systematic reviews, involving 662 RCTs, including both conventional medicine (CM) and complementary and alternative medicine (CAM) interventions.

RESULTS

For CM interventions, language-restricted systematic reviews, compared with language-inclusive ones, did not introduce biased results, in terms of estimates of intervention effectiveness (random effects ration of odds rations ROR=1.02; 95% CI=0.83-1.26). For CAM interventions, however, language-restricted systematic reviews resulted in a 63% smaller protective effect estimate than language-inclusive reviews (random effects ROR=1.63; 95% CI=1.03-2.60).

CONCLUSION

Language restrictions do not change the results of CM systematic reviews but do substantially alter the results of CAM systematic reviews. These findings are robust even after sensitivity analyses, and do not appear to be influenced by statistical heterogeneity and publication bias.

Systematic reviews involving complementary and alternative medicine interventions had higher quality of reporting than conventional medicine reviews

OBJECTIVE

To compare the quality of systematic reviews reported in English and in languages other than English, and to determine whether there are differences between conventional medicine (CM) and complementary and alternative medicine (CAM) reports.

STUDY DESIGN AND SETTING

We used the Oxman and Guyatt (OG) scale to assess the quality of reporting in 130 systematic reviews: 50 were language-restricted, 32 were language-inclusive but only English-language (EL) trials contained (inclusive-EL), and 48 were language-inclusive and included trials published in languages other than English (inclusive-LOE). Of the 130 reviews, 105 addressed CM interventions and 25 addressed CAM interventions.

RESULTS

Comparison of the systematic reviews showed that the quality of reporting and reporting characteristics are not affected by inclusion or exclusion of LOE; however, the quality of reporting of systematic reviews involving CAM interventions is higher than that of reviews focusing on CM interventions.

CONCLUSION

Informal comparison of the OG scale with the data collected on quality assessments showed that the OG scale performs well overall but may not identify important differences in comprehensiveness of the search strategy and avoidance of bias in study selection. Further research is required to determine the best methods for assessing quality of systematic reviews and whether the effect of language restrictions is dependent on the type of intervention (CM or CAM).

Acupuncture in xerostomia--a systematic review

The aim of this systematic review was to assess the efficacy of acupuncture in the management of xerostomia. Assessing quality of studies aim to efficiently integrate valid information and provide a basis for sound decision making based on the best available evidence. Articles of controlled clinical trials evaluating the efficacy of acupuncture in the management of xerostomia were obtained by searching through the databases MEDLINE and Cochrane Central Register of Controlled Trials to September 2003. Three articles met the criteria for inclusion and a criteria list was used to assess the quality of these studies. The studies were considered to be of high quality or low quality in accordance with the criteria list utilized. The results of the trials were considered positive, negative or indifferent based on statistically significant between group differences. The criteria list utilized indicate that one of the three studies was of high quality and it presents indifferent results. One of the two studies of low quality presents positive results and one presents indifferent results. An analysis of the results degree of evidence resulted in no evidence for the efficacy of acupuncture in the management of xerostomia. This systematic review shows that there is no evidence for the efficacy of acupuncture in the management of xerostomia. There is a need for future high quality randomized controlled trials.

Intraocular pressure-lowering effects of all commonly used glaucoma drugs: a meta-analysis of randomized clinical trials

OBJECTIVE

To estimate the intraocular pressure (IOP) reduction achieved by the most frequently prescribed glaucoma drugs and a placebo in a meta-analysis of randomized clinical trials.

DESIGN

Meta-analysis of randomized clinical trials.

PARTICIPANTS

Twenty-seven articles reporting on 28 randomized clinical trials. These articles reported 6953 participants for the trough and 6841 for the peak.

METHODS

Articles published up to December 2003 were identified in the following data sources: Medline, Embase, and the Cochrane Controlled Trials Register, and references from relevant articles. Over 85% of the patients had to be diagnosed with primary open-angle glaucoma (POAG) or ocular hypertension (OH), and articles had to be written in English, German, French, or Dutch. Quality of trials was assessed by a Delphi list with additions. The pooled 1-month IOP-lowering effect from baseline at peak and trough was calculated by performing meta-analysis using the random effects model.

MAIN OUTCOME MEASURES

Absolute and relative change in IOP from baseline, for peak and trough moments.

RESULTS

Relative IOP reductions from baseline [mean (95% confidence interval)] were -23% (-25% to -22%) for a peak and -20% (-23% to -17%) for a trough for 0.5% betaxolol; peak, -27% (-29% to -25%), and trough, -26% (-28% to -25%), for 0.5% timolol; peak, -22% (-24% to -20%), and trough, -17% (-19% to -15%), for 2.0% dorzolamide; peak, -17% (-19% to -15%), and trough, -17% (-19% to -15%) for 1.0% brinzolamide; peak, -25% (-28% to -22%), and trough, -18% (-21% to -14%) for 0.2% brimonidine; peak, -31% (-33% to -29%), and trough, -28% (-30% to -26%) for 0.005% latanoprost; peak, -31% (-32% to -29%), and trough, -29% (-32% to -25%) for 0.004% travoprost; peak, -33% (-35% to -31%), and trough, -28% (-29% to -27%) for 0.03% bimatoprost; and peak, -5% (-9% to -1%), and trough, -5% (-10% to -0%) for the placebo. The difference in absolute IOP reduction from baseline between timolol and prostaglandin analogs or prostamide varied from -0.4 to 0.1 mmHg at trough and from 1.0 to 1.5 mmHg at peak. Quality scores of included studies were generally high, a mean of 14.2 on a scale from 0 to 20 (interquartile range, 13-16).

CONCLUSION

This meta-analysis suggests that bimatoprost, travoprost, latanoprost, and timolol are the most effective intraocular pressure-reducing agents in POAG and OH patients.

Systematic review of long-term weight loss studies in obese adults: clinical significance and applicability to clinical practice

BACKGROUND

Obesity is a common health problem that requires a long-term care approach. We systematically reviewed long-term (> or =2 y) studies investigating dietary/lifestyle, pharmacologic, and surgical weight loss methods to assess (1) weight loss efficacy, defined by absolute weight loss and the proportion of subjects with > or =5% weight loss, (2) effects of weight loss on cardiovascular risk factors, and (3) applicability of findings from studies to everyday clinical practice.

METHODS

The MEDLINE, HealthSTAR, and the Cochrane Controlled Trials databases were searched for studies investigating the long-term efficacy of weight loss methods in overweight and obese adults. Data were extracted for (i) weight loss after 1 y (pharmacologic studies only), 2 y, 3 y, and 4 y, (ii) proportion of subjects with > or =5% weight loss at the end of follow-up, and (iii) changes (end-of follow-up minus baseline values) in blood lipids, fasting blood glucose, and systolic and diastolic blood pressure.

RESULTS

Dietary/lifestyle therapy provides <5 kg weight loss after 2-4 y, pharmacologic therapy provides 5-10 kg weight loss after 1-2 y, and surgical therapy provides 25-75 kg weight loss after 2-4 y. Weight loss of > or =5% baseline weight is not consistently associated with improvements in cardiovascular risk factors and these benefits appear to be intervention specific and occur mainly in people with concomitant cardiovascular risk factors. Weight loss studies have methodologic limitations that restrict the applicability of findings to unselected obese people assessed in everyday clinical practice. These limitations include an inadequate study duration, large proportions of subjects lost to follow-up, a lack of an appropriate usual care group, and a lack of reporting of outcomes in high-risk subgroups.

CONCLUSIONS

Dietary/lifestyle and pharmacologic weight loss interventions provide modest weight loss, and may improve markers of cardiovascular risk factors although these benefits occur mainly in patients with cardiovascular risks. Studies investigating weight loss have methodologic limitations that restrict the applicability of findings to obese patients assessed in clinical practice.

Autologous stem cells derived from the peripheral blood compared to standard bone marrow transplant; time to engraftment: A systematic review

Lymphoma patients who require high dose chemotherapy are 'rescued' by reinfusion of stem cells to repopulate their bone marrow and minimise the risk of fatal infections or haemorrhage. This review evaluated the evidence for the use of stem cells derived from the peripheral blood to speed the engraftment of neutrophil and platelets when compared to standard bone marrow transplant. A systematic search of the Cochrane Library, Medline and Embase was carried out to identify randomised controlled trials comparing haematological recovery following these two interventions which met predetermined inclusion and exclusion criteria. Four studies were critically appraised and found to follow heterogenous protocols but were otherwise of satisfactory quality. All four studies demonstrated an advantage of peripheral blood stem cell transplantation over bone marrow transplantation in terms of neutrophil recovery and three out of four demonstrated the same trend for platelet engraftment. In sum, there is evidence to support the use of peripheral blood stem cell transplantation for this population of lymphoma patients. Nurses can share this information confidently with patients and other staff. However, a more extensive review of studies which have investigated the association between extended neutrophil and platelet recovery and length of hospitalisation, number of septic neutropenic episodes and cost reduction is needed to give a fuller picture of the effects for treatment.

Meta-analysis and structured literature review in radiology

The overall goal of a systematic review or meta-analysis is to combine results of previous studies to arrive at summary conclusions about a body of research. In radiology, systematic reviews or meta-analyses can be used to calculate a summary estimate of effect size of a treatment that used imaging data to assess outcomes in observational or randomized controlled clinical trials, estimate the clinical effectiveness of an imaging-guided therapy procedure, evaluate the summary diagnostic accuracy of an imaging test, or synthesize results of economic evaluations that used imaging data. This article outlines the general concepts of structured literature reviews and discusses the approaches for conducting a meta-analysis in radiology, emphasizing the methods available for data synthesis and handling heterogeneity between and among studies.

Acupuncture analgesia during surgery: a systematic review

The aim of this systematic review is to assess the effectiveness of acupuncture as an adjunctive analgesic method to standard anaesthetic procedures for surgery and to determine whether acupuncture has any analgesic-sparing effect. Electronic literature searches for randomised clinical trials (RCTs) of acupuncture during surgery were performed in seven electronic databases. No language restrictions were imposed. All included studies were rated according to their methodological quality and validity. As the studies were clinically heterogeneous, no meta-analyses were performed. The evidence was classified according to four levels: strong, moderate, limited, or inconclusive. Nineteen RCTs were identified. Seven of them suggested that acupuncture is efficacious. Of nine high-quality RCTs, two studies had positive outcomes. There was no significant association between study quality and direction of outcome. One of eight high-validity trials reported a positive outcome and there was a significant relationship between validity and direction of outcome. The evidence that acupuncture is more effective than no acupuncture as an adjunct to standard anaesthetic procedures is therefore inconclusive. Strong evidence exists that real acupuncture is not significantly different from placebo acupuncture. For an analgesic-sparing effect of acupuncture, evidence remains inconclusive. In conclusion, this review does not support the use of acupuncture as an adjunct to standard anaesthetic procedures during surgery.

Reporting quality of randomized trials in the diet and exercise literature for weight loss

Background

To adequately assess individual studies and synthesize quantitative research on weight loss studies, transparent reporting of data is required. The authors examined the reporting quality of randomized trials in the weight loss literature, focusing exclusively on subject characteristics as they relate to enrollment, allocation, and follow-up.

Methods

An extensive literature review, which included a computerized search of the MEDLINE database, manual searches of bibliographic references, and cross-referencing of 92 review articles was conducted. A checklist, based on CONSORT recommendations, was used to collect information on whether or not authors reported age, gender, co-morbid disease, medication use, race/ethnicity, and postmenopausal status. Also tracked was whether or not initial and final sample size was reported and stratified by gender.

Results

Of 604 possible articles, 231 articles met eligibility criteria. Important subject characteristics were not reported as the following breakdown indicates: age (11%), gender (4%), race/ethnicity (86%), co-morbid disease states (34%), and medication use (92%). Additionally, 21% of articles failed to report initial sample size by gender while 69% neglected to report final sample size by gender.

Conclusion

Inadequate reporting can create difficulties with interpretation and can lead to biased results receiving false credibility. The quality of reporting for weight loss studies needs considerable improvement.

"No Language Restrictions" in Database Searches: What Does This Really Mean?

The aim of this study was to investigate the coverage of non-English journals by MEDLINE((R)) and EMBASE, the two major biomedical databases used for identifying studies for possible inclusion in systematic reviews and meta-analyses. A series of searches were conducted to compare the coverage of journals in languages other than English. The results were compared against listings in Ulrich's Periodicals Directory, an authoritative source of information on periodicals published in more than 200 countries. This study has highlighted the existence of a database coverage bias, in terms of the systematic exclusion of journals from certain countries and/or in certain languages. Searching that relies only on English language databases may result in failure to find many relevant studies published in languages other than English, irrespective of the research question and the avoidance of any language restrictions.

Assessing heterogeneity in meta-analyses of Helicobacter pylori infection-related clinical studies: a critical appraisal

OBJECTIVE

To critically assess the meta-analyses of Helicobacter pylori infection-related clinical studies, particularly the handling of between-study heterogeneity.

METHODS

A qualitative, all-language, systematic literature search was performed in Medline, PubMed, BioMed Central and Embase up to February 2003, supplemented by a manual search of major relevant journals. Assessment was according to modified criteria for literature searching, eligibility criteria, validity assessment, data extraction and presentation. Five parameters were used to assess the quality of the meta-analyses in handling between-study heterogeneity.

RESULTS

Of 84 potentially relevant citations, 47 were systematic reviews and of them 38 were meta-analyses. Of these 38 studies, 15 (39.5%) had conducted a literature search of multiple databases and 34 (89.5%) had conducted a supplementary manual search. The eligibility criteria were clearly presented in 81.6% of studies, but the quality of the primary studies was assessed in only 26.3%. The process and strategy for data extraction was reported in 57.9% of all studies; 19 (50%) studies planned statistical tests of between-study homogeneity and the results were reported in 18, but the level of statistical significance was reported in only 11 (57.9%). The selection of and justification for a statistical model was presented in 39.5% and 26.3% of studies, respectively. Among the 11 meta-analyses in which statistical between-study heterogeneity was reported, 54.5% ignored the statistical findings and proceeded to pool the study results. The implications of between-study heterogeneity were discussed in only 8 studies.

CONCLUSIONS

Many methodological flaws were identified in the meta-analyses of H. pylori-related clinical studies, particularly for assessing, reporting and interpreting between-study heterogeneity. This warrants consistent and urgent adherence by reviewers and journal editors to the methodological guidelines for meta-analyses.

Comparing efficacy of first-line atypical antipsychotics: no evidence of differential efficacy between risperidone, olanzapine, quetiapine, ziprasidone, and aripiprazole

Objective To evaluate the comparative efficacy of the first-line atypical antipsychotics risperidone, olanzapine, quetiapine, ziprasidone, and aripiprazole. Methods We reviewed published short-term, randomised, controlled clinical trials of first-line atypical antipsychotics in the treatment of schizophrenia or schizoaffective disorder that used the Positive and Negative Syndrome Scale to assess efficacy. We used a combined overview analysis to compare the extent of improvement in global symptoms and positive and negative symptoms. We did not analyse adverse event data. Results Although we found considerable variation in the degree of improvement with a particular atypical antipsychotic across different studies, the range and average improvement were similar among all first-line atypicals for all efficacy parameters considered. Dosage was a critical determinant of efficacy, although the most effective dose of each agent varied across studies. There were insufficient data for ziprasidone and aripiprazole to allow their inclusion in the formal overview comparison. Conclusion Despite confounding and methodological limitations, the data we reviewed do not support assertions of differential efficacy between the first-line atypical antipsychotics. Additional controlled comparative studies of the atypical antipsychotics should be of particular interest.

Insulin-sensitizing agents as primary therapy for patients with polycystic ovarian syndrome

BACKGROUND

This paper is a systematic review of metformin versus clomiphene citrate (CC) in women with polycystic ovary syndrome (PCOS).

METHODS

Meta-analysis Of Observational Studies in Epidemiology (MOOSE) and QUality Of Reporting Of Meta-analyses (QUOROM) guidelines were followed. A systematic computerized literature search was done of seven bibliographic databases. Inclusion criteria included cohort and randomized controlled trials (RCT) of women with PCOS and the following medications: metformin versus placebo; metformin versus CC; metformin plus CC versus placebo plus CC. Rev-man 4.1 and Metaview 4.0 were used to analyse data. Relative risk (RR) estimates were presented. A chi2-test determined the significance of the association. Heterogeneity was determined by the Cochran Q-test.

RESULTS

Metformin was 50% better than placebo for ovulation induction in infertile PCOS patients [RR 1.50; 95% confidence interval (CI) 1.13, 1.99]. Metformin was also of benefit in non-infertile (i.e. patients with PCOS who were not complaining of infertility) PCOS patients for cycle regulation compared to placebo (RR 1.45; CI 1.11, 1.90). Metformin was not of confirmed benefit versus placebo for achievement of pregnancy (RR 1.07; CI 0.20, 5.74). Metformin plus CC may be 3-4-fold superior to CC alone for ovulation induction (RR 3.04; CI 1.77, 5.24) and pregnancy (RR 3.65; CI 1.11, 11.99) in women with PCOS.

CONCLUSIONS

Metformin is effective for ovulation induction and cycle regulation in this group of patients. Metformin plus CC appears to be very effective for achievement of pregnancy compared to CC alone. No RCTs directly compare metformin to CC but the need for such a trial exists.

Quality of life assessment and reporting in randomized controlled trials: a study of literature published from Japan

Background

Standardization of quality of life (QOL) assessment and reporting in clinical trials is an imperative issue. While English-speaking countries have led this movement in standardization, there persists to be a limited amount of information from non-English-speaking including Japan. In this study, we bibliographically analyze the reporting of randomized controlled trials (RCT) conducted in Japan that used a QOL instrument.

Methods

A PubMed search of reports published between 1970–2003 followed by an examination of QOL reporting and its frequency of use in RCTs published from Japan.

Results

Percentages of QOL reporting in RCTs have increased between 1970–2003 both worldwide (0% for 1970–1974 to 4.4% for 2000–2003) and in Japan (0% to 1.8% for the identical periods). We found and evaluated 46 RCT reports published from Japan (32 in English, 14 in Japanese). The most commonly studied clinical condition was cancer (26, 56.5%) and the most common intervention was drug therapy (29, 63.0%). QOL was used as the primary endpoint in 10 studies (21.7%). Authors used established QOL instruments in 12 studies (26.1%), developed original instruments in 8 studies (17.5%) and assessed the symptoms or performance status in 10 studies (21.7%). Authors conceptually defined QOL in only 6 studies (13.0%). Neither response rate nor number of respondents for questionnaire surveys was specified in 16 studies (34.8%); furthermore, 11 studies (23.9%) did not describe respondents' attributes.

Conclusions

Findings on relative frequency suggested that Japanese authors of RCT reports have less interest in QOL instruments than other international researchers in Western Europe and North America. Examination of RCT reports published from Japan revealed that there were several points to be improved in reporting QOL instruments. This study highlights the need to define QOL measures specific to clinical specialty and to examine methodology for assessing and reporting QOL.