Problems with systematic reviews of acupuncture. What should we do about these?

Defining the quality of acupuncture: the case of acupuncture for cancer-related fatigue

BACKGROUND

The quality and dose of acupuncture used in a clinical trial affects the outcome, as with the quality and dose of any intervention. The dose of acupuncture treatment may be characterized by the frequency of treatment, needle type and depth, length of needle retention, point selection, and combination. The dose in trials of acupuncture has at times been described as low or inappropriate but is seldom assessed in systematic reviews of acupuncture trials. This article examines the research evaluating acupuncture for cancer-related fatigue to determine what characteristics of treatment may contribute to a quality acupuncture intervention.

METHODOLOGY

English and Chinese language databases were searched from inception to December 2013 for randomized controlled trials of acupuncture for the treatment of cancer-related fatigue. Assessment of the quality of the acupuncture intervention was undertaken using the domains and items from the NICMAN framework.

RESULTS

Seven studies with a total of 690 patients were included. Four of the studies were designed as feasibility or pilot studies, and the other 3 studies were described as "effectiveness" trials. The treatment paradigm for the active intervention was based on traditional Chinese medicine in all studies, yet few of the studies were explicit as to how the active intervention was justified within a traditional Chinese medicine paradigm. Acupuncture point prescriptions were developed by a small consensus panel or based on typical points and/or "clinical experience." No discussion of traditional Chinese medicine theory or literature review was reported in any studies. Acupuncture point location was adequately described in 4 of the 7 studies. Frequency of treatment was twice per week in 2 studies; all others were once per week. Two studies did not apply needle manipulation or stimulation, and no justification was given.

CONCLUSION

The 7 trials reviewed meet some criteria for a quality acupuncture intervention. However, frequently elements of the intervention were not addressed, and it is possible that the dosage trialed was suboptimal. Systematic reviews of acupuncture are likely to continue to be inconclusive while comparisons are conducted of heterogeneous interventions without providing.

Getting inside acupuncture trials--exploring intervention theory and rationale

Background

Acupuncture can be described as a complex intervention. In reports of clinical trials the mechanism of acupuncture (that is, the process by which change is effected) is often left unstated or not known. This is problematic in assisting understanding of how acupuncture might work and in drawing together evidence on the potential benefits of acupuncture. Our aim was to aid the identification of the assumed mechanisms underlying the acupuncture interventions in clinical trials by developing an analytical framework to differentiate two contrasting approaches to acupuncture (traditional acupuncture and Western medical acupuncture).

Methods

Based on the principles of realist review, an analytical framework to differentiate these two contrasting approaches was developed. In order to see how useful the framework was in uncovering the theoretical rationale, it was applied to a set of trials of acupuncture for fatigue and vasomotor symptoms, identified from a wider literature review of acupuncture and early stage breast cancer.

Results

When examined for the degree to which a study demonstrated adherence to a theoretical model, two of the fourteen selected studies could be considered TA, five MA, with the remaining seven not fitting into any recognisable model. When examined by symptom, five of the nine vasomotor studies, all from one group of researchers, are arguably in the MA category, and two a TA model; in contrast, none of the five fatigue studies could be classed as either MA or TA and all studies had a weak rationale for the chosen treatment for fatigue.

Conclusion

Our application of the framework to the selected studies suggests that it is a useful tool to help uncover the therapeutic rationale of acupuncture interventions in clinical trials, for distinguishing between TA and MA approaches and for exploring issues of model validity. English language acupuncture trials frequently fail to report enough detail relating to the intervention. We advocate using this framework to aid reporting, along with further testing and refinement of the framework.

Clinical Research on Acupuncture: Part 2. Controlled Clinical Trials, an Overview of Their Methods

There is almost universal agreement that the quality of clinical trials of acupuncture is poor. There is an urgent need to improve their quality. The author develops here a list of 45 criteria important in the design, implementation, and writing up of controlled clinical acupuncture trials. This list has been compiled after examining the quality assessment criteria used in meta-analyses and systematic reviews of acupuncture, general publications on clinical trial designs and methodological considerations specific to acupuncture trials. Each criterion is discussed with recommendations about use and implementation. Additionally, each criterion is discussed relative to their importance in three types of acupuncture trial, acupuncture versus sham acupuncture, acupuncture versus standard therapy and acupuncture versus no treatment or wait-list. It is hoped that this exploration and systematic presentation of the 45 criteria will contribute to improving the quality of clinical trials of acupuncture. Improved trial quality will lead to greater ease interpreting the results of trials, especially in systematic reviews.