Can you trust systematic reviews of complementary and alternative therapies?

Scoping review of systematic reviews of complementary medicine for musculoskeletal and mental health conditions

OBJECTIVE

To identify potentially effective complementary approaches for musculoskeletal (MSK)-mental health (MH) comorbidity, by synthesising evidence on effectiveness, cost-effectiveness and safety from systematic reviews (SRs).

DESIGN

Scoping review of SRs.

METHODS

We searched literature databases, registries and reference lists, and contacted key authors and professional organisations to identify SRs of randomised controlled trials for complementary medicine for MSK or MH. Inclusion criteria were: published after 2004, studying adults, in English and scoring >50% on Assessing the Methodological Quality of Systematic Reviews (AMSTAR); quality appraisal checklist). SRs were synthesised to identify research priorities, based on moderate/good quality evidence, sample size and indication of cost-effectiveness and safety.

RESULTS

We included 84 MSK SRs and 27 MH SRs. Only one focused on MSK-MH comorbidity. Meditative approaches and yoga may improve MH outcomes in MSK populations. Yoga and tai chi had moderate/good evidence for MSK and MH conditions. SRs reported moderate/good quality evidence (any comparator) in a moderate/large population for: low back pain (LBP) (yoga, acupuncture, spinal manipulation/mobilisation, osteopathy), osteoarthritis (OA) (acupuncture, tai chi), neck pain (acupuncture, manipulation/manual therapy), myofascial trigger point pain (acupuncture), depression (mindfulness-based stress reduction (MBSR), meditation, tai chi, relaxation), anxiety (meditation/MBSR, moving meditation, yoga), sleep disorders (meditative/mind-body movement) and stress/distress (mindfulness). The majority of these complementary approaches had some evidence of safety-only three had evidence of harm. There was some evidence of cost-effectiveness for spinal manipulation/mobilisation and acupuncture for LBP, and manual therapy/manipulation for neck pain, but few SRs reviewed cost-effectiveness and many found no data.

CONCLUSIONS

Only one SR studied MSK-MH comorbidity. Research priorities for complementary medicine for both MSK and MH (LBP, OA, depression, anxiety and sleep problems) are yoga, mindfulness and tai chi. Despite the large number of SRs and the prevalence of comorbidity, more high-quality, large randomised controlled trials in comorbid populations are needed.

The Development of a Checklist to Enhance Methodological Quality in Intervention Programs

The methodological quality of primary studies is an important issue when performing meta-analyses or systematic reviews. Nevertheless, there are no clear criteria for how methodological quality should be analyzed. Controversies emerge when considering the various theoretical and empirical definitions, especially in relation to three interrelated problems: the lack of representativeness, utility, and feasibility. In this article, we (a) systematize and summarize the available literature about methodological quality in primary studies; (b) propose a specific, parsimonious, 12-items checklist to empirically define the methodological quality of primary studies based on a content validity study; and (c) present an inter-coder reliability study for the resulting 12-items. This paper provides a precise and rigorous description of the development of this checklist, highlighting the clearly specified criteria for the inclusion of items and a substantial inter-coder agreement in the different items. Rather than simply proposing another checklist, however, it then argues that the list constitutes an assessment tool with respect to the representativeness, utility, and feasibility of the most frequent methodological quality items in the literature, one that provides practitioners and researchers with clear criteria for choosing items that may be adequate to their needs. We propose individual methodological features as indicators of quality, arguing that these need to be taken into account when designing, implementing, or evaluating an intervention program. This enhances methodological quality of intervention programs and fosters the cumulative knowledge based on meta-analyses of these interventions. Future development of the checklist is discussed.