Trends and quality of randomized controlled trials on acupuncture conducted in Japan by decade from the 1960s to the 2010s: a systematic review

BACKGROUND

More new randomized controlled trials (RCTs) on acupuncture have been published in Japan since our last updated systematic review (2010). This systematic review aimed to evaluate the quality of RCTs on acupuncture conducted in Japan and understand the decade-wise changes in the methodological characteristics of the relevant RCTs.

METHODS

The literature search was performed using Ichushi Web, the Cochrane Central Register of Controlled Trials (CENTRAL), PubMed and our team's compilation of relevant papers. We included full-length papers reporting RCTs that examined the clinical effects of acupuncture on patients in Japan published in or before 2019. We assessed the risk of bias (RoB), sample size, control setting, negative trial reporting, informed consent, ethics approval, trial registration, and adverse event reporting.

RESULTS

A total of 99 articles reporting 108 eligible RCTs were identified. The number of RCTs published in each decade was 1, 6, 9, 5, 40, and 47 in the 1960s, 1970s, 1980s, 1990s, 2000s, and 2010s, respectively. Quality assessment using the Cochrane RoB tool revealed that "sequence generation" improved in and after 1990 (73%-80% of RCTs were rated as "low") and "blinding of outcome assessors" slightly improved in and after the 2000s (40%-50% judged as "low"). However, "high" or "unclear" remained the dominant grades in other domains. Clinical trial registration and adverse events were reported only in 9% and 28% of the included RCTs even in the 2010s, respectively. A different acupuncture method or different point selection (e.g., deep vs. shallow insertion) was the most dominant control setting before 1990, while sham (or "placebo") needling and/or sham acupoints became the most dominant in the 2000s. The proportion of RCTs with positive results was 80% in the 2000s and 69% in the 2010s.

CONCLUSIONS

The quality of RCTs on acupuncture conducted in Japan did not appear to have improved over the decades except for "sequence generation." While the culture of submitting negative trial reports was prevalent in the Japanese acupuncture research milieu as late as the 1990s, the overall quality of the relevant trials needs to be further improved.

Do the CONSORT and STRICTA Checklists Improve the Reporting Quality of Acupuncture and Moxibustion Randomized Controlled Trials Published in Chinese Journals? A Systematic Review and Analysis of Trends

Background

We investigated whether there had been an improvement in the quality of reporting for randomised controlled trials of acupuncture and moxibustion published in Chinese journals. We compared the compliance rate for the quality of reporting following the publication of both the STRICTA and CONSORT recommendations in China.

Methods

Four Chinese databases were searched for RCTs of acupuncture from January 1978 through to December 2012. The CONSORT and STRICTA checklists were used to assess the quality of reporting. Data were collected using a standardised form. All included RCTs were divided into three distinct time periods based on the time that CONSORT and STRICTA were introduced in China, respectively. Pearson's χ2 test and/or Fisher's exact test were used to assess differences in reporting among three groups.

Principal Findings

A total of 1978 RCTs were identified. Although the percentage of all the items has increased over time with the introduction of CONSORT and STRICTA in China, the actual compliance in several important methodological components, including sample size calculation (0% vs. 0% vs. 1.2%, for pre-CONSORT and pre-STRICTA, post-CONSORT but pre-STRICTA, and post-CONSORT and post-STRICTA, respectively), randomisation sequence generation (1.4% vs. 15% vs. 26.3%) and implementation (0% vs. 0% vs. 1.3%), allocation concealment (0% vs. 1.4% vs. 4.9%), and blinding (0% vs. 5.7% vs. 9.1%), remains low. Moreover, no RCTs have reported the setting and context of treatment and no descriptions of the participating acupuncturists have been provided thus far.

Conclusions

Overall, the quality of the reporting of RCTs of acupuncture and moxibustion published in Chinese journals has improved since CONSORT and STRICTA were introduced in China, though the actual compliance rate of some important items were still low as of 2012. In the future, Chinese journals should enhance the adoption of the CONSORT and STRICTA statement to improve the reporting quality of the RCTs of acupuncture and moxibustion and to ensure the truth and reliability of the conclusions.

Randomised clinical trials on acupuncture in the Korean literature: bibliometric analysis and methodological quality

Objective

Acupuncture systematic reviewers have increasingly searched Chinese databases and journals to identify eligible randomised clinical trials (RCTs). However, reviewers have infrequently searched for eligible RCTs in Korean databases and journals. This study aimed to identify difficult to locate acupuncture RCTs in Korean databases and journals and to assess the characteristics and quality of the identified RCTs.

Methods

Eleven electronic databases and seven journals were searched up to December 2012. All RCTs using needle acupuncture were considered for inclusion. Key study characteristics were extracted and risk of bias was assessed using the Cochrane Collaboration tool.

Results

One hundred and forty-three publications met our inclusion criteria. Acupuncture RCTs in the Korean literature emerged in the mid-1990s and increased in the mid-2000s. Diverse methods of acupuncture were used, including some methods unique to Korea (eg, Saam acupuncture). The largest proportion of trials evaluated acupuncture for musculoskeletal conditions (27.3%). The mean sample size was 44.3±25.3 per trial. Random sequence generation methods were reported in 44.8% of the RCTs, whereas only 11.9% reported methods of allocation concealment. A low proportion of trials reported participant blinding (32.9%) and outcome assessment blinding (18.9%).

Conclusions

Korean acupuncture trials, many of which evaluate acupuncture styles unique to Korea, are typically omitted from systematic reviews of acupuncture, resulting in the potential for language bias. The development of this database of difficult to locate Korean trials, which includes English language translations of abstracts, will enable these trials of varying quality to be assessed for inclusion in future acupuncture systematic reviews.

Exploring the Evidence Base for Acupuncture in the Treatment of Ménière's Syndrome-A Systematic Review

Ménière's syndrome is a long-term, progressive disease that damages the balance and hearing parts of the inner ear. To address the paucity of information on which evidence-based treatment decisions should be made, a systematic review of acupuncture for Ménière's syndrome was undertaken. The method used was a systematic review of English and Chinese literature, from six databases for randomized, non-randomized and observational studies. All studies were critically appraised and a narrative approach to data synthesis was adopted. Twenty-seven studies were included in this review (9 in English and 18 in Chinese languages): three randomized controlled trials, three non-randomized controlled studies and four pre-test, post-test designs. All but one of the studies was conducted in China. The studies covered body acupuncture, ear acupuncture, scalp acupuncture, fluid acupuncture point injection and moxibustion. The studies were of varying quality. The weight of evidence, across all study types, is of beneficial effect from acupuncture, for those in an acute phase or those who have had Ménière's syndrome for a number of years. The review reinforces the importance of searching for studies from English and Chinese literature. The transferability of the findings from China to a Western context needs confirmation. Further research is also needed to clarify questions around the appropriate frequency and number of treatment/courses of acupuncture. The weight of evidence suggests a potential benefit of acupuncture for persons with Ménière's disease, including those in an acute phase and reinforces the importance of searching for published studies in the Chinese language.

A qualitative analysis of adolescents' experiences of active and sham Japanese-style acupuncture protocols administered in a clinical trial

INTRODUCTION

Acupuncture is a complex holistic intervention in which patient-practitioner relationships and healing changes occur in interactive, iterative ways. Qualitative research is one way to capture such complexity. This study sought to understand better the experiences of adolescents involved in acupuncture treatment.

MATERIALS AND METHODS

We included a qualitative substudy as part of a pilot randomized sham-controlled study of the use of Japanese acupuncture to treat chronic pelvic pain in adolescent girls. Seven (7) interviews were attained. Themes were double-coded and analyzed using qualitative analysis software.

RESULTS

Regardless of treatment arm, all subjects reported positive study-related changes, often attributed to positive qualities of the patient-practitioner relationship. Participants in both the sham and verum acupuncture treatment arms reported in the narratives that they were unsure of their study assignment. In contrast, the study's close-ended success of blinding question suggests that some participants were sure of their treatment allocation.

CONCLUSIONS

As we continue to study acupuncture using sham controls, we need a better understanding of the possible affects of sham treatments on both treatment outcomes and success of blinding. Qualitative research is one-way to explore subtle emergent changes in participants' experiences.

Safety of acupuncture practice in Japan: patient reactions, therapist negligence and error reduction strategies

Evidence-based approach on the safety of acupuncture had been lagging behind both in the West and the East, but reliable data based on some prospective surveys were published after the late 1990s. In the present article, we, focusing on 'Japanese acupuncture', review relevant case reports and prospective surveys on adverse events in Japan, assess the safety of acupuncture practice in this country, and suggest a strategy for reducing the therapists' error. Based on the prospective surveys, it seems reasonable to suppose that serious adverse events are rare in standard practice by adequately trained acupuncturists, regardless of countries or modes of practice. Almost all of adverse reactions commonly seen in acupuncture practice-such as fatigue, drowsiness, aggravation, minor bleeding, pain on insertion and subcutaneous hemorrhage-are mild and transient, although we should be cautious of secondary injury following drowsiness and needle fainting. After demonstrating that acupuncture is inherently safe, we have been focusing on how to reduce the risk of negligence in Japan, as well as educating acupuncturists more about safe depth of insertion and infection control. Incident reporting and feedback system is a useful strategy for reducing therapist errors such as forgotten needles. For the benefit of acupuncture patients in Japan, it is important to establish mandatory postgraduate clinical training and continued education system.

Factors That Influence the Applicability of Sham Needle in Acupuncture Trials

OBJECTIVES

In recent years the retractable type of sham needle has been anticipated to be a possible solution for masking patients in acupuncture research. However, this needle has been intended mainly for acupuncture-naïve subjects. The authors' goal in this study was to assess the validity of the retractable type of sham needle.

METHODS

The authors conducted two randomized, single-blind, crossover trials with acupuncture-experienced subjects. Different acupuncture points were used in each trial (a LI-4 trial and a BL-23 trial). The subjects received two sessions of different stimulations in each trial. A Park Sham Needle was used in one session, a genuine acupuncture needle in the other.

RESULTS

In the LI-4 trial, all of the 21 subjects (100%) felt penetration with the genuine needle, but only 7 of the 20 subjects (35%) felt a similar sensation with the sham needle (P=0.0002). Fifteen of the 21 subjects (71%) felt a dull sensation with the genuine needle, but only 4 of the 20 subjects (20%) felt a similar sensation with the sham needle (P=0.01). In the BL-23 trial, 14 of the 20 subjects (70%) felt penetration with the genuine needle and 10 of the 20 subjects (50%) felt "penetration" with the sham needle (P=0.39). Eight of the 20 subjects (40%) felt a dull sensation with the genuine needle and 2 of the 20 subjects (10%) did with the sham needle (P=0.109).

CONCLUSIONS

Potential factors that influence the applicability of "placebo" needling include not only inter-tester variability but also the patient's knowledge and experience of acupuncture, acupuncture point selection, the visual impact of needling, and so on.

Acupuncture--a critical analysis

Even though widely used in today's clinical practice, acupuncture has remained a controversial subject. Many reviews are currently available but most lack a critical stance and some are overtly promotional. The aim of this overview is to provide a balanced, critical analysis of the existing evidence. Some of the original concepts of traditional acupuncture are not supported by good scientific evidence. Several plausible theories attempt to explain how acupuncture works but none are proved beyond doubt. The clinical effectiveness of acupuncture continues to attract controversy. Many controlled clinical trials and numerous systematic reviews of these studies have been published. Considerable problems are encountered when interpreting these data. Heterogeneity is a significant drawback of both clinical trials and systematic reviews. Some of the controversies may be resolved through the use of the new 'placebo needles' which enable researchers to adequately control for placebo effects of acupuncture. The majority of studies using such devices fails to show effects beyond a placebo response. Acupuncture has been associated with serious adverse events but most large-scale studies suggest that these are probably rare. Nonserious adverse effects occur in 7-11% of all patients. In conclusion, acupuncture remains steeped in controversy. Some findings are encouraging but others suggest that its clinical effects mainly depend on a placebo response.