Open science practices in traditional, complementary, and integrative medicine research: A path to enhanced transparency and collaboration

This educational article explores the convergence of open science practices and traditional, complementary, and integrative medicine (TCIM), shedding light on the potential benefits and challenges of open science for the development, dissemination, and implementation of evidence-based TCIM. We emphasize the transformative shift in medical science towards open and collaborative practices, highlighting the limited application of open science in TCIM research despite its growing acceptance among patients. We define open science practices and discuss those that are applicable to TCIM, including: study registration; reporting guidelines; data, code and material sharing; preprinting; publishing open access; and reproducibility/replication studies. We explore the benefits of open science in TCIM, spanning improved research quality, increased public trust, accelerated innovation, and enhanced evidence-based decision-making. We also acknowledge challenges such as data privacy concerns, limited resources, and resistance to cultural change. We propose strategies to overcome these challenges, including ethical guidelines, education programs, funding advocacy, interdisciplinary dialogue, and patient engagement. Looking to the future, we envision the maturation of open science in TCIM, the development of TCIM-specific guidelines for open science practices, advancements in data sharing platforms, the integration of open data and artificial intelligence in TCIM research, and changes in the context of policy and regulation. We foresee a future where open science in TCIM leads to a better evidence base, informed decision-making, interdisciplinary collaboration, and transformative impacts on healthcare and research methodologies, highlighting the promising synergy between open science and TCIM for holistic, evidence-based healthcare solutions.

Zinc for prevention and treatment of the common cold

BACKGROUND

The common cold is an acute, self-limiting viral respiratory illness. Symptoms include nasal congestion and mucus discharge, sneezing, sore throat, cough, and general malaise. Given the frequency of colds, they are a public health burden and a significant cause of lost work productivity and school absenteeism. There are no established interventions to prevent colds or shorten their duration. However, zinc supplements are commonly recommended and taken for this purpose.

OBJECTIVES

To assess the effectiveness and safety of zinc for the prevention and treatment of the common cold.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, CINAHL, and LILACS to 22 May 2023, and searched Web of Science Core Collection and two trials registries to 14 June 2023. We also used reference checking, citation searching, and contact with study authors to identify additional studies.

SELECTION CRITERIA

We included randomised controlled trials (RCTs) in children or adults that tested any form of zinc against placebo to prevent or treat the common cold or upper respiratory infection (URTI). We excluded zinc interventions in which zinc was combined with other minerals, vitamins, or herbs (e.g. a multivitamin, or mineral supplement containing zinc).

DATA COLLECTION AND ANALYSIS

We used the Cochrane risk of bias tool to assess risks of bias, and GRADE to assess the certainty of the evidence. We independently extracted data. When necessary, we contacted study authors for additional information. We assessed zinc (type and route) with placebo in the prevention and treatment of the common cold. Primary outcomes included the proportion of participants developing colds (for analyses of prevention trials only), duration of cold (measured in days from start to resolution of the cold), adverse events potentially due to zinc supplements (e.g. unpleasant taste, loss of smell, vomiting, stomach cramps, and diarrhoea), and adverse events considered to be potential complications of the common cold (e.g. respiratory bacterial infections).

MAIN RESULTS

We included 34 studies (15 prevention, 19 treatment) involving 8526 participants. Twenty-two studies were conducted on adults and 12 studies were conducted on children. Most trials were conducted in the USA (n = 18), followed by India, Indonesia, Iran, and Turkey (two studies each), and Australia, Burkina Faso, Colombia, Denmark, Finland, Tanzania, Thailand, and the UK (one study each). The 15 prevention studies identified the condition as either common cold (n = 8) or URTI (n = 7). However, almost all therapeutic studies (17/19) focused on the common cold. Most studies (17/34) evaluated the effectiveness of zinc administered as lozenges (3 prevention; 14 treatment) in acetate, gluconate, and orotate forms; gluconate lozenges were the most common (9/17). Zinc gluconate was given at doses between 45 and 276 mg/day for between 4.5 and 21 days. Five (5/17) lozenge studies gave acetate lozenges and two (2/17) gave both acetate and gluconate lozenges. One (1/17) lozenge study administered intranasal (gluconate) and lozenge (orotate) zinc in tandem for cold treatment. Of the 17/34 studies that did not use lozenges, 1/17 gave capsules, 3/17 administered dissolved powders, 5/17 gave tablets, 4/17 used syrups, and 4/17 used intranasal administration. Most studies were at unclear or high risk of bias in at least one domain. There may be little or no reduction in the risk of developing a cold with zinc compared to placebo (risk ratio (RR) 0.93, 95% CI 0.85 to 1.01; I2 = 20%; 9 studies, 1449 participants; low-certainty evidence). There may be little or no reduction in the mean number of colds that occur over five to 18 months of follow-up (mean difference (MD) -0.90, 95% CI -1.93 to 0.12; I2 = 96%; 2 studies, 1284 participants; low-certainty evidence). When colds occur, there is probably little or no difference in the duration of colds in days (MD -0.63, 95% CI -1.29 to 0.04; I² = 77%; 3 studies, 740 participants; moderate-certainty evidence), and there may be little or no difference in global symptom severity (standardised mean difference (SMD) 0.04, 95% CI -0.35 to 0.43; I² = 0%; 2 studies, 101 participants; low-certainty evidence). When zinc is used for cold treatment, there may be a reduction in the mean duration of the cold in days (MD -2.37, 95% CI -4.21 to -0.53; I² = 97%; 8 studies, 972 participants; low-certainty evidence), although it is uncertain whether there is a reduction in the risk of having an ongoing cold at the end of follow-up (RR 0.52, 95% CI 0.21 to 1.27; I² = 65%; 5 studies, 357 participants; very low-certainty evidence), or global symptom severity (SMD -0.03, 95% CI -0.56 to 0.50; I² = 78%; 2 studies, 261 participants; very low-certainty evidence), and there may be little or no difference in the risk of a change in global symptom severity (RR 1.02, 95% CI 0.85 to 1.23; 1 study, 114 participants; low-certainty evidence). Thirty-one studies reported non-serious adverse events (2422 participants). It is uncertain whether there is a difference in the risk of adverse events with zinc used for cold prevention (RR 1.11, 95% CI 0.84 to 1.47; I2 = 0%; 7 studies, 1517 participants; very low-certainty evidence) or an increase in the risk of serious adverse events (RR 1.67, 95% CI 0.78 to 3.57; I2 = 0%; 3 studies, 1563 participants; low-certainty evidence). There is probably an increase in the risk of non-serious adverse events when zinc is used for cold treatment (RR 1.34, 95% CI 1.15 to 1.55; I2 = 44%; 2084 participants, 16 studies; moderate-certainty evidence); no treatment study provided information on serious adverse events. No study provided clear information about adverse events considered to be potential complications of the common cold.

AUTHORS' CONCLUSIONS

The findings suggest that zinc supplementation may have little or no effect on the prevention of colds but may reduce the duration of ongoing colds, with an increase in non-serious adverse events. Overall, there was wide variation in interventions (including concomitant therapy) and outcomes across the studies, as well as incomplete reporting of several domains, which should be considered when making conclusions about the efficacy of zinc for the common cold.

Methodological challenges in systematic reviews of mHealth interventions: Survey and consensus-based recommendations

OBJECTIVE

Mobile Health (mHealth) refers to using mobile devices to support health. This study aimed to identify specific methodological challenges in systematic reviews (SRs) of mHealth interventions and to develop guidance for addressing selected challenges.

STUDY DESIGN AND SETTING

Two-phase participatory research project. First, we sent an online survey to corresponding authors of SRs of mHealth interventions. On a five-category scale, survey respondents rated how challenging they found 24 methodological aspects in SRs of mHealth interventions compared to non-mHealth intervention SRs. Second, a subset of survey respondents participated in an online workshop to discuss recommendations to address the most challenging methodological aspects identified in the survey. Finally, consensus-based recommendations were developed based on the workshop discussion and subsequent interaction via email with the workshop participants and two external mHealth SR authors.

RESULTS

We contacted 953 corresponding authors of mHealth intervention SRs, of whom 50 (5 %) completed the survey. All the respondents identified at least one methodological aspect as more or much more challenging in mHealth intervention SRs than in non-mHealth SRs. A median of 11 (IQR 7.25-15) out of 24 aspects (46 %) were rated as more or much more challenging. Those most frequently reported were: defining intervention intensity and components (85 %), extracting mHealth intervention details (71 %), dealing with dynamic research with evolving interventions (70 %), assessing intervention integrity (69 %), defining the intervention (66 %) and maintaining an updated review (65 %). Eleven survey respondents participated in the workshop (five had authored more than three mHealth SRs). Eighteen consensus-based recommendations were developed to address issues related to mHealth intervention integrity and to keep mHealth SRs up to date.

CONCLUSION

mHealth SRs present specific methodological challenges compared to non-mHealth interventions, particularly related to intervention integrity and keeping SRs current. Our recommendations for addressing these challenges can improve mHealth SRs.

Determining the Completeness of Registration and Reporting in Systematic Reviews of Yoga for Health

Introduction: Yoga is a mind-body practice often used to improve health. Systematic reviews (SRs) of randomized controlled trials on yoga for health are foundational to evidence-based yoga interventions and require rigorous and transparent methods, including preparation of a protocol (e.g., PROSPERO) and following SR reporting guidelines (e.g., Preferred Reporting Items for Systematic Reviews and Meta-Analyses [PRISMA]). Objective: To evaluate the availability of protocols and the completeness of reporting for SRs on yoga for health. Methods: We used a previously assembled database of SRs focused on the use of yoga for health. The authors independently extracted data on protocol availability, PROSPERO registration, and reporting for each PRISMA 2009 checklist item. Discrepancies were discussed or referred to a third author. We used Stata 10 software to produce descriptive statistics and tests for relationships between registration, reporting, and publication year, country, and journal type. Results: We included 147 reviews published between 2005 and 2019. The most common first author country was the United States or Germany (total 67/147; 46%), and the most common journal type was specialty journals (71/147; 48%). Most reviews (116/147; 79%) made no mention of a protocol or registration, and only 15/147 (10%) reviews were linked to an accessible protocol or registration. Most SRs published in 2010 or later mentioned or cited PRISMA (97/139; 70%), and individual PRISMA items were addressed between 10% and 100% of the time. PRISMA reporting improved; over time, but there was no relationship with country or journal type. Discussion: This study identifies a need for increased SR registration for yoga research. The assessment of PRISMA reporting did not evaluate the comprehensiveness with which each item was reported, and while trends are encouraging, there is likely room for improvement. We recommend registering all yoga SRs and following updated PRISMA and recent yoga-specific guidelines for reporting. This may increase transparency, minimize bias, and produce high-quality data to inform evidence-based yoga practices.

The effect of sham acupuncture can differ depending on the points needled in knee osteoarthritis: A systematic review and network meta-analysis

Objective

In sham acupuncture-controlled acupuncture clinical trials, although sham acupuncture techniques are different from those of verum acupuncture, the same acupuncture points are often used for verum and sham acupuncture, raising the question of whether sham acupuncture is an appropriate placebo. We aimed to examine the effects of sham and verum acupuncture according to the points needled (same or different between verum and sham acupuncture) in knee osteoarthritis.

Methods

Ten databases were searched to find randomized controlled clinical trials (RCTs) assessing the effects of verum acupuncture with sham acupuncture or waiting lists on knee osteoarthritis. Sham acupuncture was classified as using the same acupuncture points as those in verum acupuncture (SATV) or using sham points (SATS). A frequentist network meta-analysis (NMA) was conducted, and the certainty of evidence was evaluated.

Results

A total of 10 RCTs involving 1628 participants were included. Verum acupuncture was significantly superior to SATS but not different from SATV in terms of pain reduction. Additionally, SATV was significantly superior to the waiting list. For physical function, no difference were found between verum acupuncture, SATV, and SATS. The certainty of evidence was low to moderate.

Conclusion

For knee osteoarthritis, the pain reduction effect of acupuncture may differ according to the needling points of sham acupuncture, and the control group should be established according to the specific aim of the study design and treatment mechanism.

Mobile health (m-health) smartphone interventions for adolescents and adults with overweight or obesity

BACKGROUND

Obesity is considered to be a risk factor for various diseases, and its incidence has tripled worldwide since 1975. In addition to potentially being at risk for adverse health outcomes, people with overweight or obesity are often stigmatised. Behaviour change interventions are increasingly delivered as mobile health (m-health) interventions, using smartphone apps and wearables. They are believed to support healthy behaviours at the individual level in a low-threshold manner.

OBJECTIVES

To assess the effects of integrated smartphone applications for adolescents and adults with overweight or obesity.

SEARCH METHODS

We searched CENTRAL, MEDLINE, PsycINFO, CINAHL, and LILACS, as well as the trials registers ClinicalTrials.gov and World Health Organization International Clinical Trials Registry Platform on 2 October 2023 (date of last search for all databases). We placed no restrictions on the language of publication.

SELECTION CRITERIA

Participants were adolescents and adults with overweight or obesity. Eligible interventions were integrated smartphone apps using at least two behaviour change techniques. The intervention could target physical activity, cardiorespiratory fitness, weight loss, healthy diet, or self-efficacy. Comparators included no or minimal intervention (NMI), a different smartphone app, personal coaching, or usual care. Eligible studies were randomised controlled trials of any duration with a follow-up of at least three months.

DATA COLLECTION AND ANALYSIS

We used standard Cochrane methodology and the RoB 2 tool. Important outcomes were physical activity, body mass index (BMI) and weight, health-related quality of life, self-efficacy, well-being, change in dietary behaviour, and adverse events. We focused on presenting studies with medium- (6 to < 12 months) and long-term (≥ 12 months) outcomes in our summary of findings table, following recommendations in the core outcome set for behavioural weight management interventions.

MAIN RESULTS

We included 18 studies with 2703 participants. Interventions lasted from 2 to 24 months. The mean BMI in adults ranged from 27 to 50, and the median BMI z-score in adolescents ranged from 2.2 to 2.5. Smartphone app versus no or minimal intervention Thirteen studies compared a smartphone app versus NMI in adults; no studies were available for adolescents. The comparator comprised minimal health advice, handouts, food diaries, smartphone apps unrelated to weight loss, and waiting list. Measures of physical activity: at 12 months' follow-up, a smartphone app compared to NMI probably reduces moderate to vigorous physical activity (MVPA) slightly (mean difference (MD) -28.9 min/week (95% confidence interval (CI) -85.9 to 28; 1 study, 650 participants; moderate-certainty evidence)). We are very uncertain about the results of estimated energy expenditure and cardiorespiratory fitness at eight months' follow-up. A smartphone app compared with NMI probably results in little to no difference in changes in total activity time at 12 months' follow-up and leisure time physical activity at 24 months' follow-up. Anthropometric measures: a smartphone app compared with NMI may reduce BMI (MD of BMI change -2.6 kg/m2, 95% CI -6 to 0.8; 2 studies, 146 participants; very low-certainty evidence) at six to eight months' follow-up, but the evidence is very uncertain. At 12 months' follow-up, a smartphone app probably resulted in little to no difference in BMI change (MD -0.1 kg/m2, 95% CI -0.4 to 0.3; 1 study; 650 participants; moderate-certainty evidence). A smartphone app compared with NMI may result in little to no difference in body weight change (MD -2.5 kg, 95% CI -6.8 to 1.7; 3 studies, 1044 participants; low-certainty evidence) at 12 months' follow-up. At 24 months' follow-up, a smartphone app probably resulted in little to no difference in body weight change (MD 0.7 kg, 95% CI -1.2 to 2.6; 1 study, 245 participants; moderate-certainty evidence). A smartphone app compared with NMI may result in little to no difference in self-efficacy for a physical activity score at eight months' follow-up, but the results are very uncertain. A smartphone app probably results in little to no difference in quality of life and well-being at 12 months (moderate-certainty evidence) and in little to no difference in various measures used to inform dietary behaviour at 12 and 24 months' follow-up. We are very uncertain about adverse events, which were only reported narratively in two studies (very low-certainty evidence). Smartphone app versus another smartphone app Two studies compared different versions of the same app in adults, showing no or minimal differences in outcomes. One study in adults compared two different apps (calorie counting versus ketogenic diet) and suggested a slight reduction in body weight at six months in favour of the ketogenic diet app. No studies were available for adolescents. Smartphone app versus personal coaching Only one study compared a smartphone app with personal coaching in adults, presenting data at three months. Two studies compared these interventions in adolescents. A smartphone app resulted in little to no difference in BMI z-score compared to personal coaching at six months' follow-up (MD 0, 95% CI -0.2 to 0.2; 1 study; 107 participants). Smartphone app versus usual care Only one study compared an app with usual care in adults but only reported data at three months on participant satisfaction. No studies were available for adolescents. We identified 34 ongoing studies.

AUTHORS' CONCLUSIONS

The available evidence is limited and does not demonstrate a clear benefit of smartphone applications as interventions for adolescents or adults with overweight or obesity. While the number of studies is growing, the evidence remains incomplete due to the high variability of the apps' features, content and components, which complicates direct comparisons and assessment of their effectiveness. Comparisons with either no or minimal intervention or personal coaching show minor effects, which are mostly not clinically significant. Minimal data for adolescents also warrants further research. Evidence is also scarce for low- and middle-income countries as well as for people with different socio-economic and cultural backgrounds. The 34 ongoing studies suggest sustained interest in the topic, with new evidence expected to emerge within the next two years. In practice, clinicians and healthcare practitioners should carefully consider the potential benefits, limitations, and evolving research when recommending smartphone apps to adolescents and adults with overweight or obesity.

Different Outcomes According to Needling Point Location Used in Sham Acupuncture for Cancer-Related Pain: A Systematic Review and Network Meta-Analysis

Numerous acupuncture studies have been conducted on cancer-related pain; however, its efficacy compared to sham acupuncture remains controversial. We confirmed whether the outcome of acupuncture differs according to the needling points of sham acupuncture for cancer-related pain. We searched 10 databases on 23 May 2023 to screen acupuncture trials using sham acupuncture or waiting list as controls for cancer-related pain. Sham acupuncture was classified into two types, depending on whether the needling was applied at the same locations as verum acupuncture (SATV) or not (SATS). A network meta-analysis (NMA) was performed on the basis of a frequentist approach to assess pain severity. Eight studies (n = 574 participants) were included in the review, seven of which (n = 527 participants) were included in the NMA. The pain severity was not significantly different between SATV and verum acupuncture, but verum acupuncture significantly improved pain severity compared to SATS. The risk of bias affecting the comparisons between the verum and sham acupuncture was generally low. Previous acupuncture trials for cancer-related pain showed differing outcomes of sham and verum acupuncture, depending on the needling points of sham acupuncture. The application of SATV cannot be considered a true placebo, which leads to an underestimation of the efficacy of verum acupuncture.

The Brief History of Complementary, Alternative, and Integrative Medicine Terminology and the Development and Creation of an Operational Definition

The definition of complementary, alternative, and integrative medicine (CAIM) remains dynamic and complex despite a steady increase in the popularity/usage of CAIM therapies across the globe. A lack of consistency in how these terms are defined remains a challenge for researchers, clinicians, and national and international organizations (e.g., World Health Organization, National Center for Complementary and Integrative Health) alike. In the present article, we provide a brief history of the use of these terminologies, and then outline the process we took to develop and create an operational definition of complementary, alternative, and integrative medicine. Our operational definition is the first to be informed by a systematic search of four quality-assessed information resource types, ultimately yielding 604 unique CAIM therapies. We then developed a single search string for the most common bibliographic databases using the finalized operational definition list of CAIM therapies. These CAIM therapies were searched against the Therapeutic Research Center's "Natural Medicines" database for all 604 therapies, whereby each item's scientific name and/or synonym was included as a keyword or phrase in the search string. While the current definition is not without limitations and ongoing debates still surround the field, this work is arguably a steppingstone towards enabling increased collaboration and communication amongst healthcare clinicians, researchers, and the public. This operational definition provides a foundation for developing well-coordinated research efforts that will assist in the acceptance and understanding of this field, while also focusing on adopting knowledge translation techniques and efforts for further research advancement and use.

Characteristics of bibliometric analyses of the complementary, alternative, and integrative medicine literature: A scoping review protocol

Background: There is a growing body of literature on complementary, alternative, and integrative medicine (CAIM), which offers a holistic approach to health and the maintenance of social and cultural values. Bibliometric analyses are an increasingly commonly used method employing quantitative statistical techniques to understand trends in a particular scientific field. The objective of this scoping review is to investigate the quantity and characteristics of evidence in relation to bibliometric analyses of CAIM literature. Methods: The following bibliographic databases will be searched: MEDLINE, EMBASE, PsycINFO, AMED, CINAHL, Scopus and Web of Science. Studies published in English, conducting any type of bibliometric analysis involving any CAIM therapies, as detailed by an operational definition of CAIM adopted by Cochrane Complementary Medicine, will be included. Conference abstracts and study protocols will be excluded. The following variables will be extracted from included studies: title, author, year, country, study objective, type of CAIM, health condition targeted, databases searched in the bibliometric analysis, the type of bibliometric variables assessed, how bibliometric information was reported, main findings, conclusions, and limitations. Findings will be summarized narratively, as well as in tabular and graphical format. Conclusions: To the best of our knowledge, this scoping review will be the first to investigate the characteristics of evidence in relation to bibliometric analyses on CAIM literature. The findings of this review may be useful to identify variations in the objectives, methods, and results of bibliometric analyses of CAIM research literature.

Needling Point Location Used in Sham Acupuncture for Chronic Nonspecific Low Back Pain: A Systematic Review and Network Meta-Analysis

Importance

When sham acupuncture is set as a control in evaluating acupuncture, the sham needling technique is usually different from acupuncture. However, the sham procedure is conducted either at the same points that are used for the acupuncture group or at nonindicated points.

Objective

To assess whether the outcome of sham acupuncture varies according to the needling points in sham-controlled trials of acupuncture for chronic nonspecific low back pain (CLBP) as an example.

Data sources

Searches of MEDLINE, Embase, Cochrane Central Register of Controlled Trials, and the Allied and Complementary Medicine Database were conducted on February 12, 2023.

Study selection

Randomized clinical trials (RCTs) assessing the outcomes of acupuncture in sham acupuncture-controlled or waiting list-controlled trials on CLBP were included.

Data extraction and synthesis

Two researchers independently extracted data on study characteristics and outcomes and assessed quality. Sham acupuncture was classified according to whether it was conducted at the same acupuncture points used in the acupuncture group, referred to as sham acupuncture therapy (verum) (SATV) or at different points, referred to as sham acupuncture therapy (sham) (SATS). Clinical similarity, transitivity, and consistency tests were conducted, followed by a random-effects frequentist network meta-analysis (NMA).

Main outcomes and measures

The primary outcome was pain, and the secondary outcome was back-specific function. The first assessment after the end of treatment was chosen for analysis. Effect sizes are reported as standardized mean differences (SMD) with 95% CIs. The risk of bias was assessed using the Cochrane risk of bias tool, and the certainty of evidence for findings was evaluated using the Grading of Recommendations Assessment, Development, and Evaluation approach.

Results

Ten RCTs involving 4379 participants were included. In comparison with SATS, acupuncture was significantly associated with improvements in both pain (SMD, -0.33; 95% CI, -0.52 to -0.15) and function outcomes (SMD, -0.13; 95% CI, -0.25 to -0.02); however, there were no differences between acupuncture and SATV. In comparison with SATS, SATV was significantly associated with better pain (SMD, -0.45; 95% CI, -0.88 to -0.03) and function outcomes (SMD, -0.30; 95% CI, -0.56 to -0.05). The risk of bias that could affect the interpretation of the results was usually low, and the certainty of evidence was moderate to low.

Conclusions and relevance

In this NMA, sham acupuncture needling at the same points as those in acupuncture was not a true placebo control for assessing the efficacy of acupuncture for CLBP and might underestimate the outcome of acupuncture in clinical settings.

Comparative effectiveness of acupuncture in sham-controlled trials for knee osteoarthritis: A systematic review and network meta-analysis

Objectives

Although many trials have assessed the effect of acupuncture on knee osteoarthritis (KOA), its efficacy remains controversial. Sham acupuncture techniques are regarded as representative control interventions in acupuncture trials and sometimes incorporate the use of sham devices (base units) to support a non-penetrating needle. To achieve successful blinding, these trials also use acupuncture base units in the verum acupuncture group. Base units are not used in real-world clinical settings. We aimed to assess the effect sizes of verum and sham acupuncture for KOA in sham-controlled trials with or without base units.

Methods

A total of 10 electronic databases for randomized controlled trials (RCTs) comparing the efficacy of verum manual acupuncture and sham acupuncture for the treatment of KOA were searched for articles published before April 12, 2022. The primary outcome was pain intensity, and the secondary outcomes included physical function. The first assessment after the end of treatment was chosen for analysis. Effect sizes are reported as standardized mean differences (SMDs) with 95% confidence intervals (95% CIs). The risk of bias was assessed using the Cochrane risk of bias tool, and publication bias was evaluated using a funnel plot and Egger's test. The quality of evidence for estimates was evaluated using the Grading of Recommendations, Assessment, Development, and Evaluations (GRADE) approach.

Results

Fifteen RCTs were included. There was generally a low risk of bias except for the difficulty in blinding acupuncture therapists (performance bias). Compared to verum acupuncture in sham-controlled trials using base units, verum acupuncture in sham-controlled trials without base units was more effective for improving pain (SMD -0.56, 95% CI -1.09 to -0.03) and function (SMD -0.73, 95% CI -1.36 to -0.10) in KOA. The quality of evidence for network estimates was moderate to low due to the risk of bias and imprecision.

Conclusion

These findings suggest that verum acupuncture in different types of sham-controlled trials has different effect sizes for KOA. Because base units are not used in clinical settings, the results of verum acupuncture in sham-controlled trials with base units need to be interpreted carefully.

Systematic review registration

https://www.researchregistry.com/browse-the-registry#registryofsystematicreviewsmeta-analyses/registryofsystematicreviewsmeta-analysesdetails/6269f962606c5e001fd8790c/, identifier reviewregistry1351.