Rating of Included Trials on the Efficacy-Effectiveness Spectrum: development of a new tool for systematic reviews

Biofield therapies: Guidelines for reporting clinical trials

A set of guidelines has been developed to help improve reporting of clinical trials of biofield therapies. The need for enhanced transparency when reporting trials of this family of integrative health practices, e.g., External Qigong, Healing Touch, Reiki and Therapeutic Touch, has been advocated in systematic reviews of these studies. The guidelines, called Biofield Therapies: Reporting Evidence Guidelines (BiFi REGs), supplement CONSORT 2010 by including details of the intervention protocols relevant to biofield therapy trials. BiFi REGs evolved through a draft document created by a core group, two rounds of a Delphi process with an international group of subject matter experts and two panels, meeting via Zoom, which included editors of complementary and integrative medicine journals. BiFi REGs comprises a 15-item Intervention checklist. Modifications of two other CONSORT topic areas are also proposed to enhance their relevance to trials of biofield therapies. Included for each item are an explanation, and exemplars of reporting from peer-reviewed published reports of biofield therapy trials. When used in conjunction with all other items from CONSORT 2010, we anticipate that BiFi REGs will expedite the peer review process for biofield therapy trials, facilitate attempts at trial replication and help to inform decision-making in the clinical practice of biofield therapies.

Best practices for the dissemination and implementation of neuromuscular training injury prevention warm-ups in youth team sport: a systematic review

OBJECTIVE

To evaluate best practices for neuromuscular training (NMT) injury prevention warm-up programme dissemination and implementation (D&I) in youth team sports, including characteristics, contextual predictors and D&I strategy effectiveness.

DESIGN

Systematic review.

DATA SOURCES

Seven databases were searched.

ELIGIBILITY

The literature search followed Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.

INCLUSION CRITERIA

participation in a team sport, ≥70% youth participants (<19 years), D&I outcomes with/without NMT-related D&I strategies. The risk of bias was assessed using the Downs & Black checklist.

RESULTS

Of 8334 identified papers, 68 were included. Sport participants included boys, girls and coaches. Top sports were soccer, basketball and rugby. Study designs included randomised controlled trials (RCTs) (29.4%), cross-sectional (23.5%) and quasi-experimental studies (13.2%). The median Downs & Black score was 14/33. Injury prevention effectiveness (vs efficacy) was rarely (8.3%) prioritised across the RCTs evaluating NMT programmes. Two RCTs (2.9%) used Type 2/3 hybrid approaches to investigate D&I strategies. 19 studies (31.6%) used D&I frameworks/models. Top barriers were time restrictions, lack of buy-in/support and limited benefit awareness. Top facilitators were comprehensive workshops and resource accessibility. Common D&I strategies included Workshops with supplementary Resources (WR; n=24) and Workshops with Resources plus in-season Personnel support (WRP; n=14). WR (70%) and WRP (64%) were similar in potential D&I effect. WR and WRP had similar injury reduction (36-72%) with higher adherence showing greater effectiveness.

CONCLUSIONS

Workshops including supplementary resources supported the success of NMT programme implementation, however, few studies examined effectiveness. High-quality D&I studies are needed to optimise the translation of NMT programmes into routine practice in youth sport.

Enhancing Lifestyles in the Metabolic syndrome (ELM) multisite behavioral efficacy trial. Design and baseline cohort

BACKGROUND

Prevalence of metabolic syndrome (MetS) increased from one-quarter to one-third of the U.S. adult population over 8 years and is spreading to young adults and Asian and Hispanic Americans. Diagnosed when >3 out of 5 cardiometabolic risk factors are present, there is widespread agreement that its fundamental roots are in a lifestyle characterized by poor dietary quality and physical inactivity. Past lifestyle trials for MetS produce benefits that have limited sustainability, suggesting the need for new treatment approaches.

METHODS

This is the design and baseline cohort of the Enhancing Lifestyles in the Metabolic Syndrome (ELM) multi-site trial. The trial tests the hypothesis that a habit-based lifestyle treatment offered over 6 months, followed by 18 monthly maintenance contacts, can produce 4 new diet, physical activity, and mindfulness habits and, if so, sustained MetS remission. The design is an individually randomized, partially clustered group treatment trial of 618 participants with the MetS recruited from 5 sites in the U.S. and randomized to a small group lifestyle treatment or an enhanced standard of care education comparator. The primary outcome is MetS remission at 24 months. Secondary outcomes compare arms at 6, 15, and 24 months on MetS components, lifestyle targets, weight, body mass index, hemoglobin A1c, LDL cholesterol, medications, quality of life, psychosocial factors, and cost-effectiveness.

RESULTS

The cohort of 618 participants was recruited by screening 14,817 over 2.5 years (screening to enrollment ratio 24:1). Recruitment exceeded the target of 600 despite 2 COVID-19 pauses. The mean age was 55.5 years, 24.3% were male, 25.5% were a racial minority, 9.7% identified as Hispanic, and 83.0% were classified as obese (body mass index >30). The most common MetS components were abdominal obesity (97.7%) and elevated blood pressure or antihypertensive medication (86.2%).

CONCLUSIONS

The geographic, sociodemographic, and clinical diversity of the cohort, combined with rigorous behavioral efficacy trial methods, will provide a conclusive answer to the question of whether this habit-based lifestyle program can produce sustained 24-month remission of the MetS and thereby help to curb a significant and growing public health problem.

The majority of clinical trials assessing mobilization and manipulation for neck pain lack a pragmatic approach: a systematic review of 174 trials

BACKGROUND

Disorders of the cervical spine are some of the costliest musculoskeletal conditions to manage globally. Joint mobilization and manipulation have been shown to be an effective treatment for neck pain. However, the generalizability and clinical translation depends on the nature of the trial designs that inform its use. The extent to which randomized control trials (RCTs) assessing manual therapy treatments for cervical spine disorders fall on the efficacy (explanatory) -effectiveness (pragmatic) spectrum often informs how the findings are translated into clinical practice.

OBJECTIVE

The aim of this systematic review was to determine where RCTs of manual therapy for neck disorders fall on the efficacy-effectiveness spectrum.

METHODS

A search of three electronic databases including PubMed, CINAHL, and CENTRAL were completed for trials published from inception to May 2023. RCTs in which joint mobilization or manipulation were used to treat cervical spine disorders were assessed on the effectiveness-efficacy spectrum using the Rating of Included Trials on the Efficacy-Effectiveness Spectrum (RITES) tool and risk of bias using the Revised Cochrane Risk of Bias tool.

RESULTS

A total of 174 trials met eligibility. RITES domain two trial setting (71.3% vs 16.1%), domain three flexibility of intervention(s) (62.1% vs 23%), and domain four clinical relevance of experimental and comparison intervention(s) (51.7% vs 29.3%) all favored efficacy over effectiveness. Domain one participant characteristic(s) had a slightly greater emphasis on effectiveness compared to efficacy (36.8% vs 44.8%). Most studies (96%) had at least some risk of bias.

CONCLUSION

Over half of the RCTs assessing the treatment effect of joint mobilization and manipulation for neck pain favor efficacy (explanatory) over effectiveness (pragmatic) designs. Future RCTs on this topic should consider a greater emphasis on pragmatic trial design components in order to better reflect real-world translation to clinical practice.

Consensus on the definition and assessment of external validity of randomized controlled trials: A Delphi study

External validity is an important parameter that needs to be considered for decision making in health research, but no widely accepted measurement tool for the assessment of external validity of randomized controlled trials (RCTs) exists. One of the most limiting factors for creating such a tool is probably the substantial heterogeneity and lack of consensus in this field. The objective of this study was to reach consensus on a definition of external validity and on criteria to assess the external validity of RCTs included in systematic reviews. A three-round online Delphi study was conducted. The development of the Delphi survey was based on findings from a previous systematic review. Potential panelists were identified through a comprehensive web search. Consensus was reached when at least 67% of the panelists agreed to a proposal. Eighty-four panelists from different countries and various disciplines participated in at least one round of this study. Consensus was reached on the definition of external validity ("External validity is the extent to which results of trials provide an acceptable basis for generalization to other circumstances such as variations in populations, settings, interventions, outcomes, or other relevant contextual factors"), and on 14 criteria to assess the external validity of RCTs in systematic reviews. The results of this Delphi study provide a consensus-based reference standard for future tool development. Future research should focus on adapting, pilot testing, and validating these criteria to develop measurement tools for the assessment of external validity.

Biofield therapies: Guidelines for reporting clinical trials

A set of guidelines has been developed to help improve reporting of clinical trials of biofield therapies. The need for enhanced transparency when reporting trials of this family of integrative health practices, e.g., External Qigong, Healing Touch, Reiki and Therapeutic Touch, has been advocated in systematic reviews of these studies. The guidelines, called Biofield Therapies: Reporting Evidence Guidelines (BiFi REGs), supplement CONSORT 2010 by including details of the intervention protocols relevant to biofield therapy trials. BiFi REGs evolved through a draft document created by a core group, two rounds of a Delphi process with an international group of subject matter experts and two panels, meeting via Zoom, which included editors of complementary and integrative medicine journals. BiFi REGs comprises a 15-item Intervention checklist. Modifications of two other CONSORT topic areas are also proposed to enhance their relevance to trials of biofield therapies. Included for each item are an explanation, and exemplars of reporting from peer-reviewed published reports of biofield therapy trials. When used in conjunction with all other items from CONSORT 2010, we anticipate that BiFi REGs will expedite the peer review process for biofield therapy trials, facilitate attempts at trial replication and help to inform decision-making in the clinical practice of biofield therapies.

Biofield Therapies: Guidelines for Reporting Clinical Trials

Highlights Guidelines have been created to improve the reporting of clinical trials of biofield therapies, e.g. External Qigong, Healing Touch, Reiki, and Therapeutic Touch. Appropriate use of these guidelines is likely to strengthen the evidence base for biofield therapies as well as increase their usage as stand-alone practices and as complementary therapies within mainstream healthcare.

Trials Investigating Exercise for Low Back Pain Lack Pragmatic Application: A Systematic Review

OBJECTIVE

To systematically review the orientation of trials analyzing exercise for low back pain (LBP) on the efficacy-effectiveness spectrum.

DATA SOURCES

PubMed, Cumulative Index to Nursing and Allied Health Literature (CINAHL), and Ovid MEDLINE were searched for trials published between January 1, 2010, and August 13, 2022.

STUDY SELECTION

Randomized controlled trials investigating exercise for adults with LBP.

DATA EXTRACTION

Two reviewers independently used the Rating of Included Trials on the Efficacy-Effectiveness Spectrum (RITES) tool to determine the efficacy-effectiveness orientation. The same 2 reviewers assessed the risk of bias for all studies using the Cochrane Collaboration risk of bias 2.0 tool.

DATA SYNTHESIS

The search identified 2975 records. Full-text review was conducted on 674 studies, and 159 studies were included. The proportion of trials with a strong or rather strong efficacy orientation (RITES rating=1 or 2), balanced emphasis (RITES rating=3), or strong or rather strong effectiveness (RITES rating=4 or 5) orientation on the efficacy-effectiveness spectrum within each RITES domain were reported. A greater proportion of trials had an efficacy orientation when compared with effectiveness or a balanced emphasis within 4 domains: participant characteristics: efficacy 43.9%, 41.9% effectiveness, balanced 14.5%; trial setting: 69.0% efficacy, effectiveness 15.8% balanced 15.2%; flexibility of interventions: 74.2% efficacy, effectiveness 8.8%, balanced 17.0%; clinical relevance of experimental and comparison interventions: 50.3% efficacy, 33.3% effectiveness 33.3%, balanced 16.4%. A high risk of bias was found in 42.1% (n=67) of trials.

CONCLUSION

Trials investigating the effect of exercise for LBP have a greater orientation toward efficacy across multiple trial design domains. Researchers should consider pragmatic designs in future trials to improve generalizability. Clinicians should consider the efficacy-effectiveness orientation when translating evidence into clinical practice.

Pragmatism in manual therapy trials for knee osteoarthritis: a systematic review

Introduction

Manual therapy is an often-utilized intervention for the management of knee osteoarthritis (OA). The interpretation of results presented by these trials can be affected by how well the study designs align applicability to real-world clinical settings.

Aim

To examine the existing body of clinical trials investigating manual therapy for knee OA to determine where they fall on the efficacy-effectiveness spectrum.

Methods

This systematic review has been guided and informed by the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) guidelines. Randomized controlled trials that investigated manual therapy treatments for adults with knee OA were retrieved via searches of multiple databases to identify trials published prior to April 2023. The Rating of Included Trials on the Efficacy-Effectiveness Spectrum (RITES) tool was used to objectively rate the efficacy-effectiveness nature of each trial design. The Cochrane Risk of Bias 2.0 assessment tool (RoB-2) was used to assess the risk of bias across five domains.

Results

Of the 36 trials, a higher percentage of trials had a greater emphasis on efficacy within all four domains: participant characteristics (75.0%), trial setting (77.8%), flexibility of intervention (58.3%), and clinical relevance of experimental and comparison intervention (47.2%). In addition, 13.9% of the trials had low risk of bias, 41.7% had high risk of bias, and 44.4% had some concerns regarding bias.

Conclusions

While many trials support manual therapy as effective for the management of knee OA, a greater focus on study designs with an emphasis on effectiveness would improve the applicability and generalizability of future trials.

Biofield Therapies: Guidelines for Reporting Clinical Trials

A set of guidelines has been developed to help improve reporting of clinical trials of biofield therapies. The need for enhanced transparency when reporting trials of this family of integrative health practices, eg, External Qigong, Healing Touch, Reiki and Therapeutic Touch, has been advocated in systematic reviews of these studies. The guidelines, called Biofield Therapies: Reporting Evidence Guidelines (BiFi REGs), supplement CONsolidated Standards of Reporting Trials (CONSORT) 2010 by including details of the intervention protocols relevant to biofield therapy trials. BiFi REGs evolved through a draft document created by a core group, two rounds of a Delphi process with an international group of subject matter experts and two panels, meeting via Zoom, which included editors of complementary and integrative medicine journals. BiFi REGs comprises a 15-item Intervention checklist. Modifications of two other CONSORT topic areas are also proposed to enhance their relevance to trials of biofield therapies. Included for each item are an explanation, and exemplars of reporting from peer-reviewed published reports of biofield therapy trials. When used in conjunction with all other items from CONSORT 2010, we anticipate that BiFi REGs will expedite the peer review process for biofield therapy trials, facilitate attempts at trial replication and help to inform decision-making in the clinical practice of biofield therapies.

Overcoming challenges in conducting systematic reviews in implementation science: a methods commentary

Consolidation of the literature using systematic reviews is a critical way to advance a discipline and support evidence-based decision-making in healthcare. However, unique challenges exist that impact the conduct of systematic reviews in implementation science. In this commentary, we reflect on our combined experience to describe five key challenges unique to systematic reviews of primary implementation research. These challenges include (1) descriptors used in implementation science publications, (2) distinction between evidence-based interventions and implementation strategies, (3) assessment of external validity, (4) synthesis of implementation studies with substantial clinical and methodological diversity, and (5) variability in defining implementation 'success'. We outline possible solutions and highlight resources that can be used by authors of primary implementation research, as well as systematic review and editorial teams, to overcome the identified challenges and optimise the utility of future systematic reviews in implementation science.

Technology-Assisted Cognitive Motor Dual-Task Rehabilitation in Chronic Age-Related Conditions: Systematic Review

BACKGROUND

Cognitive-motor dual-task (CMDT) is defined as the parallel processing of motor (eg, gait) and cognitive (eg, executive functions) activities and is an essential ability in daily life. Older adults living with frailty, chronic conditions (eg, neurodegenerative diseases), or multimorbidity pay high costs during CMDT. This can have serious consequences on the health and safety of older adults with chronic age-related conditions. However, CMDT rehabilitation can provide useful and effective therapies for these patients, particularly if delivered through technological devices.

OBJECTIVE

This review aims to describe the current technological applications, CMDT rehabilitative procedures, target populations, condition assessment, and efficacy and effectiveness of technology-assisted CMDT rehabilitation in chronic age-related conditions.

METHODS

We performed this systematic review, following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, on 3 databases (Web of Science, Embase, and PubMed). Original articles that were published in English; involved older adults (>65 years) with ≥1 chronic condition and/or frailty; and tested, with a clinical trial, a technology-assisted CMDT rehabilitation against a control condition were included. Risk of bias (Cochrane tool) and the RITES (Rating of Included Trials on the Efficacy-Effectiveness Spectrum) tool were used to evaluate the included studies.

RESULTS

A total of 1097 papers were screened, and 8 (0.73%) studies met the predefined inclusion criteria for this review. The target conditions for technology-assisted CMDT rehabilitation included Parkinson disease and dementia. However, little information regarding multimorbidity, chronicity, or frailty status is available. The primary outcomes included falls, balance, gait parameters, dual-task performance, and executive functions and attention. CMDT technology mainly consists of a motion-tracking system combined with virtual reality. CMDT rehabilitation involves different types of tasks (eg, obstacle negotiation and CMDT exercises). Compared with control conditions, CMDT training was found to be pleasant, safe, and effective particularly for dual-task performances, falls, gait, and cognition, and the effects were maintained at midterm follow-up.

CONCLUSIONS

Despite further research being mandatory, technology-assisted CMDT rehabilitation is a promising method to enhance motor-cognitive functions in older adults with chronic conditions.

Generalizability of randomized controlled trials in primary health care: Applying the PRECIS-2 tool on published protocols

RATIONALE

Pragmatic design may facilitate the generalizability of effectiveness of randomized controlled trials (RCTs) in primary health care (PHC).

AIMS AND OBJECTIVES

The aim of this study was to investigate whether published protocols in PHC were designed pragmatically and to explore whether specific trial characteristics may be related to a pragmatic design.

METHODS

Using the Pragmatic Explanatory Continuum Indicator Summary-2 (PRECIS-2), we assessed pragmatism for 123 published RCT protocols. For each domain, we calculated the mean score with the 95% confidence interval (95% CI). Interrater reliability was assessed by weighted κ-coefficient with 95% CI. We examined potential associations of published protocol characteristics with overall pragmatism by performing univariate and multivariate analyses.

RESULTS

We observed the highest score for primary analysis (4.66, 95% CI: 4.51, 4.82). The eligibility score was intermediate (3.16, 95% CI: 3.01, 3.32). Domains with scores towards the explanatory side included organization (2.50, 95% CI: 2.36, 2.63), flexibility of delivery (2.74, 95% CI: 2.60, 2.88) and flexibility of adherence (3.00, 95% CI: 2.83, 3.17). Interrater agreement was good (κ = 0.61; 95% CI: 0.34, 0.80; p < 0.001). Higher sample sizes were correlated to a pragmatic design (odds ratio: 6.86, 95% CI: 1.64, 28.75; p = 0.04).

CONCLUSION

Most RCT protocols were rated as intermediate in the pragmatic-explanatory continuum. Future research may guide all stakeholders on how best to incorporate the level of pragmatism in the interpretation of the results so that the trials are more likely to be applicable in real-world settings.

Smartphone-RCCT: an online repository of randomized controlled clinical trials of smartphone applications for chronic conditions

BACKGROUND

Chronic health conditions have a big impact on disability, morbidity, and mortality worldwide. Smartphone health applications (apps) can improve the health of patients with chronic conditions and enhance the quality and efficiency of healthcare. The number of randomized controlled trials (RCTs) of smartphone health apps is increasing, but a collection of the available evidence into a single database is still missing. The purpose of this study is to describe Smartphone-RCCT, which is an in-progress database of RCTs of smartphone apps for chronic conditions.

METHODS

For a study to be included in the database, the following criteria had to be met: (a) RCT published in a peer-reviewed journal; (b) population: adult study participants with one or several chronic conditions that represent the main health problem addressed by the study intervention; (c) intervention: smartphone health app used by the patient; (d) comparator: any control condition; (e) outcomes: any patient-reported health outcome (studies exclusively measuring the patients' knowledge about the chronic conditions or their satisfaction with the smartphone app were excluded); (f) sample size: at least 15 participants per study arm. We searched in electronic databases and other resources to identify relevant studies. Two reviewers selected the studies and extracted data independently. Annual updates are planned.

RESULTS

The proposed database is called Smartphone-RCCT, an open-access repository collecting bibliographic references and important characteristics of RCTs of smartphone apps for chronic conditions. The database is available for free in Open Science Framework (OSF): https://osf.io/nxerf/ . To date, it includes 70 trials. Their references can be exported to standard reference management software and the extracted data is available in a Microsoft Excel file.

CONCLUSIONS

Smartphone-RCCT is the first systematic open-access database collecting peer-reviewed publications of RCTs of smartphone apps for patients with chronic conditions. The database accelerates the delivery of evidence-based information in a dynamic research field. It represents an essential resource for different stakeholders, such as professionals working in evidence synthesis, meta-epidemiological studies, or planning an RCT.

Over Half of Clinical Trials of Mobilization and Manipulation for Patients With Low Back Pain May Have Limited Real-World Applicability: A Systematic Review of 132 Clinical Trials

OBJECTIVE

To evaluate the existing body of trials assessing manual therapy for low back pain (LBP) to determine where it falls on the efficacyeffectiveness continuum.

DESIGN

Methodology systematic review.

LITERATURE SEARCH

PubMed, CINAHL (Cumulative Index to Nursing and Allied Health Literature), CENTRAL (Cochrane Central Register of Controlled Trials), and PEDro (Physiotherapy Evidence Database) were searched for trials published between January 1, 2000, and April 30, 2021.

STUDY SELECTION CRITERIA

We included randomized clinical trials investigating joint mobilization and manipulation for adults with nonspecific LBP that were available in English.

DATA SYNTHESIS

We used the Rating of Included Trials on the Efficacy-Effectiveness Spectrum (RITES) tool to score included trials across 4 domains: participant characteristics, trial setting, flexibility of intervention(s), and clinical relevance of experimental and comparison intervention(s). Proportions of trials with greater emphasis on efficacy or effectiveness were calculated for each domain.

RESULTS

Of the 132 included trials, a greater proportion emphasized efficacy than effectiveness for domains participant characteristics (50% vs 38%), trial setting (71% vs 20%), and flexibility of intervention(s) (61% vs 25%). The domain clinical relevance of experimental and comparison intervention(s) had lower emphasis on efficacy (41% vs 50%).

CONCLUSION

Most trials investigating manual therapy for LBP lack pragmatism across the RITES domains (ie, they emphasize efficacy). To improve real-world implementation, more research emphasizing effectiveness is needed. This could be accomplished by recruiting from more diverse participant pools, involving multiple centers that reflect common clinical practice settings, involving clinicians with a variety of backgrounds/experience, and allowing flexibility in how interventions are delivered. J Orthop Sports Phys Ther 2022;52(8):532-545. Epub: 19 June 2022. doi:10.2519/jospt.2022.10962.

Identification of tools used to assess the external validity of randomized controlled trials in reviews: a systematic review of measurement properties

Background

Internal and external validity are the most relevant components when critically appraising randomized controlled trials (RCTs) for systematic reviews. However, there is no gold standard to assess external validity. This might be related to the heterogeneity of the terminology as well as to unclear evidence of the measurement properties of available tools. The aim of this review was to identify tools to assess the external validity of RCTs. It was further, to evaluate the quality of identified tools and to recommend the use of individual tools to assess the external validity of RCTs in future systematic reviews.

Methods

A two-phase systematic literature search was performed in four databases: PubMed, Scopus, PsycINFO via OVID, and CINAHL via EBSCO. First, tools to assess the external validity of RCTs were identified. Second, studies investigating the measurement properties of these tools were selected. The measurement properties of each included tool were appraised using an adapted version of the COnsensus based Standards for the selection of health Measurement INstruments (COSMIN) guidelines.

Results

38 publications reporting on the development or validation of 28 included tools were included. For 61% (17/28) of the included tools, there was no evidence for measurement properties. For the remaining tools, reliability was the most frequently assessed property. Reliability was judged as “sufficient” for three tools (very low certainty of evidence). Content validity was rated as “sufficient” for one tool (moderate certainty of evidence).

Conclusions

Based on these results, no available tool can be fully recommended to assess the external validity of RCTs in systematic reviews. Several steps are required to overcome the identified difficulties to either adapt and validate available tools or to develop a better suitable tool.

Trial registration

Prospective registration at Open Science Framework (OSF): 10.17605/OSF.IO/PTG4D.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12874-022-01561-5.

Effect of obesity treatment interventions in preschool children aged 2-6 years: a systematic review and meta-analysis

OBJECTIVES

(1) To summarise the literature on the impact of paediatric weight management interventions on health outcomes in preschool age children with overweight or obesity and (2) to evaluate the completeness of intervention description and real-world applicability using validated tools.

DESIGN

Systematic review and meta-analysis.

DATA SOURCES

MEDLINE, Embase, CINAHL, Cochrane Library and PsychInfo were searched between 10 March 2015 and 21 November 2021.

ELIGIBILITY CRITERIA

Randomised controlled trials addressing weight management in preschool children (2-6 years) with overweight or obesity.

DATA EXTRACTION AND SYNTHESIS

Two reviewers independently extracted key information from each study and assessed risk of bias. Random-effects meta-analysis was performed where there was evidence for homogeneous effects. The certainty of evidence was assessed by the Grading of Recommendations Assessment, Development and Evaluation.

RESULTS

Of the 16 908 studies retrieved, 9 trials (1687 participants) met the inclusion criteria. These interventions used motivational interviewing (MI) or multicomponent educational interventions related to health behaviour approaches and were 6-12 months in duration. All studies contained some risk of bias. A difference was found in the intervention groups compared with controls for body mass index (BMI) z score (mean difference -0.10, 95% CI -0.12 to -0.09; eight trials, 1491 participants; p<0.001; I² 68%), though there was substantial heterogeneity. There were no subgroup effects between studies using MI compared with studies using multicomponent interventions. The certainty of the evidence was considered low. The trials were reported in sufficient detail and were considered pragmatic.

CONCLUSIONS

Paediatric weight management interventions delivered to the parents of young children with obesity result in small declines in BMI z score. The results should be interpreted cautiously as they were inconsistent and the quality of the evidence was low.

PROSPERO REGISTRATION NUMBER

CRD42020166843.

Meta-analysis of Pragmatic and Explanatory Trials

Pooling studies with different clinical and methodological features may lead to statistical heterogeneity, particularly if heterogeneity remains unexplained. One potential source of heterogeneity may be how much the included trials tend toward a pragmatic or explanatory design. Many tools have been developed to aid researchers in quantifying pragmatism in clinical trials, at both the design and appraisal stages.In this chapter we review these tools, illustrate examples of their use, and discuss methods of including pragmatism in meta-analysis as a way of exploring heterogeneity.We suggest a stepwise approach to incorporating evidence from pragmatic and explanatory trials which includes planning to assess pragmatism at the protocol stage, collecting data on pragmatism, extracting data on treatment effects, incorporating pragmatism in meta-analysis using subgroup analysis or meta-regression techniques, and interpreting and reporting the findings transparently.

Evidence on Technology-Based Psychological Interventions in Diagnosed Depression: Systematic Review

BACKGROUND

Evidence on technology-based psychological interventions (TBIs) for the treatment of depression is rapidly growing and covers a broad scope of research. Despite extensive research in this field, guideline recommendations are still limited to the general effectiveness of TBIs.

OBJECTIVE

This study aims to structure evidence on TBIs by considering different application areas (eg, TBIs for acute treatment and their implementation in health care, such as stand-alone interventions) and treatment characteristics (eg, therapeutic rationale of TBIs) to provide a comprehensive evidence base and to identify research gaps in TBIs for diagnosed depression. Moreover, the reporting of negative events in the included studies is investigated in this review to enable subsequent safety assessment of the TBIs.

METHODS

Randomized controlled trials on adults diagnosed with unipolar depression receiving any kind of psychotherapeutic treatment, which was at least partly delivered by a technical medium, were eligible for inclusion in our preregistered systematic review. We searched for trials in CENTRAL (Cochrane Central Register of Controlled Trials; until August 2020), MEDLINE, PsycINFO, PSYNDEX, CINAHL; until the end of January 2018), clinical trial registers, and sources of gray literature (until the end of January 2019). Study selection and data extraction were conducted by 2 review authors independently.

RESULTS

Database searches resulted in 15,546 records, of which 241 publications were included, representing 83 completed studies and 60 studies awaiting classification (ie, preregistered studies, study protocols). Almost all completed studies (78/83, 94%) addressed the acute treatment phase, being largely either implemented as stand-alone interventions (66/83, 80%) or blended treatment approaches (12/83, 14%). Studies on TBIs for aftercare (4/83, 5%) and for bridging waiting periods (1/83, 1%) were scarce. Most TBI study arms (n=107) were guided (59/107, 55.1%), delivered via the internet (80/107, 74.8%), and based on cognitive behavioral treatment approaches (88/107, 79.4%). Almost all studies (77/83, 93%) reported information on negative events, considering dropouts from treatment as a negative event. However, reports on negative events were heterogeneous and largely unsystematic.

CONCLUSIONS

Research has given little attention to studies evaluating TBIs for aftercare and for bridging waiting periods in people with depression, even though TBIs are seen as highly promising in these application areas; thus, high quality studies are urgently needed. In addition, the variety of therapeutic rationales on TBIs has barely been represented by identified studies hindering the consideration of patient preferences when planning treatment. Finally, future studies should use specific guidelines to systematically assess and report negative events.

TRIAL REGISTRATION

International Prospective Register of Systematic Reviews (PROSPERO) CRD42016050413; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42016050413.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1136/bmjopen-2018-028042.

Better, Virtually: the Past, Present, and Future of Virtual Reality Cognitive Behavior Therapy

Virtual reality (VR) is an immersive technology capable of creating a powerful, perceptual illusion of being present in a virtual environment. VR technology has been used in cognitive behavior therapy since the 1990s and accumulated an impressive evidence base, yet with the recent release of consumer VR platforms came a true paradigm shift in the capabilities and scalability of VR for mental health. This narrative review summarizes the past, present, and future of the field, including milestone studies and discussions on the clinical potential of alternative embodiment, gamification, avatar therapists, virtual gatherings, immersive storytelling, and more. Although the future is hard to predict, clinical VR has and will continue to be inherently intertwined with what are now rapid developments in technology, presenting both challenges and exciting opportunities to do what is not possible in the real world.

Effectiveness and safety of acupuncture and moxibustion for defecation dysfunction after sphincter-preserving surgery for rectal cancer: protocol for systematic review and meta-analysis

INTRODUCTION

Defecation dysfunction (DD) is one of the most common complications following sphincter-preserving surgery for rectal cancer. And there is no effective treatment of DD after sphincter-preserving surgery for rectal cancer. Although some studies suggested that acupuncture and moxibustion (AM) is effective and safe for DD after sphincter-preserving surgery for rectal cancer, lacking strong evidence, for instance, the relevant systematic review, meta-analysis and randomised controlled trial (RCT) of a large, multicentre sample, makes the effects and safety remain uncertain. The present protocol is described for a systematic review and meta-analysis to investigate the effectiveness and safety of AM for DD after sphincter-preserving surgery for rectal cancer.

METHODS AND ANALYSIS

We will search nine online databases from inception to 1 October 2019; the language of included trials will not be restricted. This study will include RCTs that performed AM as the main method of the experimental group for patients with DD after sphincter-preserving surgery for rectal cancer. Two of the researchers will independently select the studies, conduct risk of bias assessment and extract the data. We will use the fixed-effects model or random-effects model of RevMan V.5.2 software to analyse data synthesis. The risk ratios with 95% CIs and weighted mean differences or standardised mean differences with 95% CIs will be used to present the data synthesis outcome of dichotomous data respectively and the continuous data. Evidence quality of outcome will be assessed by using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system.

ETHICS AND DISSEMINATION

Ethical approval is not required in this secondary research evidence, and we will publish the results of this study in a journal or concerned conferences.

TRIAL REGISTRATION NUMBER

CRD42019140097.

International ResearchKit App for Women with Menstrual Pain: Development, Access, and Engagement

BACKGROUND

Primary dysmenorrhea is a common condition in women of reproductive age. A previous app-based study undertaken by our group demonstrated that a smartphone app supporting self-acupressure introduced by a health care professional can reduce menstrual pain.

OBJECTIVE

This study aims to evaluate whether a specific smartphone app is effective in reducing menstrual pain in 18- to 34-year-old women with primary dysmenorrhea in a self-care setting. One group of women has access to the full-featured study app and will be compared with 2 control groups who have access to fewer app features. Here, we report the trial design, app development, user access, and engagement.

METHODS

On the basis of the practical implications of the previous app-based study, we revised and reengineered the study app and included the ResearchKit (Apple Inc) framework. Behavior change techniques (BCTs) were implemented in the app and validated by expert ratings. User access was estimated by assessing recruitment progress over time. User evolution and baseline survey respondent rate were assessed to evaluate user engagement.

RESULTS

The development of the study app for a 3-armed randomized controlled trial required a multidisciplinary team. The app is accessible for the target population free of charge via the Apple App Store. In Germany, within 9 months, the app was downloaded 1458 times and 328 study participants were recruited using it without external advertising. A total of 98.27% (5157/5248) of the app-based baseline questions were answered. The correct classification of BCTs used in the app required psychological expertise.

CONCLUSIONS

Conducting an innovative app study requires multidisciplinary effort. Easy access and engagement with such an app can be achieved by recruitment via the App Store. Future research is needed to investigate the determinants of user engagement, optimal BCT application, and potential clinical and self-care scenarios for app use.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03432611; https://clinicaltrials.gov/ct2/show/NCT03432611 (Archived by WebCite at http://www.webcitation.org/75LLAcnCQ).

The Effect of Brief Interventions for Alcohol Among People with Comorbid Mental Health Conditions: A Systematic Review of Randomized Trials and Narrative Synthesis

Aims

To review the evidence on the effect of brief interventions (BIs) for alcohol among adults with risky alcohol consumption and comorbid mental health conditions.

Methods

A systematic review of randomized controlled trials (RCTs) published before May 2016 was undertaken and reported according to PRISMA guidelines. The findings were combined in a narrative synthesis. The risk of bias was assessed for included trials.

Results

Seventeen RCTs were included in the review and narrative synthesis: 11 in common mental health problems, and 6 in severe mental illness. There was considerable heterogeneity in study populations, BI delivery mode and intensity, outcome measures and risk of bias. Where BI was compared with a minimally active control, BI was associated with a significant reduction in alcohol consumption in four out of nine RCTs in common mental disorders and two out of five RCTs in severe mental illness. Where BI was compared with active comparator groups (such as motivational interviewing or cognitive behavioural therapy), findings were also mixed. Differences in the findings may be partly due to differences in study design, such as the intensity of BI and possibly the risk of bias.

Conclusions

Overall, the evidence is mixed regarding the effects of alcohol BI in participants with comorbid mental health conditions. Future well-designed research is required to answer this question more definitively.

Strategies to improve adherence to antiretroviral therapy and retention in care for people living with HIV in high-income countries: a protocol for an overview of systematic reviews

INTRODUCTION

While access to antiretroviral therapy (ART) for people living with HIV has expanded in recent years, additional efforts are required to support adherence to medication and retention in care. Interventions should be applicable in real-world settings and amenable to widespread use. The objectives of this overview are to identify effective pragmatic interventions that increase adherence to ART and retention in care for people living with HIV at high risk for suboptimal adherence and retention in high-income countries.

METHODS AND ANALYSIS

We will conduct an overview of systematic reviews of studies on interventions which target improved adherence to medication and retention in care among high-risk people living with HIV in high-income countries (men who have sex with men, African, Caribbean and black people, sex workers, people who inject drugs, indigenous people and other socially marginalised groups). We will search the following databases: PubMed, EMBASE (Exerpta Medica Database), CINAHL (Cumulative Index to Nursing and Allied Health Literature), PsycINFO, Web of Science and the Cochrane Library. We will conduct screening, data extraction and assessment of methodological quality of the systematic reviews. Analysis will be narrative. Our findings will be interpreted in light of the certainty of the evidence, level of pragmatism, setting and population of interest.

ETHICS AND DISSEMINATION

Only published secondary data will be used in this study, and therefore ethics approval is not required. Our findings will be disseminated as peer-reviewed manuscripts, conference abstracts and through community activities. The findings from this overview will inform a mixed-methods study among people living with HIV and health workers in Ontario, Canada.

Brief Interventions in Primary Care: an Evidence Overview of Practitioner and Digital Intervention Programmes

PURPOSE OF THE REVIEW

Excessive drinking is a major public health problem that adversely affects all parts of the population. Previous systematic reviews and meta-analyses have reported that brief interventions delivered in primary care are effective at reducing alcohol consumption, albeit with small effect sizes that have decreased over time. This review summarises the updated evidence base on practitioner and digitally delivered brief interventions.

RECENT FINDINGS

Using Cochrane methodology, 69 primary care brief intervention trials (33,642 participants) and 57 digital intervention trials (34,390 participants) were identified. Meta-analyses showed both approaches significantly reduced consumption compared to controls. Five trials (390 participants) compared practitioner-delivered and digital interventions directly with no evidence of difference in outcomes at follow-up.

SUMMARY

Brief interventions have the potential to impact at both individual and population levels. Future research should focus on optimising components and delivery mechanisms, and on alcohol-related harms. Digital interventions may overcome some of the implementation barriers faced by practitioner-delivered interventions.

Acupuncture for stable angina pectoris: a systematic review protocol

INTRODUCTION

Previous reviews indicate that the effect of acupuncture on stable angina pectoris (SAP) remains controversial. The results of trials published in the past 5 years may possibly change this situation, but an updated systematic review is not available. We therefore designed this study to systematically assess the efficacy and safety of acupuncture for treating SAP.

METHODS AND ANALYSIS

Nine online databases will be searched without language or publication status restrictions from their inception to September 2017. Randomised controlled trials that include patients with stable angina receiving acupuncture therapy versus a control group will be deemed eligible. The selection of studies, data extraction and risk of bias assessment will be carried out by two independent reviewers. Data synthesis will be performed using RevMan V.5.3 software with either a fixed effects model or random effects model, depending on the heterogeneity test. Evidence quality will be evaluated using the Grading of Recommendations Assessment, Development and Evaluation system. The efficacy-effectiveness spectrum for each included trial will be rated using the Rating of Included Trials on the Efficacy-effectiveness Spectrum tool. Outcomes of interest include the improvement of weekly angina attacks and reduction of nitroglycerin medication use after receiving acupuncture treatment, the incidence of cardiovascular events, heart rate variability, pain intensity measured on a visual analogue scale, total workload and exercise duration at peak exercise, safety and adverse events. A meta-analysis will be conducted if no considerable heterogeneity is detected. The results will be presented as risk ratios with 95% CIs for dichotomous data and weighted mean differences or standardised mean differences with 95% CIs for continuous data.

ETHICS AND DISSEMINATION

This systematic review will not involve private information from individuals or endanger their rights, and therefore does not necessarily require ethical approval. The results may be published in a peer-reviewed journal or disseminated in relevant conferences.

TRIAL REGISTRATION NUMBER

CRD42015016201.

Effectiveness of brief alcohol interventions in primary care populations

BACKGROUND

Excessive drinking is a significant cause of mortality, morbidity and social problems in many countries. Brief interventions aim to reduce alcohol consumption and related harm in hazardous and harmful drinkers who are not actively seeking help for alcohol problems. Interventions usually take the form of a conversation with a primary care provider and may include feedback on the person's alcohol use, information about potential harms and benefits of reducing intake, and advice on how to reduce consumption. Discussion informs the development of a personal plan to help reduce consumption. Brief interventions can also include behaviour change or motivationally-focused counselling.This is an update of a Cochrane Review published in 2007.

OBJECTIVES

To assess the effectiveness of screening and brief alcohol intervention to reduce excessive alcohol consumption in hazardous or harmful drinkers in general practice or emergency care settings.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, and 12 other bibliographic databases to September 2017. We searched Alcohol and Alcohol Problems Science Database (to December 2003, after which the database was discontinued), trials registries, and websites. We carried out handsearching and checked reference lists of included studies and relevant reviews.

SELECTION CRITERIA

We included randomised controlled trials (RCTs) of brief interventions to reduce hazardous or harmful alcohol consumption in people attending general practice, emergency care or other primary care settings for reasons other than alcohol treatment. The comparison group was no or minimal intervention, where a measure of alcohol consumption was reported. 'Brief intervention' was defined as a conversation comprising five or fewer sessions of brief advice or brief lifestyle counselling and a total duration of less than 60 minutes. Any more was considered an extended intervention. Digital interventions were not included in this review.

DATA COLLECTION AND ANALYSIS

We used standard methodological procedures expected by Cochrane. We carried out subgroup analyses where possible to investigate the impact of factors such as gender, age, setting (general practice versus emergency care), treatment exposure and baseline consumption.

MAIN RESULTS

We included 69 studies that randomised a total of 33,642 participants. Of these, 42 studies were added for this update (24,057 participants). Most interventions were delivered in general practice (38 studies, 55%) or emergency care (27 studies, 39%) settings. Most studies (61 studies, 88%) compared brief intervention to minimal or no intervention. Extended interventions were compared with brief (4 studies, 6%), minimal or no intervention (7 studies, 10%). Few studies targeted particular age groups: adolescents or young adults (6 studies, 9%) and older adults (4 studies, 6%). Mean baseline alcohol consumption was 244 g/week (30.5 standard UK units) among the studies that reported these data. Main sources of bias were attrition and lack of provider or participant blinding. The primary meta-analysis included 34 studies (15,197 participants) and provided moderate-quality evidence that participants who received brief intervention consumed less alcohol than minimal or no intervention participants after one year (mean difference (MD) -20 g/week, 95% confidence interval (CI) -28 to -12). There was substantial heterogeneity among studies (I² = 73%). A subgroup analysis by gender demonstrated that both men and women reduced alcohol consumption after receiving a brief intervention.We found moderate-quality evidence that brief alcohol interventions have little impact on frequency of binges per week (MD -0.08, 95% CI -0.14 to -0.02; 15 studies, 6946 participants); drinking days per week (MD -0.13, 95% CI -0.23 to -0.04; 11 studies, 5469 participants); or drinking intensity (-0.2 g/drinking day, 95% CI -3.1 to 2.7; 10 studies, 3128 participants).We found moderate-quality evidence of little difference in quantity of alcohol consumed when extended and no or minimal interventions were compared (-14 g/week, 95% CI -37 to 9; 6 studies, 1296 participants). There was little difference in binges per week (-0.08, 95% CI -0.28 to 0.12; 2 studies, 456 participants; moderate-quality evidence) or difference in days drinking per week (-0.45, 95% CI -0.81 to -0.09; 2 studies, 319 participants; moderate-quality evidence). Extended versus no or minimal intervention provided little impact on drinking intensity (9 g/drinking day, 95% CI -26 to 9; 1 study, 158 participants; low-quality evidence).Extended intervention had no greater impact than brief intervention on alcohol consumption, although findings were imprecise (MD 2 g/week, 95% CI -42 to 45; 3 studies, 552 participants; low-quality evidence). Numbers of binges were not reported for this comparison, but one trial suggested a possible drop in days drinking per week (-0.5, 95% CI -1.2 to 0.2; 147 participants; low-quality evidence). Results from this trial also suggested very little impact on drinking intensity (-1.7 g/drinking day, 95% CI -18.9 to 15.5; 147 participants; very low-quality evidence).Only five studies reported adverse effects (very low-quality evidence). No participants experienced any adverse effects in two studies; one study reported that the intervention increased binge drinking for women and two studies reported adverse events related to driving outcomes but concluded they were equivalent in both study arms.Sources of funding were reported by 67 studies (87%). With two exceptions, studies were funded by government institutes, research bodies or charitable foundations. One study was partly funded by a pharmaceutical company and a brewers association, another by a company developing diagnostic testing equipment.

AUTHORS' CONCLUSIONS

We found moderate-quality evidence that brief interventions can reduce alcohol consumption in hazardous and harmful drinkers compared to minimal or no intervention. Longer counselling duration probably has little additional effect. Future studies should focus on identifying the components of interventions which are most closely associated with effectiveness.